2024-09-13T22:54:02.526 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T22:54:02.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T22:54:02.645 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-13_21:40:02-rgw-squid-distro-default-smithi/7904378 branch: squid description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7904378' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-13_21:40:02-rgw-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 rgw: ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast s3tests: slow_backend: true selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 3476 sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 targets: smithi017.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMQg4+aPLRL3AjT/kPRJZw9+HI0iEjSRa8M/hDxJldiVXGk1i7y+tgUBWTPoZe2BS121w5esi6Cw/BkQcCzk20A= smithi164.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJdn7uu6BhtJRg1inz/emwrAlsUludb5JLwVSYeBB6ZguUCh4TBjlORSh+Y+nIO/Q4atE7wV7JSlFs/Lu+HIBT0= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_21:40:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T22:54:02.645 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa; will attempt to use it 2024-09-13T22:54:02.646 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks 2024-09-13T22:54:02.646 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T22:54:02.647 INFO:teuthology.task.internal:Checking packages... 2024-09-13T22:54:02.669 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ecab7be58963a5bd03910cd73eef66405d7fdd50' 2024-09-13T22:54:02.669 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T22:54:02.669 INFO:teuthology.packaging:ref: None 2024-09-13T22:54:02.669 INFO:teuthology.packaging:tag: None 2024-09-13T22:54:02.669 INFO:teuthology.packaging:branch: squid 2024-09-13T22:54:02.669 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:54:02.669 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-13T22:54:02.887 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-324.gecab7be5 2024-09-13T22:54:02.889 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T22:54:02.896 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T22:54:02.896 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T22:54:02.915 INFO:teuthology.task.internal:Saving configuration 2024-09-13T22:54:02.929 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T22:54:02.935 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T22:54:02.970 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_21:40:02-rgw-squid-distro-default-smithi/7904378', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 22:48:48.742501', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMQg4+aPLRL3AjT/kPRJZw9+HI0iEjSRa8M/hDxJldiVXGk1i7y+tgUBWTPoZe2BS121w5esi6Cw/BkQcCzk20A='} 2024-09-13T22:54:03.000 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_21:40:02-rgw-squid-distro-default-smithi/7904378', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 22:48:48.740739', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJdn7uu6BhtJRg1inz/emwrAlsUludb5JLwVSYeBB6ZguUCh4TBjlORSh+Y+nIO/Q4atE7wV7JSlFs/Lu+HIBT0='} 2024-09-13T22:54:03.001 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T22:54:03.011 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-13T22:54:03.011 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-13T22:54:03.011 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T22:54:03.087 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f47ca7cfac0>, signals=[15]) 2024-09-13T22:54:03.087 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T22:54:03.093 INFO:teuthology.task.internal:Opening connections... 2024-09-13T22:54:03.093 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi017.front.sepia.ceph.com 2024-09-13T22:54:03.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:54:03.198 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi164.front.sepia.ceph.com 2024-09-13T22:54:03.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:54:03.282 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T22:54:03.289 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2024-09-13T22:54:03.307 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2024-09-13T22:54:03.308 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2024-09-13T22:54:03.365 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2024-09-13T22:54:03.365 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9" 2024-09-13T22:54:03.365 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2024-09-13T22:54:03.365 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2024-09-13T22:54:03.366 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9" 2024-09-13T22:54:03.366 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9" 2024-09-13T22:54:03.366 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T22:54:03.366 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2024-09-13T22:54:03.366 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon" 2024-09-13T22:54:03.366 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T22:54:03.366 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2024-09-13T22:54:03.366 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T22:54:03.366 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T22:54:03.366 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T22:54:03.367 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2024-09-13T22:54:03.396 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2024-09-13T22:54:03.414 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2024-09-13T22:54:03.414 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2024-09-13T22:54:03.472 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream" 2024-09-13T22:54:03.472 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="9" 2024-09-13T22:54:03.472 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos" 2024-09-13T22:54:03.472 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora" 2024-09-13T22:54:03.472 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="9" 2024-09-13T22:54:03.472 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el9" 2024-09-13T22:54:03.472 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T22:54:03.472 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2024-09-13T22:54:03.472 INFO:teuthology.orchestra.run.smithi164.stdout:LOGO="fedora-logo-icon" 2024-09-13T22:54:03.473 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T22:54:03.473 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/" 2024-09-13T22:54:03.473 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T22:54:03.473 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T22:54:03.473 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T22:54:03.473 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2024-09-13T22:54:03.505 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T22:54:03.515 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T22:54:03.545 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T22:54:03.546 DEBUG:teuthology.orchestra.run.smithi017:> test '!' -e /home/ubuntu/cephtest 2024-09-13T22:54:03.548 DEBUG:teuthology.orchestra.run.smithi164:> test '!' -e /home/ubuntu/cephtest 2024-09-13T22:54:03.564 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T22:54:03.570 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T22:54:03.570 DEBUG:teuthology.orchestra.run.smithi017:> test -z $(ls -A /var/lib/ceph) 2024-09-13T22:54:03.606 DEBUG:teuthology.orchestra.run.smithi164:> test -z $(ls -A /var/lib/ceph) 2024-09-13T22:54:03.709 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T22:54:03.780 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T22:54:03.794 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T22:54:03.794 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T22:54:03.795 DEBUG:teuthology.orchestra.run.smithi017:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T22:54:03.795 DEBUG:teuthology.orchestra.run.smithi164:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T22:54:03.812 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T22:54:03.812 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-09-13T22:54:03.813 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T22:54:03.814 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-09-13T22:54:03.870 INFO:teuthology.orchestra.run.smithi164.stdout:5.14.0-503.el9.x86_64 2024-09-13T22:54:03.871 INFO:teuthology.task.kernel:Running kernel on smithi164: 5.14.0-503.el9.x86_64 2024-09-13T22:54:03.871 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum install -y kernel 2024-09-13T22:54:03.872 INFO:teuthology.orchestra.run.smithi017.stdout:5.14.0-503.el9.x86_64 2024-09-13T22:54:03.872 INFO:teuthology.task.kernel:Running kernel on smithi017: 5.14.0-503.el9.x86_64 2024-09-13T22:54:03.872 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum install -y kernel 2024-09-13T22:54:06.297 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-13T22:54:07.647 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.2 MB 00:02 2024-09-13T22:54:09.531 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-13T22:54:10.232 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - AppStream 7.4 MB/s | 20 MB 00:02 2024-09-13T22:54:14.323 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - CRB 6.5 MB/s | 6.5 MB 00:01 2024-09-13T22:54:14.757 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-13T22:54:15.674 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - Extras packages 118 kB/s | 19 kB 00:00 2024-09-13T22:54:16.157 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - Extras packages 115 kB/s | 19 kB 00:00 2024-09-13T22:54:16.586 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-13T22:54:17.120 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-13T22:54:22.000 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-13T22:54:22.810 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 22 kB/s | 1.7 kB 00:00 2024-09-13T22:54:23.974 INFO:teuthology.orchestra.run.smithi164.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T22:54:23.974 INFO:teuthology.orchestra.run.smithi164.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T22:54:24.070 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-13T22:54:24.078 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T22:54:24.078 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-09-13T22:54:24.078 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T22:54:24.078 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-13T22:54:24.078 INFO:teuthology.orchestra.run.smithi164.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T22:54:24.078 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-09-13T22:54:24.078 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T22:54:24.078 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T22:54:24.078 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T22:54:24.079 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T22:54:24.079 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-13T22:54:24.079 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T22:54:24.079 INFO:teuthology.orchestra.run.smithi164.stdout:Install 4 Packages 2024-09-13T22:54:24.079 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T22:54:24.079 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 79 M 2024-09-13T22:54:24.079 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 126 M 2024-09-13T22:54:24.080 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-13T22:54:24.627 INFO:teuthology.orchestra.run.smithi164.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 78 kB/s | 23 kB 00:00 2024-09-13T22:54:24.891 INFO:teuthology.orchestra.run.smithi017.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T22:54:24.891 INFO:teuthology.orchestra.run.smithi017.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T22:54:25.000 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-13T22:54:25.011 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T22:54:25.011 INFO:teuthology.orchestra.run.smithi017.stdout: Package Architecture Version Repository Size 2024-09-13T22:54:25.011 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T22:54:25.011 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-13T22:54:25.011 INFO:teuthology.orchestra.run.smithi017.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T22:54:25.011 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-13T22:54:25.011 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T22:54:25.011 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T22:54:25.011 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T22:54:25.011 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T22:54:25.011 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-13T22:54:25.011 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T22:54:25.012 INFO:teuthology.orchestra.run.smithi017.stdout:Install 4 Packages 2024-09-13T22:54:25.012 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T22:54:25.012 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 79 M 2024-09-13T22:54:25.012 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 126 M 2024-09-13T22:54:25.012 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-13T22:54:25.602 INFO:teuthology.orchestra.run.smithi017.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 40 kB/s | 23 kB 00:00 2024-09-13T22:54:26.877 INFO:teuthology.orchestra.run.smithi017.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 8.5 MB/s | 16 MB 00:01 2024-09-13T22:54:27.728 INFO:teuthology.orchestra.run.smithi017.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 13 MB/s | 35 MB 00:02 2024-09-13T22:54:28.544 INFO:teuthology.orchestra.run.smithi017.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 9.7 MB/s | 29 MB 00:02 2024-09-13T22:54:28.545 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:54:28.545 INFO:teuthology.orchestra.run.smithi017.stdout:Total 22 MB/s | 79 MB 00:03 2024-09-13T22:54:29.259 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-13T22:54:29.637 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-13T22:54:29.638 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-13T22:54:30.638 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-13T22:54:30.639 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-13T22:54:33.214 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-13T22:54:33.881 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T22:54:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T22:54:36.785 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T22:54:36.914 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T22:54:39.634 INFO:teuthology.orchestra.run.smithi164.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 1.9 MB/s | 29 MB 00:15 2024-09-13T22:54:39.792 INFO:teuthology.orchestra.run.smithi164.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 1.0 MB/s | 16 MB 00:15 2024-09-13T22:54:42.037 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T22:54:42.081 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:54:45.842 INFO:teuthology.orchestra.run.smithi164.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 1.6 MB/s | 35 MB 00:21 2024-09-13T22:54:45.842 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:54:45.842 INFO:teuthology.orchestra.run.smithi164.stdout:Total 3.6 MB/s | 79 MB 00:21 2024-09-13T22:54:46.527 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-13T22:54:46.902 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-13T22:54:46.902 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-13T22:54:47.229 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:54:47.846 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-13T22:54:47.847 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-13T22:54:50.319 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-13T22:54:51.228 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T22:54:51.317 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T22:54:54.111 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T22:54:54.253 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T22:54:59.119 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T22:54:59.229 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:55:04.099 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:55:26.541 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:55:26.581 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:55:26.908 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:55:26.908 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T22:55:26.908 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T22:55:26.909 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T22:55:27.788 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:55:27.789 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T22:55:27.789 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-13T22:55:27.789 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T22:55:27.789 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T22:55:27.789 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T22:55:27.789 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T22:55:27.789 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T22:55:27.789 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-13T22:55:28.149 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T22:55:28.224 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T22:55:28.224 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T22:55:28.224 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T22:55:28.224 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T22:55:28.224 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T22:55:28.225 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-13T22:55:28.225 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi017.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T22:55:28.225 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T22:55:28.283 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T22:55:28.283 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T22:55:28.284 DEBUG:teuthology.orchestra.run.smithi017:> sudo rpm -qi grub2-tools 2024-09-13T22:55:28.323 INFO:teuthology.orchestra.run.smithi017.stdout:Name : grub2-tools 2024-09-13T22:55:28.323 INFO:teuthology.orchestra.run.smithi017.stdout:Epoch : 1 2024-09-13T22:55:28.324 INFO:teuthology.orchestra.run.smithi017.stdout:Version : 2.06 2024-09-13T22:55:28.324 INFO:teuthology.orchestra.run.smithi017.stdout:Release : 82.el9 2024-09-13T22:55:28.324 INFO:teuthology.orchestra.run.smithi017.stdout:Architecture: x86_64 2024-09-13T22:55:28.324 INFO:teuthology.orchestra.run.smithi017.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T22:55:28.324 INFO:teuthology.orchestra.run.smithi017.stdout:Group : Unspecified 2024-09-13T22:55:28.324 INFO:teuthology.orchestra.run.smithi017.stdout:Size : 8274670 2024-09-13T22:55:28.324 INFO:teuthology.orchestra.run.smithi017.stdout:License : GPLv3+ 2024-09-13T22:55:28.324 INFO:teuthology.orchestra.run.smithi017.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T22:55:28.324 INFO:teuthology.orchestra.run.smithi017.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T22:55:28.324 INFO:teuthology.orchestra.run.smithi017.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T22:55:28.324 INFO:teuthology.orchestra.run.smithi017.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T22:55:28.324 INFO:teuthology.orchestra.run.smithi017.stdout:Packager : builder@centos.org 2024-09-13T22:55:28.324 INFO:teuthology.orchestra.run.smithi017.stdout:Vendor : CentOS 2024-09-13T22:55:28.325 INFO:teuthology.orchestra.run.smithi017.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T22:55:28.325 INFO:teuthology.orchestra.run.smithi017.stdout:Summary : Support tools for GRUB. 2024-09-13T22:55:28.325 INFO:teuthology.orchestra.run.smithi017.stdout:Description : 2024-09-13T22:55:28.325 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T22:55:28.325 INFO:teuthology.orchestra.run.smithi017.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T22:55:28.325 INFO:teuthology.orchestra.run.smithi017.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T22:55:28.325 INFO:teuthology.orchestra.run.smithi017.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T22:55:28.325 INFO:teuthology.orchestra.run.smithi017.stdout:hardware devices. 2024-09-13T22:55:28.325 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T22:55:28.325 INFO:teuthology.orchestra.run.smithi017.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T22:55:28.326 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T22:55:28.326 INFO:teuthology.task.kernel:Updating grub on smithi017 to boot 5.14.0-505.el9.x86_64 2024-09-13T22:55:28.326 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T22:55:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:Generating grub configuration file ... 2024-09-13T22:55:30.394 INFO:teuthology.orchestra.run.smithi017.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T22:55:30.409 INFO:teuthology.orchestra.run.smithi017.stderr:done 2024-09-13T22:55:30.411 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2024-09-13T22:55:30.426 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.kqDyhd7zcV 2024-09-13T22:55:30.426 DEBUG:teuthology.orchestra.run.smithi017:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.kqDyhd7zcV 2024-09-13T22:55:30.502 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.kqDyhd7zcV 2024-09-13T22:55:30.655 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.kqDyhd7zcV is 6KB 2024-09-13T22:55:30.704 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.kqDyhd7zcV 2024-09-13T22:55:30.718 DEBUG:teuthology.orchestra.run.smithi017:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T22:55:30.780 INFO:teuthology.orchestra.run.smithi017.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T22:55:30.780 INFO:teuthology.orchestra.run.smithi017.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T22:55:30.780 INFO:teuthology.orchestra.run.smithi017.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T22:55:30.780 INFO:teuthology.orchestra.run.smithi017.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T22:55:30.782 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T22:55:30.923 DEBUG:teuthology.orchestra.run.smithi017:> sudo shutdown -r now 2024-09-13T22:55:42.279 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:55:42.320 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:55:42.701 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:55:42.701 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T22:55:42.701 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T22:55:42.701 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T22:55:43.547 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:55:43.547 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T22:55:43.547 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-13T22:55:43.547 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T22:55:43.547 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T22:55:43.547 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T22:55:43.547 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T22:55:43.547 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T22:55:43.548 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-13T22:55:43.891 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T22:55:43.987 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T22:55:43.987 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T22:55:43.988 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T22:55:43.988 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T22:55:43.988 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T22:55:43.988 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-13T22:55:43.988 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi164.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T22:55:43.988 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T22:55:44.047 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T22:55:44.047 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T22:55:44.047 DEBUG:teuthology.orchestra.run.smithi164:> sudo rpm -qi grub2-tools 2024-09-13T22:55:44.080 INFO:teuthology.orchestra.run.smithi164.stdout:Name : grub2-tools 2024-09-13T22:55:44.080 INFO:teuthology.orchestra.run.smithi164.stdout:Epoch : 1 2024-09-13T22:55:44.080 INFO:teuthology.orchestra.run.smithi164.stdout:Version : 2.06 2024-09-13T22:55:44.080 INFO:teuthology.orchestra.run.smithi164.stdout:Release : 82.el9 2024-09-13T22:55:44.080 INFO:teuthology.orchestra.run.smithi164.stdout:Architecture: x86_64 2024-09-13T22:55:44.080 INFO:teuthology.orchestra.run.smithi164.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T22:55:44.080 INFO:teuthology.orchestra.run.smithi164.stdout:Group : Unspecified 2024-09-13T22:55:44.080 INFO:teuthology.orchestra.run.smithi164.stdout:Size : 8274670 2024-09-13T22:55:44.080 INFO:teuthology.orchestra.run.smithi164.stdout:License : GPLv3+ 2024-09-13T22:55:44.080 INFO:teuthology.orchestra.run.smithi164.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T22:55:44.080 INFO:teuthology.orchestra.run.smithi164.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T22:55:44.081 INFO:teuthology.orchestra.run.smithi164.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T22:55:44.081 INFO:teuthology.orchestra.run.smithi164.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T22:55:44.081 INFO:teuthology.orchestra.run.smithi164.stdout:Packager : builder@centos.org 2024-09-13T22:55:44.081 INFO:teuthology.orchestra.run.smithi164.stdout:Vendor : CentOS 2024-09-13T22:55:44.081 INFO:teuthology.orchestra.run.smithi164.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T22:55:44.081 INFO:teuthology.orchestra.run.smithi164.stdout:Summary : Support tools for GRUB. 2024-09-13T22:55:44.081 INFO:teuthology.orchestra.run.smithi164.stdout:Description : 2024-09-13T22:55:44.081 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T22:55:44.081 INFO:teuthology.orchestra.run.smithi164.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T22:55:44.081 INFO:teuthology.orchestra.run.smithi164.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T22:55:44.081 INFO:teuthology.orchestra.run.smithi164.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T22:55:44.081 INFO:teuthology.orchestra.run.smithi164.stdout:hardware devices. 2024-09-13T22:55:44.081 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T22:55:44.081 INFO:teuthology.orchestra.run.smithi164.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T22:55:44.082 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T22:55:44.082 INFO:teuthology.task.kernel:Updating grub on smithi164 to boot 5.14.0-505.el9.x86_64 2024-09-13T22:55:44.082 DEBUG:teuthology.orchestra.run.smithi164:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T22:55:44.750 INFO:teuthology.orchestra.run.smithi164.stderr:Generating grub configuration file ... 2024-09-13T22:55:46.078 INFO:teuthology.orchestra.run.smithi164.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T22:55:46.104 INFO:teuthology.orchestra.run.smithi164.stderr:done 2024-09-13T22:55:46.106 DEBUG:teuthology.orchestra.run.smithi164:> mktemp 2024-09-13T22:55:46.122 INFO:teuthology.orchestra.run.smithi164.stdout:/tmp/tmp.uvKX8gBuWX 2024-09-13T22:55:46.122 DEBUG:teuthology.orchestra.run.smithi164:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.uvKX8gBuWX 2024-09-13T22:55:46.188 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0666 /tmp/tmp.uvKX8gBuWX 2024-09-13T22:55:46.324 DEBUG:teuthology.orchestra.remote:smithi164:/tmp/tmp.uvKX8gBuWX is 6KB 2024-09-13T22:55:46.374 DEBUG:teuthology.orchestra.run.smithi164:> rm -fr /tmp/tmp.uvKX8gBuWX 2024-09-13T22:55:46.390 DEBUG:teuthology.orchestra.run.smithi164:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T22:55:46.455 INFO:teuthology.orchestra.run.smithi164.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T22:55:46.455 INFO:teuthology.orchestra.run.smithi164.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T22:55:46.455 INFO:teuthology.orchestra.run.smithi164.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T22:55:46.455 INFO:teuthology.orchestra.run.smithi164.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T22:55:46.456 DEBUG:teuthology.orchestra.run.smithi164:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T22:55:46.611 DEBUG:teuthology.orchestra.run.smithi164:> sudo shutdown -r now 2024-09-13T22:56:00.938 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-13T22:56:00.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-13T22:56:00.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:56:16.629 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-13T22:56:16.629 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-13T22:56:16.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:56:19.521 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-09-13T22:56:28.530 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-13T22:56:28.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:56:31.613 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-09-13T22:56:35.137 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-09-13T22:56:43.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-13T22:56:43.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:56:44.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-13T22:56:44.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:56:47.233 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-09-13T22:56:59.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-13T22:56:59.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:57:15.370 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-09-13T22:57:15.753 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-13T22:57:15.754 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-13T22:57:15.754 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-09-13T22:57:15.812 INFO:teuthology.orchestra.run.smithi017.stdout:5.14.0-505.el9.x86_64 2024-09-13T22:57:15.812 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T22:57:15.812 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T22:57:15.812 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T22:57:16.814 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-13T22:57:16.814 DEBUG:teuthology.orchestra.run.smithi017:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T22:57:16.933 INFO:teuthology.orchestra.run.smithi017.stdout:ttyS1 2024-09-13T22:57:16.958 DEBUG:teuthology.parallel:result is None 2024-09-13T22:57:59.257 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T22:58:14.259 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-13T22:58:14.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:58:14.652 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-09-13T22:58:15.010 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-13T22:58:15.010 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-505.el9.x86_64"... 2024-09-13T22:58:15.011 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-09-13T22:58:15.026 INFO:teuthology.orchestra.run.smithi164.stdout:5.14.0-505.el9.x86_64 2024-09-13T22:58:15.027 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T22:58:15.027 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T22:58:15.027 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T22:58:16.028 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-13T22:58:16.028 DEBUG:teuthology.orchestra.run.smithi164:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T22:58:16.105 INFO:teuthology.orchestra.run.smithi164.stdout:ttyS1 2024-09-13T22:58:16.132 DEBUG:teuthology.parallel:result is None 2024-09-13T22:58:16.132 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T22:58:16.143 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T22:58:16.143 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T22:58:16.146 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T22:58:16.164 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T22:58:16.173 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T22:58:16.183 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T22:58:16.183 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T22:58:16.205 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T22:58:16.238 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T22:58:16.246 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T22:58:16.246 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T22:58:16.270 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T22:58:16.306 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T22:58:16.311 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T22:58:16.318 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T22:58:16.322 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T22:58:16.324 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T22:58:16.331 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T22:58:16.331 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T22:58:16.363 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T22:58:16.392 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T22:58:16.403 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T22:58:16.403 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T22:58:16.433 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T22:58:16.451 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T22:58:16.560 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T22:58:16.594 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T22:58:16.687 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T22:58:16.720 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T22:58:16.721 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T22:58:16.787 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T22:58:16.842 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T22:58:16.890 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T22:58:16.980 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T22:58:17.018 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-13T22:58:17.018 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T22:58:17.085 DEBUG:teuthology.orchestra.run.smithi017:> sudo service rsyslog restart 2024-09-13T22:58:17.088 DEBUG:teuthology.orchestra.run.smithi164:> sudo service rsyslog restart 2024-09-13T22:58:17.143 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T22:58:17.165 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T22:58:17.588 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T22:58:17.596 INFO:teuthology.task.internal:Starting timer... 2024-09-13T22:58:17.596 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T22:58:17.611 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T22:58:17.623 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-13T22:58:17.623 DEBUG:teuthology.orchestra.run.smithi017:> sudo service auditd rotate 2024-09-13T22:58:17.676 INFO:teuthology.orchestra.run.smithi017.stdout:Rotating logs: 2024-09-13T22:58:17.678 DEBUG:teuthology.orchestra.run.smithi164:> sudo service auditd rotate 2024-09-13T22:58:17.717 INFO:teuthology.orchestra.run.smithi164.stdout:Rotating logs: 2024-09-13T22:58:17.719 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T22:58:17.719 DEBUG:teuthology.orchestra.run.smithi017:> /usr/sbin/getenforce 2024-09-13T22:58:17.752 INFO:teuthology.orchestra.run.smithi017.stdout:Permissive 2024-09-13T22:58:17.752 DEBUG:teuthology.orchestra.run.smithi164:> /usr/sbin/getenforce 2024-09-13T22:58:17.781 INFO:teuthology.orchestra.run.smithi164.stdout:Permissive 2024-09-13T22:58:17.782 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi017.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi164.front.sepia.ceph.com': 'permissive'} 2024-09-13T22:58:17.782 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T22:58:17.822 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T22:58:17.822 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T22:58:17.850 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T22:58:17.850 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T22:58:17.851 DEBUG:teuthology.orchestra.run.smithi017:> sudo /usr/sbin/setenforce permissive 2024-09-13T22:58:17.902 DEBUG:teuthology.orchestra.run.smithi164:> sudo /usr/sbin/setenforce permissive 2024-09-13T22:58:17.940 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T22:58:17.964 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T22:58:17.975 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T22:58:17.976 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi017.front.sepia.ceph.com,smithi164.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T23:02:04.483 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi017.front.sepia.ceph.com'), Remote(name='ubuntu@smithi164.front.sepia.ceph.com')] 2024-09-13T23:02:04.484 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-13T23:02:04.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T23:02:04.578 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-09-13T23:02:04.657 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-13T23:02:04.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-13T23:02:04.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T23:02:04.750 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-09-13T23:02:04.837 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-13T23:02:04.837 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T23:02:04.849 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T23:02:04.850 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T23:02:04.851 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T23:02:04.856 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T23:02:04.856 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T23:02:04.882 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T23:02:04.898 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T23:02:04.907 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T23:02:04.922 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T23:02:04.923 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: ntpd: command not found 2024-09-13T23:02:04.935 INFO:teuthology.orchestra.run.smithi017.stdout:506 Cannot talk to daemon 2024-09-13T23:02:04.947 INFO:teuthology.orchestra.run.smithi164.stderr:sudo: ntpd: command not found 2024-09-13T23:02:04.949 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T23:02:04.958 INFO:teuthology.orchestra.run.smithi164.stdout:506 Cannot talk to daemon 2024-09-13T23:02:04.964 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T23:02:04.972 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T23:02:04.986 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T23:02:05.029 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: ntpq: command not found 2024-09-13T23:02:05.033 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T23:02:05.033 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2024-09-13T23:02:05.033 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T23:02:05.033 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T23:02:05.033 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T23:02:05.033 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T23:02:05.046 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: ntpq: command not found 2024-09-13T23:02:05.049 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T23:02:05.050 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2024-09-13T23:02:05.050 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T23:02:05.050 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T23:02:05.050 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T23:02:05.050 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T23:02:05.051 INFO:teuthology.run_tasks:Running task install... 2024-09-13T23:02:05.067 DEBUG:teuthology.task.install:project ceph 2024-09-13T23:02:05.067 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50'}} 2024-09-13T23:02:05.067 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50'} 2024-09-13T23:02:05.068 INFO:teuthology.task.install:Using flavor: default 2024-09-13T23:02:05.079 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T23:02:05.079 INFO:teuthology.task.install:extra packages: [] 2024-09-13T23:02:05.080 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50', 'tag': None, 'wait_for_package': False} 2024-09-13T23:02:05.081 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T23:02:05.084 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50', 'tag': None, 'wait_for_package': False} 2024-09-13T23:02:05.084 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T23:02:05.237 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/centos/9/flavors/default/ 2024-09-13T23:02:05.237 INFO:teuthology.task.install.rpm:Package version is 19.1.1-324.gecab7be5 2024-09-13T23:02:05.249 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/centos/9/flavors/default/ 2024-09-13T23:02:05.249 INFO:teuthology.task.install.rpm:Package version is 19.1.1-324.gecab7be5 2024-09-13T23:02:05.355 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T23:02:05.355 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T23:02:05.355 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T23:02:05.366 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T23:02:05.367 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-13T23:02:05.367 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T23:02:05.383 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-13T23:02:05.383 DEBUG:teuthology.orchestra.run.smithi017:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ecab7be58963a5bd03910cd73eef66405d7fdd50/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T23:02:05.394 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-13T23:02:05.394 DEBUG:teuthology.orchestra.run.smithi164:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ecab7be58963a5bd03910cd73eef66405d7fdd50/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T23:02:05.454 DEBUG:teuthology.orchestra.run.smithi017:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T23:02:05.461 DEBUG:teuthology.orchestra.run.smithi164:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T23:02:05.543 DEBUG:teuthology.orchestra.run.smithi017:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T23:02:05.994 DEBUG:teuthology.orchestra.run.smithi164:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T23:02:06.019 INFO:teuthology.orchestra.run.smithi017.stdout:check_obsoletes = 1 2024-09-13T23:02:06.021 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum clean all 2024-09-13T23:02:06.059 INFO:teuthology.orchestra.run.smithi164.stdout:check_obsoletes = 1 2024-09-13T23:02:06.060 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum clean all 2024-09-13T23:02:06.255 INFO:teuthology.orchestra.run.smithi017.stdout:45 files removed 2024-09-13T23:02:06.282 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-radosgw 2024-09-13T23:02:06.300 INFO:teuthology.orchestra.run.smithi164.stdout:45 files removed 2024-09-13T23:02:06.327 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-radosgw 2024-09-13T23:02:06.845 INFO:teuthology.orchestra.run.smithi017.stdout:ceph packages for x86_64 318 kB/s | 84 kB 00:00 2024-09-13T23:02:06.885 INFO:teuthology.orchestra.run.smithi164.stdout:ceph packages for x86_64 309 kB/s | 84 kB 00:00 2024-09-13T23:02:07.129 INFO:teuthology.orchestra.run.smithi017.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-13T23:02:07.169 INFO:teuthology.orchestra.run.smithi164.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-13T23:02:07.404 INFO:teuthology.orchestra.run.smithi017.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-13T23:02:07.445 INFO:teuthology.orchestra.run.smithi164.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-13T23:02:07.978 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-13T23:02:08.180 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-13T23:02:09.940 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - AppStream 32 MB/s | 20 MB 00:00 2024-09-13T23:02:15.966 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.5 MB 00:02 2024-09-13T23:02:16.329 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - AppStream 2.8 MB/s | 20 MB 00:07 2024-09-13T23:02:17.516 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 19 kB 00:00 2024-09-13T23:02:18.420 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-13T23:02:20.771 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-13T23:02:23.247 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 19 kB 00:01 2024-09-13T23:02:24.068 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-13T23:02:24.185 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-13T23:02:26.647 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-13T23:02:26.667 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:02:26.667 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-13T23:02:26.667 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:02:26.667 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-13T23:02:26.667 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw x86_64 2:19.1.1-324.gecab7be5.el9 ceph 11 M 2024-09-13T23:02:26.667 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrading: 2024-09-13T23:02:26.667 INFO:teuthology.orchestra.run.smithi017.stdout: librados2 x86_64 2:19.1.1-324.gecab7be5.el9 ceph 3.4 M 2024-09-13T23:02:26.667 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1 x86_64 2:19.1.1-324.gecab7be5.el9 ceph 3.2 M 2024-09-13T23:02:26.668 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-13T23:02:26.668 INFO:teuthology.orchestra.run.smithi017.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T23:02:26.668 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base x86_64 2:19.1.1-324.gecab7be5.el9 ceph 5.4 M 2024-09-13T23:02:26.668 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common x86_64 2:19.1.1-324.gecab7be5.el9 ceph 21 M 2024-09-13T23:02:26.668 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux x86_64 2:19.1.1-324.gecab7be5.el9 ceph 25 k 2024-09-13T23:02:26.668 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T23:02:26.668 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T23:02:26.668 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T23:02:26.668 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2 x86_64 2:19.1.1-324.gecab7be5.el9 ceph 752 k 2024-09-13T23:02:26.668 INFO:teuthology.orchestra.run.smithi017.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T23:02:26.668 INFO:teuthology.orchestra.run.smithi017.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T23:02:26.668 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T23:02:26.669 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1 x86_64 2:19.1.1-324.gecab7be5.el9 ceph 507 k 2024-09-13T23:02:26.669 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T23:02:26.669 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2 x86_64 2:19.1.1-324.gecab7be5.el9 ceph 5.3 M 2024-09-13T23:02:26.669 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T23:02:26.669 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T23:02:26.669 INFO:teuthology.orchestra.run.smithi017.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T23:02:26.669 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse x86_64 2:19.1.1-324.gecab7be5.el9 ceph 45 k 2024-09-13T23:02:26.669 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common x86_64 2:19.1.1-324.gecab7be5.el9 ceph 136 k 2024-09-13T23:02:26.669 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs x86_64 2:19.1.1-324.gecab7be5.el9 ceph 162 k 2024-09-13T23:02:26.669 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T23:02:26.669 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados x86_64 2:19.1.1-324.gecab7be5.el9 ceph 321 k 2024-09-13T23:02:26.669 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd x86_64 2:19.1.1-324.gecab7be5.el9 ceph 301 k 2024-09-13T23:02:26.669 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw x86_64 2:19.1.1-324.gecab7be5.el9 ceph 99 k 2024-09-13T23:02:26.670 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-13T23:02:26.670 INFO:teuthology.orchestra.run.smithi017.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-13T23:02:26.670 INFO:teuthology.orchestra.run.smithi017.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T23:02:26.670 INFO:teuthology.orchestra.run.smithi017.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T23:02:26.670 INFO:teuthology.orchestra.run.smithi017.stdout:Installing weak dependencies: 2024-09-13T23:02:26.670 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-13T23:02:26.670 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:02:26.670 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-13T23:02:26.670 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:02:26.670 INFO:teuthology.orchestra.run.smithi017.stdout:Install 30 Packages 2024-09-13T23:02:26.670 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrade 2 Packages 2024-09-13T23:02:26.670 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:02:26.671 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 60 M 2024-09-13T23:02:26.671 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-13T23:02:27.661 INFO:teuthology.orchestra.run.smithi017.stdout:(1/32): ceph-base-19.1.1-324.gecab7be5.el9.x86_ 9.7 MB/s | 5.4 MB 00:00 2024-09-13T23:02:27.711 INFO:teuthology.orchestra.run.smithi017.stdout:(2/32): ceph-selinux-19.1.1-324.gecab7be5.el9.x 506 kB/s | 25 kB 00:00 2024-09-13T23:02:27.803 INFO:teuthology.orchestra.run.smithi017.stdout:(3/32): libcephfs2-19.1.1-324.gecab7be5.el9.x86 8.0 MB/s | 752 kB 00:00 2024-09-13T23:02:27.912 INFO:teuthology.orchestra.run.smithi017.stdout:(4/32): ceph-radosgw-19.1.1-324.gecab7be5.el9.x 13 MB/s | 11 MB 00:00 2024-09-13T23:02:27.945 INFO:teuthology.orchestra.run.smithi017.stdout:(5/32): libradosstriper1-19.1.1-324.gecab7be5.e 3.5 MB/s | 507 kB 00:00 2024-09-13T23:02:28.004 INFO:teuthology.orchestra.run.smithi017.stdout:(6/32): python3-ceph-argparse-19.1.1-324.gecab7 774 kB/s | 45 kB 00:00 2024-09-13T23:02:28.088 INFO:teuthology.orchestra.run.smithi017.stdout:(7/32): python3-ceph-common-19.1.1-324.gecab7be 1.6 MB/s | 136 kB 00:00 2024-09-13T23:02:28.171 INFO:teuthology.orchestra.run.smithi017.stdout:(8/32): librgw2-19.1.1-324.gecab7be5.el9.x86_64 21 MB/s | 5.3 MB 00:00 2024-09-13T23:02:28.197 INFO:teuthology.orchestra.run.smithi017.stdout:(9/32): python3-cephfs-19.1.1-324.gecab7be5.el9 1.5 MB/s | 162 kB 00:00 2024-09-13T23:02:28.222 INFO:teuthology.orchestra.run.smithi017.stdout:(10/32): python3-rados-19.1.1-324.gecab7be5.el9 6.3 MB/s | 321 kB 00:00 2024-09-13T23:02:28.247 INFO:teuthology.orchestra.run.smithi017.stdout:(11/32): python3-rbd-19.1.1-324.gecab7be5.el9.x 5.9 MB/s | 301 kB 00:00 2024-09-13T23:02:28.272 INFO:teuthology.orchestra.run.smithi017.stdout:(12/32): python3-rgw-19.1.1-324.gecab7be5.el9.x 1.9 MB/s | 99 kB 00:00 2024-09-13T23:02:28.473 INFO:teuthology.orchestra.run.smithi017.stdout:(13/32): ceph-common-19.1.1-324.gecab7be5.el9.x 16 MB/s | 21 MB 00:01 2024-09-13T23:02:28.523 INFO:teuthology.orchestra.run.smithi017.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 388 kB/s | 107 kB 00:00 2024-09-13T23:02:28.623 INFO:teuthology.orchestra.run.smithi017.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 457 kB/s | 160 kB 00:00 2024-09-13T23:02:28.649 INFO:teuthology.orchestra.run.smithi017.stdout:(16/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 258 kB/s | 45 kB 00:00 2024-09-13T23:02:28.674 INFO:teuthology.orchestra.run.smithi017.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-09-13T23:02:28.699 INFO:teuthology.orchestra.run.smithi017.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 848 kB/s | 42 kB 00:00 2024-09-13T23:02:28.733 INFO:teuthology.orchestra.run.smithi017.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-13T23:02:28.758 INFO:teuthology.orchestra.run.smithi017.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 610 kB/s | 36 kB 00:00 2024-09-13T23:02:28.791 INFO:teuthology.orchestra.run.smithi017.stdout:(21/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-09-13T23:02:28.817 INFO:teuthology.orchestra.run.smithi017.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 567 kB/s | 47 kB 00:00 2024-09-13T23:02:28.876 INFO:teuthology.orchestra.run.smithi017.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.6 MB/s | 308 kB 00:00 2024-09-13T23:02:28.901 INFO:teuthology.orchestra.run.smithi017.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-13T23:02:28.926 INFO:teuthology.orchestra.run.smithi017.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 280 kB/s | 26 kB 00:00 2024-09-13T23:02:28.951 INFO:teuthology.orchestra.run.smithi017.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-13T23:02:28.993 INFO:teuthology.orchestra.run.smithi017.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-13T23:02:29.035 INFO:teuthology.orchestra.run.smithi017.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-13T23:02:29.102 INFO:teuthology.orchestra.run.smithi017.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-13T23:02:29.186 INFO:teuthology.orchestra.run.smithi017.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-13T23:02:29.311 INFO:teuthology.orchestra.run.smithi017.stdout:(31/32): librados2-19.1.1-324.gecab7be5.el9.x86 12 MB/s | 3.4 MB 00:00 2024-09-13T23:02:29.370 INFO:teuthology.orchestra.run.smithi017.stdout:(32/32): librbd1-19.1.1-324.gecab7be5.el9.x86_6 12 MB/s | 3.2 MB 00:00 2024-09-13T23:02:29.374 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:02:29.374 INFO:teuthology.orchestra.run.smithi017.stdout:Total 22 MB/s | 60 MB 00:02 2024-09-13T23:02:29.478 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-13T23:02:29.518 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-13T23:02:29.519 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-13T23:02:29.623 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-13T23:02:30.205 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-13T23:02:30.206 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-13T23:02:31.720 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-13T23:02:31.815 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-13T23:02:31.850 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-13T23:02:31.875 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-13T23:02:31.897 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-13T23:02:31.925 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-13T23:02:32.001 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-13T23:02:32.018 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:02:32.018 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-09-13T23:02:32.018 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:02:32.018 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-13T23:02:32.018 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw x86_64 2:19.1.1-324.gecab7be5.el9 ceph 11 M 2024-09-13T23:02:32.018 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrading: 2024-09-13T23:02:32.018 INFO:teuthology.orchestra.run.smithi164.stdout: librados2 x86_64 2:19.1.1-324.gecab7be5.el9 ceph 3.4 M 2024-09-13T23:02:32.018 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1 x86_64 2:19.1.1-324.gecab7be5.el9 ceph 3.2 M 2024-09-13T23:02:32.018 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-09-13T23:02:32.018 INFO:teuthology.orchestra.run.smithi164.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T23:02:32.019 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base x86_64 2:19.1.1-324.gecab7be5.el9 ceph 5.4 M 2024-09-13T23:02:32.019 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common x86_64 2:19.1.1-324.gecab7be5.el9 ceph 21 M 2024-09-13T23:02:32.019 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux x86_64 2:19.1.1-324.gecab7be5.el9 ceph 25 k 2024-09-13T23:02:32.019 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T23:02:32.019 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T23:02:32.019 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T23:02:32.019 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2 x86_64 2:19.1.1-324.gecab7be5.el9 ceph 752 k 2024-09-13T23:02:32.019 INFO:teuthology.orchestra.run.smithi164.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T23:02:32.019 INFO:teuthology.orchestra.run.smithi164.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T23:02:32.019 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T23:02:32.019 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1 x86_64 2:19.1.1-324.gecab7be5.el9 ceph 507 k 2024-09-13T23:02:32.019 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T23:02:32.019 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2 x86_64 2:19.1.1-324.gecab7be5.el9 ceph 5.3 M 2024-09-13T23:02:32.020 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T23:02:32.020 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T23:02:32.020 INFO:teuthology.orchestra.run.smithi164.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T23:02:32.020 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse x86_64 2:19.1.1-324.gecab7be5.el9 ceph 45 k 2024-09-13T23:02:32.020 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common x86_64 2:19.1.1-324.gecab7be5.el9 ceph 136 k 2024-09-13T23:02:32.020 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs x86_64 2:19.1.1-324.gecab7be5.el9 ceph 162 k 2024-09-13T23:02:32.020 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T23:02:32.020 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados x86_64 2:19.1.1-324.gecab7be5.el9 ceph 321 k 2024-09-13T23:02:32.020 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd x86_64 2:19.1.1-324.gecab7be5.el9 ceph 301 k 2024-09-13T23:02:32.020 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw x86_64 2:19.1.1-324.gecab7be5.el9 ceph 99 k 2024-09-13T23:02:32.020 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-13T23:02:32.020 INFO:teuthology.orchestra.run.smithi164.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-13T23:02:32.020 INFO:teuthology.orchestra.run.smithi164.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T23:02:32.021 INFO:teuthology.orchestra.run.smithi164.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T23:02:32.021 INFO:teuthology.orchestra.run.smithi164.stdout:Installing weak dependencies: 2024-09-13T23:02:32.021 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-13T23:02:32.021 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:02:32.021 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-13T23:02:32.021 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:02:32.021 INFO:teuthology.orchestra.run.smithi164.stdout:Install 30 Packages 2024-09-13T23:02:32.021 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrade 2 Packages 2024-09-13T23:02:32.021 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:02:32.022 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 60 M 2024-09-13T23:02:32.022 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-13T23:02:32.186 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-13T23:02:32.255 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-13T23:02:32.643 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-13T23:02:32.727 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librados2-2:19.1.1-324.gecab7be5.el9.x86_64 7/34 2024-09-13T23:02:32.758 INFO:teuthology.orchestra.run.smithi164.stdout:(1/32): ceph-base-19.1.1-324.gecab7be5.el9.x86_ 10 MB/s | 5.4 MB 00:00 2024-09-13T23:02:32.820 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:19.1.1-324.gecab7be5.el9.x86_64 7/34 2024-09-13T23:02:32.841 INFO:teuthology.orchestra.run.smithi164.stdout:(2/32): ceph-selinux-19.1.1-324.gecab7be5.el9.x 302 kB/s | 25 kB 00:00 2024-09-13T23:02:32.910 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rados-2:19.1.1-324.gecab7be5.el9.x86_64 8/34 2024-09-13T23:02:32.937 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs2-2:19.1.1-324.gecab7be5.el9.x86_64 9/34 2024-09-13T23:02:32.975 INFO:teuthology.orchestra.run.smithi164.stdout:(3/32): ceph-radosgw-19.1.1-324.gecab7be5.el9.x 14 MB/s | 11 MB 00:00 2024-09-13T23:02:33.000 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephfs2-2:19.1.1-324.gecab7be5.el9.x86_64 9/34 2024-09-13T23:02:33.017 INFO:teuthology.orchestra.run.smithi164.stdout:(4/32): libcephfs2-19.1.1-324.gecab7be5.el9.x86 4.2 MB/s | 752 kB 00:00 2024-09-13T23:02:33.037 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-13T23:02:33.050 INFO:teuthology.orchestra.run.smithi164.stdout:(5/32): libradosstriper1-19.1.1-324.gecab7be5.e 6.6 MB/s | 507 kB 00:00 2024-09-13T23:02:33.081 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-argparse-2:19.1.1-324.gecab7be5.el9.x 11/34 2024-09-13T23:02:33.109 INFO:teuthology.orchestra.run.smithi164.stdout:(6/32): python3-ceph-argparse-19.1.1-324.gecab7 773 kB/s | 45 kB 00:00 2024-09-13T23:02:33.152 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cephfs-2:19.1.1-324.gecab7be5.el9.x86_64 12/34 2024-09-13T23:02:33.181 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libradosstriper1-2:19.1.1-324.gecab7be5.el9.x86_64 13/34 2024-09-13T23:02:33.201 INFO:teuthology.orchestra.run.smithi164.stdout:(7/32): python3-ceph-common-19.1.1-324.gecab7be 1.5 MB/s | 136 kB 00:00 2024-09-13T23:02:33.237 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libradosstriper1-2:19.1.1-324.gecab7be5.el9.x86_64 13/34 2024-09-13T23:02:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-13T23:02:33.276 INFO:teuthology.orchestra.run.smithi164.stdout:(8/32): librgw2-19.1.1-324.gecab7be5.el9.x86_64 21 MB/s | 5.3 MB 00:00 2024-09-13T23:02:33.304 INFO:teuthology.orchestra.run.smithi164.stdout:(9/32): python3-cephfs-19.1.1-324.gecab7be5.el9 1.6 MB/s | 162 kB 00:00 2024-09-13T23:02:33.327 INFO:teuthology.orchestra.run.smithi164.stdout:(10/32): python3-rados-19.1.1-324.gecab7be5.el9 6.3 MB/s | 321 kB 00:00 2024-09-13T23:02:33.352 INFO:teuthology.orchestra.run.smithi164.stdout:(11/32): python3-rbd-19.1.1-324.gecab7be5.el9.x 5.9 MB/s | 301 kB 00:00 2024-09-13T23:02:33.378 INFO:teuthology.orchestra.run.smithi164.stdout:(12/32): python3-rgw-19.1.1-324.gecab7be5.el9.x 1.9 MB/s | 99 kB 00:00 2024-09-13T23:02:33.382 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-13T23:02:33.427 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-13T23:02:33.476 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-13T23:02:33.504 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-13T23:02:33.536 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-13T23:02:33.567 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-13T23:02:33.578 INFO:teuthology.orchestra.run.smithi164.stdout:(13/32): ceph-common-19.1.1-324.gecab7be5.el9.x 16 MB/s | 21 MB 00:01 2024-09-13T23:02:33.636 INFO:teuthology.orchestra.run.smithi164.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 376 kB/s | 107 kB 00:00 2024-09-13T23:02:33.670 INFO:teuthology.orchestra.run.smithi164.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 493 kB/s | 45 kB 00:00 2024-09-13T23:02:33.695 INFO:teuthology.orchestra.run.smithi164.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 504 kB/s | 160 kB 00:00 2024-09-13T23:02:33.729 INFO:teuthology.orchestra.run.smithi164.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-13T23:02:33.755 INFO:teuthology.orchestra.run.smithi164.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 720 kB/s | 42 kB 00:00 2024-09-13T23:02:33.780 INFO:teuthology.orchestra.run.smithi164.stdout:(19/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-13T23:02:33.805 INFO:teuthology.orchestra.run.smithi164.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-13T23:02:33.830 INFO:teuthology.orchestra.run.smithi164.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 476 kB/s | 36 kB 00:00 2024-09-13T23:02:33.855 INFO:teuthology.orchestra.run.smithi164.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 627 kB/s | 47 kB 00:00 2024-09-13T23:02:33.893 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-13T23:02:33.914 INFO:teuthology.orchestra.run.smithi164.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-13T23:02:33.937 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librbd1-2:19.1.1-324.gecab7be5.el9.x86_64 22/34 2024-09-13T23:02:33.939 INFO:teuthology.orchestra.run.smithi164.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-13T23:02:33.965 INFO:teuthology.orchestra.run.smithi164.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 275 kB/s | 26 kB 00:00 2024-09-13T23:02:33.990 INFO:teuthology.orchestra.run.smithi164.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-13T23:02:34.024 INFO:teuthology.orchestra.run.smithi164.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-13T23:02:34.029 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:19.1.1-324.gecab7be5.el9.x86_64 22/34 2024-09-13T23:02:34.059 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rbd-2:19.1.1-324.gecab7be5.el9.x86_64 23/34 2024-09-13T23:02:34.065 INFO:teuthology.orchestra.run.smithi164.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-13T23:02:34.112 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-13T23:02:34.115 INFO:teuthology.orchestra.run.smithi164.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-13T23:02:34.199 INFO:teuthology.orchestra.run.smithi164.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-13T23:02:34.291 INFO:teuthology.orchestra.run.smithi164.stdout:(31/32): librados2-19.1.1-324.gecab7be5.el9.x86 15 MB/s | 3.4 MB 00:00 2024-09-13T23:02:34.358 INFO:teuthology.orchestra.run.smithi164.stdout:(32/32): librbd1-19.1.1-324.gecab7be5.el9.x86_6 13 MB/s | 3.2 MB 00:00 2024-09-13T23:02:34.363 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:02:34.363 INFO:teuthology.orchestra.run.smithi164.stdout:Total 26 MB/s | 60 MB 00:02 2024-09-13T23:02:34.467 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-13T23:02:34.503 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-13T23:02:34.503 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-13T23:02:34.621 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-13T23:02:34.665 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librgw2-2:19.1.1-324.gecab7be5.el9.x86_64 26/34 2024-09-13T23:02:34.736 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librgw2-2:19.1.1-324.gecab7be5.el9.x86_64 26/34 2024-09-13T23:02:34.817 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rgw-2:19.1.1-324.gecab7be5.el9.x86_64 27/34 2024-09-13T23:02:34.850 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-common-2:19.1.1-324.gecab7be5.el9.x86 28/34 2024-09-13T23:02:35.184 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-13T23:02:35.184 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-13T23:02:36.679 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-13T23:02:36.742 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-13T23:02:36.771 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-13T23:02:36.797 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-13T23:02:36.819 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-13T23:02:36.840 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-13T23:02:37.029 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-13T23:02:37.084 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-13T23:02:37.294 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:19.1.1-324.gecab7be5.el9.x86_64 29/34 2024-09-13T23:02:37.331 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-common-2:19.1.1-324.gecab7be5.el9.x86_64 29/34 2024-09-13T23:02:37.489 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-13T23:02:37.540 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librados2-2:19.1.1-324.gecab7be5.el9.x86_64 7/34 2024-09-13T23:02:37.616 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:19.1.1-324.gecab7be5.el9.x86_64 7/34 2024-09-13T23:02:37.706 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rados-2:19.1.1-324.gecab7be5.el9.x86_64 8/34 2024-09-13T23:02:37.733 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs2-2:19.1.1-324.gecab7be5.el9.x86_64 9/34 2024-09-13T23:02:37.805 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephfs2-2:19.1.1-324.gecab7be5.el9.x86_64 9/34 2024-09-13T23:02:37.833 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-13T23:02:37.884 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-argparse-2:19.1.1-324.gecab7be5.el9.x 11/34 2024-09-13T23:02:37.955 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:19.1.1-324.gecab7be5.el9.x86_64 29/34 2024-09-13T23:02:37.955 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cephfs-2:19.1.1-324.gecab7be5.el9.x86_64 12/34 2024-09-13T23:02:37.977 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libradosstriper1-2:19.1.1-324.gecab7be5.el9.x86_64 13/34 2024-09-13T23:02:37.992 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-base-2:19.1.1-324.gecab7be5.el9.x86_64 30/34 2024-09-13T23:02:38.085 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-base-2:19.1.1-324.gecab7be5.el9.x86_64 30/34 2024-09-13T23:02:38.085 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T23:02:38.085 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T23:02:38.085 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:02:38.119 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-selinux-2:19.1.1-324.gecab7be5.el9.x86_64 31/34 2024-09-13T23:02:38.167 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libradosstriper1-2:19.1.1-324.gecab7be5.el9.x86_64 13/34 2024-09-13T23:02:38.334 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-13T23:02:38.457 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-13T23:02:38.485 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-13T23:02:38.530 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-13T23:02:38.558 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-13T23:02:38.587 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-13T23:02:38.621 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-13T23:02:38.939 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-13T23:02:38.983 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librbd1-2:19.1.1-324.gecab7be5.el9.x86_64 22/34 2024-09-13T23:02:39.065 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:19.1.1-324.gecab7be5.el9.x86_64 22/34 2024-09-13T23:02:39.096 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rbd-2:19.1.1-324.gecab7be5.el9.x86_64 23/34 2024-09-13T23:02:39.132 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-13T23:02:39.616 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-13T23:02:39.644 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librgw2-2:19.1.1-324.gecab7be5.el9.x86_64 26/34 2024-09-13T23:02:39.698 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librgw2-2:19.1.1-324.gecab7be5.el9.x86_64 26/34 2024-09-13T23:02:39.768 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rgw-2:19.1.1-324.gecab7be5.el9.x86_64 27/34 2024-09-13T23:02:39.805 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-common-2:19.1.1-324.gecab7be5.el9.x86 28/34 2024-09-13T23:02:42.065 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:19.1.1-324.gecab7be5.el9.x86_64 29/34 2024-09-13T23:02:42.119 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-common-2:19.1.1-324.gecab7be5.el9.x86_64 29/34 2024-09-13T23:02:42.685 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:19.1.1-324.gecab7be5.el9.x86_64 29/34 2024-09-13T23:02:42.729 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-base-2:19.1.1-324.gecab7be5.el9.x86_64 30/34 2024-09-13T23:02:42.811 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-base-2:19.1.1-324.gecab7be5.el9.x86_64 30/34 2024-09-13T23:02:42.811 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T23:02:42.811 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T23:02:42.811 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:02:42.839 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-selinux-2:19.1.1-324.gecab7be5.el9.x86_64 31/34 2024-09-13T23:02:48.451 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-selinux-2:19.1.1-324.gecab7be5.el9.x86_64 31/34 2024-09-13T23:02:48.451 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /sys 2024-09-13T23:02:48.451 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /proc 2024-09-13T23:02:48.451 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /mnt 2024-09-13T23:02:48.452 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /var/tmp 2024-09-13T23:02:48.452 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /home 2024-09-13T23:02:48.452 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /root 2024-09-13T23:02:48.452 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /tmp 2024-09-13T23:02:48.452 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:02:49.522 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-radosgw-2:19.1.1-324.gecab7be5.el9.x86_64 32/34 2024-09-13T23:02:49.549 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-324.gecab7be5.el9.x86_64 32/34 2024-09-13T23:02:49.549 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:02:49.549 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T23:02:49.550 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T23:02:49.550 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T23:02:49.550 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:02:49.551 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-13T23:02:49.633 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-13T23:02:49.633 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-13T23:02:50.876 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-13T23:02:50.876 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-base-2:19.1.1-324.gecab7be5.el9.x86_64 1/34 2024-09-13T23:02:50.876 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-common-2:19.1.1-324.gecab7be5.el9.x86_64 2/34 2024-09-13T23:02:50.876 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-radosgw-2:19.1.1-324.gecab7be5.el9.x86_64 3/34 2024-09-13T23:02:50.877 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-selinux-2:19.1.1-324.gecab7be5.el9.x86_64 4/34 2024-09-13T23:02:50.877 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs2-2:19.1.1-324.gecab7be5.el9.x86_64 5/34 2024-09-13T23:02:50.877 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libradosstriper1-2:19.1.1-324.gecab7be5.el9.x86_64 6/34 2024-09-13T23:02:50.877 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librgw2-2:19.1.1-324.gecab7be5.el9.x86_64 7/34 2024-09-13T23:02:50.877 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-argparse-2:19.1.1-324.gecab7be5.el9.x 8/34 2024-09-13T23:02:50.877 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-common-2:19.1.1-324.gecab7be5.el9.x86 9/34 2024-09-13T23:02:50.877 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cephfs-2:19.1.1-324.gecab7be5.el9.x86_64 10/34 2024-09-13T23:02:50.878 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rados-2:19.1.1-324.gecab7be5.el9.x86_64 11/34 2024-09-13T23:02:50.878 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rbd-2:19.1.1-324.gecab7be5.el9.x86_64 12/34 2024-09-13T23:02:50.878 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rgw-2:19.1.1-324.gecab7be5.el9.x86_64 13/34 2024-09-13T23:02:50.878 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-13T23:02:50.878 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-13T23:02:50.878 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-13T23:02:50.878 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-13T23:02:50.878 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-13T23:02:50.878 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-13T23:02:50.879 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-13T23:02:50.879 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-13T23:02:50.879 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-13T23:02:50.879 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-13T23:02:50.879 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-13T23:02:50.879 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-13T23:02:50.879 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-13T23:02:50.879 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-13T23:02:50.880 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-13T23:02:50.880 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-13T23:02:50.880 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-13T23:02:50.880 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:19.1.1-324.gecab7be5.el9.x86_64 31/34 2024-09-13T23:02:50.880 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-13T23:02:50.880 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:19.1.1-324.gecab7be5.el9.x86_64 33/34 2024-09-13T23:02:51.823 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-13T23:02:51.823 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:02:51.823 INFO:teuthology.orchestra.run.smithi017.stdout:Upgraded: 2024-09-13T23:02:51.823 INFO:teuthology.orchestra.run.smithi017.stdout: librados2-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:51.823 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:51.823 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-13T23:02:51.823 INFO:teuthology.orchestra.run.smithi017.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T23:02:51.823 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:51.824 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:51.824 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:51.824 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:51.824 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T23:02:51.824 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T23:02:51.824 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T23:02:51.824 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:51.824 INFO:teuthology.orchestra.run.smithi017.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T23:02:51.824 INFO:teuthology.orchestra.run.smithi017.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T23:02:51.824 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T23:02:51.824 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:51.824 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T23:02:51.824 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:51.824 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T23:02:51.825 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T23:02:51.825 INFO:teuthology.orchestra.run.smithi017.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T23:02:51.825 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:51.825 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:51.825 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:51.825 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T23:02:51.825 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:51.825 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:51.825 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:51.825 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-13T23:02:51.825 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-13T23:02:51.825 INFO:teuthology.orchestra.run.smithi017.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-13T23:02:51.825 INFO:teuthology.orchestra.run.smithi017.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T23:02:51.826 INFO:teuthology.orchestra.run.smithi017.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T23:02:51.826 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:02:51.826 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-13T23:02:52.155 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-test 2024-09-13T23:02:52.751 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:28 ago on Fri 13 Sep 2024 11:02:24 PM UTC. 2024-09-13T23:02:52.897 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-13T23:02:52.898 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:02:52.898 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-13T23:02:52.898 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:02:52.899 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-13T23:02:52.899 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test x86_64 2:19.1.1-324.gecab7be5.el9 ceph 49 M 2024-09-13T23:02:52.899 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-13T23:02:52.899 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite x86_64 2:19.1.1-324.gecab7be5.el9 ceph 163 k 2024-09-13T23:02:52.899 INFO:teuthology.orchestra.run.smithi017.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T23:02:52.899 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T23:02:52.900 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:02:52.900 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-13T23:02:52.900 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:02:52.900 INFO:teuthology.orchestra.run.smithi017.stdout:Install 4 Packages 2024-09-13T23:02:52.900 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:02:52.901 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 49 M 2024-09-13T23:02:52.901 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 209 M 2024-09-13T23:02:52.902 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-13T23:02:53.056 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-selinux-2:19.1.1-324.gecab7be5.el9.x86_64 31/34 2024-09-13T23:02:53.056 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /sys 2024-09-13T23:02:53.057 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /proc 2024-09-13T23:02:53.057 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /mnt 2024-09-13T23:02:53.057 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /var/tmp 2024-09-13T23:02:53.057 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /home 2024-09-13T23:02:53.057 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /root 2024-09-13T23:02:53.057 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /tmp 2024-09-13T23:02:53.057 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:02:53.180 INFO:teuthology.orchestra.run.smithi017.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.1 MB/s | 304 kB 00:00 2024-09-13T23:02:53.222 INFO:teuthology.orchestra.run.smithi017.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-13T23:02:53.264 INFO:teuthology.orchestra.run.smithi017.stdout:(3/4): libcephsqlite-19.1.1-324.gecab7be5.el9.x 728 kB/s | 163 kB 00:00 2024-09-13T23:02:54.042 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-radosgw-2:19.1.1-324.gecab7be5.el9.x86_64 32/34 2024-09-13T23:02:54.071 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-324.gecab7be5.el9.x86_64 32/34 2024-09-13T23:02:54.071 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:02:54.071 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T23:02:54.071 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T23:02:54.071 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T23:02:54.071 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:02:54.073 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-13T23:02:54.145 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-13T23:02:54.145 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-13T23:02:54.547 INFO:teuthology.orchestra.run.smithi017.stdout:(4/4): ceph-test-19.1.1-324.gecab7be5.el9.x86_6 32 MB/s | 49 MB 00:01 2024-09-13T23:02:54.549 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:02:54.550 INFO:teuthology.orchestra.run.smithi017.stdout:Total 30 MB/s | 49 MB 00:01 2024-09-13T23:02:54.578 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-13T23:02:54.600 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-13T23:02:54.601 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-13T23:02:55.017 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-13T23:02:55.017 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-13T23:02:55.348 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-13T23:02:55.348 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-base-2:19.1.1-324.gecab7be5.el9.x86_64 1/34 2024-09-13T23:02:55.348 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-common-2:19.1.1-324.gecab7be5.el9.x86_64 2/34 2024-09-13T23:02:55.348 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-radosgw-2:19.1.1-324.gecab7be5.el9.x86_64 3/34 2024-09-13T23:02:55.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-selinux-2:19.1.1-324.gecab7be5.el9.x86_64 4/34 2024-09-13T23:02:55.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs2-2:19.1.1-324.gecab7be5.el9.x86_64 5/34 2024-09-13T23:02:55.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libradosstriper1-2:19.1.1-324.gecab7be5.el9.x86_64 6/34 2024-09-13T23:02:55.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librgw2-2:19.1.1-324.gecab7be5.el9.x86_64 7/34 2024-09-13T23:02:55.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-argparse-2:19.1.1-324.gecab7be5.el9.x 8/34 2024-09-13T23:02:55.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-common-2:19.1.1-324.gecab7be5.el9.x86 9/34 2024-09-13T23:02:55.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cephfs-2:19.1.1-324.gecab7be5.el9.x86_64 10/34 2024-09-13T23:02:55.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rados-2:19.1.1-324.gecab7be5.el9.x86_64 11/34 2024-09-13T23:02:55.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rbd-2:19.1.1-324.gecab7be5.el9.x86_64 12/34 2024-09-13T23:02:55.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rgw-2:19.1.1-324.gecab7be5.el9.x86_64 13/34 2024-09-13T23:02:55.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-13T23:02:55.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-13T23:02:55.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-13T23:02:55.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-13T23:02:55.350 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-13T23:02:55.350 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-13T23:02:55.350 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-13T23:02:55.350 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-13T23:02:55.350 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-13T23:02:55.350 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-13T23:02:55.350 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-13T23:02:55.350 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-13T23:02:55.350 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-13T23:02:55.350 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-13T23:02:55.350 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-13T23:02:55.350 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-13T23:02:55.351 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-13T23:02:55.351 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:19.1.1-324.gecab7be5.el9.x86_64 31/34 2024-09-13T23:02:55.351 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-13T23:02:55.351 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:19.1.1-324.gecab7be5.el9.x86_64 33/34 2024-09-13T23:02:55.563 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-13T23:02:55.657 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-13T23:02:55.714 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-13T23:02:55.741 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephsqlite-2:19.1.1-324.gecab7be5.el9.x86_64 3/4 2024-09-13T23:02:56.547 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-13T23:02:56.547 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:02:56.547 INFO:teuthology.orchestra.run.smithi164.stdout:Upgraded: 2024-09-13T23:02:56.547 INFO:teuthology.orchestra.run.smithi164.stdout: librados2-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:56.547 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:56.548 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-13T23:02:56.548 INFO:teuthology.orchestra.run.smithi164.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T23:02:56.548 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:56.548 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:56.548 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:56.548 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:56.548 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T23:02:56.548 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T23:02:56.548 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T23:02:56.548 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:56.548 INFO:teuthology.orchestra.run.smithi164.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T23:02:56.548 INFO:teuthology.orchestra.run.smithi164.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T23:02:56.548 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T23:02:56.549 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:56.549 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T23:02:56.549 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:56.549 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T23:02:56.549 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T23:02:56.549 INFO:teuthology.orchestra.run.smithi164.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T23:02:56.549 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:56.549 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:56.549 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:56.549 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T23:02:56.549 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:56.549 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:56.549 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:02:56.550 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-13T23:02:56.550 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-13T23:02:56.550 INFO:teuthology.orchestra.run.smithi164.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-13T23:02:56.550 INFO:teuthology.orchestra.run.smithi164.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T23:02:56.550 INFO:teuthology.orchestra.run.smithi164.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T23:02:56.550 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:02:56.550 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-13T23:02:56.960 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-test 2024-09-13T23:02:57.532 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:28 ago on Fri 13 Sep 2024 11:02:29 PM UTC. 2024-09-13T23:02:57.668 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-13T23:02:57.669 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:02:57.669 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-09-13T23:02:57.669 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:02:57.669 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-13T23:02:57.669 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test x86_64 2:19.1.1-324.gecab7be5.el9 ceph 49 M 2024-09-13T23:02:57.669 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-09-13T23:02:57.670 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite x86_64 2:19.1.1-324.gecab7be5.el9 ceph 163 k 2024-09-13T23:02:57.670 INFO:teuthology.orchestra.run.smithi164.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T23:02:57.670 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T23:02:57.670 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:02:57.670 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-13T23:02:57.670 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:02:57.670 INFO:teuthology.orchestra.run.smithi164.stdout:Install 4 Packages 2024-09-13T23:02:57.670 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:02:57.671 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 49 M 2024-09-13T23:02:57.671 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 209 M 2024-09-13T23:02:57.671 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-13T23:02:57.934 INFO:teuthology.orchestra.run.smithi164.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-13T23:02:57.959 INFO:teuthology.orchestra.run.smithi164.stdout:(2/4): libcephsqlite-19.1.1-324.gecab7be5.el9.x 680 kB/s | 163 kB 00:00 2024-09-13T23:02:57.984 INFO:teuthology.orchestra.run.smithi164.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-13T23:02:59.218 INFO:teuthology.orchestra.run.smithi164.stdout:(4/4): ceph-test-19.1.1-324.gecab7be5.el9.x86_6 32 MB/s | 49 MB 00:01 2024-09-13T23:02:59.220 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:02:59.220 INFO:teuthology.orchestra.run.smithi164.stdout:Total 32 MB/s | 49 MB 00:01 2024-09-13T23:02:59.248 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-13T23:02:59.268 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-13T23:02:59.268 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-13T23:02:59.659 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-13T23:02:59.660 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-13T23:03:00.179 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-13T23:03:00.278 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-13T23:03:00.317 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-13T23:03:00.345 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephsqlite-2:19.1.1-324.gecab7be5.el9.x86_64 3/4 2024-09-13T23:03:00.622 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephsqlite-2:19.1.1-324.gecab7be5.el9.x86_64 3/4 2024-09-13T23:03:00.701 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-test-2:19.1.1-324.gecab7be5.el9.x86_64 4/4 2024-09-13T23:03:03.070 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-test-2:19.1.1-324.gecab7be5.el9.x86_64 4/4 2024-09-13T23:03:03.070 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-test-2:19.1.1-324.gecab7be5.el9.x86_64 1/4 2024-09-13T23:03:03.070 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephsqlite-2:19.1.1-324.gecab7be5.el9.x86_64 2/4 2024-09-13T23:03:03.070 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-13T23:03:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-13T23:03:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:03.501 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-13T23:03:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:03:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:03:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T23:03:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T23:03:03.501 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:03.502 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-13T23:03:03.775 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph 2024-09-13T23:03:04.358 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:40 ago on Fri 13 Sep 2024 11:02:24 PM UTC. 2024-09-13T23:03:04.508 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-13T23:03:04.511 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:03:04.511 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-13T23:03:04.511 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:03:04.511 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-13T23:03:04.511 INFO:teuthology.orchestra.run.smithi017.stdout: ceph x86_64 2:19.1.1-324.gecab7be5.el9 ceph 6.5 k 2024-09-13T23:03:04.512 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-13T23:03:04.512 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds x86_64 2:19.1.1-324.gecab7be5.el9 ceph 2.4 M 2024-09-13T23:03:04.512 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr x86_64 2:19.1.1-324.gecab7be5.el9 ceph 1.5 M 2024-09-13T23:03:04.512 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 249 k 2024-09-13T23:03:04.512 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon x86_64 2:19.1.1-324.gecab7be5.el9 ceph 4.7 M 2024-09-13T23:03:04.512 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd x86_64 2:19.1.1-324.gecab7be5.el9 ceph 17 M 2024-09-13T23:03:04.512 INFO:teuthology.orchestra.run.smithi017.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-13T23:03:04.512 INFO:teuthology.orchestra.run.smithi017.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-13T23:03:04.513 INFO:teuthology.orchestra.run.smithi017.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-13T23:03:04.513 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T23:03:04.513 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T23:03:04.513 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T23:03:04.513 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T23:03:04.513 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T23:03:04.513 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T23:03:04.513 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T23:03:04.514 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T23:03:04.514 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T23:03:04.514 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T23:03:04.514 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T23:03:04.514 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T23:03:04.514 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T23:03:04.514 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T23:03:04.515 INFO:teuthology.orchestra.run.smithi017.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T23:03:04.515 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T23:03:04.515 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T23:03:04.515 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T23:03:04.515 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T23:03:04.515 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T23:03:04.515 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T23:03:04.515 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T23:03:04.515 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T23:03:04.516 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T23:03:04.516 INFO:teuthology.orchestra.run.smithi017.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T23:03:04.516 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T23:03:04.516 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T23:03:04.516 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T23:03:04.516 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:04.517 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-13T23:03:04.517 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:03:04.517 INFO:teuthology.orchestra.run.smithi017.stdout:Install 37 Packages 2024-09-13T23:03:04.517 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:04.518 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 30 M 2024-09-13T23:03:04.518 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 108 M 2024-09-13T23:03:04.518 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-13T23:03:04.924 INFO:teuthology.orchestra.run.smithi017.stdout:(1/37): ceph-19.1.1-324.gecab7be5.el9.x86_64.rp 44 kB/s | 6.5 kB 00:00 2024-09-13T23:03:04.952 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephsqlite-2:19.1.1-324.gecab7be5.el9.x86_64 3/4 2024-09-13T23:03:05.026 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-test-2:19.1.1-324.gecab7be5.el9.x86_64 4/4 2024-09-13T23:03:05.249 INFO:teuthology.orchestra.run.smithi017.stdout:(2/37): ceph-mgr-19.1.1-324.gecab7be5.el9.x86_6 3.2 MB/s | 1.5 MB 00:00 2024-09-13T23:03:05.324 INFO:teuthology.orchestra.run.smithi017.stdout:(3/37): ceph-mds-19.1.1-324.gecab7be5.el9.x86_6 4.3 MB/s | 2.4 MB 00:00 2024-09-13T23:03:05.392 INFO:teuthology.orchestra.run.smithi017.stdout:(4/37): ceph-mgr-modules-core-19.1.1-324.gecab7 3.7 MB/s | 249 kB 00:00 2024-09-13T23:03:05.892 INFO:teuthology.orchestra.run.smithi017.stdout:(5/37): ceph-mon-19.1.1-324.gecab7be5.el9.x86_6 4.9 MB/s | 4.7 MB 00:00 2024-09-13T23:03:05.934 INFO:teuthology.orchestra.run.smithi017.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 467 kB/s | 253 kB 00:00 2024-09-13T23:03:06.051 INFO:teuthology.orchestra.run.smithi017.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 912 kB/s | 106 kB 00:00 2024-09-13T23:03:06.185 INFO:teuthology.orchestra.run.smithi017.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.0 MB/s | 135 kB 00:00 2024-09-13T23:03:06.427 INFO:teuthology.orchestra.run.smithi017.stdout:(9/37): ceph-osd-19.1.1-324.gecab7be5.el9.x86_6 14 MB/s | 17 MB 00:01 2024-09-13T23:03:06.455 INFO:teuthology.orchestra.run.smithi017.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 462 kB/s | 125 kB 00:00 2024-09-13T23:03:06.622 INFO:teuthology.orchestra.run.smithi017.stdout:(11/37): lua-5.4.4-4.el9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2024-09-13T23:03:06.697 INFO:teuthology.orchestra.run.smithi017.stdout:(12/37): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-13T23:03:06.773 INFO:teuthology.orchestra.run.smithi017.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 464 kB/s | 35 kB 00:00 2024-09-13T23:03:06.823 INFO:teuthology.orchestra.run.smithi017.stdout:(14/37): python3-cryptography-36.0.1-4.el9.x86_ 1.3 MB/s | 1.2 MB 00:00 2024-09-13T23:03:06.848 INFO:teuthology.orchestra.run.smithi017.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.0 MB/s | 77 kB 00:00 2024-09-13T23:03:07.025 INFO:teuthology.orchestra.run.smithi017.stdout:(16/37): python3-toml-0.10.2-6.el9.noarch.rpm 626 kB/s | 42 kB 00:00 2024-09-13T23:03:07.025 INFO:teuthology.orchestra.run.smithi017.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 290 kB/s | 51 kB 00:00 2024-09-13T23:03:07.082 INFO:teuthology.orchestra.run.smithi017.stdout:(18/37): lua-devel-5.4.4-4.el9.x86_64.rpm 133 kB/s | 22 kB 00:00 2024-09-13T23:03:07.108 INFO:teuthology.orchestra.run.smithi017.stdout:(19/37): python3-urllib3-1.26.5-6.el9.noarch.rp 315 kB/s | 215 kB 00:00 2024-09-13T23:03:07.158 INFO:teuthology.orchestra.run.smithi017.stdout:(20/37): luarocks-3.9.2-5.el9.noarch.rpm 961 kB/s | 151 kB 00:00 2024-09-13T23:03:07.183 INFO:teuthology.orchestra.run.smithi017.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 432 kB/s | 43 kB 00:00 2024-09-13T23:03:07.208 INFO:teuthology.orchestra.run.smithi017.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 433 kB/s | 11 kB 00:00 2024-09-13T23:03:07.234 INFO:teuthology.orchestra.run.smithi017.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 706 kB/s | 18 kB 00:00 2024-09-13T23:03:07.259 INFO:teuthology.orchestra.run.smithi017.stdout:(24/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-13T23:03:07.288 INFO:teuthology.orchestra.run.smithi017.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 460 kB/s | 23 kB 00:00 2024-09-13T23:03:07.310 INFO:teuthology.orchestra.run.smithi017.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-13T23:03:07.352 INFO:teuthology.orchestra.run.smithi017.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 294 kB/s | 20 kB 00:00 2024-09-13T23:03:07.377 INFO:teuthology.orchestra.run.smithi017.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 690 kB/s | 46 kB 00:00 2024-09-13T23:03:07.402 INFO:teuthology.orchestra.run.smithi017.stdout:(29/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2024-09-13T23:03:07.428 INFO:teuthology.orchestra.run.smithi017.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-13T23:03:07.453 INFO:teuthology.orchestra.run.smithi017.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-09-13T23:03:07.473 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-test-2:19.1.1-324.gecab7be5.el9.x86_64 4/4 2024-09-13T23:03:07.473 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-test-2:19.1.1-324.gecab7be5.el9.x86_64 1/4 2024-09-13T23:03:07.473 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephsqlite-2:19.1.1-324.gecab7be5.el9.x86_64 2/4 2024-09-13T23:03:07.473 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-13T23:03:07.478 INFO:teuthology.orchestra.run.smithi017.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-13T23:03:07.504 INFO:teuthology.orchestra.run.smithi017.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-13T23:03:07.529 INFO:teuthology.orchestra.run.smithi017.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-13T23:03:07.554 INFO:teuthology.orchestra.run.smithi017.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 802 kB/s | 20 kB 00:00 2024-09-13T23:03:07.579 INFO:teuthology.orchestra.run.smithi017.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-13T23:03:07.604 INFO:teuthology.orchestra.run.smithi017.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-13T23:03:07.610 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:03:07.610 INFO:teuthology.orchestra.run.smithi017.stdout:Total 9.8 MB/s | 30 MB 00:03 2024-09-13T23:03:07.767 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-13T23:03:07.800 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-13T23:03:07.800 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:07.800 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-13T23:03:07.800 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:03:07.800 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:03:07.800 INFO:teuthology.orchestra.run.smithi164.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T23:03:07.800 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T23:03:07.800 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:07.800 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-13T23:03:07.812 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-13T23:03:07.812 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-13T23:03:08.086 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph 2024-09-13T23:03:08.321 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-13T23:03:08.321 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-13T23:03:08.660 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:39 ago on Fri 13 Sep 2024 11:02:29 PM UTC. 2024-09-13T23:03:08.803 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-13T23:03:08.806 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:03:08.806 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-09-13T23:03:08.806 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:03:08.806 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-13T23:03:08.806 INFO:teuthology.orchestra.run.smithi164.stdout: ceph x86_64 2:19.1.1-324.gecab7be5.el9 ceph 6.5 k 2024-09-13T23:03:08.806 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-09-13T23:03:08.806 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds x86_64 2:19.1.1-324.gecab7be5.el9 ceph 2.4 M 2024-09-13T23:03:08.807 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr x86_64 2:19.1.1-324.gecab7be5.el9 ceph 1.5 M 2024-09-13T23:03:08.807 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 249 k 2024-09-13T23:03:08.807 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon x86_64 2:19.1.1-324.gecab7be5.el9 ceph 4.7 M 2024-09-13T23:03:08.807 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd x86_64 2:19.1.1-324.gecab7be5.el9 ceph 17 M 2024-09-13T23:03:08.807 INFO:teuthology.orchestra.run.smithi164.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-13T23:03:08.807 INFO:teuthology.orchestra.run.smithi164.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-13T23:03:08.807 INFO:teuthology.orchestra.run.smithi164.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-13T23:03:08.807 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T23:03:08.807 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T23:03:08.807 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T23:03:08.807 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T23:03:08.807 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T23:03:08.807 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T23:03:08.808 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T23:03:08.808 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T23:03:08.808 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T23:03:08.808 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T23:03:08.808 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T23:03:08.808 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T23:03:08.808 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T23:03:08.808 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T23:03:08.808 INFO:teuthology.orchestra.run.smithi164.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T23:03:08.808 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T23:03:08.808 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T23:03:08.808 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T23:03:08.808 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T23:03:08.809 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T23:03:08.809 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T23:03:08.809 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T23:03:08.809 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T23:03:08.809 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T23:03:08.809 INFO:teuthology.orchestra.run.smithi164.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T23:03:08.809 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T23:03:08.809 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T23:03:08.809 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T23:03:08.809 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:08.809 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-13T23:03:08.809 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:03:08.809 INFO:teuthology.orchestra.run.smithi164.stdout:Install 37 Packages 2024-09-13T23:03:08.810 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:08.810 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 30 M 2024-09-13T23:03:08.810 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 108 M 2024-09-13T23:03:08.810 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-13T23:03:09.686 INFO:teuthology.orchestra.run.smithi164.stdout:(1/37): ceph-19.1.1-324.gecab7be5.el9.x86_64.rp 54 kB/s | 6.5 kB 00:00 2024-09-13T23:03:09.839 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-13T23:03:09.878 INFO:teuthology.orchestra.run.smithi164.stdout:(2/37): ceph-mgr-19.1.1-324.gecab7be5.el9.x86_6 4.9 MB/s | 1.5 MB 00:00 2024-09-13T23:03:09.899 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-13T23:03:09.928 INFO:teuthology.orchestra.run.smithi164.stdout:(3/37): ceph-mds-19.1.1-324.gecab7be5.el9.x86_6 6.6 MB/s | 2.4 MB 00:00 2024-09-13T23:03:09.951 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-13T23:03:09.985 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-13T23:03:10.037 INFO:teuthology.orchestra.run.smithi164.stdout:(4/37): ceph-mon-19.1.1-324.gecab7be5.el9.x86_6 13 MB/s | 4.7 MB 00:00 2024-09-13T23:03:10.061 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-13T23:03:10.062 INFO:teuthology.orchestra.run.smithi164.stdout:(5/37): ceph-mgr-modules-core-19.1.1-324.gecab7 1.8 MB/s | 249 kB 00:00 2024-09-13T23:03:10.102 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-13T23:03:10.134 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-13T23:03:10.171 INFO:teuthology.orchestra.run.smithi164.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.9 MB/s | 253 kB 00:00 2024-09-13T23:03:10.213 INFO:teuthology.orchestra.run.smithi164.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-13T23:03:10.231 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-13T23:03:10.254 INFO:teuthology.orchestra.run.smithi164.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-09-13T23:03:10.296 INFO:teuthology.orchestra.run.smithi164.stdout:(9/37): python3-cryptography-36.0.1-4.el9.x86_6 5.2 MB/s | 1.2 MB 00:00 2024-09-13T23:03:10.317 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-13T23:03:10.321 INFO:teuthology.orchestra.run.smithi164.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 1.8 MB/s | 125 kB 00:00 2024-09-13T23:03:10.347 INFO:teuthology.orchestra.run.smithi164.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-09-13T23:03:10.371 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-13T23:03:10.405 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-13T23:03:10.435 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-13T23:03:10.470 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-13T23:03:10.511 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-13T23:03:10.522 INFO:teuthology.orchestra.run.smithi164.stdout:(12/37): ceph-osd-19.1.1-324.gecab7be5.el9.x86_ 26 MB/s | 17 MB 00:00 2024-09-13T23:03:10.553 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-13T23:03:10.596 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-13T23:03:10.629 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-13T23:03:10.681 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-13T23:03:10.721 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-13T23:03:10.798 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-13T23:03:10.968 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-13T23:03:11.058 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-13T23:03:11.108 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-13T23:03:11.146 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-13T23:03:11.204 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-13T23:03:11.268 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-13T23:03:11.289 INFO:teuthology.orchestra.run.smithi164.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 183 kB/s | 172 kB 00:00 2024-09-13T23:03:11.397 INFO:teuthology.orchestra.run.smithi164.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 175 kB/s | 188 kB 00:01 2024-09-13T23:03:11.431 INFO:teuthology.orchestra.run.smithi164.stdout:(15/37): python3-markupsafe-1.1.1-12.el9.x86_64 38 kB/s | 35 kB 00:00 2024-09-13T23:03:11.465 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-13T23:03:11.526 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-13T23:03:11.607 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-13T23:03:11.705 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-13T23:03:11.741 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-13T23:03:11.872 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-13T23:03:12.015 INFO:teuthology.orchestra.run.smithi164.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 83 kB/s | 51 kB 00:00 2024-09-13T23:03:12.045 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-324.gecab7be5.el9.n 32/37 2024-09-13T23:03:12.056 INFO:teuthology.orchestra.run.smithi164.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 67 kB/s | 42 kB 00:00 2024-09-13T23:03:12.076 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-2:19.1.1-324.gecab7be5.el9.x86_64 33/37 2024-09-13T23:03:12.090 INFO:teuthology.orchestra.run.smithi164.stdout:(18/37): lua-devel-5.4.4-4.el9.x86_64.rpm 298 kB/s | 22 kB 00:00 2024-09-13T23:03:12.102 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-2:19.1.1-324.gecab7be5.el9.x86_64 33/37 2024-09-13T23:03:12.103 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:03:12.103 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T23:03:12.103 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T23:03:12.103 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T23:03:12.103 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:12.115 INFO:teuthology.orchestra.run.smithi164.stdout:(19/37): python3-packaging-20.9-5.el9.noarch.rp 93 kB/s | 77 kB 00:00 2024-09-13T23:03:12.157 INFO:teuthology.orchestra.run.smithi164.stdout:(20/37): luarocks-3.9.2-5.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-09-13T23:03:12.182 INFO:teuthology.orchestra.run.smithi164.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 487 kB/s | 43 kB 00:00 2024-09-13T23:03:12.208 INFO:teuthology.orchestra.run.smithi164.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 429 kB/s | 11 kB 00:00 2024-09-13T23:03:12.225 INFO:teuthology.orchestra.run.smithi164.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 1.0 MB/s | 18 kB 00:00 2024-09-13T23:03:12.250 INFO:teuthology.orchestra.run.smithi164.stdout:(24/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-13T23:03:12.267 INFO:teuthology.orchestra.run.smithi164.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 554 kB/s | 23 kB 00:00 2024-09-13T23:03:12.284 INFO:teuthology.orchestra.run.smithi164.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 578 kB/s | 19 kB 00:00 2024-09-13T23:03:12.301 INFO:teuthology.orchestra.run.smithi164.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 587 kB/s | 20 kB 00:00 2024-09-13T23:03:12.318 INFO:teuthology.orchestra.run.smithi164.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 1.4 MB/s | 46 kB 00:00 2024-09-13T23:03:12.347 INFO:teuthology.orchestra.run.smithi164.stdout:(29/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.9 MB/s | 358 kB 00:00 2024-09-13T23:03:12.372 INFO:teuthology.orchestra.run.smithi164.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.1 MB/s | 79 kB 00:00 2024-09-13T23:03:12.397 INFO:teuthology.orchestra.run.smithi164.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 328 kB/s | 16 kB 00:00 2024-09-13T23:03:12.422 INFO:teuthology.orchestra.run.smithi164.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-13T23:03:12.448 INFO:teuthology.orchestra.run.smithi164.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-13T23:03:12.473 INFO:teuthology.orchestra.run.smithi164.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-13T23:03:12.499 INFO:teuthology.orchestra.run.smithi164.stdout:(35/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-13T23:03:12.524 INFO:teuthology.orchestra.run.smithi164.stdout:(36/37): python3-zc-lockfile-2.0-10.el9.noarch. 397 kB/s | 20 kB 00:00 2024-09-13T23:03:12.549 INFO:teuthology.orchestra.run.smithi164.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.1 MB/s | 427 kB 00:00 2024-09-13T23:03:12.554 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:03:12.554 INFO:teuthology.orchestra.run.smithi164.stdout:Total 8.1 MB/s | 30 MB 00:03 2024-09-13T23:03:12.703 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-13T23:03:12.742 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-13T23:03:12.742 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-13T23:03:13.213 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-13T23:03:13.213 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-13T23:03:13.643 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-osd-2:19.1.1-324.gecab7be5.el9.x86_64 34/37 2024-09-13T23:03:13.672 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-osd-2:19.1.1-324.gecab7be5.el9.x86_64 34/37 2024-09-13T23:03:13.672 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:03:13.672 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T23:03:13.673 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T23:03:13.673 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T23:03:13.673 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:14.144 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mon-2:19.1.1-324.gecab7be5.el9.x86_64 35/37 2024-09-13T23:03:14.169 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mon-2:19.1.1-324.gecab7be5.el9.x86_64 35/37 2024-09-13T23:03:14.169 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:03:14.169 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T23:03:14.169 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T23:03:14.169 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T23:03:14.169 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:14.403 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mds-2:19.1.1-324.gecab7be5.el9.x86_64 36/37 2024-09-13T23:03:14.428 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mds-2:19.1.1-324.gecab7be5.el9.x86_64 36/37 2024-09-13T23:03:14.429 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:03:14.429 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T23:03:14.429 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T23:03:14.429 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T23:03:14.429 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:14.497 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-2:19.1.1-324.gecab7be5.el9.x86_64 37/37 2024-09-13T23:03:14.594 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-13T23:03:14.652 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-13T23:03:14.685 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-13T23:03:14.713 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-13T23:03:14.783 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-13T23:03:14.829 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-13T23:03:14.861 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-13T23:03:14.953 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-13T23:03:15.039 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-13T23:03:15.089 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-13T23:03:15.124 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-13T23:03:15.154 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-13T23:03:15.188 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-13T23:03:15.222 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-13T23:03:15.262 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-13T23:03:15.297 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-13T23:03:15.331 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-13T23:03:15.380 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-13T23:03:15.412 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-13T23:03:15.485 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-13T23:03:15.624 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-13T23:03:15.704 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-13T23:03:15.757 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-13T23:03:15.798 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-13T23:03:15.846 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-13T23:03:15.902 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-13T23:03:16.097 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-13T23:03:16.144 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-13T23:03:16.222 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-13T23:03:16.311 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-13T23:03:16.343 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-13T23:03:16.382 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-2:19.1.1-324.gecab7be5.el9.x86_64 37/37 2024-09-13T23:03:16.383 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-2:19.1.1-324.gecab7be5.el9.x86_64 1/37 2024-09-13T23:03:16.383 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mds-2:19.1.1-324.gecab7be5.el9.x86_64 2/37 2024-09-13T23:03:16.383 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-2:19.1.1-324.gecab7be5.el9.x86_64 3/37 2024-09-13T23:03:16.383 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mon-2:19.1.1-324.gecab7be5.el9.x86_64 4/37 2024-09-13T23:03:16.383 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-osd-2:19.1.1-324.gecab7be5.el9.x86_64 5/37 2024-09-13T23:03:16.383 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-324.gecab7be5.el9.n 6/37 2024-09-13T23:03:16.383 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-13T23:03:16.383 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-13T23:03:16.383 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-13T23:03:16.383 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-13T23:03:16.383 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-13T23:03:16.383 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-13T23:03:16.384 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-13T23:03:16.384 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-13T23:03:16.384 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-13T23:03:16.384 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-13T23:03:16.384 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-13T23:03:16.384 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-13T23:03:16.384 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-13T23:03:16.384 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-13T23:03:16.384 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-13T23:03:16.384 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-13T23:03:16.384 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-13T23:03:16.384 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-13T23:03:16.384 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-13T23:03:16.386 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-13T23:03:16.386 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-13T23:03:16.386 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-13T23:03:16.387 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-13T23:03:16.387 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-13T23:03:16.387 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-13T23:03:16.387 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-13T23:03:16.387 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-13T23:03:16.387 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-13T23:03:16.387 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-13T23:03:16.387 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-13T23:03:16.468 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-13T23:03:16.748 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-324.gecab7be5.el9.n 32/37 2024-09-13T23:03:16.778 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-2:19.1.1-324.gecab7be5.el9.x86_64 33/37 2024-09-13T23:03:16.804 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-2:19.1.1-324.gecab7be5.el9.x86_64 33/37 2024-09-13T23:03:16.804 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:03:16.804 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T23:03:16.804 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T23:03:16.804 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T23:03:16.805 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:17.516 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-13T23:03:17.516 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:17.517 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-13T23:03:17.517 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:03:17.517 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:03:17.517 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:03:17.520 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:03:17.520 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:03:17.520 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:03:17.520 INFO:teuthology.orchestra.run.smithi017.stdout: lua-5.4.4-4.el9.x86_64 2024-09-13T23:03:17.520 INFO:teuthology.orchestra.run.smithi017.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-13T23:03:17.521 INFO:teuthology.orchestra.run.smithi017.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-13T23:03:17.521 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T23:03:17.521 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T23:03:17.521 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T23:03:17.521 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T23:03:17.521 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T23:03:17.521 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T23:03:17.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T23:03:17.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T23:03:17.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T23:03:17.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T23:03:17.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T23:03:17.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T23:03:17.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T23:03:17.523 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T23:03:17.523 INFO:teuthology.orchestra.run.smithi017.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T23:03:17.523 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T23:03:17.523 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T23:03:17.523 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T23:03:17.523 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T23:03:17.523 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T23:03:17.523 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T23:03:17.523 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T23:03:17.524 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T23:03:17.524 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T23:03:17.524 INFO:teuthology.orchestra.run.smithi017.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T23:03:17.524 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T23:03:17.524 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T23:03:17.524 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T23:03:17.524 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:17.525 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-13T23:03:17.887 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-base 2024-09-13T23:03:18.237 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-osd-2:19.1.1-324.gecab7be5.el9.x86_64 34/37 2024-09-13T23:03:18.265 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-osd-2:19.1.1-324.gecab7be5.el9.x86_64 34/37 2024-09-13T23:03:18.266 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:03:18.266 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T23:03:18.266 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T23:03:18.266 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T23:03:18.266 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:18.483 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:54 ago on Fri 13 Sep 2024 11:02:24 PM UTC. 2024-09-13T23:03:18.576 INFO:teuthology.orchestra.run.smithi017.stdout:Package ceph-base-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:03:18.621 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-13T23:03:18.622 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-13T23:03:18.622 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-13T23:03:18.688 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install cephadm 2024-09-13T23:03:18.697 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mon-2:19.1.1-324.gecab7be5.el9.x86_64 35/37 2024-09-13T23:03:18.721 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mon-2:19.1.1-324.gecab7be5.el9.x86_64 35/37 2024-09-13T23:03:18.721 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:03:18.721 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T23:03:18.721 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T23:03:18.721 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T23:03:18.721 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:18.947 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mds-2:19.1.1-324.gecab7be5.el9.x86_64 36/37 2024-09-13T23:03:18.971 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mds-2:19.1.1-324.gecab7be5.el9.x86_64 36/37 2024-09-13T23:03:18.972 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:03:18.972 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T23:03:18.972 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T23:03:18.972 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T23:03:18.972 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:19.036 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-2:19.1.1-324.gecab7be5.el9.x86_64 37/37 2024-09-13T23:03:19.279 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:55 ago on Fri 13 Sep 2024 11:02:24 PM UTC. 2024-09-13T23:03:19.415 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-13T23:03:19.416 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:03:19.417 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-13T23:03:19.417 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:03:19.417 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-13T23:03:19.417 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 765 k 2024-09-13T23:03:19.417 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:19.417 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-13T23:03:19.417 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:03:19.417 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-09-13T23:03:19.417 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:19.418 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 765 k 2024-09-13T23:03:19.418 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 771 k 2024-09-13T23:03:19.418 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-13T23:03:19.671 INFO:teuthology.orchestra.run.smithi017.stdout:cephadm-19.1.1-324.gecab7be5.el9.noarch.rpm 2.9 MB/s | 765 kB 00:00 2024-09-13T23:03:19.672 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:03:19.672 INFO:teuthology.orchestra.run.smithi017.stdout:Total 2.9 MB/s | 765 kB 00:00 2024-09-13T23:03:19.672 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-13T23:03:19.678 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-13T23:03:19.678 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-13T23:03:19.684 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-13T23:03:19.684 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-13T23:03:19.880 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-13T23:03:20.368 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephadm-2:19.1.1-324.gecab7be5.el9.noarch 1/1 2024-09-13T23:03:20.469 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephadm-2:19.1.1-324.gecab7be5.el9.noarch 1/1 2024-09-13T23:03:20.621 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-2:19.1.1-324.gecab7be5.el9.x86_64 37/37 2024-09-13T23:03:20.621 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-2:19.1.1-324.gecab7be5.el9.x86_64 1/37 2024-09-13T23:03:20.621 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mds-2:19.1.1-324.gecab7be5.el9.x86_64 2/37 2024-09-13T23:03:20.621 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-2:19.1.1-324.gecab7be5.el9.x86_64 3/37 2024-09-13T23:03:20.621 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mon-2:19.1.1-324.gecab7be5.el9.x86_64 4/37 2024-09-13T23:03:20.621 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-osd-2:19.1.1-324.gecab7be5.el9.x86_64 5/37 2024-09-13T23:03:20.622 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-324.gecab7be5.el9.n 6/37 2024-09-13T23:03:20.622 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-13T23:03:20.622 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-13T23:03:20.622 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-13T23:03:20.622 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-13T23:03:20.622 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-13T23:03:20.622 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-13T23:03:20.622 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-13T23:03:20.622 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-13T23:03:20.622 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-13T23:03:20.622 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-13T23:03:20.622 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-13T23:03:20.622 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-13T23:03:20.623 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-13T23:03:20.623 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-13T23:03:20.623 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-13T23:03:20.623 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-13T23:03:20.623 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-13T23:03:20.623 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-13T23:03:20.623 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-13T23:03:20.623 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-13T23:03:20.623 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-13T23:03:20.623 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-13T23:03:20.623 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-13T23:03:20.623 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-13T23:03:20.623 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-13T23:03:20.624 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-13T23:03:20.624 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-13T23:03:20.624 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-13T23:03:20.624 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-13T23:03:20.624 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-13T23:03:20.873 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephadm-2:19.1.1-324.gecab7be5.el9.noarch 1/1 2024-09-13T23:03:21.141 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephadm-2:19.1.1-324.gecab7be5.el9.noarch 1/1 2024-09-13T23:03:21.141 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:21.141 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-13T23:03:21.141 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:03:21.141 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:21.141 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-13T23:03:21.351 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-immutable-object-cache 2024-09-13T23:03:21.466 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-13T23:03:21.466 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:21.466 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-13T23:03:21.466 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:03:21.467 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:03:21.467 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:03:21.467 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:03:21.467 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:03:21.467 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:03:21.467 INFO:teuthology.orchestra.run.smithi164.stdout: lua-5.4.4-4.el9.x86_64 2024-09-13T23:03:21.467 INFO:teuthology.orchestra.run.smithi164.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-13T23:03:21.468 INFO:teuthology.orchestra.run.smithi164.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-13T23:03:21.468 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T23:03:21.468 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T23:03:21.468 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T23:03:21.468 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T23:03:21.468 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T23:03:21.469 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T23:03:21.469 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T23:03:21.469 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T23:03:21.469 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T23:03:21.469 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T23:03:21.469 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T23:03:21.469 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T23:03:21.470 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T23:03:21.470 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T23:03:21.470 INFO:teuthology.orchestra.run.smithi164.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T23:03:21.470 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T23:03:21.470 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T23:03:21.470 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T23:03:21.471 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T23:03:21.471 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T23:03:21.471 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T23:03:21.471 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T23:03:21.471 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T23:03:21.471 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T23:03:21.471 INFO:teuthology.orchestra.run.smithi164.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T23:03:21.471 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T23:03:21.472 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T23:03:21.472 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T23:03:21.472 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:21.472 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-13T23:03:21.865 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-base 2024-09-13T23:03:21.940 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:57 ago on Fri 13 Sep 2024 11:02:24 PM UTC. 2024-09-13T23:03:22.080 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-13T23:03:22.081 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:03:22.081 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repo Size 2024-09-13T23:03:22.082 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:03:22.082 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-13T23:03:22.082 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-324.gecab7be5.el9 ceph 145 k 2024-09-13T23:03:22.082 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:22.082 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-13T23:03:22.082 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:03:22.082 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-09-13T23:03:22.083 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:22.083 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 145 k 2024-09-13T23:03:22.083 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 435 k 2024-09-13T23:03:22.083 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-13T23:03:22.294 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-immutable-object-cache-19.1.1-324.gecab7be 685 kB/s | 145 kB 00:00 2024-09-13T23:03:22.294 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:03:22.295 INFO:teuthology.orchestra.run.smithi017.stdout:Total 679 kB/s | 145 kB 00:00 2024-09-13T23:03:22.295 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-13T23:03:22.303 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-13T23:03:22.304 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-13T23:03:22.365 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-13T23:03:22.366 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-13T23:03:22.440 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:53 ago on Fri 13 Sep 2024 11:02:29 PM UTC. 2024-09-13T23:03:22.512 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-13T23:03:22.530 INFO:teuthology.orchestra.run.smithi164.stdout:Package ceph-base-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:03:22.572 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-13T23:03:22.573 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-09-13T23:03:22.573 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-13T23:03:22.640 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install cephadm 2024-09-13T23:03:22.663 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-324.gecab7be5.e 1/1 2024-09-13T23:03:22.691 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-324.gecab7be5.e 1/1 2024-09-13T23:03:22.691 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:03:22.692 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T23:03:22.692 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:23.200 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:54 ago on Fri 13 Sep 2024 11:02:29 PM UTC. 2024-09-13T23:03:23.334 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-13T23:03:23.334 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:03:23.335 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-09-13T23:03:23.335 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:03:23.335 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-13T23:03:23.335 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 765 k 2024-09-13T23:03:23.335 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:23.335 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-13T23:03:23.335 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:03:23.336 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-09-13T23:03:23.336 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:23.336 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 765 k 2024-09-13T23:03:23.336 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 771 k 2024-09-13T23:03:23.336 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-13T23:03:23.599 INFO:teuthology.orchestra.run.smithi164.stdout:cephadm-19.1.1-324.gecab7be5.el9.noarch.rpm 2.8 MB/s | 765 kB 00:00 2024-09-13T23:03:23.599 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:03:23.600 INFO:teuthology.orchestra.run.smithi164.stdout:Total 2.8 MB/s | 765 kB 00:00 2024-09-13T23:03:23.600 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-13T23:03:23.605 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-13T23:03:23.605 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-13T23:03:23.611 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-13T23:03:23.611 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-13T23:03:23.646 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-324.gecab7be5.e 1/1 2024-09-13T23:03:23.646 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:23.647 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-13T23:03:23.647 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:03:23.647 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:23.647 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-13T23:03:23.682 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-13T23:03:23.891 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr 2024-09-13T23:03:24.177 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: cephadm-2:19.1.1-324.gecab7be5.el9.noarch 1/1 2024-09-13T23:03:24.270 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephadm-2:19.1.1-324.gecab7be5.el9.noarch 1/1 2024-09-13T23:03:24.485 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:00 ago on Fri 13 Sep 2024 11:02:24 PM UTC. 2024-09-13T23:03:24.579 INFO:teuthology.orchestra.run.smithi017.stdout:Package ceph-mgr-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:03:24.624 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-13T23:03:24.625 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-13T23:03:24.626 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-13T23:03:24.629 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: cephadm-2:19.1.1-324.gecab7be5.el9.noarch 1/1 2024-09-13T23:03:24.697 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr-dashboard 2024-09-13T23:03:24.823 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephadm-2:19.1.1-324.gecab7be5.el9.noarch 1/1 2024-09-13T23:03:24.823 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:24.824 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-13T23:03:24.824 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:03:24.824 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:24.824 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-13T23:03:25.027 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-immutable-object-cache 2024-09-13T23:03:25.283 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:01 ago on Fri 13 Sep 2024 11:02:24 PM UTC. 2024-09-13T23:03:25.421 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-13T23:03:25.422 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:03:25.423 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-13T23:03:25.423 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:03:25.423 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-13T23:03:25.423 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 3.6 M 2024-09-13T23:03:25.423 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-13T23:03:25.423 INFO:teuthology.orchestra.run.smithi017.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-13T23:03:25.423 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 32 k 2024-09-13T23:03:25.424 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 16 k 2024-09-13T23:03:25.424 INFO:teuthology.orchestra.run.smithi017.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-13T23:03:25.424 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-13T23:03:25.424 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-13T23:03:25.424 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-13T23:03:25.425 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-13T23:03:25.425 INFO:teuthology.orchestra.run.smithi017.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-13T23:03:25.425 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T23:03:25.425 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T23:03:25.425 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:25.425 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-13T23:03:25.426 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:03:25.426 INFO:teuthology.orchestra.run.smithi017.stdout:Install 12 Packages 2024-09-13T23:03:25.426 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:25.427 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 8.7 M 2024-09-13T23:03:25.427 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 104 M 2024-09-13T23:03:25.427 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-13T23:03:25.602 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:56 ago on Fri 13 Sep 2024 11:02:29 PM UTC. 2024-09-13T23:03:25.735 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-13T23:03:25.736 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:03:25.736 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-09-13T23:03:25.736 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:03:25.736 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-13T23:03:25.736 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-324.gecab7be5.el9 ceph 145 k 2024-09-13T23:03:25.736 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:25.736 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-13T23:03:25.736 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:03:25.736 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-09-13T23:03:25.736 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:25.736 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 145 k 2024-09-13T23:03:25.737 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 435 k 2024-09-13T23:03:25.737 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-13T23:03:25.955 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-immutable-object-cache-19.1.1-324.gecab7be 664 kB/s | 145 kB 00:00 2024-09-13T23:03:25.956 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:03:25.956 INFO:teuthology.orchestra.run.smithi164.stdout:Total 659 kB/s | 145 kB 00:00 2024-09-13T23:03:25.956 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-13T23:03:25.964 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-13T23:03:25.964 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-13T23:03:25.982 INFO:teuthology.orchestra.run.smithi017.stdout:(1/12): ceph-grafana-dashboards-19.1.1-324.geca 206 kB/s | 32 kB 00:00 2024-09-13T23:03:26.008 INFO:teuthology.orchestra.run.smithi017.stdout:(2/12): ceph-prometheus-alerts-19.1.1-324.gecab 91 kB/s | 16 kB 00:00 2024-09-13T23:03:26.023 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-13T23:03:26.023 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-13T23:03:26.177 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-13T23:03:26.216 INFO:teuthology.orchestra.run.smithi017.stdout:(3/12): ceph-mgr-dashboard-19.1.1-324.gecab7be5 9.2 MB/s | 3.6 MB 00:00 2024-09-13T23:03:26.241 INFO:teuthology.orchestra.run.smithi017.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.1 MB/s | 269 kB 00:00 2024-09-13T23:03:26.273 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-324.gecab7be5.e 1/1 2024-09-13T23:03:26.292 INFO:teuthology.orchestra.run.smithi017.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-13T23:03:26.298 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-324.gecab7be5.e 1/1 2024-09-13T23:03:26.298 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:03:26.298 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T23:03:26.298 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:26.317 INFO:teuthology.orchestra.run.smithi017.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 778 kB/s | 19 kB 00:00 2024-09-13T23:03:26.384 INFO:teuthology.orchestra.run.smithi017.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 31 MB/s | 2.0 MB 00:00 2024-09-13T23:03:26.409 INFO:teuthology.orchestra.run.smithi017.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.6 MB/s | 144 kB 00:00 2024-09-13T23:03:26.435 INFO:teuthology.orchestra.run.smithi017.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-13T23:03:26.477 INFO:teuthology.orchestra.run.smithi017.stdout:(10/12): protobuf-compiler-3.14.0-13.el9.x86_64 3.2 MB/s | 863 kB 00:00 2024-09-13T23:03:26.510 INFO:teuthology.orchestra.run.smithi017.stdout:(11/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.9 MB/s | 1.0 MB 00:00 2024-09-13T23:03:26.544 INFO:teuthology.orchestra.run.smithi017.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.7 MB/s | 188 kB 00:00 2024-09-13T23:03:26.547 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:03:26.547 INFO:teuthology.orchestra.run.smithi017.stdout:Total 7.7 MB/s | 8.7 MB 00:01 2024-09-13T23:03:26.598 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-13T23:03:26.617 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-13T23:03:26.617 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-13T23:03:26.839 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-13T23:03:26.839 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-13T23:03:27.215 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-324.gecab7be5.e 1/1 2024-09-13T23:03:27.215 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:27.215 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-13T23:03:27.215 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:03:27.215 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:27.215 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-13T23:03:27.393 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-13T23:03:27.469 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-mgr 2024-09-13T23:03:27.503 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-13T23:03:27.547 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-13T23:03:27.594 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-13T23:03:27.632 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-13T23:03:27.733 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-13T23:03:27.872 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-13T23:03:27.971 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-13T23:03:28.021 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-13T23:03:28.048 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:59 ago on Fri 13 Sep 2024 11:02:29 PM UTC. 2024-09-13T23:03:28.049 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-13T23:03:28.080 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-324.gecab7be5.el9. 10/12 2024-09-13T23:03:28.141 INFO:teuthology.orchestra.run.smithi164.stdout:Package ceph-mgr-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:03:28.183 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-13T23:03:28.184 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-09-13T23:03:28.184 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-13T23:03:28.257 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-mgr-dashboard 2024-09-13T23:03:28.823 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:59 ago on Fri 13 Sep 2024 11:02:29 PM UTC. 2024-09-13T23:03:28.957 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-13T23:03:28.958 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:03:28.958 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-09-13T23:03:28.958 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:03:28.958 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-13T23:03:28.958 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 3.6 M 2024-09-13T23:03:28.958 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-09-13T23:03:28.959 INFO:teuthology.orchestra.run.smithi164.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-13T23:03:28.959 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 32 k 2024-09-13T23:03:28.959 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 16 k 2024-09-13T23:03:28.959 INFO:teuthology.orchestra.run.smithi164.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-13T23:03:28.959 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-13T23:03:28.959 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-13T23:03:28.959 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-13T23:03:28.959 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-13T23:03:28.959 INFO:teuthology.orchestra.run.smithi164.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-13T23:03:28.959 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T23:03:28.959 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T23:03:28.960 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:28.960 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-13T23:03:28.960 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:03:28.960 INFO:teuthology.orchestra.run.smithi164.stdout:Install 12 Packages 2024-09-13T23:03:28.960 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:28.960 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 8.7 M 2024-09-13T23:03:28.960 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 104 M 2024-09-13T23:03:28.961 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-13T23:03:29.192 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-324.gecab7be5.el9 11/12 2024-09-13T23:03:29.231 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-324.gecab7be5.el9.noar 12/12 2024-09-13T23:03:29.234 INFO:teuthology.orchestra.run.smithi164.stdout:(1/12): ceph-grafana-dashboards-19.1.1-324.geca 211 kB/s | 32 kB 00:00 2024-09-13T23:03:29.259 INFO:teuthology.orchestra.run.smithi164.stdout:(2/12): ceph-prometheus-alerts-19.1.1-324.gecab 93 kB/s | 16 kB 00:00 2024-09-13T23:03:29.384 INFO:teuthology.orchestra.run.smithi164.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.1 MB/s | 269 kB 00:00 2024-09-13T23:03:29.501 INFO:teuthology.orchestra.run.smithi164.stdout:(4/12): ceph-mgr-dashboard-19.1.1-324.gecab7be5 8.5 MB/s | 3.6 MB 00:00 2024-09-13T23:03:29.543 INFO:teuthology.orchestra.run.smithi164.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.3 MB/s | 1.0 MB 00:00 2024-09-13T23:03:29.598 INFO:teuthology.orchestra.run.smithi164.stdout:(6/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 5.8 MB/s | 548 kB 00:00 2024-09-13T23:03:29.618 INFO:teuthology.orchestra.run.smithi164.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 283 kB/s | 19 kB 00:00 2024-09-13T23:03:29.652 INFO:teuthology.orchestra.run.smithi164.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.2 MB/s | 144 kB 00:00 2024-09-13T23:03:29.678 INFO:teuthology.orchestra.run.smithi164.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-13T23:03:29.703 INFO:teuthology.orchestra.run.smithi164.stdout:(10/12): protobuf-compiler-3.14.0-13.el9.x86_64 2.6 MB/s | 863 kB 00:00 2024-09-13T23:03:29.728 INFO:teuthology.orchestra.run.smithi164.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-13T23:03:29.787 INFO:teuthology.orchestra.run.smithi164.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 11 MB/s | 2.0 MB 00:00 2024-09-13T23:03:29.790 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:03:29.791 INFO:teuthology.orchestra.run.smithi164.stdout:Total 10 MB/s | 8.7 MB 00:00 2024-09-13T23:03:29.839 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-13T23:03:29.857 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-13T23:03:29.857 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-13T23:03:30.073 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-13T23:03:30.074 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-13T23:03:30.338 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-324.gecab7be5.el9.noar 12/12 2024-09-13T23:03:30.339 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-324.gecab7be5.el9 1/12 2024-09-13T23:03:30.339 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-324.gecab7be5.el9.noar 2/12 2024-09-13T23:03:30.339 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-324.gecab7be5.el9. 3/12 2024-09-13T23:03:30.339 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-13T23:03:30.339 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-13T23:03:30.340 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-13T23:03:30.340 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-13T23:03:30.340 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-13T23:03:30.340 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-13T23:03:30.340 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-13T23:03:30.340 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-13T23:03:30.624 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-13T23:03:30.666 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-13T23:03:30.666 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:30.666 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-13T23:03:30.666 INFO:teuthology.orchestra.run.smithi017.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-13T23:03:30.666 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:03:30.666 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:03:30.666 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:03:30.666 INFO:teuthology.orchestra.run.smithi017.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-13T23:03:30.666 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-13T23:03:30.666 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-13T23:03:30.666 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-13T23:03:30.666 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-13T23:03:30.667 INFO:teuthology.orchestra.run.smithi017.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-13T23:03:30.667 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T23:03:30.667 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T23:03:30.667 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:30.667 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-13T23:03:30.704 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-13T23:03:30.748 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-13T23:03:30.795 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-13T23:03:30.833 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-13T23:03:30.926 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-13T23:03:30.936 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-13T23:03:31.062 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-13T23:03:31.156 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-13T23:03:31.214 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-13T23:03:31.242 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-13T23:03:31.273 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-324.gecab7be5.el9. 10/12 2024-09-13T23:03:31.516 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:07 ago on Fri 13 Sep 2024 11:02:24 PM UTC. 2024-09-13T23:03:31.656 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-13T23:03:31.657 INFO:teuthology.orchestra.run.smithi017.stdout:====================================================================================== 2024-09-13T23:03:31.657 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-13T23:03:31.657 INFO:teuthology.orchestra.run.smithi017.stdout:====================================================================================== 2024-09-13T23:03:31.657 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-13T23:03:31.657 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 7.4 M 2024-09-13T23:03:31.657 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-13T23:03:31.657 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T23:03:31.657 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T23:03:31.657 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T23:03:31.657 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T23:03:31.657 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T23:03:31.658 INFO:teuthology.orchestra.run.smithi017.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T23:03:31.658 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T23:03:31.658 INFO:teuthology.orchestra.run.smithi017.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T23:03:31.658 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T23:03:31.658 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T23:03:31.658 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T23:03:31.658 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:31.658 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-13T23:03:31.658 INFO:teuthology.orchestra.run.smithi017.stdout:====================================================================================== 2024-09-13T23:03:31.658 INFO:teuthology.orchestra.run.smithi017.stdout:Install 12 Packages 2024-09-13T23:03:31.658 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:31.659 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 38 M 2024-09-13T23:03:31.659 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 212 M 2024-09-13T23:03:31.659 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-13T23:03:32.019 INFO:teuthology.orchestra.run.smithi017.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-13T23:03:32.071 INFO:teuthology.orchestra.run.smithi017.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.2 MB/s | 801 kB 00:00 2024-09-13T23:03:32.311 INFO:teuthology.orchestra.run.smithi017.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 112 kB/s | 33 kB 00:00 2024-09-13T23:03:32.332 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-324.gecab7be5.el9 11/12 2024-09-13T23:03:32.366 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-324.gecab7be5.el9.noar 12/12 2024-09-13T23:03:32.403 INFO:teuthology.orchestra.run.smithi017.stdout:(4/12): ceph-mgr-diskprediction-local-19.1.1-32 14 MB/s | 7.4 MB 00:00 2024-09-13T23:03:32.428 INFO:teuthology.orchestra.run.smithi017.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 156 kB/s | 18 kB 00:00 2024-09-13T23:03:32.687 INFO:teuthology.orchestra.run.smithi017.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 136 kB/s | 38 kB 00:00 2024-09-13T23:03:33.062 INFO:teuthology.orchestra.run.smithi017.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 653 kB/s | 245 kB 00:00 2024-09-13T23:03:33.371 INFO:teuthology.orchestra.run.smithi017.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.3 MB/s | 3.0 MB 00:01 2024-09-13T23:03:33.496 INFO:teuthology.orchestra.run.smithi017.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.0 MB/s | 250 kB 00:00 2024-09-13T23:03:33.648 INFO:teuthology.orchestra.run.smithi017.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 4.1 MB/s | 4.9 MB 00:01 2024-09-13T23:03:33.732 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-324.gecab7be5.el9.noar 12/12 2024-09-13T23:03:33.732 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-324.gecab7be5.el9 1/12 2024-09-13T23:03:33.732 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-324.gecab7be5.el9.noar 2/12 2024-09-13T23:03:33.733 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-324.gecab7be5.el9. 3/12 2024-09-13T23:03:33.733 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-13T23:03:33.733 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-13T23:03:33.733 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-13T23:03:33.733 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-13T23:03:33.733 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-13T23:03:33.733 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-13T23:03:33.733 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-13T23:03:33.733 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-13T23:03:33.913 INFO:teuthology.orchestra.run.smithi017.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.0 MB/s | 5.1 MB 00:00 2024-09-13T23:03:34.035 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-13T23:03:34.035 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:34.036 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-13T23:03:34.036 INFO:teuthology.orchestra.run.smithi164.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-13T23:03:34.036 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:03:34.036 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:03:34.036 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:03:34.036 INFO:teuthology.orchestra.run.smithi164.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-13T23:03:34.036 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-13T23:03:34.037 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-13T23:03:34.037 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-13T23:03:34.037 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-13T23:03:34.037 INFO:teuthology.orchestra.run.smithi164.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-13T23:03:34.037 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T23:03:34.037 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T23:03:34.037 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:34.037 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-13T23:03:34.291 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-13T23:03:34.852 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:05 ago on Fri 13 Sep 2024 11:02:29 PM UTC. 2024-09-13T23:03:34.984 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-13T23:03:34.985 INFO:teuthology.orchestra.run.smithi164.stdout:====================================================================================== 2024-09-13T23:03:34.985 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-09-13T23:03:34.986 INFO:teuthology.orchestra.run.smithi164.stdout:====================================================================================== 2024-09-13T23:03:34.986 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-13T23:03:34.986 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 7.4 M 2024-09-13T23:03:34.986 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-09-13T23:03:34.986 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T23:03:34.986 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T23:03:34.986 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T23:03:34.986 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T23:03:34.986 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T23:03:34.986 INFO:teuthology.orchestra.run.smithi164.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T23:03:34.986 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T23:03:34.986 INFO:teuthology.orchestra.run.smithi164.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T23:03:34.986 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T23:03:34.987 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T23:03:34.987 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T23:03:34.987 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:34.987 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-13T23:03:34.987 INFO:teuthology.orchestra.run.smithi164.stdout:====================================================================================== 2024-09-13T23:03:34.987 INFO:teuthology.orchestra.run.smithi164.stdout:Install 12 Packages 2024-09-13T23:03:34.987 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:34.987 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 38 M 2024-09-13T23:03:34.988 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 212 M 2024-09-13T23:03:34.988 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-13T23:03:35.354 INFO:teuthology.orchestra.run.smithi164.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 881 kB/s | 191 kB 00:00 2024-09-13T23:03:35.429 INFO:teuthology.orchestra.run.smithi164.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.7 MB/s | 801 kB 00:00 2024-09-13T23:03:35.613 INFO:teuthology.orchestra.run.smithi164.stdout:(3/12): ceph-mgr-diskprediction-local-19.1.1-32 16 MB/s | 7.4 MB 00:00 2024-09-13T23:03:35.955 INFO:teuthology.orchestra.run.smithi164.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 54 kB/s | 33 kB 00:00 2024-09-13T23:03:36.113 INFO:teuthology.orchestra.run.smithi164.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 37 kB/s | 18 kB 00:00 2024-09-13T23:03:36.572 INFO:teuthology.orchestra.run.smithi164.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 62 kB/s | 38 kB 00:00 2024-09-13T23:03:37.297 INFO:teuthology.orchestra.run.smithi164.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 1.6 MB/s | 3.0 MB 00:01 2024-09-13T23:03:37.339 INFO:teuthology.orchestra.run.smithi164.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 319 kB/s | 245 kB 00:00 2024-09-13T23:03:37.414 INFO:teuthology.orchestra.run.smithi164.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 3.8 MB/s | 4.9 MB 00:01 2024-09-13T23:03:38.289 INFO:teuthology.orchestra.run.smithi164.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 264 kB/s | 250 kB 00:00 2024-09-13T23:03:38.346 INFO:teuthology.orchestra.run.smithi017.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.4 MB/s | 16 MB 00:04 2024-09-13T23:03:38.347 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:03:38.347 INFO:teuthology.orchestra.run.smithi017.stdout:Total 5.7 MB/s | 38 MB 00:06 2024-09-13T23:03:38.713 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-13T23:03:38.740 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-13T23:03:38.740 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-13T23:03:39.195 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-13T23:03:39.196 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-13T23:03:39.982 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-13T23:03:40.047 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-13T23:03:40.047 INFO:teuthology.orchestra.run.smithi164.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.9 MB/s | 5.1 MB 00:02 2024-09-13T23:03:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-13T23:03:40.215 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-13T23:03:40.254 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-13T23:03:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-13T23:03:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-13T23:03:40.558 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-13T23:03:40.915 INFO:teuthology.orchestra.run.smithi164.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.6 MB/s | 16 MB 00:03 2024-09-13T23:03:40.916 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:03:40.916 INFO:teuthology.orchestra.run.smithi164.stdout:Total 6.4 MB/s | 38 MB 00:05 2024-09-13T23:03:41.251 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-13T23:03:41.279 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-13T23:03:41.306 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-13T23:03:41.306 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-13T23:03:41.370 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-13T23:03:41.736 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-13T23:03:41.736 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-13T23:03:42.494 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-13T23:03:42.560 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-13T23:03:42.614 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-13T23:03:42.686 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T23:03:42.711 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-13T23:03:42.755 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-13T23:03:42.941 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-13T23:03:42.979 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-13T23:03:43.056 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-13T23:03:43.701 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-13T23:03:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-13T23:03:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-324.gecab7b 12/12 2024-09-13T23:03:43.817 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-13T23:03:45.062 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T23:03:46.104 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-13T23:03:46.138 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-324.gecab7b 12/12 2024-09-13T23:03:46.349 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-324.gecab7b 12/12 2024-09-13T23:03:46.349 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-324.gecab7b 1/12 2024-09-13T23:03:46.349 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-13T23:03:46.349 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-13T23:03:46.349 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-13T23:03:46.349 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-13T23:03:46.349 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-13T23:03:46.349 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-13T23:03:46.349 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-13T23:03:46.350 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-13T23:03:46.350 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T23:03:46.350 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-13T23:03:46.723 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-13T23:03:46.723 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:46.724 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-13T23:03:46.724 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:03:46.724 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T23:03:46.724 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T23:03:46.724 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T23:03:46.724 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T23:03:46.724 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T23:03:46.724 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T23:03:46.724 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T23:03:46.724 INFO:teuthology.orchestra.run.smithi017.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T23:03:46.724 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T23:03:46.724 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T23:03:46.724 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T23:03:46.725 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:46.725 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-13T23:03:47.097 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr-rook 2024-09-13T23:03:47.685 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:23 ago on Fri 13 Sep 2024 11:02:24 PM UTC. 2024-09-13T23:03:47.825 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-13T23:03:47.826 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:03:47.826 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-13T23:03:47.826 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:03:47.827 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-13T23:03:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 49 k 2024-09-13T23:03:47.827 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-13T23:03:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T23:03:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T23:03:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T23:03:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T23:03:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T23:03:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T23:03:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T23:03:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T23:03:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T23:03:47.827 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T23:03:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T23:03:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T23:03:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:47.828 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-13T23:03:47.828 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:03:47.828 INFO:teuthology.orchestra.run.smithi017.stdout:Install 13 Packages 2024-09-13T23:03:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:47.829 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 2.2 M 2024-09-13T23:03:47.829 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 26 M 2024-09-13T23:03:47.829 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-13T23:03:48.336 INFO:teuthology.orchestra.run.smithi017.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 207 kB/s | 19 kB 00:00 2024-09-13T23:03:48.362 INFO:teuthology.orchestra.run.smithi017.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 217 kB/s | 26 kB 00:00 2024-09-13T23:03:48.420 INFO:teuthology.orchestra.run.smithi017.stdout:(3/13): ceph-mgr-rook-19.1.1-324.gecab7be5.el9. 279 kB/s | 49 kB 00:00 2024-09-13T23:03:48.504 INFO:teuthology.orchestra.run.smithi017.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-13T23:03:48.529 INFO:teuthology.orchestra.run.smithi017.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.1 MB/s | 222 kB 00:00 2024-09-13T23:03:48.563 INFO:teuthology.orchestra.run.smithi017.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 917 kB/s | 54 kB 00:00 2024-09-13T23:03:48.597 INFO:teuthology.orchestra.run.smithi017.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 480 kB/s | 32 kB 00:00 2024-09-13T23:03:48.622 INFO:teuthology.orchestra.run.smithi017.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 250 kB/s | 14 kB 00:00 2024-09-13T23:03:48.650 INFO:teuthology.orchestra.run.smithi017.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.2 MB/s | 279 kB 00:00 2024-09-13T23:03:48.681 INFO:teuthology.orchestra.run.smithi017.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.6 MB/s | 220 kB 00:00 2024-09-13T23:03:48.706 INFO:teuthology.orchestra.run.smithi017.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.8 MB/s | 90 kB 00:00 2024-09-13T23:03:48.721 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-324.gecab7b 12/12 2024-09-13T23:03:48.721 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-324.gecab7b 1/12 2024-09-13T23:03:48.721 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-13T23:03:48.721 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-13T23:03:48.721 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-13T23:03:48.721 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-13T23:03:48.721 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-13T23:03:48.722 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-13T23:03:48.722 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-13T23:03:48.722 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-13T23:03:48.722 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T23:03:48.722 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-13T23:03:48.731 INFO:teuthology.orchestra.run.smithi017.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 706 kB/s | 59 kB 00:00 2024-09-13T23:03:48.765 INFO:teuthology.orchestra.run.smithi017.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-13T23:03:48.768 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:03:48.768 INFO:teuthology.orchestra.run.smithi017.stdout:Total 2.4 MB/s | 2.2 MB 00:00 2024-09-13T23:03:48.836 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-13T23:03:48.852 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-13T23:03:48.852 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-13T23:03:48.949 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-13T23:03:48.950 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-13T23:03:49.140 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-13T23:03:49.140 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:49.140 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-13T23:03:49.140 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:03:49.140 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T23:03:49.140 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T23:03:49.140 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T23:03:49.140 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T23:03:49.141 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T23:03:49.141 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T23:03:49.141 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T23:03:49.141 INFO:teuthology.orchestra.run.smithi164.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T23:03:49.141 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T23:03:49.141 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T23:03:49.141 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T23:03:49.141 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:49.141 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-13T23:03:49.462 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-13T23:03:49.569 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-mgr-rook 2024-09-13T23:03:49.645 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-13T23:03:49.701 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-13T23:03:49.757 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-13T23:03:49.801 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-13T23:03:49.851 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-13T23:03:49.957 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-13T23:03:50.067 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-13T23:03:50.120 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-13T23:03:50.151 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:21 ago on Fri 13 Sep 2024 11:02:29 PM UTC. 2024-09-13T23:03:50.289 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-13T23:03:50.289 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:03:50.289 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-09-13T23:03:50.289 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:03:50.289 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-13T23:03:50.289 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 49 k 2024-09-13T23:03:50.289 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-09-13T23:03:50.290 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T23:03:50.290 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T23:03:50.290 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T23:03:50.290 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T23:03:50.290 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T23:03:50.290 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T23:03:50.290 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T23:03:50.290 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T23:03:50.290 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T23:03:50.290 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T23:03:50.290 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T23:03:50.290 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T23:03:50.290 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:50.290 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-13T23:03:50.291 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:03:50.291 INFO:teuthology.orchestra.run.smithi164.stdout:Install 13 Packages 2024-09-13T23:03:50.291 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:50.291 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 2.2 M 2024-09-13T23:03:50.291 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 26 M 2024-09-13T23:03:50.291 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-13T23:03:50.554 INFO:teuthology.orchestra.run.smithi164.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 173 kB/s | 19 kB 00:00 2024-09-13T23:03:50.580 INFO:teuthology.orchestra.run.smithi164.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 189 kB/s | 26 kB 00:00 2024-09-13T23:03:50.605 INFO:teuthology.orchestra.run.smithi164.stdout:(3/13): ceph-mgr-rook-19.1.1-324.gecab7be5.el9. 305 kB/s | 49 kB 00:00 2024-09-13T23:03:50.714 INFO:teuthology.orchestra.run.smithi164.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 222 kB 00:00 2024-09-13T23:03:50.739 INFO:teuthology.orchestra.run.smithi164.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 998 kB/s | 159 kB 00:00 2024-09-13T23:03:50.773 INFO:teuthology.orchestra.run.smithi164.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 917 kB/s | 54 kB 00:00 2024-09-13T23:03:50.806 INFO:teuthology.orchestra.run.smithi164.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-09-13T23:03:50.831 INFO:teuthology.orchestra.run.smithi164.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.2 MB/s | 279 kB 00:00 2024-09-13T23:03:50.857 INFO:teuthology.orchestra.run.smithi164.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 172 kB/s | 14 kB 00:00 2024-09-13T23:03:50.881 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-13T23:03:50.890 INFO:teuthology.orchestra.run.smithi164.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.6 MB/s | 220 kB 00:00 2024-09-13T23:03:50.916 INFO:teuthology.orchestra.run.smithi164.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-13T23:03:50.933 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-13T23:03:50.941 INFO:teuthology.orchestra.run.smithi164.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-13T23:03:50.974 INFO:teuthology.orchestra.run.smithi164.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-13T23:03:50.975 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-13T23:03:50.977 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:03:50.977 INFO:teuthology.orchestra.run.smithi164.stdout:Total 3.2 MB/s | 2.2 MB 00:00 2024-09-13T23:03:51.033 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-13T23:03:51.041 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-13T23:03:51.056 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-13T23:03:51.056 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-13T23:03:51.069 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-rook-2:19.1.1-324.gecab7be5.el9.noarch 13/13 2024-09-13T23:03:51.147 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-13T23:03:51.147 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-13T23:03:51.653 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-13T23:03:51.813 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-324.gecab7be5.el9.noarch 13/13 2024-09-13T23:03:51.813 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-rook-2:19.1.1-324.gecab7be5.el9.noarch 1/13 2024-09-13T23:03:51.813 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-13T23:03:51.813 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-13T23:03:51.813 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-13T23:03:51.813 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-13T23:03:51.813 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-13T23:03:51.814 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-13T23:03:51.814 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-13T23:03:51.814 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-13T23:03:51.814 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-13T23:03:51.814 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-13T23:03:51.814 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-13T23:03:51.829 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-13T23:03:51.883 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-13T23:03:51.947 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-13T23:03:51.984 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-13T23:03:52.026 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-13T23:03:52.129 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-13T23:03:52.143 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-13T23:03:52.144 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:52.144 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-13T23:03:52.144 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:03:52.144 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T23:03:52.144 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T23:03:52.144 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T23:03:52.144 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T23:03:52.144 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T23:03:52.144 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T23:03:52.144 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T23:03:52.144 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T23:03:52.145 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T23:03:52.145 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T23:03:52.145 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T23:03:52.145 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T23:03:52.145 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:52.145 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-13T23:03:52.229 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-13T23:03:52.355 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-13T23:03:52.441 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr-cephadm 2024-09-13T23:03:53.033 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:29 ago on Fri 13 Sep 2024 11:02:24 PM UTC. 2024-09-13T23:03:53.138 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-13T23:03:53.174 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-13T23:03:53.175 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:03:53.175 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-13T23:03:53.175 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:03:53.175 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-13T23:03:53.175 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 146 k 2024-09-13T23:03:53.175 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-13T23:03:53.175 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T23:03:53.176 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T23:03:53.176 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T23:03:53.176 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T23:03:53.176 INFO:teuthology.orchestra.run.smithi017.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T23:03:53.176 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:53.176 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-13T23:03:53.176 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:03:53.176 INFO:teuthology.orchestra.run.smithi017.stdout:Install 6 Packages 2024-09-13T23:03:53.176 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:53.177 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 7.0 M 2024-09-13T23:03:53.177 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 33 M 2024-09-13T23:03:53.177 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-13T23:03:53.183 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-13T23:03:53.217 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-13T23:03:53.266 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-13T23:03:53.313 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-rook-2:19.1.1-324.gecab7be5.el9.noarch 13/13 2024-09-13T23:03:53.593 INFO:teuthology.orchestra.run.smithi017.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.8 MB/s | 248 kB 00:00 2024-09-13T23:03:53.643 INFO:teuthology.orchestra.run.smithi017.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-13T23:03:53.676 INFO:teuthology.orchestra.run.smithi017.stdout:(3/6): ceph-mgr-cephadm-19.1.1-324.gecab7be5.el 674 kB/s | 146 kB 00:00 2024-09-13T23:03:53.694 INFO:teuthology.orchestra.run.smithi017.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-13T23:03:53.735 INFO:teuthology.orchestra.run.smithi017.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.2 MB/s | 74 kB 00:00 2024-09-13T23:03:53.819 INFO:teuthology.orchestra.run.smithi017.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-13T23:03:53.822 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:03:53.822 INFO:teuthology.orchestra.run.smithi017.stdout:Total 11 MB/s | 7.0 MB 00:00 2024-09-13T23:03:53.894 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-13T23:03:53.906 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-13T23:03:53.906 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-13T23:03:53.990 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-324.gecab7be5.el9.noarch 13/13 2024-09-13T23:03:53.990 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-rook-2:19.1.1-324.gecab7be5.el9.noarch 1/13 2024-09-13T23:03:53.990 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-13T23:03:53.990 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-13T23:03:53.990 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-13T23:03:53.990 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-13T23:03:53.990 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-13T23:03:53.990 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-13T23:03:53.990 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-13T23:03:53.990 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-13T23:03:53.990 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-13T23:03:53.990 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-13T23:03:53.991 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-13T23:03:54.012 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-13T23:03:54.014 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-13T23:03:54.319 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-13T23:03:54.320 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:54.320 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-13T23:03:54.320 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:03:54.320 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T23:03:54.320 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T23:03:54.320 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T23:03:54.320 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T23:03:54.320 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T23:03:54.321 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T23:03:54.321 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T23:03:54.321 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T23:03:54.321 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T23:03:54.321 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T23:03:54.321 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T23:03:54.321 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T23:03:54.321 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:54.321 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-13T23:03:54.329 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-13T23:03:54.492 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-13T23:03:54.556 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-13T23:03:54.595 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-mgr-cephadm 2024-09-13T23:03:55.113 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-13T23:03:55.162 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:26 ago on Fri 13 Sep 2024 11:02:29 PM UTC. 2024-09-13T23:03:55.210 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-13T23:03:55.290 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-13T23:03:55.297 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-13T23:03:55.297 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:03:55.298 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-09-13T23:03:55.298 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:03:55.298 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-13T23:03:55.298 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 146 k 2024-09-13T23:03:55.298 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-09-13T23:03:55.298 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T23:03:55.298 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T23:03:55.299 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T23:03:55.299 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T23:03:55.299 INFO:teuthology.orchestra.run.smithi164.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T23:03:55.299 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:55.299 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-13T23:03:55.299 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:03:55.299 INFO:teuthology.orchestra.run.smithi164.stdout:Install 6 Packages 2024-09-13T23:03:55.300 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:55.300 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 7.0 M 2024-09-13T23:03:55.301 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 33 M 2024-09-13T23:03:55.301 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-13T23:03:55.317 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-324.gecab7be5.el9.noarch 6/6 2024-09-13T23:03:55.944 INFO:teuthology.orchestra.run.smithi164.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.6 MB/s | 248 kB 00:00 2024-09-13T23:03:55.994 INFO:teuthology.orchestra.run.smithi164.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-13T23:03:56.019 INFO:teuthology.orchestra.run.smithi164.stdout:(3/6): ceph-mgr-cephadm-19.1.1-324.gecab7be5.el 655 kB/s | 146 kB 00:00 2024-09-13T23:03:56.045 INFO:teuthology.orchestra.run.smithi164.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-13T23:03:56.081 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-324.gecab7be5.el9.noarch 6/6 2024-09-13T23:03:56.081 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-324.gecab7be5.el9.noarch 1/6 2024-09-13T23:03:56.081 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-13T23:03:56.081 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-13T23:03:56.081 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-13T23:03:56.081 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-13T23:03:56.095 INFO:teuthology.orchestra.run.smithi164.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 989 kB/s | 74 kB 00:00 2024-09-13T23:03:56.170 INFO:teuthology.orchestra.run.smithi164.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-13T23:03:56.173 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:03:56.173 INFO:teuthology.orchestra.run.smithi164.stdout:Total 8.0 MB/s | 7.0 MB 00:00 2024-09-13T23:03:56.245 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-13T23:03:56.256 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-13T23:03:56.256 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-13T23:03:56.358 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-13T23:03:56.359 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-13T23:03:56.367 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-13T23:03:56.368 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:56.368 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-13T23:03:56.368 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:03:56.368 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T23:03:56.368 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T23:03:56.368 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T23:03:56.368 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T23:03:56.368 INFO:teuthology.orchestra.run.smithi017.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T23:03:56.369 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:56.369 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-13T23:03:56.636 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-fuse 2024-09-13T23:03:56.666 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-13T23:03:56.845 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-13T23:03:56.897 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-13T23:03:57.224 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:33 ago on Fri 13 Sep 2024 11:02:24 PM UTC. 2024-09-13T23:03:57.363 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-13T23:03:57.364 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:03:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-13T23:03:57.364 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:03:57.364 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-13T23:03:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse x86_64 2:19.1.1-324.gecab7be5.el9 ceph 896 k 2024-09-13T23:03:57.364 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-13T23:03:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T23:03:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:57.364 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-13T23:03:57.364 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:03:57.364 INFO:teuthology.orchestra.run.smithi017.stdout:Install 2 Packages 2024-09-13T23:03:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:57.365 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 976 k 2024-09-13T23:03:57.365 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 2.9 M 2024-09-13T23:03:57.365 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-13T23:03:57.421 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-13T23:03:57.508 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-13T23:03:57.555 INFO:teuthology.orchestra.run.smithi017.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 480 kB/s | 80 kB 00:00 2024-09-13T23:03:57.572 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-13T23:03:57.601 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-324.gecab7be5.el9.noarch 6/6 2024-09-13T23:03:57.672 INFO:teuthology.orchestra.run.smithi017.stdout:(2/2): ceph-fuse-19.1.1-324.gecab7be5.el9.x86_6 3.1 MB/s | 896 kB 00:00 2024-09-13T23:03:57.672 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:03:57.673 INFO:teuthology.orchestra.run.smithi017.stdout:Total 3.1 MB/s | 976 kB 00:00 2024-09-13T23:03:57.685 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-13T23:03:57.708 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-13T23:03:57.708 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-13T23:03:57.795 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-13T23:03:57.795 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-13T23:03:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-13T23:03:58.137 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-13T23:03:58.207 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 2/2 2024-09-13T23:03:58.370 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-324.gecab7be5.el9.noarch 6/6 2024-09-13T23:03:58.370 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-324.gecab7be5.el9.noarch 1/6 2024-09-13T23:03:58.370 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-13T23:03:58.370 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-13T23:03:58.370 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-13T23:03:58.370 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-13T23:03:58.635 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-13T23:03:58.636 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:58.636 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-13T23:03:58.636 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:03:58.636 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T23:03:58.636 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T23:03:58.636 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T23:03:58.636 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T23:03:58.636 INFO:teuthology.orchestra.run.smithi164.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T23:03:58.636 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:58.636 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-13T23:03:58.868 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-fuse 2024-09-13T23:03:58.889 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 2/2 2024-09-13T23:03:58.889 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 1/2 2024-09-13T23:03:59.159 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-13T23:03:59.160 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:59.160 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-13T23:03:59.160 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-13T23:03:59.160 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:03:59.160 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-13T23:03:59.428 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-volume 2024-09-13T23:03:59.437 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:30 ago on Fri 13 Sep 2024 11:02:29 PM UTC. 2024-09-13T23:03:59.572 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-13T23:03:59.572 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:03:59.573 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-09-13T23:03:59.573 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:03:59.573 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-13T23:03:59.573 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse x86_64 2:19.1.1-324.gecab7be5.el9 ceph 896 k 2024-09-13T23:03:59.573 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-09-13T23:03:59.573 INFO:teuthology.orchestra.run.smithi164.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T23:03:59.573 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:59.573 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-13T23:03:59.573 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:03:59.573 INFO:teuthology.orchestra.run.smithi164.stdout:Install 2 Packages 2024-09-13T23:03:59.573 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:03:59.574 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 976 k 2024-09-13T23:03:59.574 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 2.9 M 2024-09-13T23:03:59.574 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-13T23:03:59.789 INFO:teuthology.orchestra.run.smithi164.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 703 kB/s | 80 kB 00:00 2024-09-13T23:03:59.947 INFO:teuthology.orchestra.run.smithi164.stdout:(2/2): ceph-fuse-19.1.1-324.gecab7be5.el9.x86_6 3.2 MB/s | 896 kB 00:00 2024-09-13T23:03:59.948 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:03:59.948 INFO:teuthology.orchestra.run.smithi164.stdout:Total 2.5 MB/s | 976 kB 00:00 2024-09-13T23:03:59.960 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-13T23:03:59.982 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-13T23:03:59.982 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-13T23:04:00.021 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:36 ago on Fri 13 Sep 2024 11:02:24 PM UTC. 2024-09-13T23:04:00.064 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-13T23:04:00.064 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-13T23:04:00.163 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-13T23:04:00.164 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:04:00.164 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-13T23:04:00.164 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:04:00.164 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-13T23:04:00.164 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 285 k 2024-09-13T23:04:00.164 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:00.164 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-13T23:04:00.164 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:04:00.164 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-09-13T23:04:00.164 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:00.165 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 285 k 2024-09-13T23:04:00.165 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 1.3 M 2024-09-13T23:04:00.165 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-13T23:04:00.248 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-13T23:04:00.377 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-volume-19.1.1-324.gecab7be5.el9.noarch.rpm 1.3 MB/s | 285 kB 00:00 2024-09-13T23:04:00.377 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:04:00.377 INFO:teuthology.orchestra.run.smithi017.stdout:Total 1.3 MB/s | 285 kB 00:00 2024-09-13T23:04:00.378 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-13T23:04:00.382 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-13T23:04:00.386 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-13T23:04:00.387 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-13T23:04:00.418 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-13T23:04:00.419 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-13T23:04:00.447 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 2/2 2024-09-13T23:04:00.650 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-13T23:04:00.721 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-volume-2:19.1.1-324.gecab7be5.el9.noarch 1/1 2024-09-13T23:04:00.737 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-volume-2:19.1.1-324.gecab7be5.el9.noarch 1/1 2024-09-13T23:04:00.737 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:04:00.737 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T23:04:00.738 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:01.101 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 2/2 2024-09-13T23:04:01.101 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 1/2 2024-09-13T23:04:01.349 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-13T23:04:01.349 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:01.350 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-13T23:04:01.350 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-13T23:04:01.350 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:01.350 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-13T23:04:01.649 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-volume 2024-09-13T23:04:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-volume-2:19.1.1-324.gecab7be5.el9.noarch 1/1 2024-09-13T23:04:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:01.717 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-13T23:04:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:04:01.717 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:01.717 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-13T23:04:02.026 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install librados-devel 2024-09-13T23:04:02.233 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:33 ago on Fri 13 Sep 2024 11:02:29 PM UTC. 2024-09-13T23:04:02.376 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-13T23:04:02.376 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:04:02.376 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-09-13T23:04:02.376 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:04:02.376 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-13T23:04:02.376 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-volume noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 285 k 2024-09-13T23:04:02.376 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:02.376 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-13T23:04:02.377 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:04:02.377 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-09-13T23:04:02.377 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:02.377 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 285 k 2024-09-13T23:04:02.377 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 1.3 M 2024-09-13T23:04:02.377 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-13T23:04:02.602 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-volume-19.1.1-324.gecab7be5.el9.noarch.rpm 1.2 MB/s | 285 kB 00:00 2024-09-13T23:04:02.603 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:04:02.603 INFO:teuthology.orchestra.run.smithi164.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-13T23:04:02.603 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-13T23:04:02.611 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-13T23:04:02.612 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-13T23:04:02.628 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:38 ago on Fri 13 Sep 2024 11:02:24 PM UTC. 2024-09-13T23:04:02.640 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-13T23:04:02.641 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-13T23:04:02.767 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-13T23:04:02.767 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:04:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repo Size 2024-09-13T23:04:02.767 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:04:02.767 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-13T23:04:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel x86_64 2:19.1.1-324.gecab7be5.el9 ceph 127 k 2024-09-13T23:04:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:02.768 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-13T23:04:02.768 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:04:02.768 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-09-13T23:04:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:02.768 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 127 k 2024-09-13T23:04:02.768 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 456 k 2024-09-13T23:04:02.769 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-13T23:04:02.859 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-13T23:04:02.921 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-volume-2:19.1.1-324.gecab7be5.el9.noarch 1/1 2024-09-13T23:04:02.937 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-volume-2:19.1.1-324.gecab7be5.el9.noarch 1/1 2024-09-13T23:04:02.938 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:04:02.938 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T23:04:02.938 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:02.983 INFO:teuthology.orchestra.run.smithi017.stdout:librados-devel-19.1.1-324.gecab7be5.el9.x86_64. 594 kB/s | 127 kB 00:00 2024-09-13T23:04:02.983 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:04:02.983 INFO:teuthology.orchestra.run.smithi017.stdout:Total 588 kB/s | 127 kB 00:00 2024-09-13T23:04:02.984 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-13T23:04:02.990 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-13T23:04:02.990 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-13T23:04:03.057 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-13T23:04:03.057 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-13T23:04:03.218 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-13T23:04:03.333 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librados-devel-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:03.760 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados-devel-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:03.921 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-volume-2:19.1.1-324.gecab7be5.el9.noarch 1/1 2024-09-13T23:04:03.921 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:03.921 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-13T23:04:03.921 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-volume-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:04:03.921 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:03.922 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-13T23:04:04.002 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados-devel-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:04.002 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:04.002 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-13T23:04:04.002 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:04:04.003 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:04.003 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-13T23:04:04.258 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install librados-devel 2024-09-13T23:04:04.268 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install libcephfs2 2024-09-13T23:04:04.847 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:35 ago on Fri 13 Sep 2024 11:02:29 PM UTC. 2024-09-13T23:04:04.869 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:40 ago on Fri 13 Sep 2024 11:02:24 PM UTC. 2024-09-13T23:04:04.963 INFO:teuthology.orchestra.run.smithi017.stdout:Package libcephfs2-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:04:04.982 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-13T23:04:04.983 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:04:04.983 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-09-13T23:04:04.983 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:04:04.983 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-13T23:04:04.983 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel x86_64 2:19.1.1-324.gecab7be5.el9 ceph 127 k 2024-09-13T23:04:04.983 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:04.983 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-13T23:04:04.984 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:04:04.984 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-09-13T23:04:04.984 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:04.984 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 127 k 2024-09-13T23:04:04.984 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 456 k 2024-09-13T23:04:04.984 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-13T23:04:05.010 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-13T23:04:05.011 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-13T23:04:05.011 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-13T23:04:05.085 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install libcephfs-devel 2024-09-13T23:04:05.199 INFO:teuthology.orchestra.run.smithi164.stdout:librados-devel-19.1.1-324.gecab7be5.el9.x86_64. 590 kB/s | 127 kB 00:00 2024-09-13T23:04:05.200 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:04:05.200 INFO:teuthology.orchestra.run.smithi164.stdout:Total 586 kB/s | 127 kB 00:00 2024-09-13T23:04:05.200 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-13T23:04:05.205 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-13T23:04:05.206 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-13T23:04:05.269 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-13T23:04:05.270 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-13T23:04:05.422 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-13T23:04:05.530 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librados-devel-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:05.676 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:41 ago on Fri 13 Sep 2024 11:02:24 PM UTC. 2024-09-13T23:04:05.813 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-13T23:04:05.814 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:04:05.814 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repo Size 2024-09-13T23:04:05.814 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:04:05.814 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-13T23:04:05.815 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel x86_64 2:19.1.1-324.gecab7be5.el9 ceph 32 k 2024-09-13T23:04:05.815 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:05.815 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-13T23:04:05.815 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:04:05.815 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-09-13T23:04:05.815 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:05.815 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 32 k 2024-09-13T23:04:05.815 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 142 k 2024-09-13T23:04:05.815 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-13T23:04:05.961 INFO:teuthology.orchestra.run.smithi017.stdout:libcephfs-devel-19.1.1-324.gecab7be5.el9.x86_64 217 kB/s | 32 kB 00:00 2024-09-13T23:04:05.962 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:04:05.962 INFO:teuthology.orchestra.run.smithi017.stdout:Total 215 kB/s | 32 kB 00:00 2024-09-13T23:04:05.962 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-13T23:04:05.965 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados-devel-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:05.966 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-13T23:04:05.966 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-13T23:04:05.983 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-13T23:04:05.983 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-13T23:04:06.071 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-13T23:04:06.204 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs-devel-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:06.225 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados-devel-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:06.225 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:06.225 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-13T23:04:06.225 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:04:06.225 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:06.225 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-13T23:04:06.511 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install libcephfs2 2024-09-13T23:04:06.587 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:06.824 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs-devel-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:06.824 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:06.824 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-13T23:04:06.824 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:04:06.824 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:06.824 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-13T23:04:07.011 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install librados2 2024-09-13T23:04:07.089 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:38 ago on Fri 13 Sep 2024 11:02:29 PM UTC. 2024-09-13T23:04:07.182 INFO:teuthology.orchestra.run.smithi164.stdout:Package libcephfs2-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:04:07.226 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-13T23:04:07.227 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-09-13T23:04:07.227 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-13T23:04:07.293 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install libcephfs-devel 2024-09-13T23:04:07.604 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:43 ago on Fri 13 Sep 2024 11:02:24 PM UTC. 2024-09-13T23:04:07.698 INFO:teuthology.orchestra.run.smithi017.stdout:Package librados2-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:04:07.744 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-13T23:04:07.745 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-13T23:04:07.745 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-13T23:04:07.818 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install librbd1 2024-09-13T23:04:07.857 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:38 ago on Fri 13 Sep 2024 11:02:29 PM UTC. 2024-09-13T23:04:07.991 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-13T23:04:07.992 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:04:07.992 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-09-13T23:04:07.992 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:04:07.992 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-13T23:04:07.992 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel x86_64 2:19.1.1-324.gecab7be5.el9 ceph 32 k 2024-09-13T23:04:07.992 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:07.992 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-13T23:04:07.993 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:04:07.993 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-09-13T23:04:07.993 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:07.993 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 32 k 2024-09-13T23:04:07.993 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 142 k 2024-09-13T23:04:07.993 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-13T23:04:08.145 INFO:teuthology.orchestra.run.smithi164.stdout:libcephfs-devel-19.1.1-324.gecab7be5.el9.x86_64 208 kB/s | 32 kB 00:00 2024-09-13T23:04:08.145 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:04:08.145 INFO:teuthology.orchestra.run.smithi164.stdout:Total 207 kB/s | 32 kB 00:00 2024-09-13T23:04:08.146 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-13T23:04:08.149 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-13T23:04:08.149 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-13T23:04:08.169 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-13T23:04:08.170 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-13T23:04:08.262 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-13T23:04:08.358 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs-devel-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:08.409 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:44 ago on Fri 13 Sep 2024 11:02:24 PM UTC. 2024-09-13T23:04:08.503 INFO:teuthology.orchestra.run.smithi017.stdout:Package librbd1-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:04:08.549 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-13T23:04:08.550 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-13T23:04:08.550 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-13T23:04:08.626 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install python3-rados 2024-09-13T23:04:08.721 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:08.949 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs-devel-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:08.949 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:08.949 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-13T23:04:08.949 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:04:08.949 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:08.949 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-13T23:04:09.141 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install librados2 2024-09-13T23:04:09.222 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:45 ago on Fri 13 Sep 2024 11:02:24 PM UTC. 2024-09-13T23:04:09.316 INFO:teuthology.orchestra.run.smithi017.stdout:Package python3-rados-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:04:09.362 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-13T23:04:09.364 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-13T23:04:09.364 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-13T23:04:09.431 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install python3-rgw 2024-09-13T23:04:09.715 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:40 ago on Fri 13 Sep 2024 11:02:29 PM UTC. 2024-09-13T23:04:09.807 INFO:teuthology.orchestra.run.smithi164.stdout:Package librados2-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:04:09.851 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-13T23:04:09.852 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-09-13T23:04:09.853 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-13T23:04:09.927 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install librbd1 2024-09-13T23:04:10.026 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:46 ago on Fri 13 Sep 2024 11:02:24 PM UTC. 2024-09-13T23:04:10.120 INFO:teuthology.orchestra.run.smithi017.stdout:Package python3-rgw-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:04:10.166 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-13T23:04:10.167 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-13T23:04:10.167 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-13T23:04:10.238 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install python3-cephfs 2024-09-13T23:04:10.509 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:41 ago on Fri 13 Sep 2024 11:02:29 PM UTC. 2024-09-13T23:04:10.600 INFO:teuthology.orchestra.run.smithi164.stdout:Package librbd1-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:04:10.643 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-13T23:04:10.644 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-09-13T23:04:10.645 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-13T23:04:10.718 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install python3-rados 2024-09-13T23:04:10.832 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:46 ago on Fri 13 Sep 2024 11:02:24 PM UTC. 2024-09-13T23:04:10.926 INFO:teuthology.orchestra.run.smithi017.stdout:Package python3-cephfs-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:04:10.973 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-13T23:04:10.974 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-13T23:04:10.974 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-13T23:04:11.042 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install python3-rbd 2024-09-13T23:04:11.289 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:42 ago on Fri 13 Sep 2024 11:02:29 PM UTC. 2024-09-13T23:04:11.378 INFO:teuthology.orchestra.run.smithi164.stdout:Package python3-rados-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:04:11.422 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-13T23:04:11.423 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-09-13T23:04:11.423 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-13T23:04:11.493 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install python3-rgw 2024-09-13T23:04:11.639 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:47 ago on Fri 13 Sep 2024 11:02:24 PM UTC. 2024-09-13T23:04:11.732 INFO:teuthology.orchestra.run.smithi017.stdout:Package python3-rbd-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:04:11.780 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-13T23:04:11.781 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-13T23:04:11.781 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-13T23:04:11.851 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install rbd-fuse 2024-09-13T23:04:12.066 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:43 ago on Fri 13 Sep 2024 11:02:29 PM UTC. 2024-09-13T23:04:12.157 INFO:teuthology.orchestra.run.smithi164.stdout:Package python3-rgw-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:04:12.200 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-13T23:04:12.201 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-09-13T23:04:12.201 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-13T23:04:12.276 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install python3-cephfs 2024-09-13T23:04:12.441 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:48 ago on Fri 13 Sep 2024 11:02:24 PM UTC. 2024-09-13T23:04:12.582 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-13T23:04:12.583 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:04:12.583 INFO:teuthology.orchestra.run.smithi017.stdout: Package Architecture Version Repository Size 2024-09-13T23:04:12.583 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:04:12.583 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-13T23:04:12.583 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse x86_64 2:19.1.1-324.gecab7be5.el9 ceph 85 k 2024-09-13T23:04:12.583 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:12.583 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-13T23:04:12.583 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:04:12.583 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-09-13T23:04:12.583 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:12.583 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 85 k 2024-09-13T23:04:12.584 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 231 k 2024-09-13T23:04:12.584 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-13T23:04:12.774 INFO:teuthology.orchestra.run.smithi017.stdout:rbd-fuse-19.1.1-324.gecab7be5.el9.x86_64.rpm 449 kB/s | 85 kB 00:00 2024-09-13T23:04:12.774 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:04:12.774 INFO:teuthology.orchestra.run.smithi017.stdout:Total 446 kB/s | 85 kB 00:00 2024-09-13T23:04:12.775 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-13T23:04:12.782 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-13T23:04:12.782 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-13T23:04:12.847 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:43 ago on Fri 13 Sep 2024 11:02:29 PM UTC. 2024-09-13T23:04:12.849 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-13T23:04:12.849 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-13T23:04:12.937 INFO:teuthology.orchestra.run.smithi164.stdout:Package python3-cephfs-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:04:12.981 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-13T23:04:12.982 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-09-13T23:04:12.982 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-13T23:04:13.015 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-13T23:04:13.058 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install python3-rbd 2024-09-13T23:04:13.124 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:13.526 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:13.630 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:44 ago on Fri 13 Sep 2024 11:02:29 PM UTC. 2024-09-13T23:04:13.721 INFO:teuthology.orchestra.run.smithi164.stdout:Package python3-rbd-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:04:13.764 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-13T23:04:13.765 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-09-13T23:04:13.765 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-13T23:04:13.775 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:13.776 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:13.776 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-13T23:04:13.776 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:04:13.776 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:13.776 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-13T23:04:13.843 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install rbd-fuse 2024-09-13T23:04:14.030 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install rbd-mirror 2024-09-13T23:04:14.413 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:45 ago on Fri 13 Sep 2024 11:02:29 PM UTC. 2024-09-13T23:04:14.550 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-13T23:04:14.551 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:04:14.551 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-09-13T23:04:14.551 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:04:14.551 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-13T23:04:14.551 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse x86_64 2:19.1.1-324.gecab7be5.el9 ceph 85 k 2024-09-13T23:04:14.552 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:14.552 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-13T23:04:14.552 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:04:14.552 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-09-13T23:04:14.552 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:14.552 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 85 k 2024-09-13T23:04:14.552 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 231 k 2024-09-13T23:04:14.552 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-13T23:04:14.632 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:50 ago on Fri 13 Sep 2024 11:02:24 PM UTC. 2024-09-13T23:04:14.739 INFO:teuthology.orchestra.run.smithi164.stdout:rbd-fuse-19.1.1-324.gecab7be5.el9.x86_64.rpm 455 kB/s | 85 kB 00:00 2024-09-13T23:04:14.740 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:04:14.740 INFO:teuthology.orchestra.run.smithi164.stdout:Total 452 kB/s | 85 kB 00:00 2024-09-13T23:04:14.740 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-13T23:04:14.747 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-13T23:04:14.747 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-13T23:04:14.774 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-13T23:04:14.774 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:04:14.775 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repo Size 2024-09-13T23:04:14.775 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:04:14.775 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-13T23:04:14.775 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror x86_64 2:19.1.1-324.gecab7be5.el9 ceph 3.1 M 2024-09-13T23:04:14.775 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:14.775 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-13T23:04:14.775 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:04:14.775 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-09-13T23:04:14.775 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:14.775 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 3.1 M 2024-09-13T23:04:14.775 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 13 M 2024-09-13T23:04:14.775 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-13T23:04:14.811 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-13T23:04:14.812 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-13T23:04:14.967 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-13T23:04:15.062 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:15.120 INFO:teuthology.orchestra.run.smithi017.stdout:rbd-mirror-19.1.1-324.gecab7be5.el9.x86_64.rpm 9.0 MB/s | 3.1 MB 00:00 2024-09-13T23:04:15.120 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:04:15.120 INFO:teuthology.orchestra.run.smithi017.stdout:Total 9.0 MB/s | 3.1 MB 00:00 2024-09-13T23:04:15.121 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-13T23:04:15.129 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-13T23:04:15.129 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-13T23:04:15.215 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-13T23:04:15.215 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-13T23:04:15.475 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:15.671 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-13T23:04:15.716 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:15.716 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:15.716 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-13T23:04:15.717 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:04:15.717 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:15.717 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-13T23:04:15.736 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-mirror-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:15.763 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-mirror-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:15.763 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:04:15.763 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T23:04:15.763 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T23:04:15.763 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T23:04:15.763 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:15.993 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install rbd-mirror 2024-09-13T23:04:16.591 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:47 ago on Fri 13 Sep 2024 11:02:29 PM UTC. 2024-09-13T23:04:16.738 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-13T23:04:16.739 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:04:16.739 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-09-13T23:04:16.740 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:04:16.740 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-13T23:04:16.740 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror x86_64 2:19.1.1-324.gecab7be5.el9 ceph 3.1 M 2024-09-13T23:04:16.740 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:16.740 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-13T23:04:16.740 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:04:16.740 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-09-13T23:04:16.740 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:16.740 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 3.1 M 2024-09-13T23:04:16.740 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 13 M 2024-09-13T23:04:16.740 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-13T23:04:16.885 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-mirror-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:16.885 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:16.885 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-13T23:04:16.885 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:04:16.885 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:16.886 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-13T23:04:17.061 INFO:teuthology.orchestra.run.smithi164.stdout:rbd-mirror-19.1.1-324.gecab7be5.el9.x86_64.rpm 9.7 MB/s | 3.1 MB 00:00 2024-09-13T23:04:17.062 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:04:17.062 INFO:teuthology.orchestra.run.smithi164.stdout:Total 9.6 MB/s | 3.1 MB 00:00 2024-09-13T23:04:17.063 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-13T23:04:17.072 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-13T23:04:17.072 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-13T23:04:17.132 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install rbd-nbd 2024-09-13T23:04:17.156 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-13T23:04:17.157 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-13T23:04:17.598 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-13T23:04:17.736 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:53 ago on Fri 13 Sep 2024 11:02:24 PM UTC. 2024-09-13T23:04:17.787 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-mirror-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:17.813 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-mirror-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:17.814 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:04:17.814 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T23:04:17.814 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T23:04:17.814 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T23:04:17.814 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:17.878 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-13T23:04:17.878 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:04:17.878 INFO:teuthology.orchestra.run.smithi017.stdout: Package Architecture Version Repository Size 2024-09-13T23:04:17.878 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:04:17.879 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-13T23:04:17.879 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd x86_64 2:19.1.1-324.gecab7be5.el9 ceph 170 k 2024-09-13T23:04:17.879 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:17.879 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-13T23:04:17.879 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-13T23:04:17.879 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-09-13T23:04:17.879 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:17.879 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 170 k 2024-09-13T23:04:17.879 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 494 k 2024-09-13T23:04:17.879 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-13T23:04:18.098 INFO:teuthology.orchestra.run.smithi017.stdout:rbd-nbd-19.1.1-324.gecab7be5.el9.x86_64.rpm 781 kB/s | 170 kB 00:00 2024-09-13T23:04:18.098 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:04:18.099 INFO:teuthology.orchestra.run.smithi017.stdout:Total 775 kB/s | 170 kB 00:00 2024-09-13T23:04:18.099 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-13T23:04:18.107 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-13T23:04:18.107 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-13T23:04:18.175 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-13T23:04:18.175 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-13T23:04:18.338 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-13T23:04:18.448 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-nbd-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:18.805 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-mirror-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:18.805 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:18.806 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-13T23:04:18.806 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:04:18.806 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:18.806 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-13T23:04:18.867 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-nbd-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:19.057 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install rbd-nbd 2024-09-13T23:04:19.150 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-nbd-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:19.151 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:19.151 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-13T23:04:19.151 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:04:19.151 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:19.151 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-13T23:04:19.387 DEBUG:teuthology.parallel:result is None 2024-09-13T23:04:19.633 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:50 ago on Fri 13 Sep 2024 11:02:29 PM UTC. 2024-09-13T23:04:19.770 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-13T23:04:19.771 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:04:19.771 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-09-13T23:04:19.771 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:04:19.771 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-13T23:04:19.771 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd x86_64 2:19.1.1-324.gecab7be5.el9 ceph 170 k 2024-09-13T23:04:19.771 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:19.771 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-13T23:04:19.771 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-13T23:04:19.772 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-09-13T23:04:19.772 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:19.772 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 170 k 2024-09-13T23:04:19.772 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 494 k 2024-09-13T23:04:19.772 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-13T23:04:19.973 INFO:teuthology.orchestra.run.smithi164.stdout:rbd-nbd-19.1.1-324.gecab7be5.el9.x86_64.rpm 848 kB/s | 170 kB 00:00 2024-09-13T23:04:19.974 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:04:19.974 INFO:teuthology.orchestra.run.smithi164.stdout:Total 840 kB/s | 170 kB 00:00 2024-09-13T23:04:19.974 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-13T23:04:19.982 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-13T23:04:19.982 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-13T23:04:20.046 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-13T23:04:20.046 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-13T23:04:20.198 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-13T23:04:20.287 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-nbd-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:20.721 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-nbd-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:20.975 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-nbd-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:04:20.975 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:20.975 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-13T23:04:20.975 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:04:20.975 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:20.975 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-13T23:04:21.228 DEBUG:teuthology.parallel:result is None 2024-09-13T23:04:21.229 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T23:04:21.377 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T23:04:21.403 INFO:teuthology.orchestra.run.smithi017.stdout:19.1.1-324.gecab7be5.el9 2024-09-13T23:04:21.404 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-324.gecab7be5.el9 2024-09-13T23:04:21.404 INFO:teuthology.task.install:The correct ceph version 19.1.1-324.gecab7be5 is installed. 2024-09-13T23:04:21.406 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T23:04:21.547 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T23:04:21.572 INFO:teuthology.orchestra.run.smithi164.stdout:19.1.1-324.gecab7be5.el9 2024-09-13T23:04:21.572 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-324.gecab7be5.el9 2024-09-13T23:04:21.572 INFO:teuthology.task.install:The correct ceph version 19.1.1-324.gecab7be5 is installed. 2024-09-13T23:04:21.574 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T23:04:21.574 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T23:04:21.574 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T23:04:21.606 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-13T23:04:21.606 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T23:04:21.640 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T23:04:21.641 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T23:04:21.641 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T23:04:21.676 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T23:04:21.745 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-13T23:04:21.746 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T23:04:21.773 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T23:04:21.841 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T23:04:21.841 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T23:04:21.841 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T23:04:21.870 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T23:04:21.940 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-13T23:04:21.940 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T23:04:21.977 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T23:04:22.043 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T23:04:22.043 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T23:04:22.043 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T23:04:22.074 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T23:04:22.143 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-13T23:04:22.143 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T23:04:22.169 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T23:04:22.235 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T23:04:22.319 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T23:04:22.320 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 777 /var/log/ceph 2024-09-13T23:04:22.322 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 777 /var/log/ceph 2024-09-13T23:04:22.347 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T23:04:22.348 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T23:04:22.388 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T23:04:22.412 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T23:04:22.413 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T23:04:22.454 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T23:04:22.487 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T23:04:22.487 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T23:04:22.487 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-13_21:40:02-rgw-squid-distro-default-smithi/7904378', 'branch': 'squid', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7904378', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-13_21:40:02-rgw-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50'}}, 'rgw': {'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 3476, 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50', 'targets': {'smithi017.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMQg4+aPLRL3AjT/kPRJZw9+HI0iEjSRa8M/hDxJldiVXGk1i7y+tgUBWTPoZe2BS121w5esi6Cw/BkQcCzk20A=', 'smithi164.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJdn7uu6BhtJRg1inz/emwrAlsUludb5JLwVSYeBB6ZguUCh4TBjlORSh+Y+nIO/Q4atE7wV7JSlFs/Lu+HIBT0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_21:40:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T23:04:22.487 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T23:04:22.521 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T23:04:22.536 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T23:04:22.577 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T23:04:22.601 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T23:04:22.602 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T23:04:22.658 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T23:04:22.658 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_1 2024-09-13T23:04:22.713 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T23:04:22.714 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T23:04:22.714 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-13T23:04:22.714 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T23:04:22.714 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T23:04:22.714 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-13 23:04:16.045204854 +0000 2024-09-13T23:04:22.714 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-13 23:01:45.806128948 +0000 2024-09-13T23:04:22.714 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-13 23:01:45.806128948 +0000 2024-09-13T23:04:22.714 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-13 23:01:45.806128948 +0000 2024-09-13T23:04:22.714 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T23:04:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-13T23:04:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-13T23:04:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 9.7849e-05 s, 5.2 MB/s 2024-09-13T23:04:22.779 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T23:04:22.836 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_2 2024-09-13T23:04:22.893 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T23:04:22.893 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T23:04:22.893 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-13T23:04:22.893 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T23:04:22.893 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T23:04:22.893 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-13 23:04:16.045204854 +0000 2024-09-13T23:04:22.893 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-13 23:01:46.132126044 +0000 2024-09-13T23:04:22.893 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-13 23:01:46.132126044 +0000 2024-09-13T23:04:22.893 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-13 23:01:46.132126044 +0000 2024-09-13T23:04:22.894 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T23:04:22.958 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-13T23:04:22.958 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-13T23:04:22.958 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000100307 s, 5.1 MB/s 2024-09-13T23:04:22.959 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T23:04:23.017 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_3 2024-09-13T23:04:23.074 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T23:04:23.075 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T23:04:23.075 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-13T23:04:23.075 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T23:04:23.075 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T23:04:23.075 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-13 23:04:16.046204845 +0000 2024-09-13T23:04:23.075 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-13 23:01:46.458123140 +0000 2024-09-13T23:04:23.075 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-13 23:01:46.458123140 +0000 2024-09-13T23:04:23.075 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-13 23:01:46.458123140 +0000 2024-09-13T23:04:23.076 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T23:04:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-13T23:04:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-13T23:04:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000100814 s, 5.1 MB/s 2024-09-13T23:04:23.140 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T23:04:23.197 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_4 2024-09-13T23:04:23.253 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T23:04:23.253 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T23:04:23.253 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-13T23:04:23.254 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T23:04:23.254 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T23:04:23.254 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-13 23:04:16.046204845 +0000 2024-09-13T23:04:23.254 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-13 23:01:46.795120138 +0000 2024-09-13T23:04:23.254 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-13 23:01:46.795120138 +0000 2024-09-13T23:04:23.254 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-13 23:01:46.795120138 +0000 2024-09-13T23:04:23.254 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T23:04:23.318 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-13T23:04:23.319 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-13T23:04:23.319 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000100254 s, 5.1 MB/s 2024-09-13T23:04:23.320 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T23:04:23.378 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-13T23:04:23.378 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-13T23:04:23.378 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T23:04:23.397 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T23:04:23.397 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_1 2024-09-13T23:04:23.455 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T23:04:23.455 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T23:04:23.455 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-13T23:04:23.455 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T23:04:23.456 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T23:04:23.456 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-09-13 23:04:18.065239397 +0000 2024-09-13T23:04:23.456 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-09-13 23:01:40.691433145 +0000 2024-09-13T23:04:23.456 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-09-13 23:01:40.691433145 +0000 2024-09-13T23:04:23.456 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-09-13 23:01:40.691433145 +0000 2024-09-13T23:04:23.456 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T23:04:23.522 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-09-13T23:04:23.522 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-09-13T23:04:23.522 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000221374 s, 2.3 MB/s 2024-09-13T23:04:23.524 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T23:04:23.582 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_2 2024-09-13T23:04:23.640 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T23:04:23.640 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T23:04:23.640 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-13T23:04:23.640 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T23:04:23.641 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T23:04:23.641 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-09-13 23:04:18.066239381 +0000 2024-09-13T23:04:23.641 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-09-13 23:01:41.016427818 +0000 2024-09-13T23:04:23.641 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-09-13 23:01:41.016427818 +0000 2024-09-13T23:04:23.641 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-09-13 23:01:41.016427818 +0000 2024-09-13T23:04:23.641 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T23:04:23.706 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-09-13T23:04:23.706 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-09-13T23:04:23.706 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.00022067 s, 2.3 MB/s 2024-09-13T23:04:23.707 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T23:04:23.765 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_3 2024-09-13T23:04:23.822 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T23:04:23.822 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T23:04:23.822 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-13T23:04:23.822 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T23:04:23.822 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T23:04:23.823 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-09-13 23:04:18.066239381 +0000 2024-09-13T23:04:23.823 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-09-13 23:01:41.352422312 +0000 2024-09-13T23:04:23.823 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-09-13 23:01:41.352422312 +0000 2024-09-13T23:04:23.823 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-09-13 23:01:41.352422312 +0000 2024-09-13T23:04:23.823 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T23:04:23.887 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-09-13T23:04:23.887 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-09-13T23:04:23.887 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000219932 s, 2.3 MB/s 2024-09-13T23:04:23.888 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T23:04:23.946 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_4 2024-09-13T23:04:24.002 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T23:04:24.002 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T23:04:24.003 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-13T23:04:24.003 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T23:04:24.003 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T23:04:24.003 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-09-13 23:04:18.067239365 +0000 2024-09-13T23:04:24.003 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-09-13 23:01:41.693416723 +0000 2024-09-13T23:04:24.003 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-09-13 23:01:41.693416723 +0000 2024-09-13T23:04:24.003 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-09-13 23:01:41.693416723 +0000 2024-09-13T23:04:24.003 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T23:04:24.067 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-09-13T23:04:24.067 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-09-13T23:04:24.067 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.0002058 s, 2.5 MB/s 2024-09-13T23:04:24.068 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T23:04:24.125 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T23:04:24.125 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi017.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-13T23:04:24.125 INFO:tasks.ceph:Generating config... 2024-09-13T23:04:24.127 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T23:04:24.127 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-13T23:04:24.127 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-13T23:04:24.127 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-13T23:04:24.127 INFO:tasks.ceph:[client] setuser = ceph 2024-09-13T23:04:24.127 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T23:04:24.127 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-13T23:04:24.127 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-13T23:04:24.127 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-13T23:04:24.127 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-13T23:04:24.127 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T23:04:24.127 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T23:04:24.128 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-13T23:04:24.128 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-13T23:04:24.128 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T23:04:24.128 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-13T23:04:24.128 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T23:04:24.128 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T23:04:24.128 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T23:04:24.128 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T23:04:24.128 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T23:04:24.128 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T23:04:24.128 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T23:04:24.128 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T23:04:24.128 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T23:04:24.128 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T23:04:24.129 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T23:04:24.129 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T23:04:24.183 INFO:teuthology.orchestra.run.smithi017.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T23:04:24.186 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T23:04:24.233 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T23:04:24.260 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.17')] 2024-09-13T23:04:24.261 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.17'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-13T23:04:24.261 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T23:04:24.262 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T23:04:24.317 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.17 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T23:04:24.398 INFO:teuthology.orchestra.run.smithi017.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:04:24.398 INFO:teuthology.orchestra.run.smithi017.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:04:24.399 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T23:04:24.399 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: generated fsid cf23c940-4ed5-4d79-b536-21dd117d26cb 2024-09-13T23:04:24.399 INFO:teuthology.orchestra.run.smithi017.stdout:setting min_mon_release = quincy 2024-09-13T23:04:24.399 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 0 2024-09-13T23:04:24.399 INFO:teuthology.orchestra.run.smithi017.stdout:fsid cf23c940-4ed5-4d79-b536-21dd117d26cb 2024-09-13T23:04:24.399 INFO:teuthology.orchestra.run.smithi017.stdout:last_changed 2024-09-13T23:04:24.398917+0000 2024-09-13T23:04:24.399 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-13T23:04:24.398917+0000 2024-09-13T23:04:24.399 INFO:teuthology.orchestra.run.smithi017.stdout:min_mon_release 17 (quincy) 2024-09-13T23:04:24.399 INFO:teuthology.orchestra.run.smithi017.stdout:election_strategy: 1 2024-09-13T23:04:24.399 INFO:teuthology.orchestra.run.smithi017.stdout:0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-13T23:04:24.399 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-13T23:04:24.401 DEBUG:teuthology.orchestra.run.smithi017:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T23:04:24.457 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID cf23c940-4ed5-4d79-b536-21dd117d26cb... 2024-09-13T23:04:24.457 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T23:04:24.499 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T23:04:24.541 INFO:teuthology.orchestra.run.smithi017.stdout:[global] 2024-09-13T23:04:24.541 INFO:teuthology.orchestra.run.smithi017.stdout: chdir = "" 2024-09-13T23:04:24.542 INFO:teuthology.orchestra.run.smithi017.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T23:04:24.542 INFO:teuthology.orchestra.run.smithi017.stdout: auth supported = cephx 2024-09-13T23:04:24.542 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.542 INFO:teuthology.orchestra.run.smithi017.stdout: filestore xattr use omap = true 2024-09-13T23:04:24.542 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.542 INFO:teuthology.orchestra.run.smithi017.stdout: mon clock drift allowed = 1.000 2024-09-13T23:04:24.542 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.542 INFO:teuthology.orchestra.run.smithi017.stdout: osd crush chooseleaf type = 0 2024-09-13T23:04:24.542 INFO:teuthology.orchestra.run.smithi017.stdout: auth debug = true 2024-09-13T23:04:24.542 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.542 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on old message = true 2024-09-13T23:04:24.542 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on bug = true 2024-09-13T23:04:24.542 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T23:04:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: mon pg warn max object skew = 0 2024-09-13T23:04:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T23:04:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T23:04:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default size = 2 2024-09-13T23:04:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow primary affinity = true 2024-09-13T23:04:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow pg remap = true 2024-09-13T23:04:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on legacy crush tunables = false 2024-09-13T23:04:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on crush straw calc version zero = false 2024-09-13T23:04:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on no sortbitwise = false 2024-09-13T23:04:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on osd down out interval zero = false 2024-09-13T23:04:24.543 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on too few osds = false 2024-09-13T23:04:24.544 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T23:04:24.544 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T23:04:24.544 INFO:teuthology.orchestra.run.smithi017.stdout: mon_allow_pool_size_one = true 2024-09-13T23:04:24.544 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.544 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T23:04:24.544 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.544 INFO:teuthology.orchestra.run.smithi017.stdout: osd default data pool replay window = 5 2024-09-13T23:04:24.544 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.544 INFO:teuthology.orchestra.run.smithi017.stdout: mon allow pool delete = true 2024-09-13T23:04:24.544 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.544 INFO:teuthology.orchestra.run.smithi017.stdout: mon cluster log file level = debug 2024-09-13T23:04:24.544 INFO:teuthology.orchestra.run.smithi017.stdout: debug asserts on shutdown = true 2024-09-13T23:04:24.544 INFO:teuthology.orchestra.run.smithi017.stdout: mon health detail to clog = false 2024-09-13T23:04:24.545 INFO:teuthology.orchestra.run.smithi017.stdout: mon host = 172.21.15.17 2024-09-13T23:04:24.545 INFO:teuthology.orchestra.run.smithi017.stdout: fsid = cf23c940-4ed5-4d79-b536-21dd117d26cb 2024-09-13T23:04:24.545 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.545 INFO:teuthology.orchestra.run.smithi017.stdout:[osd] 2024-09-13T23:04:24.545 INFO:teuthology.orchestra.run.smithi017.stdout: osd journal size = 100 2024-09-13T23:04:24.545 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.545 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub load threshold = 5.0 2024-09-13T23:04:24.545 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub max interval = 600 2024-09-13T23:04:24.545 INFO:teuthology.orchestra.run.smithi017.stdout: osd mclock profile = high_recovery_ops 2024-09-13T23:04:24.545 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.545 INFO:teuthology.orchestra.run.smithi017.stdout: osd recover clone overlap = true 2024-09-13T23:04:24.545 INFO:teuthology.orchestra.run.smithi017.stdout: osd recovery max chunk = 1048576 2024-09-13T23:04:24.545 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.545 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug shutdown = true 2024-09-13T23:04:24.545 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug op order = true 2024-09-13T23:04:24.546 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug verify stray on activate = true 2024-09-13T23:04:24.546 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug trim objects = true 2024-09-13T23:04:24.546 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.546 INFO:teuthology.orchestra.run.smithi017.stdout: osd open classes on start = true 2024-09-13T23:04:24.546 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug pg log writeout = true 2024-09-13T23:04:24.546 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.546 INFO:teuthology.orchestra.run.smithi017.stdout: osd deep scrub update digest min age = 30 2024-09-13T23:04:24.546 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.546 INFO:teuthology.orchestra.run.smithi017.stdout: osd map max advance = 10 2024-09-13T23:04:24.546 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.546 INFO:teuthology.orchestra.run.smithi017.stdout: journal zero on create = true 2024-09-13T23:04:24.546 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.546 INFO:teuthology.orchestra.run.smithi017.stdout: filestore ondisk finisher threads = 3 2024-09-13T23:04:24.546 INFO:teuthology.orchestra.run.smithi017.stdout: filestore apply finisher threads = 3 2024-09-13T23:04:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: bdev debug aio = true 2024-09-13T23:04:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug misdirected ops = true 2024-09-13T23:04:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-13T23:04:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: debug objclass = 20 2024-09-13T23:04:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: bdev async discard = True 2024-09-13T23:04:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: bdev enable discard = True 2024-09-13T23:04:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore allocator = bitmap 2024-09-13T23:04:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore block size = 96636764160 2024-09-13T23:04:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore fsck on mount = True 2024-09-13T23:04:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluefs = 1/20 2024-09-13T23:04:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluestore = 1/20 2024-09-13T23:04:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: debug osd = 20 2024-09-13T23:04:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: debug rocksdb = 4/10 2024-09-13T23:04:24.547 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T23:04:24.548 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd full ratio = 0.9 2024-09-13T23:04:24.548 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd nearfull ratio = 0.8 2024-09-13T23:04:24.548 INFO:teuthology.orchestra.run.smithi017.stdout: osd failsafe full ratio = 0.95 2024-09-13T23:04:24.548 INFO:teuthology.orchestra.run.smithi017.stdout: osd objectstore = bluestore 2024-09-13T23:04:24.548 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.548 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr] 2024-09-13T23:04:24.548 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-13T23:04:24.548 INFO:teuthology.orchestra.run.smithi017.stdout: debug mgr = 20 2024-09-13T23:04:24.548 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2024-09-13T23:04:24.548 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2024-09-13T23:04:24.548 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2024-09-13T23:04:24.548 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2024-09-13T23:04:24.548 INFO:teuthology.orchestra.run.smithi017.stdout: mgr/telemetry/nag = false 2024-09-13T23:04:24.548 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.549 INFO:teuthology.orchestra.run.smithi017.stdout:[mon] 2024-09-13T23:04:24.549 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-13T23:04:24.549 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2024-09-13T23:04:24.549 INFO:teuthology.orchestra.run.smithi017.stdout: debug paxos = 20 2024-09-13T23:04:24.549 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2024-09-13T23:04:24.549 INFO:teuthology.orchestra.run.smithi017.stdout: mon data avail warn = 5 2024-09-13T23:04:24.549 INFO:teuthology.orchestra.run.smithi017.stdout: mon mgr mkfs grace = 240 2024-09-13T23:04:24.549 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2024-09-13T23:04:24.549 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd reporter subtree level = osd 2024-09-13T23:04:24.549 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd prime pg temp = true 2024-09-13T23:04:24.549 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2024-09-13T23:04:24.549 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.549 INFO:teuthology.orchestra.run.smithi017.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T23:04:24.549 INFO:teuthology.orchestra.run.smithi017.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T23:04:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T23:04:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T23:04:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T23:04:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T23:04:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: # 1m isn't quite enough 2024-09-13T23:04:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: mon_down_mkfs_grace = 2m 2024-09-13T23:04:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_filestore_osds = false 2024-09-13T23:04:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:24.550 INFO:teuthology.orchestra.run.smithi017.stdout:[client] 2024-09-13T23:04:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: rgw cache enabled = true 2024-09-13T23:04:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable ops log = true 2024-09-13T23:04:24.550 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable usage log = true 2024-09-13T23:04:24.551 INFO:teuthology.orchestra.run.smithi017.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T23:04:24.551 INFO:teuthology.orchestra.run.smithi017.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T23:04:24.551 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-13T23:04:24.551 INFO:teuthology.orchestra.run.smithi017.stdout: rgw gc obj min wait = 15 2024-09-13T23:04:24.551 INFO:teuthology.orchestra.run.smithi017.stdout: debug rgw = 20 2024-09-13T23:04:24.551 INFO:teuthology.orchestra.run.smithi017.stdout: setgroup = ceph 2024-09-13T23:04:24.551 INFO:teuthology.orchestra.run.smithi017.stdout: setuser = ceph 2024-09-13T23:04:24.551 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.a] 2024-09-13T23:04:24.551 INFO:teuthology.orchestra.run.smithi164.stdout:[global] 2024-09-13T23:04:24.552 INFO:teuthology.orchestra.run.smithi164.stdout: chdir = "" 2024-09-13T23:04:24.552 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T23:04:24.552 INFO:teuthology.orchestra.run.smithi164.stdout: auth supported = cephx 2024-09-13T23:04:24.552 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.552 INFO:teuthology.orchestra.run.smithi164.stdout: filestore xattr use omap = true 2024-09-13T23:04:24.552 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.552 INFO:teuthology.orchestra.run.smithi164.stdout: mon clock drift allowed = 1.000 2024-09-13T23:04:24.552 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.552 INFO:teuthology.orchestra.run.smithi164.stdout: osd crush chooseleaf type = 0 2024-09-13T23:04:24.552 INFO:teuthology.orchestra.run.smithi164.stdout: auth debug = true 2024-09-13T23:04:24.552 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.552 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on old message = true 2024-09-13T23:04:24.552 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on bug = true 2024-09-13T23:04:24.552 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.553 INFO:teuthology.orchestra.run.smithi164.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T23:04:24.553 INFO:teuthology.orchestra.run.smithi164.stdout: mon pg warn max object skew = 0 2024-09-13T23:04:24.553 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.553 INFO:teuthology.orchestra.run.smithi164.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T23:04:24.553 INFO:teuthology.orchestra.run.smithi164.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T23:04:24.553 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.553 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default size = 2 2024-09-13T23:04:24.553 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.553 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow primary affinity = true 2024-09-13T23:04:24.553 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow pg remap = true 2024-09-13T23:04:24.553 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on legacy crush tunables = false 2024-09-13T23:04:24.553 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on crush straw calc version zero = false 2024-09-13T23:04:24.553 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on no sortbitwise = false 2024-09-13T23:04:24.553 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on osd down out interval zero = false 2024-09-13T23:04:24.553 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on too few osds = false 2024-09-13T23:04:24.554 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T23:04:24.554 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T23:04:24.554 INFO:teuthology.orchestra.run.smithi164.stdout: mon_allow_pool_size_one = true 2024-09-13T23:04:24.554 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.554 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T23:04:24.554 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.554 INFO:teuthology.orchestra.run.smithi164.stdout: osd default data pool replay window = 5 2024-09-13T23:04:24.554 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.554 INFO:teuthology.orchestra.run.smithi164.stdout: mon allow pool delete = true 2024-09-13T23:04:24.554 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.554 INFO:teuthology.orchestra.run.smithi164.stdout: mon cluster log file level = debug 2024-09-13T23:04:24.554 INFO:teuthology.orchestra.run.smithi164.stdout: debug asserts on shutdown = true 2024-09-13T23:04:24.554 INFO:teuthology.orchestra.run.smithi164.stdout: mon health detail to clog = false 2024-09-13T23:04:24.554 INFO:teuthology.orchestra.run.smithi164.stdout: mon host = 172.21.15.17 2024-09-13T23:04:24.554 INFO:teuthology.orchestra.run.smithi164.stdout: fsid = cf23c940-4ed5-4d79-b536-21dd117d26cb 2024-09-13T23:04:24.554 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.555 INFO:teuthology.orchestra.run.smithi164.stdout:[osd] 2024-09-13T23:04:24.555 INFO:teuthology.orchestra.run.smithi164.stdout: osd journal size = 100 2024-09-13T23:04:24.555 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.555 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub load threshold = 5.0 2024-09-13T23:04:24.555 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub max interval = 600 2024-09-13T23:04:24.555 INFO:teuthology.orchestra.run.smithi164.stdout: osd mclock profile = high_recovery_ops 2024-09-13T23:04:24.555 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.555 INFO:teuthology.orchestra.run.smithi164.stdout: osd recover clone overlap = true 2024-09-13T23:04:24.555 INFO:teuthology.orchestra.run.smithi164.stdout: osd recovery max chunk = 1048576 2024-09-13T23:04:24.555 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.555 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug shutdown = true 2024-09-13T23:04:24.555 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug op order = true 2024-09-13T23:04:24.555 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug verify stray on activate = true 2024-09-13T23:04:24.555 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug trim objects = true 2024-09-13T23:04:24.556 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.556 INFO:teuthology.orchestra.run.smithi164.stdout: osd open classes on start = true 2024-09-13T23:04:24.556 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug pg log writeout = true 2024-09-13T23:04:24.556 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.556 INFO:teuthology.orchestra.run.smithi164.stdout: osd deep scrub update digest min age = 30 2024-09-13T23:04:24.556 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.556 INFO:teuthology.orchestra.run.smithi164.stdout: osd map max advance = 10 2024-09-13T23:04:24.556 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.556 INFO:teuthology.orchestra.run.smithi164.stdout: journal zero on create = true 2024-09-13T23:04:24.556 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.556 INFO:teuthology.orchestra.run.smithi164.stdout: filestore ondisk finisher threads = 3 2024-09-13T23:04:24.556 INFO:teuthology.orchestra.run.smithi164.stdout: filestore apply finisher threads = 3 2024-09-13T23:04:24.556 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.556 INFO:teuthology.orchestra.run.smithi164.stdout: bdev debug aio = true 2024-09-13T23:04:24.556 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug misdirected ops = true 2024-09-13T23:04:24.557 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-13T23:04:24.557 INFO:teuthology.orchestra.run.smithi164.stdout: debug objclass = 20 2024-09-13T23:04:24.557 INFO:teuthology.orchestra.run.smithi164.stdout: bdev async discard = True 2024-09-13T23:04:24.557 INFO:teuthology.orchestra.run.smithi164.stdout: bdev enable discard = True 2024-09-13T23:04:24.557 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore allocator = bitmap 2024-09-13T23:04:24.557 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore block size = 96636764160 2024-09-13T23:04:24.557 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore fsck on mount = True 2024-09-13T23:04:24.557 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluefs = 1/20 2024-09-13T23:04:24.557 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluestore = 1/20 2024-09-13T23:04:24.557 INFO:teuthology.orchestra.run.smithi164.stdout: debug osd = 20 2024-09-13T23:04:24.557 INFO:teuthology.orchestra.run.smithi164.stdout: debug rocksdb = 4/10 2024-09-13T23:04:24.557 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T23:04:24.557 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd full ratio = 0.9 2024-09-13T23:04:24.558 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd nearfull ratio = 0.8 2024-09-13T23:04:24.558 INFO:teuthology.orchestra.run.smithi164.stdout: osd failsafe full ratio = 0.95 2024-09-13T23:04:24.558 INFO:teuthology.orchestra.run.smithi164.stdout: osd objectstore = bluestore 2024-09-13T23:04:24.558 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.558 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr] 2024-09-13T23:04:24.558 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-13T23:04:24.558 INFO:teuthology.orchestra.run.smithi164.stdout: debug mgr = 20 2024-09-13T23:04:24.558 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-09-13T23:04:24.558 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-09-13T23:04:24.558 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-09-13T23:04:24.558 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-09-13T23:04:24.559 INFO:teuthology.orchestra.run.smithi164.stdout: mgr/telemetry/nag = false 2024-09-13T23:04:24.559 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.559 INFO:teuthology.orchestra.run.smithi164.stdout:[mon] 2024-09-13T23:04:24.559 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-13T23:04:24.559 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-09-13T23:04:24.559 INFO:teuthology.orchestra.run.smithi164.stdout: debug paxos = 20 2024-09-13T23:04:24.559 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-09-13T23:04:24.560 INFO:teuthology.orchestra.run.smithi164.stdout: mon data avail warn = 5 2024-09-13T23:04:24.560 INFO:teuthology.orchestra.run.smithi164.stdout: mon mgr mkfs grace = 240 2024-09-13T23:04:24.560 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-09-13T23:04:24.560 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd reporter subtree level = osd 2024-09-13T23:04:24.560 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd prime pg temp = true 2024-09-13T23:04:24.560 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-09-13T23:04:24.560 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.560 INFO:teuthology.orchestra.run.smithi164.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T23:04:24.561 INFO:teuthology.orchestra.run.smithi164.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T23:04:24.561 INFO:teuthology.orchestra.run.smithi164.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T23:04:24.561 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.561 INFO:teuthology.orchestra.run.smithi164.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T23:04:24.561 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T23:04:24.561 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T23:04:24.561 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.561 INFO:teuthology.orchestra.run.smithi164.stdout: # 1m isn't quite enough 2024-09-13T23:04:24.561 INFO:teuthology.orchestra.run.smithi164.stdout: mon_down_mkfs_grace = 2m 2024-09-13T23:04:24.561 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.561 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_filestore_osds = false 2024-09-13T23:04:24.561 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-13T23:04:24.561 INFO:teuthology.orchestra.run.smithi164.stdout:[client] 2024-09-13T23:04:24.561 INFO:teuthology.orchestra.run.smithi164.stdout: rgw cache enabled = true 2024-09-13T23:04:24.561 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable ops log = true 2024-09-13T23:04:24.562 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable usage log = true 2024-09-13T23:04:24.562 INFO:teuthology.orchestra.run.smithi164.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T23:04:24.562 INFO:teuthology.orchestra.run.smithi164.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T23:04:24.562 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-13T23:04:24.562 INFO:teuthology.orchestra.run.smithi164.stdout: rgw gc obj min wait = 15 2024-09-13T23:04:24.562 INFO:teuthology.orchestra.run.smithi164.stdout: debug rgw = 20 2024-09-13T23:04:24.562 INFO:teuthology.orchestra.run.smithi164.stdout: setgroup = ceph 2024-09-13T23:04:24.562 INFO:teuthology.orchestra.run.smithi164.stdout: setuser = ceph 2024-09-13T23:04:24.562 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.a] 2024-09-13T23:04:24.564 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T23:04:24.564 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T23:04:24.660 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T23:04:24.660 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T23:04:24.660 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T23:04:24.676 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T23:04:24.676 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T23:04:24.733 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi017.front.sepia.ceph.com 2024-09-13T23:04:24.733 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T23:04:24.734 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T23:04:24.734 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T23:04:24.810 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T23:04:24.810 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T23:04:24.866 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi164.front.sepia.ceph.com 2024-09-13T23:04:24.866 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-13T23:04:24.866 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T23:04:24.867 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T23:04:24.905 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-13T23:04:24.905 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T23:04:24.963 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T23:04:24.964 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T23:04:24.964 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T23:04:25.077 INFO:teuthology.orchestra.run.smithi164.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T23:04:25.080 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T23:04:25.080 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T23:04:25.081 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T23:04:25.123 INFO:teuthology.orchestra.run.smithi164.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T23:04:25.136 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T23:04:25.136 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi017.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-13T23:04:25.136 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T23:04:25.163 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-13T23:04:25.164 INFO:tasks.ceph:role: osd.0 2024-09-13T23:04:25.164 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-13T23:04:25.164 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T23:04:25.230 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T23:04:25.230 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T23:04:25.230 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T23:04:25.230 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T23:04:25.230 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T23:04:25.230 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-09-13T23:04:25.230 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T23:04:25.230 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T23:04:25.230 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T23:04:25.230 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T23:04:25.263 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-09-13T23:04:25.264 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-09-13T23:04:25.264 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T23:04:25.334 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T23:04:25.405 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T23:04:25.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:25.650+0000 7f59652ef640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T23:04:25.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:25.650+0000 7f59652ef640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T23:04:25.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:25.650+0000 7f59652ef640 -1 bdev(0x55accf84b800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-13T23:04:25.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:25.650+0000 7f59652ef640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T23:04:28.828 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T23:04:28.859 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T23:04:28.890 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T23:04:28.890 INFO:tasks.ceph:role: osd.1 2024-09-13T23:04:28.891 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-13T23:04:28.891 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T23:04:28.967 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T23:04:28.967 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T23:04:28.967 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T23:04:28.967 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T23:04:28.967 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T23:04:28.968 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-09-13T23:04:28.968 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T23:04:28.968 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T23:04:28.968 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T23:04:28.968 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T23:04:29.486 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-09-13T23:04:29.488 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-09-13T23:04:29.488 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-13T23:04:29.614 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T23:04:29.647 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T23:04:29.714 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T23:04:29.715 INFO:tasks.ceph:role: osd.2 2024-09-13T23:04:29.715 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-13T23:04:29.715 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T23:04:29.788 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T23:04:29.789 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T23:04:29.789 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T23:04:29.789 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T23:04:29.789 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T23:04:29.789 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-09-13T23:04:29.789 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T23:04:29.789 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T23:04:29.789 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T23:04:29.789 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T23:04:30.247 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-09-13T23:04:30.250 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-09-13T23:04:30.250 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-13T23:04:30.342 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T23:04:30.371 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T23:04:30.436 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T23:04:30.437 INFO:tasks.ceph:role: osd.3 2024-09-13T23:04:30.437 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-13T23:04:30.437 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T23:04:30.510 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T23:04:30.510 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T23:04:30.510 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T23:04:30.510 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T23:04:30.510 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T23:04:30.510 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-09-13T23:04:30.510 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T23:04:30.511 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T23:04:30.511 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T23:04:30.511 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T23:04:30.992 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-09-13T23:04:30.994 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-09-13T23:04:30.995 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-13T23:04:31.142 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T23:04:31.175 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T23:04:31.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:31.266+0000 7f954461a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T23:04:31.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:31.270+0000 7f954461a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T23:04:31.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:31.271+0000 7f954461a640 -1 bdev(0x55dacd0f3800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-13T23:04:31.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:31.271+0000 7f954461a640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T23:04:34.681 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T23:04:34.710 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T23:04:34.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:34.798+0000 7f40e5410640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T23:04:34.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:34.799+0000 7f40e5410640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T23:04:34.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:34.799+0000 7f40e5410640 -1 bdev(0x55c2cb475800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-13T23:04:34.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:34.799+0000 7f40e5410640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T23:04:38.707 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T23:04:38.737 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T23:04:38.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:38.826+0000 7f1cd5f29640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T23:04:38.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:38.826+0000 7f1cd5f29640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T23:04:38.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:38.826+0000 7f1cd5f29640 -1 bdev(0x5629dfab3800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-13T23:04:38.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:38.826+0000 7f1cd5f29640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T23:04:42.727 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T23:04:42.756 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T23:04:42.757 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T23:04:42.757 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T23:04:42.789 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-13T23:04:42.789 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T23:04:42.825 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-13T23:04:42.825 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T23:04:42.892 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-13T23:04:42.893 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T23:04:42.959 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-13T23:04:42.959 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T23:04:43.025 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-13T23:04:43.025 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T23:04:43.081 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T23:04:43.082 DEBUG:teuthology.orchestra.run.smithi017:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T23:04:43.111 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.0] 2024-09-13T23:04:43.112 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQD5xORmTuDLJhAALQyjokak4fo+D6dKQ8/o9w== 2024-09-13T23:04:43.112 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr.x] 2024-09-13T23:04:43.112 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQD5xORmy2yaBBAAqztHYfQoVDm5+BJ3u0jygQ== 2024-09-13T23:04:43.112 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.1] 2024-09-13T23:04:43.112 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQD/xORmOg3yDxAARi89IVaslRuT6OZ9Tb6ERw== 2024-09-13T23:04:43.112 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.2] 2024-09-13T23:04:43.112 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQACxeRmAaizLxAAq/PSIfAwB2aFYhVH+6F+rA== 2024-09-13T23:04:43.112 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.3] 2024-09-13T23:04:43.112 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAGxeRmhpFXMRAArXz2yheIJu4GsCf/AX1wXA== 2024-09-13T23:04:43.112 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-09-13T23:04:43.112 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQD5xORm+dFgBxAA9Z4ETScX4/c2BnYvnGTfYA== 2024-09-13T23:04:43.113 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T23:04:43.214 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T23:04:43.270 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T23:04:43.323 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T23:04:43.375 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T23:04:43.427 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T23:04:43.481 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T23:04:43.482 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T23:04:43.507 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T23:04:43.605 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T23:04:43.631 DEBUG:teuthology.orchestra.run.smithi017:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T23:04:43.688 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T23:04:43.688 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T23:04:43.689 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T23:04:43.731 INFO:tasks.ceph.mon.a:Started 2024-09-13T23:04:43.731 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T23:04:43.731 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T23:04:43.731 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T23:04:43.734 INFO:tasks.ceph.mgr.x:Started 2024-09-13T23:04:43.734 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T23:04:43.734 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T23:04:43.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.833+0000 7f4392bc4640 1 Processor -- start 2024-09-13T23:04:43.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.833+0000 7f4392bc4640 1 -- start start 2024-09-13T23:04:43.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.833+0000 7f4392bc4640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f438c074e50 0x7f438c130920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:43.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.833+0000 7f4392bc4640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f438c06d740 con 0x7f438c12b380 2024-09-13T23:04:43.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.833+0000 7f4392bc4640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f438c09e100 con 0x7f438c074e50 2024-09-13T23:04:43.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.833+0000 7f438bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f438c074e50 0x7f438c130920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:43.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.833+0000 7f438bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f438c074e50 0x7f438c130920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50008/0 (socket says 172.21.15.17:50008) 2024-09-13T23:04:43.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.833+0000 7f438bfff640 1 -- 172.21.15.17:0/1543121056 learned_addr learned my addr 172.21.15.17:0/1543121056 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:04:43.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.833+0000 7f4390960640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f438c12b380 0x7f438c12b760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:33270/0 (socket says 172.21.15.17:33270) 2024-09-13T23:04:43.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.834+0000 7f438bfff640 1 -- 172.21.15.17:0/1543121056 >> v1:172.21.15.17:6789/0 conn(0x7f438c12b380 legacy=0x7f438c12b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:43.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.834+0000 7f438bfff640 1 -- 172.21.15.17:0/1543121056 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f438c06daf0 con 0x7f438c074e50 2024-09-13T23:04:43.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.835+0000 7f438bfff640 1 --2- 172.21.15.17:0/1543121056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f438c074e50 0x7f438c130920 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f437800ba90 tx=0x7f437802c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57341da6603e25ad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:43.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.835+0000 7f438b7fe640 1 -- 172.21.15.17:0/1543121056 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4378033570 con 0x7f438c074e50 2024-09-13T23:04:43.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.835+0000 7f438b7fe640 1 -- 172.21.15.17:0/1543121056 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4378038070 con 0x7f438c074e50 2024-09-13T23:04:43.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.835+0000 7f438b7fe640 1 -- 172.21.15.17:0/1543121056 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4378033860 con 0x7f438c074e50 2024-09-13T23:04:43.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.836+0000 7f4392bc4640 1 -- 172.21.15.17:0/1543121056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f438c074e50 msgr2=0x7f438c130920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:43.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.836+0000 7f4392bc4640 1 --2- 172.21.15.17:0/1543121056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f438c074e50 0x7f438c130920 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f437800ba90 tx=0x7f437802c8b0 comp rx=0 tx=0).stop 2024-09-13T23:04:43.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.836+0000 7f4392bc4640 1 -- 172.21.15.17:0/1543121056 shutdown_connections 2024-09-13T23:04:43.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.836+0000 7f4392bc4640 1 --2- 172.21.15.17:0/1543121056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f438c074e50 0x7f438c130920 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:43.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.836+0000 7f4392bc4640 1 -- 172.21.15.17:0/1543121056 >> 172.21.15.17:0/1543121056 conn(0x7f438c09d5e0 msgr2=0x7f438c09d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:43.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.836+0000 7f4392bc4640 1 -- 172.21.15.17:0/1543121056 shutdown_connections 2024-09-13T23:04:43.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.836+0000 7f4392bc4640 1 -- 172.21.15.17:0/1543121056 wait complete. 2024-09-13T23:04:43.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.837+0000 7f4392bc4640 1 Processor -- start 2024-09-13T23:04:43.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.837+0000 7f4392bc4640 1 -- start start 2024-09-13T23:04:43.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.837+0000 7f4392bc4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f438c074e50 0x7f438c1224f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:43.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.837+0000 7f4392bc4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f438c094b20 con 0x7f438c074e50 2024-09-13T23:04:43.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.837+0000 7f4390960640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f438c074e50 0x7f438c1224f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:43.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.838+0000 7f4390960640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f438c074e50 0x7f438c1224f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50010/0 (socket says 172.21.15.17:50010) 2024-09-13T23:04:43.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.838+0000 7f4390960640 1 -- 172.21.15.17:0/3304822615 learned_addr learned my addr 172.21.15.17:0/3304822615 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:04:43.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.838+0000 7f4390960640 1 -- 172.21.15.17:0/3304822615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f438c123d90 con 0x7f438c074e50 2024-09-13T23:04:43.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.838+0000 7f4390960640 1 --2- 172.21.15.17:0/3304822615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f438c074e50 0x7f438c1224f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f438000c450 tx=0x7f438000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:43.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.838+0000 7f43897fa640 1 -- 172.21.15.17:0/3304822615 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4380007410 con 0x7f438c074e50 2024-09-13T23:04:43.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.838+0000 7f43897fa640 1 -- 172.21.15.17:0/3304822615 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43800075b0 con 0x7f438c074e50 2024-09-13T23:04:43.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.838+0000 7f4392bc4640 1 -- 172.21.15.17:0/3304822615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f438c125630 con 0x7f438c074e50 2024-09-13T23:04:43.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.838+0000 7f43897fa640 1 -- 172.21.15.17:0/3304822615 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4380004910 con 0x7f438c074e50 2024-09-13T23:04:43.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.838+0000 7f4392bc4640 1 -- 172.21.15.17:0/3304822615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f438c128eb0 con 0x7f438c074e50 2024-09-13T23:04:43.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.838+0000 7f43897fa640 1 -- 172.21.15.17:0/3304822615 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f438001a020 con 0x7f438c074e50 2024-09-13T23:04:43.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.838+0000 7f43897fa640 1 -- 172.21.15.17:0/3304822615 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f438001c570 con 0x7f438c074e50 2024-09-13T23:04:43.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.839+0000 7f4392bc4640 1 -- 172.21.15.17:0/3304822615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f438c0008d0 con 0x7f438c074e50 2024-09-13T23:04:43.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.841+0000 7f43897fa640 1 -- 172.21.15.17:0/3304822615 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4380021070 con 0x7f438c074e50 2024-09-13T23:04:43.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.905+0000 7f4392bc4640 1 -- 172.21.15.17:0/3304822615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f438c124e20 con 0x7f438c074e50 2024-09-13T23:04:43.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.906+0000 7f43897fa640 1 -- 172.21.15.17:0/3304822615 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f438001c9a0 con 0x7f438c074e50 2024-09-13T23:04:43.907 INFO:teuthology.orchestra.run.smithi017.stderr:adjusted tunables profile to default 2024-09-13T23:04:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.906+0000 7f4392bc4640 1 -- 172.21.15.17:0/3304822615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f438c074e50 msgr2=0x7f438c1224f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.906+0000 7f4392bc4640 1 --2- 172.21.15.17:0/3304822615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f438c074e50 0x7f438c1224f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f438000c450 tx=0x7f438000c910 comp rx=0 tx=0).stop 2024-09-13T23:04:43.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.906+0000 7f4392bc4640 1 -- 172.21.15.17:0/3304822615 shutdown_connections 2024-09-13T23:04:43.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.906+0000 7f4392bc4640 1 --2- 172.21.15.17:0/3304822615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f438c074e50 0x7f438c1224f0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:43.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.906+0000 7f4392bc4640 1 -- 172.21.15.17:0/3304822615 >> 172.21.15.17:0/3304822615 conn(0x7f438c09d5e0 msgr2=0x7f438c097bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:43.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.906+0000 7f4392bc4640 1 -- 172.21.15.17:0/3304822615 shutdown_connections 2024-09-13T23:04:43.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:43.907+0000 7f4392bc4640 1 -- 172.21.15.17:0/3304822615 wait complete. 2024-09-13T23:04:43.918 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T23:04:43.918 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T23:04:43.919 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-13T23:04:43.919 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T23:04:43.944 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-13T23:04:43.944 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T23:04:43.970 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-13T23:04:43.970 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T23:04:44.036 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-13T23:04:44.036 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T23:04:44.101 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 1aaccac6-e1e9-4353-846a-47ea97c7bafd 0 2024-09-13T23:04:44.118 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-13T23:04:44.116+0000 7f1978b78040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T23:04:44.161 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-13T23:04:44.160+0000 7f1978b78040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T23:04:44.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.215+0000 7f3fe3877640 1 Processor -- start 2024-09-13T23:04:44.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.215+0000 7f3fe3877640 1 -- start start 2024-09-13T23:04:44.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.215+0000 7f3fe3877640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3fdc118af0 0x7f3fdc11aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:44.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.215+0000 7f3fe3877640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fdc11b420 con 0x7f3fdc114c40 2024-09-13T23:04:44.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.215+0000 7f3fe3877640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f3fdc11c620 con 0x7f3fdc118af0 2024-09-13T23:04:44.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.215+0000 7f3fe0e12640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3fdc118af0 0x7f3fdc11aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:44.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.215+0000 7f3fe0e12640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3fdc118af0 0x7f3fdc11aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54352/0 (socket says 172.21.15.164:54352) 2024-09-13T23:04:44.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.216+0000 7f3fe0e12640 1 -- 172.21.15.164:0/1154620128 learned_addr learned my addr 172.21.15.164:0/1154620128 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:04:44.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.216+0000 7f3fe1613640 1 --1- 172.21.15.164:0/1154620128 >> v1:172.21.15.17:6789/0 conn(0x7f3fdc114c40 0x7f3fdc115020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:33354/0 (socket says 172.21.15.164:33354) 2024-09-13T23:04:44.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.216+0000 7f3fe0e12640 1 -- 172.21.15.164:0/1154620128 >> v1:172.21.15.17:6789/0 conn(0x7f3fdc114c40 legacy=0x7f3fdc115020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:44.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.216+0000 7f3fe0e12640 1 -- 172.21.15.164:0/1154620128 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fdc11c7d0 con 0x7f3fdc118af0 2024-09-13T23:04:44.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.217+0000 7f3fe0e12640 1 --2- 172.21.15.164:0/1154620128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fdc118af0 0x7f3fdc11aee0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc0097f0 tx=0x7f3fcc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f36f0049ab3f7d95 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:44.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.217+0000 7f3fd3fff640 1 -- 172.21.15.164:0/1154620128 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fcc037070 con 0x7f3fdc118af0 2024-09-13T23:04:44.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.217+0000 7f3fd3fff640 1 -- 172.21.15.164:0/1154620128 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fcc032440 con 0x7f3fdc118af0 2024-09-13T23:04:44.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.217+0000 7f3fd3fff640 1 -- 172.21.15.164:0/1154620128 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fcc02ae60 con 0x7f3fdc118af0 2024-09-13T23:04:44.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.217+0000 7f3fe3877640 1 -- 172.21.15.164:0/1154620128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fdc118af0 msgr2=0x7f3fdc11aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:44.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.217+0000 7f3fe3877640 1 --2- 172.21.15.164:0/1154620128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fdc118af0 0x7f3fdc11aee0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc0097f0 tx=0x7f3fcc02a1e0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.217+0000 7f3fe3877640 1 -- 172.21.15.164:0/1154620128 shutdown_connections 2024-09-13T23:04:44.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.217+0000 7f3fe3877640 1 --2- 172.21.15.164:0/1154620128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fdc118af0 0x7f3fdc11aee0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.217+0000 7f3fe3877640 1 -- 172.21.15.164:0/1154620128 >> 172.21.15.164:0/1154620128 conn(0x7f3fdc06ff70 msgr2=0x7f3fdc072390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:44.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.217+0000 7f3fe3877640 1 -- 172.21.15.164:0/1154620128 shutdown_connections 2024-09-13T23:04:44.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.217+0000 7f3fe3877640 1 -- 172.21.15.164:0/1154620128 wait complete. 2024-09-13T23:04:44.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.218+0000 7f3fe3877640 1 Processor -- start 2024-09-13T23:04:44.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.218+0000 7f3fe3877640 1 -- start start 2024-09-13T23:04:44.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.218+0000 7f3fe3877640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fdc114c40 0x7f3fdc1a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:44.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.218+0000 7f3fe3877640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3fdc11bad0 con 0x7f3fdc114c40 2024-09-13T23:04:44.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.218+0000 7f3fe1613640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fdc114c40 0x7f3fdc1a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:44.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.218+0000 7f3fe1613640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fdc114c40 0x7f3fdc1a4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54358/0 (socket says 172.21.15.164:54358) 2024-09-13T23:04:44.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.218+0000 7f3fe1613640 1 -- 172.21.15.164:0/2736446690 learned_addr learned my addr 172.21.15.164:0/2736446690 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:04:44.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.219+0000 7f3fe1613640 1 -- 172.21.15.164:0/2736446690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fdc1a4f50 con 0x7f3fdc114c40 2024-09-13T23:04:44.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.219+0000 7f3fe1613640 1 --2- 172.21.15.164:0/2736446690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fdc114c40 0x7f3fdc1a4a10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800c450 tx=0x7f3fd800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:44.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.219+0000 7f3fd1ffb640 1 -- 172.21.15.164:0/2736446690 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fd8007410 con 0x7f3fdc114c40 2024-09-13T23:04:44.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.219+0000 7f3fd1ffb640 1 -- 172.21.15.164:0/2736446690 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fd80075b0 con 0x7f3fdc114c40 2024-09-13T23:04:44.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.219+0000 7f3fe3877640 1 -- 172.21.15.164:0/2736446690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fdc1a5240 con 0x7f3fdc114c40 2024-09-13T23:04:44.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.219+0000 7f3fd1ffb640 1 -- 172.21.15.164:0/2736446690 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fd8004910 con 0x7f3fdc114c40 2024-09-13T23:04:44.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.219+0000 7f3fe3877640 1 -- 172.21.15.164:0/2736446690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fdc1a9370 con 0x7f3fdc114c40 2024-09-13T23:04:44.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.219+0000 7f3fd1ffb640 1 -- 172.21.15.164:0/2736446690 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3fd801a020 con 0x7f3fdc114c40 2024-09-13T23:04:44.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.220+0000 7f3fd1ffb640 1 -- 172.21.15.164:0/2736446690 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f3fd8012710 con 0x7f3fdc114c40 2024-09-13T23:04:44.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.220+0000 7f3fe3877640 1 -- 172.21.15.164:0/2736446690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fdc11c090 con 0x7f3fdc114c40 2024-09-13T23:04:44.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.223+0000 7f3fd1ffb640 1 -- 172.21.15.164:0/2736446690 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3fd8021070 con 0x7f3fdc114c40 2024-09-13T23:04:44.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.292+0000 7f3fe3877640 1 -- 172.21.15.164:0/2736446690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1aaccac6-e1e9-4353-846a-47ea97c7bafd", "id": 0} v 0) -- 0x7f3fdc1a5470 con 0x7f3fdc114c40 2024-09-13T23:04:44.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.293+0000 7f3fd1ffb640 1 -- 172.21.15.164:0/2736446690 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1aaccac6-e1e9-4353-846a-47ea97c7bafd", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f3fd8012a90 con 0x7f3fdc114c40 2024-09-13T23:04:44.295 INFO:teuthology.orchestra.run.smithi164.stdout:0 2024-09-13T23:04:44.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.294+0000 7f3fe3877640 1 -- 172.21.15.164:0/2736446690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fdc114c40 msgr2=0x7f3fdc1a4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:44.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.294+0000 7f3fe3877640 1 --2- 172.21.15.164:0/2736446690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fdc114c40 0x7f3fdc1a4a10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800c450 tx=0x7f3fd800c910 comp rx=0 tx=0).stop 2024-09-13T23:04:44.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.294+0000 7f3fe3877640 1 -- 172.21.15.164:0/2736446690 shutdown_connections 2024-09-13T23:04:44.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.294+0000 7f3fe3877640 1 --2- 172.21.15.164:0/2736446690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fdc114c40 0x7f3fdc1a4a10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.294+0000 7f3fe3877640 1 -- 172.21.15.164:0/2736446690 >> 172.21.15.164:0/2736446690 conn(0x7f3fdc06ff70 msgr2=0x7f3fdc1197b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:44.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.294+0000 7f3fe3877640 1 -- 172.21.15.164:0/2736446690 shutdown_connections 2024-09-13T23:04:44.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.294+0000 7f3fe3877640 1 -- 172.21.15.164:0/2736446690 wait complete. 2024-09-13T23:04:44.306 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new ea6cecf5-527b-441a-96f0-942169c28c19 1 2024-09-13T23:04:44.314 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-13T23:04:44.313+0000 7f1978b78040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T23:04:44.368 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-13T23:04:44.366+0000 7f1978b78040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T23:04:44.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.403+0000 7f8216333640 1 Processor -- start 2024-09-13T23:04:44.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.403+0000 7f8216333640 1 -- start start 2024-09-13T23:04:44.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.403+0000 7f8216333640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f821006d3f0 0x7f821006d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:44.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.403+0000 7f8216333640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f821006e1c0 con 0x7f821006dd10 2024-09-13T23:04:44.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.403+0000 7f8216333640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f821011e930 con 0x7f821006d3f0 2024-09-13T23:04:44.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.404+0000 7f820ffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f821006d3f0 0x7f821006d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:44.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.404+0000 7f820f7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f821006dd10 0x7f821011c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:33358/0 (socket says 172.21.15.164:33358) 2024-09-13T23:04:44.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.404+0000 7f820f7fe640 1 -- 172.21.15.164:0/2457260364 learned_addr learned my addr 172.21.15.164:0/2457260364 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:04:44.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.404+0000 7f820ffff640 1 -- 172.21.15.164:0/2457260364 >> v1:172.21.15.17:6789/0 conn(0x7f821006dd10 legacy=0x7f821011c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:44.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.404+0000 7f820ffff640 1 -- 172.21.15.164:0/2457260364 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f821011eab0 con 0x7f821006d3f0 2024-09-13T23:04:44.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.404+0000 7f820effd640 1 -- 172.21.15.164:0/2457260364 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1858862437 0 0) 0x7f821006e1c0 con 0x7f821006dd10 2024-09-13T23:04:44.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.405+0000 7f820ffff640 1 --2- 172.21.15.164:0/2457260364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f821006d3f0 0x7f821006d7d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8200009720 tx=0x7f820002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28e9d54b7bbdf797 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:44.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.405+0000 7f820effd640 1 -- 172.21.15.164:0/2457260364 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8200037070 con 0x7f821006d3f0 2024-09-13T23:04:44.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.405+0000 7f820effd640 1 -- 172.21.15.164:0/2457260364 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f820002ad90 con 0x7f821006d3f0 2024-09-13T23:04:44.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.405+0000 7f820effd640 1 -- 172.21.15.164:0/2457260364 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8200032590 con 0x7f821006d3f0 2024-09-13T23:04:44.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.405+0000 7f8216333640 1 -- 172.21.15.164:0/2457260364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f821006d3f0 msgr2=0x7f821006d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:44.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.405+0000 7f8216333640 1 --2- 172.21.15.164:0/2457260364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f821006d3f0 0x7f821006d7d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8200009720 tx=0x7f820002a110 comp rx=0 tx=0).stop 2024-09-13T23:04:44.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.406+0000 7f8216333640 1 -- 172.21.15.164:0/2457260364 shutdown_connections 2024-09-13T23:04:44.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.406+0000 7f8216333640 1 --2- 172.21.15.164:0/2457260364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f821006d3f0 0x7f821006d7d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.406+0000 7f8216333640 1 -- 172.21.15.164:0/2457260364 >> 172.21.15.164:0/2457260364 conn(0x7f8210071290 msgr2=0x7f82100736b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:44.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.406+0000 7f8216333640 1 -- 172.21.15.164:0/2457260364 shutdown_connections 2024-09-13T23:04:44.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.406+0000 7f8216333640 1 -- 172.21.15.164:0/2457260364 wait complete. 2024-09-13T23:04:44.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.406+0000 7f8216333640 1 Processor -- start 2024-09-13T23:04:44.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.406+0000 7f8216333640 1 -- start start 2024-09-13T23:04:44.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.407+0000 7f8216333640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f821006d3f0 0x7f82101a6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:44.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.407+0000 7f8216333640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f821011de00 con 0x7f821006d3f0 2024-09-13T23:04:44.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.407+0000 7f820ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f821006d3f0 0x7f82101a6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:44.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.407+0000 7f820ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f821006d3f0 0x7f82101a6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54378/0 (socket says 172.21.15.164:54378) 2024-09-13T23:04:44.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.407+0000 7f820ffff640 1 -- 172.21.15.164:0/3700597080 learned_addr learned my addr 172.21.15.164:0/3700597080 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:04:44.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.407+0000 7f820ffff640 1 -- 172.21.15.164:0/3700597080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82101a6fb0 con 0x7f821006d3f0 2024-09-13T23:04:44.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.407+0000 7f820ffff640 1 --2- 172.21.15.164:0/3700597080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f821006d3f0 0x7f82101a6a70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8200009720 tx=0x7f82000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:44.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.407+0000 7f820cff9640 1 -- 172.21.15.164:0/3700597080 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8200041070 con 0x7f821006d3f0 2024-09-13T23:04:44.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.408+0000 7f820cff9640 1 -- 172.21.15.164:0/3700597080 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f820003c460 con 0x7f821006d3f0 2024-09-13T23:04:44.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.408+0000 7f820cff9640 1 -- 172.21.15.164:0/3700597080 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8200037040 con 0x7f821006d3f0 2024-09-13T23:04:44.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.408+0000 7f8216333640 1 -- 172.21.15.164:0/3700597080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82101a7240 con 0x7f821006d3f0 2024-09-13T23:04:44.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.408+0000 7f8216333640 1 -- 172.21.15.164:0/3700597080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82101ab170 con 0x7f821006d3f0 2024-09-13T23:04:44.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.408+0000 7f820cff9640 1 -- 172.21.15.164:0/3700597080 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8200044070 con 0x7f821006d3f0 2024-09-13T23:04:44.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.408+0000 7f820cff9640 1 -- 172.21.15.164:0/3700597080 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f8200046ac0 con 0x7f821006d3f0 2024-09-13T23:04:44.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.409+0000 7f8216333640 1 -- 172.21.15.164:0/3700597080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f821006d850 con 0x7f821006d3f0 2024-09-13T23:04:44.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.411+0000 7f820cff9640 1 -- 172.21.15.164:0/3700597080 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f820003c740 con 0x7f821006d3f0 2024-09-13T23:04:44.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.481+0000 7f8216333640 1 -- 172.21.15.164:0/3700597080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ea6cecf5-527b-441a-96f0-942169c28c19", "id": 1} v 0) -- 0x7f821006dd10 con 0x7f821006d3f0 2024-09-13T23:04:44.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.481+0000 7f820cff9640 1 -- 172.21.15.164:0/3700597080 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ea6cecf5-527b-441a-96f0-942169c28c19", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f820003c920 con 0x7f821006d3f0 2024-09-13T23:04:44.484 INFO:teuthology.orchestra.run.smithi164.stdout:1 2024-09-13T23:04:44.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.482+0000 7f8216333640 1 -- 172.21.15.164:0/3700597080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f821006d3f0 msgr2=0x7f82101a6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:44.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.482+0000 7f8216333640 1 --2- 172.21.15.164:0/3700597080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f821006d3f0 0x7f82101a6a70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8200009720 tx=0x7f82000046c0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.483+0000 7f8216333640 1 -- 172.21.15.164:0/3700597080 shutdown_connections 2024-09-13T23:04:44.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.483+0000 7f8216333640 1 --2- 172.21.15.164:0/3700597080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f821006d3f0 0x7f82101a6a70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.483+0000 7f8216333640 1 -- 172.21.15.164:0/3700597080 >> 172.21.15.164:0/3700597080 conn(0x7f8210071290 msgr2=0x7f821011a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:44.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.483+0000 7f8216333640 1 -- 172.21.15.164:0/3700597080 shutdown_connections 2024-09-13T23:04:44.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.483+0000 7f8216333640 1 -- 172.21.15.164:0/3700597080 wait complete. 2024-09-13T23:04:44.495 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 7e05691a-818f-4fa2-9543-1be239750d9d 2 2024-09-13T23:04:44.534 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-13T23:04:44.532+0000 7f1978b78040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T23:04:44.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.630+0000 7f8b92166640 1 Processor -- start 2024-09-13T23:04:44.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.630+0000 7f8b92166640 1 -- start start 2024-09-13T23:04:44.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.630+0000 7f8b92166640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8b8c117fb0 0x7f8b8c118390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:44.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.630+0000 7f8b92166640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b8c112960 con 0x7f8b8c111da0 2024-09-13T23:04:44.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.630+0000 7f8b92166640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f8b8c118a50 con 0x7f8b8c117fb0 2024-09-13T23:04:44.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.630+0000 7f8b8b7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8b8c117fb0 0x7f8b8c118390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:44.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.631+0000 7f8b8affd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f8b8c111da0 0x7f8b8c112250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:33374/0 (socket says 172.21.15.164:33374) 2024-09-13T23:04:44.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.631+0000 7f8b8affd640 1 -- 172.21.15.164:0/2756748313 learned_addr learned my addr 172.21.15.164:0/2756748313 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:04:44.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.631+0000 7f8b8b7fe640 1 -- 172.21.15.164:0/2756748313 >> v1:172.21.15.17:6789/0 conn(0x7f8b8c111da0 legacy=0x7f8b8c112250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:44.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.631+0000 7f8b8b7fe640 1 -- 172.21.15.164:0/2756748313 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b8c112b30 con 0x7f8b8c117fb0 2024-09-13T23:04:44.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.632+0000 7f8b8b7fe640 1 --2- 172.21.15.164:0/2756748313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b8c117fb0 0x7f8b8c118390 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009720 tx=0x7f8b7c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54379675ca113d18 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:44.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.632+0000 7f8b8a7fc640 1 -- 172.21.15.164:0/2756748313 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b7c037070 con 0x7f8b8c117fb0 2024-09-13T23:04:44.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.632+0000 7f8b8a7fc640 1 -- 172.21.15.164:0/2756748313 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7c02ad90 con 0x7f8b8c117fb0 2024-09-13T23:04:44.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.632+0000 7f8b8a7fc640 1 -- 172.21.15.164:0/2756748313 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b7c032590 con 0x7f8b8c117fb0 2024-09-13T23:04:44.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.633+0000 7f8b92166640 1 -- 172.21.15.164:0/2756748313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b8c117fb0 msgr2=0x7f8b8c118390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:44.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.633+0000 7f8b92166640 1 --2- 172.21.15.164:0/2756748313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b8c117fb0 0x7f8b8c118390 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009720 tx=0x7f8b7c02a110 comp rx=0 tx=0).stop 2024-09-13T23:04:44.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.633+0000 7f8b92166640 1 -- 172.21.15.164:0/2756748313 shutdown_connections 2024-09-13T23:04:44.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.633+0000 7f8b92166640 1 --2- 172.21.15.164:0/2756748313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b8c117fb0 0x7f8b8c118390 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.633+0000 7f8b92166640 1 -- 172.21.15.164:0/2756748313 >> 172.21.15.164:0/2756748313 conn(0x7f8b8c06e5e0 msgr2=0x7f8b8c06e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:44.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.633+0000 7f8b92166640 1 -- 172.21.15.164:0/2756748313 shutdown_connections 2024-09-13T23:04:44.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.633+0000 7f8b92166640 1 -- 172.21.15.164:0/2756748313 wait complete. 2024-09-13T23:04:44.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.634+0000 7f8b92166640 1 Processor -- start 2024-09-13T23:04:44.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.634+0000 7f8b92166640 1 -- start start 2024-09-13T23:04:44.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.634+0000 7f8b92166640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b8c111da0 0x7f8b8c1a6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:44.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.634+0000 7f8b92166640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8c11e120 con 0x7f8b8c111da0 2024-09-13T23:04:44.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.635+0000 7f8b8b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b8c111da0 0x7f8b8c1a6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:44.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.635+0000 7f8b8b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b8c111da0 0x7f8b8c1a6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54396/0 (socket says 172.21.15.164:54396) 2024-09-13T23:04:44.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.635+0000 7f8b8b7fe640 1 -- 172.21.15.164:0/2598748845 learned_addr learned my addr 172.21.15.164:0/2598748845 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:04:44.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.635+0000 7f8b8b7fe640 1 -- 172.21.15.164:0/2598748845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b8c1a7180 con 0x7f8b8c111da0 2024-09-13T23:04:44.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.635+0000 7f8b8b7fe640 1 --2- 172.21.15.164:0/2598748845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b8c111da0 0x7f8b8c1a6bb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009840 tx=0x7f8b7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:44.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.635+0000 7f8b73fff640 1 -- 172.21.15.164:0/2598748845 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b7c041070 con 0x7f8b8c111da0 2024-09-13T23:04:44.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.635+0000 7f8b73fff640 1 -- 172.21.15.164:0/2598748845 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7c03c460 con 0x7f8b8c111da0 2024-09-13T23:04:44.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.635+0000 7f8b92166640 1 -- 172.21.15.164:0/2598748845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b8c1a7470 con 0x7f8b8c111da0 2024-09-13T23:04:44.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.636+0000 7f8b92166640 1 -- 172.21.15.164:0/2598748845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b8c1ab460 con 0x7f8b8c111da0 2024-09-13T23:04:44.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.636+0000 7f8b73fff640 1 -- 172.21.15.164:0/2598748845 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b7c04b060 con 0x7f8b8c111da0 2024-09-13T23:04:44.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.636+0000 7f8b73fff640 1 -- 172.21.15.164:0/2598748845 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8b7c044070 con 0x7f8b8c111da0 2024-09-13T23:04:44.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.636+0000 7f8b73fff640 1 -- 172.21.15.164:0/2598748845 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f8b7c046d70 con 0x7f8b8c111da0 2024-09-13T23:04:44.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.636+0000 7f8b92166640 1 -- 172.21.15.164:0/2598748845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b8c1a76a0 con 0x7f8b8c111da0 2024-09-13T23:04:44.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.639+0000 7f8b73fff640 1 -- 172.21.15.164:0/2598748845 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8b7c046450 con 0x7f8b8c111da0 2024-09-13T23:04:44.651 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-13T23:04:44.649+0000 7f1978b78040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T23:04:44.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.708+0000 7f8b92166640 1 -- 172.21.15.164:0/2598748845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7e05691a-818f-4fa2-9543-1be239750d9d", "id": 2} v 0) -- 0x7f8b8c118410 con 0x7f8b8c111da0 2024-09-13T23:04:44.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.709+0000 7f8b73fff640 1 -- 172.21.15.164:0/2598748845 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7e05691a-818f-4fa2-9543-1be239750d9d", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f8b7c046950 con 0x7f8b8c111da0 2024-09-13T23:04:44.710 INFO:teuthology.orchestra.run.smithi164.stdout:2 2024-09-13T23:04:44.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.710+0000 7f8b92166640 1 -- 172.21.15.164:0/2598748845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b8c111da0 msgr2=0x7f8b8c1a6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:44.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.710+0000 7f8b92166640 1 --2- 172.21.15.164:0/2598748845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b8c111da0 0x7f8b8c1a6bb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009840 tx=0x7f8b7c0046c0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.710+0000 7f8b92166640 1 -- 172.21.15.164:0/2598748845 shutdown_connections 2024-09-13T23:04:44.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.710+0000 7f8b92166640 1 --2- 172.21.15.164:0/2598748845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b8c111da0 0x7f8b8c1a6bb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.710+0000 7f8b92166640 1 -- 172.21.15.164:0/2598748845 >> 172.21.15.164:0/2598748845 conn(0x7f8b8c06e5e0 msgr2=0x7f8b8c113c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:44.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.710+0000 7f8b92166640 1 -- 172.21.15.164:0/2598748845 shutdown_connections 2024-09-13T23:04:44.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.710+0000 7f8b92166640 1 -- 172.21.15.164:0/2598748845 wait complete. 2024-09-13T23:04:44.721 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 230fdf2b-0a05-4cae-937e-e642ae9fb49e 3 2024-09-13T23:04:44.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.817+0000 7f2778677640 1 Processor -- start 2024-09-13T23:04:44.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.817+0000 7f2778677640 1 -- start start 2024-09-13T23:04:44.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.818+0000 7f2778677640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f277006d370 0x7f277006d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:44.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.818+0000 7f2778677640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f277006e140 con 0x7f277006dc90 2024-09-13T23:04:44.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.818+0000 7f2778677640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f277011e930 con 0x7f277006d370 2024-09-13T23:04:44.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.818+0000 7f2776413640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f277006d370 0x7f277006d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:44.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.818+0000 7f2776413640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f277006d370 0x7f277006d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54408/0 (socket says 172.21.15.164:54408) 2024-09-13T23:04:44.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.818+0000 7f2776413640 1 -- 172.21.15.164:0/120334956 learned_addr learned my addr 172.21.15.164:0/120334956 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:04:44.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.818+0000 7f2776413640 1 -- 172.21.15.164:0/120334956 >> v1:172.21.15.17:6789/0 conn(0x7f277006dc90 legacy=0x7f277011c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:44.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.818+0000 7f2776413640 1 -- 172.21.15.164:0/120334956 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f277011eab0 con 0x7f277006d370 2024-09-13T23:04:44.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.819+0000 7f2776413640 1 --2- 172.21.15.164:0/120334956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f277006d370 0x7f277006d750 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f276c0097f0 tx=0x7f276c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d3fd6cebf76411 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:44.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.819+0000 7f2775411640 1 -- 172.21.15.164:0/120334956 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f276c037070 con 0x7f277006d370 2024-09-13T23:04:44.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.819+0000 7f2775411640 1 -- 172.21.15.164:0/120334956 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f276c032440 con 0x7f277006d370 2024-09-13T23:04:44.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.819+0000 7f2775411640 1 -- 172.21.15.164:0/120334956 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f276c02ae60 con 0x7f277006d370 2024-09-13T23:04:44.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.820+0000 7f2778677640 1 -- 172.21.15.164:0/120334956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f277006d370 msgr2=0x7f277006d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:44.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.820+0000 7f2778677640 1 --2- 172.21.15.164:0/120334956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f277006d370 0x7f277006d750 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f276c0097f0 tx=0x7f276c02a1e0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.820+0000 7f2778677640 1 -- 172.21.15.164:0/120334956 shutdown_connections 2024-09-13T23:04:44.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.820+0000 7f2778677640 1 --2- 172.21.15.164:0/120334956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f277006d370 0x7f277006d750 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.820+0000 7f2778677640 1 -- 172.21.15.164:0/120334956 >> 172.21.15.164:0/120334956 conn(0x7f27700712e0 msgr2=0x7f2770073700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:44.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.820+0000 7f2778677640 1 -- 172.21.15.164:0/120334956 shutdown_connections 2024-09-13T23:04:44.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.820+0000 7f2778677640 1 -- 172.21.15.164:0/120334956 wait complete. 2024-09-13T23:04:44.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.820+0000 7f2778677640 1 Processor -- start 2024-09-13T23:04:44.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.821+0000 7f2778677640 1 -- start start 2024-09-13T23:04:44.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.821+0000 7f2778677640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f277006d370 0x7f27701a6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:44.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.821+0000 7f2778677640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f277011de00 con 0x7f277006d370 2024-09-13T23:04:44.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.821+0000 7f2776413640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f277006d370 0x7f27701a6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:44.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.821+0000 7f2776413640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f277006d370 0x7f27701a6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54414/0 (socket says 172.21.15.164:54414) 2024-09-13T23:04:44.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.821+0000 7f2776413640 1 -- 172.21.15.164:0/3746419585 learned_addr learned my addr 172.21.15.164:0/3746419585 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:04:44.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.821+0000 7f2776413640 1 -- 172.21.15.164:0/3746419585 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27701a7220 con 0x7f277006d370 2024-09-13T23:04:44.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.821+0000 7f2776413640 1 --2- 172.21.15.164:0/3746419585 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f277006d370 0x7f27701a6ce0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f276c035040 tx=0x7f276c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:44.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.822+0000 7f2766ffd640 1 -- 172.21.15.164:0/3746419585 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f276c041070 con 0x7f277006d370 2024-09-13T23:04:44.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.822+0000 7f2766ffd640 1 -- 172.21.15.164:0/3746419585 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f276c03c7a0 con 0x7f277006d370 2024-09-13T23:04:44.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.822+0000 7f2778677640 1 -- 172.21.15.164:0/3746419585 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27701a74b0 con 0x7f277006d370 2024-09-13T23:04:44.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.822+0000 7f2766ffd640 1 -- 172.21.15.164:0/3746419585 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f276c037040 con 0x7f277006d370 2024-09-13T23:04:44.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.823+0000 7f2778677640 1 -- 172.21.15.164:0/3746419585 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27701ab500 con 0x7f277006d370 2024-09-13T23:04:44.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.823+0000 7f2766ffd640 1 -- 172.21.15.164:0/3746419585 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f276c044070 con 0x7f277006d370 2024-09-13T23:04:44.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.823+0000 7f2766ffd640 1 -- 172.21.15.164:0/3746419585 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f276c03d3f0 con 0x7f277006d370 2024-09-13T23:04:44.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.823+0000 7f2778677640 1 -- 172.21.15.164:0/3746419585 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f277006d7d0 con 0x7f277006d370 2024-09-13T23:04:44.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.826+0000 7f2766ffd640 1 -- 172.21.15.164:0/3746419585 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f276c046450 con 0x7f277006d370 2024-09-13T23:04:44.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.895+0000 7f2778677640 1 -- 172.21.15.164:0/3746419585 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd new", "uuid": "230fdf2b-0a05-4cae-937e-e642ae9fb49e", "id": 3} v 0) -- 0x7f27701a7680 con 0x7f277006d370 2024-09-13T23:04:44.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.897+0000 7f2766ffd640 1 -- 172.21.15.164:0/3746419585 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "230fdf2b-0a05-4cae-937e-e642ae9fb49e", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f276c03caa0 con 0x7f277006d370 2024-09-13T23:04:44.898 INFO:teuthology.orchestra.run.smithi164.stdout:3 2024-09-13T23:04:44.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.897+0000 7f2778677640 1 -- 172.21.15.164:0/3746419585 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f277006d370 msgr2=0x7f27701a6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:44.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.897+0000 7f2778677640 1 --2- 172.21.15.164:0/3746419585 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f277006d370 0x7f27701a6ce0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f276c035040 tx=0x7f276c0046c0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.897+0000 7f2778677640 1 -- 172.21.15.164:0/3746419585 shutdown_connections 2024-09-13T23:04:44.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.897+0000 7f2778677640 1 --2- 172.21.15.164:0/3746419585 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f277006d370 0x7f27701a6ce0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.898+0000 7f2778677640 1 -- 172.21.15.164:0/3746419585 >> 172.21.15.164:0/3746419585 conn(0x7f27700712e0 msgr2=0x7f277011d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:44.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.898+0000 7f2778677640 1 -- 172.21.15.164:0/3746419585 shutdown_connections 2024-09-13T23:04:44.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:04:44.898+0000 7f2778677640 1 -- 172.21.15.164:0/3746419585 wait complete. 2024-09-13T23:04:44.910 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T23:04:44.910 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T23:04:44.913 INFO:tasks.ceph.osd.0:Started 2024-09-13T23:04:44.913 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T23:04:44.913 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T23:04:44.915 INFO:tasks.ceph.osd.1:Started 2024-09-13T23:04:44.915 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T23:04:44.915 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T23:04:44.917 INFO:tasks.ceph.osd.2:Started 2024-09-13T23:04:44.917 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T23:04:44.917 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T23:04:44.919 INFO:tasks.ceph.osd.3:Started 2024-09-13T23:04:44.920 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T23:04:44.989 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-13T23:04:44.988+0000 7f1978b78040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T23:04:45.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.027+0000 7f55e4f23640 1 Processor -- start 2024-09-13T23:04:45.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.027+0000 7f55e4f23640 1 -- start start 2024-09-13T23:04:45.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.027+0000 7f55e4f23640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f55e0093a70 0x7f55e0094260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:45.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.027+0000 7f55e4f23640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55e0073e80 con 0x7f55e00947a0 2024-09-13T23:04:45.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.027+0000 7f55e4f23640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f55e0093e50 con 0x7f55e0093a70 2024-09-13T23:04:45.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.027+0000 7f55de59c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f55e0093a70 0x7f55e0094260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:45.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.028+0000 7f55de59c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f55e0093a70 0x7f55e0094260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50024/0 (socket says 172.21.15.17:50024) 2024-09-13T23:04:45.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.028+0000 7f55ddd9b640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f55e00947a0 0x7f55e0132ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:33300/0 (socket says 172.21.15.17:33300) 2024-09-13T23:04:45.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.028+0000 7f55de59c640 1 -- 172.21.15.17:0/1271497254 learned_addr learned my addr 172.21.15.17:0/1271497254 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:04:45.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.028+0000 7f55de59c640 1 -- 172.21.15.17:0/1271497254 >> v1:172.21.15.17:6789/0 conn(0x7f55e00947a0 legacy=0x7f55e0132ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:45.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.028+0000 7f55de59c640 1 -- 172.21.15.17:0/1271497254 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e00966d0 con 0x7f55e0093a70 2024-09-13T23:04:45.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.028+0000 7f55de59c640 1 --2- 172.21.15.17:0/1271497254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e0093a70 0x7f55e0094260 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f55d00097f0 tx=0x7f55d002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63279b9dee1641fa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:45.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.029+0000 7f55dd59a640 1 -- 172.21.15.17:0/1271497254 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55d0037070 con 0x7f55e0093a70 2024-09-13T23:04:45.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.029+0000 7f55dd59a640 1 -- 172.21.15.17:0/1271497254 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55d0032440 con 0x7f55e0093a70 2024-09-13T23:04:45.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.029+0000 7f55dd59a640 1 -- 172.21.15.17:0/1271497254 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55d002ae60 con 0x7f55e0093a70 2024-09-13T23:04:45.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.029+0000 7f55e4f23640 1 -- 172.21.15.17:0/1271497254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e0093a70 msgr2=0x7f55e0094260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:45.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.029+0000 7f55e4f23640 1 --2- 172.21.15.17:0/1271497254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e0093a70 0x7f55e0094260 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f55d00097f0 tx=0x7f55d002a1e0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.029+0000 7f55e4f23640 1 -- 172.21.15.17:0/1271497254 shutdown_connections 2024-09-13T23:04:45.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.029+0000 7f55e4f23640 1 --2- 172.21.15.17:0/1271497254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e0093a70 0x7f55e0094260 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.029+0000 7f55e4f23640 1 -- 172.21.15.17:0/1271497254 >> 172.21.15.17:0/1271497254 conn(0x7f55e009ccf0 msgr2=0x7f55e009d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:45.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.029+0000 7f55e4f23640 1 -- 172.21.15.17:0/1271497254 shutdown_connections 2024-09-13T23:04:45.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.029+0000 7f55e4f23640 1 -- 172.21.15.17:0/1271497254 wait complete. 2024-09-13T23:04:45.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.030+0000 7f55e4f23640 1 Processor -- start 2024-09-13T23:04:45.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.030+0000 7f55e4f23640 1 -- start start 2024-09-13T23:04:45.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.031+0000 7f55e4f23640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e0093a70 0x7f55e01c3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:45.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.031+0000 7f55e4f23640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f55e0094bd0 con 0x7f55e0093a70 2024-09-13T23:04:45.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.031+0000 7f55de59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e0093a70 0x7f55e01c3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:45.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.031+0000 7f55de59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e0093a70 0x7f55e01c3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50032/0 (socket says 172.21.15.17:50032) 2024-09-13T23:04:45.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.031+0000 7f55de59c640 1 -- 172.21.15.17:0/3174672548 learned_addr learned my addr 172.21.15.17:0/3174672548 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:04:45.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.031+0000 7f55de59c640 1 -- 172.21.15.17:0/3174672548 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e0072ff0 con 0x7f55e0093a70 2024-09-13T23:04:45.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.031+0000 7f55de59c640 1 --2- 172.21.15.17:0/3174672548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e0093a70 0x7f55e01c3950 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f55d0035040 tx=0x7f55d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:45.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.031+0000 7f55ceffd640 1 -- 172.21.15.17:0/3174672548 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55d0041070 con 0x7f55e0093a70 2024-09-13T23:04:45.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.031+0000 7f55ceffd640 1 -- 172.21.15.17:0/3174672548 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55d003c7a0 con 0x7f55e0093a70 2024-09-13T23:04:45.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.031+0000 7f55e4f23640 1 -- 172.21.15.17:0/3174672548 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e01c3510 con 0x7f55e0093a70 2024-09-13T23:04:45.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.031+0000 7f55ceffd640 1 -- 172.21.15.17:0/3174672548 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55d0037040 con 0x7f55e0093a70 2024-09-13T23:04:45.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.031+0000 7f55e4f23640 1 -- 172.21.15.17:0/3174672548 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e01a7f50 con 0x7f55e0093a70 2024-09-13T23:04:45.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.032+0000 7f55ceffd640 1 -- 172.21.15.17:0/3174672548 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f55d0044070 con 0x7f55e0093a70 2024-09-13T23:04:45.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.032+0000 7f55ceffd640 1 -- 172.21.15.17:0/3174672548 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f55d003d3f0 con 0x7f55e0093a70 2024-09-13T23:04:45.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.032+0000 7f55e4f23640 1 -- 172.21.15.17:0/3174672548 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e0094ff0 con 0x7f55e0093a70 2024-09-13T23:04:45.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.034+0000 7f55ceffd640 1 -- 172.21.15.17:0/3174672548 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f55e00966d0 con 0x7f55e0093a70 2024-09-13T23:04:45.043 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-13T23:04:45.042+0000 7f1978b78040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T23:04:45.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.094+0000 7f55e4f23640 1 -- 172.21.15.17:0/3174672548 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55e0075b40 con 0x7f55e0093a70 2024-09-13T23:04:45.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.094+0000 7f55ceffd640 1 -- 172.21.15.17:0/3174672548 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f55d0046450 con 0x7f55e0093a70 2024-09-13T23:04:45.096 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:04:45.097 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":6,"fsid":"cf23c940-4ed5-4d79-b536-21dd117d26cb","created":"2024-09-13T23:04:43.818362+0000","modified":"2024-09-13T23:04:44.898009+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T23:04:44.898009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1aaccac6-e1e9-4353-846a-47ea97c7bafd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ea6cecf5-527b-441a-96f0-942169c28c19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7e05691a-818f-4fa2-9543-1be239750d9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"230fdf2b-0a05-4cae-937e-e642ae9fb49e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T23:04:45.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.095+0000 7f55e4f23640 1 -- 172.21.15.17:0/3174672548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e0093a70 msgr2=0x7f55e01c3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:45.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.095+0000 7f55e4f23640 1 --2- 172.21.15.17:0/3174672548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e0093a70 0x7f55e01c3950 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f55d0035040 tx=0x7f55d00046c0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.095+0000 7f55e4f23640 1 -- 172.21.15.17:0/3174672548 shutdown_connections 2024-09-13T23:04:45.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.095+0000 7f55e4f23640 1 --2- 172.21.15.17:0/3174672548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e0093a70 0x7f55e01c3950 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.095+0000 7f55e4f23640 1 -- 172.21.15.17:0/3174672548 >> 172.21.15.17:0/3174672548 conn(0x7f55e009ccf0 msgr2=0x7f55e008ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:45.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.095+0000 7f55e4f23640 1 -- 172.21.15.17:0/3174672548 shutdown_connections 2024-09-13T23:04:45.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:45.095+0000 7f55e4f23640 1 -- 172.21.15.17:0/3174672548 wait complete. 2024-09-13T23:04:45.107 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T23:04:45.107 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T23:04:45.191 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-13T23:04:45.189+0000 7f1978b78040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T23:04:45.510 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T23:04:45.607 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.605+0000 7ff6e1c23640 1 Processor -- start 2024-09-13T23:04:45.608 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.605+0000 7ff6e1c23640 1 -- start start 2024-09-13T23:04:45.608 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.605+0000 7ff6e1c23640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff6dc128310 0x7ff6dc094540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:45.608 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.605+0000 7ff6e1c23640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6dc127ec0 con 0x7ff6dc1286f0 2024-09-13T23:04:45.608 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.605+0000 7ff6e1c23640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7ff6dc06e430 con 0x7ff6dc128310 2024-09-13T23:04:45.608 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.605+0000 7ff6d3fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff6dc1286f0 0x7ff6dc095d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:33314/0 (socket says 172.21.15.17:33314) 2024-09-13T23:04:45.608 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.605+0000 7ff6db7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff6dc128310 0x7ff6dc094540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:45.608 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.605+0000 7ff6d3fff640 1 -- 172.21.15.17:0/1772192469 learned_addr learned my addr 172.21.15.17:0/1772192469 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:04:45.608 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.606+0000 7ff6db7fe640 1 -- 172.21.15.17:0/1772192469 >> v1:172.21.15.17:6789/0 conn(0x7ff6dc1286f0 legacy=0x7ff6dc095d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:45.608 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.606+0000 7ff6db7fe640 1 -- 172.21.15.17:0/1772192469 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6dc06dac0 con 0x7ff6dc128310 2024-09-13T23:04:45.610 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.606+0000 7ff6db7fe640 1 --2- 172.21.15.17:0/1772192469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6dc128310 0x7ff6dc094540 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc009720 tx=0x7ff6cc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ae8b069d99d58e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:45.610 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.607+0000 7ff6daffd640 1 -- 172.21.15.17:0/1772192469 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6cc037070 con 0x7ff6dc128310 2024-09-13T23:04:45.610 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.607+0000 7ff6daffd640 1 -- 172.21.15.17:0/1772192469 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6cc02ad90 con 0x7ff6dc128310 2024-09-13T23:04:45.610 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.607+0000 7ff6daffd640 1 -- 172.21.15.17:0/1772192469 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6cc032590 con 0x7ff6dc128310 2024-09-13T23:04:45.610 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.607+0000 7ff6e1c23640 1 -- 172.21.15.17:0/1772192469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6dc128310 msgr2=0x7ff6dc094540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:45.610 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.607+0000 7ff6e1c23640 1 --2- 172.21.15.17:0/1772192469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6dc128310 0x7ff6dc094540 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc009720 tx=0x7ff6cc02a110 comp rx=0 tx=0).stop 2024-09-13T23:04:45.610 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.607+0000 7ff6e1c23640 1 -- 172.21.15.17:0/1772192469 shutdown_connections 2024-09-13T23:04:45.610 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.607+0000 7ff6e1c23640 1 --2- 172.21.15.17:0/1772192469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6dc128310 0x7ff6dc094540 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.610 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.607+0000 7ff6e1c23640 1 -- 172.21.15.17:0/1772192469 >> 172.21.15.17:0/1772192469 conn(0x7ff6dc09ac90 msgr2=0x7ff6dc09b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:45.610 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.607+0000 7ff6e1c23640 1 -- 172.21.15.17:0/1772192469 shutdown_connections 2024-09-13T23:04:45.610 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.607+0000 7ff6e1c23640 1 -- 172.21.15.17:0/1772192469 wait complete. 2024-09-13T23:04:45.611 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.608+0000 7ff6e1c23640 1 Processor -- start 2024-09-13T23:04:45.611 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.608+0000 7ff6e1c23640 1 -- start start 2024-09-13T23:04:45.612 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.608+0000 7ff6e1c23640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6dc128310 0x7ff6dc1c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:45.612 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.608+0000 7ff6e1c23640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc096590 con 0x7ff6dc128310 2024-09-13T23:04:45.613 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.609+0000 7ff6db7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6dc128310 0x7ff6dc1c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:45.613 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.609+0000 7ff6db7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6dc128310 0x7ff6dc1c34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50044/0 (socket says 172.21.15.17:50044) 2024-09-13T23:04:45.613 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.609+0000 7ff6db7fe640 1 -- 172.21.15.17:0/2617133792 learned_addr learned my addr 172.21.15.17:0/2617133792 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:04:45.613 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.609+0000 7ff6db7fe640 1 -- 172.21.15.17:0/2617133792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6dc073bd0 con 0x7ff6dc128310 2024-09-13T23:04:45.613 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.609+0000 7ff6db7fe640 1 --2- 172.21.15.17:0/2617133792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6dc128310 0x7ff6dc1c34c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc009840 tx=0x7ff6cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:45.613 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.609+0000 7ff6d8ff9640 1 -- 172.21.15.17:0/2617133792 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6cc041070 con 0x7ff6dc128310 2024-09-13T23:04:45.613 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.609+0000 7ff6d8ff9640 1 -- 172.21.15.17:0/2617133792 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6cc03c460 con 0x7ff6dc128310 2024-09-13T23:04:45.613 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.609+0000 7ff6e1c23640 1 -- 172.21.15.17:0/2617133792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6dc08e3f0 con 0x7ff6dc128310 2024-09-13T23:04:45.613 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.609+0000 7ff6d8ff9640 1 -- 172.21.15.17:0/2617133792 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6cc037040 con 0x7ff6dc128310 2024-09-13T23:04:45.613 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.609+0000 7ff6e1c23640 1 -- 172.21.15.17:0/2617133792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6dc1c3a00 con 0x7ff6dc128310 2024-09-13T23:04:45.613 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.609+0000 7ff6d8ff9640 1 -- 172.21.15.17:0/2617133792 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff6cc044070 con 0x7ff6dc128310 2024-09-13T23:04:45.613 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.609+0000 7ff6d8ff9640 1 -- 172.21.15.17:0/2617133792 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7ff6cc03d3f0 con 0x7ff6dc128310 2024-09-13T23:04:45.613 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.610+0000 7ff6e1c23640 1 -- 172.21.15.17:0/2617133792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6dc08cc20 con 0x7ff6dc128310 2024-09-13T23:04:45.614 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.612+0000 7ff6d8ff9640 1 -- 172.21.15.17:0/2617133792 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ff6cc046450 con 0x7ff6dc128310 2024-09-13T23:04:45.673 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.672+0000 7ff6e1c23640 1 -- 172.21.15.17:0/2617133792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff6dc094540 con 0x7ff6dc128310 2024-09-13T23:04:45.674 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.672+0000 7ff6d8ff9640 1 -- 172.21.15.17:0/2617133792 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7ff6cc03c990 con 0x7ff6dc128310 2024-09-13T23:04:45.674 INFO:teuthology.misc.health.smithi017.stdout: 2024-09-13T23:04:45.674 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":6,"fsid":"cf23c940-4ed5-4d79-b536-21dd117d26cb","created":"2024-09-13T23:04:43.818362+0000","modified":"2024-09-13T23:04:44.898009+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T23:04:44.898009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1aaccac6-e1e9-4353-846a-47ea97c7bafd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ea6cecf5-527b-441a-96f0-942169c28c19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7e05691a-818f-4fa2-9543-1be239750d9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"230fdf2b-0a05-4cae-937e-e642ae9fb49e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T23:04:45.675 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.673+0000 7ff6e1c23640 1 -- 172.21.15.17:0/2617133792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6dc128310 msgr2=0x7ff6dc1c34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:45.675 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.673+0000 7ff6e1c23640 1 --2- 172.21.15.17:0/2617133792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6dc128310 0x7ff6dc1c34c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc009840 tx=0x7ff6cc0046c0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.675 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.673+0000 7ff6e1c23640 1 -- 172.21.15.17:0/2617133792 shutdown_connections 2024-09-13T23:04:45.675 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.673+0000 7ff6e1c23640 1 --2- 172.21.15.17:0/2617133792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6dc128310 0x7ff6dc1c34c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.675 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.673+0000 7ff6e1c23640 1 -- 172.21.15.17:0/2617133792 >> 172.21.15.17:0/2617133792 conn(0x7ff6dc09ac90 msgr2=0x7ff6dc0975b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:45.675 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.673+0000 7ff6e1c23640 1 -- 172.21.15.17:0/2617133792 shutdown_connections 2024-09-13T23:04:45.675 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:45.673+0000 7ff6e1c23640 1 -- 172.21.15.17:0/2617133792 wait complete. 2024-09-13T23:04:45.683 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-13T23:04:46.147 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-13T23:04:46.145+0000 7f1978b78040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T23:04:46.199 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-13T23:04:46.197+0000 7f1978b78040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T23:04:46.383 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-09-13T23:04:46.381+0000 7f80c3b34640 -1 Falling back to public interface 2024-09-13T23:04:46.564 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-13T23:04:46.563+0000 7f1978b78040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T23:04:46.613 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-13T23:04:46.612+0000 7fc0ed410640 -1 Falling back to public interface 2024-09-13T23:04:46.650 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-13T23:04:46.648+0000 7f1978b78040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T23:04:46.651 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-13T23:04:46.650+0000 7fc16d7c5640 -1 Falling back to public interface 2024-09-13T23:04:46.757 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-13T23:04:46.755+0000 7f1978b78040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T23:04:46.802 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-13T23:04:46.801+0000 7f1978b78040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T23:04:46.885 INFO:tasks.ceph.osd.3.smithi164.stderr:2024-09-13T23:04:46.883+0000 7fc839a0b640 -1 Falling back to public interface 2024-09-13T23:04:46.916 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-13T23:04:46.914+0000 7f1978b78040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T23:04:46.971 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-13T23:04:46.969+0000 7f1978b78040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T23:04:47.015 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-13T23:04:47.013+0000 7f1978b78040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T23:04:47.125 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-13T23:04:47.124+0000 7f1978b78040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T23:04:47.175 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-13T23:04:47.174+0000 7f1978b78040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T23:04:47.228 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-13T23:04:47.227+0000 7f1978b78040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T23:04:47.296 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-13T23:04:47.294+0000 7f1978b78040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T23:04:47.339 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-13T23:04:47.338+0000 7f1978b78040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T23:04:47.383 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-13T23:04:47.381+0000 7f1978b78040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T23:04:48.033 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-13T23:04:48.032+0000 7f1978b78040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T23:04:49.042 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-13T23:04:49.041+0000 7f1919446640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-13T23:04:50.244 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-09-13T23:04:50.243+0000 7f80c3b34640 -1 osd.1 0 log_to_monitors true 2024-09-13T23:04:50.375 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-13T23:04:50.373+0000 7fc0ed410640 -1 osd.0 0 log_to_monitors true 2024-09-13T23:04:51.188 INFO:tasks.ceph.osd.3.smithi164.stderr:2024-09-13T23:04:51.187+0000 7fc839a0b640 -1 osd.3 0 log_to_monitors true 2024-09-13T23:04:51.234 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-13T23:04:51.232+0000 7fc16d7c5640 -1 osd.2 0 log_to_monitors true 2024-09-13T23:04:52.088 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T23:04:52.199 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.196+0000 7f19c431f640 1 Processor -- start 2024-09-13T23:04:52.199 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.196+0000 7f19c431f640 1 -- start start 2024-09-13T23:04:52.199 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.197+0000 7f19c431f640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f19bc12cff0 0x7f19bc131a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:52.199 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.197+0000 7f19c431f640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19bc06f540 con 0x7f19bc12c500 2024-09-13T23:04:52.199 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.197+0000 7f19c431f640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f19bc06f100 con 0x7f19bc12cff0 2024-09-13T23:04:52.200 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.197+0000 7f19c18ba640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f19bc12cff0 0x7f19bc131a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:52.200 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.197+0000 7f19c20bb640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f19bc12c500 0x7f19bc12c8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:33322/0 (socket says 172.21.15.17:33322) 2024-09-13T23:04:52.200 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.197+0000 7f19c18ba640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f19bc12cff0 0x7f19bc131a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50070/0 (socket says 172.21.15.17:50070) 2024-09-13T23:04:52.200 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.197+0000 7f19c20bb640 1 -- 172.21.15.17:0/131608525 learned_addr learned my addr 172.21.15.17:0/131608525 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:04:52.200 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.197+0000 7f19c18ba640 1 -- 172.21.15.17:0/131608525 >> v1:172.21.15.17:6789/0 conn(0x7f19bc12c500 legacy=0x7f19bc12c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:52.200 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.197+0000 7f19c18ba640 1 -- 172.21.15.17:0/131608525 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19bc097b20 con 0x7f19bc12cff0 2024-09-13T23:04:52.203 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.198+0000 7f19c18ba640 1 --2- 172.21.15.17:0/131608525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19bc12cff0 0x7f19bc131a30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009720 tx=0x7f19ac02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896621347a85cf28 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:52.203 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.198+0000 7f19c10b9640 1 -- 172.21.15.17:0/131608525 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19ac037070 con 0x7f19bc12cff0 2024-09-13T23:04:52.203 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.198+0000 7f19c10b9640 1 -- 172.21.15.17:0/131608525 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19ac02ad90 con 0x7f19bc12cff0 2024-09-13T23:04:52.203 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.198+0000 7f19c10b9640 1 -- 172.21.15.17:0/131608525 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19ac032590 con 0x7f19bc12cff0 2024-09-13T23:04:52.203 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.199+0000 7f19c431f640 1 -- 172.21.15.17:0/131608525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19bc12cff0 msgr2=0x7f19bc131a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:52.203 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.199+0000 7f19c431f640 1 --2- 172.21.15.17:0/131608525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19bc12cff0 0x7f19bc131a30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009720 tx=0x7f19ac02a110 comp rx=0 tx=0).stop 2024-09-13T23:04:52.203 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.199+0000 7f19c431f640 1 -- 172.21.15.17:0/131608525 shutdown_connections 2024-09-13T23:04:52.203 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.199+0000 7f19c431f640 1 --2- 172.21.15.17:0/131608525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19bc12cff0 0x7f19bc131a30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:52.203 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.199+0000 7f19c431f640 1 -- 172.21.15.17:0/131608525 >> 172.21.15.17:0/131608525 conn(0x7f19bc09e0f0 msgr2=0x7f19bc09e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:52.203 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.199+0000 7f19c431f640 1 -- 172.21.15.17:0/131608525 shutdown_connections 2024-09-13T23:04:52.203 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.199+0000 7f19c431f640 1 -- 172.21.15.17:0/131608525 wait complete. 2024-09-13T23:04:52.204 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.200+0000 7f19c431f640 1 Processor -- start 2024-09-13T23:04:52.204 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.200+0000 7f19c431f640 1 -- start start 2024-09-13T23:04:52.204 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.201+0000 7f19c431f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19bc12c500 0x7f19bc1c1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:52.204 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.201+0000 7f19c431f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f19bc132300 con 0x7f19bc12c500 2024-09-13T23:04:52.204 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.201+0000 7f19c20bb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19bc12c500 0x7f19bc1c1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:52.204 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.201+0000 7f19c20bb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19bc12c500 0x7f19bc1c1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50084/0 (socket says 172.21.15.17:50084) 2024-09-13T23:04:52.204 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.201+0000 7f19c20bb640 1 -- 172.21.15.17:0/769156329 learned_addr learned my addr 172.21.15.17:0/769156329 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:04:52.204 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.201+0000 7f19c20bb640 1 -- 172.21.15.17:0/769156329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19bc1306e0 con 0x7f19bc12c500 2024-09-13T23:04:52.204 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.201+0000 7f19c20bb640 1 --2- 172.21.15.17:0/769156329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19bc12c500 0x7f19bc1c1620 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f19b800c480 tx=0x7f19b800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:52.206 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.201+0000 7f19b2ffd640 1 -- 172.21.15.17:0/769156329 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b8017070 con 0x7f19bc12c500 2024-09-13T23:04:52.206 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.201+0000 7f19b2ffd640 1 -- 172.21.15.17:0/769156329 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b8005c10 con 0x7f19bc12c500 2024-09-13T23:04:52.206 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.201+0000 7f19c431f640 1 -- 172.21.15.17:0/769156329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19bc1304a0 con 0x7f19bc12c500 2024-09-13T23:04:52.206 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.201+0000 7f19b2ffd640 1 -- 172.21.15.17:0/769156329 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b80070d0 con 0x7f19bc12c500 2024-09-13T23:04:52.207 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.201+0000 7f19c431f640 1 -- 172.21.15.17:0/769156329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19bc1c1b60 con 0x7f19bc12c500 2024-09-13T23:04:52.207 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.203+0000 7f19c431f640 1 -- 172.21.15.17:0/769156329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19bc12c8e0 con 0x7f19bc12c500 2024-09-13T23:04:52.207 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.203+0000 7f19b2ffd640 1 -- 172.21.15.17:0/769156329 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) ==== 45681+0+0 (secure 0 0 0) 0x7f19b801a070 con 0x7f19bc12c500 2024-09-13T23:04:52.207 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.203+0000 7f19b2ffd640 1 --2- 172.21.15.17:0/769156329 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f19a0038210 0x7f19a003a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:52.207 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.203+0000 7f19b2ffd640 1 -- 172.21.15.17:0/769156329 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1591+0+0 (secure 0 0 0) 0x7f19b8049c40 con 0x7f19bc12c500 2024-09-13T23:04:52.207 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.203+0000 7f19c18ba640 1 --2- 172.21.15.17:0/769156329 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f19a0038210 0x7f19a003a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:52.207 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.204+0000 7f19c18ba640 1 --2- 172.21.15.17:0/769156329 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f19a0038210 0x7f19a003a6d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f19ac034000 tx=0x7f19ac02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:52.210 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.208+0000 7f19b2ffd640 1 -- 172.21.15.17:0/769156329 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f19b8007270 con 0x7f19bc12c500 2024-09-13T23:04:52.401 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.400+0000 7f19c431f640 1 -- 172.21.15.17:0/769156329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f19bc126dd0 con 0x7f19bc12c500 2024-09-13T23:04:52.402 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.400+0000 7f19b2ffd640 1 -- 172.21.15.17:0/769156329 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+4153 (secure 0 0 0) 0x7f19b8012400 con 0x7f19bc12c500 2024-09-13T23:04:52.402 INFO:teuthology.misc.health.smithi017.stdout: 2024-09-13T23:04:52.402 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":8,"fsid":"cf23c940-4ed5-4d79-b536-21dd117d26cb","created":"2024-09-13T23:04:43.818362+0000","modified":"2024-09-13T23:04:52.044741+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T23:04:44.898009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1aaccac6-e1e9-4353-846a-47ea97c7bafd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ea6cecf5-527b-441a-96f0-942169c28c19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7e05691a-818f-4fa2-9543-1be239750d9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"230fdf2b-0a05-4cae-937e-e642ae9fb49e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T23:04:52.405 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.403+0000 7f19c431f640 1 -- 172.21.15.17:0/769156329 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f19a0038210 msgr2=0x7f19a003a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:52.406 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.403+0000 7f19c431f640 1 --2- 172.21.15.17:0/769156329 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f19a0038210 0x7f19a003a6d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f19ac034000 tx=0x7f19ac02e000 comp rx=0 tx=0).stop 2024-09-13T23:04:52.406 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.403+0000 7f19c431f640 1 -- 172.21.15.17:0/769156329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19bc12c500 msgr2=0x7f19bc1c1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:52.406 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.403+0000 7f19c431f640 1 --2- 172.21.15.17:0/769156329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19bc12c500 0x7f19bc1c1620 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f19b800c480 tx=0x7f19b800c940 comp rx=0 tx=0).stop 2024-09-13T23:04:52.406 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.403+0000 7f19c431f640 1 -- 172.21.15.17:0/769156329 shutdown_connections 2024-09-13T23:04:52.406 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.403+0000 7f19c431f640 1 --2- 172.21.15.17:0/769156329 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f19a0038210 0x7f19a003a6d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:52.406 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.403+0000 7f19c431f640 1 --2- 172.21.15.17:0/769156329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19bc12c500 0x7f19bc1c1620 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:52.406 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.403+0000 7f19c431f640 1 -- 172.21.15.17:0/769156329 >> 172.21.15.17:0/769156329 conn(0x7f19bc09e0f0 msgr2=0x7f19bc12b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:52.406 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.403+0000 7f19c431f640 1 -- 172.21.15.17:0/769156329 shutdown_connections 2024-09-13T23:04:52.406 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:52.403+0000 7f19c431f640 1 -- 172.21.15.17:0/769156329 wait complete. 2024-09-13T23:04:52.415 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-13T23:04:52.843 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-13T23:04:52.842+0000 7fc0e94ab640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T23:04:52.860 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-13T23:04:52.859+0000 7fc0e0aa6640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:04:52.878 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-09-13T23:04:52.877+0000 7f80c02d7640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T23:04:52.889 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-09-13T23:04:52.888+0000 7f80b78d2640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:04:54.076 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-13T23:04:54.074+0000 7fc168f31640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T23:04:54.105 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-13T23:04:54.104+0000 7fc161563640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:04:55.657 INFO:tasks.ceph.osd.3.smithi164.stderr:2024-09-13T23:04:55.656+0000 7fc835b12640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T23:04:55.668 INFO:tasks.ceph.osd.3.smithi164.stderr:2024-09-13T23:04:55.666+0000 7fc82d10d640 -1 osd.3 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:04:58.819 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T23:04:58.923 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.922+0000 7f1f17a4c640 1 Processor -- start 2024-09-13T23:04:58.923 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.922+0000 7f1f17a4c640 1 -- start start 2024-09-13T23:04:58.924 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.923+0000 7f1f17a4c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1f10131a40 0x7f1f10133e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:58.924 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.923+0000 7f1f17a4c640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f10098260 con 0x7f1f10097770 2024-09-13T23:04:58.924 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.923+0000 7f1f17a4c640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f1f100a0da0 con 0x7f1f10131a40 2024-09-13T23:04:58.924 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.923+0000 7f1f14fe7640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1f10131a40 0x7f1f10133e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:58.924 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.923+0000 7f1f157e8640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f1f10097770 0x7f1f10097b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:51034/0 (socket says 172.21.15.17:51034) 2024-09-13T23:04:58.924 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.923+0000 7f1f157e8640 1 -- 172.21.15.17:0/82443762 learned_addr learned my addr 172.21.15.17:0/82443762 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:04:58.925 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.923+0000 7f1f14fe7640 1 -- 172.21.15.17:0/82443762 >> v1:172.21.15.17:6789/0 conn(0x7f1f10097770 legacy=0x7f1f10097b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:58.925 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.924+0000 7f1f14fe7640 1 -- 172.21.15.17:0/82443762 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1009ac90 con 0x7f1f10131a40 2024-09-13T23:04:58.926 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.924+0000 7f1f14fe7640 1 --2- 172.21.15.17:0/82443762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f10131a40 0x7f1f10133e30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1f00009720 tx=0x7f1f0002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cdb6bd27f9c3e60 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:58.926 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.924+0000 7f1f07fff640 1 -- 172.21.15.17:0/82443762 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f00037070 con 0x7f1f10131a40 2024-09-13T23:04:58.926 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.924+0000 7f1f07fff640 1 -- 172.21.15.17:0/82443762 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f0002ad90 con 0x7f1f10131a40 2024-09-13T23:04:58.926 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.924+0000 7f1f07fff640 1 -- 172.21.15.17:0/82443762 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f00032590 con 0x7f1f10131a40 2024-09-13T23:04:58.926 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.925+0000 7f1f17a4c640 1 -- 172.21.15.17:0/82443762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f10131a40 msgr2=0x7f1f10133e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:58.926 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.925+0000 7f1f17a4c640 1 --2- 172.21.15.17:0/82443762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f10131a40 0x7f1f10133e30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1f00009720 tx=0x7f1f0002a110 comp rx=0 tx=0).stop 2024-09-13T23:04:58.926 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.925+0000 7f1f17a4c640 1 -- 172.21.15.17:0/82443762 shutdown_connections 2024-09-13T23:04:58.926 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.925+0000 7f1f17a4c640 1 --2- 172.21.15.17:0/82443762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f10131a40 0x7f1f10133e30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:58.926 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.925+0000 7f1f17a4c640 1 -- 172.21.15.17:0/82443762 >> 172.21.15.17:0/82443762 conn(0x7f1f100a15f0 msgr2=0x7f1f1009dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:58.926 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.925+0000 7f1f17a4c640 1 -- 172.21.15.17:0/82443762 shutdown_connections 2024-09-13T23:04:58.927 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.925+0000 7f1f17a4c640 1 -- 172.21.15.17:0/82443762 wait complete. 2024-09-13T23:04:58.928 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.926+0000 7f1f17a4c640 1 Processor -- start 2024-09-13T23:04:58.928 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.926+0000 7f1f17a4c640 1 -- start start 2024-09-13T23:04:58.929 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.926+0000 7f1f17a4c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f10097770 0x7f1f101c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:58.929 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.926+0000 7f1f17a4c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1009a620 con 0x7f1f10097770 2024-09-13T23:04:58.929 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.927+0000 7f1f157e8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f10097770 0x7f1f101c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:58.929 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.927+0000 7f1f157e8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f10097770 0x7f1f101c3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45070/0 (socket says 172.21.15.17:45070) 2024-09-13T23:04:58.929 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.927+0000 7f1f157e8640 1 -- 172.21.15.17:0/1702798668 learned_addr learned my addr 172.21.15.17:0/1702798668 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:04:58.929 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.927+0000 7f1f157e8640 1 -- 172.21.15.17:0/1702798668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1012e600 con 0x7f1f10097770 2024-09-13T23:04:58.929 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.927+0000 7f1f157e8640 1 --2- 172.21.15.17:0/1702798668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f10097770 0x7f1f101c3540 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c00c4a0 tx=0x7f1f0c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:58.930 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.927+0000 7f1f05ffb640 1 -- 172.21.15.17:0/1702798668 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f0c017070 con 0x7f1f10097770 2024-09-13T23:04:58.930 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.927+0000 7f1f05ffb640 1 -- 172.21.15.17:0/1702798668 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f0c005c10 con 0x7f1f10097770 2024-09-13T23:04:58.930 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.927+0000 7f1f17a4c640 1 -- 172.21.15.17:0/1702798668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f101292c0 con 0x7f1f10097770 2024-09-13T23:04:58.930 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.927+0000 7f1f05ffb640 1 -- 172.21.15.17:0/1702798668 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f0c007070 con 0x7f1f10097770 2024-09-13T23:04:58.930 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.927+0000 7f1f17a4c640 1 -- 172.21.15.17:0/1702798668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f1012f370 con 0x7f1f10097770 2024-09-13T23:04:58.931 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.928+0000 7f1f05ffb640 1 -- 172.21.15.17:0/1702798668 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1f0c01a070 con 0x7f1f10097770 2024-09-13T23:04:58.931 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.929+0000 7f1f05ffb640 1 --2- 172.21.15.17:0/1702798668 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1ef40382a0 0x7f1ef403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:58.931 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.929+0000 7f1f17a4c640 1 -- 172.21.15.17:0/1702798668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f10097b50 con 0x7f1f10097770 2024-09-13T23:04:58.931 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.929+0000 7f1f05ffb640 1 -- 172.21.15.17:0/1702798668 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3129+0+0 (secure 0 0 0) 0x7f1f0c04a350 con 0x7f1f10097770 2024-09-13T23:04:58.931 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.929+0000 7f1f14fe7640 1 --2- 172.21.15.17:0/1702798668 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1ef40382a0 0x7f1ef403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:58.931 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.929+0000 7f1f14fe7640 1 --2- 172.21.15.17:0/1702798668 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1ef40382a0 0x7f1ef403a760 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1f00034000 tx=0x7f1f0002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:58.934 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:58.934+0000 7f1f05ffb640 1 -- 172.21.15.17:0/1702798668 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1f0c041070 con 0x7f1f10097770 2024-09-13T23:04:59.111 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:59.110+0000 7f1f17a4c640 1 -- 172.21.15.17:0/1702798668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f100008d0 con 0x7f1f10097770 2024-09-13T23:04:59.111 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:59.111+0000 7f1f05ffb640 1 -- 172.21.15.17:0/1702798668 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7977 (secure 0 0 0) 0x7f1f0c0117a0 con 0x7f1f10097770 2024-09-13T23:04:59.111 INFO:teuthology.misc.health.smithi017.stdout: 2024-09-13T23:04:59.112 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":13,"fsid":"cf23c940-4ed5-4d79-b536-21dd117d26cb","created":"2024-09-13T23:04:43.818362+0000","modified":"2024-09-13T23:04:57.057504+0000","last_up_change":"2024-09-13T23:04:56.054738+0000","last_in_change":"2024-09-13T23:04:44.898009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T23:04:54.087115+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1aaccac6-e1e9-4353-846a-47ea97c7bafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":489863589},{"type":"v1","addr":"172.21.15.17:6801","nonce":489863589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":489863589},{"type":"v1","addr":"172.21.15.17:6803","nonce":489863589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":489863589},{"type":"v1","addr":"172.21.15.17:6807","nonce":489863589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":489863589},{"type":"v1","addr":"172.21.15.17:6805","nonce":489863589}]},"public_addr":"172.21.15.17:6801/489863589","cluster_addr":"172.21.15.17:6803/489863589","heartbeat_back_addr":"172.21.15.17:6807/489863589","heartbeat_front_addr":"172.21.15.17:6805/489863589","state":["exists","up"]},{"osd":1,"uuid":"ea6cecf5-527b-441a-96f0-942169c28c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":4060509701},{"type":"v1","addr":"172.21.15.164:6801","nonce":4060509701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":4060509701},{"type":"v1","addr":"172.21.15.164:6803","nonce":4060509701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":4060509701},{"type":"v1","addr":"172.21.15.164:6807","nonce":4060509701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":4060509701},{"type":"v1","addr":"172.21.15.164:6805","nonce":4060509701}]},"public_addr":"172.21.15.164:6801/4060509701","cluster_addr":"172.21.15.164:6803/4060509701","heartbeat_back_addr":"172.21.15.164:6807/4060509701","heartbeat_front_addr":"172.21.15.164:6805/4060509701","state":["exists","up"]},{"osd":2,"uuid":"7e05691a-818f-4fa2-9543-1be239750d9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3795914978},{"type":"v1","addr":"172.21.15.164:6809","nonce":3795914978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":3795914978},{"type":"v1","addr":"172.21.15.164:6811","nonce":3795914978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":3795914978},{"type":"v1","addr":"172.21.15.164:6815","nonce":3795914978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":3795914978},{"type":"v1","addr":"172.21.15.164:6813","nonce":3795914978}]},"public_addr":"172.21.15.164:6809/3795914978","cluster_addr":"172.21.15.164:6811/3795914978","heartbeat_back_addr":"172.21.15.164:6815/3795914978","heartbeat_front_addr":"172.21.15.164:6813/3795914978","state":["exists","up"]},{"osd":3,"uuid":"230fdf2b-0a05-4cae-937e-e642ae9fb49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":93809510},{"type":"v1","addr":"172.21.15.164:6817","nonce":93809510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":93809510},{"type":"v1","addr":"172.21.15.164:6819","nonce":93809510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":93809510},{"type":"v1","addr":"172.21.15.164:6823","nonce":93809510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":93809510},{"type":"v1","addr":"172.21.15.164:6821","nonce":93809510}]},"public_addr":"172.21.15.164:6817/93809510","cluster_addr":"172.21.15.164:6819/93809510","heartbeat_back_addr":"172.21.15.164:6823/93809510","heartbeat_front_addr":"172.21.15.164:6821/93809510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:04:51.331306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:04:51.258107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:04:52.223303+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:04:52.153336+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T23:04:59.113 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:59.112+0000 7f1f17a4c640 1 -- 172.21.15.17:0/1702798668 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1ef40382a0 msgr2=0x7f1ef403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:59.113 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:59.112+0000 7f1f17a4c640 1 --2- 172.21.15.17:0/1702798668 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1ef40382a0 0x7f1ef403a760 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1f00034000 tx=0x7f1f0002e000 comp rx=0 tx=0).stop 2024-09-13T23:04:59.114 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:59.113+0000 7f1f17a4c640 1 -- 172.21.15.17:0/1702798668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f10097770 msgr2=0x7f1f101c3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:59.114 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:59.113+0000 7f1f17a4c640 1 --2- 172.21.15.17:0/1702798668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f10097770 0x7f1f101c3540 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c00c4a0 tx=0x7f1f0c00c960 comp rx=0 tx=0).stop 2024-09-13T23:04:59.114 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:59.113+0000 7f1f17a4c640 1 -- 172.21.15.17:0/1702798668 shutdown_connections 2024-09-13T23:04:59.114 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:59.113+0000 7f1f17a4c640 1 --2- 172.21.15.17:0/1702798668 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1ef40382a0 0x7f1ef403a760 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:59.114 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:59.113+0000 7f1f17a4c640 1 --2- 172.21.15.17:0/1702798668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f10097770 0x7f1f101c3540 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:59.114 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:59.113+0000 7f1f17a4c640 1 -- 172.21.15.17:0/1702798668 >> 172.21.15.17:0/1702798668 conn(0x7f1f100a15f0 msgr2=0x7f1f10098530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:59.114 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:59.113+0000 7f1f17a4c640 1 -- 172.21.15.17:0/1702798668 shutdown_connections 2024-09-13T23:04:59.114 INFO:teuthology.misc.health.smithi017.stderr:2024-09-13T23:04:59.113+0000 7f1f17a4c640 1 -- 172.21.15.17:0/1702798668 wait complete. 2024-09-13T23:04:59.123 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-13T23:04:59.123 INFO:tasks.ceph:Creating RBD pool 2024-09-13T23:04:59.123 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-13T23:04:59.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.223+0000 7f7561118640 1 Processor -- start 2024-09-13T23:04:59.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.223+0000 7f7561118640 1 -- start start 2024-09-13T23:04:59.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.223+0000 7f7561118640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f755c06eda0 0x7f755c06f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:59.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.223+0000 7f7561118640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f755c06eba0 con 0x7f755c06f6c0 2024-09-13T23:04:59.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.223+0000 7f7561118640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f755c06d2f0 con 0x7f755c06eda0 2024-09-13T23:04:59.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.224+0000 7f755ad9d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f755c06eda0 0x7f755c06f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:59.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.224+0000 7f755a59c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f755c06f6c0 0x7f755c121a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:51048/0 (socket says 172.21.15.17:51048) 2024-09-13T23:04:59.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.224+0000 7f755a59c640 1 -- 172.21.15.17:0/3576070436 learned_addr learned my addr 172.21.15.17:0/3576070436 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:04:59.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.224+0000 7f755ad9d640 1 -- 172.21.15.17:0/3576070436 >> v1:172.21.15.17:6789/0 conn(0x7f755c06f6c0 legacy=0x7f755c121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:59.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.224+0000 7f7559d9b640 1 -- 172.21.15.17:0/3576070436 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3815301077 0 0) 0x7f755c06eba0 con 0x7f755c06f6c0 2024-09-13T23:04:59.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.224+0000 7f755ad9d640 1 -- 172.21.15.17:0/3576070436 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f755c070d50 con 0x7f755c06eda0 2024-09-13T23:04:59.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.225+0000 7f755ad9d640 1 --2- 172.21.15.17:0/3576070436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f755c06eda0 0x7f755c06f180 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f754c009720 tx=0x7f754c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e79f76e78df49524 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:59.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.225+0000 7f7559d9b640 1 -- 172.21.15.17:0/3576070436 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f754c037070 con 0x7f755c06eda0 2024-09-13T23:04:59.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.225+0000 7f7559d9b640 1 -- 172.21.15.17:0/3576070436 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f754c02ae20 con 0x7f755c06eda0 2024-09-13T23:04:59.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.225+0000 7f7559d9b640 1 -- 172.21.15.17:0/3576070436 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f754c032590 con 0x7f755c06eda0 2024-09-13T23:04:59.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.225+0000 7f7561118640 1 -- 172.21.15.17:0/3576070436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f755c06eda0 msgr2=0x7f755c06f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:59.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.225+0000 7f7561118640 1 --2- 172.21.15.17:0/3576070436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f755c06eda0 0x7f755c06f180 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f754c009720 tx=0x7f754c02a1a0 comp rx=0 tx=0).stop 2024-09-13T23:04:59.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.225+0000 7f7561118640 1 -- 172.21.15.17:0/3576070436 shutdown_connections 2024-09-13T23:04:59.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.225+0000 7f7561118640 1 --2- 172.21.15.17:0/3576070436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f755c06eda0 0x7f755c06f180 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:59.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.225+0000 7f7561118640 1 -- 172.21.15.17:0/3576070436 >> 172.21.15.17:0/3576070436 conn(0x7f755c09a890 msgr2=0x7f755c09aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:59.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.225+0000 7f7561118640 1 -- 172.21.15.17:0/3576070436 shutdown_connections 2024-09-13T23:04:59.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.225+0000 7f7561118640 1 -- 172.21.15.17:0/3576070436 wait complete. 2024-09-13T23:04:59.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.226+0000 7f7561118640 1 Processor -- start 2024-09-13T23:04:59.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.227+0000 7f7561118640 1 -- start start 2024-09-13T23:04:59.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.227+0000 7f7561118640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f755c06eda0 0x7f755c08ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:59.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.227+0000 7f7561118640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f755c122160 con 0x7f755c06eda0 2024-09-13T23:04:59.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.227+0000 7f755ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f755c06eda0 0x7f755c08ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:59.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.227+0000 7f755ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f755c06eda0 0x7f755c08ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45090/0 (socket says 172.21.15.17:45090) 2024-09-13T23:04:59.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.227+0000 7f755ad9d640 1 -- 172.21.15.17:0/3547284617 learned_addr learned my addr 172.21.15.17:0/3547284617 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:04:59.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.227+0000 7f755ad9d640 1 -- 172.21.15.17:0/3547284617 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f755c08d810 con 0x7f755c06eda0 2024-09-13T23:04:59.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.227+0000 7f755ad9d640 1 --2- 172.21.15.17:0/3547284617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f755c06eda0 0x7f755c08ba60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f754c02a1e0 tx=0x7f754c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:59.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.228+0000 7f75437fe640 1 -- 172.21.15.17:0/3547284617 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f754c042070 con 0x7f755c06eda0 2024-09-13T23:04:59.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.228+0000 7f75437fe640 1 -- 172.21.15.17:0/3547284617 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f754c03e590 con 0x7f755c06eda0 2024-09-13T23:04:59.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.228+0000 7f7561118640 1 -- 172.21.15.17:0/3547284617 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f755c125d80 con 0x7f755c06eda0 2024-09-13T23:04:59.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.228+0000 7f75437fe640 1 -- 172.21.15.17:0/3547284617 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f754c037040 con 0x7f755c06eda0 2024-09-13T23:04:59.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.228+0000 7f7561118640 1 -- 172.21.15.17:0/3547284617 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f755c08e4a0 con 0x7f755c06eda0 2024-09-13T23:04:59.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.228+0000 7f75437fe640 1 -- 172.21.15.17:0/3547284617 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f754c045070 con 0x7f755c06eda0 2024-09-13T23:04:59.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.229+0000 7f7561118640 1 -- 172.21.15.17:0/3547284617 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f755c122670 con 0x7f755c06eda0 2024-09-13T23:04:59.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.229+0000 7f75437fe640 1 --2- 172.21.15.17:0/3547284617 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f75480382a0 0x7f754803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:59.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.229+0000 7f75437fe640 1 -- 172.21.15.17:0/3547284617 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3129+0+0 (secure 0 0 0) 0x7f754c06b960 con 0x7f755c06eda0 2024-09-13T23:04:59.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.229+0000 7f755a59c640 1 --2- 172.21.15.17:0/3547284617 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f75480382a0 0x7f754803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:59.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.230+0000 7f755a59c640 1 --2- 172.21.15.17:0/3547284617 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f75480382a0 0x7f754803a760 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7550000c00 tx=0x7f7550007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:59.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.233+0000 7f75437fe640 1 -- 172.21.15.17:0/3547284617 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f755c08d810 con 0x7f755c06eda0 2024-09-13T23:04:59.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:04:59.409+0000 7f7561118640 1 -- 172.21.15.17:0/3547284617 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f755c08ef60 con 0x7f755c06eda0 2024-09-13T23:05:00.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.065+0000 7f75437fe640 1 -- 172.21.15.17:0/3547284617 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) ==== 109+0+0 (secure 0 0 0) 0x7f754c03e960 con 0x7f755c06eda0 2024-09-13T23:05:00.066 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'rbd' created 2024-09-13T23:05:00.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.068+0000 7f7561118640 1 -- 172.21.15.17:0/3547284617 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f75480382a0 msgr2=0x7f754803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:00.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.068+0000 7f7561118640 1 --2- 172.21.15.17:0/3547284617 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f75480382a0 0x7f754803a760 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7550000c00 tx=0x7f7550007910 comp rx=0 tx=0).stop 2024-09-13T23:05:00.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.068+0000 7f7561118640 1 -- 172.21.15.17:0/3547284617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f755c06eda0 msgr2=0x7f755c08ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:00.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.068+0000 7f7561118640 1 --2- 172.21.15.17:0/3547284617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f755c06eda0 0x7f755c08ba60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f754c02a1e0 tx=0x7f754c0046c0 comp rx=0 tx=0).stop 2024-09-13T23:05:00.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.068+0000 7f7561118640 1 -- 172.21.15.17:0/3547284617 shutdown_connections 2024-09-13T23:05:00.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.068+0000 7f7561118640 1 --2- 172.21.15.17:0/3547284617 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f75480382a0 0x7f754803a760 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:00.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.068+0000 7f7561118640 1 --2- 172.21.15.17:0/3547284617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f755c06eda0 0x7f755c08ba60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:00.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.068+0000 7f7561118640 1 -- 172.21.15.17:0/3547284617 >> 172.21.15.17:0/3547284617 conn(0x7f755c09a890 msgr2=0x7f755c06e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:00.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.068+0000 7f7561118640 1 -- 172.21.15.17:0/3547284617 shutdown_connections 2024-09-13T23:05:00.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.068+0000 7f7561118640 1 -- 172.21.15.17:0/3547284617 wait complete. 2024-09-13T23:05:00.083 DEBUG:teuthology.orchestra.run.smithi017:> rbd --cluster ceph pool init rbd 2024-09-13T23:05:00.145 INFO:teuthology.orchestra.run.smithi017.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:00.145 INFO:teuthology.orchestra.run.smithi017.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:00.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.145+0000 7f6bd2199d80 1 Processor -- start 2024-09-13T23:05:00.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.145+0000 7f6bd2199d80 1 -- start start 2024-09-13T23:05:00.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.146+0000 7f6bd2199d80 1 --2- >> v2:172.21.15.17:3300/0 conn(0x563605dc3ea0 0x563605e5d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:00.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.146+0000 7f6bd2199d80 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x563605c33050 con 0x563605e584b0 2024-09-13T23:05:00.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.146+0000 7f6bd2199d80 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x563605c41930 con 0x563605dc3ea0 2024-09-13T23:05:00.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.146+0000 7f6bd048e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x563605dc3ea0 0x563605e5d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:00.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.146+0000 7f6bd0c8f640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x563605e584b0 0x563605e58890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:51064/0 (socket says 172.21.15.17:51064) 2024-09-13T23:05:00.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.146+0000 7f6bd0c8f640 1 -- 172.21.15.17:0/3754577587 learned_addr learned my addr 172.21.15.17:0/3754577587 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:05:00.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.146+0000 7f6bd048e640 1 --2- 172.21.15.17:0/3754577587 >> v2:172.21.15.17:3300/0 conn(0x563605dc3ea0 0x563605e5d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45104/0 (socket says 172.21.15.17:45104) 2024-09-13T23:05:00.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.146+0000 7f6bd048e640 1 -- 172.21.15.17:0/3754577587 >> v1:172.21.15.17:6789/0 conn(0x563605e584b0 legacy=0x563605e58890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:00.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.146+0000 7f6bd048e640 1 -- 172.21.15.17:0/3754577587 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563605c1cce0 con 0x563605dc3ea0 2024-09-13T23:05:00.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.148+0000 7f6bd048e640 1 --2- 172.21.15.17:0/3754577587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563605dc3ea0 0x563605e5d490 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6bc400a4a0 tx=0x7f6bc4045ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b8d0a0aa2e9ecb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:00.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.148+0000 7f6bcfc8d640 1 -- 172.21.15.17:0/3754577587 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bc4056020 con 0x563605dc3ea0 2024-09-13T23:05:00.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.148+0000 7f6bcfc8d640 1 -- 172.21.15.17:0/3754577587 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bc4052570 con 0x563605dc3ea0 2024-09-13T23:05:00.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.148+0000 7f6bcfc8d640 1 -- 172.21.15.17:0/3754577587 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bc404e040 con 0x563605dc3ea0 2024-09-13T23:05:00.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.149+0000 7f6bd2199d80 1 -- 172.21.15.17:0/3754577587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563605dc3ea0 msgr2=0x563605e5d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:00.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.149+0000 7f6bd2199d80 1 --2- 172.21.15.17:0/3754577587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563605dc3ea0 0x563605e5d490 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6bc400a4a0 tx=0x7f6bc4045ac0 comp rx=0 tx=0).stop 2024-09-13T23:05:00.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.149+0000 7f6bd2199d80 1 -- 172.21.15.17:0/3754577587 shutdown_connections 2024-09-13T23:05:00.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.149+0000 7f6bd2199d80 1 --2- 172.21.15.17:0/3754577587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563605dc3ea0 0x563605e5d490 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:00.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.149+0000 7f6bd2199d80 1 -- 172.21.15.17:0/3754577587 >> 172.21.15.17:0/3754577587 conn(0x563605dca060 msgr2=0x563605dc64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:00.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.149+0000 7f6bd2199d80 1 -- 172.21.15.17:0/3754577587 shutdown_connections 2024-09-13T23:05:00.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.149+0000 7f6bd2199d80 1 -- 172.21.15.17:0/3754577587 wait complete. 2024-09-13T23:05:00.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.150+0000 7f6bd2199d80 1 Processor -- start 2024-09-13T23:05:00.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.150+0000 7f6bd2199d80 1 -- start start 2024-09-13T23:05:00.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.150+0000 7f6bd2199d80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563605dc3ea0 0x563605dc1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:00.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.150+0000 7f6bd2199d80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563605c43540 con 0x563605dc3ea0 2024-09-13T23:05:00.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.150+0000 7f6bd0c8f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563605dc3ea0 0x563605dc1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:00.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.150+0000 7f6bd0c8f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563605dc3ea0 0x563605dc1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45106/0 (socket says 172.21.15.17:45106) 2024-09-13T23:05:00.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.150+0000 7f6bd0c8f640 1 -- 172.21.15.17:0/2286145458 learned_addr learned my addr 172.21.15.17:0/2286145458 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:00.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.150+0000 7f6bd0c8f640 1 -- 172.21.15.17:0/2286145458 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563605dc2cd0 con 0x563605dc3ea0 2024-09-13T23:05:00.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.151+0000 7f6bd0c8f640 1 --2- 172.21.15.17:0/2286145458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563605dc3ea0 0x563605dc1150 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6bc000bbb0 tx=0x7f6bc0009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:00.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.151+0000 7f6bcd488640 1 -- 172.21.15.17:0/2286145458 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bc0012070 con 0x563605dc3ea0 2024-09-13T23:05:00.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.151+0000 7f6bcd488640 1 -- 172.21.15.17:0/2286145458 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bc000e470 con 0x563605dc3ea0 2024-09-13T23:05:00.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.151+0000 7f6bcd488640 1 -- 172.21.15.17:0/2286145458 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bc000e750 con 0x563605dc3ea0 2024-09-13T23:05:00.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.151+0000 7f6bd2199d80 1 -- 172.21.15.17:0/2286145458 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563605e469b0 con 0x563605dc3ea0 2024-09-13T23:05:00.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.151+0000 7f6bd2199d80 1 -- 172.21.15.17:0/2286145458 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563605dc1690 con 0x563605dc3ea0 2024-09-13T23:05:00.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.152+0000 7f6bcd488640 1 -- 172.21.15.17:0/2286145458 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6bc0015070 con 0x563605dc3ea0 2024-09-13T23:05:00.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.152+0000 7f6bcd488640 1 --2- 172.21.15.17:0/2286145458 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6bb4036b90 0x7f6bb4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:00.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.152+0000 7f6bcd488640 1 -- 172.21.15.17:0/2286145458 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3471+0+0 (secure 0 0 0) 0x7f6bc0049f30 con 0x563605dc3ea0 2024-09-13T23:05:00.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.152+0000 7f6bd2199d80 1 -- 172.21.15.17:0/2286145458 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x563605dc1cb0 con 0x563605dc3ea0 2024-09-13T23:05:00.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.152+0000 7f6bd048e640 1 --2- 172.21.15.17:0/2286145458 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6bb4036b90 0x7f6bb4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:00.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:00.153+0000 7f6bd048e640 1 --2- 172.21.15.17:0/2286145458 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6bb4036b90 0x7f6bb4039050 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4057000 tx=0x7f6bc4052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:01.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:01.068+0000 7f6bcd488640 1 -- 172.21.15.17:0/2286145458 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v15) ==== 141+0+0 (secure 0 0 0) 0x7f6bc001f750 con 0x563605dc3ea0 2024-09-13T23:05:01.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:01.068+0000 7f6bd2199d80 1 -- 172.21.15.17:0/2286145458 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6bc4052570 con 0x563605dc3ea0 2024-09-13T23:05:01.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:01.070+0000 7f6bcd488640 1 -- 172.21.15.17:0/2286145458 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f6bc0016590 con 0x563605dc3ea0 2024-09-13T23:05:01.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:01.070+0000 7f6bcf48c640 1 -- 172.21.15.17:0/2286145458 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=15}) -- 0x7f6bac002ae0 con 0x563605dc3ea0 2024-09-13T23:05:01.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:01.070+0000 7f6bcd488640 1 -- 172.21.15.17:0/2286145458 <== mon.0 v2:172.21.15.17:3300/0 8 ==== osd_map(15..15 src has 1..15) ==== 650+0+0 (secure 0 0 0) 0x7f6bc000d450 con 0x563605dc3ea0 2024-09-13T23:05:01.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:01.071+0000 7f6bd2199d80 1 --2- 172.21.15.17:0/2286145458 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563605e584b0 0x563605e6df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:01.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:01.071+0000 7f6bd2199d80 1 -- 172.21.15.17:0/2286145458 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) -- 0x563605e6e470 con 0x563605e584b0 2024-09-13T23:05:01.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:01.071+0000 7f6bd1ef1640 1 --2- 172.21.15.17:0/2286145458 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563605e584b0 0x563605e6df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:01.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:01.072+0000 7f6bd1ef1640 1 --2- 172.21.15.17:0/2286145458 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563605e584b0 0x563605e6df30 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:01.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:01.076+0000 7f6bd1ef1640 1 -- 172.21.15.17:0/2286145458 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(1 rbd_trash [create] v15'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f6bc8002040 con 0x563605e584b0 2024-09-13T23:05:01.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:01.078+0000 7f6bd2199d80 1 -- 172.21.15.17:0/2286145458 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) -- 0x563605ebfc40 con 0x563605e584b0 2024-09-13T23:05:01.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:01.079+0000 7f6bd1ef1640 1 -- 172.21.15.17:0/2286145458 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6bc8002040 con 0x563605e584b0 2024-09-13T23:05:01.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:01.079+0000 7f6bd2199d80 1 -- 172.21.15.17:0/2286145458 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) -- 0x563605ebed50 con 0x563605e584b0 2024-09-13T23:05:01.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:01.079+0000 7f6bd1ef1640 1 -- 172.21.15.17:0/2286145458 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6bc8002040 con 0x563605e584b0 2024-09-13T23:05:01.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:01.079+0000 7f6bcec8b640 1 -- 172.21.15.17:0/2286145458 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f6bb0001f00 con 0x563605dc3ea0 2024-09-13T23:05:02.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:02.073+0000 7f6bcd488640 1 -- 172.21.15.17:0/2286145458 <== mon.0 v2:172.21.15.17:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v16) ==== 55+0+0 (secure 0 0 0) 0x7f6bc0015c80 con 0x563605dc3ea0 2024-09-13T23:05:02.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:02.073+0000 7f6bcd488640 1 -- 172.21.15.17:0/2286145458 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=16}) -- 0x7f6bb403c740 con 0x563605dc3ea0 2024-09-13T23:05:02.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:02.073+0000 7f6bcd488640 1 -- 172.21.15.17:0/2286145458 <== mon.0 v2:172.21.15.17:3300/0 10 ==== osd_map(16..16 src has 1..16) ==== 626+0+0 (secure 0 0 0) 0x7f6bc0027060 con 0x563605dc3ea0 2024-09-13T23:05:02.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:02.073+0000 7f6bcf48c640 1 -- 172.21.15.17:0/2286145458 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x7f6bac0056a0 con 0x563605e584b0 2024-09-13T23:05:02.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:02.077+0000 7f6bd1ef1640 1 -- 172.21.15.17:0/2286145458 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v16'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6bc8002040 con 0x563605e584b0 2024-09-13T23:05:02.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:02.077+0000 7f6bcec8b640 1 -- 172.21.15.17:0/2286145458 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v16) -- 0x7f6bb0003350 con 0x563605dc3ea0 2024-09-13T23:05:03.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.073+0000 7f6bcd488640 1 -- 172.21.15.17:0/2286145458 <== mon.0 v2:172.21.15.17:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v17) ==== 43+0+0 (secure 0 0 0) 0x7f6bc0016bd0 con 0x563605dc3ea0 2024-09-13T23:05:03.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.073+0000 7f6bcd488640 1 -- 172.21.15.17:0/2286145458 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=17}) -- 0x7f6bb403c9c0 con 0x563605dc3ea0 2024-09-13T23:05:03.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.073+0000 7f6bcd488640 1 -- 172.21.15.17:0/2286145458 <== mon.0 v2:172.21.15.17:3300/0 12 ==== osd_map(17..17 src has 1..17) ==== 654+0+0 (secure 0 0 0) 0x7f6bc0016db0 con 0x563605dc3ea0 2024-09-13T23:05:03.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.073+0000 7f6bcf48c640 1 -- 172.21.15.17:0/2286145458 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x7f6bac005a60 con 0x563605e584b0 2024-09-13T23:05:03.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.078+0000 7f6bd1ef1640 1 -- 172.21.15.17:0/2286145458 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(7 rbd_info [write 0~19] v17'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bc8002040 con 0x563605e584b0 2024-09-13T23:05:03.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.079+0000 7f6bd2199d80 1 -- 172.21.15.17:0/2286145458 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563605e584b0 msgr2=0x563605e6df30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:03.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.079+0000 7f6bd2199d80 1 --2- 172.21.15.17:0/2286145458 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563605e584b0 0x563605e6df30 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:03.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.079+0000 7f6bd2199d80 1 -- 172.21.15.17:0/2286145458 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6bb4036b90 msgr2=0x7f6bb4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:03.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.079+0000 7f6bd2199d80 1 --2- 172.21.15.17:0/2286145458 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6bb4036b90 0x7f6bb4039050 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4057000 tx=0x7f6bc4052000 comp rx=0 tx=0).stop 2024-09-13T23:05:03.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.079+0000 7f6bd2199d80 1 -- 172.21.15.17:0/2286145458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563605dc3ea0 msgr2=0x563605dc1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:03.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.079+0000 7f6bd2199d80 1 --2- 172.21.15.17:0/2286145458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563605dc3ea0 0x563605dc1150 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6bc000bbb0 tx=0x7f6bc0009640 comp rx=0 tx=0).stop 2024-09-13T23:05:03.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.079+0000 7f6bd2199d80 1 -- 172.21.15.17:0/2286145458 shutdown_connections 2024-09-13T23:05:03.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.079+0000 7f6bd2199d80 1 --2- 172.21.15.17:0/2286145458 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563605e584b0 0x563605e6df30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:03.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.079+0000 7f6bd2199d80 1 --2- 172.21.15.17:0/2286145458 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6bb4036b90 0x7f6bb4039050 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:03.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.079+0000 7f6bd2199d80 1 --2- 172.21.15.17:0/2286145458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563605dc3ea0 0x563605dc1150 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:03.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.079+0000 7f6bd2199d80 1 -- 172.21.15.17:0/2286145458 >> 172.21.15.17:0/2286145458 conn(0x563605dca060 msgr2=0x563605dc43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:03.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.079+0000 7f6bd2199d80 1 -- 172.21.15.17:0/2286145458 shutdown_connections 2024-09-13T23:05:03.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.079+0000 7f6bd2199d80 1 -- 172.21.15.17:0/2286145458 wait complete. 2024-09-13T23:05:03.085 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T23:05:03.085 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T23:05:03.085 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T23:05:03.086 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T23:05:03.086 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T23:05:03.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.196+0000 7fb7c2b0a640 1 Processor -- start 2024-09-13T23:05:03.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.196+0000 7fb7c2b0a640 1 -- start start 2024-09-13T23:05:03.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.197+0000 7fb7c2b0a640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb7bc12f1e0 0x7fb7bc133a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:03.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.197+0000 7fb7c2b0a640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7bc06e9a0 con 0x7fb7bc12e6f0 2024-09-13T23:05:03.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.197+0000 7fb7c2b0a640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fb7bc12f5f0 con 0x7fb7bc12f1e0 2024-09-13T23:05:03.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.197+0000 7fb7bbfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb7bc12f1e0 0x7fb7bc133a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:03.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.197+0000 7fb7c08a6640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb7bc12e6f0 0x7fb7bc12ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:40858/0 (socket says 172.21.15.17:40858) 2024-09-13T23:05:03.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.197+0000 7fb7c08a6640 1 -- 172.21.15.17:0/3285454709 learned_addr learned my addr 172.21.15.17:0/3285454709 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:05:03.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.197+0000 7fb7bbfff640 1 -- 172.21.15.17:0/3285454709 >> v1:172.21.15.17:6789/0 conn(0x7fb7bc12e6f0 legacy=0x7fb7bc12ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:03.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.197+0000 7fb7bbfff640 1 -- 172.21.15.17:0/3285454709 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7bc134fc0 con 0x7fb7bc12f1e0 2024-09-13T23:05:03.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.197+0000 7fb7bb7fe640 1 -- 172.21.15.17:0/3285454709 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 566482827 0 0) 0x7fb7bc06e9a0 con 0x7fb7bc12e6f0 2024-09-13T23:05:03.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.198+0000 7fb7bbfff640 1 --2- 172.21.15.17:0/3285454709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7bc12f1e0 0x7fb7bc133a70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0009720 tx=0x7fb7b002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7abbbb158db11d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:03.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.198+0000 7fb7bb7fe640 1 -- 172.21.15.17:0/3285454709 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7b0037070 con 0x7fb7bc12f1e0 2024-09-13T23:05:03.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.198+0000 7fb7bb7fe640 1 -- 172.21.15.17:0/3285454709 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7b002ad90 con 0x7fb7bc12f1e0 2024-09-13T23:05:03.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.198+0000 7fb7bb7fe640 1 -- 172.21.15.17:0/3285454709 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7b0032590 con 0x7fb7bc12f1e0 2024-09-13T23:05:03.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.199+0000 7fb7c2b0a640 1 -- 172.21.15.17:0/3285454709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7bc12f1e0 msgr2=0x7fb7bc133a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:03.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.199+0000 7fb7c2b0a640 1 --2- 172.21.15.17:0/3285454709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7bc12f1e0 0x7fb7bc133a70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0009720 tx=0x7fb7b002a110 comp rx=0 tx=0).stop 2024-09-13T23:05:03.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.199+0000 7fb7c2b0a640 1 -- 172.21.15.17:0/3285454709 shutdown_connections 2024-09-13T23:05:03.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.199+0000 7fb7c2b0a640 1 --2- 172.21.15.17:0/3285454709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7bc12f1e0 0x7fb7bc133a70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:03.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.199+0000 7fb7c2b0a640 1 -- 172.21.15.17:0/3285454709 >> 172.21.15.17:0/3285454709 conn(0x7fb7bc09f020 msgr2=0x7fb7bc09f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:03.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.199+0000 7fb7c2b0a640 1 -- 172.21.15.17:0/3285454709 shutdown_connections 2024-09-13T23:05:03.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.199+0000 7fb7c2b0a640 1 -- 172.21.15.17:0/3285454709 wait complete. 2024-09-13T23:05:03.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.200+0000 7fb7c2b0a640 1 Processor -- start 2024-09-13T23:05:03.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.200+0000 7fb7c2b0a640 1 -- start start 2024-09-13T23:05:03.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.200+0000 7fb7c2b0a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7bc12e6f0 0x7fb7bc1319e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:03.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.200+0000 7fb7c2b0a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb7bc134340 con 0x7fb7bc12e6f0 2024-09-13T23:05:03.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.200+0000 7fb7c08a6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7bc12e6f0 0x7fb7bc1319e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:03.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.200+0000 7fb7c08a6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7bc12e6f0 0x7fb7bc1319e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38530/0 (socket says 172.21.15.17:38530) 2024-09-13T23:05:03.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.200+0000 7fb7c08a6640 1 -- 172.21.15.17:0/4045580593 learned_addr learned my addr 172.21.15.17:0/4045580593 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:03.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.201+0000 7fb7c08a6640 1 -- 172.21.15.17:0/4045580593 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7bc133560 con 0x7fb7bc12e6f0 2024-09-13T23:05:03.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.201+0000 7fb7c08a6640 1 --2- 172.21.15.17:0/4045580593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7bc12e6f0 0x7fb7bc1319e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac00c370 tx=0x7fb7ac00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:03.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.201+0000 7fb7b97fa640 1 -- 172.21.15.17:0/4045580593 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7ac007410 con 0x7fb7bc12e6f0 2024-09-13T23:05:03.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.201+0000 7fb7b97fa640 1 -- 172.21.15.17:0/4045580593 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ac0075d0 con 0x7fb7bc12e6f0 2024-09-13T23:05:03.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.201+0000 7fb7b97fa640 1 -- 172.21.15.17:0/4045580593 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7ac004950 con 0x7fb7bc12e6f0 2024-09-13T23:05:03.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.201+0000 7fb7c2b0a640 1 -- 172.21.15.17:0/4045580593 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7bc1255b0 con 0x7fb7bc12e6f0 2024-09-13T23:05:03.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.201+0000 7fb7c2b0a640 1 -- 172.21.15.17:0/4045580593 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7bc125170 con 0x7fb7bc12e6f0 2024-09-13T23:05:03.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.202+0000 7fb7b97fa640 1 -- 172.21.15.17:0/4045580593 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb7ac011070 con 0x7fb7bc12e6f0 2024-09-13T23:05:03.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.202+0000 7fb7c2b0a640 1 -- 172.21.15.17:0/4045580593 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7bc12ead0 con 0x7fb7bc12e6f0 2024-09-13T23:05:03.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.202+0000 7fb7b97fa640 1 --2- 172.21.15.17:0/4045580593 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb7a80382a0 0x7fb7a803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:03.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.202+0000 7fb7b97fa640 1 -- 172.21.15.17:0/4045580593 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fb7ac04ae20 con 0x7fb7bc12e6f0 2024-09-13T23:05:03.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.202+0000 7fb7bbfff640 1 --2- 172.21.15.17:0/4045580593 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb7a80382a0 0x7fb7a803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:03.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.203+0000 7fb7bbfff640 1 --2- 172.21.15.17:0/4045580593 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb7a80382a0 0x7fb7a803a760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0034000 tx=0x7fb7b002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:03.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.207+0000 7fb7b97fa640 1 -- 172.21.15.17:0/4045580593 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb7ac01cbd0 con 0x7fb7bc12e6f0 2024-09-13T23:05:03.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.429+0000 7fb7c2b0a640 1 -- 172.21.15.17:0/4045580593 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb7bc06e550 con 0x7fb7bc12e6f0 2024-09-13T23:05:03.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.431+0000 7fb7b97fa640 1 -- 172.21.15.17:0/4045580593 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+87486 (secure 0 0 0) 0x7fb7ac004d80 con 0x7fb7bc12e6f0 2024-09-13T23:05:03.433 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:05:03.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.433+0000 7fb7c2b0a640 1 -- 172.21.15.17:0/4045580593 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb7a80382a0 msgr2=0x7fb7a803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:03.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.433+0000 7fb7c2b0a640 1 --2- 172.21.15.17:0/4045580593 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb7a80382a0 0x7fb7a803a760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0034000 tx=0x7fb7b002e000 comp rx=0 tx=0).stop 2024-09-13T23:05:03.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.433+0000 7fb7c2b0a640 1 -- 172.21.15.17:0/4045580593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7bc12e6f0 msgr2=0x7fb7bc1319e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:03.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.433+0000 7fb7c2b0a640 1 --2- 172.21.15.17:0/4045580593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7bc12e6f0 0x7fb7bc1319e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac00c370 tx=0x7fb7ac00c830 comp rx=0 tx=0).stop 2024-09-13T23:05:03.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.433+0000 7fb7c2b0a640 1 -- 172.21.15.17:0/4045580593 shutdown_connections 2024-09-13T23:05:03.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.433+0000 7fb7c2b0a640 1 --2- 172.21.15.17:0/4045580593 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb7a80382a0 0x7fb7a803a760 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:03.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.433+0000 7fb7c2b0a640 1 --2- 172.21.15.17:0/4045580593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7bc12e6f0 0x7fb7bc1319e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:03.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.433+0000 7fb7c2b0a640 1 -- 172.21.15.17:0/4045580593 >> 172.21.15.17:0/4045580593 conn(0x7fb7bc09f020 msgr2=0x7fb7bc099600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:03.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.433+0000 7fb7c2b0a640 1 -- 172.21.15.17:0/4045580593 shutdown_connections 2024-09-13T23:05:03.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.433+0000 7fb7c2b0a640 1 -- 172.21.15.17:0/4045580593 wait complete. 2024-09-13T23:05:03.444 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":713838566},{"type":"v1","addr":"172.21.15.164:6825","nonce":713838566}]},"active_addr":"172.21.15.164:6825/713838566","active_change":"2024-09-13T23:04:48.035373+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.164:0","nonce":915603585}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.164:0","nonce":3206559832}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.164:0","nonce":2831472299}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.164:0","nonce":2239159276}]}]} 2024-09-13T23:05:03.447 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T23:05:03.448 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T23:05:03.448 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T23:05:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.548+0000 7f625acaf640 1 Processor -- start 2024-09-13T23:05:03.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.548+0000 7f625acaf640 1 -- start start 2024-09-13T23:05:03.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.548+0000 7f625acaf640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6254095740 0x7f6254095b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:03.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.548+0000 7f625acaf640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f625409e100 con 0x7f6254096060 2024-09-13T23:05:03.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.548+0000 7f625acaf640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f625409a960 con 0x7f6254095740 2024-09-13T23:05:03.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.549+0000 7f6258a4b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6254095740 0x7f6254095b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:03.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.549+0000 7f6253fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f6254096060 0x7f625412b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:40872/0 (socket says 172.21.15.17:40872) 2024-09-13T23:05:03.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.549+0000 7f6253fff640 1 -- 172.21.15.17:0/3371476447 learned_addr learned my addr 172.21.15.17:0/3371476447 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:05:03.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.549+0000 7f6258a4b640 1 -- 172.21.15.17:0/3371476447 >> v1:172.21.15.17:6789/0 conn(0x7f6254096060 legacy=0x7f625412b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:03.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.549+0000 7f6258a4b640 1 -- 172.21.15.17:0/3371476447 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6254097220 con 0x7f6254095740 2024-09-13T23:05:03.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.550+0000 7f6258a4b640 1 --2- 172.21.15.17:0/3371476447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6254095740 0x7f6254095b20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6244009d90 tx=0x7f624402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4246ee82f48f03cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:03.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.550+0000 7f62537fe640 1 -- 172.21.15.17:0/3371476447 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6244007670 con 0x7f6254095740 2024-09-13T23:05:03.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.550+0000 7f62537fe640 1 -- 172.21.15.17:0/3371476447 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6244007810 con 0x7f6254095740 2024-09-13T23:05:03.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.550+0000 7f62537fe640 1 -- 172.21.15.17:0/3371476447 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6244007b10 con 0x7f6254095740 2024-09-13T23:05:03.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.550+0000 7f625acaf640 1 -- 172.21.15.17:0/3371476447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6254095740 msgr2=0x7f6254095b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:03.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.550+0000 7f625acaf640 1 --2- 172.21.15.17:0/3371476447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6254095740 0x7f6254095b20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6244009d90 tx=0x7f624402a6f0 comp rx=0 tx=0).stop 2024-09-13T23:05:03.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.550+0000 7f625acaf640 1 -- 172.21.15.17:0/3371476447 shutdown_connections 2024-09-13T23:05:03.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.550+0000 7f625acaf640 1 --2- 172.21.15.17:0/3371476447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6254095740 0x7f6254095b20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:03.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.550+0000 7f625acaf640 1 -- 172.21.15.17:0/3371476447 >> 172.21.15.17:0/3371476447 conn(0x7f625409d860 msgr2=0x7f6254099d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:03.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.550+0000 7f625acaf640 1 -- 172.21.15.17:0/3371476447 shutdown_connections 2024-09-13T23:05:03.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.550+0000 7f625acaf640 1 -- 172.21.15.17:0/3371476447 wait complete. 2024-09-13T23:05:03.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.551+0000 7f625acaf640 1 Processor -- start 2024-09-13T23:05:03.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.551+0000 7f625acaf640 1 -- start start 2024-09-13T23:05:03.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.552+0000 7f625acaf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6254095740 0x7f625406dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:03.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.552+0000 7f625acaf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6254096440 con 0x7f6254095740 2024-09-13T23:05:03.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.552+0000 7f6258a4b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6254095740 0x7f625406dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:03.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.552+0000 7f6258a4b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6254095740 0x7f625406dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38540/0 (socket says 172.21.15.17:38540) 2024-09-13T23:05:03.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.552+0000 7f6258a4b640 1 -- 172.21.15.17:0/2021076318 learned_addr learned my addr 172.21.15.17:0/2021076318 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:03.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.552+0000 7f6258a4b640 1 -- 172.21.15.17:0/2021076318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625406f4b0 con 0x7f6254095740 2024-09-13T23:05:03.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.552+0000 7f6258a4b640 1 --2- 172.21.15.17:0/2021076318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6254095740 0x7f625406dc60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6244009d90 tx=0x7f6244004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:03.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.552+0000 7f62517fa640 1 -- 172.21.15.17:0/2021076318 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6244040070 con 0x7f6254095740 2024-09-13T23:05:03.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.552+0000 7f62517fa640 1 -- 172.21.15.17:0/2021076318 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6244031a90 con 0x7f6254095740 2024-09-13T23:05:03.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.552+0000 7f62517fa640 1 -- 172.21.15.17:0/2021076318 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6244031d70 con 0x7f6254095740 2024-09-13T23:05:03.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.552+0000 7f625acaf640 1 -- 172.21.15.17:0/2021076318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6254071190 con 0x7f6254095740 2024-09-13T23:05:03.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.552+0000 7f625acaf640 1 -- 172.21.15.17:0/2021076318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f625406e380 con 0x7f6254095740 2024-09-13T23:05:03.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.553+0000 7f62517fa640 1 -- 172.21.15.17:0/2021076318 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6244039040 con 0x7f6254095740 2024-09-13T23:05:03.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.553+0000 7f62517fa640 1 --2- 172.21.15.17:0/2021076318 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f62340382a0 0x7f623403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:03.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.553+0000 7f62517fa640 1 -- 172.21.15.17:0/2021076318 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f624406cc10 con 0x7f6254095740 2024-09-13T23:05:03.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.553+0000 7f625acaf640 1 -- 172.21.15.17:0/2021076318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6254095b20 con 0x7f6254095740 2024-09-13T23:05:03.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.554+0000 7f6253fff640 1 --2- 172.21.15.17:0/2021076318 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f62340382a0 0x7f623403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:03.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.554+0000 7f6253fff640 1 --2- 172.21.15.17:0/2021076318 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f62340382a0 0x7f623403a760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f623c007fd0 tx=0x7f623c007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:03.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.558+0000 7f62517fa640 1 -- 172.21.15.17:0/2021076318 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f624403a3b0 con 0x7f6254095740 2024-09-13T23:05:03.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.734+0000 7f625acaf640 1 -- 172.21.15.17:0/2021076318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f625406ed30 con 0x7f6254095740 2024-09-13T23:05:03.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.735+0000 7f62517fa640 1 -- 172.21.15.17:0/2021076318 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+9877 (secure 0 0 0) 0x7f6244053030 con 0x7f6254095740 2024-09-13T23:05:03.736 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:05:03.736 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"fsid":"cf23c940-4ed5-4d79-b536-21dd117d26cb","created":"2024-09-13T23:04:43.818362+0000","modified":"2024-09-13T23:05:03.072013+0000","last_up_change":"2024-09-13T23:04:56.054738+0000","last_in_change":"2024-09-13T23:04:44.898009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T23:04:54.087115+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T23:04:59.440302+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1aaccac6-e1e9-4353-846a-47ea97c7bafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":489863589},{"type":"v1","addr":"172.21.15.17:6801","nonce":489863589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":489863589},{"type":"v1","addr":"172.21.15.17:6803","nonce":489863589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":489863589},{"type":"v1","addr":"172.21.15.17:6807","nonce":489863589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":489863589},{"type":"v1","addr":"172.21.15.17:6805","nonce":489863589}]},"public_addr":"172.21.15.17:6801/489863589","cluster_addr":"172.21.15.17:6803/489863589","heartbeat_back_addr":"172.21.15.17:6807/489863589","heartbeat_front_addr":"172.21.15.17:6805/489863589","state":["exists","up"]},{"osd":1,"uuid":"ea6cecf5-527b-441a-96f0-942169c28c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":4060509701},{"type":"v1","addr":"172.21.15.164:6801","nonce":4060509701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":4060509701},{"type":"v1","addr":"172.21.15.164:6803","nonce":4060509701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":4060509701},{"type":"v1","addr":"172.21.15.164:6807","nonce":4060509701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":4060509701},{"type":"v1","addr":"172.21.15.164:6805","nonce":4060509701}]},"public_addr":"172.21.15.164:6801/4060509701","cluster_addr":"172.21.15.164:6803/4060509701","heartbeat_back_addr":"172.21.15.164:6807/4060509701","heartbeat_front_addr":"172.21.15.164:6805/4060509701","state":["exists","up"]},{"osd":2,"uuid":"7e05691a-818f-4fa2-9543-1be239750d9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3795914978},{"type":"v1","addr":"172.21.15.164:6809","nonce":3795914978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":3795914978},{"type":"v1","addr":"172.21.15.164:6811","nonce":3795914978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":3795914978},{"type":"v1","addr":"172.21.15.164:6815","nonce":3795914978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":3795914978},{"type":"v1","addr":"172.21.15.164:6813","nonce":3795914978}]},"public_addr":"172.21.15.164:6809/3795914978","cluster_addr":"172.21.15.164:6811/3795914978","heartbeat_back_addr":"172.21.15.164:6815/3795914978","heartbeat_front_addr":"172.21.15.164:6813/3795914978","state":["exists","up"]},{"osd":3,"uuid":"230fdf2b-0a05-4cae-937e-e642ae9fb49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":93809510},{"type":"v1","addr":"172.21.15.164:6817","nonce":93809510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":93809510},{"type":"v1","addr":"172.21.15.164:6819","nonce":93809510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":93809510},{"type":"v1","addr":"172.21.15.164:6823","nonce":93809510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":93809510},{"type":"v1","addr":"172.21.15.164:6821","nonce":93809510}]},"public_addr":"172.21.15.164:6817/93809510","cluster_addr":"172.21.15.164:6819/93809510","heartbeat_back_addr":"172.21.15.164:6823/93809510","heartbeat_front_addr":"172.21.15.164:6821/93809510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:04:51.331306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:04:51.258107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:04:52.223303+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:04:52.153336+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T23:05:03.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.737+0000 7f625acaf640 1 -- 172.21.15.17:0/2021076318 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f62340382a0 msgr2=0x7f623403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:03.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.737+0000 7f625acaf640 1 --2- 172.21.15.17:0/2021076318 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f62340382a0 0x7f623403a760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f623c007fd0 tx=0x7f623c007ac0 comp rx=0 tx=0).stop 2024-09-13T23:05:03.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.737+0000 7f625acaf640 1 -- 172.21.15.17:0/2021076318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6254095740 msgr2=0x7f625406dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:03.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.737+0000 7f625acaf640 1 --2- 172.21.15.17:0/2021076318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6254095740 0x7f625406dc60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6244009d90 tx=0x7f6244004a40 comp rx=0 tx=0).stop 2024-09-13T23:05:03.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.737+0000 7f625acaf640 1 -- 172.21.15.17:0/2021076318 shutdown_connections 2024-09-13T23:05:03.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.737+0000 7f625acaf640 1 --2- 172.21.15.17:0/2021076318 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f62340382a0 0x7f623403a760 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:03.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.737+0000 7f625acaf640 1 --2- 172.21.15.17:0/2021076318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6254095740 0x7f625406dc60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:03.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.737+0000 7f625acaf640 1 -- 172.21.15.17:0/2021076318 >> 172.21.15.17:0/2021076318 conn(0x7f625409d860 msgr2=0x7f62541b6b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:03.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.737+0000 7f625acaf640 1 -- 172.21.15.17:0/2021076318 shutdown_connections 2024-09-13T23:05:03.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.737+0000 7f625acaf640 1 -- 172.21.15.17:0/2021076318 wait complete. 2024-09-13T23:05:03.749 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T23:05:03.749 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T23:05:03.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.849+0000 7fca8a0e4640 1 Processor -- start 2024-09-13T23:05:03.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.849+0000 7fca8a0e4640 1 -- start start 2024-09-13T23:05:03.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.850+0000 7fca8a0e4640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fca8409bd50 0x7fca8409c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:03.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.850+0000 7fca8a0e4640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca8409d3b0 con 0x7fca8409c670 2024-09-13T23:05:03.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.850+0000 7fca8a0e4640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fca84098230 con 0x7fca8409bd50 2024-09-13T23:05:03.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.850+0000 7fca837fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fca8409bd50 0x7fca8409c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:03.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.850+0000 7fca82ffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fca8409c670 0x7fca840990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:40888/0 (socket says 172.21.15.17:40888) 2024-09-13T23:05:03.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.850+0000 7fca82ffd640 1 -- 172.21.15.17:0/3937927171 learned_addr learned my addr 172.21.15.17:0/3937927171 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:05:03.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.850+0000 7fca837fe640 1 --2- 172.21.15.17:0/3937927171 >> v2:172.21.15.17:3300/0 conn(0x7fca8409bd50 0x7fca8409c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38550/0 (socket says 172.21.15.17:38550) 2024-09-13T23:05:03.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.850+0000 7fca837fe640 1 -- 172.21.15.17:0/3937927171 >> v1:172.21.15.17:6789/0 conn(0x7fca8409c670 legacy=0x7fca840990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:03.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.850+0000 7fca837fe640 1 -- 172.21.15.17:0/3937927171 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca840983e0 con 0x7fca8409bd50 2024-09-13T23:05:03.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.851+0000 7fca837fe640 1 --2- 172.21.15.17:0/3937927171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca8409bd50 0x7fca8409c130 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fca74009720 tx=0x7fca7402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48126d77c3591b91 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:03.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.851+0000 7fca827fc640 1 -- 172.21.15.17:0/3937927171 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca74037070 con 0x7fca8409bd50 2024-09-13T23:05:03.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.851+0000 7fca827fc640 1 -- 172.21.15.17:0/3937927171 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca7402ad90 con 0x7fca8409bd50 2024-09-13T23:05:03.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.851+0000 7fca827fc640 1 -- 172.21.15.17:0/3937927171 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca74032590 con 0x7fca8409bd50 2024-09-13T23:05:03.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.852+0000 7fca8a0e4640 1 -- 172.21.15.17:0/3937927171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca8409bd50 msgr2=0x7fca8409c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:03.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.852+0000 7fca8a0e4640 1 --2- 172.21.15.17:0/3937927171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca8409bd50 0x7fca8409c130 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fca74009720 tx=0x7fca7402a110 comp rx=0 tx=0).stop 2024-09-13T23:05:03.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.852+0000 7fca8a0e4640 1 -- 172.21.15.17:0/3937927171 shutdown_connections 2024-09-13T23:05:03.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.852+0000 7fca8a0e4640 1 --2- 172.21.15.17:0/3937927171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca8409bd50 0x7fca8409c130 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:03.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.852+0000 7fca8a0e4640 1 -- 172.21.15.17:0/3937927171 >> 172.21.15.17:0/3937927171 conn(0x7fca8406d4a0 msgr2=0x7fca8406d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:03.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.852+0000 7fca8a0e4640 1 -- 172.21.15.17:0/3937927171 shutdown_connections 2024-09-13T23:05:03.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.852+0000 7fca8a0e4640 1 -- 172.21.15.17:0/3937927171 wait complete. 2024-09-13T23:05:03.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.853+0000 7fca8a0e4640 1 Processor -- start 2024-09-13T23:05:03.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.853+0000 7fca8a0e4640 1 -- start start 2024-09-13T23:05:03.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.853+0000 7fca8a0e4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca8409bd50 0x7fca84093570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:03.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.853+0000 7fca8a0e4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fca84099b90 con 0x7fca8409bd50 2024-09-13T23:05:03.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.853+0000 7fca837fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca8409bd50 0x7fca84093570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:03.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.853+0000 7fca837fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca8409bd50 0x7fca84093570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38566/0 (socket says 172.21.15.17:38566) 2024-09-13T23:05:03.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.853+0000 7fca837fe640 1 -- 172.21.15.17:0/3344093192 learned_addr learned my addr 172.21.15.17:0/3344093192 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:03.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.854+0000 7fca837fe640 1 -- 172.21.15.17:0/3344093192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca84094eb0 con 0x7fca8409bd50 2024-09-13T23:05:03.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.854+0000 7fca837fe640 1 --2- 172.21.15.17:0/3344093192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca8409bd50 0x7fca84093570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fca74009840 tx=0x7fca740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:03.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.854+0000 7fca6bfff640 1 -- 172.21.15.17:0/3344093192 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca74041070 con 0x7fca8409bd50 2024-09-13T23:05:03.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.854+0000 7fca6bfff640 1 -- 172.21.15.17:0/3344093192 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca7403c460 con 0x7fca8409bd50 2024-09-13T23:05:03.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.854+0000 7fca8a0e4640 1 -- 172.21.15.17:0/3344093192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca84095590 con 0x7fca8409bd50 2024-09-13T23:05:03.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.854+0000 7fca6bfff640 1 -- 172.21.15.17:0/3344093192 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca74037040 con 0x7fca8409bd50 2024-09-13T23:05:03.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.854+0000 7fca8a0e4640 1 -- 172.21.15.17:0/3344093192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca840961c0 con 0x7fca8409bd50 2024-09-13T23:05:03.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.855+0000 7fca6bfff640 1 -- 172.21.15.17:0/3344093192 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fca74044070 con 0x7fca8409bd50 2024-09-13T23:05:03.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.855+0000 7fca8a0e4640 1 -- 172.21.15.17:0/3344093192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca8409a130 con 0x7fca8409bd50 2024-09-13T23:05:03.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.855+0000 7fca6bfff640 1 --2- 172.21.15.17:0/3344093192 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fca70038250 0x7fca7003a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:03.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.855+0000 7fca6bfff640 1 -- 172.21.15.17:0/3344093192 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fca7406bb30 con 0x7fca8409bd50 2024-09-13T23:05:03.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.855+0000 7fca82ffd640 1 --2- 172.21.15.17:0/3344093192 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fca70038250 0x7fca7003a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:03.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.856+0000 7fca82ffd640 1 --2- 172.21.15.17:0/3344093192 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fca70038250 0x7fca7003a710 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fca78007fd0 tx=0x7fca78007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:03.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:03.860+0000 7fca6bfff640 1 -- 172.21.15.17:0/3344093192 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fca840961c0 con 0x7fca8409bd50 2024-09-13T23:05:04.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.036+0000 7fca8a0e4640 1 -- 172.21.15.17:0/3344093192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca8409d020 con 0x7fca8409bd50 2024-09-13T23:05:04.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.037+0000 7fca6bfff640 1 -- 172.21.15.17:0/3344093192 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+9877 (secure 0 0 0) 0x7fca74044520 con 0x7fca8409bd50 2024-09-13T23:05:04.038 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:05:04.038 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"fsid":"cf23c940-4ed5-4d79-b536-21dd117d26cb","created":"2024-09-13T23:04:43.818362+0000","modified":"2024-09-13T23:05:03.072013+0000","last_up_change":"2024-09-13T23:04:56.054738+0000","last_in_change":"2024-09-13T23:04:44.898009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T23:04:54.087115+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T23:04:59.440302+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1aaccac6-e1e9-4353-846a-47ea97c7bafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":489863589},{"type":"v1","addr":"172.21.15.17:6801","nonce":489863589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":489863589},{"type":"v1","addr":"172.21.15.17:6803","nonce":489863589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":489863589},{"type":"v1","addr":"172.21.15.17:6807","nonce":489863589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":489863589},{"type":"v1","addr":"172.21.15.17:6805","nonce":489863589}]},"public_addr":"172.21.15.17:6801/489863589","cluster_addr":"172.21.15.17:6803/489863589","heartbeat_back_addr":"172.21.15.17:6807/489863589","heartbeat_front_addr":"172.21.15.17:6805/489863589","state":["exists","up"]},{"osd":1,"uuid":"ea6cecf5-527b-441a-96f0-942169c28c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":4060509701},{"type":"v1","addr":"172.21.15.164:6801","nonce":4060509701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":4060509701},{"type":"v1","addr":"172.21.15.164:6803","nonce":4060509701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":4060509701},{"type":"v1","addr":"172.21.15.164:6807","nonce":4060509701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":4060509701},{"type":"v1","addr":"172.21.15.164:6805","nonce":4060509701}]},"public_addr":"172.21.15.164:6801/4060509701","cluster_addr":"172.21.15.164:6803/4060509701","heartbeat_back_addr":"172.21.15.164:6807/4060509701","heartbeat_front_addr":"172.21.15.164:6805/4060509701","state":["exists","up"]},{"osd":2,"uuid":"7e05691a-818f-4fa2-9543-1be239750d9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3795914978},{"type":"v1","addr":"172.21.15.164:6809","nonce":3795914978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":3795914978},{"type":"v1","addr":"172.21.15.164:6811","nonce":3795914978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":3795914978},{"type":"v1","addr":"172.21.15.164:6815","nonce":3795914978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":3795914978},{"type":"v1","addr":"172.21.15.164:6813","nonce":3795914978}]},"public_addr":"172.21.15.164:6809/3795914978","cluster_addr":"172.21.15.164:6811/3795914978","heartbeat_back_addr":"172.21.15.164:6815/3795914978","heartbeat_front_addr":"172.21.15.164:6813/3795914978","state":["exists","up"]},{"osd":3,"uuid":"230fdf2b-0a05-4cae-937e-e642ae9fb49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":93809510},{"type":"v1","addr":"172.21.15.164:6817","nonce":93809510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":93809510},{"type":"v1","addr":"172.21.15.164:6819","nonce":93809510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":93809510},{"type":"v1","addr":"172.21.15.164:6823","nonce":93809510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":93809510},{"type":"v1","addr":"172.21.15.164:6821","nonce":93809510}]},"public_addr":"172.21.15.164:6817/93809510","cluster_addr":"172.21.15.164:6819/93809510","heartbeat_back_addr":"172.21.15.164:6823/93809510","heartbeat_front_addr":"172.21.15.164:6821/93809510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:04:51.331306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:04:51.258107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:04:52.223303+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:04:52.153336+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T23:05:04.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.039+0000 7fca8a0e4640 1 -- 172.21.15.17:0/3344093192 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fca70038250 msgr2=0x7fca7003a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.039+0000 7fca8a0e4640 1 --2- 172.21.15.17:0/3344093192 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fca70038250 0x7fca7003a710 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fca78007fd0 tx=0x7fca78007ac0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.039+0000 7fca8a0e4640 1 -- 172.21.15.17:0/3344093192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca8409bd50 msgr2=0x7fca84093570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.039+0000 7fca8a0e4640 1 --2- 172.21.15.17:0/3344093192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca8409bd50 0x7fca84093570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fca74009840 tx=0x7fca740046c0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.039+0000 7fca8a0e4640 1 -- 172.21.15.17:0/3344093192 shutdown_connections 2024-09-13T23:05:04.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.039+0000 7fca8a0e4640 1 --2- 172.21.15.17:0/3344093192 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fca70038250 0x7fca7003a710 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.039+0000 7fca8a0e4640 1 --2- 172.21.15.17:0/3344093192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca8409bd50 0x7fca84093570 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.039+0000 7fca8a0e4640 1 -- 172.21.15.17:0/3344093192 >> 172.21.15.17:0/3344093192 conn(0x7fca8406d4a0 msgr2=0x7fca8409eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:04.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.039+0000 7fca8a0e4640 1 -- 172.21.15.17:0/3344093192 shutdown_connections 2024-09-13T23:05:04.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.039+0000 7fca8a0e4640 1 -- 172.21.15.17:0/3344093192 wait complete. 2024-09-13T23:05:04.051 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T23:05:04.052 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T23:05:04.052 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T23:05:04.052 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T23:05:04.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.159+0000 7f75e05bd640 1 Processor -- start 2024-09-13T23:05:04.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.159+0000 7fc5fa49b640 1 Processor -- start 2024-09-13T23:05:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.159+0000 7f8f15959640 1 Processor -- start 2024-09-13T23:05:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.159+0000 7f75e05bd640 1 -- start start 2024-09-13T23:05:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.159+0000 7fc5fa49b640 1 -- start start 2024-09-13T23:05:04.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.160+0000 7f1456711640 1 Processor -- start 2024-09-13T23:05:04.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.160+0000 7f8f15959640 1 -- start start 2024-09-13T23:05:04.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.160+0000 7f1456711640 1 -- start start 2024-09-13T23:05:04.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.160+0000 7fc5fa49b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc5f412e940 0x7fc5f4130d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.160+0000 7f8f15959640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8f10096840 0x7f8f10096c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.160+0000 7fc5fa49b640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5f406eba0 con 0x7fc5f406eda0 2024-09-13T23:05:04.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.160+0000 7f8f15959640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f1009aaa0 con 0x7f8f10097160 2024-09-13T23:05:04.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.160+0000 7f8f15959640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f8f1009e080 con 0x7f8f10096840 2024-09-13T23:05:04.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.160+0000 7f1456711640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1450073180 0x7f145006c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.160+0000 7f1456711640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f145009af00 con 0x7f1450072da0 2024-09-13T23:05:04.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.160+0000 7f1456711640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f1450097660 con 0x7f1450073180 2024-09-13T23:05:04.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.160+0000 7f75e05bd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f75d8098a20 0x7f75d812d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.160+0000 7f75e05bd640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75d8131890 con 0x7f75d812c570 2024-09-13T23:05:04.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.160+0000 7f8f0e7fc640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f8f10097160 0x7f8f10128340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:40906/0 (socket says 172.21.15.17:40906) 2024-09-13T23:05:04.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.160+0000 7f75e05bd640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f75d8098550 con 0x7f75d8098a20 2024-09-13T23:05:04.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.160+0000 7f8f0e7fc640 1 -- 172.21.15.17:0/3011905344 learned_addr learned my addr 172.21.15.17:0/3011905344 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:05:04.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.160+0000 7f144f7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1450073180 0x7f145006c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.160+0000 7f144ffff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f1450072da0 0x7f145006bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:40920/0 (socket says 172.21.15.17:40920) 2024-09-13T23:05:04.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.160+0000 7f144f7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1450073180 0x7f145006c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38578/0 (socket says 172.21.15.17:38578) 2024-09-13T23:05:04.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.160+0000 7f144ffff640 1 -- 172.21.15.17:0/1112333521 learned_addr learned my addr 172.21.15.17:0/1112333521 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:05:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.160+0000 7fc5fa49b640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fc5f406d2f0 con 0x7fc5f412e940 2024-09-13T23:05:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.160+0000 7f8f0effd640 1 --2- 172.21.15.17:0/3011905344 >> v2:172.21.15.17:3300/0 conn(0x7f8f10096840 0x7f8f10096c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.160+0000 7fc5f3fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc5f406eda0 0x7fc5f406f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:40904/0 (socket says 172.21.15.17:40904) 2024-09-13T23:05:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.161+0000 7fc5f3fff640 1 -- 172.21.15.17:0/21642540 learned_addr learned my addr 172.21.15.17:0/21642540 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:05:04.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.161+0000 7f75de359640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f75d812c570 0x7f75d812c950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:40934/0 (socket says 172.21.15.17:40934) 2024-09-13T23:05:04.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.161+0000 7f75de359640 1 -- 172.21.15.17:0/2957180852 learned_addr learned my addr 172.21.15.17:0/2957180852 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:05:04.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.161+0000 7f75ddb58640 1 --2- 172.21.15.17:0/2957180852 >> v2:172.21.15.17:3300/0 conn(0x7f75d8098a20 0x7f75d812d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.161+0000 7fc5f37fe640 1 --2- 172.21.15.17:0/21642540 >> v2:172.21.15.17:3300/0 conn(0x7fc5f412e940 0x7fc5f4130d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.161+0000 7f144f7fe640 1 -- 172.21.15.17:0/1112333521 >> v1:172.21.15.17:6789/0 conn(0x7f1450072da0 legacy=0x7f145006bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.161+0000 7f144f7fe640 1 -- 172.21.15.17:0/1112333521 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f145006f240 con 0x7f1450073180 2024-09-13T23:05:04.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.161+0000 7f8f0effd640 1 -- 172.21.15.17:0/3011905344 >> v1:172.21.15.17:6789/0 conn(0x7f8f10097160 legacy=0x7f8f10128340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.161+0000 7f8f0dffb640 1 -- 172.21.15.17:0/3011905344 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2061151557 0 0) 0x7f8f1009aaa0 con 0x7f8f10097160 2024-09-13T23:05:04.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.161+0000 7f8f0effd640 1 -- 172.21.15.17:0/3011905344 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f10074ee0 con 0x7f8f10096840 2024-09-13T23:05:04.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.161+0000 7f75ddb58640 1 -- 172.21.15.17:0/2957180852 >> v1:172.21.15.17:6789/0 conn(0x7f75d812c570 legacy=0x7f75d812c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.161+0000 7f75ddb58640 1 -- 172.21.15.17:0/2957180852 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d8132a70 con 0x7f75d8098a20 2024-09-13T23:05:04.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.161+0000 7fc5f2ffd640 1 -- 172.21.15.17:0/21642540 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2895609632 0 0) 0x7fc5f406eba0 con 0x7fc5f406eda0 2024-09-13T23:05:04.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.161+0000 7fc5f2ffd640 1 -- 172.21.15.17:0/21642540 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5dc005730 con 0x7fc5f406eda0 2024-09-13T23:05:04.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.161+0000 7fc5f2ffd640 1 -- 172.21.15.17:0/21642540 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 578663971 0 0) 0x7fc5dc005730 con 0x7fc5f406eda0 2024-09-13T23:05:04.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.161+0000 7fc5f2ffd640 1 -- 172.21.15.17:0/21642540 >> v2:172.21.15.17:3300/0 conn(0x7fc5f412e940 msgr2=0x7fc5f4130d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T23:05:04.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.161+0000 7fc5f2ffd640 1 --2- 172.21.15.17:0/21642540 >> v2:172.21.15.17:3300/0 conn(0x7fc5f412e940 0x7fc5f4130d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.161+0000 7fc5f2ffd640 1 -- 172.21.15.17:0/21642540 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f4070d50 con 0x7fc5f406eda0 2024-09-13T23:05:04.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.161+0000 7fc5f2ffd640 1 -- 172.21.15.17:0/21642540 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 3051827003 0 0) 0x7fc5e40015a0 con 0x7fc5f406eda0 2024-09-13T23:05:04.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.161+0000 7fc5f2ffd640 1 -- 172.21.15.17:0/21642540 >> v1:172.21.15.17:6789/0 conn(0x7fc5f406eda0 legacy=0x7fc5f406f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.161+0000 7fc5f2ffd640 1 --2- 172.21.15.17:0/21642540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc005c10 0x7fc5dc006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.161+0000 7fc5f2ffd640 1 -- 172.21.15.17:0/21642540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f406d2f0 con 0x7fc5dc005c10 2024-09-13T23:05:04.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.162+0000 7fc5f3fff640 1 --2- 172.21.15.17:0/21642540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc005c10 0x7fc5dc006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.162+0000 7fc5f3fff640 1 -- 172.21.15.17:0/21642540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5dc005730 con 0x7fc5dc005c10 2024-09-13T23:05:04.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.162+0000 7f144f7fe640 1 --2- 172.21.15.17:0/1112333521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1450073180 0x7f145006c2b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1440009720 tx=0x7f144002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df481d967235a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:04.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.162+0000 7f75ddb58640 1 --2- 172.21.15.17:0/2957180852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d8098a20 0x7f75d812d060 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f75c8009720 tx=0x7f75c802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d92891f088c844 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:04.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.162+0000 7f8f0effd640 1 --2- 172.21.15.17:0/3011905344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f10096840 0x7f8f10096c20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8f00009720 tx=0x7f8f0002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4979f924ab6426 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:04.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.162+0000 7f144effd640 1 -- 172.21.15.17:0/1112333521 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1440037070 con 0x7f1450073180 2024-09-13T23:05:04.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.162+0000 7f144effd640 1 -- 172.21.15.17:0/1112333521 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f144002ad90 con 0x7f1450073180 2024-09-13T23:05:04.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.162+0000 7f144effd640 1 -- 172.21.15.17:0/1112333521 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1440032590 con 0x7f1450073180 2024-09-13T23:05:04.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.162+0000 7f75dd357640 1 -- 172.21.15.17:0/2957180852 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75c8037070 con 0x7f75d8098a20 2024-09-13T23:05:04.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.163+0000 7f75dd357640 1 -- 172.21.15.17:0/2957180852 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75c802ad90 con 0x7f75d8098a20 2024-09-13T23:05:04.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.162+0000 7f8f0dffb640 1 -- 172.21.15.17:0/3011905344 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f00037070 con 0x7f8f10096840 2024-09-13T23:05:04.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.163+0000 7f8f0dffb640 1 -- 172.21.15.17:0/3011905344 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f0002ad90 con 0x7f8f10096840 2024-09-13T23:05:04.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.163+0000 7f8f0dffb640 1 -- 172.21.15.17:0/3011905344 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f00032590 con 0x7f8f10096840 2024-09-13T23:05:04.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.163+0000 7f75dd357640 1 -- 172.21.15.17:0/2957180852 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75c8032590 con 0x7f75d8098a20 2024-09-13T23:05:04.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.163+0000 7fc5f3fff640 1 --2- 172.21.15.17:0/21642540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc005c10 0x7fc5dc006010 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4007f20 tx=0x7fc5dc007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b8e1e3fb091e99b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:04.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.163+0000 7fc5f2ffd640 1 -- 172.21.15.17:0/21642540 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5e4007bc0 con 0x7fc5dc005c10 2024-09-13T23:05:04.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.163+0000 7fc5f2ffd640 1 -- 172.21.15.17:0/21642540 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e40058d0 con 0x7fc5dc005c10 2024-09-13T23:05:04.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.163+0000 7fc5f2ffd640 1 -- 172.21.15.17:0/21642540 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5e4005bf0 con 0x7fc5dc005c10 2024-09-13T23:05:04.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.163+0000 7f1456711640 1 -- 172.21.15.17:0/1112333521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1450073180 msgr2=0x7f145006c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.163+0000 7f1456711640 1 --2- 172.21.15.17:0/1112333521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1450073180 0x7f145006c2b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1440009720 tx=0x7f144002a110 comp rx=0 tx=0).stop 2024-09-13T23:05:04.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.163+0000 7f1456711640 1 -- 172.21.15.17:0/1112333521 shutdown_connections 2024-09-13T23:05:04.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.163+0000 7f1456711640 1 --2- 172.21.15.17:0/1112333521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1450073180 0x7f145006c2b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.163+0000 7f1456711640 1 -- 172.21.15.17:0/1112333521 >> 172.21.15.17:0/1112333521 conn(0x7f145009e0b0 msgr2=0x7f145009a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:04.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.163+0000 7f1456711640 1 -- 172.21.15.17:0/1112333521 shutdown_connections 2024-09-13T23:05:04.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.163+0000 7f1456711640 1 -- 172.21.15.17:0/1112333521 wait complete. 2024-09-13T23:05:04.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.163+0000 7f8f15959640 1 -- 172.21.15.17:0/3011905344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f10096840 msgr2=0x7f8f10096c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.163+0000 7f75e05bd640 1 -- 172.21.15.17:0/2957180852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d8098a20 msgr2=0x7f75d812d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.163+0000 7f75e05bd640 1 --2- 172.21.15.17:0/2957180852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d8098a20 0x7f75d812d060 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f75c8009720 tx=0x7f75c802a110 comp rx=0 tx=0).stop 2024-09-13T23:05:04.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.163+0000 7f8f15959640 1 --2- 172.21.15.17:0/3011905344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f10096840 0x7f8f10096c20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8f00009720 tx=0x7f8f0002a110 comp rx=0 tx=0).stop 2024-09-13T23:05:04.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.164+0000 7f8f15959640 1 -- 172.21.15.17:0/3011905344 shutdown_connections 2024-09-13T23:05:04.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.164+0000 7f8f15959640 1 --2- 172.21.15.17:0/3011905344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f10096840 0x7f8f10096c20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.164+0000 7f75e05bd640 1 -- 172.21.15.17:0/2957180852 shutdown_connections 2024-09-13T23:05:04.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.164+0000 7f75e05bd640 1 --2- 172.21.15.17:0/2957180852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d8098a20 0x7f75d812d060 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.164+0000 7f75e05bd640 1 -- 172.21.15.17:0/2957180852 >> 172.21.15.17:0/2957180852 conn(0x7f75d809f020 msgr2=0x7f75d809f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:04.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.164+0000 7fc5fa49b640 1 -- 172.21.15.17:0/21642540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc005c10 msgr2=0x7fc5dc006010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.164+0000 7fc5fa49b640 1 --2- 172.21.15.17:0/21642540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc005c10 0x7fc5dc006010 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4007f20 tx=0x7fc5dc007a40 comp rx=0 tx=0).stop 2024-09-13T23:05:04.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.164+0000 7f8f15959640 1 -- 172.21.15.17:0/3011905344 >> 172.21.15.17:0/3011905344 conn(0x7f8f1009d850 msgr2=0x7f8f10099d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:04.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.164+0000 7f8f15959640 1 -- 172.21.15.17:0/3011905344 shutdown_connections 2024-09-13T23:05:04.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.164+0000 7f8f15959640 1 -- 172.21.15.17:0/3011905344 wait complete. 2024-09-13T23:05:04.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.164+0000 7f75e05bd640 1 -- 172.21.15.17:0/2957180852 shutdown_connections 2024-09-13T23:05:04.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.164+0000 7f75e05bd640 1 -- 172.21.15.17:0/2957180852 wait complete. 2024-09-13T23:05:04.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.164+0000 7fc5fa49b640 1 -- 172.21.15.17:0/21642540 shutdown_connections 2024-09-13T23:05:04.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.164+0000 7fc5fa49b640 1 --2- 172.21.15.17:0/21642540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc005c10 0x7fc5dc006010 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.164+0000 7fc5fa49b640 1 --2- 172.21.15.17:0/21642540 >> v2:172.21.15.17:3300/0 conn(0x7fc5f412e940 0x7fc5f4130d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.164+0000 7fc5fa49b640 1 -- 172.21.15.17:0/21642540 >> 172.21.15.17:0/21642540 conn(0x7fc5f409a890 msgr2=0x7fc5f409aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:04.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.164+0000 7fc5fa49b640 1 -- 172.21.15.17:0/21642540 shutdown_connections 2024-09-13T23:05:04.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.164+0000 7fc5fa49b640 1 -- 172.21.15.17:0/21642540 wait complete. 2024-09-13T23:05:04.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.165+0000 7f8f15959640 1 Processor -- start 2024-09-13T23:05:04.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.165+0000 7f1456711640 1 Processor -- start 2024-09-13T23:05:04.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.165+0000 7fc5fa49b640 1 Processor -- start 2024-09-13T23:05:04.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.165+0000 7f8f15959640 1 -- start start 2024-09-13T23:05:04.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.165+0000 7fc5fa49b640 1 -- start start 2024-09-13T23:05:04.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.165+0000 7f1456711640 1 -- start start 2024-09-13T23:05:04.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.165+0000 7f75e05bd640 1 Processor -- start 2024-09-13T23:05:04.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.165+0000 7f8f15959640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f10096840 0x7f8f101c3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.165+0000 7f8f15959640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8f100975b0 con 0x7f8f10096840 2024-09-13T23:05:04.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.165+0000 7f75e05bd640 1 -- start start 2024-09-13T23:05:04.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.165+0000 7f8f0effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f10096840 0x7f8f101c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.165+0000 7f8f0effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f10096840 0x7f8f101c3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38608/0 (socket says 172.21.15.17:38608) 2024-09-13T23:05:04.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.165+0000 7f8f0effd640 1 -- 172.21.15.17:0/305279477 learned_addr learned my addr 172.21.15.17:0/305279477 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:04.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.166+0000 7f8f0effd640 1 -- 172.21.15.17:0/305279477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f100908e0 con 0x7f8f10096840 2024-09-13T23:05:04.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.166+0000 7fc5fa49b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc005c10 0x7fc5f412a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.166+0000 7f1456711640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1450072da0 0x7f1450123690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.166+0000 7fc5fa49b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f406fcd0 con 0x7fc5dc005c10 2024-09-13T23:05:04.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.166+0000 7f1456711640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1450134c40 con 0x7f1450072da0 2024-09-13T23:05:04.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.166+0000 7fc5f3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc005c10 0x7fc5f412a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.166+0000 7f8f0effd640 1 --2- 172.21.15.17:0/305279477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f10096840 0x7f8f101c3530 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8f0002ad60 tx=0x7f8f000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:04.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.166+0000 7fc5f3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc005c10 0x7fc5f412a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38622/0 (socket says 172.21.15.17:38622) 2024-09-13T23:05:04.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.166+0000 7fc5f3fff640 1 -- 172.21.15.17:0/1929746525 learned_addr learned my addr 172.21.15.17:0/1929746525 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:04.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.166+0000 7f144ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1450072da0 0x7f1450123690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.166+0000 7f75e05bd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d8098a20 0x7f75d81311c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.166+0000 7f144ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1450072da0 0x7f1450123690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38628/0 (socket says 172.21.15.17:38628) 2024-09-13T23:05:04.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.166+0000 7f144ffff640 1 -- 172.21.15.17:0/2602497253 learned_addr learned my addr 172.21.15.17:0/2602497253 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:04.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.166+0000 7f8ef7fff640 1 -- 172.21.15.17:0/305279477 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f00041070 con 0x7f8f10096840 2024-09-13T23:05:04.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.166+0000 7f75e05bd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f75d8131df0 con 0x7f75d8098a20 2024-09-13T23:05:04.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.166+0000 7f8f15959640 1 -- 172.21.15.17:0/305279477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f101c30f0 con 0x7f8f10096840 2024-09-13T23:05:04.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.166+0000 7f75de359640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d8098a20 0x7f75d81311c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.166+0000 7f8f15959640 1 -- 172.21.15.17:0/305279477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f10098430 con 0x7f8f10096840 2024-09-13T23:05:04.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.167+0000 7f75de359640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d8098a20 0x7f75d81311c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38632/0 (socket says 172.21.15.17:38632) 2024-09-13T23:05:04.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.167+0000 7fc5f3fff640 1 -- 172.21.15.17:0/1929746525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f412e080 con 0x7fc5dc005c10 2024-09-13T23:05:04.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.167+0000 7f75de359640 1 -- 172.21.15.17:0/2550706435 learned_addr learned my addr 172.21.15.17:0/2550706435 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:04.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.167+0000 7f8ef7fff640 1 -- 172.21.15.17:0/305279477 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f0003c460 con 0x7f8f10096840 2024-09-13T23:05:04.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.167+0000 7f8ef7fff640 1 -- 172.21.15.17:0/305279477 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f0004b060 con 0x7f8f10096840 2024-09-13T23:05:04.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.167+0000 7f144ffff640 1 -- 172.21.15.17:0/2602497253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1450125440 con 0x7f1450072da0 2024-09-13T23:05:04.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.167+0000 7fc5f3fff640 1 --2- 172.21.15.17:0/1929746525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc005c10 0x7fc5f412a950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4000c00 tx=0x7fc5f406bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:04.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.167+0000 7f75de359640 1 -- 172.21.15.17:0/2550706435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d8126d60 con 0x7f75d8098a20 2024-09-13T23:05:04.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.167+0000 7f144ffff640 1 --2- 172.21.15.17:0/2602497253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1450072da0 0x7f1450123690 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f144800cb20 tx=0x7f144800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:04.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.167+0000 7fc5f0ff9640 1 -- 172.21.15.17:0/1929746525 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5e4042020 con 0x7fc5dc005c10 2024-09-13T23:05:04.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.167+0000 7f144cff9640 1 -- 172.21.15.17:0/2602497253 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1448017070 con 0x7f1450072da0 2024-09-13T23:05:04.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.167+0000 7fc5f0ff9640 1 -- 172.21.15.17:0/1929746525 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e40049f0 con 0x7fc5dc005c10 2024-09-13T23:05:04.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.167+0000 7f144cff9640 1 -- 172.21.15.17:0/2602497253 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f144800abf0 con 0x7f1450072da0 2024-09-13T23:05:04.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.167+0000 7fc5fa49b640 1 -- 172.21.15.17:0/1929746525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5f412d1c0 con 0x7fc5dc005c10 2024-09-13T23:05:04.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.167+0000 7f1456711640 1 -- 172.21.15.17:0/2602497253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1450097810 con 0x7f1450072da0 2024-09-13T23:05:04.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.167+0000 7f144cff9640 1 -- 172.21.15.17:0/2602497253 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1448012400 con 0x7f1450072da0 2024-09-13T23:05:04.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.167+0000 7fc5f0ff9640 1 -- 172.21.15.17:0/1929746525 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5e4004cd0 con 0x7fc5dc005c10 2024-09-13T23:05:04.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.167+0000 7f1456711640 1 -- 172.21.15.17:0/2602497253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14501260d0 con 0x7f1450072da0 2024-09-13T23:05:04.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.167+0000 7fc5fa49b640 1 -- 172.21.15.17:0/1929746525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5f412b070 con 0x7fc5dc005c10 2024-09-13T23:05:04.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.167+0000 7f75de359640 1 --2- 172.21.15.17:0/2550706435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d8098a20 0x7f75d81311c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f75d400c4a0 tx=0x7f75d400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:04.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.168+0000 7f8f15959640 1 -- 172.21.15.17:0/305279477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8ef0000f80 con 0x7f8f10096840 2024-09-13T23:05:04.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.168+0000 7f8ef7fff640 1 -- 172.21.15.17:0/305279477 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8f00044070 con 0x7f8f10096840 2024-09-13T23:05:04.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.168+0000 7f8ef7fff640 1 --2- 172.21.15.17:0/305279477 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8efc0382a0 0x7f8efc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.168+0000 7f75ceffd640 1 -- 172.21.15.17:0/2550706435 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d4017070 con 0x7f75d8098a20 2024-09-13T23:05:04.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.168+0000 7f75ceffd640 1 -- 172.21.15.17:0/2550706435 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d4005c10 con 0x7f75d8098a20 2024-09-13T23:05:04.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.168+0000 7f8ef7fff640 1 -- 172.21.15.17:0/305279477 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f8f0006c020 con 0x7f8f10096840 2024-09-13T23:05:04.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.169+0000 7fc5da7fc640 1 -- 172.21.15.17:0/1929746525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc5f409bd00 con 0x7fc5dc005c10 2024-09-13T23:05:04.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.169+0000 7f1456711640 1 -- 172.21.15.17:0/2602497253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1434000f80 con 0x7f1450072da0 2024-09-13T23:05:04.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.168+0000 7f8ef7fff640 1 --2- 172.21.15.17:0/305279477 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f8efc03da20 0x7f8efc03fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.169+0000 7fc5f0ff9640 1 -- 172.21.15.17:0/1929746525 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc5e4045020 con 0x7fc5dc005c10 2024-09-13T23:05:04.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.168+0000 7f75ceffd640 1 -- 172.21.15.17:0/2550706435 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d4007070 con 0x7f75d8098a20 2024-09-13T23:05:04.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.168+0000 7f75e05bd640 1 -- 172.21.15.17:0/2550706435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75d80709a0 con 0x7f75d8098a20 2024-09-13T23:05:04.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.169+0000 7f75e05bd640 1 -- 172.21.15.17:0/2550706435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75d8070e70 con 0x7f75d8098a20 2024-09-13T23:05:04.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.168+0000 7f8ef7fff640 1 -- 172.21.15.17:0/305279477 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8f00031ec0 con 0x7f8efc03da20 2024-09-13T23:05:04.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.169+0000 7f8ef7fff640 1 -- 172.21.15.17:0/305279477 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f8f00073050 con 0x7f8f10096840 2024-09-13T23:05:04.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.169+0000 7f8f0e7fc640 1 --2- 172.21.15.17:0/305279477 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8efc0382a0 0x7f8efc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.169+0000 7fc5f0ff9640 1 --2- 172.21.15.17:0/1929746525 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc5e00382a0 0x7fc5e003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.169+0000 7f8f0f7fe640 1 --2- 172.21.15.17:0/305279477 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f8efc03da20 0x7f8efc03fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.169+0000 7f144cff9640 1 -- 172.21.15.17:0/2602497253 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f144801a070 con 0x7f1450072da0 2024-09-13T23:05:04.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.169+0000 7fc5f37fe640 1 --2- 172.21.15.17:0/1929746525 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc5e00382a0 0x7fc5e003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.169+0000 7fc5f0ff9640 1 -- 172.21.15.17:0/1929746525 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fc5e4005040 con 0x7fc5dc005c10 2024-09-13T23:05:04.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.169+0000 7fc5f0ff9640 1 --2- 172.21.15.17:0/1929746525 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc5e003da20 0x7fc5e003fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.169+0000 7fc5f0ff9640 1 -- 172.21.15.17:0/1929746525 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc5e40058d0 con 0x7fc5e003da20 2024-09-13T23:05:04.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.169+0000 7f75e05bd640 1 -- 172.21.15.17:0/2550706435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f75d81322a0 con 0x7f75d8098a20 2024-09-13T23:05:04.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.169+0000 7f144cff9640 1 --2- 172.21.15.17:0/2602497253 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f14300382f0 0x7f143003a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.170+0000 7f144cff9640 1 -- 172.21.15.17:0/2602497253 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f144804afa0 con 0x7f1450072da0 2024-09-13T23:05:04.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.170+0000 7f144cff9640 1 --2- 172.21.15.17:0/2602497253 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x7f143003da70 0x7f143003fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.170+0000 7f144cff9640 1 -- 172.21.15.17:0/2602497253 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f144800de50 con 0x7f143003da70 2024-09-13T23:05:04.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.170+0000 7fc5f0ff9640 1 -- 172.21.15.17:0/1929746525 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fc5e4031c70 con 0x7fc5dc005c10 2024-09-13T23:05:04.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.170+0000 7f144f7fe640 1 --2- 172.21.15.17:0/2602497253 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f14300382f0 0x7f143003a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.170+0000 7f8f0f7fe640 1 --2- 172.21.15.17:0/305279477 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f8efc03da20 0x7f8efc03fea0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:04.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.170+0000 7fc5f37fe640 1 --2- 172.21.15.17:0/1929746525 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc5e00382a0 0x7fc5e003a760 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc5f409a4b0 tx=0x7fc5e8009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:04.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.170+0000 7fc5f8a38640 1 --2- 172.21.15.17:0/1929746525 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc5e003da20 0x7fc5e003fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.170+0000 7f75ceffd640 1 -- 172.21.15.17:0/2550706435 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f75d401a070 con 0x7f75d8098a20 2024-09-13T23:05:04.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.170+0000 7f1454cae640 1 --2- 172.21.15.17:0/2602497253 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x7f143003da70 0x7f143003fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.170+0000 7f144cff9640 1 -- 172.21.15.17:0/2602497253 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f144801ad30 con 0x7f1450072da0 2024-09-13T23:05:04.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.170+0000 7f8f0e7fc640 1 --2- 172.21.15.17:0/305279477 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8efc0382a0 0x7f8efc03a760 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8f04007fd0 tx=0x7f8f04007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:04.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.170+0000 7f75ceffd640 1 --2- 172.21.15.17:0/2550706435 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f75bc0382f0 0x7f75bc03a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.170+0000 7f75ceffd640 1 -- 172.21.15.17:0/2550706435 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f75d404a4c0 con 0x7f75d8098a20 2024-09-13T23:05:04.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.170+0000 7f75ceffd640 1 --2- 172.21.15.17:0/2550706435 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x7f75bc03da70 0x7f75bc03fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.170+0000 7f75ceffd640 1 -- 172.21.15.17:0/2550706435 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f75bc0405c0 con 0x7f75bc03da70 2024-09-13T23:05:04.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.170+0000 7f75ceffd640 1 -- 172.21.15.17:0/2550706435 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f75d4051050 con 0x7f75d8098a20 2024-09-13T23:05:04.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.170+0000 7fc5f8a38640 1 --2- 172.21.15.17:0/1929746525 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc5e003da20 0x7fc5e003fea0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:04.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.170+0000 7f1454cae640 1 --2- 172.21.15.17:0/2602497253 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x7f143003da70 0x7f143003fef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:04.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.170+0000 7f75ddb58640 1 --2- 172.21.15.17:0/2550706435 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f75bc0382f0 0x7f75bc03a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.170+0000 7f144f7fe640 1 --2- 172.21.15.17:0/2602497253 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f14300382f0 0x7f143003a7b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1440009720 tx=0x7f144002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:04.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.171+0000 7f75deb5a640 1 --2- 172.21.15.17:0/2550706435 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x7f75bc03da70 0x7f75bc03fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.171+0000 7f8ef7fff640 1 -- 172.21.15.17:0/305279477 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8f00031ec0 con 0x7f8efc03da20 2024-09-13T23:05:04.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.171+0000 7f75ddb58640 1 --2- 172.21.15.17:0/2550706435 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f75bc0382f0 0x7f75bc03a7b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f75c8034000 tx=0x7f75c802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:04.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.171+0000 7f75deb5a640 1 --2- 172.21.15.17:0/2550706435 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x7f75bc03da70 0x7f75bc03fef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:04.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.171+0000 7fc5f0ff9640 1 -- 172.21.15.17:0/1929746525 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc5e40058d0 con 0x7fc5e003da20 2024-09-13T23:05:04.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.171+0000 7f144cff9640 1 -- 172.21.15.17:0/2602497253 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f144800de50 con 0x7f143003da70 2024-09-13T23:05:04.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.172+0000 7f75ceffd640 1 -- 172.21.15.17:0/2550706435 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f75bc0405c0 con 0x7f75bc03da70 2024-09-13T23:05:04.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.185+0000 7f8f15959640 1 -- 172.21.15.17:0/305279477 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8ef0002c70 con 0x7f8efc03da20 2024-09-13T23:05:04.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.185+0000 7f1456711640 1 -- 172.21.15.17:0/2602497253 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1434002c70 con 0x7f143003da70 2024-09-13T23:05:04.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.185+0000 7f8ef7fff640 1 -- 172.21.15.17:0/305279477 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8ef0002c70 con 0x7f8efc03da20 2024-09-13T23:05:04.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.185+0000 7f8f15959640 1 -- 172.21.15.17:0/305279477 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f8efc03da20 msgr2=0x7f8efc03fea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.185+0000 7f8f15959640 1 --2- 172.21.15.17:0/305279477 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f8efc03da20 0x7f8efc03fea0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.185+0000 7f144cff9640 1 -- 172.21.15.17:0/2602497253 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1434002c70 con 0x7f143003da70 2024-09-13T23:05:04.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.186+0000 7f8f15959640 1 -- 172.21.15.17:0/305279477 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8efc0382a0 msgr2=0x7f8efc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.186+0000 7f8f15959640 1 --2- 172.21.15.17:0/305279477 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8efc0382a0 0x7f8efc03a760 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8f04007fd0 tx=0x7f8f04007ac0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.186+0000 7f1456711640 1 -- 172.21.15.17:0/2602497253 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x7f143003da70 msgr2=0x7f143003fef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.186+0000 7f8f15959640 1 -- 172.21.15.17:0/305279477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f10096840 msgr2=0x7f8f101c3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.186+0000 7f8f15959640 1 --2- 172.21.15.17:0/305279477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f10096840 0x7f8f101c3530 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8f0002ad60 tx=0x7f8f000046c0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.186+0000 7f1456711640 1 --2- 172.21.15.17:0/2602497253 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x7f143003da70 0x7f143003fef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.186+0000 7f8f15959640 1 -- 172.21.15.17:0/305279477 shutdown_connections 2024-09-13T23:05:04.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.186+0000 7f8f15959640 1 --2- 172.21.15.17:0/305279477 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f8efc03da20 0x7f8efc03fea0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.186+0000 7f8f15959640 1 --2- 172.21.15.17:0/305279477 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8efc0382a0 0x7f8efc03a760 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.186+0000 7f8f15959640 1 --2- 172.21.15.17:0/305279477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f10096840 0x7f8f101c3530 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.186+0000 7f8f15959640 1 -- 172.21.15.17:0/305279477 >> 172.21.15.17:0/305279477 conn(0x7f8f1009d850 msgr2=0x7f8f10094e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:04.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.186+0000 7f1456711640 1 -- 172.21.15.17:0/2602497253 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f14300382f0 msgr2=0x7f143003a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.186+0000 7f1456711640 1 --2- 172.21.15.17:0/2602497253 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f14300382f0 0x7f143003a7b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1440009720 tx=0x7f144002e000 comp rx=0 tx=0).stop 2024-09-13T23:05:04.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.186+0000 7f1456711640 1 -- 172.21.15.17:0/2602497253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1450072da0 msgr2=0x7f1450123690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.186+0000 7f1456711640 1 --2- 172.21.15.17:0/2602497253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1450072da0 0x7f1450123690 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f144800cb20 tx=0x7f144800a060 comp rx=0 tx=0).stop 2024-09-13T23:05:04.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.186+0000 7f8f15959640 1 -- 172.21.15.17:0/305279477 shutdown_connections 2024-09-13T23:05:04.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.186+0000 7f8f15959640 1 -- 172.21.15.17:0/305279477 wait complete. 2024-09-13T23:05:04.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.186+0000 7f1456711640 1 -- 172.21.15.17:0/2602497253 shutdown_connections 2024-09-13T23:05:04.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.186+0000 7f1456711640 1 --2- 172.21.15.17:0/2602497253 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x7f143003da70 0x7f143003fef0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.186+0000 7f1456711640 1 --2- 172.21.15.17:0/2602497253 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f14300382f0 0x7f143003a7b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.186+0000 7f1456711640 1 --2- 172.21.15.17:0/2602497253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1450072da0 0x7f1450123690 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.186+0000 7f1456711640 1 -- 172.21.15.17:0/2602497253 >> 172.21.15.17:0/2602497253 conn(0x7f145009e0b0 msgr2=0x7f14500913e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:04.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.186+0000 7f1456711640 1 -- 172.21.15.17:0/2602497253 shutdown_connections 2024-09-13T23:05:04.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.186+0000 7f1456711640 1 -- 172.21.15.17:0/2602497253 wait complete. 2024-09-13T23:05:04.215 INFO:teuthology.orchestra.run.smithi017.stdout:47244640260 2024-09-13T23:05:04.216 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T23:05:04.217 INFO:teuthology.orchestra.run.smithi017.stdout:51539607558 2024-09-13T23:05:04.217 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T23:05:04.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.203+0000 7fc5da7fc640 1 -- 172.21.15.17:0/1929746525 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc5f406d890 con 0x7fc5e003da20 2024-09-13T23:05:04.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.203+0000 7fc5f0ff9640 1 -- 172.21.15.17:0/1929746525 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc5f406d890 con 0x7fc5e003da20 2024-09-13T23:05:04.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.203+0000 7f75e05bd640 1 -- 172.21.15.17:0/2550706435 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f75d812e160 con 0x7f75bc03da70 2024-09-13T23:05:04.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.204+0000 7fc5da7fc640 1 -- 172.21.15.17:0/1929746525 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc5e003da20 msgr2=0x7fc5e003fea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.204+0000 7fc5da7fc640 1 --2- 172.21.15.17:0/1929746525 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc5e003da20 0x7fc5e003fea0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.204+0000 7f75ceffd640 1 -- 172.21.15.17:0/2550706435 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f75d812e160 con 0x7f75bc03da70 2024-09-13T23:05:04.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.204+0000 7fc5da7fc640 1 -- 172.21.15.17:0/1929746525 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc5e00382a0 msgr2=0x7fc5e003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.204+0000 7fc5da7fc640 1 --2- 172.21.15.17:0/1929746525 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc5e00382a0 0x7fc5e003a760 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc5f409a4b0 tx=0x7fc5e8009190 comp rx=0 tx=0).stop 2024-09-13T23:05:04.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.204+0000 7fc5da7fc640 1 -- 172.21.15.17:0/1929746525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc005c10 msgr2=0x7fc5f412a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.204+0000 7fc5da7fc640 1 --2- 172.21.15.17:0/1929746525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc005c10 0x7fc5f412a950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4000c00 tx=0x7fc5f406bea0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.204+0000 7fc5da7fc640 1 -- 172.21.15.17:0/1929746525 shutdown_connections 2024-09-13T23:05:04.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.204+0000 7fc5da7fc640 1 --2- 172.21.15.17:0/1929746525 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc5e003da20 0x7fc5e003fea0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.204+0000 7fc5da7fc640 1 --2- 172.21.15.17:0/1929746525 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc5e00382a0 0x7fc5e003a760 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.204+0000 7fc5da7fc640 1 --2- 172.21.15.17:0/1929746525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc005c10 0x7fc5f412a950 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.204+0000 7fc5da7fc640 1 -- 172.21.15.17:0/1929746525 >> 172.21.15.17:0/1929746525 conn(0x7fc5f409a890 msgr2=0x7fc5f4125f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:04.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.204+0000 7fc5da7fc640 1 -- 172.21.15.17:0/1929746525 shutdown_connections 2024-09-13T23:05:04.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.204+0000 7fc5da7fc640 1 -- 172.21.15.17:0/1929746525 wait complete. 2024-09-13T23:05:04.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.204+0000 7f75e05bd640 1 -- 172.21.15.17:0/2550706435 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x7f75bc03da70 msgr2=0x7f75bc03fef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.204+0000 7f75e05bd640 1 --2- 172.21.15.17:0/2550706435 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x7f75bc03da70 0x7f75bc03fef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.204+0000 7f75e05bd640 1 -- 172.21.15.17:0/2550706435 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f75bc0382f0 msgr2=0x7f75bc03a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.204+0000 7f75e05bd640 1 --2- 172.21.15.17:0/2550706435 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f75bc0382f0 0x7f75bc03a7b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f75c8034000 tx=0x7f75c802e000 comp rx=0 tx=0).stop 2024-09-13T23:05:04.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.204+0000 7f75e05bd640 1 -- 172.21.15.17:0/2550706435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d8098a20 msgr2=0x7f75d81311c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.204+0000 7f75e05bd640 1 --2- 172.21.15.17:0/2550706435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d8098a20 0x7f75d81311c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f75d400c4a0 tx=0x7f75d400c960 comp rx=0 tx=0).stop 2024-09-13T23:05:04.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.204+0000 7f75e05bd640 1 -- 172.21.15.17:0/2550706435 shutdown_connections 2024-09-13T23:05:04.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.204+0000 7f75e05bd640 1 --2- 172.21.15.17:0/2550706435 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x7f75bc03da70 0x7f75bc03fef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.204+0000 7f75e05bd640 1 --2- 172.21.15.17:0/2550706435 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f75bc0382f0 0x7f75bc03a7b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.204+0000 7f75e05bd640 1 --2- 172.21.15.17:0/2550706435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d8098a20 0x7f75d81311c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.204+0000 7f75e05bd640 1 -- 172.21.15.17:0/2550706435 >> 172.21.15.17:0/2550706435 conn(0x7f75d809f020 msgr2=0x7f75d812ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:04.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.204+0000 7f75e05bd640 1 -- 172.21.15.17:0/2550706435 shutdown_connections 2024-09-13T23:05:04.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.204+0000 7f75e05bd640 1 -- 172.21.15.17:0/2550706435 wait complete. 2024-09-13T23:05:04.224 INFO:teuthology.orchestra.run.smithi017.stdout:38654705669 2024-09-13T23:05:04.224 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T23:05:04.225 INFO:teuthology.orchestra.run.smithi017.stdout:38654705669 2024-09-13T23:05:04.225 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T23:05:04.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.362+0000 7f05d43fd640 1 Processor -- start 2024-09-13T23:05:04.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.363+0000 7f05d43fd640 1 -- start start 2024-09-13T23:05:04.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.363+0000 7fbd06247640 1 Processor -- start 2024-09-13T23:05:04.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.363+0000 7f9d4e0d0640 1 Processor -- start 2024-09-13T23:05:04.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.363+0000 7fbd06247640 1 -- start start 2024-09-13T23:05:04.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.363+0000 7f9d4e0d0640 1 -- start start 2024-09-13T23:05:04.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.363+0000 7fe9169e4640 1 Processor -- start 2024-09-13T23:05:04.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.363+0000 7fe9169e4640 1 -- start start 2024-09-13T23:05:04.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.363+0000 7f05d43fd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f05cc09bd50 0x7f05cc09c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.363+0000 7f05d43fd640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05cc09d3b0 con 0x7f05cc09c670 2024-09-13T23:05:04.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.363+0000 7f05d43fd640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f05cc098230 con 0x7f05cc09bd50 2024-09-13T23:05:04.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.363+0000 7f05d2199640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f05cc09bd50 0x7f05cc09c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.363+0000 7f05d1998640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f05cc09c670 0x7f05cc0990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:40950/0 (socket says 172.21.15.17:40950) 2024-09-13T23:05:04.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.363+0000 7f05d1998640 1 -- 172.21.15.17:0/1269476029 learned_addr learned my addr 172.21.15.17:0/1269476029 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:05:04.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.364+0000 7fe9169e4640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe91006e500 0x7fe91006e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.363+0000 7fbd06247640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbd0009a100 0x7fbd00133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.363+0000 7fbd06247640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd0009d3b0 con 0x7fbd0009bd50 2024-09-13T23:05:04.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.363+0000 7fbd06247640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fbd0009c840 con 0x7fbd0009a100 2024-09-13T23:05:04.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.364+0000 7f9d4e0d0640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9d480708a0 0x7f9d48130ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.364+0000 7fe9169e4640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe91006be10 con 0x7fe91006ee20 2024-09-13T23:05:04.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.364+0000 7f9d4e0d0640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d48072700 con 0x7f9d4806e570 2024-09-13T23:05:04.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.364+0000 7f9d4e0d0640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f9d48072f90 con 0x7f9d480708a0 2024-09-13T23:05:04.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.364+0000 7f9d46ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9d480708a0 0x7f9d48130ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.364+0000 7fbcff7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fbd0009bd50 0x7fbd0009c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:40960/0 (socket says 172.21.15.17:40960) 2024-09-13T23:05:04.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.364+0000 7fe9169e4640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fe91006f200 con 0x7fe91006e500 2024-09-13T23:05:04.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.364+0000 7fe90f7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe91006ee20 0x7fe91012ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:40972/0 (socket says 172.21.15.17:40972) 2024-09-13T23:05:04.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.364+0000 7fe90ffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe91006e500 0x7fe91006e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.364+0000 7f9d46ffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9d480708a0 0x7f9d48130ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38648/0 (socket says 172.21.15.17:38648) 2024-09-13T23:05:04.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.364+0000 7fe90f7fe640 1 -- 172.21.15.17:0/2132257073 learned_addr learned my addr 172.21.15.17:0/2132257073 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:05:04.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.364+0000 7f9d46ffd640 1 -- 172.21.15.17:0/3591789248 learned_addr learned my addr 172.21.15.17:0/3591789248 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:04.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.364+0000 7fbcff7fe640 1 -- 172.21.15.17:0/2670262164 learned_addr learned my addr 172.21.15.17:0/2670262164 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:05:04.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.364+0000 7fbcfeffd640 1 --2- 172.21.15.17:0/2670262164 >> v2:172.21.15.17:3300/0 conn(0x7fbd0009a100 0x7fbd00133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.364+0000 7f05d2199640 1 -- 172.21.15.17:0/1269476029 >> v1:172.21.15.17:6789/0 conn(0x7f05cc09c670 legacy=0x7f05cc0990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.364+0000 7f05d2199640 1 -- 172.21.15.17:0/1269476029 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05cc0983e0 con 0x7f05cc09bd50 2024-09-13T23:05:04.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.364+0000 7fe90ffff640 1 -- 172.21.15.17:0/2132257073 >> v1:172.21.15.17:6789/0 conn(0x7fe91006ee20 legacy=0x7fe91012ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.364+0000 7fe90ffff640 1 -- 172.21.15.17:0/2132257073 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91006c750 con 0x7fe91006e500 2024-09-13T23:05:04.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.364+0000 7f9d46ffd640 1 -- 172.21.15.17:0/3591789248 >> v1:172.21.15.17:6789/0 conn(0x7f9d4806e570 legacy=0x7f9d4806e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.364+0000 7f9d46ffd640 1 -- 172.21.15.17:0/3591789248 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d4806f060 con 0x7f9d480708a0 2024-09-13T23:05:04.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.365+0000 7fbcfe7fc640 1 -- 172.21.15.17:0/2670262164 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2148271970 0 0) 0x7fbcf0001110 con 0x7fbd0009bd50 2024-09-13T23:05:04.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.365+0000 7fbcfe7fc640 1 -- 172.21.15.17:0/2670262164 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbce8003520 con 0x7fbd0009bd50 2024-09-13T23:05:04.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.365+0000 7fbcfeffd640 1 -- 172.21.15.17:0/2670262164 >> v1:172.21.15.17:6789/0 conn(0x7fbd0009bd50 legacy=0x7fbd0009c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.365+0000 7fbcfeffd640 1 -- 172.21.15.17:0/2670262164 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd00098230 con 0x7fbd0009a100 2024-09-13T23:05:04.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.365+0000 7f05d2199640 1 --2- 172.21.15.17:0/1269476029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05cc09bd50 0x7f05cc09c130 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f05c8009720 tx=0x7f05c802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155ed5cd34d24d7a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:04.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.365+0000 7f05d1197640 1 -- 172.21.15.17:0/1269476029 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05c8037070 con 0x7f05cc09bd50 2024-09-13T23:05:04.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.365+0000 7f05d1197640 1 -- 172.21.15.17:0/1269476029 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05c802ad90 con 0x7f05cc09bd50 2024-09-13T23:05:04.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.365+0000 7f05d1197640 1 -- 172.21.15.17:0/1269476029 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05c8032590 con 0x7f05cc09bd50 2024-09-13T23:05:04.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.365+0000 7f9d46ffd640 1 --2- 172.21.15.17:0/3591789248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d480708a0 0x7f9d48130ce0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c0097f0 tx=0x7f9d3c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad895463703c88 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:04.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.365+0000 7fe90ffff640 1 --2- 172.21.15.17:0/2132257073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe91006e500 0x7fe91006e8e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe900009720 tx=0x7fe90002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f547e4bf30d9eb97 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:04.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.365+0000 7f9d467fc640 1 -- 172.21.15.17:0/3591789248 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d3c037070 con 0x7f9d480708a0 2024-09-13T23:05:04.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.366+0000 7f9d467fc640 1 -- 172.21.15.17:0/3591789248 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d3c032440 con 0x7f9d480708a0 2024-09-13T23:05:04.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.366+0000 7f9d467fc640 1 -- 172.21.15.17:0/3591789248 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d3c02ae60 con 0x7f9d480708a0 2024-09-13T23:05:04.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.366+0000 7fe90effd640 1 -- 172.21.15.17:0/2132257073 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe900037070 con 0x7fe91006e500 2024-09-13T23:05:04.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.366+0000 7fe90effd640 1 -- 172.21.15.17:0/2132257073 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe90002ad90 con 0x7fe91006e500 2024-09-13T23:05:04.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.366+0000 7fe90effd640 1 -- 172.21.15.17:0/2132257073 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe900032590 con 0x7fe91006e500 2024-09-13T23:05:04.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.366+0000 7fbcfeffd640 1 --2- 172.21.15.17:0/2670262164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd0009a100 0x7fbd00133da0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4009720 tx=0x7fbcf402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e3db88e534f504 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:04.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.366+0000 7fbcfe7fc640 1 -- 172.21.15.17:0/2670262164 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf4037070 con 0x7fbd0009a100 2024-09-13T23:05:04.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.366+0000 7f05d43fd640 1 -- 172.21.15.17:0/1269476029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05cc09bd50 msgr2=0x7f05cc09c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.366+0000 7f05d43fd640 1 --2- 172.21.15.17:0/1269476029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05cc09bd50 0x7f05cc09c130 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f05c8009720 tx=0x7f05c802a110 comp rx=0 tx=0).stop 2024-09-13T23:05:04.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.366+0000 7fbcfe7fc640 1 -- 172.21.15.17:0/2670262164 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf402ad90 con 0x7fbd0009a100 2024-09-13T23:05:04.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.366+0000 7fbcfe7fc640 1 -- 172.21.15.17:0/2670262164 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf4032570 con 0x7fbd0009a100 2024-09-13T23:05:04.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.366+0000 7f9d4e0d0640 1 -- 172.21.15.17:0/3591789248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d480708a0 msgr2=0x7f9d48130ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.366+0000 7f9d4e0d0640 1 --2- 172.21.15.17:0/3591789248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d480708a0 0x7f9d48130ce0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c0097f0 tx=0x7f9d3c02a1e0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.366+0000 7f05d43fd640 1 -- 172.21.15.17:0/1269476029 shutdown_connections 2024-09-13T23:05:04.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.366+0000 7f05d43fd640 1 --2- 172.21.15.17:0/1269476029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05cc09bd50 0x7f05cc09c130 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.366+0000 7f05d43fd640 1 -- 172.21.15.17:0/1269476029 >> 172.21.15.17:0/1269476029 conn(0x7f05cc06d4a0 msgr2=0x7f05cc06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:04.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.366+0000 7f9d4e0d0640 1 -- 172.21.15.17:0/3591789248 shutdown_connections 2024-09-13T23:05:04.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.366+0000 7f9d4e0d0640 1 --2- 172.21.15.17:0/3591789248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d480708a0 0x7f9d48130ce0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.366+0000 7f9d4e0d0640 1 -- 172.21.15.17:0/3591789248 >> 172.21.15.17:0/3591789248 conn(0x7f9d4809aa80 msgr2=0x7f9d4809ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:04.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.366+0000 7f05d43fd640 1 -- 172.21.15.17:0/1269476029 shutdown_connections 2024-09-13T23:05:04.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.366+0000 7f9d4e0d0640 1 -- 172.21.15.17:0/3591789248 shutdown_connections 2024-09-13T23:05:04.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.366+0000 7f05d43fd640 1 -- 172.21.15.17:0/1269476029 wait complete. 2024-09-13T23:05:04.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.366+0000 7f9d4e0d0640 1 -- 172.21.15.17:0/3591789248 wait complete. 2024-09-13T23:05:04.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.367+0000 7fe9169e4640 1 -- 172.21.15.17:0/2132257073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe91006e500 msgr2=0x7fe91006e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.367+0000 7fe9169e4640 1 --2- 172.21.15.17:0/2132257073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe91006e500 0x7fe91006e8e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe900009720 tx=0x7fe90002a110 comp rx=0 tx=0).stop 2024-09-13T23:05:04.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.367+0000 7fe9169e4640 1 -- 172.21.15.17:0/2132257073 shutdown_connections 2024-09-13T23:05:04.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.367+0000 7fe9169e4640 1 --2- 172.21.15.17:0/2132257073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe91006e500 0x7fe91006e8e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.367+0000 7fe9169e4640 1 -- 172.21.15.17:0/2132257073 >> 172.21.15.17:0/2132257073 conn(0x7fe91009aa80 msgr2=0x7fe91009ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:04.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.367+0000 7fe9169e4640 1 -- 172.21.15.17:0/2132257073 shutdown_connections 2024-09-13T23:05:04.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.367+0000 7fe9169e4640 1 -- 172.21.15.17:0/2132257073 wait complete. 2024-09-13T23:05:04.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.367+0000 7fbd06247640 1 -- 172.21.15.17:0/2670262164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd0009a100 msgr2=0x7fbd00133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.367+0000 7fbd06247640 1 --2- 172.21.15.17:0/2670262164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd0009a100 0x7fbd00133da0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4009720 tx=0x7fbcf402a110 comp rx=0 tx=0).stop 2024-09-13T23:05:04.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.367+0000 7fbd06247640 1 -- 172.21.15.17:0/2670262164 shutdown_connections 2024-09-13T23:05:04.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.367+0000 7fbd06247640 1 --2- 172.21.15.17:0/2670262164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd0009a100 0x7fbd00133da0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.367+0000 7fbd06247640 1 -- 172.21.15.17:0/2670262164 >> 172.21.15.17:0/2670262164 conn(0x7fbd0006d4a0 msgr2=0x7fbd0006d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:04.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.367+0000 7fbd06247640 1 -- 172.21.15.17:0/2670262164 shutdown_connections 2024-09-13T23:05:04.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.367+0000 7fbd06247640 1 -- 172.21.15.17:0/2670262164 wait complete. 2024-09-13T23:05:04.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.368+0000 7f9d4e0d0640 1 Processor -- start 2024-09-13T23:05:04.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.368+0000 7f9d4e0d0640 1 -- start start 2024-09-13T23:05:04.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.368+0000 7f05d43fd640 1 Processor -- start 2024-09-13T23:05:04.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.368+0000 7fe9169e4640 1 Processor -- start 2024-09-13T23:05:04.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.368+0000 7f05d43fd640 1 -- start start 2024-09-13T23:05:04.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.368+0000 7f9d4e0d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d4806e570 0x7f9d481b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.368+0000 7f9d4e0d0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4806bd20 con 0x7f9d4806e570 2024-09-13T23:05:04.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.368+0000 7fbd06247640 1 Processor -- start 2024-09-13T23:05:04.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.368+0000 7f9d477fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d4806e570 0x7f9d481b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.368+0000 7fe9169e4640 1 -- start start 2024-09-13T23:05:04.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.368+0000 7f9d477fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d4806e570 0x7f9d481b0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38650/0 (socket says 172.21.15.17:38650) 2024-09-13T23:05:04.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.368+0000 7f9d477fe640 1 -- 172.21.15.17:0/1635426601 learned_addr learned my addr 172.21.15.17:0/1635426601 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:04.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.368+0000 7fbd06247640 1 -- start start 2024-09-13T23:05:04.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.369+0000 7f9d477fe640 1 -- 172.21.15.17:0/1635426601 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d4808f690 con 0x7f9d4806e570 2024-09-13T23:05:04.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.369+0000 7f9d477fe640 1 --2- 172.21.15.17:0/1635426601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d4806e570 0x7f9d481b0ac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800c450 tx=0x7f9d3800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:04.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.369+0000 7f05d43fd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05cc09bd50 0x7f05cc1c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.369+0000 7f9d2ffff640 1 -- 172.21.15.17:0/1635426601 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d38017070 con 0x7f9d4806e570 2024-09-13T23:05:04.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.369+0000 7fe9169e4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe91006e500 0x7fe910122e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.369+0000 7f05d43fd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f05cc099b90 con 0x7f05cc09bd50 2024-09-13T23:05:04.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.369+0000 7f9d2ffff640 1 -- 172.21.15.17:0/1635426601 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d38005220 con 0x7f9d4806e570 2024-09-13T23:05:04.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.369+0000 7fbd06247640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd0009a100 0x7fbd000927d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.369+0000 7fbd06247640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbd00134670 con 0x7fbd0009a100 2024-09-13T23:05:04.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.369+0000 7fe9169e4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe91012f780 con 0x7fe91006e500 2024-09-13T23:05:04.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.369+0000 7fe90ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe91006e500 0x7fe910122e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.369+0000 7f9d2ffff640 1 -- 172.21.15.17:0/1635426601 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d380035f0 con 0x7f9d4806e570 2024-09-13T23:05:04.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.369+0000 7f9d4e0d0640 1 -- 172.21.15.17:0/1635426601 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d481b2820 con 0x7f9d4806e570 2024-09-13T23:05:04.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.369+0000 7f9d4e0d0640 1 -- 172.21.15.17:0/1635426601 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d48072920 con 0x7f9d4806e570 2024-09-13T23:05:04.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.369+0000 7fbcff7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd0009a100 0x7fbd000927d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.369+0000 7f05d2199640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05cc09bd50 0x7f05cc1c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.370+0000 7fbcff7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd0009a100 0x7fbd000927d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38664/0 (socket says 172.21.15.17:38664) 2024-09-13T23:05:04.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.370+0000 7fbcff7fe640 1 -- 172.21.15.17:0/3237569316 learned_addr learned my addr 172.21.15.17:0/3237569316 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:04.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.369+0000 7f05d2199640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05cc09bd50 0x7f05cc1c3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38652/0 (socket says 172.21.15.17:38652) 2024-09-13T23:05:04.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.370+0000 7f05d2199640 1 -- 172.21.15.17:0/811285856 learned_addr learned my addr 172.21.15.17:0/811285856 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:04.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.370+0000 7fe90ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe91006e500 0x7fe910122e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38656/0 (socket says 172.21.15.17:38656) 2024-09-13T23:05:04.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.370+0000 7fe90ffff640 1 -- 172.21.15.17:0/4218171752 learned_addr learned my addr 172.21.15.17:0/4218171752 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:04.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.370+0000 7fbcff7fe640 1 -- 172.21.15.17:0/3237569316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd000948b0 con 0x7fbd0009a100 2024-09-13T23:05:04.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.370+0000 7fe90ffff640 1 -- 172.21.15.17:0/4218171752 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe910124c50 con 0x7fe91006e500 2024-09-13T23:05:04.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.370+0000 7f05d2199640 1 -- 172.21.15.17:0/811285856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05cc1b3080 con 0x7f05cc09bd50 2024-09-13T23:05:04.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.370+0000 7fe90ffff640 1 --2- 172.21.15.17:0/4218171752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe91006e500 0x7fe910122e90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe900009720 tx=0x7fe9000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:04.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.370+0000 7fbcff7fe640 1 --2- 172.21.15.17:0/3237569316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd0009a100 0x7fbd000927d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000c6b0 tx=0x7fbcf000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:04.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.371+0000 7f05d2199640 1 --2- 172.21.15.17:0/811285856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05cc09bd50 0x7f05cc1c3900 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f05c8009840 tx=0x7f05c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:04.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.371+0000 7f9d2ffff640 1 -- 172.21.15.17:0/1635426601 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9d3801a070 con 0x7f9d4806e570 2024-09-13T23:05:04.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.370+0000 7f9d4e0d0640 1 -- 172.21.15.17:0/1635426601 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d4809ec50 con 0x7f9d4806e570 2024-09-13T23:05:04.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.371+0000 7fbce7fff640 1 -- 172.21.15.17:0/3237569316 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf0017070 con 0x7fbd0009a100 2024-09-13T23:05:04.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.371+0000 7fe90cff9640 1 -- 172.21.15.17:0/4218171752 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe900041070 con 0x7fe91006e500 2024-09-13T23:05:04.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.371+0000 7fe9169e4640 1 -- 172.21.15.17:0/4218171752 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe91012f090 con 0x7fe91006e500 2024-09-13T23:05:04.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.371+0000 7fe9169e4640 1 -- 172.21.15.17:0/4218171752 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe910125dd0 con 0x7fe91006e500 2024-09-13T23:05:04.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.371+0000 7fe90cff9640 1 -- 172.21.15.17:0/4218171752 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe90003c460 con 0x7fe91006e500 2024-09-13T23:05:04.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.371+0000 7fe90cff9640 1 -- 172.21.15.17:0/4218171752 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe900037040 con 0x7fe91006e500 2024-09-13T23:05:04.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.371+0000 7fbce7fff640 1 -- 172.21.15.17:0/3237569316 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf0007e40 con 0x7fbd0009a100 2024-09-13T23:05:04.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.371+0000 7fbce7fff640 1 -- 172.21.15.17:0/3237569316 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf00059e0 con 0x7fbd0009a100 2024-09-13T23:05:04.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.371+0000 7fbd06247640 1 -- 172.21.15.17:0/3237569316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd00095290 con 0x7fbd0009a100 2024-09-13T23:05:04.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.371+0000 7fbd06247640 1 -- 172.21.15.17:0/3237569316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd00092ef0 con 0x7fbd0009a100 2024-09-13T23:05:04.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.371+0000 7f05c2ffd640 1 -- 172.21.15.17:0/811285856 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05c8041070 con 0x7f05cc09bd50 2024-09-13T23:05:04.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.371+0000 7f05c2ffd640 1 -- 172.21.15.17:0/811285856 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05c803c460 con 0x7f05cc09bd50 2024-09-13T23:05:04.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.371+0000 7f05c2ffd640 1 -- 172.21.15.17:0/811285856 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05c8037040 con 0x7f05cc09bd50 2024-09-13T23:05:04.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.371+0000 7f9d2ffff640 1 --2- 172.21.15.17:0/1635426601 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9d340382a0 0x7f9d3403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.371+0000 7f9d2ffff640 1 -- 172.21.15.17:0/1635426601 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f9d3804a510 con 0x7f9d4806e570 2024-09-13T23:05:04.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.372+0000 7f05d43fd640 1 -- 172.21.15.17:0/811285856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05cc1b4880 con 0x7f05cc09bd50 2024-09-13T23:05:04.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.372+0000 7fe9169e4640 1 -- 172.21.15.17:0/4218171752 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe91006e8e0 con 0x7fe91006e500 2024-09-13T23:05:04.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.372+0000 7f05d43fd640 1 -- 172.21.15.17:0/811285856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05cc1b1a80 con 0x7f05cc09bd50 2024-09-13T23:05:04.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.372+0000 7f9d46ffd640 1 --2- 172.21.15.17:0/1635426601 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9d340382a0 0x7f9d3403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.372+0000 7fbd06247640 1 -- 172.21.15.17:0/3237569316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd00131e10 con 0x7fbd0009a100 2024-09-13T23:05:04.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.373+0000 7f9d46ffd640 1 --2- 172.21.15.17:0/1635426601 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9d340382a0 0x7f9d3403a760 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c034000 tx=0x7f9d3c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:04.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.373+0000 7f05d43fd640 1 -- 172.21.15.17:0/811285856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05cc09a130 con 0x7f05cc09bd50 2024-09-13T23:05:04.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.376+0000 7f9d2ffff640 1 -- 172.21.15.17:0/1635426601 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9d3801ac60 con 0x7f9d4806e570 2024-09-13T23:05:04.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.377+0000 7fbce7fff640 1 -- 172.21.15.17:0/3237569316 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbcf001a070 con 0x7fbd0009a100 2024-09-13T23:05:04.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.377+0000 7fbce7fff640 1 --2- 172.21.15.17:0/3237569316 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbcec038250 0x7fbcec03a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.377+0000 7fbce7fff640 1 -- 172.21.15.17:0/3237569316 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fbcf004aac0 con 0x7fbd0009a100 2024-09-13T23:05:04.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.377+0000 7f05c2ffd640 1 -- 172.21.15.17:0/811285856 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f05c8044070 con 0x7f05cc09bd50 2024-09-13T23:05:04.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.377+0000 7fe90cff9640 1 -- 172.21.15.17:0/4218171752 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe900044070 con 0x7fe91006e500 2024-09-13T23:05:04.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.377+0000 7fe90cff9640 1 --2- 172.21.15.17:0/4218171752 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe8fc038250 0x7fe8fc03a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.377+0000 7fe90cff9640 1 -- 172.21.15.17:0/4218171752 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fe90003b780 con 0x7fe91006e500 2024-09-13T23:05:04.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.377+0000 7f05c2ffd640 1 --2- 172.21.15.17:0/811285856 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f05b0038320 0x7f05b003a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:04.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.377+0000 7f05c2ffd640 1 -- 172.21.15.17:0/811285856 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f05c806c0d0 con 0x7f05cc09bd50 2024-09-13T23:05:04.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.377+0000 7fbcfeffd640 1 --2- 172.21.15.17:0/3237569316 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbcec038250 0x7fbcec03a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.378+0000 7fe90f7fe640 1 --2- 172.21.15.17:0/4218171752 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe8fc038250 0x7fe8fc03a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.378+0000 7f05d1998640 1 --2- 172.21.15.17:0/811285856 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f05b0038320 0x7f05b003a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:04.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.378+0000 7fe90f7fe640 1 --2- 172.21.15.17:0/4218171752 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe8fc038250 0x7fe8fc03a710 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe904007fd0 tx=0x7fe904007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:04.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.378+0000 7fbcfeffd640 1 --2- 172.21.15.17:0/3237569316 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbcec038250 0x7fbcec03a710 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4034000 tx=0x7fbcf402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:04.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.378+0000 7f05d1998640 1 --2- 172.21.15.17:0/811285856 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f05b0038320 0x7f05b003a7e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f05bc007fd0 tx=0x7f05bc007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:04.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.381+0000 7fe90cff9640 1 -- 172.21.15.17:0/4218171752 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe90003a720 con 0x7fe91006e500 2024-09-13T23:05:04.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.386+0000 7fbce7fff640 1 -- 172.21.15.17:0/3237569316 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbcf0021020 con 0x7fbd0009a100 2024-09-13T23:05:04.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.390+0000 7f05c2ffd640 1 -- 172.21.15.17:0/811285856 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f05cc1b3080 con 0x7f05cc09bd50 2024-09-13T23:05:04.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.558+0000 7fe9169e4640 1 -- 172.21.15.17:0/4218171752 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe910126170 con 0x7fe91006e500 2024-09-13T23:05:04.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.558+0000 7fe90cff9640 1 -- 172.21.15.17:0/4218171752 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe900050480 con 0x7fe91006e500 2024-09-13T23:05:04.559 INFO:teuthology.orchestra.run.smithi017.stdout:38654705667 2024-09-13T23:05:04.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.561+0000 7fe9169e4640 1 -- 172.21.15.17:0/4218171752 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe8fc038250 msgr2=0x7fe8fc03a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.561+0000 7fe9169e4640 1 --2- 172.21.15.17:0/4218171752 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe8fc038250 0x7fe8fc03a710 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe904007fd0 tx=0x7fe904007ac0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.561+0000 7fe9169e4640 1 -- 172.21.15.17:0/4218171752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe91006e500 msgr2=0x7fe910122e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.561+0000 7fe9169e4640 1 --2- 172.21.15.17:0/4218171752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe91006e500 0x7fe910122e90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe900009720 tx=0x7fe9000046c0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.561+0000 7fe9169e4640 1 -- 172.21.15.17:0/4218171752 shutdown_connections 2024-09-13T23:05:04.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.561+0000 7fe9169e4640 1 --2- 172.21.15.17:0/4218171752 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe8fc038250 0x7fe8fc03a710 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.561+0000 7fe9169e4640 1 --2- 172.21.15.17:0/4218171752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe91006e500 0x7fe910122e90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.561+0000 7fe9169e4640 1 -- 172.21.15.17:0/4218171752 >> 172.21.15.17:0/4218171752 conn(0x7fe91009aa80 msgr2=0x7fe910071790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:04.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.561+0000 7fe9169e4640 1 -- 172.21.15.17:0/4218171752 shutdown_connections 2024-09-13T23:05:04.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.561+0000 7fe9169e4640 1 -- 172.21.15.17:0/4218171752 wait complete. 2024-09-13T23:05:04.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.565+0000 7fbd06247640 1 -- 172.21.15.17:0/3237569316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fbd000954c0 con 0x7fbd0009a100 2024-09-13T23:05:04.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.565+0000 7fbce7fff640 1 -- 172.21.15.17:0/3237569316 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbcf0005e20 con 0x7fbd0009a100 2024-09-13T23:05:04.566 INFO:teuthology.orchestra.run.smithi017.stdout:47244640259 2024-09-13T23:05:04.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.567+0000 7fbd06247640 1 -- 172.21.15.17:0/3237569316 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbcec038250 msgr2=0x7fbcec03a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.567+0000 7fbd06247640 1 --2- 172.21.15.17:0/3237569316 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbcec038250 0x7fbcec03a710 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4034000 tx=0x7fbcf402e000 comp rx=0 tx=0).stop 2024-09-13T23:05:04.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.567+0000 7fbd06247640 1 -- 172.21.15.17:0/3237569316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd0009a100 msgr2=0x7fbd000927d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.567+0000 7fbd06247640 1 --2- 172.21.15.17:0/3237569316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd0009a100 0x7fbd000927d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000c6b0 tx=0x7fbcf000cb70 comp rx=0 tx=0).stop 2024-09-13T23:05:04.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.567+0000 7fbd06247640 1 -- 172.21.15.17:0/3237569316 shutdown_connections 2024-09-13T23:05:04.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.567+0000 7fbd06247640 1 --2- 172.21.15.17:0/3237569316 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbcec038250 0x7fbcec03a710 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.567+0000 7fbd06247640 1 --2- 172.21.15.17:0/3237569316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd0009a100 0x7fbd000927d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.567+0000 7fbd06247640 1 -- 172.21.15.17:0/3237569316 >> 172.21.15.17:0/3237569316 conn(0x7fbd0006d4a0 msgr2=0x7fbd0009eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:04.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.567+0000 7fbd06247640 1 -- 172.21.15.17:0/3237569316 shutdown_connections 2024-09-13T23:05:04.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.567+0000 7fbd06247640 1 -- 172.21.15.17:0/3237569316 wait complete. 2024-09-13T23:05:04.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.0 2024-09-13T23:05:04.580 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.2 2024-09-13T23:05:04.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.580+0000 7f9d4e0d0640 1 -- 172.21.15.17:0/1635426601 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f9d4806faf0 con 0x7f9d4806e570 2024-09-13T23:05:04.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.580+0000 7f9d2ffff640 1 -- 172.21.15.17:0/1635426601 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9d3801a9a0 con 0x7f9d4806e570 2024-09-13T23:05:04.710 INFO:teuthology.orchestra.run.smithi017.stdout:38654705668 2024-09-13T23:05:04.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.583+0000 7f9d4e0d0640 1 -- 172.21.15.17:0/1635426601 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9d340382a0 msgr2=0x7f9d3403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.583+0000 7f9d4e0d0640 1 --2- 172.21.15.17:0/1635426601 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9d340382a0 0x7f9d3403a760 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c034000 tx=0x7f9d3c02e000 comp rx=0 tx=0).stop 2024-09-13T23:05:04.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.583+0000 7f9d4e0d0640 1 -- 172.21.15.17:0/1635426601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d4806e570 msgr2=0x7f9d481b0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.583+0000 7f9d4e0d0640 1 --2- 172.21.15.17:0/1635426601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d4806e570 0x7f9d481b0ac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800c450 tx=0x7f9d3800c910 comp rx=0 tx=0).stop 2024-09-13T23:05:04.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.583+0000 7f9d4e0d0640 1 -- 172.21.15.17:0/1635426601 shutdown_connections 2024-09-13T23:05:04.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.583+0000 7f9d4e0d0640 1 --2- 172.21.15.17:0/1635426601 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9d340382a0 0x7f9d3403a760 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.583+0000 7f9d4e0d0640 1 --2- 172.21.15.17:0/1635426601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d4806e570 0x7f9d481b0ac0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.583+0000 7f9d4e0d0640 1 -- 172.21.15.17:0/1635426601 >> 172.21.15.17:0/1635426601 conn(0x7f9d4809aa80 msgr2=0x7f9d481a9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:04.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.583+0000 7f9d4e0d0640 1 -- 172.21.15.17:0/1635426601 shutdown_connections 2024-09-13T23:05:04.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.583+0000 7f9d4e0d0640 1 -- 172.21.15.17:0/1635426601 wait complete. 2024-09-13T23:05:04.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.590+0000 7f05d43fd640 1 -- 172.21.15.17:0/811285856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f05cc09d020 con 0x7f05cc09bd50 2024-09-13T23:05:04.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.590+0000 7f05c2ffd640 1 -- 172.21.15.17:0/811285856 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f05c803ce60 con 0x7f05cc09bd50 2024-09-13T23:05:04.712 INFO:teuthology.orchestra.run.smithi017.stdout:51539607557 2024-09-13T23:05:04.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.592+0000 7f05d43fd640 1 -- 172.21.15.17:0/811285856 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f05b0038320 msgr2=0x7f05b003a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.592+0000 7f05d43fd640 1 --2- 172.21.15.17:0/811285856 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f05b0038320 0x7f05b003a7e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f05bc007fd0 tx=0x7f05bc007ac0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.592+0000 7f05d43fd640 1 -- 172.21.15.17:0/811285856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05cc09bd50 msgr2=0x7f05cc1c3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:04.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.592+0000 7f05d43fd640 1 --2- 172.21.15.17:0/811285856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05cc09bd50 0x7f05cc1c3900 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f05c8009840 tx=0x7f05c80046c0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.592+0000 7f05d43fd640 1 -- 172.21.15.17:0/811285856 shutdown_connections 2024-09-13T23:05:04.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.592+0000 7f05d43fd640 1 --2- 172.21.15.17:0/811285856 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f05b0038320 0x7f05b003a7e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.592+0000 7f05d43fd640 1 --2- 172.21.15.17:0/811285856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05cc09bd50 0x7f05cc1c3900 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:04.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.592+0000 7f05d43fd640 1 -- 172.21.15.17:0/811285856 >> 172.21.15.17:0/811285856 conn(0x7f05cc06d4a0 msgr2=0x7f05cc09eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:04.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.592+0000 7f05d43fd640 1 -- 172.21.15.17:0/811285856 shutdown_connections 2024-09-13T23:05:04.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:04.592+0000 7f05d43fd640 1 -- 172.21.15.17:0/811285856 wait complete. 2024-09-13T23:05:04.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.1 2024-09-13T23:05:04.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607558 got 51539607557 for osd.3 2024-09-13T23:05:05.576 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T23:05:05.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.691+0000 7f75a5e77640 1 Processor -- start 2024-09-13T23:05:05.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.691+0000 7f75a5e77640 1 -- start start 2024-09-13T23:05:05.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.691+0000 7f75a5e77640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f75a012e940 0x7f75a0130d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:05.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.691+0000 7f75a5e77640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75a006eba0 con 0x7f75a006eda0 2024-09-13T23:05:05.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.691+0000 7f75a5e77640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f75a006d2f0 con 0x7f75a012e940 2024-09-13T23:05:05.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.691+0000 7f759f7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f75a006eda0 0x7f75a006f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:40976/0 (socket says 172.21.15.17:40976) 2024-09-13T23:05:05.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.691+0000 7f759f7fe640 1 -- 172.21.15.17:0/1663497607 learned_addr learned my addr 172.21.15.17:0/1663497607 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:05:05.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.691+0000 7f759effd640 1 --2- 172.21.15.17:0/1663497607 >> v2:172.21.15.17:3300/0 conn(0x7f75a012e940 0x7f75a0130d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:05.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.692+0000 7f759e7fc640 1 -- 172.21.15.17:0/1663497607 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3913865548 0 0) 0x7f75a006eba0 con 0x7f75a006eda0 2024-09-13T23:05:05.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.692+0000 7f759e7fc640 1 -- 172.21.15.17:0/1663497607 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7588005730 con 0x7f75a006eda0 2024-09-13T23:05:05.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.692+0000 7f759effd640 1 -- 172.21.15.17:0/1663497607 >> v1:172.21.15.17:6789/0 conn(0x7f75a006eda0 legacy=0x7f75a006f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:05.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.692+0000 7f759effd640 1 -- 172.21.15.17:0/1663497607 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a0070d50 con 0x7f75a012e940 2024-09-13T23:05:05.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.692+0000 7f759effd640 1 --2- 172.21.15.17:0/1663497607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a012e940 0x7f75a0130d30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7594009720 tx=0x7f759402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86965de3d9b182b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:05.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.693+0000 7f759e7fc640 1 -- 172.21.15.17:0/1663497607 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7594037070 con 0x7f75a012e940 2024-09-13T23:05:05.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.693+0000 7f759e7fc640 1 -- 172.21.15.17:0/1663497607 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f759402ae20 con 0x7f75a012e940 2024-09-13T23:05:05.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.693+0000 7f759e7fc640 1 -- 172.21.15.17:0/1663497607 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7594032590 con 0x7f75a012e940 2024-09-13T23:05:05.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.693+0000 7f75a5e77640 1 -- 172.21.15.17:0/1663497607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a012e940 msgr2=0x7f75a0130d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:05.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.693+0000 7f75a5e77640 1 --2- 172.21.15.17:0/1663497607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a012e940 0x7f75a0130d30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7594009720 tx=0x7f759402a1a0 comp rx=0 tx=0).stop 2024-09-13T23:05:05.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.693+0000 7f75a5e77640 1 -- 172.21.15.17:0/1663497607 shutdown_connections 2024-09-13T23:05:05.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.693+0000 7f75a5e77640 1 --2- 172.21.15.17:0/1663497607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a012e940 0x7f75a0130d30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:05.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.693+0000 7f75a5e77640 1 -- 172.21.15.17:0/1663497607 >> 172.21.15.17:0/1663497607 conn(0x7f75a009a890 msgr2=0x7f75a009aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:05.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.693+0000 7f75a5e77640 1 -- 172.21.15.17:0/1663497607 shutdown_connections 2024-09-13T23:05:05.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.693+0000 7f75a5e77640 1 -- 172.21.15.17:0/1663497607 wait complete. 2024-09-13T23:05:05.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.694+0000 7f75a5e77640 1 Processor -- start 2024-09-13T23:05:05.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.694+0000 7f75a5e77640 1 -- start start 2024-09-13T23:05:05.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.695+0000 7f75a5e77640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a006eda0 0x7f75a01bed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:05.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.695+0000 7f75a5e77640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f75a006fcd0 con 0x7f75a006eda0 2024-09-13T23:05:05.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.695+0000 7f759f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a006eda0 0x7f75a01bed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:05.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.695+0000 7f759f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a006eda0 0x7f75a01bed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38684/0 (socket says 172.21.15.17:38684) 2024-09-13T23:05:05.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.695+0000 7f759f7fe640 1 -- 172.21.15.17:0/2235714728 learned_addr learned my addr 172.21.15.17:0/2235714728 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:05.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.695+0000 7f759f7fe640 1 -- 172.21.15.17:0/2235714728 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a0125050 con 0x7f75a006eda0 2024-09-13T23:05:05.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.695+0000 7f759f7fe640 1 --2- 172.21.15.17:0/2235714728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a006eda0 0x7f75a01bed60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f759000c480 tx=0x7f759000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:05.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.695+0000 7f7587fff640 1 -- 172.21.15.17:0/2235714728 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7590017070 con 0x7f75a006eda0 2024-09-13T23:05:05.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.696+0000 7f7587fff640 1 -- 172.21.15.17:0/2235714728 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7590005c10 con 0x7f75a006eda0 2024-09-13T23:05:05.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.696+0000 7f75a5e77640 1 -- 172.21.15.17:0/2235714728 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75a0128e80 con 0x7f75a006eda0 2024-09-13T23:05:05.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.696+0000 7f7587fff640 1 -- 172.21.15.17:0/2235714728 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7590007070 con 0x7f75a006eda0 2024-09-13T23:05:05.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.696+0000 7f75a5e77640 1 -- 172.21.15.17:0/2235714728 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75a01288e0 con 0x7f75a006eda0 2024-09-13T23:05:05.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.697+0000 7f7587fff640 1 -- 172.21.15.17:0/2235714728 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f759001a070 con 0x7f75a006eda0 2024-09-13T23:05:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.697+0000 7f75a5e77640 1 -- 172.21.15.17:0/2235714728 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75a006d890 con 0x7f75a006eda0 2024-09-13T23:05:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.697+0000 7f7587fff640 1 --2- 172.21.15.17:0/2235714728 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f758c0382a0 0x7f758c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.697+0000 7f7587fff640 1 -- 172.21.15.17:0/2235714728 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f759004a580 con 0x7f75a006eda0 2024-09-13T23:05:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.697+0000 7f759effd640 1 --2- 172.21.15.17:0/2235714728 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f758c0382a0 0x7f758c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.698+0000 7f759effd640 1 --2- 172.21.15.17:0/2235714728 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f758c0382a0 0x7f758c03a760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7594034000 tx=0x7f759402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:05.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.702+0000 7f7587fff640 1 -- 172.21.15.17:0/2235714728 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f759001a790 con 0x7f75a006eda0 2024-09-13T23:05:05.710 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T23:05:05.715 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T23:05:05.716 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T23:05:05.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.815+0000 7f12675bc640 1 Processor -- start 2024-09-13T23:05:05.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.815+0000 7f12675bc640 1 -- start start 2024-09-13T23:05:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.816+0000 7f12675bc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f126009a100 0x7f1260133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.816+0000 7f12675bc640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f126009d3b0 con 0x7f126009bd50 2024-09-13T23:05:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.816+0000 7f12675bc640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f126009c840 con 0x7f126009a100 2024-09-13T23:05:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.816+0000 7f1265358640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f126009bd50 0x7f126009c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:40988/0 (socket says 172.21.15.17:40988) 2024-09-13T23:05:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.816+0000 7f1265358640 1 -- 172.21.15.17:0/3612734510 learned_addr learned my addr 172.21.15.17:0/3612734510 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:05:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.816+0000 7f1264b57640 1 --2- 172.21.15.17:0/3612734510 >> v2:172.21.15.17:3300/0 conn(0x7f126009a100 0x7f1260133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:05.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.816+0000 7f1264b57640 1 -- 172.21.15.17:0/3612734510 >> v1:172.21.15.17:6789/0 conn(0x7f126009bd50 legacy=0x7f126009c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:05.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.816+0000 7f1264b57640 1 -- 172.21.15.17:0/3612734510 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1260098230 con 0x7f126009a100 2024-09-13T23:05:05.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.817+0000 7f1264b57640 1 --2- 172.21.15.17:0/3612734510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f126009a100 0x7f1260133da0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1250009720 tx=0x7f125002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1454c7fac2d79610 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:05.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.817+0000 7f1257fff640 1 -- 172.21.15.17:0/3612734510 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1250037070 con 0x7f126009a100 2024-09-13T23:05:05.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.817+0000 7f1257fff640 1 -- 172.21.15.17:0/3612734510 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f125002ad90 con 0x7f126009a100 2024-09-13T23:05:05.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.817+0000 7f1257fff640 1 -- 172.21.15.17:0/3612734510 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1250032590 con 0x7f126009a100 2024-09-13T23:05:05.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.818+0000 7f12675bc640 1 -- 172.21.15.17:0/3612734510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f126009a100 msgr2=0x7f1260133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:05.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.818+0000 7f12675bc640 1 --2- 172.21.15.17:0/3612734510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f126009a100 0x7f1260133da0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1250009720 tx=0x7f125002a110 comp rx=0 tx=0).stop 2024-09-13T23:05:05.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.818+0000 7f12675bc640 1 -- 172.21.15.17:0/3612734510 shutdown_connections 2024-09-13T23:05:05.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.818+0000 7f12675bc640 1 --2- 172.21.15.17:0/3612734510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f126009a100 0x7f1260133da0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:05.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.818+0000 7f12675bc640 1 -- 172.21.15.17:0/3612734510 >> 172.21.15.17:0/3612734510 conn(0x7f126006d4a0 msgr2=0x7f126006d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:05.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.818+0000 7f12675bc640 1 -- 172.21.15.17:0/3612734510 shutdown_connections 2024-09-13T23:05:05.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.818+0000 7f12675bc640 1 -- 172.21.15.17:0/3612734510 wait complete. 2024-09-13T23:05:05.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.819+0000 7f12675bc640 1 Processor -- start 2024-09-13T23:05:05.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.819+0000 7f12675bc640 1 -- start start 2024-09-13T23:05:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.820+0000 7f12675bc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f126009a100 0x7f12601c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.820+0000 7f12675bc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1260134670 con 0x7f126009a100 2024-09-13T23:05:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.820+0000 7f1265358640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f126009a100 0x7f12601c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.820+0000 7f1265358640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f126009a100 0x7f12601c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38702/0 (socket says 172.21.15.17:38702) 2024-09-13T23:05:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.820+0000 7f1265358640 1 -- 172.21.15.17:0/2457640934 learned_addr learned my addr 172.21.15.17:0/2457640934 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.820+0000 7f1265358640 1 -- 172.21.15.17:0/2457640934 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1260125ee0 con 0x7f126009a100 2024-09-13T23:05:05.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.820+0000 7f1265358640 1 --2- 172.21.15.17:0/2457640934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f126009a100 0x7f12601c3990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f125c00c4a0 tx=0x7f125c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:05.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.820+0000 7f1255ffb640 1 -- 172.21.15.17:0/2457640934 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f125c017070 con 0x7f126009a100 2024-09-13T23:05:05.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.820+0000 7f1255ffb640 1 -- 172.21.15.17:0/2457640934 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f125c005c10 con 0x7f126009a100 2024-09-13T23:05:05.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.820+0000 7f12675bc640 1 -- 172.21.15.17:0/2457640934 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1260095510 con 0x7f126009a100 2024-09-13T23:05:05.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.820+0000 7f1255ffb640 1 -- 172.21.15.17:0/2457640934 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f125c007070 con 0x7f126009a100 2024-09-13T23:05:05.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.821+0000 7f12675bc640 1 -- 172.21.15.17:0/2457640934 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12600961a0 con 0x7f126009a100 2024-09-13T23:05:05.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.822+0000 7f1255ffb640 1 -- 172.21.15.17:0/2457640934 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f125c01a070 con 0x7f126009a100 2024-09-13T23:05:05.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.822+0000 7f12675bc640 1 -- 172.21.15.17:0/2457640934 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1260096490 con 0x7f126009a100 2024-09-13T23:05:05.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.822+0000 7f1255ffb640 1 --2- 172.21.15.17:0/2457640934 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f12440382a0 0x7f124403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:05.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.822+0000 7f1255ffb640 1 -- 172.21.15.17:0/2457640934 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f125c04a5c0 con 0x7f126009a100 2024-09-13T23:05:05.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.822+0000 7f1264b57640 1 --2- 172.21.15.17:0/2457640934 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f12440382a0 0x7f124403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:05.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.823+0000 7f1264b57640 1 --2- 172.21.15.17:0/2457640934 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f12440382a0 0x7f124403a760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1250034000 tx=0x7f125002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:05.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.831+0000 7f1255ffb640 1 -- 172.21.15.17:0/2457640934 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1260096490 con 0x7f126009a100 2024-09-13T23:05:05.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.858+0000 7f06ea7e4640 1 Processor -- start 2024-09-13T23:05:05.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.858+0000 7f06ea7e4640 1 -- start start 2024-09-13T23:05:05.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.858+0000 7f06ea7e4640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f06e409a100 0x7f06e4133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:05.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.858+0000 7f06ea7e4640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06e409d3b0 con 0x7f06e409bd50 2024-09-13T23:05:05.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.858+0000 7f06ea7e4640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f06e409c840 con 0x7f06e409a100 2024-09-13T23:05:05.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.859+0000 7f06e37fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f06e409a100 0x7f06e4133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:05.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.859+0000 7f06e37fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f06e409a100 0x7f06e4133da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38708/0 (socket says 172.21.15.17:38708) 2024-09-13T23:05:05.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.859+0000 7f06e37fe640 1 -- 172.21.15.17:0/2679475369 learned_addr learned my addr 172.21.15.17:0/2679475369 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:05.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.859+0000 7f06e3fff640 1 --1- 172.21.15.17:0/2679475369 >> v1:172.21.15.17:6789/0 conn(0x7f06e409bd50 0x7f06e409c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:40994/0 (socket says 172.21.15.17:40994) 2024-09-13T23:05:05.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.859+0000 7f06e37fe640 1 -- 172.21.15.17:0/2679475369 >> v1:172.21.15.17:6789/0 conn(0x7f06e409bd50 legacy=0x7f06e409c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:05.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.859+0000 7f06e37fe640 1 -- 172.21.15.17:0/2679475369 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e4098230 con 0x7f06e409a100 2024-09-13T23:05:05.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.860+0000 7f06e37fe640 1 --2- 172.21.15.17:0/2679475369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e409a100 0x7f06e4133da0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f06d80097f0 tx=0x7f06d802a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390e8bd8efc5358d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:05.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.860+0000 7f06e2ffd640 1 -- 172.21.15.17:0/2679475369 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d8037070 con 0x7f06e409a100 2024-09-13T23:05:05.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.860+0000 7f06e2ffd640 1 -- 172.21.15.17:0/2679475369 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d8032440 con 0x7f06e409a100 2024-09-13T23:05:05.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.860+0000 7f06e2ffd640 1 -- 172.21.15.17:0/2679475369 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d8032740 con 0x7f06e409a100 2024-09-13T23:05:05.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.860+0000 7fd74e680640 1 Processor -- start 2024-09-13T23:05:05.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.860+0000 7fd74e680640 1 -- start start 2024-09-13T23:05:05.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.861+0000 7fd74e680640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd74809bd50 0x7fd74809c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:05.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.861+0000 7fd74e680640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd74809d3b0 con 0x7fd74809c670 2024-09-13T23:05:05.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.861+0000 7fd74e680640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fd748098230 con 0x7fd74809bd50 2024-09-13T23:05:05.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.861+0000 7f06ea7e4640 1 -- 172.21.15.17:0/2679475369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e409a100 msgr2=0x7f06e4133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:05.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.861+0000 7f06ea7e4640 1 --2- 172.21.15.17:0/2679475369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e409a100 0x7f06e4133da0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f06d80097f0 tx=0x7f06d802a1f0 comp rx=0 tx=0).stop 2024-09-13T23:05:05.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.861+0000 7fd747fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd74809bd50 0x7fd74809c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:05.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.861+0000 7fd747fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd74809bd50 0x7fd74809c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38718/0 (socket says 172.21.15.17:38718) 2024-09-13T23:05:05.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.861+0000 7fd747fff640 1 -- 172.21.15.17:0/785058940 learned_addr learned my addr 172.21.15.17:0/785058940 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:05.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.861+0000 7fd747fff640 1 -- 172.21.15.17:0/785058940 >> v1:172.21.15.17:6789/0 conn(0x7fd74809c670 legacy=0x7fd7480990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:05.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.861+0000 7fd747fff640 1 -- 172.21.15.17:0/785058940 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7480983e0 con 0x7fd74809bd50 2024-09-13T23:05:05.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.861+0000 7f06ea7e4640 1 -- 172.21.15.17:0/2679475369 shutdown_connections 2024-09-13T23:05:05.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.861+0000 7f06ea7e4640 1 --2- 172.21.15.17:0/2679475369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e409a100 0x7f06e4133da0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:05.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.861+0000 7f06ea7e4640 1 -- 172.21.15.17:0/2679475369 >> 172.21.15.17:0/2679475369 conn(0x7f06e406d4a0 msgr2=0x7f06e406d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:05.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.861+0000 7f06ea7e4640 1 -- 172.21.15.17:0/2679475369 shutdown_connections 2024-09-13T23:05:05.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.861+0000 7f06ea7e4640 1 -- 172.21.15.17:0/2679475369 wait complete. 2024-09-13T23:05:05.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.862+0000 7fd747fff640 1 --2- 172.21.15.17:0/785058940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd74809bd50 0x7fd74809c130 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd7380097f0 tx=0x7fd73802a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1630680baf3c8fe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:05.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.862+0000 7fd746ffd640 1 -- 172.21.15.17:0/785058940 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd738037070 con 0x7fd74809bd50 2024-09-13T23:05:05.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.862+0000 7f06ea7e4640 1 Processor -- start 2024-09-13T23:05:05.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.862+0000 7fd746ffd640 1 -- 172.21.15.17:0/785058940 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd738032440 con 0x7fd74809bd50 2024-09-13T23:05:05.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.863+0000 7fd746ffd640 1 -- 172.21.15.17:0/785058940 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd738032740 con 0x7fd74809bd50 2024-09-13T23:05:05.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.863+0000 7f06ea7e4640 1 -- start start 2024-09-13T23:05:05.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.863+0000 7f06ea7e4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e409a100 0x7f06e41c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:05.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.863+0000 7f06ea7e4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f06e4134670 con 0x7f06e409a100 2024-09-13T23:05:05.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.863+0000 7f06e3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e409a100 0x7f06e41c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:05.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.863+0000 7f06e3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e409a100 0x7f06e41c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38730/0 (socket says 172.21.15.17:38730) 2024-09-13T23:05:05.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.863+0000 7f06e3fff640 1 -- 172.21.15.17:0/2090078441 learned_addr learned my addr 172.21.15.17:0/2090078441 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:05.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.863+0000 7fd74e680640 1 -- 172.21.15.17:0/785058940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd74809bd50 msgr2=0x7fd74809c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:05.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.863+0000 7fd74e680640 1 --2- 172.21.15.17:0/785058940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd74809bd50 0x7fd74809c130 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd7380097f0 tx=0x7fd73802a1f0 comp rx=0 tx=0).stop 2024-09-13T23:05:05.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.863+0000 7fd74e680640 1 -- 172.21.15.17:0/785058940 shutdown_connections 2024-09-13T23:05:05.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.863+0000 7fd74e680640 1 --2- 172.21.15.17:0/785058940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd74809bd50 0x7fd74809c130 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:05.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.863+0000 7fd74e680640 1 -- 172.21.15.17:0/785058940 >> 172.21.15.17:0/785058940 conn(0x7fd74806d4a0 msgr2=0x7fd74806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:05.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.863+0000 7fd74e680640 1 -- 172.21.15.17:0/785058940 shutdown_connections 2024-09-13T23:05:05.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.863+0000 7f06e3fff640 1 -- 172.21.15.17:0/2090078441 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e4125ee0 con 0x7f06e409a100 2024-09-13T23:05:05.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.864+0000 7fd74e680640 1 -- 172.21.15.17:0/785058940 wait complete. 2024-09-13T23:05:05.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.864+0000 7f06e3fff640 1 --2- 172.21.15.17:0/2090078441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e409a100 0x7f06e41c3990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f06d400c450 tx=0x7f06d400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:05.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.864+0000 7f06e0ff9640 1 -- 172.21.15.17:0/2090078441 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d4007410 con 0x7f06e409a100 2024-09-13T23:05:05.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.864+0000 7f06e0ff9640 1 -- 172.21.15.17:0/2090078441 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d40075b0 con 0x7f06e409a100 2024-09-13T23:05:05.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.864+0000 7f06ea7e4640 1 -- 172.21.15.17:0/2090078441 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e4095510 con 0x7f06e409a100 2024-09-13T23:05:05.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.864+0000 7f06e0ff9640 1 -- 172.21.15.17:0/2090078441 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d4004910 con 0x7f06e409a100 2024-09-13T23:05:05.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.864+0000 7f06ea7e4640 1 -- 172.21.15.17:0/2090078441 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e40961a0 con 0x7f06e409a100 2024-09-13T23:05:05.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.865+0000 7fd74e680640 1 Processor -- start 2024-09-13T23:05:05.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.865+0000 7f06e0ff9640 1 -- 172.21.15.17:0/2090078441 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f06d401a020 con 0x7f06e409a100 2024-09-13T23:05:05.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.865+0000 7fd74e680640 1 -- start start 2024-09-13T23:05:05.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.866+0000 7fd74e680640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd74809bd50 0x7fd7481c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:05.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.866+0000 7fd74e680640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd748099b90 con 0x7fd74809bd50 2024-09-13T23:05:05.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.866+0000 7f06e0ff9640 1 --2- 172.21.15.17:0/2090078441 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f06d00382a0 0x7f06d003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:05.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.866+0000 7f06e0ff9640 1 -- 172.21.15.17:0/2090078441 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f06d404e120 con 0x7f06e409a100 2024-09-13T23:05:05.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.866+0000 7fd747fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd74809bd50 0x7fd7481c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:05.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.866+0000 7fd747fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd74809bd50 0x7fd7481c3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38740/0 (socket says 172.21.15.17:38740) 2024-09-13T23:05:05.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.866+0000 7fd747fff640 1 -- 172.21.15.17:0/1599312765 learned_addr learned my addr 172.21.15.17:0/1599312765 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:05.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.866+0000 7f06ea7e4640 1 -- 172.21.15.17:0/2090078441 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e4096490 con 0x7f06e409a100 2024-09-13T23:05:05.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.866+0000 7f06e37fe640 1 --2- 172.21.15.17:0/2090078441 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f06d00382a0 0x7f06d003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:05.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.866+0000 7fd747fff640 1 -- 172.21.15.17:0/1599312765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7481b3080 con 0x7fd74809bd50 2024-09-13T23:05:05.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.867+0000 7fd747fff640 1 --2- 172.21.15.17:0/1599312765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd74809bd50 0x7fd7481c3900 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd738035040 tx=0x7fd7380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:05.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.867+0000 7f06e37fe640 1 --2- 172.21.15.17:0/2090078441 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f06d00382a0 0x7f06d003a760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f06d8034000 tx=0x7f06d802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:05.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.875+0000 7fd744ff9640 1 -- 172.21.15.17:0/1599312765 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd738041070 con 0x7fd74809bd50 2024-09-13T23:05:05.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.875+0000 7fd744ff9640 1 -- 172.21.15.17:0/1599312765 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd73803c7a0 con 0x7fd74809bd50 2024-09-13T23:05:05.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.875+0000 7fd744ff9640 1 -- 172.21.15.17:0/1599312765 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd738037040 con 0x7fd74809bd50 2024-09-13T23:05:05.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.875+0000 7fd74e680640 1 -- 172.21.15.17:0/1599312765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7481b4880 con 0x7fd74809bd50 2024-09-13T23:05:05.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.875+0000 7fd74e680640 1 -- 172.21.15.17:0/1599312765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7481b1a80 con 0x7fd74809bd50 2024-09-13T23:05:05.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.875+0000 7f06e0ff9640 1 -- 172.21.15.17:0/2090078441 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f06e4096490 con 0x7f06e409a100 2024-09-13T23:05:05.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.876+0000 7fd74e680640 1 -- 172.21.15.17:0/1599312765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd74809a130 con 0x7fd74809bd50 2024-09-13T23:05:05.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.877+0000 7fd744ff9640 1 -- 172.21.15.17:0/1599312765 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd738044070 con 0x7fd74809bd50 2024-09-13T23:05:05.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.877+0000 7fd744ff9640 1 --2- 172.21.15.17:0/1599312765 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd734038320 0x7fd73403a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:05.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.877+0000 7fd744ff9640 1 -- 172.21.15.17:0/1599312765 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fd73806bea0 con 0x7fd74809bd50 2024-09-13T23:05:05.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.877+0000 7fd7477fe640 1 --2- 172.21.15.17:0/1599312765 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd734038320 0x7fd73403a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:05.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.878+0000 7fd7477fe640 1 --2- 172.21.15.17:0/1599312765 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd734038320 0x7fd73403a7e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd73c000f60 tx=0x7fd73c007a30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:05.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.886+0000 7fd744ff9640 1 -- 172.21.15.17:0/1599312765 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd7481b3080 con 0x7fd74809bd50 2024-09-13T23:05:05.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.888+0000 7f75a5e77640 1 -- 172.21.15.17:0/2235714728 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f75a006f180 con 0x7f75a006eda0 2024-09-13T23:05:05.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.889+0000 7f7587fff640 1 -- 172.21.15.17:0/2235714728 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f759001a9b0 con 0x7f75a006eda0 2024-09-13T23:05:05.890 INFO:teuthology.orchestra.run.smithi017.stdout:38654705667 2024-09-13T23:05:05.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.892+0000 7f75a5e77640 1 -- 172.21.15.17:0/2235714728 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f758c0382a0 msgr2=0x7f758c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:05.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.892+0000 7f75a5e77640 1 --2- 172.21.15.17:0/2235714728 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f758c0382a0 0x7f758c03a760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7594034000 tx=0x7f759402e000 comp rx=0 tx=0).stop 2024-09-13T23:05:05.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.892+0000 7f75a5e77640 1 -- 172.21.15.17:0/2235714728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a006eda0 msgr2=0x7f75a01bed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:05.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.892+0000 7f75a5e77640 1 --2- 172.21.15.17:0/2235714728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a006eda0 0x7f75a01bed60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f759000c480 tx=0x7f759000c940 comp rx=0 tx=0).stop 2024-09-13T23:05:05.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.892+0000 7f75a5e77640 1 -- 172.21.15.17:0/2235714728 shutdown_connections 2024-09-13T23:05:05.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.892+0000 7f75a5e77640 1 --2- 172.21.15.17:0/2235714728 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f758c0382a0 0x7f758c03a760 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:05.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.892+0000 7f75a5e77640 1 --2- 172.21.15.17:0/2235714728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75a006eda0 0x7f75a01bed60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:05.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.892+0000 7f75a5e77640 1 -- 172.21.15.17:0/2235714728 >> 172.21.15.17:0/2235714728 conn(0x7f75a009a890 msgr2=0x7f75a0071290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:05.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.893+0000 7f75a5e77640 1 -- 172.21.15.17:0/2235714728 shutdown_connections 2024-09-13T23:05:05.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:05.893+0000 7f75a5e77640 1 -- 172.21.15.17:0/2235714728 wait complete. 2024-09-13T23:05:05.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.0 2024-09-13T23:05:06.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.020+0000 7f12675bc640 1 -- 172.21.15.17:0/2457640934 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f12601260b0 con 0x7f126009a100 2024-09-13T23:05:06.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.021+0000 7f1255ffb640 1 -- 172.21.15.17:0/2457640934 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f126009d3b0 con 0x7f126009a100 2024-09-13T23:05:06.022 INFO:teuthology.orchestra.run.smithi017.stdout:47244640259 2024-09-13T23:05:06.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.023+0000 7f12675bc640 1 -- 172.21.15.17:0/2457640934 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f12440382a0 msgr2=0x7f124403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:06.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.023+0000 7f12675bc640 1 --2- 172.21.15.17:0/2457640934 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f12440382a0 0x7f124403a760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1250034000 tx=0x7f125002e000 comp rx=0 tx=0).stop 2024-09-13T23:05:06.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.023+0000 7f12675bc640 1 -- 172.21.15.17:0/2457640934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f126009a100 msgr2=0x7f12601c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:06.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.023+0000 7f12675bc640 1 --2- 172.21.15.17:0/2457640934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f126009a100 0x7f12601c3990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f125c00c4a0 tx=0x7f125c00c960 comp rx=0 tx=0).stop 2024-09-13T23:05:06.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.023+0000 7f12675bc640 1 -- 172.21.15.17:0/2457640934 shutdown_connections 2024-09-13T23:05:06.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.023+0000 7f12675bc640 1 --2- 172.21.15.17:0/2457640934 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f12440382a0 0x7f124403a760 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:06.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.023+0000 7f12675bc640 1 --2- 172.21.15.17:0/2457640934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f126009a100 0x7f12601c3990 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:06.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.023+0000 7f12675bc640 1 -- 172.21.15.17:0/2457640934 >> 172.21.15.17:0/2457640934 conn(0x7f126006d4a0 msgr2=0x7f1260096af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:06.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.023+0000 7f12675bc640 1 -- 172.21.15.17:0/2457640934 shutdown_connections 2024-09-13T23:05:06.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.023+0000 7f12675bc640 1 -- 172.21.15.17:0/2457640934 wait complete. 2024-09-13T23:05:06.034 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.2 2024-09-13T23:05:06.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.057+0000 7f06ea7e4640 1 -- 172.21.15.17:0/2090078441 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f06e41260b0 con 0x7f06e409a100 2024-09-13T23:05:06.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.058+0000 7f06e0ff9640 1 -- 172.21.15.17:0/2090078441 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f06e409d3b0 con 0x7f06e409a100 2024-09-13T23:05:06.058 INFO:teuthology.orchestra.run.smithi017.stdout:51539607557 2024-09-13T23:05:06.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.059+0000 7f06ea7e4640 1 -- 172.21.15.17:0/2090078441 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f06d00382a0 msgr2=0x7f06d003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:06.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.059+0000 7f06ea7e4640 1 --2- 172.21.15.17:0/2090078441 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f06d00382a0 0x7f06d003a760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f06d8034000 tx=0x7f06d802e000 comp rx=0 tx=0).stop 2024-09-13T23:05:06.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.059+0000 7f06ea7e4640 1 -- 172.21.15.17:0/2090078441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e409a100 msgr2=0x7f06e41c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:06.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.059+0000 7f06ea7e4640 1 --2- 172.21.15.17:0/2090078441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e409a100 0x7f06e41c3990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f06d400c450 tx=0x7f06d400c910 comp rx=0 tx=0).stop 2024-09-13T23:05:06.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.060+0000 7f06ea7e4640 1 -- 172.21.15.17:0/2090078441 shutdown_connections 2024-09-13T23:05:06.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.060+0000 7f06ea7e4640 1 --2- 172.21.15.17:0/2090078441 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f06d00382a0 0x7f06d003a760 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:06.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.060+0000 7f06ea7e4640 1 --2- 172.21.15.17:0/2090078441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e409a100 0x7f06e41c3990 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:06.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.060+0000 7f06ea7e4640 1 -- 172.21.15.17:0/2090078441 >> 172.21.15.17:0/2090078441 conn(0x7f06e406d4a0 msgr2=0x7f06e4096af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:06.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.060+0000 7f06ea7e4640 1 -- 172.21.15.17:0/2090078441 shutdown_connections 2024-09-13T23:05:06.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.060+0000 7f06ea7e4640 1 -- 172.21.15.17:0/2090078441 wait complete. 2024-09-13T23:05:06.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.065+0000 7fd74e680640 1 -- 172.21.15.17:0/1599312765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fd74809d020 con 0x7fd74809bd50 2024-09-13T23:05:06.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.066+0000 7fd744ff9640 1 -- 172.21.15.17:0/1599312765 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd73806ad70 con 0x7fd74809bd50 2024-09-13T23:05:06.066 INFO:teuthology.orchestra.run.smithi017.stdout:38654705668 2024-09-13T23:05:06.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.068+0000 7fd74e680640 1 -- 172.21.15.17:0/1599312765 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd734038320 msgr2=0x7fd73403a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:06.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.068+0000 7fd74e680640 1 --2- 172.21.15.17:0/1599312765 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd734038320 0x7fd73403a7e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd73c000f60 tx=0x7fd73c007a30 comp rx=0 tx=0).stop 2024-09-13T23:05:06.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.068+0000 7fd74e680640 1 -- 172.21.15.17:0/1599312765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd74809bd50 msgr2=0x7fd7481c3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:06.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.068+0000 7fd74e680640 1 --2- 172.21.15.17:0/1599312765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd74809bd50 0x7fd7481c3900 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd738035040 tx=0x7fd7380046c0 comp rx=0 tx=0).stop 2024-09-13T23:05:06.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.068+0000 7fd74e680640 1 -- 172.21.15.17:0/1599312765 shutdown_connections 2024-09-13T23:05:06.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.068+0000 7fd74e680640 1 --2- 172.21.15.17:0/1599312765 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd734038320 0x7fd73403a7e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:06.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.068+0000 7fd74e680640 1 --2- 172.21.15.17:0/1599312765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd74809bd50 0x7fd7481c3900 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:06.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.068+0000 7fd74e680640 1 -- 172.21.15.17:0/1599312765 >> 172.21.15.17:0/1599312765 conn(0x7fd74806d4a0 msgr2=0x7fd74809eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:06.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.068+0000 7fd74e680640 1 -- 172.21.15.17:0/1599312765 shutdown_connections 2024-09-13T23:05:06.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:06.068+0000 7fd74e680640 1 -- 172.21.15.17:0/1599312765 wait complete. 2024-09-13T23:05:06.071 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607558 got 51539607557 for osd.3 2024-09-13T23:05:06.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.1 2024-09-13T23:05:06.906 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T23:05:07.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.021+0000 7fb31d494640 1 Processor -- start 2024-09-13T23:05:07.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.021+0000 7fb31d494640 1 -- start start 2024-09-13T23:05:07.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.022+0000 7fb31d494640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb31809a100 0x7fb318133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:07.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.022+0000 7fb31d494640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb31809d3b0 con 0x7fb31809bd50 2024-09-13T23:05:07.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.022+0000 7fb31d494640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fb31809c840 con 0x7fb31809a100 2024-09-13T23:05:07.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.022+0000 7fb316ffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb31809bd50 0x7fb31809c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:41010/0 (socket says 172.21.15.17:41010) 2024-09-13T23:05:07.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.022+0000 7fb316ffd640 1 -- 172.21.15.17:0/2418965877 learned_addr learned my addr 172.21.15.17:0/2418965877 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:05:07.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.022+0000 7fb30ffff640 1 --2- 172.21.15.17:0/2418965877 >> v2:172.21.15.17:3300/0 conn(0x7fb31809a100 0x7fb318133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:07.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.022+0000 7fb3167fc640 1 -- 172.21.15.17:0/2418965877 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2494214688 0 0) 0x7fb308001110 con 0x7fb31809bd50 2024-09-13T23:05:07.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.022+0000 7fb3167fc640 1 -- 172.21.15.17:0/2418965877 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb304003520 con 0x7fb31809bd50 2024-09-13T23:05:07.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.022+0000 7fb30ffff640 1 -- 172.21.15.17:0/2418965877 >> v1:172.21.15.17:6789/0 conn(0x7fb31809bd50 legacy=0x7fb31809c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:07.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.022+0000 7fb30ffff640 1 -- 172.21.15.17:0/2418965877 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb318098230 con 0x7fb31809a100 2024-09-13T23:05:07.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.023+0000 7fb30ffff640 1 --2- 172.21.15.17:0/2418965877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb31809a100 0x7fb318133da0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb300009720 tx=0x7fb30002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2227a446a8863636 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:07.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.023+0000 7fb3167fc640 1 -- 172.21.15.17:0/2418965877 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb300037070 con 0x7fb31809a100 2024-09-13T23:05:07.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.023+0000 7fb3167fc640 1 -- 172.21.15.17:0/2418965877 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb30002ad90 con 0x7fb31809a100 2024-09-13T23:05:07.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.023+0000 7fb3167fc640 1 -- 172.21.15.17:0/2418965877 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb300032590 con 0x7fb31809a100 2024-09-13T23:05:07.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.024+0000 7fb31d494640 1 -- 172.21.15.17:0/2418965877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb31809a100 msgr2=0x7fb318133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:07.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.024+0000 7fb31d494640 1 --2- 172.21.15.17:0/2418965877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb31809a100 0x7fb318133da0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb300009720 tx=0x7fb30002a110 comp rx=0 tx=0).stop 2024-09-13T23:05:07.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.024+0000 7fb31d494640 1 -- 172.21.15.17:0/2418965877 shutdown_connections 2024-09-13T23:05:07.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.024+0000 7fb31d494640 1 --2- 172.21.15.17:0/2418965877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb31809a100 0x7fb318133da0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:07.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.024+0000 7fb31d494640 1 -- 172.21.15.17:0/2418965877 >> 172.21.15.17:0/2418965877 conn(0x7fb31806d4a0 msgr2=0x7fb31806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:07.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.024+0000 7fb31d494640 1 -- 172.21.15.17:0/2418965877 shutdown_connections 2024-09-13T23:05:07.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.024+0000 7fb31d494640 1 -- 172.21.15.17:0/2418965877 wait complete. 2024-09-13T23:05:07.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.025+0000 7fb31d494640 1 Processor -- start 2024-09-13T23:05:07.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.025+0000 7fb31d494640 1 -- start start 2024-09-13T23:05:07.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.025+0000 7fb31d494640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb31809a100 0x7fb318092f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:07.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.025+0000 7fb31d494640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb318134670 con 0x7fb31809a100 2024-09-13T23:05:07.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.025+0000 7fb316ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb31809a100 0x7fb318092f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:07.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.025+0000 7fb316ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb31809a100 0x7fb318092f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38752/0 (socket says 172.21.15.17:38752) 2024-09-13T23:05:07.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.025+0000 7fb316ffd640 1 -- 172.21.15.17:0/1327275158 learned_addr learned my addr 172.21.15.17:0/1327275158 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:07.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.025+0000 7fb316ffd640 1 -- 172.21.15.17:0/1327275158 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb318094be0 con 0x7fb31809a100 2024-09-13T23:05:07.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.026+0000 7fb316ffd640 1 --2- 172.21.15.17:0/1327275158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb31809a100 0x7fb318092f40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb30800c6b0 tx=0x7fb30800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:07.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.026+0000 7fb30f7fe640 1 -- 172.21.15.17:0/1327275158 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb308017070 con 0x7fb31809a100 2024-09-13T23:05:07.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.026+0000 7fb30f7fe640 1 -- 172.21.15.17:0/1327275158 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3080058b0 con 0x7fb31809a100 2024-09-13T23:05:07.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.026+0000 7fb31d494640 1 -- 172.21.15.17:0/1327275158 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb31809a760 con 0x7fb31809a100 2024-09-13T23:05:07.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.026+0000 7fb30f7fe640 1 -- 172.21.15.17:0/1327275158 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb308005bd0 con 0x7fb31809a100 2024-09-13T23:05:07.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.026+0000 7fb31d494640 1 -- 172.21.15.17:0/1327275158 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb318095a50 con 0x7fb31809a100 2024-09-13T23:05:07.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.027+0000 7fb30f7fe640 1 -- 172.21.15.17:0/1327275158 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb30801a070 con 0x7fb31809a100 2024-09-13T23:05:07.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.027+0000 7fb31d494640 1 -- 172.21.15.17:0/1327275158 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb318094030 con 0x7fb31809a100 2024-09-13T23:05:07.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.027+0000 7fb30f7fe640 1 --2- 172.21.15.17:0/1327275158 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb2f80382a0 0x7fb2f803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:07.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.027+0000 7fb30f7fe640 1 -- 172.21.15.17:0/1327275158 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fb30804a540 con 0x7fb31809a100 2024-09-13T23:05:07.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.027+0000 7fb30ffff640 1 --2- 172.21.15.17:0/1327275158 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb2f80382a0 0x7fb2f803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:07.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.028+0000 7fb30ffff640 1 --2- 172.21.15.17:0/1327275158 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb2f80382a0 0x7fb2f803a760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb300034000 tx=0x7fb30002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:07.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.032+0000 7fb30f7fe640 1 -- 172.21.15.17:0/1327275158 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb31809d3b0 con 0x7fb31809a100 2024-09-13T23:05:07.035 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T23:05:07.072 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T23:05:07.080 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T23:05:07.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.141+0000 7fe2f69fd640 1 Processor -- start 2024-09-13T23:05:07.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.141+0000 7fe2f69fd640 1 -- start start 2024-09-13T23:05:07.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.141+0000 7fe2f69fd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe2f009a100 0x7fe2f0133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:07.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.142+0000 7fe2f69fd640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2f009d3b0 con 0x7fe2f009bd50 2024-09-13T23:05:07.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.142+0000 7fe2f69fd640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fe2f009c840 con 0x7fe2f009a100 2024-09-13T23:05:07.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.142+0000 7fe2ef7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe2f009a100 0x7fe2f0133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:07.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.142+0000 7fe2ef7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe2f009a100 0x7fe2f0133da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38758/0 (socket says 172.21.15.17:38758) 2024-09-13T23:05:07.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.142+0000 7fe2ef7fe640 1 -- 172.21.15.17:0/210296266 learned_addr learned my addr 172.21.15.17:0/210296266 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:07.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.142+0000 7fe2effff640 1 --1- 172.21.15.17:0/210296266 >> v1:172.21.15.17:6789/0 conn(0x7fe2f009bd50 0x7fe2f009c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:41014/0 (socket says 172.21.15.17:41014) 2024-09-13T23:05:07.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.142+0000 7fe2ef7fe640 1 -- 172.21.15.17:0/210296266 >> v1:172.21.15.17:6789/0 conn(0x7fe2f009bd50 legacy=0x7fe2f009c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:07.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.142+0000 7fe2ef7fe640 1 -- 172.21.15.17:0/210296266 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f0098230 con 0x7fe2f009a100 2024-09-13T23:05:07.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.143+0000 7fe2ef7fe640 1 --2- 172.21.15.17:0/210296266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2f009a100 0x7fe2f0133da0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40097f0 tx=0x7fe2e402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=288cfd095e3dae24 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:07.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.143+0000 7fe2eeffd640 1 -- 172.21.15.17:0/210296266 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2e4037070 con 0x7fe2f009a100 2024-09-13T23:05:07.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.143+0000 7fe2eeffd640 1 -- 172.21.15.17:0/210296266 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2e4032440 con 0x7fe2f009a100 2024-09-13T23:05:07.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.143+0000 7fe2eeffd640 1 -- 172.21.15.17:0/210296266 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2e402ae60 con 0x7fe2f009a100 2024-09-13T23:05:07.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.144+0000 7fe2f69fd640 1 -- 172.21.15.17:0/210296266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2f009a100 msgr2=0x7fe2f0133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:07.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.144+0000 7fe2f69fd640 1 --2- 172.21.15.17:0/210296266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2f009a100 0x7fe2f0133da0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40097f0 tx=0x7fe2e402a1e0 comp rx=0 tx=0).stop 2024-09-13T23:05:07.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.144+0000 7fe2f69fd640 1 -- 172.21.15.17:0/210296266 shutdown_connections 2024-09-13T23:05:07.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.144+0000 7fe2f69fd640 1 --2- 172.21.15.17:0/210296266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2f009a100 0x7fe2f0133da0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:07.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.144+0000 7fe2f69fd640 1 -- 172.21.15.17:0/210296266 >> 172.21.15.17:0/210296266 conn(0x7fe2f006d4a0 msgr2=0x7fe2f006d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:07.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.144+0000 7fe2f69fd640 1 -- 172.21.15.17:0/210296266 shutdown_connections 2024-09-13T23:05:07.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.144+0000 7fe2f69fd640 1 -- 172.21.15.17:0/210296266 wait complete. 2024-09-13T23:05:07.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.146+0000 7fe2f69fd640 1 Processor -- start 2024-09-13T23:05:07.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.146+0000 7fe2f69fd640 1 -- start start 2024-09-13T23:05:07.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.146+0000 7fe2f69fd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2f009a100 0x7fe2f01c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:07.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.146+0000 7fe2f69fd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f0134670 con 0x7fe2f009a100 2024-09-13T23:05:07.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.147+0000 7fe2effff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2f009a100 0x7fe2f01c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:07.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.147+0000 7fe2effff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2f009a100 0x7fe2f01c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38768/0 (socket says 172.21.15.17:38768) 2024-09-13T23:05:07.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.147+0000 7fe2effff640 1 -- 172.21.15.17:0/9606174 learned_addr learned my addr 172.21.15.17:0/9606174 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:07.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.147+0000 7fe2effff640 1 -- 172.21.15.17:0/9606174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f0125ee0 con 0x7fe2f009a100 2024-09-13T23:05:07.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.147+0000 7fe2effff640 1 --2- 172.21.15.17:0/9606174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2f009a100 0x7fe2f01c3990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe2e000c450 tx=0x7fe2e000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:07.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.147+0000 7fe2ecff9640 1 -- 172.21.15.17:0/9606174 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2e0007410 con 0x7fe2f009a100 2024-09-13T23:05:07.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.147+0000 7fe2ecff9640 1 -- 172.21.15.17:0/9606174 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2e00075b0 con 0x7fe2f009a100 2024-09-13T23:05:07.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.147+0000 7fe2f69fd640 1 -- 172.21.15.17:0/9606174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2f0095510 con 0x7fe2f009a100 2024-09-13T23:05:07.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.147+0000 7fe2ecff9640 1 -- 172.21.15.17:0/9606174 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2e0004910 con 0x7fe2f009a100 2024-09-13T23:05:07.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.147+0000 7fe2f69fd640 1 -- 172.21.15.17:0/9606174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2f00961a0 con 0x7fe2f009a100 2024-09-13T23:05:07.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.148+0000 7fe2f69fd640 1 -- 172.21.15.17:0/9606174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2f0096490 con 0x7fe2f009a100 2024-09-13T23:05:07.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.149+0000 7fe2ecff9640 1 -- 172.21.15.17:0/9606174 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe2e001a020 con 0x7fe2f009a100 2024-09-13T23:05:07.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.149+0000 7fe2ecff9640 1 --2- 172.21.15.17:0/9606174 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe2dc0382a0 0x7fe2dc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:07.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.149+0000 7fe2ecff9640 1 -- 172.21.15.17:0/9606174 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fe2e004ab10 con 0x7fe2f009a100 2024-09-13T23:05:07.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.149+0000 7fe2ef7fe640 1 --2- 172.21.15.17:0/9606174 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe2dc0382a0 0x7fe2dc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:07.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.150+0000 7fe2ef7fe640 1 --2- 172.21.15.17:0/9606174 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe2dc0382a0 0x7fe2dc03a760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4034000 tx=0x7fe2e402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:07.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.154+0000 7fe2ecff9640 1 -- 172.21.15.17:0/9606174 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe2f0096490 con 0x7fe2f009a100 2024-09-13T23:05:07.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.185+0000 7f649cb03640 1 Processor -- start 2024-09-13T23:05:07.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.185+0000 7f649cb03640 1 -- start start 2024-09-13T23:05:07.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.186+0000 7fb3a894b640 1 Processor -- start 2024-09-13T23:05:07.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.186+0000 7fb3a894b640 1 -- start start 2024-09-13T23:05:07.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.186+0000 7f649cb03640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f649809bd50 0x7f649809c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:07.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.186+0000 7f649cb03640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f649809d3b0 con 0x7f649809c670 2024-09-13T23:05:07.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.186+0000 7f649cb03640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f6498098230 con 0x7f649809bd50 2024-09-13T23:05:07.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.186+0000 7f649659c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f649809bd50 0x7f649809c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:07.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.186+0000 7f649659c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f649809bd50 0x7f649809c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38780/0 (socket says 172.21.15.17:38780) 2024-09-13T23:05:07.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.186+0000 7f649659c640 1 -- 172.21.15.17:0/856125084 learned_addr learned my addr 172.21.15.17:0/856125084 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:07.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.186+0000 7f6495d9b640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f649809c670 0x7f64980990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:41022/0 (socket says 172.21.15.17:41022) 2024-09-13T23:05:07.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.187+0000 7fb3a894b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb3a406f0b0 0x7fb3a4130ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:07.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.187+0000 7f649659c640 1 -- 172.21.15.17:0/856125084 >> v1:172.21.15.17:6789/0 conn(0x7f649809c670 legacy=0x7f64980990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:07.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.187+0000 7f649659c640 1 -- 172.21.15.17:0/856125084 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64980983e0 con 0x7f649809bd50 2024-09-13T23:05:07.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.187+0000 7fb3a894b640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3a4072780 con 0x7fb3a406e5c0 2024-09-13T23:05:07.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.187+0000 7fb3a894b640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fb3a4070000 con 0x7fb3a406f0b0 2024-09-13T23:05:07.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.187+0000 7fb3a1d9b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb3a406f0b0 0x7fb3a4130ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:07.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.187+0000 7fb3a1d9b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb3a406f0b0 0x7fb3a4130ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38796/0 (socket says 172.21.15.17:38796) 2024-09-13T23:05:07.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.187+0000 7fb3a1d9b640 1 -- 172.21.15.17:0/3972154011 learned_addr learned my addr 172.21.15.17:0/3972154011 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:07.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.187+0000 7fb3a259c640 1 --1- 172.21.15.17:0/3972154011 >> v1:172.21.15.17:6789/0 conn(0x7fb3a406e5c0 0x7fb3a406e9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:41034/0 (socket says 172.21.15.17:41034) 2024-09-13T23:05:07.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.187+0000 7fb3a1d9b640 1 -- 172.21.15.17:0/3972154011 >> v1:172.21.15.17:6789/0 conn(0x7fb3a406e5c0 legacy=0x7fb3a406e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:07.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.187+0000 7fb3a1d9b640 1 -- 172.21.15.17:0/3972154011 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a4071460 con 0x7fb3a406f0b0 2024-09-13T23:05:07.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.188+0000 7f649659c640 1 --2- 172.21.15.17:0/856125084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f649809bd50 0x7f649809c130 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f64880097f0 tx=0x7f648802a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded256920b1d72e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:07.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.188+0000 7fb3a1d9b640 1 --2- 172.21.15.17:0/3972154011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a406f0b0 0x7fb3a4130ce0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb39800be50 tx=0x7fb39802c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a5cb75810dc2ad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:07.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.188+0000 7f649559a640 1 -- 172.21.15.17:0/856125084 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6488037070 con 0x7f649809bd50 2024-09-13T23:05:07.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.188+0000 7f649559a640 1 -- 172.21.15.17:0/856125084 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6488032440 con 0x7f649809bd50 2024-09-13T23:05:07.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.188+0000 7f649559a640 1 -- 172.21.15.17:0/856125084 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6488032740 con 0x7f649809bd50 2024-09-13T23:05:07.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.188+0000 7fb3a159a640 1 -- 172.21.15.17:0/3972154011 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb39802cc20 con 0x7fb3a406f0b0 2024-09-13T23:05:07.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.188+0000 7fb3a159a640 1 -- 172.21.15.17:0/3972154011 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb39802cdc0 con 0x7fb3a406f0b0 2024-09-13T23:05:07.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.188+0000 7fb3a159a640 1 -- 172.21.15.17:0/3972154011 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb398034540 con 0x7fb3a406f0b0 2024-09-13T23:05:07.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.189+0000 7f649cb03640 1 -- 172.21.15.17:0/856125084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f649809bd50 msgr2=0x7f649809c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:07.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.189+0000 7f649cb03640 1 --2- 172.21.15.17:0/856125084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f649809bd50 0x7f649809c130 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f64880097f0 tx=0x7f648802a1f0 comp rx=0 tx=0).stop 2024-09-13T23:05:07.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.189+0000 7f649cb03640 1 -- 172.21.15.17:0/856125084 shutdown_connections 2024-09-13T23:05:07.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.189+0000 7f649cb03640 1 --2- 172.21.15.17:0/856125084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f649809bd50 0x7f649809c130 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:07.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.189+0000 7f649cb03640 1 -- 172.21.15.17:0/856125084 >> 172.21.15.17:0/856125084 conn(0x7f649806d4a0 msgr2=0x7f649806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:07.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.189+0000 7fb3a894b640 1 -- 172.21.15.17:0/3972154011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a406f0b0 msgr2=0x7fb3a4130ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:07.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.189+0000 7fb3a894b640 1 --2- 172.21.15.17:0/3972154011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a406f0b0 0x7fb3a4130ce0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb39800be50 tx=0x7fb39802c360 comp rx=0 tx=0).stop 2024-09-13T23:05:07.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.189+0000 7f649cb03640 1 -- 172.21.15.17:0/856125084 shutdown_connections 2024-09-13T23:05:07.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.189+0000 7f649cb03640 1 -- 172.21.15.17:0/856125084 wait complete. 2024-09-13T23:05:07.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.189+0000 7fb3a894b640 1 -- 172.21.15.17:0/3972154011 shutdown_connections 2024-09-13T23:05:07.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.189+0000 7fb3a894b640 1 --2- 172.21.15.17:0/3972154011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a406f0b0 0x7fb3a4130ce0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:07.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.189+0000 7fb3a894b640 1 -- 172.21.15.17:0/3972154011 >> 172.21.15.17:0/3972154011 conn(0x7fb3a409aa80 msgr2=0x7fb3a409ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:07.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.189+0000 7fb3a894b640 1 -- 172.21.15.17:0/3972154011 shutdown_connections 2024-09-13T23:05:07.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.189+0000 7fb3a894b640 1 -- 172.21.15.17:0/3972154011 wait complete. 2024-09-13T23:05:07.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.191+0000 7f649cb03640 1 Processor -- start 2024-09-13T23:05:07.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.191+0000 7f649cb03640 1 -- start start 2024-09-13T23:05:07.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.191+0000 7fb3a894b640 1 Processor -- start 2024-09-13T23:05:07.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.191+0000 7fb3a894b640 1 -- start start 2024-09-13T23:05:07.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.191+0000 7f649cb03640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f649809bd50 0x7f64981c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:07.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.191+0000 7f649cb03640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6498099b90 con 0x7f649809bd50 2024-09-13T23:05:07.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.191+0000 7f649659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f649809bd50 0x7f64981c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:07.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.192+0000 7f649659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f649809bd50 0x7f64981c3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38800/0 (socket says 172.21.15.17:38800) 2024-09-13T23:05:07.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.192+0000 7f649659c640 1 -- 172.21.15.17:0/765782739 learned_addr learned my addr 172.21.15.17:0/765782739 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:07.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.192+0000 7fb3a894b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a406e5c0 0x7fb3a41b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:07.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.192+0000 7f649659c640 1 -- 172.21.15.17:0/765782739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64981b3080 con 0x7f649809bd50 2024-09-13T23:05:07.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.192+0000 7fb3a259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a406e5c0 0x7fb3a41b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:07.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.192+0000 7fb3a259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a406e5c0 0x7fb3a41b0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38814/0 (socket says 172.21.15.17:38814) 2024-09-13T23:05:07.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.192+0000 7fb3a259c640 1 -- 172.21.15.17:0/1056264386 learned_addr learned my addr 172.21.15.17:0/1056264386 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:07.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.192+0000 7fb3a894b640 1 -- 172.21.15.17:0/1056264386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a406bba0 con 0x7fb3a406e5c0 2024-09-13T23:05:07.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.192+0000 7f649659c640 1 --2- 172.21.15.17:0/765782739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f649809bd50 0x7f64981c3900 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6488035040 tx=0x7f64880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:07.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.192+0000 7f6486ffd640 1 -- 172.21.15.17:0/765782739 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6488041070 con 0x7f649809bd50 2024-09-13T23:05:07.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.193+0000 7f6486ffd640 1 -- 172.21.15.17:0/765782739 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f648803c7a0 con 0x7f649809bd50 2024-09-13T23:05:07.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.193+0000 7f6486ffd640 1 -- 172.21.15.17:0/765782739 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6488037040 con 0x7f649809bd50 2024-09-13T23:05:07.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.193+0000 7f649cb03640 1 -- 172.21.15.17:0/765782739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64981b4880 con 0x7f649809bd50 2024-09-13T23:05:07.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.193+0000 7fb3a259c640 1 -- 172.21.15.17:0/1056264386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a41b2530 con 0x7fb3a406e5c0 2024-09-13T23:05:07.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.193+0000 7f649cb03640 1 -- 172.21.15.17:0/765782739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64981b1a80 con 0x7f649809bd50 2024-09-13T23:05:07.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.193+0000 7fb3a259c640 1 --2- 172.21.15.17:0/1056264386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a406e5c0 0x7fb3a41b0cf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb39400c360 tx=0x7fb39400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:07.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.193+0000 7fb392ffd640 1 -- 172.21.15.17:0/1056264386 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb394007410 con 0x7fb3a406e5c0 2024-09-13T23:05:07.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.193+0000 7fb392ffd640 1 -- 172.21.15.17:0/1056264386 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3940075b0 con 0x7fb3a406e5c0 2024-09-13T23:05:07.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.194+0000 7fb392ffd640 1 -- 172.21.15.17:0/1056264386 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb394007410 con 0x7fb3a406e5c0 2024-09-13T23:05:07.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.194+0000 7fb3a894b640 1 -- 172.21.15.17:0/1056264386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a408f930 con 0x7fb3a406e5c0 2024-09-13T23:05:07.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.194+0000 7f649cb03640 1 -- 172.21.15.17:0/765782739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f649809a130 con 0x7f649809bd50 2024-09-13T23:05:07.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.194+0000 7fb3a894b640 1 -- 172.21.15.17:0/1056264386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a41b1230 con 0x7fb3a406e5c0 2024-09-13T23:05:07.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.194+0000 7f6486ffd640 1 -- 172.21.15.17:0/765782739 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6488044070 con 0x7f649809bd50 2024-09-13T23:05:07.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.194+0000 7f6486ffd640 1 --2- 172.21.15.17:0/765782739 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64780382d0 0x7f647803a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:07.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.194+0000 7f6486ffd640 1 -- 172.21.15.17:0/765782739 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f648806bea0 con 0x7f649809bd50 2024-09-13T23:05:07.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.195+0000 7f6495d9b640 1 --2- 172.21.15.17:0/765782739 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64780382d0 0x7f647803a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:07.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.195+0000 7fb392ffd640 1 -- 172.21.15.17:0/1056264386 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb39401a020 con 0x7fb3a406e5c0 2024-09-13T23:05:07.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.195+0000 7f6495d9b640 1 --2- 172.21.15.17:0/765782739 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64780382d0 0x7f647803a790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f649809cac0 tx=0x7f648c007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:07.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.195+0000 7fb392ffd640 1 --2- 172.21.15.17:0/1056264386 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb3840383e0 0x7fb38403a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:07.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.196+0000 7fb3a1d9b640 1 --2- 172.21.15.17:0/1056264386 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb3840383e0 0x7fb38403a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:07.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.196+0000 7fb3a894b640 1 -- 172.21.15.17:0/1056264386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3a406e9a0 con 0x7fb3a406e5c0 2024-09-13T23:05:07.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.196+0000 7fb3a1d9b640 1 --2- 172.21.15.17:0/1056264386 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb3840383e0 0x7fb38403a8a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb398035000 tx=0x7fb398030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:07.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.203+0000 7fb392ffd640 1 -- 172.21.15.17:0/1056264386 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fb39401bc30 con 0x7fb3a406e5c0 2024-09-13T23:05:07.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.203+0000 7f6486ffd640 1 -- 172.21.15.17:0/765782739 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f64981b3080 con 0x7f649809bd50 2024-09-13T23:05:07.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.212+0000 7fb392ffd640 1 -- 172.21.15.17:0/1056264386 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb39401ad80 con 0x7fb3a406e5c0 2024-09-13T23:05:07.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.221+0000 7fb31d494640 1 -- 172.21.15.17:0/1327275158 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb31809d020 con 0x7fb31809a100 2024-09-13T23:05:07.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.222+0000 7fb30f7fe640 1 -- 172.21.15.17:0/1327275158 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb308005d70 con 0x7fb31809a100 2024-09-13T23:05:07.223 INFO:teuthology.orchestra.run.smithi017.stdout:38654705669 2024-09-13T23:05:07.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.224+0000 7fb31d494640 1 -- 172.21.15.17:0/1327275158 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb2f80382a0 msgr2=0x7fb2f803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:07.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.224+0000 7fb31d494640 1 --2- 172.21.15.17:0/1327275158 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb2f80382a0 0x7fb2f803a760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb300034000 tx=0x7fb30002e000 comp rx=0 tx=0).stop 2024-09-13T23:05:07.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.224+0000 7fb31d494640 1 -- 172.21.15.17:0/1327275158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb31809a100 msgr2=0x7fb318092f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:07.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.224+0000 7fb31d494640 1 --2- 172.21.15.17:0/1327275158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb31809a100 0x7fb318092f40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb30800c6b0 tx=0x7fb30800cb70 comp rx=0 tx=0).stop 2024-09-13T23:05:07.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.224+0000 7fb31d494640 1 -- 172.21.15.17:0/1327275158 shutdown_connections 2024-09-13T23:05:07.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.224+0000 7fb31d494640 1 --2- 172.21.15.17:0/1327275158 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb2f80382a0 0x7fb2f803a760 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:07.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.224+0000 7fb31d494640 1 --2- 172.21.15.17:0/1327275158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb31809a100 0x7fb318092f40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:07.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.224+0000 7fb31d494640 1 -- 172.21.15.17:0/1327275158 >> 172.21.15.17:0/1327275158 conn(0x7fb31806d4a0 msgr2=0x7fb31809f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:07.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.224+0000 7fb31d494640 1 -- 172.21.15.17:0/1327275158 shutdown_connections 2024-09-13T23:05:07.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.224+0000 7fb31d494640 1 -- 172.21.15.17:0/1327275158 wait complete. 2024-09-13T23:05:07.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2024-09-13T23:05:07.240 DEBUG:teuthology.parallel:result is None 2024-09-13T23:05:07.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.353+0000 7fe2f69fd640 1 -- 172.21.15.17:0/9606174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe2f01260b0 con 0x7fe2f009a100 2024-09-13T23:05:07.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.353+0000 7fe2ecff9640 1 -- 172.21.15.17:0/9606174 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe2f009d3b0 con 0x7fe2f009a100 2024-09-13T23:05:07.354 INFO:teuthology.orchestra.run.smithi017.stdout:47244640260 2024-09-13T23:05:07.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.356+0000 7fe2f69fd640 1 -- 172.21.15.17:0/9606174 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe2dc0382a0 msgr2=0x7fe2dc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:07.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.356+0000 7fe2f69fd640 1 --2- 172.21.15.17:0/9606174 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe2dc0382a0 0x7fe2dc03a760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4034000 tx=0x7fe2e402e000 comp rx=0 tx=0).stop 2024-09-13T23:05:07.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.356+0000 7fe2f69fd640 1 -- 172.21.15.17:0/9606174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2f009a100 msgr2=0x7fe2f01c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:07.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.356+0000 7fe2f69fd640 1 --2- 172.21.15.17:0/9606174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2f009a100 0x7fe2f01c3990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe2e000c450 tx=0x7fe2e000c910 comp rx=0 tx=0).stop 2024-09-13T23:05:07.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.356+0000 7fe2f69fd640 1 -- 172.21.15.17:0/9606174 shutdown_connections 2024-09-13T23:05:07.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.356+0000 7fe2f69fd640 1 --2- 172.21.15.17:0/9606174 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe2dc0382a0 0x7fe2dc03a760 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:07.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.356+0000 7fe2f69fd640 1 --2- 172.21.15.17:0/9606174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2f009a100 0x7fe2f01c3990 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:07.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.356+0000 7fe2f69fd640 1 -- 172.21.15.17:0/9606174 >> 172.21.15.17:0/9606174 conn(0x7fe2f006d4a0 msgr2=0x7fe2f0096af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:07.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.356+0000 7fe2f69fd640 1 -- 172.21.15.17:0/9606174 shutdown_connections 2024-09-13T23:05:07.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.356+0000 7fe2f69fd640 1 -- 172.21.15.17:0/9606174 wait complete. 2024-09-13T23:05:07.367 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.2 2024-09-13T23:05:07.368 DEBUG:teuthology.parallel:result is None 2024-09-13T23:05:07.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.382+0000 7f649cb03640 1 -- 172.21.15.17:0/765782739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f649809d020 con 0x7f649809bd50 2024-09-13T23:05:07.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.382+0000 7f6486ffd640 1 -- 172.21.15.17:0/765782739 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6488030580 con 0x7f649809bd50 2024-09-13T23:05:07.383 INFO:teuthology.orchestra.run.smithi017.stdout:38654705669 2024-09-13T23:05:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.384+0000 7f649cb03640 1 -- 172.21.15.17:0/765782739 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64780382d0 msgr2=0x7f647803a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.384+0000 7f649cb03640 1 --2- 172.21.15.17:0/765782739 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64780382d0 0x7f647803a790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f649809cac0 tx=0x7f648c007a40 comp rx=0 tx=0).stop 2024-09-13T23:05:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.384+0000 7f649cb03640 1 -- 172.21.15.17:0/765782739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f649809bd50 msgr2=0x7f64981c3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.384+0000 7f649cb03640 1 --2- 172.21.15.17:0/765782739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f649809bd50 0x7f64981c3900 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6488035040 tx=0x7f64880046c0 comp rx=0 tx=0).stop 2024-09-13T23:05:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.384+0000 7f649cb03640 1 -- 172.21.15.17:0/765782739 shutdown_connections 2024-09-13T23:05:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.384+0000 7f649cb03640 1 --2- 172.21.15.17:0/765782739 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64780382d0 0x7f647803a790 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.384+0000 7f649cb03640 1 --2- 172.21.15.17:0/765782739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f649809bd50 0x7f64981c3900 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.384+0000 7f649cb03640 1 -- 172.21.15.17:0/765782739 >> 172.21.15.17:0/765782739 conn(0x7f649806d4a0 msgr2=0x7f649809eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.384+0000 7f649cb03640 1 -- 172.21.15.17:0/765782739 shutdown_connections 2024-09-13T23:05:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.384+0000 7f649cb03640 1 -- 172.21.15.17:0/765782739 wait complete. 2024-09-13T23:05:07.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.393+0000 7fb3a894b640 1 -- 172.21.15.17:0/1056264386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb3a408f6d0 con 0x7fb3a406e5c0 2024-09-13T23:05:07.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.394+0000 7fb392ffd640 1 -- 172.21.15.17:0/1056264386 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb394019d50 con 0x7fb3a406e5c0 2024-09-13T23:05:07.394 INFO:teuthology.orchestra.run.smithi017.stdout:51539607558 2024-09-13T23:05:07.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.1 2024-09-13T23:05:07.396 DEBUG:teuthology.parallel:result is None 2024-09-13T23:05:07.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.396+0000 7fb3a894b640 1 -- 172.21.15.17:0/1056264386 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb3840383e0 msgr2=0x7fb38403a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:07.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.396+0000 7fb3a894b640 1 --2- 172.21.15.17:0/1056264386 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb3840383e0 0x7fb38403a8a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb398035000 tx=0x7fb398030000 comp rx=0 tx=0).stop 2024-09-13T23:05:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.396+0000 7fb3a894b640 1 -- 172.21.15.17:0/1056264386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a406e5c0 msgr2=0x7fb3a41b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.396+0000 7fb3a894b640 1 --2- 172.21.15.17:0/1056264386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a406e5c0 0x7fb3a41b0cf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb39400c360 tx=0x7fb39400c820 comp rx=0 tx=0).stop 2024-09-13T23:05:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.396+0000 7fb3a894b640 1 -- 172.21.15.17:0/1056264386 shutdown_connections 2024-09-13T23:05:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.396+0000 7fb3a894b640 1 --2- 172.21.15.17:0/1056264386 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb3840383e0 0x7fb38403a8a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.396+0000 7fb3a894b640 1 --2- 172.21.15.17:0/1056264386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3a406e5c0 0x7fb3a41b0cf0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.396+0000 7fb3a894b640 1 -- 172.21.15.17:0/1056264386 >> 172.21.15.17:0/1056264386 conn(0x7fb3a409aa80 msgr2=0x7fb3a41a9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.396+0000 7fb3a894b640 1 -- 172.21.15.17:0/1056264386 shutdown_connections 2024-09-13T23:05:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.396+0000 7fb3a894b640 1 -- 172.21.15.17:0/1056264386 wait complete. 2024-09-13T23:05:07.407 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607558 got 51539607558 for osd.3 2024-09-13T23:05:07.408 DEBUG:teuthology.parallel:result is None 2024-09-13T23:05:07.408 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T23:05:07.408 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T23:05:07.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.548+0000 7f9f79c2e640 1 Processor -- start 2024-09-13T23:05:07.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.548+0000 7f9f79c2e640 1 -- start start 2024-09-13T23:05:07.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.548+0000 7f9f79c2e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9f740731f0 0x7f9f74095740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:07.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.549+0000 7f9f79c2e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f740971f0 con 0x7f9f74095c80 2024-09-13T23:05:07.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.549+0000 7f9f79c2e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f9f74074e50 con 0x7f9f740731f0 2024-09-13T23:05:07.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.549+0000 7f9f737fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9f740731f0 0x7f9f74095740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:07.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.549+0000 7f9f72ffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f9f74095c80 0x7f9f741313c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:41050/0 (socket says 172.21.15.17:41050) 2024-09-13T23:05:07.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.549+0000 7f9f72ffd640 1 -- 172.21.15.17:0/3986020414 learned_addr learned my addr 172.21.15.17:0/3986020414 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:05:07.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.549+0000 7f9f727fc640 1 -- 172.21.15.17:0/3986020414 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2145813976 0 0) 0x7f9f740971f0 con 0x7f9f74095c80 2024-09-13T23:05:07.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.549+0000 7f9f727fc640 1 -- 172.21.15.17:0/3986020414 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f5c003520 con 0x7f9f74095c80 2024-09-13T23:05:07.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.549+0000 7f9f737fe640 1 -- 172.21.15.17:0/3986020414 >> v1:172.21.15.17:6789/0 conn(0x7f9f74095c80 legacy=0x7f9f741313c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:07.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.549+0000 7f9f737fe640 1 -- 172.21.15.17:0/3986020414 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f7409aa40 con 0x7f9f740731f0 2024-09-13T23:05:07.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.550+0000 7f9f737fe640 1 --2- 172.21.15.17:0/3986020414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f740731f0 0x7f9f74095740 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9f64009720 tx=0x7f9f6402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2627669d36485 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:07.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.550+0000 7f9f727fc640 1 -- 172.21.15.17:0/3986020414 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f64037070 con 0x7f9f740731f0 2024-09-13T23:05:07.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.550+0000 7f9f727fc640 1 -- 172.21.15.17:0/3986020414 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f6402ad90 con 0x7f9f740731f0 2024-09-13T23:05:07.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.550+0000 7f9f727fc640 1 -- 172.21.15.17:0/3986020414 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f64032590 con 0x7f9f740731f0 2024-09-13T23:05:07.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.550+0000 7f9f79c2e640 1 -- 172.21.15.17:0/3986020414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f740731f0 msgr2=0x7f9f74095740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:07.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.550+0000 7f9f79c2e640 1 --2- 172.21.15.17:0/3986020414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f740731f0 0x7f9f74095740 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9f64009720 tx=0x7f9f6402a110 comp rx=0 tx=0).stop 2024-09-13T23:05:07.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.550+0000 7f9f79c2e640 1 -- 172.21.15.17:0/3986020414 shutdown_connections 2024-09-13T23:05:07.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.550+0000 7f9f79c2e640 1 --2- 172.21.15.17:0/3986020414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f740731f0 0x7f9f74095740 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:07.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.550+0000 7f9f79c2e640 1 -- 172.21.15.17:0/3986020414 >> 172.21.15.17:0/3986020414 conn(0x7f9f7409d860 msgr2=0x7f9f74099d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:07.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.551+0000 7f9f79c2e640 1 -- 172.21.15.17:0/3986020414 shutdown_connections 2024-09-13T23:05:07.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.551+0000 7f9f79c2e640 1 -- 172.21.15.17:0/3986020414 wait complete. 2024-09-13T23:05:07.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.551+0000 7f9f79c2e640 1 Processor -- start 2024-09-13T23:05:07.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.552+0000 7f9f79c2e640 1 -- start start 2024-09-13T23:05:07.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.552+0000 7f9f79c2e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f740731f0 0x7f9f741bde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:07.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.552+0000 7f9f79c2e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9f740961e0 con 0x7f9f740731f0 2024-09-13T23:05:07.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.552+0000 7f9f737fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f740731f0 0x7f9f741bde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:07.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.552+0000 7f9f737fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f740731f0 0x7f9f741bde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38840/0 (socket says 172.21.15.17:38840) 2024-09-13T23:05:07.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.552+0000 7f9f737fe640 1 -- 172.21.15.17:0/1996373314 learned_addr learned my addr 172.21.15.17:0/1996373314 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:07.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.552+0000 7f9f737fe640 1 -- 172.21.15.17:0/1996373314 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f741a8a20 con 0x7f9f740731f0 2024-09-13T23:05:07.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.552+0000 7f9f737fe640 1 --2- 172.21.15.17:0/1996373314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f740731f0 0x7f9f741bde60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9f64009720 tx=0x7f9f640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:07.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.553+0000 7f9f5bfff640 1 -- 172.21.15.17:0/1996373314 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f64041070 con 0x7f9f740731f0 2024-09-13T23:05:07.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.553+0000 7f9f5bfff640 1 -- 172.21.15.17:0/1996373314 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f6403c460 con 0x7f9f740731f0 2024-09-13T23:05:07.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.553+0000 7f9f79c2e640 1 -- 172.21.15.17:0/1996373314 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f74092f20 con 0x7f9f740731f0 2024-09-13T23:05:07.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.553+0000 7f9f5bfff640 1 -- 172.21.15.17:0/1996373314 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f64037040 con 0x7f9f740731f0 2024-09-13T23:05:07.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.553+0000 7f9f79c2e640 1 -- 172.21.15.17:0/1996373314 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f741be3a0 con 0x7f9f740731f0 2024-09-13T23:05:07.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.554+0000 7f9f5bfff640 1 -- 172.21.15.17:0/1996373314 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9f64044070 con 0x7f9f740731f0 2024-09-13T23:05:07.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.554+0000 7f9f79c2e640 1 -- 172.21.15.17:0/1996373314 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f740975a0 con 0x7f9f740731f0 2024-09-13T23:05:07.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.554+0000 7f9f5bfff640 1 --2- 172.21.15.17:0/1996373314 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9f600382a0 0x7f9f6003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:07.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.554+0000 7f9f5bfff640 1 -- 172.21.15.17:0/1996373314 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f9f6406b910 con 0x7f9f740731f0 2024-09-13T23:05:07.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.554+0000 7f9f72ffd640 1 --2- 172.21.15.17:0/1996373314 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9f600382a0 0x7f9f6003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:07.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.555+0000 7f9f72ffd640 1 --2- 172.21.15.17:0/1996373314 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9f600382a0 0x7f9f6003a760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9f68001610 tx=0x7f9f68007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:07.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.558+0000 7f9f5bfff640 1 -- 172.21.15.17:0/1996373314 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9f6403a360 con 0x7f9f740731f0 2024-09-13T23:05:07.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.730+0000 7f9f79c2e640 1 -- 172.21.15.17:0/1996373314 --> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9f74093890 con 0x7f9f600382a0 2024-09-13T23:05:07.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.732+0000 7f9f5bfff640 1 -- 172.21.15.17:0/1996373314 <== mgr.4102 v2:172.21.15.164:6824/713838566 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32205 (secure 0 0 0) 0x7f9f74093890 con 0x7f9f600382a0 2024-09-13T23:05:07.733 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:05:07.734 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-13T23:05:07.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.734+0000 7f9f79c2e640 1 -- 172.21.15.17:0/1996373314 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9f600382a0 msgr2=0x7f9f6003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:07.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.734+0000 7f9f79c2e640 1 --2- 172.21.15.17:0/1996373314 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9f600382a0 0x7f9f6003a760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9f68001610 tx=0x7f9f68007970 comp rx=0 tx=0).stop 2024-09-13T23:05:07.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.734+0000 7f9f79c2e640 1 -- 172.21.15.17:0/1996373314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f740731f0 msgr2=0x7f9f741bde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:07.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.734+0000 7f9f79c2e640 1 --2- 172.21.15.17:0/1996373314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f740731f0 0x7f9f741bde60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9f64009720 tx=0x7f9f640046c0 comp rx=0 tx=0).stop 2024-09-13T23:05:07.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.734+0000 7f9f79c2e640 1 -- 172.21.15.17:0/1996373314 shutdown_connections 2024-09-13T23:05:07.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.734+0000 7f9f79c2e640 1 --2- 172.21.15.17:0/1996373314 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9f600382a0 0x7f9f6003a760 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:07.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.734+0000 7f9f79c2e640 1 --2- 172.21.15.17:0/1996373314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f740731f0 0x7f9f741bde60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:07.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.734+0000 7f9f79c2e640 1 -- 172.21.15.17:0/1996373314 >> 172.21.15.17:0/1996373314 conn(0x7f9f7409d860 msgr2=0x7f9f74070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:07.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.734+0000 7f9f79c2e640 1 -- 172.21.15.17:0/1996373314 shutdown_connections 2024-09-13T23:05:07.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.734+0000 7f9f79c2e640 1 -- 172.21.15.17:0/1996373314 wait complete. 2024-09-13T23:05:07.746 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-13T23:05:06.042420+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118192,"kb_used_data":1736,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377369168,"statfs":{"total":386547056640,"available":386426028032,"internally_reserved":0,"allocated":1777664,"data_stored":1366010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":119138070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.975485"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:05:03.078777+0000","last_change":"2024-09-13T23:05:03.078956+0000","last_active":"2024-09-13T23:05:03.078777+0000","last_peered":"2024-09-13T23:05:03.078777+0000","last_clean":"2024-09-13T23:05:03.078777+0000","last_became_active":"2024-09-13T23:05:01.323761+0000","last_became_peered":"2024-09-13T23:05:01.323761+0000","last_unstale":"2024-09-13T23:05:03.078777+0000","last_undegraded":"2024-09-13T23:05:03.078777+0000","last_fullsized":"2024-09-13T23:05:03.078777+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:39.972272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001181893,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:05:03.080603+0000","last_change":"2024-09-13T23:05:03.080603+0000","last_active":"2024-09-13T23:05:03.080603+0000","last_peered":"2024-09-13T23:05:03.080603+0000","last_clean":"2024-09-13T23:05:03.080603+0000","last_became_active":"2024-09-13T23:05:01.074982+0000","last_became_peered":"2024-09-13T23:05:01.074982+0000","last_unstale":"2024-09-13T23:05:03.080603+0000","last_undegraded":"2024-09-13T23:05:03.080603+0000","last_fullsized":"2024-09-13T23:05:03.080603+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:59:19.159167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054650599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:05:03.077891+0000","last_change":"2024-09-13T23:05:03.078119+0000","last_active":"2024-09-13T23:05:03.077891+0000","last_peered":"2024-09-13T23:05:03.077891+0000","last_clean":"2024-09-13T23:05:03.077891+0000","last_became_active":"2024-09-13T23:05:01.075431+0000","last_became_peered":"2024-09-13T23:05:01.075431+0000","last_unstale":"2024-09-13T23:05:03.077891+0000","last_undegraded":"2024-09-13T23:05:03.077891+0000","last_fullsized":"2024-09-13T23:05:03.077891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:22:31.741360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041474900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:05:03.080556+0000","last_change":"2024-09-13T23:05:03.080556+0000","last_active":"2024-09-13T23:05:03.080556+0000","last_peered":"2024-09-13T23:05:03.080556+0000","last_clean":"2024-09-13T23:05:03.080556+0000","last_became_active":"2024-09-13T23:05:01.074963+0000","last_became_peered":"2024-09-13T23:05:01.074963+0000","last_unstale":"2024-09-13T23:05:03.080556+0000","last_undegraded":"2024-09-13T23:05:03.080556+0000","last_fullsized":"2024-09-13T23:05:03.080556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:02.162649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055235699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:05:03.078756+0000","last_change":"2024-09-13T23:05:03.078756+0000","last_active":"2024-09-13T23:05:03.078756+0000","last_peered":"2024-09-13T23:05:03.078756+0000","last_clean":"2024-09-13T23:05:03.078756+0000","last_became_active":"2024-09-13T23:05:01.075399+0000","last_became_peered":"2024-09-13T23:05:01.075399+0000","last_unstale":"2024-09-13T23:05:03.078756+0000","last_undegraded":"2024-09-13T23:05:03.078756+0000","last_fullsized":"2024-09-13T23:05:03.078756+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:30.026879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010379530000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:05:03.246300+0000","last_change":"2024-09-13T23:05:03.246597+0000","last_active":"2024-09-13T23:05:03.246300+0000","last_peered":"2024-09-13T23:05:03.246300+0000","last_clean":"2024-09-13T23:05:03.246300+0000","last_became_active":"2024-09-13T23:05:01.075422+0000","last_became_peered":"2024-09-13T23:05:01.075422+0000","last_unstale":"2024-09-13T23:05:03.246300+0000","last_undegraded":"2024-09-13T23:05:03.246300+0000","last_fullsized":"2024-09-13T23:05:03.246300+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:46.318146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049267099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:05:03.077943+0000","last_change":"2024-09-13T23:05:03.078145+0000","last_active":"2024-09-13T23:05:03.077943+0000","last_peered":"2024-09-13T23:05:03.077943+0000","last_clean":"2024-09-13T23:05:03.077943+0000","last_became_active":"2024-09-13T23:05:01.075438+0000","last_became_peered":"2024-09-13T23:05:01.075438+0000","last_unstale":"2024-09-13T23:05:03.077943+0000","last_undegraded":"2024-09-13T23:05:03.077943+0000","last_fullsized":"2024-09-13T23:05:03.077943+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:36:59.019783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043480299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:05:03.078573+0000","last_change":"2024-09-13T23:05:03.078734+0000","last_active":"2024-09-13T23:05:03.078573+0000","last_peered":"2024-09-13T23:05:03.078573+0000","last_clean":"2024-09-13T23:05:03.078573+0000","last_became_active":"2024-09-13T23:05:01.074608+0000","last_became_peered":"2024-09-13T23:05:01.074608+0000","last_unstale":"2024-09-13T23:05:03.078573+0000","last_undegraded":"2024-09-13T23:05:03.078573+0000","last_fullsized":"2024-09-13T23:05:03.078573+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:03.125973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097176599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"12'117","reported_seq":170,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:05:03.074315+0000","last_change":"2024-09-13T23:04:56.151685+0000","last_active":"2024-09-13T23:05:03.074315+0000","last_peered":"2024-09-13T23:05:03.074315+0000","last_clean":"2024-09-13T23:05:03.074315+0000","last_became_active":"2024-09-13T23:04:56.149747+0000","last_became_peered":"2024-09-13T23:04:56.149747+0000","last_unstale":"2024-09-13T23:05:03.074315+0000","last_undegraded":"2024-09-13T23:05:03.074315+0000","last_fullsized":"2024-09-13T23:05:03.074315+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:04:55.054026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:04:55.054026+0000","last_clean_scrub_stamp":"2024-09-13T23:04:55.054026+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:38.290092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":12,"seq":51539607558,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":151552,"data_stored":47354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":733184,"data_stored":633599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":741376,"data_stored":637703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35500,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336340,"statfs":{"total":96636764160,"available":96600412160,"internally_reserved":0,"allocated":151552,"data_stored":47354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T23:05:07.747 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T23:05:07.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.847+0000 7fd78e2dd640 1 Processor -- start 2024-09-13T23:05:07.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.847+0000 7fd78e2dd640 1 -- start start 2024-09-13T23:05:07.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.847+0000 7fd78e2dd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd78806eda0 0x7fd78806f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:07.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.847+0000 7fd78e2dd640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd78806eba0 con 0x7fd78806f6c0 2024-09-13T23:05:07.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.847+0000 7fd78e2dd640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fd78806d2f0 con 0x7fd78806eda0 2024-09-13T23:05:07.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.847+0000 7fd787fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd78806eda0 0x7fd78806f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:07.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.847+0000 7fd7877fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd78806f6c0 0x7fd788121a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:41054/0 (socket says 172.21.15.17:41054) 2024-09-13T23:05:07.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.847+0000 7fd7877fe640 1 -- 172.21.15.17:0/2696584135 learned_addr learned my addr 172.21.15.17:0/2696584135 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:05:07.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.848+0000 7fd787fff640 1 -- 172.21.15.17:0/2696584135 >> v1:172.21.15.17:6789/0 conn(0x7fd78806f6c0 legacy=0x7fd788121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:07.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.848+0000 7fd787fff640 1 -- 172.21.15.17:0/2696584135 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd788070d50 con 0x7fd78806eda0 2024-09-13T23:05:07.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.848+0000 7fd787fff640 1 --2- 172.21.15.17:0/2696584135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd78806eda0 0x7fd78806f180 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd778009720 tx=0x7fd77802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff3843c7911f0a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:07.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.849+0000 7fd786ffd640 1 -- 172.21.15.17:0/2696584135 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd778037070 con 0x7fd78806eda0 2024-09-13T23:05:07.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.849+0000 7fd786ffd640 1 -- 172.21.15.17:0/2696584135 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd77802ae20 con 0x7fd78806eda0 2024-09-13T23:05:07.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.849+0000 7fd786ffd640 1 -- 172.21.15.17:0/2696584135 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd778032590 con 0x7fd78806eda0 2024-09-13T23:05:07.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.849+0000 7fd78e2dd640 1 -- 172.21.15.17:0/2696584135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd78806eda0 msgr2=0x7fd78806f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:07.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.849+0000 7fd78e2dd640 1 --2- 172.21.15.17:0/2696584135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd78806eda0 0x7fd78806f180 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd778009720 tx=0x7fd77802a1a0 comp rx=0 tx=0).stop 2024-09-13T23:05:07.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.849+0000 7fd78e2dd640 1 -- 172.21.15.17:0/2696584135 shutdown_connections 2024-09-13T23:05:07.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.849+0000 7fd78e2dd640 1 --2- 172.21.15.17:0/2696584135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd78806eda0 0x7fd78806f180 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:07.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.849+0000 7fd78e2dd640 1 -- 172.21.15.17:0/2696584135 >> 172.21.15.17:0/2696584135 conn(0x7fd78809a890 msgr2=0x7fd78809aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:07.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.849+0000 7fd78e2dd640 1 -- 172.21.15.17:0/2696584135 shutdown_connections 2024-09-13T23:05:07.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.849+0000 7fd78e2dd640 1 -- 172.21.15.17:0/2696584135 wait complete. 2024-09-13T23:05:07.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.850+0000 7fd78e2dd640 1 Processor -- start 2024-09-13T23:05:07.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.850+0000 7fd78e2dd640 1 -- start start 2024-09-13T23:05:07.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.851+0000 7fd78e2dd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd78806eda0 0x7fd7881c17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:07.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.851+0000 7fd78e2dd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd788122160 con 0x7fd78806eda0 2024-09-13T23:05:07.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.851+0000 7fd787fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd78806eda0 0x7fd7881c17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:07.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.851+0000 7fd787fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd78806eda0 0x7fd7881c17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38852/0 (socket says 172.21.15.17:38852) 2024-09-13T23:05:07.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.851+0000 7fd787fff640 1 -- 172.21.15.17:0/1329417035 learned_addr learned my addr 172.21.15.17:0/1329417035 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:07.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.851+0000 7fd787fff640 1 -- 172.21.15.17:0/1329417035 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd78808db50 con 0x7fd78806eda0 2024-09-13T23:05:07.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.851+0000 7fd787fff640 1 --2- 172.21.15.17:0/1329417035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd78806eda0 0x7fd7881c17a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd77802a1e0 tx=0x7fd7780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:07.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.851+0000 7fd784ff9640 1 -- 172.21.15.17:0/1329417035 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd778042070 con 0x7fd78806eda0 2024-09-13T23:05:07.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.851+0000 7fd784ff9640 1 -- 172.21.15.17:0/1329417035 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd77803e590 con 0x7fd78806eda0 2024-09-13T23:05:07.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.851+0000 7fd78e2dd640 1 -- 172.21.15.17:0/1329417035 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7881c1ce0 con 0x7fd78806eda0 2024-09-13T23:05:07.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.851+0000 7fd784ff9640 1 -- 172.21.15.17:0/1329417035 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd778037040 con 0x7fd78806eda0 2024-09-13T23:05:07.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.851+0000 7fd78e2dd640 1 -- 172.21.15.17:0/1329417035 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7881c21b0 con 0x7fd78806eda0 2024-09-13T23:05:07.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.852+0000 7fd784ff9640 1 -- 172.21.15.17:0/1329417035 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd778045070 con 0x7fd78806eda0 2024-09-13T23:05:07.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.852+0000 7fd784ff9640 1 --2- 172.21.15.17:0/1329417035 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd7740382d0 0x7fd77403a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:07.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.852+0000 7fd784ff9640 1 -- 172.21.15.17:0/1329417035 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fd77806bb50 con 0x7fd78806eda0 2024-09-13T23:05:07.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.852+0000 7fd78e2dd640 1 -- 172.21.15.17:0/1329417035 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd78808d6b0 con 0x7fd78806eda0 2024-09-13T23:05:07.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.853+0000 7fd7877fe640 1 --2- 172.21.15.17:0/1329417035 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd7740382d0 0x7fd77403a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:07.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.853+0000 7fd7877fe640 1 --2- 172.21.15.17:0/1329417035 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd7740382d0 0x7fd77403a790 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd77c007fd0 tx=0x7fd77c007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:07.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:07.857+0000 7fd784ff9640 1 -- 172.21.15.17:0/1329417035 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd77803e8b0 con 0x7fd78806eda0 2024-09-13T23:05:08.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.029+0000 7fd78e2dd640 1 -- 172.21.15.17:0/1329417035 --> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd78808e3b0 con 0x7fd7740382d0 2024-09-13T23:05:08.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.031+0000 7fd784ff9640 1 -- 172.21.15.17:0/1329417035 <== mgr.4102 v2:172.21.15.164:6824/713838566 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32205 (secure 0 0 0) 0x7fd78808e3b0 con 0x7fd7740382d0 2024-09-13T23:05:08.032 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:05:08.032 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-13T23:05:08.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.033+0000 7fd78e2dd640 1 -- 172.21.15.17:0/1329417035 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd7740382d0 msgr2=0x7fd77403a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:08.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.033+0000 7fd78e2dd640 1 --2- 172.21.15.17:0/1329417035 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd7740382d0 0x7fd77403a790 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd77c007fd0 tx=0x7fd77c007ac0 comp rx=0 tx=0).stop 2024-09-13T23:05:08.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.033+0000 7fd78e2dd640 1 -- 172.21.15.17:0/1329417035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd78806eda0 msgr2=0x7fd7881c17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:08.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.033+0000 7fd78e2dd640 1 --2- 172.21.15.17:0/1329417035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd78806eda0 0x7fd7881c17a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd77802a1e0 tx=0x7fd7780046c0 comp rx=0 tx=0).stop 2024-09-13T23:05:08.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.033+0000 7fd78e2dd640 1 -- 172.21.15.17:0/1329417035 shutdown_connections 2024-09-13T23:05:08.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.033+0000 7fd78e2dd640 1 --2- 172.21.15.17:0/1329417035 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd7740382d0 0x7fd77403a790 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:08.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.033+0000 7fd78e2dd640 1 --2- 172.21.15.17:0/1329417035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd78806eda0 0x7fd7881c17a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:08.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.033+0000 7fd78e2dd640 1 -- 172.21.15.17:0/1329417035 >> 172.21.15.17:0/1329417035 conn(0x7fd78809a890 msgr2=0x7fd78806d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:08.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.033+0000 7fd78e2dd640 1 -- 172.21.15.17:0/1329417035 shutdown_connections 2024-09-13T23:05:08.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.033+0000 7fd78e2dd640 1 -- 172.21.15.17:0/1329417035 wait complete. 2024-09-13T23:05:08.045 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-13T23:05:06.042420+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118192,"kb_used_data":1736,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377369168,"statfs":{"total":386547056640,"available":386426028032,"internally_reserved":0,"allocated":1777664,"data_stored":1366010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":119138070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.975485"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:05:03.078777+0000","last_change":"2024-09-13T23:05:03.078956+0000","last_active":"2024-09-13T23:05:03.078777+0000","last_peered":"2024-09-13T23:05:03.078777+0000","last_clean":"2024-09-13T23:05:03.078777+0000","last_became_active":"2024-09-13T23:05:01.323761+0000","last_became_peered":"2024-09-13T23:05:01.323761+0000","last_unstale":"2024-09-13T23:05:03.078777+0000","last_undegraded":"2024-09-13T23:05:03.078777+0000","last_fullsized":"2024-09-13T23:05:03.078777+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:39.972272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001181893,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:05:03.080603+0000","last_change":"2024-09-13T23:05:03.080603+0000","last_active":"2024-09-13T23:05:03.080603+0000","last_peered":"2024-09-13T23:05:03.080603+0000","last_clean":"2024-09-13T23:05:03.080603+0000","last_became_active":"2024-09-13T23:05:01.074982+0000","last_became_peered":"2024-09-13T23:05:01.074982+0000","last_unstale":"2024-09-13T23:05:03.080603+0000","last_undegraded":"2024-09-13T23:05:03.080603+0000","last_fullsized":"2024-09-13T23:05:03.080603+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:59:19.159167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054650599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:05:03.077891+0000","last_change":"2024-09-13T23:05:03.078119+0000","last_active":"2024-09-13T23:05:03.077891+0000","last_peered":"2024-09-13T23:05:03.077891+0000","last_clean":"2024-09-13T23:05:03.077891+0000","last_became_active":"2024-09-13T23:05:01.075431+0000","last_became_peered":"2024-09-13T23:05:01.075431+0000","last_unstale":"2024-09-13T23:05:03.077891+0000","last_undegraded":"2024-09-13T23:05:03.077891+0000","last_fullsized":"2024-09-13T23:05:03.077891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:22:31.741360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041474900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:05:03.080556+0000","last_change":"2024-09-13T23:05:03.080556+0000","last_active":"2024-09-13T23:05:03.080556+0000","last_peered":"2024-09-13T23:05:03.080556+0000","last_clean":"2024-09-13T23:05:03.080556+0000","last_became_active":"2024-09-13T23:05:01.074963+0000","last_became_peered":"2024-09-13T23:05:01.074963+0000","last_unstale":"2024-09-13T23:05:03.080556+0000","last_undegraded":"2024-09-13T23:05:03.080556+0000","last_fullsized":"2024-09-13T23:05:03.080556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:02.162649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055235699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:05:03.078756+0000","last_change":"2024-09-13T23:05:03.078756+0000","last_active":"2024-09-13T23:05:03.078756+0000","last_peered":"2024-09-13T23:05:03.078756+0000","last_clean":"2024-09-13T23:05:03.078756+0000","last_became_active":"2024-09-13T23:05:01.075399+0000","last_became_peered":"2024-09-13T23:05:01.075399+0000","last_unstale":"2024-09-13T23:05:03.078756+0000","last_undegraded":"2024-09-13T23:05:03.078756+0000","last_fullsized":"2024-09-13T23:05:03.078756+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:30.026879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010379530000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:05:03.246300+0000","last_change":"2024-09-13T23:05:03.246597+0000","last_active":"2024-09-13T23:05:03.246300+0000","last_peered":"2024-09-13T23:05:03.246300+0000","last_clean":"2024-09-13T23:05:03.246300+0000","last_became_active":"2024-09-13T23:05:01.075422+0000","last_became_peered":"2024-09-13T23:05:01.075422+0000","last_unstale":"2024-09-13T23:05:03.246300+0000","last_undegraded":"2024-09-13T23:05:03.246300+0000","last_fullsized":"2024-09-13T23:05:03.246300+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:46.318146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049267099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:05:03.077943+0000","last_change":"2024-09-13T23:05:03.078145+0000","last_active":"2024-09-13T23:05:03.077943+0000","last_peered":"2024-09-13T23:05:03.077943+0000","last_clean":"2024-09-13T23:05:03.077943+0000","last_became_active":"2024-09-13T23:05:01.075438+0000","last_became_peered":"2024-09-13T23:05:01.075438+0000","last_unstale":"2024-09-13T23:05:03.077943+0000","last_undegraded":"2024-09-13T23:05:03.077943+0000","last_fullsized":"2024-09-13T23:05:03.077943+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:36:59.019783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043480299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:05:03.078573+0000","last_change":"2024-09-13T23:05:03.078734+0000","last_active":"2024-09-13T23:05:03.078573+0000","last_peered":"2024-09-13T23:05:03.078573+0000","last_clean":"2024-09-13T23:05:03.078573+0000","last_became_active":"2024-09-13T23:05:01.074608+0000","last_became_peered":"2024-09-13T23:05:01.074608+0000","last_unstale":"2024-09-13T23:05:03.078573+0000","last_undegraded":"2024-09-13T23:05:03.078573+0000","last_fullsized":"2024-09-13T23:05:03.078573+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:03.125973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097176599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"12'117","reported_seq":170,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T23:05:03.074315+0000","last_change":"2024-09-13T23:04:56.151685+0000","last_active":"2024-09-13T23:05:03.074315+0000","last_peered":"2024-09-13T23:05:03.074315+0000","last_clean":"2024-09-13T23:05:03.074315+0000","last_became_active":"2024-09-13T23:04:56.149747+0000","last_became_peered":"2024-09-13T23:04:56.149747+0000","last_unstale":"2024-09-13T23:05:03.074315+0000","last_undegraded":"2024-09-13T23:05:03.074315+0000","last_fullsized":"2024-09-13T23:05:03.074315+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:04:55.054026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:04:55.054026+0000","last_clean_scrub_stamp":"2024-09-13T23:04:55.054026+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:38.290092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":12,"seq":51539607558,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":151552,"data_stored":47354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":733184,"data_stored":633599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":741376,"data_stored":637703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35500,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336340,"statfs":{"total":96636764160,"available":96600412160,"internally_reserved":0,"allocated":151552,"data_stored":47354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T23:05:08.046 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T23:05:08.046 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T23:05:08.046 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T23:05:08.046 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T23:05:08.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.147+0000 7fdebfbe4640 1 Processor -- start 2024-09-13T23:05:08.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.147+0000 7fdebfbe4640 1 -- start start 2024-09-13T23:05:08.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.147+0000 7fdebfbe4640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdeb806eda0 0x7fdeb806f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:08.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.147+0000 7fdebfbe4640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdeb806eba0 con 0x7fdeb806f6c0 2024-09-13T23:05:08.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.147+0000 7fdebfbe4640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fdeb806d2f0 con 0x7fdeb806eda0 2024-09-13T23:05:08.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.147+0000 7fdebd980640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdeb806eda0 0x7fdeb806f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:08.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.147+0000 7fdebd17f640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fdeb806f6c0 0x7fdeb8121a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:41056/0 (socket says 172.21.15.17:41056) 2024-09-13T23:05:08.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.147+0000 7fdebd17f640 1 -- 172.21.15.17:0/634550889 learned_addr learned my addr 172.21.15.17:0/634550889 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:05:08.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.148+0000 7fdebd980640 1 -- 172.21.15.17:0/634550889 >> v1:172.21.15.17:6789/0 conn(0x7fdeb806f6c0 legacy=0x7fdeb8121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:08.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.148+0000 7fdebd980640 1 -- 172.21.15.17:0/634550889 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb8070d50 con 0x7fdeb806eda0 2024-09-13T23:05:08.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.148+0000 7fdebd980640 1 --2- 172.21.15.17:0/634550889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeb806eda0 0x7fdeb806f180 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdea8009d90 tx=0x7fdea802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ce9534fa13007 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:08.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.148+0000 7fdebc97e640 1 -- 172.21.15.17:0/634550889 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdea8007670 con 0x7fdeb806eda0 2024-09-13T23:05:08.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.148+0000 7fdebc97e640 1 -- 172.21.15.17:0/634550889 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdea8007810 con 0x7fdeb806eda0 2024-09-13T23:05:08.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.148+0000 7fdebc97e640 1 -- 172.21.15.17:0/634550889 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdea8007b10 con 0x7fdeb806eda0 2024-09-13T23:05:08.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.149+0000 7fdebfbe4640 1 -- 172.21.15.17:0/634550889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeb806eda0 msgr2=0x7fdeb806f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:08.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.149+0000 7fdebfbe4640 1 --2- 172.21.15.17:0/634550889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeb806eda0 0x7fdeb806f180 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdea8009d90 tx=0x7fdea802a6f0 comp rx=0 tx=0).stop 2024-09-13T23:05:08.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.149+0000 7fdebfbe4640 1 -- 172.21.15.17:0/634550889 shutdown_connections 2024-09-13T23:05:08.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.149+0000 7fdebfbe4640 1 --2- 172.21.15.17:0/634550889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeb806eda0 0x7fdeb806f180 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:08.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.149+0000 7fdebfbe4640 1 -- 172.21.15.17:0/634550889 >> 172.21.15.17:0/634550889 conn(0x7fdeb809a890 msgr2=0x7fdeb809aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:08.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.149+0000 7fdebfbe4640 1 -- 172.21.15.17:0/634550889 shutdown_connections 2024-09-13T23:05:08.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.149+0000 7fdebfbe4640 1 -- 172.21.15.17:0/634550889 wait complete. 2024-09-13T23:05:08.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.150+0000 7fdebfbe4640 1 Processor -- start 2024-09-13T23:05:08.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.150+0000 7fdebfbe4640 1 -- start start 2024-09-13T23:05:08.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.150+0000 7fdebfbe4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeb806eda0 0x7fdeb808d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:08.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.150+0000 7fdebfbe4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb8122160 con 0x7fdeb806eda0 2024-09-13T23:05:08.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.150+0000 7fdebd980640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeb806eda0 0x7fdeb808d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:08.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.150+0000 7fdebd980640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeb806eda0 0x7fdeb808d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38872/0 (socket says 172.21.15.17:38872) 2024-09-13T23:05:08.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.150+0000 7fdebd980640 1 -- 172.21.15.17:0/1722912529 learned_addr learned my addr 172.21.15.17:0/1722912529 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:05:08.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.151+0000 7fdebd980640 1 -- 172.21.15.17:0/1722912529 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb806de60 con 0x7fdeb806eda0 2024-09-13T23:05:08.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.151+0000 7fdebd980640 1 --2- 172.21.15.17:0/1722912529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeb806eda0 0x7fdeb808d1d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdea8009d90 tx=0x7fdea8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:08.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.151+0000 7fdeb67fc640 1 -- 172.21.15.17:0/1722912529 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdea8040070 con 0x7fdeb806eda0 2024-09-13T23:05:08.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.151+0000 7fdeb67fc640 1 -- 172.21.15.17:0/1722912529 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdea8031b10 con 0x7fdeb806eda0 2024-09-13T23:05:08.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.151+0000 7fdebfbe4640 1 -- 172.21.15.17:0/1722912529 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeb806db80 con 0x7fdeb806eda0 2024-09-13T23:05:08.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.151+0000 7fdeb67fc640 1 -- 172.21.15.17:0/1722912529 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdea8031df0 con 0x7fdeb806eda0 2024-09-13T23:05:08.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.151+0000 7fdebfbe4640 1 -- 172.21.15.17:0/1722912529 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeb808e730 con 0x7fdeb806eda0 2024-09-13T23:05:08.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.152+0000 7fdeb67fc640 1 -- 172.21.15.17:0/1722912529 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdea8039040 con 0x7fdeb806eda0 2024-09-13T23:05:08.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.152+0000 7fdebfbe4640 1 -- 172.21.15.17:0/1722912529 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdeb806e2e0 con 0x7fdeb806eda0 2024-09-13T23:05:08.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.152+0000 7fdeb67fc640 1 --2- 172.21.15.17:0/1722912529 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdea40382a0 0x7fdea403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:08.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.152+0000 7fdeb67fc640 1 -- 172.21.15.17:0/1722912529 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fdea806ccc0 con 0x7fdeb806eda0 2024-09-13T23:05:08.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.152+0000 7fdebd17f640 1 --2- 172.21.15.17:0/1722912529 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdea40382a0 0x7fdea403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:08.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.153+0000 7fdebd17f640 1 --2- 172.21.15.17:0/1722912529 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdea40382a0 0x7fdea403a760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdeac007fd0 tx=0x7fdeac007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:08.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.157+0000 7fdeb67fc640 1 -- 172.21.15.17:0/1722912529 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdea803b3b0 con 0x7fdeb806eda0 2024-09-13T23:05:08.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.371+0000 7fdebfbe4640 1 -- 172.21.15.17:0/1722912529 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdeb8122670 con 0x7fdeb806eda0 2024-09-13T23:05:08.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.371+0000 7fdeb67fc640 1 -- 172.21.15.17:0/1722912529 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fdea804de10 con 0x7fdeb806eda0 2024-09-13T23:05:08.372 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:05:08.372 INFO:teuthology.orchestra.run.smithi017.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T23:05:08.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.373+0000 7fdebfbe4640 1 -- 172.21.15.17:0/1722912529 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdea40382a0 msgr2=0x7fdea403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:08.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.373+0000 7fdebfbe4640 1 --2- 172.21.15.17:0/1722912529 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdea40382a0 0x7fdea403a760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdeac007fd0 tx=0x7fdeac007ac0 comp rx=0 tx=0).stop 2024-09-13T23:05:08.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.373+0000 7fdebfbe4640 1 -- 172.21.15.17:0/1722912529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeb806eda0 msgr2=0x7fdeb808d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:08.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.373+0000 7fdebfbe4640 1 --2- 172.21.15.17:0/1722912529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeb806eda0 0x7fdeb808d1d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdea8009d90 tx=0x7fdea8004a40 comp rx=0 tx=0).stop 2024-09-13T23:05:08.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.373+0000 7fdebfbe4640 1 -- 172.21.15.17:0/1722912529 shutdown_connections 2024-09-13T23:05:08.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.373+0000 7fdebfbe4640 1 --2- 172.21.15.17:0/1722912529 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdea40382a0 0x7fdea403a760 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:08.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.373+0000 7fdebfbe4640 1 --2- 172.21.15.17:0/1722912529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeb806eda0 0x7fdeb808d1d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:08.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.373+0000 7fdebfbe4640 1 -- 172.21.15.17:0/1722912529 >> 172.21.15.17:0/1722912529 conn(0x7fdeb809a890 msgr2=0x7fdeb812b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:08.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.373+0000 7fdebfbe4640 1 -- 172.21.15.17:0/1722912529 shutdown_connections 2024-09-13T23:05:08.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:05:08.373+0000 7fdebfbe4640 1 -- 172.21.15.17:0/1722912529 wait complete. 2024-09-13T23:05:08.385 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T23:05:08.385 INFO:teuthology.run_tasks:Running task rgw... 2024-09-13T23:05:08.401 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-13T23:05:08.401 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-13T23:05:08.402 INFO:tasks.rgw:Creating data pools 2024-09-13T23:05:08.402 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-13T23:05:08.402 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-09-13T23:05:08.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.513+0000 7ff6e4349640 1 Processor -- start 2024-09-13T23:05:08.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.513+0000 7ff6e4349640 1 -- start start 2024-09-13T23:05:08.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.513+0000 7ff6e4349640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff6dc117a40 0x7ff6dc119e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:08.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.513+0000 7ff6e4349640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6dc11a370 con 0x7ff6dc113b00 2024-09-13T23:05:08.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.513+0000 7ff6e4349640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7ff6dc10ed80 con 0x7ff6dc117a40 2024-09-13T23:05:08.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.514+0000 7ff6e18e4640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff6dc117a40 0x7ff6dc119e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:08.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.514+0000 7ff6e20e5640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff6dc113b00 0x7ff6dc113ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:57180/0 (socket says 172.21.15.164:57180) 2024-09-13T23:05:08.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.514+0000 7ff6e18e4640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff6dc117a40 0x7ff6dc119e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:40034/0 (socket says 172.21.15.164:40034) 2024-09-13T23:05:08.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.514+0000 7ff6e20e5640 1 -- 172.21.15.164:0/1698905979 learned_addr learned my addr 172.21.15.164:0/1698905979 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:08.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.514+0000 7ff6e18e4640 1 -- 172.21.15.164:0/1698905979 >> v1:172.21.15.17:6789/0 conn(0x7ff6dc113b00 legacy=0x7ff6dc113ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:08.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.514+0000 7ff6e18e4640 1 -- 172.21.15.164:0/1698905979 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6dc10ef30 con 0x7ff6dc117a40 2024-09-13T23:05:08.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.515+0000 7ff6e18e4640 1 --2- 172.21.15.164:0/1698905979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6dc117a40 0x7ff6dc119e30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8009720 tx=0x7ff6d802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b8dc5d943644c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:08.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.515+0000 7ff6e10e3640 1 -- 172.21.15.164:0/1698905979 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6d8037070 con 0x7ff6dc117a40 2024-09-13T23:05:08.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.515+0000 7ff6e10e3640 1 -- 172.21.15.164:0/1698905979 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d802ad90 con 0x7ff6dc117a40 2024-09-13T23:05:08.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.515+0000 7ff6e10e3640 1 -- 172.21.15.164:0/1698905979 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6d8032590 con 0x7ff6dc117a40 2024-09-13T23:05:08.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.516+0000 7ff6e4349640 1 -- 172.21.15.164:0/1698905979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6dc117a40 msgr2=0x7ff6dc119e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:08.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.516+0000 7ff6e4349640 1 --2- 172.21.15.164:0/1698905979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6dc117a40 0x7ff6dc119e30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8009720 tx=0x7ff6d802a110 comp rx=0 tx=0).stop 2024-09-13T23:05:08.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.516+0000 7ff6e4349640 1 -- 172.21.15.164:0/1698905979 shutdown_connections 2024-09-13T23:05:08.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.516+0000 7ff6e4349640 1 --2- 172.21.15.164:0/1698905979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6dc117a40 0x7ff6dc119e30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:08.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.516+0000 7ff6e4349640 1 -- 172.21.15.164:0/1698905979 >> 172.21.15.164:0/1698905979 conn(0x7ff6dc06f330 msgr2=0x7ff6dc071750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:08.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.516+0000 7ff6e4349640 1 -- 172.21.15.164:0/1698905979 shutdown_connections 2024-09-13T23:05:08.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.516+0000 7ff6e4349640 1 -- 172.21.15.164:0/1698905979 wait complete. 2024-09-13T23:05:08.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.517+0000 7ff6e4349640 1 Processor -- start 2024-09-13T23:05:08.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.517+0000 7ff6e4349640 1 -- start start 2024-09-13T23:05:08.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.517+0000 7ff6e4349640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6dc113b00 0x7ff6dc1a4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:08.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.517+0000 7ff6e4349640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc10f6a0 con 0x7ff6dc113b00 2024-09-13T23:05:08.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.517+0000 7ff6e20e5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6dc113b00 0x7ff6dc1a4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:08.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.517+0000 7ff6e20e5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6dc113b00 0x7ff6dc1a4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:40042/0 (socket says 172.21.15.164:40042) 2024-09-13T23:05:08.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.517+0000 7ff6e20e5640 1 -- 172.21.15.164:0/279500829 learned_addr learned my addr 172.21.15.164:0/279500829 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:08.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.518+0000 7ff6e20e5640 1 -- 172.21.15.164:0/279500829 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6dc1a4f60 con 0x7ff6dc113b00 2024-09-13T23:05:08.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.518+0000 7ff6e20e5640 1 --2- 172.21.15.164:0/279500829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6dc113b00 0x7ff6dc1a4a20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00c4a0 tx=0x7ff6cc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:08.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.518+0000 7ff6d2ffd640 1 -- 172.21.15.164:0/279500829 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6cc017070 con 0x7ff6dc113b00 2024-09-13T23:05:08.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.518+0000 7ff6d2ffd640 1 -- 172.21.15.164:0/279500829 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6cc005c10 con 0x7ff6dc113b00 2024-09-13T23:05:08.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.518+0000 7ff6e4349640 1 -- 172.21.15.164:0/279500829 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6dc1a5250 con 0x7ff6dc113b00 2024-09-13T23:05:08.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.518+0000 7ff6d2ffd640 1 -- 172.21.15.164:0/279500829 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6cc007070 con 0x7ff6dc113b00 2024-09-13T23:05:08.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.518+0000 7ff6e4349640 1 -- 172.21.15.164:0/279500829 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6dc1a9380 con 0x7ff6dc113b00 2024-09-13T23:05:08.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.519+0000 7ff6d2ffd640 1 -- 172.21.15.164:0/279500829 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff6cc01a070 con 0x7ff6dc113b00 2024-09-13T23:05:08.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.519+0000 7ff6e4349640 1 -- 172.21.15.164:0/279500829 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6dc10fbe0 con 0x7ff6dc113b00 2024-09-13T23:05:08.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.519+0000 7ff6d2ffd640 1 --2- 172.21.15.164:0/279500829 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ff6c00382a0 0x7ff6c003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:08.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.519+0000 7ff6d2ffd640 1 -- 172.21.15.164:0/279500829 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7ff6cc04a590 con 0x7ff6dc113b00 2024-09-13T23:05:08.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.519+0000 7ff6e18e4640 1 --2- 172.21.15.164:0/279500829 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ff6c00382a0 0x7ff6c003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:08.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.520+0000 7ff6e18e4640 1 --2- 172.21.15.164:0/279500829 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ff6c00382a0 0x7ff6c003a760 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8034000 tx=0x7ff6d802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:08.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.524+0000 7ff6d2ffd640 1 -- 172.21.15.164:0/279500829 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff6cc01b3b0 con 0x7ff6dc113b00 2024-09-13T23:05:08.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.697+0000 7ff6e4349640 1 -- 172.21.15.164:0/279500829 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]} v 0) -- 0x7ff6dc1a5480 con 0x7ff6dc113b00 2024-09-13T23:05:08.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.815+0000 7ff6d2ffd640 1 -- 172.21.15.164:0/279500829 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]}]=0 v18) ==== 171+0+0 (secure 0 0 0) 0x7ff6cc010300 con 0x7ff6dc113b00 2024-09-13T23:05:08.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.818+0000 7ff6e4349640 1 -- 172.21.15.164:0/279500829 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ff6c00382a0 msgr2=0x7ff6c003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:08.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.818+0000 7ff6e4349640 1 --2- 172.21.15.164:0/279500829 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ff6c00382a0 0x7ff6c003a760 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8034000 tx=0x7ff6d802e000 comp rx=0 tx=0).stop 2024-09-13T23:05:08.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.818+0000 7ff6e4349640 1 -- 172.21.15.164:0/279500829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6dc113b00 msgr2=0x7ff6dc1a4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:08.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.818+0000 7ff6e4349640 1 --2- 172.21.15.164:0/279500829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6dc113b00 0x7ff6dc1a4a20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00c4a0 tx=0x7ff6cc00c960 comp rx=0 tx=0).stop 2024-09-13T23:05:08.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.818+0000 7ff6e4349640 1 -- 172.21.15.164:0/279500829 shutdown_connections 2024-09-13T23:05:08.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.818+0000 7ff6e4349640 1 --2- 172.21.15.164:0/279500829 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ff6c00382a0 0x7ff6c003a760 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:08.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.818+0000 7ff6e4349640 1 --2- 172.21.15.164:0/279500829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6dc113b00 0x7ff6dc1a4a20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:08.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.818+0000 7ff6e4349640 1 -- 172.21.15.164:0/279500829 >> 172.21.15.164:0/279500829 conn(0x7ff6dc06f330 msgr2=0x7ff6dc116000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:08.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.818+0000 7ff6e4349640 1 -- 172.21.15.164:0/279500829 shutdown_connections 2024-09-13T23:05:08.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.818+0000 7ff6e4349640 1 -- 172.21.15.164:0/279500829 wait complete. 2024-09-13T23:05:08.829 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-13T23:05:08.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.928+0000 7fdfbe1db640 1 Processor -- start 2024-09-13T23:05:08.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.928+0000 7fdfbe1db640 1 -- start start 2024-09-13T23:05:08.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.928+0000 7fdfbe1db640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdfb8113b00 0x7fdfb8113ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:08.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.928+0000 7fdfbe1db640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfb8114540 con 0x7fdfb8073290 2024-09-13T23:05:08.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.928+0000 7fdfbe1db640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fdfb8073e30 con 0x7fdfb8113b00 2024-09-13T23:05:08.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.928+0000 7fdfb77fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdfb8113b00 0x7fdfb8113ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:08.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.928+0000 7fdfb77fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdfb8113b00 0x7fdfb8113ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:40052/0 (socket says 172.21.15.164:40052) 2024-09-13T23:05:08.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.928+0000 7fdfb77fe640 1 -- 172.21.15.164:0/2728527479 learned_addr learned my addr 172.21.15.164:0/2728527479 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:08.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.928+0000 7fdfaffff640 1 --1- 172.21.15.164:0/2728527479 >> v1:172.21.15.17:6789/0 conn(0x7fdfb8073290 0x7fdfb8073720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:57196/0 (socket says 172.21.15.164:57196) 2024-09-13T23:05:08.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.929+0000 7fdfb77fe640 1 -- 172.21.15.164:0/2728527479 >> v1:172.21.15.17:6789/0 conn(0x7fdfb8073290 legacy=0x7fdfb8073720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:08.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.929+0000 7fdfb77fe640 1 -- 172.21.15.164:0/2728527479 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb8073fe0 con 0x7fdfb8113b00 2024-09-13T23:05:08.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.929+0000 7fdfb77fe640 1 --2- 172.21.15.164:0/2728527479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfb8113b00 0x7fdfb8113ee0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdfa80097f0 tx=0x7fdfa802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f887a2813f67b9e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:08.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.930+0000 7fdfb6ffd640 1 -- 172.21.15.164:0/2728527479 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfa8037070 con 0x7fdfb8113b00 2024-09-13T23:05:08.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.930+0000 7fdfb6ffd640 1 -- 172.21.15.164:0/2728527479 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa8032440 con 0x7fdfb8113b00 2024-09-13T23:05:08.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.930+0000 7fdfb6ffd640 1 -- 172.21.15.164:0/2728527479 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfa802ae60 con 0x7fdfb8113b00 2024-09-13T23:05:08.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.930+0000 7fdfbe1db640 1 -- 172.21.15.164:0/2728527479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfb8113b00 msgr2=0x7fdfb8113ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:08.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.930+0000 7fdfbe1db640 1 --2- 172.21.15.164:0/2728527479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfb8113b00 0x7fdfb8113ee0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdfa80097f0 tx=0x7fdfa802a1e0 comp rx=0 tx=0).stop 2024-09-13T23:05:08.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.930+0000 7fdfbe1db640 1 -- 172.21.15.164:0/2728527479 shutdown_connections 2024-09-13T23:05:08.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.930+0000 7fdfbe1db640 1 --2- 172.21.15.164:0/2728527479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfb8113b00 0x7fdfb8113ee0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:08.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.930+0000 7fdfbe1db640 1 -- 172.21.15.164:0/2728527479 >> 172.21.15.164:0/2728527479 conn(0x7fdfb806f330 msgr2=0x7fdfb8071750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:08.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.930+0000 7fdfbe1db640 1 -- 172.21.15.164:0/2728527479 shutdown_connections 2024-09-13T23:05:08.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.930+0000 7fdfbe1db640 1 -- 172.21.15.164:0/2728527479 wait complete. 2024-09-13T23:05:08.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.931+0000 7fdfbe1db640 1 Processor -- start 2024-09-13T23:05:08.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.931+0000 7fdfbe1db640 1 -- start start 2024-09-13T23:05:08.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.931+0000 7fdfbe1db640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfb8073290 0x7fdfb81a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:08.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.931+0000 7fdfbe1db640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb811ae80 con 0x7fdfb8073290 2024-09-13T23:05:08.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.931+0000 7fdfb77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfb8073290 0x7fdfb81a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:08.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.931+0000 7fdfb77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfb8073290 0x7fdfb81a5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:40056/0 (socket says 172.21.15.164:40056) 2024-09-13T23:05:08.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.931+0000 7fdfb77fe640 1 -- 172.21.15.164:0/1285396748 learned_addr learned my addr 172.21.15.164:0/1285396748 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:08.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.932+0000 7fdfb77fe640 1 -- 172.21.15.164:0/1285396748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb81a5c70 con 0x7fdfb8073290 2024-09-13T23:05:08.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.932+0000 7fdfb77fe640 1 --2- 172.21.15.164:0/1285396748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfb8073290 0x7fdfb81a5730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8035040 tx=0x7fdfa80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:08.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.932+0000 7fdfb4ff9640 1 -- 172.21.15.164:0/1285396748 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfa8041070 con 0x7fdfb8073290 2024-09-13T23:05:08.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.932+0000 7fdfb4ff9640 1 -- 172.21.15.164:0/1285396748 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa803c7a0 con 0x7fdfb8073290 2024-09-13T23:05:08.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.932+0000 7fdfbe1db640 1 -- 172.21.15.164:0/1285396748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfb81a5ea0 con 0x7fdfb8073290 2024-09-13T23:05:08.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.932+0000 7fdfb4ff9640 1 -- 172.21.15.164:0/1285396748 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfa8037040 con 0x7fdfb8073290 2024-09-13T23:05:08.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.932+0000 7fdfbe1db640 1 -- 172.21.15.164:0/1285396748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfb81a6310 con 0x7fdfb8073290 2024-09-13T23:05:08.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.933+0000 7fdfb4ff9640 1 -- 172.21.15.164:0/1285396748 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdfa8044070 con 0x7fdfb8073290 2024-09-13T23:05:08.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.933+0000 7fdfbe1db640 1 -- 172.21.15.164:0/1285396748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfb8118110 con 0x7fdfb8073290 2024-09-13T23:05:08.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.933+0000 7fdfb4ff9640 1 --2- 172.21.15.164:0/1285396748 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdf98038250 0x7fdf9803a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:08.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.933+0000 7fdfb4ff9640 1 -- 172.21.15.164:0/1285396748 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3825+0+0 (secure 0 0 0) 0x7fdfa806bfe0 con 0x7fdfb8073290 2024-09-13T23:05:08.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.933+0000 7fdfaffff640 1 --2- 172.21.15.164:0/1285396748 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdf98038250 0x7fdf9803a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:08.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.934+0000 7fdfaffff640 1 --2- 172.21.15.164:0/1285396748 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdf98038250 0x7fdf9803a710 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00015f0 tx=0x7fdfa0007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:08.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:08.938+0000 7fdfb4ff9640 1 -- 172.21.15.164:0/1285396748 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdfa806ad70 con 0x7fdfb8073290 2024-09-13T23:05:09.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:09.104+0000 7fdfbe1db640 1 -- 172.21.15.164:0/1285396748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7fdfb8117b80 con 0x7fdfb8073290 2024-09-13T23:05:11.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.086+0000 7fdfb4ff9640 1 -- 172.21.15.164:0/1285396748 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v20) ==== 227+0+0 (secure 0 0 0) 0x7fdfa803a520 con 0x7fdfb8073290 2024-09-13T23:05:11.087 INFO:teuthology.orchestra.run.smithi164.stderr:pool 'default.rgw.buckets.data' created 2024-09-13T23:05:11.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.090+0000 7fdfbe1db640 1 -- 172.21.15.164:0/1285396748 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdf98038250 msgr2=0x7fdf9803a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:11.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.090+0000 7fdfbe1db640 1 --2- 172.21.15.164:0/1285396748 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdf98038250 0x7fdf9803a710 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00015f0 tx=0x7fdfa0007a40 comp rx=0 tx=0).stop 2024-09-13T23:05:11.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.090+0000 7fdfbe1db640 1 -- 172.21.15.164:0/1285396748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfb8073290 msgr2=0x7fdfb81a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:11.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.090+0000 7fdfbe1db640 1 --2- 172.21.15.164:0/1285396748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfb8073290 0x7fdfb81a5730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8035040 tx=0x7fdfa80046c0 comp rx=0 tx=0).stop 2024-09-13T23:05:11.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.090+0000 7fdfbe1db640 1 -- 172.21.15.164:0/1285396748 shutdown_connections 2024-09-13T23:05:11.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.090+0000 7fdfbe1db640 1 --2- 172.21.15.164:0/1285396748 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdf98038250 0x7fdf9803a710 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:11.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.090+0000 7fdfbe1db640 1 --2- 172.21.15.164:0/1285396748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfb8073290 0x7fdfb81a5730 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:11.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.090+0000 7fdfbe1db640 1 -- 172.21.15.164:0/1285396748 >> 172.21.15.164:0/1285396748 conn(0x7fdfb806f330 msgr2=0x7fdfb81126c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:11.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.091+0000 7fdfbe1db640 1 -- 172.21.15.164:0/1285396748 shutdown_connections 2024-09-13T23:05:11.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.091+0000 7fdfbe1db640 1 -- 172.21.15.164:0/1285396748 wait complete. 2024-09-13T23:05:11.112 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-13T23:05:11.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.216+0000 7f8adc6dd640 1 Processor -- start 2024-09-13T23:05:11.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.216+0000 7f8adc6dd640 1 -- start start 2024-09-13T23:05:11.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.216+0000 7f8adc6dd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8ad410ed80 0x7f8ad410f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:11.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.216+0000 7f8adc6dd640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ad410fb50 con 0x7f8ad410f6a0 2024-09-13T23:05:11.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.216+0000 7f8adc6dd640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f8ad411c830 con 0x7f8ad410ed80 2024-09-13T23:05:11.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.217+0000 7f8ada479640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8ad410ed80 0x7f8ad410f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:11.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.217+0000 7f8ada479640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8ad410ed80 0x7f8ad410f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:38500/0 (socket says 172.21.15.164:38500) 2024-09-13T23:05:11.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.217+0000 7f8ada479640 1 -- 172.21.15.164:0/2822868910 learned_addr learned my addr 172.21.15.164:0/2822868910 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:11.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.217+0000 7f8ad9c78640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f8ad410f6a0 0x7f8ad411a100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:34926/0 (socket says 172.21.15.164:34926) 2024-09-13T23:05:11.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.217+0000 7f8ada479640 1 -- 172.21.15.164:0/2822868910 >> v1:172.21.15.17:6789/0 conn(0x7f8ad410f6a0 legacy=0x7f8ad411a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:11.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.217+0000 7f8ada479640 1 -- 172.21.15.164:0/2822868910 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad411c9b0 con 0x7f8ad410ed80 2024-09-13T23:05:11.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.218+0000 7f8ada479640 1 --2- 172.21.15.164:0/2822868910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ad410ed80 0x7f8ad410f160 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00097f0 tx=0x7f8ad002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b528a47e29eecd6f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:11.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.218+0000 7f8ad9477640 1 -- 172.21.15.164:0/2822868910 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad0037070 con 0x7f8ad410ed80 2024-09-13T23:05:11.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.218+0000 7f8ad9477640 1 -- 172.21.15.164:0/2822868910 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad0032440 con 0x7f8ad410ed80 2024-09-13T23:05:11.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.218+0000 7f8ad9477640 1 -- 172.21.15.164:0/2822868910 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad002ae60 con 0x7f8ad410ed80 2024-09-13T23:05:11.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.219+0000 7f8adc6dd640 1 -- 172.21.15.164:0/2822868910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ad410ed80 msgr2=0x7f8ad410f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:11.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.219+0000 7f8adc6dd640 1 --2- 172.21.15.164:0/2822868910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ad410ed80 0x7f8ad410f160 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00097f0 tx=0x7f8ad002a1e0 comp rx=0 tx=0).stop 2024-09-13T23:05:11.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.219+0000 7f8adc6dd640 1 -- 172.21.15.164:0/2822868910 shutdown_connections 2024-09-13T23:05:11.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.219+0000 7f8adc6dd640 1 --2- 172.21.15.164:0/2822868910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ad410ed80 0x7f8ad410f160 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:11.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.219+0000 7f8adc6dd640 1 -- 172.21.15.164:0/2822868910 >> 172.21.15.164:0/2822868910 conn(0x7f8ad406f300 msgr2=0x7f8ad4071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:11.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.219+0000 7f8adc6dd640 1 -- 172.21.15.164:0/2822868910 shutdown_connections 2024-09-13T23:05:11.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.219+0000 7f8adc6dd640 1 -- 172.21.15.164:0/2822868910 wait complete. 2024-09-13T23:05:11.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.219+0000 7f8adc6dd640 1 Processor -- start 2024-09-13T23:05:11.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.220+0000 7f8adc6dd640 1 -- start start 2024-09-13T23:05:11.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.220+0000 7f8adc6dd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ad410ed80 0x7f8ad410ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:11.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.220+0000 7f8adc6dd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad411bc70 con 0x7f8ad410ed80 2024-09-13T23:05:11.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.220+0000 7f8ada479640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ad410ed80 0x7f8ad410ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:11.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.220+0000 7f8ada479640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ad410ed80 0x7f8ad410ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:38514/0 (socket says 172.21.15.164:38514) 2024-09-13T23:05:11.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.220+0000 7f8ada479640 1 -- 172.21.15.164:0/354779544 learned_addr learned my addr 172.21.15.164:0/354779544 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:11.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.220+0000 7f8ada479640 1 -- 172.21.15.164:0/354779544 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad41104a0 con 0x7f8ad410ed80 2024-09-13T23:05:11.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.221+0000 7f8ada479640 1 --2- 172.21.15.164:0/354779544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ad410ed80 0x7f8ad410ff60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0035040 tx=0x7f8ad00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:11.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.221+0000 7f8acaffd640 1 -- 172.21.15.164:0/354779544 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad0041070 con 0x7f8ad410ed80 2024-09-13T23:05:11.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.221+0000 7f8acaffd640 1 -- 172.21.15.164:0/354779544 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad003c7a0 con 0x7f8ad410ed80 2024-09-13T23:05:11.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.221+0000 7f8acaffd640 1 -- 172.21.15.164:0/354779544 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad0037040 con 0x7f8ad410ed80 2024-09-13T23:05:11.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.221+0000 7f8adc6dd640 1 -- 172.21.15.164:0/354779544 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ad4110730 con 0x7f8ad410ed80 2024-09-13T23:05:11.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.221+0000 7f8adc6dd640 1 -- 172.21.15.164:0/354779544 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ad4110c80 con 0x7f8ad410ed80 2024-09-13T23:05:11.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.222+0000 7f8adc6dd640 1 -- 172.21.15.164:0/354779544 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ad410f160 con 0x7f8ad410ed80 2024-09-13T23:05:11.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.222+0000 7f8acaffd640 1 -- 172.21.15.164:0/354779544 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8ad0044070 con 0x7f8ad410ed80 2024-09-13T23:05:11.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.222+0000 7f8acaffd640 1 --2- 172.21.15.164:0/354779544 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8ab8038250 0x7f8ab803a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:11.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.222+0000 7f8acaffd640 1 -- 172.21.15.164:0/354779544 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4272+0+0 (secure 0 0 0) 0x7f8ad006c120 con 0x7f8ad410ed80 2024-09-13T23:05:11.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.222+0000 7f8ad9c78640 1 --2- 172.21.15.164:0/354779544 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8ab8038250 0x7f8ab803a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:11.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.222+0000 7f8ad9c78640 1 --2- 172.21.15.164:0/354779544 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8ab8038250 0x7f8ab803a710 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40015f0 tx=0x7f8ac4007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:11.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.227+0000 7f8acaffd640 1 -- 172.21.15.164:0/354779544 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8ad00307c0 con 0x7f8ad410ed80 2024-09-13T23:05:11.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:11.394+0000 7f8adc6dd640 1 -- 172.21.15.164:0/354779544 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f8ad410f6a0 con 0x7f8ad410ed80 2024-09-13T23:05:12.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.092+0000 7f8acaffd640 1 -- 172.21.15.164:0/354779544 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v21) ==== 185+0+0 (secure 0 0 0) 0x7f8ad003d3f0 con 0x7f8ad410ed80 2024-09-13T23:05:12.093 INFO:teuthology.orchestra.run.smithi164.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-13T23:05:12.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.102+0000 7f8adc6dd640 1 -- 172.21.15.164:0/354779544 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8ab8038250 msgr2=0x7f8ab803a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:12.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.102+0000 7f8adc6dd640 1 --2- 172.21.15.164:0/354779544 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8ab8038250 0x7f8ab803a710 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40015f0 tx=0x7f8ac4007a40 comp rx=0 tx=0).stop 2024-09-13T23:05:12.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.102+0000 7f8adc6dd640 1 -- 172.21.15.164:0/354779544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ad410ed80 msgr2=0x7f8ad410ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:12.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.102+0000 7f8adc6dd640 1 --2- 172.21.15.164:0/354779544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ad410ed80 0x7f8ad410ff60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0035040 tx=0x7f8ad00046c0 comp rx=0 tx=0).stop 2024-09-13T23:05:12.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.103+0000 7f8adc6dd640 1 -- 172.21.15.164:0/354779544 shutdown_connections 2024-09-13T23:05:12.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.103+0000 7f8adc6dd640 1 --2- 172.21.15.164:0/354779544 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8ab8038250 0x7f8ab803a710 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:12.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.103+0000 7f8adc6dd640 1 --2- 172.21.15.164:0/354779544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ad410ed80 0x7f8ad410ff60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:12.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.103+0000 7f8adc6dd640 1 -- 172.21.15.164:0/354779544 >> 172.21.15.164:0/354779544 conn(0x7f8ad406f300 msgr2=0x7f8ad4117680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:12.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.106+0000 7f8adc6dd640 1 -- 172.21.15.164:0/354779544 shutdown_connections 2024-09-13T23:05:12.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.106+0000 7f8adc6dd640 1 -- 172.21.15.164:0/354779544 wait complete. 2024-09-13T23:05:12.130 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-13T23:05:12.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.240+0000 7ff42636c640 1 Processor -- start 2024-09-13T23:05:12.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.240+0000 7ff42636c640 1 -- start start 2024-09-13T23:05:12.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.240+0000 7ff42636c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff420117a50 0x7ff420119e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:12.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.240+0000 7ff42636c640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff42011a380 con 0x7ff420114c40 2024-09-13T23:05:12.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.240+0000 7ff42636c640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7ff42011b560 con 0x7ff420117a50 2024-09-13T23:05:12.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.240+0000 7ff41f7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff420117a50 0x7ff420119e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:12.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.240+0000 7ff41f7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff420117a50 0x7ff420119e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:38516/0 (socket says 172.21.15.164:38516) 2024-09-13T23:05:12.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.240+0000 7ff41ffff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff420114c40 0x7ff420115020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:34930/0 (socket says 172.21.15.164:34930) 2024-09-13T23:05:12.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.240+0000 7ff41f7fe640 1 -- 172.21.15.164:0/2899389067 learned_addr learned my addr 172.21.15.164:0/2899389067 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:12.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.241+0000 7ff41f7fe640 1 -- 172.21.15.164:0/2899389067 >> v1:172.21.15.17:6789/0 conn(0x7ff420114c40 legacy=0x7ff420115020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:12.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.241+0000 7ff41f7fe640 1 -- 172.21.15.164:0/2899389067 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff42011b6e0 con 0x7ff420117a50 2024-09-13T23:05:12.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.241+0000 7ff41f7fe640 1 --2- 172.21.15.164:0/2899389067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff420117a50 0x7ff420119e40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff4140097f0 tx=0x7ff41402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7503855ea045a916 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:12.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.242+0000 7ff41effd640 1 -- 172.21.15.164:0/2899389067 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff414037070 con 0x7ff420117a50 2024-09-13T23:05:12.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.242+0000 7ff41effd640 1 -- 172.21.15.164:0/2899389067 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff414032440 con 0x7ff420117a50 2024-09-13T23:05:12.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.242+0000 7ff41effd640 1 -- 172.21.15.164:0/2899389067 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff41402ae60 con 0x7ff420117a50 2024-09-13T23:05:12.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.242+0000 7ff42636c640 1 -- 172.21.15.164:0/2899389067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff420117a50 msgr2=0x7ff420119e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:12.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.242+0000 7ff42636c640 1 --2- 172.21.15.164:0/2899389067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff420117a50 0x7ff420119e40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff4140097f0 tx=0x7ff41402a1e0 comp rx=0 tx=0).stop 2024-09-13T23:05:12.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.242+0000 7ff42636c640 1 -- 172.21.15.164:0/2899389067 shutdown_connections 2024-09-13T23:05:12.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.242+0000 7ff42636c640 1 --2- 172.21.15.164:0/2899389067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff420117a50 0x7ff420119e40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:12.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.242+0000 7ff42636c640 1 -- 172.21.15.164:0/2899389067 >> 172.21.15.164:0/2899389067 conn(0x7ff42006f300 msgr2=0x7ff420071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:12.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.242+0000 7ff42636c640 1 -- 172.21.15.164:0/2899389067 shutdown_connections 2024-09-13T23:05:12.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.242+0000 7ff42636c640 1 -- 172.21.15.164:0/2899389067 wait complete. 2024-09-13T23:05:12.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.243+0000 7ff42636c640 1 Processor -- start 2024-09-13T23:05:12.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.243+0000 7ff42636c640 1 -- start start 2024-09-13T23:05:12.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.243+0000 7ff42636c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff420114c40 0x7ff4201a56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:12.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.243+0000 7ff42636c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff42011aa70 con 0x7ff420114c40 2024-09-13T23:05:12.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.243+0000 7ff41ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff420114c40 0x7ff4201a56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:12.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.244+0000 7ff41ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff420114c40 0x7ff4201a56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:38528/0 (socket says 172.21.15.164:38528) 2024-09-13T23:05:12.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.244+0000 7ff41ffff640 1 -- 172.21.15.164:0/1348793979 learned_addr learned my addr 172.21.15.164:0/1348793979 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:12.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.244+0000 7ff41ffff640 1 -- 172.21.15.164:0/1348793979 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4201a5bf0 con 0x7ff420114c40 2024-09-13T23:05:12.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.244+0000 7ff41ffff640 1 --2- 172.21.15.164:0/1348793979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff420114c40 0x7ff4201a56b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff41000c450 tx=0x7ff41000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:12.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.244+0000 7ff41cff9640 1 -- 172.21.15.164:0/1348793979 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff410007410 con 0x7ff420114c40 2024-09-13T23:05:12.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.244+0000 7ff41cff9640 1 -- 172.21.15.164:0/1348793979 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4100075b0 con 0x7ff420114c40 2024-09-13T23:05:12.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.244+0000 7ff41cff9640 1 -- 172.21.15.164:0/1348793979 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff410004910 con 0x7ff420114c40 2024-09-13T23:05:12.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.244+0000 7ff42636c640 1 -- 172.21.15.164:0/1348793979 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4201a5e80 con 0x7ff420114c40 2024-09-13T23:05:12.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.244+0000 7ff42636c640 1 -- 172.21.15.164:0/1348793979 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4201a63d0 con 0x7ff420114c40 2024-09-13T23:05:12.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.245+0000 7ff41cff9640 1 -- 172.21.15.164:0/1348793979 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff41001a020 con 0x7ff420114c40 2024-09-13T23:05:12.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.245+0000 7ff42636c640 1 -- 172.21.15.164:0/1348793979 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff42011afb0 con 0x7ff420114c40 2024-09-13T23:05:12.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.245+0000 7ff41cff9640 1 --2- 172.21.15.164:0/1348793979 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ff40c0382a0 0x7ff40c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:12.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.245+0000 7ff41cff9640 1 -- 172.21.15.164:0/1348793979 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 4283+0+0 (secure 0 0 0) 0x7ff41004add0 con 0x7ff420114c40 2024-09-13T23:05:12.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.246+0000 7ff41f7fe640 1 --2- 172.21.15.164:0/1348793979 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ff40c0382a0 0x7ff40c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:12.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.246+0000 7ff41f7fe640 1 --2- 172.21.15.164:0/1348793979 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ff40c0382a0 0x7ff40c03a760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff414034000 tx=0x7ff41402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:12.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.250+0000 7ff41cff9640 1 -- 172.21.15.164:0/1348793979 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff41004e030 con 0x7ff420114c40 2024-09-13T23:05:12.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:12.415+0000 7ff42636c640 1 -- 172.21.15.164:0/1348793979 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7ff420117a50 con 0x7ff420114c40 2024-09-13T23:05:13.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.094+0000 7ff41cff9640 1 -- 172.21.15.164:0/1348793979 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v22) ==== 169+0+0 (secure 0 0 0) 0x7ff4100499c0 con 0x7ff420114c40 2024-09-13T23:05:13.094 INFO:teuthology.orchestra.run.smithi164.stderr:pool 'default.rgw.buckets.index' created 2024-09-13T23:05:13.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.098+0000 7ff42636c640 1 -- 172.21.15.164:0/1348793979 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ff40c0382a0 msgr2=0x7ff40c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:13.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.098+0000 7ff42636c640 1 --2- 172.21.15.164:0/1348793979 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ff40c0382a0 0x7ff40c03a760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff414034000 tx=0x7ff41402e000 comp rx=0 tx=0).stop 2024-09-13T23:05:13.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.098+0000 7ff42636c640 1 -- 172.21.15.164:0/1348793979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff420114c40 msgr2=0x7ff4201a56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:13.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.098+0000 7ff42636c640 1 --2- 172.21.15.164:0/1348793979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff420114c40 0x7ff4201a56b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff41000c450 tx=0x7ff41000c910 comp rx=0 tx=0).stop 2024-09-13T23:05:13.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.098+0000 7ff42636c640 1 -- 172.21.15.164:0/1348793979 shutdown_connections 2024-09-13T23:05:13.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.098+0000 7ff42636c640 1 --2- 172.21.15.164:0/1348793979 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ff40c0382a0 0x7ff40c03a760 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:13.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.098+0000 7ff42636c640 1 --2- 172.21.15.164:0/1348793979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff420114c40 0x7ff4201a56b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:13.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.098+0000 7ff42636c640 1 -- 172.21.15.164:0/1348793979 >> 172.21.15.164:0/1348793979 conn(0x7ff42006f300 msgr2=0x7ff420117e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:13.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.098+0000 7ff42636c640 1 -- 172.21.15.164:0/1348793979 shutdown_connections 2024-09-13T23:05:13.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.098+0000 7ff42636c640 1 -- 172.21.15.164:0/1348793979 wait complete. 2024-09-13T23:05:13.117 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-13T23:05:13.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.219+0000 7efc09f4b640 1 Processor -- start 2024-09-13T23:05:13.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.219+0000 7efc09f4b640 1 -- start start 2024-09-13T23:05:13.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.219+0000 7efc09f4b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7efc04117fe0 0x7efc041183c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:13.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.219+0000 7efc09f4b640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc04118a50 con 0x7efc04111da0 2024-09-13T23:05:13.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.219+0000 7efc09f4b640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7efc04112960 con 0x7efc04117fe0 2024-09-13T23:05:13.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.220+0000 7efc037fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7efc04117fe0 0x7efc041183c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:13.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.220+0000 7efc02ffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7efc04111da0 0x7efc04112250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:34940/0 (socket says 172.21.15.164:34940) 2024-09-13T23:05:13.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.220+0000 7efc02ffd640 1 -- 172.21.15.164:0/2515245704 learned_addr learned my addr 172.21.15.164:0/2515245704 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:13.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.220+0000 7efc027fc640 1 -- 172.21.15.164:0/2515245704 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2552776538 0 0) 0x7efc04118a50 con 0x7efc04111da0 2024-09-13T23:05:13.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.220+0000 7efc027fc640 1 -- 172.21.15.164:0/2515245704 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efbec003520 con 0x7efc04111da0 2024-09-13T23:05:13.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.220+0000 7efc037fe640 1 -- 172.21.15.164:0/2515245704 >> v1:172.21.15.17:6789/0 conn(0x7efc04111da0 legacy=0x7efc04112250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:13.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.220+0000 7efc037fe640 1 -- 172.21.15.164:0/2515245704 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc04112b10 con 0x7efc04117fe0 2024-09-13T23:05:13.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.221+0000 7efc037fe640 1 --2- 172.21.15.164:0/2515245704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc04117fe0 0x7efc041183c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efbf4009d90 tx=0x7efbf402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=102b0593b04a695f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:13.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.221+0000 7efc027fc640 1 -- 172.21.15.164:0/2515245704 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf4007670 con 0x7efc04117fe0 2024-09-13T23:05:13.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.221+0000 7efc027fc640 1 -- 172.21.15.164:0/2515245704 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf4007810 con 0x7efc04117fe0 2024-09-13T23:05:13.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.221+0000 7efc027fc640 1 -- 172.21.15.164:0/2515245704 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf4007af0 con 0x7efc04117fe0 2024-09-13T23:05:13.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.222+0000 7efc09f4b640 1 -- 172.21.15.164:0/2515245704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc04117fe0 msgr2=0x7efc041183c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:13.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.222+0000 7efc09f4b640 1 --2- 172.21.15.164:0/2515245704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc04117fe0 0x7efc041183c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efbf4009d90 tx=0x7efbf402a660 comp rx=0 tx=0).stop 2024-09-13T23:05:13.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.222+0000 7efc09f4b640 1 -- 172.21.15.164:0/2515245704 shutdown_connections 2024-09-13T23:05:13.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.222+0000 7efc09f4b640 1 --2- 172.21.15.164:0/2515245704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc04117fe0 0x7efc041183c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:13.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.222+0000 7efc09f4b640 1 -- 172.21.15.164:0/2515245704 >> 172.21.15.164:0/2515245704 conn(0x7efc0406e680 msgr2=0x7efc0406ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:13.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.222+0000 7efc09f4b640 1 -- 172.21.15.164:0/2515245704 shutdown_connections 2024-09-13T23:05:13.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.222+0000 7efc09f4b640 1 -- 172.21.15.164:0/2515245704 wait complete. 2024-09-13T23:05:13.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.222+0000 7efc09f4b640 1 Processor -- start 2024-09-13T23:05:13.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.223+0000 7efc09f4b640 1 -- start start 2024-09-13T23:05:13.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.223+0000 7efc09f4b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc04111da0 0x7efc041a6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:13.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.223+0000 7efc09f4b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efc0411e1b0 con 0x7efc04111da0 2024-09-13T23:05:13.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.223+0000 7efc037fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc04111da0 0x7efc041a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:13.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.223+0000 7efc037fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc04111da0 0x7efc041a6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:38546/0 (socket says 172.21.15.164:38546) 2024-09-13T23:05:13.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.223+0000 7efc037fe640 1 -- 172.21.15.164:0/2655392187 learned_addr learned my addr 172.21.15.164:0/2655392187 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:13.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.224+0000 7efc037fe640 1 -- 172.21.15.164:0/2655392187 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc041a6f50 con 0x7efc04111da0 2024-09-13T23:05:13.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.224+0000 7efc037fe640 1 --2- 172.21.15.164:0/2655392187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc04111da0 0x7efc041a6980 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efbf4009d90 tx=0x7efbf4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:13.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.224+0000 7efbebfff640 1 -- 172.21.15.164:0/2655392187 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf4040070 con 0x7efc04111da0 2024-09-13T23:05:13.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.224+0000 7efbebfff640 1 -- 172.21.15.164:0/2655392187 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf4007ce0 con 0x7efc04111da0 2024-09-13T23:05:13.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.224+0000 7efc09f4b640 1 -- 172.21.15.164:0/2655392187 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc041a7240 con 0x7efc04111da0 2024-09-13T23:05:13.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.224+0000 7efbebfff640 1 -- 172.21.15.164:0/2655392187 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf4007670 con 0x7efc04111da0 2024-09-13T23:05:13.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.224+0000 7efc09f4b640 1 -- 172.21.15.164:0/2655392187 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc041ab290 con 0x7efc04111da0 2024-09-13T23:05:13.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.225+0000 7efc09f4b640 1 -- 172.21.15.164:0/2655392187 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc04118440 con 0x7efc04111da0 2024-09-13T23:05:13.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.225+0000 7efbebfff640 1 -- 172.21.15.164:0/2655392187 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7efbf4039040 con 0x7efc04111da0 2024-09-13T23:05:13.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.225+0000 7efbebfff640 1 --2- 172.21.15.164:0/2655392187 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efbf0038250 0x7efbf003a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:13.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.225+0000 7efbebfff640 1 -- 172.21.15.164:0/2655392187 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 4647+0+0 (secure 0 0 0) 0x7efbf402ae00 con 0x7efc04111da0 2024-09-13T23:05:13.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.225+0000 7efc02ffd640 1 --2- 172.21.15.164:0/2655392187 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efbf0038250 0x7efbf003a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:13.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.226+0000 7efc02ffd640 1 --2- 172.21.15.164:0/2655392187 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efbf0038250 0x7efbf003a710 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efbf8007fd0 tx=0x7efbf80010a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:13.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.231+0000 7efbebfff640 1 -- 172.21.15.164:0/2655392187 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efbf403a3b0 con 0x7efc04111da0 2024-09-13T23:05:13.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:13.396+0000 7efc09f4b640 1 -- 172.21.15.164:0/2655392187 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7efc041a7410 con 0x7efc04111da0 2024-09-13T23:05:14.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:14.099+0000 7efbebfff640 1 -- 172.21.15.164:0/2655392187 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v23) ==== 187+0+0 (secure 0 0 0) 0x7efbf403a590 con 0x7efc04111da0 2024-09-13T23:05:14.100 INFO:teuthology.orchestra.run.smithi164.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-13T23:05:14.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:14.103+0000 7efc09f4b640 1 -- 172.21.15.164:0/2655392187 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efbf0038250 msgr2=0x7efbf003a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:14.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:14.103+0000 7efc09f4b640 1 --2- 172.21.15.164:0/2655392187 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efbf0038250 0x7efbf003a710 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efbf8007fd0 tx=0x7efbf80010a0 comp rx=0 tx=0).stop 2024-09-13T23:05:14.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:14.103+0000 7efc09f4b640 1 -- 172.21.15.164:0/2655392187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc04111da0 msgr2=0x7efc041a6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:14.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:14.103+0000 7efc09f4b640 1 --2- 172.21.15.164:0/2655392187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc04111da0 0x7efc041a6980 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efbf4009d90 tx=0x7efbf4004a40 comp rx=0 tx=0).stop 2024-09-13T23:05:14.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:14.107+0000 7efc09f4b640 1 -- 172.21.15.164:0/2655392187 shutdown_connections 2024-09-13T23:05:14.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:14.107+0000 7efc09f4b640 1 --2- 172.21.15.164:0/2655392187 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efbf0038250 0x7efbf003a710 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:14.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:14.107+0000 7efc09f4b640 1 --2- 172.21.15.164:0/2655392187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc04111da0 0x7efc041a6980 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:14.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:14.107+0000 7efc09f4b640 1 -- 172.21.15.164:0/2655392187 >> 172.21.15.164:0/2655392187 conn(0x7efc0406e680 msgr2=0x7efc04113df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:14.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:14.109+0000 7efc09f4b640 1 -- 172.21.15.164:0/2655392187 shutdown_connections 2024-09-13T23:05:14.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:14.110+0000 7efc09f4b640 1 -- 172.21.15.164:0/2655392187 wait complete. 2024-09-13T23:05:14.131 DEBUG:tasks.rgw:Pools created 2024-09-13T23:05:14.131 INFO:tasks.rgw:Starting rgw... 2024-09-13T23:05:14.131 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-13T23:05:14.131 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-13T23:05:14.131 DEBUG:teuthology.orchestra.run.smithi164:> sudo echo -n http://smithi164.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-13T23:05:14.157 INFO:teuthology.orchestra.run.smithi164.stdout:http://smithi164.front.sepia.ceph.com:80 2024-09-13T23:05:14.158 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-13T23:05:14.223 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-13T23:05:14.223 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-13T23:05:14.266 INFO:tasks.rgw.client.0:Started 2024-09-13T23:05:14.266 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi164.front.sepia.ceph.com:80/ 2024-09-13T23:05:14.266 DEBUG:teuthology.orchestra.run.smithi164:> curl http://smithi164.front.sepia.ceph.com:80/ 2024-09-13T23:05:14.291 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T23:05:14.291 INFO:teuthology.orchestra.run.smithi164.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T23:05:14.291 INFO:teuthology.orchestra.run.smithi164.stderr: Dload Upload Total Spent Left Speed 2024-09-13T23:05:14.291 INFO:teuthology.orchestra.run.smithi164.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T23:05:14.292 INFO:teuthology.orchestra.run.smithi164.stderr:curl: (7) Failed to connect to smithi164.front.sepia.ceph.com port 80: Connection refused 2024-09-13T23:05:15.293 DEBUG:teuthology.orchestra.run.smithi164:> curl http://smithi164.front.sepia.ceph.com:80/ 2024-09-13T23:05:15.315 INFO:teuthology.orchestra.run.smithi164.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T23:05:15.315 INFO:teuthology.orchestra.run.smithi164.stderr: Dload Upload Total Spent Left Speed 2024-09-13T23:05:15.315 INFO:teuthology.orchestra.run.smithi164.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T23:05:15.316 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T23:05:15.317 INFO:teuthology.orchestra.run.smithi164.stderr:curl: (7) Failed to connect to smithi164.front.sepia.ceph.com port 80: Connection refused 2024-09-13T23:05:17.319 DEBUG:teuthology.orchestra.run.smithi164:> curl http://smithi164.front.sepia.ceph.com:80/ 2024-09-13T23:05:17.344 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T23:05:17.344 INFO:teuthology.orchestra.run.smithi164.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T23:05:17.344 INFO:teuthology.orchestra.run.smithi164.stderr: Dload Upload Total Spent Left Speed 2024-09-13T23:05:17.344 INFO:teuthology.orchestra.run.smithi164.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T23:05:17.344 INFO:teuthology.orchestra.run.smithi164.stderr:curl: (7) Failed to connect to smithi164.front.sepia.ceph.com port 80: Connection refused 2024-09-13T23:05:21.346 DEBUG:teuthology.orchestra.run.smithi164:> curl http://smithi164.front.sepia.ceph.com:80/ 2024-09-13T23:05:21.369 INFO:teuthology.orchestra.run.smithi164.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T23:05:21.369 INFO:teuthology.orchestra.run.smithi164.stderr: Dload Upload Total Spent Left Speed 2024-09-13T23:05:21.369 INFO:teuthology.orchestra.run.smithi164.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T23:05:21.369 INFO:teuthology.orchestra.run.smithi164.stderr:curl: (7) Failed to connect to smithi164.front.sepia.ceph.com port 80: Connection refused 2024-09-13T23:05:21.370 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T23:05:23.209 INFO:tasks.rgw.client.0.smithi164.stdout:2024-09-13T23:05:23.209+0000 7f436b793880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-09-13T23:05:29.371 DEBUG:teuthology.orchestra.run.smithi164:> curl http://smithi164.front.sepia.ceph.com:80/ 2024-09-13T23:05:29.396 INFO:teuthology.orchestra.run.smithi164.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T23:05:29.396 INFO:teuthology.orchestra.run.smithi164.stderr: Dload Upload Total Spent Left Speed 2024-09-13T23:05:29.397 INFO:teuthology.orchestra.run.smithi164.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 93500 2024-09-13T23:05:29.398 INFO:teuthology.orchestra.run.smithi164.stdout:anonymous 2024-09-13T23:05:29.399 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-13T23:05:29.897 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-13T23:05:29.897 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-13T23:05:29.898 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-13T23:05:29.898 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-13T23:05:29.950 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:29.950 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:29.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.950+0000 7f05e6b33800 1 Processor -- start 2024-09-13T23:05:29.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.950+0000 7f05e6b33800 1 -- start start 2024-09-13T23:05:29.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.951+0000 7f05e6b33800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x56010455d5e0 0x5601045ee680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:29.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.951+0000 7f05e6b33800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5601044a8b30 con 0x5601045eebc0 2024-09-13T23:05:29.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.951+0000 7f05e6b33800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x56010448a360 con 0x56010455d5e0 2024-09-13T23:05:29.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.951+0000 7f05e2824640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x56010455d5e0 0x5601045ee680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:29.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.951+0000 7f05e2824640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x56010455d5e0 0x5601045ee680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55758/0 (socket says 172.21.15.164:55758) 2024-09-13T23:05:29.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.951+0000 7f05e2824640 1 -- 172.21.15.164:0/4136035874 learned_addr learned my addr 172.21.15.164:0/4136035874 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:29.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.951+0000 7f05e2023640 1 --1- 172.21.15.164:0/4136035874 >> v1:172.21.15.17:6789/0 conn(0x5601045eebc0 0x5601045f0fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40660/0 (socket says 172.21.15.164:40660) 2024-09-13T23:05:29.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.951+0000 7f05e2824640 1 -- 172.21.15.164:0/4136035874 >> v1:172.21.15.17:6789/0 conn(0x5601045eebc0 legacy=0x5601045f0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:29.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.952+0000 7f05e2824640 1 -- 172.21.15.164:0/4136035874 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601044b0e00 con 0x56010455d5e0 2024-09-13T23:05:29.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.953+0000 7f05e2824640 1 --2- 172.21.15.164:0/4136035874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56010455d5e0 0x5601045ee680 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f05d4005fd0 tx=0x7f05d4045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6edf52ded3f7cb6f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:29.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.954+0000 7f05e1822640 1 -- 172.21.15.164:0/4136035874 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d404e600 con 0x56010455d5e0 2024-09-13T23:05:29.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.954+0000 7f05e1822640 1 -- 172.21.15.164:0/4136035874 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d404e7a0 con 0x56010455d5e0 2024-09-13T23:05:29.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.954+0000 7f05e1822640 1 -- 172.21.15.164:0/4136035874 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d404eaa0 con 0x56010455d5e0 2024-09-13T23:05:29.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.954+0000 7f05e6b33800 1 -- 172.21.15.164:0/4136035874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56010455d5e0 msgr2=0x5601045ee680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:29.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.954+0000 7f05e6b33800 1 --2- 172.21.15.164:0/4136035874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56010455d5e0 0x5601045ee680 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f05d4005fd0 tx=0x7f05d4045cf0 comp rx=0 tx=0).stop 2024-09-13T23:05:29.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.954+0000 7f05e6b33800 1 -- 172.21.15.164:0/4136035874 shutdown_connections 2024-09-13T23:05:29.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.954+0000 7f05e6b33800 1 --2- 172.21.15.164:0/4136035874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56010455d5e0 0x5601045ee680 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:29.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.954+0000 7f05e6b33800 1 -- 172.21.15.164:0/4136035874 >> 172.21.15.164:0/4136035874 conn(0x5601045e3dd0 msgr2=0x5601045e61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:29.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.954+0000 7f05e6b33800 1 -- 172.21.15.164:0/4136035874 shutdown_connections 2024-09-13T23:05:29.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.954+0000 7f05e6b33800 1 -- 172.21.15.164:0/4136035874 wait complete. 2024-09-13T23:05:29.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.970+0000 7f05e6b33800 1 Processor -- start 2024-09-13T23:05:29.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.970+0000 7f05e6b33800 1 -- start start 2024-09-13T23:05:29.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.970+0000 7f05e6b33800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56010455d5e0 0x5601046daa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:29.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.970+0000 7f05e6b33800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560104535320 con 0x56010455d5e0 2024-09-13T23:05:29.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.971+0000 7f05e2824640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56010455d5e0 0x5601046daa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:29.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.971+0000 7f05e2824640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56010455d5e0 0x5601046daa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55772/0 (socket says 172.21.15.164:55772) 2024-09-13T23:05:29.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.971+0000 7f05e2824640 1 -- 172.21.15.164:0/346957268 learned_addr learned my addr 172.21.15.164:0/346957268 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:29.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.971+0000 7f05e2824640 1 -- 172.21.15.164:0/346957268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560104482bc0 con 0x56010455d5e0 2024-09-13T23:05:29.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.971+0000 7f05e2824640 1 --2- 172.21.15.164:0/346957268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56010455d5e0 0x5601046daa60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f05d4045d30 tx=0x7f05d4050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe9c913f37995229 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:29.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.972+0000 7f04d0e09640 1 -- 172.21.15.164:0/346957268 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d404eb40 con 0x56010455d5e0 2024-09-13T23:05:29.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.972+0000 7f04d0e09640 1 -- 172.21.15.164:0/346957268 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d405c040 con 0x56010455d5e0 2024-09-13T23:05:29.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.972+0000 7f04d0e09640 1 -- 172.21.15.164:0/346957268 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d404ee10 con 0x56010455d5e0 2024-09-13T23:05:29.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.972+0000 7f05e6b33800 1 -- 172.21.15.164:0/346957268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56010455d5e0 msgr2=0x5601046daa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:29.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.972+0000 7f05e6b33800 1 --2- 172.21.15.164:0/346957268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56010455d5e0 0x5601046daa60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f05d4045d30 tx=0x7f05d4050000 comp rx=0 tx=0).stop 2024-09-13T23:05:29.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.972+0000 7f05e6b33800 1 -- 172.21.15.164:0/346957268 shutdown_connections 2024-09-13T23:05:29.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.972+0000 7f05e6b33800 1 --2- 172.21.15.164:0/346957268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56010455d5e0 0x5601046daa60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:29.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.972+0000 7f05e6b33800 1 -- 172.21.15.164:0/346957268 >> 172.21.15.164:0/346957268 conn(0x5601045e3dd0 msgr2=0x5601046d6420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:29.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.973+0000 7f05e6b33800 1 -- 172.21.15.164:0/346957268 shutdown_connections 2024-09-13T23:05:29.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.973+0000 7f05e6b33800 1 -- 172.21.15.164:0/346957268 wait complete. 2024-09-13T23:05:29.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.973+0000 7f05e6b33800 1 Processor -- start 2024-09-13T23:05:29.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.973+0000 7f05e6b33800 1 -- start start 2024-09-13T23:05:29.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.973+0000 7f05e6b33800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56010455d5e0 0x5601046e23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:29.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.973+0000 7f05e6b33800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5601045f2970 con 0x56010455d5e0 2024-09-13T23:05:29.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.973+0000 7f05e2824640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56010455d5e0 0x5601046e23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:29.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.973+0000 7f05e2824640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56010455d5e0 0x5601046e23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55786/0 (socket says 172.21.15.164:55786) 2024-09-13T23:05:29.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.973+0000 7f05e2824640 1 -- 172.21.15.164:0/3691514235 learned_addr learned my addr 172.21.15.164:0/3691514235 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:29.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.974+0000 7f05e2824640 1 -- 172.21.15.164:0/3691514235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560104496fe0 con 0x56010455d5e0 2024-09-13T23:05:29.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.974+0000 7f05e2824640 1 --2- 172.21.15.164:0/3691514235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56010455d5e0 0x5601046e23d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f05d4045d30 tx=0x7f05d4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:29.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.974+0000 7f04cf606640 1 -- 172.21.15.164:0/3691514235 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d4061420 con 0x56010455d5e0 2024-09-13T23:05:29.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.974+0000 7f04cf606640 1 -- 172.21.15.164:0/3691514235 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d4070070 con 0x56010455d5e0 2024-09-13T23:05:29.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.974+0000 7f05e6b33800 1 -- 172.21.15.164:0/3691514235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601046e2910 con 0x56010455d5e0 2024-09-13T23:05:29.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.974+0000 7f04cf606640 1 -- 172.21.15.164:0/3691514235 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d40616f0 con 0x56010455d5e0 2024-09-13T23:05:29.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.974+0000 7f05e6b33800 1 -- 172.21.15.164:0/3691514235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601046e2db0 con 0x56010455d5e0 2024-09-13T23:05:29.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.975+0000 7f04cf606640 1 -- 172.21.15.164:0/3691514235 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f05d4061890 con 0x56010455d5e0 2024-09-13T23:05:29.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.976+0000 7f04cf606640 1 --2- 172.21.15.164:0/3691514235 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f04c8036b90 0x7f04c8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:29.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.976+0000 7f04cf606640 1 -- 172.21.15.164:0/3691514235 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f05d4066070 con 0x56010455d5e0 2024-09-13T23:05:29.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.976+0000 7f05e2023640 1 --2- 172.21.15.164:0/3691514235 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f04c8036b90 0x7f04c8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:29.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.976+0000 7f05e6b33800 1 --2- 172.21.15.164:0/3691514235 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5601045eebc0 0x5601046e9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:29.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.976+0000 7f05e6b33800 1 -- 172.21.15.164:0/3691514235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601046e98e0 con 0x5601045eebc0 2024-09-13T23:05:29.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.976+0000 7f05e3025640 1 --2- 172.21.15.164:0/3691514235 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5601045eebc0 0x5601046e9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:29.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.976+0000 7f05e2023640 1 --2- 172.21.15.164:0/3691514235 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f04c8036b90 0x7f04c8039050 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f05d8000f60 tx=0x7f05d8001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:29.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.976+0000 7f05e3025640 1 --2- 172.21.15.164:0/3691514235 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5601045eebc0 0x5601046e9310 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:29.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.976+0000 7f05e3025640 1 -- 172.21.15.164:0/3691514235 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05dc0083e0 con 0x5601045eebc0 2024-09-13T23:05:29.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.977+0000 7f05e6b33800 1 -- 172.21.15.164:0/3691514235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601046e69f0 con 0x5601045eebc0 2024-09-13T23:05:29.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.977+0000 7f05e3025640 1 -- 172.21.15.164:0/3691514235 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f05dc0083e0 con 0x5601045eebc0 2024-09-13T23:05:29.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.977+0000 7f05e6b33800 1 -- 172.21.15.164:0/3691514235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601046eb700 con 0x5601045eebc0 2024-09-13T23:05:29.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.977+0000 7f05e3025640 1 -- 172.21.15.164:0/3691514235 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f05dc0083e0 con 0x5601045eebc0 2024-09-13T23:05:29.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.977+0000 7f05e6b33800 1 -- 172.21.15.164:0/3691514235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601046ea930 con 0x5601045eebc0 2024-09-13T23:05:29.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.977+0000 7f05e3025640 1 -- 172.21.15.164:0/3691514235 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f05dc0083e0 con 0x5601045eebc0 2024-09-13T23:05:29.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.978+0000 7f05e6b33800 1 -- 172.21.15.164:0/3691514235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601046ead20 con 0x5601045eebc0 2024-09-13T23:05:29.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.978+0000 7f05e3025640 1 -- 172.21.15.164:0/3691514235 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f05dc0083e0 con 0x5601045eebc0 2024-09-13T23:05:29.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.978+0000 7f05e6b33800 1 Processor -- start 2024-09-13T23:05:29.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.978+0000 7f05e6b33800 1 -- start start 2024-09-13T23:05:29.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.978+0000 7f05e6b33800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601046f9d40 0x5601046fa160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:29.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.978+0000 7f05e6b33800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560104484580 con 0x5601046f9d40 2024-09-13T23:05:29.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.979+0000 7f05e2023640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601046f9d40 0x5601046fa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:29.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.979+0000 7f05e2023640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601046f9d40 0x5601046fa160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55798/0 (socket says 172.21.15.164:55798) 2024-09-13T23:05:29.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.979+0000 7f05e2023640 1 -- 172.21.15.164:0/1937685916 learned_addr learned my addr 172.21.15.164:0/1937685916 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:29.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.979+0000 7f05e2023640 1 -- 172.21.15.164:0/1937685916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601046fa6a0 con 0x5601046f9d40 2024-09-13T23:05:29.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.979+0000 7f05e2023640 1 --2- 172.21.15.164:0/1937685916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601046f9d40 0x5601046fa160 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f05d8001ed0 tx=0x7f05d800ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:29.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.980+0000 7f04cce01640 1 -- 172.21.15.164:0/1937685916 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d8022070 con 0x5601046f9d40 2024-09-13T23:05:29.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.980+0000 7f04cce01640 1 -- 172.21.15.164:0/1937685916 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d800d520 con 0x5601046f9d40 2024-09-13T23:05:29.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.980+0000 7f05e6b33800 1 -- 172.21.15.164:0/1937685916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601046fa930 con 0x5601046f9d40 2024-09-13T23:05:29.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.980+0000 7f04cce01640 1 -- 172.21.15.164:0/1937685916 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d800d800 con 0x5601046f9d40 2024-09-13T23:05:29.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.980+0000 7f05e6b33800 1 -- 172.21.15.164:0/1937685916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601046fd610 con 0x5601046f9d40 2024-09-13T23:05:29.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.980+0000 7f04cce01640 1 -- 172.21.15.164:0/1937685916 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f05d8025070 con 0x5601046f9d40 2024-09-13T23:05:29.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.981+0000 7f04cce01640 1 --2- 172.21.15.164:0/1937685916 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f04bc036b90 0x7f04bc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:29.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.981+0000 7f04cce01640 1 -- 172.21.15.164:0/1937685916 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f05d804e080 con 0x5601046f9d40 2024-09-13T23:05:29.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.981+0000 7f05e3025640 1 --2- 172.21.15.164:0/1937685916 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f04bc036b90 0x7f04bc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:29.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.981+0000 7f05e6b33800 1 Processor -- start 2024-09-13T23:05:29.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.981+0000 7f05e3025640 1 --2- 172.21.15.164:0/1937685916 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f04bc036b90 0x7f04bc039050 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x5601046ea450 tx=0x7f05dc000f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:29.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.981+0000 7f05e6b33800 1 -- start start 2024-09-13T23:05:29.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.981+0000 7f05e6b33800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560104706a00 0x560104706e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:29.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.981+0000 7f05e6b33800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5601046db150 con 0x560104706a00 2024-09-13T23:05:29.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.982+0000 7f05e2023640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560104706a00 0x560104706e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:29.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.982+0000 7f05e2023640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560104706a00 0x560104706e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55802/0 (socket says 172.21.15.164:55802) 2024-09-13T23:05:29.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.982+0000 7f05e2023640 1 -- 172.21.15.164:0/2669719812 learned_addr learned my addr 172.21.15.164:0/2669719812 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:29.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.982+0000 7f05e2023640 1 -- 172.21.15.164:0/2669719812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601047073d0 con 0x560104706a00 2024-09-13T23:05:29.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.982+0000 7f05e2023640 1 --2- 172.21.15.164:0/2669719812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560104706a00 0x560104706e00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f05d800eee0 tx=0x7f05d8024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4285d46c3663f60d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:29.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.982+0000 7f04c67fc640 1 -- 172.21.15.164:0/2669719812 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d8045070 con 0x560104706a00 2024-09-13T23:05:29.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.982+0000 7f04c67fc640 1 -- 172.21.15.164:0/2669719812 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d8026730 con 0x560104706a00 2024-09-13T23:05:29.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.982+0000 7f04c67fc640 1 -- 172.21.15.164:0/2669719812 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d8025c50 con 0x560104706a00 2024-09-13T23:05:29.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.983+0000 7f05e6b33800 1 -- 172.21.15.164:0/2669719812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560104706a00 msgr2=0x560104706e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:29.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.983+0000 7f05e6b33800 1 --2- 172.21.15.164:0/2669719812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560104706a00 0x560104706e00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f05d800eee0 tx=0x7f05d8024740 comp rx=0 tx=0).stop 2024-09-13T23:05:29.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.983+0000 7f05e6b33800 1 -- 172.21.15.164:0/2669719812 shutdown_connections 2024-09-13T23:05:29.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.983+0000 7f05e6b33800 1 --2- 172.21.15.164:0/2669719812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560104706a00 0x560104706e00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:29.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.983+0000 7f05e6b33800 1 -- 172.21.15.164:0/2669719812 >> 172.21.15.164:0/2669719812 conn(0x560104702d60 msgr2=0x560104700e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:29.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.983+0000 7f05e6b33800 1 -- 172.21.15.164:0/2669719812 shutdown_connections 2024-09-13T23:05:29.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.983+0000 7f05e6b33800 1 -- 172.21.15.164:0/2669719812 wait complete. 2024-09-13T23:05:29.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.983+0000 7f05e6b33800 1 Processor -- start 2024-09-13T23:05:29.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.983+0000 7f05e6b33800 1 -- start start 2024-09-13T23:05:29.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.984+0000 7f05e6b33800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560104706a00 0x56010470dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:29.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.984+0000 7f05e6b33800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560104707950 con 0x560104706a00 2024-09-13T23:05:29.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.984+0000 7f05e2023640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560104706a00 0x56010470dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:29.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.984+0000 7f05e2023640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560104706a00 0x56010470dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55806/0 (socket says 172.21.15.164:55806) 2024-09-13T23:05:29.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.984+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 learned_addr learned my addr 172.21.15.164:0/1442853377 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:29.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.984+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56010470e270 con 0x560104706a00 2024-09-13T23:05:29.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.984+0000 7f05e2023640 1 --2- 172.21.15.164:0/1442853377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560104706a00 0x56010470dd30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f05d804c470 tx=0x7f05d804c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:29.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.984+0000 7f04c4ff9640 1 -- 172.21.15.164:0/1442853377 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d8045070 con 0x560104706a00 2024-09-13T23:05:29.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.984+0000 7f04c4ff9640 1 -- 172.21.15.164:0/1442853377 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d800dbb0 con 0x560104706a00 2024-09-13T23:05:29.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.984+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56010470e270 con 0x560104706a00 2024-09-13T23:05:29.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.984+0000 7f04c4ff9640 1 -- 172.21.15.164:0/1442853377 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d804c780 con 0x560104706a00 2024-09-13T23:05:29.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.985+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56010470e270 con 0x560104706a00 2024-09-13T23:05:29.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.985+0000 7f04c4ff9640 1 -- 172.21.15.164:0/1442853377 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f05d8033070 con 0x560104706a00 2024-09-13T23:05:29.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.986+0000 7f04c4ff9640 1 --2- 172.21.15.164:0/1442853377 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f04ac036b40 0x7f04ac039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:29.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.986+0000 7f04c4ff9640 1 -- 172.21.15.164:0/1442853377 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f05d8037c80 con 0x560104706a00 2024-09-13T23:05:29.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.986+0000 7f05e3025640 1 --2- 172.21.15.164:0/1442853377 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f04ac036b40 0x7f04ac039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:29.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.986+0000 7f05e6b33800 20 rados->read ofs=0 len=0 2024-09-13T23:05:29.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.986+0000 7f05e6b33800 1 --2- 172.21.15.164:0/1442853377 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5601047194b0 0x56010471b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:29.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.986+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56010471c0c0 con 0x5601047194b0 2024-09-13T23:05:29.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.986+0000 7f05e2824640 1 --2- 172.21.15.164:0/1442853377 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5601047194b0 0x56010471b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:29.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.986+0000 7f05e3025640 1 --2- 172.21.15.164:0/1442853377 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f04ac036b40 0x7f04ac039000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00f010 tx=0x7f05dc00c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:29.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.986+0000 7f05e2824640 1 --2- 172.21.15.164:0/1442853377 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5601047194b0 0x56010471b970 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:29.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.987+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:29.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.987+0000 7f05e6b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:29.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.987+0000 7f05e6b33800 20 realm 2024-09-13T23:05:29.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.987+0000 7f05e6b33800 20 rados->read ofs=0 len=0 2024-09-13T23:05:29.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.987+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56010471c4d0 con 0x5601047194b0 2024-09-13T23:05:29.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.987+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:29.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.987+0000 7f05e6b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:29.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.987+0000 7f05e6b33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:29.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.987+0000 7f05e6b33800 20 rados->read ofs=0 len=0 2024-09-13T23:05:29.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.987+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56010471cda0 con 0x5601047194b0 2024-09-13T23:05:29.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.987+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:29.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.987+0000 7f05e6b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:29.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.987+0000 7f05e6b33800 20 rados->read ofs=0 len=0 2024-09-13T23:05:29.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.987+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56010471d140 con 0x5601047194b0 2024-09-13T23:05:29.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.987+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:29.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.987+0000 7f05e6b33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:29.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.987+0000 7f05e6b33800 20 rados->read ofs=0 len=0 2024-09-13T23:05:29.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.987+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x5601047194b0 2024-09-13T23:05:29.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.988+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:29.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.988+0000 7f05e6b33800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:29.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.988+0000 7f05e6b33800 20 searching for the correct realm 2024-09-13T23:05:29.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.988+0000 7f05e6b33800 1 --2- 172.21.15.164:0/1442853377 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x56010471f5f0 0x5601047219e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:29.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.988+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560104722090 con 0x56010471f5f0 2024-09-13T23:05:29.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.988+0000 7f05e2023640 1 --2- 172.21.15.164:0/1442853377 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x56010471f5f0 0x5601047219e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:29.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.988+0000 7f05e2023640 1 --2- 172.21.15.164:0/1442853377 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x56010471f5f0 0x5601047219e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:29.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.988+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d803c020 con 0x56010471f5f0 2024-09-13T23:05:29.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.988+0000 7f05e2023640 1 --2- 172.21.15.164:0/1442853377 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f05d8050020 0x7f05d804b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.988+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560104722090 con 0x7f05d8050020 2024-09-13T23:05:30.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.989+0000 7f05e3025640 1 --2- 172.21.15.164:0/1442853377 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f05d8050020 0x7f05d804b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.989+0000 7f05e3025640 1 --2- 172.21.15.164:0/1442853377 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f05d8050020 0x7f05d804b3a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.989+0000 7f05e3025640 1 -- 172.21.15.164:0/1442853377 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05dc02f040 con 0x7f05d8050020 2024-09-13T23:05:30.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.989+0000 7f05e3025640 1 --2- 172.21.15.164:0/1442853377 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f05dc019040 0x7f05dc019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.989+0000 7f05e3025640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560104722090 con 0x7f05dc019040 2024-09-13T23:05:30.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.990+0000 7f05e2824640 1 --2- 172.21.15.164:0/1442853377 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f05dc019040 0x7f05dc019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.990+0000 7f05e2824640 1 --2- 172.21.15.164:0/1442853377 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f05dc019040 0x7f05dc019930 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.990+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x7f05dc019040 2024-09-13T23:05:30.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.990+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x5601047194b0 2024-09-13T23:05:30.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.991+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:30.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.991+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x5601047194b0 2024-09-13T23:05:30.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.991+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:30.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.991+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x7f05dc019040 2024-09-13T23:05:30.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.991+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x7f05dc019040 2024-09-13T23:05:30.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.991+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x7f05dc019040 2024-09-13T23:05:30.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.992+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x7f05dc019040 2024-09-13T23:05:30.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.992+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x7f05d8050020 2024-09-13T23:05:30.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.992+0000 7f05e3025640 1 -- 172.21.15.164:0/1442853377 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05dc02f040 con 0x7f05d8050020 2024-09-13T23:05:30.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.992+0000 7f05e3025640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x56010471f5f0 2024-09-13T23:05:30.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.992+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d803c020 con 0x56010471f5f0 2024-09-13T23:05:30.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.992+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x5601047194b0 2024-09-13T23:05:30.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.992+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:30.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.992+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x7f05dc019040 2024-09-13T23:05:30.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.993+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x7f05dc019040 2024-09-13T23:05:30.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.993+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x5601047194b0 2024-09-13T23:05:30.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.993+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:30.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.993+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x7f05d8050020 2024-09-13T23:05:30.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.993+0000 7f05e3025640 1 -- 172.21.15.164:0/1442853377 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f05dc02f040 con 0x7f05d8050020 2024-09-13T23:05:30.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.993+0000 7f05e3025640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x56010471f5f0 2024-09-13T23:05:30.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.994+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d803c020 con 0x56010471f5f0 2024-09-13T23:05:30.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.994+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x56010471f5f0 2024-09-13T23:05:30.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.994+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d803c020 con 0x56010471f5f0 2024-09-13T23:05:30.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.994+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x7f05dc019040 2024-09-13T23:05:30.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.994+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x7f05dc019040 2024-09-13T23:05:30.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.994+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x56010471f5f0 2024-09-13T23:05:30.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.995+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d803c020 con 0x56010471f5f0 2024-09-13T23:05:30.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.995+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x56010471f5f0 2024-09-13T23:05:30.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.995+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d803c020 con 0x56010471f5f0 2024-09-13T23:05:30.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.995+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x5601047194b0 2024-09-13T23:05:30.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.995+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:30.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.995+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x5601047194b0 2024-09-13T23:05:30.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.995+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:30.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.995+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x7f05dc019040 2024-09-13T23:05:30.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.996+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x7f05dc019040 2024-09-13T23:05:30.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.996+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x56010471f5f0 2024-09-13T23:05:30.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.996+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d803c020 con 0x56010471f5f0 2024-09-13T23:05:30.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.996+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x7f05d8050020 2024-09-13T23:05:30.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.996+0000 7f05e3025640 1 -- 172.21.15.164:0/1442853377 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05dc02f040 con 0x7f05d8050020 2024-09-13T23:05:30.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.996+0000 7f05e3025640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x5601047194b0 2024-09-13T23:05:30.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.997+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:30.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.997+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x7f05dc019040 2024-09-13T23:05:30.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.997+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x7f05dc019040 2024-09-13T23:05:30.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.997+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x56010471f5f0 2024-09-13T23:05:30.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.997+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d803c020 con 0x56010471f5f0 2024-09-13T23:05:30.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.997+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x7f05dc019040 2024-09-13T23:05:30.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.998+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x7f05dc019040 2024-09-13T23:05:30.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.998+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x7f05d8050020 2024-09-13T23:05:30.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.998+0000 7f05e3025640 1 -- 172.21.15.164:0/1442853377 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05dc02f040 con 0x7f05d8050020 2024-09-13T23:05:30.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.998+0000 7f05e3025640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x56010471f5f0 2024-09-13T23:05:30.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.998+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d803c020 con 0x56010471f5f0 2024-09-13T23:05:30.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.998+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x7f05dc019040 2024-09-13T23:05:30.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.999+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x7f05dc019040 2024-09-13T23:05:30.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.999+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x5601047194b0 2024-09-13T23:05:30.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.999+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:30.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.999+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x7f05d8050020 2024-09-13T23:05:30.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.999+0000 7f05e3025640 1 -- 172.21.15.164:0/1442853377 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05dc02f040 con 0x7f05d8050020 2024-09-13T23:05:30.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.999+0000 7f05e6b33800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:30.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.999+0000 7f05e6b33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:30.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.999+0000 7f05e6b33800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:30.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.999+0000 7f05e6b33800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:30.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.999+0000 7f05e6b33800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:30.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.999+0000 7f05e6b33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:30.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.999+0000 7f05e6b33800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.999+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56010471df10 con 0x5601047194b0 2024-09-13T23:05:30.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.999+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:30.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.999+0000 7f05e6b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.999+0000 7f05e6b33800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:29.999+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56010471e300 con 0x5601047194b0 2024-09-13T23:05:30.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.000+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:30.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.000+0000 7f05e6b33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:30.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.000+0000 7f05e6b33800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.000+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56010471e300 con 0x5601047194b0 2024-09-13T23:05:30.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.000+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:30.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.000+0000 7f05e6b33800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:30.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.000+0000 7f05e6b33800 20 zone default found 2024-09-13T23:05:30.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.000+0000 7f05e6b33800 4 Realm: () 2024-09-13T23:05:30.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.000+0000 7f05e6b33800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:30.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.000+0000 7f05e6b33800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:30.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.000+0000 7f05e6b33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:30.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.000+0000 7f05e6b33800 20 zonegroup default 2024-09-13T23:05:30.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.000+0000 7f05e6b33800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.000+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56010471e720 con 0x7f05dc019040 2024-09-13T23:05:30.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.000+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f05d407c070 con 0x7f05dc019040 2024-09-13T23:05:30.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.000+0000 7f05e6b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.000+0000 7f05e6b33800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.000+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56010471e720 con 0x56010471f5f0 2024-09-13T23:05:30.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.001+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f05d803c020 con 0x56010471f5f0 2024-09-13T23:05:30.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.001+0000 7f05e6b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.001+0000 7f05e6b33800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.001+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560104723ed0 con 0x56010471f5f0 2024-09-13T23:05:30.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.001+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f05d803c020 con 0x56010471f5f0 2024-09-13T23:05:30.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.001+0000 7f05e6b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.001+0000 7f05e6b33800 20 started sync module instance, tier type = 2024-09-13T23:05:30.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.001+0000 7f05e6b33800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:30.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.001+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560104723370 con 0x7f05d8050020 2024-09-13T23:05:30.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.002+0000 7f05e3025640 1 -- 172.21.15.164:0/1442853377 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05dc02f040 con 0x7f05d8050020 2024-09-13T23:05:30.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.002+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94562369550448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560104723370 con 0x7f05d8050020 2024-09-13T23:05:30.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.002+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560104724980 con 0x5601047194b0 2024-09-13T23:05:30.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.003+0000 7f05e3025640 1 -- 172.21.15.164:0/1442853377 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94562369550448] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05dc02f040 con 0x7f05d8050020 2024-09-13T23:05:30.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.004+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:30.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.004+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94562369553488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560104723370 con 0x5601047194b0 2024-09-13T23:05:30.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.004+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560104725430 con 0x56010471f5f0 2024-09-13T23:05:30.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.005+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94562369553488] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:30.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.005+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d803c020 con 0x56010471f5f0 2024-09-13T23:05:30.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.005+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94562369547968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601047232e0 con 0x56010471f5f0 2024-09-13T23:05:30.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.005+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601047262f0 con 0x7f05d8050020 2024-09-13T23:05:30.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.006+0000 7f05e3025640 1 -- 172.21.15.164:0/1442853377 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05dc02f040 con 0x7f05d8050020 2024-09-13T23:05:30.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.006+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94562369560608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560104726af0 con 0x7f05d8050020 2024-09-13T23:05:30.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.006+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601047275f0 con 0x5601047194b0 2024-09-13T23:05:30.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.007+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94562369547968] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d803c020 con 0x56010471f5f0 2024-09-13T23:05:30.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.007+0000 7f05e3025640 1 -- 172.21.15.164:0/1442853377 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94562369560608] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05dc02f040 con 0x7f05d8050020 2024-09-13T23:05:30.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.008+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:30.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.008+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94562369564896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601047275b0 con 0x5601047194b0 2024-09-13T23:05:30.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.008+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560104727ec0 con 0x7f05dc019040 2024-09-13T23:05:30.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.009+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d407c070 con 0x7f05dc019040 2024-09-13T23:05:30.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.009+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94562369567168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601047275b0 con 0x7f05dc019040 2024-09-13T23:05:30.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.009+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560104728a10 con 0x7f05dc019040 2024-09-13T23:05:30.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.009+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94562369564896] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:30.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.010+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94562369567168] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d407c070 con 0x7f05dc019040 2024-09-13T23:05:30.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.010+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d407c070 con 0x7f05dc019040 2024-09-13T23:05:30.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.010+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94562369570016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560104727de0 con 0x7f05dc019040 2024-09-13T23:05:30.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.010+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560104728e80 con 0x7f05dc019040 2024-09-13T23:05:30.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.012+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94562369570016] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d407c070 con 0x7f05dc019040 2024-09-13T23:05:30.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.012+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d407c070 con 0x7f05dc019040 2024-09-13T23:05:30.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.012+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94562369558560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560104728e80 con 0x7f05dc019040 2024-09-13T23:05:30.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.012+0000 7f05e6b33800 20 add_watcher() i=0 2024-09-13T23:05:30.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.012+0000 7f05e6b33800 20 add_watcher() i=1 2024-09-13T23:05:30.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.012+0000 7f05e6b33800 20 add_watcher() i=2 2024-09-13T23:05:30.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.012+0000 7f05e6b33800 20 add_watcher() i=3 2024-09-13T23:05:30.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.012+0000 7f05e6b33800 20 add_watcher() i=4 2024-09-13T23:05:30.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.012+0000 7f05e6b33800 20 add_watcher() i=5 2024-09-13T23:05:30.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.012+0000 7f05e6b33800 20 add_watcher() i=6 2024-09-13T23:05:30.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.013+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94562369558560] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d407c070 con 0x7f05dc019040 2024-09-13T23:05:30.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.013+0000 7f05e6b33800 20 add_watcher() i=7 2024-09-13T23:05:30.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.013+0000 7f05e6b33800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:30.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.013+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56010472c2a0 con 0x5601047194b0 2024-09-13T23:05:30.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.013+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:30.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.013+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94562369571744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560104729740 con 0x5601047194b0 2024-09-13T23:05:30.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.015+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94562369571744] v32'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:30.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.015+0000 7f04997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:30.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.015+0000 7f05e6b33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:30.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.015+0000 7f05e6b33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:30.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.015+0000 7f05e6b33800 5 note: GC not initialized 2024-09-13T23:05:30.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.015+0000 7f0413fff640 20 reqs_thread_entry: start 2024-09-13T23:05:30.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.015+0000 7f05e6b33800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:30.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.015+0000 7f05e6b33800 20 Filter name: none 2024-09-13T23:05:30.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.015+0000 7f0411ffb640 20 reqs_thread_entry: start 2024-09-13T23:05:30.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.015+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010475ed00 con 0x56010471f5f0 2024-09-13T23:05:30.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.016+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d803c020 con 0x56010471f5f0 2024-09-13T23:05:30.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.016+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010475ed00 con 0x56010471f5f0 2024-09-13T23:05:30.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.016+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d803c020 con 0x56010471f5f0 2024-09-13T23:05:30.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.016+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010475ed00 con 0x5601047194b0 2024-09-13T23:05:30.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.016+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:30.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.016+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471df10 con 0x5601047194b0 2024-09-13T23:05:30.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.016+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:30.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.016+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471df10 con 0x7f05d8050020 2024-09-13T23:05:30.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.017+0000 7f05e3025640 1 -- 172.21.15.164:0/1442853377 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05dc02f040 con 0x7f05d8050020 2024-09-13T23:05:30.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.017+0000 7f05e3025640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x56010471f5f0 2024-09-13T23:05:30.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.017+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d803c020 con 0x56010471f5f0 2024-09-13T23:05:30.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.017+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x5601047194b0 2024-09-13T23:05:30.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.017+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:30.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.017+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x56010471f5f0 2024-09-13T23:05:30.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.017+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d803c020 con 0x56010471f5f0 2024-09-13T23:05:30.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.017+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x7f05d8050020 2024-09-13T23:05:30.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.018+0000 7f05e3025640 1 -- 172.21.15.164:0/1442853377 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05dc02f040 con 0x7f05d8050020 2024-09-13T23:05:30.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.018+0000 7f05e3025640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x56010471f5f0 2024-09-13T23:05:30.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.018+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d803c020 con 0x56010471f5f0 2024-09-13T23:05:30.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.018+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x5601047194b0 2024-09-13T23:05:30.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.018+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:30.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.018+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x7f05dc019040 2024-09-13T23:05:30.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.018+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x7f05dc019040 2024-09-13T23:05:30.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.018+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x7f05dc019040 2024-09-13T23:05:30.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.019+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(74 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x7f05dc019040 2024-09-13T23:05:30.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.019+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x56010471f5f0 2024-09-13T23:05:30.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.019+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d803c020 con 0x56010471f5f0 2024-09-13T23:05:30.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.019+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x7f05dc019040 2024-09-13T23:05:30.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.019+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(76 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x7f05dc019040 2024-09-13T23:05:30.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.019+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x7f05dc019040 2024-09-13T23:05:30.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.019+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(77 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x7f05dc019040 2024-09-13T23:05:30.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.019+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x7f05dc019040 2024-09-13T23:05:30.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.020+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(78 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x7f05dc019040 2024-09-13T23:05:30.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.020+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x56010471f5f0 2024-09-13T23:05:30.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.020+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(79 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d803c020 con 0x56010471f5f0 2024-09-13T23:05:30.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.020+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x7f05d8050020 2024-09-13T23:05:30.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.020+0000 7f05e3025640 1 -- 172.21.15.164:0/1442853377 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(80 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05dc02f040 con 0x7f05d8050020 2024-09-13T23:05:30.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.020+0000 7f05e3025640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x5601047194b0 2024-09-13T23:05:30.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.020+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(81 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:30.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.020+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x5601047194b0 2024-09-13T23:05:30.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.021+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(82 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:30.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.021+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x56010471f5f0 2024-09-13T23:05:30.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.021+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 <== osd.3 v2:172.21.15.164:6816/93809510 21 ==== osd_op_reply(83 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d803c020 con 0x56010471f5f0 2024-09-13T23:05:30.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.021+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x7f05d8050020 2024-09-13T23:05:30.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.021+0000 7f05e3025640 1 -- 172.21.15.164:0/1442853377 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(84 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05dc02f040 con 0x7f05d8050020 2024-09-13T23:05:30.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.021+0000 7f05e3025640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x7f05dc019040 2024-09-13T23:05:30.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.022+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(85 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x7f05dc019040 2024-09-13T23:05:30.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.022+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x5601047194b0 2024-09-13T23:05:30.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.022+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(86 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:30.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.022+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x7f05dc019040 2024-09-13T23:05:30.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.022+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(87 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x7f05dc019040 2024-09-13T23:05:30.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.022+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x56010471f5f0 2024-09-13T23:05:30.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.022+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 <== osd.3 v2:172.21.15.164:6816/93809510 22 ==== osd_op_reply(88 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d803c020 con 0x56010471f5f0 2024-09-13T23:05:30.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.022+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x7f05d8050020 2024-09-13T23:05:30.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.023+0000 7f05e3025640 1 -- 172.21.15.164:0/1442853377 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(89 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05dc02f040 con 0x7f05d8050020 2024-09-13T23:05:30.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.023+0000 7f05e3025640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x7f05dc019040 2024-09-13T23:05:30.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.023+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(90 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x7f05dc019040 2024-09-13T23:05:30.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.023+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x5601047194b0 2024-09-13T23:05:30.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.023+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(91 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:30.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.023+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x56010471f5f0 2024-09-13T23:05:30.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.023+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 <== osd.3 v2:172.21.15.164:6816/93809510 23 ==== osd_op_reply(92 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d803c020 con 0x56010471f5f0 2024-09-13T23:05:30.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.023+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56010471d5a0 con 0x7f05d8050020 2024-09-13T23:05:30.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.024+0000 7f05e3025640 1 -- 172.21.15.164:0/1442853377 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(93 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05dc02f040 con 0x7f05d8050020 2024-09-13T23:05:30.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.024+0000 7f04997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:30.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.024+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94562369571744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56010471df10 con 0x5601047194b0 2024-09-13T23:05:30.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.026+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94562369571744] v32'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:30.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.026+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94562369550448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56010475ecc0 con 0x7f05d8050020 2024-09-13T23:05:30.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.027+0000 7f05e3025640 1 -- 172.21.15.164:0/1442853377 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94562369550448] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05dc02f040 con 0x7f05d8050020 2024-09-13T23:05:30.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.027+0000 7f05e6b33800 20 remove_watcher() i=0 2024-09-13T23:05:30.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.027+0000 7f05e6b33800 2 removed watcher, disabling cache 2024-09-13T23:05:30.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.027+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94562369553488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560104723870 con 0x5601047194b0 2024-09-13T23:05:30.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.028+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94562369553488] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:30.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.028+0000 7f05e6b33800 20 remove_watcher() i=1 2024-09-13T23:05:30.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.028+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94562369547968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560104723870 con 0x56010471f5f0 2024-09-13T23:05:30.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.029+0000 7f05e2023640 1 -- 172.21.15.164:0/1442853377 <== osd.3 v2:172.21.15.164:6816/93809510 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94562369547968] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d803c020 con 0x56010471f5f0 2024-09-13T23:05:30.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.029+0000 7f05e6b33800 20 remove_watcher() i=2 2024-09-13T23:05:30.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.029+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94562369560608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560104722ec0 con 0x7f05d8050020 2024-09-13T23:05:30.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.030+0000 7f05e3025640 1 -- 172.21.15.164:0/1442853377 <== osd.2 v2:172.21.15.164:6808/3795914978 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94562369560608] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05dc02f040 con 0x7f05d8050020 2024-09-13T23:05:30.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.030+0000 7f05e6b33800 20 remove_watcher() i=3 2024-09-13T23:05:30.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.030+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94562369564896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560104722ec0 con 0x5601047194b0 2024-09-13T23:05:30.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.031+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.1 v2:172.21.15.164:6800/4060509701 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94562369564896] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d407c070 con 0x5601047194b0 2024-09-13T23:05:30.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.031+0000 7f05e6b33800 20 remove_watcher() i=4 2024-09-13T23:05:30.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.031+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94562369567168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601047270e0 con 0x7f05dc019040 2024-09-13T23:05:30.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.032+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94562369567168] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d407c070 con 0x7f05dc019040 2024-09-13T23:05:30.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.032+0000 7f05e6b33800 20 remove_watcher() i=5 2024-09-13T23:05:30.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.032+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94562369570016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560104722ec0 con 0x7f05dc019040 2024-09-13T23:05:30.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.034+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94562369570016] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d407c070 con 0x7f05dc019040 2024-09-13T23:05:30.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.034+0000 7f05e6b33800 20 remove_watcher() i=6 2024-09-13T23:05:30.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.034+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94562369558560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601047284e0 con 0x7f05dc019040 2024-09-13T23:05:30.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.035+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 <== osd.0 v2:172.21.15.17:6800/489863589 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94562369558560] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d407c070 con 0x7f05dc019040 2024-09-13T23:05:30.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.035+0000 7f05e6b33800 20 remove_watcher() i=7 2024-09-13T23:05:30.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.035+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f05dc019040 msgr2=0x7f05dc019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.035+0000 7f05e6b33800 1 --2- 172.21.15.164:0/1442853377 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f05dc019040 0x7f05dc019930 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.035+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5601047194b0 msgr2=0x56010471b970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.035+0000 7f05e6b33800 1 --2- 172.21.15.164:0/1442853377 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5601047194b0 0x56010471b970 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.035+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f05d8050020 msgr2=0x7f05d804b3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.035+0000 7f05e6b33800 1 --2- 172.21.15.164:0/1442853377 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f05d8050020 0x7f05d804b3a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.035+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x56010471f5f0 msgr2=0x5601047219e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.035+0000 7f05e6b33800 1 --2- 172.21.15.164:0/1442853377 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x56010471f5f0 0x5601047219e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.035+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f04ac036b40 msgr2=0x7f04ac039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.035+0000 7f05e6b33800 1 --2- 172.21.15.164:0/1442853377 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f04ac036b40 0x7f04ac039000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00f010 tx=0x7f05dc00c040 comp rx=0 tx=0).stop 2024-09-13T23:05:30.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.035+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560104706a00 msgr2=0x56010470dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.035+0000 7f05e2824640 1 -- 172.21.15.164:0/1442853377 reap_dead start 2024-09-13T23:05:30.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.035+0000 7f05e6b33800 1 --2- 172.21.15.164:0/1442853377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560104706a00 0x56010470dd30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f05d804c470 tx=0x7f05d804c340 comp rx=0 tx=0).stop 2024-09-13T23:05:30.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.036+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 shutdown_connections 2024-09-13T23:05:30.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.036+0000 7f05e6b33800 1 --2- 172.21.15.164:0/1442853377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560104706a00 0x56010470dd30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.036+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 >> 172.21.15.164:0/1442853377 conn(0x560104702d60 msgr2=0x560104700e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.036+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 shutdown_connections 2024-09-13T23:05:30.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.036+0000 7f05e6b33800 1 -- 172.21.15.164:0/1442853377 wait complete. 2024-09-13T23:05:30.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.036+0000 7f05e6b33800 1 -- 172.21.15.164:0/1937685916 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f04bc036b90 msgr2=0x7f04bc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.036+0000 7f05e6b33800 1 --2- 172.21.15.164:0/1937685916 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f04bc036b90 0x7f04bc039050 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x5601046ea450 tx=0x7f05dc000f90 comp rx=0 tx=0).stop 2024-09-13T23:05:30.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.036+0000 7f05e6b33800 1 -- 172.21.15.164:0/1937685916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601046f9d40 msgr2=0x5601046fa160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.036+0000 7f05e6b33800 1 --2- 172.21.15.164:0/1937685916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601046f9d40 0x5601046fa160 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f05d8001ed0 tx=0x7f05d800ea00 comp rx=0 tx=0).stop 2024-09-13T23:05:30.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.036+0000 7f05e6b33800 1 -- 172.21.15.164:0/1937685916 shutdown_connections 2024-09-13T23:05:30.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.036+0000 7f05e6b33800 1 --2- 172.21.15.164:0/1937685916 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f04bc036b90 0x7f04bc039050 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.036+0000 7f05e6b33800 1 --2- 172.21.15.164:0/1937685916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5601046f9d40 0x5601046fa160 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.036+0000 7f05e6b33800 1 -- 172.21.15.164:0/1937685916 >> 172.21.15.164:0/1937685916 conn(0x5601046eecd0 msgr2=0x5601046f1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.036+0000 7f05e6b33800 1 -- 172.21.15.164:0/1937685916 shutdown_connections 2024-09-13T23:05:30.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.036+0000 7f05e6b33800 1 -- 172.21.15.164:0/1937685916 wait complete. 2024-09-13T23:05:30.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.036+0000 7f05e6b33800 1 -- 172.21.15.164:0/3691514235 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5601045eebc0 msgr2=0x5601046e9310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.036+0000 7f05e6b33800 1 --2- 172.21.15.164:0/3691514235 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5601045eebc0 0x5601046e9310 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.037+0000 7f05e6b33800 1 -- 172.21.15.164:0/3691514235 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f04c8036b90 msgr2=0x7f04c8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.037+0000 7f05e6b33800 1 --2- 172.21.15.164:0/3691514235 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f04c8036b90 0x7f04c8039050 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f05d8000f60 tx=0x7f05d8001370 comp rx=0 tx=0).stop 2024-09-13T23:05:30.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.037+0000 7f05e6b33800 1 -- 172.21.15.164:0/3691514235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56010455d5e0 msgr2=0x5601046e23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.037+0000 7f05e6b33800 1 --2- 172.21.15.164:0/3691514235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56010455d5e0 0x5601046e23d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f05d4045d30 tx=0x7f05d4003330 comp rx=0 tx=0).stop 2024-09-13T23:05:30.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.037+0000 7f05e6b33800 1 -- 172.21.15.164:0/3691514235 shutdown_connections 2024-09-13T23:05:30.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.037+0000 7f05e6b33800 1 --2- 172.21.15.164:0/3691514235 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5601045eebc0 0x5601046e9310 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.037+0000 7f05e6b33800 1 --2- 172.21.15.164:0/3691514235 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f04c8036b90 0x7f04c8039050 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.037+0000 7f05e6b33800 1 --2- 172.21.15.164:0/3691514235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56010455d5e0 0x5601046e23d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.037+0000 7f05e6b33800 1 -- 172.21.15.164:0/3691514235 >> 172.21.15.164:0/3691514235 conn(0x5601045e3dd0 msgr2=0x5601046d4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.037+0000 7f05e6b33800 1 -- 172.21.15.164:0/3691514235 shutdown_connections 2024-09-13T23:05:30.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.037+0000 7f05e6b33800 1 -- 172.21.15.164:0/3691514235 wait complete. 2024-09-13T23:05:30.059 INFO:teuthology.orchestra.run.smithi164.stdout:[] 2024-09-13T23:05:30.060 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T23:05:30.060 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-13T23:05:30.060 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-13T23:05:30.060 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-13T23:05:30.105 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:30.105 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:30.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.105+0000 7eff98b22800 1 Processor -- start 2024-09-13T23:05:30.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.105+0000 7eff98b22800 1 -- start start 2024-09-13T23:05:30.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.105+0000 7eff98b22800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x558252371550 0x558252371950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.105+0000 7eff98b22800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558252231b30 con 0x558252371e90 2024-09-13T23:05:30.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.105+0000 7eff98b22800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x558252213360 con 0x558252371550 2024-09-13T23:05:30.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.106+0000 7eff94816640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x558252371550 0x558252371950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.106+0000 7eff8ffff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x558252371e90 0x558252376a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40662/0 (socket says 172.21.15.164:40662) 2024-09-13T23:05:30.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.106+0000 7eff94816640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x558252371550 0x558252371950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55822/0 (socket says 172.21.15.164:55822) 2024-09-13T23:05:30.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.106+0000 7eff8ffff640 1 -- 172.21.15.164:0/2484126294 learned_addr learned my addr 172.21.15.164:0/2484126294 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:30.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.106+0000 7eff94816640 1 -- 172.21.15.164:0/2484126294 >> v1:172.21.15.17:6789/0 conn(0x558252371e90 legacy=0x558252376a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.106+0000 7eff94816640 1 -- 172.21.15.164:0/2484126294 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558252239e00 con 0x558252371550 2024-09-13T23:05:30.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.108+0000 7eff94816640 1 --2- 172.21.15.164:0/2484126294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252371550 0x558252371950 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7eff8800a470 tx=0x7eff88045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190f1908f82d32f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.108+0000 7eff8f7fe640 1 -- 172.21.15.164:0/2484126294 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff88053570 con 0x558252371550 2024-09-13T23:05:30.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.108+0000 7eff8f7fe640 1 -- 172.21.15.164:0/2484126294 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff88058070 con 0x558252371550 2024-09-13T23:05:30.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.108+0000 7eff8f7fe640 1 -- 172.21.15.164:0/2484126294 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff88053880 con 0x558252371550 2024-09-13T23:05:30.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.109+0000 7eff98b22800 1 -- 172.21.15.164:0/2484126294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252371550 msgr2=0x558252371950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.109+0000 7eff98b22800 1 --2- 172.21.15.164:0/2484126294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252371550 0x558252371950 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7eff8800a470 tx=0x7eff88045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:30.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.109+0000 7eff98b22800 1 -- 172.21.15.164:0/2484126294 shutdown_connections 2024-09-13T23:05:30.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.109+0000 7eff98b22800 1 --2- 172.21.15.164:0/2484126294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252371550 0x558252371950 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.109+0000 7eff98b22800 1 -- 172.21.15.164:0/2484126294 >> 172.21.15.164:0/2484126294 conn(0x55825236cde0 msgr2=0x55825236f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.109+0000 7eff98b22800 1 -- 172.21.15.164:0/2484126294 shutdown_connections 2024-09-13T23:05:30.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.109+0000 7eff98b22800 1 -- 172.21.15.164:0/2484126294 wait complete. 2024-09-13T23:05:30.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.125+0000 7eff98b22800 1 Processor -- start 2024-09-13T23:05:30.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.126+0000 7eff98b22800 1 -- start start 2024-09-13T23:05:30.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.126+0000 7eff98b22800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252371550 0x55825245f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.126+0000 7eff98b22800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5582522be330 con 0x558252371550 2024-09-13T23:05:30.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.126+0000 7eff94816640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252371550 0x55825245f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.126+0000 7eff94816640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252371550 0x55825245f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55838/0 (socket says 172.21.15.164:55838) 2024-09-13T23:05:30.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.126+0000 7eff94816640 1 -- 172.21.15.164:0/942763284 learned_addr learned my addr 172.21.15.164:0/942763284 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.126+0000 7eff94816640 1 -- 172.21.15.164:0/942763284 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55825220bbc0 con 0x558252371550 2024-09-13T23:05:30.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.127+0000 7eff94816640 1 --2- 172.21.15.164:0/942763284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252371550 0x55825245f690 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7eff88025c20 tx=0x7eff88051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d34b6ba4ae33c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.127+0000 7efe82e05640 1 -- 172.21.15.164:0/942763284 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff88053ba0 con 0x558252371550 2024-09-13T23:05:30.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.127+0000 7efe82e05640 1 -- 172.21.15.164:0/942763284 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff88063030 con 0x558252371550 2024-09-13T23:05:30.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.127+0000 7efe82e05640 1 -- 172.21.15.164:0/942763284 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff88053440 con 0x558252371550 2024-09-13T23:05:30.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.128+0000 7eff98b22800 1 -- 172.21.15.164:0/942763284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252371550 msgr2=0x55825245f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.128+0000 7eff98b22800 1 --2- 172.21.15.164:0/942763284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252371550 0x55825245f690 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7eff88025c20 tx=0x7eff88051000 comp rx=0 tx=0).stop 2024-09-13T23:05:30.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.128+0000 7eff98b22800 1 -- 172.21.15.164:0/942763284 shutdown_connections 2024-09-13T23:05:30.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.128+0000 7eff98b22800 1 --2- 172.21.15.164:0/942763284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252371550 0x55825245f690 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.128+0000 7eff98b22800 1 -- 172.21.15.164:0/942763284 >> 172.21.15.164:0/942763284 conn(0x55825236cde0 msgr2=0x55825245b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.128+0000 7eff98b22800 1 -- 172.21.15.164:0/942763284 shutdown_connections 2024-09-13T23:05:30.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.128+0000 7eff98b22800 1 -- 172.21.15.164:0/942763284 wait complete. 2024-09-13T23:05:30.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.128+0000 7eff98b22800 1 Processor -- start 2024-09-13T23:05:30.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.128+0000 7eff98b22800 1 -- start start 2024-09-13T23:05:30.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.128+0000 7eff98b22800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252371550 0x558252467000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.128+0000 7eff98b22800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x558252378570 con 0x558252371550 2024-09-13T23:05:30.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.128+0000 7eff94816640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252371550 0x558252467000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.128+0000 7eff94816640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252371550 0x558252467000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55846/0 (socket says 172.21.15.164:55846) 2024-09-13T23:05:30.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.128+0000 7eff94816640 1 -- 172.21.15.164:0/3643474136 learned_addr learned my addr 172.21.15.164:0/3643474136 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.129+0000 7eff94816640 1 -- 172.21.15.164:0/3643474136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55825221ffe0 con 0x558252371550 2024-09-13T23:05:30.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.129+0000 7eff94816640 1 --2- 172.21.15.164:0/3643474136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252371550 0x558252467000 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x5582524604f0 tx=0x7eff88002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.129+0000 7efe81602640 1 -- 172.21.15.164:0/3643474136 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff88078070 con 0x558252371550 2024-09-13T23:05:30.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.129+0000 7efe81602640 1 -- 172.21.15.164:0/3643474136 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff88053570 con 0x558252371550 2024-09-13T23:05:30.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.129+0000 7efe81602640 1 -- 172.21.15.164:0/3643474136 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff88053850 con 0x558252371550 2024-09-13T23:05:30.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.129+0000 7eff98b22800 1 -- 172.21.15.164:0/3643474136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558252467540 con 0x558252371550 2024-09-13T23:05:30.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.129+0000 7eff98b22800 1 -- 172.21.15.164:0/3643474136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558252467ac0 con 0x558252371550 2024-09-13T23:05:30.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.131+0000 7efe81602640 1 -- 172.21.15.164:0/3643474136 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7eff8807b070 con 0x558252371550 2024-09-13T23:05:30.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.131+0000 7efe81602640 1 --2- 172.21.15.164:0/3643474136 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efe7c03af50 0x7efe7c03d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.131+0000 7efe81602640 1 -- 172.21.15.164:0/3643474136 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7eff88070070 con 0x558252371550 2024-09-13T23:05:30.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.131+0000 7eff98b22800 1 --2- 172.21.15.164:0/3643474136 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x558252371e90 0x55825246e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.131+0000 7eff8ffff640 1 --2- 172.21.15.164:0/3643474136 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efe7c03af50 0x7efe7c03d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.131+0000 7eff98b22800 1 -- 172.21.15.164:0/3643474136 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55825246e6a0 con 0x558252371e90 2024-09-13T23:05:30.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.131+0000 7eff95017640 1 --2- 172.21.15.164:0/3643474136 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x558252371e90 0x55825246e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.131+0000 7eff95017640 1 --2- 172.21.15.164:0/3643474136 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x558252371e90 0x55825246e0d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.131+0000 7eff8ffff640 1 --2- 172.21.15.164:0/3643474136 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efe7c03af50 0x7efe7c03d410 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7eff80000f60 tx=0x7eff800012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.132+0000 7eff95017640 1 -- 172.21.15.164:0/3643474136 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff9000a4a0 con 0x558252371e90 2024-09-13T23:05:30.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.132+0000 7eff98b22800 1 -- 172.21.15.164:0/3643474136 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55825246b680 con 0x558252371e90 2024-09-13T23:05:30.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.132+0000 7eff95017640 1 -- 172.21.15.164:0/3643474136 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7eff9000a4a0 con 0x558252371e90 2024-09-13T23:05:30.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.132+0000 7eff98b22800 1 -- 172.21.15.164:0/3643474136 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582524704f0 con 0x558252371e90 2024-09-13T23:05:30.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.132+0000 7eff95017640 1 -- 172.21.15.164:0/3643474136 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7eff9000a4a0 con 0x558252371e90 2024-09-13T23:05:30.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.132+0000 7eff98b22800 1 -- 172.21.15.164:0/3643474136 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55825246f570 con 0x558252371e90 2024-09-13T23:05:30.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.132+0000 7eff95017640 1 -- 172.21.15.164:0/3643474136 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7eff9000a4a0 con 0x558252371e90 2024-09-13T23:05:30.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.132+0000 7eff98b22800 1 -- 172.21.15.164:0/3643474136 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55825246f990 con 0x558252371e90 2024-09-13T23:05:30.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.133+0000 7eff95017640 1 -- 172.21.15.164:0/3643474136 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7eff9000a4a0 con 0x558252371e90 2024-09-13T23:05:30.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.133+0000 7eff98b22800 1 Processor -- start 2024-09-13T23:05:30.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.133+0000 7eff98b22800 1 -- start start 2024-09-13T23:05:30.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.133+0000 7eff98b22800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55825247ea60 0x55825247ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.133+0000 7eff98b22800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55825220d580 con 0x55825247ea60 2024-09-13T23:05:30.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.134+0000 7eff8ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55825247ea60 0x55825247ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.134+0000 7eff8ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55825247ea60 0x55825247ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55854/0 (socket says 172.21.15.164:55854) 2024-09-13T23:05:30.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.134+0000 7eff8ffff640 1 -- 172.21.15.164:0/2522722800 learned_addr learned my addr 172.21.15.164:0/2522722800 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.134+0000 7eff8ffff640 1 -- 172.21.15.164:0/2522722800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55825247f3c0 con 0x55825247ea60 2024-09-13T23:05:30.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.134+0000 7eff8ffff640 1 --2- 172.21.15.164:0/2522722800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55825247ea60 0x55825247ee80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7eff80001ed0 tx=0x7eff8000d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.134+0000 7efe7a7fc640 1 -- 172.21.15.164:0/2522722800 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff8001b550 con 0x55825247ea60 2024-09-13T23:05:30.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.134+0000 7efe7a7fc640 1 -- 172.21.15.164:0/2522722800 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff8001b6f0 con 0x55825247ea60 2024-09-13T23:05:30.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.134+0000 7efe7a7fc640 1 -- 172.21.15.164:0/2522722800 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff8001b9d0 con 0x55825247ea60 2024-09-13T23:05:30.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.134+0000 7eff98b22800 1 -- 172.21.15.164:0/2522722800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55825247f650 con 0x55825247ea60 2024-09-13T23:05:30.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.134+0000 7eff98b22800 1 -- 172.21.15.164:0/2522722800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582524822d0 con 0x55825247ea60 2024-09-13T23:05:30.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.135+0000 7efe7a7fc640 1 -- 172.21.15.164:0/2522722800 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7eff80023020 con 0x55825247ea60 2024-09-13T23:05:30.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.135+0000 7efe7a7fc640 1 --2- 172.21.15.164:0/2522722800 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efe6c036b90 0x7efe6c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.135+0000 7efe7a7fc640 1 -- 172.21.15.164:0/2522722800 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7eff80021020 con 0x55825247ea60 2024-09-13T23:05:30.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.135+0000 7eff95017640 1 --2- 172.21.15.164:0/2522722800 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efe6c036b90 0x7efe6c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.136+0000 7eff98b22800 1 Processor -- start 2024-09-13T23:05:30.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.136+0000 7eff95017640 1 --2- 172.21.15.164:0/2522722800 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efe6c036b90 0x7efe6c039050 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x55825246f910 tx=0x7eff90005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.136+0000 7eff98b22800 1 -- start start 2024-09-13T23:05:30.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.136+0000 7eff98b22800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252493f80 0x558252494380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.136+0000 7eff98b22800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55825245fde0 con 0x558252493f80 2024-09-13T23:05:30.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.136+0000 7eff8ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252493f80 0x558252494380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.136+0000 7eff8ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252493f80 0x558252494380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55858/0 (socket says 172.21.15.164:55858) 2024-09-13T23:05:30.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.136+0000 7eff8ffff640 1 -- 172.21.15.164:0/1222185434 learned_addr learned my addr 172.21.15.164:0/1222185434 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.136+0000 7eff8ffff640 1 -- 172.21.15.164:0/1222185434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558252494950 con 0x558252493f80 2024-09-13T23:05:30.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.137+0000 7eff8ffff640 1 --2- 172.21.15.164:0/1222185434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252493f80 0x558252494380 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7eff8004d2f0 tx=0x7eff80019cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e75487591fd1e12 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.138+0000 7efe6bfff640 1 -- 172.21.15.164:0/1222185434 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff80046070 con 0x558252493f80 2024-09-13T23:05:30.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.138+0000 7efe6bfff640 1 -- 172.21.15.164:0/1222185434 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff80024cb0 con 0x558252493f80 2024-09-13T23:05:30.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.138+0000 7efe6bfff640 1 -- 172.21.15.164:0/1222185434 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff80046e60 con 0x558252493f80 2024-09-13T23:05:30.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.139+0000 7eff98b22800 1 -- 172.21.15.164:0/1222185434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252493f80 msgr2=0x558252494380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.139+0000 7eff98b22800 1 --2- 172.21.15.164:0/1222185434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252493f80 0x558252494380 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7eff8004d2f0 tx=0x7eff80019cd0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.139+0000 7eff98b22800 1 -- 172.21.15.164:0/1222185434 shutdown_connections 2024-09-13T23:05:30.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.139+0000 7eff98b22800 1 --2- 172.21.15.164:0/1222185434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252493f80 0x558252494380 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.139+0000 7eff98b22800 1 -- 172.21.15.164:0/1222185434 >> 172.21.15.164:0/1222185434 conn(0x558252487ad0 msgr2=0x558252485bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.139+0000 7eff98b22800 1 -- 172.21.15.164:0/1222185434 shutdown_connections 2024-09-13T23:05:30.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.139+0000 7eff98b22800 1 -- 172.21.15.164:0/1222185434 wait complete. 2024-09-13T23:05:30.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.139+0000 7eff98b22800 1 Processor -- start 2024-09-13T23:05:30.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.139+0000 7eff98b22800 1 -- start start 2024-09-13T23:05:30.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.140+0000 7eff98b22800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252493f80 0x55825249b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.140+0000 7eff98b22800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x558252494fc0 con 0x558252493f80 2024-09-13T23:05:30.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.140+0000 7eff8ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252493f80 0x55825249b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.140+0000 7eff8ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252493f80 0x55825249b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55872/0 (socket says 172.21.15.164:55872) 2024-09-13T23:05:30.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.140+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 learned_addr learned my addr 172.21.15.164:0/656199461 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.140+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55825249b9e0 con 0x558252493f80 2024-09-13T23:05:30.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.140+0000 7eff8ffff640 1 --2- 172.21.15.164:0/656199461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252493f80 0x55825249b4a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7eff8004bf90 tx=0x7eff8000ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.140+0000 7efe6a7fc640 1 -- 172.21.15.164:0/656199461 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff80034070 con 0x558252493f80 2024-09-13T23:05:30.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.140+0000 7efe6a7fc640 1 -- 172.21.15.164:0/656199461 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff80047040 con 0x558252493f80 2024-09-13T23:05:30.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.140+0000 7efe6a7fc640 1 -- 172.21.15.164:0/656199461 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff80046070 con 0x558252493f80 2024-09-13T23:05:30.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.140+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55825249bc70 con 0x558252493f80 2024-09-13T23:05:30.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.141+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55825249bc70 con 0x558252493f80 2024-09-13T23:05:30.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.141+0000 7efe6a7fc640 1 -- 172.21.15.164:0/656199461 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7eff80024580 con 0x558252493f80 2024-09-13T23:05:30.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.142+0000 7efe6a7fc640 1 --2- 172.21.15.164:0/656199461 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efe60036b90 0x7efe60039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.142+0000 7efe6a7fc640 1 -- 172.21.15.164:0/656199461 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7eff80039c60 con 0x558252493f80 2024-09-13T23:05:30.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.142+0000 7eff95017640 1 --2- 172.21.15.164:0/656199461 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efe60036b90 0x7efe60039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.142+0000 7eff95017640 1 --2- 172.21.15.164:0/656199461 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efe60036b90 0x7efe60039050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x55825246f090 tx=0x7eff9001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.142+0000 7eff98b22800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.142+0000 7eff98b22800 1 --2- 172.21.15.164:0/656199461 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5582524a6d90 0x5582524a9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.142+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582524a99a0 con 0x5582524a6d90 2024-09-13T23:05:30.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.142+0000 7eff94816640 1 --2- 172.21.15.164:0/656199461 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5582524a6d90 0x5582524a9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.143+0000 7eff94816640 1 --2- 172.21.15.164:0/656199461 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5582524a6d90 0x5582524a9250 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.143+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.143+0000 7eff98b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.143+0000 7eff98b22800 20 realm 2024-09-13T23:05:30.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.143+0000 7eff98b22800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.143+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582524a9db0 con 0x5582524a6d90 2024-09-13T23:05:30.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.143+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.143+0000 7eff98b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.143+0000 7eff98b22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:30.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.143+0000 7eff98b22800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.143+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582524aa1d0 con 0x5582524a6d90 2024-09-13T23:05:30.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.144+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.144+0000 7eff98b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.144+0000 7eff98b22800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.144+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582524aaa70 con 0x5582524a6d90 2024-09-13T23:05:30.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.144+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.144+0000 7eff98b22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:30.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.144+0000 7eff98b22800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.144+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582524aae10 con 0x5582524a6d90 2024-09-13T23:05:30.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.144+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.144+0000 7eff98b22800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:30.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.144+0000 7eff98b22800 20 searching for the correct realm 2024-09-13T23:05:30.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.144+0000 7eff98b22800 1 --2- 172.21.15.164:0/656199461 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5582524acd40 0x5582524af130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.144+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x5582524acd40 2024-09-13T23:05:30.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.144+0000 7eff8ffff640 1 --2- 172.21.15.164:0/656199461 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5582524acd40 0x5582524af130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.145+0000 7eff8ffff640 1 --2- 172.21.15.164:0/656199461 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5582524acd40 0x5582524af130 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.145+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff80009050 con 0x5582524acd40 2024-09-13T23:05:30.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.145+0000 7eff8ffff640 1 --2- 172.21.15.164:0/656199461 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7eff8004dc20 0x7eff80023810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.145+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x7eff8004dc20 2024-09-13T23:05:30.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.145+0000 7eff95017640 1 --2- 172.21.15.164:0/656199461 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7eff8004dc20 0x7eff80023810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.145+0000 7eff95017640 1 --2- 172.21.15.164:0/656199461 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7eff8004dc20 0x7eff80023810 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.146+0000 7eff95017640 1 -- 172.21.15.164:0/656199461 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff9001f070 con 0x7eff8004dc20 2024-09-13T23:05:30.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.146+0000 7eff95017640 1 --2- 172.21.15.164:0/656199461 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7eff90031040 0x7eff90032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.146+0000 7eff95017640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x7eff90031040 2024-09-13T23:05:30.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.146+0000 7eff94816640 1 --2- 172.21.15.164:0/656199461 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7eff90031040 0x7eff90032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.147+0000 7eff94816640 1 --2- 172.21.15.164:0/656199461 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7eff90031040 0x7eff90032430 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.147+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8807a030 con 0x7eff90031040 2024-09-13T23:05:30.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.147+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x5582524a6d90 2024-09-13T23:05:30.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.147+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.147+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x5582524a6d90 2024-09-13T23:05:30.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.148+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.148+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x7eff90031040 2024-09-13T23:05:30.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.148+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8807a030 con 0x7eff90031040 2024-09-13T23:05:30.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.148+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x7eff90031040 2024-09-13T23:05:30.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.148+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8807a030 con 0x7eff90031040 2024-09-13T23:05:30.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.148+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x7eff8004dc20 2024-09-13T23:05:30.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.148+0000 7eff95017640 1 -- 172.21.15.164:0/656199461 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff9001f070 con 0x7eff8004dc20 2024-09-13T23:05:30.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.148+0000 7eff95017640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x5582524acd40 2024-09-13T23:05:30.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.149+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff80009050 con 0x5582524acd40 2024-09-13T23:05:30.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.149+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x5582524a6d90 2024-09-13T23:05:30.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.149+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.149+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x7eff90031040 2024-09-13T23:05:30.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.149+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8807a030 con 0x7eff90031040 2024-09-13T23:05:30.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.149+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x5582524a6d90 2024-09-13T23:05:30.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.150+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.150+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x7eff8004dc20 2024-09-13T23:05:30.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.150+0000 7eff95017640 1 -- 172.21.15.164:0/656199461 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7eff9001f070 con 0x7eff8004dc20 2024-09-13T23:05:30.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.150+0000 7eff95017640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x5582524acd40 2024-09-13T23:05:30.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.150+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff80009050 con 0x5582524acd40 2024-09-13T23:05:30.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.150+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x5582524acd40 2024-09-13T23:05:30.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.150+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff80009050 con 0x5582524acd40 2024-09-13T23:05:30.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.150+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x7eff90031040 2024-09-13T23:05:30.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.151+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8807a030 con 0x7eff90031040 2024-09-13T23:05:30.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.151+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x5582524acd40 2024-09-13T23:05:30.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.151+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff80009050 con 0x5582524acd40 2024-09-13T23:05:30.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.151+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x5582524acd40 2024-09-13T23:05:30.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.151+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff80009050 con 0x5582524acd40 2024-09-13T23:05:30.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.151+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x5582524a6d90 2024-09-13T23:05:30.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.151+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.151+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x5582524a6d90 2024-09-13T23:05:30.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.152+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.152+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x7eff90031040 2024-09-13T23:05:30.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.152+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8807a030 con 0x7eff90031040 2024-09-13T23:05:30.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.152+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x5582524acd40 2024-09-13T23:05:30.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.152+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff80009050 con 0x5582524acd40 2024-09-13T23:05:30.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.152+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x7eff8004dc20 2024-09-13T23:05:30.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.152+0000 7eff95017640 1 -- 172.21.15.164:0/656199461 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff9001f070 con 0x7eff8004dc20 2024-09-13T23:05:30.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.152+0000 7eff95017640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x5582524a6d90 2024-09-13T23:05:30.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.153+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.153+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x7eff90031040 2024-09-13T23:05:30.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.153+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8807a030 con 0x7eff90031040 2024-09-13T23:05:30.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.153+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x5582524acd40 2024-09-13T23:05:30.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.153+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff80009050 con 0x5582524acd40 2024-09-13T23:05:30.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.153+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x7eff90031040 2024-09-13T23:05:30.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.154+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8807a030 con 0x7eff90031040 2024-09-13T23:05:30.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.154+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x7eff8004dc20 2024-09-13T23:05:30.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.154+0000 7eff95017640 1 -- 172.21.15.164:0/656199461 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff9001f070 con 0x7eff8004dc20 2024-09-13T23:05:30.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.154+0000 7eff95017640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x5582524acd40 2024-09-13T23:05:30.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.154+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff80009050 con 0x5582524acd40 2024-09-13T23:05:30.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.154+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x7eff90031040 2024-09-13T23:05:30.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.154+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff8807a030 con 0x7eff90031040 2024-09-13T23:05:30.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.154+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x5582524a6d90 2024-09-13T23:05:30.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.155+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.155+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5582524af800 con 0x7eff8004dc20 2024-09-13T23:05:30.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.155+0000 7eff95017640 1 -- 172.21.15.164:0/656199461 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff9001f070 con 0x7eff8004dc20 2024-09-13T23:05:30.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.155+0000 7eff98b22800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:30.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.155+0000 7eff98b22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:30.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.155+0000 7eff98b22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:30.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.155+0000 7eff98b22800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:30.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.155+0000 7eff98b22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:30.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.155+0000 7eff98b22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:30.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.155+0000 7eff98b22800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.155+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582524ab810 con 0x5582524a6d90 2024-09-13T23:05:30.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.155+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.155+0000 7eff98b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.155+0000 7eff98b22800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.155+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582524abc00 con 0x5582524a6d90 2024-09-13T23:05:30.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.155+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.155+0000 7eff98b22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:30.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.155+0000 7eff98b22800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.155+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582524abc00 con 0x5582524a6d90 2024-09-13T23:05:30.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.156+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.156+0000 7eff98b22800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:30.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.156+0000 7eff98b22800 20 zone default found 2024-09-13T23:05:30.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.156+0000 7eff98b22800 4 Realm: () 2024-09-13T23:05:30.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.156+0000 7eff98b22800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:30.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.156+0000 7eff98b22800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:30.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.156+0000 7eff98b22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:30.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.156+0000 7eff98b22800 20 zonegroup default 2024-09-13T23:05:30.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.156+0000 7eff98b22800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.156+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582524ac020 con 0x7eff90031040 2024-09-13T23:05:30.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.156+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x7eff90031040 2024-09-13T23:05:30.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.156+0000 7eff98b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.156+0000 7eff98b22800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.156+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582524b1660 con 0x5582524acd40 2024-09-13T23:05:30.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.156+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7eff80009050 con 0x5582524acd40 2024-09-13T23:05:30.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.156+0000 7eff98b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.156+0000 7eff98b22800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.156+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582524b1a00 con 0x5582524acd40 2024-09-13T23:05:30.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.157+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7eff80009050 con 0x5582524acd40 2024-09-13T23:05:30.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.157+0000 7eff98b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.157+0000 7eff98b22800 20 started sync module instance, tier type = 2024-09-13T23:05:30.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.157+0000 7eff98b22800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:30.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.157+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524b0b00 con 0x7eff8004dc20 2024-09-13T23:05:30.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.160+0000 7eff95017640 1 -- 172.21.15.164:0/656199461 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff90040040 con 0x7eff8004dc20 2024-09-13T23:05:30.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.161+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94018214757968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524b1da0 con 0x7eff8004dc20 2024-09-13T23:05:30.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.161+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524b2630 con 0x5582524a6d90 2024-09-13T23:05:30.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.162+0000 7eff95017640 1 -- 172.21.15.164:0/656199461 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94018214757968] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff90040040 con 0x7eff8004dc20 2024-09-13T23:05:30.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.162+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.162+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94018214760176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524b2250 con 0x5582524a6d90 2024-09-13T23:05:30.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.162+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524b30a0 con 0x5582524acd40 2024-09-13T23:05:30.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.164+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff80009050 con 0x5582524acd40 2024-09-13T23:05:30.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.164+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94018214767600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524b3930 con 0x5582524acd40 2024-09-13T23:05:30.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.164+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524b4420 con 0x7eff8004dc20 2024-09-13T23:05:30.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.164+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94018214760176] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.167+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94018214767600] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff80009050 con 0x5582524acd40 2024-09-13T23:05:30.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.167+0000 7eff95017640 1 -- 172.21.15.164:0/656199461 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff90040040 con 0x7eff8004dc20 2024-09-13T23:05:30.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.167+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94018214772464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524b3440 con 0x7eff8004dc20 2024-09-13T23:05:30.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.167+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524b4e30 con 0x5582524a6d90 2024-09-13T23:05:30.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.170+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.170+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94018214775168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524b5250 con 0x5582524a6d90 2024-09-13T23:05:30.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.170+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524b5c90 con 0x7eff90031040 2024-09-13T23:05:30.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.170+0000 7eff95017640 1 -- 172.21.15.164:0/656199461 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94018214772464] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff90040040 con 0x7eff8004dc20 2024-09-13T23:05:30.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.171+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x7eff90031040 2024-09-13T23:05:30.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.171+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94018214778720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524b5c50 con 0x7eff90031040 2024-09-13T23:05:30.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.171+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524b66a0 con 0x7eff90031040 2024-09-13T23:05:30.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.172+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94018214775168] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.173+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x7eff90031040 2024-09-13T23:05:30.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.174+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94018214776224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524b66a0 con 0x7eff90031040 2024-09-13T23:05:30.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.174+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524b70a0 con 0x7eff90031040 2024-09-13T23:05:30.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.174+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94018214778720] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x7eff90031040 2024-09-13T23:05:30.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.175+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94018214776224] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x7eff90031040 2024-09-13T23:05:30.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.175+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x7eff90031040 2024-09-13T23:05:30.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.175+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94018214763936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524b61f0 con 0x7eff90031040 2024-09-13T23:05:30.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.175+0000 7eff98b22800 20 add_watcher() i=0 2024-09-13T23:05:30.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.175+0000 7eff98b22800 20 add_watcher() i=1 2024-09-13T23:05:30.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.175+0000 7eff98b22800 20 add_watcher() i=2 2024-09-13T23:05:30.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.175+0000 7eff98b22800 20 add_watcher() i=3 2024-09-13T23:05:30.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.175+0000 7eff98b22800 20 add_watcher() i=4 2024-09-13T23:05:30.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.175+0000 7eff98b22800 20 add_watcher() i=5 2024-09-13T23:05:30.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.175+0000 7eff98b22800 20 add_watcher() i=6 2024-09-13T23:05:30.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.178+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94018214763936] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x7eff90031040 2024-09-13T23:05:30.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.178+0000 7eff98b22800 20 add_watcher() i=7 2024-09-13T23:05:30.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.178+0000 7eff98b22800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:30.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.178+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582524ba1a0 con 0x5582524a6d90 2024-09-13T23:05:30.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.178+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.178+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94018214783920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524b7620 con 0x5582524a6d90 2024-09-13T23:05:30.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.179+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94018214783920] v32'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.179+0000 7efe4afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:30.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.179+0000 7eff98b22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:30.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.179+0000 7eff98b22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:30.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.179+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c29a0 con 0x5582524a6d90 2024-09-13T23:05:30.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.181+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.181+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c3070 con 0x7eff90031040 2024-09-13T23:05:30.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.182+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x7eff90031040 2024-09-13T23:05:30.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.182+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c3070 con 0x5582524acd40 2024-09-13T23:05:30.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.183+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff80009050 con 0x5582524acd40 2024-09-13T23:05:30.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.183+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c3410 con 0x5582524a6d90 2024-09-13T23:05:30.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.186+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'27 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.186+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c3410 con 0x7eff8004dc20 2024-09-13T23:05:30.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.187+0000 7eff95017640 1 -- 172.21.15.164:0/656199461 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'20 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff90040040 con 0x7eff8004dc20 2024-09-13T23:05:30.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.187+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c3980 con 0x5582524acd40 2024-09-13T23:05:30.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.189+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'13 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff80009050 con 0x5582524acd40 2024-09-13T23:05:30.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.189+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c3a10 con 0x5582524a6d90 2024-09-13T23:05:30.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.190+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.190+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c3a10 con 0x7eff90031040 2024-09-13T23:05:30.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.191+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'13 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x7eff90031040 2024-09-13T23:05:30.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.191+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c3a10 con 0x7eff8004dc20 2024-09-13T23:05:30.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.192+0000 7eff95017640 1 -- 172.21.15.164:0/656199461 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff90040040 con 0x7eff8004dc20 2024-09-13T23:05:30.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.192+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c4020 con 0x5582524acd40 2024-09-13T23:05:30.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.193+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff80009050 con 0x5582524acd40 2024-09-13T23:05:30.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.193+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c4020 con 0x7eff8004dc20 2024-09-13T23:05:30.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.196+0000 7eff95017640 1 -- 172.21.15.164:0/656199461 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'21 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff90040040 con 0x7eff8004dc20 2024-09-13T23:05:30.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.196+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c4590 con 0x7eff90031040 2024-09-13T23:05:30.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.197+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x7eff90031040 2024-09-13T23:05:30.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.197+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c4590 con 0x7eff8004dc20 2024-09-13T23:05:30.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.199+0000 7eff95017640 1 -- 172.21.15.164:0/656199461 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff90040040 con 0x7eff8004dc20 2024-09-13T23:05:30.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.199+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c4a40 con 0x7eff90031040 2024-09-13T23:05:30.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.201+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'19 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x7eff90031040 2024-09-13T23:05:30.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.201+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c4a40 con 0x5582524a6d90 2024-09-13T23:05:30.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.202+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.202+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c4a40 con 0x5582524acd40 2024-09-13T23:05:30.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.203+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff80009050 con 0x5582524acd40 2024-09-13T23:05:30.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.203+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c4a40 con 0x7eff8004dc20 2024-09-13T23:05:30.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.204+0000 7eff95017640 1 -- 172.21.15.164:0/656199461 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff90040040 con 0x7eff8004dc20 2024-09-13T23:05:30.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.204+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c4a40 con 0x5582524acd40 2024-09-13T23:05:30.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.205+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff80009050 con 0x5582524acd40 2024-09-13T23:05:30.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.205+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c4a40 con 0x5582524a6d90 2024-09-13T23:05:30.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.206+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.206+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c4a40 con 0x5582524a6d90 2024-09-13T23:05:30.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.207+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'29 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.208+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c4a40 con 0x5582524acd40 2024-09-13T23:05:30.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.208+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff80009050 con 0x5582524acd40 2024-09-13T23:05:30.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.208+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c4a40 con 0x7eff8004dc20 2024-09-13T23:05:30.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.209+0000 7eff95017640 1 -- 172.21.15.164:0/656199461 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff90040040 con 0x7eff8004dc20 2024-09-13T23:05:30.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.209+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c4a40 con 0x5582524acd40 2024-09-13T23:05:30.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.212+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff80009050 con 0x5582524acd40 2024-09-13T23:05:30.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.212+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c4a40 con 0x5582524acd40 2024-09-13T23:05:30.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.213+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 <== osd.3 v2:172.21.15.164:6816/93809510 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff80009050 con 0x5582524acd40 2024-09-13T23:05:30.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.213+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c4a40 con 0x5582524acd40 2024-09-13T23:05:30.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.214+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 <== osd.3 v2:172.21.15.164:6816/93809510 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff80009050 con 0x5582524acd40 2024-09-13T23:05:30.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.214+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c4a40 con 0x5582524acd40 2024-09-13T23:05:30.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.215+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 <== osd.3 v2:172.21.15.164:6816/93809510 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff80009050 con 0x5582524acd40 2024-09-13T23:05:30.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.215+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c4a40 con 0x7eff90031040 2024-09-13T23:05:30.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.216+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x7eff90031040 2024-09-13T23:05:30.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.216+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c4a40 con 0x5582524acd40 2024-09-13T23:05:30.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.217+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 <== osd.3 v2:172.21.15.164:6816/93809510 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff80009050 con 0x5582524acd40 2024-09-13T23:05:30.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.217+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c4a40 con 0x7eff90031040 2024-09-13T23:05:30.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.218+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x7eff90031040 2024-09-13T23:05:30.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.218+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c4a40 con 0x5582524acd40 2024-09-13T23:05:30.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.219+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 <== osd.3 v2:172.21.15.164:6816/93809510 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'16 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff80009050 con 0x5582524acd40 2024-09-13T23:05:30.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.219+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c4a40 con 0x7eff90031040 2024-09-13T23:05:30.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.220+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'20 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x7eff90031040 2024-09-13T23:05:30.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.220+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524c4a40 con 0x7eff8004dc20 2024-09-13T23:05:30.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.221+0000 7eff95017640 1 -- 172.21.15.164:0/656199461 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff90040040 con 0x7eff8004dc20 2024-09-13T23:05:30.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.221+0000 7efe49fe3640 20 reqs_thread_entry: start 2024-09-13T23:05:30.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.221+0000 7eff98b22800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:30.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.221+0000 7eff98b22800 20 Filter name: none 2024-09-13T23:05:30.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.222+0000 7efdbb7fe640 20 reqs_thread_entry: start 2024-09-13T23:05:30.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.222+0000 7eff98b22800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-13T23:05:30.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.222+0000 7eff98b22800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.222+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5582524ef7d0 con 0x7eff8004dc20 2024-09-13T23:05:30.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.222+0000 7eff95017640 1 -- 172.21.15.164:0/656199461 <== osd.2 v2:172.21.15.164:6808/3795914978 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7eff90040040 con 0x7eff8004dc20 2024-09-13T23:05:30.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.222+0000 7eff98b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.222+0000 7eff98b22800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-13T23:05:30.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.222+0000 7eff98b22800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T23:05:30.223 INFO:teuthology.orchestra.run.smithi164.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T23:05:30.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.223+0000 7efe4afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:30.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.223+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94018214783920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524be2f0 con 0x5582524a6d90 2024-09-13T23:05:30.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.224+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94018214783920] v32'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.224+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94018214757968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524b6bb0 con 0x7eff8004dc20 2024-09-13T23:05:30.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.225+0000 7eff95017640 1 -- 172.21.15.164:0/656199461 <== osd.2 v2:172.21.15.164:6808/3795914978 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94018214757968] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff90040040 con 0x7eff8004dc20 2024-09-13T23:05:30.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.225+0000 7eff98b22800 20 remove_watcher() i=0 2024-09-13T23:05:30.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.225+0000 7eff98b22800 2 removed watcher, disabling cache 2024-09-13T23:05:30.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.225+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94018214760176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524b6bb0 con 0x5582524a6d90 2024-09-13T23:05:30.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.226+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94018214760176] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.226+0000 7eff98b22800 20 remove_watcher() i=1 2024-09-13T23:05:30.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.226+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94018214767600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524b6bb0 con 0x5582524acd40 2024-09-13T23:05:30.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.227+0000 7eff8ffff640 1 -- 172.21.15.164:0/656199461 <== osd.3 v2:172.21.15.164:6816/93809510 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94018214767600] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff80009050 con 0x5582524acd40 2024-09-13T23:05:30.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.227+0000 7eff98b22800 20 remove_watcher() i=2 2024-09-13T23:05:30.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.227+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94018214772464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524b6bb0 con 0x7eff8004dc20 2024-09-13T23:05:30.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.228+0000 7eff95017640 1 -- 172.21.15.164:0/656199461 <== osd.2 v2:172.21.15.164:6808/3795914978 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94018214772464] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff90040040 con 0x7eff8004dc20 2024-09-13T23:05:30.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.228+0000 7eff98b22800 20 remove_watcher() i=3 2024-09-13T23:05:30.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.228+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94018214775168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524b6bb0 con 0x5582524a6d90 2024-09-13T23:05:30.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.229+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94018214775168] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x5582524a6d90 2024-09-13T23:05:30.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.229+0000 7eff98b22800 20 remove_watcher() i=4 2024-09-13T23:05:30.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.229+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94018214778720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524b4980 con 0x7eff90031040 2024-09-13T23:05:30.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.230+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94018214778720] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x7eff90031040 2024-09-13T23:05:30.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.230+0000 7eff98b22800 20 remove_watcher() i=5 2024-09-13T23:05:30.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.230+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94018214776224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524b6bb0 con 0x7eff90031040 2024-09-13T23:05:30.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.231+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94018214776224] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x7eff90031040 2024-09-13T23:05:30.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.231+0000 7eff98b22800 20 remove_watcher() i=6 2024-09-13T23:05:30.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.231+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94018214763936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5582524b6bb0 con 0x7eff90031040 2024-09-13T23:05:30.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.232+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94018214763936] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff8807a030 con 0x7eff90031040 2024-09-13T23:05:30.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.232+0000 7eff98b22800 20 remove_watcher() i=7 2024-09-13T23:05:30.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.232+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7eff90031040 msgr2=0x7eff90032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.232+0000 7eff98b22800 1 --2- 172.21.15.164:0/656199461 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7eff90031040 0x7eff90032430 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.232+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5582524a6d90 msgr2=0x5582524a9250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.232+0000 7eff98b22800 1 --2- 172.21.15.164:0/656199461 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5582524a6d90 0x5582524a9250 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.232+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7eff8004dc20 msgr2=0x7eff80023810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.232+0000 7eff98b22800 1 --2- 172.21.15.164:0/656199461 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7eff8004dc20 0x7eff80023810 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.232+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5582524acd40 msgr2=0x5582524af130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.232+0000 7eff98b22800 1 --2- 172.21.15.164:0/656199461 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5582524acd40 0x5582524af130 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.232+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efe60036b90 msgr2=0x7efe60039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.232+0000 7eff98b22800 1 --2- 172.21.15.164:0/656199461 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efe60036b90 0x7efe60039050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x55825246f090 tx=0x7eff9001f000 comp rx=0 tx=0).stop 2024-09-13T23:05:30.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.232+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252493f80 msgr2=0x55825249b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.232+0000 7eff94816640 1 -- 172.21.15.164:0/656199461 reap_dead start 2024-09-13T23:05:30.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.232+0000 7eff98b22800 1 --2- 172.21.15.164:0/656199461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252493f80 0x55825249b4a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7eff8004bf90 tx=0x7eff8000ce90 comp rx=0 tx=0).stop 2024-09-13T23:05:30.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.233+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 shutdown_connections 2024-09-13T23:05:30.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.233+0000 7eff98b22800 1 --2- 172.21.15.164:0/656199461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252493f80 0x55825249b4a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.233+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 >> 172.21.15.164:0/656199461 conn(0x558252487ad0 msgr2=0x558252485ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.233+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 shutdown_connections 2024-09-13T23:05:30.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.233+0000 7eff98b22800 1 -- 172.21.15.164:0/656199461 wait complete. 2024-09-13T23:05:30.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.233+0000 7eff98b22800 1 -- 172.21.15.164:0/2522722800 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efe6c036b90 msgr2=0x7efe6c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.233+0000 7eff98b22800 1 --2- 172.21.15.164:0/2522722800 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efe6c036b90 0x7efe6c039050 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x55825246f910 tx=0x7eff90005840 comp rx=0 tx=0).stop 2024-09-13T23:05:30.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.233+0000 7eff98b22800 1 -- 172.21.15.164:0/2522722800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55825247ea60 msgr2=0x55825247ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.233+0000 7eff98b22800 1 --2- 172.21.15.164:0/2522722800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55825247ea60 0x55825247ee80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7eff80001ed0 tx=0x7eff8000d7a0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.233+0000 7eff98b22800 1 -- 172.21.15.164:0/2522722800 shutdown_connections 2024-09-13T23:05:30.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.233+0000 7eff98b22800 1 --2- 172.21.15.164:0/2522722800 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efe6c036b90 0x7efe6c039050 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.233+0000 7eff98b22800 1 --2- 172.21.15.164:0/2522722800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55825247ea60 0x55825247ee80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.233+0000 7eff98b22800 1 -- 172.21.15.164:0/2522722800 >> 172.21.15.164:0/2522722800 conn(0x5582524739f0 msgr2=0x558252476570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.233+0000 7eff98b22800 1 -- 172.21.15.164:0/2522722800 shutdown_connections 2024-09-13T23:05:30.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.233+0000 7eff98b22800 1 -- 172.21.15.164:0/2522722800 wait complete. 2024-09-13T23:05:30.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.233+0000 7eff98b22800 1 -- 172.21.15.164:0/3643474136 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x558252371e90 msgr2=0x55825246e0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.233+0000 7eff98b22800 1 --2- 172.21.15.164:0/3643474136 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x558252371e90 0x55825246e0d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.233+0000 7eff98b22800 1 -- 172.21.15.164:0/3643474136 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efe7c03af50 msgr2=0x7efe7c03d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.233+0000 7eff98b22800 1 --2- 172.21.15.164:0/3643474136 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efe7c03af50 0x7efe7c03d410 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7eff80000f60 tx=0x7eff800012b0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.233+0000 7eff98b22800 1 -- 172.21.15.164:0/3643474136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252371550 msgr2=0x558252467000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.233+0000 7eff98b22800 1 --2- 172.21.15.164:0/3643474136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252371550 0x558252467000 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x5582524604f0 tx=0x7eff88002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.233+0000 7eff98b22800 1 -- 172.21.15.164:0/3643474136 shutdown_connections 2024-09-13T23:05:30.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.233+0000 7eff98b22800 1 --2- 172.21.15.164:0/3643474136 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x558252371e90 0x55825246e0d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.233+0000 7eff98b22800 1 --2- 172.21.15.164:0/3643474136 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efe7c03af50 0x7efe7c03d410 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.233+0000 7eff98b22800 1 --2- 172.21.15.164:0/3643474136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558252371550 0x558252467000 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.233+0000 7eff98b22800 1 -- 172.21.15.164:0/3643474136 >> 172.21.15.164:0/3643474136 conn(0x55825236cde0 msgr2=0x5582524598c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.234+0000 7eff98b22800 1 -- 172.21.15.164:0/3643474136 shutdown_connections 2024-09-13T23:05:30.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.234+0000 7eff98b22800 1 -- 172.21.15.164:0/3643474136 wait complete. 2024-09-13T23:05:30.242 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T23:05:30.243 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-13T23:05:30.243 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-13T23:05:30.243 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-13T23:05:30.287 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:30.288 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:30.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.288+0000 7fc37bd42800 1 Processor -- start 2024-09-13T23:05:30.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.288+0000 7fc37bd42800 1 -- start start 2024-09-13T23:05:30.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.288+0000 7fc37bd42800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55f2c21f3550 0x55f2c21f3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.288+0000 7fc37bd42800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f2c20b3b30 con 0x55f2c21f3e90 2024-09-13T23:05:30.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.288+0000 7fc37bd42800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55f2c2095360 con 0x55f2c21f3550 2024-09-13T23:05:30.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.288+0000 7fc377a90640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55f2c21f3550 0x55f2c21f3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.288+0000 7fc377a90640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55f2c21f3550 0x55f2c21f3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55884/0 (socket says 172.21.15.164:55884) 2024-09-13T23:05:30.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.288+0000 7fc377a90640 1 -- 172.21.15.164:0/2060138190 learned_addr learned my addr 172.21.15.164:0/2060138190 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.288+0000 7fc37728f640 1 --1- 172.21.15.164:0/2060138190 >> v1:172.21.15.17:6789/0 conn(0x55f2c21f3e90 0x55f2c21f8a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40664/0 (socket says 172.21.15.164:40664) 2024-09-13T23:05:30.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.289+0000 7fc377a90640 1 -- 172.21.15.164:0/2060138190 >> v1:172.21.15.17:6789/0 conn(0x55f2c21f3e90 legacy=0x55f2c21f8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.289+0000 7fc377a90640 1 -- 172.21.15.164:0/2060138190 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2c20bbe00 con 0x55f2c21f3550 2024-09-13T23:05:30.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.290+0000 7fc377a90640 1 --2- 172.21.15.164:0/2060138190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c21f3550 0x55f2c21f3950 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc36800a520 tx=0x7fc368045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d2ad35278860592 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.291+0000 7fc376a8e640 1 -- 172.21.15.164:0/2060138190 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc368055070 con 0x55f2c21f3550 2024-09-13T23:05:30.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.291+0000 7fc376a8e640 1 -- 172.21.15.164:0/2060138190 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3680515b0 con 0x55f2c21f3550 2024-09-13T23:05:30.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.291+0000 7fc376a8e640 1 -- 172.21.15.164:0/2060138190 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3680518d0 con 0x55f2c21f3550 2024-09-13T23:05:30.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.291+0000 7fc37bd42800 1 -- 172.21.15.164:0/2060138190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c21f3550 msgr2=0x55f2c21f3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.291+0000 7fc37bd42800 1 --2- 172.21.15.164:0/2060138190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c21f3550 0x55f2c21f3950 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc36800a520 tx=0x7fc368045ba0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.291+0000 7fc37bd42800 1 -- 172.21.15.164:0/2060138190 shutdown_connections 2024-09-13T23:05:30.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.291+0000 7fc37bd42800 1 --2- 172.21.15.164:0/2060138190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c21f3550 0x55f2c21f3950 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.291+0000 7fc37bd42800 1 -- 172.21.15.164:0/2060138190 >> 172.21.15.164:0/2060138190 conn(0x55f2c21eede0 msgr2=0x55f2c21f1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.291+0000 7fc37bd42800 1 -- 172.21.15.164:0/2060138190 shutdown_connections 2024-09-13T23:05:30.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.291+0000 7fc37bd42800 1 -- 172.21.15.164:0/2060138190 wait complete. 2024-09-13T23:05:30.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.305+0000 7fc37bd42800 1 Processor -- start 2024-09-13T23:05:30.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.306+0000 7fc37bd42800 1 -- start start 2024-09-13T23:05:30.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.306+0000 7fc37bd42800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c21f3550 0x55f2c21685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.306+0000 7fc37bd42800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f2c2140330 con 0x55f2c21f3550 2024-09-13T23:05:30.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.306+0000 7fc377a90640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c21f3550 0x55f2c21685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.306+0000 7fc377a90640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c21f3550 0x55f2c21685a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55892/0 (socket says 172.21.15.164:55892) 2024-09-13T23:05:30.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.306+0000 7fc377a90640 1 -- 172.21.15.164:0/2813272169 learned_addr learned my addr 172.21.15.164:0/2813272169 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.306+0000 7fc377a90640 1 -- 172.21.15.164:0/2813272169 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2c208dbc0 con 0x55f2c21f3550 2024-09-13T23:05:30.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.306+0000 7fc377a90640 1 --2- 172.21.15.164:0/2813272169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c21f3550 0x55f2c21685a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc368025da0 tx=0x7fc368051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5950b3391d0b9d56 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.307+0000 7fc265e0b640 1 -- 172.21.15.164:0/2813272169 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc368051890 con 0x55f2c21f3550 2024-09-13T23:05:30.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.307+0000 7fc265e0b640 1 -- 172.21.15.164:0/2813272169 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc368051ac0 con 0x55f2c21f3550 2024-09-13T23:05:30.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.307+0000 7fc265e0b640 1 -- 172.21.15.164:0/2813272169 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc368051da0 con 0x55f2c21f3550 2024-09-13T23:05:30.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.307+0000 7fc37bd42800 1 -- 172.21.15.164:0/2813272169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c21f3550 msgr2=0x55f2c21685a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.307+0000 7fc37bd42800 1 --2- 172.21.15.164:0/2813272169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c21f3550 0x55f2c21685a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc368025da0 tx=0x7fc368051000 comp rx=0 tx=0).stop 2024-09-13T23:05:30.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.307+0000 7fc37bd42800 1 -- 172.21.15.164:0/2813272169 shutdown_connections 2024-09-13T23:05:30.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.307+0000 7fc37bd42800 1 --2- 172.21.15.164:0/2813272169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c21f3550 0x55f2c21685a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.307+0000 7fc37bd42800 1 -- 172.21.15.164:0/2813272169 >> 172.21.15.164:0/2813272169 conn(0x55f2c21eede0 msgr2=0x55f2c22de100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.307+0000 7fc37bd42800 1 -- 172.21.15.164:0/2813272169 shutdown_connections 2024-09-13T23:05:30.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.307+0000 7fc37bd42800 1 -- 172.21.15.164:0/2813272169 wait complete. 2024-09-13T23:05:30.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.308+0000 7fc37bd42800 1 Processor -- start 2024-09-13T23:05:30.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.308+0000 7fc37bd42800 1 -- start start 2024-09-13T23:05:30.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.308+0000 7fc37bd42800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c21f3550 0x55f2c22e3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.308+0000 7fc37bd42800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f2c21fa570 con 0x55f2c21f3550 2024-09-13T23:05:30.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.308+0000 7fc377a90640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c21f3550 0x55f2c22e3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.308+0000 7fc377a90640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c21f3550 0x55f2c22e3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55902/0 (socket says 172.21.15.164:55902) 2024-09-13T23:05:30.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.308+0000 7fc377a90640 1 -- 172.21.15.164:0/2937556683 learned_addr learned my addr 172.21.15.164:0/2937556683 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.309+0000 7fc377a90640 1 -- 172.21.15.164:0/2937556683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2c20a1fe0 con 0x55f2c21f3550 2024-09-13T23:05:30.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.309+0000 7fc377a90640 1 --2- 172.21.15.164:0/2937556683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c21f3550 0x55f2c22e3ec0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc368000c00 tx=0x7fc368002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.309+0000 7fc25ffff640 1 -- 172.21.15.164:0/2937556683 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc368073070 con 0x55f2c21f3550 2024-09-13T23:05:30.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.309+0000 7fc25ffff640 1 -- 172.21.15.164:0/2937556683 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc36805a450 con 0x55f2c21f3550 2024-09-13T23:05:30.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.309+0000 7fc25ffff640 1 -- 172.21.15.164:0/2937556683 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc36805a730 con 0x55f2c21f3550 2024-09-13T23:05:30.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.309+0000 7fc37bd42800 1 -- 172.21.15.164:0/2937556683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f2c22e25b0 con 0x55f2c21f3550 2024-09-13T23:05:30.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.309+0000 7fc37bd42800 1 -- 172.21.15.164:0/2937556683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2c22e2b30 con 0x55f2c21f3550 2024-09-13T23:05:30.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.310+0000 7fc25ffff640 1 -- 172.21.15.164:0/2937556683 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc368076070 con 0x55f2c21f3550 2024-09-13T23:05:30.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.310+0000 7fc25ffff640 1 --2- 172.21.15.164:0/2937556683 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc260036b40 0x7fc260039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.310+0000 7fc25ffff640 1 -- 172.21.15.164:0/2937556683 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc368062070 con 0x55f2c21f3550 2024-09-13T23:05:30.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.310+0000 7fc37728f640 1 --2- 172.21.15.164:0/2937556683 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc260036b40 0x7fc260039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.310+0000 7fc37bd42800 1 --2- 172.21.15.164:0/2937556683 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f2c21f3e90 0x55f2c22f44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.310+0000 7fc37bd42800 1 -- 172.21.15.164:0/2937556683 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2c22f49f0 con 0x55f2c21f3e90 2024-09-13T23:05:30.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.310+0000 7fc378291640 1 --2- 172.21.15.164:0/2937556683 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f2c21f3e90 0x55f2c22f44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.311+0000 7fc37728f640 1 --2- 172.21.15.164:0/2937556683 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc260036b40 0x7fc260039000 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc360001e40 tx=0x7fc3600013a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.311+0000 7fc378291640 1 --2- 172.21.15.164:0/2937556683 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f2c21f3e90 0x55f2c22f44b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.311+0000 7fc378291640 1 -- 172.21.15.164:0/2937556683 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc37000a4a0 con 0x55f2c21f3e90 2024-09-13T23:05:30.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.311+0000 7fc37bd42800 1 -- 172.21.15.164:0/2937556683 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2c22e3020 con 0x55f2c21f3e90 2024-09-13T23:05:30.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.311+0000 7fc378291640 1 -- 172.21.15.164:0/2937556683 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc37000a4a0 con 0x55f2c21f3e90 2024-09-13T23:05:30.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.311+0000 7fc37bd42800 1 -- 172.21.15.164:0/2937556683 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2c22f67a0 con 0x55f2c21f3e90 2024-09-13T23:05:30.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.312+0000 7fc378291640 1 -- 172.21.15.164:0/2937556683 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc37000a4a0 con 0x55f2c21f3e90 2024-09-13T23:05:30.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.312+0000 7fc37bd42800 1 -- 172.21.15.164:0/2937556683 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2c22f5a00 con 0x55f2c21f3e90 2024-09-13T23:05:30.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.312+0000 7fc378291640 1 -- 172.21.15.164:0/2937556683 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc37000a4a0 con 0x55f2c21f3e90 2024-09-13T23:05:30.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.312+0000 7fc37bd42800 1 -- 172.21.15.164:0/2937556683 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2c22f5e50 con 0x55f2c21f3e90 2024-09-13T23:05:30.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.312+0000 7fc378291640 1 -- 172.21.15.164:0/2937556683 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc37000a4a0 con 0x55f2c21f3e90 2024-09-13T23:05:30.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.312+0000 7fc37bd42800 1 Processor -- start 2024-09-13T23:05:30.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.312+0000 7fc37bd42800 1 -- start start 2024-09-13T23:05:30.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.313+0000 7fc37bd42800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c2304cf0 0x55f2c2305110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.313+0000 7fc37bd42800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f2c208f580 con 0x55f2c2304cf0 2024-09-13T23:05:30.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.313+0000 7fc37728f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c2304cf0 0x55f2c2305110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.313+0000 7fc37728f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c2304cf0 0x55f2c2305110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55910/0 (socket says 172.21.15.164:55910) 2024-09-13T23:05:30.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.313+0000 7fc37728f640 1 -- 172.21.15.164:0/30482809 learned_addr learned my addr 172.21.15.164:0/30482809 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.313+0000 7fc37728f640 1 -- 172.21.15.164:0/30482809 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2c2305650 con 0x55f2c2304cf0 2024-09-13T23:05:30.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.313+0000 7fc37728f640 1 --2- 172.21.15.164:0/30482809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c2304cf0 0x55f2c2305110 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc36000e630 tx=0x7fc36000ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.314+0000 7fc25dffb640 1 -- 172.21.15.164:0/30482809 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc360022070 con 0x55f2c2304cf0 2024-09-13T23:05:30.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.314+0000 7fc25dffb640 1 -- 172.21.15.164:0/30482809 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc36000d520 con 0x55f2c2304cf0 2024-09-13T23:05:30.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.314+0000 7fc25dffb640 1 -- 172.21.15.164:0/30482809 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc36000d840 con 0x55f2c2304cf0 2024-09-13T23:05:30.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.314+0000 7fc37bd42800 1 -- 172.21.15.164:0/30482809 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f2c23058e0 con 0x55f2c2304cf0 2024-09-13T23:05:30.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.314+0000 7fc37bd42800 1 -- 172.21.15.164:0/30482809 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2c23085c0 con 0x55f2c2304cf0 2024-09-13T23:05:30.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.314+0000 7fc25dffb640 1 -- 172.21.15.164:0/30482809 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc360025070 con 0x55f2c2304cf0 2024-09-13T23:05:30.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.315+0000 7fc25dffb640 1 --2- 172.21.15.164:0/30482809 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc250036b40 0x7fc250039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.315+0000 7fc25dffb640 1 -- 172.21.15.164:0/30482809 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc36004e1a0 con 0x55f2c2304cf0 2024-09-13T23:05:30.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.315+0000 7fc378291640 1 --2- 172.21.15.164:0/30482809 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc250036b40 0x7fc250039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.315+0000 7fc37bd42800 1 Processor -- start 2024-09-13T23:05:30.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.315+0000 7fc378291640 1 --2- 172.21.15.164:0/30482809 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc250036b40 0x7fc250039000 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55f2c22f5520 tx=0x7fc370005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.315+0000 7fc37bd42800 1 -- start start 2024-09-13T23:05:30.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.315+0000 7fc37bd42800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c2311a00 0x55f2c2311e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.315+0000 7fc37bd42800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f2c22e6660 con 0x55f2c2311a00 2024-09-13T23:05:30.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.315+0000 7fc37728f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c2311a00 0x55f2c2311e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.315+0000 7fc37728f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c2311a00 0x55f2c2311e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55920/0 (socket says 172.21.15.164:55920) 2024-09-13T23:05:30.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.316+0000 7fc37728f640 1 -- 172.21.15.164:0/1032405965 learned_addr learned my addr 172.21.15.164:0/1032405965 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.316+0000 7fc37728f640 1 -- 172.21.15.164:0/1032405965 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2c23123d0 con 0x55f2c2311a00 2024-09-13T23:05:30.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.316+0000 7fc37728f640 1 --2- 172.21.15.164:0/1032405965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c2311a00 0x55f2c2311e00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc36004c500 tx=0x7fc360025f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55192a3079de6168 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.316+0000 7fc256ffd640 1 -- 172.21.15.164:0/1032405965 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc360045070 con 0x55f2c2311a00 2024-09-13T23:05:30.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.316+0000 7fc256ffd640 1 -- 172.21.15.164:0/1032405965 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3600263b0 con 0x55f2c2311a00 2024-09-13T23:05:30.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.316+0000 7fc256ffd640 1 -- 172.21.15.164:0/1032405965 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3600242c0 con 0x55f2c2311a00 2024-09-13T23:05:30.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.317+0000 7fc37bd42800 1 -- 172.21.15.164:0/1032405965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c2311a00 msgr2=0x55f2c2311e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.317+0000 7fc37bd42800 1 --2- 172.21.15.164:0/1032405965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c2311a00 0x55f2c2311e00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc36004c500 tx=0x7fc360025f20 comp rx=0 tx=0).stop 2024-09-13T23:05:30.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.317+0000 7fc37bd42800 1 -- 172.21.15.164:0/1032405965 shutdown_connections 2024-09-13T23:05:30.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.317+0000 7fc37bd42800 1 --2- 172.21.15.164:0/1032405965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c2311a00 0x55f2c2311e00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.317+0000 7fc37bd42800 1 -- 172.21.15.164:0/1032405965 >> 172.21.15.164:0/1032405965 conn(0x55f2c230dd60 msgr2=0x55f2c230be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.317+0000 7fc37bd42800 1 -- 172.21.15.164:0/1032405965 shutdown_connections 2024-09-13T23:05:30.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.317+0000 7fc37bd42800 1 -- 172.21.15.164:0/1032405965 wait complete. 2024-09-13T23:05:30.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.317+0000 7fc37bd42800 1 Processor -- start 2024-09-13T23:05:30.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.317+0000 7fc37bd42800 1 -- start start 2024-09-13T23:05:30.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.317+0000 7fc37bd42800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c2311a00 0x55f2c2318f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.317+0000 7fc37bd42800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f2c2312a40 con 0x55f2c2311a00 2024-09-13T23:05:30.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.317+0000 7fc37728f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c2311a00 0x55f2c2318f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.317+0000 7fc37728f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c2311a00 0x55f2c2318f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55934/0 (socket says 172.21.15.164:55934) 2024-09-13T23:05:30.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.317+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 learned_addr learned my addr 172.21.15.164:0/4155210313 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.318+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2c2319450 con 0x55f2c2311a00 2024-09-13T23:05:30.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.318+0000 7fc37728f640 1 --2- 172.21.15.164:0/4155210313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c2311a00 0x55f2c2318f10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc360043040 tx=0x7fc36004c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.318+0000 7fc2557fa640 1 -- 172.21.15.164:0/4155210313 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc360035020 con 0x55f2c2311a00 2024-09-13T23:05:30.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.318+0000 7fc2557fa640 1 -- 172.21.15.164:0/4155210313 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc360046040 con 0x55f2c2311a00 2024-09-13T23:05:30.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.318+0000 7fc2557fa640 1 -- 172.21.15.164:0/4155210313 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc360045070 con 0x55f2c2311a00 2024-09-13T23:05:30.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.318+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f2c2319450 con 0x55f2c2311a00 2024-09-13T23:05:30.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.318+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2c2319450 con 0x55f2c2311a00 2024-09-13T23:05:30.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.319+0000 7fc2557fa640 1 -- 172.21.15.164:0/4155210313 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc360038020 con 0x55f2c2311a00 2024-09-13T23:05:30.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.319+0000 7fc2557fa640 1 --2- 172.21.15.164:0/4155210313 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc240036af0 0x7fc240038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.319+0000 7fc2557fa640 1 -- 172.21.15.164:0/4155210313 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc36004fd20 con 0x55f2c2311a00 2024-09-13T23:05:30.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.319+0000 7fc378291640 1 --2- 172.21.15.164:0/4155210313 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc240036af0 0x7fc240038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.319+0000 7fc378291640 1 --2- 172.21.15.164:0/4155210313 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc240036af0 0x7fc240038fb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x55f2c22e2f50 tx=0x7fc37001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.320+0000 7fc37bd42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.320+0000 7fc37bd42800 1 --2- 172.21.15.164:0/4155210313 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f2c23246b0 0x55f2c2326b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.320+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2c23272c0 con 0x55f2c23246b0 2024-09-13T23:05:30.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.320+0000 7fc377a90640 1 --2- 172.21.15.164:0/4155210313 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f2c23246b0 0x55f2c2326b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.320+0000 7fc377a90640 1 --2- 172.21.15.164:0/4155210313 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f2c23246b0 0x55f2c2326b70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.320+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.320+0000 7fc37bd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.320+0000 7fc37bd42800 20 realm 2024-09-13T23:05:30.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.320+0000 7fc37bd42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.320+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2c23276d0 con 0x55f2c23246b0 2024-09-13T23:05:30.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.320+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.320+0000 7fc37bd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.320+0000 7fc37bd42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:30.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.320+0000 7fc37bd42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.320+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2327fa0 con 0x55f2c23246b0 2024-09-13T23:05:30.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.321+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.321+0000 7fc37bd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.321+0000 7fc37bd42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.321+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2328340 con 0x55f2c23246b0 2024-09-13T23:05:30.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.321+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.321+0000 7fc37bd42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:30.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.321+0000 7fc37bd42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.321+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2328b90 con 0x55f2c23246b0 2024-09-13T23:05:30.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.321+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.321+0000 7fc37bd42800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:30.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.321+0000 7fc37bd42800 20 searching for the correct realm 2024-09-13T23:05:30.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.321+0000 7fc37bd42800 1 --2- 172.21.15.164:0/4155210313 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55f2c232a900 0x55f2c232ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.321+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x55f2c232a900 2024-09-13T23:05:30.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.321+0000 7fc37728f640 1 --2- 172.21.15.164:0/4155210313 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55f2c232a900 0x55f2c232ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.322+0000 7fc37728f640 1 --2- 172.21.15.164:0/4155210313 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55f2c232a900 0x55f2c232ccf0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.322+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc360024030 con 0x55f2c232a900 2024-09-13T23:05:30.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.322+0000 7fc37728f640 1 --2- 172.21.15.164:0/4155210313 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc36003a020 0x7fc36001f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.322+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x7fc36003a020 2024-09-13T23:05:30.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.322+0000 7fc378291640 1 --2- 172.21.15.164:0/4155210313 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc36003a020 0x7fc36001f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.322+0000 7fc378291640 1 --2- 172.21.15.164:0/4155210313 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc36003a020 0x7fc36001f080 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.323+0000 7fc378291640 1 -- 172.21.15.164:0/4155210313 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc37001f070 con 0x7fc36003a020 2024-09-13T23:05:30.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.323+0000 7fc378291640 1 --2- 172.21.15.164:0/4155210313 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc370031040 0x7fc370032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.323+0000 7fc378291640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x7fc370031040 2024-09-13T23:05:30.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.323+0000 7fc377a90640 1 --2- 172.21.15.164:0/4155210313 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc370031040 0x7fc370032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.323+0000 7fc377a90640 1 --2- 172.21.15.164:0/4155210313 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc370031040 0x7fc370032940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.324+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36807f070 con 0x7fc370031040 2024-09-13T23:05:30.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.324+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x55f2c23246b0 2024-09-13T23:05:30.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.324+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.324+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x55f2c23246b0 2024-09-13T23:05:30.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.324+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.324+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x7fc370031040 2024-09-13T23:05:30.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.324+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36807f070 con 0x7fc370031040 2024-09-13T23:05:30.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.324+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x7fc370031040 2024-09-13T23:05:30.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.325+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36807f070 con 0x7fc370031040 2024-09-13T23:05:30.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.325+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x7fc36003a020 2024-09-13T23:05:30.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.325+0000 7fc378291640 1 -- 172.21.15.164:0/4155210313 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc37001f070 con 0x7fc36003a020 2024-09-13T23:05:30.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.325+0000 7fc378291640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x55f2c232a900 2024-09-13T23:05:30.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.325+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc360024030 con 0x55f2c232a900 2024-09-13T23:05:30.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.325+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x55f2c23246b0 2024-09-13T23:05:30.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.325+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.325+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x7fc370031040 2024-09-13T23:05:30.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.326+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36807f070 con 0x7fc370031040 2024-09-13T23:05:30.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.326+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x55f2c23246b0 2024-09-13T23:05:30.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.326+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.326+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x7fc36003a020 2024-09-13T23:05:30.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.326+0000 7fc378291640 1 -- 172.21.15.164:0/4155210313 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc37001f070 con 0x7fc36003a020 2024-09-13T23:05:30.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.326+0000 7fc378291640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x55f2c232a900 2024-09-13T23:05:30.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.327+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc360024030 con 0x55f2c232a900 2024-09-13T23:05:30.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.327+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x55f2c232a900 2024-09-13T23:05:30.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.327+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc360024030 con 0x55f2c232a900 2024-09-13T23:05:30.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.327+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x7fc370031040 2024-09-13T23:05:30.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.327+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36807f070 con 0x7fc370031040 2024-09-13T23:05:30.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.327+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x55f2c232a900 2024-09-13T23:05:30.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.327+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc360024030 con 0x55f2c232a900 2024-09-13T23:05:30.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.327+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x55f2c232a900 2024-09-13T23:05:30.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.327+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc360024030 con 0x55f2c232a900 2024-09-13T23:05:30.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.328+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x55f2c23246b0 2024-09-13T23:05:30.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.328+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.328+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x55f2c23246b0 2024-09-13T23:05:30.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.328+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.328+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x7fc370031040 2024-09-13T23:05:30.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.328+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36807f070 con 0x7fc370031040 2024-09-13T23:05:30.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.328+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x55f2c232a900 2024-09-13T23:05:30.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.329+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc360024030 con 0x55f2c232a900 2024-09-13T23:05:30.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.329+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x7fc36003a020 2024-09-13T23:05:30.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.329+0000 7fc378291640 1 -- 172.21.15.164:0/4155210313 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc37001f070 con 0x7fc36003a020 2024-09-13T23:05:30.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.329+0000 7fc378291640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x55f2c23246b0 2024-09-13T23:05:30.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.329+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.329+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x7fc370031040 2024-09-13T23:05:30.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.329+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36807f070 con 0x7fc370031040 2024-09-13T23:05:30.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.329+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x55f2c232a900 2024-09-13T23:05:30.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.330+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc360024030 con 0x55f2c232a900 2024-09-13T23:05:30.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.330+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x7fc370031040 2024-09-13T23:05:30.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.330+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36807f070 con 0x7fc370031040 2024-09-13T23:05:30.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.330+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x7fc36003a020 2024-09-13T23:05:30.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.330+0000 7fc378291640 1 -- 172.21.15.164:0/4155210313 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc37001f070 con 0x7fc36003a020 2024-09-13T23:05:30.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.330+0000 7fc378291640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x55f2c232a900 2024-09-13T23:05:30.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.330+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc360024030 con 0x55f2c232a900 2024-09-13T23:05:30.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.330+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x7fc370031040 2024-09-13T23:05:30.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.331+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36807f070 con 0x7fc370031040 2024-09-13T23:05:30.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.331+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x55f2c23246b0 2024-09-13T23:05:30.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.331+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.331+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d300 con 0x7fc36003a020 2024-09-13T23:05:30.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.331+0000 7fc378291640 1 -- 172.21.15.164:0/4155210313 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc37001f070 con 0x7fc36003a020 2024-09-13T23:05:30.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.331+0000 7fc37bd42800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:30.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.331+0000 7fc37bd42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:30.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.331+0000 7fc37bd42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:30.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.331+0000 7fc37bd42800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:30.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.331+0000 7fc37bd42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:30.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.331+0000 7fc37bd42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:30.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.331+0000 7fc37bd42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.331+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2329540 con 0x55f2c23246b0 2024-09-13T23:05:30.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.331+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.331+0000 7fc37bd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.331+0000 7fc37bd42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.331+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2329de0 con 0x55f2c23246b0 2024-09-13T23:05:30.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.332+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.332+0000 7fc37bd42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:30.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.332+0000 7fc37bd42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.332+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232d780 con 0x55f2c23246b0 2024-09-13T23:05:30.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.332+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.332+0000 7fc37bd42800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:30.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.332+0000 7fc37bd42800 20 zone default found 2024-09-13T23:05:30.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.332+0000 7fc37bd42800 4 Realm: () 2024-09-13T23:05:30.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.332+0000 7fc37bd42800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:30.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.332+0000 7fc37bd42800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:30.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.332+0000 7fc37bd42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:30.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.332+0000 7fc37bd42800 20 zonegroup default 2024-09-13T23:05:30.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.332+0000 7fc37bd42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.332+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232dc30 con 0x7fc370031040 2024-09-13T23:05:30.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.332+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x7fc370031040 2024-09-13T23:05:30.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.332+0000 7fc37bd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.332+0000 7fc37bd42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.332+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232f610 con 0x55f2c232a900 2024-09-13T23:05:30.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.333+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc360024030 con 0x55f2c232a900 2024-09-13T23:05:30.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.333+0000 7fc37bd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.333+0000 7fc37bd42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.333+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232fa40 con 0x55f2c232a900 2024-09-13T23:05:30.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.333+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc360024030 con 0x55f2c232a900 2024-09-13T23:05:30.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.333+0000 7fc37bd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.333+0000 7fc37bd42800 20 started sync module instance, tier type = 2024-09-13T23:05:30.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.333+0000 7fc37bd42800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:30.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.333+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232eaa0 con 0x7fc36003a020 2024-09-13T23:05:30.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.334+0000 7fc378291640 1 -- 172.21.15.164:0/4155210313 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc370040040 con 0x7fc36003a020 2024-09-13T23:05:30.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.334+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94501128564368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c232e700 con 0x7fc36003a020 2024-09-13T23:05:30.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.334+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2330970 con 0x55f2c23246b0 2024-09-13T23:05:30.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.335+0000 7fc378291640 1 -- 172.21.15.164:0/4155210313 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94501128564368] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc370040040 con 0x7fc36003a020 2024-09-13T23:05:30.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.335+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.335+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94501128570048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c23308e0 con 0x55f2c23246b0 2024-09-13T23:05:30.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.335+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2331830 con 0x55f2c232a900 2024-09-13T23:05:30.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.337+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94501128570048] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.337+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc360024030 con 0x55f2c232a900 2024-09-13T23:05:30.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.337+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94501128573824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2331c20 con 0x55f2c232a900 2024-09-13T23:05:30.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.337+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c23325e0 con 0x7fc36003a020 2024-09-13T23:05:30.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.338+0000 7fc378291640 1 -- 172.21.15.164:0/4155210313 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc370040040 con 0x7fc36003a020 2024-09-13T23:05:30.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.338+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94501128573824] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc360024030 con 0x55f2c232a900 2024-09-13T23:05:30.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.338+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94501128577840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2332a00 con 0x7fc36003a020 2024-09-13T23:05:30.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.338+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2333430 con 0x55f2c23246b0 2024-09-13T23:05:30.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.339+0000 7fc378291640 1 -- 172.21.15.164:0/4155210313 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94501128577840] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc370040040 con 0x7fc36003a020 2024-09-13T23:05:30.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.339+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.339+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94501128572176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c23333f0 con 0x55f2c23246b0 2024-09-13T23:05:30.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.339+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2333e80 con 0x7fc370031040 2024-09-13T23:05:30.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.340+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94501128572176] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.340+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x7fc370031040 2024-09-13T23:05:30.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.340+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94501128583568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c23333f0 con 0x7fc370031040 2024-09-13T23:05:30.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.340+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2334890 con 0x7fc370031040 2024-09-13T23:05:30.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.341+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x7fc370031040 2024-09-13T23:05:30.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.341+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94501128586208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2334cb0 con 0x7fc370031040 2024-09-13T23:05:30.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.341+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c23357d0 con 0x7fc370031040 2024-09-13T23:05:30.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.341+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94501128583568] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x7fc370031040 2024-09-13T23:05:30.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.342+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94501128586208] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x7fc370031040 2024-09-13T23:05:30.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.342+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x7fc370031040 2024-09-13T23:05:30.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.342+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94501128589984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2334800 con 0x7fc370031040 2024-09-13T23:05:30.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.342+0000 7fc37bd42800 20 add_watcher() i=0 2024-09-13T23:05:30.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.342+0000 7fc37bd42800 20 add_watcher() i=1 2024-09-13T23:05:30.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.342+0000 7fc37bd42800 20 add_watcher() i=2 2024-09-13T23:05:30.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.342+0000 7fc37bd42800 20 add_watcher() i=3 2024-09-13T23:05:30.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.342+0000 7fc37bd42800 20 add_watcher() i=4 2024-09-13T23:05:30.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.342+0000 7fc37bd42800 20 add_watcher() i=5 2024-09-13T23:05:30.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.342+0000 7fc37bd42800 20 add_watcher() i=6 2024-09-13T23:05:30.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.343+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94501128589984] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x7fc370031040 2024-09-13T23:05:30.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.343+0000 7fc37bd42800 20 add_watcher() i=7 2024-09-13T23:05:30.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.343+0000 7fc37bd42800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:30.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.343+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2c23388d0 con 0x55f2c23246b0 2024-09-13T23:05:30.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.344+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.344+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94501128580928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2335d50 con 0x55f2c23246b0 2024-09-13T23:05:30.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.345+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94501128580928] v32'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.345+0000 7fc22dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:30.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.345+0000 7fc37bd42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:30.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.345+0000 7fc37bd42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:30.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.345+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2341160 con 0x55f2c23246b0 2024-09-13T23:05:30.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.346+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.346+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2341830 con 0x7fc370031040 2024-09-13T23:05:30.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.347+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x7fc370031040 2024-09-13T23:05:30.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.347+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2341830 con 0x55f2c232a900 2024-09-13T23:05:30.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.348+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc360024030 con 0x55f2c232a900 2024-09-13T23:05:30.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.348+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2342080 con 0x55f2c23246b0 2024-09-13T23:05:30.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.349+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'32 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.349+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2340940 con 0x7fc36003a020 2024-09-13T23:05:30.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.350+0000 7fc378291640 1 -- 172.21.15.164:0/4155210313 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'23 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc370040040 con 0x7fc36003a020 2024-09-13T23:05:30.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.350+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2340940 con 0x55f2c232a900 2024-09-13T23:05:30.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.351+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'15 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc360024030 con 0x55f2c232a900 2024-09-13T23:05:30.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.351+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2342700 con 0x55f2c23246b0 2024-09-13T23:05:30.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.352+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.352+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2342700 con 0x7fc370031040 2024-09-13T23:05:30.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.353+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'15 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x7fc370031040 2024-09-13T23:05:30.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.354+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2342700 con 0x7fc36003a020 2024-09-13T23:05:30.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.354+0000 7fc378291640 1 -- 172.21.15.164:0/4155210313 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc370040040 con 0x7fc36003a020 2024-09-13T23:05:30.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.355+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2342c70 con 0x55f2c232a900 2024-09-13T23:05:30.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.355+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc360024030 con 0x55f2c232a900 2024-09-13T23:05:30.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.356+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2343010 con 0x7fc36003a020 2024-09-13T23:05:30.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.356+0000 7fc378291640 1 -- 172.21.15.164:0/4155210313 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'24 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc370040040 con 0x7fc36003a020 2024-09-13T23:05:30.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.356+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2343580 con 0x7fc370031040 2024-09-13T23:05:30.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.358+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x7fc370031040 2024-09-13T23:05:30.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.358+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2343580 con 0x7fc36003a020 2024-09-13T23:05:30.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.358+0000 7fc378291640 1 -- 172.21.15.164:0/4155210313 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc370040040 con 0x7fc36003a020 2024-09-13T23:05:30.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.359+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2343610 con 0x7fc370031040 2024-09-13T23:05:30.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.361+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'21 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x7fc370031040 2024-09-13T23:05:30.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.361+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2343610 con 0x55f2c23246b0 2024-09-13T23:05:30.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.364+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'33 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.364+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2343610 con 0x55f2c232a900 2024-09-13T23:05:30.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.366+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc360024030 con 0x55f2c232a900 2024-09-13T23:05:30.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.366+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c23437e0 con 0x7fc36003a020 2024-09-13T23:05:30.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.372+0000 7fc378291640 1 -- 172.21.15.164:0/4155210313 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc370040040 con 0x7fc36003a020 2024-09-13T23:05:30.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.372+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c23437e0 con 0x55f2c232a900 2024-09-13T23:05:30.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.373+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc360024030 con 0x55f2c232a900 2024-09-13T23:05:30.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.373+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c23437e0 con 0x55f2c23246b0 2024-09-13T23:05:30.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.374+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.374+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c23437e0 con 0x55f2c23246b0 2024-09-13T23:05:30.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.376+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'34 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.376+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c23437e0 con 0x55f2c232a900 2024-09-13T23:05:30.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.377+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc360024030 con 0x55f2c232a900 2024-09-13T23:05:30.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.377+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c23437e0 con 0x7fc36003a020 2024-09-13T23:05:30.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.378+0000 7fc378291640 1 -- 172.21.15.164:0/4155210313 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc370040040 con 0x7fc36003a020 2024-09-13T23:05:30.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.378+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2343c80 con 0x55f2c232a900 2024-09-13T23:05:30.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.379+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc360024030 con 0x55f2c232a900 2024-09-13T23:05:30.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.379+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2343c80 con 0x55f2c232a900 2024-09-13T23:05:30.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.382+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 <== osd.3 v2:172.21.15.164:6816/93809510 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc360024030 con 0x55f2c232a900 2024-09-13T23:05:30.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.382+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2343c80 con 0x55f2c232a900 2024-09-13T23:05:30.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.385+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 <== osd.3 v2:172.21.15.164:6816/93809510 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc360024030 con 0x55f2c232a900 2024-09-13T23:05:30.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.385+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2343c80 con 0x55f2c232a900 2024-09-13T23:05:30.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.388+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 <== osd.3 v2:172.21.15.164:6816/93809510 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc360024030 con 0x55f2c232a900 2024-09-13T23:05:30.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.388+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2343c80 con 0x7fc370031040 2024-09-13T23:05:30.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.391+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x7fc370031040 2024-09-13T23:05:30.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.391+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2343c80 con 0x55f2c232a900 2024-09-13T23:05:30.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.393+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 <== osd.3 v2:172.21.15.164:6816/93809510 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc360024030 con 0x55f2c232a900 2024-09-13T23:05:30.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.393+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2343c80 con 0x7fc370031040 2024-09-13T23:05:30.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.395+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x7fc370031040 2024-09-13T23:05:30.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.395+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2343c80 con 0x55f2c232a900 2024-09-13T23:05:30.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.396+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 <== osd.3 v2:172.21.15.164:6816/93809510 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'19 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc360024030 con 0x55f2c232a900 2024-09-13T23:05:30.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.396+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2343c80 con 0x7fc370031040 2024-09-13T23:05:30.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.398+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'22 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x7fc370031040 2024-09-13T23:05:30.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.398+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2343c80 con 0x7fc36003a020 2024-09-13T23:05:30.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.400+0000 7fc378291640 1 -- 172.21.15.164:0/4155210313 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc370040040 con 0x7fc36003a020 2024-09-13T23:05:30.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.400+0000 7fc22cfe1640 20 reqs_thread_entry: start 2024-09-13T23:05:30.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.400+0000 7fc37bd42800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:30.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.400+0000 7fc37bd42800 20 Filter name: none 2024-09-13T23:05:30.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.400+0000 7fc1a67fc640 20 reqs_thread_entry: start 2024-09-13T23:05:30.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.400+0000 7fc37bd42800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-13T23:05:30.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.400+0000 7fc37bd42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.400+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2c236e5b0 con 0x7fc370031040 2024-09-13T23:05:30.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.400+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x7fc370031040 2024-09-13T23:05:30.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.401+0000 7fc37bd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.401+0000 7fc37bd42800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-13T23:05:30.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.401+0000 7fc37bd42800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T23:05:30.402 INFO:teuthology.orchestra.run.smithi164.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T23:05:30.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.401+0000 7fc22dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:30.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.401+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94501128580928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c233cb00 con 0x55f2c23246b0 2024-09-13T23:05:30.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.402+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94501128580928] v32'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.402+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94501128564368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2332f40 con 0x7fc36003a020 2024-09-13T23:05:30.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.405+0000 7fc378291640 1 -- 172.21.15.164:0/4155210313 <== osd.2 v2:172.21.15.164:6808/3795914978 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94501128564368] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc370040040 con 0x7fc36003a020 2024-09-13T23:05:30.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.405+0000 7fc37bd42800 20 remove_watcher() i=0 2024-09-13T23:05:30.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.405+0000 7fc37bd42800 2 removed watcher, disabling cache 2024-09-13T23:05:30.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.405+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94501128570048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2332f40 con 0x55f2c23246b0 2024-09-13T23:05:30.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.406+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94501128570048] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.406+0000 7fc37bd42800 20 remove_watcher() i=1 2024-09-13T23:05:30.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.406+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94501128573824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c23304c0 con 0x55f2c232a900 2024-09-13T23:05:30.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.410+0000 7fc37728f640 1 -- 172.21.15.164:0/4155210313 <== osd.3 v2:172.21.15.164:6816/93809510 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94501128573824] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc360024030 con 0x55f2c232a900 2024-09-13T23:05:30.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.410+0000 7fc37bd42800 20 remove_watcher() i=2 2024-09-13T23:05:30.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.410+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94501128577840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2332f40 con 0x7fc36003a020 2024-09-13T23:05:30.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.411+0000 7fc378291640 1 -- 172.21.15.164:0/4155210313 <== osd.2 v2:172.21.15.164:6808/3795914978 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94501128577840] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc370040040 con 0x7fc36003a020 2024-09-13T23:05:30.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.411+0000 7fc37bd42800 20 remove_watcher() i=3 2024-09-13T23:05:30.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.411+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94501128572176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c23304c0 con 0x55f2c23246b0 2024-09-13T23:05:30.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.413+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94501128572176] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x55f2c23246b0 2024-09-13T23:05:30.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.413+0000 7fc37bd42800 20 remove_watcher() i=4 2024-09-13T23:05:30.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.413+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94501128583568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2332f40 con 0x7fc370031040 2024-09-13T23:05:30.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.414+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94501128583568] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x7fc370031040 2024-09-13T23:05:30.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.414+0000 7fc37bd42800 20 remove_watcher() i=5 2024-09-13T23:05:30.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.414+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94501128586208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c23304c0 con 0x7fc370031040 2024-09-13T23:05:30.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.415+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94501128586208] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x7fc370031040 2024-09-13T23:05:30.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.415+0000 7fc37bd42800 20 remove_watcher() i=6 2024-09-13T23:05:30.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.415+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94501128589984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2c2332f40 con 0x7fc370031040 2024-09-13T23:05:30.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.416+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 <== osd.0 v2:172.21.15.17:6800/489863589 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94501128589984] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc36807f070 con 0x7fc370031040 2024-09-13T23:05:30.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.416+0000 7fc37bd42800 20 remove_watcher() i=7 2024-09-13T23:05:30.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.416+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc370031040 msgr2=0x7fc370032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.416+0000 7fc37bd42800 1 --2- 172.21.15.164:0/4155210313 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc370031040 0x7fc370032940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.416+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f2c23246b0 msgr2=0x55f2c2326b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.416+0000 7fc37bd42800 1 --2- 172.21.15.164:0/4155210313 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f2c23246b0 0x55f2c2326b70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.416+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc36003a020 msgr2=0x7fc36001f080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.416+0000 7fc37bd42800 1 --2- 172.21.15.164:0/4155210313 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc36003a020 0x7fc36001f080 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.416+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55f2c232a900 msgr2=0x55f2c232ccf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.416+0000 7fc37bd42800 1 --2- 172.21.15.164:0/4155210313 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55f2c232a900 0x55f2c232ccf0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.416+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc240036af0 msgr2=0x7fc240038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.416+0000 7fc37bd42800 1 --2- 172.21.15.164:0/4155210313 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc240036af0 0x7fc240038fb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x55f2c22e2f50 tx=0x7fc37001f000 comp rx=0 tx=0).stop 2024-09-13T23:05:30.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.416+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c2311a00 msgr2=0x55f2c2318f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.416+0000 7fc377a90640 1 -- 172.21.15.164:0/4155210313 reap_dead start 2024-09-13T23:05:30.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.416+0000 7fc37bd42800 1 --2- 172.21.15.164:0/4155210313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c2311a00 0x55f2c2318f10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc360043040 tx=0x7fc36004c460 comp rx=0 tx=0).stop 2024-09-13T23:05:30.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.416+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 shutdown_connections 2024-09-13T23:05:30.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.416+0000 7fc37bd42800 1 --2- 172.21.15.164:0/4155210313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c2311a00 0x55f2c2318f10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.416+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 >> 172.21.15.164:0/4155210313 conn(0x55f2c230dd60 msgr2=0x55f2c230be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.416+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 shutdown_connections 2024-09-13T23:05:30.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.416+0000 7fc37bd42800 1 -- 172.21.15.164:0/4155210313 wait complete. 2024-09-13T23:05:30.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.417+0000 7fc37bd42800 1 -- 172.21.15.164:0/30482809 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc250036b40 msgr2=0x7fc250039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.417+0000 7fc37bd42800 1 --2- 172.21.15.164:0/30482809 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc250036b40 0x7fc250039000 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55f2c22f5520 tx=0x7fc370005840 comp rx=0 tx=0).stop 2024-09-13T23:05:30.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.417+0000 7fc37bd42800 1 -- 172.21.15.164:0/30482809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c2304cf0 msgr2=0x55f2c2305110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.417+0000 7fc37bd42800 1 --2- 172.21.15.164:0/30482809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c2304cf0 0x55f2c2305110 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc36000e630 tx=0x7fc36000ea30 comp rx=0 tx=0).stop 2024-09-13T23:05:30.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.417+0000 7fc37bd42800 1 -- 172.21.15.164:0/30482809 shutdown_connections 2024-09-13T23:05:30.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.417+0000 7fc37bd42800 1 --2- 172.21.15.164:0/30482809 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc250036b40 0x7fc250039000 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.417+0000 7fc37bd42800 1 --2- 172.21.15.164:0/30482809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c2304cf0 0x55f2c2305110 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.417+0000 7fc37bd42800 1 -- 172.21.15.164:0/30482809 >> 172.21.15.164:0/30482809 conn(0x55f2c22f9c80 msgr2=0x55f2c22fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.417+0000 7fc37bd42800 1 -- 172.21.15.164:0/30482809 shutdown_connections 2024-09-13T23:05:30.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.417+0000 7fc37bd42800 1 -- 172.21.15.164:0/30482809 wait complete. 2024-09-13T23:05:30.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.417+0000 7fc37bd42800 1 -- 172.21.15.164:0/2937556683 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f2c21f3e90 msgr2=0x55f2c22f44b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.417+0000 7fc37bd42800 1 --2- 172.21.15.164:0/2937556683 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f2c21f3e90 0x55f2c22f44b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.417+0000 7fc37bd42800 1 -- 172.21.15.164:0/2937556683 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc260036b40 msgr2=0x7fc260039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.417+0000 7fc37bd42800 1 --2- 172.21.15.164:0/2937556683 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc260036b40 0x7fc260039000 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc360001e40 tx=0x7fc3600013a0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.417+0000 7fc37bd42800 1 -- 172.21.15.164:0/2937556683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c21f3550 msgr2=0x55f2c22e3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.417+0000 7fc37bd42800 1 --2- 172.21.15.164:0/2937556683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c21f3550 0x55f2c22e3ec0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc368000c00 tx=0x7fc368002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.417+0000 7fc37bd42800 1 -- 172.21.15.164:0/2937556683 shutdown_connections 2024-09-13T23:05:30.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.417+0000 7fc37bd42800 1 --2- 172.21.15.164:0/2937556683 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f2c21f3e90 0x55f2c22f44b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.417+0000 7fc37bd42800 1 --2- 172.21.15.164:0/2937556683 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc260036b40 0x7fc260039000 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.417+0000 7fc37bd42800 1 --2- 172.21.15.164:0/2937556683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2c21f3550 0x55f2c22e3ec0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.417+0000 7fc37bd42800 1 -- 172.21.15.164:0/2937556683 >> 172.21.15.164:0/2937556683 conn(0x55f2c21eede0 msgr2=0x55f2c22dc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.417+0000 7fc37bd42800 1 -- 172.21.15.164:0/2937556683 shutdown_connections 2024-09-13T23:05:30.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.417+0000 7fc37bd42800 1 -- 172.21.15.164:0/2937556683 wait complete. 2024-09-13T23:05:30.426 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T23:05:30.426 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-13T23:05:30.426 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-13T23:05:30.427 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-13T23:05:30.471 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:30.471 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:30.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.471+0000 7f789e40f800 1 Processor -- start 2024-09-13T23:05:30.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.471+0000 7f789e40f800 1 -- start start 2024-09-13T23:05:30.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.471+0000 7f789e40f800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x556d8a00d4c0 0x556d8a00d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.471+0000 7f789e40f800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556d89ecdb30 con 0x556d8a00de00 2024-09-13T23:05:30.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.471+0000 7f789e40f800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x556d89eaf360 con 0x556d8a00d4c0 2024-09-13T23:05:30.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.472+0000 7f7899aee640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x556d8a00d4c0 0x556d8a00d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.472+0000 7f78912ed640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x556d8a00de00 0x556d8a012980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40680/0 (socket says 172.21.15.164:40680) 2024-09-13T23:05:30.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.472+0000 7f7899aee640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x556d8a00d4c0 0x556d8a00d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55936/0 (socket says 172.21.15.164:55936) 2024-09-13T23:05:30.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.472+0000 7f78912ed640 1 -- 172.21.15.164:0/3774865749 learned_addr learned my addr 172.21.15.164:0/3774865749 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:30.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.472+0000 7f7899aee640 1 -- 172.21.15.164:0/3774865749 >> v1:172.21.15.17:6789/0 conn(0x556d8a00de00 legacy=0x556d8a012980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.472+0000 7f7899aee640 1 -- 172.21.15.164:0/3774865749 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d89ed5e00 con 0x556d8a00d4c0 2024-09-13T23:05:30.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.474+0000 7f7899aee640 1 --2- 172.21.15.164:0/3774865749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a00d4c0 0x556d8a00d8c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f788c00a470 tx=0x7f788c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5871be32c5367510 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.474+0000 7f78992ed640 1 -- 172.21.15.164:0/3774865749 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f788c053570 con 0x556d8a00d4c0 2024-09-13T23:05:30.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.474+0000 7f78992ed640 1 -- 172.21.15.164:0/3774865749 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f788c058070 con 0x556d8a00d4c0 2024-09-13T23:05:30.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.474+0000 7f78992ed640 1 -- 172.21.15.164:0/3774865749 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f788c053880 con 0x556d8a00d4c0 2024-09-13T23:05:30.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.475+0000 7f789e40f800 1 -- 172.21.15.164:0/3774865749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a00d4c0 msgr2=0x556d8a00d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.475+0000 7f789e40f800 1 --2- 172.21.15.164:0/3774865749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a00d4c0 0x556d8a00d8c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f788c00a470 tx=0x7f788c045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:30.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.475+0000 7f789e40f800 1 -- 172.21.15.164:0/3774865749 shutdown_connections 2024-09-13T23:05:30.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.475+0000 7f789e40f800 1 --2- 172.21.15.164:0/3774865749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a00d4c0 0x556d8a00d8c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.475+0000 7f789e40f800 1 -- 172.21.15.164:0/3774865749 >> 172.21.15.164:0/3774865749 conn(0x556d8a008df0 msgr2=0x556d8a00b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.475+0000 7f789e40f800 1 -- 172.21.15.164:0/3774865749 shutdown_connections 2024-09-13T23:05:30.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.475+0000 7f789e40f800 1 -- 172.21.15.164:0/3774865749 wait complete. 2024-09-13T23:05:30.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.489+0000 7f789e40f800 1 Processor -- start 2024-09-13T23:05:30.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.489+0000 7f789e40f800 1 -- start start 2024-09-13T23:05:30.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.489+0000 7f789e40f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a00d4c0 0x556d8a0fc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.489+0000 7f789e40f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556d89f5a330 con 0x556d8a00d4c0 2024-09-13T23:05:30.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.489+0000 7f7899aee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a00d4c0 0x556d8a0fc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.489+0000 7f7899aee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a00d4c0 0x556d8a0fc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55950/0 (socket says 172.21.15.164:55950) 2024-09-13T23:05:30.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.489+0000 7f7899aee640 1 -- 172.21.15.164:0/439121510 learned_addr learned my addr 172.21.15.164:0/439121510 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.489+0000 7f7899aee640 1 -- 172.21.15.164:0/439121510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d89ea7bc0 con 0x556d8a00d4c0 2024-09-13T23:05:30.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.490+0000 7f7899aee640 1 --2- 172.21.15.164:0/439121510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a00d4c0 0x556d8a0fc770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f788c025c20 tx=0x7f788c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897159803b92b786 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.490+0000 7f7787e07640 1 -- 172.21.15.164:0/439121510 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f788c05c650 con 0x556d8a00d4c0 2024-09-13T23:05:30.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.490+0000 7f7787e07640 1 -- 172.21.15.164:0/439121510 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f788c05c7f0 con 0x556d8a00d4c0 2024-09-13T23:05:30.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.490+0000 7f7787e07640 1 -- 172.21.15.164:0/439121510 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f788c05cad0 con 0x556d8a00d4c0 2024-09-13T23:05:30.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.491+0000 7f789e40f800 1 -- 172.21.15.164:0/439121510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a00d4c0 msgr2=0x556d8a0fc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.491+0000 7f789e40f800 1 --2- 172.21.15.164:0/439121510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a00d4c0 0x556d8a0fc770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f788c025c20 tx=0x7f788c051000 comp rx=0 tx=0).stop 2024-09-13T23:05:30.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.491+0000 7f789e40f800 1 -- 172.21.15.164:0/439121510 shutdown_connections 2024-09-13T23:05:30.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.491+0000 7f789e40f800 1 --2- 172.21.15.164:0/439121510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a00d4c0 0x556d8a0fc770 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.491+0000 7f789e40f800 1 -- 172.21.15.164:0/439121510 >> 172.21.15.164:0/439121510 conn(0x556d8a008df0 msgr2=0x556d8a0f8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.491+0000 7f789e40f800 1 -- 172.21.15.164:0/439121510 shutdown_connections 2024-09-13T23:05:30.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.491+0000 7f789e40f800 1 -- 172.21.15.164:0/439121510 wait complete. 2024-09-13T23:05:30.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.491+0000 7f789e40f800 1 Processor -- start 2024-09-13T23:05:30.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.491+0000 7f789e40f800 1 -- start start 2024-09-13T23:05:30.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.491+0000 7f789e40f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a00d4c0 0x556d8a102fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.491+0000 7f789e40f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556d8a0144e0 con 0x556d8a00d4c0 2024-09-13T23:05:30.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.491+0000 7f7899aee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a00d4c0 0x556d8a102fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.491+0000 7f7899aee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a00d4c0 0x556d8a102fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55960/0 (socket says 172.21.15.164:55960) 2024-09-13T23:05:30.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.491+0000 7f7899aee640 1 -- 172.21.15.164:0/1052838837 learned_addr learned my addr 172.21.15.164:0/1052838837 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.492+0000 7f7899aee640 1 -- 172.21.15.164:0/1052838837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d89ebbfe0 con 0x556d8a00d4c0 2024-09-13T23:05:30.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.492+0000 7f7899aee640 1 --2- 172.21.15.164:0/1052838837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a00d4c0 0x556d8a102fa0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f788c05e040 tx=0x7f788c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.492+0000 7f7786604640 1 -- 172.21.15.164:0/1052838837 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f788c05ce10 con 0x556d8a00d4c0 2024-09-13T23:05:30.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.492+0000 7f7786604640 1 -- 172.21.15.164:0/1052838837 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f788c068460 con 0x556d8a00d4c0 2024-09-13T23:05:30.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.492+0000 7f789e40f800 1 -- 172.21.15.164:0/1052838837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556d8a1034e0 con 0x556d8a00d4c0 2024-09-13T23:05:30.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.492+0000 7f7786604640 1 -- 172.21.15.164:0/1052838837 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f788c068740 con 0x556d8a00d4c0 2024-09-13T23:05:30.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.492+0000 7f789e40f800 1 -- 172.21.15.164:0/1052838837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d8a103a00 con 0x556d8a00d4c0 2024-09-13T23:05:30.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.493+0000 7f7786604640 1 -- 172.21.15.164:0/1052838837 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f788c070030 con 0x556d8a00d4c0 2024-09-13T23:05:30.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.493+0000 7f7786604640 1 --2- 172.21.15.164:0/1052838837 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7780036b40 0x7f7780039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.493+0000 7f7786604640 1 -- 172.21.15.164:0/1052838837 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f788c06e070 con 0x556d8a00d4c0 2024-09-13T23:05:30.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.493+0000 7f78912ed640 1 --2- 172.21.15.164:0/1052838837 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7780036b40 0x7f7780039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.493+0000 7f789e40f800 1 --2- 172.21.15.164:0/1052838837 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x556d8a00de00 0x556d8a109ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.493+0000 7f789e40f800 1 -- 172.21.15.164:0/1052838837 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d8a10a530 con 0x556d8a00de00 2024-09-13T23:05:30.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.493+0000 7f789a2ef640 1 --2- 172.21.15.164:0/1052838837 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x556d8a00de00 0x556d8a109ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.494+0000 7f78912ed640 1 --2- 172.21.15.164:0/1052838837 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7780036b40 0x7f7780039000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7884000f60 tx=0x7f78840012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.494+0000 7f789a2ef640 1 --2- 172.21.15.164:0/1052838837 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x556d8a00de00 0x556d8a109ec0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.494+0000 7f789a2ef640 1 -- 172.21.15.164:0/1052838837 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f789400a4a0 con 0x556d8a00de00 2024-09-13T23:05:30.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.494+0000 7f789e40f800 1 -- 172.21.15.164:0/1052838837 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1075e0 con 0x556d8a00de00 2024-09-13T23:05:30.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.494+0000 7f789a2ef640 1 -- 172.21.15.164:0/1052838837 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f789400a4a0 con 0x556d8a00de00 2024-09-13T23:05:30.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.494+0000 7f789e40f800 1 -- 172.21.15.164:0/1052838837 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d8a10c3a0 con 0x556d8a00de00 2024-09-13T23:05:30.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.495+0000 7f789a2ef640 1 -- 172.21.15.164:0/1052838837 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f789400a4a0 con 0x556d8a00de00 2024-09-13T23:05:30.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.495+0000 7f789e40f800 1 -- 172.21.15.164:0/1052838837 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d8a10b5d0 con 0x556d8a00de00 2024-09-13T23:05:30.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.495+0000 7f789a2ef640 1 -- 172.21.15.164:0/1052838837 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f789400a4a0 con 0x556d8a00de00 2024-09-13T23:05:30.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.495+0000 7f789e40f800 1 -- 172.21.15.164:0/1052838837 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d8a10ba20 con 0x556d8a00de00 2024-09-13T23:05:30.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.495+0000 7f789a2ef640 1 -- 172.21.15.164:0/1052838837 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f789400a4a0 con 0x556d8a00de00 2024-09-13T23:05:30.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.495+0000 7f789e40f800 1 Processor -- start 2024-09-13T23:05:30.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.495+0000 7f789e40f800 1 -- start start 2024-09-13T23:05:30.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.496+0000 7f789e40f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a11a930 0x556d8a11ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.496+0000 7f789e40f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556d89ea9580 con 0x556d8a11a930 2024-09-13T23:05:30.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.496+0000 7f78912ed640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a11a930 0x556d8a11ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.496+0000 7f78912ed640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a11a930 0x556d8a11ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55966/0 (socket says 172.21.15.164:55966) 2024-09-13T23:05:30.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.496+0000 7f78912ed640 1 -- 172.21.15.164:0/2875846820 learned_addr learned my addr 172.21.15.164:0/2875846820 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.496+0000 7f78912ed640 1 -- 172.21.15.164:0/2875846820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d8a11b290 con 0x556d8a11a930 2024-09-13T23:05:30.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.496+0000 7f78912ed640 1 --2- 172.21.15.164:0/2875846820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a11a930 0x556d8a11ad50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7884001ed0 tx=0x7f788400d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.496+0000 7f777f7fe640 1 -- 172.21.15.164:0/2875846820 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f788401b550 con 0x556d8a11a930 2024-09-13T23:05:30.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.497+0000 7f777f7fe640 1 -- 172.21.15.164:0/2875846820 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f788401b6f0 con 0x556d8a11a930 2024-09-13T23:05:30.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.497+0000 7f789e40f800 1 -- 172.21.15.164:0/2875846820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556d8a11b520 con 0x556d8a11a930 2024-09-13T23:05:30.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.497+0000 7f777f7fe640 1 -- 172.21.15.164:0/2875846820 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f788401b9d0 con 0x556d8a11a930 2024-09-13T23:05:30.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.497+0000 7f789e40f800 1 -- 172.21.15.164:0/2875846820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d8a11e200 con 0x556d8a11a930 2024-09-13T23:05:30.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.497+0000 7f777f7fe640 1 -- 172.21.15.164:0/2875846820 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7884023020 con 0x556d8a11a930 2024-09-13T23:05:30.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.498+0000 7f777f7fe640 1 --2- 172.21.15.164:0/2875846820 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7774036b40 0x7f7774039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.498+0000 7f777f7fe640 1 -- 172.21.15.164:0/2875846820 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7884021020 con 0x556d8a11a930 2024-09-13T23:05:30.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.498+0000 7f789a2ef640 1 --2- 172.21.15.164:0/2875846820 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7774036b40 0x7f7774039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.498+0000 7f789e40f800 1 Processor -- start 2024-09-13T23:05:30.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.498+0000 7f789e40f800 1 -- start start 2024-09-13T23:05:30.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.498+0000 7f789a2ef640 1 --2- 172.21.15.164:0/2875846820 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7774036b40 0x7f7774039000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x556d8a10b0f0 tx=0x7f7894005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.498+0000 7f789e40f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a12ba50 0x556d8a12be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.498+0000 7f789e40f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556d8a0fcec0 con 0x556d8a12ba50 2024-09-13T23:05:30.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.498+0000 7f78912ed640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a12ba50 0x556d8a12be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.498+0000 7f78912ed640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a12ba50 0x556d8a12be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55980/0 (socket says 172.21.15.164:55980) 2024-09-13T23:05:30.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.498+0000 7f78912ed640 1 -- 172.21.15.164:0/801450523 learned_addr learned my addr 172.21.15.164:0/801450523 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.499+0000 7f78912ed640 1 -- 172.21.15.164:0/801450523 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d8a12c420 con 0x556d8a12ba50 2024-09-13T23:05:30.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.499+0000 7f78912ed640 1 --2- 172.21.15.164:0/801450523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a12ba50 0x556d8a12be50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f788404d180 tx=0x7f7884046be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48394270ad8e16b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.499+0000 7f777d7fa640 1 -- 172.21.15.164:0/801450523 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f788401be20 con 0x556d8a12ba50 2024-09-13T23:05:30.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.499+0000 7f777d7fa640 1 -- 172.21.15.164:0/801450523 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7884046070 con 0x556d8a12ba50 2024-09-13T23:05:30.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.499+0000 7f777d7fa640 1 -- 172.21.15.164:0/801450523 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f788400c360 con 0x556d8a12ba50 2024-09-13T23:05:30.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.499+0000 7f789e40f800 1 -- 172.21.15.164:0/801450523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a12ba50 msgr2=0x556d8a12be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.499+0000 7f789e40f800 1 --2- 172.21.15.164:0/801450523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a12ba50 0x556d8a12be50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f788404d180 tx=0x7f7884046be0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.499+0000 7f789e40f800 1 -- 172.21.15.164:0/801450523 shutdown_connections 2024-09-13T23:05:30.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.499+0000 7f789e40f800 1 --2- 172.21.15.164:0/801450523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a12ba50 0x556d8a12be50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.499+0000 7f789e40f800 1 -- 172.21.15.164:0/801450523 >> 172.21.15.164:0/801450523 conn(0x556d8a1239a0 msgr2=0x556d8a121aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.499+0000 7f789e40f800 1 -- 172.21.15.164:0/801450523 shutdown_connections 2024-09-13T23:05:30.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.499+0000 7f789e40f800 1 -- 172.21.15.164:0/801450523 wait complete. 2024-09-13T23:05:30.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.500+0000 7f789e40f800 1 Processor -- start 2024-09-13T23:05:30.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.500+0000 7f789e40f800 1 -- start start 2024-09-13T23:05:30.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.500+0000 7f789e40f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a12ba50 0x556d8a132f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.500+0000 7f789e40f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556d8a12ca90 con 0x556d8a12ba50 2024-09-13T23:05:30.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.500+0000 7f78912ed640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a12ba50 0x556d8a132f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.500+0000 7f78912ed640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a12ba50 0x556d8a132f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55990/0 (socket says 172.21.15.164:55990) 2024-09-13T23:05:30.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.500+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 learned_addr learned my addr 172.21.15.164:0/2311376129 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.500+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d8a133470 con 0x556d8a12ba50 2024-09-13T23:05:30.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.500+0000 7f78912ed640 1 --2- 172.21.15.164:0/2311376129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a12ba50 0x556d8a132f30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f788400dcc0 tx=0x7f788404d110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.501+0000 7f776b7fe640 1 -- 172.21.15.164:0/2311376129 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7884019d50 con 0x556d8a12ba50 2024-09-13T23:05:30.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.501+0000 7f776b7fe640 1 -- 172.21.15.164:0/2311376129 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f788400c360 con 0x556d8a12ba50 2024-09-13T23:05:30.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.501+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556d8a133700 con 0x556d8a12ba50 2024-09-13T23:05:30.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.501+0000 7f776b7fe640 1 -- 172.21.15.164:0/2311376129 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7884024e10 con 0x556d8a12ba50 2024-09-13T23:05:30.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.501+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d8a133700 con 0x556d8a12ba50 2024-09-13T23:05:30.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.501+0000 7f776b7fe640 1 -- 172.21.15.164:0/2311376129 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7884025980 con 0x556d8a12ba50 2024-09-13T23:05:30.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.502+0000 7f776b7fe640 1 --2- 172.21.15.164:0/2311376129 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7764036af0 0x7f7764038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.502+0000 7f776b7fe640 1 -- 172.21.15.164:0/2311376129 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7884039c50 con 0x556d8a12ba50 2024-09-13T23:05:30.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.502+0000 7f789a2ef640 1 --2- 172.21.15.164:0/2311376129 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7764036af0 0x7f7764038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.502+0000 7f789a2ef640 1 --2- 172.21.15.164:0/2311376129 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7764036af0 0x7f7764038fb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x556d8a107530 tx=0x7f789401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.502+0000 7f789e40f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.502+0000 7f789e40f800 1 --2- 172.21.15.164:0/2311376129 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x556d8a13e850 0x556d8a140d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.502+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d8a141460 con 0x556d8a13e850 2024-09-13T23:05:30.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.502+0000 7f7899aee640 1 --2- 172.21.15.164:0/2311376129 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x556d8a13e850 0x556d8a140d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.503+0000 7f7899aee640 1 --2- 172.21.15.164:0/2311376129 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x556d8a13e850 0x556d8a140d10 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.503+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.503+0000 7f789e40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.503+0000 7f789e40f800 20 realm 2024-09-13T23:05:30.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.503+0000 7f789e40f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.503+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d8a141870 con 0x556d8a13e850 2024-09-13T23:05:30.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.503+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.503+0000 7f789e40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.503+0000 7f789e40f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:30.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.503+0000 7f789e40f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.503+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d8a142140 con 0x556d8a13e850 2024-09-13T23:05:30.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.503+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.503+0000 7f789e40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.503+0000 7f789e40f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.503+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1424e0 con 0x556d8a13e850 2024-09-13T23:05:30.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.504+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.504+0000 7f789e40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:30.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.504+0000 7f789e40f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.504+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d8a142d30 con 0x556d8a13e850 2024-09-13T23:05:30.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.504+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.504+0000 7f789e40f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:30.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.504+0000 7f789e40f800 20 searching for the correct realm 2024-09-13T23:05:30.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.504+0000 7f789e40f800 1 --2- 172.21.15.164:0/2311376129 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x556d8a144aa0 0x556d8a146e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.504+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x556d8a144aa0 2024-09-13T23:05:30.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.504+0000 7f78912ed640 1 --2- 172.21.15.164:0/2311376129 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x556d8a144aa0 0x556d8a146e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.504+0000 7f78912ed640 1 --2- 172.21.15.164:0/2311376129 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x556d8a144aa0 0x556d8a146e90 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.505+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7884009050 con 0x556d8a144aa0 2024-09-13T23:05:30.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.505+0000 7f78912ed640 1 --2- 172.21.15.164:0/2311376129 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f788401dbc0 0x7f788400c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.505+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x7f788401dbc0 2024-09-13T23:05:30.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.505+0000 7f789a2ef640 1 --2- 172.21.15.164:0/2311376129 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f788401dbc0 0x7f788400c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.505+0000 7f789a2ef640 1 --2- 172.21.15.164:0/2311376129 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f788401dbc0 0x7f788400c580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.505+0000 7f789a2ef640 1 -- 172.21.15.164:0/2311376129 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f789401f070 con 0x7f788401dbc0 2024-09-13T23:05:30.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.505+0000 7f789a2ef640 1 --2- 172.21.15.164:0/2311376129 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7894031040 0x7f7894032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.505+0000 7f789a2ef640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x7f7894031040 2024-09-13T23:05:30.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.505+0000 7f7899aee640 1 --2- 172.21.15.164:0/2311376129 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7894031040 0x7f7894032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.506+0000 7f7899aee640 1 --2- 172.21.15.164:0/2311376129 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7894031040 0x7f7894032430 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.506+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f788c079070 con 0x7f7894031040 2024-09-13T23:05:30.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.506+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x556d8a13e850 2024-09-13T23:05:30.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.506+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.506+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x556d8a13e850 2024-09-13T23:05:30.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.506+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.507+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x7f7894031040 2024-09-13T23:05:30.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.507+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f788c079070 con 0x7f7894031040 2024-09-13T23:05:30.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.507+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x7f7894031040 2024-09-13T23:05:30.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.507+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f788c079070 con 0x7f7894031040 2024-09-13T23:05:30.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.507+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x7f788401dbc0 2024-09-13T23:05:30.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.507+0000 7f789a2ef640 1 -- 172.21.15.164:0/2311376129 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f789401f070 con 0x7f788401dbc0 2024-09-13T23:05:30.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.507+0000 7f789a2ef640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x556d8a144aa0 2024-09-13T23:05:30.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.508+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7884009050 con 0x556d8a144aa0 2024-09-13T23:05:30.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.508+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x556d8a13e850 2024-09-13T23:05:30.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.508+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.508+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x7f7894031040 2024-09-13T23:05:30.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.508+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f788c079070 con 0x7f7894031040 2024-09-13T23:05:30.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.508+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x556d8a13e850 2024-09-13T23:05:30.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.508+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.508+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x7f788401dbc0 2024-09-13T23:05:30.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.509+0000 7f789a2ef640 1 -- 172.21.15.164:0/2311376129 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f789401f070 con 0x7f788401dbc0 2024-09-13T23:05:30.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.509+0000 7f789a2ef640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x556d8a144aa0 2024-09-13T23:05:30.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.509+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7884009050 con 0x556d8a144aa0 2024-09-13T23:05:30.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.509+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x556d8a144aa0 2024-09-13T23:05:30.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.509+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7884009050 con 0x556d8a144aa0 2024-09-13T23:05:30.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.509+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x7f7894031040 2024-09-13T23:05:30.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.509+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f788c079070 con 0x7f7894031040 2024-09-13T23:05:30.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.509+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x556d8a144aa0 2024-09-13T23:05:30.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.510+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7884009050 con 0x556d8a144aa0 2024-09-13T23:05:30.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.510+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x556d8a144aa0 2024-09-13T23:05:30.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.510+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7884009050 con 0x556d8a144aa0 2024-09-13T23:05:30.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.510+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x556d8a13e850 2024-09-13T23:05:30.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.510+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.510+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x556d8a13e850 2024-09-13T23:05:30.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.510+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.510+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x7f7894031040 2024-09-13T23:05:30.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.511+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f788c079070 con 0x7f7894031040 2024-09-13T23:05:30.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.511+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x556d8a144aa0 2024-09-13T23:05:30.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.511+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7884009050 con 0x556d8a144aa0 2024-09-13T23:05:30.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.511+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x7f788401dbc0 2024-09-13T23:05:30.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.511+0000 7f789a2ef640 1 -- 172.21.15.164:0/2311376129 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f789401f070 con 0x7f788401dbc0 2024-09-13T23:05:30.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.511+0000 7f789a2ef640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x556d8a13e850 2024-09-13T23:05:30.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.511+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.511+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x7f7894031040 2024-09-13T23:05:30.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.512+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f788c079070 con 0x7f7894031040 2024-09-13T23:05:30.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.512+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x556d8a144aa0 2024-09-13T23:05:30.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.512+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7884009050 con 0x556d8a144aa0 2024-09-13T23:05:30.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.512+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x7f7894031040 2024-09-13T23:05:30.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.512+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f788c079070 con 0x7f7894031040 2024-09-13T23:05:30.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.512+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x7f788401dbc0 2024-09-13T23:05:30.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.512+0000 7f789a2ef640 1 -- 172.21.15.164:0/2311376129 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f789401f070 con 0x7f788401dbc0 2024-09-13T23:05:30.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.512+0000 7f789a2ef640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x556d8a144aa0 2024-09-13T23:05:30.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.513+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7884009050 con 0x556d8a144aa0 2024-09-13T23:05:30.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.513+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1474a0 con 0x7f7894031040 2024-09-13T23:05:30.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.513+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f788c079070 con 0x7f7894031040 2024-09-13T23:05:30.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.513+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f788c0a4040 con 0x556d8a13e850 2024-09-13T23:05:30.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.513+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.513+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f788c0a4040 con 0x7f788401dbc0 2024-09-13T23:05:30.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.514+0000 7f789a2ef640 1 -- 172.21.15.164:0/2311376129 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f789401f070 con 0x7f788401dbc0 2024-09-13T23:05:30.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.514+0000 7f789e40f800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:30.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.514+0000 7f789e40f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:30.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.514+0000 7f789e40f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:30.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.514+0000 7f789e40f800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:30.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.514+0000 7f789e40f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:30.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.514+0000 7f789e40f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:30.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.514+0000 7f789e40f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.514+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d8a143580 con 0x556d8a13e850 2024-09-13T23:05:30.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.514+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.514+0000 7f789e40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.514+0000 7f789e40f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.514+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d8a143970 con 0x556d8a13e850 2024-09-13T23:05:30.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.514+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.514+0000 7f789e40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:30.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.514+0000 7f789e40f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.514+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d8a143970 con 0x556d8a13e850 2024-09-13T23:05:30.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.514+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.514+0000 7f789e40f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:30.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.514+0000 7f789e40f800 20 zone default found 2024-09-13T23:05:30.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.514+0000 7f789e40f800 4 Realm: () 2024-09-13T23:05:30.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.514+0000 7f789e40f800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:30.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.514+0000 7f789e40f800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:30.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.514+0000 7f789e40f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:30.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.514+0000 7f789e40f800 20 zonegroup default 2024-09-13T23:05:30.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.514+0000 7f789e40f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.514+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d8a147900 con 0x7f7894031040 2024-09-13T23:05:30.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.515+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f788c079070 con 0x7f7894031040 2024-09-13T23:05:30.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.515+0000 7f789e40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.515+0000 7f789e40f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.515+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1492e0 con 0x556d8a144aa0 2024-09-13T23:05:30.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.515+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7884009050 con 0x556d8a144aa0 2024-09-13T23:05:30.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.515+0000 7f789e40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.515+0000 7f789e40f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.515+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d8a149680 con 0x556d8a144aa0 2024-09-13T23:05:30.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.515+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7884009050 con 0x556d8a144aa0 2024-09-13T23:05:30.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.515+0000 7f789e40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.515+0000 7f789e40f800 20 started sync module instance, tier type = 2024-09-13T23:05:30.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.515+0000 7f789e40f800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:30.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.515+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a148780 con 0x7f788401dbc0 2024-09-13T23:05:30.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.516+0000 7f789a2ef640 1 -- 172.21.15.164:0/2311376129 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7894040040 con 0x7f788401dbc0 2024-09-13T23:05:30.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.516+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93928956396240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a149a20 con 0x7f788401dbc0 2024-09-13T23:05:30.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.516+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a14a2b0 con 0x556d8a13e850 2024-09-13T23:05:30.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.518+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.518+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93928956402208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a149ec0 con 0x556d8a13e850 2024-09-13T23:05:30.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.518+0000 7f789a2ef640 1 -- 172.21.15.164:0/2311376129 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93928956396240] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7894040040 con 0x7f788401dbc0 2024-09-13T23:05:30.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.518+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a14b280 con 0x556d8a144aa0 2024-09-13T23:05:30.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.520+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93928956402208] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.520+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7884009050 con 0x556d8a144aa0 2024-09-13T23:05:30.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.520+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93928956405408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a148ba0 con 0x556d8a144aa0 2024-09-13T23:05:30.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.520+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a14bb20 con 0x7f788401dbc0 2024-09-13T23:05:30.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.523+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93928956405408] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7884009050 con 0x556d8a144aa0 2024-09-13T23:05:30.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.523+0000 7f789a2ef640 1 -- 172.21.15.164:0/2311376129 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7894040040 con 0x7f788401dbc0 2024-09-13T23:05:30.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.523+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93928956409456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a14bf40 con 0x7f788401dbc0 2024-09-13T23:05:30.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.523+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a14c940 con 0x556d8a13e850 2024-09-13T23:05:30.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.524+0000 7f789a2ef640 1 -- 172.21.15.164:0/2311376129 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93928956409456] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7894040040 con 0x7f788401dbc0 2024-09-13T23:05:30.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.524+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.524+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93928956413008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a14bf40 con 0x556d8a13e850 2024-09-13T23:05:30.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.524+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a14d390 con 0x7f7894031040 2024-09-13T23:05:30.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.525+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c079070 con 0x7f7894031040 2024-09-13T23:05:30.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.525+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93928956415648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a14d2c0 con 0x7f7894031040 2024-09-13T23:05:30.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.525+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a14e2e0 con 0x7f7894031040 2024-09-13T23:05:30.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.525+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93928956413008] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.526+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c079070 con 0x7f7894031040 2024-09-13T23:05:30.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.526+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93928956419536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a14e2a0 con 0x7f7894031040 2024-09-13T23:05:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.526+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a14ecf0 con 0x7f7894031040 2024-09-13T23:05:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.526+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93928956415648] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c079070 con 0x7f7894031040 2024-09-13T23:05:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.527+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c079070 con 0x7f7894031040 2024-09-13T23:05:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.527+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93928956419536] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c079070 con 0x7f7894031040 2024-09-13T23:05:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.527+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93928956417920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a14e840 con 0x7f7894031040 2024-09-13T23:05:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.527+0000 7f789e40f800 20 add_watcher() i=0 2024-09-13T23:05:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.527+0000 7f789e40f800 20 add_watcher() i=1 2024-09-13T23:05:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.527+0000 7f789e40f800 20 add_watcher() i=2 2024-09-13T23:05:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.527+0000 7f789e40f800 20 add_watcher() i=3 2024-09-13T23:05:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.527+0000 7f789e40f800 20 add_watcher() i=4 2024-09-13T23:05:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.527+0000 7f789e40f800 20 add_watcher() i=5 2024-09-13T23:05:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.527+0000 7f789e40f800 20 add_watcher() i=6 2024-09-13T23:05:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.530+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93928956417920] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c079070 con 0x7f7894031040 2024-09-13T23:05:30.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.530+0000 7f789e40f800 20 add_watcher() i=7 2024-09-13T23:05:30.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.530+0000 7f789e40f800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:30.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.530+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d8a151d20 con 0x556d8a13e850 2024-09-13T23:05:30.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.530+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.530+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93928956422208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a14f1e0 con 0x556d8a13e850 2024-09-13T23:05:30.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.531+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93928956422208] v32'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.531+0000 7f774bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:30.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.531+0000 7f789e40f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.531+0000 7f789e40f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.531+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a15a640 con 0x556d8a13e850 2024-09-13T23:05:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.533+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.533+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a15ad10 con 0x7f7894031040 2024-09-13T23:05:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.534+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f788c079070 con 0x7f7894031040 2024-09-13T23:05:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.534+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a15ad10 con 0x556d8a144aa0 2024-09-13T23:05:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.535+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7884009050 con 0x556d8a144aa0 2024-09-13T23:05:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.535+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a15b1a0 con 0x556d8a13e850 2024-09-13T23:05:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.536+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'37 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.536+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a15b230 con 0x7f788401dbc0 2024-09-13T23:05:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.537+0000 7f789a2ef640 1 -- 172.21.15.164:0/2311376129 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'26 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7894040040 con 0x7f788401dbc0 2024-09-13T23:05:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.537+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a15b7a0 con 0x556d8a144aa0 2024-09-13T23:05:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.538+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'17 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7884009050 con 0x556d8a144aa0 2024-09-13T23:05:30.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.538+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a15bc50 con 0x556d8a13e850 2024-09-13T23:05:30.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.541+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.541+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a15bc50 con 0x7f7894031040 2024-09-13T23:05:30.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.542+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'17 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f788c079070 con 0x7f7894031040 2024-09-13T23:05:30.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.542+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a15bc50 con 0x7f788401dbc0 2024-09-13T23:05:30.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.543+0000 7f789a2ef640 1 -- 172.21.15.164:0/2311376129 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7894040040 con 0x7f788401dbc0 2024-09-13T23:05:30.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.543+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a156310 con 0x556d8a144aa0 2024-09-13T23:05:30.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.544+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7884009050 con 0x556d8a144aa0 2024-09-13T23:05:30.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.544+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a156310 con 0x7f788401dbc0 2024-09-13T23:05:30.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.547+0000 7f789a2ef640 1 -- 172.21.15.164:0/2311376129 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'27 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7894040040 con 0x7f788401dbc0 2024-09-13T23:05:30.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.547+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a156310 con 0x7f7894031040 2024-09-13T23:05:30.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.548+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f788c079070 con 0x7f7894031040 2024-09-13T23:05:30.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.548+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a156310 con 0x7f788401dbc0 2024-09-13T23:05:30.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.549+0000 7f789a2ef640 1 -- 172.21.15.164:0/2311376129 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7894040040 con 0x7f788401dbc0 2024-09-13T23:05:30.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.549+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a15c7b0 con 0x7f7894031040 2024-09-13T23:05:30.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.550+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'23 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f788c079070 con 0x7f7894031040 2024-09-13T23:05:30.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.550+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a15c7b0 con 0x556d8a13e850 2024-09-13T23:05:30.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.551+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'38 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.551+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a15c7b0 con 0x556d8a144aa0 2024-09-13T23:05:30.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.552+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7884009050 con 0x556d8a144aa0 2024-09-13T23:05:30.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.552+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a15c7b0 con 0x7f788401dbc0 2024-09-13T23:05:30.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.553+0000 7f789a2ef640 1 -- 172.21.15.164:0/2311376129 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'28 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7894040040 con 0x7f788401dbc0 2024-09-13T23:05:30.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.553+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a15c7b0 con 0x556d8a144aa0 2024-09-13T23:05:30.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.555+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7884009050 con 0x556d8a144aa0 2024-09-13T23:05:30.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.555+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a15c7b0 con 0x556d8a13e850 2024-09-13T23:05:30.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.557+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.557+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a15c7b0 con 0x556d8a13e850 2024-09-13T23:05:30.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.558+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'39 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.558+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a156310 con 0x556d8a144aa0 2024-09-13T23:05:30.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.559+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7884009050 con 0x556d8a144aa0 2024-09-13T23:05:30.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.559+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a156310 con 0x7f788401dbc0 2024-09-13T23:05:30.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.560+0000 7f789a2ef640 1 -- 172.21.15.164:0/2311376129 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7894040040 con 0x7f788401dbc0 2024-09-13T23:05:30.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.560+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a156140 con 0x556d8a144aa0 2024-09-13T23:05:30.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.561+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7884009050 con 0x556d8a144aa0 2024-09-13T23:05:30.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.561+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a156140 con 0x556d8a144aa0 2024-09-13T23:05:30.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.563+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 <== osd.3 v2:172.21.15.164:6816/93809510 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7884009050 con 0x556d8a144aa0 2024-09-13T23:05:30.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.563+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a156140 con 0x556d8a144aa0 2024-09-13T23:05:30.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.564+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 <== osd.3 v2:172.21.15.164:6816/93809510 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7884009050 con 0x556d8a144aa0 2024-09-13T23:05:30.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.564+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a156140 con 0x556d8a144aa0 2024-09-13T23:05:30.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.565+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 <== osd.3 v2:172.21.15.164:6816/93809510 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7884009050 con 0x556d8a144aa0 2024-09-13T23:05:30.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.565+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a156140 con 0x7f7894031040 2024-09-13T23:05:30.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.566+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f788c079070 con 0x7f7894031040 2024-09-13T23:05:30.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.566+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a156140 con 0x556d8a144aa0 2024-09-13T23:05:30.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.567+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 <== osd.3 v2:172.21.15.164:6816/93809510 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7884009050 con 0x556d8a144aa0 2024-09-13T23:05:30.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.567+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a156140 con 0x7f7894031040 2024-09-13T23:05:30.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.568+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f788c079070 con 0x7f7894031040 2024-09-13T23:05:30.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.568+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a156140 con 0x556d8a144aa0 2024-09-13T23:05:30.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.570+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 <== osd.3 v2:172.21.15.164:6816/93809510 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7884009050 con 0x556d8a144aa0 2024-09-13T23:05:30.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.570+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a156140 con 0x7f7894031040 2024-09-13T23:05:30.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.571+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'24 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f788c079070 con 0x7f7894031040 2024-09-13T23:05:30.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.571+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a156140 con 0x7f788401dbc0 2024-09-13T23:05:30.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.572+0000 7f789a2ef640 1 -- 172.21.15.164:0/2311376129 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7894040040 con 0x7f788401dbc0 2024-09-13T23:05:30.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.572+0000 7f774affd640 20 reqs_thread_entry: start 2024-09-13T23:05:30.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.572+0000 7f789e40f800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:30.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.572+0000 7f789e40f800 20 Filter name: none 2024-09-13T23:05:30.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.572+0000 7f7748ff9640 20 reqs_thread_entry: start 2024-09-13T23:05:30.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.572+0000 7f789e40f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T23:05:30.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.572+0000 7f789e40f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.572+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d8a1875a0 con 0x7f7894031040 2024-09-13T23:05:30.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.573+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f788c079070 con 0x7f7894031040 2024-09-13T23:05:30.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.573+0000 7f789e40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.573+0000 7f789e40f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T23:05:30.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.573+0000 7f789e40f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:05:30.575 INFO:teuthology.orchestra.run.smithi164.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T23:05:30.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.574+0000 7f774bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:30.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.574+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93928956422208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a15bc50 con 0x556d8a13e850 2024-09-13T23:05:30.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.575+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93928956422208] v32'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.575+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93928956396240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a14e840 con 0x7f788401dbc0 2024-09-13T23:05:30.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.576+0000 7f789a2ef640 1 -- 172.21.15.164:0/2311376129 <== osd.2 v2:172.21.15.164:6808/3795914978 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93928956396240] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7894040040 con 0x7f788401dbc0 2024-09-13T23:05:30.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.576+0000 7f789e40f800 20 remove_watcher() i=0 2024-09-13T23:05:30.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.576+0000 7f789e40f800 2 removed watcher, disabling cache 2024-09-13T23:05:30.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.576+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93928956402208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a14e840 con 0x556d8a13e850 2024-09-13T23:05:30.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.577+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93928956402208] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.577+0000 7f789e40f800 20 remove_watcher() i=1 2024-09-13T23:05:30.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.577+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93928956405408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a149a20 con 0x556d8a144aa0 2024-09-13T23:05:30.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.578+0000 7f78912ed640 1 -- 172.21.15.164:0/2311376129 <== osd.3 v2:172.21.15.164:6816/93809510 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93928956405408] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7884009050 con 0x556d8a144aa0 2024-09-13T23:05:30.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.578+0000 7f789e40f800 20 remove_watcher() i=2 2024-09-13T23:05:30.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.578+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93928956409456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a14e840 con 0x7f788401dbc0 2024-09-13T23:05:30.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.579+0000 7f789a2ef640 1 -- 172.21.15.164:0/2311376129 <== osd.2 v2:172.21.15.164:6808/3795914978 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93928956409456] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7894040040 con 0x7f788401dbc0 2024-09-13T23:05:30.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.579+0000 7f789e40f800 20 remove_watcher() i=3 2024-09-13T23:05:30.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.579+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93928956413008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a14a6a0 con 0x556d8a13e850 2024-09-13T23:05:30.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.580+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93928956413008] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c079070 con 0x556d8a13e850 2024-09-13T23:05:30.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.580+0000 7f789e40f800 20 remove_watcher() i=4 2024-09-13T23:05:30.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.580+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93928956415648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a149a20 con 0x7f7894031040 2024-09-13T23:05:30.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.581+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93928956415648] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c079070 con 0x7f7894031040 2024-09-13T23:05:30.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.581+0000 7f789e40f800 20 remove_watcher() i=5 2024-09-13T23:05:30.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.581+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93928956419536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a14b670 con 0x7f7894031040 2024-09-13T23:05:30.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.582+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93928956419536] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c079070 con 0x7f7894031040 2024-09-13T23:05:30.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.582+0000 7f789e40f800 20 remove_watcher() i=6 2024-09-13T23:05:30.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.582+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93928956417920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d8a14e840 con 0x7f7894031040 2024-09-13T23:05:30.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.583+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 <== osd.0 v2:172.21.15.17:6800/489863589 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93928956417920] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f788c079070 con 0x7f7894031040 2024-09-13T23:05:30.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.583+0000 7f789e40f800 20 remove_watcher() i=7 2024-09-13T23:05:30.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.583+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7894031040 msgr2=0x7f7894032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.583+0000 7f789e40f800 1 --2- 172.21.15.164:0/2311376129 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7894031040 0x7f7894032430 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.583+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x556d8a13e850 msgr2=0x556d8a140d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.583+0000 7f789e40f800 1 --2- 172.21.15.164:0/2311376129 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x556d8a13e850 0x556d8a140d10 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.583+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f788401dbc0 msgr2=0x7f788400c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.583+0000 7f789e40f800 1 --2- 172.21.15.164:0/2311376129 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f788401dbc0 0x7f788400c580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.583+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x556d8a144aa0 msgr2=0x556d8a146e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.583+0000 7f789e40f800 1 --2- 172.21.15.164:0/2311376129 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x556d8a144aa0 0x556d8a146e90 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.583+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7764036af0 msgr2=0x7f7764038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.583+0000 7f789e40f800 1 --2- 172.21.15.164:0/2311376129 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7764036af0 0x7f7764038fb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x556d8a107530 tx=0x7f789401f000 comp rx=0 tx=0).stop 2024-09-13T23:05:30.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.584+0000 7f7899aee640 1 -- 172.21.15.164:0/2311376129 reap_dead start 2024-09-13T23:05:30.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.584+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a12ba50 msgr2=0x556d8a132f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.584+0000 7f789e40f800 1 --2- 172.21.15.164:0/2311376129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a12ba50 0x556d8a132f30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f788400dcc0 tx=0x7f788404d110 comp rx=0 tx=0).stop 2024-09-13T23:05:30.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.584+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 shutdown_connections 2024-09-13T23:05:30.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.584+0000 7f789e40f800 1 --2- 172.21.15.164:0/2311376129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a12ba50 0x556d8a132f30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.584+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 >> 172.21.15.164:0/2311376129 conn(0x556d8a1239a0 msgr2=0x556d8a121a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.584+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 shutdown_connections 2024-09-13T23:05:30.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.584+0000 7f789e40f800 1 -- 172.21.15.164:0/2311376129 wait complete. 2024-09-13T23:05:30.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.584+0000 7f789e40f800 1 -- 172.21.15.164:0/2875846820 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7774036b40 msgr2=0x7f7774039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.584+0000 7f789e40f800 1 --2- 172.21.15.164:0/2875846820 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7774036b40 0x7f7774039000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x556d8a10b0f0 tx=0x7f7894005840 comp rx=0 tx=0).stop 2024-09-13T23:05:30.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.584+0000 7f789e40f800 1 -- 172.21.15.164:0/2875846820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a11a930 msgr2=0x556d8a11ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.584+0000 7f789e40f800 1 --2- 172.21.15.164:0/2875846820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a11a930 0x556d8a11ad50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7884001ed0 tx=0x7f788400d7a0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.584+0000 7f789e40f800 1 -- 172.21.15.164:0/2875846820 shutdown_connections 2024-09-13T23:05:30.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.584+0000 7f789e40f800 1 --2- 172.21.15.164:0/2875846820 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7774036b40 0x7f7774039000 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.584+0000 7f789e40f800 1 --2- 172.21.15.164:0/2875846820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a11a930 0x556d8a11ad50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.584+0000 7f789e40f800 1 -- 172.21.15.164:0/2875846820 >> 172.21.15.164:0/2875846820 conn(0x556d8a10f8c0 msgr2=0x556d8a112440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.584+0000 7f789e40f800 1 -- 172.21.15.164:0/2875846820 shutdown_connections 2024-09-13T23:05:30.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.584+0000 7f789e40f800 1 -- 172.21.15.164:0/2875846820 wait complete. 2024-09-13T23:05:30.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.584+0000 7f789e40f800 1 -- 172.21.15.164:0/1052838837 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x556d8a00de00 msgr2=0x556d8a109ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.584+0000 7f789e40f800 1 --2- 172.21.15.164:0/1052838837 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x556d8a00de00 0x556d8a109ec0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.585+0000 7f789e40f800 1 -- 172.21.15.164:0/1052838837 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7780036b40 msgr2=0x7f7780039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.585+0000 7f789e40f800 1 --2- 172.21.15.164:0/1052838837 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7780036b40 0x7f7780039000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7884000f60 tx=0x7f78840012b0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.585+0000 7f789e40f800 1 -- 172.21.15.164:0/1052838837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a00d4c0 msgr2=0x556d8a102fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.585+0000 7f789e40f800 1 --2- 172.21.15.164:0/1052838837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a00d4c0 0x556d8a102fa0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f788c05e040 tx=0x7f788c002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.585+0000 7f789e40f800 1 -- 172.21.15.164:0/1052838837 shutdown_connections 2024-09-13T23:05:30.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.585+0000 7f789e40f800 1 --2- 172.21.15.164:0/1052838837 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x556d8a00de00 0x556d8a109ec0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.585+0000 7f789e40f800 1 --2- 172.21.15.164:0/1052838837 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7780036b40 0x7f7780039000 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.585+0000 7f789e40f800 1 --2- 172.21.15.164:0/1052838837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d8a00d4c0 0x556d8a102fa0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.585+0000 7f789e40f800 1 -- 172.21.15.164:0/1052838837 >> 172.21.15.164:0/1052838837 conn(0x556d8a008df0 msgr2=0x556d8a0f69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.585+0000 7f789e40f800 1 -- 172.21.15.164:0/1052838837 shutdown_connections 2024-09-13T23:05:30.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.585+0000 7f789e40f800 1 -- 172.21.15.164:0/1052838837 wait complete. 2024-09-13T23:05:30.595 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T23:05:30.595 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-13T23:05:30.596 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-13T23:05:30.596 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-13T23:05:30.640 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:30.641 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:30.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.641+0000 7f7d69287800 1 Processor -- start 2024-09-13T23:05:30.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.641+0000 7f7d69287800 1 -- start start 2024-09-13T23:05:30.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.641+0000 7f7d69287800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x560992316550 0x560992316950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.641+0000 7f7d69287800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5609921d6b30 con 0x560992316e90 2024-09-13T23:05:30.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.641+0000 7f7d69287800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x5609921b8360 con 0x560992316550 2024-09-13T23:05:30.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.641+0000 7f7d66d7b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x560992316550 0x560992316950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.641+0000 7f7d6657a640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x560992316e90 0x56099231ba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40690/0 (socket says 172.21.15.164:40690) 2024-09-13T23:05:30.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.641+0000 7f7d66d7b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x560992316550 0x560992316950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56006/0 (socket says 172.21.15.164:56006) 2024-09-13T23:05:30.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.641+0000 7f7d6657a640 1 -- 172.21.15.164:0/219129599 learned_addr learned my addr 172.21.15.164:0/219129599 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:30.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.642+0000 7f7d66d7b640 1 -- 172.21.15.164:0/219129599 >> v1:172.21.15.17:6789/0 conn(0x560992316e90 legacy=0x56099231ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.642+0000 7f7d66d7b640 1 -- 172.21.15.164:0/219129599 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609921dee00 con 0x560992316550 2024-09-13T23:05:30.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.643+0000 7f7d66d7b640 1 --2- 172.21.15.164:0/219129599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992316550 0x560992316950 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7d5800a470 tx=0x7f7d58045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a122904bc3d70acc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.643+0000 7f7d65d79640 1 -- 172.21.15.164:0/219129599 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d58053570 con 0x560992316550 2024-09-13T23:05:30.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.644+0000 7f7d65d79640 1 -- 172.21.15.164:0/219129599 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d58058070 con 0x560992316550 2024-09-13T23:05:30.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.644+0000 7f7d65d79640 1 -- 172.21.15.164:0/219129599 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d58053880 con 0x560992316550 2024-09-13T23:05:30.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.644+0000 7f7d69287800 1 -- 172.21.15.164:0/219129599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992316550 msgr2=0x560992316950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.644+0000 7f7d69287800 1 --2- 172.21.15.164:0/219129599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992316550 0x560992316950 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7d5800a470 tx=0x7f7d58045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:30.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.644+0000 7f7d69287800 1 -- 172.21.15.164:0/219129599 shutdown_connections 2024-09-13T23:05:30.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.644+0000 7f7d69287800 1 --2- 172.21.15.164:0/219129599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992316550 0x560992316950 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.644+0000 7f7d69287800 1 -- 172.21.15.164:0/219129599 >> 172.21.15.164:0/219129599 conn(0x560992311de0 msgr2=0x560992314200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.644+0000 7f7d69287800 1 -- 172.21.15.164:0/219129599 shutdown_connections 2024-09-13T23:05:30.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.644+0000 7f7d69287800 1 -- 172.21.15.164:0/219129599 wait complete. 2024-09-13T23:05:30.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.658+0000 7f7d69287800 1 Processor -- start 2024-09-13T23:05:30.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.658+0000 7f7d69287800 1 -- start start 2024-09-13T23:05:30.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.658+0000 7f7d69287800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992316550 0x56099228b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.658+0000 7f7d69287800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560992263330 con 0x560992316550 2024-09-13T23:05:30.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.659+0000 7f7d66d7b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992316550 0x56099228b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.659+0000 7f7d66d7b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992316550 0x56099228b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56018/0 (socket says 172.21.15.164:56018) 2024-09-13T23:05:30.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.659+0000 7f7d66d7b640 1 -- 172.21.15.164:0/3171482932 learned_addr learned my addr 172.21.15.164:0/3171482932 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.659+0000 7f7d66d7b640 1 -- 172.21.15.164:0/3171482932 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609921b0bc0 con 0x560992316550 2024-09-13T23:05:30.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.659+0000 7f7d66d7b640 1 --2- 172.21.15.164:0/3171482932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992316550 0x56099228b5a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7d58025c20 tx=0x7f7d58051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50df07bf017053c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.659+0000 7f7c54e09640 1 -- 172.21.15.164:0/3171482932 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d58053ba0 con 0x560992316550 2024-09-13T23:05:30.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.659+0000 7f7c54e09640 1 -- 172.21.15.164:0/3171482932 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d58063030 con 0x560992316550 2024-09-13T23:05:30.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.659+0000 7f7c54e09640 1 -- 172.21.15.164:0/3171482932 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d58053440 con 0x560992316550 2024-09-13T23:05:30.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.660+0000 7f7d69287800 1 -- 172.21.15.164:0/3171482932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992316550 msgr2=0x56099228b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.660+0000 7f7d69287800 1 --2- 172.21.15.164:0/3171482932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992316550 0x56099228b5a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7d58025c20 tx=0x7f7d58051000 comp rx=0 tx=0).stop 2024-09-13T23:05:30.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.660+0000 7f7d69287800 1 -- 172.21.15.164:0/3171482932 shutdown_connections 2024-09-13T23:05:30.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.660+0000 7f7d69287800 1 --2- 172.21.15.164:0/3171482932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992316550 0x56099228b5a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.660+0000 7f7d69287800 1 -- 172.21.15.164:0/3171482932 >> 172.21.15.164:0/3171482932 conn(0x560992311de0 msgr2=0x560992401150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.660+0000 7f7d69287800 1 -- 172.21.15.164:0/3171482932 shutdown_connections 2024-09-13T23:05:30.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.660+0000 7f7d69287800 1 -- 172.21.15.164:0/3171482932 wait complete. 2024-09-13T23:05:30.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.660+0000 7f7d69287800 1 Processor -- start 2024-09-13T23:05:30.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.660+0000 7f7d69287800 1 -- start start 2024-09-13T23:05:30.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.660+0000 7f7d69287800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992316550 0x56099240e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.660+0000 7f7d69287800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56099231d570 con 0x560992316550 2024-09-13T23:05:30.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.661+0000 7f7d66d7b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992316550 0x56099240e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.661+0000 7f7d66d7b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992316550 0x56099240e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56034/0 (socket says 172.21.15.164:56034) 2024-09-13T23:05:30.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.661+0000 7f7d66d7b640 1 -- 172.21.15.164:0/1692817739 learned_addr learned my addr 172.21.15.164:0/1692817739 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.661+0000 7f7d66d7b640 1 -- 172.21.15.164:0/1692817739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609921c4fe0 con 0x560992316550 2024-09-13T23:05:30.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.661+0000 7f7d66d7b640 1 --2- 172.21.15.164:0/1692817739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992316550 0x56099240e1f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x56099228aca0 tx=0x7f7d58002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.661+0000 7f7c53606640 1 -- 172.21.15.164:0/1692817739 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d58078070 con 0x560992316550 2024-09-13T23:05:30.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.661+0000 7f7c53606640 1 -- 172.21.15.164:0/1692817739 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d58053570 con 0x560992316550 2024-09-13T23:05:30.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.661+0000 7f7c53606640 1 -- 172.21.15.164:0/1692817739 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d58053850 con 0x560992316550 2024-09-13T23:05:30.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.661+0000 7f7d69287800 1 -- 172.21.15.164:0/1692817739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56099240e730 con 0x560992316550 2024-09-13T23:05:30.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.662+0000 7f7d69287800 1 -- 172.21.15.164:0/1692817739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56099240ecb0 con 0x560992316550 2024-09-13T23:05:30.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.662+0000 7f7c53606640 1 -- 172.21.15.164:0/1692817739 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7d5807b070 con 0x560992316550 2024-09-13T23:05:30.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.662+0000 7f7c53606640 1 --2- 172.21.15.164:0/1692817739 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c4c036b40 0x7f7c4c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.662+0000 7f7c53606640 1 -- 172.21.15.164:0/1692817739 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7d58070070 con 0x560992316550 2024-09-13T23:05:30.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.663+0000 7f7d6657a640 1 --2- 172.21.15.164:0/1692817739 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c4c036b40 0x7f7c4c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.663+0000 7f7d69287800 1 --2- 172.21.15.164:0/1692817739 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560992316e90 0x560992415260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.663+0000 7f7d69287800 1 -- 172.21.15.164:0/1692817739 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609924158b0 con 0x560992316e90 2024-09-13T23:05:30.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.663+0000 7f7d6757c640 1 --2- 172.21.15.164:0/1692817739 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560992316e90 0x560992415260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.663+0000 7f7d6657a640 1 --2- 172.21.15.164:0/1692817739 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c4c036b40 0x7f7c4c039000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c000f60 tx=0x7f7d5c0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.663+0000 7f7d6757c640 1 --2- 172.21.15.164:0/1692817739 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560992316e90 0x560992415260 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.663+0000 7f7d6757c640 1 -- 172.21.15.164:0/1692817739 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d6000a4a0 con 0x560992316e90 2024-09-13T23:05:30.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.663+0000 7f7d69287800 1 -- 172.21.15.164:0/1692817739 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560992412810 con 0x560992316e90 2024-09-13T23:05:30.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.664+0000 7f7d6757c640 1 -- 172.21.15.164:0/1692817739 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7d6000a4a0 con 0x560992316e90 2024-09-13T23:05:30.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.664+0000 7f7d69287800 1 -- 172.21.15.164:0/1692817739 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560992417700 con 0x560992316e90 2024-09-13T23:05:30.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.664+0000 7f7d6757c640 1 -- 172.21.15.164:0/1692817739 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7d6000a4a0 con 0x560992316e90 2024-09-13T23:05:30.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.664+0000 7f7d69287800 1 -- 172.21.15.164:0/1692817739 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609924167e0 con 0x560992316e90 2024-09-13T23:05:30.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.664+0000 7f7d6757c640 1 -- 172.21.15.164:0/1692817739 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7d6000a4a0 con 0x560992316e90 2024-09-13T23:05:30.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.664+0000 7f7d69287800 1 -- 172.21.15.164:0/1692817739 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560992416c30 con 0x560992316e90 2024-09-13T23:05:30.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.664+0000 7f7d6757c640 1 -- 172.21.15.164:0/1692817739 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7d6000a4a0 con 0x560992316e90 2024-09-13T23:05:30.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.665+0000 7f7d69287800 1 Processor -- start 2024-09-13T23:05:30.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.665+0000 7f7d69287800 1 -- start start 2024-09-13T23:05:30.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.665+0000 7f7d69287800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992406f70 0x5609924055c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.665+0000 7f7d69287800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5609921b2580 con 0x560992406f70 2024-09-13T23:05:30.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.665+0000 7f7d6657a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992406f70 0x5609924055c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.665+0000 7f7d6657a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992406f70 0x5609924055c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56048/0 (socket says 172.21.15.164:56048) 2024-09-13T23:05:30.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.665+0000 7f7d6657a640 1 -- 172.21.15.164:0/3303923876 learned_addr learned my addr 172.21.15.164:0/3303923876 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.665+0000 7f7d6657a640 1 -- 172.21.15.164:0/3303923876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560992407390 con 0x560992406f70 2024-09-13T23:05:30.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.666+0000 7f7d6657a640 1 --2- 172.21.15.164:0/3303923876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992406f70 0x5609924055c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c001ed0 tx=0x7f7d5c00d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.666+0000 7f7c50e01640 1 -- 172.21.15.164:0/3303923876 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d5c01b550 con 0x560992406f70 2024-09-13T23:05:30.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.666+0000 7f7c50e01640 1 -- 172.21.15.164:0/3303923876 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d5c01b6f0 con 0x560992406f70 2024-09-13T23:05:30.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.666+0000 7f7d69287800 1 -- 172.21.15.164:0/3303923876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560992405bc0 con 0x560992406f70 2024-09-13T23:05:30.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.666+0000 7f7c50e01640 1 -- 172.21.15.164:0/3303923876 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d5c01b9d0 con 0x560992406f70 2024-09-13T23:05:30.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.666+0000 7f7d69287800 1 -- 172.21.15.164:0/3303923876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609924060c0 con 0x560992406f70 2024-09-13T23:05:30.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.667+0000 7f7c50e01640 1 -- 172.21.15.164:0/3303923876 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7d5c023020 con 0x560992406f70 2024-09-13T23:05:30.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.667+0000 7f7c50e01640 1 --2- 172.21.15.164:0/3303923876 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c40036b40 0x7f7c40039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.667+0000 7f7c50e01640 1 -- 172.21.15.164:0/3303923876 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7d5c021020 con 0x560992406f70 2024-09-13T23:05:30.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.667+0000 7f7d6757c640 1 --2- 172.21.15.164:0/3303923876 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c40036b40 0x7f7c40039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.667+0000 7f7d69287800 1 Processor -- start 2024-09-13T23:05:30.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.667+0000 7f7d6757c640 1 --2- 172.21.15.164:0/3303923876 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c40036b40 0x7f7c40039000 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x560992416300 tx=0x7f7d60005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.667+0000 7f7d69287800 1 -- start start 2024-09-13T23:05:30.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.667+0000 7f7d69287800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992434b20 0x560992434f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.667+0000 7f7d69287800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560992409710 con 0x560992434b20 2024-09-13T23:05:30.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.668+0000 7f7d6657a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992434b20 0x560992434f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.668+0000 7f7d6657a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992434b20 0x560992434f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56052/0 (socket says 172.21.15.164:56052) 2024-09-13T23:05:30.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.668+0000 7f7d6657a640 1 -- 172.21.15.164:0/1167384465 learned_addr learned my addr 172.21.15.164:0/1167384465 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.668+0000 7f7d6657a640 1 -- 172.21.15.164:0/1167384465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609924354f0 con 0x560992434b20 2024-09-13T23:05:30.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.668+0000 7f7d6657a640 1 --2- 172.21.15.164:0/1167384465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992434b20 0x560992434f20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c04d180 tx=0x7f7d5c046be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2735ca3e5c0adb70 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.668+0000 7f7c4a7fc640 1 -- 172.21.15.164:0/1167384465 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d5c01be20 con 0x560992434b20 2024-09-13T23:05:30.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.668+0000 7f7c4a7fc640 1 -- 172.21.15.164:0/1167384465 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d5c046070 con 0x560992434b20 2024-09-13T23:05:30.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.668+0000 7f7c4a7fc640 1 -- 172.21.15.164:0/1167384465 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d5c00c360 con 0x560992434b20 2024-09-13T23:05:30.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.669+0000 7f7d69287800 1 -- 172.21.15.164:0/1167384465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992434b20 msgr2=0x560992434f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.669+0000 7f7d69287800 1 --2- 172.21.15.164:0/1167384465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992434b20 0x560992434f20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c04d180 tx=0x7f7d5c046be0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.669+0000 7f7d69287800 1 -- 172.21.15.164:0/1167384465 shutdown_connections 2024-09-13T23:05:30.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.669+0000 7f7d69287800 1 --2- 172.21.15.164:0/1167384465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992434b20 0x560992434f20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.669+0000 7f7d69287800 1 -- 172.21.15.164:0/1167384465 >> 172.21.15.164:0/1167384465 conn(0x560992430e80 msgr2=0x56099242ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.669+0000 7f7d69287800 1 -- 172.21.15.164:0/1167384465 shutdown_connections 2024-09-13T23:05:30.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.669+0000 7f7d69287800 1 -- 172.21.15.164:0/1167384465 wait complete. 2024-09-13T23:05:30.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.669+0000 7f7d69287800 1 Processor -- start 2024-09-13T23:05:30.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.669+0000 7f7d69287800 1 -- start start 2024-09-13T23:05:30.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.669+0000 7f7d69287800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992434b20 0x56099243c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.669+0000 7f7d69287800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560992435b60 con 0x560992434b20 2024-09-13T23:05:30.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.670+0000 7f7d6657a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992434b20 0x56099243c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.670+0000 7f7d6657a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992434b20 0x56099243c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56054/0 (socket says 172.21.15.164:56054) 2024-09-13T23:05:30.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.670+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 learned_addr learned my addr 172.21.15.164:0/2246689176 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.670+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56099243c560 con 0x560992434b20 2024-09-13T23:05:30.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.670+0000 7f7d6657a640 1 --2- 172.21.15.164:0/2246689176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992434b20 0x56099243c020 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c00dcc0 tx=0x7f7d5c04d110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.670+0000 7f7c48ff9640 1 -- 172.21.15.164:0/2246689176 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d5c019d50 con 0x560992434b20 2024-09-13T23:05:30.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.670+0000 7f7c48ff9640 1 -- 172.21.15.164:0/2246689176 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d5c00c360 con 0x560992434b20 2024-09-13T23:05:30.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.670+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56099243c7f0 con 0x560992434b20 2024-09-13T23:05:30.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.670+0000 7f7c48ff9640 1 -- 172.21.15.164:0/2246689176 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d5c024e10 con 0x560992434b20 2024-09-13T23:05:30.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.670+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56099243c7f0 con 0x560992434b20 2024-09-13T23:05:30.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.671+0000 7f7c48ff9640 1 -- 172.21.15.164:0/2246689176 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7d5c025980 con 0x560992434b20 2024-09-13T23:05:30.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.671+0000 7f7c48ff9640 1 --2- 172.21.15.164:0/2246689176 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c30036af0 0x7f7c30038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.672+0000 7f7c48ff9640 1 -- 172.21.15.164:0/2246689176 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7d5c030050 con 0x560992434b20 2024-09-13T23:05:30.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.672+0000 7f7d6757c640 1 --2- 172.21.15.164:0/2246689176 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c30036af0 0x7f7c30038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.672+0000 7f7d6757c640 1 --2- 172.21.15.164:0/2246689176 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c30036af0 0x7f7c30038fb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x560992412780 tx=0x7f7d6001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.672+0000 7f7d69287800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.672+0000 7f7d69287800 1 --2- 172.21.15.164:0/2246689176 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560992447930 0x560992449df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.672+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56099244a540 con 0x560992447930 2024-09-13T23:05:30.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.672+0000 7f7d66d7b640 1 --2- 172.21.15.164:0/2246689176 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560992447930 0x560992449df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.673+0000 7f7d66d7b640 1 --2- 172.21.15.164:0/2246689176 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560992447930 0x560992449df0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.673+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.673+0000 7f7d69287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.673+0000 7f7d69287800 20 realm 2024-09-13T23:05:30.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.673+0000 7f7d69287800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.673+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56099244a950 con 0x560992447930 2024-09-13T23:05:30.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.673+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.673+0000 7f7d69287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.673+0000 7f7d69287800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:30.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.673+0000 7f7d69287800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.673+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56099244b220 con 0x560992447930 2024-09-13T23:05:30.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.673+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.673+0000 7f7d69287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.673+0000 7f7d69287800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.673+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56099244b5c0 con 0x560992447930 2024-09-13T23:05:30.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.673+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.673+0000 7f7d69287800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:30.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.674+0000 7f7d69287800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.674+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56099244be10 con 0x560992447930 2024-09-13T23:05:30.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.674+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.674+0000 7f7d69287800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:30.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.674+0000 7f7d69287800 20 searching for the correct realm 2024-09-13T23:05:30.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.674+0000 7f7d69287800 1 --2- 172.21.15.164:0/2246689176 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x56099244db80 0x56099244ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.674+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x56099244db80 2024-09-13T23:05:30.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.674+0000 7f7d6657a640 1 --2- 172.21.15.164:0/2246689176 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x56099244db80 0x56099244ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.674+0000 7f7d6657a640 1 --2- 172.21.15.164:0/2246689176 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x56099244db80 0x56099244ff70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.674+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5c009050 con 0x56099244db80 2024-09-13T23:05:30.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.674+0000 7f7d6657a640 1 --2- 172.21.15.164:0/2246689176 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7d5c043b70 0x7f7d5c00c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.674+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x7f7d5c043b70 2024-09-13T23:05:30.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.675+0000 7f7d6757c640 1 --2- 172.21.15.164:0/2246689176 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7d5c043b70 0x7f7d5c00c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.675+0000 7f7d6757c640 1 --2- 172.21.15.164:0/2246689176 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7d5c043b70 0x7f7d5c00c580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.675+0000 7f7d6757c640 1 -- 172.21.15.164:0/2246689176 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d6001f070 con 0x7f7d5c043b70 2024-09-13T23:05:30.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.675+0000 7f7d6757c640 1 --2- 172.21.15.164:0/2246689176 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7d60031040 0x7f7d60032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.675+0000 7f7d6757c640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x7f7d60031040 2024-09-13T23:05:30.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.675+0000 7f7d66d7b640 1 --2- 172.21.15.164:0/2246689176 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7d60031040 0x7f7d60032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.676+0000 7f7d66d7b640 1 --2- 172.21.15.164:0/2246689176 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7d60031040 0x7f7d60032430 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.676+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5807a030 con 0x7f7d60031040 2024-09-13T23:05:30.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.676+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x560992447930 2024-09-13T23:05:30.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.676+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.676+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x560992447930 2024-09-13T23:05:30.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.676+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.676+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x7f7d60031040 2024-09-13T23:05:30.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.677+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5807a030 con 0x7f7d60031040 2024-09-13T23:05:30.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.677+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x7f7d60031040 2024-09-13T23:05:30.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.677+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5807a030 con 0x7f7d60031040 2024-09-13T23:05:30.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.677+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x7f7d5c043b70 2024-09-13T23:05:30.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.677+0000 7f7d6757c640 1 -- 172.21.15.164:0/2246689176 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d6001f070 con 0x7f7d5c043b70 2024-09-13T23:05:30.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.677+0000 7f7d6757c640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x56099244db80 2024-09-13T23:05:30.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.677+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5c009050 con 0x56099244db80 2024-09-13T23:05:30.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.677+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x560992447930 2024-09-13T23:05:30.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.678+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.678+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x7f7d60031040 2024-09-13T23:05:30.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.678+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5807a030 con 0x7f7d60031040 2024-09-13T23:05:30.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.678+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x560992447930 2024-09-13T23:05:30.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.678+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.678+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x7f7d5c043b70 2024-09-13T23:05:30.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.678+0000 7f7d6757c640 1 -- 172.21.15.164:0/2246689176 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7d6001f070 con 0x7f7d5c043b70 2024-09-13T23:05:30.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.678+0000 7f7d6757c640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x56099244db80 2024-09-13T23:05:30.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.679+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5c009050 con 0x56099244db80 2024-09-13T23:05:30.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.679+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x56099244db80 2024-09-13T23:05:30.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.679+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5c009050 con 0x56099244db80 2024-09-13T23:05:30.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.679+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x7f7d60031040 2024-09-13T23:05:30.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.679+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5807a030 con 0x7f7d60031040 2024-09-13T23:05:30.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.679+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x56099244db80 2024-09-13T23:05:30.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.679+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5c009050 con 0x56099244db80 2024-09-13T23:05:30.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.679+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x56099244db80 2024-09-13T23:05:30.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.679+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5c009050 con 0x56099244db80 2024-09-13T23:05:30.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.679+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x560992447930 2024-09-13T23:05:30.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.680+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.680+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x560992447930 2024-09-13T23:05:30.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.680+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.680+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x7f7d60031040 2024-09-13T23:05:30.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.680+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5807a030 con 0x7f7d60031040 2024-09-13T23:05:30.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.680+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x56099244db80 2024-09-13T23:05:30.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.680+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5c009050 con 0x56099244db80 2024-09-13T23:05:30.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.680+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x7f7d5c043b70 2024-09-13T23:05:30.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.681+0000 7f7d6757c640 1 -- 172.21.15.164:0/2246689176 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d6001f070 con 0x7f7d5c043b70 2024-09-13T23:05:30.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.681+0000 7f7d6757c640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x560992447930 2024-09-13T23:05:30.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.681+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.681+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x7f7d60031040 2024-09-13T23:05:30.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.681+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5807a030 con 0x7f7d60031040 2024-09-13T23:05:30.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.681+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x56099244db80 2024-09-13T23:05:30.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.681+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5c009050 con 0x56099244db80 2024-09-13T23:05:30.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.681+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x7f7d60031040 2024-09-13T23:05:30.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.682+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5807a030 con 0x7f7d60031040 2024-09-13T23:05:30.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.682+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x7f7d5c043b70 2024-09-13T23:05:30.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.682+0000 7f7d6757c640 1 -- 172.21.15.164:0/2246689176 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d6001f070 con 0x7f7d5c043b70 2024-09-13T23:05:30.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.682+0000 7f7d6757c640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x56099244db80 2024-09-13T23:05:30.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.682+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5c009050 con 0x56099244db80 2024-09-13T23:05:30.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.682+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x7f7d60031040 2024-09-13T23:05:30.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.683+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d5807a030 con 0x7f7d60031040 2024-09-13T23:05:30.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.683+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x560992447930 2024-09-13T23:05:30.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.683+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.683+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560992450550 con 0x7f7d5c043b70 2024-09-13T23:05:30.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.683+0000 7f7d6757c640 1 -- 172.21.15.164:0/2246689176 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d6001f070 con 0x7f7d5c043b70 2024-09-13T23:05:30.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.683+0000 7f7d69287800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:30.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.683+0000 7f7d69287800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:30.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.683+0000 7f7d69287800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:30.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.683+0000 7f7d69287800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:30.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.683+0000 7f7d69287800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:30.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.683+0000 7f7d69287800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:30.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.683+0000 7f7d69287800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.683+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56099244c760 con 0x560992447930 2024-09-13T23:05:30.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.683+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.683+0000 7f7d69287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.683+0000 7f7d69287800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.683+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56099244cb50 con 0x560992447930 2024-09-13T23:05:30.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.684+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.684+0000 7f7d69287800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:30.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.684+0000 7f7d69287800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.684+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56099244cb50 con 0x560992447930 2024-09-13T23:05:30.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.684+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.684+0000 7f7d69287800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:30.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.684+0000 7f7d69287800 20 zone default found 2024-09-13T23:05:30.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.684+0000 7f7d69287800 4 Realm: () 2024-09-13T23:05:30.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.684+0000 7f7d69287800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:30.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.684+0000 7f7d69287800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:30.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.684+0000 7f7d69287800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:30.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.684+0000 7f7d69287800 20 zonegroup default 2024-09-13T23:05:30.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.684+0000 7f7d69287800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.684+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56099244cfd0 con 0x7f7d60031040 2024-09-13T23:05:30.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.684+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x7f7d60031040 2024-09-13T23:05:30.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.684+0000 7f7d69287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.684+0000 7f7d69287800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.684+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56099244d000 con 0x56099244db80 2024-09-13T23:05:30.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.684+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7d5c009050 con 0x56099244db80 2024-09-13T23:05:30.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.684+0000 7f7d69287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.684+0000 7f7d69287800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.684+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609924524d0 con 0x56099244db80 2024-09-13T23:05:30.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.685+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7d5c009050 con 0x56099244db80 2024-09-13T23:05:30.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.685+0000 7f7d69287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.685+0000 7f7d69287800 20 started sync module instance, tier type = 2024-09-13T23:05:30.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.685+0000 7f7d69287800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:30.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.685+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992451850 con 0x7f7d5c043b70 2024-09-13T23:05:30.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.686+0000 7f7d6757c640 1 -- 172.21.15.164:0/2246689176 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d60040040 con 0x7f7d5c043b70 2024-09-13T23:05:30.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.686+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94599108697200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609924514b0 con 0x7f7d5c043b70 2024-09-13T23:05:30.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.686+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992453290 con 0x560992447930 2024-09-13T23:05:30.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.687+0000 7f7d6757c640 1 -- 172.21.15.164:0/2246689176 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94599108697200] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d60040040 con 0x7f7d5c043b70 2024-09-13T23:05:30.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.687+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.687+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94599108700464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992453320 con 0x560992447930 2024-09-13T23:05:30.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.687+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992453e40 con 0x56099244db80 2024-09-13T23:05:30.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.689+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94599108700464] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.692+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d5c009050 con 0x56099244db80 2024-09-13T23:05:30.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.692+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94599108704528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992454230 con 0x56099244db80 2024-09-13T23:05:30.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.692+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992454bf0 con 0x7f7d5c043b70 2024-09-13T23:05:30.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.693+0000 7f7d6757c640 1 -- 172.21.15.164:0/2246689176 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d60040040 con 0x7f7d5c043b70 2024-09-13T23:05:30.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.693+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94599108708640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992455490 con 0x7f7d5c043b70 2024-09-13T23:05:30.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.693+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992455f60 con 0x560992447930 2024-09-13T23:05:30.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.693+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94599108704528] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d5c009050 con 0x56099244db80 2024-09-13T23:05:30.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.694+0000 7f7d6757c640 1 -- 172.21.15.164:0/2246689176 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94599108708640] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d60040040 con 0x7f7d5c043b70 2024-09-13T23:05:30.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.694+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.694+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94599108713040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992454fe0 con 0x560992447930 2024-09-13T23:05:30.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.694+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992456800 con 0x7f7d60031040 2024-09-13T23:05:30.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.695+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x7f7d60031040 2024-09-13T23:05:30.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.695+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94599108715024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992456ae0 con 0x7f7d60031040 2024-09-13T23:05:30.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.695+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992457390 con 0x7f7d60031040 2024-09-13T23:05:30.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.695+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94599108713040] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.696+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x7f7d60031040 2024-09-13T23:05:30.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.696+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94599108717280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992456f00 con 0x7f7d60031040 2024-09-13T23:05:30.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.696+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992457e20 con 0x7f7d60031040 2024-09-13T23:05:30.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.696+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94599108715024] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x7f7d60031040 2024-09-13T23:05:30.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.697+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x7f7d60031040 2024-09-13T23:05:30.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.697+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94599108717280] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x7f7d60031040 2024-09-13T23:05:30.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.697+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94599108716080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992457e20 con 0x7f7d60031040 2024-09-13T23:05:30.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.697+0000 7f7d69287800 20 add_watcher() i=0 2024-09-13T23:05:30.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.697+0000 7f7d69287800 20 add_watcher() i=1 2024-09-13T23:05:30.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.697+0000 7f7d69287800 20 add_watcher() i=2 2024-09-13T23:05:30.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.697+0000 7f7d69287800 20 add_watcher() i=3 2024-09-13T23:05:30.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.697+0000 7f7d69287800 20 add_watcher() i=4 2024-09-13T23:05:30.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.697+0000 7f7d69287800 20 add_watcher() i=5 2024-09-13T23:05:30.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.697+0000 7f7d69287800 20 add_watcher() i=6 2024-09-13T23:05:30.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.698+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94599108716080] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x7f7d60031040 2024-09-13T23:05:30.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.698+0000 7f7d69287800 20 add_watcher() i=7 2024-09-13T23:05:30.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.698+0000 7f7d69287800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:30.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.698+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560992457e20 con 0x560992447930 2024-09-13T23:05:30.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.698+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.698+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94599108721008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992457d90 con 0x560992447930 2024-09-13T23:05:30.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.699+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94599108721008] v32'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.700+0000 7f7c1d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:30.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.700+0000 7f7d69287800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:30.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.700+0000 7f7d69287800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:30.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.700+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992463780 con 0x560992447930 2024-09-13T23:05:30.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.701+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.701+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992463e50 con 0x7f7d60031040 2024-09-13T23:05:30.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.702+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x7f7d60031040 2024-09-13T23:05:30.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.702+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992463e50 con 0x56099244db80 2024-09-13T23:05:30.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.703+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d5c009050 con 0x56099244db80 2024-09-13T23:05:30.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.703+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609924641f0 con 0x560992447930 2024-09-13T23:05:30.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.704+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'42 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.704+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992464240 con 0x7f7d5c043b70 2024-09-13T23:05:30.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.705+0000 7f7d6757c640 1 -- 172.21.15.164:0/2246689176 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'29 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d60040040 con 0x7f7d5c043b70 2024-09-13T23:05:30.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.705+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609924648c0 con 0x56099244db80 2024-09-13T23:05:30.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.706+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'19 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d5c009050 con 0x56099244db80 2024-09-13T23:05:30.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.706+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992464c60 con 0x560992447930 2024-09-13T23:05:30.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.707+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.708+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992464c60 con 0x7f7d60031040 2024-09-13T23:05:30.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.709+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'19 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x7f7d60031040 2024-09-13T23:05:30.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.709+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992464c60 con 0x7f7d5c043b70 2024-09-13T23:05:30.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.710+0000 7f7d6757c640 1 -- 172.21.15.164:0/2246689176 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d60040040 con 0x7f7d5c043b70 2024-09-13T23:05:30.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.710+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992465250 con 0x56099244db80 2024-09-13T23:05:30.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.711+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d5c009050 con 0x56099244db80 2024-09-13T23:05:30.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.711+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992465250 con 0x7f7d5c043b70 2024-09-13T23:05:30.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.712+0000 7f7d6757c640 1 -- 172.21.15.164:0/2246689176 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'30 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d60040040 con 0x7f7d5c043b70 2024-09-13T23:05:30.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.712+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609924657c0 con 0x7f7d60031040 2024-09-13T23:05:30.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.713+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x7f7d60031040 2024-09-13T23:05:30.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.713+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609924657c0 con 0x7f7d5c043b70 2024-09-13T23:05:30.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.714+0000 7f7d6757c640 1 -- 172.21.15.164:0/2246689176 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d60040040 con 0x7f7d5c043b70 2024-09-13T23:05:30.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.714+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992465c70 con 0x7f7d60031040 2024-09-13T23:05:30.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.717+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'25 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x7f7d60031040 2024-09-13T23:05:30.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.717+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992465c70 con 0x560992447930 2024-09-13T23:05:30.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.719+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'43 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.719+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992465c70 con 0x56099244db80 2024-09-13T23:05:30.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.722+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d5c009050 con 0x56099244db80 2024-09-13T23:05:30.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.722+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992465c70 con 0x7f7d5c043b70 2024-09-13T23:05:30.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.725+0000 7f7d6757c640 1 -- 172.21.15.164:0/2246689176 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'31 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d60040040 con 0x7f7d5c043b70 2024-09-13T23:05:30.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.725+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992465c70 con 0x56099244db80 2024-09-13T23:05:30.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.727+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d5c009050 con 0x56099244db80 2024-09-13T23:05:30.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.727+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992465c70 con 0x560992447930 2024-09-13T23:05:30.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.729+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.729+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992465c70 con 0x560992447930 2024-09-13T23:05:30.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.730+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'44 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.730+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992465c70 con 0x56099244db80 2024-09-13T23:05:30.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.731+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d5c009050 con 0x56099244db80 2024-09-13T23:05:30.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.731+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992465c70 con 0x7f7d5c043b70 2024-09-13T23:05:30.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.732+0000 7f7d6757c640 1 -- 172.21.15.164:0/2246689176 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d60040040 con 0x7f7d5c043b70 2024-09-13T23:05:30.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.732+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992465c70 con 0x56099244db80 2024-09-13T23:05:30.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.733+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d5c009050 con 0x56099244db80 2024-09-13T23:05:30.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.733+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992465c70 con 0x56099244db80 2024-09-13T23:05:30.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.734+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 <== osd.3 v2:172.21.15.164:6816/93809510 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d5c009050 con 0x56099244db80 2024-09-13T23:05:30.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.734+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992465c70 con 0x56099244db80 2024-09-13T23:05:30.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.734+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 <== osd.3 v2:172.21.15.164:6816/93809510 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d5c009050 con 0x56099244db80 2024-09-13T23:05:30.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.734+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992465c70 con 0x56099244db80 2024-09-13T23:05:30.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.735+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 <== osd.3 v2:172.21.15.164:6816/93809510 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d5c009050 con 0x56099244db80 2024-09-13T23:05:30.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.735+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992465c70 con 0x7f7d60031040 2024-09-13T23:05:30.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.737+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x7f7d60031040 2024-09-13T23:05:30.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.737+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992465c70 con 0x56099244db80 2024-09-13T23:05:30.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.738+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 <== osd.3 v2:172.21.15.164:6816/93809510 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d5c009050 con 0x56099244db80 2024-09-13T23:05:30.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.738+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992465c70 con 0x7f7d60031040 2024-09-13T23:05:30.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.739+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x7f7d60031040 2024-09-13T23:05:30.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.739+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992465c70 con 0x56099244db80 2024-09-13T23:05:30.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.740+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 <== osd.3 v2:172.21.15.164:6816/93809510 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d5c009050 con 0x56099244db80 2024-09-13T23:05:30.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.740+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992465c70 con 0x7f7d60031040 2024-09-13T23:05:30.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.741+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'26 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x7f7d60031040 2024-09-13T23:05:30.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.741+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992465c70 con 0x7f7d5c043b70 2024-09-13T23:05:30.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.742+0000 7f7d6757c640 1 -- 172.21.15.164:0/2246689176 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d60040040 con 0x7f7d5c043b70 2024-09-13T23:05:30.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.742+0000 7f7b97fff640 20 reqs_thread_entry: start 2024-09-13T23:05:30.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.742+0000 7f7d69287800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:30.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.743+0000 7f7d69287800 20 Filter name: none 2024-09-13T23:05:30.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.743+0000 7f7b95ffb640 20 reqs_thread_entry: start 2024-09-13T23:05:30.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.743+0000 7f7d69287800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:05:30.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.743+0000 7f7d69287800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.743+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560992490aa0 con 0x560992447930 2024-09-13T23:05:30.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.743+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.743+0000 7f7d69287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.743+0000 7f7d69287800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-13T23:05:30.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.743+0000 7f7d69287800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:30.747 INFO:teuthology.orchestra.run.smithi164.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T23:05:30.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.744+0000 7f7c1d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:30.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.744+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94599108721008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56099245f130 con 0x560992447930 2024-09-13T23:05:30.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.745+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94599108721008] v32'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.745+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94599108697200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992457970 con 0x7f7d5c043b70 2024-09-13T23:05:30.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.746+0000 7f7d6757c640 1 -- 172.21.15.164:0/2246689176 <== osd.2 v2:172.21.15.164:6808/3795914978 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94599108697200] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d60040040 con 0x7f7d5c043b70 2024-09-13T23:05:30.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.746+0000 7f7d69287800 20 remove_watcher() i=0 2024-09-13T23:05:30.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.746+0000 7f7d69287800 2 removed watcher, disabling cache 2024-09-13T23:05:30.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.746+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94599108700464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992457970 con 0x560992447930 2024-09-13T23:05:30.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.747+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94599108700464] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.747+0000 7f7d69287800 20 remove_watcher() i=1 2024-09-13T23:05:30.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.747+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94599108704528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992452930 con 0x56099244db80 2024-09-13T23:05:30.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.748+0000 7f7d6657a640 1 -- 172.21.15.164:0/2246689176 <== osd.3 v2:172.21.15.164:6816/93809510 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94599108704528] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d5c009050 con 0x56099244db80 2024-09-13T23:05:30.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.748+0000 7f7d69287800 20 remove_watcher() i=2 2024-09-13T23:05:30.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.748+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94599108708640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992457970 con 0x7f7d5c043b70 2024-09-13T23:05:30.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.749+0000 7f7d6757c640 1 -- 172.21.15.164:0/2246689176 <== osd.2 v2:172.21.15.164:6808/3795914978 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94599108708640] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d60040040 con 0x7f7d5c043b70 2024-09-13T23:05:30.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.749+0000 7f7d69287800 20 remove_watcher() i=3 2024-09-13T23:05:30.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.749+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94599108713040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992457970 con 0x560992447930 2024-09-13T23:05:30.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.750+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.1 v2:172.21.15.164:6800/4060509701 32 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94599108713040] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x560992447930 2024-09-13T23:05:30.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.750+0000 7f7d69287800 20 remove_watcher() i=4 2024-09-13T23:05:30.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.750+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94599108715024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992455a50 con 0x7f7d60031040 2024-09-13T23:05:30.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.751+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94599108715024] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x7f7d60031040 2024-09-13T23:05:30.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.751+0000 7f7d69287800 20 remove_watcher() i=5 2024-09-13T23:05:30.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.751+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94599108717280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992456210 con 0x7f7d60031040 2024-09-13T23:05:30.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.752+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94599108717280] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x7f7d60031040 2024-09-13T23:05:30.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.752+0000 7f7d69287800 20 remove_watcher() i=6 2024-09-13T23:05:30.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.752+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94599108716080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560992455a50 con 0x7f7d60031040 2024-09-13T23:05:30.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.753+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94599108716080] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d5807a030 con 0x7f7d60031040 2024-09-13T23:05:30.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.753+0000 7f7d69287800 20 remove_watcher() i=7 2024-09-13T23:05:30.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.753+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7d60031040 msgr2=0x7f7d60032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.753+0000 7f7d69287800 1 --2- 172.21.15.164:0/2246689176 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7d60031040 0x7f7d60032430 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.753+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560992447930 msgr2=0x560992449df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.753+0000 7f7d69287800 1 --2- 172.21.15.164:0/2246689176 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560992447930 0x560992449df0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.753+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7d5c043b70 msgr2=0x7f7d5c00c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.753+0000 7f7d69287800 1 --2- 172.21.15.164:0/2246689176 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7d5c043b70 0x7f7d5c00c580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.753+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x56099244db80 msgr2=0x56099244ff70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.753+0000 7f7d69287800 1 --2- 172.21.15.164:0/2246689176 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x56099244db80 0x56099244ff70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.753+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c30036af0 msgr2=0x7f7c30038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.753+0000 7f7d69287800 1 --2- 172.21.15.164:0/2246689176 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c30036af0 0x7f7c30038fb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x560992412780 tx=0x7f7d6001f000 comp rx=0 tx=0).stop 2024-09-13T23:05:30.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.753+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992434b20 msgr2=0x56099243c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.753+0000 7f7d66d7b640 1 -- 172.21.15.164:0/2246689176 reap_dead start 2024-09-13T23:05:30.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.753+0000 7f7d69287800 1 --2- 172.21.15.164:0/2246689176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992434b20 0x56099243c020 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c00dcc0 tx=0x7f7d5c04d110 comp rx=0 tx=0).stop 2024-09-13T23:05:30.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.753+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 shutdown_connections 2024-09-13T23:05:30.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.753+0000 7f7d69287800 1 --2- 172.21.15.164:0/2246689176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992434b20 0x56099243c020 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.753+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 >> 172.21.15.164:0/2246689176 conn(0x560992430e80 msgr2=0x56099242ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.753+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 shutdown_connections 2024-09-13T23:05:30.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.753+0000 7f7d69287800 1 -- 172.21.15.164:0/2246689176 wait complete. 2024-09-13T23:05:30.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.754+0000 7f7d69287800 1 -- 172.21.15.164:0/3303923876 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c40036b40 msgr2=0x7f7c40039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.754+0000 7f7d69287800 1 --2- 172.21.15.164:0/3303923876 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c40036b40 0x7f7c40039000 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x560992416300 tx=0x7f7d60005840 comp rx=0 tx=0).stop 2024-09-13T23:05:30.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.754+0000 7f7d69287800 1 -- 172.21.15.164:0/3303923876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992406f70 msgr2=0x5609924055c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.754+0000 7f7d69287800 1 --2- 172.21.15.164:0/3303923876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992406f70 0x5609924055c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c001ed0 tx=0x7f7d5c00d7a0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.754+0000 7f7d69287800 1 -- 172.21.15.164:0/3303923876 shutdown_connections 2024-09-13T23:05:30.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.754+0000 7f7d69287800 1 --2- 172.21.15.164:0/3303923876 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c40036b40 0x7f7c40039000 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.754+0000 7f7d69287800 1 --2- 172.21.15.164:0/3303923876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992406f70 0x5609924055c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.754+0000 7f7d69287800 1 -- 172.21.15.164:0/3303923876 >> 172.21.15.164:0/3303923876 conn(0x56099241aba0 msgr2=0x56099241d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.754+0000 7f7d69287800 1 -- 172.21.15.164:0/3303923876 shutdown_connections 2024-09-13T23:05:30.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.754+0000 7f7d69287800 1 -- 172.21.15.164:0/3303923876 wait complete. 2024-09-13T23:05:30.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.754+0000 7f7d69287800 1 -- 172.21.15.164:0/1692817739 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560992316e90 msgr2=0x560992415260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.754+0000 7f7d69287800 1 --2- 172.21.15.164:0/1692817739 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560992316e90 0x560992415260 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.754+0000 7f7d69287800 1 -- 172.21.15.164:0/1692817739 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c4c036b40 msgr2=0x7f7c4c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.754+0000 7f7d69287800 1 --2- 172.21.15.164:0/1692817739 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c4c036b40 0x7f7c4c039000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c000f60 tx=0x7f7d5c0012b0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.754+0000 7f7d69287800 1 -- 172.21.15.164:0/1692817739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992316550 msgr2=0x56099240e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.754+0000 7f7d69287800 1 --2- 172.21.15.164:0/1692817739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992316550 0x56099240e1f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x56099228aca0 tx=0x7f7d58002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.754+0000 7f7d69287800 1 -- 172.21.15.164:0/1692817739 shutdown_connections 2024-09-13T23:05:30.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.754+0000 7f7d69287800 1 --2- 172.21.15.164:0/1692817739 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560992316e90 0x560992415260 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.754+0000 7f7d69287800 1 --2- 172.21.15.164:0/1692817739 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c4c036b40 0x7f7c4c039000 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.754+0000 7f7d69287800 1 --2- 172.21.15.164:0/1692817739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560992316550 0x56099240e1f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.754+0000 7f7d69287800 1 -- 172.21.15.164:0/1692817739 >> 172.21.15.164:0/1692817739 conn(0x560992311de0 msgr2=0x5609923ff9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.754+0000 7f7d69287800 1 -- 172.21.15.164:0/1692817739 shutdown_connections 2024-09-13T23:05:30.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.754+0000 7f7d69287800 1 -- 172.21.15.164:0/1692817739 wait complete. 2024-09-13T23:05:30.763 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T23:05:30.763 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T23:05:30.763 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T23:05:30.763 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-13T23:05:30.810 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:30.810 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:30.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.810+0000 7f42d760f800 1 Processor -- start 2024-09-13T23:05:30.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.810+0000 7f42d760f800 1 -- start start 2024-09-13T23:05:30.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.810+0000 7f42d760f800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x556e3b287ad0 0x556e3b287ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.810+0000 7f42d760f800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556e3b148b30 con 0x556e3b288410 2024-09-13T23:05:30.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.810+0000 7f42d760f800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x556e3b12a360 con 0x556e3b287ad0 2024-09-13T23:05:30.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.811+0000 7f42d2cee640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x556e3b287ad0 0x556e3b287ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.811+0000 7f42d24ed640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x556e3b288410 0x556e3b290f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40696/0 (socket says 172.21.15.164:40696) 2024-09-13T23:05:30.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.811+0000 7f42d24ed640 1 -- 172.21.15.164:0/3215697406 learned_addr learned my addr 172.21.15.164:0/3215697406 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:30.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.811+0000 7f42d2cee640 1 -- 172.21.15.164:0/3215697406 >> v1:172.21.15.17:6789/0 conn(0x556e3b288410 legacy=0x556e3b290f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.811+0000 7f42d2cee640 1 -- 172.21.15.164:0/3215697406 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e3b150e00 con 0x556e3b287ad0 2024-09-13T23:05:30.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.813+0000 7f42d2cee640 1 --2- 172.21.15.164:0/3215697406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b287ad0 0x556e3b287ed0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f42c4005fd0 tx=0x7f42c4045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f77b736fb5ccee3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.813+0000 7f42d1cec640 1 -- 172.21.15.164:0/3215697406 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42c4058530 con 0x556e3b287ad0 2024-09-13T23:05:30.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.813+0000 7f42d1cec640 1 -- 172.21.15.164:0/3215697406 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c40586d0 con 0x556e3b287ad0 2024-09-13T23:05:30.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.813+0000 7f42d1cec640 1 -- 172.21.15.164:0/3215697406 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42c40589d0 con 0x556e3b287ad0 2024-09-13T23:05:30.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.813+0000 7f42d760f800 1 -- 172.21.15.164:0/3215697406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b287ad0 msgr2=0x556e3b287ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.813+0000 7f42d760f800 1 --2- 172.21.15.164:0/3215697406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b287ad0 0x556e3b287ed0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f42c4005fd0 tx=0x7f42c4045c30 comp rx=0 tx=0).stop 2024-09-13T23:05:30.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.813+0000 7f42d760f800 1 -- 172.21.15.164:0/3215697406 shutdown_connections 2024-09-13T23:05:30.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.813+0000 7f42d760f800 1 --2- 172.21.15.164:0/3215697406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b287ad0 0x556e3b287ed0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.813+0000 7f42d760f800 1 -- 172.21.15.164:0/3215697406 >> 172.21.15.164:0/3215697406 conn(0x556e3b283640 msgr2=0x556e3b285a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.813+0000 7f42d760f800 1 -- 172.21.15.164:0/3215697406 shutdown_connections 2024-09-13T23:05:30.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.813+0000 7f42d760f800 1 -- 172.21.15.164:0/3215697406 wait complete. 2024-09-13T23:05:30.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.827+0000 7f42d760f800 1 Processor -- start 2024-09-13T23:05:30.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.827+0000 7f42d760f800 1 -- start start 2024-09-13T23:05:30.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.828+0000 7f42d760f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b287ad0 0x556e3b37aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.828+0000 7f42d760f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556e3b1d5350 con 0x556e3b287ad0 2024-09-13T23:05:30.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.828+0000 7f42d2cee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b287ad0 0x556e3b37aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.828+0000 7f42d2cee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b287ad0 0x556e3b37aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56074/0 (socket says 172.21.15.164:56074) 2024-09-13T23:05:30.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.828+0000 7f42d2cee640 1 -- 172.21.15.164:0/3119601018 learned_addr learned my addr 172.21.15.164:0/3119601018 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.828+0000 7f42d2cee640 1 -- 172.21.15.164:0/3119601018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e3b122bc0 con 0x556e3b287ad0 2024-09-13T23:05:30.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.829+0000 7f42d2cee640 1 --2- 172.21.15.164:0/3119601018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b287ad0 0x556e3b37aba0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f42c400a3f0 tx=0x7f42c4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5978c26728648acb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.829+0000 7f41c0e09640 1 -- 172.21.15.164:0/3119601018 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42c40589b0 con 0x556e3b287ad0 2024-09-13T23:05:30.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.829+0000 7f41c0e09640 1 -- 172.21.15.164:0/3119601018 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c4068070 con 0x556e3b287ad0 2024-09-13T23:05:30.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.829+0000 7f41c0e09640 1 -- 172.21.15.164:0/3119601018 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42c4058c80 con 0x556e3b287ad0 2024-09-13T23:05:30.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.829+0000 7f42d760f800 1 -- 172.21.15.164:0/3119601018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b287ad0 msgr2=0x556e3b37aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.829+0000 7f42d760f800 1 --2- 172.21.15.164:0/3119601018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b287ad0 0x556e3b37aba0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f42c400a3f0 tx=0x7f42c4051000 comp rx=0 tx=0).stop 2024-09-13T23:05:30.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.829+0000 7f42d760f800 1 -- 172.21.15.164:0/3119601018 shutdown_connections 2024-09-13T23:05:30.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.829+0000 7f42d760f800 1 --2- 172.21.15.164:0/3119601018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b287ad0 0x556e3b37aba0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.829+0000 7f42d760f800 1 -- 172.21.15.164:0/3119601018 >> 172.21.15.164:0/3119601018 conn(0x556e3b283640 msgr2=0x556e3b376560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.829+0000 7f42d760f800 1 -- 172.21.15.164:0/3119601018 shutdown_connections 2024-09-13T23:05:30.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.830+0000 7f42d760f800 1 -- 172.21.15.164:0/3119601018 wait complete. 2024-09-13T23:05:30.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.830+0000 7f42d760f800 1 Processor -- start 2024-09-13T23:05:30.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.830+0000 7f42d760f800 1 -- start start 2024-09-13T23:05:30.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.830+0000 7f42d760f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b287ad0 0x556e3b3823e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.830+0000 7f42d760f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556e3b292990 con 0x556e3b287ad0 2024-09-13T23:05:30.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.830+0000 7f42d2cee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b287ad0 0x556e3b3823e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.830+0000 7f42d2cee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b287ad0 0x556e3b3823e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56084/0 (socket says 172.21.15.164:56084) 2024-09-13T23:05:30.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.830+0000 7f42d2cee640 1 -- 172.21.15.164:0/2129796586 learned_addr learned my addr 172.21.15.164:0/2129796586 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.830+0000 7f42d2cee640 1 -- 172.21.15.164:0/2129796586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e3b136fe0 con 0x556e3b287ad0 2024-09-13T23:05:30.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.831+0000 7f42d2cee640 1 --2- 172.21.15.164:0/2129796586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b287ad0 0x556e3b3823e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f42c400a3f0 tx=0x7f42c4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.831+0000 7f41bf606640 1 -- 172.21.15.164:0/2129796586 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42c4063570 con 0x556e3b287ad0 2024-09-13T23:05:30.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.831+0000 7f41bf606640 1 -- 172.21.15.164:0/2129796586 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c4063710 con 0x556e3b287ad0 2024-09-13T23:05:30.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.831+0000 7f42d760f800 1 -- 172.21.15.164:0/2129796586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e3b382920 con 0x556e3b287ad0 2024-09-13T23:05:30.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.831+0000 7f41bf606640 1 -- 172.21.15.164:0/2129796586 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42c40639f0 con 0x556e3b287ad0 2024-09-13T23:05:30.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.831+0000 7f42d760f800 1 -- 172.21.15.164:0/2129796586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e3b382e40 con 0x556e3b287ad0 2024-09-13T23:05:30.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.832+0000 7f42d760f800 1 Processor -- start 2024-09-13T23:05:30.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.832+0000 7f42d760f800 1 -- start start 2024-09-13T23:05:30.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.832+0000 7f41bf606640 1 -- 172.21.15.164:0/2129796586 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f42c4075020 con 0x556e3b287ad0 2024-09-13T23:05:30.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.832+0000 7f42d760f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b38f180 0x556e3b38f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.832+0000 7f42d760f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556e3b124580 con 0x556e3b38f180 2024-09-13T23:05:30.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.832+0000 7f41bf606640 1 --2- 172.21.15.164:0/2129796586 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f41b8036b40 0x7f41b8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.832+0000 7f41bf606640 1 -- 172.21.15.164:0/2129796586 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f42c4090eb0 con 0x556e3b287ad0 2024-09-13T23:05:30.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.832+0000 7f42d34ef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b38f180 0x556e3b38f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.832+0000 7f42d34ef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b38f180 0x556e3b38f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56098/0 (socket says 172.21.15.164:56098) 2024-09-13T23:05:30.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.832+0000 7f42d34ef640 1 -- 172.21.15.164:0/3529859299 learned_addr learned my addr 172.21.15.164:0/3529859299 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.832+0000 7f42d2cee640 1 --2- 172.21.15.164:0/2129796586 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f41b8036b40 0x7f41b8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.832+0000 7f42d34ef640 1 -- 172.21.15.164:0/3529859299 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e3b38fac0 con 0x556e3b38f180 2024-09-13T23:05:30.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.832+0000 7f42d2cee640 1 --2- 172.21.15.164:0/2129796586 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f41b8036b40 0x7f41b8039000 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f42c4079040 tx=0x7f42c4063c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.832+0000 7f42d34ef640 1 --2- 172.21.15.164:0/3529859299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b38f180 0x556e3b38f580 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00a400 tx=0x7f42cc00a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd54c5999bae4cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.833+0000 7f41bd602640 1 -- 172.21.15.164:0/3529859299 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc0087e0 con 0x556e3b38f180 2024-09-13T23:05:30.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.833+0000 7f41bd602640 1 -- 172.21.15.164:0/3529859299 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42cc0089a0 con 0x556e3b38f180 2024-09-13T23:05:30.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.833+0000 7f41bd602640 1 -- 172.21.15.164:0/3529859299 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc008d00 con 0x556e3b38f180 2024-09-13T23:05:30.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.833+0000 7f42d760f800 1 -- 172.21.15.164:0/3529859299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b38f180 msgr2=0x556e3b38f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.833+0000 7f42d760f800 1 --2- 172.21.15.164:0/3529859299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b38f180 0x556e3b38f580 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00a400 tx=0x7f42cc00a8c0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.833+0000 7f42d760f800 1 -- 172.21.15.164:0/3529859299 shutdown_connections 2024-09-13T23:05:30.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.833+0000 7f42d760f800 1 --2- 172.21.15.164:0/3529859299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b38f180 0x556e3b38f580 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.833+0000 7f42d760f800 1 -- 172.21.15.164:0/3529859299 >> 172.21.15.164:0/3529859299 conn(0x556e3b288410 msgr2=0x556e3b38a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.833+0000 7f42d760f800 1 -- 172.21.15.164:0/3529859299 shutdown_connections 2024-09-13T23:05:30.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.833+0000 7f42d760f800 1 -- 172.21.15.164:0/3529859299 wait complete. 2024-09-13T23:05:30.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.833+0000 7f42d760f800 1 Processor -- start 2024-09-13T23:05:30.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.833+0000 7f42d760f800 1 -- start start 2024-09-13T23:05:30.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.834+0000 7f42d760f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b38f180 0x556e3b3967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.834+0000 7f42d760f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556e3b390470 con 0x556e3b38f180 2024-09-13T23:05:30.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.834+0000 7f42d34ef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b38f180 0x556e3b3967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.834+0000 7f42d34ef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b38f180 0x556e3b3967d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56104/0 (socket says 172.21.15.164:56104) 2024-09-13T23:05:30.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.834+0000 7f42d34ef640 1 -- 172.21.15.164:0/3414390116 learned_addr learned my addr 172.21.15.164:0/3414390116 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.834+0000 7f42d34ef640 1 -- 172.21.15.164:0/3414390116 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e3b396d10 con 0x556e3b38f180 2024-09-13T23:05:30.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.834+0000 7f42d34ef640 1 --2- 172.21.15.164:0/3414390116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b38f180 0x556e3b3967d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x556e3b38ff00 tx=0x7f42cc002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.834+0000 7f41b77fe640 1 -- 172.21.15.164:0/3414390116 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc022020 con 0x556e3b38f180 2024-09-13T23:05:30.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.834+0000 7f41b77fe640 1 -- 172.21.15.164:0/3414390116 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42cc019040 con 0x556e3b38f180 2024-09-13T23:05:30.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.834+0000 7f41b77fe640 1 -- 172.21.15.164:0/3414390116 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc013880 con 0x556e3b38f180 2024-09-13T23:05:30.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.834+0000 7f42d760f800 1 -- 172.21.15.164:0/3414390116 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e3b396fa0 con 0x556e3b38f180 2024-09-13T23:05:30.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.835+0000 7f42d760f800 1 -- 172.21.15.164:0/3414390116 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e3b399c50 con 0x556e3b38f180 2024-09-13T23:05:30.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.835+0000 7f41b77fe640 1 -- 172.21.15.164:0/3414390116 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f42cc025020 con 0x556e3b38f180 2024-09-13T23:05:30.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.836+0000 7f41b77fe640 1 --2- 172.21.15.164:0/3414390116 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f41ac036b90 0x7f41ac039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.836+0000 7f41b77fe640 1 -- 172.21.15.164:0/3414390116 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f42cc04c4e0 con 0x556e3b38f180 2024-09-13T23:05:30.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.836+0000 7f42d24ed640 1 --2- 172.21.15.164:0/3414390116 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f41ac036b90 0x7f41ac039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.836+0000 7f42d760f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:30.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.836+0000 7f42d760f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:30.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.836+0000 7f42d24ed640 1 --2- 172.21.15.164:0/3414390116 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f41ac036b90 0x7f41ac039050 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f42bc000f60 tx=0x7f42bc001230 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.836+0000 7f42d760f800 1 Processor -- start 2024-09-13T23:05:30.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.837+0000 7f42d760f800 1 -- start start 2024-09-13T23:05:30.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.837+0000 7f42d760f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b3b07e0 0x556e3b3b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.837+0000 7f42d760f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556e3b37b290 con 0x556e3b3b07e0 2024-09-13T23:05:30.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.837+0000 7f42d2cee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b3b07e0 0x556e3b3b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.837+0000 7f42d2cee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b3b07e0 0x556e3b3b0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56108/0 (socket says 172.21.15.164:56108) 2024-09-13T23:05:30.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.837+0000 7f42d2cee640 1 -- 172.21.15.164:0/1454481203 learned_addr learned my addr 172.21.15.164:0/1454481203 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.837+0000 7f42d2cee640 1 -- 172.21.15.164:0/1454481203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e3b3b11d0 con 0x556e3b3b07e0 2024-09-13T23:05:30.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.838+0000 7f42d2cee640 1 --2- 172.21.15.164:0/1454481203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b3b07e0 0x556e3b3b0c00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f42c406dfd0 tx=0x7f42c406bae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.838+0000 7f4192ffd640 1 -- 172.21.15.164:0/1454481203 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42c409c020 con 0x556e3b3b07e0 2024-09-13T23:05:30.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.838+0000 7f4192ffd640 1 -- 172.21.15.164:0/1454481203 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c408e290 con 0x556e3b3b07e0 2024-09-13T23:05:30.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.838+0000 7f42d760f800 1 -- 172.21.15.164:0/1454481203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e3b3b3e20 con 0x556e3b3b07e0 2024-09-13T23:05:30.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.838+0000 7f4192ffd640 1 -- 172.21.15.164:0/1454481203 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42c4092040 con 0x556e3b3b07e0 2024-09-13T23:05:30.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.838+0000 7f42d760f800 1 -- 172.21.15.164:0/1454481203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e3b3b4200 con 0x556e3b3b07e0 2024-09-13T23:05:30.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.838+0000 7f4192ffd640 1 -- 172.21.15.164:0/1454481203 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f42c409f020 con 0x556e3b3b07e0 2024-09-13T23:05:30.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.839+0000 7f4192ffd640 1 --2- 172.21.15.164:0/1454481203 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4114036b40 0x7f4114039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.839+0000 7f4192ffd640 1 -- 172.21.15.164:0/1454481203 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f42c40a2c60 con 0x556e3b3b07e0 2024-09-13T23:05:30.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.839+0000 7f42d24ed640 1 --2- 172.21.15.164:0/1454481203 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4114036b40 0x7f4114039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.839+0000 7f42d24ed640 1 --2- 172.21.15.164:0/1454481203 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4114036b40 0x7f4114039000 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f42bc001ed0 tx=0x7f42bc00f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.839+0000 7f4190ff9640 20 reqs_thread_entry: start 2024-09-13T23:05:30.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.839+0000 7f42d760f800 1 --2- 172.21.15.164:0/2129796586 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x556e3b3be240 0x556e3b3c0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.839+0000 7f42d760f800 1 -- 172.21.15.164:0/2129796586 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e3b3c0ce0 con 0x556e3b3be240 2024-09-13T23:05:30.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.839+0000 7f42d34ef640 1 --2- 172.21.15.164:0/2129796586 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x556e3b3be240 0x556e3b3c0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.840+0000 7f42d34ef640 1 --2- 172.21.15.164:0/2129796586 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x556e3b3be240 0x556e3b3c0630 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.840+0000 7f42d34ef640 1 -- 172.21.15.164:0/2129796586 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f42cc01e940 con 0x556e3b3be240 2024-09-13T23:05:30.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.840+0000 7f42d760f800 1 -- 172.21.15.164:0/2129796586 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e3b3c25a0 con 0x556e3b3be240 2024-09-13T23:05:30.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.840+0000 7f42d34ef640 1 -- 172.21.15.164:0/2129796586 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f42cc01e940 con 0x556e3b3be240 2024-09-13T23:05:30.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.840+0000 7f42d760f800 1 -- 172.21.15.164:0/2129796586 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e3b3c7110 con 0x556e3b3be240 2024-09-13T23:05:30.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.842+0000 7f42d34ef640 1 -- 172.21.15.164:0/2129796586 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [stat,call,call,writefull 0~993] v32'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f42cc01e940 con 0x556e3b3be240 2024-09-13T23:05:30.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.842+0000 7f42d760f800 1 -- 172.21.15.164:0/3414390116 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f41ac036b90 msgr2=0x7f41ac039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.842+0000 7f42d760f800 1 --2- 172.21.15.164:0/3414390116 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f41ac036b90 0x7f41ac039050 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f42bc000f60 tx=0x7f42bc001230 comp rx=0 tx=0).stop 2024-09-13T23:05:30.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.842+0000 7f42d760f800 1 -- 172.21.15.164:0/3414390116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b38f180 msgr2=0x556e3b3967d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.843+0000 7f42d760f800 1 --2- 172.21.15.164:0/3414390116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b38f180 0x556e3b3967d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x556e3b38ff00 tx=0x7f42cc002ff0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.843+0000 7f42d760f800 1 -- 172.21.15.164:0/3414390116 shutdown_connections 2024-09-13T23:05:30.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.843+0000 7f42d760f800 1 --2- 172.21.15.164:0/3414390116 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f41ac036b90 0x7f41ac039050 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.843+0000 7f42d760f800 1 --2- 172.21.15.164:0/3414390116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b38f180 0x556e3b3967d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.843+0000 7f42d760f800 1 -- 172.21.15.164:0/3414390116 >> 172.21.15.164:0/3414390116 conn(0x556e3b288410 msgr2=0x556e3b38a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.843+0000 7f42d760f800 1 -- 172.21.15.164:0/3414390116 shutdown_connections 2024-09-13T23:05:30.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.843+0000 7f42d760f800 1 -- 172.21.15.164:0/3414390116 wait complete. 2024-09-13T23:05:30.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.843+0000 7f42d760f800 1 -- 172.21.15.164:0/1454481203 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4114036b40 msgr2=0x7f4114039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.843+0000 7f42d760f800 1 --2- 172.21.15.164:0/1454481203 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4114036b40 0x7f4114039000 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f42bc001ed0 tx=0x7f42bc00f000 comp rx=0 tx=0).stop 2024-09-13T23:05:30.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.843+0000 7f42d760f800 1 -- 172.21.15.164:0/1454481203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b3b07e0 msgr2=0x556e3b3b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.843+0000 7f42d760f800 1 --2- 172.21.15.164:0/1454481203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b3b07e0 0x556e3b3b0c00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f42c406dfd0 tx=0x7f42c406bae0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.843+0000 7f42d760f800 1 -- 172.21.15.164:0/1454481203 shutdown_connections 2024-09-13T23:05:30.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.843+0000 7f42d760f800 1 --2- 172.21.15.164:0/1454481203 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4114036b40 0x7f4114039000 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.843+0000 7f42d760f800 1 --2- 172.21.15.164:0/1454481203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b3b07e0 0x556e3b3b0c00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.843+0000 7f42d760f800 1 -- 172.21.15.164:0/1454481203 >> 172.21.15.164:0/1454481203 conn(0x556e3b3a56f0 msgr2=0x556e3b3a7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.843+0000 7f42d760f800 1 -- 172.21.15.164:0/1454481203 shutdown_connections 2024-09-13T23:05:30.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.843+0000 7f42d760f800 1 -- 172.21.15.164:0/1454481203 wait complete. 2024-09-13T23:05:30.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.844+0000 7f42d760f800 1 -- 172.21.15.164:0/2129796586 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x556e3b3be240 msgr2=0x556e3b3c0630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.844+0000 7f42d760f800 1 --2- 172.21.15.164:0/2129796586 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x556e3b3be240 0x556e3b3c0630 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.844+0000 7f42d760f800 1 -- 172.21.15.164:0/2129796586 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f41b8036b40 msgr2=0x7f41b8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.844+0000 7f42d760f800 1 --2- 172.21.15.164:0/2129796586 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f41b8036b40 0x7f41b8039000 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f42c4079040 tx=0x7f42c4063c10 comp rx=0 tx=0).stop 2024-09-13T23:05:30.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.844+0000 7f42d760f800 1 -- 172.21.15.164:0/2129796586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b287ad0 msgr2=0x556e3b3823e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.844+0000 7f42d760f800 1 --2- 172.21.15.164:0/2129796586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b287ad0 0x556e3b3823e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f42c400a3f0 tx=0x7f42c4003330 comp rx=0 tx=0).stop 2024-09-13T23:05:30.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.844+0000 7f42d760f800 1 -- 172.21.15.164:0/2129796586 shutdown_connections 2024-09-13T23:05:30.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.844+0000 7f42d760f800 1 --2- 172.21.15.164:0/2129796586 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x556e3b3be240 0x556e3b3c0630 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.844+0000 7f42d760f800 1 --2- 172.21.15.164:0/2129796586 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f41b8036b40 0x7f41b8039000 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.844+0000 7f42d760f800 1 --2- 172.21.15.164:0/2129796586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e3b287ad0 0x556e3b3823e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.844+0000 7f42d760f800 1 -- 172.21.15.164:0/2129796586 >> 172.21.15.164:0/2129796586 conn(0x556e3b283640 msgr2=0x556e3b374e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.844+0000 7f42d760f800 1 -- 172.21.15.164:0/2129796586 shutdown_connections 2024-09-13T23:05:30.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.844+0000 7f42d760f800 1 -- 172.21.15.164:0/2129796586 wait complete. 2024-09-13T23:05:30.854 INFO:teuthology.orchestra.run.smithi164.stdout:{"id":"a32fa7f4-f49a-4762-82e4-81303c4fe8ba","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-13T23:05:30.854 DEBUG:tasks.util.rgw: json result: {'id': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-13T23:05:30.856 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-13T23:05:30.856 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-13T23:05:30.856 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-13T23:05:30.898 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:30.898 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:30.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.898+0000 7f48dc351800 1 Processor -- start 2024-09-13T23:05:30.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.898+0000 7f48dc351800 1 -- start start 2024-09-13T23:05:30.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.899+0000 7f48dc351800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55c2c69e75c0 0x55c2c69e5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.899+0000 7f48dc351800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c2c6930b30 con 0x55c2c69e62e0 2024-09-13T23:05:30.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.899+0000 7f48dc351800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55c2c6912360 con 0x55c2c69e75c0 2024-09-13T23:05:30.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.899+0000 7f48d9e45640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55c2c69e75c0 0x55c2c69e5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.899+0000 7f48d1644640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55c2c69e62e0 0x55c2c6a796a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40700/0 (socket says 172.21.15.164:40700) 2024-09-13T23:05:30.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.899+0000 7f48d1644640 1 -- 172.21.15.164:0/2918301197 learned_addr learned my addr 172.21.15.164:0/2918301197 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:30.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.899+0000 7f48d9e45640 1 -- 172.21.15.164:0/2918301197 >> v1:172.21.15.17:6789/0 conn(0x55c2c69e62e0 legacy=0x55c2c6a796a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.899+0000 7f48d9e45640 1 -- 172.21.15.164:0/2918301197 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2c6938e00 con 0x55c2c69e75c0 2024-09-13T23:05:30.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.901+0000 7f48d9e45640 1 --2- 172.21.15.164:0/2918301197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c69e75c0 0x55c2c69e5da0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f48cc00a470 tx=0x7f48cc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200a1f727105111d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.901+0000 7f48d9644640 1 -- 172.21.15.164:0/2918301197 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48cc053570 con 0x55c2c69e75c0 2024-09-13T23:05:30.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.901+0000 7f48d9644640 1 -- 172.21.15.164:0/2918301197 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48cc058070 con 0x55c2c69e75c0 2024-09-13T23:05:30.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.901+0000 7f48d9644640 1 -- 172.21.15.164:0/2918301197 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48cc053880 con 0x55c2c69e75c0 2024-09-13T23:05:30.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.902+0000 7f48dc351800 1 -- 172.21.15.164:0/2918301197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c69e75c0 msgr2=0x55c2c69e5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.902+0000 7f48dc351800 1 --2- 172.21.15.164:0/2918301197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c69e75c0 0x55c2c69e5da0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f48cc00a470 tx=0x7f48cc045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:30.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.902+0000 7f48dc351800 1 -- 172.21.15.164:0/2918301197 shutdown_connections 2024-09-13T23:05:30.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.902+0000 7f48dc351800 1 --2- 172.21.15.164:0/2918301197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c69e75c0 0x55c2c69e5da0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.902+0000 7f48dc351800 1 -- 172.21.15.164:0/2918301197 >> 172.21.15.164:0/2918301197 conn(0x55c2c6a6cfe0 msgr2=0x55c2c6a6f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.902+0000 7f48dc351800 1 -- 172.21.15.164:0/2918301197 shutdown_connections 2024-09-13T23:05:30.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.902+0000 7f48dc351800 1 -- 172.21.15.164:0/2918301197 wait complete. 2024-09-13T23:05:30.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.915+0000 7f48dc351800 1 Processor -- start 2024-09-13T23:05:30.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.916+0000 7f48dc351800 1 -- start start 2024-09-13T23:05:30.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.916+0000 7f48dc351800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c69e62e0 0x55c2c6b62b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.916+0000 7f48dc351800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c2c69bd320 con 0x55c2c69e62e0 2024-09-13T23:05:30.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.916+0000 7f48d9e45640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c69e62e0 0x55c2c6b62b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.916+0000 7f48d9e45640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c69e62e0 0x55c2c6b62b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56116/0 (socket says 172.21.15.164:56116) 2024-09-13T23:05:30.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.916+0000 7f48d9e45640 1 -- 172.21.15.164:0/2574650032 learned_addr learned my addr 172.21.15.164:0/2574650032 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.916+0000 7f48d9e45640 1 -- 172.21.15.164:0/2574650032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2c690abc0 con 0x55c2c69e62e0 2024-09-13T23:05:30.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.917+0000 7f48d9e45640 1 --2- 172.21.15.164:0/2574650032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c69e62e0 0x55c2c6b62b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f48cc025c20 tx=0x7f48cc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be666df073e0a983 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.917+0000 7f47c7e07640 1 -- 172.21.15.164:0/2574650032 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48cc053ba0 con 0x55c2c69e62e0 2024-09-13T23:05:30.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.917+0000 7f47c7e07640 1 -- 172.21.15.164:0/2574650032 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48cc063030 con 0x55c2c69e62e0 2024-09-13T23:05:30.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.917+0000 7f47c7e07640 1 -- 172.21.15.164:0/2574650032 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48cc053440 con 0x55c2c69e62e0 2024-09-13T23:05:30.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.918+0000 7f48dc351800 1 -- 172.21.15.164:0/2574650032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c69e62e0 msgr2=0x55c2c6b62b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.918+0000 7f48dc351800 1 --2- 172.21.15.164:0/2574650032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c69e62e0 0x55c2c6b62b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f48cc025c20 tx=0x7f48cc051000 comp rx=0 tx=0).stop 2024-09-13T23:05:30.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.918+0000 7f48dc351800 1 -- 172.21.15.164:0/2574650032 shutdown_connections 2024-09-13T23:05:30.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.918+0000 7f48dc351800 1 --2- 172.21.15.164:0/2574650032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c69e62e0 0x55c2c6b62b00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.918+0000 7f48dc351800 1 -- 172.21.15.164:0/2574650032 >> 172.21.15.164:0/2574650032 conn(0x55c2c6a6cfe0 msgr2=0x55c2c6b5e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.918+0000 7f48dc351800 1 -- 172.21.15.164:0/2574650032 shutdown_connections 2024-09-13T23:05:30.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.918+0000 7f48dc351800 1 -- 172.21.15.164:0/2574650032 wait complete. 2024-09-13T23:05:30.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.918+0000 7f48dc351800 1 Processor -- start 2024-09-13T23:05:30.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.918+0000 7f48dc351800 1 -- start start 2024-09-13T23:05:30.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.918+0000 7f48dc351800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c69e62e0 0x55c2c6b6a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.918+0000 7f48dc351800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c2c69e69d0 con 0x55c2c69e62e0 2024-09-13T23:05:30.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.918+0000 7f48d9e45640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c69e62e0 0x55c2c6b6a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.918+0000 7f48d9e45640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c69e62e0 0x55c2c6b6a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56122/0 (socket says 172.21.15.164:56122) 2024-09-13T23:05:30.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.918+0000 7f48d9e45640 1 -- 172.21.15.164:0/3606860619 learned_addr learned my addr 172.21.15.164:0/3606860619 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.919+0000 7f48d9e45640 1 -- 172.21.15.164:0/3606860619 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2c691efe0 con 0x55c2c69e62e0 2024-09-13T23:05:30.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.919+0000 7f48d9e45640 1 --2- 172.21.15.164:0/3606860619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c69e62e0 0x55c2c6b6a370 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55c2c6b63960 tx=0x7f48cc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.919+0000 7f47c6604640 1 -- 172.21.15.164:0/3606860619 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48cc078070 con 0x55c2c69e62e0 2024-09-13T23:05:30.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.919+0000 7f47c6604640 1 -- 172.21.15.164:0/3606860619 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48cc053570 con 0x55c2c69e62e0 2024-09-13T23:05:30.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.919+0000 7f47c6604640 1 -- 172.21.15.164:0/3606860619 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48cc053850 con 0x55c2c69e62e0 2024-09-13T23:05:30.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.919+0000 7f48dc351800 1 -- 172.21.15.164:0/3606860619 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2c6b6a8b0 con 0x55c2c69e62e0 2024-09-13T23:05:30.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.919+0000 7f48dc351800 1 -- 172.21.15.164:0/3606860619 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2c6b6ae30 con 0x55c2c69e62e0 2024-09-13T23:05:30.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.920+0000 7f47c6604640 1 -- 172.21.15.164:0/3606860619 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f48cc07b070 con 0x55c2c69e62e0 2024-09-13T23:05:30.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.920+0000 7f47c6604640 1 --2- 172.21.15.164:0/3606860619 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f47c0036b40 0x7f47c0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.920+0000 7f47c6604640 1 -- 172.21.15.164:0/3606860619 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f48cc070070 con 0x55c2c69e62e0 2024-09-13T23:05:30.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.920+0000 7f48d1644640 1 --2- 172.21.15.164:0/3606860619 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f47c0036b40 0x7f47c0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.920+0000 7f48dc351800 1 --2- 172.21.15.164:0/3606860619 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c2c69e75c0 0x55c2c6b713e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.920+0000 7f48dc351800 1 -- 172.21.15.164:0/3606860619 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6b71a00 con 0x55c2c69e75c0 2024-09-13T23:05:30.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.920+0000 7f48da646640 1 --2- 172.21.15.164:0/3606860619 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c2c69e75c0 0x55c2c6b713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.921+0000 7f48d1644640 1 --2- 172.21.15.164:0/3606860619 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f47c0036b40 0x7f47c0039000 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f48c4000f60 tx=0x7f48c40012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.921+0000 7f48da646640 1 --2- 172.21.15.164:0/3606860619 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c2c69e75c0 0x55c2c6b713e0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.921+0000 7f48da646640 1 -- 172.21.15.164:0/3606860619 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48d400a4a0 con 0x55c2c69e75c0 2024-09-13T23:05:30.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.921+0000 7f48dc351800 1 -- 172.21.15.164:0/3606860619 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6b6e9b0 con 0x55c2c69e75c0 2024-09-13T23:05:30.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.921+0000 7f48da646640 1 -- 172.21.15.164:0/3606860619 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f48d400a4a0 con 0x55c2c69e75c0 2024-09-13T23:05:30.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.921+0000 7f48dc351800 1 -- 172.21.15.164:0/3606860619 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6b73840 con 0x55c2c69e75c0 2024-09-13T23:05:30.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.922+0000 7f48da646640 1 -- 172.21.15.164:0/3606860619 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f48d400a4a0 con 0x55c2c69e75c0 2024-09-13T23:05:30.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.922+0000 7f48dc351800 1 -- 172.21.15.164:0/3606860619 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6b72920 con 0x55c2c69e75c0 2024-09-13T23:05:30.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.922+0000 7f48da646640 1 -- 172.21.15.164:0/3606860619 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f48d400a4a0 con 0x55c2c69e75c0 2024-09-13T23:05:30.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.922+0000 7f48dc351800 1 -- 172.21.15.164:0/3606860619 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6b72d70 con 0x55c2c69e75c0 2024-09-13T23:05:30.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.922+0000 7f48da646640 1 -- 172.21.15.164:0/3606860619 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f48d400a4a0 con 0x55c2c69e75c0 2024-09-13T23:05:30.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.922+0000 7f48dc351800 1 Processor -- start 2024-09-13T23:05:30.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.923+0000 7f48dc351800 1 -- start start 2024-09-13T23:05:30.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.923+0000 7f48dc351800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c6b81da0 0x55c2c6b821c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.923+0000 7f48dc351800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c2c690c580 con 0x55c2c6b81da0 2024-09-13T23:05:30.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.923+0000 7f48d1644640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c6b81da0 0x55c2c6b821c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.923+0000 7f48d1644640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c6b81da0 0x55c2c6b821c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56124/0 (socket says 172.21.15.164:56124) 2024-09-13T23:05:30.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.923+0000 7f48d1644640 1 -- 172.21.15.164:0/3336325179 learned_addr learned my addr 172.21.15.164:0/3336325179 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.923+0000 7f48d1644640 1 -- 172.21.15.164:0/3336325179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2c6b82700 con 0x55c2c6b81da0 2024-09-13T23:05:30.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.923+0000 7f48d1644640 1 --2- 172.21.15.164:0/3336325179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c6b81da0 0x55c2c6b821c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f48c4001ed0 tx=0x7f48c400d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.924+0000 7f47bf7fe640 1 -- 172.21.15.164:0/3336325179 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48c401b550 con 0x55c2c6b81da0 2024-09-13T23:05:30.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.924+0000 7f47bf7fe640 1 -- 172.21.15.164:0/3336325179 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c401b6f0 con 0x55c2c6b81da0 2024-09-13T23:05:30.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.924+0000 7f47bf7fe640 1 -- 172.21.15.164:0/3336325179 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48c401b9d0 con 0x55c2c6b81da0 2024-09-13T23:05:30.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.924+0000 7f48dc351800 1 -- 172.21.15.164:0/3336325179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2c6b82990 con 0x55c2c6b81da0 2024-09-13T23:05:30.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.924+0000 7f48dc351800 1 -- 172.21.15.164:0/3336325179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2c6b85670 con 0x55c2c6b81da0 2024-09-13T23:05:30.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.924+0000 7f47bf7fe640 1 -- 172.21.15.164:0/3336325179 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f48c4023020 con 0x55c2c6b81da0 2024-09-13T23:05:30.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.925+0000 7f47bf7fe640 1 --2- 172.21.15.164:0/3336325179 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f47b4036b40 0x7f47b4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.925+0000 7f47bf7fe640 1 -- 172.21.15.164:0/3336325179 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f48c4021020 con 0x55c2c6b81da0 2024-09-13T23:05:30.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.925+0000 7f48da646640 1 --2- 172.21.15.164:0/3336325179 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f47b4036b40 0x7f47b4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.925+0000 7f48dc351800 1 Processor -- start 2024-09-13T23:05:30.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.925+0000 7f48da646640 1 --2- 172.21.15.164:0/3336325179 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f47b4036b40 0x7f47b4039000 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55c2c6b72440 tx=0x7f48d4005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.925+0000 7f48dc351800 1 -- start start 2024-09-13T23:05:30.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.925+0000 7f48dc351800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c6b8eab0 0x55c2c6b8eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.925+0000 7f48dc351800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c2c6b63250 con 0x55c2c6b8eab0 2024-09-13T23:05:30.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.925+0000 7f48d1644640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c6b8eab0 0x55c2c6b8eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.925+0000 7f48d1644640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c6b8eab0 0x55c2c6b8eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56136/0 (socket says 172.21.15.164:56136) 2024-09-13T23:05:30.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.925+0000 7f48d1644640 1 -- 172.21.15.164:0/2999645106 learned_addr learned my addr 172.21.15.164:0/2999645106 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.926+0000 7f48d1644640 1 -- 172.21.15.164:0/2999645106 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2c6b8f480 con 0x55c2c6b8eab0 2024-09-13T23:05:30.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.926+0000 7f48d1644640 1 --2- 172.21.15.164:0/2999645106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c6b8eab0 0x55c2c6b8eeb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f48c404d180 tx=0x7f48c4046be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8564d575289a09a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.926+0000 7f47bd7fa640 1 -- 172.21.15.164:0/2999645106 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48c401be20 con 0x55c2c6b8eab0 2024-09-13T23:05:30.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.926+0000 7f47bd7fa640 1 -- 172.21.15.164:0/2999645106 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c4046070 con 0x55c2c6b8eab0 2024-09-13T23:05:30.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.926+0000 7f47bd7fa640 1 -- 172.21.15.164:0/2999645106 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48c400c360 con 0x55c2c6b8eab0 2024-09-13T23:05:30.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.926+0000 7f48dc351800 1 -- 172.21.15.164:0/2999645106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c6b8eab0 msgr2=0x55c2c6b8eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.926+0000 7f48dc351800 1 --2- 172.21.15.164:0/2999645106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c6b8eab0 0x55c2c6b8eeb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f48c404d180 tx=0x7f48c4046be0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.926+0000 7f48dc351800 1 -- 172.21.15.164:0/2999645106 shutdown_connections 2024-09-13T23:05:30.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.926+0000 7f48dc351800 1 --2- 172.21.15.164:0/2999645106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c6b8eab0 0x55c2c6b8eeb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.926+0000 7f48dc351800 1 -- 172.21.15.164:0/2999645106 >> 172.21.15.164:0/2999645106 conn(0x55c2c6b8ae10 msgr2=0x55c2c6b88f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.926+0000 7f48dc351800 1 -- 172.21.15.164:0/2999645106 shutdown_connections 2024-09-13T23:05:30.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.926+0000 7f48dc351800 1 -- 172.21.15.164:0/2999645106 wait complete. 2024-09-13T23:05:30.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.927+0000 7f48dc351800 1 Processor -- start 2024-09-13T23:05:30.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.927+0000 7f48dc351800 1 -- start start 2024-09-13T23:05:30.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.927+0000 7f48dc351800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c6b8eab0 0x55c2c6b95fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.927+0000 7f48dc351800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c2c6b8faf0 con 0x55c2c6b8eab0 2024-09-13T23:05:30.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.927+0000 7f48d1644640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c6b8eab0 0x55c2c6b95fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.927+0000 7f48d1644640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c6b8eab0 0x55c2c6b95fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56138/0 (socket says 172.21.15.164:56138) 2024-09-13T23:05:30.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.927+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 learned_addr learned my addr 172.21.15.164:0/502149062 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:30.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.927+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2c6b964f0 con 0x55c2c6b8eab0 2024-09-13T23:05:30.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.928+0000 7f48d1644640 1 --2- 172.21.15.164:0/502149062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c6b8eab0 0x55c2c6b95fb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f48c400dcc0 tx=0x7f48c404d110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.928+0000 7f47ab7fe640 1 -- 172.21.15.164:0/502149062 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48c4019d50 con 0x55c2c6b8eab0 2024-09-13T23:05:30.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.928+0000 7f47ab7fe640 1 -- 172.21.15.164:0/502149062 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c400c360 con 0x55c2c6b8eab0 2024-09-13T23:05:30.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.928+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2c6b96780 con 0x55c2c6b8eab0 2024-09-13T23:05:30.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.928+0000 7f47ab7fe640 1 -- 172.21.15.164:0/502149062 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48c4024e10 con 0x55c2c6b8eab0 2024-09-13T23:05:30.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.928+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2c6b96780 con 0x55c2c6b8eab0 2024-09-13T23:05:30.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.929+0000 7f47ab7fe640 1 -- 172.21.15.164:0/502149062 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f48c4025980 con 0x55c2c6b8eab0 2024-09-13T23:05:30.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.929+0000 7f47ab7fe640 1 --2- 172.21.15.164:0/502149062 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f47a4036af0 0x7f47a4038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.929+0000 7f47ab7fe640 1 -- 172.21.15.164:0/502149062 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f48c4030050 con 0x55c2c6b8eab0 2024-09-13T23:05:30.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.929+0000 7f48da646640 1 --2- 172.21.15.164:0/502149062 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f47a4036af0 0x7f47a4038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.929+0000 7f48dc351800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.929+0000 7f48dc351800 1 --2- 172.21.15.164:0/502149062 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c2c6ba1870 0x55c2c6ba3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.929+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6ba4480 con 0x55c2c6ba1870 2024-09-13T23:05:30.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.929+0000 7f48d9e45640 1 --2- 172.21.15.164:0/502149062 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c2c6ba1870 0x55c2c6ba3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.929+0000 7f48da646640 1 --2- 172.21.15.164:0/502149062 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f47a4036af0 0x7f47a4038fb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55c2c6b6e900 tx=0x7f48d401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.929+0000 7f48d9e45640 1 --2- 172.21.15.164:0/502149062 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c2c6ba1870 0x55c2c6ba3d30 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.930+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.930+0000 7f48dc351800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.930+0000 7f48dc351800 20 realm 2024-09-13T23:05:30.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.930+0000 7f48dc351800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.930+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6ba4890 con 0x55c2c6ba1870 2024-09-13T23:05:30.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.930+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.930+0000 7f48dc351800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.930+0000 7f48dc351800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:30.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.930+0000 7f48dc351800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.930+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6ba5160 con 0x55c2c6ba1870 2024-09-13T23:05:30.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.930+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.930+0000 7f48dc351800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.930+0000 7f48dc351800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.930+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6ba5500 con 0x55c2c6ba1870 2024-09-13T23:05:30.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.930+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.930+0000 7f48dc351800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:30.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.930+0000 7f48dc351800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.930+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6ba5960 con 0x55c2c6ba1870 2024-09-13T23:05:30.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.931+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.931+0000 7f48dc351800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:30.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.931+0000 7f48dc351800 20 searching for the correct realm 2024-09-13T23:05:30.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.931+0000 7f48dc351800 1 --2- 172.21.15.164:0/502149062 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55c2c6ba79b0 0x55c2c6ba9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.931+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x55c2c6ba79b0 2024-09-13T23:05:30.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.931+0000 7f48d1644640 1 --2- 172.21.15.164:0/502149062 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55c2c6ba79b0 0x55c2c6ba9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.931+0000 7f48d1644640 1 --2- 172.21.15.164:0/502149062 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55c2c6ba79b0 0x55c2c6ba9da0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.931+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48c4009050 con 0x55c2c6ba79b0 2024-09-13T23:05:30.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.931+0000 7f48d1644640 1 --2- 172.21.15.164:0/502149062 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f48c4043b70 0x7f48c400c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.931+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x7f48c4043b70 2024-09-13T23:05:30.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.931+0000 7f48da646640 1 --2- 172.21.15.164:0/502149062 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f48c4043b70 0x7f48c400c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.932+0000 7f48da646640 1 --2- 172.21.15.164:0/502149062 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f48c4043b70 0x7f48c400c580 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.932+0000 7f48da646640 1 -- 172.21.15.164:0/502149062 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48d401f070 con 0x7f48c4043b70 2024-09-13T23:05:30.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.932+0000 7f48da646640 1 --2- 172.21.15.164:0/502149062 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f48d4031040 0x7f48d4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:30.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.932+0000 7f48da646640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x7f48d4031040 2024-09-13T23:05:30.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.932+0000 7f48d9e45640 1 --2- 172.21.15.164:0/502149062 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f48d4031040 0x7f48d4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:30.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.933+0000 7f48d9e45640 1 --2- 172.21.15.164:0/502149062 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f48d4031040 0x7f48d4032940 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:30.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.933+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48cc07a030 con 0x7f48d4031040 2024-09-13T23:05:30.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.933+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x55c2c6ba1870 2024-09-13T23:05:30.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.933+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.933+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x55c2c6ba1870 2024-09-13T23:05:30.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.933+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.933+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x7f48d4031040 2024-09-13T23:05:30.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.934+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48cc07a030 con 0x7f48d4031040 2024-09-13T23:05:30.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.934+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x7f48d4031040 2024-09-13T23:05:30.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.934+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48cc07a030 con 0x7f48d4031040 2024-09-13T23:05:30.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.934+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x7f48c4043b70 2024-09-13T23:05:30.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.934+0000 7f48da646640 1 -- 172.21.15.164:0/502149062 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48d401f070 con 0x7f48c4043b70 2024-09-13T23:05:30.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.934+0000 7f48da646640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x55c2c6ba79b0 2024-09-13T23:05:30.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.934+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48c4009050 con 0x55c2c6ba79b0 2024-09-13T23:05:30.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.934+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x55c2c6ba1870 2024-09-13T23:05:30.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.934+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.934+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x7f48d4031040 2024-09-13T23:05:30.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.935+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48cc07a030 con 0x7f48d4031040 2024-09-13T23:05:30.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.935+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x55c2c6ba1870 2024-09-13T23:05:30.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.935+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.935+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x7f48c4043b70 2024-09-13T23:05:30.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.935+0000 7f48da646640 1 -- 172.21.15.164:0/502149062 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f48d401f070 con 0x7f48c4043b70 2024-09-13T23:05:30.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.935+0000 7f48da646640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x55c2c6ba79b0 2024-09-13T23:05:30.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.936+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48c4009050 con 0x55c2c6ba79b0 2024-09-13T23:05:30.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.936+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x55c2c6ba79b0 2024-09-13T23:05:30.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.936+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48c4009050 con 0x55c2c6ba79b0 2024-09-13T23:05:30.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.936+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x7f48d4031040 2024-09-13T23:05:30.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.936+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48cc07a030 con 0x7f48d4031040 2024-09-13T23:05:30.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.936+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x55c2c6ba79b0 2024-09-13T23:05:30.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.936+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48c4009050 con 0x55c2c6ba79b0 2024-09-13T23:05:30.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.936+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x55c2c6ba79b0 2024-09-13T23:05:30.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.936+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48c4009050 con 0x55c2c6ba79b0 2024-09-13T23:05:30.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.936+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x55c2c6ba1870 2024-09-13T23:05:30.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.937+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.937+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x55c2c6ba1870 2024-09-13T23:05:30.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.937+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.937+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x7f48d4031040 2024-09-13T23:05:30.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.937+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48cc07a030 con 0x7f48d4031040 2024-09-13T23:05:30.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.937+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x55c2c6ba79b0 2024-09-13T23:05:30.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.937+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48c4009050 con 0x55c2c6ba79b0 2024-09-13T23:05:30.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.937+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x7f48c4043b70 2024-09-13T23:05:30.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.938+0000 7f48da646640 1 -- 172.21.15.164:0/502149062 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48d401f070 con 0x7f48c4043b70 2024-09-13T23:05:30.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.938+0000 7f48da646640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x55c2c6ba1870 2024-09-13T23:05:30.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.938+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.938+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x7f48d4031040 2024-09-13T23:05:30.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.938+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48cc07a030 con 0x7f48d4031040 2024-09-13T23:05:30.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.938+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x55c2c6ba79b0 2024-09-13T23:05:30.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.938+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48c4009050 con 0x55c2c6ba79b0 2024-09-13T23:05:30.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.938+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x7f48d4031040 2024-09-13T23:05:30.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.939+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48cc07a030 con 0x7f48d4031040 2024-09-13T23:05:30.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.939+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x7f48c4043b70 2024-09-13T23:05:30.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.939+0000 7f48da646640 1 -- 172.21.15.164:0/502149062 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48d401f070 con 0x7f48c4043b70 2024-09-13T23:05:30.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.939+0000 7f48da646640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x55c2c6ba79b0 2024-09-13T23:05:30.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.939+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48c4009050 con 0x55c2c6ba79b0 2024-09-13T23:05:30.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.939+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x7f48d4031040 2024-09-13T23:05:30.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.939+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48cc07a030 con 0x7f48d4031040 2024-09-13T23:05:30.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.939+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x55c2c6ba1870 2024-09-13T23:05:30.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.940+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.940+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baa450 con 0x7f48c4043b70 2024-09-13T23:05:30.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.940+0000 7f48da646640 1 -- 172.21.15.164:0/502149062 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48d401f070 con 0x7f48c4043b70 2024-09-13T23:05:30.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.940+0000 7f48dc351800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:30.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.940+0000 7f48dc351800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:30.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.940+0000 7f48dc351800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:30.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.940+0000 7f48dc351800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:30.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.940+0000 7f48dc351800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:30.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.940+0000 7f48dc351800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:30.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.940+0000 7f48dc351800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.940+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6ba6400 con 0x55c2c6ba1870 2024-09-13T23:05:30.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.940+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.940+0000 7f48dc351800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.940+0000 7f48dc351800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.940+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6ba67f0 con 0x55c2c6ba1870 2024-09-13T23:05:30.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.940+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.940+0000 7f48dc351800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:30.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.940+0000 7f48dc351800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.940+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6ba67f0 con 0x55c2c6ba1870 2024-09-13T23:05:30.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.941+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.941+0000 7f48dc351800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:30.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.941+0000 7f48dc351800 20 zone default found 2024-09-13T23:05:30.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.941+0000 7f48dc351800 4 Realm: () 2024-09-13T23:05:30.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.941+0000 7f48dc351800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:30.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.941+0000 7f48dc351800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:30.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.941+0000 7f48dc351800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:30.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.941+0000 7f48dc351800 20 zonegroup default 2024-09-13T23:05:30.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.941+0000 7f48dc351800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.941+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6ba6c10 con 0x7f48d4031040 2024-09-13T23:05:30.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.941+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x7f48d4031040 2024-09-13T23:05:30.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.941+0000 7f48dc351800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.941+0000 7f48dc351800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.941+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6ba6c10 con 0x55c2c6ba79b0 2024-09-13T23:05:30.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.941+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f48c4009050 con 0x55c2c6ba79b0 2024-09-13T23:05:30.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.941+0000 7f48dc351800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.941+0000 7f48dc351800 20 rados->read ofs=0 len=0 2024-09-13T23:05:30.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.941+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6bac290 con 0x55c2c6ba79b0 2024-09-13T23:05:30.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.942+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f48c4009050 con 0x55c2c6ba79b0 2024-09-13T23:05:30.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.942+0000 7f48dc351800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:30.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.942+0000 7f48dc351800 20 started sync module instance, tier type = 2024-09-13T23:05:30.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.942+0000 7f48dc351800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:30.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.942+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6bab730 con 0x7f48c4043b70 2024-09-13T23:05:30.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.943+0000 7f48da646640 1 -- 172.21.15.164:0/502149062 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48d4040040 con 0x7f48c4043b70 2024-09-13T23:05:30.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.943+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94295046142752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6bab390 con 0x7f48c4043b70 2024-09-13T23:05:30.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.943+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6bad100 con 0x55c2c6ba1870 2024-09-13T23:05:30.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.943+0000 7f48da646640 1 -- 172.21.15.164:0/502149062 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94295046142752] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48d4040040 con 0x7f48c4043b70 2024-09-13T23:05:30.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.944+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.944+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94295046145584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6bad100 con 0x55c2c6ba1870 2024-09-13T23:05:30.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.944+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6badb40 con 0x55c2c6ba79b0 2024-09-13T23:05:30.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.945+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94295046145584] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.945+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48c4009050 con 0x55c2c6ba79b0 2024-09-13T23:05:30.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.945+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94295046147152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6bad070 con 0x55c2c6ba79b0 2024-09-13T23:05:30.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.945+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baea00 con 0x7f48c4043b70 2024-09-13T23:05:30.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.946+0000 7f48da646640 1 -- 172.21.15.164:0/502149062 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48d4040040 con 0x7f48c4043b70 2024-09-13T23:05:30.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.946+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94295046154032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6baf1e0 con 0x7f48c4043b70 2024-09-13T23:05:30.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.946+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6bafce0 con 0x55c2c6ba1870 2024-09-13T23:05:30.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.946+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94295046147152] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48c4009050 con 0x55c2c6ba79b0 2024-09-13T23:05:30.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.947+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.947+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94295046158288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6bafca0 con 0x55c2c6ba1870 2024-09-13T23:05:30.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.947+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6bb0720 con 0x7f48d4031040 2024-09-13T23:05:30.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.947+0000 7f48da646640 1 -- 172.21.15.164:0/502149062 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94295046154032] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48d4040040 con 0x7f48c4043b70 2024-09-13T23:05:30.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.948+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94295046158288] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.948+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x7f48d4031040 2024-09-13T23:05:30.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.948+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94295046151984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6bb0270 con 0x7f48d4031040 2024-09-13T23:05:30.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.949+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6bb0fc0 con 0x7f48d4031040 2024-09-13T23:05:30.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.949+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x7f48d4031040 2024-09-13T23:05:30.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.949+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94295046162480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6bb1100 con 0x7f48d4031040 2024-09-13T23:05:30.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.949+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6bb1b00 con 0x7f48d4031040 2024-09-13T23:05:30.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.950+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94295046151984] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x7f48d4031040 2024-09-13T23:05:30.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.950+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x7f48d4031040 2024-09-13T23:05:30.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.950+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94295046162480] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x7f48d4031040 2024-09-13T23:05:30.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.950+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94295046155312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6bb1ac0 con 0x7f48d4031040 2024-09-13T23:05:30.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.950+0000 7f48dc351800 20 add_watcher() i=0 2024-09-13T23:05:30.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.950+0000 7f48dc351800 20 add_watcher() i=1 2024-09-13T23:05:30.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.950+0000 7f48dc351800 20 add_watcher() i=2 2024-09-13T23:05:30.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.950+0000 7f48dc351800 20 add_watcher() i=3 2024-09-13T23:05:30.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.950+0000 7f48dc351800 20 add_watcher() i=4 2024-09-13T23:05:30.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.950+0000 7f48dc351800 20 add_watcher() i=5 2024-09-13T23:05:30.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.950+0000 7f48dc351800 20 add_watcher() i=6 2024-09-13T23:05:30.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.951+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94295046155312] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x7f48d4031040 2024-09-13T23:05:30.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.951+0000 7f48dc351800 20 add_watcher() i=7 2024-09-13T23:05:30.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.951+0000 7f48dc351800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:30.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.951+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6bb1ac0 con 0x55c2c6ba1870 2024-09-13T23:05:30.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.952+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.952+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94295046166032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6bb1a60 con 0x55c2c6ba1870 2024-09-13T23:05:30.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.953+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94295046166032] v32'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.953+0000 7f478bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:30.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.953+0000 7f48dc351800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:30.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.953+0000 7f48dc351800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:30.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.953+0000 7f48dc351800 5 note: GC not initialized 2024-09-13T23:05:30.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.953+0000 7f478affd640 20 reqs_thread_entry: start 2024-09-13T23:05:30.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.953+0000 7f48dc351800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:30.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.953+0000 7f48dc351800 20 Filter name: none 2024-09-13T23:05:30.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.953+0000 7f4788ff9640 20 reqs_thread_entry: start 2024-09-13T23:05:30.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.953+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8300 con 0x55c2c6ba1870 2024-09-13T23:05:30.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.954+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.954+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8300 con 0x7f48c4043b70 2024-09-13T23:05:30.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.954+0000 7f48da646640 1 -- 172.21.15.164:0/502149062 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f48d4040040 con 0x7f48c4043b70 2024-09-13T23:05:30.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.954+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8300 con 0x55c2c6ba1870 2024-09-13T23:05:30.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.954+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.954+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be82c0 con 0x55c2c6ba79b0 2024-09-13T23:05:30.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.954+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f48c4009050 con 0x55c2c6ba79b0 2024-09-13T23:05:30.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.954+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8840 con 0x55c2c6ba79b0 2024-09-13T23:05:30.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.955+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f48c4009050 con 0x55c2c6ba79b0 2024-09-13T23:05:30.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.955+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8ca0 con 0x55c2c6ba79b0 2024-09-13T23:05:30.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.955+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f48c4009050 con 0x55c2c6ba79b0 2024-09-13T23:05:30.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.955+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8ca0 con 0x55c2c6ba1870 2024-09-13T23:05:30.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.955+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.955+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8ca0 con 0x55c2c6ba1870 2024-09-13T23:05:30.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.955+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.955+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8ca0 con 0x55c2c6ba79b0 2024-09-13T23:05:30.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.955+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f48c4009050 con 0x55c2c6ba79b0 2024-09-13T23:05:30.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.955+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c50 con 0x55c2c6ba79b0 2024-09-13T23:05:30.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.956+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f48c4009050 con 0x55c2c6ba79b0 2024-09-13T23:05:30.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.956+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x7f48d4031040 2024-09-13T23:05:30.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.956+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x7f48d4031040 2024-09-13T23:05:30.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.956+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x55c2c6ba1870 2024-09-13T23:05:30.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.956+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.956+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x7f48c4043b70 2024-09-13T23:05:30.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.956+0000 7f48da646640 1 -- 172.21.15.164:0/502149062 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f48d4040040 con 0x7f48c4043b70 2024-09-13T23:05:30.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.956+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x55c2c6ba79b0 2024-09-13T23:05:30.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.957+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f48c4009050 con 0x55c2c6ba79b0 2024-09-13T23:05:30.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.957+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x7f48d4031040 2024-09-13T23:05:30.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.957+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x7f48d4031040 2024-09-13T23:05:30.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.957+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x7f48d4031040 2024-09-13T23:05:30.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.957+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x7f48d4031040 2024-09-13T23:05:30.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.957+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x55c2c6ba79b0 2024-09-13T23:05:30.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.957+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f48c4009050 con 0x55c2c6ba79b0 2024-09-13T23:05:30.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.957+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x7f48d4031040 2024-09-13T23:05:30.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.958+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x7f48d4031040 2024-09-13T23:05:30.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.958+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x55c2c6ba1870 2024-09-13T23:05:30.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.958+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.958+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x55c2c6ba79b0 2024-09-13T23:05:30.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.958+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 <== osd.3 v2:172.21.15.164:6816/93809510 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f48c4009050 con 0x55c2c6ba79b0 2024-09-13T23:05:30.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.958+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x7f48d4031040 2024-09-13T23:05:30.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.959+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x7f48d4031040 2024-09-13T23:05:30.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.959+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x7f48c4043b70 2024-09-13T23:05:30.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.959+0000 7f48da646640 1 -- 172.21.15.164:0/502149062 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f48d4040040 con 0x7f48c4043b70 2024-09-13T23:05:30.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.959+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x7f48d4031040 2024-09-13T23:05:30.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.959+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x7f48d4031040 2024-09-13T23:05:30.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.959+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x55c2c6ba1870 2024-09-13T23:05:30.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.959+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.959+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x55c2c6ba1870 2024-09-13T23:05:30.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.960+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.960+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x55c2c6ba79b0 2024-09-13T23:05:30.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.960+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 <== osd.3 v2:172.21.15.164:6816/93809510 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f48c4009050 con 0x55c2c6ba79b0 2024-09-13T23:05:30.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.960+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x55c2c6ba1870 2024-09-13T23:05:30.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.960+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.960+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x55c2c6ba1870 2024-09-13T23:05:30.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.960+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.960+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x55c2c6ba79b0 2024-09-13T23:05:30.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.960+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 <== osd.3 v2:172.21.15.164:6816/93809510 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f48c4009050 con 0x55c2c6ba79b0 2024-09-13T23:05:30.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.960+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x55c2c6ba79b0 2024-09-13T23:05:30.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.960+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 <== osd.3 v2:172.21.15.164:6816/93809510 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f48c4009050 con 0x55c2c6ba79b0 2024-09-13T23:05:30.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.961+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x55c2c6ba79b0 2024-09-13T23:05:30.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.961+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 <== osd.3 v2:172.21.15.164:6816/93809510 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f48c4009050 con 0x55c2c6ba79b0 2024-09-13T23:05:30.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.961+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x7f48d4031040 2024-09-13T23:05:30.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.961+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x7f48d4031040 2024-09-13T23:05:30.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.962+0000 7f478bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:30.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.962+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94295046166032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x55c2c6ba1870 2024-09-13T23:05:30.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.963+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94295046166032] v32'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.963+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94295046142752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x7f48c4043b70 2024-09-13T23:05:30.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.966+0000 7f48da646640 1 -- 172.21.15.164:0/502149062 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94295046142752] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48d4040040 con 0x7f48c4043b70 2024-09-13T23:05:30.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.966+0000 7f48dc351800 20 remove_watcher() i=0 2024-09-13T23:05:30.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.966+0000 7f48dc351800 2 removed watcher, disabling cache 2024-09-13T23:05:30.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.966+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94295046145584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x55c2c6ba1870 2024-09-13T23:05:30.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.967+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94295046145584] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.967+0000 7f48dc351800 20 remove_watcher() i=1 2024-09-13T23:05:30.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.967+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94295046147152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x55c2c6ba79b0 2024-09-13T23:05:30.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.968+0000 7f48d1644640 1 -- 172.21.15.164:0/502149062 <== osd.3 v2:172.21.15.164:6816/93809510 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94295046147152] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48c4009050 con 0x55c2c6ba79b0 2024-09-13T23:05:30.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.968+0000 7f48dc351800 20 remove_watcher() i=2 2024-09-13T23:05:30.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.968+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94295046154032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x7f48c4043b70 2024-09-13T23:05:30.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.969+0000 7f48da646640 1 -- 172.21.15.164:0/502149062 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94295046154032] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48d4040040 con 0x7f48c4043b70 2024-09-13T23:05:30.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.969+0000 7f48dc351800 20 remove_watcher() i=3 2024-09-13T23:05:30.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.969+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94295046158288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x55c2c6ba1870 2024-09-13T23:05:30.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.970+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.1 v2:172.21.15.164:6800/4060509701 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94295046158288] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x55c2c6ba1870 2024-09-13T23:05:30.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.970+0000 7f48dc351800 20 remove_watcher() i=4 2024-09-13T23:05:30.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.970+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94295046151984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x7f48d4031040 2024-09-13T23:05:30.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.971+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94295046151984] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x7f48d4031040 2024-09-13T23:05:30.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.971+0000 7f48dc351800 20 remove_watcher() i=5 2024-09-13T23:05:30.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.971+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94295046162480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x7f48d4031040 2024-09-13T23:05:30.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.972+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94295046162480] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x7f48d4031040 2024-09-13T23:05:30.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.972+0000 7f48dc351800 20 remove_watcher() i=6 2024-09-13T23:05:30.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.972+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94295046155312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2c6be8c00 con 0x7f48d4031040 2024-09-13T23:05:30.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.973+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94295046155312] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48cc07a030 con 0x7f48d4031040 2024-09-13T23:05:30.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.973+0000 7f48dc351800 20 remove_watcher() i=7 2024-09-13T23:05:30.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.973+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f48d4031040 msgr2=0x7f48d4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.973+0000 7f48dc351800 1 --2- 172.21.15.164:0/502149062 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f48d4031040 0x7f48d4032940 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.973+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c2c6ba1870 msgr2=0x55c2c6ba3d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.973+0000 7f48dc351800 1 --2- 172.21.15.164:0/502149062 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c2c6ba1870 0x55c2c6ba3d30 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.973+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f48c4043b70 msgr2=0x7f48c400c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.973+0000 7f48dc351800 1 --2- 172.21.15.164:0/502149062 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f48c4043b70 0x7f48c400c580 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.973+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55c2c6ba79b0 msgr2=0x55c2c6ba9da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.973+0000 7f48dc351800 1 --2- 172.21.15.164:0/502149062 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55c2c6ba79b0 0x55c2c6ba9da0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.973+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f47a4036af0 msgr2=0x7f47a4038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.973+0000 7f48dc351800 1 --2- 172.21.15.164:0/502149062 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f47a4036af0 0x7f47a4038fb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55c2c6b6e900 tx=0x7f48d401f000 comp rx=0 tx=0).stop 2024-09-13T23:05:30.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.973+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c6b8eab0 msgr2=0x55c2c6b95fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.973+0000 7f48d9e45640 1 -- 172.21.15.164:0/502149062 reap_dead start 2024-09-13T23:05:30.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.973+0000 7f48dc351800 1 --2- 172.21.15.164:0/502149062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c6b8eab0 0x55c2c6b95fb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f48c400dcc0 tx=0x7f48c404d110 comp rx=0 tx=0).stop 2024-09-13T23:05:30.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.973+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 shutdown_connections 2024-09-13T23:05:30.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.973+0000 7f48dc351800 1 --2- 172.21.15.164:0/502149062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c6b8eab0 0x55c2c6b95fb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.973+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 >> 172.21.15.164:0/502149062 conn(0x55c2c6b8ae10 msgr2=0x55c2c6b88ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.973+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 shutdown_connections 2024-09-13T23:05:30.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.973+0000 7f48dc351800 1 -- 172.21.15.164:0/502149062 wait complete. 2024-09-13T23:05:30.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.973+0000 7f48dc351800 1 -- 172.21.15.164:0/3336325179 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f47b4036b40 msgr2=0x7f47b4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.973+0000 7f48dc351800 1 --2- 172.21.15.164:0/3336325179 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f47b4036b40 0x7f47b4039000 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55c2c6b72440 tx=0x7f48d4005840 comp rx=0 tx=0).stop 2024-09-13T23:05:30.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.973+0000 7f48dc351800 1 -- 172.21.15.164:0/3336325179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c6b81da0 msgr2=0x55c2c6b821c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.973+0000 7f48dc351800 1 --2- 172.21.15.164:0/3336325179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c6b81da0 0x55c2c6b821c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f48c4001ed0 tx=0x7f48c400d7a0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.974+0000 7f48dc351800 1 -- 172.21.15.164:0/3336325179 shutdown_connections 2024-09-13T23:05:30.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.974+0000 7f48dc351800 1 --2- 172.21.15.164:0/3336325179 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f47b4036b40 0x7f47b4039000 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.974+0000 7f48dc351800 1 --2- 172.21.15.164:0/3336325179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c6b81da0 0x55c2c6b821c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.974+0000 7f48dc351800 1 -- 172.21.15.164:0/3336325179 >> 172.21.15.164:0/3336325179 conn(0x55c2c6b76d30 msgr2=0x55c2c6b798b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.974+0000 7f48dc351800 1 -- 172.21.15.164:0/3336325179 shutdown_connections 2024-09-13T23:05:30.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.974+0000 7f48dc351800 1 -- 172.21.15.164:0/3336325179 wait complete. 2024-09-13T23:05:30.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.974+0000 7f48dc351800 1 -- 172.21.15.164:0/3606860619 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c2c69e75c0 msgr2=0x55c2c6b713e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.974+0000 7f48dc351800 1 --2- 172.21.15.164:0/3606860619 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c2c69e75c0 0x55c2c6b713e0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.974+0000 7f48dc351800 1 -- 172.21.15.164:0/3606860619 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f47c0036b40 msgr2=0x7f47c0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.974+0000 7f48dc351800 1 --2- 172.21.15.164:0/3606860619 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f47c0036b40 0x7f47c0039000 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f48c4000f60 tx=0x7f48c40012b0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.974+0000 7f48dc351800 1 -- 172.21.15.164:0/3606860619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c69e62e0 msgr2=0x55c2c6b6a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:30.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.974+0000 7f48dc351800 1 --2- 172.21.15.164:0/3606860619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c69e62e0 0x55c2c6b6a370 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55c2c6b63960 tx=0x7f48cc002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.974+0000 7f48dc351800 1 -- 172.21.15.164:0/3606860619 shutdown_connections 2024-09-13T23:05:30.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.974+0000 7f48dc351800 1 --2- 172.21.15.164:0/3606860619 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c2c69e75c0 0x55c2c6b713e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.974+0000 7f48dc351800 1 --2- 172.21.15.164:0/3606860619 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f47c0036b40 0x7f47c0039000 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.974+0000 7f48dc351800 1 --2- 172.21.15.164:0/3606860619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c69e62e0 0x55c2c6b6a370 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:30.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.974+0000 7f48dc351800 1 -- 172.21.15.164:0/3606860619 >> 172.21.15.164:0/3606860619 conn(0x55c2c6a6cfe0 msgr2=0x55c2c6b5cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:30.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.974+0000 7f48dc351800 1 -- 172.21.15.164:0/3606860619 shutdown_connections 2024-09-13T23:05:30.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:30.974+0000 7f48dc351800 1 -- 172.21.15.164:0/3606860619 wait complete. 2024-09-13T23:05:30.997 INFO:teuthology.orchestra.run.smithi164.stdout:{"entries":[],"summary":[]} 2024-09-13T23:05:30.998 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-13T23:05:30.998 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T23:05:30.998 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T23:05:30.998 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T23:05:31.082 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:31.082 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:31.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.082+0000 7f1d16a87800 1 Processor -- start 2024-09-13T23:05:31.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.083+0000 7f1d16a87800 1 -- start start 2024-09-13T23:05:31.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.083+0000 7f1d16a87800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x556c3589d630 0x556c3592c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.083+0000 7f1d16a87800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556c357e8b30 con 0x556c3592c790 2024-09-13T23:05:31.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.083+0000 7f1d16a87800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x556c357ca360 con 0x556c3589d630 2024-09-13T23:05:31.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.083+0000 7f1d1457b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x556c3589d630 0x556c3592c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.083+0000 7f1d13d7a640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x556c3592c790 0x556c3592eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40714/0 (socket says 172.21.15.164:40714) 2024-09-13T23:05:31.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.083+0000 7f1d1457b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x556c3589d630 0x556c3592c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56146/0 (socket says 172.21.15.164:56146) 2024-09-13T23:05:31.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.083+0000 7f1d13d7a640 1 -- 172.21.15.164:0/3454192461 learned_addr learned my addr 172.21.15.164:0/3454192461 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:31.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.083+0000 7f1d1457b640 1 -- 172.21.15.164:0/3454192461 >> v1:172.21.15.17:6789/0 conn(0x556c3592c790 legacy=0x556c3592eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.083+0000 7f1d1457b640 1 -- 172.21.15.164:0/3454192461 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c357f0e00 con 0x556c3589d630 2024-09-13T23:05:31.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.085+0000 7f1d1457b640 1 --2- 172.21.15.164:0/3454192461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c3589d630 0x556c3592c250 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1d0400a470 tx=0x7f1d04045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d378c2e3ecc6bb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.085+0000 7f1d13579640 1 -- 172.21.15.164:0/3454192461 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d04053570 con 0x556c3589d630 2024-09-13T23:05:31.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.086+0000 7f1d13579640 1 -- 172.21.15.164:0/3454192461 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d04058070 con 0x556c3589d630 2024-09-13T23:05:31.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.086+0000 7f1d13579640 1 -- 172.21.15.164:0/3454192461 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d04053880 con 0x556c3589d630 2024-09-13T23:05:31.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.086+0000 7f1d16a87800 1 -- 172.21.15.164:0/3454192461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c3589d630 msgr2=0x556c3592c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.086+0000 7f1d16a87800 1 --2- 172.21.15.164:0/3454192461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c3589d630 0x556c3592c250 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1d0400a470 tx=0x7f1d04045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:31.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.086+0000 7f1d16a87800 1 -- 172.21.15.164:0/3454192461 shutdown_connections 2024-09-13T23:05:31.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.086+0000 7f1d16a87800 1 --2- 172.21.15.164:0/3454192461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c3589d630 0x556c3592c250 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.086+0000 7f1d16a87800 1 -- 172.21.15.164:0/3454192461 >> 172.21.15.164:0/3454192461 conn(0x556c35923de0 msgr2=0x556c35926200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.086+0000 7f1d16a87800 1 -- 172.21.15.164:0/3454192461 shutdown_connections 2024-09-13T23:05:31.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.086+0000 7f1d16a87800 1 -- 172.21.15.164:0/3454192461 wait complete. 2024-09-13T23:05:31.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.100+0000 7f1d16a87800 1 Processor -- start 2024-09-13T23:05:31.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.100+0000 7f1d16a87800 1 -- start start 2024-09-13T23:05:31.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.100+0000 7f1d16a87800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c3589d630 0x556c35929b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.100+0000 7f1d16a87800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556c35875330 con 0x556c3589d630 2024-09-13T23:05:31.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.100+0000 7f1d1457b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c3589d630 0x556c35929b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.100+0000 7f1d1457b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c3589d630 0x556c35929b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56158/0 (socket says 172.21.15.164:56158) 2024-09-13T23:05:31.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.100+0000 7f1d1457b640 1 -- 172.21.15.164:0/227421112 learned_addr learned my addr 172.21.15.164:0/227421112 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.101+0000 7f1d1457b640 1 -- 172.21.15.164:0/227421112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c357c2bc0 con 0x556c3589d630 2024-09-13T23:05:31.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.101+0000 7f1d1457b640 1 --2- 172.21.15.164:0/227421112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c3589d630 0x556c35929b80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1d04025c20 tx=0x7f1d04051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2dc64497b0a64ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.101+0000 7f1c0260c640 1 -- 172.21.15.164:0/227421112 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d0405c580 con 0x556c3589d630 2024-09-13T23:05:31.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.101+0000 7f1c0260c640 1 -- 172.21.15.164:0/227421112 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d04063030 con 0x556c3589d630 2024-09-13T23:05:31.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.101+0000 7f1c0260c640 1 -- 172.21.15.164:0/227421112 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d0405c850 con 0x556c3589d630 2024-09-13T23:05:31.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.102+0000 7f1d16a87800 1 -- 172.21.15.164:0/227421112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c3589d630 msgr2=0x556c35929b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.102+0000 7f1d16a87800 1 --2- 172.21.15.164:0/227421112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c3589d630 0x556c35929b80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1d04025c20 tx=0x7f1d04051000 comp rx=0 tx=0).stop 2024-09-13T23:05:31.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.102+0000 7f1d16a87800 1 -- 172.21.15.164:0/227421112 shutdown_connections 2024-09-13T23:05:31.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.102+0000 7f1d16a87800 1 --2- 172.21.15.164:0/227421112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c3589d630 0x556c35929b80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.102+0000 7f1d16a87800 1 -- 172.21.15.164:0/227421112 >> 172.21.15.164:0/227421112 conn(0x556c35923de0 msgr2=0x556c35a14250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.102+0000 7f1d16a87800 1 -- 172.21.15.164:0/227421112 shutdown_connections 2024-09-13T23:05:31.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.102+0000 7f1d16a87800 1 -- 172.21.15.164:0/227421112 wait complete. 2024-09-13T23:05:31.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.102+0000 7f1d16a87800 1 Processor -- start 2024-09-13T23:05:31.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.102+0000 7f1d16a87800 1 -- start start 2024-09-13T23:05:31.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.102+0000 7f1d16a87800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c3589d630 0x556c35a22490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.102+0000 7f1d16a87800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556c35930690 con 0x556c3589d630 2024-09-13T23:05:31.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.103+0000 7f1d1457b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c3589d630 0x556c35a22490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.103+0000 7f1d1457b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c3589d630 0x556c35a22490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56166/0 (socket says 172.21.15.164:56166) 2024-09-13T23:05:31.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.103+0000 7f1d1457b640 1 -- 172.21.15.164:0/585474705 learned_addr learned my addr 172.21.15.164:0/585474705 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.103+0000 7f1d1457b640 1 -- 172.21.15.164:0/585474705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c357d6fe0 con 0x556c3589d630 2024-09-13T23:05:31.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.103+0000 7f1d1457b640 1 --2- 172.21.15.164:0/585474705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c3589d630 0x556c35a22490 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x556c35929280 tx=0x7f1d04002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.103+0000 7f1c00e09640 1 -- 172.21.15.164:0/585474705 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d04054ad0 con 0x556c3589d630 2024-09-13T23:05:31.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.103+0000 7f1c00e09640 1 -- 172.21.15.164:0/585474705 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d04054c70 con 0x556c3589d630 2024-09-13T23:05:31.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.103+0000 7f1c00e09640 1 -- 172.21.15.164:0/585474705 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d04068420 con 0x556c3589d630 2024-09-13T23:05:31.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.103+0000 7f1d16a87800 1 -- 172.21.15.164:0/585474705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556c35a229d0 con 0x556c3589d630 2024-09-13T23:05:31.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.103+0000 7f1d16a87800 1 -- 172.21.15.164:0/585474705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c35a22ef0 con 0x556c3589d630 2024-09-13T23:05:31.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.104+0000 7f1c00e09640 1 -- 172.21.15.164:0/585474705 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1d040685c0 con 0x556c3589d630 2024-09-13T23:05:31.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.104+0000 7f1c00e09640 1 --2- 172.21.15.164:0/585474705 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1bfc036b90 0x7f1bfc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.104+0000 7f1c00e09640 1 -- 172.21.15.164:0/585474705 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f1d04070030 con 0x556c3589d630 2024-09-13T23:05:31.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.104+0000 7f1d13d7a640 1 --2- 172.21.15.164:0/585474705 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1bfc036b90 0x7f1bfc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.104+0000 7f1d16a87800 1 --2- 172.21.15.164:0/585474705 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x556c3592c790 0x556c35a29500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.104+0000 7f1d16a87800 1 -- 172.21.15.164:0/585474705 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c35a29a40 con 0x556c3592c790 2024-09-13T23:05:31.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.105+0000 7f1d14d7c640 1 --2- 172.21.15.164:0/585474705 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x556c3592c790 0x556c35a29500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.105+0000 7f1d13d7a640 1 --2- 172.21.15.164:0/585474705 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1bfc036b90 0x7f1bfc039050 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc000f60 tx=0x7f1cfc0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.105+0000 7f1d14d7c640 1 --2- 172.21.15.164:0/585474705 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x556c3592c790 0x556c35a29500 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.105+0000 7f1d14d7c640 1 -- 172.21.15.164:0/585474705 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d0c00a4a0 con 0x556c3592c790 2024-09-13T23:05:31.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.105+0000 7f1d16a87800 1 -- 172.21.15.164:0/585474705 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c35a26ad0 con 0x556c3592c790 2024-09-13T23:05:31.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.105+0000 7f1d14d7c640 1 -- 172.21.15.164:0/585474705 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d0c00a4a0 con 0x556c3592c790 2024-09-13T23:05:31.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.105+0000 7f1d16a87800 1 -- 172.21.15.164:0/585474705 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c35a2b880 con 0x556c3592c790 2024-09-13T23:05:31.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.106+0000 7f1d14d7c640 1 -- 172.21.15.164:0/585474705 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1d0c00a4a0 con 0x556c3592c790 2024-09-13T23:05:31.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.106+0000 7f1d16a87800 1 -- 172.21.15.164:0/585474705 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c35a2aab0 con 0x556c3592c790 2024-09-13T23:05:31.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.106+0000 7f1d14d7c640 1 -- 172.21.15.164:0/585474705 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d0c00a4a0 con 0x556c3592c790 2024-09-13T23:05:31.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.106+0000 7f1d16a87800 1 -- 172.21.15.164:0/585474705 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c35a2ae50 con 0x556c3592c790 2024-09-13T23:05:31.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.106+0000 7f1d14d7c640 1 -- 172.21.15.164:0/585474705 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1d0c00a4a0 con 0x556c3592c790 2024-09-13T23:05:31.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.107+0000 7f1d16a87800 1 Processor -- start 2024-09-13T23:05:31.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.107+0000 7f1d16a87800 1 -- start start 2024-09-13T23:05:31.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.107+0000 7f1d16a87800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c35a39e80 0x556c35a3a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.107+0000 7f1d16a87800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556c357c4580 con 0x556c35a39e80 2024-09-13T23:05:31.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.107+0000 7f1d13d7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c35a39e80 0x556c35a3a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.107+0000 7f1d13d7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c35a39e80 0x556c35a3a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56182/0 (socket says 172.21.15.164:56182) 2024-09-13T23:05:31.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.107+0000 7f1d13d7a640 1 -- 172.21.15.164:0/2905463151 learned_addr learned my addr 172.21.15.164:0/2905463151 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.108+0000 7f1d13d7a640 1 -- 172.21.15.164:0/2905463151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c35a3a7e0 con 0x556c35a39e80 2024-09-13T23:05:31.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.108+0000 7f1d13d7a640 1 --2- 172.21.15.164:0/2905463151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c35a39e80 0x556c35a3a2a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc001ed0 tx=0x7f1cfc00d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.108+0000 7f1bf9ffb640 1 -- 172.21.15.164:0/2905463151 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cfc01b550 con 0x556c35a39e80 2024-09-13T23:05:31.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.108+0000 7f1bf9ffb640 1 -- 172.21.15.164:0/2905463151 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cfc01b6f0 con 0x556c35a39e80 2024-09-13T23:05:31.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.108+0000 7f1bf9ffb640 1 -- 172.21.15.164:0/2905463151 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cfc01b9d0 con 0x556c35a39e80 2024-09-13T23:05:31.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.108+0000 7f1d16a87800 1 -- 172.21.15.164:0/2905463151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556c35a3aa70 con 0x556c35a39e80 2024-09-13T23:05:31.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.108+0000 7f1d16a87800 1 -- 172.21.15.164:0/2905463151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c35a3d750 con 0x556c35a39e80 2024-09-13T23:05:31.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.109+0000 7f1bf9ffb640 1 -- 172.21.15.164:0/2905463151 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1cfc023020 con 0x556c35a39e80 2024-09-13T23:05:31.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.109+0000 7f1bf9ffb640 1 --2- 172.21.15.164:0/2905463151 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1bec036b90 0x7f1bec039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.109+0000 7f1bf9ffb640 1 -- 172.21.15.164:0/2905463151 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f1cfc021020 con 0x556c35a39e80 2024-09-13T23:05:31.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.109+0000 7f1d14d7c640 1 --2- 172.21.15.164:0/2905463151 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1bec036b90 0x7f1bec039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.109+0000 7f1d16a87800 1 Processor -- start 2024-09-13T23:05:31.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.110+0000 7f1d14d7c640 1 --2- 172.21.15.164:0/2905463151 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1bec036b90 0x7f1bec039050 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x556c35a2a5d0 tx=0x7f1d0c005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.110+0000 7f1d16a87800 1 -- start start 2024-09-13T23:05:31.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.110+0000 7f1d16a87800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c35a46b90 0x556c35a46f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.110+0000 7f1d16a87800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556c359281f0 con 0x556c35a46b90 2024-09-13T23:05:31.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.110+0000 7f1d13d7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c35a46b90 0x556c35a46f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.110+0000 7f1d13d7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c35a46b90 0x556c35a46f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56188/0 (socket says 172.21.15.164:56188) 2024-09-13T23:05:31.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.110+0000 7f1d13d7a640 1 -- 172.21.15.164:0/1725545094 learned_addr learned my addr 172.21.15.164:0/1725545094 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.110+0000 7f1d13d7a640 1 -- 172.21.15.164:0/1725545094 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c35a47560 con 0x556c35a46b90 2024-09-13T23:05:31.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.110+0000 7f1d13d7a640 1 --2- 172.21.15.164:0/1725545094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c35a46b90 0x556c35a46f90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc04d100 tx=0x7f1cfc019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53b9cc6e478f435 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.110+0000 7f1beb7fe640 1 -- 172.21.15.164:0/1725545094 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cfc0258e0 con 0x556c35a46b90 2024-09-13T23:05:31.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.111+0000 7f1beb7fe640 1 -- 172.21.15.164:0/1725545094 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cfc025410 con 0x556c35a46b90 2024-09-13T23:05:31.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.111+0000 7f1beb7fe640 1 -- 172.21.15.164:0/1725545094 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cfc025a80 con 0x556c35a46b90 2024-09-13T23:05:31.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.111+0000 7f1d16a87800 1 -- 172.21.15.164:0/1725545094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c35a46b90 msgr2=0x556c35a46f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.111+0000 7f1d16a87800 1 --2- 172.21.15.164:0/1725545094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c35a46b90 0x556c35a46f90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc04d100 tx=0x7f1cfc019ce0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.111+0000 7f1d16a87800 1 -- 172.21.15.164:0/1725545094 shutdown_connections 2024-09-13T23:05:31.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.111+0000 7f1d16a87800 1 --2- 172.21.15.164:0/1725545094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c35a46b90 0x556c35a46f90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.111+0000 7f1d16a87800 1 -- 172.21.15.164:0/1725545094 >> 172.21.15.164:0/1725545094 conn(0x556c35a42ef0 msgr2=0x556c35a40ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.111+0000 7f1d16a87800 1 -- 172.21.15.164:0/1725545094 shutdown_connections 2024-09-13T23:05:31.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.111+0000 7f1d16a87800 1 -- 172.21.15.164:0/1725545094 wait complete. 2024-09-13T23:05:31.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.111+0000 7f1d16a87800 1 Processor -- start 2024-09-13T23:05:31.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.111+0000 7f1d16a87800 1 -- start start 2024-09-13T23:05:31.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.112+0000 7f1d16a87800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c35a46b90 0x556c35a4e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.112+0000 7f1d16a87800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556c35a47bd0 con 0x556c35a46b90 2024-09-13T23:05:31.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.112+0000 7f1d13d7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c35a46b90 0x556c35a4e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.112+0000 7f1d13d7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c35a46b90 0x556c35a4e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56198/0 (socket says 172.21.15.164:56198) 2024-09-13T23:05:31.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.112+0000 7f1d13d7a640 1 -- 172.21.15.164:0/2438369728 learned_addr learned my addr 172.21.15.164:0/2438369728 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.112+0000 7f1d13d7a640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c35a4e5e0 con 0x556c35a46b90 2024-09-13T23:05:31.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.112+0000 7f1d13d7a640 1 --2- 172.21.15.164:0/2438369728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c35a46b90 0x556c35a4e0a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc019d20 tx=0x7f1cfc04d090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.112+0000 7f1be9ffb640 1 -- 172.21.15.164:0/2438369728 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cfc00cc60 con 0x556c35a46b90 2024-09-13T23:05:31.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.112+0000 7f1be9ffb640 1 -- 172.21.15.164:0/2438369728 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cfc00ce00 con 0x556c35a46b90 2024-09-13T23:05:31.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.112+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556c35a4e870 con 0x556c35a46b90 2024-09-13T23:05:31.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.112+0000 7f1be9ffb640 1 -- 172.21.15.164:0/2438369728 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cfc040990 con 0x556c35a46b90 2024-09-13T23:05:31.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.112+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c35a4e870 con 0x556c35a46b90 2024-09-13T23:05:31.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.113+0000 7f1be9ffb640 1 -- 172.21.15.164:0/2438369728 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1cfc040b30 con 0x556c35a46b90 2024-09-13T23:05:31.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.113+0000 7f1be9ffb640 1 --2- 172.21.15.164:0/2438369728 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1bdc036b40 0x7f1bdc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.113+0000 7f1be9ffb640 1 -- 172.21.15.164:0/2438369728 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f1cfc035070 con 0x556c35a46b90 2024-09-13T23:05:31.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.113+0000 7f1d14d7c640 1 --2- 172.21.15.164:0/2438369728 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1bdc036b40 0x7f1bdc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.114+0000 7f1d16a87800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.114+0000 7f1d16a87800 1 --2- 172.21.15.164:0/2438369728 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x556c35a59990 0x556c35a5be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.114+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c35a5c5a0 con 0x556c35a59990 2024-09-13T23:05:31.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.114+0000 7f1d14d7c640 1 --2- 172.21.15.164:0/2438369728 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1bdc036b40 0x7f1bdc039000 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x556c35a26a20 tx=0x7f1d0c01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.114+0000 7f1d1457b640 1 --2- 172.21.15.164:0/2438369728 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x556c35a59990 0x556c35a5be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.114+0000 7f1d1457b640 1 --2- 172.21.15.164:0/2438369728 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x556c35a59990 0x556c35a5be50 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.114+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d04051070 con 0x556c35a59990 2024-09-13T23:05:31.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.114+0000 7f1d16a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.114+0000 7f1d16a87800 20 realm 2024-09-13T23:05:31.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.114+0000 7f1d16a87800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.114+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c35a5c9b0 con 0x556c35a59990 2024-09-13T23:05:31.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.114+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d04051070 con 0x556c35a59990 2024-09-13T23:05:31.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.114+0000 7f1d16a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.114+0000 7f1d16a87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:31.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.114+0000 7f1d16a87800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.115+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c35a5d280 con 0x556c35a59990 2024-09-13T23:05:31.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.115+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d04051070 con 0x556c35a59990 2024-09-13T23:05:31.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.115+0000 7f1d16a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.115+0000 7f1d16a87800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.115+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c35a5d620 con 0x556c35a59990 2024-09-13T23:05:31.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.115+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d04051070 con 0x556c35a59990 2024-09-13T23:05:31.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.115+0000 7f1d16a87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:31.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.115+0000 7f1d16a87800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.115+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c35a5da80 con 0x556c35a59990 2024-09-13T23:05:31.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.115+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1d04051070 con 0x556c35a59990 2024-09-13T23:05:31.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.115+0000 7f1d16a87800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:31.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.115+0000 7f1d16a87800 20 searching for the correct realm 2024-09-13T23:05:31.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.115+0000 7f1d16a87800 1 --2- 172.21.15.164:0/2438369728 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x556c35a5fad0 0x556c35a61ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.115+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x556c35a5fad0 2024-09-13T23:05:31.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.115+0000 7f1d13d7a640 1 --2- 172.21.15.164:0/2438369728 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x556c35a5fad0 0x556c35a61ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.116+0000 7f1d13d7a640 1 --2- 172.21.15.164:0/2438369728 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x556c35a5fad0 0x556c35a61ec0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.116+0000 7f1d13d7a640 1 -- 172.21.15.164:0/2438369728 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cfc03f020 con 0x556c35a5fad0 2024-09-13T23:05:31.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.116+0000 7f1d13d7a640 1 --2- 172.21.15.164:0/2438369728 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f1cfc023be0 0x7f1cfc04d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.116+0000 7f1d13d7a640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x7f1cfc023be0 2024-09-13T23:05:31.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.116+0000 7f1d14d7c640 1 --2- 172.21.15.164:0/2438369728 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f1cfc023be0 0x7f1cfc04d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.116+0000 7f1d14d7c640 1 --2- 172.21.15.164:0/2438369728 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f1cfc023be0 0x7f1cfc04d510 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.116+0000 7f1d14d7c640 1 -- 172.21.15.164:0/2438369728 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c01f070 con 0x7f1cfc023be0 2024-09-13T23:05:31.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.116+0000 7f1d14d7c640 1 --2- 172.21.15.164:0/2438369728 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f1d0c031040 0x7f1d0c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.116+0000 7f1d14d7c640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x7f1d0c031040 2024-09-13T23:05:31.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.117+0000 7f1d1457b640 1 --2- 172.21.15.164:0/2438369728 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f1d0c031040 0x7f1d0c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.117+0000 7f1d1457b640 1 --2- 172.21.15.164:0/2438369728 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f1d0c031040 0x7f1d0c032940 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.118+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d04051070 con 0x7f1d0c031040 2024-09-13T23:05:31.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.118+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x556c35a59990 2024-09-13T23:05:31.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.118+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1d04051070 con 0x556c35a59990 2024-09-13T23:05:31.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.118+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x556c35a59990 2024-09-13T23:05:31.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.118+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d04051070 con 0x556c35a59990 2024-09-13T23:05:31.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.118+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x7f1d0c031040 2024-09-13T23:05:31.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.118+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d04051070 con 0x7f1d0c031040 2024-09-13T23:05:31.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.118+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x7f1d0c031040 2024-09-13T23:05:31.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.118+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d04051070 con 0x7f1d0c031040 2024-09-13T23:05:31.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.118+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x7f1cfc023be0 2024-09-13T23:05:31.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.119+0000 7f1d14d7c640 1 -- 172.21.15.164:0/2438369728 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c01f070 con 0x7f1cfc023be0 2024-09-13T23:05:31.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.119+0000 7f1d14d7c640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x556c35a5fad0 2024-09-13T23:05:31.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.119+0000 7f1d13d7a640 1 -- 172.21.15.164:0/2438369728 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cfc03f020 con 0x556c35a5fad0 2024-09-13T23:05:31.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.119+0000 7f1d13d7a640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x556c35a59990 2024-09-13T23:05:31.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.119+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d04051070 con 0x556c35a59990 2024-09-13T23:05:31.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.119+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x7f1d0c031040 2024-09-13T23:05:31.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.119+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d04051070 con 0x7f1d0c031040 2024-09-13T23:05:31.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.119+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x556c35a59990 2024-09-13T23:05:31.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.120+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d04051070 con 0x556c35a59990 2024-09-13T23:05:31.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.120+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x7f1cfc023be0 2024-09-13T23:05:31.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.120+0000 7f1d14d7c640 1 -- 172.21.15.164:0/2438369728 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1d0c01f070 con 0x7f1cfc023be0 2024-09-13T23:05:31.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.120+0000 7f1d14d7c640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x556c35a5fad0 2024-09-13T23:05:31.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.120+0000 7f1d13d7a640 1 -- 172.21.15.164:0/2438369728 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cfc03f020 con 0x556c35a5fad0 2024-09-13T23:05:31.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.120+0000 7f1d13d7a640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x556c35a5fad0 2024-09-13T23:05:31.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.120+0000 7f1d13d7a640 1 -- 172.21.15.164:0/2438369728 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cfc03f020 con 0x556c35a5fad0 2024-09-13T23:05:31.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.120+0000 7f1d13d7a640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x7f1d0c031040 2024-09-13T23:05:31.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.121+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d04051070 con 0x7f1d0c031040 2024-09-13T23:05:31.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.121+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x556c35a5fad0 2024-09-13T23:05:31.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.121+0000 7f1d13d7a640 1 -- 172.21.15.164:0/2438369728 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cfc03f020 con 0x556c35a5fad0 2024-09-13T23:05:31.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.121+0000 7f1d13d7a640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x556c35a5fad0 2024-09-13T23:05:31.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.121+0000 7f1d13d7a640 1 -- 172.21.15.164:0/2438369728 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cfc03f020 con 0x556c35a5fad0 2024-09-13T23:05:31.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.121+0000 7f1d13d7a640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x556c35a59990 2024-09-13T23:05:31.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.121+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d04051070 con 0x556c35a59990 2024-09-13T23:05:31.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.121+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x556c35a59990 2024-09-13T23:05:31.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.122+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1d04051070 con 0x556c35a59990 2024-09-13T23:05:31.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.122+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x7f1d0c031040 2024-09-13T23:05:31.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.122+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d04051070 con 0x7f1d0c031040 2024-09-13T23:05:31.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.122+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x556c35a5fad0 2024-09-13T23:05:31.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.122+0000 7f1d13d7a640 1 -- 172.21.15.164:0/2438369728 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cfc03f020 con 0x556c35a5fad0 2024-09-13T23:05:31.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.122+0000 7f1d13d7a640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x7f1cfc023be0 2024-09-13T23:05:31.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.122+0000 7f1d14d7c640 1 -- 172.21.15.164:0/2438369728 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c01f070 con 0x7f1cfc023be0 2024-09-13T23:05:31.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.122+0000 7f1d14d7c640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x556c35a59990 2024-09-13T23:05:31.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.123+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1d04051070 con 0x556c35a59990 2024-09-13T23:05:31.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.123+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x7f1d0c031040 2024-09-13T23:05:31.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.123+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d04051070 con 0x7f1d0c031040 2024-09-13T23:05:31.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.123+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x556c35a5fad0 2024-09-13T23:05:31.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.123+0000 7f1d13d7a640 1 -- 172.21.15.164:0/2438369728 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cfc03f020 con 0x556c35a5fad0 2024-09-13T23:05:31.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.123+0000 7f1d13d7a640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x7f1d0c031040 2024-09-13T23:05:31.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.124+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d04051070 con 0x7f1d0c031040 2024-09-13T23:05:31.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.124+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x7f1cfc023be0 2024-09-13T23:05:31.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.124+0000 7f1d14d7c640 1 -- 172.21.15.164:0/2438369728 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c01f070 con 0x7f1cfc023be0 2024-09-13T23:05:31.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.124+0000 7f1d14d7c640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x556c35a5fad0 2024-09-13T23:05:31.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.124+0000 7f1d13d7a640 1 -- 172.21.15.164:0/2438369728 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cfc03f020 con 0x556c35a5fad0 2024-09-13T23:05:31.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.124+0000 7f1d13d7a640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x7f1d0c031040 2024-09-13T23:05:31.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.125+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d04051070 con 0x7f1d0c031040 2024-09-13T23:05:31.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.125+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x556c35a59990 2024-09-13T23:05:31.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.125+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1d04051070 con 0x556c35a59990 2024-09-13T23:05:31.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.125+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c35a62590 con 0x7f1cfc023be0 2024-09-13T23:05:31.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.125+0000 7f1d14d7c640 1 -- 172.21.15.164:0/2438369728 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c01f070 con 0x7f1cfc023be0 2024-09-13T23:05:31.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.125+0000 7f1d16a87800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:31.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.125+0000 7f1d16a87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:31.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.125+0000 7f1d16a87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:31.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.125+0000 7f1d16a87800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:31.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.125+0000 7f1d16a87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:31.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.125+0000 7f1d16a87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:31.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.125+0000 7f1d16a87800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.125+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c35a5e550 con 0x556c35a59990 2024-09-13T23:05:31.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.125+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d04051070 con 0x556c35a59990 2024-09-13T23:05:31.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.125+0000 7f1d16a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.125+0000 7f1d16a87800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.125+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c35a5edf0 con 0x556c35a59990 2024-09-13T23:05:31.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.126+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d04051070 con 0x556c35a59990 2024-09-13T23:05:31.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.126+0000 7f1d16a87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:31.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.126+0000 7f1d16a87800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.126+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c35a5e190 con 0x556c35a59990 2024-09-13T23:05:31.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.126+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1d04051070 con 0x556c35a59990 2024-09-13T23:05:31.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.126+0000 7f1d16a87800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:31.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.126+0000 7f1d16a87800 20 zone default found 2024-09-13T23:05:31.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.126+0000 7f1d16a87800 4 Realm: () 2024-09-13T23:05:31.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.126+0000 7f1d16a87800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:31.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.126+0000 7f1d16a87800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:31.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.126+0000 7f1d16a87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:31.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.126+0000 7f1d16a87800 20 zonegroup default 2024-09-13T23:05:31.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.126+0000 7f1d16a87800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.126+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c35a5edf0 con 0x7f1d0c031040 2024-09-13T23:05:31.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.126+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1d04051070 con 0x7f1d0c031040 2024-09-13T23:05:31.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.126+0000 7f1d16a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.126+0000 7f1d16a87800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.126+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c35a643f0 con 0x556c35a5fad0 2024-09-13T23:05:31.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.126+0000 7f1d13d7a640 1 -- 172.21.15.164:0/2438369728 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1cfc03f020 con 0x556c35a5fad0 2024-09-13T23:05:31.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.126+0000 7f1d16a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.126+0000 7f1d16a87800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.126+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c35a64790 con 0x556c35a5fad0 2024-09-13T23:05:31.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.127+0000 7f1d13d7a640 1 -- 172.21.15.164:0/2438369728 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1cfc03f020 con 0x556c35a5fad0 2024-09-13T23:05:31.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.127+0000 7f1d16a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.127+0000 7f1d16a87800 20 started sync module instance, tier type = 2024-09-13T23:05:31.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.127+0000 7f1d16a87800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:31.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.127+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c35a63890 con 0x7f1cfc023be0 2024-09-13T23:05:31.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.128+0000 7f1d14d7c640 1 -- 172.21.15.164:0/2438369728 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c040040 con 0x7f1cfc023be0 2024-09-13T23:05:31.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.128+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93923244915840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c35a634f0 con 0x7f1cfc023be0 2024-09-13T23:05:31.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.128+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c35a65650 con 0x556c35a59990 2024-09-13T23:05:31.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.129+0000 7f1d14d7c640 1 -- 172.21.15.164:0/2438369728 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93923244915840] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c040040 con 0x7f1cfc023be0 2024-09-13T23:05:31.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.129+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d04051070 con 0x556c35a59990 2024-09-13T23:05:31.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.129+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93923244919680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c35a65650 con 0x556c35a59990 2024-09-13T23:05:31.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.129+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c35a66110 con 0x556c35a5fad0 2024-09-13T23:05:31.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.130+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93923244919680] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d04051070 con 0x556c35a59990 2024-09-13T23:05:31.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.130+0000 7f1d13d7a640 1 -- 172.21.15.164:0/2438369728 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cfc03f020 con 0x556c35a5fad0 2024-09-13T23:05:31.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.130+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93923244921248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c35a655c0 con 0x556c35a5fad0 2024-09-13T23:05:31.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.130+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c35a66fd0 con 0x7f1cfc023be0 2024-09-13T23:05:31.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.131+0000 7f1d13d7a640 1 -- 172.21.15.164:0/2438369728 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93923244921248] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cfc03f020 con 0x556c35a5fad0 2024-09-13T23:05:31.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.131+0000 7f1d14d7c640 1 -- 172.21.15.164:0/2438369728 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c040040 con 0x7f1cfc023be0 2024-09-13T23:05:31.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.131+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93923244927776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c35a673f0 con 0x7f1cfc023be0 2024-09-13T23:05:31.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.131+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c35a67db0 con 0x556c35a59990 2024-09-13T23:05:31.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.132+0000 7f1d14d7c640 1 -- 172.21.15.164:0/2438369728 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93923244927776] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c040040 con 0x7f1cfc023be0 2024-09-13T23:05:31.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.133+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d04051070 con 0x556c35a59990 2024-09-13T23:05:31.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.133+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93923244929312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c35a67db0 con 0x556c35a59990 2024-09-13T23:05:31.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.133+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c35a68770 con 0x7f1d0c031040 2024-09-13T23:05:31.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.133+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93923244929312] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d04051070 con 0x556c35a59990 2024-09-13T23:05:31.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.134+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d04051070 con 0x7f1d0c031040 2024-09-13T23:05:31.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.134+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93923244934304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c35a67db0 con 0x7f1d0c031040 2024-09-13T23:05:31.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.134+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c35a69180 con 0x7f1d0c031040 2024-09-13T23:05:31.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.135+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d04051070 con 0x7f1d0c031040 2024-09-13T23:05:31.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.135+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93923244936400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c35a690f0 con 0x7f1d0c031040 2024-09-13T23:05:31.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.135+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c35a6a120 con 0x7f1d0c031040 2024-09-13T23:05:31.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.135+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93923244934304] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d04051070 con 0x7f1d0c031040 2024-09-13T23:05:31.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.136+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93923244936400] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d04051070 con 0x7f1d0c031040 2024-09-13T23:05:31.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.136+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d04051070 con 0x7f1d0c031040 2024-09-13T23:05:31.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.136+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93923244940272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c35a6a0e0 con 0x7f1d0c031040 2024-09-13T23:05:31.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.136+0000 7f1d16a87800 20 add_watcher() i=0 2024-09-13T23:05:31.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.136+0000 7f1d16a87800 20 add_watcher() i=1 2024-09-13T23:05:31.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.136+0000 7f1d16a87800 20 add_watcher() i=2 2024-09-13T23:05:31.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.136+0000 7f1d16a87800 20 add_watcher() i=3 2024-09-13T23:05:31.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.136+0000 7f1d16a87800 20 add_watcher() i=4 2024-09-13T23:05:31.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.136+0000 7f1d16a87800 20 add_watcher() i=5 2024-09-13T23:05:31.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.136+0000 7f1d16a87800 20 add_watcher() i=6 2024-09-13T23:05:31.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.137+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93923244940272] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d04051070 con 0x7f1d0c031040 2024-09-13T23:05:31.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.137+0000 7f1d16a87800 20 add_watcher() i=7 2024-09-13T23:05:31.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.137+0000 7f1d16a87800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:31.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.137+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c35a69550 con 0x556c35a59990 2024-09-13T23:05:31.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.137+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1d04051070 con 0x556c35a59990 2024-09-13T23:05:31.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.137+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93923244938576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c35a6a4c0 con 0x556c35a59990 2024-09-13T23:05:31.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.138+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93923244938576] v32'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d04051070 con 0x556c35a59990 2024-09-13T23:05:31.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.138+0000 7f1bca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:31.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.138+0000 7f1d16a87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:31.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.138+0000 7f1d16a87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:31.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.138+0000 7f1d16a87800 5 note: GC not initialized 2024-09-13T23:05:31.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.138+0000 7f1bc97e2640 20 reqs_thread_entry: start 2024-09-13T23:05:31.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.138+0000 7f1d16a87800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:31.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.138+0000 7f1d16a87800 20 Filter name: none 2024-09-13T23:05:31.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.139+0000 7f1b3affd640 20 reqs_thread_entry: start 2024-09-13T23:05:31.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.139+0000 7f1d16a87800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.139+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c35a9ff10 con 0x556c35a59990 2024-09-13T23:05:31.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.139+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f1d04051070 con 0x556c35a59990 2024-09-13T23:05:31.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.139+0000 7f1d16a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.175 INFO:teuthology.orchestra.run.smithi164.stderr:could not fetch user info: no user info saved 2024-09-13T23:05:31.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.140+0000 7f1bca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:31.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.140+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93923244938576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c35a9fed0 con 0x556c35a59990 2024-09-13T23:05:31.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.141+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93923244938576] v32'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d04051070 con 0x556c35a59990 2024-09-13T23:05:31.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.141+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93923244915840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c35a9dd00 con 0x7f1cfc023be0 2024-09-13T23:05:31.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.142+0000 7f1d14d7c640 1 -- 172.21.15.164:0/2438369728 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93923244915840] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c040040 con 0x7f1cfc023be0 2024-09-13T23:05:31.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.142+0000 7f1d16a87800 20 remove_watcher() i=0 2024-09-13T23:05:31.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.142+0000 7f1d16a87800 2 removed watcher, disabling cache 2024-09-13T23:05:31.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.142+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93923244919680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c35a9dd00 con 0x556c35a59990 2024-09-13T23:05:31.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.143+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93923244919680] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d04051070 con 0x556c35a59990 2024-09-13T23:05:31.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.143+0000 7f1d16a87800 20 remove_watcher() i=1 2024-09-13T23:05:31.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.143+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93923244921248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c35a9dd00 con 0x556c35a5fad0 2024-09-13T23:05:31.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.144+0000 7f1d13d7a640 1 -- 172.21.15.164:0/2438369728 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93923244921248] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cfc03f020 con 0x556c35a5fad0 2024-09-13T23:05:31.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.144+0000 7f1d16a87800 20 remove_watcher() i=2 2024-09-13T23:05:31.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.144+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93923244927776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c35a9fed0 con 0x7f1cfc023be0 2024-09-13T23:05:31.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.145+0000 7f1d14d7c640 1 -- 172.21.15.164:0/2438369728 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93923244927776] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c040040 con 0x7f1cfc023be0 2024-09-13T23:05:31.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.145+0000 7f1d16a87800 20 remove_watcher() i=3 2024-09-13T23:05:31.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.145+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93923244929312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c35a9fed0 con 0x556c35a59990 2024-09-13T23:05:31.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.146+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93923244929312] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d04051070 con 0x556c35a59990 2024-09-13T23:05:31.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.146+0000 7f1d16a87800 20 remove_watcher() i=4 2024-09-13T23:05:31.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.146+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93923244934304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c35a9fed0 con 0x7f1d0c031040 2024-09-13T23:05:31.181 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-13T23:05:31.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.146+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93923244934304] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d04051070 con 0x7f1d0c031040 2024-09-13T23:05:31.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.146+0000 7f1d16a87800 20 remove_watcher() i=5 2024-09-13T23:05:31.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.146+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93923244936400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c35a9fed0 con 0x7f1d0c031040 2024-09-13T23:05:31.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.147+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93923244936400] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d04051070 con 0x7f1d0c031040 2024-09-13T23:05:31.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.147+0000 7f1d16a87800 20 remove_watcher() i=6 2024-09-13T23:05:31.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.147+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93923244940272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c35a9fed0 con 0x7f1d0c031040 2024-09-13T23:05:31.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.148+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93923244940272] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d04051070 con 0x7f1d0c031040 2024-09-13T23:05:31.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.148+0000 7f1d16a87800 20 remove_watcher() i=7 2024-09-13T23:05:31.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.148+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f1d0c031040 msgr2=0x7f1d0c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.148+0000 7f1d16a87800 1 --2- 172.21.15.164:0/2438369728 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f1d0c031040 0x7f1d0c032940 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.148+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x556c35a59990 msgr2=0x556c35a5be50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.148+0000 7f1d16a87800 1 --2- 172.21.15.164:0/2438369728 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x556c35a59990 0x556c35a5be50 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.148+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f1cfc023be0 msgr2=0x7f1cfc04d510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.148+0000 7f1d16a87800 1 --2- 172.21.15.164:0/2438369728 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f1cfc023be0 0x7f1cfc04d510 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.148+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x556c35a5fad0 msgr2=0x556c35a61ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.148+0000 7f1d16a87800 1 --2- 172.21.15.164:0/2438369728 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x556c35a5fad0 0x556c35a61ec0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.148+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1bdc036b40 msgr2=0x7f1bdc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.149+0000 7f1d16a87800 1 --2- 172.21.15.164:0/2438369728 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1bdc036b40 0x7f1bdc039000 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x556c35a26a20 tx=0x7f1d0c01f000 comp rx=0 tx=0).stop 2024-09-13T23:05:31.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.149+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c35a46b90 msgr2=0x556c35a4e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.149+0000 7f1d1457b640 1 -- 172.21.15.164:0/2438369728 reap_dead start 2024-09-13T23:05:31.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.149+0000 7f1d16a87800 1 --2- 172.21.15.164:0/2438369728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c35a46b90 0x556c35a4e0a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc019d20 tx=0x7f1cfc04d090 comp rx=0 tx=0).stop 2024-09-13T23:05:31.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.149+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 shutdown_connections 2024-09-13T23:05:31.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.149+0000 7f1d16a87800 1 --2- 172.21.15.164:0/2438369728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c35a46b90 0x556c35a4e0a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.149+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 >> 172.21.15.164:0/2438369728 conn(0x556c35a42ef0 msgr2=0x556c35a40fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.149+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 shutdown_connections 2024-09-13T23:05:31.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.149+0000 7f1d16a87800 1 -- 172.21.15.164:0/2438369728 wait complete. 2024-09-13T23:05:31.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.149+0000 7f1d16a87800 1 -- 172.21.15.164:0/2905463151 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1bec036b90 msgr2=0x7f1bec039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.149+0000 7f1d16a87800 1 --2- 172.21.15.164:0/2905463151 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1bec036b90 0x7f1bec039050 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x556c35a2a5d0 tx=0x7f1d0c005840 comp rx=0 tx=0).stop 2024-09-13T23:05:31.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.149+0000 7f1d16a87800 1 -- 172.21.15.164:0/2905463151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c35a39e80 msgr2=0x556c35a3a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.149+0000 7f1d16a87800 1 --2- 172.21.15.164:0/2905463151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c35a39e80 0x556c35a3a2a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc001ed0 tx=0x7f1cfc00d7a0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.149+0000 7f1d16a87800 1 -- 172.21.15.164:0/2905463151 shutdown_connections 2024-09-13T23:05:31.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.149+0000 7f1d16a87800 1 --2- 172.21.15.164:0/2905463151 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1bec036b90 0x7f1bec039050 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.149+0000 7f1d16a87800 1 --2- 172.21.15.164:0/2905463151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c35a39e80 0x556c35a3a2a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.149+0000 7f1d16a87800 1 -- 172.21.15.164:0/2905463151 >> 172.21.15.164:0/2905463151 conn(0x556c35a2ee10 msgr2=0x556c35a31990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.149+0000 7f1d16a87800 1 -- 172.21.15.164:0/2905463151 shutdown_connections 2024-09-13T23:05:31.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.149+0000 7f1d16a87800 1 -- 172.21.15.164:0/2905463151 wait complete. 2024-09-13T23:05:31.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.149+0000 7f1d16a87800 1 -- 172.21.15.164:0/585474705 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x556c3592c790 msgr2=0x556c35a29500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.149+0000 7f1d16a87800 1 --2- 172.21.15.164:0/585474705 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x556c3592c790 0x556c35a29500 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.149+0000 7f1d16a87800 1 -- 172.21.15.164:0/585474705 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1bfc036b90 msgr2=0x7f1bfc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.149+0000 7f1d16a87800 1 --2- 172.21.15.164:0/585474705 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1bfc036b90 0x7f1bfc039050 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc000f60 tx=0x7f1cfc0012b0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.149+0000 7f1d16a87800 1 -- 172.21.15.164:0/585474705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c3589d630 msgr2=0x556c35a22490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.149+0000 7f1d16a87800 1 --2- 172.21.15.164:0/585474705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c3589d630 0x556c35a22490 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x556c35929280 tx=0x7f1d04002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.150+0000 7f1d16a87800 1 -- 172.21.15.164:0/585474705 shutdown_connections 2024-09-13T23:05:31.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.150+0000 7f1d16a87800 1 --2- 172.21.15.164:0/585474705 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x556c3592c790 0x556c35a29500 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.150+0000 7f1d16a87800 1 --2- 172.21.15.164:0/585474705 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1bfc036b90 0x7f1bfc039050 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.150+0000 7f1d16a87800 1 --2- 172.21.15.164:0/585474705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c3589d630 0x556c35a22490 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.150+0000 7f1d16a87800 1 -- 172.21.15.164:0/585474705 >> 172.21.15.164:0/585474705 conn(0x556c35923de0 msgr2=0x556c35a13e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.150+0000 7f1d16a87800 1 -- 172.21.15.164:0/585474705 shutdown_connections 2024-09-13T23:05:31.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.150+0000 7f1d16a87800 1 -- 172.21.15.164:0/585474705 wait complete. 2024-09-13T23:05:31.187 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-13T23:05:31.187 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-13T23:05:31.187 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-13T23:05:31.242 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:31.242 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:31.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.243+0000 7f6ae2308800 1 Processor -- start 2024-09-13T23:05:31.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.243+0000 7f6ae2308800 1 -- start start 2024-09-13T23:05:31.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.243+0000 7f6ae2308800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x56066477bd50 0x56066477e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.243+0000 7f6ae2308800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560664634b30 con 0x5606646e8e40 2024-09-13T23:05:31.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.243+0000 7f6ae2308800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x560664616360 con 0x56066477bd50 2024-09-13T23:05:31.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.243+0000 7f6adf5fb640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x56066477bd50 0x56066477e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.243+0000 7f6adfdfc640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x5606646e8e40 0x56066477a630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40726/0 (socket says 172.21.15.164:40726) 2024-09-13T23:05:31.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.243+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2254522266 learned_addr learned my addr 172.21.15.164:0/2254522266 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:31.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.244+0000 7f6adedfa640 1 -- 172.21.15.164:0/2254522266 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1886434987 0 0) 0x560664634b30 con 0x5606646e8e40 2024-09-13T23:05:31.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.244+0000 7f6adedfa640 1 -- 172.21.15.164:0/2254522266 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ac8001e10 con 0x5606646e8e40 2024-09-13T23:05:31.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.244+0000 7f6adf5fb640 1 -- 172.21.15.164:0/2254522266 >> v1:172.21.15.17:6789/0 conn(0x5606646e8e40 legacy=0x56066477a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.244+0000 7f6adf5fb640 1 -- 172.21.15.164:0/2254522266 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56066463ce00 con 0x56066477bd50 2024-09-13T23:05:31.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.245+0000 7f6adf5fb640 1 --2- 172.21.15.164:0/2254522266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56066477bd50 0x56066477e140 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400a470 tx=0x7f6ad4045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3375cfdda96d269c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.246+0000 7f6adedfa640 1 -- 172.21.15.164:0/2254522266 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad4059070 con 0x56066477bd50 2024-09-13T23:05:31.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.246+0000 7f6adedfa640 1 -- 172.21.15.164:0/2254522266 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad4054570 con 0x56066477bd50 2024-09-13T23:05:31.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.246+0000 7f6adedfa640 1 -- 172.21.15.164:0/2254522266 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad4054870 con 0x56066477bd50 2024-09-13T23:05:31.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.246+0000 7f6ae2308800 1 -- 172.21.15.164:0/2254522266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56066477bd50 msgr2=0x56066477e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.246+0000 7f6ae2308800 1 --2- 172.21.15.164:0/2254522266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56066477bd50 0x56066477e140 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400a470 tx=0x7f6ad4045920 comp rx=0 tx=0).stop 2024-09-13T23:05:31.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.246+0000 7f6ae2308800 1 -- 172.21.15.164:0/2254522266 shutdown_connections 2024-09-13T23:05:31.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.246+0000 7f6ae2308800 1 --2- 172.21.15.164:0/2254522266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56066477bd50 0x56066477e140 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.246+0000 7f6ae2308800 1 -- 172.21.15.164:0/2254522266 >> 172.21.15.164:0/2254522266 conn(0x56066476fe00 msgr2=0x560664772220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.246+0000 7f6ae2308800 1 -- 172.21.15.164:0/2254522266 shutdown_connections 2024-09-13T23:05:31.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.246+0000 7f6ae2308800 1 -- 172.21.15.164:0/2254522266 wait complete. 2024-09-13T23:05:31.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.260+0000 7f6ae2308800 1 Processor -- start 2024-09-13T23:05:31.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.260+0000 7f6ae2308800 1 -- start start 2024-09-13T23:05:31.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.261+0000 7f6ae2308800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606646e8e40 0x5606648669c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.261+0000 7f6ae2308800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5606646c1450 con 0x5606646e8e40 2024-09-13T23:05:31.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.261+0000 7f6adfdfc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606646e8e40 0x5606648669c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.261+0000 7f6adfdfc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606646e8e40 0x5606648669c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56206/0 (socket says 172.21.15.164:56206) 2024-09-13T23:05:31.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.261+0000 7f6adfdfc640 1 -- 172.21.15.164:0/1948989910 learned_addr learned my addr 172.21.15.164:0/1948989910 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.261+0000 7f6adfdfc640 1 -- 172.21.15.164:0/1948989910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56066460ebc0 con 0x5606646e8e40 2024-09-13T23:05:31.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.262+0000 7f6adfdfc640 1 --2- 172.21.15.164:0/1948989910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606646e8e40 0x5606648669c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0001e30 tx=0x7f6ad000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa305d8df218ef4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.262+0000 7f69cde0b640 1 -- 172.21.15.164:0/1948989910 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad0012020 con 0x5606646e8e40 2024-09-13T23:05:31.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.262+0000 7f69cde0b640 1 -- 172.21.15.164:0/1948989910 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad000e5a0 con 0x5606646e8e40 2024-09-13T23:05:31.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.262+0000 7f69cde0b640 1 -- 172.21.15.164:0/1948989910 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad000e8e0 con 0x5606646e8e40 2024-09-13T23:05:31.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.262+0000 7f6ae2308800 1 -- 172.21.15.164:0/1948989910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606646e8e40 msgr2=0x5606648669c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.262+0000 7f6ae2308800 1 --2- 172.21.15.164:0/1948989910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606646e8e40 0x5606648669c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0001e30 tx=0x7f6ad000b780 comp rx=0 tx=0).stop 2024-09-13T23:05:31.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.262+0000 7f6ae2308800 1 -- 172.21.15.164:0/1948989910 shutdown_connections 2024-09-13T23:05:31.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.262+0000 7f6ae2308800 1 --2- 172.21.15.164:0/1948989910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606646e8e40 0x5606648669c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.262+0000 7f6ae2308800 1 -- 172.21.15.164:0/1948989910 >> 172.21.15.164:0/1948989910 conn(0x56066476fe00 msgr2=0x560664862380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.262+0000 7f6ae2308800 1 -- 172.21.15.164:0/1948989910 shutdown_connections 2024-09-13T23:05:31.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.262+0000 7f6ae2308800 1 -- 172.21.15.164:0/1948989910 wait complete. 2024-09-13T23:05:31.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.263+0000 7f6ae2308800 1 Processor -- start 2024-09-13T23:05:31.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.263+0000 7f6ae2308800 1 -- start start 2024-09-13T23:05:31.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.263+0000 7f6ae2308800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606646e8e40 0x56066486e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.263+0000 7f6ae2308800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56066477e950 con 0x5606646e8e40 2024-09-13T23:05:31.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.263+0000 7f6adfdfc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606646e8e40 0x56066486e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.263+0000 7f6adfdfc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606646e8e40 0x56066486e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56222/0 (socket says 172.21.15.164:56222) 2024-09-13T23:05:31.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.263+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2983301825 learned_addr learned my addr 172.21.15.164:0/2983301825 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.263+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2983301825 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560664622fe0 con 0x5606646e8e40 2024-09-13T23:05:31.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.264+0000 7f6adfdfc640 1 --2- 172.21.15.164:0/2983301825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606646e8e40 0x56066486e3c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0001e30 tx=0x7f6ad0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.264+0000 7f69c7fff640 1 -- 172.21.15.164:0/2983301825 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad0012030 con 0x5606646e8e40 2024-09-13T23:05:31.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.264+0000 7f69c7fff640 1 -- 172.21.15.164:0/2983301825 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad0001490 con 0x5606646e8e40 2024-09-13T23:05:31.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.264+0000 7f6ae2308800 1 -- 172.21.15.164:0/2983301825 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56066486e900 con 0x5606646e8e40 2024-09-13T23:05:31.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.264+0000 7f69c7fff640 1 -- 172.21.15.164:0/2983301825 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad001a8f0 con 0x5606646e8e40 2024-09-13T23:05:31.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.264+0000 7f6ae2308800 1 -- 172.21.15.164:0/2983301825 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56066486ee20 con 0x5606646e8e40 2024-09-13T23:05:31.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.265+0000 7f69c7fff640 1 -- 172.21.15.164:0/2983301825 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6ad0015020 con 0x5606646e8e40 2024-09-13T23:05:31.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.265+0000 7f69c7fff640 1 --2- 172.21.15.164:0/2983301825 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f69c8036b90 0x7f69c8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.265+0000 7f69c7fff640 1 -- 172.21.15.164:0/2983301825 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6ad0020030 con 0x5606646e8e40 2024-09-13T23:05:31.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.265+0000 7f6adf5fb640 1 --2- 172.21.15.164:0/2983301825 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f69c8036b90 0x7f69c8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.265+0000 7f6ae2308800 1 --2- 172.21.15.164:0/2983301825 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x56066477bd50 0x560664875430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.265+0000 7f6ae2308800 1 -- 172.21.15.164:0/2983301825 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560664875970 con 0x56066477bd50 2024-09-13T23:05:31.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.265+0000 7f6ae05fd640 1 --2- 172.21.15.164:0/2983301825 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x56066477bd50 0x560664875430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.265+0000 7f6adf5fb640 1 --2- 172.21.15.164:0/2983301825 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f69c8036b90 0x7f69c8039050 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x5606646e8580 tx=0x7f6ad4050000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.265+0000 7f6ae05fd640 1 --2- 172.21.15.164:0/2983301825 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x56066477bd50 0x560664875430 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.266+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2983301825 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ad800a4a0 con 0x56066477bd50 2024-09-13T23:05:31.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.266+0000 7f6ae2308800 1 -- 172.21.15.164:0/2983301825 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560664872950 con 0x56066477bd50 2024-09-13T23:05:31.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.266+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2983301825 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6ad800a4a0 con 0x56066477bd50 2024-09-13T23:05:31.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.266+0000 7f6ae2308800 1 -- 172.21.15.164:0/2983301825 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560664877410 con 0x56066477bd50 2024-09-13T23:05:31.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.266+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2983301825 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6ad800a4a0 con 0x56066477bd50 2024-09-13T23:05:31.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.266+0000 7f6ae2308800 1 -- 172.21.15.164:0/2983301825 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560664876250 con 0x56066477bd50 2024-09-13T23:05:31.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.267+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2983301825 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6ad800a4a0 con 0x56066477bd50 2024-09-13T23:05:31.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.267+0000 7f6ae2308800 1 -- 172.21.15.164:0/2983301825 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5606648766a0 con 0x56066477bd50 2024-09-13T23:05:31.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.267+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2983301825 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6ad800a4a0 con 0x56066477bd50 2024-09-13T23:05:31.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.267+0000 7f6ae2308800 1 Processor -- start 2024-09-13T23:05:31.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.267+0000 7f6ae2308800 1 -- start start 2024-09-13T23:05:31.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.267+0000 7f6ae2308800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560664885ce0 0x560664886120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.267+0000 7f6ae2308800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560664610580 con 0x560664885ce0 2024-09-13T23:05:31.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.268+0000 7f6adf5fb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560664885ce0 0x560664886120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.268+0000 7f6adf5fb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560664885ce0 0x560664886120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56232/0 (socket says 172.21.15.164:56232) 2024-09-13T23:05:31.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.268+0000 7f6adf5fb640 1 -- 172.21.15.164:0/896230109 learned_addr learned my addr 172.21.15.164:0/896230109 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.268+0000 7f6adf5fb640 1 -- 172.21.15.164:0/896230109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560664886660 con 0x560664885ce0 2024-09-13T23:05:31.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.268+0000 7f6adf5fb640 1 --2- 172.21.15.164:0/896230109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560664885ce0 0x560664886120 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4025af0 tx=0x7f6ad4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.268+0000 7f69c57fa640 1 -- 172.21.15.164:0/896230109 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad4070070 con 0x560664885ce0 2024-09-13T23:05:31.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.268+0000 7f69c57fa640 1 -- 172.21.15.164:0/896230109 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad405f470 con 0x560664885ce0 2024-09-13T23:05:31.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.268+0000 7f6ae2308800 1 -- 172.21.15.164:0/896230109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606648868f0 con 0x560664885ce0 2024-09-13T23:05:31.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.268+0000 7f69c57fa640 1 -- 172.21.15.164:0/896230109 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad4059040 con 0x560664885ce0 2024-09-13T23:05:31.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.268+0000 7f6ae2308800 1 -- 172.21.15.164:0/896230109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560664889580 con 0x560664885ce0 2024-09-13T23:05:31.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.269+0000 7f69c57fa640 1 -- 172.21.15.164:0/896230109 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6ad4073070 con 0x560664885ce0 2024-09-13T23:05:31.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.269+0000 7f69c57fa640 1 --2- 172.21.15.164:0/896230109 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f69b8036b90 0x7f69b8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.269+0000 7f69c57fa640 1 -- 172.21.15.164:0/896230109 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6ad4068070 con 0x560664885ce0 2024-09-13T23:05:31.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.269+0000 7f6ae05fd640 1 --2- 172.21.15.164:0/896230109 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f69b8036b90 0x7f69b8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.270+0000 7f6ae2308800 1 Processor -- start 2024-09-13T23:05:31.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.270+0000 7f6ae05fd640 1 --2- 172.21.15.164:0/896230109 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f69b8036b90 0x7f69b8039050 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x560664876df0 tx=0x7f6ad8005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.270+0000 7f6ae2308800 1 -- start start 2024-09-13T23:05:31.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.270+0000 7f6ae2308800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560664892950 0x560664892d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.270+0000 7f6ae2308800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560664867170 con 0x560664892950 2024-09-13T23:05:31.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.270+0000 7f6adf5fb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560664892950 0x560664892d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.270+0000 7f6adf5fb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560664892950 0x560664892d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56248/0 (socket says 172.21.15.164:56248) 2024-09-13T23:05:31.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.270+0000 7f6adf5fb640 1 -- 172.21.15.164:0/3256077900 learned_addr learned my addr 172.21.15.164:0/3256077900 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.270+0000 7f6adf5fb640 1 -- 172.21.15.164:0/3256077900 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560664893320 con 0x560664892950 2024-09-13T23:05:31.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.270+0000 7f6adf5fb640 1 --2- 172.21.15.164:0/3256077900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560664892950 0x560664892d50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6ad408f960 tx=0x7f6ad405eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b27ad0d87063b7f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.270+0000 7f69beffd640 1 -- 172.21.15.164:0/3256077900 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad4074c60 con 0x560664892950 2024-09-13T23:05:31.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.271+0000 7f69beffd640 1 -- 172.21.15.164:0/3256077900 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad4009790 con 0x560664892950 2024-09-13T23:05:31.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.271+0000 7f69beffd640 1 -- 172.21.15.164:0/3256077900 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad405e3d0 con 0x560664892950 2024-09-13T23:05:31.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.271+0000 7f6ae2308800 1 -- 172.21.15.164:0/3256077900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560664892950 msgr2=0x560664892d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.271+0000 7f6ae2308800 1 --2- 172.21.15.164:0/3256077900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560664892950 0x560664892d50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6ad408f960 tx=0x7f6ad405eb20 comp rx=0 tx=0).stop 2024-09-13T23:05:31.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.271+0000 7f6ae2308800 1 -- 172.21.15.164:0/3256077900 shutdown_connections 2024-09-13T23:05:31.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.271+0000 7f6ae2308800 1 --2- 172.21.15.164:0/3256077900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560664892950 0x560664892d50 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.271+0000 7f6ae2308800 1 -- 172.21.15.164:0/3256077900 >> 172.21.15.164:0/3256077900 conn(0x56066488ecb0 msgr2=0x56066488cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.271+0000 7f6ae2308800 1 -- 172.21.15.164:0/3256077900 shutdown_connections 2024-09-13T23:05:31.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.271+0000 7f6ae2308800 1 -- 172.21.15.164:0/3256077900 wait complete. 2024-09-13T23:05:31.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.271+0000 7f6ae2308800 1 Processor -- start 2024-09-13T23:05:31.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.271+0000 7f6ae2308800 1 -- start start 2024-09-13T23:05:31.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.272+0000 7f6ae2308800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560664892950 0x560664899e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.272+0000 7f6ae2308800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560664893990 con 0x560664892950 2024-09-13T23:05:31.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.272+0000 7f6adf5fb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560664892950 0x560664899e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.272+0000 7f6adf5fb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560664892950 0x560664899e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56252/0 (socket says 172.21.15.164:56252) 2024-09-13T23:05:31.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.272+0000 7f6adf5fb640 1 -- 172.21.15.164:0/2599349732 learned_addr learned my addr 172.21.15.164:0/2599349732 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.272+0000 7f6adf5fb640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56066489a350 con 0x560664892950 2024-09-13T23:05:31.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.272+0000 7f6adf5fb640 1 --2- 172.21.15.164:0/2599349732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560664892950 0x560664899e10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6ad405f000 tx=0x7f6ad408f8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.272+0000 7f69bd7fa640 1 -- 172.21.15.164:0/2599349732 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad4096070 con 0x560664892950 2024-09-13T23:05:31.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.272+0000 7f69bd7fa640 1 -- 172.21.15.164:0/2599349732 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad4073d90 con 0x560664892950 2024-09-13T23:05:31.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.272+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56066489a5e0 con 0x560664892950 2024-09-13T23:05:31.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.272+0000 7f69bd7fa640 1 -- 172.21.15.164:0/2599349732 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ad408d050 con 0x560664892950 2024-09-13T23:05:31.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.273+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56066489d290 con 0x560664892950 2024-09-13T23:05:31.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.273+0000 7f69bd7fa640 1 -- 172.21.15.164:0/2599349732 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6ad4099070 con 0x560664892950 2024-09-13T23:05:31.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.273+0000 7f69bd7fa640 1 --2- 172.21.15.164:0/2599349732 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f69a8036b40 0x7f69a8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.273+0000 7f69bd7fa640 1 -- 172.21.15.164:0/2599349732 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6ad409cca0 con 0x560664892950 2024-09-13T23:05:31.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.274+0000 7f6ae05fd640 1 --2- 172.21.15.164:0/2599349732 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f69a8036b40 0x7f69a8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.274+0000 7f6ae05fd640 1 --2- 172.21.15.164:0/2599349732 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f69a8036b40 0x7f69a8039000 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x5606648771b0 tx=0x7f6ad801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.274+0000 7f6ae2308800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.274+0000 7f6ae2308800 1 --2- 172.21.15.164:0/2599349732 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5606648a5920 0x5606648a7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.274+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5606648a8530 con 0x5606648a5920 2024-09-13T23:05:31.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.274+0000 7f6adfdfc640 1 --2- 172.21.15.164:0/2599349732 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5606648a5920 0x5606648a7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.275+0000 7f6adfdfc640 1 --2- 172.21.15.164:0/2599349732 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5606648a5920 0x5606648a7de0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.275+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.275+0000 7f6ae2308800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.275+0000 7f6ae2308800 20 realm 2024-09-13T23:05:31.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.275+0000 7f6ae2308800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.275+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5606648a8940 con 0x5606648a5920 2024-09-13T23:05:31.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.275+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.275+0000 7f6ae2308800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.275+0000 7f6ae2308800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:31.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.275+0000 7f6ae2308800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.275+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5606648a9210 con 0x5606648a5920 2024-09-13T23:05:31.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.275+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.275+0000 7f6ae2308800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.275+0000 7f6ae2308800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.275+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5606648a95b0 con 0x5606648a5920 2024-09-13T23:05:31.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.275+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.275+0000 7f6ae2308800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:31.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.275+0000 7f6ae2308800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.275+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5606648a9e00 con 0x5606648a5920 2024-09-13T23:05:31.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.276+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.276+0000 7f6ae2308800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:31.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.276+0000 7f6ae2308800 20 searching for the correct realm 2024-09-13T23:05:31.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.276+0000 7f6ae2308800 1 --2- 172.21.15.164:0/2599349732 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5606648abb70 0x5606648adf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.276+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x5606648abb70 2024-09-13T23:05:31.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.276+0000 7f6adf5fb640 1 --2- 172.21.15.164:0/2599349732 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5606648abb70 0x5606648adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.276+0000 7f6adf5fb640 1 --2- 172.21.15.164:0/2599349732 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5606648abb70 0x5606648adf60 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.276+0000 7f6adf5fb640 1 -- 172.21.15.164:0/2599349732 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad4098030 con 0x5606648abb70 2024-09-13T23:05:31.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.276+0000 7f6adf5fb640 1 --2- 172.21.15.164:0/2599349732 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f6ad409b060 0x7f6ad4091650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.276+0000 7f6adf5fb640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x7f6ad409b060 2024-09-13T23:05:31.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.276+0000 7f6ae05fd640 1 --2- 172.21.15.164:0/2599349732 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f6ad409b060 0x7f6ad4091650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.277+0000 7f6ae05fd640 1 --2- 172.21.15.164:0/2599349732 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f6ad409b060 0x7f6ad4091650 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.277+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2599349732 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad801f070 con 0x7f6ad409b060 2024-09-13T23:05:31.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.277+0000 7f6ae05fd640 1 --2- 172.21.15.164:0/2599349732 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f6ad8031040 0x7f6ad8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.277+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x7f6ad8031040 2024-09-13T23:05:31.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.277+0000 7f6adfdfc640 1 --2- 172.21.15.164:0/2599349732 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f6ad8031040 0x7f6ad8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.278+0000 7f6adfdfc640 1 --2- 172.21.15.164:0/2599349732 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f6ad8031040 0x7f6ad8032940 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.278+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad001ac70 con 0x7f6ad8031040 2024-09-13T23:05:31.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.278+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x5606648a5920 2024-09-13T23:05:31.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.278+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.278+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x5606648a5920 2024-09-13T23:05:31.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.278+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.278+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x7f6ad8031040 2024-09-13T23:05:31.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.279+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad001ac70 con 0x7f6ad8031040 2024-09-13T23:05:31.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.279+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x7f6ad8031040 2024-09-13T23:05:31.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.279+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad001ac70 con 0x7f6ad8031040 2024-09-13T23:05:31.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.279+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x7f6ad409b060 2024-09-13T23:05:31.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.279+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2599349732 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad801f070 con 0x7f6ad409b060 2024-09-13T23:05:31.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.279+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x5606648abb70 2024-09-13T23:05:31.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.279+0000 7f6adf5fb640 1 -- 172.21.15.164:0/2599349732 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad40aa040 con 0x5606648abb70 2024-09-13T23:05:31.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.279+0000 7f6adf5fb640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x5606648a5920 2024-09-13T23:05:31.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.280+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.280+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x7f6ad8031040 2024-09-13T23:05:31.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.280+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad001ac70 con 0x7f6ad8031040 2024-09-13T23:05:31.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.280+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x5606648a5920 2024-09-13T23:05:31.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.280+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.280+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x7f6ad409b060 2024-09-13T23:05:31.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.280+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2599349732 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6ad801f070 con 0x7f6ad409b060 2024-09-13T23:05:31.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.280+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x5606648abb70 2024-09-13T23:05:31.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.281+0000 7f6adf5fb640 1 -- 172.21.15.164:0/2599349732 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad40aa040 con 0x5606648abb70 2024-09-13T23:05:31.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.281+0000 7f6adf5fb640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x5606648abb70 2024-09-13T23:05:31.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.281+0000 7f6adf5fb640 1 -- 172.21.15.164:0/2599349732 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad40aa040 con 0x5606648abb70 2024-09-13T23:05:31.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.281+0000 7f6adf5fb640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x7f6ad8031040 2024-09-13T23:05:31.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.281+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad001ac70 con 0x7f6ad8031040 2024-09-13T23:05:31.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.281+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x5606648abb70 2024-09-13T23:05:31.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.281+0000 7f6adf5fb640 1 -- 172.21.15.164:0/2599349732 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad40aa040 con 0x5606648abb70 2024-09-13T23:05:31.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.281+0000 7f6adf5fb640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x5606648abb70 2024-09-13T23:05:31.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.281+0000 7f6adf5fb640 1 -- 172.21.15.164:0/2599349732 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad40aa040 con 0x5606648abb70 2024-09-13T23:05:31.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.281+0000 7f6adf5fb640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x5606648a5920 2024-09-13T23:05:31.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.282+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.282+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x5606648a5920 2024-09-13T23:05:31.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.282+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.282+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x7f6ad8031040 2024-09-13T23:05:31.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.282+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad001ac70 con 0x7f6ad8031040 2024-09-13T23:05:31.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.282+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x5606648abb70 2024-09-13T23:05:31.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.282+0000 7f6adf5fb640 1 -- 172.21.15.164:0/2599349732 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad40aa040 con 0x5606648abb70 2024-09-13T23:05:31.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.282+0000 7f6adf5fb640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x7f6ad409b060 2024-09-13T23:05:31.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.283+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2599349732 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad801f070 con 0x7f6ad409b060 2024-09-13T23:05:31.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.283+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x5606648a5920 2024-09-13T23:05:31.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.283+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.283+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x7f6ad8031040 2024-09-13T23:05:31.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.283+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad001ac70 con 0x7f6ad8031040 2024-09-13T23:05:31.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.283+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x5606648abb70 2024-09-13T23:05:31.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.283+0000 7f6adf5fb640 1 -- 172.21.15.164:0/2599349732 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad40aa040 con 0x5606648abb70 2024-09-13T23:05:31.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.283+0000 7f6adf5fb640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x7f6ad8031040 2024-09-13T23:05:31.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.284+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad001ac70 con 0x7f6ad8031040 2024-09-13T23:05:31.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.284+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x7f6ad409b060 2024-09-13T23:05:31.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.284+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2599349732 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad801f070 con 0x7f6ad409b060 2024-09-13T23:05:31.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.284+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x5606648abb70 2024-09-13T23:05:31.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.284+0000 7f6adf5fb640 1 -- 172.21.15.164:0/2599349732 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad40aa040 con 0x5606648abb70 2024-09-13T23:05:31.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.284+0000 7f6adf5fb640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x7f6ad8031040 2024-09-13T23:05:31.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.285+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad001ac70 con 0x7f6ad8031040 2024-09-13T23:05:31.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.285+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x5606648a5920 2024-09-13T23:05:31.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.285+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.285+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae570 con 0x7f6ad409b060 2024-09-13T23:05:31.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.285+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2599349732 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ad801f070 con 0x7f6ad409b060 2024-09-13T23:05:31.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.285+0000 7f6ae2308800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:31.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.285+0000 7f6ae2308800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:31.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.285+0000 7f6ae2308800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:31.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.285+0000 7f6ae2308800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:31.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.285+0000 7f6ae2308800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:31.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.285+0000 7f6ae2308800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:31.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.285+0000 7f6ae2308800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.285+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5606648aa780 con 0x5606648a5920 2024-09-13T23:05:31.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.285+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.285+0000 7f6ae2308800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.285+0000 7f6ae2308800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.285+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5606648ab020 con 0x5606648a5920 2024-09-13T23:05:31.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.286+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.286+0000 7f6ae2308800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:31.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.286+0000 7f6ae2308800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.286+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5606648ae9f0 con 0x5606648a5920 2024-09-13T23:05:31.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.286+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.286+0000 7f6ae2308800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:31.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.286+0000 7f6ae2308800 20 zone default found 2024-09-13T23:05:31.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.286+0000 7f6ae2308800 4 Realm: () 2024-09-13T23:05:31.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.286+0000 7f6ae2308800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:31.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.286+0000 7f6ae2308800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:31.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.286+0000 7f6ae2308800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:31.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.286+0000 7f6ae2308800 20 zonegroup default 2024-09-13T23:05:31.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.286+0000 7f6ae2308800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.286+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5606648aac80 con 0x7f6ad8031040 2024-09-13T23:05:31.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.286+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x7f6ad8031040 2024-09-13T23:05:31.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.286+0000 7f6ae2308800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.286+0000 7f6ae2308800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.286+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5606648b08d0 con 0x5606648abb70 2024-09-13T23:05:31.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.286+0000 7f6adf5fb640 1 -- 172.21.15.164:0/2599349732 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6ad40aa040 con 0x5606648abb70 2024-09-13T23:05:31.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.287+0000 7f6ae2308800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.287+0000 7f6ae2308800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.287+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5606648b0c70 con 0x5606648abb70 2024-09-13T23:05:31.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.287+0000 7f6adf5fb640 1 -- 172.21.15.164:0/2599349732 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6ad40aa040 con 0x5606648abb70 2024-09-13T23:05:31.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.287+0000 7f6ae2308800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.287+0000 7f6ae2308800 20 started sync module instance, tier type = 2024-09-13T23:05:31.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.287+0000 7f6ae2308800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:31.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.287+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648afd70 con 0x7f6ad409b060 2024-09-13T23:05:31.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.288+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2599349732 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad8040040 con 0x7f6ad409b060 2024-09-13T23:05:31.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.288+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94585456623968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648af9d0 con 0x7f6ad409b060 2024-09-13T23:05:31.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.288+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648b1a80 con 0x5606648a5920 2024-09-13T23:05:31.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.289+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2599349732 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94585456623968] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad8040040 con 0x7f6ad409b060 2024-09-13T23:05:31.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.289+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.289+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94585456627872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648b1a40 con 0x5606648a5920 2024-09-13T23:05:31.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.289+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648b2530 con 0x5606648abb70 2024-09-13T23:05:31.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.290+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94585456627872] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.290+0000 7f6adf5fb640 1 -- 172.21.15.164:0/2599349732 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad40aa040 con 0x5606648abb70 2024-09-13T23:05:31.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.290+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94585456631776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648b2920 con 0x5606648abb70 2024-09-13T23:05:31.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.291+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648b3340 con 0x7f6ad409b060 2024-09-13T23:05:31.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.291+0000 7f6adf5fb640 1 -- 172.21.15.164:0/2599349732 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94585456631776] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad40aa040 con 0x5606648abb70 2024-09-13T23:05:31.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.292+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2599349732 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad8040040 con 0x7f6ad409b060 2024-09-13T23:05:31.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.292+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94585456635440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648b3730 con 0x7f6ad409b060 2024-09-13T23:05:31.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.292+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648b4190 con 0x5606648a5920 2024-09-13T23:05:31.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.292+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2599349732 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94585456635440] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad8040040 con 0x7f6ad409b060 2024-09-13T23:05:31.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.293+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.293+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94585456628928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648b4190 con 0x5606648a5920 2024-09-13T23:05:31.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.293+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648b4be0 con 0x7f6ad8031040 2024-09-13T23:05:31.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.294+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x7f6ad8031040 2024-09-13T23:05:31.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.294+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94585456641776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648b4b10 con 0x7f6ad8031040 2024-09-13T23:05:31.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.294+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648b5b00 con 0x7f6ad8031040 2024-09-13T23:05:31.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.294+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94585456628928] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.295+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x7f6ad8031040 2024-09-13T23:05:31.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.295+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94585456645616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648b5ac0 con 0x7f6ad8031040 2024-09-13T23:05:31.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.295+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648b64e0 con 0x7f6ad8031040 2024-09-13T23:05:31.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.295+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94585456641776] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x7f6ad8031040 2024-09-13T23:05:31.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.296+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94585456645616] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x7f6ad8031040 2024-09-13T23:05:31.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.296+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x7f6ad8031040 2024-09-13T23:05:31.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.296+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94585456648144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648b4f80 con 0x7f6ad8031040 2024-09-13T23:05:31.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.296+0000 7f6ae2308800 20 add_watcher() i=0 2024-09-13T23:05:31.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.296+0000 7f6ae2308800 20 add_watcher() i=1 2024-09-13T23:05:31.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.296+0000 7f6ae2308800 20 add_watcher() i=2 2024-09-13T23:05:31.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.296+0000 7f6ae2308800 20 add_watcher() i=3 2024-09-13T23:05:31.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.296+0000 7f6ae2308800 20 add_watcher() i=4 2024-09-13T23:05:31.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.296+0000 7f6ae2308800 20 add_watcher() i=5 2024-09-13T23:05:31.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.296+0000 7f6ae2308800 20 add_watcher() i=6 2024-09-13T23:05:31.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.297+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94585456648144] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x7f6ad8031040 2024-09-13T23:05:31.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.297+0000 7f6ae2308800 20 add_watcher() i=7 2024-09-13T23:05:31.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.297+0000 7f6ae2308800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:31.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.297+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5606648b94d0 con 0x5606648a5920 2024-09-13T23:05:31.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.297+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.297+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94585456639088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648b6950 con 0x5606648a5920 2024-09-13T23:05:31.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.298+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94585456639088] v32'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.298+0000 7f6995fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:31.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.298+0000 7f6ae2308800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:31.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.298+0000 7f6ae2308800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:31.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.298+0000 7f6ae2308800 5 note: GC not initialized 2024-09-13T23:05:31.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.299+0000 7f6994fe1640 20 reqs_thread_entry: start 2024-09-13T23:05:31.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.299+0000 7f6ae2308800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:31.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.299+0000 7f6ae2308800 20 Filter name: none 2024-09-13T23:05:31.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.299+0000 7f690e7fc640 20 reqs_thread_entry: start 2024-09-13T23:05:31.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.299+0000 7f6ae2308800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:05:31.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.299+0000 7f6ae2308800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.299+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5606648ec840 con 0x5606648a5920 2024-09-13T23:05:31.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.299+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.299+0000 7f6ae2308800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.299+0000 7f6ae2308800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-13T23:05:31.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.299+0000 7f6ae2308800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:31.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.299+0000 7f6ae2308800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-13T23:05:31.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.299+0000 7f6ae2308800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.299+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5606648eae80 con 0x5606648a5920 2024-09-13T23:05:31.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.299+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.299+0000 7f6ae2308800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.299+0000 7f6ae2308800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-13T23:05:31.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.299+0000 7f6ae2308800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T23:05:31.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.299+0000 7f6ae2308800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-13T23:05:31.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.299+0000 7f6ae2308800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.299+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5606648eae80 con 0x7f6ad8031040 2024-09-13T23:05:31.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.300+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x7f6ad8031040 2024-09-13T23:05:31.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.300+0000 7f6ae2308800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.300+0000 7f6ae2308800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-13T23:05:31.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.300+0000 7f6ae2308800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-13T23:05:31.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.300+0000 7f6ae2308800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-13T23:05:31.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.300+0000 7f6ae2308800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-13T23:05:31.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.300+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648eb8f0 con 0x5606648a5920 2024-09-13T23:05:31.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.301+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v32'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.301+0000 7f6ae2308800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:31.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.301+0000 7f6ae2308800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:31.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.301+0000 7f6ae2308800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:05:31.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.301+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94585456867504 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5606648f0290 con 0x5606648a5920 2024-09-13T23:05:31.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.301+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== watch-notify(notify (1) cookie 94585456628928 notify 137438953472 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5606648ec480 con 0x5606648a5920 2024-09-13T23:05:31.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.301+0000 7f69beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94585456628928 notifier 4302 bl.length()=567 2024-09-13T23:05:31.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.301+0000 7f69beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:31.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.301+0000 7f69beffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:31.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.302+0000 7f69beffd640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f69a4003ea0 con 0x5606648a5920 2024-09-13T23:05:31.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.302+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(66 notify.4 [notify cookie 94585456867504 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.302+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.302+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== watch-notify(notify_complete (2) cookie 94585456867504 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6ad0033040 con 0x5606648a5920 2024-09-13T23:05:31.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.302+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648eb8b0 con 0x5606648a5920 2024-09-13T23:05:31.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.303+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.303+0000 7f6ae2308800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-13T23:05:31.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.303+0000 7f6ae2308800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T23:05:31.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.303+0000 7f6ae2308800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-13T23:05:31.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.303+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94585456867504 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5606648f0290 con 0x7f6ad409b060 2024-09-13T23:05:31.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.304+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2599349732 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== watch-notify(notify (1) cookie 94585456635440 notify 137438953472 ret 0) ==== 211+0+0 (crc 0 0 0) 0x7f6ad80247c0 con 0x7f6ad409b060 2024-09-13T23:05:31.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.304+0000 7f69be7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94585456635440 notifier 4302 bl.length()=169 2024-09-13T23:05:31.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.304+0000 7f69be7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-13T23:05:31.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.304+0000 7f69be7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T23:05:31.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.304+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2599349732 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(69 notify.3 [notify cookie 94585456867504 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6ad8040040 con 0x7f6ad409b060 2024-09-13T23:05:31.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.304+0000 7f69be7fc640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6914003400 con 0x7f6ad409b060 2024-09-13T23:05:31.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.304+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2599349732 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== watch-notify(notify_complete (2) cookie 94585456867504 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6ad8024990 con 0x7f6ad409b060 2024-09-13T23:05:31.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.304+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2599349732 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad8040040 con 0x7f6ad409b060 2024-09-13T23:05:31.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.304+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648eb8b0 con 0x7f6ad8031040 2024-09-13T23:05:31.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.305+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x7f6ad8031040 2024-09-13T23:05:31.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.305+0000 7f6ae2308800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-13T23:05:31.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.305+0000 7f6ae2308800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-13T23:05:31.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.305+0000 7f6ae2308800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-13T23:05:31.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.305+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94585456867504 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5606648f0290 con 0x7f6ad409b060 2024-09-13T23:05:31.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.306+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2599349732 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== watch-notify(notify (1) cookie 94585456635440 notify 137438953473 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f6ad8024990 con 0x7f6ad409b060 2024-09-13T23:05:31.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.306+0000 7f69beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94585456635440 notifier 4302 bl.length()=177 2024-09-13T23:05:31.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.306+0000 7f69beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-13T23:05:31.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.306+0000 7f69beffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-13T23:05:31.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.306+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2599349732 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(72 notify.3 [notify cookie 94585456867504 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6ad8040040 con 0x7f6ad409b060 2024-09-13T23:05:31.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.306+0000 7f69beffd640 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f69a4003ea0 con 0x7f6ad409b060 2024-09-13T23:05:31.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.306+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2599349732 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad8040040 con 0x7f6ad409b060 2024-09-13T23:05:31.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.306+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2599349732 <== osd.2 v2:172.21.15.164:6808/3795914978 18 ==== watch-notify(notify_complete (2) cookie 94585456867504 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6ad8043420 con 0x7f6ad409b060 2024-09-13T23:05:31.347 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:05:31.300851Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:05:31.300826Z","tags":[],"group_ids":[]} 2024-09-13T23:05:31.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.307+0000 7f6995fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:31.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.307+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94585456639088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648ea520 con 0x5606648a5920 2024-09-13T23:05:31.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.308+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94585456639088] v32'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.308+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94585456623968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648ea520 con 0x7f6ad409b060 2024-09-13T23:05:31.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.309+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2599349732 <== osd.2 v2:172.21.15.164:6808/3795914978 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94585456623968] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad8040040 con 0x7f6ad409b060 2024-09-13T23:05:31.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.309+0000 7f6ae2308800 20 remove_watcher() i=0 2024-09-13T23:05:31.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.309+0000 7f6ae2308800 2 removed watcher, disabling cache 2024-09-13T23:05:31.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.309+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94585456627872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648ea520 con 0x5606648a5920 2024-09-13T23:05:31.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.310+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 32 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94585456627872] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.310+0000 7f6ae2308800 20 remove_watcher() i=1 2024-09-13T23:05:31.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.310+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94585456631776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648ea520 con 0x5606648abb70 2024-09-13T23:05:31.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.311+0000 7f6adf5fb640 1 -- 172.21.15.164:0/2599349732 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94585456631776] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad40aa040 con 0x5606648abb70 2024-09-13T23:05:31.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.311+0000 7f6ae2308800 20 remove_watcher() i=2 2024-09-13T23:05:31.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.311+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94585456635440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648b10a0 con 0x7f6ad409b060 2024-09-13T23:05:31.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.312+0000 7f6ae05fd640 1 -- 172.21.15.164:0/2599349732 <== osd.2 v2:172.21.15.164:6808/3795914978 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94585456635440] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad8040040 con 0x7f6ad409b060 2024-09-13T23:05:31.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.312+0000 7f6ae2308800 20 remove_watcher() i=3 2024-09-13T23:05:31.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.312+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94585456628928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648b2e30 con 0x5606648a5920 2024-09-13T23:05:31.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.313+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.1 v2:172.21.15.164:6800/4060509701 33 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94585456628928] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x5606648a5920 2024-09-13T23:05:31.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.313+0000 7f6ae2308800 20 remove_watcher() i=4 2024-09-13T23:05:31.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.313+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94585456641776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648b2e30 con 0x7f6ad8031040 2024-09-13T23:05:31.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.314+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94585456641776] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x7f6ad8031040 2024-09-13T23:05:31.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.314+0000 7f6ae2308800 20 remove_watcher() i=5 2024-09-13T23:05:31.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.314+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94585456645616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648b1550 con 0x7f6ad8031040 2024-09-13T23:05:31.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.315+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94585456645616] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x7f6ad8031040 2024-09-13T23:05:31.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.315+0000 7f6ae2308800 20 remove_watcher() i=6 2024-09-13T23:05:31.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.315+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94585456648144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606648b1550 con 0x7f6ad8031040 2024-09-13T23:05:31.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.316+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94585456648144] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ad001ac70 con 0x7f6ad8031040 2024-09-13T23:05:31.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.316+0000 7f6ae2308800 20 remove_watcher() i=7 2024-09-13T23:05:31.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.316+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f6ad8031040 msgr2=0x7f6ad8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.316+0000 7f6ae2308800 1 --2- 172.21.15.164:0/2599349732 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f6ad8031040 0x7f6ad8032940 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.316+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5606648a5920 msgr2=0x5606648a7de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.316+0000 7f6ae2308800 1 --2- 172.21.15.164:0/2599349732 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5606648a5920 0x5606648a7de0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.316+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f6ad409b060 msgr2=0x7f6ad4091650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.316+0000 7f6ae2308800 1 --2- 172.21.15.164:0/2599349732 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f6ad409b060 0x7f6ad4091650 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.316+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5606648abb70 msgr2=0x5606648adf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.316+0000 7f6ae2308800 1 --2- 172.21.15.164:0/2599349732 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5606648abb70 0x5606648adf60 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.316+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f69a8036b40 msgr2=0x7f69a8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.316+0000 7f6ae2308800 1 --2- 172.21.15.164:0/2599349732 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f69a8036b40 0x7f69a8039000 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x5606648771b0 tx=0x7f6ad801f000 comp rx=0 tx=0).stop 2024-09-13T23:05:31.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.316+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560664892950 msgr2=0x560664899e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.316+0000 7f6adfdfc640 1 -- 172.21.15.164:0/2599349732 reap_dead start 2024-09-13T23:05:31.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.316+0000 7f6ae2308800 1 --2- 172.21.15.164:0/2599349732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560664892950 0x560664899e10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6ad405f000 tx=0x7f6ad408f8c0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.316+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 shutdown_connections 2024-09-13T23:05:31.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.316+0000 7f6ae2308800 1 --2- 172.21.15.164:0/2599349732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560664892950 0x560664899e10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.316+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 >> 172.21.15.164:0/2599349732 conn(0x56066488ecb0 msgr2=0x56066488cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.316+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 shutdown_connections 2024-09-13T23:05:31.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.316+0000 7f6ae2308800 1 -- 172.21.15.164:0/2599349732 wait complete. 2024-09-13T23:05:31.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.317+0000 7f6ae2308800 1 -- 172.21.15.164:0/896230109 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f69b8036b90 msgr2=0x7f69b8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.317+0000 7f6ae2308800 1 --2- 172.21.15.164:0/896230109 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f69b8036b90 0x7f69b8039050 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x560664876df0 tx=0x7f6ad8005840 comp rx=0 tx=0).stop 2024-09-13T23:05:31.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.317+0000 7f6ae2308800 1 -- 172.21.15.164:0/896230109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560664885ce0 msgr2=0x560664886120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.317+0000 7f6ae2308800 1 --2- 172.21.15.164:0/896230109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560664885ce0 0x560664886120 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4025af0 tx=0x7f6ad4002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.317+0000 7f6ae2308800 1 -- 172.21.15.164:0/896230109 shutdown_connections 2024-09-13T23:05:31.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.317+0000 7f6ae2308800 1 --2- 172.21.15.164:0/896230109 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f69b8036b90 0x7f69b8039050 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.317+0000 7f6ae2308800 1 --2- 172.21.15.164:0/896230109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560664885ce0 0x560664886120 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.317+0000 7f6ae2308800 1 -- 172.21.15.164:0/896230109 >> 172.21.15.164:0/896230109 conn(0x56066487ac70 msgr2=0x56066487d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.317+0000 7f6ae2308800 1 -- 172.21.15.164:0/896230109 shutdown_connections 2024-09-13T23:05:31.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.317+0000 7f6ae2308800 1 -- 172.21.15.164:0/896230109 wait complete. 2024-09-13T23:05:31.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.317+0000 7f6ae2308800 1 -- 172.21.15.164:0/2983301825 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x56066477bd50 msgr2=0x560664875430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.317+0000 7f6ae2308800 1 --2- 172.21.15.164:0/2983301825 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x56066477bd50 0x560664875430 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.317+0000 7f6ae2308800 1 -- 172.21.15.164:0/2983301825 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f69c8036b90 msgr2=0x7f69c8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.317+0000 7f6ae2308800 1 --2- 172.21.15.164:0/2983301825 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f69c8036b90 0x7f69c8039050 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x5606646e8580 tx=0x7f6ad4050000 comp rx=0 tx=0).stop 2024-09-13T23:05:31.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.317+0000 7f6ae2308800 1 -- 172.21.15.164:0/2983301825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606646e8e40 msgr2=0x56066486e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.317+0000 7f6ae2308800 1 --2- 172.21.15.164:0/2983301825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606646e8e40 0x56066486e3c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0001e30 tx=0x7f6ad0000ed0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.317+0000 7f6ae2308800 1 -- 172.21.15.164:0/2983301825 shutdown_connections 2024-09-13T23:05:31.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.317+0000 7f6ae2308800 1 --2- 172.21.15.164:0/2983301825 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x56066477bd50 0x560664875430 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.317+0000 7f6ae2308800 1 --2- 172.21.15.164:0/2983301825 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f69c8036b90 0x7f69c8039050 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.317+0000 7f6ae2308800 1 --2- 172.21.15.164:0/2983301825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606646e8e40 0x56066486e3c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.317+0000 7f6ae2308800 1 -- 172.21.15.164:0/2983301825 >> 172.21.15.164:0/2983301825 conn(0x56066476fe00 msgr2=0x560664860c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.317+0000 7f6ae2308800 1 -- 172.21.15.164:0/2983301825 shutdown_connections 2024-09-13T23:05:31.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.317+0000 7f6ae2308800 1 -- 172.21.15.164:0/2983301825 wait complete. 2024-09-13T23:05:31.358 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:05:31.300851Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:05:31.300826Z', 'tags': [], 'group_ids': []} 2024-09-13T23:05:31.358 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-13T23:05:31.359 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-13T23:05:31.359 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-13T23:05:31.407 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:31.407 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:31.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.407+0000 7feeec13e800 1 Processor -- start 2024-09-13T23:05:31.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.407+0000 7feeec13e800 1 -- start start 2024-09-13T23:05:31.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.407+0000 7feeec13e800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5647445df920 0x5647445e1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.407+0000 7feeec13e800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56474449bb30 con 0x5647445db4e0 2024-09-13T23:05:31.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.407+0000 7feeec13e800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x56474447d360 con 0x5647445df920 2024-09-13T23:05:31.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.408+0000 7feee7633640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5647445df920 0x5647445e1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.408+0000 7feee7e34640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x5647445db4e0 0x5647445db8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40736/0 (socket says 172.21.15.164:40736) 2024-09-13T23:05:31.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.408+0000 7feee7e34640 1 -- 172.21.15.164:0/4126004949 learned_addr learned my addr 172.21.15.164:0/4126004949 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:31.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.408+0000 7feee7633640 1 -- 172.21.15.164:0/4126004949 >> v1:172.21.15.17:6789/0 conn(0x5647445db4e0 legacy=0x5647445db8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.408+0000 7feee6e32640 1 -- 172.21.15.164:0/4126004949 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4238173184 0 0) 0x56474449bb30 con 0x5647445db4e0 2024-09-13T23:05:31.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.408+0000 7feee7633640 1 -- 172.21.15.164:0/4126004949 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647444a3e00 con 0x5647445df920 2024-09-13T23:05:31.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.410+0000 7feee7633640 1 --2- 172.21.15.164:0/4126004949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647445df920 0x5647445e1d10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7feedc00a470 tx=0x7feedc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c33226ec966d9e93 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.410+0000 7feee6e32640 1 -- 172.21.15.164:0/4126004949 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feedc053570 con 0x5647445df920 2024-09-13T23:05:31.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.410+0000 7feee6e32640 1 -- 172.21.15.164:0/4126004949 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feedc058070 con 0x5647445df920 2024-09-13T23:05:31.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.410+0000 7feee6e32640 1 -- 172.21.15.164:0/4126004949 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feedc053880 con 0x5647445df920 2024-09-13T23:05:31.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.411+0000 7feeec13e800 1 -- 172.21.15.164:0/4126004949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647445df920 msgr2=0x5647445e1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.411+0000 7feeec13e800 1 --2- 172.21.15.164:0/4126004949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647445df920 0x5647445e1d10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7feedc00a470 tx=0x7feedc045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:31.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.411+0000 7feeec13e800 1 -- 172.21.15.164:0/4126004949 shutdown_connections 2024-09-13T23:05:31.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.411+0000 7feeec13e800 1 --2- 172.21.15.164:0/4126004949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647445df920 0x5647445e1d10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.411+0000 7feeec13e800 1 -- 172.21.15.164:0/4126004949 >> 172.21.15.164:0/4126004949 conn(0x5647445d6e10 msgr2=0x5647445d9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.411+0000 7feeec13e800 1 -- 172.21.15.164:0/4126004949 shutdown_connections 2024-09-13T23:05:31.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.411+0000 7feeec13e800 1 -- 172.21.15.164:0/4126004949 wait complete. 2024-09-13T23:05:31.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.425+0000 7feeec13e800 1 Processor -- start 2024-09-13T23:05:31.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.425+0000 7feeec13e800 1 -- start start 2024-09-13T23:05:31.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.425+0000 7feeec13e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647445db4e0 0x5647446ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.425+0000 7feeec13e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564744528350 con 0x5647445db4e0 2024-09-13T23:05:31.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.425+0000 7feee7e34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647445db4e0 0x5647446ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.425+0000 7feee7e34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647445db4e0 0x5647446ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56260/0 (socket says 172.21.15.164:56260) 2024-09-13T23:05:31.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.425+0000 7feee7e34640 1 -- 172.21.15.164:0/1718379433 learned_addr learned my addr 172.21.15.164:0/1718379433 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.426+0000 7feee7e34640 1 -- 172.21.15.164:0/1718379433 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564744475bc0 con 0x5647445db4e0 2024-09-13T23:05:31.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.426+0000 7feee7e34640 1 --2- 172.21.15.164:0/1718379433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647445db4e0 0x5647446ca580 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7feed8001760 tx=0x7feed8006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=123de35c713c629a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.426+0000 7fedd5e0b640 1 -- 172.21.15.164:0/1718379433 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feed800f490 con 0x5647445db4e0 2024-09-13T23:05:31.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.426+0000 7fedd5e0b640 1 -- 172.21.15.164:0/1718379433 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feed800f650 con 0x5647445db4e0 2024-09-13T23:05:31.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.426+0000 7fedd5e0b640 1 -- 172.21.15.164:0/1718379433 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feed800f9b0 con 0x5647445db4e0 2024-09-13T23:05:31.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.427+0000 7feeec13e800 1 -- 172.21.15.164:0/1718379433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647445db4e0 msgr2=0x5647446ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.427+0000 7feeec13e800 1 --2- 172.21.15.164:0/1718379433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647445db4e0 0x5647446ca580 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7feed8001760 tx=0x7feed8006f90 comp rx=0 tx=0).stop 2024-09-13T23:05:31.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.427+0000 7feeec13e800 1 -- 172.21.15.164:0/1718379433 shutdown_connections 2024-09-13T23:05:31.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.427+0000 7feeec13e800 1 --2- 172.21.15.164:0/1718379433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647445db4e0 0x5647446ca580 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.427+0000 7feeec13e800 1 -- 172.21.15.164:0/1718379433 >> 172.21.15.164:0/1718379433 conn(0x5647445d6e10 msgr2=0x5647446c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.427+0000 7feeec13e800 1 -- 172.21.15.164:0/1718379433 shutdown_connections 2024-09-13T23:05:31.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.427+0000 7feeec13e800 1 -- 172.21.15.164:0/1718379433 wait complete. 2024-09-13T23:05:31.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.427+0000 7feeec13e800 1 Processor -- start 2024-09-13T23:05:31.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.427+0000 7feeec13e800 1 -- start start 2024-09-13T23:05:31.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.427+0000 7feeec13e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647445db4e0 0x5647446d0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.427+0000 7feeec13e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5647445e2550 con 0x5647445db4e0 2024-09-13T23:05:31.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.428+0000 7feee7e34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647445db4e0 0x5647446d0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.428+0000 7feee7e34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647445db4e0 0x5647446d0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56276/0 (socket says 172.21.15.164:56276) 2024-09-13T23:05:31.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.428+0000 7feee7e34640 1 -- 172.21.15.164:0/3846580622 learned_addr learned my addr 172.21.15.164:0/3846580622 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.428+0000 7feee7e34640 1 -- 172.21.15.164:0/3846580622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564744489fe0 con 0x5647445db4e0 2024-09-13T23:05:31.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.428+0000 7feee7e34640 1 --2- 172.21.15.164:0/3846580622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647445db4e0 0x5647446d0ea0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feed8001330 tx=0x7feed8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.428+0000 7fedcffff640 1 -- 172.21.15.164:0/3846580622 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feed8010870 con 0x5647445db4e0 2024-09-13T23:05:31.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.428+0000 7fedcffff640 1 -- 172.21.15.164:0/3846580622 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feed8010a10 con 0x5647445db4e0 2024-09-13T23:05:31.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.428+0000 7fedcffff640 1 -- 172.21.15.164:0/3846580622 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feed8010cf0 con 0x5647445db4e0 2024-09-13T23:05:31.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.428+0000 7feeec13e800 1 -- 172.21.15.164:0/3846580622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5647446d13e0 con 0x5647445db4e0 2024-09-13T23:05:31.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.428+0000 7feeec13e800 1 -- 172.21.15.164:0/3846580622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647446d18a0 con 0x5647445db4e0 2024-09-13T23:05:31.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.429+0000 7fedcffff640 1 -- 172.21.15.164:0/3846580622 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7feed8003450 con 0x5647445db4e0 2024-09-13T23:05:31.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.429+0000 7fedcffff640 1 --2- 172.21.15.164:0/3846580622 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fedd0036b90 0x7fedd0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.429+0000 7fedcffff640 1 -- 172.21.15.164:0/3846580622 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7feed804f5c0 con 0x5647445db4e0 2024-09-13T23:05:31.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.429+0000 7feee7633640 1 --2- 172.21.15.164:0/3846580622 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fedd0036b90 0x7fedd0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.430+0000 7feeec13e800 1 --2- 172.21.15.164:0/3846580622 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5647445df920 0x5647446d7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.430+0000 7feeec13e800 1 -- 172.21.15.164:0/3846580622 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5647446d83e0 con 0x5647445df920 2024-09-13T23:05:31.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.430+0000 7feee8635640 1 --2- 172.21.15.164:0/3846580622 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5647445df920 0x5647446d7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.430+0000 7feee7633640 1 --2- 172.21.15.164:0/3846580622 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fedd0036b90 0x7fedd0039050 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feedc057000 tx=0x7feedc052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.430+0000 7feee8635640 1 --2- 172.21.15.164:0/3846580622 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5647445df920 0x5647446d7e40 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.430+0000 7feee8635640 1 -- 172.21.15.164:0/3846580622 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feee000a4e0 con 0x5647445df920 2024-09-13T23:05:31.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.430+0000 7feeec13e800 1 -- 172.21.15.164:0/3846580622 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5647446d54a0 con 0x5647445df920 2024-09-13T23:05:31.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.431+0000 7feee8635640 1 -- 172.21.15.164:0/3846580622 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feee000a4e0 con 0x5647445df920 2024-09-13T23:05:31.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.431+0000 7feeec13e800 1 -- 172.21.15.164:0/3846580622 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5647446da200 con 0x5647445df920 2024-09-13T23:05:31.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.431+0000 7feee8635640 1 -- 172.21.15.164:0/3846580622 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7feee000a4e0 con 0x5647445df920 2024-09-13T23:05:31.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.431+0000 7feeec13e800 1 -- 172.21.15.164:0/3846580622 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5647446d9370 con 0x5647445df920 2024-09-13T23:05:31.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.431+0000 7feee8635640 1 -- 172.21.15.164:0/3846580622 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feee000a4e0 con 0x5647445df920 2024-09-13T23:05:31.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.431+0000 7feeec13e800 1 -- 172.21.15.164:0/3846580622 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5647446d9760 con 0x5647445df920 2024-09-13T23:05:31.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.431+0000 7feee8635640 1 -- 172.21.15.164:0/3846580622 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7feee000a4e0 con 0x5647445df920 2024-09-13T23:05:31.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.432+0000 7feeec13e800 1 Processor -- start 2024-09-13T23:05:31.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.432+0000 7feeec13e800 1 -- start start 2024-09-13T23:05:31.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.432+0000 7feeec13e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647446ecc20 0x5647446ed040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.432+0000 7feeec13e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564744477580 con 0x5647446ecc20 2024-09-13T23:05:31.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.432+0000 7feee7633640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647446ecc20 0x5647446ed040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.432+0000 7feee7633640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647446ecc20 0x5647446ed040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56292/0 (socket says 172.21.15.164:56292) 2024-09-13T23:05:31.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.432+0000 7feee7633640 1 -- 172.21.15.164:0/2508727877 learned_addr learned my addr 172.21.15.164:0/2508727877 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.433+0000 7feee7633640 1 -- 172.21.15.164:0/2508727877 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647446ed580 con 0x5647446ecc20 2024-09-13T23:05:31.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.433+0000 7feee7633640 1 --2- 172.21.15.164:0/2508727877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647446ecc20 0x5647446ed040 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7feedc025bf0 tx=0x7feedc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.433+0000 7fedcd7fa640 1 -- 172.21.15.164:0/2508727877 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feedc06f070 con 0x5647446ecc20 2024-09-13T23:05:31.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.433+0000 7fedcd7fa640 1 -- 172.21.15.164:0/2508727877 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feedc05f550 con 0x5647446ecc20 2024-09-13T23:05:31.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.433+0000 7feeec13e800 1 -- 172.21.15.164:0/2508727877 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5647446ed7b0 con 0x5647446ecc20 2024-09-13T23:05:31.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.433+0000 7fedcd7fa640 1 -- 172.21.15.164:0/2508727877 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feedc05f830 con 0x5647446ecc20 2024-09-13T23:05:31.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.433+0000 7feeec13e800 1 -- 172.21.15.164:0/2508727877 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647446f0430 con 0x5647446ecc20 2024-09-13T23:05:31.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.434+0000 7fedcd7fa640 1 -- 172.21.15.164:0/2508727877 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7feedc05f9d0 con 0x5647446ecc20 2024-09-13T23:05:31.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.434+0000 7fedcd7fa640 1 --2- 172.21.15.164:0/2508727877 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fedc0036b90 0x7fedc0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.434+0000 7fedcd7fa640 1 -- 172.21.15.164:0/2508727877 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7feedc092c40 con 0x5647446ecc20 2024-09-13T23:05:31.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.434+0000 7feee8635640 1 --2- 172.21.15.164:0/2508727877 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fedc0036b90 0x7fedc0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.434+0000 7feeec13e800 1 Processor -- start 2024-09-13T23:05:31.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.434+0000 7feeec13e800 1 -- start start 2024-09-13T23:05:31.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.434+0000 7feee8635640 1 --2- 172.21.15.164:0/2508727877 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fedc0036b90 0x7fedc0039050 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x5647446d8e90 tx=0x7feee0000f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.434+0000 7feeec13e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647446f97c0 0x5647446f9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.435+0000 7feeec13e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5647446cad30 con 0x5647446f97c0 2024-09-13T23:05:31.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.435+0000 7feee7633640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647446f97c0 0x5647446f9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.435+0000 7feee7633640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647446f97c0 0x5647446f9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56302/0 (socket says 172.21.15.164:56302) 2024-09-13T23:05:31.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.435+0000 7feee7633640 1 -- 172.21.15.164:0/3244868050 learned_addr learned my addr 172.21.15.164:0/3244868050 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.435+0000 7feee7633640 1 -- 172.21.15.164:0/3244868050 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647446fa190 con 0x5647446f97c0 2024-09-13T23:05:31.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.435+0000 7feee7633640 1 --2- 172.21.15.164:0/3244868050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647446f97c0 0x5647446f9bc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7feedc090fa0 tx=0x7feedc05c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d193e09b40c20ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.435+0000 7fedc6ffd640 1 -- 172.21.15.164:0/3244868050 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feedc05c560 con 0x5647446f97c0 2024-09-13T23:05:31.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.435+0000 7fedc6ffd640 1 -- 172.21.15.164:0/3244868050 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feedc06bc10 con 0x5647446f97c0 2024-09-13T23:05:31.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.435+0000 7fedc6ffd640 1 -- 172.21.15.164:0/3244868050 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feedc06a560 con 0x5647446f97c0 2024-09-13T23:05:31.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.436+0000 7feeec13e800 1 -- 172.21.15.164:0/3244868050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647446f97c0 msgr2=0x5647446f9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.436+0000 7feeec13e800 1 --2- 172.21.15.164:0/3244868050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647446f97c0 0x5647446f9bc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7feedc090fa0 tx=0x7feedc05c460 comp rx=0 tx=0).stop 2024-09-13T23:05:31.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.436+0000 7feeec13e800 1 -- 172.21.15.164:0/3244868050 shutdown_connections 2024-09-13T23:05:31.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.436+0000 7feeec13e800 1 --2- 172.21.15.164:0/3244868050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647446f97c0 0x5647446f9bc0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.436+0000 7feeec13e800 1 -- 172.21.15.164:0/3244868050 >> 172.21.15.164:0/3244868050 conn(0x5647446f5b20 msgr2=0x5647446f3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.436+0000 7feeec13e800 1 -- 172.21.15.164:0/3244868050 shutdown_connections 2024-09-13T23:05:31.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.436+0000 7feeec13e800 1 -- 172.21.15.164:0/3244868050 wait complete. 2024-09-13T23:05:31.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.436+0000 7feeec13e800 1 Processor -- start 2024-09-13T23:05:31.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.436+0000 7feeec13e800 1 -- start start 2024-09-13T23:05:31.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.436+0000 7feeec13e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647446f97c0 0x564744700c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.436+0000 7feeec13e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5647446fa800 con 0x5647446f97c0 2024-09-13T23:05:31.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.436+0000 7feee7633640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647446f97c0 0x564744700c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.436+0000 7feee7633640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647446f97c0 0x564744700c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56306/0 (socket says 172.21.15.164:56306) 2024-09-13T23:05:31.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.436+0000 7feee7633640 1 -- 172.21.15.164:0/2434823887 learned_addr learned my addr 172.21.15.164:0/2434823887 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.437+0000 7feee7633640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647447011a0 con 0x5647446f97c0 2024-09-13T23:05:31.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.437+0000 7feee7633640 1 --2- 172.21.15.164:0/2434823887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647446f97c0 0x564744700c60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7feedc069740 tx=0x7feedc090f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.437+0000 7fedc57fa640 1 -- 172.21.15.164:0/2434823887 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feedc06a8a0 con 0x5647446f97c0 2024-09-13T23:05:31.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.437+0000 7fedc57fa640 1 -- 172.21.15.164:0/2434823887 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feedc08a040 con 0x5647446f97c0 2024-09-13T23:05:31.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.437+0000 7fedc57fa640 1 -- 172.21.15.164:0/2434823887 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feedc06b540 con 0x5647446f97c0 2024-09-13T23:05:31.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.437+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564744701430 con 0x5647446f97c0 2024-09-13T23:05:31.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.437+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647447040e0 con 0x5647446f97c0 2024-09-13T23:05:31.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.438+0000 7fedc57fa640 1 -- 172.21.15.164:0/2434823887 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7feedc06b6e0 con 0x5647446f97c0 2024-09-13T23:05:31.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.438+0000 7fedc57fa640 1 --2- 172.21.15.164:0/2434823887 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fedb0036b40 0x7fedb0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.438+0000 7feee8635640 1 --2- 172.21.15.164:0/2434823887 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fedb0036b40 0x7fedb0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.439+0000 7fedc57fa640 1 -- 172.21.15.164:0/2434823887 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7feedc09cca0 con 0x5647446f97c0 2024-09-13T23:05:31.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.439+0000 7feee8635640 1 --2- 172.21.15.164:0/2434823887 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fedb0036b40 0x7fedb0039000 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feee000f010 tx=0x7feee000c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.439+0000 7feeec13e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.439+0000 7feeec13e800 1 --2- 172.21.15.164:0/2434823887 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x56474470c7d0 0x56474470ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.439+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56474470f3e0 con 0x56474470c7d0 2024-09-13T23:05:31.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.439+0000 7feee7e34640 1 --2- 172.21.15.164:0/2434823887 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x56474470c7d0 0x56474470ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.439+0000 7feee7e34640 1 --2- 172.21.15.164:0/2434823887 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x56474470c7d0 0x56474470ec90 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.440+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feed802f070 con 0x56474470c7d0 2024-09-13T23:05:31.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.440+0000 7feeec13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.440+0000 7feeec13e800 20 realm 2024-09-13T23:05:31.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.440+0000 7feeec13e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.440+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56474470f7f0 con 0x56474470c7d0 2024-09-13T23:05:31.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.440+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feed802f070 con 0x56474470c7d0 2024-09-13T23:05:31.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.440+0000 7feeec13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.440+0000 7feeec13e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:31.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.440+0000 7feeec13e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.440+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5647447100c0 con 0x56474470c7d0 2024-09-13T23:05:31.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.440+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feed802f070 con 0x56474470c7d0 2024-09-13T23:05:31.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.440+0000 7feeec13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.440+0000 7feeec13e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.440+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564744710460 con 0x56474470c7d0 2024-09-13T23:05:31.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.440+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feed802f070 con 0x56474470c7d0 2024-09-13T23:05:31.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.440+0000 7feeec13e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:31.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.440+0000 7feeec13e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.440+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564744710cb0 con 0x56474470c7d0 2024-09-13T23:05:31.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.441+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7feed802f070 con 0x56474470c7d0 2024-09-13T23:05:31.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.441+0000 7feeec13e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:31.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.441+0000 7feeec13e800 20 searching for the correct realm 2024-09-13T23:05:31.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.441+0000 7feeec13e800 1 --2- 172.21.15.164:0/2434823887 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x564744712a20 0x564744714e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.441+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x564744712a20 2024-09-13T23:05:31.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.441+0000 7feee7633640 1 --2- 172.21.15.164:0/2434823887 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x564744712a20 0x564744714e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.441+0000 7feee7633640 1 --2- 172.21.15.164:0/2434823887 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x564744712a20 0x564744714e10 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.441+0000 7feee7633640 1 -- 172.21.15.164:0/2434823887 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feedc08bd70 con 0x564744712a20 2024-09-13T23:05:31.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.441+0000 7feee7633640 1 --2- 172.21.15.164:0/2434823887 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7feedc05f040 0x7feedc0699e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.441+0000 7feee7633640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x7feedc05f040 2024-09-13T23:05:31.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.441+0000 7feee8635640 1 --2- 172.21.15.164:0/2434823887 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7feedc05f040 0x7feedc0699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.442+0000 7feee8635640 1 --2- 172.21.15.164:0/2434823887 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7feedc05f040 0x7feedc0699e0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.442+0000 7feee8635640 1 -- 172.21.15.164:0/2434823887 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee002f040 con 0x7feedc05f040 2024-09-13T23:05:31.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.442+0000 7feee8635640 1 --2- 172.21.15.164:0/2434823887 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7feee0019040 0x7feee00328d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.442+0000 7feee8635640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x7feee0019040 2024-09-13T23:05:31.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.442+0000 7feee7e34640 1 --2- 172.21.15.164:0/2434823887 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7feee0019040 0x7feee00328d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.442+0000 7feee7e34640 1 --2- 172.21.15.164:0/2434823887 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7feee0019040 0x7feee00328d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.443+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feed802f070 con 0x7feee0019040 2024-09-13T23:05:31.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.443+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x56474470c7d0 2024-09-13T23:05:31.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.443+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7feed802f070 con 0x56474470c7d0 2024-09-13T23:05:31.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.443+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x56474470c7d0 2024-09-13T23:05:31.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.443+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feed802f070 con 0x56474470c7d0 2024-09-13T23:05:31.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.443+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x7feee0019040 2024-09-13T23:05:31.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.443+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feed802f070 con 0x7feee0019040 2024-09-13T23:05:31.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.443+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x7feee0019040 2024-09-13T23:05:31.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.444+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feed802f070 con 0x7feee0019040 2024-09-13T23:05:31.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.444+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x7feedc05f040 2024-09-13T23:05:31.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.444+0000 7feee8635640 1 -- 172.21.15.164:0/2434823887 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee002f040 con 0x7feedc05f040 2024-09-13T23:05:31.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.444+0000 7feee8635640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x564744712a20 2024-09-13T23:05:31.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.444+0000 7feee7633640 1 -- 172.21.15.164:0/2434823887 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feedc08bd70 con 0x564744712a20 2024-09-13T23:05:31.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.444+0000 7feee7633640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x56474470c7d0 2024-09-13T23:05:31.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.444+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feed802f070 con 0x56474470c7d0 2024-09-13T23:05:31.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.444+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x7feee0019040 2024-09-13T23:05:31.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.445+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feed802f070 con 0x7feee0019040 2024-09-13T23:05:31.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.445+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x56474470c7d0 2024-09-13T23:05:31.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.445+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feed802f070 con 0x56474470c7d0 2024-09-13T23:05:31.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.445+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x7feedc05f040 2024-09-13T23:05:31.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.445+0000 7feee8635640 1 -- 172.21.15.164:0/2434823887 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7feee002f040 con 0x7feedc05f040 2024-09-13T23:05:31.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.445+0000 7feee8635640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x564744712a20 2024-09-13T23:05:31.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.445+0000 7feee7633640 1 -- 172.21.15.164:0/2434823887 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feedc08bd70 con 0x564744712a20 2024-09-13T23:05:31.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.445+0000 7feee7633640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x564744712a20 2024-09-13T23:05:31.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.445+0000 7feee7633640 1 -- 172.21.15.164:0/2434823887 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feedc08bd70 con 0x564744712a20 2024-09-13T23:05:31.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.445+0000 7feee7633640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x7feee0019040 2024-09-13T23:05:31.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.446+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feed802f070 con 0x7feee0019040 2024-09-13T23:05:31.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.446+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x564744712a20 2024-09-13T23:05:31.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.446+0000 7feee7633640 1 -- 172.21.15.164:0/2434823887 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feedc08bd70 con 0x564744712a20 2024-09-13T23:05:31.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.446+0000 7feee7633640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x564744712a20 2024-09-13T23:05:31.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.446+0000 7feee7633640 1 -- 172.21.15.164:0/2434823887 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feedc08bd70 con 0x564744712a20 2024-09-13T23:05:31.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.446+0000 7feee7633640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x56474470c7d0 2024-09-13T23:05:31.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.446+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feed802f070 con 0x56474470c7d0 2024-09-13T23:05:31.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.446+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x56474470c7d0 2024-09-13T23:05:31.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.447+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7feed802f070 con 0x56474470c7d0 2024-09-13T23:05:31.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.447+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x7feee0019040 2024-09-13T23:05:31.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.447+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feed802f070 con 0x7feee0019040 2024-09-13T23:05:31.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.447+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x564744712a20 2024-09-13T23:05:31.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.447+0000 7feee7633640 1 -- 172.21.15.164:0/2434823887 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feedc08bd70 con 0x564744712a20 2024-09-13T23:05:31.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.447+0000 7feee7633640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x7feedc05f040 2024-09-13T23:05:31.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.447+0000 7feee8635640 1 -- 172.21.15.164:0/2434823887 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee002f040 con 0x7feedc05f040 2024-09-13T23:05:31.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.447+0000 7feee8635640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x56474470c7d0 2024-09-13T23:05:31.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.448+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7feed802f070 con 0x56474470c7d0 2024-09-13T23:05:31.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.448+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x7feee0019040 2024-09-13T23:05:31.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.448+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feed802f070 con 0x7feee0019040 2024-09-13T23:05:31.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.448+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x564744712a20 2024-09-13T23:05:31.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.448+0000 7feee7633640 1 -- 172.21.15.164:0/2434823887 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feedc08bd70 con 0x564744712a20 2024-09-13T23:05:31.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.448+0000 7feee7633640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x7feee0019040 2024-09-13T23:05:31.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.448+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feed802f070 con 0x7feee0019040 2024-09-13T23:05:31.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.448+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x7feedc05f040 2024-09-13T23:05:31.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.449+0000 7feee8635640 1 -- 172.21.15.164:0/2434823887 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee002f040 con 0x7feedc05f040 2024-09-13T23:05:31.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.449+0000 7feee8635640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x564744712a20 2024-09-13T23:05:31.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.449+0000 7feee7633640 1 -- 172.21.15.164:0/2434823887 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feedc08bd70 con 0x564744712a20 2024-09-13T23:05:31.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.449+0000 7feee7633640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x7feee0019040 2024-09-13T23:05:31.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.449+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feed802f070 con 0x7feee0019040 2024-09-13T23:05:31.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.449+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x56474470c7d0 2024-09-13T23:05:31.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.449+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7feed802f070 con 0x56474470c7d0 2024-09-13T23:05:31.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.449+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647447153f0 con 0x7feedc05f040 2024-09-13T23:05:31.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.450+0000 7feee8635640 1 -- 172.21.15.164:0/2434823887 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee002f040 con 0x7feedc05f040 2024-09-13T23:05:31.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.450+0000 7feeec13e800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:31.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.450+0000 7feeec13e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:31.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.450+0000 7feeec13e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:31.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.450+0000 7feeec13e800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:31.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.450+0000 7feeec13e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:31.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.450+0000 7feeec13e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:31.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.450+0000 7feeec13e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.450+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564744711660 con 0x56474470c7d0 2024-09-13T23:05:31.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.450+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feed802f070 con 0x56474470c7d0 2024-09-13T23:05:31.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.450+0000 7feeec13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.450+0000 7feeec13e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.450+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564744711f00 con 0x56474470c7d0 2024-09-13T23:05:31.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.450+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feed802f070 con 0x56474470c7d0 2024-09-13T23:05:31.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.450+0000 7feeec13e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:31.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.450+0000 7feeec13e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.450+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564744715870 con 0x56474470c7d0 2024-09-13T23:05:31.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.450+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7feed802f070 con 0x56474470c7d0 2024-09-13T23:05:31.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.450+0000 7feeec13e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:31.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.451+0000 7feeec13e800 20 zone default found 2024-09-13T23:05:31.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.451+0000 7feeec13e800 4 Realm: () 2024-09-13T23:05:31.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.451+0000 7feeec13e800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:31.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.451+0000 7feeec13e800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:31.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.451+0000 7feeec13e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:31.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.451+0000 7feeec13e800 20 zonegroup default 2024-09-13T23:05:31.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.451+0000 7feeec13e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.451+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564744715d20 con 0x7feee0019040 2024-09-13T23:05:31.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.451+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7feed802f070 con 0x7feee0019040 2024-09-13T23:05:31.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.451+0000 7feeec13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.451+0000 7feeec13e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.451+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564744717700 con 0x564744712a20 2024-09-13T23:05:31.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.451+0000 7feee7633640 1 -- 172.21.15.164:0/2434823887 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feedc08bd70 con 0x564744712a20 2024-09-13T23:05:31.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.451+0000 7feeec13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.451+0000 7feeec13e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.451+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564744717b70 con 0x564744712a20 2024-09-13T23:05:31.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.451+0000 7feee7633640 1 -- 172.21.15.164:0/2434823887 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feedc08bd70 con 0x564744712a20 2024-09-13T23:05:31.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.451+0000 7feeec13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.451+0000 7feeec13e800 20 started sync module instance, tier type = 2024-09-13T23:05:31.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.451+0000 7feeec13e800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:31.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.451+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564744716b90 con 0x7feedc05f040 2024-09-13T23:05:31.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.452+0000 7feee8635640 1 -- 172.21.15.164:0/2434823887 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee002f040 con 0x7feedc05f040 2024-09-13T23:05:31.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.452+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94864090951856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564744716b90 con 0x7feedc05f040 2024-09-13T23:05:31.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.452+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647447185f0 con 0x56474470c7d0 2024-09-13T23:05:31.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.453+0000 7feee8635640 1 -- 172.21.15.164:0/2434823887 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94864090951856] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee002f040 con 0x7feedc05f040 2024-09-13T23:05:31.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.454+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feed802f070 con 0x56474470c7d0 2024-09-13T23:05:31.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.454+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94864090956576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564744716b90 con 0x56474470c7d0 2024-09-13T23:05:31.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.454+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564744719070 con 0x564744712a20 2024-09-13T23:05:31.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.455+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94864090956576] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feed802f070 con 0x56474470c7d0 2024-09-13T23:05:31.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.455+0000 7feee7633640 1 -- 172.21.15.164:0/2434823887 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feedc08bd70 con 0x564744712a20 2024-09-13T23:05:31.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.455+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94864090949344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564744716b00 con 0x564744712a20 2024-09-13T23:05:31.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.455+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564744719e60 con 0x7feedc05f040 2024-09-13T23:05:31.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.456+0000 7feee8635640 1 -- 172.21.15.164:0/2434823887 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee002f040 con 0x7feedc05f040 2024-09-13T23:05:31.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.456+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94864090962240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56474471a700 con 0x7feedc05f040 2024-09-13T23:05:31.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.456+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56474471b1c0 con 0x56474470c7d0 2024-09-13T23:05:31.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.456+0000 7feee7633640 1 -- 172.21.15.164:0/2434823887 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94864090949344] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feedc08bd70 con 0x564744712a20 2024-09-13T23:05:31.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.457+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feed802f070 con 0x56474470c7d0 2024-09-13T23:05:31.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.457+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94864090967280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56474471b1c0 con 0x56474470c7d0 2024-09-13T23:05:31.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.457+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56474471bc40 con 0x7feee0019040 2024-09-13T23:05:31.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.457+0000 7feee8635640 1 -- 172.21.15.164:0/2434823887 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94864090962240] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee002f040 con 0x7feedc05f040 2024-09-13T23:05:31.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.458+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feed802f070 con 0x7feee0019040 2024-09-13T23:05:31.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.458+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94864090964560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56474471bc00 con 0x7feee0019040 2024-09-13T23:05:31.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.458+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56474471c650 con 0x7feee0019040 2024-09-13T23:05:31.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.458+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94864090967280] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feed802f070 con 0x56474470c7d0 2024-09-13T23:05:31.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.459+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feed802f070 con 0x7feee0019040 2024-09-13T23:05:31.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.459+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94864090964560] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feed802f070 con 0x7feee0019040 2024-09-13T23:05:31.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.459+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94864090961040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56474471c650 con 0x7feee0019040 2024-09-13T23:05:31.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.459+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56474471b750 con 0x7feee0019040 2024-09-13T23:05:31.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.460+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feed802f070 con 0x7feee0019040 2024-09-13T23:05:31.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.460+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94864090961040] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feed802f070 con 0x7feee0019040 2024-09-13T23:05:31.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.460+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94864090969936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56474471cb60 con 0x7feee0019040 2024-09-13T23:05:31.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.460+0000 7feeec13e800 20 add_watcher() i=0 2024-09-13T23:05:31.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.460+0000 7feeec13e800 20 add_watcher() i=1 2024-09-13T23:05:31.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.460+0000 7feeec13e800 20 add_watcher() i=2 2024-09-13T23:05:31.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.460+0000 7feeec13e800 20 add_watcher() i=3 2024-09-13T23:05:31.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.460+0000 7feeec13e800 20 add_watcher() i=4 2024-09-13T23:05:31.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.460+0000 7feeec13e800 20 add_watcher() i=5 2024-09-13T23:05:31.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.460+0000 7feeec13e800 20 add_watcher() i=6 2024-09-13T23:05:31.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.463+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94864090969936] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feed802f070 con 0x7feee0019040 2024-09-13T23:05:31.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.463+0000 7feeec13e800 20 add_watcher() i=7 2024-09-13T23:05:31.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.463+0000 7feeec13e800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:31.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.463+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564744720040 con 0x56474470c7d0 2024-09-13T23:05:31.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.464+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7feed802f070 con 0x56474470c7d0 2024-09-13T23:05:31.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.464+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94864090975072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56474471d430 con 0x56474470c7d0 2024-09-13T23:05:31.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.465+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94864090975072] v32'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feed802f070 con 0x56474470c7d0 2024-09-13T23:05:31.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.465+0000 7fed9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:31.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.465+0000 7feeec13e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:31.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.465+0000 7feeec13e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:31.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.465+0000 7feeec13e800 5 note: GC not initialized 2024-09-13T23:05:31.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.465+0000 7fed9cfe1640 20 reqs_thread_entry: start 2024-09-13T23:05:31.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.465+0000 7feeec13e800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:31.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.465+0000 7feeec13e800 20 Filter name: none 2024-09-13T23:05:31.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.465+0000 7fed167fc640 20 reqs_thread_entry: start 2024-09-13T23:05:31.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.465+0000 7feeec13e800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T23:05:31.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.465+0000 7feeec13e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.465+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564744753320 con 0x7feee0019040 2024-09-13T23:05:31.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.466+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7feed802f070 con 0x7feee0019040 2024-09-13T23:05:31.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.466+0000 7feeec13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.466+0000 7feeec13e800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T23:05:31.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.466+0000 7feeec13e800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:05:31.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.466+0000 7feeec13e800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-13T23:05:31.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.466+0000 7feeec13e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.466+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564744751960 con 0x56474470c7d0 2024-09-13T23:05:31.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.466+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7feed802f070 con 0x56474470c7d0 2024-09-13T23:05:31.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.466+0000 7feeec13e800 20 rados_obj.operate() r=0 bl.length=7 2024-09-13T23:05:31.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.466+0000 7feeec13e800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-13T23:05:31.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.466+0000 7feeec13e800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T23:05:31.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.466+0000 7feeec13e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:05:31.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.466+0000 7feeec13e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.466+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564744751d50 con 0x56474470c7d0 2024-09-13T23:05:31.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.466+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7feed802f070 con 0x56474470c7d0 2024-09-13T23:05:31.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.466+0000 7feeec13e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:05:31.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.467+0000 7feeec13e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:05:31.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.467+0000 7feeec13e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:31.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.467+0000 7feeec13e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:31.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.467+0000 7feeec13e800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-13T23:05:31.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.467+0000 7feeec13e800 20 get_user_info_from_index found 0 xattrs 2024-09-13T23:05:31.493 INFO:teuthology.orchestra.run.smithi164.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-13T23:05:31.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.467+0000 7fed9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:31.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.467+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94864090975072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564744709410 con 0x56474470c7d0 2024-09-13T23:05:31.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.468+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94864090975072] v32'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feed802f070 con 0x56474470c7d0 2024-09-13T23:05:31.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.468+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94864090951856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564744751090 con 0x7feedc05f040 2024-09-13T23:05:31.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.469+0000 7feee8635640 1 -- 172.21.15.164:0/2434823887 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94864090951856] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee002f040 con 0x7feedc05f040 2024-09-13T23:05:31.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.469+0000 7feeec13e800 20 remove_watcher() i=0 2024-09-13T23:05:31.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.469+0000 7feeec13e800 2 removed watcher, disabling cache 2024-09-13T23:05:31.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.469+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94864090956576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564744751090 con 0x56474470c7d0 2024-09-13T23:05:31.504 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-13T23:05:31.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.471+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94864090956576] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feed802f070 con 0x56474470c7d0 2024-09-13T23:05:31.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.471+0000 7feeec13e800 20 remove_watcher() i=1 2024-09-13T23:05:31.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.471+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94864090949344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564744751090 con 0x564744712a20 2024-09-13T23:05:31.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.472+0000 7feee7633640 1 -- 172.21.15.164:0/2434823887 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94864090949344] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feedc08bd70 con 0x564744712a20 2024-09-13T23:05:31.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.472+0000 7feeec13e800 20 remove_watcher() i=2 2024-09-13T23:05:31.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.472+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94864090962240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564744718320 con 0x7feedc05f040 2024-09-13T23:05:31.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.473+0000 7feee8635640 1 -- 172.21.15.164:0/2434823887 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94864090962240] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee002f040 con 0x7feedc05f040 2024-09-13T23:05:31.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.473+0000 7feeec13e800 20 remove_watcher() i=3 2024-09-13T23:05:31.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.473+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94864090967280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647447166e0 con 0x56474470c7d0 2024-09-13T23:05:31.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.474+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94864090967280] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feed802f070 con 0x56474470c7d0 2024-09-13T23:05:31.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.474+0000 7feeec13e800 20 remove_watcher() i=4 2024-09-13T23:05:31.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.474+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94864090964560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564744719940 con 0x7feee0019040 2024-09-13T23:05:31.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.475+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94864090964560] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feed802f070 con 0x7feee0019040 2024-09-13T23:05:31.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.475+0000 7feeec13e800 20 remove_watcher() i=5 2024-09-13T23:05:31.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.475+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94864090961040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564744718320 con 0x7feee0019040 2024-09-13T23:05:31.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.476+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94864090961040] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feed802f070 con 0x7feee0019040 2024-09-13T23:05:31.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.476+0000 7feeec13e800 20 remove_watcher() i=6 2024-09-13T23:05:31.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.476+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94864090969936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647447166e0 con 0x7feee0019040 2024-09-13T23:05:31.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.477+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94864090969936] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feed802f070 con 0x7feee0019040 2024-09-13T23:05:31.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.477+0000 7feeec13e800 20 remove_watcher() i=7 2024-09-13T23:05:31.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.477+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7feee0019040 msgr2=0x7feee00328d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.477+0000 7feeec13e800 1 --2- 172.21.15.164:0/2434823887 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7feee0019040 0x7feee00328d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.477+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x56474470c7d0 msgr2=0x56474470ec90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.477+0000 7feeec13e800 1 --2- 172.21.15.164:0/2434823887 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x56474470c7d0 0x56474470ec90 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.477+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7feedc05f040 msgr2=0x7feedc0699e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.477+0000 7feeec13e800 1 --2- 172.21.15.164:0/2434823887 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7feedc05f040 0x7feedc0699e0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.477+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x564744712a20 msgr2=0x564744714e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.477+0000 7feeec13e800 1 --2- 172.21.15.164:0/2434823887 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x564744712a20 0x564744714e10 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.477+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fedb0036b40 msgr2=0x7fedb0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.477+0000 7feeec13e800 1 --2- 172.21.15.164:0/2434823887 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fedb0036b40 0x7fedb0039000 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feee000f010 tx=0x7feee000c040 comp rx=0 tx=0).stop 2024-09-13T23:05:31.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.477+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647446f97c0 msgr2=0x564744700c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.477+0000 7feeec13e800 1 --2- 172.21.15.164:0/2434823887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647446f97c0 0x564744700c60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7feedc069740 tx=0x7feedc090f00 comp rx=0 tx=0).stop 2024-09-13T23:05:31.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.477+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 reap_dead start 2024-09-13T23:05:31.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.477+0000 7feee7e34640 1 -- 172.21.15.164:0/2434823887 reap_dead start 2024-09-13T23:05:31.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.477+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 shutdown_connections 2024-09-13T23:05:31.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.477+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 >> 172.21.15.164:0/2434823887 conn(0x5647446f5b20 msgr2=0x5647446f3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.477+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 shutdown_connections 2024-09-13T23:05:31.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.477+0000 7feeec13e800 1 -- 172.21.15.164:0/2434823887 wait complete. 2024-09-13T23:05:31.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.478+0000 7feeec13e800 1 -- 172.21.15.164:0/2508727877 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fedc0036b90 msgr2=0x7fedc0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.478+0000 7feeec13e800 1 --2- 172.21.15.164:0/2508727877 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fedc0036b90 0x7fedc0039050 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x5647446d8e90 tx=0x7feee0000f90 comp rx=0 tx=0).stop 2024-09-13T23:05:31.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.478+0000 7feeec13e800 1 -- 172.21.15.164:0/2508727877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647446ecc20 msgr2=0x5647446ed040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.478+0000 7feeec13e800 1 --2- 172.21.15.164:0/2508727877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647446ecc20 0x5647446ed040 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7feedc025bf0 tx=0x7feedc002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.478+0000 7feeec13e800 1 -- 172.21.15.164:0/2508727877 shutdown_connections 2024-09-13T23:05:31.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.478+0000 7feeec13e800 1 --2- 172.21.15.164:0/2508727877 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fedc0036b90 0x7fedc0039050 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.478+0000 7feeec13e800 1 --2- 172.21.15.164:0/2508727877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647446ecc20 0x5647446ed040 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.478+0000 7feeec13e800 1 -- 172.21.15.164:0/2508727877 >> 172.21.15.164:0/2508727877 conn(0x5647446dd7a0 msgr2=0x5647446e0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.478+0000 7feeec13e800 1 -- 172.21.15.164:0/2508727877 shutdown_connections 2024-09-13T23:05:31.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.478+0000 7feeec13e800 1 -- 172.21.15.164:0/2508727877 wait complete. 2024-09-13T23:05:31.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.478+0000 7feeec13e800 1 -- 172.21.15.164:0/3846580622 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5647445df920 msgr2=0x5647446d7e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.478+0000 7feeec13e800 1 --2- 172.21.15.164:0/3846580622 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5647445df920 0x5647446d7e40 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.478+0000 7feeec13e800 1 -- 172.21.15.164:0/3846580622 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fedd0036b90 msgr2=0x7fedd0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.478+0000 7feeec13e800 1 --2- 172.21.15.164:0/3846580622 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fedd0036b90 0x7fedd0039050 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feedc057000 tx=0x7feedc052000 comp rx=0 tx=0).stop 2024-09-13T23:05:31.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.478+0000 7feeec13e800 1 -- 172.21.15.164:0/3846580622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647445db4e0 msgr2=0x5647446d0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.478+0000 7feeec13e800 1 --2- 172.21.15.164:0/3846580622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647445db4e0 0x5647446d0ea0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feed8001330 tx=0x7feed8001250 comp rx=0 tx=0).stop 2024-09-13T23:05:31.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.478+0000 7feeec13e800 1 -- 172.21.15.164:0/3846580622 shutdown_connections 2024-09-13T23:05:31.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.478+0000 7feeec13e800 1 --2- 172.21.15.164:0/3846580622 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5647445df920 0x5647446d7e40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.478+0000 7feeec13e800 1 --2- 172.21.15.164:0/3846580622 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fedd0036b90 0x7fedd0039050 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.478+0000 7feeec13e800 1 --2- 172.21.15.164:0/3846580622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647445db4e0 0x5647446d0ea0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.478+0000 7feeec13e800 1 -- 172.21.15.164:0/3846580622 >> 172.21.15.164:0/3846580622 conn(0x5647445d6e10 msgr2=0x5647446c4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.478+0000 7feeec13e800 1 -- 172.21.15.164:0/3846580622 shutdown_connections 2024-09-13T23:05:31.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.478+0000 7feeec13e800 1 -- 172.21.15.164:0/3846580622 wait complete. 2024-09-13T23:05:31.511 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T23:05:31.511 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T23:05:31.511 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T23:05:31.555 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:31.556 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:31.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.556+0000 7f8acdc0e800 1 Processor -- start 2024-09-13T23:05:31.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.556+0000 7f8acdc0e800 1 -- start start 2024-09-13T23:05:31.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.556+0000 7f8acdc0e800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55669e1f65f0 0x55669e287690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.556+0000 7f8acdc0e800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55669e141b30 con 0x55669e287bd0 2024-09-13T23:05:31.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.556+0000 7f8acdc0e800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55669e123360 con 0x55669e1f65f0 2024-09-13T23:05:31.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.556+0000 7f8ac9375640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55669e1f65f0 0x55669e287690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.556+0000 7f8ac8b74640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55669e287bd0 0x55669e289fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40740/0 (socket says 172.21.15.164:40740) 2024-09-13T23:05:31.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.557+0000 7f8ac8b74640 1 -- 172.21.15.164:0/1834668745 learned_addr learned my addr 172.21.15.164:0/1834668745 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:31.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.557+0000 7f8abbfff640 1 -- 172.21.15.164:0/1834668745 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 297891476 0 0) 0x55669e141b30 con 0x55669e287bd0 2024-09-13T23:05:31.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.557+0000 7f8abbfff640 1 -- 172.21.15.164:0/1834668745 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ab4001e10 con 0x55669e287bd0 2024-09-13T23:05:31.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.557+0000 7f8ac9375640 1 -- 172.21.15.164:0/1834668745 >> v1:172.21.15.17:6789/0 conn(0x55669e287bd0 legacy=0x55669e289fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.557+0000 7f8ac9375640 1 -- 172.21.15.164:0/1834668745 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55669e149e00 con 0x55669e1f65f0 2024-09-13T23:05:31.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.559+0000 7f8ac9375640 1 --2- 172.21.15.164:0/1834668745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e1f65f0 0x55669e287690 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8abc00a470 tx=0x7f8abc045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f177a2da84eeac7b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.559+0000 7f8abbfff640 1 -- 172.21.15.164:0/1834668745 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8abc059070 con 0x55669e1f65f0 2024-09-13T23:05:31.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.559+0000 7f8abbfff640 1 -- 172.21.15.164:0/1834668745 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8abc054570 con 0x55669e1f65f0 2024-09-13T23:05:31.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.559+0000 7f8abbfff640 1 -- 172.21.15.164:0/1834668745 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8abc054870 con 0x55669e1f65f0 2024-09-13T23:05:31.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.559+0000 7f8acdc0e800 1 -- 172.21.15.164:0/1834668745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e1f65f0 msgr2=0x55669e287690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.559+0000 7f8acdc0e800 1 --2- 172.21.15.164:0/1834668745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e1f65f0 0x55669e287690 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8abc00a470 tx=0x7f8abc045920 comp rx=0 tx=0).stop 2024-09-13T23:05:31.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.559+0000 7f8acdc0e800 1 -- 172.21.15.164:0/1834668745 shutdown_connections 2024-09-13T23:05:31.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.559+0000 7f8acdc0e800 1 --2- 172.21.15.164:0/1834668745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e1f65f0 0x55669e287690 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.559+0000 7f8acdc0e800 1 -- 172.21.15.164:0/1834668745 >> 172.21.15.164:0/1834668745 conn(0x55669e27cde0 msgr2=0x55669e27f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.559+0000 7f8acdc0e800 1 -- 172.21.15.164:0/1834668745 shutdown_connections 2024-09-13T23:05:31.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.559+0000 7f8acdc0e800 1 -- 172.21.15.164:0/1834668745 wait complete. 2024-09-13T23:05:31.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.573+0000 7f8acdc0e800 1 Processor -- start 2024-09-13T23:05:31.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.573+0000 7f8acdc0e800 1 -- start start 2024-09-13T23:05:31.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.574+0000 7f8acdc0e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e1f65f0 0x55669e3738b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.574+0000 7f8acdc0e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55669e1ce330 con 0x55669e1f65f0 2024-09-13T23:05:31.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.574+0000 7f8ac9375640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e1f65f0 0x55669e3738b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.574+0000 7f8ac9375640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e1f65f0 0x55669e3738b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56314/0 (socket says 172.21.15.164:56314) 2024-09-13T23:05:31.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.574+0000 7f8ac9375640 1 -- 172.21.15.164:0/1100433293 learned_addr learned my addr 172.21.15.164:0/1100433293 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.574+0000 7f8ac9375640 1 -- 172.21.15.164:0/1100433293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55669e11bbc0 con 0x55669e1f65f0 2024-09-13T23:05:31.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.574+0000 7f8ac9375640 1 --2- 172.21.15.164:0/1100433293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e1f65f0 0x55669e3738b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8abc025b20 tx=0x7f8abc04e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb9ee8fd0d40e6a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.575+0000 7f89b7606640 1 -- 172.21.15.164:0/1100433293 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8abc062070 con 0x55669e1f65f0 2024-09-13T23:05:31.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.575+0000 7f89b7606640 1 -- 172.21.15.164:0/1100433293 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8abc00a170 con 0x55669e1f65f0 2024-09-13T23:05:31.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.575+0000 7f89b7606640 1 -- 172.21.15.164:0/1100433293 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8abc059040 con 0x55669e1f65f0 2024-09-13T23:05:31.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.575+0000 7f8acdc0e800 1 -- 172.21.15.164:0/1100433293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e1f65f0 msgr2=0x55669e3738b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.575+0000 7f8acdc0e800 1 --2- 172.21.15.164:0/1100433293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e1f65f0 0x55669e3738b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8abc025b20 tx=0x7f8abc04e000 comp rx=0 tx=0).stop 2024-09-13T23:05:31.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.576+0000 7f8acdc0e800 1 -- 172.21.15.164:0/1100433293 shutdown_connections 2024-09-13T23:05:31.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.576+0000 7f8acdc0e800 1 --2- 172.21.15.164:0/1100433293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e1f65f0 0x55669e3738b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.576+0000 7f8acdc0e800 1 -- 172.21.15.164:0/1100433293 >> 172.21.15.164:0/1100433293 conn(0x55669e27cde0 msgr2=0x55669e36f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.576+0000 7f8acdc0e800 1 -- 172.21.15.164:0/1100433293 shutdown_connections 2024-09-13T23:05:31.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.576+0000 7f8acdc0e800 1 -- 172.21.15.164:0/1100433293 wait complete. 2024-09-13T23:05:31.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.576+0000 7f8acdc0e800 1 Processor -- start 2024-09-13T23:05:31.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.576+0000 7f8acdc0e800 1 -- start start 2024-09-13T23:05:31.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.576+0000 7f8acdc0e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e287bd0 0x55669e37b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.576+0000 7f8acdc0e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55669e28b980 con 0x55669e287bd0 2024-09-13T23:05:31.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.576+0000 7f8ac9375640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e287bd0 0x55669e37b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.576+0000 7f8ac9375640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e287bd0 0x55669e37b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56328/0 (socket says 172.21.15.164:56328) 2024-09-13T23:05:31.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.576+0000 7f8ac9375640 1 -- 172.21.15.164:0/601732519 learned_addr learned my addr 172.21.15.164:0/601732519 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.577+0000 7f8ac9375640 1 -- 172.21.15.164:0/601732519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55669e12ffe0 con 0x55669e287bd0 2024-09-13T23:05:31.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.577+0000 7f8ac9375640 1 --2- 172.21.15.164:0/601732519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e287bd0 0x55669e37b310 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8abc025b20 tx=0x7f8abc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.577+0000 7f89b5e03640 1 -- 172.21.15.164:0/601732519 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8abc06b020 con 0x55669e287bd0 2024-09-13T23:05:31.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.577+0000 7f89b5e03640 1 -- 172.21.15.164:0/601732519 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8abc054ad0 con 0x55669e287bd0 2024-09-13T23:05:31.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.577+0000 7f89b5e03640 1 -- 172.21.15.164:0/601732519 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8abc059070 con 0x55669e287bd0 2024-09-13T23:05:31.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.577+0000 7f8acdc0e800 1 -- 172.21.15.164:0/601732519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55669e37b850 con 0x55669e287bd0 2024-09-13T23:05:31.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.577+0000 7f8acdc0e800 1 -- 172.21.15.164:0/601732519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55669e37bd70 con 0x55669e287bd0 2024-09-13T23:05:31.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.578+0000 7f89b5e03640 1 -- 172.21.15.164:0/601732519 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8abc06e020 con 0x55669e287bd0 2024-09-13T23:05:31.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.578+0000 7f89b5e03640 1 --2- 172.21.15.164:0/601732519 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f89b0036b90 0x7f89b0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.578+0000 7f89b5e03640 1 -- 172.21.15.164:0/601732519 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8abc08f780 con 0x55669e287bd0 2024-09-13T23:05:31.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.578+0000 7f8ac8b74640 1 --2- 172.21.15.164:0/601732519 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f89b0036b90 0x7f89b0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.579+0000 7f8acdc0e800 1 --2- 172.21.15.164:0/601732519 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55669e380200 0x55669e382650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.579+0000 7f8acdc0e800 1 -- 172.21.15.164:0/601732519 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55669e382c70 con 0x55669e380200 2024-09-13T23:05:31.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.579+0000 7f8ac9b76640 1 --2- 172.21.15.164:0/601732519 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55669e380200 0x55669e382650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.579+0000 7f8ac8b74640 1 --2- 172.21.15.164:0/601732519 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f89b0036b90 0x7f89b0039050 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0000f60 tx=0x7f8ac00010a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.579+0000 7f8ac9b76640 1 --2- 172.21.15.164:0/601732519 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55669e380200 0x55669e382650 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.579+0000 7f8ac9b76640 1 -- 172.21.15.164:0/601732519 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ac400a4a0 con 0x55669e380200 2024-09-13T23:05:31.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.579+0000 7f8acdc0e800 1 -- 172.21.15.164:0/601732519 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55669e37f930 con 0x55669e380200 2024-09-13T23:05:31.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.580+0000 7f8ac9b76640 1 -- 172.21.15.164:0/601732519 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8ac400a4a0 con 0x55669e380200 2024-09-13T23:05:31.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.580+0000 7f8acdc0e800 1 -- 172.21.15.164:0/601732519 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55669e384a90 con 0x55669e380200 2024-09-13T23:05:31.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.580+0000 7f8ac9b76640 1 -- 172.21.15.164:0/601732519 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8ac400a4a0 con 0x55669e380200 2024-09-13T23:05:31.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.580+0000 7f8acdc0e800 1 -- 172.21.15.164:0/601732519 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55669e383bd0 con 0x55669e380200 2024-09-13T23:05:31.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.580+0000 7f8ac9b76640 1 -- 172.21.15.164:0/601732519 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8ac400a4a0 con 0x55669e380200 2024-09-13T23:05:31.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.580+0000 7f8acdc0e800 1 -- 172.21.15.164:0/601732519 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55669e383ff0 con 0x55669e380200 2024-09-13T23:05:31.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.580+0000 7f8ac9b76640 1 -- 172.21.15.164:0/601732519 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8ac400a4a0 con 0x55669e380200 2024-09-13T23:05:31.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.581+0000 7f8acdc0e800 1 Processor -- start 2024-09-13T23:05:31.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.581+0000 7f8acdc0e800 1 -- start start 2024-09-13T23:05:31.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.581+0000 7f8acdc0e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e3930c0 0x55669e3934e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.581+0000 7f8acdc0e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55669e11d580 con 0x55669e3930c0 2024-09-13T23:05:31.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.581+0000 7f8ac8b74640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e3930c0 0x55669e3934e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.581+0000 7f8ac8b74640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e3930c0 0x55669e3934e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56344/0 (socket says 172.21.15.164:56344) 2024-09-13T23:05:31.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.581+0000 7f8ac8b74640 1 -- 172.21.15.164:0/726216130 learned_addr learned my addr 172.21.15.164:0/726216130 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.582+0000 7f8ac8b74640 1 -- 172.21.15.164:0/726216130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55669e393a20 con 0x55669e3930c0 2024-09-13T23:05:31.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.582+0000 7f8ac8b74640 1 --2- 172.21.15.164:0/726216130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e3930c0 0x55669e3934e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000bec0 tx=0x7f8ac000d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.582+0000 7f89aeffd640 1 -- 172.21.15.164:0/726216130 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ac001b550 con 0x55669e3930c0 2024-09-13T23:05:31.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.582+0000 7f89aeffd640 1 -- 172.21.15.164:0/726216130 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ac001b6f0 con 0x55669e3930c0 2024-09-13T23:05:31.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.582+0000 7f8acdc0e800 1 -- 172.21.15.164:0/726216130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55669e393cb0 con 0x55669e3930c0 2024-09-13T23:05:31.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.582+0000 7f89aeffd640 1 -- 172.21.15.164:0/726216130 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ac001ba10 con 0x55669e3930c0 2024-09-13T23:05:31.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.582+0000 7f8acdc0e800 1 -- 172.21.15.164:0/726216130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55669e396990 con 0x55669e3930c0 2024-09-13T23:05:31.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.583+0000 7f89aeffd640 1 -- 172.21.15.164:0/726216130 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8ac0023020 con 0x55669e3930c0 2024-09-13T23:05:31.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.583+0000 7f89aeffd640 1 --2- 172.21.15.164:0/726216130 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f89a4036b40 0x7f89a4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.583+0000 7f89aeffd640 1 -- 172.21.15.164:0/726216130 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8ac0021020 con 0x55669e3930c0 2024-09-13T23:05:31.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.583+0000 7f8ac9b76640 1 --2- 172.21.15.164:0/726216130 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f89a4036b40 0x7f89a4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.583+0000 7f8acdc0e800 1 Processor -- start 2024-09-13T23:05:31.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.583+0000 7f8acdc0e800 1 -- start start 2024-09-13T23:05:31.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.583+0000 7f8ac9b76640 1 --2- 172.21.15.164:0/726216130 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f89a4036b40 0x7f89a4039000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55669e383f70 tx=0x7f8ac4005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.583+0000 7f8acdc0e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e39fdd0 0x55669e3a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.583+0000 7f8acdc0e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55669e373fa0 con 0x55669e39fdd0 2024-09-13T23:05:31.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.584+0000 7f8ac8b74640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e39fdd0 0x55669e3a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.584+0000 7f8ac8b74640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e39fdd0 0x55669e3a01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56346/0 (socket says 172.21.15.164:56346) 2024-09-13T23:05:31.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.584+0000 7f8ac8b74640 1 -- 172.21.15.164:0/3345350689 learned_addr learned my addr 172.21.15.164:0/3345350689 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.584+0000 7f8ac8b74640 1 -- 172.21.15.164:0/3345350689 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55669e3a07a0 con 0x55669e39fdd0 2024-09-13T23:05:31.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.584+0000 7f8ac8b74640 1 --2- 172.21.15.164:0/3345350689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e39fdd0 0x55669e3a01d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000c010 tx=0x7f8ac0025ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f37a53effdc43b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.584+0000 7f89acff9640 1 -- 172.21.15.164:0/3345350689 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ac0040040 con 0x55669e39fdd0 2024-09-13T23:05:31.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.584+0000 7f89acff9640 1 -- 172.21.15.164:0/3345350689 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ac0046070 con 0x55669e39fdd0 2024-09-13T23:05:31.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.584+0000 7f89acff9640 1 -- 172.21.15.164:0/3345350689 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ac0025590 con 0x55669e39fdd0 2024-09-13T23:05:31.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.585+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3345350689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e39fdd0 msgr2=0x55669e3a01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.585+0000 7f8acdc0e800 1 --2- 172.21.15.164:0/3345350689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e39fdd0 0x55669e3a01d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000c010 tx=0x7f8ac0025ae0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.585+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3345350689 shutdown_connections 2024-09-13T23:05:31.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.585+0000 7f8acdc0e800 1 --2- 172.21.15.164:0/3345350689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e39fdd0 0x55669e3a01d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.585+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3345350689 >> 172.21.15.164:0/3345350689 conn(0x55669e39c130 msgr2=0x55669e39a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.585+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3345350689 shutdown_connections 2024-09-13T23:05:31.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.585+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3345350689 wait complete. 2024-09-13T23:05:31.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.585+0000 7f8acdc0e800 1 Processor -- start 2024-09-13T23:05:31.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.585+0000 7f8acdc0e800 1 -- start start 2024-09-13T23:05:31.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.585+0000 7f8acdc0e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e39fdd0 0x55669e3a72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.585+0000 7f8acdc0e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55669e3a0e10 con 0x55669e39fdd0 2024-09-13T23:05:31.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.585+0000 7f8ac8b74640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e39fdd0 0x55669e3a72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.585+0000 7f8ac8b74640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e39fdd0 0x55669e3a72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56348/0 (socket says 172.21.15.164:56348) 2024-09-13T23:05:31.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.585+0000 7f8ac8b74640 1 -- 172.21.15.164:0/3519182150 learned_addr learned my addr 172.21.15.164:0/3519182150 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.586+0000 7f8ac8b74640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55669e3a7810 con 0x55669e39fdd0 2024-09-13T23:05:31.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.586+0000 7f8ac8b74640 1 --2- 172.21.15.164:0/3519182150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e39fdd0 0x55669e3a72d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8ac001afd0 tx=0x7f8ac004d060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.586+0000 7f899affd640 1 -- 172.21.15.164:0/3519182150 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ac0019bb0 con 0x55669e39fdd0 2024-09-13T23:05:31.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.586+0000 7f899affd640 1 -- 172.21.15.164:0/3519182150 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ac0025590 con 0x55669e39fdd0 2024-09-13T23:05:31.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.586+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55669e3a7aa0 con 0x55669e39fdd0 2024-09-13T23:05:31.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.586+0000 7f899affd640 1 -- 172.21.15.164:0/3519182150 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ac0040ca0 con 0x55669e39fdd0 2024-09-13T23:05:31.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.586+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55669e3a7aa0 con 0x55669e39fdd0 2024-09-13T23:05:31.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.587+0000 7f899affd640 1 -- 172.21.15.164:0/3519182150 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8ac000c360 con 0x55669e39fdd0 2024-09-13T23:05:31.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.587+0000 7f899affd640 1 --2- 172.21.15.164:0/3519182150 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8994036b40 0x7f8994039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.587+0000 7f899affd640 1 -- 172.21.15.164:0/3519182150 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8ac0053a20 con 0x55669e39fdd0 2024-09-13T23:05:31.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.587+0000 7f8ac9b76640 1 --2- 172.21.15.164:0/3519182150 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8994036b40 0x7f8994039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.587+0000 7f8acdc0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.587+0000 7f8acdc0e800 1 --2- 172.21.15.164:0/3519182150 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55669e3b2c50 0x55669e3b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.587+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55669e3b5860 con 0x55669e3b2c50 2024-09-13T23:05:31.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.587+0000 7f8ac9375640 1 --2- 172.21.15.164:0/3519182150 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55669e3b2c50 0x55669e3b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.587+0000 7f8ac9b76640 1 --2- 172.21.15.164:0/3519182150 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8994036b40 0x7f8994039000 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x55669e3836f0 tx=0x7f8ac401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.588+0000 7f8ac9375640 1 --2- 172.21.15.164:0/3519182150 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55669e3b2c50 0x55669e3b5110 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.588+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8abc05c040 con 0x55669e3b2c50 2024-09-13T23:05:31.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.588+0000 7f8acdc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.588+0000 7f8acdc0e800 20 realm 2024-09-13T23:05:31.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.588+0000 7f8acdc0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.588+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55669e3b5c70 con 0x55669e3b2c50 2024-09-13T23:05:31.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.588+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8abc05c040 con 0x55669e3b2c50 2024-09-13T23:05:31.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.588+0000 7f8acdc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.588+0000 7f8acdc0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:31.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.588+0000 7f8acdc0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.588+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55669e3b6540 con 0x55669e3b2c50 2024-09-13T23:05:31.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.588+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8abc05c040 con 0x55669e3b2c50 2024-09-13T23:05:31.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.588+0000 7f8acdc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.588+0000 7f8acdc0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.588+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55669e3b68e0 con 0x55669e3b2c50 2024-09-13T23:05:31.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.588+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8abc05c040 con 0x55669e3b2c50 2024-09-13T23:05:31.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.588+0000 7f8acdc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:31.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.588+0000 7f8acdc0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.588+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55669e3b6d40 con 0x55669e3b2c50 2024-09-13T23:05:31.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.589+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8abc05c040 con 0x55669e3b2c50 2024-09-13T23:05:31.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.589+0000 7f8acdc0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:31.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.589+0000 7f8acdc0e800 20 searching for the correct realm 2024-09-13T23:05:31.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.589+0000 7f8acdc0e800 1 --2- 172.21.15.164:0/3519182150 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55669e3b8d90 0x55669e3bb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.589+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x55669e3b8d90 2024-09-13T23:05:31.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.589+0000 7f8ac8b74640 1 --2- 172.21.15.164:0/3519182150 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55669e3b8d90 0x55669e3bb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.589+0000 7f8ac8b74640 1 --2- 172.21.15.164:0/3519182150 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55669e3b8d90 0x55669e3bb180 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.589+0000 7f8ac8b74640 1 -- 172.21.15.164:0/3519182150 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ac0009050 con 0x55669e3b8d90 2024-09-13T23:05:31.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.589+0000 7f8ac8b74640 1 --2- 172.21.15.164:0/3519182150 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f8ac0024850 0x7f8ac00152e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.589+0000 7f8ac8b74640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x7f8ac0024850 2024-09-13T23:05:31.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.590+0000 7f8ac9b76640 1 --2- 172.21.15.164:0/3519182150 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f8ac0024850 0x7f8ac00152e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.590+0000 7f8ac9b76640 1 --2- 172.21.15.164:0/3519182150 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f8ac0024850 0x7f8ac00152e0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.590+0000 7f8ac9b76640 1 -- 172.21.15.164:0/3519182150 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ac401f070 con 0x7f8ac0024850 2024-09-13T23:05:31.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.590+0000 7f8ac9b76640 1 --2- 172.21.15.164:0/3519182150 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f8ac4031040 0x7f8ac4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.590+0000 7f8ac9b76640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x7f8ac4031040 2024-09-13T23:05:31.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.590+0000 7f8ac9375640 1 --2- 172.21.15.164:0/3519182150 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f8ac4031040 0x7f8ac4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.591+0000 7f8ac9375640 1 --2- 172.21.15.164:0/3519182150 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f8ac4031040 0x7f8ac4032940 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.591+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8abc05c040 con 0x7f8ac4031040 2024-09-13T23:05:31.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.591+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x55669e3b2c50 2024-09-13T23:05:31.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.591+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8abc05c040 con 0x55669e3b2c50 2024-09-13T23:05:31.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.591+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x55669e3b2c50 2024-09-13T23:05:31.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.591+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8abc05c040 con 0x55669e3b2c50 2024-09-13T23:05:31.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.591+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x7f8ac4031040 2024-09-13T23:05:31.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.592+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8abc05c040 con 0x7f8ac4031040 2024-09-13T23:05:31.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.592+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x7f8ac4031040 2024-09-13T23:05:31.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.592+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8abc05c040 con 0x7f8ac4031040 2024-09-13T23:05:31.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.592+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x7f8ac0024850 2024-09-13T23:05:31.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.592+0000 7f8ac9b76640 1 -- 172.21.15.164:0/3519182150 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ac401f070 con 0x7f8ac0024850 2024-09-13T23:05:31.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.592+0000 7f8ac9b76640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x55669e3b8d90 2024-09-13T23:05:31.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.592+0000 7f8ac8b74640 1 -- 172.21.15.164:0/3519182150 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ac0009050 con 0x55669e3b8d90 2024-09-13T23:05:31.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.592+0000 7f8ac8b74640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x55669e3b2c50 2024-09-13T23:05:31.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.592+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8abc05c040 con 0x55669e3b2c50 2024-09-13T23:05:31.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.593+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x7f8ac4031040 2024-09-13T23:05:31.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.593+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8abc05c040 con 0x7f8ac4031040 2024-09-13T23:05:31.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.593+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x55669e3b2c50 2024-09-13T23:05:31.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.593+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8abc05c040 con 0x55669e3b2c50 2024-09-13T23:05:31.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.593+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x7f8ac0024850 2024-09-13T23:05:31.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.593+0000 7f8ac9b76640 1 -- 172.21.15.164:0/3519182150 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8ac401f070 con 0x7f8ac0024850 2024-09-13T23:05:31.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.593+0000 7f8ac9b76640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x55669e3b8d90 2024-09-13T23:05:31.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.594+0000 7f8ac8b74640 1 -- 172.21.15.164:0/3519182150 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ac0009050 con 0x55669e3b8d90 2024-09-13T23:05:31.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.594+0000 7f8ac8b74640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x55669e3b8d90 2024-09-13T23:05:31.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.594+0000 7f8ac8b74640 1 -- 172.21.15.164:0/3519182150 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ac0009050 con 0x55669e3b8d90 2024-09-13T23:05:31.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.594+0000 7f8ac8b74640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x7f8ac4031040 2024-09-13T23:05:31.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.594+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8abc05c040 con 0x7f8ac4031040 2024-09-13T23:05:31.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.594+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x55669e3b8d90 2024-09-13T23:05:31.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.594+0000 7f8ac8b74640 1 -- 172.21.15.164:0/3519182150 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ac0009050 con 0x55669e3b8d90 2024-09-13T23:05:31.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.594+0000 7f8ac8b74640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x55669e3b8d90 2024-09-13T23:05:31.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.594+0000 7f8ac8b74640 1 -- 172.21.15.164:0/3519182150 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ac0009050 con 0x55669e3b8d90 2024-09-13T23:05:31.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.594+0000 7f8ac8b74640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x55669e3b2c50 2024-09-13T23:05:31.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.595+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8abc05c040 con 0x55669e3b2c50 2024-09-13T23:05:31.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.595+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x55669e3b2c50 2024-09-13T23:05:31.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.595+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8abc05c040 con 0x55669e3b2c50 2024-09-13T23:05:31.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.595+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x7f8ac4031040 2024-09-13T23:05:31.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.595+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8abc05c040 con 0x7f8ac4031040 2024-09-13T23:05:31.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.595+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x55669e3b8d90 2024-09-13T23:05:31.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.595+0000 7f8ac8b74640 1 -- 172.21.15.164:0/3519182150 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ac0009050 con 0x55669e3b8d90 2024-09-13T23:05:31.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.595+0000 7f8ac8b74640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x7f8ac0024850 2024-09-13T23:05:31.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.596+0000 7f8ac9b76640 1 -- 172.21.15.164:0/3519182150 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ac401f070 con 0x7f8ac0024850 2024-09-13T23:05:31.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.596+0000 7f8ac9b76640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x55669e3b2c50 2024-09-13T23:05:31.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.596+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8abc05c040 con 0x55669e3b2c50 2024-09-13T23:05:31.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.596+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x7f8ac4031040 2024-09-13T23:05:31.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.596+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8abc05c040 con 0x7f8ac4031040 2024-09-13T23:05:31.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.596+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x55669e3b8d90 2024-09-13T23:05:31.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.596+0000 7f8ac8b74640 1 -- 172.21.15.164:0/3519182150 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ac0009050 con 0x55669e3b8d90 2024-09-13T23:05:31.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.596+0000 7f8ac8b74640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x7f8ac4031040 2024-09-13T23:05:31.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.597+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8abc05c040 con 0x7f8ac4031040 2024-09-13T23:05:31.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.597+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x7f8ac0024850 2024-09-13T23:05:31.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.597+0000 7f8ac9b76640 1 -- 172.21.15.164:0/3519182150 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ac401f070 con 0x7f8ac0024850 2024-09-13T23:05:31.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.597+0000 7f8ac9b76640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x55669e3b8d90 2024-09-13T23:05:31.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.597+0000 7f8ac8b74640 1 -- 172.21.15.164:0/3519182150 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ac0009050 con 0x55669e3b8d90 2024-09-13T23:05:31.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.597+0000 7f8ac8b74640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x7f8ac4031040 2024-09-13T23:05:31.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.597+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8abc05c040 con 0x7f8ac4031040 2024-09-13T23:05:31.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.597+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x55669e3b2c50 2024-09-13T23:05:31.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.598+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8abc05c040 con 0x55669e3b2c50 2024-09-13T23:05:31.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.598+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bb830 con 0x7f8ac0024850 2024-09-13T23:05:31.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.598+0000 7f8ac9b76640 1 -- 172.21.15.164:0/3519182150 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ac401f070 con 0x7f8ac0024850 2024-09-13T23:05:31.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.598+0000 7f8acdc0e800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:31.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.598+0000 7f8acdc0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:31.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.598+0000 7f8acdc0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:31.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.598+0000 7f8acdc0e800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:31.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.598+0000 7f8acdc0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:31.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.598+0000 7f8acdc0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:31.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.598+0000 7f8acdc0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.598+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55669e3b7810 con 0x55669e3b2c50 2024-09-13T23:05:31.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.598+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8abc05c040 con 0x55669e3b2c50 2024-09-13T23:05:31.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.598+0000 7f8acdc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.598+0000 7f8acdc0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.598+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55669e3b7c00 con 0x55669e3b2c50 2024-09-13T23:05:31.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.598+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8abc05c040 con 0x55669e3b2c50 2024-09-13T23:05:31.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.598+0000 7f8acdc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:31.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.598+0000 7f8acdc0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.598+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55669e3b7c00 con 0x55669e3b2c50 2024-09-13T23:05:31.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.598+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8abc05c040 con 0x55669e3b2c50 2024-09-13T23:05:31.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.598+0000 7f8acdc0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:31.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.599+0000 7f8acdc0e800 20 zone default found 2024-09-13T23:05:31.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.599+0000 7f8acdc0e800 4 Realm: () 2024-09-13T23:05:31.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.599+0000 7f8acdc0e800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:31.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.599+0000 7f8acdc0e800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:31.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.599+0000 7f8acdc0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:31.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.599+0000 7f8acdc0e800 20 zonegroup default 2024-09-13T23:05:31.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.599+0000 7f8acdc0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.599+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55669e3b8020 con 0x7f8ac4031040 2024-09-13T23:05:31.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.599+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8abc05c040 con 0x7f8ac4031040 2024-09-13T23:05:31.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.599+0000 7f8acdc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.599+0000 7f8acdc0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.599+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55669e3b8020 con 0x55669e3b8d90 2024-09-13T23:05:31.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.599+0000 7f8ac8b74640 1 -- 172.21.15.164:0/3519182150 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8ac0009050 con 0x55669e3b8d90 2024-09-13T23:05:31.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.599+0000 7f8acdc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.599+0000 7f8acdc0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.599+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bd670 con 0x55669e3b8d90 2024-09-13T23:05:31.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.599+0000 7f8ac8b74640 1 -- 172.21.15.164:0/3519182150 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8ac0009050 con 0x55669e3b8d90 2024-09-13T23:05:31.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.599+0000 7f8acdc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.599+0000 7f8acdc0e800 20 started sync module instance, tier type = 2024-09-13T23:05:31.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.599+0000 7f8acdc0e800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:31.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.599+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bcb10 con 0x7f8ac0024850 2024-09-13T23:05:31.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.600+0000 7f8ac9b76640 1 -- 172.21.15.164:0/3519182150 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ac4040040 con 0x7f8ac0024850 2024-09-13T23:05:31.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.600+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93899229744816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bd2d0 con 0x7f8ac0024850 2024-09-13T23:05:31.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.600+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55669e3be4e0 con 0x55669e3b2c50 2024-09-13T23:05:31.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.601+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8abc05c040 con 0x55669e3b2c50 2024-09-13T23:05:31.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.601+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93899229749296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55669e3be450 con 0x55669e3b2c50 2024-09-13T23:05:31.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.601+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bf4d0 con 0x55669e3b8d90 2024-09-13T23:05:31.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.602+0000 7f8ac9b76640 1 -- 172.21.15.164:0/3519182150 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93899229744816] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ac4040040 con 0x7f8ac0024850 2024-09-13T23:05:31.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.603+0000 7f8ac8b74640 1 -- 172.21.15.164:0/3519182150 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ac0009050 con 0x55669e3b8d90 2024-09-13T23:05:31.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.603+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93899229753248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55669e3bf8c0 con 0x55669e3b8d90 2024-09-13T23:05:31.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.603+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55669e3c02e0 con 0x7f8ac0024850 2024-09-13T23:05:31.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.603+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93899229749296] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8abc05c040 con 0x55669e3b2c50 2024-09-13T23:05:31.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.604+0000 7f8ac8b74640 1 -- 172.21.15.164:0/3519182150 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93899229753248] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ac0009050 con 0x55669e3b8d90 2024-09-13T23:05:31.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.604+0000 7f8ac9b76640 1 -- 172.21.15.164:0/3519182150 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ac4040040 con 0x7f8ac0024850 2024-09-13T23:05:31.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.604+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93899229747728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55669e3be8d0 con 0x7f8ac0024850 2024-09-13T23:05:31.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.604+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55669e3c0cf0 con 0x55669e3b2c50 2024-09-13T23:05:31.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.605+0000 7f8ac9b76640 1 -- 172.21.15.164:0/3519182150 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93899229747728] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ac4040040 con 0x7f8ac0024850 2024-09-13T23:05:31.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.605+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8abc05c040 con 0x55669e3b2c50 2024-09-13T23:05:31.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.605+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93899229756880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55669e3c0cf0 con 0x55669e3b2c50 2024-09-13T23:05:31.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.605+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55669e3c1580 con 0x7f8ac4031040 2024-09-13T23:05:31.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.606+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8abc05c040 con 0x7f8ac4031040 2024-09-13T23:05:31.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.606+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93899229760752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55669e3c1150 con 0x7f8ac4031040 2024-09-13T23:05:31.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.606+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55669e3c2530 con 0x7f8ac4031040 2024-09-13T23:05:31.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.606+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93899229756880] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8abc05c040 con 0x55669e3b2c50 2024-09-13T23:05:31.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.607+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8abc05c040 con 0x7f8ac4031040 2024-09-13T23:05:31.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.607+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93899229759552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55669e3c24f0 con 0x7f8ac4031040 2024-09-13T23:05:31.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.607+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55669e3c2f70 con 0x7f8ac4031040 2024-09-13T23:05:31.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.607+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93899229760752] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8abc05c040 con 0x7f8ac4031040 2024-09-13T23:05:31.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.608+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8abc05c040 con 0x7f8ac4031040 2024-09-13T23:05:31.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.608+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93899229763952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55669e3c2f70 con 0x7f8ac4031040 2024-09-13T23:05:31.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.608+0000 7f8acdc0e800 20 add_watcher() i=0 2024-09-13T23:05:31.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.608+0000 7f8acdc0e800 20 add_watcher() i=1 2024-09-13T23:05:31.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.608+0000 7f8acdc0e800 20 add_watcher() i=2 2024-09-13T23:05:31.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.608+0000 7f8acdc0e800 20 add_watcher() i=3 2024-09-13T23:05:31.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.608+0000 7f8acdc0e800 20 add_watcher() i=4 2024-09-13T23:05:31.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.608+0000 7f8acdc0e800 20 add_watcher() i=5 2024-09-13T23:05:31.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.608+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93899229759552] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8abc05c040 con 0x7f8ac4031040 2024-09-13T23:05:31.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.608+0000 7f8acdc0e800 20 add_watcher() i=6 2024-09-13T23:05:31.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.609+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93899229763952] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8abc05c040 con 0x7f8ac4031040 2024-09-13T23:05:31.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.609+0000 7f8acdc0e800 20 add_watcher() i=7 2024-09-13T23:05:31.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.609+0000 7f8acdc0e800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:31.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.609+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55669e3c2f70 con 0x55669e3b2c50 2024-09-13T23:05:31.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.609+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8abc05c040 con 0x55669e3b2c50 2024-09-13T23:05:31.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.609+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93899229768384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55669e3c2ee0 con 0x55669e3b2c50 2024-09-13T23:05:31.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.610+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93899229768384] v32'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8abc05c040 con 0x55669e3b2c50 2024-09-13T23:05:31.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.610+0000 7f897f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:31.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.610+0000 7f8acdc0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:31.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.610+0000 7f8acdc0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:31.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.610+0000 7f8acdc0e800 5 note: GC not initialized 2024-09-13T23:05:31.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.611+0000 7f897e7e4640 20 reqs_thread_entry: start 2024-09-13T23:05:31.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.611+0000 7f8acdc0e800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:31.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.611+0000 7f8acdc0e800 20 Filter name: none 2024-09-13T23:05:31.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.611+0000 7f88effff640 20 reqs_thread_entry: start 2024-09-13T23:05:31.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.611+0000 7f8acdc0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.611+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55669e3f8d80 con 0x55669e3b2c50 2024-09-13T23:05:31.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.611+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8abc05c040 con 0x55669e3b2c50 2024-09-13T23:05:31.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.611+0000 7f8acdc0e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:05:31.658 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:05:31.300851Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:05:31.300826Z","tags":[],"group_ids":[]} 2024-09-13T23:05:31.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.612+0000 7f897f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:31.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.612+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93899229768384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55669e3f7b90 con 0x55669e3b2c50 2024-09-13T23:05:31.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.613+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93899229768384] v32'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8abc05c040 con 0x55669e3b2c50 2024-09-13T23:05:31.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.613+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93899229744816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55669e3c2ac0 con 0x7f8ac0024850 2024-09-13T23:05:31.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.614+0000 7f8ac9b76640 1 -- 172.21.15.164:0/3519182150 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93899229744816] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ac4040040 con 0x7f8ac0024850 2024-09-13T23:05:31.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.614+0000 7f8acdc0e800 20 remove_watcher() i=0 2024-09-13T23:05:31.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.614+0000 7f8acdc0e800 2 removed watcher, disabling cache 2024-09-13T23:05:31.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.614+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93899229749296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55669e3c2ac0 con 0x55669e3b2c50 2024-09-13T23:05:31.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.616+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93899229749296] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8abc05c040 con 0x55669e3b2c50 2024-09-13T23:05:31.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.616+0000 7f8acdc0e800 20 remove_watcher() i=1 2024-09-13T23:05:31.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.616+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93899229753248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55669e3be030 con 0x55669e3b8d90 2024-09-13T23:05:31.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.617+0000 7f8ac8b74640 1 -- 172.21.15.164:0/3519182150 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93899229753248] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ac0009050 con 0x55669e3b8d90 2024-09-13T23:05:31.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.617+0000 7f8acdc0e800 20 remove_watcher() i=2 2024-09-13T23:05:31.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.617+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93899229747728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55669e3c2ac0 con 0x7f8ac0024850 2024-09-13T23:05:31.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.618+0000 7f8ac9b76640 1 -- 172.21.15.164:0/3519182150 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93899229747728] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ac4040040 con 0x7f8ac0024850 2024-09-13T23:05:31.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.618+0000 7f8acdc0e800 20 remove_watcher() i=3 2024-09-13T23:05:31.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.618+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93899229756880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55669e3befa0 con 0x55669e3b2c50 2024-09-13T23:05:31.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.619+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93899229756880] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8abc05c040 con 0x55669e3b2c50 2024-09-13T23:05:31.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.619+0000 7f8acdc0e800 20 remove_watcher() i=4 2024-09-13T23:05:31.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.619+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93899229760752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55669e3c2ac0 con 0x7f8ac4031040 2024-09-13T23:05:31.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.620+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93899229760752] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8abc05c040 con 0x7f8ac4031040 2024-09-13T23:05:31.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.620+0000 7f8acdc0e800 20 remove_watcher() i=5 2024-09-13T23:05:31.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.620+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93899229759552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55669e3c2ac0 con 0x7f8ac4031040 2024-09-13T23:05:31.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.621+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93899229759552] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8abc05c040 con 0x7f8ac4031040 2024-09-13T23:05:31.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.621+0000 7f8acdc0e800 20 remove_watcher() i=6 2024-09-13T23:05:31.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.621+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93899229763952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55669e3c2ac0 con 0x7f8ac4031040 2024-09-13T23:05:31.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.622+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93899229763952] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8abc05c040 con 0x7f8ac4031040 2024-09-13T23:05:31.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.622+0000 7f8acdc0e800 20 remove_watcher() i=7 2024-09-13T23:05:31.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.622+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f8ac4031040 msgr2=0x7f8ac4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.622+0000 7f8acdc0e800 1 --2- 172.21.15.164:0/3519182150 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f8ac4031040 0x7f8ac4032940 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.622+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55669e3b2c50 msgr2=0x55669e3b5110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.622+0000 7f8acdc0e800 1 --2- 172.21.15.164:0/3519182150 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55669e3b2c50 0x55669e3b5110 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.622+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f8ac0024850 msgr2=0x7f8ac00152e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.622+0000 7f8acdc0e800 1 --2- 172.21.15.164:0/3519182150 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f8ac0024850 0x7f8ac00152e0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.622+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55669e3b8d90 msgr2=0x55669e3bb180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.622+0000 7f8acdc0e800 1 --2- 172.21.15.164:0/3519182150 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55669e3b8d90 0x55669e3bb180 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.622+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8994036b40 msgr2=0x7f8994039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.622+0000 7f8acdc0e800 1 --2- 172.21.15.164:0/3519182150 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8994036b40 0x7f8994039000 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x55669e3836f0 tx=0x7f8ac401f000 comp rx=0 tx=0).stop 2024-09-13T23:05:31.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.622+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e39fdd0 msgr2=0x55669e3a72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.622+0000 7f8acdc0e800 1 --2- 172.21.15.164:0/3519182150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e39fdd0 0x55669e3a72d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8ac001afd0 tx=0x7f8ac004d060 comp rx=0 tx=0).stop 2024-09-13T23:05:31.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.622+0000 7f8ac9375640 1 -- 172.21.15.164:0/3519182150 reap_dead start 2024-09-13T23:05:31.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.622+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 shutdown_connections 2024-09-13T23:05:31.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.622+0000 7f8acdc0e800 1 --2- 172.21.15.164:0/3519182150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e39fdd0 0x55669e3a72d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.622+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 >> 172.21.15.164:0/3519182150 conn(0x55669e39c130 msgr2=0x55669e39a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.622+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 shutdown_connections 2024-09-13T23:05:31.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.622+0000 7f8acdc0e800 1 -- 172.21.15.164:0/3519182150 wait complete. 2024-09-13T23:05:31.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.623+0000 7f8acdc0e800 1 -- 172.21.15.164:0/726216130 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f89a4036b40 msgr2=0x7f89a4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.623+0000 7f8acdc0e800 1 --2- 172.21.15.164:0/726216130 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f89a4036b40 0x7f89a4039000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55669e383f70 tx=0x7f8ac4005840 comp rx=0 tx=0).stop 2024-09-13T23:05:31.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.623+0000 7f8acdc0e800 1 -- 172.21.15.164:0/726216130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e3930c0 msgr2=0x55669e3934e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.623+0000 7f8acdc0e800 1 --2- 172.21.15.164:0/726216130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e3930c0 0x55669e3934e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000bec0 tx=0x7f8ac000d7a0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.623+0000 7f8acdc0e800 1 -- 172.21.15.164:0/726216130 shutdown_connections 2024-09-13T23:05:31.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.623+0000 7f8acdc0e800 1 --2- 172.21.15.164:0/726216130 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f89a4036b40 0x7f89a4039000 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.623+0000 7f8acdc0e800 1 --2- 172.21.15.164:0/726216130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e3930c0 0x55669e3934e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.623+0000 7f8acdc0e800 1 -- 172.21.15.164:0/726216130 >> 172.21.15.164:0/726216130 conn(0x55669e388050 msgr2=0x55669e38abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.623+0000 7f8acdc0e800 1 -- 172.21.15.164:0/726216130 shutdown_connections 2024-09-13T23:05:31.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.623+0000 7f8acdc0e800 1 -- 172.21.15.164:0/726216130 wait complete. 2024-09-13T23:05:31.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.623+0000 7f8acdc0e800 1 -- 172.21.15.164:0/601732519 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55669e380200 msgr2=0x55669e382650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.623+0000 7f8acdc0e800 1 --2- 172.21.15.164:0/601732519 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55669e380200 0x55669e382650 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.623+0000 7f8acdc0e800 1 -- 172.21.15.164:0/601732519 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f89b0036b90 msgr2=0x7f89b0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.623+0000 7f8acdc0e800 1 --2- 172.21.15.164:0/601732519 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f89b0036b90 0x7f89b0039050 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0000f60 tx=0x7f8ac00010a0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.623+0000 7f8acdc0e800 1 -- 172.21.15.164:0/601732519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e287bd0 msgr2=0x55669e37b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.623+0000 7f8acdc0e800 1 --2- 172.21.15.164:0/601732519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e287bd0 0x55669e37b310 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8abc025b20 tx=0x7f8abc002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.623+0000 7f8acdc0e800 1 -- 172.21.15.164:0/601732519 shutdown_connections 2024-09-13T23:05:31.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.623+0000 7f8acdc0e800 1 --2- 172.21.15.164:0/601732519 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55669e380200 0x55669e382650 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.623+0000 7f8acdc0e800 1 --2- 172.21.15.164:0/601732519 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f89b0036b90 0x7f89b0039050 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.623+0000 7f8acdc0e800 1 --2- 172.21.15.164:0/601732519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55669e287bd0 0x55669e37b310 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.623+0000 7f8acdc0e800 1 -- 172.21.15.164:0/601732519 >> 172.21.15.164:0/601732519 conn(0x55669e27cde0 msgr2=0x55669e36dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.623+0000 7f8acdc0e800 1 -- 172.21.15.164:0/601732519 shutdown_connections 2024-09-13T23:05:31.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.623+0000 7f8acdc0e800 1 -- 172.21.15.164:0/601732519 wait complete. 2024-09-13T23:05:31.682 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:05:31.300851Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:05:31.300826Z', 'tags': [], 'group_ids': []} 2024-09-13T23:05:31.682 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-13T23:05:31.682 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-13T23:05:31.682 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-13T23:05:31.754 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:31.754 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:31.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.754+0000 7fc520524800 1 Processor -- start 2024-09-13T23:05:31.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.754+0000 7fc520524800 1 -- start start 2024-09-13T23:05:31.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.754+0000 7fc520524800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x564f8df3b990 0x564f8df3dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.754+0000 7fc520524800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564f8ddf7b30 con 0x564f8df37550 2024-09-13T23:05:31.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.754+0000 7fc520524800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x564f8ddd9360 con 0x564f8df3b990 2024-09-13T23:05:31.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.755+0000 7fc513adf640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x564f8df3b990 0x564f8df3dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.755+0000 7fc51c2e0640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x564f8df37550 0x564f8df37950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40744/0 (socket says 172.21.15.164:40744) 2024-09-13T23:05:31.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.755+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2981044626 learned_addr learned my addr 172.21.15.164:0/2981044626 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:31.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.755+0000 7fc513adf640 1 -- 172.21.15.164:0/2981044626 >> v1:172.21.15.17:6789/0 conn(0x564f8df37550 legacy=0x564f8df37950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.755+0000 7fc513adf640 1 -- 172.21.15.164:0/2981044626 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f8ddffe00 con 0x564f8df3b990 2024-09-13T23:05:31.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.757+0000 7fc513adf640 1 --2- 172.21.15.164:0/2981044626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8df3b990 0x564f8df3dd80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc50400a470 tx=0x7fc504045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4c152af2d3cf24 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.757+0000 7fc51badf640 1 -- 172.21.15.164:0/2981044626 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc504053570 con 0x564f8df3b990 2024-09-13T23:05:31.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.757+0000 7fc51badf640 1 -- 172.21.15.164:0/2981044626 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc504058070 con 0x564f8df3b990 2024-09-13T23:05:31.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.757+0000 7fc51badf640 1 -- 172.21.15.164:0/2981044626 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc504053880 con 0x564f8df3b990 2024-09-13T23:05:31.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.757+0000 7fc520524800 1 -- 172.21.15.164:0/2981044626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8df3b990 msgr2=0x564f8df3dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.757+0000 7fc520524800 1 --2- 172.21.15.164:0/2981044626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8df3b990 0x564f8df3dd80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc50400a470 tx=0x7fc504045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:31.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.757+0000 7fc520524800 1 -- 172.21.15.164:0/2981044626 shutdown_connections 2024-09-13T23:05:31.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.757+0000 7fc520524800 1 --2- 172.21.15.164:0/2981044626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8df3b990 0x564f8df3dd80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.757+0000 7fc520524800 1 -- 172.21.15.164:0/2981044626 >> 172.21.15.164:0/2981044626 conn(0x564f8df32de0 msgr2=0x564f8df35200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.757+0000 7fc520524800 1 -- 172.21.15.164:0/2981044626 shutdown_connections 2024-09-13T23:05:31.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.758+0000 7fc520524800 1 -- 172.21.15.164:0/2981044626 wait complete. 2024-09-13T23:05:31.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.771+0000 7fc520524800 1 Processor -- start 2024-09-13T23:05:31.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.771+0000 7fc520524800 1 -- start start 2024-09-13T23:05:31.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.771+0000 7fc520524800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8df37550 0x564f8deac5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.772+0000 7fc520524800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564f8de84330 con 0x564f8df37550 2024-09-13T23:05:31.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.772+0000 7fc51c2e0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8df37550 0x564f8deac5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.772+0000 7fc51c2e0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8df37550 0x564f8deac5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56366/0 (socket says 172.21.15.164:56366) 2024-09-13T23:05:31.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.772+0000 7fc51c2e0640 1 -- 172.21.15.164:0/3806248322 learned_addr learned my addr 172.21.15.164:0/3806248322 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.772+0000 7fc51c2e0640 1 -- 172.21.15.164:0/3806248322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f8ddd1bc0 con 0x564f8df37550 2024-09-13T23:05:31.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.772+0000 7fc51c2e0640 1 --2- 172.21.15.164:0/3806248322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8df37550 0x564f8deac5a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc50c001e10 tx=0x7fc50c00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9714badf47fb92 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.773+0000 7fc40a60c640 1 -- 172.21.15.164:0/3806248322 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50c012020 con 0x564f8df37550 2024-09-13T23:05:31.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.773+0000 7fc40a60c640 1 -- 172.21.15.164:0/3806248322 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc50c00e5a0 con 0x564f8df37550 2024-09-13T23:05:31.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.773+0000 7fc40a60c640 1 -- 172.21.15.164:0/3806248322 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50c00e8e0 con 0x564f8df37550 2024-09-13T23:05:31.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.773+0000 7fc520524800 1 -- 172.21.15.164:0/3806248322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8df37550 msgr2=0x564f8deac5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.773+0000 7fc520524800 1 --2- 172.21.15.164:0/3806248322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8df37550 0x564f8deac5a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc50c001e10 tx=0x7fc50c00b780 comp rx=0 tx=0).stop 2024-09-13T23:05:31.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.773+0000 7fc520524800 1 -- 172.21.15.164:0/3806248322 shutdown_connections 2024-09-13T23:05:31.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.773+0000 7fc520524800 1 --2- 172.21.15.164:0/3806248322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8df37550 0x564f8deac5a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.773+0000 7fc520524800 1 -- 172.21.15.164:0/3806248322 >> 172.21.15.164:0/3806248322 conn(0x564f8df32de0 msgr2=0x564f8e022140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.773+0000 7fc520524800 1 -- 172.21.15.164:0/3806248322 shutdown_connections 2024-09-13T23:05:31.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.773+0000 7fc520524800 1 -- 172.21.15.164:0/3806248322 wait complete. 2024-09-13T23:05:31.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.774+0000 7fc520524800 1 Processor -- start 2024-09-13T23:05:31.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.774+0000 7fc520524800 1 -- start start 2024-09-13T23:05:31.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.774+0000 7fc520524800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8df37550 0x564f8e027ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.774+0000 7fc520524800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564f8df3e5c0 con 0x564f8df37550 2024-09-13T23:05:31.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.774+0000 7fc51c2e0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8df37550 0x564f8e027ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.774+0000 7fc51c2e0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8df37550 0x564f8e027ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56370/0 (socket says 172.21.15.164:56370) 2024-09-13T23:05:31.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.774+0000 7fc51c2e0640 1 -- 172.21.15.164:0/928354211 learned_addr learned my addr 172.21.15.164:0/928354211 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.774+0000 7fc51c2e0640 1 -- 172.21.15.164:0/928354211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f8dde5fe0 con 0x564f8df37550 2024-09-13T23:05:31.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.774+0000 7fc51c2e0640 1 --2- 172.21.15.164:0/928354211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8df37550 0x564f8e027ee0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc50c00b7c0 tx=0x7fc50c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.775+0000 7fc408e09640 1 -- 172.21.15.164:0/928354211 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50c012030 con 0x564f8df37550 2024-09-13T23:05:31.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.775+0000 7fc408e09640 1 -- 172.21.15.164:0/928354211 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc50c001470 con 0x564f8df37550 2024-09-13T23:05:31.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.775+0000 7fc520524800 1 -- 172.21.15.164:0/928354211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f8e0265d0 con 0x564f8df37550 2024-09-13T23:05:31.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.775+0000 7fc408e09640 1 -- 172.21.15.164:0/928354211 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50c01a8d0 con 0x564f8df37550 2024-09-13T23:05:31.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.775+0000 7fc520524800 1 -- 172.21.15.164:0/928354211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f8e026af0 con 0x564f8df37550 2024-09-13T23:05:31.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.775+0000 7fc408e09640 1 -- 172.21.15.164:0/928354211 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc50c015020 con 0x564f8df37550 2024-09-13T23:05:31.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.776+0000 7fc408e09640 1 --2- 172.21.15.164:0/928354211 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc404036b90 0x7fc404039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.776+0000 7fc408e09640 1 -- 172.21.15.164:0/928354211 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc50c020030 con 0x564f8df37550 2024-09-13T23:05:31.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.776+0000 7fc513adf640 1 --2- 172.21.15.164:0/928354211 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc404036b90 0x7fc404039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.776+0000 7fc520524800 1 --2- 172.21.15.164:0/928354211 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564f8df3b990 0x564f8e038650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.776+0000 7fc520524800 1 -- 172.21.15.164:0/928354211 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f8e038b90 con 0x564f8df3b990 2024-09-13T23:05:31.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.776+0000 7fc51cae1640 1 --2- 172.21.15.164:0/928354211 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564f8df3b990 0x564f8e038650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.776+0000 7fc513adf640 1 --2- 172.21.15.164:0/928354211 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc404036b90 0x7fc404039050 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc504057000 tx=0x7fc504052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.776+0000 7fc51cae1640 1 --2- 172.21.15.164:0/928354211 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564f8df3b990 0x564f8e038650 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.776+0000 7fc51cae1640 1 -- 172.21.15.164:0/928354211 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc51400a4a0 con 0x564f8df3b990 2024-09-13T23:05:31.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.777+0000 7fc520524800 1 -- 172.21.15.164:0/928354211 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0393e0 con 0x564f8df3b990 2024-09-13T23:05:31.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.777+0000 7fc51cae1640 1 -- 172.21.15.164:0/928354211 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc51400a4a0 con 0x564f8df3b990 2024-09-13T23:05:31.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.777+0000 7fc520524800 1 -- 172.21.15.164:0/928354211 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f8e03a790 con 0x564f8df3b990 2024-09-13T23:05:31.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.777+0000 7fc51cae1640 1 -- 172.21.15.164:0/928354211 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc51400a4a0 con 0x564f8df3b990 2024-09-13T23:05:31.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.777+0000 7fc520524800 1 -- 172.21.15.164:0/928354211 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f8e039c30 con 0x564f8df3b990 2024-09-13T23:05:31.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.777+0000 7fc51cae1640 1 -- 172.21.15.164:0/928354211 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc51400a4a0 con 0x564f8df3b990 2024-09-13T23:05:31.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.777+0000 7fc520524800 1 -- 172.21.15.164:0/928354211 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f8e03a080 con 0x564f8df3b990 2024-09-13T23:05:31.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.778+0000 7fc51cae1640 1 -- 172.21.15.164:0/928354211 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc51400a4a0 con 0x564f8df3b990 2024-09-13T23:05:31.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.778+0000 7fc520524800 1 Processor -- start 2024-09-13T23:05:31.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.778+0000 7fc520524800 1 -- start start 2024-09-13T23:05:31.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.778+0000 7fc520524800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8e048fb0 0x564f8e0493d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.778+0000 7fc520524800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564f8e028420 con 0x564f8e048fb0 2024-09-13T23:05:31.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.778+0000 7fc513adf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8e048fb0 0x564f8e0493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.778+0000 7fc513adf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8e048fb0 0x564f8e0493d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56378/0 (socket says 172.21.15.164:56378) 2024-09-13T23:05:31.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.778+0000 7fc513adf640 1 -- 172.21.15.164:0/4060680425 learned_addr learned my addr 172.21.15.164:0/4060680425 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.779+0000 7fc513adf640 1 -- 172.21.15.164:0/4060680425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f8e049910 con 0x564f8e048fb0 2024-09-13T23:05:31.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.779+0000 7fc513adf640 1 --2- 172.21.15.164:0/4060680425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8e048fb0 0x564f8e0493d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc504045f50 tx=0x7fc504002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.779+0000 7fc401ffb640 1 -- 172.21.15.164:0/4060680425 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50406f070 con 0x564f8e048fb0 2024-09-13T23:05:31.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.779+0000 7fc401ffb640 1 -- 172.21.15.164:0/4060680425 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc50405f550 con 0x564f8e048fb0 2024-09-13T23:05:31.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.779+0000 7fc520524800 1 -- 172.21.15.164:0/4060680425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f8e049b40 con 0x564f8e048fb0 2024-09-13T23:05:31.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.779+0000 7fc401ffb640 1 -- 172.21.15.164:0/4060680425 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50405f830 con 0x564f8e048fb0 2024-09-13T23:05:31.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.779+0000 7fc520524800 1 -- 172.21.15.164:0/4060680425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f8e04c7c0 con 0x564f8e048fb0 2024-09-13T23:05:31.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.780+0000 7fc401ffb640 1 -- 172.21.15.164:0/4060680425 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc50405f9d0 con 0x564f8e048fb0 2024-09-13T23:05:31.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.780+0000 7fc401ffb640 1 --2- 172.21.15.164:0/4060680425 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc3f4036b90 0x7fc3f4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.780+0000 7fc401ffb640 1 -- 172.21.15.164:0/4060680425 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc504092c90 con 0x564f8e048fb0 2024-09-13T23:05:31.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.780+0000 7fc51cae1640 1 --2- 172.21.15.164:0/4060680425 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc3f4036b90 0x7fc3f4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.780+0000 7fc520524800 1 Processor -- start 2024-09-13T23:05:31.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.780+0000 7fc51cae1640 1 --2- 172.21.15.164:0/4060680425 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc3f4036b90 0x7fc3f4039050 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x564f8e039260 tx=0x7fc514005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.780+0000 7fc520524800 1 -- start start 2024-09-13T23:05:31.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.780+0000 7fc520524800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8e055b50 0x564f8e055f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.780+0000 7fc520524800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564f8ddd3580 con 0x564f8e055b50 2024-09-13T23:05:31.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.781+0000 7fc513adf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8e055b50 0x564f8e055f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.781+0000 7fc513adf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8e055b50 0x564f8e055f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56386/0 (socket says 172.21.15.164:56386) 2024-09-13T23:05:31.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.781+0000 7fc513adf640 1 -- 172.21.15.164:0/3904870206 learned_addr learned my addr 172.21.15.164:0/3904870206 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.781+0000 7fc513adf640 1 -- 172.21.15.164:0/3904870206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f8e056520 con 0x564f8e055b50 2024-09-13T23:05:31.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.781+0000 7fc513adf640 1 --2- 172.21.15.164:0/3904870206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8e055b50 0x564f8e055f50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc504053da0 tx=0x7fc50406baa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b02176e7098755a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.781+0000 7fc3fb7fe640 1 -- 172.21.15.164:0/3904870206 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc504080070 con 0x564f8e055b50 2024-09-13T23:05:31.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.781+0000 7fc3fb7fe640 1 -- 172.21.15.164:0/3904870206 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc50405fcc0 con 0x564f8e055b50 2024-09-13T23:05:31.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.781+0000 7fc3fb7fe640 1 -- 172.21.15.164:0/3904870206 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50406a3a0 con 0x564f8e055b50 2024-09-13T23:05:31.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.782+0000 7fc520524800 1 -- 172.21.15.164:0/3904870206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8e055b50 msgr2=0x564f8e055f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.782+0000 7fc520524800 1 --2- 172.21.15.164:0/3904870206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8e055b50 0x564f8e055f50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc504053da0 tx=0x7fc50406baa0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.782+0000 7fc520524800 1 -- 172.21.15.164:0/3904870206 shutdown_connections 2024-09-13T23:05:31.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.782+0000 7fc520524800 1 --2- 172.21.15.164:0/3904870206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8e055b50 0x564f8e055f50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.782+0000 7fc520524800 1 -- 172.21.15.164:0/3904870206 >> 172.21.15.164:0/3904870206 conn(0x564f8e051eb0 msgr2=0x564f8e04ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.782+0000 7fc520524800 1 -- 172.21.15.164:0/3904870206 shutdown_connections 2024-09-13T23:05:31.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.782+0000 7fc520524800 1 -- 172.21.15.164:0/3904870206 wait complete. 2024-09-13T23:05:31.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.782+0000 7fc520524800 1 Processor -- start 2024-09-13T23:05:31.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.782+0000 7fc520524800 1 -- start start 2024-09-13T23:05:31.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.782+0000 7fc520524800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8e055b50 0x564f8e05ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.782+0000 7fc520524800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564f8e056a10 con 0x564f8e055b50 2024-09-13T23:05:31.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.783+0000 7fc513adf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8e055b50 0x564f8e05ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.783+0000 7fc513adf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8e055b50 0x564f8e05ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56400/0 (socket says 172.21.15.164:56400) 2024-09-13T23:05:31.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.783+0000 7fc513adf640 1 -- 172.21.15.164:0/2243541914 learned_addr learned my addr 172.21.15.164:0/2243541914 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.783+0000 7fc513adf640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f8e05d3c0 con 0x564f8e055b50 2024-09-13T23:05:31.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.783+0000 7fc513adf640 1 --2- 172.21.15.164:0/2243541914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8e055b50 0x564f8e05ce80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc50406afd0 tx=0x7fc504091010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.783+0000 7fc3f9ffb640 1 -- 172.21.15.164:0/2243541914 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50406a930 con 0x564f8e055b50 2024-09-13T23:05:31.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.783+0000 7fc3f9ffb640 1 -- 172.21.15.164:0/2243541914 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc504096070 con 0x564f8e055b50 2024-09-13T23:05:31.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.783+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f8e05d650 con 0x564f8e055b50 2024-09-13T23:05:31.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.783+0000 7fc3f9ffb640 1 -- 172.21.15.164:0/2243541914 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc50407c520 con 0x564f8e055b50 2024-09-13T23:05:31.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.783+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f8e060300 con 0x564f8e055b50 2024-09-13T23:05:31.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.784+0000 7fc3f9ffb640 1 -- 172.21.15.164:0/2243541914 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc504083070 con 0x564f8e055b50 2024-09-13T23:05:31.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.784+0000 7fc3f9ffb640 1 --2- 172.21.15.164:0/2243541914 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc3ec036b40 0x7fc3ec039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.784+0000 7fc3f9ffb640 1 -- 172.21.15.164:0/2243541914 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc50409ccd0 con 0x564f8e055b50 2024-09-13T23:05:31.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.784+0000 7fc51cae1640 1 --2- 172.21.15.164:0/2243541914 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc3ec036b40 0x7fc3ec039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.785+0000 7fc51cae1640 1 --2- 172.21.15.164:0/2243541914 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc3ec036b40 0x7fc3ec039000 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x564f8e027a40 tx=0x7fc51401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.785+0000 7fc520524800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.785+0000 7fc520524800 1 --2- 172.21.15.164:0/2243541914 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564f8e068960 0x564f8e06ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.785+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f8e06b570 con 0x564f8e068960 2024-09-13T23:05:31.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.785+0000 7fc51c2e0640 1 --2- 172.21.15.164:0/2243541914 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564f8e068960 0x564f8e06ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.785+0000 7fc51c2e0640 1 --2- 172.21.15.164:0/2243541914 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564f8e068960 0x564f8e06ae20 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.786+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.786+0000 7fc520524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.786+0000 7fc520524800 20 realm 2024-09-13T23:05:31.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.786+0000 7fc520524800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.786+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f8e06b980 con 0x564f8e068960 2024-09-13T23:05:31.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.786+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.786+0000 7fc520524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.786+0000 7fc520524800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:31.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.786+0000 7fc520524800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.786+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f8e06c250 con 0x564f8e068960 2024-09-13T23:05:31.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.786+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.786+0000 7fc520524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.786+0000 7fc520524800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.786+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f8e06c5f0 con 0x564f8e068960 2024-09-13T23:05:31.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.786+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.786+0000 7fc520524800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:31.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.786+0000 7fc520524800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.786+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f8e06ce40 con 0x564f8e068960 2024-09-13T23:05:31.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.786+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.786+0000 7fc520524800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:31.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.786+0000 7fc520524800 20 searching for the correct realm 2024-09-13T23:05:31.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.786+0000 7fc520524800 1 --2- 172.21.15.164:0/2243541914 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x564f8e06ebb0 0x564f8e070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.787+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x564f8e06ebb0 2024-09-13T23:05:31.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.787+0000 7fc513adf640 1 --2- 172.21.15.164:0/2243541914 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x564f8e06ebb0 0x564f8e070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.787+0000 7fc513adf640 1 --2- 172.21.15.164:0/2243541914 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x564f8e06ebb0 0x564f8e070fa0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.787+0000 7fc513adf640 1 -- 172.21.15.164:0/2243541914 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc504082030 con 0x564f8e06ebb0 2024-09-13T23:05:31.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.787+0000 7fc513adf640 1 --2- 172.21.15.164:0/2243541914 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc504085070 0x7fc504057500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.787+0000 7fc513adf640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x7fc504085070 2024-09-13T23:05:31.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.787+0000 7fc51cae1640 1 --2- 172.21.15.164:0/2243541914 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc504085070 0x7fc504057500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.788+0000 7fc51cae1640 1 --2- 172.21.15.164:0/2243541914 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc504085070 0x7fc504057500 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.788+0000 7fc51cae1640 1 -- 172.21.15.164:0/2243541914 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc51401f070 con 0x7fc504085070 2024-09-13T23:05:31.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.788+0000 7fc51cae1640 1 --2- 172.21.15.164:0/2243541914 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc514031040 0x7fc514032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.788+0000 7fc51cae1640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x7fc514031040 2024-09-13T23:05:31.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.788+0000 7fc51c2e0640 1 --2- 172.21.15.164:0/2243541914 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc514031040 0x7fc514032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.788+0000 7fc51c2e0640 1 --2- 172.21.15.164:0/2243541914 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc514031040 0x7fc514032940 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.789+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc50c018950 con 0x7fc514031040 2024-09-13T23:05:31.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.789+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x564f8e068960 2024-09-13T23:05:31.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.789+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.789+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x564f8e068960 2024-09-13T23:05:31.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.789+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.789+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x7fc514031040 2024-09-13T23:05:31.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.789+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc50c018950 con 0x7fc514031040 2024-09-13T23:05:31.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.789+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x7fc514031040 2024-09-13T23:05:31.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.790+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc50c018950 con 0x7fc514031040 2024-09-13T23:05:31.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.790+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x7fc504085070 2024-09-13T23:05:31.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.790+0000 7fc51cae1640 1 -- 172.21.15.164:0/2243541914 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc51401f070 con 0x7fc504085070 2024-09-13T23:05:31.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.790+0000 7fc51cae1640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x564f8e06ebb0 2024-09-13T23:05:31.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.790+0000 7fc513adf640 1 -- 172.21.15.164:0/2243541914 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc504082030 con 0x564f8e06ebb0 2024-09-13T23:05:31.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.790+0000 7fc513adf640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x564f8e068960 2024-09-13T23:05:31.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.790+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.790+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x7fc514031040 2024-09-13T23:05:31.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.790+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc50c018950 con 0x7fc514031040 2024-09-13T23:05:31.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.791+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x564f8e068960 2024-09-13T23:05:31.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.791+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.791+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x7fc504085070 2024-09-13T23:05:31.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.791+0000 7fc51cae1640 1 -- 172.21.15.164:0/2243541914 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc51401f070 con 0x7fc504085070 2024-09-13T23:05:31.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.791+0000 7fc51cae1640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x564f8e06ebb0 2024-09-13T23:05:31.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.791+0000 7fc513adf640 1 -- 172.21.15.164:0/2243541914 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc504082030 con 0x564f8e06ebb0 2024-09-13T23:05:31.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.791+0000 7fc513adf640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x564f8e06ebb0 2024-09-13T23:05:31.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.791+0000 7fc513adf640 1 -- 172.21.15.164:0/2243541914 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc504082030 con 0x564f8e06ebb0 2024-09-13T23:05:31.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.791+0000 7fc513adf640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x7fc514031040 2024-09-13T23:05:31.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.792+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc50c018950 con 0x7fc514031040 2024-09-13T23:05:31.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.792+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x564f8e06ebb0 2024-09-13T23:05:31.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.792+0000 7fc513adf640 1 -- 172.21.15.164:0/2243541914 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc504082030 con 0x564f8e06ebb0 2024-09-13T23:05:31.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.792+0000 7fc513adf640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x564f8e06ebb0 2024-09-13T23:05:31.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.792+0000 7fc513adf640 1 -- 172.21.15.164:0/2243541914 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc504082030 con 0x564f8e06ebb0 2024-09-13T23:05:31.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.792+0000 7fc513adf640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x564f8e068960 2024-09-13T23:05:31.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.792+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.792+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x564f8e068960 2024-09-13T23:05:31.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.793+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.793+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x7fc514031040 2024-09-13T23:05:31.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.793+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc50c018950 con 0x7fc514031040 2024-09-13T23:05:31.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.793+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x564f8e06ebb0 2024-09-13T23:05:31.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.793+0000 7fc513adf640 1 -- 172.21.15.164:0/2243541914 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc504082030 con 0x564f8e06ebb0 2024-09-13T23:05:31.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.793+0000 7fc513adf640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x7fc504085070 2024-09-13T23:05:31.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.793+0000 7fc51cae1640 1 -- 172.21.15.164:0/2243541914 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc51401f070 con 0x7fc504085070 2024-09-13T23:05:31.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.793+0000 7fc51cae1640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x564f8e068960 2024-09-13T23:05:31.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.793+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.793+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x7fc514031040 2024-09-13T23:05:31.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.794+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc50c018950 con 0x7fc514031040 2024-09-13T23:05:31.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.794+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x564f8e06ebb0 2024-09-13T23:05:31.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.794+0000 7fc513adf640 1 -- 172.21.15.164:0/2243541914 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc504082030 con 0x564f8e06ebb0 2024-09-13T23:05:31.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.794+0000 7fc513adf640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x7fc514031040 2024-09-13T23:05:31.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.794+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc50c018950 con 0x7fc514031040 2024-09-13T23:05:31.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.794+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x7fc504085070 2024-09-13T23:05:31.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.795+0000 7fc51cae1640 1 -- 172.21.15.164:0/2243541914 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc51401f070 con 0x7fc504085070 2024-09-13T23:05:31.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.795+0000 7fc51cae1640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x564f8e06ebb0 2024-09-13T23:05:31.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.795+0000 7fc513adf640 1 -- 172.21.15.164:0/2243541914 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc504082030 con 0x564f8e06ebb0 2024-09-13T23:05:31.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.795+0000 7fc513adf640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x7fc514031040 2024-09-13T23:05:31.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.795+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc50c018950 con 0x7fc514031040 2024-09-13T23:05:31.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.795+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x564f8e068960 2024-09-13T23:05:31.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.795+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.795+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0715b0 con 0x7fc504085070 2024-09-13T23:05:31.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.795+0000 7fc51cae1640 1 -- 172.21.15.164:0/2243541914 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc51401f070 con 0x7fc504085070 2024-09-13T23:05:31.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.795+0000 7fc520524800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:31.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.795+0000 7fc520524800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:31.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.795+0000 7fc520524800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:31.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.795+0000 7fc520524800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:31.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.795+0000 7fc520524800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:31.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.795+0000 7fc520524800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:31.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.796+0000 7fc520524800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.796+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f8e06d790 con 0x564f8e068960 2024-09-13T23:05:31.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.796+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.796+0000 7fc520524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.796+0000 7fc520524800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.796+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f8e06e030 con 0x564f8e068960 2024-09-13T23:05:31.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.796+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.796+0000 7fc520524800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:31.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.796+0000 7fc520524800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.796+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f8e071a30 con 0x564f8e068960 2024-09-13T23:05:31.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.796+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.796+0000 7fc520524800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:31.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.796+0000 7fc520524800 20 zone default found 2024-09-13T23:05:31.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.796+0000 7fc520524800 4 Realm: () 2024-09-13T23:05:31.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.796+0000 7fc520524800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:31.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.796+0000 7fc520524800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:31.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.796+0000 7fc520524800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:31.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.796+0000 7fc520524800 20 zonegroup default 2024-09-13T23:05:31.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.796+0000 7fc520524800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.796+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f8e071a30 con 0x7fc514031040 2024-09-13T23:05:31.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.796+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc50c018950 con 0x7fc514031040 2024-09-13T23:05:31.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.797+0000 7fc520524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.797+0000 7fc520524800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.797+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f8e073800 con 0x564f8e06ebb0 2024-09-13T23:05:31.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.797+0000 7fc513adf640 1 -- 172.21.15.164:0/2243541914 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc504082030 con 0x564f8e06ebb0 2024-09-13T23:05:31.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.797+0000 7fc520524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.797+0000 7fc520524800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.797+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f8e073c10 con 0x564f8e06ebb0 2024-09-13T23:05:31.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.797+0000 7fc513adf640 1 -- 172.21.15.164:0/2243541914 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc504082030 con 0x564f8e06ebb0 2024-09-13T23:05:31.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.797+0000 7fc520524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.797+0000 7fc520524800 20 started sync module instance, tier type = 2024-09-13T23:05:31.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.797+0000 7fc520524800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:31.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.797+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f8e072ca0 con 0x7fc504085070 2024-09-13T23:05:31.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.798+0000 7fc51cae1640 1 -- 172.21.15.164:0/2243541914 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc514040040 con 0x7fc504085070 2024-09-13T23:05:31.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.798+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94899685240976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f8e074520 con 0x7fc504085070 2024-09-13T23:05:31.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.798+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f8e074d70 con 0x564f8e068960 2024-09-13T23:05:31.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.799+0000 7fc51cae1640 1 -- 172.21.15.164:0/2243541914 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94899685240976] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc514040040 con 0x7fc504085070 2024-09-13T23:05:31.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.799+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.799+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94899685245040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f8e074a00 con 0x564f8e068960 2024-09-13T23:05:31.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.799+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f8e075520 con 0x564f8e06ebb0 2024-09-13T23:05:31.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.800+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94899685245040] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.801+0000 7fc513adf640 1 -- 172.21.15.164:0/2243541914 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc504082030 con 0x564f8e06ebb0 2024-09-13T23:05:31.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.801+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94899685249008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f8e075910 con 0x564f8e06ebb0 2024-09-13T23:05:31.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.801+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f8e076330 con 0x7fc504085070 2024-09-13T23:05:31.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.802+0000 7fc513adf640 1 -- 172.21.15.164:0/2243541914 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94899685249008] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc504082030 con 0x564f8e06ebb0 2024-09-13T23:05:31.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.802+0000 7fc51cae1640 1 -- 172.21.15.164:0/2243541914 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc514040040 con 0x7fc504085070 2024-09-13T23:05:31.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.802+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94899685252640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f8e076720 con 0x7fc504085070 2024-09-13T23:05:31.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.802+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f8e077140 con 0x564f8e068960 2024-09-13T23:05:31.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.802+0000 7fc51cae1640 1 -- 172.21.15.164:0/2243541914 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94899685252640] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc514040040 con 0x7fc504085070 2024-09-13T23:05:31.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.803+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.803+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94899685256240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f8e077100 con 0x564f8e068960 2024-09-13T23:05:31.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.803+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f8e077bf0 con 0x7fc514031040 2024-09-13T23:05:31.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.804+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc50c018950 con 0x7fc514031040 2024-09-13T23:05:31.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.804+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94899685259008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f8e077bf0 con 0x7fc514031040 2024-09-13T23:05:31.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.804+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f8e078b50 con 0x7fc514031040 2024-09-13T23:05:31.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.804+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94899685256240] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.805+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc50c018950 con 0x7fc514031040 2024-09-13T23:05:31.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.805+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94899685246096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f8e078b50 con 0x7fc514031040 2024-09-13T23:05:31.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.805+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f8e079510 con 0x7fc514031040 2024-09-13T23:05:31.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.805+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94899685259008] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc50c018950 con 0x7fc514031040 2024-09-13T23:05:31.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.806+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94899685246096] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc50c018950 con 0x7fc514031040 2024-09-13T23:05:31.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.806+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc50c018950 con 0x7fc514031040 2024-09-13T23:05:31.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.806+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94899685261280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f8e079060 con 0x7fc514031040 2024-09-13T23:05:31.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.806+0000 7fc520524800 20 add_watcher() i=0 2024-09-13T23:05:31.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.806+0000 7fc520524800 20 add_watcher() i=1 2024-09-13T23:05:31.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.806+0000 7fc520524800 20 add_watcher() i=2 2024-09-13T23:05:31.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.806+0000 7fc520524800 20 add_watcher() i=3 2024-09-13T23:05:31.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.806+0000 7fc520524800 20 add_watcher() i=4 2024-09-13T23:05:31.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.806+0000 7fc520524800 20 add_watcher() i=5 2024-09-13T23:05:31.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.806+0000 7fc520524800 20 add_watcher() i=6 2024-09-13T23:05:31.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.807+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94899685261280] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc50c018950 con 0x7fc514031040 2024-09-13T23:05:31.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.807+0000 7fc520524800 20 add_watcher() i=7 2024-09-13T23:05:31.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.807+0000 7fc520524800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:31.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.807+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f8e07c540 con 0x564f8e068960 2024-09-13T23:05:31.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.807+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.807+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94899685265504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f8e079930 con 0x564f8e068960 2024-09-13T23:05:31.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.808+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94899685265504] v32'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.808+0000 7fc3d27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:31.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.808+0000 7fc520524800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:31.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.808+0000 7fc520524800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:31.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.808+0000 7fc520524800 5 note: GC not initialized 2024-09-13T23:05:31.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.808+0000 7fc3d17e2640 20 reqs_thread_entry: start 2024-09-13T23:05:31.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.809+0000 7fc520524800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:31.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.809+0000 7fc520524800 20 Filter name: none 2024-09-13T23:05:31.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.809+0000 7fc342ffd640 20 reqs_thread_entry: start 2024-09-13T23:05:31.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.809+0000 7fc520524800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:05:31.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.809+0000 7fc520524800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.809+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0af7f0 con 0x564f8e068960 2024-09-13T23:05:31.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.809+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.809+0000 7fc520524800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:05:31.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.809+0000 7fc520524800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:05:31.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.809+0000 7fc520524800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:31.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.809+0000 7fc520524800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:31.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.809+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0b2280 con 0x7fc504085070 2024-09-13T23:05:31.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.809+0000 7fc51cae1640 1 -- 172.21.15.164:0/2243541914 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fc514040040 con 0x7fc504085070 2024-09-13T23:05:31.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.809+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0b5ad0 con 0x564f8e068960 2024-09-13T23:05:31.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.811+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v32'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.811+0000 7fc520524800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:31.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.811+0000 7fc520524800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:31.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.811+0000 7fc520524800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:05:31.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.811+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94899685512336 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0b4570 con 0x564f8e068960 2024-09-13T23:05:31.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.811+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== watch-notify(notify (1) cookie 94899685256240 notify 137438953473 ret 0) ==== 609+0+0 (crc 0 0 0) 0x564f8e026af0 con 0x564f8e068960 2024-09-13T23:05:31.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.811+0000 7fc3fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94899685256240 notifier 4323 bl.length()=567 2024-09-13T23:05:31.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.811+0000 7fc3fb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:31.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.811+0000 7fc3fb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:31.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.811+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(65 notify.4 [notify cookie 94899685512336 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.811+0000 7fc3fb7fe640 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc3e0003ea0 con 0x564f8e068960 2024-09-13T23:05:31.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.811+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.811+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== watch-notify(notify_complete (2) cookie 94899685512336 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564f8e0265d0 con 0x564f8e068960 2024-09-13T23:05:31.846 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:05:31.300851Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:05:31.300826Z","tags":[],"group_ids":[]} 2024-09-13T23:05:31.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.812+0000 7fc3d27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:31.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.812+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94899685265504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0ad560 con 0x564f8e068960 2024-09-13T23:05:31.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.813+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94899685265504] v32'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.813+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94899685240976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0ad560 con 0x7fc504085070 2024-09-13T23:05:31.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.814+0000 7fc51cae1640 1 -- 172.21.15.164:0/2243541914 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94899685240976] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc514040040 con 0x7fc504085070 2024-09-13T23:05:31.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.814+0000 7fc520524800 20 remove_watcher() i=0 2024-09-13T23:05:31.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.814+0000 7fc520524800 2 removed watcher, disabling cache 2024-09-13T23:05:31.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.814+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94899685245040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0ad560 con 0x564f8e068960 2024-09-13T23:05:31.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.815+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94899685245040] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.815+0000 7fc520524800 20 remove_watcher() i=1 2024-09-13T23:05:31.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.815+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94899685249008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0ad560 con 0x564f8e06ebb0 2024-09-13T23:05:31.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.816+0000 7fc513adf640 1 -- 172.21.15.164:0/2243541914 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94899685249008] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc504082030 con 0x564f8e06ebb0 2024-09-13T23:05:31.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.816+0000 7fc520524800 20 remove_watcher() i=2 2024-09-13T23:05:31.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.816+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94899685252640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0b4570 con 0x7fc504085070 2024-09-13T23:05:31.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.817+0000 7fc51cae1640 1 -- 172.21.15.164:0/2243541914 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94899685252640] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc514040040 con 0x7fc504085070 2024-09-13T23:05:31.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.817+0000 7fc520524800 20 remove_watcher() i=3 2024-09-13T23:05:31.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.817+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94899685256240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0b4570 con 0x564f8e068960 2024-09-13T23:05:31.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.818+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94899685256240] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc50c018950 con 0x564f8e068960 2024-09-13T23:05:31.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.818+0000 7fc520524800 20 remove_watcher() i=4 2024-09-13T23:05:31.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.818+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94899685259008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0b4570 con 0x7fc514031040 2024-09-13T23:05:31.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.819+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94899685259008] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc50c018950 con 0x7fc514031040 2024-09-13T23:05:31.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.819+0000 7fc520524800 20 remove_watcher() i=5 2024-09-13T23:05:31.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.819+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94899685246096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f8e0b4570 con 0x7fc514031040 2024-09-13T23:05:31.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.820+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94899685246096] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc50c018950 con 0x7fc514031040 2024-09-13T23:05:31.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.820+0000 7fc520524800 20 remove_watcher() i=6 2024-09-13T23:05:31.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.820+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94899685261280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f8e073090 con 0x7fc514031040 2024-09-13T23:05:31.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.821+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94899685261280] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc50c018950 con 0x7fc514031040 2024-09-13T23:05:31.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.821+0000 7fc520524800 20 remove_watcher() i=7 2024-09-13T23:05:31.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.821+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc514031040 msgr2=0x7fc514032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.821+0000 7fc520524800 1 --2- 172.21.15.164:0/2243541914 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc514031040 0x7fc514032940 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.821+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564f8e068960 msgr2=0x564f8e06ae20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.821+0000 7fc520524800 1 --2- 172.21.15.164:0/2243541914 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564f8e068960 0x564f8e06ae20 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.821+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc504085070 msgr2=0x7fc504057500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.821+0000 7fc520524800 1 --2- 172.21.15.164:0/2243541914 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc504085070 0x7fc504057500 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.821+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x564f8e06ebb0 msgr2=0x564f8e070fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.821+0000 7fc520524800 1 --2- 172.21.15.164:0/2243541914 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x564f8e06ebb0 0x564f8e070fa0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.821+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc3ec036b40 msgr2=0x7fc3ec039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.821+0000 7fc520524800 1 --2- 172.21.15.164:0/2243541914 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc3ec036b40 0x7fc3ec039000 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x564f8e027a40 tx=0x7fc51401f000 comp rx=0 tx=0).stop 2024-09-13T23:05:31.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.821+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8e055b50 msgr2=0x564f8e05ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.821+0000 7fc51c2e0640 1 -- 172.21.15.164:0/2243541914 reap_dead start 2024-09-13T23:05:31.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.821+0000 7fc520524800 1 --2- 172.21.15.164:0/2243541914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8e055b50 0x564f8e05ce80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc50406afd0 tx=0x7fc504091010 comp rx=0 tx=0).stop 2024-09-13T23:05:31.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.821+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 shutdown_connections 2024-09-13T23:05:31.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.821+0000 7fc520524800 1 --2- 172.21.15.164:0/2243541914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8e055b50 0x564f8e05ce80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.821+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 >> 172.21.15.164:0/2243541914 conn(0x564f8e051eb0 msgr2=0x564f8e04ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.822+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 shutdown_connections 2024-09-13T23:05:31.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.822+0000 7fc520524800 1 -- 172.21.15.164:0/2243541914 wait complete. 2024-09-13T23:05:31.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.822+0000 7fc520524800 1 -- 172.21.15.164:0/4060680425 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc3f4036b90 msgr2=0x7fc3f4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.822+0000 7fc520524800 1 --2- 172.21.15.164:0/4060680425 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc3f4036b90 0x7fc3f4039050 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x564f8e039260 tx=0x7fc514005840 comp rx=0 tx=0).stop 2024-09-13T23:05:31.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.822+0000 7fc520524800 1 -- 172.21.15.164:0/4060680425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8e048fb0 msgr2=0x564f8e0493d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.822+0000 7fc520524800 1 --2- 172.21.15.164:0/4060680425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8e048fb0 0x564f8e0493d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc504045f50 tx=0x7fc504002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.822+0000 7fc520524800 1 -- 172.21.15.164:0/4060680425 shutdown_connections 2024-09-13T23:05:31.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.822+0000 7fc520524800 1 --2- 172.21.15.164:0/4060680425 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc3f4036b90 0x7fc3f4039050 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.822+0000 7fc520524800 1 --2- 172.21.15.164:0/4060680425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8e048fb0 0x564f8e0493d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.822+0000 7fc520524800 1 -- 172.21.15.164:0/4060680425 >> 172.21.15.164:0/4060680425 conn(0x564f8e03df40 msgr2=0x564f8e040ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.822+0000 7fc520524800 1 -- 172.21.15.164:0/4060680425 shutdown_connections 2024-09-13T23:05:31.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.822+0000 7fc520524800 1 -- 172.21.15.164:0/4060680425 wait complete. 2024-09-13T23:05:31.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.822+0000 7fc520524800 1 -- 172.21.15.164:0/928354211 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564f8df3b990 msgr2=0x564f8e038650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.822+0000 7fc520524800 1 --2- 172.21.15.164:0/928354211 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564f8df3b990 0x564f8e038650 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.822+0000 7fc520524800 1 -- 172.21.15.164:0/928354211 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc404036b90 msgr2=0x7fc404039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.822+0000 7fc520524800 1 --2- 172.21.15.164:0/928354211 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc404036b90 0x7fc404039050 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc504057000 tx=0x7fc504052000 comp rx=0 tx=0).stop 2024-09-13T23:05:31.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.822+0000 7fc520524800 1 -- 172.21.15.164:0/928354211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8df37550 msgr2=0x564f8e027ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.822+0000 7fc520524800 1 --2- 172.21.15.164:0/928354211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8df37550 0x564f8e027ee0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc50c00b7c0 tx=0x7fc50c000ed0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.822+0000 7fc520524800 1 -- 172.21.15.164:0/928354211 shutdown_connections 2024-09-13T23:05:31.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.822+0000 7fc520524800 1 --2- 172.21.15.164:0/928354211 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564f8df3b990 0x564f8e038650 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.822+0000 7fc520524800 1 --2- 172.21.15.164:0/928354211 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc404036b90 0x7fc404039050 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.822+0000 7fc520524800 1 --2- 172.21.15.164:0/928354211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f8df37550 0x564f8e027ee0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.822+0000 7fc520524800 1 -- 172.21.15.164:0/928354211 >> 172.21.15.164:0/928354211 conn(0x564f8df32de0 msgr2=0x564f8e0209d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.822+0000 7fc520524800 1 -- 172.21.15.164:0/928354211 shutdown_connections 2024-09-13T23:05:31.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.822+0000 7fc520524800 1 -- 172.21.15.164:0/928354211 wait complete. 2024-09-13T23:05:31.858 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:05:31.300851Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:05:31.300826Z', 'tags': [], 'group_ids': []} 2024-09-13T23:05:31.858 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T23:05:31.858 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T23:05:31.858 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T23:05:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.938+0000 7f066851f800 1 Processor -- start 2024-09-13T23:05:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.938+0000 7f066851f800 1 -- start start 2024-09-13T23:05:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.938+0000 7f066851f800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5561efc66970 0x5561efc68d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.938+0000 7f066851f800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5561efb21b30 con 0x5561efbd6630 2024-09-13T23:05:31.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.938+0000 7f066851f800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x5561efb03360 con 0x5561efc66970 2024-09-13T23:05:31.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.938+0000 7f065bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5561efc66970 0x5561efc68d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.938+0000 7f0664195640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x5561efbd6630 0x5561efc65250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40748/0 (socket says 172.21.15.164:40748) 2024-09-13T23:05:31.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.938+0000 7f0664195640 1 -- 172.21.15.164:0/1822959616 learned_addr learned my addr 172.21.15.164:0/1822959616 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:31.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.939+0000 7f065bfff640 1 -- 172.21.15.164:0/1822959616 >> v1:172.21.15.17:6789/0 conn(0x5561efbd6630 legacy=0x5561efc65250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.939+0000 7f0663994640 1 -- 172.21.15.164:0/1822959616 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3288460820 0 0) 0x5561efb21b30 con 0x5561efbd6630 2024-09-13T23:05:31.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.939+0000 7f065bfff640 1 -- 172.21.15.164:0/1822959616 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561efb29e00 con 0x5561efc66970 2024-09-13T23:05:31.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.941+0000 7f065bfff640 1 --2- 172.21.15.164:0/1822959616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efc66970 0x5561efc68d60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f064c00a470 tx=0x7f064c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=122076e95a3c303e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.941+0000 7f0663994640 1 -- 172.21.15.164:0/1822959616 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f064c053570 con 0x5561efc66970 2024-09-13T23:05:31.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.941+0000 7f0663994640 1 -- 172.21.15.164:0/1822959616 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f064c058070 con 0x5561efc66970 2024-09-13T23:05:31.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.941+0000 7f0663994640 1 -- 172.21.15.164:0/1822959616 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f064c053880 con 0x5561efc66970 2024-09-13T23:05:31.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.941+0000 7f066851f800 1 -- 172.21.15.164:0/1822959616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efc66970 msgr2=0x5561efc68d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.941+0000 7f066851f800 1 --2- 172.21.15.164:0/1822959616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efc66970 0x5561efc68d60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f064c00a470 tx=0x7f064c045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:31.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.941+0000 7f066851f800 1 -- 172.21.15.164:0/1822959616 shutdown_connections 2024-09-13T23:05:31.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.941+0000 7f066851f800 1 --2- 172.21.15.164:0/1822959616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efc66970 0x5561efc68d60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.941+0000 7f066851f800 1 -- 172.21.15.164:0/1822959616 >> 172.21.15.164:0/1822959616 conn(0x5561efc5cde0 msgr2=0x5561efc5f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.941+0000 7f066851f800 1 -- 172.21.15.164:0/1822959616 shutdown_connections 2024-09-13T23:05:31.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.941+0000 7f066851f800 1 -- 172.21.15.164:0/1822959616 wait complete. 2024-09-13T23:05:31.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.955+0000 7f066851f800 1 Processor -- start 2024-09-13T23:05:31.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.956+0000 7f066851f800 1 -- start start 2024-09-13T23:05:31.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.956+0000 7f066851f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efbd6630 0x5561efc62b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.956+0000 7f066851f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5561efbae330 con 0x5561efbd6630 2024-09-13T23:05:31.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.956+0000 7f0664195640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efbd6630 0x5561efc62b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.956+0000 7f0664195640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efbd6630 0x5561efc62b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56414/0 (socket says 172.21.15.164:56414) 2024-09-13T23:05:31.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.956+0000 7f0664195640 1 -- 172.21.15.164:0/435072602 learned_addr learned my addr 172.21.15.164:0/435072602 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.956+0000 7f0664195640 1 -- 172.21.15.164:0/435072602 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561efafbbc0 con 0x5561efbd6630 2024-09-13T23:05:31.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.956+0000 7f0664195640 1 --2- 172.21.15.164:0/435072602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efbd6630 0x5561efc62b80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f065400b240 tx=0x7f065400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31abd5a5ca006a3c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.957+0000 7f055260c640 1 -- 172.21.15.164:0/435072602 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0654008070 con 0x5561efbd6630 2024-09-13T23:05:31.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.957+0000 7f055260c640 1 -- 172.21.15.164:0/435072602 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f065400d500 con 0x5561efbd6630 2024-09-13T23:05:31.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.957+0000 7f055260c640 1 -- 172.21.15.164:0/435072602 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f065400d860 con 0x5561efbd6630 2024-09-13T23:05:31.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.957+0000 7f066851f800 1 -- 172.21.15.164:0/435072602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efbd6630 msgr2=0x5561efc62b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.957+0000 7f066851f800 1 --2- 172.21.15.164:0/435072602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efbd6630 0x5561efc62b80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f065400b240 tx=0x7f065400b700 comp rx=0 tx=0).stop 2024-09-13T23:05:31.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.957+0000 7f066851f800 1 -- 172.21.15.164:0/435072602 shutdown_connections 2024-09-13T23:05:31.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.957+0000 7f066851f800 1 --2- 172.21.15.164:0/435072602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efbd6630 0x5561efc62b80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.957+0000 7f066851f800 1 -- 172.21.15.164:0/435072602 >> 172.21.15.164:0/435072602 conn(0x5561efc5cde0 msgr2=0x5561efd4d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.957+0000 7f066851f800 1 -- 172.21.15.164:0/435072602 shutdown_connections 2024-09-13T23:05:31.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.957+0000 7f066851f800 1 -- 172.21.15.164:0/435072602 wait complete. 2024-09-13T23:05:31.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.958+0000 7f066851f800 1 Processor -- start 2024-09-13T23:05:31.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.958+0000 7f066851f800 1 -- start start 2024-09-13T23:05:31.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.958+0000 7f066851f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efbd6630 0x5561efd5b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.958+0000 7f066851f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5561efc69690 con 0x5561efbd6630 2024-09-13T23:05:31.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.958+0000 7f0664195640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efbd6630 0x5561efd5b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.958+0000 7f0664195640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efbd6630 0x5561efd5b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56420/0 (socket says 172.21.15.164:56420) 2024-09-13T23:05:31.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.958+0000 7f0664195640 1 -- 172.21.15.164:0/1695593550 learned_addr learned my addr 172.21.15.164:0/1695593550 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.959+0000 7f0664195640 1 -- 172.21.15.164:0/1695593550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561efb0ffe0 con 0x5561efbd6630 2024-09-13T23:05:31.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.959+0000 7f0664195640 1 --2- 172.21.15.164:0/1695593550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efbd6630 0x5561efd5b2a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x5561efc62280 tx=0x7f0654000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.959+0000 7f0550e09640 1 -- 172.21.15.164:0/1695593550 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0654019870 con 0x5561efbd6630 2024-09-13T23:05:31.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.959+0000 7f0550e09640 1 -- 172.21.15.164:0/1695593550 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0654019a10 con 0x5561efbd6630 2024-09-13T23:05:31.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.959+0000 7f066851f800 1 -- 172.21.15.164:0/1695593550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561efd5b7e0 con 0x5561efbd6630 2024-09-13T23:05:31.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.959+0000 7f0550e09640 1 -- 172.21.15.164:0/1695593550 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f065402b060 con 0x5561efbd6630 2024-09-13T23:05:31.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.959+0000 7f066851f800 1 -- 172.21.15.164:0/1695593550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561efd5bd00 con 0x5561efbd6630 2024-09-13T23:05:31.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.960+0000 7f0550e09640 1 -- 172.21.15.164:0/1695593550 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0654017040 con 0x5561efbd6630 2024-09-13T23:05:31.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.960+0000 7f0550e09640 1 --2- 172.21.15.164:0/1695593550 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f054c036b90 0x7f054c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.960+0000 7f0550e09640 1 -- 172.21.15.164:0/1695593550 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0654015020 con 0x5561efbd6630 2024-09-13T23:05:31.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.960+0000 7f065bfff640 1 --2- 172.21.15.164:0/1695593550 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f054c036b90 0x7f054c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.961+0000 7f066851f800 1 --2- 172.21.15.164:0/1695593550 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5561efc66970 0x5561efd62310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.961+0000 7f066851f800 1 -- 172.21.15.164:0/1695593550 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561efd62850 con 0x5561efc66970 2024-09-13T23:05:31.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.961+0000 7f0664996640 1 --2- 172.21.15.164:0/1695593550 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5561efc66970 0x5561efd62310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.961+0000 7f065bfff640 1 --2- 172.21.15.164:0/1695593550 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f054c036b90 0x7f054c039050 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f064c057000 tx=0x7f064c052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.961+0000 7f0664996640 1 --2- 172.21.15.164:0/1695593550 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5561efc66970 0x5561efd62310 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.961+0000 7f0664996640 1 -- 172.21.15.164:0/1695593550 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f065c00a4a0 con 0x5561efc66970 2024-09-13T23:05:31.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.961+0000 7f066851f800 1 -- 172.21.15.164:0/1695593550 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561efd5f8e0 con 0x5561efc66970 2024-09-13T23:05:31.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.961+0000 7f0664996640 1 -- 172.21.15.164:0/1695593550 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f065c00a4a0 con 0x5561efc66970 2024-09-13T23:05:31.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.962+0000 7f066851f800 1 -- 172.21.15.164:0/1695593550 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561efd64650 con 0x5561efc66970 2024-09-13T23:05:31.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.962+0000 7f0664996640 1 -- 172.21.15.164:0/1695593550 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f065c00a4a0 con 0x5561efc66970 2024-09-13T23:05:31.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.962+0000 7f066851f800 1 -- 172.21.15.164:0/1695593550 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561efd63880 con 0x5561efc66970 2024-09-13T23:05:31.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.962+0000 7f0664996640 1 -- 172.21.15.164:0/1695593550 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f065c00a4a0 con 0x5561efc66970 2024-09-13T23:05:31.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.962+0000 7f066851f800 1 -- 172.21.15.164:0/1695593550 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561efd63cd0 con 0x5561efc66970 2024-09-13T23:05:31.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.962+0000 7f0664996640 1 -- 172.21.15.164:0/1695593550 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f065c00a4a0 con 0x5561efc66970 2024-09-13T23:05:31.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.963+0000 7f066851f800 1 Processor -- start 2024-09-13T23:05:31.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.963+0000 7f066851f800 1 -- start start 2024-09-13T23:05:31.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.963+0000 7f066851f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efd72c60 0x5561efd73080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.963+0000 7f066851f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5561efafd580 con 0x5561efd72c60 2024-09-13T23:05:31.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.963+0000 7f065bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efd72c60 0x5561efd73080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.963+0000 7f065bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efd72c60 0x5561efd73080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56432/0 (socket says 172.21.15.164:56432) 2024-09-13T23:05:31.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.963+0000 7f065bfff640 1 -- 172.21.15.164:0/2321635278 learned_addr learned my addr 172.21.15.164:0/2321635278 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.963+0000 7f065bfff640 1 -- 172.21.15.164:0/2321635278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561efd735c0 con 0x5561efd72c60 2024-09-13T23:05:31.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.964+0000 7f065bfff640 1 --2- 172.21.15.164:0/2321635278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efd72c60 0x5561efd73080 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f064c025bf0 tx=0x7f064c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.964+0000 7f0549ffb640 1 -- 172.21.15.164:0/2321635278 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f064c06f070 con 0x5561efd72c60 2024-09-13T23:05:31.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.964+0000 7f0549ffb640 1 -- 172.21.15.164:0/2321635278 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f064c05f550 con 0x5561efd72c60 2024-09-13T23:05:31.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.964+0000 7f0549ffb640 1 -- 172.21.15.164:0/2321635278 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f064c05f830 con 0x5561efd72c60 2024-09-13T23:05:31.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.964+0000 7f066851f800 1 -- 172.21.15.164:0/2321635278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561efd737f0 con 0x5561efd72c60 2024-09-13T23:05:31.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.964+0000 7f066851f800 1 -- 172.21.15.164:0/2321635278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561efd76470 con 0x5561efd72c60 2024-09-13T23:05:31.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.964+0000 7f0549ffb640 1 -- 172.21.15.164:0/2321635278 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f064c05f9d0 con 0x5561efd72c60 2024-09-13T23:05:31.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.965+0000 7f0549ffb640 1 --2- 172.21.15.164:0/2321635278 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f053c036b90 0x7f053c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.965+0000 7f0549ffb640 1 -- 172.21.15.164:0/2321635278 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f064c092c00 con 0x5561efd72c60 2024-09-13T23:05:31.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.965+0000 7f0664996640 1 --2- 172.21.15.164:0/2321635278 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f053c036b90 0x7f053c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.965+0000 7f066851f800 1 Processor -- start 2024-09-13T23:05:31.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.965+0000 7f0664996640 1 --2- 172.21.15.164:0/2321635278 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f053c036b90 0x7f053c039050 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x5561efd633a0 tx=0x7f065c005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.965+0000 7f066851f800 1 -- start start 2024-09-13T23:05:31.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.965+0000 7f066851f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efd7f800 0x5561efd7fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.965+0000 7f066851f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5561efc61250 con 0x5561efd7f800 2024-09-13T23:05:31.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.965+0000 7f065bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efd7f800 0x5561efd7fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.965+0000 7f065bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efd7f800 0x5561efd7fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56440/0 (socket says 172.21.15.164:56440) 2024-09-13T23:05:31.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.965+0000 7f065bfff640 1 -- 172.21.15.164:0/4264321794 learned_addr learned my addr 172.21.15.164:0/4264321794 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.966+0000 7f065bfff640 1 -- 172.21.15.164:0/4264321794 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561efd801d0 con 0x5561efd7f800 2024-09-13T23:05:31.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.966+0000 7f065bfff640 1 --2- 172.21.15.164:0/4264321794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efd7f800 0x5561efd7fc00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f064c090fa0 tx=0x7f064c05c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582f8ca5d2b8fb0a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.966+0000 7f053b7fe640 1 -- 172.21.15.164:0/4264321794 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f064c05c560 con 0x5561efd7f800 2024-09-13T23:05:31.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.966+0000 7f053b7fe640 1 -- 172.21.15.164:0/4264321794 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f064c06bc10 con 0x5561efd7f800 2024-09-13T23:05:31.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.966+0000 7f053b7fe640 1 -- 172.21.15.164:0/4264321794 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f064c06a560 con 0x5561efd7f800 2024-09-13T23:05:31.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.966+0000 7f066851f800 1 -- 172.21.15.164:0/4264321794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efd7f800 msgr2=0x5561efd7fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:31.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.966+0000 7f066851f800 1 --2- 172.21.15.164:0/4264321794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efd7f800 0x5561efd7fc00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f064c090fa0 tx=0x7f064c05c460 comp rx=0 tx=0).stop 2024-09-13T23:05:31.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.966+0000 7f066851f800 1 -- 172.21.15.164:0/4264321794 shutdown_connections 2024-09-13T23:05:31.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.966+0000 7f066851f800 1 --2- 172.21.15.164:0/4264321794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efd7f800 0x5561efd7fc00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:31.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.966+0000 7f066851f800 1 -- 172.21.15.164:0/4264321794 >> 172.21.15.164:0/4264321794 conn(0x5561efd7bb60 msgr2=0x5561efd79c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:31.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.966+0000 7f066851f800 1 -- 172.21.15.164:0/4264321794 shutdown_connections 2024-09-13T23:05:31.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.967+0000 7f066851f800 1 -- 172.21.15.164:0/4264321794 wait complete. 2024-09-13T23:05:31.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.967+0000 7f066851f800 1 Processor -- start 2024-09-13T23:05:31.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.967+0000 7f066851f800 1 -- start start 2024-09-13T23:05:31.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.967+0000 7f066851f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efd7f800 0x5561efd86cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.967+0000 7f066851f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5561efd80840 con 0x5561efd7f800 2024-09-13T23:05:31.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.967+0000 7f065bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efd7f800 0x5561efd86cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.967+0000 7f065bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efd7f800 0x5561efd86cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56454/0 (socket says 172.21.15.164:56454) 2024-09-13T23:05:31.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.967+0000 7f065bfff640 1 -- 172.21.15.164:0/3789433069 learned_addr learned my addr 172.21.15.164:0/3789433069 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:31.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.967+0000 7f065bfff640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561efd87200 con 0x5561efd7f800 2024-09-13T23:05:31.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.968+0000 7f065bfff640 1 --2- 172.21.15.164:0/3789433069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efd7f800 0x5561efd86cc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f064c069740 tx=0x7f064c090f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.968+0000 7f0539ffb640 1 -- 172.21.15.164:0/3789433069 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f064c06b750 con 0x5561efd7f800 2024-09-13T23:05:31.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.968+0000 7f0539ffb640 1 -- 172.21.15.164:0/3789433069 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f064c092e50 con 0x5561efd7f800 2024-09-13T23:05:31.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.968+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561efd87490 con 0x5561efd7f800 2024-09-13T23:05:31.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.968+0000 7f0539ffb640 1 -- 172.21.15.164:0/3789433069 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f064c0699e0 con 0x5561efd7f800 2024-09-13T23:05:31.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.968+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561efd8a140 con 0x5561efd7f800 2024-09-13T23:05:31.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.969+0000 7f0539ffb640 1 -- 172.21.15.164:0/3789433069 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f064c069b80 con 0x5561efd7f800 2024-09-13T23:05:31.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.969+0000 7f0539ffb640 1 --2- 172.21.15.164:0/3789433069 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f052c036b40 0x7f052c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.969+0000 7f0539ffb640 1 -- 172.21.15.164:0/3789433069 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f064c09cca0 con 0x5561efd7f800 2024-09-13T23:05:31.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.969+0000 7f0664996640 1 --2- 172.21.15.164:0/3789433069 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f052c036b40 0x7f052c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.969+0000 7f066851f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.969+0000 7f066851f800 1 --2- 172.21.15.164:0/3789433069 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5561efd92710 0x5561efd94bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.969+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561efd95320 con 0x5561efd92710 2024-09-13T23:05:31.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.969+0000 7f0664195640 1 --2- 172.21.15.164:0/3789433069 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5561efd92710 0x5561efd94bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.969+0000 7f0664996640 1 --2- 172.21.15.164:0/3789433069 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f052c036b40 0x7f052c039000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x5561efd5f830 tx=0x7f065c01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.970+0000 7f0664195640 1 --2- 172.21.15.164:0/3789433069 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5561efd92710 0x5561efd94bd0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.970+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f065402d070 con 0x5561efd92710 2024-09-13T23:05:31.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.970+0000 7f066851f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.970+0000 7f066851f800 20 realm 2024-09-13T23:05:31.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.970+0000 7f066851f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.970+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561efd95730 con 0x5561efd92710 2024-09-13T23:05:31.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.970+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f065402d070 con 0x5561efd92710 2024-09-13T23:05:31.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.970+0000 7f066851f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.970+0000 7f066851f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:31.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.970+0000 7f066851f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.970+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561efd96000 con 0x5561efd92710 2024-09-13T23:05:31.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.970+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f065402d070 con 0x5561efd92710 2024-09-13T23:05:31.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.970+0000 7f066851f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.970+0000 7f066851f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.970+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561efd963a0 con 0x5561efd92710 2024-09-13T23:05:31.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.970+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f065402d070 con 0x5561efd92710 2024-09-13T23:05:31.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.970+0000 7f066851f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:31.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.971+0000 7f066851f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.971+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561efd96800 con 0x5561efd92710 2024-09-13T23:05:31.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.971+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f065402d070 con 0x5561efd92710 2024-09-13T23:05:31.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.971+0000 7f066851f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:31.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.971+0000 7f066851f800 20 searching for the correct realm 2024-09-13T23:05:31.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.971+0000 7f066851f800 1 --2- 172.21.15.164:0/3789433069 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5561efd98850 0x5561efd9ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.971+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x5561efd98850 2024-09-13T23:05:31.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.971+0000 7f065bfff640 1 --2- 172.21.15.164:0/3789433069 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5561efd98850 0x5561efd9ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.971+0000 7f065bfff640 1 --2- 172.21.15.164:0/3789433069 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5561efd98850 0x5561efd9ac40 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.971+0000 7f065bfff640 1 -- 172.21.15.164:0/3789433069 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f064c08bd70 con 0x5561efd98850 2024-09-13T23:05:31.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.971+0000 7f065bfff640 1 --2- 172.21.15.164:0/3789433069 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f064c05f040 0x7f064c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.971+0000 7f065bfff640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x7f064c05f040 2024-09-13T23:05:31.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.972+0000 7f0664996640 1 --2- 172.21.15.164:0/3789433069 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f064c05f040 0x7f064c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.972+0000 7f0664996640 1 --2- 172.21.15.164:0/3789433069 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f064c05f040 0x7f064c05ca00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.972+0000 7f0664996640 1 -- 172.21.15.164:0/3789433069 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f065c01f070 con 0x7f064c05f040 2024-09-13T23:05:31.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.972+0000 7f0664996640 1 --2- 172.21.15.164:0/3789433069 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f065c031040 0x7f065c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:31.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.972+0000 7f0664996640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x7f065c031040 2024-09-13T23:05:31.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.972+0000 7f0664195640 1 --2- 172.21.15.164:0/3789433069 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f065c031040 0x7f065c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:31.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.973+0000 7f0664195640 1 --2- 172.21.15.164:0/3789433069 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f065c031040 0x7f065c032940 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:31.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.973+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f065402d070 con 0x7f065c031040 2024-09-13T23:05:31.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.973+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x5561efd92710 2024-09-13T23:05:31.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.973+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f065402d070 con 0x5561efd92710 2024-09-13T23:05:31.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.973+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x5561efd92710 2024-09-13T23:05:31.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.973+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f065402d070 con 0x5561efd92710 2024-09-13T23:05:31.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.973+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x7f065c031040 2024-09-13T23:05:31.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.974+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f065402d070 con 0x7f065c031040 2024-09-13T23:05:31.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.974+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x7f065c031040 2024-09-13T23:05:31.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.974+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f065402d070 con 0x7f065c031040 2024-09-13T23:05:31.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.974+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x7f064c05f040 2024-09-13T23:05:31.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.974+0000 7f0664996640 1 -- 172.21.15.164:0/3789433069 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f065c01f070 con 0x7f064c05f040 2024-09-13T23:05:31.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.974+0000 7f0664996640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x5561efd98850 2024-09-13T23:05:31.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.974+0000 7f065bfff640 1 -- 172.21.15.164:0/3789433069 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f064c08bd70 con 0x5561efd98850 2024-09-13T23:05:31.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.974+0000 7f065bfff640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x5561efd92710 2024-09-13T23:05:31.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.975+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f065402d070 con 0x5561efd92710 2024-09-13T23:05:31.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.975+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x7f065c031040 2024-09-13T23:05:31.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.975+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f065402d070 con 0x7f065c031040 2024-09-13T23:05:31.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.975+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x5561efd92710 2024-09-13T23:05:31.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.975+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f065402d070 con 0x5561efd92710 2024-09-13T23:05:31.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.975+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x7f064c05f040 2024-09-13T23:05:31.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.975+0000 7f0664996640 1 -- 172.21.15.164:0/3789433069 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f065c01f070 con 0x7f064c05f040 2024-09-13T23:05:31.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.975+0000 7f0664996640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x5561efd98850 2024-09-13T23:05:31.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.976+0000 7f065bfff640 1 -- 172.21.15.164:0/3789433069 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f064c08bd70 con 0x5561efd98850 2024-09-13T23:05:31.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.976+0000 7f065bfff640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x5561efd98850 2024-09-13T23:05:31.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.976+0000 7f065bfff640 1 -- 172.21.15.164:0/3789433069 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f064c08bd70 con 0x5561efd98850 2024-09-13T23:05:31.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.976+0000 7f065bfff640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x7f065c031040 2024-09-13T23:05:31.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.976+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f065402d070 con 0x7f065c031040 2024-09-13T23:05:31.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.976+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x5561efd98850 2024-09-13T23:05:31.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.976+0000 7f065bfff640 1 -- 172.21.15.164:0/3789433069 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f064c08bd70 con 0x5561efd98850 2024-09-13T23:05:31.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.976+0000 7f065bfff640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x5561efd98850 2024-09-13T23:05:31.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.977+0000 7f065bfff640 1 -- 172.21.15.164:0/3789433069 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f064c08bd70 con 0x5561efd98850 2024-09-13T23:05:31.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.977+0000 7f065bfff640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x5561efd92710 2024-09-13T23:05:31.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.977+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f065402d070 con 0x5561efd92710 2024-09-13T23:05:31.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.977+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x5561efd92710 2024-09-13T23:05:31.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.977+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f065402d070 con 0x5561efd92710 2024-09-13T23:05:31.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.977+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x7f065c031040 2024-09-13T23:05:31.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.977+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f065402d070 con 0x7f065c031040 2024-09-13T23:05:31.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.977+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x5561efd98850 2024-09-13T23:05:31.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.977+0000 7f065bfff640 1 -- 172.21.15.164:0/3789433069 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f064c08bd70 con 0x5561efd98850 2024-09-13T23:05:31.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.977+0000 7f065bfff640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x7f064c05f040 2024-09-13T23:05:31.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.978+0000 7f0664996640 1 -- 172.21.15.164:0/3789433069 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f065c01f070 con 0x7f064c05f040 2024-09-13T23:05:31.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.978+0000 7f0664996640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x5561efd92710 2024-09-13T23:05:31.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.978+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f065402d070 con 0x5561efd92710 2024-09-13T23:05:31.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.978+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x7f065c031040 2024-09-13T23:05:31.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.978+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f065402d070 con 0x7f065c031040 2024-09-13T23:05:31.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.978+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x5561efd98850 2024-09-13T23:05:31.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.979+0000 7f065bfff640 1 -- 172.21.15.164:0/3789433069 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f064c08bd70 con 0x5561efd98850 2024-09-13T23:05:31.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.979+0000 7f065bfff640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x7f065c031040 2024-09-13T23:05:31.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.979+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f065402d070 con 0x7f065c031040 2024-09-13T23:05:31.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.979+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x7f064c05f040 2024-09-13T23:05:31.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.979+0000 7f0664996640 1 -- 172.21.15.164:0/3789433069 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f065c01f070 con 0x7f064c05f040 2024-09-13T23:05:31.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.979+0000 7f0664996640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x5561efd98850 2024-09-13T23:05:31.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.979+0000 7f065bfff640 1 -- 172.21.15.164:0/3789433069 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f064c08bd70 con 0x5561efd98850 2024-09-13T23:05:31.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.979+0000 7f065bfff640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x7f065c031040 2024-09-13T23:05:31.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.980+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f065402d070 con 0x7f065c031040 2024-09-13T23:05:31.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.980+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x5561efd92710 2024-09-13T23:05:31.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.980+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f065402d070 con 0x5561efd92710 2024-09-13T23:05:31.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.980+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9b2f0 con 0x7f064c05f040 2024-09-13T23:05:31.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.980+0000 7f0664996640 1 -- 172.21.15.164:0/3789433069 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f065c01f070 con 0x7f064c05f040 2024-09-13T23:05:31.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.980+0000 7f066851f800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:31.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.980+0000 7f066851f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:31.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.980+0000 7f066851f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:31.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.980+0000 7f066851f800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:31.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.980+0000 7f066851f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:31.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.980+0000 7f066851f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:31.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.980+0000 7f066851f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.980+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561efd972d0 con 0x5561efd92710 2024-09-13T23:05:31.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.980+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f065402d070 con 0x5561efd92710 2024-09-13T23:05:31.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.980+0000 7f066851f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.980+0000 7f066851f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.980+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561efd97b70 con 0x5561efd92710 2024-09-13T23:05:31.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.981+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f065402d070 con 0x5561efd92710 2024-09-13T23:05:31.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.981+0000 7f066851f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:31.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.981+0000 7f066851f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.981+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561efd96f10 con 0x5561efd92710 2024-09-13T23:05:31.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.981+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f065402d070 con 0x5561efd92710 2024-09-13T23:05:31.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.981+0000 7f066851f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:31.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.981+0000 7f066851f800 20 zone default found 2024-09-13T23:05:31.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.981+0000 7f066851f800 4 Realm: () 2024-09-13T23:05:31.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.981+0000 7f066851f800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:31.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.981+0000 7f066851f800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:31.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.981+0000 7f066851f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:31.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.981+0000 7f066851f800 20 zonegroup default 2024-09-13T23:05:31.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.981+0000 7f066851f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.981+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561efd97b70 con 0x7f065c031040 2024-09-13T23:05:31.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.981+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f065402d070 con 0x7f065c031040 2024-09-13T23:05:31.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.981+0000 7f066851f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.981+0000 7f066851f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.981+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9d130 con 0x5561efd98850 2024-09-13T23:05:31.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.981+0000 7f065bfff640 1 -- 172.21.15.164:0/3789433069 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f064c08bd70 con 0x5561efd98850 2024-09-13T23:05:31.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.981+0000 7f066851f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.981+0000 7f066851f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:31.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.981+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9d4d0 con 0x5561efd98850 2024-09-13T23:05:31.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.982+0000 7f065bfff640 1 -- 172.21.15.164:0/3789433069 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f064c08bd70 con 0x5561efd98850 2024-09-13T23:05:31.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.982+0000 7f066851f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:31.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.982+0000 7f066851f800 20 started sync module instance, tier type = 2024-09-13T23:05:31.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.982+0000 7f066851f800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:31.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.982+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9c5d0 con 0x7f064c05f040 2024-09-13T23:05:32.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.983+0000 7f0664996640 1 -- 172.21.15.164:0/3789433069 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f065c040040 con 0x7f064c05f040 2024-09-13T23:05:32.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.983+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93879124216256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9c230 con 0x7f064c05f040 2024-09-13T23:05:32.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.983+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9e390 con 0x5561efd92710 2024-09-13T23:05:32.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.984+0000 7f0664996640 1 -- 172.21.15.164:0/3789433069 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93879124216256] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f065c040040 con 0x7f064c05f040 2024-09-13T23:05:32.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.984+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f065402d070 con 0x5561efd92710 2024-09-13T23:05:32.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.984+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93879124220096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9e390 con 0x5561efd92710 2024-09-13T23:05:32.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.984+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9ee00 con 0x5561efd98850 2024-09-13T23:05:32.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.985+0000 7f065bfff640 1 -- 172.21.15.164:0/3789433069 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f064c08bd70 con 0x5561efd98850 2024-09-13T23:05:32.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.985+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93879124224240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9f6a0 con 0x5561efd98850 2024-09-13T23:05:32.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.985+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561efda0160 con 0x7f064c05f040 2024-09-13T23:05:32.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.985+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93879124220096] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f065402d070 con 0x5561efd92710 2024-09-13T23:05:32.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.986+0000 7f065bfff640 1 -- 172.21.15.164:0/3789433069 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93879124224240] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f064c08bd70 con 0x5561efd98850 2024-09-13T23:05:32.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.986+0000 7f0664996640 1 -- 172.21.15.164:0/3789433069 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f065c040040 con 0x7f064c05f040 2024-09-13T23:05:32.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.986+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93879124226544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9dee0 con 0x7f064c05f040 2024-09-13T23:05:32.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.986+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561efda0a40 con 0x5561efd92710 2024-09-13T23:05:32.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.987+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f065402d070 con 0x5561efd92710 2024-09-13T23:05:32.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.987+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93879124231504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561efda09d0 con 0x5561efd92710 2024-09-13T23:05:32.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.987+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561efda19e0 con 0x7f065c031040 2024-09-13T23:05:32.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.987+0000 7f0664996640 1 -- 172.21.15.164:0/3789433069 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93879124226544] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f065c040040 con 0x7f064c05f040 2024-09-13T23:05:32.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.988+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f065402d070 con 0x7f065c031040 2024-09-13T23:05:32.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.988+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93879124235440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561efda19a0 con 0x7f065c031040 2024-09-13T23:05:32.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.988+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561efda2430 con 0x7f065c031040 2024-09-13T23:05:32.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.988+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93879124231504] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f065402d070 con 0x5561efd92710 2024-09-13T23:05:32.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.989+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93879124235440] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f065402d070 con 0x7f065c031040 2024-09-13T23:05:32.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.989+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f065402d070 con 0x7f065c031040 2024-09-13T23:05:32.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.989+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93879124229168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561efda1f40 con 0x7f065c031040 2024-09-13T23:05:32.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.989+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561efda2900 con 0x7f065c031040 2024-09-13T23:05:32.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.990+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93879124229168] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f065402d070 con 0x7f065c031040 2024-09-13T23:05:32.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.990+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f065402d070 con 0x7f065c031040 2024-09-13T23:05:32.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.990+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93879124233776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561efda2900 con 0x7f065c031040 2024-09-13T23:05:32.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.990+0000 7f066851f800 20 add_watcher() i=0 2024-09-13T23:05:32.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.990+0000 7f066851f800 20 add_watcher() i=1 2024-09-13T23:05:32.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.990+0000 7f066851f800 20 add_watcher() i=2 2024-09-13T23:05:32.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.990+0000 7f066851f800 20 add_watcher() i=3 2024-09-13T23:05:32.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.990+0000 7f066851f800 20 add_watcher() i=4 2024-09-13T23:05:32.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.990+0000 7f066851f800 20 add_watcher() i=5 2024-09-13T23:05:32.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.990+0000 7f066851f800 20 add_watcher() i=6 2024-09-13T23:05:32.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.991+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93879124233776] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f065402d070 con 0x7f065c031040 2024-09-13T23:05:32.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.991+0000 7f066851f800 20 add_watcher() i=7 2024-09-13T23:05:32.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.991+0000 7f066851f800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:32.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.991+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561efda5c50 con 0x5561efd92710 2024-09-13T23:05:32.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.992+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f065402d070 con 0x5561efd92710 2024-09-13T23:05:32.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.992+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93879124252256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561efda2a70 con 0x5561efd92710 2024-09-13T23:05:32.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.992+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93879124252256] v32'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f065402d070 con 0x5561efd92710 2024-09-13T23:05:32.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.993+0000 7f051a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:32.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.993+0000 7f066851f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:32.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.993+0000 7f066851f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:32.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.993+0000 7f066851f800 5 note: GC not initialized 2024-09-13T23:05:32.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.993+0000 7f05197e2640 20 reqs_thread_entry: start 2024-09-13T23:05:32.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.993+0000 7f066851f800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:32.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.993+0000 7f066851f800 20 Filter name: none 2024-09-13T23:05:32.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.993+0000 7f048affd640 20 reqs_thread_entry: start 2024-09-13T23:05:32.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.993+0000 7f066851f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.993+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561efdd8c10 con 0x5561efd92710 2024-09-13T23:05:32.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.994+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f065402d070 con 0x5561efd92710 2024-09-13T23:05:32.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.994+0000 7f066851f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:05:32.005 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:05:31.300851Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:05:31.300826Z","tags":[],"group_ids":[]} 2024-09-13T23:05:32.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.994+0000 7f051a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:32.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.994+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93879124252256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561efda4640 con 0x5561efd92710 2024-09-13T23:05:32.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.995+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93879124252256] v32'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f065402d070 con 0x5561efd92710 2024-09-13T23:05:32.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.995+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93879124216256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561efda5660 con 0x7f064c05f040 2024-09-13T23:05:32.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.996+0000 7f0664996640 1 -- 172.21.15.164:0/3789433069 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93879124216256] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f065c040040 con 0x7f064c05f040 2024-09-13T23:05:32.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.997+0000 7f066851f800 20 remove_watcher() i=0 2024-09-13T23:05:32.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.997+0000 7f066851f800 2 removed watcher, disabling cache 2024-09-13T23:05:32.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.997+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93879124220096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561efda5660 con 0x5561efd92710 2024-09-13T23:05:32.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.998+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93879124220096] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f065402d070 con 0x5561efd92710 2024-09-13T23:05:32.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.998+0000 7f066851f800 20 remove_watcher() i=1 2024-09-13T23:05:32.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.998+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93879124224240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9d8c0 con 0x5561efd98850 2024-09-13T23:05:32.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.999+0000 7f065bfff640 1 -- 172.21.15.164:0/3789433069 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93879124224240] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f064c08bd70 con 0x5561efd98850 2024-09-13T23:05:32.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.999+0000 7f066851f800 20 remove_watcher() i=2 2024-09-13T23:05:32.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:31.999+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93879124226544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561efda5660 con 0x7f064c05f040 2024-09-13T23:05:32.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.000+0000 7f0664996640 1 -- 172.21.15.164:0/3789433069 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93879124226544] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f065c040040 con 0x7f064c05f040 2024-09-13T23:05:32.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.000+0000 7f066851f800 20 remove_watcher() i=3 2024-09-13T23:05:32.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.000+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93879124231504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9e8f0 con 0x5561efd92710 2024-09-13T23:05:32.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.001+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93879124231504] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f065402d070 con 0x5561efd92710 2024-09-13T23:05:32.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.001+0000 7f066851f800 20 remove_watcher() i=4 2024-09-13T23:05:32.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.001+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93879124235440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561efda5660 con 0x7f065c031040 2024-09-13T23:05:32.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.002+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93879124235440] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f065402d070 con 0x7f065c031040 2024-09-13T23:05:32.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.002+0000 7f066851f800 20 remove_watcher() i=5 2024-09-13T23:05:32.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.002+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93879124229168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561efda0550 con 0x7f065c031040 2024-09-13T23:05:32.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.002+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93879124229168] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f065402d070 con 0x7f065c031040 2024-09-13T23:05:32.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.003+0000 7f066851f800 20 remove_watcher() i=6 2024-09-13T23:05:32.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.003+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93879124233776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561efd9e8f0 con 0x7f065c031040 2024-09-13T23:05:32.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.003+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93879124233776] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f065402d070 con 0x7f065c031040 2024-09-13T23:05:32.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.003+0000 7f066851f800 20 remove_watcher() i=7 2024-09-13T23:05:32.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.004+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f065c031040 msgr2=0x7f065c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.004+0000 7f066851f800 1 --2- 172.21.15.164:0/3789433069 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f065c031040 0x7f065c032940 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.004+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5561efd92710 msgr2=0x5561efd94bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.004+0000 7f066851f800 1 --2- 172.21.15.164:0/3789433069 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5561efd92710 0x5561efd94bd0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.004+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f064c05f040 msgr2=0x7f064c05ca00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.004+0000 7f066851f800 1 --2- 172.21.15.164:0/3789433069 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f064c05f040 0x7f064c05ca00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.004+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5561efd98850 msgr2=0x5561efd9ac40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.004+0000 7f066851f800 1 --2- 172.21.15.164:0/3789433069 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5561efd98850 0x5561efd9ac40 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.004+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f052c036b40 msgr2=0x7f052c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.004+0000 7f066851f800 1 --2- 172.21.15.164:0/3789433069 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f052c036b40 0x7f052c039000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x5561efd5f830 tx=0x7f065c01f000 comp rx=0 tx=0).stop 2024-09-13T23:05:32.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.004+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efd7f800 msgr2=0x5561efd86cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.004+0000 7f0664195640 1 -- 172.21.15.164:0/3789433069 reap_dead start 2024-09-13T23:05:32.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.004+0000 7f066851f800 1 --2- 172.21.15.164:0/3789433069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efd7f800 0x5561efd86cc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f064c069740 tx=0x7f064c090f00 comp rx=0 tx=0).stop 2024-09-13T23:05:32.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.004+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 shutdown_connections 2024-09-13T23:05:32.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.004+0000 7f066851f800 1 --2- 172.21.15.164:0/3789433069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efd7f800 0x5561efd86cc0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.004+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 >> 172.21.15.164:0/3789433069 conn(0x5561efd7bb60 msgr2=0x5561efd79c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.004+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 shutdown_connections 2024-09-13T23:05:32.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.004+0000 7f066851f800 1 -- 172.21.15.164:0/3789433069 wait complete. 2024-09-13T23:05:32.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.004+0000 7f066851f800 1 -- 172.21.15.164:0/2321635278 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f053c036b90 msgr2=0x7f053c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.004+0000 7f066851f800 1 --2- 172.21.15.164:0/2321635278 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f053c036b90 0x7f053c039050 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x5561efd633a0 tx=0x7f065c005840 comp rx=0 tx=0).stop 2024-09-13T23:05:32.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.004+0000 7f066851f800 1 -- 172.21.15.164:0/2321635278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efd72c60 msgr2=0x5561efd73080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.004+0000 7f066851f800 1 --2- 172.21.15.164:0/2321635278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efd72c60 0x5561efd73080 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f064c025bf0 tx=0x7f064c002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.004+0000 7f066851f800 1 -- 172.21.15.164:0/2321635278 shutdown_connections 2024-09-13T23:05:32.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.004+0000 7f066851f800 1 --2- 172.21.15.164:0/2321635278 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f053c036b90 0x7f053c039050 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.004+0000 7f066851f800 1 --2- 172.21.15.164:0/2321635278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efd72c60 0x5561efd73080 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.004+0000 7f066851f800 1 -- 172.21.15.164:0/2321635278 >> 172.21.15.164:0/2321635278 conn(0x5561efd67bf0 msgr2=0x5561efd6a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.004+0000 7f066851f800 1 -- 172.21.15.164:0/2321635278 shutdown_connections 2024-09-13T23:05:32.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.004+0000 7f066851f800 1 -- 172.21.15.164:0/2321635278 wait complete. 2024-09-13T23:05:32.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.005+0000 7f066851f800 1 -- 172.21.15.164:0/1695593550 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5561efc66970 msgr2=0x5561efd62310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.005+0000 7f066851f800 1 --2- 172.21.15.164:0/1695593550 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5561efc66970 0x5561efd62310 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.005+0000 7f066851f800 1 -- 172.21.15.164:0/1695593550 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f054c036b90 msgr2=0x7f054c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.005+0000 7f066851f800 1 --2- 172.21.15.164:0/1695593550 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f054c036b90 0x7f054c039050 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f064c057000 tx=0x7f064c052000 comp rx=0 tx=0).stop 2024-09-13T23:05:32.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.005+0000 7f066851f800 1 -- 172.21.15.164:0/1695593550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efbd6630 msgr2=0x5561efd5b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.005+0000 7f066851f800 1 --2- 172.21.15.164:0/1695593550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efbd6630 0x5561efd5b2a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x5561efc62280 tx=0x7f0654000ed0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.005+0000 7f066851f800 1 -- 172.21.15.164:0/1695593550 shutdown_connections 2024-09-13T23:05:32.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.005+0000 7f066851f800 1 --2- 172.21.15.164:0/1695593550 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5561efc66970 0x5561efd62310 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.005+0000 7f066851f800 1 --2- 172.21.15.164:0/1695593550 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f054c036b90 0x7f054c039050 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.005+0000 7f066851f800 1 --2- 172.21.15.164:0/1695593550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5561efbd6630 0x5561efd5b2a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.005+0000 7f066851f800 1 -- 172.21.15.164:0/1695593550 >> 172.21.15.164:0/1695593550 conn(0x5561efc5cde0 msgr2=0x5561efd4cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.005+0000 7f066851f800 1 -- 172.21.15.164:0/1695593550 shutdown_connections 2024-09-13T23:05:32.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.005+0000 7f066851f800 1 -- 172.21.15.164:0/1695593550 wait complete. 2024-09-13T23:05:32.019 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:05:31.300851Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:05:31.300826Z', 'tags': [], 'group_ids': []} 2024-09-13T23:05:32.019 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-13T23:05:32.019 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-13T23:05:32.019 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-13T23:05:32.063 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:32.064 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:32.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.064+0000 7fafe2928800 1 Processor -- start 2024-09-13T23:05:32.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.064+0000 7fafe2928800 1 -- start start 2024-09-13T23:05:32.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.064+0000 7fafe2928800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x562320aacdb0 0x562320aaf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.064+0000 7fafe2928800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562320965b30 con 0x562320a1a5f0 2024-09-13T23:05:32.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.064+0000 7fafe2928800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x562320947360 con 0x562320aacdb0 2024-09-13T23:05:32.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.064+0000 7fafd7fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x562320aacdb0 0x562320aaf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.064+0000 7fafde61d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x562320a1a5f0 0x562320aab690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40756/0 (socket says 172.21.15.164:40756) 2024-09-13T23:05:32.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.064+0000 7fafde61d640 1 -- 172.21.15.164:0/3429969652 learned_addr learned my addr 172.21.15.164:0/3429969652 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:32.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.065+0000 7fafd7fff640 1 -- 172.21.15.164:0/3429969652 >> v1:172.21.15.17:6789/0 conn(0x562320a1a5f0 legacy=0x562320aab690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.065+0000 7fafdde1c640 1 -- 172.21.15.164:0/3429969652 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 814610539 0 0) 0x562320965b30 con 0x562320a1a5f0 2024-09-13T23:05:32.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.065+0000 7fafd7fff640 1 -- 172.21.15.164:0/3429969652 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56232096de00 con 0x562320aacdb0 2024-09-13T23:05:32.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.066+0000 7fafd7fff640 1 --2- 172.21.15.164:0/3429969652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320aacdb0 0x562320aaf1a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fafc800a470 tx=0x7fafc8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86933c223e94eab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.067+0000 7fafdde1c640 1 -- 172.21.15.164:0/3429969652 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc8053570 con 0x562320aacdb0 2024-09-13T23:05:32.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.067+0000 7fafdde1c640 1 -- 172.21.15.164:0/3429969652 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc8058070 con 0x562320aacdb0 2024-09-13T23:05:32.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.067+0000 7fafdde1c640 1 -- 172.21.15.164:0/3429969652 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc8053880 con 0x562320aacdb0 2024-09-13T23:05:32.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.067+0000 7fafe2928800 1 -- 172.21.15.164:0/3429969652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320aacdb0 msgr2=0x562320aaf1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.067+0000 7fafe2928800 1 --2- 172.21.15.164:0/3429969652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320aacdb0 0x562320aaf1a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fafc800a470 tx=0x7fafc8045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:32.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.067+0000 7fafe2928800 1 -- 172.21.15.164:0/3429969652 shutdown_connections 2024-09-13T23:05:32.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.067+0000 7fafe2928800 1 --2- 172.21.15.164:0/3429969652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320aacdb0 0x562320aaf1a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.067+0000 7fafe2928800 1 -- 172.21.15.164:0/3429969652 >> 172.21.15.164:0/3429969652 conn(0x562320aa0de0 msgr2=0x562320aa3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.067+0000 7fafe2928800 1 -- 172.21.15.164:0/3429969652 shutdown_connections 2024-09-13T23:05:32.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.067+0000 7fafe2928800 1 -- 172.21.15.164:0/3429969652 wait complete. 2024-09-13T23:05:32.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.081+0000 7fafe2928800 1 Processor -- start 2024-09-13T23:05:32.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.081+0000 7fafe2928800 1 -- start start 2024-09-13T23:05:32.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.081+0000 7fafe2928800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320a1a5f0 0x562320b97890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.081+0000 7fafe2928800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5623209f2330 con 0x562320a1a5f0 2024-09-13T23:05:32.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.082+0000 7fafde61d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320a1a5f0 0x562320b97890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.082+0000 7fafde61d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320a1a5f0 0x562320b97890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56470/0 (socket says 172.21.15.164:56470) 2024-09-13T23:05:32.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.082+0000 7fafde61d640 1 -- 172.21.15.164:0/2240211629 learned_addr learned my addr 172.21.15.164:0/2240211629 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.082+0000 7fafde61d640 1 -- 172.21.15.164:0/2240211629 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56232093fbc0 con 0x562320a1a5f0 2024-09-13T23:05:32.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.082+0000 7fafde61d640 1 --2- 172.21.15.164:0/2240211629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320a1a5f0 0x562320b97890 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fafd000b240 tx=0x7fafd000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b166d8f6ec847f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.083+0000 7faecc608640 1 -- 172.21.15.164:0/2240211629 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafd0008070 con 0x562320a1a5f0 2024-09-13T23:05:32.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.083+0000 7faecc608640 1 -- 172.21.15.164:0/2240211629 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafd000d500 con 0x562320a1a5f0 2024-09-13T23:05:32.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.083+0000 7faecc608640 1 -- 172.21.15.164:0/2240211629 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafd000d860 con 0x562320a1a5f0 2024-09-13T23:05:32.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.083+0000 7fafe2928800 1 -- 172.21.15.164:0/2240211629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320a1a5f0 msgr2=0x562320b97890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.083+0000 7fafe2928800 1 --2- 172.21.15.164:0/2240211629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320a1a5f0 0x562320b97890 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fafd000b240 tx=0x7fafd000b700 comp rx=0 tx=0).stop 2024-09-13T23:05:32.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.083+0000 7fafe2928800 1 -- 172.21.15.164:0/2240211629 shutdown_connections 2024-09-13T23:05:32.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.083+0000 7fafe2928800 1 --2- 172.21.15.164:0/2240211629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320a1a5f0 0x562320b97890 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.083+0000 7fafe2928800 1 -- 172.21.15.164:0/2240211629 >> 172.21.15.164:0/2240211629 conn(0x562320aa0de0 msgr2=0x562320b93250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.083+0000 7fafe2928800 1 -- 172.21.15.164:0/2240211629 shutdown_connections 2024-09-13T23:05:32.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.083+0000 7fafe2928800 1 -- 172.21.15.164:0/2240211629 wait complete. 2024-09-13T23:05:32.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.084+0000 7fafe2928800 1 Processor -- start 2024-09-13T23:05:32.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.084+0000 7fafe2928800 1 -- start start 2024-09-13T23:05:32.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.084+0000 7fafe2928800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320a1a5f0 0x562320b9f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.084+0000 7fafe2928800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562320aaf980 con 0x562320a1a5f0 2024-09-13T23:05:32.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.084+0000 7fafde61d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320a1a5f0 0x562320b9f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.084+0000 7fafde61d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320a1a5f0 0x562320b9f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56484/0 (socket says 172.21.15.164:56484) 2024-09-13T23:05:32.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.084+0000 7fafde61d640 1 -- 172.21.15.164:0/438934069 learned_addr learned my addr 172.21.15.164:0/438934069 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.084+0000 7fafde61d640 1 -- 172.21.15.164:0/438934069 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562320953fe0 con 0x562320a1a5f0 2024-09-13T23:05:32.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.085+0000 7fafde61d640 1 --2- 172.21.15.164:0/438934069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320a1a5f0 0x562320b9f2f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x562320b986f0 tx=0x7fafd0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.085+0000 7faecae05640 1 -- 172.21.15.164:0/438934069 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafd0019870 con 0x562320a1a5f0 2024-09-13T23:05:32.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.085+0000 7faecae05640 1 -- 172.21.15.164:0/438934069 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafd0019a10 con 0x562320a1a5f0 2024-09-13T23:05:32.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.085+0000 7fafe2928800 1 -- 172.21.15.164:0/438934069 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562320b9f830 con 0x562320a1a5f0 2024-09-13T23:05:32.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.085+0000 7faecae05640 1 -- 172.21.15.164:0/438934069 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafd0019d30 con 0x562320a1a5f0 2024-09-13T23:05:32.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.085+0000 7fafe2928800 1 -- 172.21.15.164:0/438934069 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562320b9fd50 con 0x562320a1a5f0 2024-09-13T23:05:32.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.085+0000 7faecae05640 1 -- 172.21.15.164:0/438934069 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fafd0017040 con 0x562320a1a5f0 2024-09-13T23:05:32.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.086+0000 7faecae05640 1 --2- 172.21.15.164:0/438934069 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faec4036b90 0x7faec4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.086+0000 7faecae05640 1 -- 172.21.15.164:0/438934069 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fafd0015020 con 0x562320a1a5f0 2024-09-13T23:05:32.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.086+0000 7fafd7fff640 1 --2- 172.21.15.164:0/438934069 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faec4036b90 0x7faec4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.086+0000 7fafe2928800 1 --2- 172.21.15.164:0/438934069 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562320aacdb0 0x562320ba6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.086+0000 7fafe2928800 1 -- 172.21.15.164:0/438934069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562320ba68a0 con 0x562320aacdb0 2024-09-13T23:05:32.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.086+0000 7fafdee1e640 1 --2- 172.21.15.164:0/438934069 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562320aacdb0 0x562320ba6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.086+0000 7fafd7fff640 1 --2- 172.21.15.164:0/438934069 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faec4036b90 0x7faec4039050 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fafc8057000 tx=0x7fafc8052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.086+0000 7fafdee1e640 1 --2- 172.21.15.164:0/438934069 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562320aacdb0 0x562320ba6360 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.087+0000 7fafdee1e640 1 -- 172.21.15.164:0/438934069 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafd800a4a0 con 0x562320aacdb0 2024-09-13T23:05:32.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.087+0000 7fafe2928800 1 -- 172.21.15.164:0/438934069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562320ba3930 con 0x562320aacdb0 2024-09-13T23:05:32.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.087+0000 7fafdee1e640 1 -- 172.21.15.164:0/438934069 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fafd800a4a0 con 0x562320aacdb0 2024-09-13T23:05:32.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.087+0000 7fafe2928800 1 -- 172.21.15.164:0/438934069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562320ba86a0 con 0x562320aacdb0 2024-09-13T23:05:32.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.087+0000 7fafdee1e640 1 -- 172.21.15.164:0/438934069 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fafd800a4a0 con 0x562320aacdb0 2024-09-13T23:05:32.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.087+0000 7fafe2928800 1 -- 172.21.15.164:0/438934069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562320ba78d0 con 0x562320aacdb0 2024-09-13T23:05:32.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.087+0000 7fafdee1e640 1 -- 172.21.15.164:0/438934069 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fafd800a4a0 con 0x562320aacdb0 2024-09-13T23:05:32.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.088+0000 7fafe2928800 1 -- 172.21.15.164:0/438934069 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562320ba7d20 con 0x562320aacdb0 2024-09-13T23:05:32.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.088+0000 7fafdee1e640 1 -- 172.21.15.164:0/438934069 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fafd800a4a0 con 0x562320aacdb0 2024-09-13T23:05:32.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.088+0000 7fafe2928800 1 Processor -- start 2024-09-13T23:05:32.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.088+0000 7fafe2928800 1 -- start start 2024-09-13T23:05:32.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.088+0000 7fafe2928800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320bb6c90 0x562320bb70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.088+0000 7fafe2928800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562320941580 con 0x562320bb6c90 2024-09-13T23:05:32.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.089+0000 7fafd7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320bb6c90 0x562320bb70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.089+0000 7fafd7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320bb6c90 0x562320bb70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56496/0 (socket says 172.21.15.164:56496) 2024-09-13T23:05:32.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.089+0000 7fafd7fff640 1 -- 172.21.15.164:0/108764549 learned_addr learned my addr 172.21.15.164:0/108764549 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.089+0000 7fafd7fff640 1 -- 172.21.15.164:0/108764549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562320bb75f0 con 0x562320bb6c90 2024-09-13T23:05:32.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.089+0000 7fafd7fff640 1 --2- 172.21.15.164:0/108764549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320bb6c90 0x562320bb70b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fafc8025bf0 tx=0x7fafc8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.089+0000 7faec3fff640 1 -- 172.21.15.164:0/108764549 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc806f070 con 0x562320bb6c90 2024-09-13T23:05:32.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.089+0000 7faec3fff640 1 -- 172.21.15.164:0/108764549 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc805f550 con 0x562320bb6c90 2024-09-13T23:05:32.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.089+0000 7faec3fff640 1 -- 172.21.15.164:0/108764549 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc805f830 con 0x562320bb6c90 2024-09-13T23:05:32.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.089+0000 7fafe2928800 1 -- 172.21.15.164:0/108764549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562320bb7820 con 0x562320bb6c90 2024-09-13T23:05:32.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.089+0000 7fafe2928800 1 -- 172.21.15.164:0/108764549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562320bba490 con 0x562320bb6c90 2024-09-13T23:05:32.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.090+0000 7faec3fff640 1 -- 172.21.15.164:0/108764549 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fafc805f9d0 con 0x562320bb6c90 2024-09-13T23:05:32.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.090+0000 7faec3fff640 1 --2- 172.21.15.164:0/108764549 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faeb8036b90 0x7faeb8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.090+0000 7faec3fff640 1 -- 172.21.15.164:0/108764549 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fafc8092c40 con 0x562320bb6c90 2024-09-13T23:05:32.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.091+0000 7fafdee1e640 1 --2- 172.21.15.164:0/108764549 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faeb8036b90 0x7faeb8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.091+0000 7fafe2928800 1 Processor -- start 2024-09-13T23:05:32.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.091+0000 7fafdee1e640 1 --2- 172.21.15.164:0/108764549 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faeb8036b90 0x7faeb8039050 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x562320ba73f0 tx=0x7fafd8005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.091+0000 7fafe2928800 1 -- start start 2024-09-13T23:05:32.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.091+0000 7fafe2928800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320bc3820 0x562320bc3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.091+0000 7fafe2928800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562320b98040 con 0x562320bc3820 2024-09-13T23:05:32.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.091+0000 7fafd7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320bc3820 0x562320bc3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.091+0000 7fafd7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320bc3820 0x562320bc3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56502/0 (socket says 172.21.15.164:56502) 2024-09-13T23:05:32.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.091+0000 7fafd7fff640 1 -- 172.21.15.164:0/1147806945 learned_addr learned my addr 172.21.15.164:0/1147806945 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.091+0000 7fafd7fff640 1 -- 172.21.15.164:0/1147806945 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562320bc41f0 con 0x562320bc3820 2024-09-13T23:05:32.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.092+0000 7fafd7fff640 1 --2- 172.21.15.164:0/1147806945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320bc3820 0x562320bc3c20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fafc8090fa0 tx=0x7fafc805c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a0e79203040295 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.092+0000 7faec1ffb640 1 -- 172.21.15.164:0/1147806945 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc805c560 con 0x562320bc3820 2024-09-13T23:05:32.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.092+0000 7faec1ffb640 1 -- 172.21.15.164:0/1147806945 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc806bc10 con 0x562320bc3820 2024-09-13T23:05:32.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.092+0000 7faec1ffb640 1 -- 172.21.15.164:0/1147806945 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc806a560 con 0x562320bc3820 2024-09-13T23:05:32.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.092+0000 7fafe2928800 1 -- 172.21.15.164:0/1147806945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320bc3820 msgr2=0x562320bc3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.092+0000 7fafe2928800 1 --2- 172.21.15.164:0/1147806945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320bc3820 0x562320bc3c20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fafc8090fa0 tx=0x7fafc805c460 comp rx=0 tx=0).stop 2024-09-13T23:05:32.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.092+0000 7fafe2928800 1 -- 172.21.15.164:0/1147806945 shutdown_connections 2024-09-13T23:05:32.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.092+0000 7fafe2928800 1 --2- 172.21.15.164:0/1147806945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320bc3820 0x562320bc3c20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.092+0000 7fafe2928800 1 -- 172.21.15.164:0/1147806945 >> 172.21.15.164:0/1147806945 conn(0x562320bbfb80 msgr2=0x562320bbdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.092+0000 7fafe2928800 1 -- 172.21.15.164:0/1147806945 shutdown_connections 2024-09-13T23:05:32.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.092+0000 7fafe2928800 1 -- 172.21.15.164:0/1147806945 wait complete. 2024-09-13T23:05:32.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.093+0000 7fafe2928800 1 Processor -- start 2024-09-13T23:05:32.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.093+0000 7fafe2928800 1 -- start start 2024-09-13T23:05:32.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.093+0000 7fafe2928800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320bc3820 0x562320bcace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.093+0000 7fafe2928800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562320bc4860 con 0x562320bc3820 2024-09-13T23:05:32.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.093+0000 7fafd7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320bc3820 0x562320bcace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.093+0000 7fafd7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320bc3820 0x562320bcace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56504/0 (socket says 172.21.15.164:56504) 2024-09-13T23:05:32.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.093+0000 7fafd7fff640 1 -- 172.21.15.164:0/2063280504 learned_addr learned my addr 172.21.15.164:0/2063280504 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.093+0000 7fafd7fff640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562320bcb220 con 0x562320bc3820 2024-09-13T23:05:32.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.094+0000 7fafd7fff640 1 --2- 172.21.15.164:0/2063280504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320bc3820 0x562320bcace0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fafc8053db0 tx=0x7fafc8090f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.094+0000 7faeaffff640 1 -- 172.21.15.164:0/2063280504 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc806a8a0 con 0x562320bc3820 2024-09-13T23:05:32.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.094+0000 7faeaffff640 1 -- 172.21.15.164:0/2063280504 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc808a040 con 0x562320bc3820 2024-09-13T23:05:32.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.094+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562320bcb4b0 con 0x562320bc3820 2024-09-13T23:05:32.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.094+0000 7faeaffff640 1 -- 172.21.15.164:0/2063280504 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc806b540 con 0x562320bc3820 2024-09-13T23:05:32.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.094+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562320bce160 con 0x562320bc3820 2024-09-13T23:05:32.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.094+0000 7faeaffff640 1 -- 172.21.15.164:0/2063280504 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fafc80699e0 con 0x562320bc3820 2024-09-13T23:05:32.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.095+0000 7faeaffff640 1 --2- 172.21.15.164:0/2063280504 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faea8036b40 0x7faea8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.095+0000 7faeaffff640 1 -- 172.21.15.164:0/2063280504 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fafc809cca0 con 0x562320bc3820 2024-09-13T23:05:32.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.095+0000 7fafdee1e640 1 --2- 172.21.15.164:0/2063280504 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faea8036b40 0x7faea8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.095+0000 7fafdee1e640 1 --2- 172.21.15.164:0/2063280504 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faea8036b40 0x7faea8039000 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x562320ba3880 tx=0x7fafd801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.095+0000 7fafe2928800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.095+0000 7fafe2928800 1 --2- 172.21.15.164:0/2063280504 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562320bd67d0 0x562320bd8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.095+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562320bd93e0 con 0x562320bd67d0 2024-09-13T23:05:32.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.096+0000 7fafde61d640 1 --2- 172.21.15.164:0/2063280504 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562320bd67d0 0x562320bd8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.096+0000 7fafde61d640 1 --2- 172.21.15.164:0/2063280504 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562320bd67d0 0x562320bd8c90 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.096+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.096+0000 7fafe2928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.096+0000 7fafe2928800 20 realm 2024-09-13T23:05:32.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.096+0000 7fafe2928800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.096+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562320bd97f0 con 0x562320bd67d0 2024-09-13T23:05:32.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.096+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.096+0000 7fafe2928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.096+0000 7fafe2928800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:32.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.096+0000 7fafe2928800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.096+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562320bda0c0 con 0x562320bd67d0 2024-09-13T23:05:32.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.096+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.096+0000 7fafe2928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.096+0000 7fafe2928800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.096+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562320bda460 con 0x562320bd67d0 2024-09-13T23:05:32.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.097+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.097+0000 7fafe2928800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:32.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.097+0000 7fafe2928800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.097+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562320bdacb0 con 0x562320bd67d0 2024-09-13T23:05:32.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.097+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.097+0000 7fafe2928800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:32.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.097+0000 7fafe2928800 20 searching for the correct realm 2024-09-13T23:05:32.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.097+0000 7fafe2928800 1 --2- 172.21.15.164:0/2063280504 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x562320bdca20 0x562320bdee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.097+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x562320bdca20 2024-09-13T23:05:32.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.097+0000 7fafd7fff640 1 --2- 172.21.15.164:0/2063280504 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x562320bdca20 0x562320bdee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.097+0000 7fafd7fff640 1 --2- 172.21.15.164:0/2063280504 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x562320bdca20 0x562320bdee10 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.098+0000 7fafd7fff640 1 -- 172.21.15.164:0/2063280504 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc808bd70 con 0x562320bdca20 2024-09-13T23:05:32.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.098+0000 7fafd7fff640 1 --2- 172.21.15.164:0/2063280504 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fafc805f040 0x7fafc8087160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.098+0000 7fafd7fff640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x7fafc805f040 2024-09-13T23:05:32.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.098+0000 7fafdee1e640 1 --2- 172.21.15.164:0/2063280504 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fafc805f040 0x7fafc8087160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.098+0000 7fafdee1e640 1 --2- 172.21.15.164:0/2063280504 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fafc805f040 0x7fafc8087160 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.098+0000 7fafdee1e640 1 -- 172.21.15.164:0/2063280504 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafd801f070 con 0x7fafc805f040 2024-09-13T23:05:32.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.098+0000 7fafdee1e640 1 --2- 172.21.15.164:0/2063280504 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fafd8031040 0x7fafd8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.098+0000 7fafdee1e640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x7fafd8031040 2024-09-13T23:05:32.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.099+0000 7fafde61d640 1 --2- 172.21.15.164:0/2063280504 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fafd8031040 0x7fafd8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.099+0000 7fafde61d640 1 --2- 172.21.15.164:0/2063280504 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fafd8031040 0x7fafd8032940 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.099+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafd002d070 con 0x7fafd8031040 2024-09-13T23:05:32.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.099+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x562320bd67d0 2024-09-13T23:05:32.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.099+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.099+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x562320bd67d0 2024-09-13T23:05:32.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.100+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.100+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x7fafd8031040 2024-09-13T23:05:32.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.100+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafd002d070 con 0x7fafd8031040 2024-09-13T23:05:32.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.100+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x7fafd8031040 2024-09-13T23:05:32.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.100+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafd002d070 con 0x7fafd8031040 2024-09-13T23:05:32.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.100+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x7fafc805f040 2024-09-13T23:05:32.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.100+0000 7fafdee1e640 1 -- 172.21.15.164:0/2063280504 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafd801f070 con 0x7fafc805f040 2024-09-13T23:05:32.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.100+0000 7fafdee1e640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x562320bdca20 2024-09-13T23:05:32.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.101+0000 7fafd7fff640 1 -- 172.21.15.164:0/2063280504 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc808bd70 con 0x562320bdca20 2024-09-13T23:05:32.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.101+0000 7fafd7fff640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x562320bd67d0 2024-09-13T23:05:32.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.101+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.101+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x7fafd8031040 2024-09-13T23:05:32.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.101+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafd002d070 con 0x7fafd8031040 2024-09-13T23:05:32.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.101+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x562320bd67d0 2024-09-13T23:05:32.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.101+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.101+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x7fafc805f040 2024-09-13T23:05:32.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.102+0000 7fafdee1e640 1 -- 172.21.15.164:0/2063280504 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fafd801f070 con 0x7fafc805f040 2024-09-13T23:05:32.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.102+0000 7fafdee1e640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x562320bdca20 2024-09-13T23:05:32.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.102+0000 7fafd7fff640 1 -- 172.21.15.164:0/2063280504 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc808bd70 con 0x562320bdca20 2024-09-13T23:05:32.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.102+0000 7fafd7fff640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x562320bdca20 2024-09-13T23:05:32.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.102+0000 7fafd7fff640 1 -- 172.21.15.164:0/2063280504 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc808bd70 con 0x562320bdca20 2024-09-13T23:05:32.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.102+0000 7fafd7fff640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x7fafd8031040 2024-09-13T23:05:32.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.102+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafd002d070 con 0x7fafd8031040 2024-09-13T23:05:32.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.102+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x562320bdca20 2024-09-13T23:05:32.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.103+0000 7fafd7fff640 1 -- 172.21.15.164:0/2063280504 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc808bd70 con 0x562320bdca20 2024-09-13T23:05:32.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.103+0000 7fafd7fff640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x562320bdca20 2024-09-13T23:05:32.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.103+0000 7fafd7fff640 1 -- 172.21.15.164:0/2063280504 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc808bd70 con 0x562320bdca20 2024-09-13T23:05:32.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.103+0000 7fafd7fff640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x562320bd67d0 2024-09-13T23:05:32.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.103+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.103+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x562320bd67d0 2024-09-13T23:05:32.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.103+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.103+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x7fafd8031040 2024-09-13T23:05:32.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.104+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafd002d070 con 0x7fafd8031040 2024-09-13T23:05:32.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.104+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x562320bdca20 2024-09-13T23:05:32.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.104+0000 7fafd7fff640 1 -- 172.21.15.164:0/2063280504 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc808bd70 con 0x562320bdca20 2024-09-13T23:05:32.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.104+0000 7fafd7fff640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x7fafc805f040 2024-09-13T23:05:32.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.104+0000 7fafdee1e640 1 -- 172.21.15.164:0/2063280504 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafd801f070 con 0x7fafc805f040 2024-09-13T23:05:32.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.104+0000 7fafdee1e640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x562320bd67d0 2024-09-13T23:05:32.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.104+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.104+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x7fafd8031040 2024-09-13T23:05:32.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.105+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafd002d070 con 0x7fafd8031040 2024-09-13T23:05:32.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.105+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x562320bdca20 2024-09-13T23:05:32.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.105+0000 7fafd7fff640 1 -- 172.21.15.164:0/2063280504 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc808bd70 con 0x562320bdca20 2024-09-13T23:05:32.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.105+0000 7fafd7fff640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x7fafd8031040 2024-09-13T23:05:32.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.105+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafd002d070 con 0x7fafd8031040 2024-09-13T23:05:32.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.105+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x7fafc805f040 2024-09-13T23:05:32.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.106+0000 7fafdee1e640 1 -- 172.21.15.164:0/2063280504 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafd801f070 con 0x7fafc805f040 2024-09-13T23:05:32.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.106+0000 7fafdee1e640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x562320bdca20 2024-09-13T23:05:32.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.106+0000 7fafd7fff640 1 -- 172.21.15.164:0/2063280504 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc808bd70 con 0x562320bdca20 2024-09-13T23:05:32.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.106+0000 7fafd7fff640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x7fafd8031040 2024-09-13T23:05:32.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.106+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafd002d070 con 0x7fafd8031040 2024-09-13T23:05:32.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.106+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x562320bd67d0 2024-09-13T23:05:32.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.106+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.106+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf440 con 0x7fafc805f040 2024-09-13T23:05:32.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.107+0000 7fafdee1e640 1 -- 172.21.15.164:0/2063280504 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafd801f070 con 0x7fafc805f040 2024-09-13T23:05:32.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.107+0000 7fafe2928800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:32.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.107+0000 7fafe2928800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:32.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.107+0000 7fafe2928800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:32.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.107+0000 7fafe2928800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:32.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.107+0000 7fafe2928800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:32.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.107+0000 7fafe2928800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:32.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.107+0000 7fafe2928800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.107+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562320bdb630 con 0x562320bd67d0 2024-09-13T23:05:32.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.107+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.107+0000 7fafe2928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.107+0000 7fafe2928800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.107+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562320bdbed0 con 0x562320bd67d0 2024-09-13T23:05:32.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.107+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.107+0000 7fafe2928800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:32.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.107+0000 7fafe2928800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.107+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562320bdf8c0 con 0x562320bd67d0 2024-09-13T23:05:32.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.107+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.107+0000 7fafe2928800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:32.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.107+0000 7fafe2928800 20 zone default found 2024-09-13T23:05:32.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.107+0000 7fafe2928800 4 Realm: () 2024-09-13T23:05:32.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.107+0000 7fafe2928800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:32.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.107+0000 7fafe2928800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:32.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.107+0000 7fafe2928800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:32.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.107+0000 7fafe2928800 20 zonegroup default 2024-09-13T23:05:32.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.107+0000 7fafe2928800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.107+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562320bdbb30 con 0x7fafd8031040 2024-09-13T23:05:32.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.108+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fafd002d070 con 0x7fafd8031040 2024-09-13T23:05:32.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.108+0000 7fafe2928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.108+0000 7fafe2928800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.108+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562320be17a0 con 0x562320bdca20 2024-09-13T23:05:32.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.108+0000 7fafd7fff640 1 -- 172.21.15.164:0/2063280504 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fafc808bd70 con 0x562320bdca20 2024-09-13T23:05:32.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.108+0000 7fafe2928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.108+0000 7fafe2928800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.108+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562320be1b40 con 0x562320bdca20 2024-09-13T23:05:32.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.108+0000 7fafd7fff640 1 -- 172.21.15.164:0/2063280504 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fafc808bd70 con 0x562320bdca20 2024-09-13T23:05:32.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.108+0000 7fafe2928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.108+0000 7fafe2928800 20 started sync module instance, tier type = 2024-09-13T23:05:32.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.108+0000 7fafe2928800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:32.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.108+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562320be0c40 con 0x7fafc805f040 2024-09-13T23:05:32.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.109+0000 7fafdee1e640 1 -- 172.21.15.164:0/2063280504 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafd8040040 con 0x7fafc805f040 2024-09-13T23:05:32.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.109+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94708873171040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562320be2420 con 0x7fafc805f040 2024-09-13T23:05:32.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.109+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562320be2c70 con 0x562320bd67d0 2024-09-13T23:05:32.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.110+0000 7fafdee1e640 1 -- 172.21.15.164:0/2063280504 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94708873171040] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafd8040040 con 0x7fafc805f040 2024-09-13T23:05:32.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.111+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.111+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94708873174896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562320be2920 con 0x562320bd67d0 2024-09-13T23:05:32.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.111+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562320be3440 con 0x562320bdca20 2024-09-13T23:05:32.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.112+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94708873174896] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.112+0000 7fafd7fff640 1 -- 172.21.15.164:0/2063280504 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc808bd70 con 0x562320bdca20 2024-09-13T23:05:32.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.112+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94708873178896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562320be3830 con 0x562320bdca20 2024-09-13T23:05:32.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.112+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562320be4230 con 0x7fafc805f040 2024-09-13T23:05:32.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.113+0000 7fafd7fff640 1 -- 172.21.15.164:0/2063280504 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94708873178896] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc808bd70 con 0x562320bdca20 2024-09-13T23:05:32.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.113+0000 7fafdee1e640 1 -- 172.21.15.164:0/2063280504 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafd8040040 con 0x7fafc805f040 2024-09-13T23:05:32.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.113+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94708873175952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562320be4620 con 0x7fafc805f040 2024-09-13T23:05:32.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.113+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562320be5060 con 0x562320bd67d0 2024-09-13T23:05:32.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.114+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.114+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94708873186096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562320be5020 con 0x562320bd67d0 2024-09-13T23:05:32.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.114+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562320be6020 con 0x7fafd8031040 2024-09-13T23:05:32.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.114+0000 7fafdee1e640 1 -- 172.21.15.164:0/2063280504 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94708873175952] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafd8040040 con 0x7fafc805f040 2024-09-13T23:05:32.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.115+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafd002d070 con 0x7fafd8031040 2024-09-13T23:05:32.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.115+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94708873190224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562320be6020 con 0x7fafd8031040 2024-09-13T23:05:32.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.115+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562320be6a30 con 0x7fafd8031040 2024-09-13T23:05:32.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.115+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94708873186096] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.116+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafd002d070 con 0x7fafd8031040 2024-09-13T23:05:32.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.116+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94708873188320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562320be6a30 con 0x7fafd8031040 2024-09-13T23:05:32.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.116+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562320be7430 con 0x7fafd8031040 2024-09-13T23:05:32.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.116+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94708873190224] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafd002d070 con 0x7fafd8031040 2024-09-13T23:05:32.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.117+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafd002d070 con 0x7fafd8031040 2024-09-13T23:05:32.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.117+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94708873182528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562320be73f0 con 0x7fafd8031040 2024-09-13T23:05:32.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.117+0000 7fafe2928800 20 add_watcher() i=0 2024-09-13T23:05:32.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.117+0000 7fafe2928800 20 add_watcher() i=1 2024-09-13T23:05:32.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.117+0000 7fafe2928800 20 add_watcher() i=2 2024-09-13T23:05:32.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.117+0000 7fafe2928800 20 add_watcher() i=3 2024-09-13T23:05:32.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.117+0000 7fafe2928800 20 add_watcher() i=4 2024-09-13T23:05:32.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.117+0000 7fafe2928800 20 add_watcher() i=5 2024-09-13T23:05:32.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.117+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94708873188320] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafd002d070 con 0x7fafd8031040 2024-09-13T23:05:32.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.117+0000 7fafe2928800 20 add_watcher() i=6 2024-09-13T23:05:32.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.118+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94708873182528] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafd002d070 con 0x7fafd8031040 2024-09-13T23:05:32.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.118+0000 7fafe2928800 20 add_watcher() i=7 2024-09-13T23:05:32.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.118+0000 7fafe2928800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:32.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.118+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562320be73f0 con 0x562320bd67d0 2024-09-13T23:05:32.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.118+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.118+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94708873195328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562320be7360 con 0x562320bd67d0 2024-09-13T23:05:32.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.119+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94708873195328] v32'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.119+0000 7fae94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:32.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.120+0000 7fafe2928800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:32.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.120+0000 7fafe2928800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:32.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.120+0000 7fafe2928800 5 note: GC not initialized 2024-09-13T23:05:32.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.120+0000 7fae0f7fe640 20 reqs_thread_entry: start 2024-09-13T23:05:32.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.120+0000 7fafe2928800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:32.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.120+0000 7fafe2928800 20 Filter name: none 2024-09-13T23:05:32.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.120+0000 7fae0d7fa640 20 reqs_thread_entry: start 2024-09-13T23:05:32.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.120+0000 7fafe2928800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:05:32.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.120+0000 7fafe2928800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.120+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562320c1d6d0 con 0x562320bd67d0 2024-09-13T23:05:32.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.120+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.121+0000 7fafe2928800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:05:32.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.121+0000 7fafe2928800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:05:32.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.121+0000 7fafe2928800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:32.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.121+0000 7fafe2928800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:32.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.121+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562320c20160 con 0x7fafc805f040 2024-09-13T23:05:32.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.121+0000 7fafdee1e640 1 -- 172.21.15.164:0/2063280504 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fafd8040040 con 0x7fafc805f040 2024-09-13T23:05:32.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.121+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562320c23a40 con 0x562320bd67d0 2024-09-13T23:05:32.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.122+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v32'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.122+0000 7fafe2928800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:32.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.122+0000 7fafe2928800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:32.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.122+0000 7fafe2928800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:05:32.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.122+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94708873442304 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562320c1f150 con 0x562320bd67d0 2024-09-13T23:05:32.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.122+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== watch-notify(notify (1) cookie 94708873186096 notify 137438953474 ret 0) ==== 609+0+0 (crc 0 0 0) 0x562320b9fd50 con 0x562320bd67d0 2024-09-13T23:05:32.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.122+0000 7faec1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94708873186096 notifier 4337 bl.length()=567 2024-09-13T23:05:32.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.122+0000 7faec1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:32.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.122+0000 7faec1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:32.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.122+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(65 notify.4 [notify cookie 94708873442304 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.122+0000 7faec1ffb640 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7faea4003ea0 con 0x562320bd67d0 2024-09-13T23:05:32.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.123+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.123+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== watch-notify(notify_complete (2) cookie 94708873442304 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562320b9f830 con 0x562320bd67d0 2024-09-13T23:05:32.141 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:05:31.300851Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:05:31.300826Z","tags":[],"group_ids":[]} 2024-09-13T23:05:32.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.124+0000 7fae94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:32.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.124+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94708873195328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562320c1b420 con 0x562320bd67d0 2024-09-13T23:05:32.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.125+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94708873195328] v32'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.125+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94708873171040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562320c1b420 con 0x7fafc805f040 2024-09-13T23:05:32.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.126+0000 7fafdee1e640 1 -- 172.21.15.164:0/2063280504 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94708873171040] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafd8040040 con 0x7fafc805f040 2024-09-13T23:05:32.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.126+0000 7fafe2928800 20 remove_watcher() i=0 2024-09-13T23:05:32.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.126+0000 7fafe2928800 2 removed watcher, disabling cache 2024-09-13T23:05:32.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.126+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94708873174896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562320c1b420 con 0x562320bd67d0 2024-09-13T23:05:32.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.127+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94708873174896] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.127+0000 7fafe2928800 20 remove_watcher() i=1 2024-09-13T23:05:32.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.127+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94708873178896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562320c1b420 con 0x562320bdca20 2024-09-13T23:05:32.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.128+0000 7fafd7fff640 1 -- 172.21.15.164:0/2063280504 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94708873178896] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc808bd70 con 0x562320bdca20 2024-09-13T23:05:32.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.128+0000 7fafe2928800 20 remove_watcher() i=2 2024-09-13T23:05:32.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.128+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94708873175952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562320be1f70 con 0x7fafc805f040 2024-09-13T23:05:32.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.129+0000 7fafdee1e640 1 -- 172.21.15.164:0/2063280504 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94708873175952] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafd8040040 con 0x7fafc805f040 2024-09-13T23:05:32.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.129+0000 7fafe2928800 20 remove_watcher() i=3 2024-09-13T23:05:32.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.129+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94708873186096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562320be2f10 con 0x562320bd67d0 2024-09-13T23:05:32.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.130+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94708873186096] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafd002d070 con 0x562320bd67d0 2024-09-13T23:05:32.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.130+0000 7fafe2928800 20 remove_watcher() i=4 2024-09-13T23:05:32.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.130+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94708873190224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562320be2f10 con 0x7fafd8031040 2024-09-13T23:05:32.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.131+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94708873190224] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafd002d070 con 0x7fafd8031040 2024-09-13T23:05:32.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.131+0000 7fafe2928800 20 remove_watcher() i=5 2024-09-13T23:05:32.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.131+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94708873188320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562320be5b50 con 0x7fafd8031040 2024-09-13T23:05:32.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.132+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94708873188320] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafd002d070 con 0x7fafd8031040 2024-09-13T23:05:32.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.132+0000 7fafe2928800 20 remove_watcher() i=6 2024-09-13T23:05:32.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.132+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94708873182528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562320be2f10 con 0x7fafd8031040 2024-09-13T23:05:32.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.133+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94708873182528] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafd002d070 con 0x7fafd8031040 2024-09-13T23:05:32.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.133+0000 7fafe2928800 20 remove_watcher() i=7 2024-09-13T23:05:32.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.133+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fafd8031040 msgr2=0x7fafd8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.133+0000 7fafe2928800 1 --2- 172.21.15.164:0/2063280504 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fafd8031040 0x7fafd8032940 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.133+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562320bd67d0 msgr2=0x562320bd8c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.133+0000 7fafe2928800 1 --2- 172.21.15.164:0/2063280504 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562320bd67d0 0x562320bd8c90 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.133+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fafc805f040 msgr2=0x7fafc8087160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.133+0000 7fafe2928800 1 --2- 172.21.15.164:0/2063280504 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fafc805f040 0x7fafc8087160 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.133+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x562320bdca20 msgr2=0x562320bdee10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.133+0000 7fafe2928800 1 --2- 172.21.15.164:0/2063280504 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x562320bdca20 0x562320bdee10 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.133+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faea8036b40 msgr2=0x7faea8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.133+0000 7fafe2928800 1 --2- 172.21.15.164:0/2063280504 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faea8036b40 0x7faea8039000 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x562320ba3880 tx=0x7fafd801f000 comp rx=0 tx=0).stop 2024-09-13T23:05:32.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.133+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320bc3820 msgr2=0x562320bcace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.133+0000 7fafe2928800 1 --2- 172.21.15.164:0/2063280504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320bc3820 0x562320bcace0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fafc8053db0 tx=0x7fafc8090f00 comp rx=0 tx=0).stop 2024-09-13T23:05:32.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.133+0000 7fafde61d640 1 -- 172.21.15.164:0/2063280504 reap_dead start 2024-09-13T23:05:32.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.133+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 shutdown_connections 2024-09-13T23:05:32.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.133+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 >> 172.21.15.164:0/2063280504 conn(0x562320bbfb80 msgr2=0x562320bbdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.134+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 shutdown_connections 2024-09-13T23:05:32.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.134+0000 7fafe2928800 1 -- 172.21.15.164:0/2063280504 wait complete. 2024-09-13T23:05:32.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.134+0000 7fafe2928800 1 -- 172.21.15.164:0/108764549 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faeb8036b90 msgr2=0x7faeb8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.134+0000 7fafe2928800 1 --2- 172.21.15.164:0/108764549 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faeb8036b90 0x7faeb8039050 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x562320ba73f0 tx=0x7fafd8005840 comp rx=0 tx=0).stop 2024-09-13T23:05:32.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.134+0000 7fafe2928800 1 -- 172.21.15.164:0/108764549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320bb6c90 msgr2=0x562320bb70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.134+0000 7fafe2928800 1 --2- 172.21.15.164:0/108764549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320bb6c90 0x562320bb70b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fafc8025bf0 tx=0x7fafc8002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.134+0000 7fafe2928800 1 -- 172.21.15.164:0/108764549 shutdown_connections 2024-09-13T23:05:32.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.134+0000 7fafe2928800 1 --2- 172.21.15.164:0/108764549 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faeb8036b90 0x7faeb8039050 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.134+0000 7fafe2928800 1 --2- 172.21.15.164:0/108764549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320bb6c90 0x562320bb70b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.134+0000 7fafe2928800 1 -- 172.21.15.164:0/108764549 >> 172.21.15.164:0/108764549 conn(0x562320babc20 msgr2=0x562320bae7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.134+0000 7fafe2928800 1 -- 172.21.15.164:0/108764549 shutdown_connections 2024-09-13T23:05:32.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.134+0000 7fafe2928800 1 -- 172.21.15.164:0/108764549 wait complete. 2024-09-13T23:05:32.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.134+0000 7fafe2928800 1 -- 172.21.15.164:0/438934069 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562320aacdb0 msgr2=0x562320ba6360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.134+0000 7fafe2928800 1 --2- 172.21.15.164:0/438934069 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562320aacdb0 0x562320ba6360 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.134+0000 7fafe2928800 1 -- 172.21.15.164:0/438934069 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faec4036b90 msgr2=0x7faec4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.134+0000 7fafe2928800 1 --2- 172.21.15.164:0/438934069 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faec4036b90 0x7faec4039050 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fafc8057000 tx=0x7fafc8052000 comp rx=0 tx=0).stop 2024-09-13T23:05:32.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.134+0000 7fafe2928800 1 -- 172.21.15.164:0/438934069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320a1a5f0 msgr2=0x562320b9f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.134+0000 7fafe2928800 1 --2- 172.21.15.164:0/438934069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320a1a5f0 0x562320b9f2f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x562320b986f0 tx=0x7fafd0000ed0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.134+0000 7fafe2928800 1 -- 172.21.15.164:0/438934069 shutdown_connections 2024-09-13T23:05:32.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.134+0000 7fafe2928800 1 --2- 172.21.15.164:0/438934069 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562320aacdb0 0x562320ba6360 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.134+0000 7fafe2928800 1 --2- 172.21.15.164:0/438934069 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faec4036b90 0x7faec4039050 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.134+0000 7fafe2928800 1 --2- 172.21.15.164:0/438934069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562320a1a5f0 0x562320b9f2f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.134+0000 7fafe2928800 1 -- 172.21.15.164:0/438934069 >> 172.21.15.164:0/438934069 conn(0x562320aa0de0 msgr2=0x562320b91ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.134+0000 7fafe2928800 1 -- 172.21.15.164:0/438934069 shutdown_connections 2024-09-13T23:05:32.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.134+0000 7fafe2928800 1 -- 172.21.15.164:0/438934069 wait complete. 2024-09-13T23:05:32.156 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:05:31.300851Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:05:31.300826Z', 'tags': [], 'group_ids': []} 2024-09-13T23:05:32.156 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T23:05:32.156 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T23:05:32.156 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T23:05:32.201 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:32.201 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:32.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.201+0000 7ffb2b836800 1 Processor -- start 2024-09-13T23:05:32.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.201+0000 7ffb2b836800 1 -- start start 2024-09-13T23:05:32.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.201+0000 7ffb2b836800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55856d1ca990 0x55856d1ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.201+0000 7ffb2b836800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55856d086b30 con 0x55856d1c6550 2024-09-13T23:05:32.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.201+0000 7ffb2b836800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55856d068360 con 0x55856d1ca990 2024-09-13T23:05:32.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.201+0000 7ffb26351640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55856d1ca990 0x55856d1ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.201+0000 7ffb26b52640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55856d1c6550 0x55856d1c6950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40766/0 (socket says 172.21.15.164:40766) 2024-09-13T23:05:32.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.201+0000 7ffb26b52640 1 -- 172.21.15.164:0/21100402 learned_addr learned my addr 172.21.15.164:0/21100402 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:32.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.202+0000 7ffb26351640 1 -- 172.21.15.164:0/21100402 >> v1:172.21.15.17:6789/0 conn(0x55856d1c6550 legacy=0x55856d1c6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.202+0000 7ffb26351640 1 -- 172.21.15.164:0/21100402 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55856d08ee00 con 0x55856d1ca990 2024-09-13T23:05:32.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.204+0000 7ffb26351640 1 --2- 172.21.15.164:0/21100402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d1ca990 0x55856d1ccd80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000a470 tx=0x7ffb10045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2279c556472eb385 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.204+0000 7ffb25b50640 1 -- 172.21.15.164:0/21100402 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb10053570 con 0x55856d1ca990 2024-09-13T23:05:32.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.204+0000 7ffb25b50640 1 -- 172.21.15.164:0/21100402 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb10058070 con 0x55856d1ca990 2024-09-13T23:05:32.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.204+0000 7ffb25b50640 1 -- 172.21.15.164:0/21100402 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb10053880 con 0x55856d1ca990 2024-09-13T23:05:32.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.204+0000 7ffb2b836800 1 -- 172.21.15.164:0/21100402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d1ca990 msgr2=0x55856d1ccd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.204+0000 7ffb2b836800 1 --2- 172.21.15.164:0/21100402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d1ca990 0x55856d1ccd80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000a470 tx=0x7ffb10045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:32.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.204+0000 7ffb2b836800 1 -- 172.21.15.164:0/21100402 shutdown_connections 2024-09-13T23:05:32.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.204+0000 7ffb2b836800 1 --2- 172.21.15.164:0/21100402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d1ca990 0x55856d1ccd80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.204+0000 7ffb2b836800 1 -- 172.21.15.164:0/21100402 >> 172.21.15.164:0/21100402 conn(0x55856d1c1de0 msgr2=0x55856d1c4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.204+0000 7ffb2b836800 1 -- 172.21.15.164:0/21100402 shutdown_connections 2024-09-13T23:05:32.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.204+0000 7ffb2b836800 1 -- 172.21.15.164:0/21100402 wait complete. 2024-09-13T23:05:32.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.218+0000 7ffb2b836800 1 Processor -- start 2024-09-13T23:05:32.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.218+0000 7ffb2b836800 1 -- start start 2024-09-13T23:05:32.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.218+0000 7ffb2b836800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d1c6550 0x55856d13b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.218+0000 7ffb2b836800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55856d113330 con 0x55856d1c6550 2024-09-13T23:05:32.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.219+0000 7ffb26b52640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d1c6550 0x55856d13b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.219+0000 7ffb26b52640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d1c6550 0x55856d13b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56512/0 (socket says 172.21.15.164:56512) 2024-09-13T23:05:32.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.219+0000 7ffb26b52640 1 -- 172.21.15.164:0/635761259 learned_addr learned my addr 172.21.15.164:0/635761259 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.219+0000 7ffb26b52640 1 -- 172.21.15.164:0/635761259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55856d060bc0 con 0x55856d1c6550 2024-09-13T23:05:32.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.219+0000 7ffb26b52640 1 --2- 172.21.15.164:0/635761259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d1c6550 0x55856d13b5a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ffb20001d80 tx=0x7ffb20001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c64ee07fafb9726 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.219+0000 7ffa14e09640 1 -- 172.21.15.164:0/635761259 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb20013030 con 0x55856d1c6550 2024-09-13T23:05:32.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.219+0000 7ffa14e09640 1 -- 172.21.15.164:0/635761259 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb2000e470 con 0x55856d1c6550 2024-09-13T23:05:32.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.219+0000 7ffa14e09640 1 -- 172.21.15.164:0/635761259 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb2000e810 con 0x55856d1c6550 2024-09-13T23:05:32.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.220+0000 7ffb2b836800 1 -- 172.21.15.164:0/635761259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d1c6550 msgr2=0x55856d13b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.220+0000 7ffb2b836800 1 --2- 172.21.15.164:0/635761259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d1c6550 0x55856d13b5a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ffb20001d80 tx=0x7ffb20001e70 comp rx=0 tx=0).stop 2024-09-13T23:05:32.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.220+0000 7ffb2b836800 1 -- 172.21.15.164:0/635761259 shutdown_connections 2024-09-13T23:05:32.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.220+0000 7ffb2b836800 1 --2- 172.21.15.164:0/635761259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d1c6550 0x55856d13b5a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.220+0000 7ffb2b836800 1 -- 172.21.15.164:0/635761259 >> 172.21.15.164:0/635761259 conn(0x55856d1c1de0 msgr2=0x55856d2b1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.220+0000 7ffb2b836800 1 -- 172.21.15.164:0/635761259 shutdown_connections 2024-09-13T23:05:32.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.220+0000 7ffb2b836800 1 -- 172.21.15.164:0/635761259 wait complete. 2024-09-13T23:05:32.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.220+0000 7ffb2b836800 1 Processor -- start 2024-09-13T23:05:32.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.221+0000 7ffb2b836800 1 -- start start 2024-09-13T23:05:32.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.221+0000 7ffb2b836800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d1c6550 0x55856d2be2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.221+0000 7ffb2b836800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55856d1cd5c0 con 0x55856d1c6550 2024-09-13T23:05:32.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.221+0000 7ffb26b52640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d1c6550 0x55856d2be2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.221+0000 7ffb26b52640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d1c6550 0x55856d2be2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56526/0 (socket says 172.21.15.164:56526) 2024-09-13T23:05:32.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.221+0000 7ffb26b52640 1 -- 172.21.15.164:0/1361840552 learned_addr learned my addr 172.21.15.164:0/1361840552 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.221+0000 7ffb26b52640 1 -- 172.21.15.164:0/1361840552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55856d074fe0 con 0x55856d1c6550 2024-09-13T23:05:32.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.221+0000 7ffb26b52640 1 --2- 172.21.15.164:0/1361840552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d1c6550 0x55856d2be2c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ffb20004000 tx=0x7ffb20000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.221+0000 7ffa13606640 1 -- 172.21.15.164:0/1361840552 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb20027070 con 0x55856d1c6550 2024-09-13T23:05:32.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.222+0000 7ffa13606640 1 -- 172.21.15.164:0/1361840552 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb20001400 con 0x55856d1c6550 2024-09-13T23:05:32.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.222+0000 7ffb2b836800 1 -- 172.21.15.164:0/1361840552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55856d2be800 con 0x55856d1c6550 2024-09-13T23:05:32.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.222+0000 7ffa13606640 1 -- 172.21.15.164:0/1361840552 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb20019a70 con 0x55856d1c6550 2024-09-13T23:05:32.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.222+0000 7ffb2b836800 1 -- 172.21.15.164:0/1361840552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55856d2bed20 con 0x55856d1c6550 2024-09-13T23:05:32.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.222+0000 7ffa13606640 1 -- 172.21.15.164:0/1361840552 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffb2002a070 con 0x55856d1c6550 2024-09-13T23:05:32.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.223+0000 7ffa13606640 1 --2- 172.21.15.164:0/1361840552 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffa0c036b90 0x7ffa0c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.223+0000 7ffa13606640 1 -- 172.21.15.164:0/1361840552 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ffb2001f070 con 0x55856d1c6550 2024-09-13T23:05:32.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.223+0000 7ffb26351640 1 --2- 172.21.15.164:0/1361840552 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffa0c036b90 0x7ffa0c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.223+0000 7ffb2b836800 1 --2- 172.21.15.164:0/1361840552 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55856d1ca990 0x55856d2c5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.223+0000 7ffb2b836800 1 -- 172.21.15.164:0/1361840552 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55856d2c5870 con 0x55856d1ca990 2024-09-13T23:05:32.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.223+0000 7ffb27353640 1 --2- 172.21.15.164:0/1361840552 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55856d1ca990 0x55856d2c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.223+0000 7ffb26351640 1 --2- 172.21.15.164:0/1361840552 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffa0c036b90 0x7ffa0c039050 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffb10057000 tx=0x7ffb10052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.223+0000 7ffb27353640 1 --2- 172.21.15.164:0/1361840552 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55856d1ca990 0x55856d2c5330 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.223+0000 7ffb27353640 1 -- 172.21.15.164:0/1361840552 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb1800a4a0 con 0x55856d1ca990 2024-09-13T23:05:32.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.224+0000 7ffb2b836800 1 -- 172.21.15.164:0/1361840552 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55856d2c2900 con 0x55856d1ca990 2024-09-13T23:05:32.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.224+0000 7ffb27353640 1 -- 172.21.15.164:0/1361840552 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffb1800a4a0 con 0x55856d1ca990 2024-09-13T23:05:32.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.224+0000 7ffb2b836800 1 -- 172.21.15.164:0/1361840552 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55856d2c76b0 con 0x55856d1ca990 2024-09-13T23:05:32.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.224+0000 7ffb27353640 1 -- 172.21.15.164:0/1361840552 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffb1800a4a0 con 0x55856d1ca990 2024-09-13T23:05:32.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.224+0000 7ffb2b836800 1 -- 172.21.15.164:0/1361840552 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55856d2c68e0 con 0x55856d1ca990 2024-09-13T23:05:32.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.224+0000 7ffb27353640 1 -- 172.21.15.164:0/1361840552 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffb1800a4a0 con 0x55856d1ca990 2024-09-13T23:05:32.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.224+0000 7ffb2b836800 1 -- 172.21.15.164:0/1361840552 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55856d2c6d30 con 0x55856d1ca990 2024-09-13T23:05:32.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.225+0000 7ffb27353640 1 -- 172.21.15.164:0/1361840552 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffb1800a4a0 con 0x55856d1ca990 2024-09-13T23:05:32.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.225+0000 7ffb2b836800 1 Processor -- start 2024-09-13T23:05:32.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.225+0000 7ffb2b836800 1 -- start start 2024-09-13T23:05:32.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.225+0000 7ffb2b836800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d2d5cc0 0x55856d2d60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.225+0000 7ffb2b836800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55856d062580 con 0x55856d2d5cc0 2024-09-13T23:05:32.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.225+0000 7ffb26351640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d2d5cc0 0x55856d2d60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.225+0000 7ffb26351640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d2d5cc0 0x55856d2d60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56532/0 (socket says 172.21.15.164:56532) 2024-09-13T23:05:32.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.225+0000 7ffb26351640 1 -- 172.21.15.164:0/3352246154 learned_addr learned my addr 172.21.15.164:0/3352246154 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.226+0000 7ffb26351640 1 -- 172.21.15.164:0/3352246154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55856d2d6620 con 0x55856d2d5cc0 2024-09-13T23:05:32.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.226+0000 7ffb26351640 1 --2- 172.21.15.164:0/3352246154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d2d5cc0 0x55856d2d60e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ffb10025bf0 tx=0x7ffb10002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.226+0000 7ffa10e01640 1 -- 172.21.15.164:0/3352246154 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb1006f070 con 0x55856d2d5cc0 2024-09-13T23:05:32.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.226+0000 7ffa10e01640 1 -- 172.21.15.164:0/3352246154 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb1005f550 con 0x55856d2d5cc0 2024-09-13T23:05:32.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.226+0000 7ffb2b836800 1 -- 172.21.15.164:0/3352246154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55856d2d6850 con 0x55856d2d5cc0 2024-09-13T23:05:32.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.226+0000 7ffa10e01640 1 -- 172.21.15.164:0/3352246154 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb1005f830 con 0x55856d2d5cc0 2024-09-13T23:05:32.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.226+0000 7ffb2b836800 1 -- 172.21.15.164:0/3352246154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55856d2d94d0 con 0x55856d2d5cc0 2024-09-13T23:05:32.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.227+0000 7ffa10e01640 1 -- 172.21.15.164:0/3352246154 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffb1005f9d0 con 0x55856d2d5cc0 2024-09-13T23:05:32.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.227+0000 7ffa10e01640 1 --2- 172.21.15.164:0/3352246154 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffa00036b90 0x7ffa00039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.227+0000 7ffa10e01640 1 -- 172.21.15.164:0/3352246154 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ffb10092bd0 con 0x55856d2d5cc0 2024-09-13T23:05:32.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.227+0000 7ffb27353640 1 --2- 172.21.15.164:0/3352246154 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffa00036b90 0x7ffa00039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.227+0000 7ffb2b836800 1 Processor -- start 2024-09-13T23:05:32.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.227+0000 7ffb2b836800 1 -- start start 2024-09-13T23:05:32.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.227+0000 7ffb27353640 1 --2- 172.21.15.164:0/3352246154 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffa00036b90 0x7ffa00039050 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x55856d2c6400 tx=0x7ffb18005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.227+0000 7ffb2b836800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d2e2860 0x55856d2e2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.227+0000 7ffb2b836800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55856d2b9760 con 0x55856d2e2860 2024-09-13T23:05:32.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.228+0000 7ffb26351640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d2e2860 0x55856d2e2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.228+0000 7ffb26351640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d2e2860 0x55856d2e2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56542/0 (socket says 172.21.15.164:56542) 2024-09-13T23:05:32.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.228+0000 7ffb26351640 1 -- 172.21.15.164:0/1581834407 learned_addr learned my addr 172.21.15.164:0/1581834407 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.228+0000 7ffb26351640 1 -- 172.21.15.164:0/1581834407 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55856d2e3230 con 0x55856d2e2860 2024-09-13T23:05:32.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.228+0000 7ffb26351640 1 --2- 172.21.15.164:0/1581834407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d2e2860 0x55856d2e2c60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ffb10090f70 tx=0x7ffb100911f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2b873968c836ce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.228+0000 7ffa0a7fc640 1 -- 172.21.15.164:0/1581834407 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb1006b930 con 0x55856d2e2860 2024-09-13T23:05:32.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.228+0000 7ffa0a7fc640 1 -- 172.21.15.164:0/1581834407 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb1006b410 con 0x55856d2e2860 2024-09-13T23:05:32.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.228+0000 7ffa0a7fc640 1 -- 172.21.15.164:0/1581834407 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb1006bad0 con 0x55856d2e2860 2024-09-13T23:05:32.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.229+0000 7ffb2b836800 1 -- 172.21.15.164:0/1581834407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d2e2860 msgr2=0x55856d2e2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.229+0000 7ffb2b836800 1 --2- 172.21.15.164:0/1581834407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d2e2860 0x55856d2e2c60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ffb10090f70 tx=0x7ffb100911f0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.229+0000 7ffb2b836800 1 -- 172.21.15.164:0/1581834407 shutdown_connections 2024-09-13T23:05:32.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.229+0000 7ffb2b836800 1 --2- 172.21.15.164:0/1581834407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d2e2860 0x55856d2e2c60 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.229+0000 7ffb2b836800 1 -- 172.21.15.164:0/1581834407 >> 172.21.15.164:0/1581834407 conn(0x55856d2debc0 msgr2=0x55856d2dccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.229+0000 7ffb2b836800 1 -- 172.21.15.164:0/1581834407 shutdown_connections 2024-09-13T23:05:32.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.229+0000 7ffb2b836800 1 -- 172.21.15.164:0/1581834407 wait complete. 2024-09-13T23:05:32.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.229+0000 7ffb2b836800 1 Processor -- start 2024-09-13T23:05:32.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.229+0000 7ffb2b836800 1 -- start start 2024-09-13T23:05:32.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.229+0000 7ffb2b836800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d2e2860 0x55856d2e9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.229+0000 7ffb2b836800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55856d2e38a0 con 0x55856d2e2860 2024-09-13T23:05:32.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.229+0000 7ffb26351640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d2e2860 0x55856d2e9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.229+0000 7ffb26351640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d2e2860 0x55856d2e9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56552/0 (socket says 172.21.15.164:56552) 2024-09-13T23:05:32.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.229+0000 7ffb26351640 1 -- 172.21.15.164:0/289766050 learned_addr learned my addr 172.21.15.164:0/289766050 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.230+0000 7ffb26351640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55856d2ea2e0 con 0x55856d2e2860 2024-09-13T23:05:32.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.230+0000 7ffb26351640 1 --2- 172.21.15.164:0/289766050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d2e2860 0x55856d2e9da0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ffb1006bfd0 tx=0x7ffb10090ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.230+0000 7ffa08ff9640 1 -- 172.21.15.164:0/289766050 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb1005cca0 con 0x55856d2e2860 2024-09-13T23:05:32.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.230+0000 7ffa08ff9640 1 -- 172.21.15.164:0/289766050 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb1005ce40 con 0x55856d2e2860 2024-09-13T23:05:32.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.230+0000 7ffa08ff9640 1 -- 172.21.15.164:0/289766050 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb1006a720 con 0x55856d2e2860 2024-09-13T23:05:32.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.230+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55856d2ea570 con 0x55856d2e2860 2024-09-13T23:05:32.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.230+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55856d2ea570 con 0x55856d2e2860 2024-09-13T23:05:32.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.231+0000 7ffa08ff9640 1 -- 172.21.15.164:0/289766050 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffb1006a8c0 con 0x55856d2e2860 2024-09-13T23:05:32.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.231+0000 7ffa08ff9640 1 --2- 172.21.15.164:0/289766050 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ff9f0036b40 0x7ff9f0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.231+0000 7ffa08ff9640 1 -- 172.21.15.164:0/289766050 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ffb10098070 con 0x55856d2e2860 2024-09-13T23:05:32.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.231+0000 7ffb27353640 1 --2- 172.21.15.164:0/289766050 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ff9f0036b40 0x7ff9f0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.231+0000 7ffb2b836800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.231+0000 7ffb2b836800 1 --2- 172.21.15.164:0/289766050 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55856d2f5680 0x55856d2f7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.231+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55856d2f8290 con 0x55856d2f5680 2024-09-13T23:05:32.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.232+0000 7ffb26b52640 1 --2- 172.21.15.164:0/289766050 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55856d2f5680 0x55856d2f7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.232+0000 7ffb26b52640 1 --2- 172.21.15.164:0/289766050 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55856d2f5680 0x55856d2f7b40 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.232+0000 7ffb27353640 1 --2- 172.21.15.164:0/289766050 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ff9f0036b40 0x7ff9f0039000 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x55856d2c2850 tx=0x7ffb1801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.232+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb20029030 con 0x55856d2f5680 2024-09-13T23:05:32.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.232+0000 7ffb2b836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.232+0000 7ffb2b836800 20 realm 2024-09-13T23:05:32.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.232+0000 7ffb2b836800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.232+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55856d2f86a0 con 0x55856d2f5680 2024-09-13T23:05:32.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.232+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb20029030 con 0x55856d2f5680 2024-09-13T23:05:32.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.232+0000 7ffb2b836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.232+0000 7ffb2b836800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:32.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.232+0000 7ffb2b836800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.232+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55856d2f8f70 con 0x55856d2f5680 2024-09-13T23:05:32.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.233+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb20029030 con 0x55856d2f5680 2024-09-13T23:05:32.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.233+0000 7ffb2b836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.233+0000 7ffb2b836800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.233+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55856d2f9310 con 0x55856d2f5680 2024-09-13T23:05:32.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.233+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffb20029030 con 0x55856d2f5680 2024-09-13T23:05:32.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.233+0000 7ffb2b836800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:32.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.233+0000 7ffb2b836800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.233+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55856d2f9770 con 0x55856d2f5680 2024-09-13T23:05:32.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.233+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffb20029030 con 0x55856d2f5680 2024-09-13T23:05:32.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.233+0000 7ffb2b836800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:32.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.233+0000 7ffb2b836800 20 searching for the correct realm 2024-09-13T23:05:32.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.233+0000 7ffb2b836800 1 --2- 172.21.15.164:0/289766050 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55856d2fb7c0 0x55856d2fdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.233+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x55856d2fb7c0 2024-09-13T23:05:32.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.233+0000 7ffb26351640 1 --2- 172.21.15.164:0/289766050 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55856d2fb7c0 0x55856d2fdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.234+0000 7ffb26351640 1 --2- 172.21.15.164:0/289766050 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55856d2fb7c0 0x55856d2fdbb0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.234+0000 7ffb26351640 1 -- 172.21.15.164:0/289766050 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb100a2020 con 0x55856d2fb7c0 2024-09-13T23:05:32.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.234+0000 7ffb26351640 1 --2- 172.21.15.164:0/289766050 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7ffb1005f040 0x7ffb10073610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.234+0000 7ffb26351640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x7ffb1005f040 2024-09-13T23:05:32.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.234+0000 7ffb27353640 1 --2- 172.21.15.164:0/289766050 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7ffb1005f040 0x7ffb10073610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.234+0000 7ffb27353640 1 --2- 172.21.15.164:0/289766050 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7ffb1005f040 0x7ffb10073610 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.235+0000 7ffb27353640 1 -- 172.21.15.164:0/289766050 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb1801f070 con 0x7ffb1005f040 2024-09-13T23:05:32.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.235+0000 7ffb27353640 1 --2- 172.21.15.164:0/289766050 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7ffb18031040 0x7ffb18032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.235+0000 7ffb27353640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x7ffb18031040 2024-09-13T23:05:32.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.235+0000 7ffb26b52640 1 --2- 172.21.15.164:0/289766050 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7ffb18031040 0x7ffb18032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.235+0000 7ffb26b52640 1 --2- 172.21.15.164:0/289766050 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7ffb18031040 0x7ffb18032940 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.236+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb20029030 con 0x7ffb18031040 2024-09-13T23:05:32.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.236+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x55856d2f5680 2024-09-13T23:05:32.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.236+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ffb20029030 con 0x55856d2f5680 2024-09-13T23:05:32.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.236+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x55856d2f5680 2024-09-13T23:05:32.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.236+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb20029030 con 0x55856d2f5680 2024-09-13T23:05:32.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.236+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x7ffb18031040 2024-09-13T23:05:32.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.236+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb20029030 con 0x7ffb18031040 2024-09-13T23:05:32.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.236+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x7ffb18031040 2024-09-13T23:05:32.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.236+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb20029030 con 0x7ffb18031040 2024-09-13T23:05:32.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.237+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x7ffb1005f040 2024-09-13T23:05:32.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.237+0000 7ffb27353640 1 -- 172.21.15.164:0/289766050 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb1801f070 con 0x7ffb1005f040 2024-09-13T23:05:32.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.237+0000 7ffb27353640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x55856d2fb7c0 2024-09-13T23:05:32.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.237+0000 7ffb26351640 1 -- 172.21.15.164:0/289766050 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb100a2020 con 0x55856d2fb7c0 2024-09-13T23:05:32.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.237+0000 7ffb26351640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x55856d2f5680 2024-09-13T23:05:32.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.237+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb20029030 con 0x55856d2f5680 2024-09-13T23:05:32.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.237+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x7ffb18031040 2024-09-13T23:05:32.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.237+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb20029030 con 0x7ffb18031040 2024-09-13T23:05:32.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.238+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x55856d2f5680 2024-09-13T23:05:32.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.238+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb20029030 con 0x55856d2f5680 2024-09-13T23:05:32.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.238+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x7ffb1005f040 2024-09-13T23:05:32.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.238+0000 7ffb27353640 1 -- 172.21.15.164:0/289766050 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffb1801f070 con 0x7ffb1005f040 2024-09-13T23:05:32.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.238+0000 7ffb27353640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x55856d2fb7c0 2024-09-13T23:05:32.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.238+0000 7ffb26351640 1 -- 172.21.15.164:0/289766050 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb100a2020 con 0x55856d2fb7c0 2024-09-13T23:05:32.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.238+0000 7ffb26351640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x55856d2fb7c0 2024-09-13T23:05:32.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.238+0000 7ffb26351640 1 -- 172.21.15.164:0/289766050 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb100a2020 con 0x55856d2fb7c0 2024-09-13T23:05:32.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.238+0000 7ffb26351640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x7ffb18031040 2024-09-13T23:05:32.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.239+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb20029030 con 0x7ffb18031040 2024-09-13T23:05:32.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.239+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x55856d2fb7c0 2024-09-13T23:05:32.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.239+0000 7ffb26351640 1 -- 172.21.15.164:0/289766050 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb100a2020 con 0x55856d2fb7c0 2024-09-13T23:05:32.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.239+0000 7ffb26351640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x55856d2fb7c0 2024-09-13T23:05:32.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.239+0000 7ffb26351640 1 -- 172.21.15.164:0/289766050 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb100a2020 con 0x55856d2fb7c0 2024-09-13T23:05:32.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.239+0000 7ffb26351640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x55856d2f5680 2024-09-13T23:05:32.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.239+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb20029030 con 0x55856d2f5680 2024-09-13T23:05:32.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.239+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x55856d2f5680 2024-09-13T23:05:32.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.240+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffb20029030 con 0x55856d2f5680 2024-09-13T23:05:32.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.240+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x7ffb18031040 2024-09-13T23:05:32.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.240+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb20029030 con 0x7ffb18031040 2024-09-13T23:05:32.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.240+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x55856d2fb7c0 2024-09-13T23:05:32.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.240+0000 7ffb26351640 1 -- 172.21.15.164:0/289766050 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb100a2020 con 0x55856d2fb7c0 2024-09-13T23:05:32.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.240+0000 7ffb26351640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x7ffb1005f040 2024-09-13T23:05:32.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.240+0000 7ffb27353640 1 -- 172.21.15.164:0/289766050 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb1801f070 con 0x7ffb1005f040 2024-09-13T23:05:32.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.240+0000 7ffb27353640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x55856d2f5680 2024-09-13T23:05:32.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.241+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffb20029030 con 0x55856d2f5680 2024-09-13T23:05:32.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.241+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x7ffb18031040 2024-09-13T23:05:32.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.241+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb20029030 con 0x7ffb18031040 2024-09-13T23:05:32.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.241+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x55856d2fb7c0 2024-09-13T23:05:32.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.241+0000 7ffb26351640 1 -- 172.21.15.164:0/289766050 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb100a2020 con 0x55856d2fb7c0 2024-09-13T23:05:32.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.241+0000 7ffb26351640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x7ffb18031040 2024-09-13T23:05:32.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.241+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb20029030 con 0x7ffb18031040 2024-09-13T23:05:32.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.241+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x7ffb1005f040 2024-09-13T23:05:32.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.242+0000 7ffb27353640 1 -- 172.21.15.164:0/289766050 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb1801f070 con 0x7ffb1005f040 2024-09-13T23:05:32.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.242+0000 7ffb27353640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x55856d2fb7c0 2024-09-13T23:05:32.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.242+0000 7ffb26351640 1 -- 172.21.15.164:0/289766050 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb100a2020 con 0x55856d2fb7c0 2024-09-13T23:05:32.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.242+0000 7ffb26351640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x7ffb18031040 2024-09-13T23:05:32.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.242+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb20029030 con 0x7ffb18031040 2024-09-13T23:05:32.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.242+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x55856d2f5680 2024-09-13T23:05:32.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.242+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ffb20029030 con 0x55856d2f5680 2024-09-13T23:05:32.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.243+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fe260 con 0x7ffb1005f040 2024-09-13T23:05:32.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.243+0000 7ffb27353640 1 -- 172.21.15.164:0/289766050 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb1801f070 con 0x7ffb1005f040 2024-09-13T23:05:32.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.243+0000 7ffb2b836800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:32.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.243+0000 7ffb2b836800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:32.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.243+0000 7ffb2b836800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:32.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.243+0000 7ffb2b836800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:32.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.243+0000 7ffb2b836800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:32.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.243+0000 7ffb2b836800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:32.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.243+0000 7ffb2b836800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.243+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55856d2fa210 con 0x55856d2f5680 2024-09-13T23:05:32.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.243+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb20029030 con 0x55856d2f5680 2024-09-13T23:05:32.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.243+0000 7ffb2b836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.243+0000 7ffb2b836800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.243+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55856d2faab0 con 0x55856d2f5680 2024-09-13T23:05:32.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.243+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffb20029030 con 0x55856d2f5680 2024-09-13T23:05:32.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.243+0000 7ffb2b836800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:32.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.243+0000 7ffb2b836800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.243+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55856d2f9e50 con 0x55856d2f5680 2024-09-13T23:05:32.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.244+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffb20029030 con 0x55856d2f5680 2024-09-13T23:05:32.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.244+0000 7ffb2b836800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:32.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.244+0000 7ffb2b836800 20 zone default found 2024-09-13T23:05:32.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.244+0000 7ffb2b836800 4 Realm: () 2024-09-13T23:05:32.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.244+0000 7ffb2b836800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:32.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.244+0000 7ffb2b836800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:32.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.244+0000 7ffb2b836800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:32.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.244+0000 7ffb2b836800 20 zonegroup default 2024-09-13T23:05:32.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.244+0000 7ffb2b836800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.244+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55856d2faab0 con 0x7ffb18031040 2024-09-13T23:05:32.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.244+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffb20029030 con 0x7ffb18031040 2024-09-13T23:05:32.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.244+0000 7ffb2b836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.244+0000 7ffb2b836800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.244+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55856d3000a0 con 0x55856d2fb7c0 2024-09-13T23:05:32.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.244+0000 7ffb26351640 1 -- 172.21.15.164:0/289766050 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffb100a2020 con 0x55856d2fb7c0 2024-09-13T23:05:32.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.244+0000 7ffb2b836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.244+0000 7ffb2b836800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.244+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55856d300440 con 0x55856d2fb7c0 2024-09-13T23:05:32.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.244+0000 7ffb26351640 1 -- 172.21.15.164:0/289766050 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffb100a2020 con 0x55856d2fb7c0 2024-09-13T23:05:32.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.244+0000 7ffb2b836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.244+0000 7ffb2b836800 20 started sync module instance, tier type = 2024-09-13T23:05:32.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.244+0000 7ffb2b836800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:32.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.244+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55856d2ff540 con 0x7ffb1005f040 2024-09-13T23:05:32.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.245+0000 7ffb27353640 1 -- 172.21.15.164:0/289766050 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb18040040 con 0x7ffb1005f040 2024-09-13T23:05:32.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.245+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94031550871904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55856d300ce0 con 0x7ffb1005f040 2024-09-13T23:05:32.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.246+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55856d301530 con 0x55856d2f5680 2024-09-13T23:05:32.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.246+0000 7ffb27353640 1 -- 172.21.15.164:0/289766050 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94031550871904] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb18040040 con 0x7ffb1005f040 2024-09-13T23:05:32.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.247+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb20029030 con 0x55856d2f5680 2024-09-13T23:05:32.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.247+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94031550875968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55856d301270 con 0x55856d2f5680 2024-09-13T23:05:32.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.247+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55856d301d80 con 0x55856d2fb7c0 2024-09-13T23:05:32.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.248+0000 7ffb26351640 1 -- 172.21.15.164:0/289766050 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb100a2020 con 0x55856d2fb7c0 2024-09-13T23:05:32.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.248+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94031550879792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55856d302620 con 0x55856d2fb7c0 2024-09-13T23:05:32.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.248+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55856d3030c0 con 0x7ffb1005f040 2024-09-13T23:05:32.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.248+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94031550875968] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb20029030 con 0x55856d2f5680 2024-09-13T23:05:32.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.249+0000 7ffb27353640 1 -- 172.21.15.164:0/289766050 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb18040040 con 0x7ffb1005f040 2024-09-13T23:05:32.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.249+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94031550884752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55856d3034b0 con 0x7ffb1005f040 2024-09-13T23:05:32.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.249+0000 7ffb26351640 1 -- 172.21.15.164:0/289766050 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94031550879792] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb100a2020 con 0x55856d2fb7c0 2024-09-13T23:05:32.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.249+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55856d3021b0 con 0x55856d2f5680 2024-09-13T23:05:32.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.250+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb20029030 con 0x55856d2f5680 2024-09-13T23:05:32.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.250+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94031550888432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55856d3021b0 con 0x55856d2f5680 2024-09-13T23:05:32.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.250+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55856d304960 con 0x7ffb18031040 2024-09-13T23:05:32.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.250+0000 7ffb27353640 1 -- 172.21.15.164:0/289766050 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94031550884752] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb18040040 con 0x7ffb1005f040 2024-09-13T23:05:32.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.251+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb20029030 con 0x7ffb18031040 2024-09-13T23:05:32.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.251+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94031550891056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55856d304920 con 0x7ffb18031040 2024-09-13T23:05:32.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.251+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55856d305370 con 0x7ffb18031040 2024-09-13T23:05:32.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.251+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94031550888432] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb20029030 con 0x55856d2f5680 2024-09-13T23:05:32.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.252+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94031550891056] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb20029030 con 0x7ffb18031040 2024-09-13T23:05:32.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.252+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb20029030 con 0x7ffb18031040 2024-09-13T23:05:32.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.252+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94031550877024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55856d304ec0 con 0x7ffb18031040 2024-09-13T23:05:32.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.252+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55856d305880 con 0x7ffb18031040 2024-09-13T23:05:32.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.253+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94031550877024] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb20029030 con 0x7ffb18031040 2024-09-13T23:05:32.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.253+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb20029030 con 0x7ffb18031040 2024-09-13T23:05:32.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.253+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94031550889488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55856d305880 con 0x7ffb18031040 2024-09-13T23:05:32.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.253+0000 7ffb2b836800 20 add_watcher() i=0 2024-09-13T23:05:32.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.253+0000 7ffb2b836800 20 add_watcher() i=1 2024-09-13T23:05:32.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.253+0000 7ffb2b836800 20 add_watcher() i=2 2024-09-13T23:05:32.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.253+0000 7ffb2b836800 20 add_watcher() i=3 2024-09-13T23:05:32.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.253+0000 7ffb2b836800 20 add_watcher() i=4 2024-09-13T23:05:32.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.253+0000 7ffb2b836800 20 add_watcher() i=5 2024-09-13T23:05:32.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.253+0000 7ffb2b836800 20 add_watcher() i=6 2024-09-13T23:05:32.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.254+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94031550889488] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb20029030 con 0x7ffb18031040 2024-09-13T23:05:32.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.254+0000 7ffb2b836800 20 add_watcher() i=7 2024-09-13T23:05:32.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.254+0000 7ffb2b836800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:32.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.254+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55856d308b40 con 0x55856d2f5680 2024-09-13T23:05:32.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.254+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffb20029030 con 0x55856d2f5680 2024-09-13T23:05:32.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.254+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94031550895424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55856d305e10 con 0x55856d2f5680 2024-09-13T23:05:32.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.255+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94031550895424] v32'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffb20029030 con 0x55856d2f5680 2024-09-13T23:05:32.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.255+0000 7ff9dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:32.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.256+0000 7ffb2b836800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:32.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.256+0000 7ffb2b836800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:32.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.256+0000 7ffb2b836800 5 note: GC not initialized 2024-09-13T23:05:32.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.256+0000 7ff957fff640 20 reqs_thread_entry: start 2024-09-13T23:05:32.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.256+0000 7ffb2b836800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:32.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.256+0000 7ffb2b836800 20 Filter name: none 2024-09-13T23:05:32.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.256+0000 7ff955ffb640 20 reqs_thread_entry: start 2024-09-13T23:05:32.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.256+0000 7ffb2b836800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.256+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55856d33baf0 con 0x55856d2f5680 2024-09-13T23:05:32.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.257+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ffb20029030 con 0x55856d2f5680 2024-09-13T23:05:32.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.257+0000 7ffb2b836800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:05:32.299 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:05:31.300851Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:05:31.300826Z","tags":[],"group_ids":[]} 2024-09-13T23:05:32.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.257+0000 7ff9dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:32.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.257+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94031550895424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55856d307fa0 con 0x55856d2f5680 2024-09-13T23:05:32.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.258+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94031550895424] v32'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffb20029030 con 0x55856d2f5680 2024-09-13T23:05:32.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.258+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94031550871904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55856d305540 con 0x7ffb1005f040 2024-09-13T23:05:32.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.259+0000 7ffb27353640 1 -- 172.21.15.164:0/289766050 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94031550871904] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb18040040 con 0x7ffb1005f040 2024-09-13T23:05:32.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.259+0000 7ffb2b836800 20 remove_watcher() i=0 2024-09-13T23:05:32.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.259+0000 7ffb2b836800 2 removed watcher, disabling cache 2024-09-13T23:05:32.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.259+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94031550875968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55856d305540 con 0x55856d2f5680 2024-09-13T23:05:32.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.260+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94031550875968] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb20029030 con 0x55856d2f5680 2024-09-13T23:05:32.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.260+0000 7ffb2b836800 20 remove_watcher() i=1 2024-09-13T23:05:32.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.260+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94031550879792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55856d305540 con 0x55856d2fb7c0 2024-09-13T23:05:32.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.261+0000 7ffb26351640 1 -- 172.21.15.164:0/289766050 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94031550879792] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb100a2020 con 0x55856d2fb7c0 2024-09-13T23:05:32.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.261+0000 7ffb2b836800 20 remove_watcher() i=2 2024-09-13T23:05:32.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.261+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94031550884752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55856d301830 con 0x7ffb1005f040 2024-09-13T23:05:32.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.262+0000 7ffb27353640 1 -- 172.21.15.164:0/289766050 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94031550884752] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb18040040 con 0x7ffb1005f040 2024-09-13T23:05:32.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.262+0000 7ffb2b836800 20 remove_watcher() i=3 2024-09-13T23:05:32.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.262+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94031550888432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55856d302b90 con 0x55856d2f5680 2024-09-13T23:05:32.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.263+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94031550888432] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb20029030 con 0x55856d2f5680 2024-09-13T23:05:32.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.263+0000 7ffb2b836800 20 remove_watcher() i=4 2024-09-13T23:05:32.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.263+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94031550891056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55856d301830 con 0x7ffb18031040 2024-09-13T23:05:32.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.264+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94031550891056] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb20029030 con 0x7ffb18031040 2024-09-13T23:05:32.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.264+0000 7ffb2b836800 20 remove_watcher() i=5 2024-09-13T23:05:32.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.264+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94031550877024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55856d3039f0 con 0x7ffb18031040 2024-09-13T23:05:32.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.265+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94031550877024] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb20029030 con 0x7ffb18031040 2024-09-13T23:05:32.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.265+0000 7ffb2b836800 20 remove_watcher() i=6 2024-09-13T23:05:32.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.265+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94031550889488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55856d300df0 con 0x7ffb18031040 2024-09-13T23:05:32.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.266+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94031550889488] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb20029030 con 0x7ffb18031040 2024-09-13T23:05:32.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.266+0000 7ffb2b836800 20 remove_watcher() i=7 2024-09-13T23:05:32.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.266+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7ffb18031040 msgr2=0x7ffb18032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.266+0000 7ffb2b836800 1 --2- 172.21.15.164:0/289766050 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7ffb18031040 0x7ffb18032940 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.266+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55856d2f5680 msgr2=0x55856d2f7b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.266+0000 7ffb2b836800 1 --2- 172.21.15.164:0/289766050 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55856d2f5680 0x55856d2f7b40 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.266+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7ffb1005f040 msgr2=0x7ffb10073610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.266+0000 7ffb2b836800 1 --2- 172.21.15.164:0/289766050 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7ffb1005f040 0x7ffb10073610 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.266+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55856d2fb7c0 msgr2=0x55856d2fdbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.266+0000 7ffb2b836800 1 --2- 172.21.15.164:0/289766050 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55856d2fb7c0 0x55856d2fdbb0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.266+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ff9f0036b40 msgr2=0x7ff9f0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.266+0000 7ffb2b836800 1 --2- 172.21.15.164:0/289766050 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ff9f0036b40 0x7ff9f0039000 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x55856d2c2850 tx=0x7ffb1801f000 comp rx=0 tx=0).stop 2024-09-13T23:05:32.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.266+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d2e2860 msgr2=0x55856d2e9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.266+0000 7ffb26b52640 1 -- 172.21.15.164:0/289766050 reap_dead start 2024-09-13T23:05:32.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.266+0000 7ffb2b836800 1 --2- 172.21.15.164:0/289766050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d2e2860 0x55856d2e9da0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ffb1006bfd0 tx=0x7ffb10090ed0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.266+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 shutdown_connections 2024-09-13T23:05:32.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.266+0000 7ffb2b836800 1 --2- 172.21.15.164:0/289766050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d2e2860 0x55856d2e9da0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.266+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 >> 172.21.15.164:0/289766050 conn(0x55856d2debc0 msgr2=0x55856d2dcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.266+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 shutdown_connections 2024-09-13T23:05:32.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.266+0000 7ffb2b836800 1 -- 172.21.15.164:0/289766050 wait complete. 2024-09-13T23:05:32.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.267+0000 7ffb2b836800 1 -- 172.21.15.164:0/3352246154 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffa00036b90 msgr2=0x7ffa00039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.267+0000 7ffb2b836800 1 --2- 172.21.15.164:0/3352246154 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffa00036b90 0x7ffa00039050 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x55856d2c6400 tx=0x7ffb18005840 comp rx=0 tx=0).stop 2024-09-13T23:05:32.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.267+0000 7ffb2b836800 1 -- 172.21.15.164:0/3352246154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d2d5cc0 msgr2=0x55856d2d60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.267+0000 7ffb2b836800 1 --2- 172.21.15.164:0/3352246154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d2d5cc0 0x55856d2d60e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ffb10025bf0 tx=0x7ffb10002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.267+0000 7ffb2b836800 1 -- 172.21.15.164:0/3352246154 shutdown_connections 2024-09-13T23:05:32.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.267+0000 7ffb2b836800 1 --2- 172.21.15.164:0/3352246154 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffa00036b90 0x7ffa00039050 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.267+0000 7ffb2b836800 1 --2- 172.21.15.164:0/3352246154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d2d5cc0 0x55856d2d60e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.267+0000 7ffb2b836800 1 -- 172.21.15.164:0/3352246154 >> 172.21.15.164:0/3352246154 conn(0x55856d2cac50 msgr2=0x55856d2cd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.267+0000 7ffb2b836800 1 -- 172.21.15.164:0/3352246154 shutdown_connections 2024-09-13T23:05:32.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.267+0000 7ffb2b836800 1 -- 172.21.15.164:0/3352246154 wait complete. 2024-09-13T23:05:32.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.267+0000 7ffb2b836800 1 -- 172.21.15.164:0/1361840552 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55856d1ca990 msgr2=0x55856d2c5330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.267+0000 7ffb2b836800 1 --2- 172.21.15.164:0/1361840552 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55856d1ca990 0x55856d2c5330 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.267+0000 7ffb2b836800 1 -- 172.21.15.164:0/1361840552 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffa0c036b90 msgr2=0x7ffa0c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.267+0000 7ffb2b836800 1 --2- 172.21.15.164:0/1361840552 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffa0c036b90 0x7ffa0c039050 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffb10057000 tx=0x7ffb10052000 comp rx=0 tx=0).stop 2024-09-13T23:05:32.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.267+0000 7ffb2b836800 1 -- 172.21.15.164:0/1361840552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d1c6550 msgr2=0x55856d2be2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.267+0000 7ffb2b836800 1 --2- 172.21.15.164:0/1361840552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d1c6550 0x55856d2be2c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ffb20004000 tx=0x7ffb20000bc0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.267+0000 7ffb2b836800 1 -- 172.21.15.164:0/1361840552 shutdown_connections 2024-09-13T23:05:32.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.267+0000 7ffb2b836800 1 --2- 172.21.15.164:0/1361840552 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55856d1ca990 0x55856d2c5330 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.267+0000 7ffb2b836800 1 --2- 172.21.15.164:0/1361840552 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffa0c036b90 0x7ffa0c039050 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.267+0000 7ffb2b836800 1 --2- 172.21.15.164:0/1361840552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55856d1c6550 0x55856d2be2c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.267+0000 7ffb2b836800 1 -- 172.21.15.164:0/1361840552 >> 172.21.15.164:0/1361840552 conn(0x55856d1c1de0 msgr2=0x55856d2af9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.267+0000 7ffb2b836800 1 -- 172.21.15.164:0/1361840552 shutdown_connections 2024-09-13T23:05:32.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.267+0000 7ffb2b836800 1 -- 172.21.15.164:0/1361840552 wait complete. 2024-09-13T23:05:32.311 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:05:31.300851Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:05:31.300826Z', 'tags': [], 'group_ids': []} 2024-09-13T23:05:32.311 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-13T23:05:32.312 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-13T23:05:32.312 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-13T23:05:32.361 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:32.361 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:32.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.361+0000 7effe6b2c800 1 Processor -- start 2024-09-13T23:05:32.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.361+0000 7effe6b2c800 1 -- start start 2024-09-13T23:05:32.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.361+0000 7effe6b2c800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x562ad3689630 0x562ad3718290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.361+0000 7effe6b2c800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562ad35d4b30 con 0x562ad37187d0 2024-09-13T23:05:32.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.361+0000 7effe6b2c800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x562ad35b6360 con 0x562ad3689630 2024-09-13T23:05:32.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.362+0000 7effe28b7640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x562ad3689630 0x562ad3718290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.362+0000 7effe20b6640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x562ad37187d0 0x562ad371abc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40780/0 (socket says 172.21.15.164:40780) 2024-09-13T23:05:32.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.362+0000 7effe20b6640 1 -- 172.21.15.164:0/279968498 learned_addr learned my addr 172.21.15.164:0/279968498 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:32.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.362+0000 7effe28b7640 1 -- 172.21.15.164:0/279968498 >> v1:172.21.15.17:6789/0 conn(0x562ad37187d0 legacy=0x562ad371abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.362+0000 7effe28b7640 1 -- 172.21.15.164:0/279968498 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ad35dce00 con 0x562ad3689630 2024-09-13T23:05:32.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.364+0000 7effe28b7640 1 --2- 172.21.15.164:0/279968498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3689630 0x562ad3718290 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7effd400a470 tx=0x7effd4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e9c724447b47321 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.364+0000 7effe18b5640 1 -- 172.21.15.164:0/279968498 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effd4053570 con 0x562ad3689630 2024-09-13T23:05:32.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.364+0000 7effe18b5640 1 -- 172.21.15.164:0/279968498 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effd4058070 con 0x562ad3689630 2024-09-13T23:05:32.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.364+0000 7effe18b5640 1 -- 172.21.15.164:0/279968498 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effd4053880 con 0x562ad3689630 2024-09-13T23:05:32.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.364+0000 7effe6b2c800 1 -- 172.21.15.164:0/279968498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3689630 msgr2=0x562ad3718290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.364+0000 7effe6b2c800 1 --2- 172.21.15.164:0/279968498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3689630 0x562ad3718290 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7effd400a470 tx=0x7effd4045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:32.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.364+0000 7effe6b2c800 1 -- 172.21.15.164:0/279968498 shutdown_connections 2024-09-13T23:05:32.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.364+0000 7effe6b2c800 1 --2- 172.21.15.164:0/279968498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3689630 0x562ad3718290 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.364+0000 7effe6b2c800 1 -- 172.21.15.164:0/279968498 >> 172.21.15.164:0/279968498 conn(0x562ad370fe00 msgr2=0x562ad3712220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.364+0000 7effe6b2c800 1 -- 172.21.15.164:0/279968498 shutdown_connections 2024-09-13T23:05:32.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.365+0000 7effe6b2c800 1 -- 172.21.15.164:0/279968498 wait complete. 2024-09-13T23:05:32.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.379+0000 7effe6b2c800 1 Processor -- start 2024-09-13T23:05:32.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.379+0000 7effe6b2c800 1 -- start start 2024-09-13T23:05:32.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.379+0000 7effe6b2c800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3689630 0x562ad3804960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.379+0000 7effe6b2c800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562ad3661350 con 0x562ad3689630 2024-09-13T23:05:32.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.379+0000 7effe28b7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3689630 0x562ad3804960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.379+0000 7effe28b7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3689630 0x562ad3804960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56572/0 (socket says 172.21.15.164:56572) 2024-09-13T23:05:32.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.379+0000 7effe28b7640 1 -- 172.21.15.164:0/3388854268 learned_addr learned my addr 172.21.15.164:0/3388854268 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.379+0000 7effe28b7640 1 -- 172.21.15.164:0/3388854268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ad35aebc0 con 0x562ad3689630 2024-09-13T23:05:32.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.379+0000 7effe28b7640 1 --2- 172.21.15.164:0/3388854268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3689630 0x562ad3804960 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7effd4025c20 tx=0x7effd4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50747453d931f568 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.380+0000 7efed0e09640 1 -- 172.21.15.164:0/3388854268 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effd405c580 con 0x562ad3689630 2024-09-13T23:05:32.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.380+0000 7efed0e09640 1 -- 172.21.15.164:0/3388854268 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effd4063030 con 0x562ad3689630 2024-09-13T23:05:32.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.380+0000 7efed0e09640 1 -- 172.21.15.164:0/3388854268 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effd405c850 con 0x562ad3689630 2024-09-13T23:05:32.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.380+0000 7effe6b2c800 1 -- 172.21.15.164:0/3388854268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3689630 msgr2=0x562ad3804960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.380+0000 7effe6b2c800 1 --2- 172.21.15.164:0/3388854268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3689630 0x562ad3804960 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7effd4025c20 tx=0x7effd4051000 comp rx=0 tx=0).stop 2024-09-13T23:05:32.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.380+0000 7effe6b2c800 1 -- 172.21.15.164:0/3388854268 shutdown_connections 2024-09-13T23:05:32.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.380+0000 7effe6b2c800 1 --2- 172.21.15.164:0/3388854268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3689630 0x562ad3804960 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.380+0000 7effe6b2c800 1 -- 172.21.15.164:0/3388854268 >> 172.21.15.164:0/3388854268 conn(0x562ad370fe00 msgr2=0x562ad3800320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.380+0000 7effe6b2c800 1 -- 172.21.15.164:0/3388854268 shutdown_connections 2024-09-13T23:05:32.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.380+0000 7effe6b2c800 1 -- 172.21.15.164:0/3388854268 wait complete. 2024-09-13T23:05:32.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.381+0000 7effe6b2c800 1 Processor -- start 2024-09-13T23:05:32.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.381+0000 7effe6b2c800 1 -- start start 2024-09-13T23:05:32.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.381+0000 7effe6b2c800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3689630 0x562ad380c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.381+0000 7effe6b2c800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562ad371c6a0 con 0x562ad3689630 2024-09-13T23:05:32.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.381+0000 7effe28b7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3689630 0x562ad380c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.381+0000 7effe28b7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3689630 0x562ad380c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56588/0 (socket says 172.21.15.164:56588) 2024-09-13T23:05:32.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.381+0000 7effe28b7640 1 -- 172.21.15.164:0/1573020899 learned_addr learned my addr 172.21.15.164:0/1573020899 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.382+0000 7effe28b7640 1 -- 172.21.15.164:0/1573020899 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ad35c2fe0 con 0x562ad3689630 2024-09-13T23:05:32.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.382+0000 7effe28b7640 1 --2- 172.21.15.164:0/1573020899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3689630 0x562ad380c2b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x562ad38057c0 tx=0x7effd4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.382+0000 7efecf606640 1 -- 172.21.15.164:0/1573020899 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effd4054ad0 con 0x562ad3689630 2024-09-13T23:05:32.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.382+0000 7efecf606640 1 -- 172.21.15.164:0/1573020899 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effd4054c70 con 0x562ad3689630 2024-09-13T23:05:32.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.382+0000 7efecf606640 1 -- 172.21.15.164:0/1573020899 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effd4068420 con 0x562ad3689630 2024-09-13T23:05:32.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.382+0000 7effe6b2c800 1 -- 172.21.15.164:0/1573020899 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562ad380c7f0 con 0x562ad3689630 2024-09-13T23:05:32.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.382+0000 7effe6b2c800 1 -- 172.21.15.164:0/1573020899 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ad380cd10 con 0x562ad3689630 2024-09-13T23:05:32.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.383+0000 7efecf606640 1 -- 172.21.15.164:0/1573020899 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7effd40685c0 con 0x562ad3689630 2024-09-13T23:05:32.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.383+0000 7efecf606640 1 --2- 172.21.15.164:0/1573020899 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efec8036b90 0x7efec8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.383+0000 7efecf606640 1 -- 172.21.15.164:0/1573020899 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7effd4070030 con 0x562ad3689630 2024-09-13T23:05:32.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.383+0000 7effe20b6640 1 --2- 172.21.15.164:0/1573020899 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efec8036b90 0x7efec8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.383+0000 7effe6b2c800 1 --2- 172.21.15.164:0/1573020899 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562ad37187d0 0x562ad3813320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.383+0000 7effe6b2c800 1 -- 172.21.15.164:0/1573020899 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ad3813860 con 0x562ad37187d0 2024-09-13T23:05:32.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.383+0000 7effe30b8640 1 --2- 172.21.15.164:0/1573020899 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562ad37187d0 0x562ad3813320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.383+0000 7effe20b6640 1 --2- 172.21.15.164:0/1573020899 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efec8036b90 0x7efec8039050 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7effd8000f60 tx=0x7effd80012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.383+0000 7effe30b8640 1 --2- 172.21.15.164:0/1573020899 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562ad37187d0 0x562ad3813320 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.384+0000 7effe30b8640 1 -- 172.21.15.164:0/1573020899 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7effdc00a4a0 con 0x562ad37187d0 2024-09-13T23:05:32.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.384+0000 7effe6b2c800 1 -- 172.21.15.164:0/1573020899 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ad38108f0 con 0x562ad37187d0 2024-09-13T23:05:32.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.384+0000 7effe30b8640 1 -- 172.21.15.164:0/1573020899 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7effdc00a4a0 con 0x562ad37187d0 2024-09-13T23:05:32.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.384+0000 7effe6b2c800 1 -- 172.21.15.164:0/1573020899 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ad38156f0 con 0x562ad37187d0 2024-09-13T23:05:32.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.384+0000 7effe30b8640 1 -- 172.21.15.164:0/1573020899 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7effdc00a4a0 con 0x562ad37187d0 2024-09-13T23:05:32.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.384+0000 7effe6b2c800 1 -- 172.21.15.164:0/1573020899 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ad3814920 con 0x562ad37187d0 2024-09-13T23:05:32.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.385+0000 7effe30b8640 1 -- 172.21.15.164:0/1573020899 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7effdc00a4a0 con 0x562ad37187d0 2024-09-13T23:05:32.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.385+0000 7effe6b2c800 1 -- 172.21.15.164:0/1573020899 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ad3814cc0 con 0x562ad37187d0 2024-09-13T23:05:32.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.385+0000 7effe30b8640 1 -- 172.21.15.164:0/1573020899 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7effdc00a4a0 con 0x562ad37187d0 2024-09-13T23:05:32.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.385+0000 7effe6b2c800 1 Processor -- start 2024-09-13T23:05:32.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.385+0000 7effe6b2c800 1 -- start start 2024-09-13T23:05:32.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.385+0000 7effe6b2c800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3715c40 0x562ad3714290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.385+0000 7effe6b2c800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562ad35b0580 con 0x562ad3715c40 2024-09-13T23:05:32.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.386+0000 7effe20b6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3715c40 0x562ad3714290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.386+0000 7effe20b6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3715c40 0x562ad3714290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56596/0 (socket says 172.21.15.164:56596) 2024-09-13T23:05:32.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.386+0000 7effe20b6640 1 -- 172.21.15.164:0/1473823153 learned_addr learned my addr 172.21.15.164:0/1473823153 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.386+0000 7effe20b6640 1 -- 172.21.15.164:0/1473823153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ad3716060 con 0x562ad3715c40 2024-09-13T23:05:32.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.386+0000 7effe20b6640 1 --2- 172.21.15.164:0/1473823153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3715c40 0x562ad3714290 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7effd8001ed0 tx=0x7effd800d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.386+0000 7efecce01640 1 -- 172.21.15.164:0/1473823153 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effd801b550 con 0x562ad3715c40 2024-09-13T23:05:32.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.386+0000 7efecce01640 1 -- 172.21.15.164:0/1473823153 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effd801b6f0 con 0x562ad3715c40 2024-09-13T23:05:32.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.386+0000 7efecce01640 1 -- 172.21.15.164:0/1473823153 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effd801b9d0 con 0x562ad3715c40 2024-09-13T23:05:32.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.386+0000 7effe6b2c800 1 -- 172.21.15.164:0/1473823153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562ad3714890 con 0x562ad3715c40 2024-09-13T23:05:32.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.386+0000 7effe6b2c800 1 -- 172.21.15.164:0/1473823153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ad3714d90 con 0x562ad3715c40 2024-09-13T23:05:32.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.387+0000 7efecce01640 1 -- 172.21.15.164:0/1473823153 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7effd8023020 con 0x562ad3715c40 2024-09-13T23:05:32.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.387+0000 7efecce01640 1 --2- 172.21.15.164:0/1473823153 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efebc036b90 0x7efebc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.387+0000 7efecce01640 1 -- 172.21.15.164:0/1473823153 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7effd8021020 con 0x562ad3715c40 2024-09-13T23:05:32.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.387+0000 7effe30b8640 1 --2- 172.21.15.164:0/1473823153 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efebc036b90 0x7efebc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.388+0000 7effe6b2c800 1 Processor -- start 2024-09-13T23:05:32.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.388+0000 7effe6b2c800 1 -- start start 2024-09-13T23:05:32.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.388+0000 7effe30b8640 1 --2- 172.21.15.164:0/1473823153 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efebc036b90 0x7efebc039050 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x562ad3814440 tx=0x7effdc005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.388+0000 7effe6b2c800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3832c70 0x562ad3833070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.388+0000 7effe6b2c800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562ad38050b0 con 0x562ad3832c70 2024-09-13T23:05:32.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.388+0000 7effe20b6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3832c70 0x562ad3833070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.388+0000 7effe20b6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3832c70 0x562ad3833070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56610/0 (socket says 172.21.15.164:56610) 2024-09-13T23:05:32.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.388+0000 7effe20b6640 1 -- 172.21.15.164:0/4015481125 learned_addr learned my addr 172.21.15.164:0/4015481125 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.388+0000 7effe20b6640 1 -- 172.21.15.164:0/4015481125 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ad3833640 con 0x562ad3832c70 2024-09-13T23:05:32.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.389+0000 7effe20b6640 1 --2- 172.21.15.164:0/4015481125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3832c70 0x562ad3833070 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7effd804d100 tx=0x7effd8019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b650e87a1b1b34 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.389+0000 7efec67fc640 1 -- 172.21.15.164:0/4015481125 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effd80258e0 con 0x562ad3832c70 2024-09-13T23:05:32.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.389+0000 7efec67fc640 1 -- 172.21.15.164:0/4015481125 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effd8025410 con 0x562ad3832c70 2024-09-13T23:05:32.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.389+0000 7efec67fc640 1 -- 172.21.15.164:0/4015481125 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effd8025a80 con 0x562ad3832c70 2024-09-13T23:05:32.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.389+0000 7effe6b2c800 1 -- 172.21.15.164:0/4015481125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3832c70 msgr2=0x562ad3833070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.389+0000 7effe6b2c800 1 --2- 172.21.15.164:0/4015481125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3832c70 0x562ad3833070 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7effd804d100 tx=0x7effd8019ce0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.389+0000 7effe6b2c800 1 -- 172.21.15.164:0/4015481125 shutdown_connections 2024-09-13T23:05:32.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.389+0000 7effe6b2c800 1 --2- 172.21.15.164:0/4015481125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3832c70 0x562ad3833070 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.389+0000 7effe6b2c800 1 -- 172.21.15.164:0/4015481125 >> 172.21.15.164:0/4015481125 conn(0x562ad382efd0 msgr2=0x562ad382d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.389+0000 7effe6b2c800 1 -- 172.21.15.164:0/4015481125 shutdown_connections 2024-09-13T23:05:32.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.389+0000 7effe6b2c800 1 -- 172.21.15.164:0/4015481125 wait complete. 2024-09-13T23:05:32.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.389+0000 7effe6b2c800 1 Processor -- start 2024-09-13T23:05:32.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.390+0000 7effe6b2c800 1 -- start start 2024-09-13T23:05:32.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.390+0000 7effe6b2c800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3832c70 0x562ad383a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.390+0000 7effe6b2c800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562ad3833cb0 con 0x562ad3832c70 2024-09-13T23:05:32.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.390+0000 7effe20b6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3832c70 0x562ad383a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.390+0000 7effe20b6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3832c70 0x562ad383a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56616/0 (socket says 172.21.15.164:56616) 2024-09-13T23:05:32.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.390+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 learned_addr learned my addr 172.21.15.164:0/2006742387 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.390+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ad383a6c0 con 0x562ad3832c70 2024-09-13T23:05:32.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.390+0000 7effe20b6640 1 --2- 172.21.15.164:0/2006742387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3832c70 0x562ad383a180 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7effd804d1c0 tx=0x7effd804d090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.390+0000 7efec4ff9640 1 -- 172.21.15.164:0/2006742387 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effd800cc60 con 0x562ad3832c70 2024-09-13T23:05:32.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.390+0000 7efec4ff9640 1 -- 172.21.15.164:0/2006742387 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effd800ce00 con 0x562ad3832c70 2024-09-13T23:05:32.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.390+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562ad383a950 con 0x562ad3832c70 2024-09-13T23:05:32.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.390+0000 7efec4ff9640 1 -- 172.21.15.164:0/2006742387 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effd8040990 con 0x562ad3832c70 2024-09-13T23:05:32.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.391+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ad383a950 con 0x562ad3832c70 2024-09-13T23:05:32.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.391+0000 7efec4ff9640 1 -- 172.21.15.164:0/2006742387 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7effd8040b30 con 0x562ad3832c70 2024-09-13T23:05:32.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.391+0000 7efec4ff9640 1 --2- 172.21.15.164:0/2006742387 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efeac036b40 0x7efeac039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.391+0000 7efec4ff9640 1 -- 172.21.15.164:0/2006742387 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7effd8035070 con 0x562ad3832c70 2024-09-13T23:05:32.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.391+0000 7effe30b8640 1 --2- 172.21.15.164:0/2006742387 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efeac036b40 0x7efeac039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.392+0000 7effe30b8640 1 --2- 172.21.15.164:0/2006742387 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efeac036b40 0x7efeac039000 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x562ad3810840 tx=0x7effdc01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.392+0000 7effe6b2c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.392+0000 7effe6b2c800 1 --2- 172.21.15.164:0/2006742387 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562ad3845aa0 0x562ad3847f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.392+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ad38486b0 con 0x562ad3845aa0 2024-09-13T23:05:32.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.392+0000 7effe28b7640 1 --2- 172.21.15.164:0/2006742387 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562ad3845aa0 0x562ad3847f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.392+0000 7effe28b7640 1 --2- 172.21.15.164:0/2006742387 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562ad3845aa0 0x562ad3847f60 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.393+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.393+0000 7effe6b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.393+0000 7effe6b2c800 20 realm 2024-09-13T23:05:32.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.393+0000 7effe6b2c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.393+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ad3848ac0 con 0x562ad3845aa0 2024-09-13T23:05:32.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.393+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.393+0000 7effe6b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.393+0000 7effe6b2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:32.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.393+0000 7effe6b2c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.393+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ad3849390 con 0x562ad3845aa0 2024-09-13T23:05:32.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.393+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.393+0000 7effe6b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.393+0000 7effe6b2c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.393+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ad3849730 con 0x562ad3845aa0 2024-09-13T23:05:32.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.393+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.393+0000 7effe6b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:32.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.393+0000 7effe6b2c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.393+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ad3849f80 con 0x562ad3845aa0 2024-09-13T23:05:32.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.394+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.394+0000 7effe6b2c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:32.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.394+0000 7effe6b2c800 20 searching for the correct realm 2024-09-13T23:05:32.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.394+0000 7effe6b2c800 1 --2- 172.21.15.164:0/2006742387 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x562ad384bcf0 0x562ad384e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.394+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x562ad384bcf0 2024-09-13T23:05:32.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.394+0000 7effe20b6640 1 --2- 172.21.15.164:0/2006742387 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x562ad384bcf0 0x562ad384e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.394+0000 7effe20b6640 1 --2- 172.21.15.164:0/2006742387 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x562ad384bcf0 0x562ad384e0e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.394+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effd803f020 con 0x562ad384bcf0 2024-09-13T23:05:32.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.394+0000 7effe20b6640 1 --2- 172.21.15.164:0/2006742387 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7effd8032b60 0x7effd8042070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.394+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x7effd8032b60 2024-09-13T23:05:32.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.394+0000 7effe30b8640 1 --2- 172.21.15.164:0/2006742387 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7effd8032b60 0x7effd8042070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.395+0000 7effe30b8640 1 --2- 172.21.15.164:0/2006742387 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7effd8032b60 0x7effd8042070 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.395+0000 7effe30b8640 1 -- 172.21.15.164:0/2006742387 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effdc01f070 con 0x7effd8032b60 2024-09-13T23:05:32.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.395+0000 7effe30b8640 1 --2- 172.21.15.164:0/2006742387 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7effdc031040 0x7effdc032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.395+0000 7effe30b8640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x7effdc031040 2024-09-13T23:05:32.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.395+0000 7effe28b7640 1 --2- 172.21.15.164:0/2006742387 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7effdc031040 0x7effdc032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.396+0000 7effe28b7640 1 --2- 172.21.15.164:0/2006742387 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7effdc031040 0x7effdc032430 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.396+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effd4051070 con 0x7effdc031040 2024-09-13T23:05:32.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.396+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x562ad3845aa0 2024-09-13T23:05:32.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.396+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.396+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x562ad3845aa0 2024-09-13T23:05:32.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.396+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.396+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x7effdc031040 2024-09-13T23:05:32.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.397+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effd4051070 con 0x7effdc031040 2024-09-13T23:05:32.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.397+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x7effdc031040 2024-09-13T23:05:32.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.397+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effd4051070 con 0x7effdc031040 2024-09-13T23:05:32.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.397+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x7effd8032b60 2024-09-13T23:05:32.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.397+0000 7effe30b8640 1 -- 172.21.15.164:0/2006742387 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effdc01f070 con 0x7effd8032b60 2024-09-13T23:05:32.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.397+0000 7effe30b8640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x562ad384bcf0 2024-09-13T23:05:32.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.397+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effd803f020 con 0x562ad384bcf0 2024-09-13T23:05:32.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.397+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x562ad3845aa0 2024-09-13T23:05:32.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.397+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.397+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x7effdc031040 2024-09-13T23:05:32.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.398+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effd4051070 con 0x7effdc031040 2024-09-13T23:05:32.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.398+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x562ad3845aa0 2024-09-13T23:05:32.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.398+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.398+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x7effd8032b60 2024-09-13T23:05:32.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.398+0000 7effe30b8640 1 -- 172.21.15.164:0/2006742387 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7effdc01f070 con 0x7effd8032b60 2024-09-13T23:05:32.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.398+0000 7effe30b8640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x562ad384bcf0 2024-09-13T23:05:32.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.398+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effd803f020 con 0x562ad384bcf0 2024-09-13T23:05:32.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.398+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x562ad384bcf0 2024-09-13T23:05:32.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.399+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effd803f020 con 0x562ad384bcf0 2024-09-13T23:05:32.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.399+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x7effdc031040 2024-09-13T23:05:32.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.399+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effd4051070 con 0x7effdc031040 2024-09-13T23:05:32.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.399+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x562ad384bcf0 2024-09-13T23:05:32.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.399+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effd803f020 con 0x562ad384bcf0 2024-09-13T23:05:32.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.399+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x562ad384bcf0 2024-09-13T23:05:32.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.399+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effd803f020 con 0x562ad384bcf0 2024-09-13T23:05:32.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.399+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x562ad3845aa0 2024-09-13T23:05:32.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.399+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.400+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x562ad3845aa0 2024-09-13T23:05:32.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.400+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.400+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x7effdc031040 2024-09-13T23:05:32.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.400+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effd4051070 con 0x7effdc031040 2024-09-13T23:05:32.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.400+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x562ad384bcf0 2024-09-13T23:05:32.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.400+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effd803f020 con 0x562ad384bcf0 2024-09-13T23:05:32.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.400+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x7effd8032b60 2024-09-13T23:05:32.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.400+0000 7effe30b8640 1 -- 172.21.15.164:0/2006742387 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effdc01f070 con 0x7effd8032b60 2024-09-13T23:05:32.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.400+0000 7effe30b8640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x562ad3845aa0 2024-09-13T23:05:32.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.401+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.401+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x7effdc031040 2024-09-13T23:05:32.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.401+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effd4051070 con 0x7effdc031040 2024-09-13T23:05:32.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.401+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x562ad384bcf0 2024-09-13T23:05:32.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.401+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effd803f020 con 0x562ad384bcf0 2024-09-13T23:05:32.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.401+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x7effdc031040 2024-09-13T23:05:32.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.401+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effd4051070 con 0x7effdc031040 2024-09-13T23:05:32.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.401+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x7effd8032b60 2024-09-13T23:05:32.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.402+0000 7effe30b8640 1 -- 172.21.15.164:0/2006742387 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effdc01f070 con 0x7effd8032b60 2024-09-13T23:05:32.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.402+0000 7effe30b8640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x562ad384bcf0 2024-09-13T23:05:32.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.402+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effd803f020 con 0x562ad384bcf0 2024-09-13T23:05:32.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.402+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x7effdc031040 2024-09-13T23:05:32.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.402+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effd4051070 con 0x7effdc031040 2024-09-13T23:05:32.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.402+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x562ad3845aa0 2024-09-13T23:05:32.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.402+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.402+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562ad384e6a0 con 0x7effd8032b60 2024-09-13T23:05:32.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.403+0000 7effe30b8640 1 -- 172.21.15.164:0/2006742387 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effdc01f070 con 0x7effd8032b60 2024-09-13T23:05:32.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.403+0000 7effe6b2c800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:32.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.403+0000 7effe6b2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:32.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.403+0000 7effe6b2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:32.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.403+0000 7effe6b2c800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:32.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.403+0000 7effe6b2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:32.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.403+0000 7effe6b2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:32.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.403+0000 7effe6b2c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.403+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ad384a930 con 0x562ad3845aa0 2024-09-13T23:05:32.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.403+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.403+0000 7effe6b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.403+0000 7effe6b2c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.403+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ad384b1d0 con 0x562ad3845aa0 2024-09-13T23:05:32.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.403+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.403+0000 7effe6b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:32.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.403+0000 7effe6b2c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.403+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ad384b1d0 con 0x562ad3845aa0 2024-09-13T23:05:32.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.403+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.403+0000 7effe6b2c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:32.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.403+0000 7effe6b2c800 20 zone default found 2024-09-13T23:05:32.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.403+0000 7effe6b2c800 4 Realm: () 2024-09-13T23:05:32.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.403+0000 7effe6b2c800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:32.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.403+0000 7effe6b2c800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:32.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.403+0000 7effe6b2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:32.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.403+0000 7effe6b2c800 20 zonegroup default 2024-09-13T23:05:32.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.403+0000 7effe6b2c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.403+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ad384eb20 con 0x7effdc031040 2024-09-13T23:05:32.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.404+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7effd4051070 con 0x7effdc031040 2024-09-13T23:05:32.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.404+0000 7effe6b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.404+0000 7effe6b2c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.404+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ad3850590 con 0x562ad384bcf0 2024-09-13T23:05:32.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.404+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7effd803f020 con 0x562ad384bcf0 2024-09-13T23:05:32.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.404+0000 7effe6b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.404+0000 7effe6b2c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.404+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ad3850a60 con 0x562ad384bcf0 2024-09-13T23:05:32.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.404+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7effd803f020 con 0x562ad384bcf0 2024-09-13T23:05:32.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.404+0000 7effe6b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.404+0000 7effe6b2c800 20 started sync module instance, tier type = 2024-09-13T23:05:32.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.404+0000 7effe6b2c800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:32.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.404+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ad384f9a0 con 0x7effd8032b60 2024-09-13T23:05:32.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.405+0000 7effe30b8640 1 -- 172.21.15.164:0/2006742387 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effdc040040 con 0x7effd8032b60 2024-09-13T23:05:32.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.405+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94741937323408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ad38501b0 con 0x7effd8032b60 2024-09-13T23:05:32.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.405+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ad3851990 con 0x562ad3845aa0 2024-09-13T23:05:32.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.406+0000 7effe30b8640 1 -- 172.21.15.164:0/2006742387 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94741937323408] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effdc040040 con 0x7effd8032b60 2024-09-13T23:05:32.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.407+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.407+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94741937329376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ad3851db0 con 0x562ad3845aa0 2024-09-13T23:05:32.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.407+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ad3852770 con 0x562ad384bcf0 2024-09-13T23:05:32.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.408+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effd803f020 con 0x562ad384bcf0 2024-09-13T23:05:32.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.408+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94741937332928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ad3852fc0 con 0x562ad384bcf0 2024-09-13T23:05:32.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.408+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ad3853a80 con 0x7effd8032b60 2024-09-13T23:05:32.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.408+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94741937329376] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.409+0000 7effe30b8640 1 -- 172.21.15.164:0/2006742387 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effdc040040 con 0x7effd8032b60 2024-09-13T23:05:32.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.409+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94741937337776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ad3853ea0 con 0x7effd8032b60 2024-09-13T23:05:32.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.409+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ad38548e0 con 0x562ad3845aa0 2024-09-13T23:05:32.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.409+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94741937332928] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effd803f020 con 0x562ad384bcf0 2024-09-13T23:05:32.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.410+0000 7effe30b8640 1 -- 172.21.15.164:0/2006742387 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94741937337776] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effdc040040 con 0x7effd8032b60 2024-09-13T23:05:32.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.410+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.410+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94741937330432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ad38548a0 con 0x562ad3845aa0 2024-09-13T23:05:32.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.410+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ad3855180 con 0x7effdc031040 2024-09-13T23:05:32.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.411+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effd4051070 con 0x7effdc031040 2024-09-13T23:05:32.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.411+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94741937343616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ad3855550 con 0x7effdc031040 2024-09-13T23:05:32.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.411+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ad3855da0 con 0x7effdc031040 2024-09-13T23:05:32.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.411+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94741937330432] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.412+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94741937343616] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effd4051070 con 0x7effdc031040 2024-09-13T23:05:32.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.412+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effd4051070 con 0x7effdc031040 2024-09-13T23:05:32.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.412+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94741937344672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ad3855970 con 0x7effdc031040 2024-09-13T23:05:32.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.412+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ad38561c0 con 0x7effdc031040 2024-09-13T23:05:32.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.413+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94741937344672] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effd4051070 con 0x7effdc031040 2024-09-13T23:05:32.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.413+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effd4051070 con 0x7effdc031040 2024-09-13T23:05:32.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.413+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94741937346208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ad3856030 con 0x7effdc031040 2024-09-13T23:05:32.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.413+0000 7effe6b2c800 20 add_watcher() i=0 2024-09-13T23:05:32.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.413+0000 7effe6b2c800 20 add_watcher() i=1 2024-09-13T23:05:32.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.413+0000 7effe6b2c800 20 add_watcher() i=2 2024-09-13T23:05:32.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.413+0000 7effe6b2c800 20 add_watcher() i=3 2024-09-13T23:05:32.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.413+0000 7effe6b2c800 20 add_watcher() i=4 2024-09-13T23:05:32.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.413+0000 7effe6b2c800 20 add_watcher() i=5 2024-09-13T23:05:32.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.413+0000 7effe6b2c800 20 add_watcher() i=6 2024-09-13T23:05:32.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.414+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94741937346208] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effd4051070 con 0x7effdc031040 2024-09-13T23:05:32.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.414+0000 7effe6b2c800 20 add_watcher() i=7 2024-09-13T23:05:32.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.414+0000 7effe6b2c800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:32.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.414+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ad38595a0 con 0x562ad3845aa0 2024-09-13T23:05:32.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.414+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.414+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94741937347264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ad3856ac0 con 0x562ad3845aa0 2024-09-13T23:05:32.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.415+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94741937347264] v32'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.415+0000 7efe997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:32.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.415+0000 7effe6b2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:32.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.415+0000 7effe6b2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:32.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.415+0000 7effe6b2c800 5 note: GC not initialized 2024-09-13T23:05:32.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.416+0000 7efe13fff640 20 reqs_thread_entry: start 2024-09-13T23:05:32.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.416+0000 7effe6b2c800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:32.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.416+0000 7effe6b2c800 20 Filter name: none 2024-09-13T23:05:32.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.416+0000 7efe11ffb640 20 reqs_thread_entry: start 2024-09-13T23:05:32.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.416+0000 7effe6b2c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:05:32.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.416+0000 7effe6b2c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.416+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ad388ca50 con 0x562ad3845aa0 2024-09-13T23:05:32.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.416+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.416+0000 7effe6b2c800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:05:32.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.416+0000 7effe6b2c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:05:32.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.416+0000 7effe6b2c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:32.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.416+0000 7effe6b2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:32.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.416+0000 7effe6b2c800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T23:05:32.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.416+0000 7effe6b2c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.416+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ad388d4c0 con 0x7effdc031040 2024-09-13T23:05:32.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.417+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7effd4051070 con 0x7effdc031040 2024-09-13T23:05:32.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.417+0000 7effe6b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.417+0000 7effe6b2c800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T23:05:32.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.417+0000 7effe6b2c800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:05:32.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.417+0000 7effe6b2c800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T23:05:32.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.417+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ad3892f10 con 0x562ad3845aa0 2024-09-13T23:05:32.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.418+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v32'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.418+0000 7effe6b2c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:32.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.418+0000 7effe6b2c800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:32.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.418+0000 7effe6b2c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:05:32.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.418+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94741937596624 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ad388e590 con 0x562ad3845aa0 2024-09-13T23:05:32.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.418+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== watch-notify(notify (1) cookie 94741937330432 notify 137438953475 ret 0) ==== 720+0+0 (crc 0 0 0) 0x7effd4097040 con 0x562ad3845aa0 2024-09-13T23:05:32.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.418+0000 7efec67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94741937330432 notifier 4351 bl.length()=678 2024-09-13T23:05:32.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.418+0000 7efec67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:32.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.418+0000 7efec67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:32.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.418+0000 7efec67fc640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7efea8003ea0 con 0x562ad3845aa0 2024-09-13T23:05:32.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.418+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(65 notify.4 [notify cookie 94741937596624 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.418+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.419+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== watch-notify(notify_complete (2) cookie 94741937596624 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562ad380cd10 con 0x562ad3845aa0 2024-09-13T23:05:32.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.419+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ad38928d0 con 0x7effdc031040 2024-09-13T23:05:32.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.420+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7effd4051070 con 0x7effdc031040 2024-09-13T23:05:32.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.420+0000 7effe6b2c800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T23:05:32.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.420+0000 7effe6b2c800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:05:32.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.420+0000 7effe6b2c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T23:05:32.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.420+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94741937596624 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562ad388e0e0 con 0x562ad384bcf0 2024-09-13T23:05:32.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.420+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== watch-notify(notify (1) cookie 94741937332928 notify 137438953472 ret 0) ==== 219+0+0 (crc 0 0 0) 0x562ad383a6c0 con 0x562ad384bcf0 2024-09-13T23:05:32.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.420+0000 7efec5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94741937332928 notifier 4351 bl.length()=177 2024-09-13T23:05:32.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.420+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(68 notify.2 [notify cookie 94741937596624 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7effd803f020 con 0x562ad384bcf0 2024-09-13T23:05:32.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.420+0000 7efec5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T23:05:32.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.420+0000 7efec5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:05:32.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.420+0000 7efec5ffb640 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7efe18003400 con 0x562ad384bcf0 2024-09-13T23:05:32.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.421+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effd803f020 con 0x562ad384bcf0 2024-09-13T23:05:32.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.421+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== watch-notify(notify_complete (2) cookie 94741937596624 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562ad3833640 con 0x562ad384bcf0 2024-09-13T23:05:32.436 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:05:31.300851Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T23:05:32.417695Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:05:31.300826Z","tags":[],"group_ids":[]} 2024-09-13T23:05:32.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.422+0000 7efe997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:32.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.422+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94741937347264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ad388e9c0 con 0x562ad3845aa0 2024-09-13T23:05:32.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.423+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94741937347264] v32'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.423+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94741937323408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ad388a730 con 0x7effd8032b60 2024-09-13T23:05:32.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.423+0000 7effe30b8640 1 -- 172.21.15.164:0/2006742387 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94741937323408] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effdc040040 con 0x7effd8032b60 2024-09-13T23:05:32.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.423+0000 7effe6b2c800 20 remove_watcher() i=0 2024-09-13T23:05:32.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.423+0000 7effe6b2c800 2 removed watcher, disabling cache 2024-09-13T23:05:32.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.423+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94741937329376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ad388a730 con 0x562ad3845aa0 2024-09-13T23:05:32.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.424+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94741937329376] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.425+0000 7effe6b2c800 20 remove_watcher() i=1 2024-09-13T23:05:32.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.425+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94741937332928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ad388a730 con 0x562ad384bcf0 2024-09-13T23:05:32.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.426+0000 7effe20b6640 1 -- 172.21.15.164:0/2006742387 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94741937332928] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effd803f020 con 0x562ad384bcf0 2024-09-13T23:05:32.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.426+0000 7effe6b2c800 20 remove_watcher() i=2 2024-09-13T23:05:32.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.426+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94741937337776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ad388a730 con 0x7effd8032b60 2024-09-13T23:05:32.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.427+0000 7effe30b8640 1 -- 172.21.15.164:0/2006742387 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94741937337776] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effdc040040 con 0x7effd8032b60 2024-09-13T23:05:32.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.427+0000 7effe6b2c800 20 remove_watcher() i=3 2024-09-13T23:05:32.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.427+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94741937330432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ad388a730 con 0x562ad3845aa0 2024-09-13T23:05:32.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.428+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94741937330432] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effd4051070 con 0x562ad3845aa0 2024-09-13T23:05:32.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.428+0000 7effe6b2c800 20 remove_watcher() i=4 2024-09-13T23:05:32.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.428+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94741937343616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ad388a730 con 0x7effdc031040 2024-09-13T23:05:32.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.428+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94741937343616] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effd4051070 con 0x7effdc031040 2024-09-13T23:05:32.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.428+0000 7effe6b2c800 20 remove_watcher() i=5 2024-09-13T23:05:32.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.429+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94741937344672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ad388a730 con 0x7effdc031040 2024-09-13T23:05:32.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.430+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94741937344672] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effd4051070 con 0x7effdc031040 2024-09-13T23:05:32.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.430+0000 7effe6b2c800 20 remove_watcher() i=6 2024-09-13T23:05:32.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.430+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94741937346208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562ad388a730 con 0x7effdc031040 2024-09-13T23:05:32.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.430+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94741937346208] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effd4051070 con 0x7effdc031040 2024-09-13T23:05:32.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.430+0000 7effe6b2c800 20 remove_watcher() i=7 2024-09-13T23:05:32.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.431+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7effdc031040 msgr2=0x7effdc032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.431+0000 7effe6b2c800 1 --2- 172.21.15.164:0/2006742387 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7effdc031040 0x7effdc032430 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.431+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562ad3845aa0 msgr2=0x562ad3847f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.431+0000 7effe6b2c800 1 --2- 172.21.15.164:0/2006742387 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562ad3845aa0 0x562ad3847f60 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.431+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7effd8032b60 msgr2=0x7effd8042070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.431+0000 7effe6b2c800 1 --2- 172.21.15.164:0/2006742387 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7effd8032b60 0x7effd8042070 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.431+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x562ad384bcf0 msgr2=0x562ad384e0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.431+0000 7effe6b2c800 1 --2- 172.21.15.164:0/2006742387 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x562ad384bcf0 0x562ad384e0e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.431+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efeac036b40 msgr2=0x7efeac039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.431+0000 7effe6b2c800 1 --2- 172.21.15.164:0/2006742387 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efeac036b40 0x7efeac039000 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x562ad3810840 tx=0x7effdc01f000 comp rx=0 tx=0).stop 2024-09-13T23:05:32.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.431+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3832c70 msgr2=0x562ad383a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.431+0000 7effe28b7640 1 -- 172.21.15.164:0/2006742387 reap_dead start 2024-09-13T23:05:32.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.431+0000 7effe6b2c800 1 --2- 172.21.15.164:0/2006742387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3832c70 0x562ad383a180 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7effd804d1c0 tx=0x7effd804d090 comp rx=0 tx=0).stop 2024-09-13T23:05:32.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.431+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 shutdown_connections 2024-09-13T23:05:32.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.431+0000 7effe6b2c800 1 --2- 172.21.15.164:0/2006742387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3832c70 0x562ad383a180 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.431+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 >> 172.21.15.164:0/2006742387 conn(0x562ad382efd0 msgr2=0x562ad382d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.431+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 shutdown_connections 2024-09-13T23:05:32.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.431+0000 7effe6b2c800 1 -- 172.21.15.164:0/2006742387 wait complete. 2024-09-13T23:05:32.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.431+0000 7effe6b2c800 1 -- 172.21.15.164:0/1473823153 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efebc036b90 msgr2=0x7efebc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.431+0000 7effe6b2c800 1 --2- 172.21.15.164:0/1473823153 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efebc036b90 0x7efebc039050 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x562ad3814440 tx=0x7effdc005840 comp rx=0 tx=0).stop 2024-09-13T23:05:32.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.431+0000 7effe6b2c800 1 -- 172.21.15.164:0/1473823153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3715c40 msgr2=0x562ad3714290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.431+0000 7effe6b2c800 1 --2- 172.21.15.164:0/1473823153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3715c40 0x562ad3714290 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7effd8001ed0 tx=0x7effd800d7a0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.431+0000 7effe6b2c800 1 -- 172.21.15.164:0/1473823153 shutdown_connections 2024-09-13T23:05:32.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.431+0000 7effe6b2c800 1 --2- 172.21.15.164:0/1473823153 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efebc036b90 0x7efebc039050 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.431+0000 7effe6b2c800 1 --2- 172.21.15.164:0/1473823153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3715c40 0x562ad3714290 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.431+0000 7effe6b2c800 1 -- 172.21.15.164:0/1473823153 >> 172.21.15.164:0/1473823153 conn(0x562ad3818cf0 msgr2=0x562ad381b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.431+0000 7effe6b2c800 1 -- 172.21.15.164:0/1473823153 shutdown_connections 2024-09-13T23:05:32.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.431+0000 7effe6b2c800 1 -- 172.21.15.164:0/1473823153 wait complete. 2024-09-13T23:05:32.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.432+0000 7effe6b2c800 1 -- 172.21.15.164:0/1573020899 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562ad37187d0 msgr2=0x562ad3813320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.432+0000 7effe6b2c800 1 --2- 172.21.15.164:0/1573020899 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562ad37187d0 0x562ad3813320 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.432+0000 7effe6b2c800 1 -- 172.21.15.164:0/1573020899 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efec8036b90 msgr2=0x7efec8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.432+0000 7effe6b2c800 1 --2- 172.21.15.164:0/1573020899 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efec8036b90 0x7efec8039050 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7effd8000f60 tx=0x7effd80012b0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.432+0000 7effe6b2c800 1 -- 172.21.15.164:0/1573020899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3689630 msgr2=0x562ad380c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.432+0000 7effe6b2c800 1 --2- 172.21.15.164:0/1573020899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3689630 0x562ad380c2b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x562ad38057c0 tx=0x7effd4002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.432+0000 7effe6b2c800 1 -- 172.21.15.164:0/1573020899 shutdown_connections 2024-09-13T23:05:32.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.432+0000 7effe6b2c800 1 --2- 172.21.15.164:0/1573020899 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562ad37187d0 0x562ad3813320 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.432+0000 7effe6b2c800 1 --2- 172.21.15.164:0/1573020899 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efec8036b90 0x7efec8039050 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.432+0000 7effe6b2c800 1 --2- 172.21.15.164:0/1573020899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562ad3689630 0x562ad380c2b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.432+0000 7effe6b2c800 1 -- 172.21.15.164:0/1573020899 >> 172.21.15.164:0/1573020899 conn(0x562ad370fe00 msgr2=0x562ad37feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.432+0000 7effe6b2c800 1 -- 172.21.15.164:0/1573020899 shutdown_connections 2024-09-13T23:05:32.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.432+0000 7effe6b2c800 1 -- 172.21.15.164:0/1573020899 wait complete. 2024-09-13T23:05:32.447 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:05:31.300851Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T23:05:32.417695Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:05:31.300826Z', 'tags': [], 'group_ids': []} 2024-09-13T23:05:32.447 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T23:05:32.447 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T23:05:32.448 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T23:05:32.492 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:32.492 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:32.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.492+0000 7f68c8b39800 1 Processor -- start 2024-09-13T23:05:32.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.492+0000 7f68c8b39800 1 -- start start 2024-09-13T23:05:32.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.492+0000 7f68c8b39800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x559cf2023990 0x559cf2025d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.492+0000 7f68c8b39800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559cf1edeb30 con 0x559cf1f93610 2024-09-13T23:05:32.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.492+0000 7f68c8b39800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x559cf1ec0360 con 0x559cf2023990 2024-09-13T23:05:32.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.493+0000 7f68bbfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x559cf2023990 0x559cf2025d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.493+0000 7f68c47d1640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x559cf1f93610 0x559cf2022270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40782/0 (socket says 172.21.15.164:40782) 2024-09-13T23:05:32.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.493+0000 7f68c47d1640 1 -- 172.21.15.164:0/2119523051 learned_addr learned my addr 172.21.15.164:0/2119523051 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:32.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.493+0000 7f68bbfff640 1 -- 172.21.15.164:0/2119523051 >> v1:172.21.15.17:6789/0 conn(0x559cf1f93610 legacy=0x559cf2022270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.493+0000 7f68c3fd0640 1 -- 172.21.15.164:0/2119523051 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 780083486 0 0) 0x559cf1edeb30 con 0x559cf1f93610 2024-09-13T23:05:32.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.493+0000 7f68bbfff640 1 -- 172.21.15.164:0/2119523051 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cf1ee6e00 con 0x559cf2023990 2024-09-13T23:05:32.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.495+0000 7f68bbfff640 1 --2- 172.21.15.164:0/2119523051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf2023990 0x559cf2025d80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00a470 tx=0x7f68ac045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbec4cb63d9364cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.495+0000 7f68c3fd0640 1 -- 172.21.15.164:0/2119523051 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68ac053570 con 0x559cf2023990 2024-09-13T23:05:32.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.495+0000 7f68c3fd0640 1 -- 172.21.15.164:0/2119523051 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68ac058070 con 0x559cf2023990 2024-09-13T23:05:32.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.495+0000 7f68c3fd0640 1 -- 172.21.15.164:0/2119523051 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68ac053880 con 0x559cf2023990 2024-09-13T23:05:32.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.495+0000 7f68c8b39800 1 -- 172.21.15.164:0/2119523051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf2023990 msgr2=0x559cf2025d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.495+0000 7f68c8b39800 1 --2- 172.21.15.164:0/2119523051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf2023990 0x559cf2025d80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00a470 tx=0x7f68ac045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:32.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.496+0000 7f68c8b39800 1 -- 172.21.15.164:0/2119523051 shutdown_connections 2024-09-13T23:05:32.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.496+0000 7f68c8b39800 1 --2- 172.21.15.164:0/2119523051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf2023990 0x559cf2025d80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.496+0000 7f68c8b39800 1 -- 172.21.15.164:0/2119523051 >> 172.21.15.164:0/2119523051 conn(0x559cf2019de0 msgr2=0x559cf201c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.496+0000 7f68c8b39800 1 -- 172.21.15.164:0/2119523051 shutdown_connections 2024-09-13T23:05:32.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.496+0000 7f68c8b39800 1 -- 172.21.15.164:0/2119523051 wait complete. 2024-09-13T23:05:32.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.509+0000 7f68c8b39800 1 Processor -- start 2024-09-13T23:05:32.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.509+0000 7f68c8b39800 1 -- start start 2024-09-13T23:05:32.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.509+0000 7f68c8b39800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf1f93610 0x559cf201fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.510+0000 7f68c8b39800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559cf1f6b330 con 0x559cf1f93610 2024-09-13T23:05:32.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.510+0000 7f68c47d1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf1f93610 0x559cf201fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.510+0000 7f68c47d1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf1f93610 0x559cf201fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56630/0 (socket says 172.21.15.164:56630) 2024-09-13T23:05:32.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.510+0000 7f68c47d1640 1 -- 172.21.15.164:0/584502826 learned_addr learned my addr 172.21.15.164:0/584502826 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.510+0000 7f68c47d1640 1 -- 172.21.15.164:0/584502826 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cf1eb8bc0 con 0x559cf1f93610 2024-09-13T23:05:32.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.510+0000 7f68c47d1640 1 --2- 172.21.15.164:0/584502826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf1f93610 0x559cf201fba0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f68b400b240 tx=0x7f68b400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1992c7a58098c8e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.511+0000 7f67b260c640 1 -- 172.21.15.164:0/584502826 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68b4008070 con 0x559cf1f93610 2024-09-13T23:05:32.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.511+0000 7f67b260c640 1 -- 172.21.15.164:0/584502826 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68b400d500 con 0x559cf1f93610 2024-09-13T23:05:32.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.511+0000 7f67b260c640 1 -- 172.21.15.164:0/584502826 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68b400d860 con 0x559cf1f93610 2024-09-13T23:05:32.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.511+0000 7f68c8b39800 1 -- 172.21.15.164:0/584502826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf1f93610 msgr2=0x559cf201fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.511+0000 7f68c8b39800 1 --2- 172.21.15.164:0/584502826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf1f93610 0x559cf201fba0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f68b400b240 tx=0x7f68b400b700 comp rx=0 tx=0).stop 2024-09-13T23:05:32.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.511+0000 7f68c8b39800 1 -- 172.21.15.164:0/584502826 shutdown_connections 2024-09-13T23:05:32.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.511+0000 7f68c8b39800 1 --2- 172.21.15.164:0/584502826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf1f93610 0x559cf201fba0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.511+0000 7f68c8b39800 1 -- 172.21.15.164:0/584502826 >> 172.21.15.164:0/584502826 conn(0x559cf2019de0 msgr2=0x559cf210a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.511+0000 7f68c8b39800 1 -- 172.21.15.164:0/584502826 shutdown_connections 2024-09-13T23:05:32.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.511+0000 7f68c8b39800 1 -- 172.21.15.164:0/584502826 wait complete. 2024-09-13T23:05:32.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.512+0000 7f68c8b39800 1 Processor -- start 2024-09-13T23:05:32.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.512+0000 7f68c8b39800 1 -- start start 2024-09-13T23:05:32.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.512+0000 7f68c8b39800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf1f93610 0x559cf21182b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.512+0000 7f68c8b39800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559cf2026680 con 0x559cf1f93610 2024-09-13T23:05:32.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.512+0000 7f68c47d1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf1f93610 0x559cf21182b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.512+0000 7f68c47d1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf1f93610 0x559cf21182b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56638/0 (socket says 172.21.15.164:56638) 2024-09-13T23:05:32.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.512+0000 7f68c47d1640 1 -- 172.21.15.164:0/1256627832 learned_addr learned my addr 172.21.15.164:0/1256627832 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.513+0000 7f68c47d1640 1 -- 172.21.15.164:0/1256627832 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cf1eccfe0 con 0x559cf1f93610 2024-09-13T23:05:32.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.513+0000 7f68c47d1640 1 --2- 172.21.15.164:0/1256627832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf1f93610 0x559cf21182b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f68b4000f60 tx=0x7f68b4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.513+0000 7f67b0e09640 1 -- 172.21.15.164:0/1256627832 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68b4019870 con 0x559cf1f93610 2024-09-13T23:05:32.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.513+0000 7f67b0e09640 1 -- 172.21.15.164:0/1256627832 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68b4019a10 con 0x559cf1f93610 2024-09-13T23:05:32.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.513+0000 7f67b0e09640 1 -- 172.21.15.164:0/1256627832 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68b4019d10 con 0x559cf1f93610 2024-09-13T23:05:32.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.513+0000 7f68c8b39800 1 -- 172.21.15.164:0/1256627832 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559cf21187f0 con 0x559cf1f93610 2024-09-13T23:05:32.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.513+0000 7f68c8b39800 1 -- 172.21.15.164:0/1256627832 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cf2118d10 con 0x559cf1f93610 2024-09-13T23:05:32.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.514+0000 7f67b0e09640 1 -- 172.21.15.164:0/1256627832 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f68b4017040 con 0x559cf1f93610 2024-09-13T23:05:32.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.514+0000 7f67b0e09640 1 --2- 172.21.15.164:0/1256627832 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f67ac036b40 0x7f67ac039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.514+0000 7f67b0e09640 1 -- 172.21.15.164:0/1256627832 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f68b4015020 con 0x559cf1f93610 2024-09-13T23:05:32.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.514+0000 7f68bbfff640 1 --2- 172.21.15.164:0/1256627832 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f67ac036b40 0x7f67ac039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.514+0000 7f68c8b39800 1 --2- 172.21.15.164:0/1256627832 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559cf2023990 0x559cf211f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.514+0000 7f68c8b39800 1 -- 172.21.15.164:0/1256627832 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559cf211f860 con 0x559cf2023990 2024-09-13T23:05:32.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.514+0000 7f68c4fd2640 1 --2- 172.21.15.164:0/1256627832 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559cf2023990 0x559cf211f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.515+0000 7f68bbfff640 1 --2- 172.21.15.164:0/1256627832 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f67ac036b40 0x7f67ac039000 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f68ac057000 tx=0x7f68ac052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.515+0000 7f68c4fd2640 1 --2- 172.21.15.164:0/1256627832 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559cf2023990 0x559cf211f320 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.515+0000 7f68c4fd2640 1 -- 172.21.15.164:0/1256627832 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68bc00a4a0 con 0x559cf2023990 2024-09-13T23:05:32.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.515+0000 7f68c8b39800 1 -- 172.21.15.164:0/1256627832 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559cf211c8f0 con 0x559cf2023990 2024-09-13T23:05:32.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.515+0000 7f68c4fd2640 1 -- 172.21.15.164:0/1256627832 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f68bc00a4a0 con 0x559cf2023990 2024-09-13T23:05:32.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.515+0000 7f68c8b39800 1 -- 172.21.15.164:0/1256627832 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559cf2121640 con 0x559cf2023990 2024-09-13T23:05:32.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.516+0000 7f68c4fd2640 1 -- 172.21.15.164:0/1256627832 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f68bc00a4a0 con 0x559cf2023990 2024-09-13T23:05:32.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.516+0000 7f68c8b39800 1 -- 172.21.15.164:0/1256627832 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559cf2120870 con 0x559cf2023990 2024-09-13T23:05:32.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.516+0000 7f68c4fd2640 1 -- 172.21.15.164:0/1256627832 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f68bc00a4a0 con 0x559cf2023990 2024-09-13T23:05:32.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.516+0000 7f68c8b39800 1 -- 172.21.15.164:0/1256627832 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559cf2120cc0 con 0x559cf2023990 2024-09-13T23:05:32.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.516+0000 7f68c4fd2640 1 -- 172.21.15.164:0/1256627832 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f68bc00a4a0 con 0x559cf2023990 2024-09-13T23:05:32.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.517+0000 7f68c8b39800 1 Processor -- start 2024-09-13T23:05:32.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.517+0000 7f68c8b39800 1 -- start start 2024-09-13T23:05:32.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.517+0000 7f68c8b39800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf212fc50 0x559cf2130070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.517+0000 7f68c8b39800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559cf1eba580 con 0x559cf212fc50 2024-09-13T23:05:32.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.517+0000 7f68bbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf212fc50 0x559cf2130070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.517+0000 7f68bbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf212fc50 0x559cf2130070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56642/0 (socket says 172.21.15.164:56642) 2024-09-13T23:05:32.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.517+0000 7f68bbfff640 1 -- 172.21.15.164:0/261994649 learned_addr learned my addr 172.21.15.164:0/261994649 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.517+0000 7f68bbfff640 1 -- 172.21.15.164:0/261994649 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cf21305b0 con 0x559cf212fc50 2024-09-13T23:05:32.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.518+0000 7f68bbfff640 1 --2- 172.21.15.164:0/261994649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf212fc50 0x559cf2130070 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f68ac025bf0 tx=0x7f68ac002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.518+0000 7f67a9ffb640 1 -- 172.21.15.164:0/261994649 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68ac06f070 con 0x559cf212fc50 2024-09-13T23:05:32.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.518+0000 7f67a9ffb640 1 -- 172.21.15.164:0/261994649 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68ac05f550 con 0x559cf212fc50 2024-09-13T23:05:32.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.518+0000 7f68c8b39800 1 -- 172.21.15.164:0/261994649 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559cf21307e0 con 0x559cf212fc50 2024-09-13T23:05:32.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.518+0000 7f67a9ffb640 1 -- 172.21.15.164:0/261994649 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68ac05f830 con 0x559cf212fc50 2024-09-13T23:05:32.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.518+0000 7f68c8b39800 1 -- 172.21.15.164:0/261994649 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cf2133460 con 0x559cf212fc50 2024-09-13T23:05:32.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.518+0000 7f67a9ffb640 1 -- 172.21.15.164:0/261994649 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f68ac05f9d0 con 0x559cf212fc50 2024-09-13T23:05:32.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.519+0000 7f67a9ffb640 1 --2- 172.21.15.164:0/261994649 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f679c036b90 0x7f679c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.519+0000 7f67a9ffb640 1 -- 172.21.15.164:0/261994649 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f68ac092c40 con 0x559cf212fc50 2024-09-13T23:05:32.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.519+0000 7f68c4fd2640 1 --2- 172.21.15.164:0/261994649 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f679c036b90 0x7f679c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.519+0000 7f68c8b39800 1 Processor -- start 2024-09-13T23:05:32.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.519+0000 7f68c4fd2640 1 --2- 172.21.15.164:0/261994649 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f679c036b90 0x7f679c039050 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x559cf2120390 tx=0x7f68bc005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.519+0000 7f68c8b39800 1 -- start start 2024-09-13T23:05:32.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.519+0000 7f68c8b39800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf213c7f0 0x559cf213cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.519+0000 7f68c8b39800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559cf201e270 con 0x559cf213c7f0 2024-09-13T23:05:32.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.520+0000 7f68bbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf213c7f0 0x559cf213cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.520+0000 7f68bbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf213c7f0 0x559cf213cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56654/0 (socket says 172.21.15.164:56654) 2024-09-13T23:05:32.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.520+0000 7f68bbfff640 1 -- 172.21.15.164:0/843946109 learned_addr learned my addr 172.21.15.164:0/843946109 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.520+0000 7f68bbfff640 1 -- 172.21.15.164:0/843946109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cf213d1c0 con 0x559cf213c7f0 2024-09-13T23:05:32.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.520+0000 7f68bbfff640 1 --2- 172.21.15.164:0/843946109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf213c7f0 0x559cf213cbf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f68ac090fa0 tx=0x7f68ac05c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd21348fa981b0d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.520+0000 7f67a37fe640 1 -- 172.21.15.164:0/843946109 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68ac05c560 con 0x559cf213c7f0 2024-09-13T23:05:32.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.520+0000 7f67a37fe640 1 -- 172.21.15.164:0/843946109 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68ac06bc10 con 0x559cf213c7f0 2024-09-13T23:05:32.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.520+0000 7f67a37fe640 1 -- 172.21.15.164:0/843946109 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68ac06a560 con 0x559cf213c7f0 2024-09-13T23:05:32.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.520+0000 7f68c8b39800 1 -- 172.21.15.164:0/843946109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf213c7f0 msgr2=0x559cf213cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.520+0000 7f68c8b39800 1 --2- 172.21.15.164:0/843946109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf213c7f0 0x559cf213cbf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f68ac090fa0 tx=0x7f68ac05c460 comp rx=0 tx=0).stop 2024-09-13T23:05:32.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.520+0000 7f68c8b39800 1 -- 172.21.15.164:0/843946109 shutdown_connections 2024-09-13T23:05:32.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.521+0000 7f68c8b39800 1 --2- 172.21.15.164:0/843946109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf213c7f0 0x559cf213cbf0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.521+0000 7f68c8b39800 1 -- 172.21.15.164:0/843946109 >> 172.21.15.164:0/843946109 conn(0x559cf2138b50 msgr2=0x559cf2136c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.521+0000 7f68c8b39800 1 -- 172.21.15.164:0/843946109 shutdown_connections 2024-09-13T23:05:32.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.521+0000 7f68c8b39800 1 -- 172.21.15.164:0/843946109 wait complete. 2024-09-13T23:05:32.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.521+0000 7f68c8b39800 1 Processor -- start 2024-09-13T23:05:32.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.521+0000 7f68c8b39800 1 -- start start 2024-09-13T23:05:32.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.521+0000 7f68c8b39800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf213c7f0 0x559cf2143cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.521+0000 7f68c8b39800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559cf213d830 con 0x559cf213c7f0 2024-09-13T23:05:32.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.521+0000 7f68bbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf213c7f0 0x559cf2143cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.521+0000 7f68bbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf213c7f0 0x559cf2143cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56670/0 (socket says 172.21.15.164:56670) 2024-09-13T23:05:32.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.521+0000 7f68bbfff640 1 -- 172.21.15.164:0/2303300131 learned_addr learned my addr 172.21.15.164:0/2303300131 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.521+0000 7f68bbfff640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cf21441f0 con 0x559cf213c7f0 2024-09-13T23:05:32.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.522+0000 7f68bbfff640 1 --2- 172.21.15.164:0/2303300131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf213c7f0 0x559cf2143cb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f68ac069740 tx=0x7f68ac090f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.522+0000 7f67a1ffb640 1 -- 172.21.15.164:0/2303300131 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68ac06a8a0 con 0x559cf213c7f0 2024-09-13T23:05:32.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.522+0000 7f67a1ffb640 1 -- 172.21.15.164:0/2303300131 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68ac08a040 con 0x559cf213c7f0 2024-09-13T23:05:32.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.522+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559cf2144480 con 0x559cf213c7f0 2024-09-13T23:05:32.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.522+0000 7f67a1ffb640 1 -- 172.21.15.164:0/2303300131 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68ac06b540 con 0x559cf213c7f0 2024-09-13T23:05:32.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.522+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cf2147130 con 0x559cf213c7f0 2024-09-13T23:05:32.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.523+0000 7f67a1ffb640 1 -- 172.21.15.164:0/2303300131 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f68ac06b6e0 con 0x559cf213c7f0 2024-09-13T23:05:32.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.523+0000 7f67a1ffb640 1 --2- 172.21.15.164:0/2303300131 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6794036b90 0x7f6794039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.523+0000 7f67a1ffb640 1 -- 172.21.15.164:0/2303300131 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f68ac09cca0 con 0x559cf213c7f0 2024-09-13T23:05:32.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.523+0000 7f68c4fd2640 1 --2- 172.21.15.164:0/2303300131 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6794036b90 0x7f6794039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.523+0000 7f68c8b39800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.523+0000 7f68c8b39800 1 --2- 172.21.15.164:0/2303300131 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559cf214f770 0x559cf2151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.523+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559cf2152380 con 0x559cf214f770 2024-09-13T23:05:32.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.523+0000 7f68c4fd2640 1 --2- 172.21.15.164:0/2303300131 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6794036b90 0x7f6794039050 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x559cf211c840 tx=0x7f68bc01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.523+0000 7f68c47d1640 1 --2- 172.21.15.164:0/2303300131 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559cf214f770 0x559cf2151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.524+0000 7f68c47d1640 1 --2- 172.21.15.164:0/2303300131 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559cf214f770 0x559cf2151c30 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.524+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68b402d070 con 0x559cf214f770 2024-09-13T23:05:32.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.524+0000 7f68c8b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.524+0000 7f68c8b39800 20 realm 2024-09-13T23:05:32.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.524+0000 7f68c8b39800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.524+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559cf2152790 con 0x559cf214f770 2024-09-13T23:05:32.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.524+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68b402d070 con 0x559cf214f770 2024-09-13T23:05:32.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.524+0000 7f68c8b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.524+0000 7f68c8b39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:32.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.524+0000 7f68c8b39800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.524+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559cf2153060 con 0x559cf214f770 2024-09-13T23:05:32.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.524+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68b402d070 con 0x559cf214f770 2024-09-13T23:05:32.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.524+0000 7f68c8b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.524+0000 7f68c8b39800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.524+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559cf2153400 con 0x559cf214f770 2024-09-13T23:05:32.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.524+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f68b402d070 con 0x559cf214f770 2024-09-13T23:05:32.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.525+0000 7f68c8b39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:32.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.525+0000 7f68c8b39800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.525+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559cf2153860 con 0x559cf214f770 2024-09-13T23:05:32.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.525+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f68b402d070 con 0x559cf214f770 2024-09-13T23:05:32.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.525+0000 7f68c8b39800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:32.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.525+0000 7f68c8b39800 20 searching for the correct realm 2024-09-13T23:05:32.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.525+0000 7f68c8b39800 1 --2- 172.21.15.164:0/2303300131 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x559cf21558b0 0x559cf2157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.525+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x559cf21558b0 2024-09-13T23:05:32.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.525+0000 7f68bbfff640 1 --2- 172.21.15.164:0/2303300131 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x559cf21558b0 0x559cf2157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.525+0000 7f68bbfff640 1 --2- 172.21.15.164:0/2303300131 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x559cf21558b0 0x559cf2157ca0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.525+0000 7f68bbfff640 1 -- 172.21.15.164:0/2303300131 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68ac08bd70 con 0x559cf21558b0 2024-09-13T23:05:32.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.525+0000 7f68bbfff640 1 --2- 172.21.15.164:0/2303300131 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f68ac05f040 0x7f68ac0699e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.525+0000 7f68bbfff640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x7f68ac05f040 2024-09-13T23:05:32.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.526+0000 7f68c4fd2640 1 --2- 172.21.15.164:0/2303300131 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f68ac05f040 0x7f68ac0699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.526+0000 7f68c4fd2640 1 --2- 172.21.15.164:0/2303300131 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f68ac05f040 0x7f68ac0699e0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.526+0000 7f68c4fd2640 1 -- 172.21.15.164:0/2303300131 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc01f070 con 0x7f68ac05f040 2024-09-13T23:05:32.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.526+0000 7f68c4fd2640 1 --2- 172.21.15.164:0/2303300131 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f68bc031040 0x7f68bc032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.526+0000 7f68c4fd2640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x7f68bc031040 2024-09-13T23:05:32.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.526+0000 7f68c47d1640 1 --2- 172.21.15.164:0/2303300131 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f68bc031040 0x7f68bc032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.527+0000 7f68c47d1640 1 --2- 172.21.15.164:0/2303300131 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f68bc031040 0x7f68bc032940 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.527+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b402d070 con 0x7f68bc031040 2024-09-13T23:05:32.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.527+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x559cf214f770 2024-09-13T23:05:32.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.527+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f68b402d070 con 0x559cf214f770 2024-09-13T23:05:32.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.527+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x559cf214f770 2024-09-13T23:05:32.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.527+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b402d070 con 0x559cf214f770 2024-09-13T23:05:32.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.527+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x7f68bc031040 2024-09-13T23:05:32.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.528+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b402d070 con 0x7f68bc031040 2024-09-13T23:05:32.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.528+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x7f68bc031040 2024-09-13T23:05:32.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.528+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b402d070 con 0x7f68bc031040 2024-09-13T23:05:32.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.528+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x7f68ac05f040 2024-09-13T23:05:32.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.528+0000 7f68c4fd2640 1 -- 172.21.15.164:0/2303300131 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc01f070 con 0x7f68ac05f040 2024-09-13T23:05:32.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.528+0000 7f68c4fd2640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x559cf21558b0 2024-09-13T23:05:32.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.528+0000 7f68bbfff640 1 -- 172.21.15.164:0/2303300131 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68ac0af040 con 0x559cf21558b0 2024-09-13T23:05:32.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.528+0000 7f68bbfff640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x559cf214f770 2024-09-13T23:05:32.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.529+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b402d070 con 0x559cf214f770 2024-09-13T23:05:32.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.529+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x7f68bc031040 2024-09-13T23:05:32.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.529+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b402d070 con 0x7f68bc031040 2024-09-13T23:05:32.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.529+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x559cf214f770 2024-09-13T23:05:32.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.529+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b402d070 con 0x559cf214f770 2024-09-13T23:05:32.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.529+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x7f68ac05f040 2024-09-13T23:05:32.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.529+0000 7f68c4fd2640 1 -- 172.21.15.164:0/2303300131 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f68bc01f070 con 0x7f68ac05f040 2024-09-13T23:05:32.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.529+0000 7f68c4fd2640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x559cf21558b0 2024-09-13T23:05:32.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.530+0000 7f68bbfff640 1 -- 172.21.15.164:0/2303300131 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68ac0af040 con 0x559cf21558b0 2024-09-13T23:05:32.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.530+0000 7f68bbfff640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x559cf21558b0 2024-09-13T23:05:32.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.530+0000 7f68bbfff640 1 -- 172.21.15.164:0/2303300131 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68ac0af040 con 0x559cf21558b0 2024-09-13T23:05:32.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.530+0000 7f68bbfff640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x7f68bc031040 2024-09-13T23:05:32.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.530+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b402d070 con 0x7f68bc031040 2024-09-13T23:05:32.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.530+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x559cf21558b0 2024-09-13T23:05:32.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.530+0000 7f68bbfff640 1 -- 172.21.15.164:0/2303300131 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68ac0af040 con 0x559cf21558b0 2024-09-13T23:05:32.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.530+0000 7f68bbfff640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x559cf21558b0 2024-09-13T23:05:32.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.531+0000 7f68bbfff640 1 -- 172.21.15.164:0/2303300131 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68ac0af040 con 0x559cf21558b0 2024-09-13T23:05:32.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.531+0000 7f68bbfff640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x559cf214f770 2024-09-13T23:05:32.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.531+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b402d070 con 0x559cf214f770 2024-09-13T23:05:32.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.531+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x559cf214f770 2024-09-13T23:05:32.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.531+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f68b402d070 con 0x559cf214f770 2024-09-13T23:05:32.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.531+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x7f68bc031040 2024-09-13T23:05:32.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.531+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b402d070 con 0x7f68bc031040 2024-09-13T23:05:32.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.531+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x559cf21558b0 2024-09-13T23:05:32.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.531+0000 7f68bbfff640 1 -- 172.21.15.164:0/2303300131 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68ac0af040 con 0x559cf21558b0 2024-09-13T23:05:32.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.531+0000 7f68bbfff640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x7f68ac05f040 2024-09-13T23:05:32.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.532+0000 7f68c4fd2640 1 -- 172.21.15.164:0/2303300131 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc01f070 con 0x7f68ac05f040 2024-09-13T23:05:32.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.532+0000 7f68c4fd2640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x559cf214f770 2024-09-13T23:05:32.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.532+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f68b402d070 con 0x559cf214f770 2024-09-13T23:05:32.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.532+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x7f68bc031040 2024-09-13T23:05:32.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.532+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b402d070 con 0x7f68bc031040 2024-09-13T23:05:32.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.532+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x559cf21558b0 2024-09-13T23:05:32.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.532+0000 7f68bbfff640 1 -- 172.21.15.164:0/2303300131 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68ac0af040 con 0x559cf21558b0 2024-09-13T23:05:32.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.532+0000 7f68bbfff640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x7f68bc031040 2024-09-13T23:05:32.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.533+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b402d070 con 0x7f68bc031040 2024-09-13T23:05:32.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.533+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x7f68ac05f040 2024-09-13T23:05:32.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.533+0000 7f68c4fd2640 1 -- 172.21.15.164:0/2303300131 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc01f070 con 0x7f68ac05f040 2024-09-13T23:05:32.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.533+0000 7f68c4fd2640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x559cf21558b0 2024-09-13T23:05:32.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.533+0000 7f68bbfff640 1 -- 172.21.15.164:0/2303300131 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68ac0af040 con 0x559cf21558b0 2024-09-13T23:05:32.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.533+0000 7f68bbfff640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x7f68bc031040 2024-09-13T23:05:32.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.533+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68b402d070 con 0x7f68bc031040 2024-09-13T23:05:32.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.533+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x559cf214f770 2024-09-13T23:05:32.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.534+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f68b402d070 con 0x559cf214f770 2024-09-13T23:05:32.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.534+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559cf2158350 con 0x7f68ac05f040 2024-09-13T23:05:32.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.534+0000 7f68c4fd2640 1 -- 172.21.15.164:0/2303300131 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68bc01f070 con 0x7f68ac05f040 2024-09-13T23:05:32.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.534+0000 7f68c8b39800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:32.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.534+0000 7f68c8b39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:32.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.534+0000 7f68c8b39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:32.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.534+0000 7f68c8b39800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:32.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.534+0000 7f68c8b39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:32.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.534+0000 7f68c8b39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:32.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.534+0000 7f68c8b39800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.534+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559cf2154330 con 0x559cf214f770 2024-09-13T23:05:32.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.534+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68b402d070 con 0x559cf214f770 2024-09-13T23:05:32.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.534+0000 7f68c8b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.534+0000 7f68c8b39800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.534+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559cf2154bd0 con 0x559cf214f770 2024-09-13T23:05:32.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.534+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f68b402d070 con 0x559cf214f770 2024-09-13T23:05:32.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.534+0000 7f68c8b39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:32.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.534+0000 7f68c8b39800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.534+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559cf2153f70 con 0x559cf214f770 2024-09-13T23:05:32.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.535+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f68b402d070 con 0x559cf214f770 2024-09-13T23:05:32.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.535+0000 7f68c8b39800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:32.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.535+0000 7f68c8b39800 20 zone default found 2024-09-13T23:05:32.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.535+0000 7f68c8b39800 4 Realm: () 2024-09-13T23:05:32.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.535+0000 7f68c8b39800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:32.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.535+0000 7f68c8b39800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:32.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.535+0000 7f68c8b39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:32.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.535+0000 7f68c8b39800 20 zonegroup default 2024-09-13T23:05:32.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.535+0000 7f68c8b39800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.535+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559cf21587b0 con 0x7f68bc031040 2024-09-13T23:05:32.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.535+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f68b402d070 con 0x7f68bc031040 2024-09-13T23:05:32.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.535+0000 7f68c8b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.535+0000 7f68c8b39800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.535+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559cf215a640 con 0x559cf21558b0 2024-09-13T23:05:32.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.536+0000 7f68bbfff640 1 -- 172.21.15.164:0/2303300131 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f68ac0af040 con 0x559cf21558b0 2024-09-13T23:05:32.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.536+0000 7f68c8b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.536+0000 7f68c8b39800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.536+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559cf215a9e0 con 0x559cf21558b0 2024-09-13T23:05:32.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.536+0000 7f68bbfff640 1 -- 172.21.15.164:0/2303300131 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f68ac0af040 con 0x559cf21558b0 2024-09-13T23:05:32.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.536+0000 7f68c8b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.536+0000 7f68c8b39800 20 started sync module instance, tier type = 2024-09-13T23:05:32.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.536+0000 7f68c8b39800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:32.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.536+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559cf2159a80 con 0x7f68ac05f040 2024-09-13T23:05:32.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.537+0000 7f68c4fd2640 1 -- 172.21.15.164:0/2303300131 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc040040 con 0x7f68ac05f040 2024-09-13T23:05:32.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.537+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94132564762272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559cf215b230 con 0x7f68ac05f040 2024-09-13T23:05:32.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.537+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559cf215ba80 con 0x559cf214f770 2024-09-13T23:05:32.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.538+0000 7f68c4fd2640 1 -- 172.21.15.164:0/2303300131 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94132564762272] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc040040 con 0x7f68ac05f040 2024-09-13T23:05:32.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.538+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b402d070 con 0x559cf214f770 2024-09-13T23:05:32.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.538+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94132564766080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559cf215b710 con 0x559cf214f770 2024-09-13T23:05:32.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.538+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559cf215c230 con 0x559cf21558b0 2024-09-13T23:05:32.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.539+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94132564766080] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b402d070 con 0x559cf214f770 2024-09-13T23:05:32.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.540+0000 7f68bbfff640 1 -- 172.21.15.164:0/2303300131 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68ac0af040 con 0x559cf21558b0 2024-09-13T23:05:32.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.540+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94132564770048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559cf215c620 con 0x559cf21558b0 2024-09-13T23:05:32.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.540+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559cf215d020 con 0x7f68ac05f040 2024-09-13T23:05:32.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.541+0000 7f68c4fd2640 1 -- 172.21.15.164:0/2303300131 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc040040 con 0x7f68ac05f040 2024-09-13T23:05:32.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.541+0000 7f68bbfff640 1 -- 172.21.15.164:0/2303300131 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94132564770048] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68ac0af040 con 0x559cf21558b0 2024-09-13T23:05:32.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.541+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94132564773680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559cf215d8f0 con 0x7f68ac05f040 2024-09-13T23:05:32.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.541+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559cf215b1c0 con 0x559cf214f770 2024-09-13T23:05:32.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.542+0000 7f68c4fd2640 1 -- 172.21.15.164:0/2303300131 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94132564773680] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc040040 con 0x7f68ac05f040 2024-09-13T23:05:32.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.542+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b402d070 con 0x559cf214f770 2024-09-13T23:05:32.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.542+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94132564776000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559cf215d860 con 0x559cf214f770 2024-09-13T23:05:32.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.542+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559cf215e980 con 0x7f68bc031040 2024-09-13T23:05:32.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.543+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b402d070 con 0x7f68bc031040 2024-09-13T23:05:32.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.543+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94132564780240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559cf215eda0 con 0x7f68bc031040 2024-09-13T23:05:32.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.543+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94132564776000] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b402d070 con 0x559cf214f770 2024-09-13T23:05:32.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.543+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559cf215f7f0 con 0x7f68bc031040 2024-09-13T23:05:32.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.544+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94132564780240] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b402d070 con 0x7f68bc031040 2024-09-13T23:05:32.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.544+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b402d070 con 0x7f68bc031040 2024-09-13T23:05:32.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.544+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94132564783840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559cf215e8f0 con 0x7f68bc031040 2024-09-13T23:05:32.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.544+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559cf21600c0 con 0x7f68bc031040 2024-09-13T23:05:32.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.545+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b402d070 con 0x7f68bc031040 2024-09-13T23:05:32.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.545+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94132564786192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559cf215e8f0 con 0x7f68bc031040 2024-09-13T23:05:32.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.545+0000 7f68c8b39800 20 add_watcher() i=0 2024-09-13T23:05:32.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.545+0000 7f68c8b39800 20 add_watcher() i=1 2024-09-13T23:05:32.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.545+0000 7f68c8b39800 20 add_watcher() i=2 2024-09-13T23:05:32.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.545+0000 7f68c8b39800 20 add_watcher() i=3 2024-09-13T23:05:32.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.545+0000 7f68c8b39800 20 add_watcher() i=4 2024-09-13T23:05:32.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.545+0000 7f68c8b39800 20 add_watcher() i=5 2024-09-13T23:05:32.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.545+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94132564783840] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b402d070 con 0x7f68bc031040 2024-09-13T23:05:32.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.545+0000 7f68c8b39800 20 add_watcher() i=6 2024-09-13T23:05:32.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.546+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94132564786192] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b402d070 con 0x7f68bc031040 2024-09-13T23:05:32.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.546+0000 7f68c8b39800 20 add_watcher() i=7 2024-09-13T23:05:32.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.546+0000 7f68c8b39800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:32.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.546+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559cf215deb0 con 0x559cf214f770 2024-09-13T23:05:32.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.546+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f68b402d070 con 0x559cf214f770 2024-09-13T23:05:32.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.546+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94132564778672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559cf21605a0 con 0x559cf214f770 2024-09-13T23:05:32.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.547+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94132564778672] v32'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f68b402d070 con 0x559cf214f770 2024-09-13T23:05:32.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.547+0000 7f677a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:32.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.547+0000 7f68c8b39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:32.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.547+0000 7f68c8b39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:32.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.547+0000 7f68c8b39800 5 note: GC not initialized 2024-09-13T23:05:32.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.548+0000 7f67797e2640 20 reqs_thread_entry: start 2024-09-13T23:05:32.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.548+0000 7f68c8b39800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:32.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.548+0000 7f68c8b39800 20 Filter name: none 2024-09-13T23:05:32.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.548+0000 7f66eaffd640 20 reqs_thread_entry: start 2024-09-13T23:05:32.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.548+0000 7f68c8b39800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.548+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559cf2196050 con 0x559cf214f770 2024-09-13T23:05:32.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.549+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f68b402d070 con 0x559cf214f770 2024-09-13T23:05:32.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.549+0000 7f68c8b39800 20 rados_obj.operate() r=0 bl.length=502 2024-09-13T23:05:32.568 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:05:31.300851Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T23:05:32.417695Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:05:31.300826Z","tags":[],"group_ids":[]} 2024-09-13T23:05:32.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.549+0000 7f677a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:32.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.549+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94132564778672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559cf2194aa0 con 0x559cf214f770 2024-09-13T23:05:32.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.550+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94132564778672] v32'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f68b402d070 con 0x559cf214f770 2024-09-13T23:05:32.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.550+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94132564762272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559cf2193e00 con 0x7f68ac05f040 2024-09-13T23:05:32.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.551+0000 7f68c4fd2640 1 -- 172.21.15.164:0/2303300131 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94132564762272] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc040040 con 0x7f68ac05f040 2024-09-13T23:05:32.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.551+0000 7f68c8b39800 20 remove_watcher() i=0 2024-09-13T23:05:32.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.551+0000 7f68c8b39800 2 removed watcher, disabling cache 2024-09-13T23:05:32.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.551+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94132564766080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559cf2193e00 con 0x559cf214f770 2024-09-13T23:05:32.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.553+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94132564766080] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b402d070 con 0x559cf214f770 2024-09-13T23:05:32.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.553+0000 7f68c8b39800 20 remove_watcher() i=1 2024-09-13T23:05:32.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.553+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94132564770048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559cf2193e00 con 0x559cf21558b0 2024-09-13T23:05:32.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.554+0000 7f68bbfff640 1 -- 172.21.15.164:0/2303300131 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94132564770048] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68ac0af040 con 0x559cf21558b0 2024-09-13T23:05:32.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.554+0000 7f68c8b39800 20 remove_watcher() i=2 2024-09-13T23:05:32.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.554+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94132564773680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559cf215ad80 con 0x7f68ac05f040 2024-09-13T23:05:32.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.555+0000 7f68c4fd2640 1 -- 172.21.15.164:0/2303300131 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94132564773680] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68bc040040 con 0x7f68ac05f040 2024-09-13T23:05:32.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.555+0000 7f68c8b39800 20 remove_watcher() i=3 2024-09-13T23:05:32.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.555+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94132564776000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559cf215bd00 con 0x559cf214f770 2024-09-13T23:05:32.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.556+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94132564776000] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b402d070 con 0x559cf214f770 2024-09-13T23:05:32.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.556+0000 7f68c8b39800 20 remove_watcher() i=4 2024-09-13T23:05:32.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.556+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94132564780240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559cf215ad80 con 0x7f68bc031040 2024-09-13T23:05:32.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.557+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94132564780240] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b402d070 con 0x7f68bc031040 2024-09-13T23:05:32.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.557+0000 7f68c8b39800 20 remove_watcher() i=5 2024-09-13T23:05:32.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.557+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94132564783840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559cf215d440 con 0x7f68bc031040 2024-09-13T23:05:32.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.558+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94132564783840] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b402d070 con 0x7f68bc031040 2024-09-13T23:05:32.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.558+0000 7f68c8b39800 20 remove_watcher() i=6 2024-09-13T23:05:32.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.558+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94132564786192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559cf215bd00 con 0x7f68bc031040 2024-09-13T23:05:32.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.559+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94132564786192] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68b402d070 con 0x7f68bc031040 2024-09-13T23:05:32.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.559+0000 7f68c8b39800 20 remove_watcher() i=7 2024-09-13T23:05:32.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.559+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f68bc031040 msgr2=0x7f68bc032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.559+0000 7f68c8b39800 1 --2- 172.21.15.164:0/2303300131 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f68bc031040 0x7f68bc032940 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.559+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559cf214f770 msgr2=0x559cf2151c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.559+0000 7f68c8b39800 1 --2- 172.21.15.164:0/2303300131 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559cf214f770 0x559cf2151c30 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.559+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f68ac05f040 msgr2=0x7f68ac0699e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.559+0000 7f68c8b39800 1 --2- 172.21.15.164:0/2303300131 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f68ac05f040 0x7f68ac0699e0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.559+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x559cf21558b0 msgr2=0x559cf2157ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.559+0000 7f68c8b39800 1 --2- 172.21.15.164:0/2303300131 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x559cf21558b0 0x559cf2157ca0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.559+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6794036b90 msgr2=0x7f6794039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.559+0000 7f68c8b39800 1 --2- 172.21.15.164:0/2303300131 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6794036b90 0x7f6794039050 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x559cf211c840 tx=0x7f68bc01f000 comp rx=0 tx=0).stop 2024-09-13T23:05:32.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.559+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf213c7f0 msgr2=0x559cf2143cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.559+0000 7f68c8b39800 1 --2- 172.21.15.164:0/2303300131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf213c7f0 0x559cf2143cb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f68ac069740 tx=0x7f68ac090f00 comp rx=0 tx=0).stop 2024-09-13T23:05:32.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.559+0000 7f68c47d1640 1 -- 172.21.15.164:0/2303300131 reap_dead start 2024-09-13T23:05:32.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.559+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 shutdown_connections 2024-09-13T23:05:32.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.559+0000 7f68c8b39800 1 --2- 172.21.15.164:0/2303300131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf213c7f0 0x559cf2143cb0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.559+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 >> 172.21.15.164:0/2303300131 conn(0x559cf2138b50 msgr2=0x559cf2136c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.559+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 shutdown_connections 2024-09-13T23:05:32.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.559+0000 7f68c8b39800 1 -- 172.21.15.164:0/2303300131 wait complete. 2024-09-13T23:05:32.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.560+0000 7f68c8b39800 1 -- 172.21.15.164:0/261994649 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f679c036b90 msgr2=0x7f679c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.560+0000 7f68c8b39800 1 --2- 172.21.15.164:0/261994649 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f679c036b90 0x7f679c039050 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x559cf2120390 tx=0x7f68bc005840 comp rx=0 tx=0).stop 2024-09-13T23:05:32.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.560+0000 7f68c8b39800 1 -- 172.21.15.164:0/261994649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf212fc50 msgr2=0x559cf2130070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.560+0000 7f68c8b39800 1 --2- 172.21.15.164:0/261994649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf212fc50 0x559cf2130070 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f68ac025bf0 tx=0x7f68ac002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.560+0000 7f68c8b39800 1 -- 172.21.15.164:0/261994649 shutdown_connections 2024-09-13T23:05:32.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.560+0000 7f68c8b39800 1 --2- 172.21.15.164:0/261994649 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f679c036b90 0x7f679c039050 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.560+0000 7f68c8b39800 1 --2- 172.21.15.164:0/261994649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf212fc50 0x559cf2130070 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.560+0000 7f68c8b39800 1 -- 172.21.15.164:0/261994649 >> 172.21.15.164:0/261994649 conn(0x559cf2124be0 msgr2=0x559cf2127760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.560+0000 7f68c8b39800 1 -- 172.21.15.164:0/261994649 shutdown_connections 2024-09-13T23:05:32.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.560+0000 7f68c8b39800 1 -- 172.21.15.164:0/261994649 wait complete. 2024-09-13T23:05:32.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.560+0000 7f68c8b39800 1 -- 172.21.15.164:0/1256627832 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559cf2023990 msgr2=0x559cf211f320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.560+0000 7f68c8b39800 1 --2- 172.21.15.164:0/1256627832 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559cf2023990 0x559cf211f320 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.560+0000 7f68c8b39800 1 -- 172.21.15.164:0/1256627832 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f67ac036b40 msgr2=0x7f67ac039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.560+0000 7f68c8b39800 1 --2- 172.21.15.164:0/1256627832 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f67ac036b40 0x7f67ac039000 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f68ac057000 tx=0x7f68ac052000 comp rx=0 tx=0).stop 2024-09-13T23:05:32.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.560+0000 7f68c8b39800 1 -- 172.21.15.164:0/1256627832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf1f93610 msgr2=0x559cf21182b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.560+0000 7f68c8b39800 1 --2- 172.21.15.164:0/1256627832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf1f93610 0x559cf21182b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f68b4000f60 tx=0x7f68b4000ed0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.560+0000 7f68c8b39800 1 -- 172.21.15.164:0/1256627832 shutdown_connections 2024-09-13T23:05:32.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.560+0000 7f68c8b39800 1 --2- 172.21.15.164:0/1256627832 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559cf2023990 0x559cf211f320 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.560+0000 7f68c8b39800 1 --2- 172.21.15.164:0/1256627832 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f67ac036b40 0x7f67ac039000 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.560+0000 7f68c8b39800 1 --2- 172.21.15.164:0/1256627832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559cf1f93610 0x559cf21182b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.560+0000 7f68c8b39800 1 -- 172.21.15.164:0/1256627832 >> 172.21.15.164:0/1256627832 conn(0x559cf2019de0 msgr2=0x559cf2109c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.560+0000 7f68c8b39800 1 -- 172.21.15.164:0/1256627832 shutdown_connections 2024-09-13T23:05:32.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.560+0000 7f68c8b39800 1 -- 172.21.15.164:0/1256627832 wait complete. 2024-09-13T23:05:32.579 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:05:31.300851Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T23:05:32.417695Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:05:31.300826Z', 'tags': [], 'group_ids': []} 2024-09-13T23:05:32.580 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-13T23:05:32.580 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-13T23:05:32.580 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-13T23:05:32.626 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:32.627 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:32.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.627+0000 7f5886f2e800 1 Processor -- start 2024-09-13T23:05:32.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.627+0000 7f5886f2e800 1 -- start start 2024-09-13T23:05:32.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.627+0000 7f5886f2e800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x564f296784e0 0x564f296788e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.627+0000 7f5886f2e800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564f29538b30 con 0x564f29678e20 2024-09-13T23:05:32.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.627+0000 7f5886f2e800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x564f2951a360 con 0x564f296784e0 2024-09-13T23:05:32.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.627+0000 7f5882c5c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x564f296784e0 0x564f296788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.627+0000 7f5882c5c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x564f296784e0 0x564f296788e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56680/0 (socket says 172.21.15.164:56680) 2024-09-13T23:05:32.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.627+0000 7f588245b640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x564f29678e20 0x564f2967d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40784/0 (socket says 172.21.15.164:40784) 2024-09-13T23:05:32.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.627+0000 7f5882c5c640 1 -- 172.21.15.164:0/2488722689 learned_addr learned my addr 172.21.15.164:0/2488722689 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.628+0000 7f5882c5c640 1 -- 172.21.15.164:0/2488722689 >> v1:172.21.15.17:6789/0 conn(0x564f29678e20 legacy=0x564f2967d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.628+0000 7f5881c5a640 1 -- 172.21.15.164:0/2488722689 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3577834699 0 0) 0x564f29538b30 con 0x564f29678e20 2024-09-13T23:05:32.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.628+0000 7f5882c5c640 1 -- 172.21.15.164:0/2488722689 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f29540e00 con 0x564f296784e0 2024-09-13T23:05:32.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.629+0000 7f5882c5c640 1 --2- 172.21.15.164:0/2488722689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f296784e0 0x564f296788e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5874005fd0 tx=0x7f5874045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7547b6a69933c02c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.630+0000 7f5881c5a640 1 -- 172.21.15.164:0/2488722689 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f587404e600 con 0x564f296784e0 2024-09-13T23:05:32.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.630+0000 7f5881c5a640 1 -- 172.21.15.164:0/2488722689 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f587404e7a0 con 0x564f296784e0 2024-09-13T23:05:32.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.630+0000 7f5881c5a640 1 -- 172.21.15.164:0/2488722689 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f587404eaa0 con 0x564f296784e0 2024-09-13T23:05:32.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.630+0000 7f5886f2e800 1 -- 172.21.15.164:0/2488722689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f296784e0 msgr2=0x564f296788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.630+0000 7f5886f2e800 1 --2- 172.21.15.164:0/2488722689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f296784e0 0x564f296788e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5874005fd0 tx=0x7f5874045cf0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.630+0000 7f5886f2e800 1 -- 172.21.15.164:0/2488722689 shutdown_connections 2024-09-13T23:05:32.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.630+0000 7f5886f2e800 1 --2- 172.21.15.164:0/2488722689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f296784e0 0x564f296788e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.630+0000 7f5886f2e800 1 -- 172.21.15.164:0/2488722689 >> 172.21.15.164:0/2488722689 conn(0x564f29673dd0 msgr2=0x564f296761f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.630+0000 7f5886f2e800 1 -- 172.21.15.164:0/2488722689 shutdown_connections 2024-09-13T23:05:32.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.630+0000 7f5886f2e800 1 -- 172.21.15.164:0/2488722689 wait complete. 2024-09-13T23:05:32.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.644+0000 7f5886f2e800 1 Processor -- start 2024-09-13T23:05:32.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.644+0000 7f5886f2e800 1 -- start start 2024-09-13T23:05:32.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.644+0000 7f5886f2e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f296784e0 0x564f295ecda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.644+0000 7f5886f2e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564f295c5360 con 0x564f296784e0 2024-09-13T23:05:32.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.644+0000 7f5882c5c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f296784e0 0x564f295ecda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.644+0000 7f5882c5c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f296784e0 0x564f295ecda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56696/0 (socket says 172.21.15.164:56696) 2024-09-13T23:05:32.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.644+0000 7f5882c5c640 1 -- 172.21.15.164:0/2167065506 learned_addr learned my addr 172.21.15.164:0/2167065506 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.645+0000 7f5882c5c640 1 -- 172.21.15.164:0/2167065506 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f29512bc0 con 0x564f296784e0 2024-09-13T23:05:32.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.645+0000 7f5882c5c640 1 --2- 172.21.15.164:0/2167065506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f296784e0 0x564f295ecda0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f587400a190 tx=0x7f5874050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664f8876c5d3c6f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.645+0000 7f5770e09640 1 -- 172.21.15.164:0/2167065506 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5874065020 con 0x564f296784e0 2024-09-13T23:05:32.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.645+0000 7f5770e09640 1 -- 172.21.15.164:0/2167065506 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f587405c040 con 0x564f296784e0 2024-09-13T23:05:32.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.645+0000 7f5770e09640 1 -- 172.21.15.164:0/2167065506 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f587404ebb0 con 0x564f296784e0 2024-09-13T23:05:32.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.646+0000 7f5886f2e800 1 -- 172.21.15.164:0/2167065506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f296784e0 msgr2=0x564f295ecda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.646+0000 7f5886f2e800 1 --2- 172.21.15.164:0/2167065506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f296784e0 0x564f295ecda0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f587400a190 tx=0x7f5874050000 comp rx=0 tx=0).stop 2024-09-13T23:05:32.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.646+0000 7f5886f2e800 1 -- 172.21.15.164:0/2167065506 shutdown_connections 2024-09-13T23:05:32.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.646+0000 7f5886f2e800 1 --2- 172.21.15.164:0/2167065506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f296784e0 0x564f295ecda0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.646+0000 7f5886f2e800 1 -- 172.21.15.164:0/2167065506 >> 172.21.15.164:0/2167065506 conn(0x564f29673dd0 msgr2=0x564f29762fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.646+0000 7f5886f2e800 1 -- 172.21.15.164:0/2167065506 shutdown_connections 2024-09-13T23:05:32.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.646+0000 7f5886f2e800 1 -- 172.21.15.164:0/2167065506 wait complete. 2024-09-13T23:05:32.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.646+0000 7f5886f2e800 1 Processor -- start 2024-09-13T23:05:32.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.646+0000 7f5886f2e800 1 -- start start 2024-09-13T23:05:32.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.646+0000 7f5886f2e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f296784e0 0x564f29768d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.646+0000 7f5886f2e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564f2967f500 con 0x564f296784e0 2024-09-13T23:05:32.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.647+0000 7f5882c5c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f296784e0 0x564f29768d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.647+0000 7f5882c5c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f296784e0 0x564f29768d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56700/0 (socket says 172.21.15.164:56700) 2024-09-13T23:05:32.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.647+0000 7f5882c5c640 1 -- 172.21.15.164:0/693249583 learned_addr learned my addr 172.21.15.164:0/693249583 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.647+0000 7f5882c5c640 1 -- 172.21.15.164:0/693249583 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f29526fe0 con 0x564f296784e0 2024-09-13T23:05:32.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.647+0000 7f5882c5c640 1 --2- 172.21.15.164:0/693249583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f296784e0 0x564f29768d60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5874045d30 tx=0x7f5874003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.647+0000 7f576f606640 1 -- 172.21.15.164:0/693249583 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5874065030 con 0x564f296784e0 2024-09-13T23:05:32.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.647+0000 7f576f606640 1 -- 172.21.15.164:0/693249583 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f587404ee50 con 0x564f296784e0 2024-09-13T23:05:32.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.647+0000 7f5886f2e800 1 -- 172.21.15.164:0/693249583 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f29767450 con 0x564f296784e0 2024-09-13T23:05:32.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.647+0000 7f576f606640 1 -- 172.21.15.164:0/693249583 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f587406c5e0 con 0x564f296784e0 2024-09-13T23:05:32.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.647+0000 7f5886f2e800 1 -- 172.21.15.164:0/693249583 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f297679d0 con 0x564f296784e0 2024-09-13T23:05:32.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.648+0000 7f576f606640 1 -- 172.21.15.164:0/693249583 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f587406c780 con 0x564f296784e0 2024-09-13T23:05:32.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.648+0000 7f576f606640 1 --2- 172.21.15.164:0/693249583 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5768036b90 0x7f5768039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.648+0000 7f576f606640 1 -- 172.21.15.164:0/693249583 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5874090bf0 con 0x564f296784e0 2024-09-13T23:05:32.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.649+0000 7f588245b640 1 --2- 172.21.15.164:0/693249583 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5768036b90 0x7f5768039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.649+0000 7f5886f2e800 1 --2- 172.21.15.164:0/693249583 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564f29678e20 0x564f29779420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.649+0000 7f5886f2e800 1 -- 172.21.15.164:0/693249583 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f29779960 con 0x564f29678e20 2024-09-13T23:05:32.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.649+0000 7f588345d640 1 --2- 172.21.15.164:0/693249583 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564f29678e20 0x564f29779420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.649+0000 7f588245b640 1 --2- 172.21.15.164:0/693249583 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5768036b90 0x7f5768039050 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5878000c00 tx=0x7f58780013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.649+0000 7f588345d640 1 --2- 172.21.15.164:0/693249583 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564f29678e20 0x564f29779420 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.649+0000 7f588345d640 1 -- 172.21.15.164:0/693249583 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f587c0083e0 con 0x564f29678e20 2024-09-13T23:05:32.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.649+0000 7f5886f2e800 1 -- 172.21.15.164:0/693249583 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f29779d00 con 0x564f29678e20 2024-09-13T23:05:32.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.650+0000 7f588345d640 1 -- 172.21.15.164:0/693249583 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f587c0083e0 con 0x564f29678e20 2024-09-13T23:05:32.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.650+0000 7f5886f2e800 1 -- 172.21.15.164:0/693249583 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f2977b5e0 con 0x564f29678e20 2024-09-13T23:05:32.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.650+0000 7f588345d640 1 -- 172.21.15.164:0/693249583 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f587c0083e0 con 0x564f29678e20 2024-09-13T23:05:32.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.650+0000 7f5886f2e800 1 -- 172.21.15.164:0/693249583 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f2977a810 con 0x564f29678e20 2024-09-13T23:05:32.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.650+0000 7f588345d640 1 -- 172.21.15.164:0/693249583 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f587c0083e0 con 0x564f29678e20 2024-09-13T23:05:32.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.650+0000 7f5886f2e800 1 -- 172.21.15.164:0/693249583 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f2977ac00 con 0x564f29678e20 2024-09-13T23:05:32.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.650+0000 7f588345d640 1 -- 172.21.15.164:0/693249583 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f587c0083e0 con 0x564f29678e20 2024-09-13T23:05:32.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.651+0000 7f5886f2e800 1 Processor -- start 2024-09-13T23:05:32.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.651+0000 7f5886f2e800 1 -- start start 2024-09-13T23:05:32.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.651+0000 7f5886f2e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f29789bf0 0x564f2978a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.651+0000 7f5886f2e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564f29514580 con 0x564f29789bf0 2024-09-13T23:05:32.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.651+0000 7f588245b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f29789bf0 0x564f2978a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.651+0000 7f588245b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f29789bf0 0x564f2978a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56706/0 (socket says 172.21.15.164:56706) 2024-09-13T23:05:32.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.651+0000 7f588245b640 1 -- 172.21.15.164:0/1554433556 learned_addr learned my addr 172.21.15.164:0/1554433556 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.651+0000 7f588245b640 1 -- 172.21.15.164:0/1554433556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f2978a550 con 0x564f29789bf0 2024-09-13T23:05:32.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.652+0000 7f588245b640 1 --2- 172.21.15.164:0/1554433556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f29789bf0 0x564f2978a010 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f587800e610 tx=0x7f587800ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.652+0000 7f576ce01640 1 -- 172.21.15.164:0/1554433556 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5878022070 con 0x564f29789bf0 2024-09-13T23:05:32.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.652+0000 7f576ce01640 1 -- 172.21.15.164:0/1554433556 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5878009050 con 0x564f29789bf0 2024-09-13T23:05:32.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.652+0000 7f5886f2e800 1 -- 172.21.15.164:0/1554433556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f2978a7e0 con 0x564f29789bf0 2024-09-13T23:05:32.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.652+0000 7f576ce01640 1 -- 172.21.15.164:0/1554433556 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f587800d500 con 0x564f29789bf0 2024-09-13T23:05:32.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.652+0000 7f5886f2e800 1 -- 172.21.15.164:0/1554433556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f2978d4c0 con 0x564f29789bf0 2024-09-13T23:05:32.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.653+0000 7f576ce01640 1 -- 172.21.15.164:0/1554433556 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5878025070 con 0x564f29789bf0 2024-09-13T23:05:32.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.653+0000 7f576ce01640 1 --2- 172.21.15.164:0/1554433556 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f575c036b90 0x7f575c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.653+0000 7f576ce01640 1 -- 172.21.15.164:0/1554433556 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f587804ddc0 con 0x564f29789bf0 2024-09-13T23:05:32.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.653+0000 7f588345d640 1 --2- 172.21.15.164:0/1554433556 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f575c036b90 0x7f575c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.653+0000 7f5886f2e800 1 Processor -- start 2024-09-13T23:05:32.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.653+0000 7f588345d640 1 --2- 172.21.15.164:0/1554433556 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f575c036b90 0x7f575c039050 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x564f2977a330 tx=0x7f587c000f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.653+0000 7f5886f2e800 1 -- start start 2024-09-13T23:05:32.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.654+0000 7f5886f2e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f29796910 0x564f29796d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.654+0000 7f5886f2e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564f2976b540 con 0x564f29796910 2024-09-13T23:05:32.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.654+0000 7f588245b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f29796910 0x564f29796d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.654+0000 7f588245b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f29796910 0x564f29796d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56710/0 (socket says 172.21.15.164:56710) 2024-09-13T23:05:32.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.654+0000 7f588245b640 1 -- 172.21.15.164:0/1385846916 learned_addr learned my addr 172.21.15.164:0/1385846916 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.654+0000 7f588245b640 1 -- 172.21.15.164:0/1385846916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f297972e0 con 0x564f29796910 2024-09-13T23:05:32.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.654+0000 7f588245b640 1 --2- 172.21.15.164:0/1385846916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f29796910 0x564f29796d10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5878026fd0 tx=0x7f5878026680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3951b9f8e3caeb12 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.654+0000 7f57667fc640 1 -- 172.21.15.164:0/1385846916 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5878025360 con 0x564f29796910 2024-09-13T23:05:32.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.655+0000 7f57667fc640 1 -- 172.21.15.164:0/1385846916 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5878025500 con 0x564f29796910 2024-09-13T23:05:32.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.655+0000 7f57667fc640 1 -- 172.21.15.164:0/1385846916 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5878025820 con 0x564f29796910 2024-09-13T23:05:32.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.655+0000 7f5886f2e800 1 -- 172.21.15.164:0/1385846916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f29796910 msgr2=0x564f29796d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.655+0000 7f5886f2e800 1 --2- 172.21.15.164:0/1385846916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f29796910 0x564f29796d10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5878026fd0 tx=0x7f5878026680 comp rx=0 tx=0).stop 2024-09-13T23:05:32.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.655+0000 7f5886f2e800 1 -- 172.21.15.164:0/1385846916 shutdown_connections 2024-09-13T23:05:32.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.655+0000 7f5886f2e800 1 --2- 172.21.15.164:0/1385846916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f29796910 0x564f29796d10 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.655+0000 7f5886f2e800 1 -- 172.21.15.164:0/1385846916 >> 172.21.15.164:0/1385846916 conn(0x564f29792c70 msgr2=0x564f29790d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.655+0000 7f5886f2e800 1 -- 172.21.15.164:0/1385846916 shutdown_connections 2024-09-13T23:05:32.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.655+0000 7f5886f2e800 1 -- 172.21.15.164:0/1385846916 wait complete. 2024-09-13T23:05:32.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.655+0000 7f5886f2e800 1 Processor -- start 2024-09-13T23:05:32.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.655+0000 7f5886f2e800 1 -- start start 2024-09-13T23:05:32.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.655+0000 7f5886f2e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f29796910 0x564f2979ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.656+0000 7f5886f2e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564f29797950 con 0x564f29796910 2024-09-13T23:05:32.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.656+0000 7f588245b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f29796910 0x564f2979ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.656+0000 7f588245b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f29796910 0x564f2979ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56720/0 (socket says 172.21.15.164:56720) 2024-09-13T23:05:32.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.656+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 learned_addr learned my addr 172.21.15.164:0/1820980365 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.656+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f2979e2f0 con 0x564f29796910 2024-09-13T23:05:32.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.656+0000 7f588245b640 1 --2- 172.21.15.164:0/1820980365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f29796910 0x564f2979ddb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5878025ff0 tx=0x7f587804c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.656+0000 7f5764ff9640 1 -- 172.21.15.164:0/1820980365 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f587803a070 con 0x564f29796910 2024-09-13T23:05:32.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.656+0000 7f5764ff9640 1 -- 172.21.15.164:0/1820980365 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f587800d6a0 con 0x564f29796910 2024-09-13T23:05:32.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.656+0000 7f5764ff9640 1 -- 172.21.15.164:0/1820980365 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58780248b0 con 0x564f29796910 2024-09-13T23:05:32.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.656+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f2979e580 con 0x564f29796910 2024-09-13T23:05:32.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.656+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f297a1230 con 0x564f29796910 2024-09-13T23:05:32.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.657+0000 7f5764ff9640 1 -- 172.21.15.164:0/1820980365 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f587800d9c0 con 0x564f29796910 2024-09-13T23:05:32.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.657+0000 7f5764ff9640 1 --2- 172.21.15.164:0/1820980365 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f574c036b40 0x7f574c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.657+0000 7f5764ff9640 1 -- 172.21.15.164:0/1820980365 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f587803d040 con 0x564f29796910 2024-09-13T23:05:32.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.657+0000 7f588345d640 1 --2- 172.21.15.164:0/1820980365 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f574c036b40 0x7f574c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.658+0000 7f588345d640 1 --2- 172.21.15.164:0/1820980365 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f574c036b40 0x7f574c039000 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f587c00f010 tx=0x7f587c00c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.658+0000 7f5886f2e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.658+0000 7f5886f2e800 1 --2- 172.21.15.164:0/1820980365 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564f297a98b0 0x564f297abd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.658+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f297ac4c0 con 0x564f297a98b0 2024-09-13T23:05:32.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.658+0000 7f5882c5c640 1 --2- 172.21.15.164:0/1820980365 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564f297a98b0 0x564f297abd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.658+0000 7f5882c5c640 1 --2- 172.21.15.164:0/1820980365 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564f297a98b0 0x564f297abd70 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.659+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.659+0000 7f5886f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.659+0000 7f5886f2e800 20 realm 2024-09-13T23:05:32.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.659+0000 7f5886f2e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.659+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f297ac8d0 con 0x564f297a98b0 2024-09-13T23:05:32.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.659+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.659+0000 7f5886f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.659+0000 7f5886f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:32.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.659+0000 7f5886f2e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.659+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f297ad1a0 con 0x564f297a98b0 2024-09-13T23:05:32.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.659+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.659+0000 7f5886f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.659+0000 7f5886f2e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.659+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f297ad540 con 0x564f297a98b0 2024-09-13T23:05:32.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.659+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.659+0000 7f5886f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:32.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.659+0000 7f5886f2e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.659+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f297add90 con 0x564f297a98b0 2024-09-13T23:05:32.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.660+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.660+0000 7f5886f2e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:32.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.660+0000 7f5886f2e800 20 searching for the correct realm 2024-09-13T23:05:32.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.660+0000 7f5886f2e800 1 --2- 172.21.15.164:0/1820980365 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x564f297afb00 0x564f297b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.660+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x564f297afb00 2024-09-13T23:05:32.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.660+0000 7f588245b640 1 --2- 172.21.15.164:0/1820980365 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x564f297afb00 0x564f297b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.660+0000 7f588245b640 1 --2- 172.21.15.164:0/1820980365 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x564f297afb00 0x564f297b1ef0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.660+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5878032070 con 0x564f297afb00 2024-09-13T23:05:32.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.660+0000 7f588245b640 1 --2- 172.21.15.164:0/1820980365 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f5878027060 0x7f587803f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.660+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x7f5878027060 2024-09-13T23:05:32.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.660+0000 7f588345d640 1 --2- 172.21.15.164:0/1820980365 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f5878027060 0x7f587803f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.661+0000 7f588345d640 1 --2- 172.21.15.164:0/1820980365 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f5878027060 0x7f587803f4a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.661+0000 7f588345d640 1 -- 172.21.15.164:0/1820980365 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f587c02f040 con 0x7f5878027060 2024-09-13T23:05:32.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.661+0000 7f588345d640 1 --2- 172.21.15.164:0/1820980365 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f587c019040 0x7f587c019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.661+0000 7f588345d640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x7f587c019040 2024-09-13T23:05:32.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.661+0000 7f5882c5c640 1 --2- 172.21.15.164:0/1820980365 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f587c019040 0x7f587c019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.662+0000 7f5882c5c640 1 --2- 172.21.15.164:0/1820980365 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f587c019040 0x7f587c019930 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.662+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f587407b070 con 0x7f587c019040 2024-09-13T23:05:32.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.662+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x564f297a98b0 2024-09-13T23:05:32.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.662+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.662+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x564f297a98b0 2024-09-13T23:05:32.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.662+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.662+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x7f587c019040 2024-09-13T23:05:32.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.663+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f587407b070 con 0x7f587c019040 2024-09-13T23:05:32.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.663+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x7f587c019040 2024-09-13T23:05:32.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.663+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f587407b070 con 0x7f587c019040 2024-09-13T23:05:32.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.663+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x7f5878027060 2024-09-13T23:05:32.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.663+0000 7f588345d640 1 -- 172.21.15.164:0/1820980365 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f587c02f040 con 0x7f5878027060 2024-09-13T23:05:32.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.663+0000 7f588345d640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x564f297afb00 2024-09-13T23:05:32.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.663+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5878032070 con 0x564f297afb00 2024-09-13T23:05:32.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.663+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x564f297a98b0 2024-09-13T23:05:32.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.664+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.664+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x7f587c019040 2024-09-13T23:05:32.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.664+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f587407b070 con 0x7f587c019040 2024-09-13T23:05:32.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.664+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x564f297a98b0 2024-09-13T23:05:32.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.664+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.664+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x7f5878027060 2024-09-13T23:05:32.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.664+0000 7f588345d640 1 -- 172.21.15.164:0/1820980365 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f587c02f040 con 0x7f5878027060 2024-09-13T23:05:32.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.664+0000 7f588345d640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x564f297afb00 2024-09-13T23:05:32.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.665+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5878032070 con 0x564f297afb00 2024-09-13T23:05:32.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.665+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x564f297afb00 2024-09-13T23:05:32.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.665+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5878032070 con 0x564f297afb00 2024-09-13T23:05:32.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.665+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x7f587c019040 2024-09-13T23:05:32.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.665+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f587407b070 con 0x7f587c019040 2024-09-13T23:05:32.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.665+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x564f297afb00 2024-09-13T23:05:32.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.665+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5878032070 con 0x564f297afb00 2024-09-13T23:05:32.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.665+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x564f297afb00 2024-09-13T23:05:32.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.665+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5878032070 con 0x564f297afb00 2024-09-13T23:05:32.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.665+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x564f297a98b0 2024-09-13T23:05:32.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.666+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.666+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x564f297a98b0 2024-09-13T23:05:32.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.666+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.666+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x7f587c019040 2024-09-13T23:05:32.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.666+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f587407b070 con 0x7f587c019040 2024-09-13T23:05:32.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.666+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x564f297afb00 2024-09-13T23:05:32.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.666+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5878032070 con 0x564f297afb00 2024-09-13T23:05:32.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.666+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x7f5878027060 2024-09-13T23:05:32.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.667+0000 7f588345d640 1 -- 172.21.15.164:0/1820980365 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f587c02f040 con 0x7f5878027060 2024-09-13T23:05:32.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.667+0000 7f588345d640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x564f297a98b0 2024-09-13T23:05:32.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.667+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.667+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x7f587c019040 2024-09-13T23:05:32.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.667+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f587407b070 con 0x7f587c019040 2024-09-13T23:05:32.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.667+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x564f297afb00 2024-09-13T23:05:32.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.667+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5878032070 con 0x564f297afb00 2024-09-13T23:05:32.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.667+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x7f587c019040 2024-09-13T23:05:32.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.668+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f587407b070 con 0x7f587c019040 2024-09-13T23:05:32.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.668+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x7f5878027060 2024-09-13T23:05:32.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.668+0000 7f588345d640 1 -- 172.21.15.164:0/1820980365 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f587c02f040 con 0x7f5878027060 2024-09-13T23:05:32.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.668+0000 7f588345d640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x564f297afb00 2024-09-13T23:05:32.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.668+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5878032070 con 0x564f297afb00 2024-09-13T23:05:32.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.668+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x7f587c019040 2024-09-13T23:05:32.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.669+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f587407b070 con 0x7f587c019040 2024-09-13T23:05:32.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.669+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x564f297a98b0 2024-09-13T23:05:32.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.669+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.669+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f297b24d0 con 0x7f5878027060 2024-09-13T23:05:32.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.670+0000 7f588345d640 1 -- 172.21.15.164:0/1820980365 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f587c02f040 con 0x7f5878027060 2024-09-13T23:05:32.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.670+0000 7f5886f2e800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:32.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.670+0000 7f5886f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:32.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.670+0000 7f5886f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:32.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.670+0000 7f5886f2e800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:32.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.670+0000 7f5886f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:32.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.670+0000 7f5886f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:32.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.670+0000 7f5886f2e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.670+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f297ae740 con 0x564f297a98b0 2024-09-13T23:05:32.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.670+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.670+0000 7f5886f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.670+0000 7f5886f2e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.670+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f297aefe0 con 0x564f297a98b0 2024-09-13T23:05:32.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.670+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.670+0000 7f5886f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:32.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.670+0000 7f5886f2e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.670+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f297b2950 con 0x564f297a98b0 2024-09-13T23:05:32.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.670+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.670+0000 7f5886f2e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:32.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.670+0000 7f5886f2e800 20 zone default found 2024-09-13T23:05:32.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.670+0000 7f5886f2e800 4 Realm: () 2024-09-13T23:05:32.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.670+0000 7f5886f2e800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:32.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.670+0000 7f5886f2e800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:32.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.670+0000 7f5886f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:32.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.670+0000 7f5886f2e800 20 zonegroup default 2024-09-13T23:05:32.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.670+0000 7f5886f2e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.670+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f297b2e00 con 0x7f587c019040 2024-09-13T23:05:32.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.671+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f587407b070 con 0x7f587c019040 2024-09-13T23:05:32.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.671+0000 7f5886f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.671+0000 7f5886f2e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.671+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f297b47e0 con 0x564f297afb00 2024-09-13T23:05:32.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.671+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5878032070 con 0x564f297afb00 2024-09-13T23:05:32.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.671+0000 7f5886f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.671+0000 7f5886f2e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.671+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f297b4c50 con 0x564f297afb00 2024-09-13T23:05:32.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.672+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5878032070 con 0x564f297afb00 2024-09-13T23:05:32.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.672+0000 7f5886f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.672+0000 7f5886f2e800 20 started sync module instance, tier type = 2024-09-13T23:05:32.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.672+0000 7f5886f2e800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:32.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.672+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f297b3c70 con 0x7f5878027060 2024-09-13T23:05:32.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.673+0000 7f588345d640 1 -- 172.21.15.164:0/1820980365 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f587c02f040 con 0x7f5878027060 2024-09-13T23:05:32.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.673+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94897998348704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f297b3c70 con 0x7f5878027060 2024-09-13T23:05:32.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.673+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f297b5710 con 0x564f297a98b0 2024-09-13T23:05:32.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.674+0000 7f588345d640 1 -- 172.21.15.164:0/1820980365 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94897998348704] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f587c02f040 con 0x7f5878027060 2024-09-13T23:05:32.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.674+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.674+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94897998352928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f297b3c70 con 0x564f297a98b0 2024-09-13T23:05:32.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.674+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f297b6160 con 0x564f297afb00 2024-09-13T23:05:32.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.675+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94897998352928] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.675+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5878032070 con 0x564f297afb00 2024-09-13T23:05:32.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.675+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94897998346176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f297b6500 con 0x564f297afb00 2024-09-13T23:05:32.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.675+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f297b6f30 con 0x7f5878027060 2024-09-13T23:05:32.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.676+0000 7f588345d640 1 -- 172.21.15.164:0/1820980365 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f587c02f040 con 0x7f5878027060 2024-09-13T23:05:32.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.676+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94897998359104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f297b7800 con 0x7f5878027060 2024-09-13T23:05:32.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.676+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94897998346176] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5878032070 con 0x564f297afb00 2024-09-13T23:05:32.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.676+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f297b5cb0 con 0x564f297a98b0 2024-09-13T23:05:32.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.677+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.677+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94897998364096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f297b5cb0 con 0x564f297a98b0 2024-09-13T23:05:32.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.677+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f297b8d10 con 0x7f587c019040 2024-09-13T23:05:32.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.677+0000 7f588345d640 1 -- 172.21.15.164:0/1820980365 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94897998359104] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f587c02f040 con 0x7f5878027060 2024-09-13T23:05:32.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.678+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f587407b070 con 0x7f587c019040 2024-09-13T23:05:32.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.678+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94897998366720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f297b8cd0 con 0x7f587c019040 2024-09-13T23:05:32.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.678+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f297b96f0 con 0x7f587c019040 2024-09-13T23:05:32.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.679+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94897998364096] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.679+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94897998366720] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f587407b070 con 0x7f587c019040 2024-09-13T23:05:32.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.679+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f587407b070 con 0x7f587c019040 2024-09-13T23:05:32.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.680+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94897998361424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f297b96b0 con 0x7f587c019040 2024-09-13T23:05:32.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.680+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f297b9f90 con 0x7f587c019040 2024-09-13T23:05:32.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.680+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f587407b070 con 0x7f587c019040 2024-09-13T23:05:32.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.681+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94897998371440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f297b96b0 con 0x7f587c019040 2024-09-13T23:05:32.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.681+0000 7f5886f2e800 20 add_watcher() i=0 2024-09-13T23:05:32.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.681+0000 7f5886f2e800 20 add_watcher() i=1 2024-09-13T23:05:32.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.681+0000 7f5886f2e800 20 add_watcher() i=2 2024-09-13T23:05:32.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.681+0000 7f5886f2e800 20 add_watcher() i=3 2024-09-13T23:05:32.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.681+0000 7f5886f2e800 20 add_watcher() i=4 2024-09-13T23:05:32.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.681+0000 7f5886f2e800 20 add_watcher() i=5 2024-09-13T23:05:32.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.681+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94897998371440] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f587407b070 con 0x7f587c019040 2024-09-13T23:05:32.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.682+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94897998361424] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f587407b070 con 0x7f587c019040 2024-09-13T23:05:32.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.682+0000 7f5886f2e800 20 add_watcher() i=6 2024-09-13T23:05:32.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.682+0000 7f5886f2e800 20 add_watcher() i=7 2024-09-13T23:05:32.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.682+0000 7f5886f2e800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:32.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.683+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f297b9e90 con 0x564f297a98b0 2024-09-13T23:05:32.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.683+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.683+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94897998372496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f297ba4b0 con 0x564f297a98b0 2024-09-13T23:05:32.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.684+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94897998372496] v32'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.684+0000 7f57397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:32.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.684+0000 7f5886f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:32.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.684+0000 7f5886f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:32.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.684+0000 7f5886f2e800 5 note: GC not initialized 2024-09-13T23:05:32.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.684+0000 7f56b3fff640 20 reqs_thread_entry: start 2024-09-13T23:05:32.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.685+0000 7f5886f2e800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:32.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.685+0000 7f5886f2e800 20 Filter name: none 2024-09-13T23:05:32.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.685+0000 7f56b1ffb640 20 reqs_thread_entry: start 2024-09-13T23:05:32.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.685+0000 7f5886f2e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:05:32.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.685+0000 7f5886f2e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.685+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f297f03f0 con 0x564f297a98b0 2024-09-13T23:05:32.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.685+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.685+0000 7f5886f2e800 20 rados_obj.operate() r=0 bl.length=502 2024-09-13T23:05:32.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.685+0000 7f5886f2e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:05:32.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.685+0000 7f5886f2e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:32.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.685+0000 7f5886f2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:32.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.685+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f297f6b30 con 0x564f297a98b0 2024-09-13T23:05:32.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.686+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.686+0000 7f5886f2e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:32.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.686+0000 7f5886f2e800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:32.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.686+0000 7f5886f2e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:05:32.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.686+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94897998619888 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f297f2190 con 0x564f297a98b0 2024-09-13T23:05:32.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.687+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== watch-notify(notify (1) cookie 94897998364096 notify 137438953476 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f5874084040 con 0x564f297a98b0 2024-09-13T23:05:32.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.687+0000 7f57667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94897998364096 notifier 4365 bl.length()=567 2024-09-13T23:05:32.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.687+0000 7f57667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:32.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.687+0000 7f57667fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:32.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.687+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(64 notify.4 [notify cookie 94897998619888 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.687+0000 7f57667fc640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5748003ea0 con 0x564f297a98b0 2024-09-13T23:05:32.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.687+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.687+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== watch-notify(notify_complete (2) cookie 94897998619888 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564f297679d0 con 0x564f297a98b0 2024-09-13T23:05:32.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.687+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f297f64f0 con 0x7f587c019040 2024-09-13T23:05:32.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.688+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v32'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f587407b070 con 0x7f587c019040 2024-09-13T23:05:32.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.688+0000 7f5886f2e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T23:05:32.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.688+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94897998619888 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f297f1ce0 con 0x564f297afb00 2024-09-13T23:05:32.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.689+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== watch-notify(notify (1) cookie 94897998346176 notify 137438953473 ret 0) ==== 212+0+0 (crc 0 0 0) 0x564f2979e580 con 0x564f297afb00 2024-09-13T23:05:32.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.689+0000 7f57667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94897998346176 notifier 4365 bl.length()=170 2024-09-13T23:05:32.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.689+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(67 notify.2 [notify cookie 94897998619888 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5878032070 con 0x564f297afb00 2024-09-13T23:05:32.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.689+0000 7f57667fc640 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5748003ea0 con 0x564f297afb00 2024-09-13T23:05:32.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.689+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== watch-notify(notify_complete (2) cookie 94897998619888 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564f2979e2f0 con 0x564f297afb00 2024-09-13T23:05:32.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.689+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5878032070 con 0x564f297afb00 2024-09-13T23:05:32.706 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:05:31.300851Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:05:31.300826Z","tags":[],"group_ids":[]} 2024-09-13T23:05:32.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.690+0000 7f57397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:32.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.690+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94897998372496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f297ee0f0 con 0x564f297a98b0 2024-09-13T23:05:32.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.691+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94897998372496] v32'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.691+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94897998348704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f297ee0f0 con 0x7f5878027060 2024-09-13T23:05:32.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.692+0000 7f588345d640 1 -- 172.21.15.164:0/1820980365 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94897998348704] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f587c02f040 con 0x7f5878027060 2024-09-13T23:05:32.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.692+0000 7f5886f2e800 20 remove_watcher() i=0 2024-09-13T23:05:32.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.692+0000 7f5886f2e800 2 removed watcher, disabling cache 2024-09-13T23:05:32.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.692+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94897998352928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f297ee0f0 con 0x564f297a98b0 2024-09-13T23:05:32.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.693+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94897998352928] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.693+0000 7f5886f2e800 20 remove_watcher() i=1 2024-09-13T23:05:32.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.693+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94897998346176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f297ee0f0 con 0x564f297afb00 2024-09-13T23:05:32.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.694+0000 7f588245b640 1 -- 172.21.15.164:0/1820980365 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94897998346176] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5878032070 con 0x564f297afb00 2024-09-13T23:05:32.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.694+0000 7f5886f2e800 20 remove_watcher() i=2 2024-09-13T23:05:32.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.694+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94897998359104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f297ee0f0 con 0x7f5878027060 2024-09-13T23:05:32.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.695+0000 7f588345d640 1 -- 172.21.15.164:0/1820980365 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94897998359104] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f587c02f040 con 0x7f5878027060 2024-09-13T23:05:32.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.695+0000 7f5886f2e800 20 remove_watcher() i=3 2024-09-13T23:05:32.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.695+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94897998364096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f297ee0f0 con 0x564f297a98b0 2024-09-13T23:05:32.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.696+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94897998364096] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f587407b070 con 0x564f297a98b0 2024-09-13T23:05:32.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.696+0000 7f5886f2e800 20 remove_watcher() i=4 2024-09-13T23:05:32.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.696+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94897998366720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f297ee0f0 con 0x7f587c019040 2024-09-13T23:05:32.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.697+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94897998366720] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f587407b070 con 0x7f587c019040 2024-09-13T23:05:32.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.697+0000 7f5886f2e800 20 remove_watcher() i=5 2024-09-13T23:05:32.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.697+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94897998361424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f297ee0f0 con 0x7f587c019040 2024-09-13T23:05:32.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.698+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94897998361424] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f587407b070 con 0x7f587c019040 2024-09-13T23:05:32.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.698+0000 7f5886f2e800 20 remove_watcher() i=6 2024-09-13T23:05:32.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.698+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94897998371440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f297ee0f0 con 0x7f587c019040 2024-09-13T23:05:32.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.699+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94897998371440] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f587407b070 con 0x7f587c019040 2024-09-13T23:05:32.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.699+0000 7f5886f2e800 20 remove_watcher() i=7 2024-09-13T23:05:32.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.700+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f587c019040 msgr2=0x7f587c019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.700+0000 7f5886f2e800 1 --2- 172.21.15.164:0/1820980365 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f587c019040 0x7f587c019930 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.700+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564f297a98b0 msgr2=0x564f297abd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.700+0000 7f5886f2e800 1 --2- 172.21.15.164:0/1820980365 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564f297a98b0 0x564f297abd70 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.700+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f5878027060 msgr2=0x7f587803f4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.700+0000 7f5886f2e800 1 --2- 172.21.15.164:0/1820980365 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f5878027060 0x7f587803f4a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.700+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x564f297afb00 msgr2=0x564f297b1ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.700+0000 7f5886f2e800 1 --2- 172.21.15.164:0/1820980365 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x564f297afb00 0x564f297b1ef0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.700+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f574c036b40 msgr2=0x7f574c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.700+0000 7f5886f2e800 1 --2- 172.21.15.164:0/1820980365 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f574c036b40 0x7f574c039000 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f587c00f010 tx=0x7f587c00c040 comp rx=0 tx=0).stop 2024-09-13T23:05:32.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.700+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f29796910 msgr2=0x564f2979ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.700+0000 7f5886f2e800 1 --2- 172.21.15.164:0/1820980365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f29796910 0x564f2979ddb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5878025ff0 tx=0x7f587804c140 comp rx=0 tx=0).stop 2024-09-13T23:05:32.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.700+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 reap_dead start 2024-09-13T23:05:32.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.700+0000 7f5882c5c640 1 -- 172.21.15.164:0/1820980365 reap_dead start 2024-09-13T23:05:32.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.700+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 shutdown_connections 2024-09-13T23:05:32.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.700+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 >> 172.21.15.164:0/1820980365 conn(0x564f29792c70 msgr2=0x564f29790d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.700+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 shutdown_connections 2024-09-13T23:05:32.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.700+0000 7f5886f2e800 1 -- 172.21.15.164:0/1820980365 wait complete. 2024-09-13T23:05:32.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.700+0000 7f5886f2e800 1 -- 172.21.15.164:0/1554433556 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f575c036b90 msgr2=0x7f575c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.700+0000 7f5886f2e800 1 --2- 172.21.15.164:0/1554433556 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f575c036b90 0x7f575c039050 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x564f2977a330 tx=0x7f587c000f90 comp rx=0 tx=0).stop 2024-09-13T23:05:32.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.700+0000 7f5886f2e800 1 -- 172.21.15.164:0/1554433556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f29789bf0 msgr2=0x564f2978a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.700+0000 7f5886f2e800 1 --2- 172.21.15.164:0/1554433556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f29789bf0 0x564f2978a010 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f587800e610 tx=0x7f587800ff90 comp rx=0 tx=0).stop 2024-09-13T23:05:32.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.700+0000 7f5886f2e800 1 -- 172.21.15.164:0/1554433556 shutdown_connections 2024-09-13T23:05:32.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.700+0000 7f5886f2e800 1 --2- 172.21.15.164:0/1554433556 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f575c036b90 0x7f575c039050 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.700+0000 7f5886f2e800 1 --2- 172.21.15.164:0/1554433556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f29789bf0 0x564f2978a010 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.700+0000 7f5886f2e800 1 -- 172.21.15.164:0/1554433556 >> 172.21.15.164:0/1554433556 conn(0x564f2977eb80 msgr2=0x564f29781700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.700+0000 7f5886f2e800 1 -- 172.21.15.164:0/1554433556 shutdown_connections 2024-09-13T23:05:32.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.700+0000 7f5886f2e800 1 -- 172.21.15.164:0/1554433556 wait complete. 2024-09-13T23:05:32.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.701+0000 7f5886f2e800 1 -- 172.21.15.164:0/693249583 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564f29678e20 msgr2=0x564f29779420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.701+0000 7f5886f2e800 1 --2- 172.21.15.164:0/693249583 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564f29678e20 0x564f29779420 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.701+0000 7f5886f2e800 1 -- 172.21.15.164:0/693249583 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5768036b90 msgr2=0x7f5768039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.701+0000 7f5886f2e800 1 --2- 172.21.15.164:0/693249583 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5768036b90 0x7f5768039050 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5878000c00 tx=0x7f58780013b0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.701+0000 7f5886f2e800 1 -- 172.21.15.164:0/693249583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f296784e0 msgr2=0x564f29768d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.701+0000 7f5886f2e800 1 --2- 172.21.15.164:0/693249583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f296784e0 0x564f29768d60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5874045d30 tx=0x7f5874003330 comp rx=0 tx=0).stop 2024-09-13T23:05:32.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.701+0000 7f5886f2e800 1 -- 172.21.15.164:0/693249583 shutdown_connections 2024-09-13T23:05:32.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.701+0000 7f5886f2e800 1 --2- 172.21.15.164:0/693249583 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564f29678e20 0x564f29779420 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.701+0000 7f5886f2e800 1 --2- 172.21.15.164:0/693249583 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5768036b90 0x7f5768039050 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.701+0000 7f5886f2e800 1 --2- 172.21.15.164:0/693249583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f296784e0 0x564f29768d60 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.701+0000 7f5886f2e800 1 -- 172.21.15.164:0/693249583 >> 172.21.15.164:0/693249583 conn(0x564f29673dd0 msgr2=0x564f297618b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.701+0000 7f5886f2e800 1 -- 172.21.15.164:0/693249583 shutdown_connections 2024-09-13T23:05:32.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.701+0000 7f5886f2e800 1 -- 172.21.15.164:0/693249583 wait complete. 2024-09-13T23:05:32.718 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:05:31.300851Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:05:31.300826Z', 'tags': [], 'group_ids': []} 2024-09-13T23:05:32.719 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-13T23:05:32.719 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-13T23:05:32.719 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-13T23:05:32.766 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:32.766 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:32.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.766+0000 7fc0bd324800 1 Processor -- start 2024-09-13T23:05:32.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.766+0000 7fc0bd324800 1 -- start start 2024-09-13T23:05:32.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.766+0000 7fc0bd324800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55e0ac74dd60 0x55e0ac750150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.766+0000 7fc0bd324800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e0ac606b30 con 0x55e0ac6bb5f0 2024-09-13T23:05:32.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.766+0000 7fc0bd324800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55e0ac5e8360 con 0x55e0ac74dd60 2024-09-13T23:05:32.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.766+0000 7fc0b8815640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55e0ac74dd60 0x55e0ac750150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.766+0000 7fc0b9016640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55e0ac6bb5f0 0x55e0ac74c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40800/0 (socket says 172.21.15.164:40800) 2024-09-13T23:05:32.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.766+0000 7fc0b9016640 1 -- 172.21.15.164:0/107289100 learned_addr learned my addr 172.21.15.164:0/107289100 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:32.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.767+0000 7fc0b8815640 1 -- 172.21.15.164:0/107289100 >> v1:172.21.15.17:6789/0 conn(0x55e0ac6bb5f0 legacy=0x55e0ac74c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.767+0000 7fc0b8815640 1 -- 172.21.15.164:0/107289100 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0ac60ee00 con 0x55e0ac74dd60 2024-09-13T23:05:32.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.767+0000 7fc0abfff640 1 -- 172.21.15.164:0/107289100 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3437253246 0 0) 0x55e0ac606b30 con 0x55e0ac6bb5f0 2024-09-13T23:05:32.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.768+0000 7fc0b8815640 1 --2- 172.21.15.164:0/107289100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac74dd60 0x55e0ac750150 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000a470 tx=0x7fc0b0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22511bb5eca08976 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.769+0000 7fc0abfff640 1 -- 172.21.15.164:0/107289100 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0b0053570 con 0x55e0ac74dd60 2024-09-13T23:05:32.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.769+0000 7fc0abfff640 1 -- 172.21.15.164:0/107289100 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b0058070 con 0x55e0ac74dd60 2024-09-13T23:05:32.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.769+0000 7fc0abfff640 1 -- 172.21.15.164:0/107289100 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0b0053880 con 0x55e0ac74dd60 2024-09-13T23:05:32.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.769+0000 7fc0bd324800 1 -- 172.21.15.164:0/107289100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac74dd60 msgr2=0x55e0ac750150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.769+0000 7fc0bd324800 1 --2- 172.21.15.164:0/107289100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac74dd60 0x55e0ac750150 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000a470 tx=0x7fc0b0045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:32.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.769+0000 7fc0bd324800 1 -- 172.21.15.164:0/107289100 shutdown_connections 2024-09-13T23:05:32.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.769+0000 7fc0bd324800 1 --2- 172.21.15.164:0/107289100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac74dd60 0x55e0ac750150 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.769+0000 7fc0bd324800 1 -- 172.21.15.164:0/107289100 >> 172.21.15.164:0/107289100 conn(0x55e0ac741db0 msgr2=0x55e0ac7441d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.769+0000 7fc0bd324800 1 -- 172.21.15.164:0/107289100 shutdown_connections 2024-09-13T23:05:32.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.769+0000 7fc0bd324800 1 -- 172.21.15.164:0/107289100 wait complete. 2024-09-13T23:05:32.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.783+0000 7fc0bd324800 1 Processor -- start 2024-09-13T23:05:32.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.783+0000 7fc0bd324800 1 -- start start 2024-09-13T23:05:32.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.783+0000 7fc0bd324800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac6bb5f0 0x55e0ac838890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.784+0000 7fc0bd324800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e0ac693360 con 0x55e0ac6bb5f0 2024-09-13T23:05:32.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.784+0000 7fc0b9016640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac6bb5f0 0x55e0ac838890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.784+0000 7fc0b9016640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac6bb5f0 0x55e0ac838890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56740/0 (socket says 172.21.15.164:56740) 2024-09-13T23:05:32.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.784+0000 7fc0b9016640 1 -- 172.21.15.164:0/1042525743 learned_addr learned my addr 172.21.15.164:0/1042525743 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.784+0000 7fc0b9016640 1 -- 172.21.15.164:0/1042525743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0ac5e0bc0 con 0x55e0ac6bb5f0 2024-09-13T23:05:32.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.784+0000 7fc0b9016640 1 --2- 172.21.15.164:0/1042525743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac6bb5f0 0x55e0ac838890 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac001660 tx=0x7fc0ac001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0cf199d95fbc294 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.785+0000 7fbfa7606640 1 -- 172.21.15.164:0/1042525743 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0ac003450 con 0x55e0ac6bb5f0 2024-09-13T23:05:32.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.785+0000 7fbfa7606640 1 -- 172.21.15.164:0/1042525743 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0ac003610 con 0x55e0ac6bb5f0 2024-09-13T23:05:32.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.785+0000 7fbfa7606640 1 -- 172.21.15.164:0/1042525743 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0ac0039b0 con 0x55e0ac6bb5f0 2024-09-13T23:05:32.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.785+0000 7fc0bd324800 1 -- 172.21.15.164:0/1042525743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac6bb5f0 msgr2=0x55e0ac838890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.785+0000 7fc0bd324800 1 --2- 172.21.15.164:0/1042525743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac6bb5f0 0x55e0ac838890 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac001660 tx=0x7fc0ac001b20 comp rx=0 tx=0).stop 2024-09-13T23:05:32.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.785+0000 7fc0bd324800 1 -- 172.21.15.164:0/1042525743 shutdown_connections 2024-09-13T23:05:32.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.785+0000 7fc0bd324800 1 --2- 172.21.15.164:0/1042525743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac6bb5f0 0x55e0ac838890 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.785+0000 7fc0bd324800 1 -- 172.21.15.164:0/1042525743 >> 172.21.15.164:0/1042525743 conn(0x55e0ac741db0 msgr2=0x55e0ac834250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.785+0000 7fc0bd324800 1 -- 172.21.15.164:0/1042525743 shutdown_connections 2024-09-13T23:05:32.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.785+0000 7fc0bd324800 1 -- 172.21.15.164:0/1042525743 wait complete. 2024-09-13T23:05:32.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.786+0000 7fc0bd324800 1 Processor -- start 2024-09-13T23:05:32.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.786+0000 7fc0bd324800 1 -- start start 2024-09-13T23:05:32.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.786+0000 7fc0bd324800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac74dd60 0x55e0ac840470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.786+0000 7fc0bd324800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e0ac750930 con 0x55e0ac74dd60 2024-09-13T23:05:32.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.786+0000 7fc0b9016640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac74dd60 0x55e0ac840470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.786+0000 7fc0b9016640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac74dd60 0x55e0ac840470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56754/0 (socket says 172.21.15.164:56754) 2024-09-13T23:05:32.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.786+0000 7fc0b9016640 1 -- 172.21.15.164:0/3584827610 learned_addr learned my addr 172.21.15.164:0/3584827610 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.786+0000 7fc0b9016640 1 -- 172.21.15.164:0/3584827610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0ac5f4fe0 con 0x55e0ac74dd60 2024-09-13T23:05:32.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.786+0000 7fc0b9016640 1 --2- 172.21.15.164:0/3584827610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac74dd60 0x55e0ac840470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55e0ac8396f0 tx=0x7fc0ac001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.787+0000 7fbfa5e03640 1 -- 172.21.15.164:0/3584827610 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0ac025070 con 0x55e0ac74dd60 2024-09-13T23:05:32.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.787+0000 7fbfa5e03640 1 -- 172.21.15.164:0/3584827610 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0ac019040 con 0x55e0ac74dd60 2024-09-13T23:05:32.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.787+0000 7fc0bd324800 1 -- 172.21.15.164:0/3584827610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e0ac8409b0 con 0x55e0ac74dd60 2024-09-13T23:05:32.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.787+0000 7fbfa5e03640 1 -- 172.21.15.164:0/3584827610 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0ac013890 con 0x55e0ac74dd60 2024-09-13T23:05:32.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.787+0000 7fc0bd324800 1 -- 172.21.15.164:0/3584827610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0ac840f30 con 0x55e0ac74dd60 2024-09-13T23:05:32.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.787+0000 7fbfa5e03640 1 -- 172.21.15.164:0/3584827610 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc0ac010070 con 0x55e0ac74dd60 2024-09-13T23:05:32.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.788+0000 7fbfa5e03640 1 --2- 172.21.15.164:0/3584827610 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbfa0036b90 0x7fbfa0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.788+0000 7fbfa5e03640 1 -- 172.21.15.164:0/3584827610 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc0ac04bf50 con 0x55e0ac74dd60 2024-09-13T23:05:32.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.788+0000 7fc0b8815640 1 --2- 172.21.15.164:0/3584827610 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbfa0036b90 0x7fbfa0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.788+0000 7fc0bd324800 1 --2- 172.21.15.164:0/3584827610 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e0ac8454d0 0x55e0ac8478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.788+0000 7fc0bd324800 1 -- 172.21.15.164:0/3584827610 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac847e00 con 0x55e0ac8454d0 2024-09-13T23:05:32.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.788+0000 7fc0b9817640 1 --2- 172.21.15.164:0/3584827610 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e0ac8454d0 0x55e0ac8478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.788+0000 7fc0b8815640 1 --2- 172.21.15.164:0/3584827610 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbfa0036b90 0x7fbfa0039050 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0057000 tx=0x7fc0b0052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.788+0000 7fc0b9817640 1 --2- 172.21.15.164:0/3584827610 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e0ac8454d0 0x55e0ac8478c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.789+0000 7fc0b9817640 1 -- 172.21.15.164:0/3584827610 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc0b40083e0 con 0x55e0ac8454d0 2024-09-13T23:05:32.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.789+0000 7fc0bd324800 1 -- 172.21.15.164:0/3584827610 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac844a90 con 0x55e0ac8454d0 2024-09-13T23:05:32.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.789+0000 7fc0b9817640 1 -- 172.21.15.164:0/3584827610 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc0b40083e0 con 0x55e0ac8454d0 2024-09-13T23:05:32.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.789+0000 7fc0bd324800 1 -- 172.21.15.164:0/3584827610 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac849c00 con 0x55e0ac8454d0 2024-09-13T23:05:32.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.789+0000 7fc0b9817640 1 -- 172.21.15.164:0/3584827610 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc0b40083e0 con 0x55e0ac8454d0 2024-09-13T23:05:32.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.789+0000 7fc0bd324800 1 -- 172.21.15.164:0/3584827610 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac848e30 con 0x55e0ac8454d0 2024-09-13T23:05:32.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.789+0000 7fc0b9817640 1 -- 172.21.15.164:0/3584827610 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc0b40083e0 con 0x55e0ac8454d0 2024-09-13T23:05:32.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.789+0000 7fc0bd324800 1 -- 172.21.15.164:0/3584827610 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac849220 con 0x55e0ac8454d0 2024-09-13T23:05:32.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.790+0000 7fc0b9817640 1 -- 172.21.15.164:0/3584827610 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc0b40083e0 con 0x55e0ac8454d0 2024-09-13T23:05:32.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.790+0000 7fc0bd324800 1 Processor -- start 2024-09-13T23:05:32.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.790+0000 7fc0bd324800 1 -- start start 2024-09-13T23:05:32.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.790+0000 7fc0bd324800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac858240 0x55e0ac858660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.790+0000 7fc0bd324800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e0ac5e2580 con 0x55e0ac858240 2024-09-13T23:05:32.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.790+0000 7fc0b8815640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac858240 0x55e0ac858660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.790+0000 7fc0b8815640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac858240 0x55e0ac858660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56768/0 (socket says 172.21.15.164:56768) 2024-09-13T23:05:32.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.790+0000 7fc0b8815640 1 -- 172.21.15.164:0/1624550506 learned_addr learned my addr 172.21.15.164:0/1624550506 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.791+0000 7fc0b8815640 1 -- 172.21.15.164:0/1624550506 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0ac858ba0 con 0x55e0ac858240 2024-09-13T23:05:32.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.791+0000 7fc0b8815640 1 --2- 172.21.15.164:0/1624550506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac858240 0x55e0ac858660 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0025bf0 tx=0x7fc0b0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.791+0000 7fbf9effd640 1 -- 172.21.15.164:0/1624550506 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0b006f070 con 0x55e0ac858240 2024-09-13T23:05:32.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.791+0000 7fbf9effd640 1 -- 172.21.15.164:0/1624550506 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b005f550 con 0x55e0ac858240 2024-09-13T23:05:32.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.791+0000 7fc0bd324800 1 -- 172.21.15.164:0/1624550506 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e0ac858dd0 con 0x55e0ac858240 2024-09-13T23:05:32.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.791+0000 7fbf9effd640 1 -- 172.21.15.164:0/1624550506 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0b005f830 con 0x55e0ac858240 2024-09-13T23:05:32.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.791+0000 7fc0bd324800 1 -- 172.21.15.164:0/1624550506 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0ac85ba50 con 0x55e0ac858240 2024-09-13T23:05:32.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.792+0000 7fbf9effd640 1 -- 172.21.15.164:0/1624550506 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc0b005f9d0 con 0x55e0ac858240 2024-09-13T23:05:32.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.792+0000 7fbf9effd640 1 --2- 172.21.15.164:0/1624550506 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbf90036b90 0x7fbf90039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.792+0000 7fbf9effd640 1 -- 172.21.15.164:0/1624550506 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc0b0092c40 con 0x55e0ac858240 2024-09-13T23:05:32.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.792+0000 7fc0b9817640 1 --2- 172.21.15.164:0/1624550506 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbf90036b90 0x7fbf90039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.792+0000 7fc0bd324800 1 Processor -- start 2024-09-13T23:05:32.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.793+0000 7fc0bd324800 1 -- start start 2024-09-13T23:05:32.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.793+0000 7fc0b9817640 1 --2- 172.21.15.164:0/1624550506 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbf90036b90 0x7fbf90039050 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x55e0ac848950 tx=0x7fc0b4000f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.793+0000 7fc0bd324800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac864de0 0x55e0ac8651e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.793+0000 7fc0bd324800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e0ac838fe0 con 0x55e0ac864de0 2024-09-13T23:05:32.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.793+0000 7fc0b8815640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac864de0 0x55e0ac8651e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.793+0000 7fc0b8815640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac864de0 0x55e0ac8651e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56772/0 (socket says 172.21.15.164:56772) 2024-09-13T23:05:32.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.793+0000 7fc0b8815640 1 -- 172.21.15.164:0/373993798 learned_addr learned my addr 172.21.15.164:0/373993798 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.793+0000 7fc0b8815640 1 -- 172.21.15.164:0/373993798 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0ac8657b0 con 0x55e0ac864de0 2024-09-13T23:05:32.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.793+0000 7fc0b8815640 1 --2- 172.21.15.164:0/373993798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac864de0 0x55e0ac8651e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0090fa0 tx=0x7fc0b005c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53dbf385cb33535a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.793+0000 7fbf9cff9640 1 -- 172.21.15.164:0/373993798 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0b005c560 con 0x55e0ac864de0 2024-09-13T23:05:32.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.793+0000 7fbf9cff9640 1 -- 172.21.15.164:0/373993798 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b006bc10 con 0x55e0ac864de0 2024-09-13T23:05:32.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.793+0000 7fbf9cff9640 1 -- 172.21.15.164:0/373993798 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0b006a560 con 0x55e0ac864de0 2024-09-13T23:05:32.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.794+0000 7fc0bd324800 1 -- 172.21.15.164:0/373993798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac864de0 msgr2=0x55e0ac8651e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.794+0000 7fc0bd324800 1 --2- 172.21.15.164:0/373993798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac864de0 0x55e0ac8651e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0090fa0 tx=0x7fc0b005c460 comp rx=0 tx=0).stop 2024-09-13T23:05:32.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.794+0000 7fc0bd324800 1 -- 172.21.15.164:0/373993798 shutdown_connections 2024-09-13T23:05:32.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.794+0000 7fc0bd324800 1 --2- 172.21.15.164:0/373993798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac864de0 0x55e0ac8651e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.794+0000 7fc0bd324800 1 -- 172.21.15.164:0/373993798 >> 172.21.15.164:0/373993798 conn(0x55e0ac861140 msgr2=0x55e0ac85f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.794+0000 7fc0bd324800 1 -- 172.21.15.164:0/373993798 shutdown_connections 2024-09-13T23:05:32.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.794+0000 7fc0bd324800 1 -- 172.21.15.164:0/373993798 wait complete. 2024-09-13T23:05:32.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.794+0000 7fc0bd324800 1 Processor -- start 2024-09-13T23:05:32.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.794+0000 7fc0bd324800 1 -- start start 2024-09-13T23:05:32.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.794+0000 7fc0bd324800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac864de0 0x55e0ac86c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.794+0000 7fc0bd324800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e0ac865e20 con 0x55e0ac864de0 2024-09-13T23:05:32.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.795+0000 7fc0b8815640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac864de0 0x55e0ac86c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.795+0000 7fc0b8815640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac864de0 0x55e0ac86c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56774/0 (socket says 172.21.15.164:56774) 2024-09-13T23:05:32.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.795+0000 7fc0b8815640 1 -- 172.21.15.164:0/3561085524 learned_addr learned my addr 172.21.15.164:0/3561085524 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.795+0000 7fc0b8815640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0ac86c7e0 con 0x55e0ac864de0 2024-09-13T23:05:32.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.795+0000 7fc0b8815640 1 --2- 172.21.15.164:0/3561085524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac864de0 0x55e0ac86c2a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0053db0 tx=0x7fc0b0090f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.795+0000 7fbf8effd640 1 -- 172.21.15.164:0/3561085524 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0b006a8a0 con 0x55e0ac864de0 2024-09-13T23:05:32.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.795+0000 7fbf8effd640 1 -- 172.21.15.164:0/3561085524 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b008a040 con 0x55e0ac864de0 2024-09-13T23:05:32.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.795+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e0ac86ca70 con 0x55e0ac864de0 2024-09-13T23:05:32.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.795+0000 7fbf8effd640 1 -- 172.21.15.164:0/3561085524 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0b006b540 con 0x55e0ac864de0 2024-09-13T23:05:32.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.795+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0ac86f720 con 0x55e0ac864de0 2024-09-13T23:05:32.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.796+0000 7fbf8effd640 1 -- 172.21.15.164:0/3561085524 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc0b00699e0 con 0x55e0ac864de0 2024-09-13T23:05:32.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.796+0000 7fbf8effd640 1 --2- 172.21.15.164:0/3561085524 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbf84036b40 0x7fbf84039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.796+0000 7fbf8effd640 1 -- 172.21.15.164:0/3561085524 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc0b009cca0 con 0x55e0ac864de0 2024-09-13T23:05:32.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.796+0000 7fc0b9817640 1 --2- 172.21.15.164:0/3561085524 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbf84036b40 0x7fbf84039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.797+0000 7fc0b9817640 1 --2- 172.21.15.164:0/3561085524 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbf84036b40 0x7fbf84039000 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc0b400f010 tx=0x7fc0b400c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.797+0000 7fc0bd324800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.797+0000 7fc0bd324800 1 --2- 172.21.15.164:0/3561085524 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e0ac877d90 0x55e0ac87a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.797+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac87a9a0 con 0x55e0ac877d90 2024-09-13T23:05:32.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.797+0000 7fc0b9016640 1 --2- 172.21.15.164:0/3561085524 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e0ac877d90 0x55e0ac87a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.798+0000 7fc0b9016640 1 --2- 172.21.15.164:0/3561085524 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e0ac877d90 0x55e0ac87a250 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.798+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.798+0000 7fc0bd324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.798+0000 7fc0bd324800 20 realm 2024-09-13T23:05:32.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.798+0000 7fc0bd324800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.798+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac87adb0 con 0x55e0ac877d90 2024-09-13T23:05:32.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.798+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.798+0000 7fc0bd324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.798+0000 7fc0bd324800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:32.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.798+0000 7fc0bd324800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.798+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac87b680 con 0x55e0ac877d90 2024-09-13T23:05:32.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.798+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.798+0000 7fc0bd324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.798+0000 7fc0bd324800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.798+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac87ba20 con 0x55e0ac877d90 2024-09-13T23:05:32.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.798+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.798+0000 7fc0bd324800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:32.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.798+0000 7fc0bd324800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.798+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac87c270 con 0x55e0ac877d90 2024-09-13T23:05:32.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.799+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.799+0000 7fc0bd324800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:32.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.799+0000 7fc0bd324800 20 searching for the correct realm 2024-09-13T23:05:32.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.799+0000 7fc0bd324800 1 --2- 172.21.15.164:0/3561085524 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55e0ac87dfe0 0x55e0ac8803d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.799+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x55e0ac87dfe0 2024-09-13T23:05:32.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.799+0000 7fc0b8815640 1 --2- 172.21.15.164:0/3561085524 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55e0ac87dfe0 0x55e0ac8803d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.799+0000 7fc0b8815640 1 --2- 172.21.15.164:0/3561085524 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55e0ac87dfe0 0x55e0ac8803d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.799+0000 7fc0b8815640 1 -- 172.21.15.164:0/3561085524 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0b008bd70 con 0x55e0ac87dfe0 2024-09-13T23:05:32.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.799+0000 7fc0b8815640 1 --2- 172.21.15.164:0/3561085524 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc0b005f040 0x7fc0b009e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.799+0000 7fc0b8815640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x7fc0b005f040 2024-09-13T23:05:32.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.800+0000 7fc0b9817640 1 --2- 172.21.15.164:0/3561085524 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc0b005f040 0x7fc0b009e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.800+0000 7fc0b9817640 1 --2- 172.21.15.164:0/3561085524 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc0b005f040 0x7fc0b009e120 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.800+0000 7fc0b9817640 1 -- 172.21.15.164:0/3561085524 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0b402f040 con 0x7fc0b005f040 2024-09-13T23:05:32.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.800+0000 7fc0b9817640 1 --2- 172.21.15.164:0/3561085524 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc0b4019040 0x7fc0b4019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.800+0000 7fc0b9817640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x7fc0b4019040 2024-09-13T23:05:32.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.800+0000 7fc0b9016640 1 --2- 172.21.15.164:0/3561085524 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc0b4019040 0x7fc0b4019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.801+0000 7fc0b9016640 1 --2- 172.21.15.164:0/3561085524 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc0b4019040 0x7fc0b4019930 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.801+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0ac00f030 con 0x7fc0b4019040 2024-09-13T23:05:32.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.801+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x55e0ac877d90 2024-09-13T23:05:32.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.801+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.801+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x55e0ac877d90 2024-09-13T23:05:32.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.801+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.801+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x7fc0b4019040 2024-09-13T23:05:32.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.801+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0ac00f030 con 0x7fc0b4019040 2024-09-13T23:05:32.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.801+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x7fc0b4019040 2024-09-13T23:05:32.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.802+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0ac00f030 con 0x7fc0b4019040 2024-09-13T23:05:32.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.802+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x7fc0b005f040 2024-09-13T23:05:32.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.802+0000 7fc0b9817640 1 -- 172.21.15.164:0/3561085524 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0b402f040 con 0x7fc0b005f040 2024-09-13T23:05:32.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.802+0000 7fc0b9817640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x55e0ac87dfe0 2024-09-13T23:05:32.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.802+0000 7fc0b8815640 1 -- 172.21.15.164:0/3561085524 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0b008bd70 con 0x55e0ac87dfe0 2024-09-13T23:05:32.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.802+0000 7fc0b8815640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x55e0ac877d90 2024-09-13T23:05:32.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.802+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.802+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x7fc0b4019040 2024-09-13T23:05:32.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.803+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0ac00f030 con 0x7fc0b4019040 2024-09-13T23:05:32.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.803+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x55e0ac877d90 2024-09-13T23:05:32.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.803+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.803+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x7fc0b005f040 2024-09-13T23:05:32.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.803+0000 7fc0b9817640 1 -- 172.21.15.164:0/3561085524 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc0b402f040 con 0x7fc0b005f040 2024-09-13T23:05:32.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.803+0000 7fc0b9817640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x55e0ac87dfe0 2024-09-13T23:05:32.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.803+0000 7fc0b8815640 1 -- 172.21.15.164:0/3561085524 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0b008bd70 con 0x55e0ac87dfe0 2024-09-13T23:05:32.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.803+0000 7fc0b8815640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x55e0ac87dfe0 2024-09-13T23:05:32.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.804+0000 7fc0b8815640 1 -- 172.21.15.164:0/3561085524 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0b008bd70 con 0x55e0ac87dfe0 2024-09-13T23:05:32.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.804+0000 7fc0b8815640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x7fc0b4019040 2024-09-13T23:05:32.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.804+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0ac00f030 con 0x7fc0b4019040 2024-09-13T23:05:32.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.804+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x55e0ac87dfe0 2024-09-13T23:05:32.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.804+0000 7fc0b8815640 1 -- 172.21.15.164:0/3561085524 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0b008bd70 con 0x55e0ac87dfe0 2024-09-13T23:05:32.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.804+0000 7fc0b8815640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x55e0ac87dfe0 2024-09-13T23:05:32.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.804+0000 7fc0b8815640 1 -- 172.21.15.164:0/3561085524 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0b008bd70 con 0x55e0ac87dfe0 2024-09-13T23:05:32.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.804+0000 7fc0b8815640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x55e0ac877d90 2024-09-13T23:05:32.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.805+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.805+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x55e0ac877d90 2024-09-13T23:05:32.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.805+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.805+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x7fc0b4019040 2024-09-13T23:05:32.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.805+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0ac00f030 con 0x7fc0b4019040 2024-09-13T23:05:32.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.805+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x55e0ac87dfe0 2024-09-13T23:05:32.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.805+0000 7fc0b8815640 1 -- 172.21.15.164:0/3561085524 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0b008bd70 con 0x55e0ac87dfe0 2024-09-13T23:05:32.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.805+0000 7fc0b8815640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x7fc0b005f040 2024-09-13T23:05:32.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.805+0000 7fc0b9817640 1 -- 172.21.15.164:0/3561085524 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0b402f040 con 0x7fc0b005f040 2024-09-13T23:05:32.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.805+0000 7fc0b9817640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x55e0ac877d90 2024-09-13T23:05:32.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.806+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.806+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x7fc0b4019040 2024-09-13T23:05:32.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.806+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0ac00f030 con 0x7fc0b4019040 2024-09-13T23:05:32.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.806+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x55e0ac87dfe0 2024-09-13T23:05:32.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.806+0000 7fc0b8815640 1 -- 172.21.15.164:0/3561085524 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0b008bd70 con 0x55e0ac87dfe0 2024-09-13T23:05:32.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.806+0000 7fc0b8815640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x7fc0b4019040 2024-09-13T23:05:32.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.807+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0ac00f030 con 0x7fc0b4019040 2024-09-13T23:05:32.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.807+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x7fc0b005f040 2024-09-13T23:05:32.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.807+0000 7fc0b9817640 1 -- 172.21.15.164:0/3561085524 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0b402f040 con 0x7fc0b005f040 2024-09-13T23:05:32.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.807+0000 7fc0b9817640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x55e0ac87dfe0 2024-09-13T23:05:32.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.807+0000 7fc0b8815640 1 -- 172.21.15.164:0/3561085524 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0b008bd70 con 0x55e0ac87dfe0 2024-09-13T23:05:32.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.807+0000 7fc0b8815640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x7fc0b4019040 2024-09-13T23:05:32.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.807+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0ac00f030 con 0x7fc0b4019040 2024-09-13T23:05:32.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.807+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x55e0ac877d90 2024-09-13T23:05:32.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.807+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.807+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880a00 con 0x7fc0b005f040 2024-09-13T23:05:32.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.808+0000 7fc0b9817640 1 -- 172.21.15.164:0/3561085524 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0b402f040 con 0x7fc0b005f040 2024-09-13T23:05:32.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.808+0000 7fc0bd324800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:32.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.808+0000 7fc0bd324800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:32.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.808+0000 7fc0bd324800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:32.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.808+0000 7fc0bd324800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:32.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.808+0000 7fc0bd324800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:32.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.808+0000 7fc0bd324800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:32.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.808+0000 7fc0bd324800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.808+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac87cbf0 con 0x55e0ac877d90 2024-09-13T23:05:32.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.808+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.808+0000 7fc0bd324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.808+0000 7fc0bd324800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.808+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac87d490 con 0x55e0ac877d90 2024-09-13T23:05:32.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.808+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.808+0000 7fc0bd324800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:32.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.808+0000 7fc0bd324800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.808+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac87d490 con 0x55e0ac877d90 2024-09-13T23:05:32.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.808+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.808+0000 7fc0bd324800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:32.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.808+0000 7fc0bd324800 20 zone default found 2024-09-13T23:05:32.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.808+0000 7fc0bd324800 4 Realm: () 2024-09-13T23:05:32.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.808+0000 7fc0bd324800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:32.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.808+0000 7fc0bd324800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:32.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.808+0000 7fc0bd324800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:32.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.808+0000 7fc0bd324800 20 zonegroup default 2024-09-13T23:05:32.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.808+0000 7fc0bd324800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.808+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac880e80 con 0x7fc0b4019040 2024-09-13T23:05:32.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.809+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc0ac00f030 con 0x7fc0b4019040 2024-09-13T23:05:32.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.809+0000 7fc0bd324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.809+0000 7fc0bd324800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.809+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac882860 con 0x55e0ac87dfe0 2024-09-13T23:05:32.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.809+0000 7fc0b8815640 1 -- 172.21.15.164:0/3561085524 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc0b008bd70 con 0x55e0ac87dfe0 2024-09-13T23:05:32.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.809+0000 7fc0bd324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.809+0000 7fc0bd324800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.809+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac882d40 con 0x55e0ac87dfe0 2024-09-13T23:05:32.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.809+0000 7fc0b8815640 1 -- 172.21.15.164:0/3561085524 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc0b008bd70 con 0x55e0ac87dfe0 2024-09-13T23:05:32.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.809+0000 7fc0bd324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.809+0000 7fc0bd324800 20 started sync module instance, tier type = 2024-09-13T23:05:32.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.809+0000 7fc0bd324800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:32.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.809+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac881d00 con 0x7fc0b005f040 2024-09-13T23:05:32.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.810+0000 7fc0b9817640 1 -- 172.21.15.164:0/3561085524 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0b402f040 con 0x7fc0b005f040 2024-09-13T23:05:32.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.810+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94423455638048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac881d00 con 0x7fc0b005f040 2024-09-13T23:05:32.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.810+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac883800 con 0x55e0ac877d90 2024-09-13T23:05:32.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.811+0000 7fc0b9817640 1 -- 172.21.15.164:0/3561085524 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94423455638048] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0b402f040 con 0x7fc0b005f040 2024-09-13T23:05:32.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.812+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.812+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94423455642384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac881d00 con 0x55e0ac877d90 2024-09-13T23:05:32.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.812+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac884290 con 0x55e0ac87dfe0 2024-09-13T23:05:32.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.812+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94423455642384] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.813+0000 7fc0b8815640 1 -- 172.21.15.164:0/3561085524 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0b008bd70 con 0x55e0ac87dfe0 2024-09-13T23:05:32.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.813+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94423455635536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac881c70 con 0x55e0ac87dfe0 2024-09-13T23:05:32.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.813+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac885150 con 0x7fc0b005f040 2024-09-13T23:05:32.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.814+0000 7fc0b8815640 1 -- 172.21.15.164:0/3561085524 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94423455635536] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0b008bd70 con 0x55e0ac87dfe0 2024-09-13T23:05:32.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.814+0000 7fc0b9817640 1 -- 172.21.15.164:0/3561085524 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0b402f040 con 0x7fc0b005f040 2024-09-13T23:05:32.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.814+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94423455648928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac885570 con 0x7fc0b005f040 2024-09-13T23:05:32.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.814+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac885f30 con 0x55e0ac877d90 2024-09-13T23:05:32.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.815+0000 7fc0b9817640 1 -- 172.21.15.164:0/3561085524 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94423455648928] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0b402f040 con 0x7fc0b005f040 2024-09-13T23:05:32.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.815+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.815+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94423455650464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac885f30 con 0x55e0ac877d90 2024-09-13T23:05:32.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.815+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac886930 con 0x7fc0b4019040 2024-09-13T23:05:32.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.816+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0ac00f030 con 0x7fc0b4019040 2024-09-13T23:05:32.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.816+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94423455654976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac886860 con 0x7fc0b4019040 2024-09-13T23:05:32.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.816+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac887860 con 0x7fc0b4019040 2024-09-13T23:05:32.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.816+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94423455650464] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.817+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94423455654976] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0ac00f030 con 0x7fc0b4019040 2024-09-13T23:05:32.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.817+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0ac00f030 con 0x7fc0b4019040 2024-09-13T23:05:32.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.817+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94423455657248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac887370 con 0x7fc0b4019040 2024-09-13T23:05:32.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.817+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac887d30 con 0x7fc0b4019040 2024-09-13T23:05:32.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.818+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0ac00f030 con 0x7fc0b4019040 2024-09-13T23:05:32.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.818+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94423455660160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac888150 con 0x7fc0b4019040 2024-09-13T23:05:32.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.818+0000 7fc0bd324800 20 add_watcher() i=0 2024-09-13T23:05:32.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.818+0000 7fc0bd324800 20 add_watcher() i=1 2024-09-13T23:05:32.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.818+0000 7fc0bd324800 20 add_watcher() i=2 2024-09-13T23:05:32.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.818+0000 7fc0bd324800 20 add_watcher() i=3 2024-09-13T23:05:32.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.818+0000 7fc0bd324800 20 add_watcher() i=4 2024-09-13T23:05:32.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.818+0000 7fc0bd324800 20 add_watcher() i=5 2024-09-13T23:05:32.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.818+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94423455657248] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0ac00f030 con 0x7fc0b4019040 2024-09-13T23:05:32.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.819+0000 7fc0bd324800 20 add_watcher() i=6 2024-09-13T23:05:32.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.819+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94423455660160] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0ac00f030 con 0x7fc0b4019040 2024-09-13T23:05:32.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.819+0000 7fc0bd324800 20 add_watcher() i=7 2024-09-13T23:05:32.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.819+0000 7fc0bd324800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:32.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.819+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac885a80 con 0x55e0ac877d90 2024-09-13T23:05:32.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.820+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.820+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94423455652480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac888620 con 0x55e0ac877d90 2024-09-13T23:05:32.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.821+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94423455652480] v32'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.821+0000 7fbf6f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:32.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.821+0000 7fc0bd324800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:32.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.821+0000 7fc0bd324800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:32.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.821+0000 7fc0bd324800 5 note: GC not initialized 2024-09-13T23:05:32.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.821+0000 7fbf6e7e4640 20 reqs_thread_entry: start 2024-09-13T23:05:32.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.821+0000 7fc0bd324800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:32.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.821+0000 7fc0bd324800 20 Filter name: none 2024-09-13T23:05:32.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.821+0000 7fbedffff640 20 reqs_thread_entry: start 2024-09-13T23:05:32.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.821+0000 7fc0bd324800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:05:32.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.821+0000 7fc0bd324800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.821+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac8be500 con 0x55e0ac877d90 2024-09-13T23:05:32.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.822+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.822+0000 7fc0bd324800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:05:32.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.822+0000 7fc0bd324800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:05:32.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.822+0000 7fc0bd324800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:32.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.822+0000 7fc0bd324800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:32.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.822+0000 7fc0bd324800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-13T23:05:32.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.822+0000 7fc0bd324800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.822+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac8bef70 con 0x55e0ac877d90 2024-09-13T23:05:32.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.822+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.822+0000 7fc0bd324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.822+0000 7fc0bd324800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-13T23:05:32.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.822+0000 7fc0bd324800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-13T23:05:32.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.822+0000 7fc0bd324800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-13T23:05:32.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.822+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac8c4a10 con 0x55e0ac877d90 2024-09-13T23:05:32.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.823+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v32'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.823+0000 7fc0bd324800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:32.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.823+0000 7fc0bd324800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:32.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.823+0000 7fc0bd324800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:05:32.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.823+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94423455908816 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac8bffb0 con 0x55e0ac877d90 2024-09-13T23:05:32.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.823+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== watch-notify(notify (1) cookie 94423455650464 notify 137438953477 ret 0) ==== 774+0+0 (crc 0 0 0) 0x55e0ac840f30 con 0x55e0ac877d90 2024-09-13T23:05:32.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.823+0000 7fbf9cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94423455650464 notifier 4372 bl.length()=732 2024-09-13T23:05:32.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.823+0000 7fbf9cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:32.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.823+0000 7fbf9cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:32.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.823+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(65 notify.4 [notify cookie 94423455908816 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.823+0000 7fbf9cff9640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fbf7c003ea0 con 0x55e0ac877d90 2024-09-13T23:05:32.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.824+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.824+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== watch-notify(notify_complete (2) cookie 94423455908816 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e0ac8409b0 con 0x55e0ac877d90 2024-09-13T23:05:32.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.824+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac8c43d0 con 0x55e0ac877d90 2024-09-13T23:05:32.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.825+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.825+0000 7fc0bd324800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-13T23:05:32.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.825+0000 7fc0bd324800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-13T23:05:32.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.825+0000 7fc0bd324800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-13T23:05:32.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.825+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94423455908816 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac8bfb00 con 0x7fc0b005f040 2024-09-13T23:05:32.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.825+0000 7fc0b9817640 1 -- 172.21.15.164:0/3561085524 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== watch-notify(notify (1) cookie 94423455638048 notify 137438953474 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7fc0b4010040 con 0x7fc0b005f040 2024-09-13T23:05:32.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.825+0000 7fbf9cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94423455638048 notifier 4372 bl.length()=166 2024-09-13T23:05:32.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.825+0000 7fbf9cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-13T23:05:32.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.825+0000 7fbf9cff9640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-13T23:05:32.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.825+0000 7fbf9cff9640 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fbf7c003ea0 con 0x7fc0b005f040 2024-09-13T23:05:32.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.825+0000 7fc0b9817640 1 -- 172.21.15.164:0/3561085524 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(68 notify.0 [notify cookie 94423455908816 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc0b402f040 con 0x7fc0b005f040 2024-09-13T23:05:32.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.825+0000 7fc0b9817640 1 -- 172.21.15.164:0/3561085524 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0b402f040 con 0x7fc0b005f040 2024-09-13T23:05:32.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.825+0000 7fc0b9817640 1 -- 172.21.15.164:0/3561085524 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== watch-notify(notify_complete (2) cookie 94423455908816 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc0b4026ac0 con 0x7fc0b005f040 2024-09-13T23:05:32.844 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:05:31.300851Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"waLZoBDF0VLOkYM37CyC8isknrCHqajGBMHCqpDw","active":true,"create_date":"2024-09-13T23:05:32.823031Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:05:31.300826Z","tags":[],"group_ids":[]} 2024-09-13T23:05:32.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.826+0000 7fbf6f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:32.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.826+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94423455652480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac8bc250 con 0x55e0ac877d90 2024-09-13T23:05:32.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.827+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94423455652480] v32'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.827+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94423455638048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac8bc250 con 0x7fc0b005f040 2024-09-13T23:05:32.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.828+0000 7fc0b9817640 1 -- 172.21.15.164:0/3561085524 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94423455638048] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0b402f040 con 0x7fc0b005f040 2024-09-13T23:05:32.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.828+0000 7fc0bd324800 20 remove_watcher() i=0 2024-09-13T23:05:32.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.828+0000 7fc0bd324800 2 removed watcher, disabling cache 2024-09-13T23:05:32.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.828+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94423455642384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac8bc250 con 0x55e0ac877d90 2024-09-13T23:05:32.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.829+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 32 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94423455642384] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.829+0000 7fc0bd324800 20 remove_watcher() i=1 2024-09-13T23:05:32.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.829+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94423455635536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac8bc250 con 0x55e0ac87dfe0 2024-09-13T23:05:32.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.830+0000 7fc0b8815640 1 -- 172.21.15.164:0/3561085524 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94423455635536] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0b008bd70 con 0x55e0ac87dfe0 2024-09-13T23:05:32.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.830+0000 7fc0bd324800 20 remove_watcher() i=2 2024-09-13T23:05:32.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.830+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94423455648928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac883310 con 0x7fc0b005f040 2024-09-13T23:05:32.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.831+0000 7fc0b9817640 1 -- 172.21.15.164:0/3561085524 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94423455648928] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0b402f040 con 0x7fc0b005f040 2024-09-13T23:05:32.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.831+0000 7fc0bd324800 20 remove_watcher() i=3 2024-09-13T23:05:32.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.831+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94423455650464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac884ca0 con 0x55e0ac877d90 2024-09-13T23:05:32.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.833+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.1 v2:172.21.15.164:6800/4060509701 33 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94423455650464] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0ac00f030 con 0x55e0ac877d90 2024-09-13T23:05:32.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.833+0000 7fc0bd324800 20 remove_watcher() i=4 2024-09-13T23:05:32.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.833+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94423455654976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac883310 con 0x7fc0b4019040 2024-09-13T23:05:32.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.834+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94423455654976] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0ac00f030 con 0x7fc0b4019040 2024-09-13T23:05:32.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.834+0000 7fc0bd324800 20 remove_watcher() i=5 2024-09-13T23:05:32.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.834+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94423455657248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac884ca0 con 0x7fc0b4019040 2024-09-13T23:05:32.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.835+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94423455657248] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0ac00f030 con 0x7fc0b4019040 2024-09-13T23:05:32.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.835+0000 7fc0bd324800 20 remove_watcher() i=6 2024-09-13T23:05:32.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.835+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94423455660160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0ac886440 con 0x7fc0b4019040 2024-09-13T23:05:32.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.836+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94423455660160] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0ac00f030 con 0x7fc0b4019040 2024-09-13T23:05:32.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.836+0000 7fc0bd324800 20 remove_watcher() i=7 2024-09-13T23:05:32.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.836+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc0b4019040 msgr2=0x7fc0b4019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.836+0000 7fc0bd324800 1 --2- 172.21.15.164:0/3561085524 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc0b4019040 0x7fc0b4019930 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.836+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e0ac877d90 msgr2=0x55e0ac87a250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.836+0000 7fc0bd324800 1 --2- 172.21.15.164:0/3561085524 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e0ac877d90 0x55e0ac87a250 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.836+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc0b005f040 msgr2=0x7fc0b009e120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.836+0000 7fc0bd324800 1 --2- 172.21.15.164:0/3561085524 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc0b005f040 0x7fc0b009e120 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.836+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55e0ac87dfe0 msgr2=0x55e0ac8803d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.836+0000 7fc0bd324800 1 --2- 172.21.15.164:0/3561085524 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55e0ac87dfe0 0x55e0ac8803d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.836+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbf84036b40 msgr2=0x7fbf84039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.836+0000 7fc0bd324800 1 --2- 172.21.15.164:0/3561085524 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbf84036b40 0x7fbf84039000 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc0b400f010 tx=0x7fc0b400c040 comp rx=0 tx=0).stop 2024-09-13T23:05:32.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.836+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac864de0 msgr2=0x55e0ac86c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.836+0000 7fc0bd324800 1 --2- 172.21.15.164:0/3561085524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac864de0 0x55e0ac86c2a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0053db0 tx=0x7fc0b0090f00 comp rx=0 tx=0).stop 2024-09-13T23:05:32.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.836+0000 7fc0b9016640 1 -- 172.21.15.164:0/3561085524 reap_dead start 2024-09-13T23:05:32.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.836+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 shutdown_connections 2024-09-13T23:05:32.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.836+0000 7fc0bd324800 1 --2- 172.21.15.164:0/3561085524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac864de0 0x55e0ac86c2a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.836+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 >> 172.21.15.164:0/3561085524 conn(0x55e0ac861140 msgr2=0x55e0ac85f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.836+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 shutdown_connections 2024-09-13T23:05:32.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.836+0000 7fc0bd324800 1 -- 172.21.15.164:0/3561085524 wait complete. 2024-09-13T23:05:32.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.836+0000 7fc0bd324800 1 -- 172.21.15.164:0/1624550506 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbf90036b90 msgr2=0x7fbf90039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.836+0000 7fc0bd324800 1 --2- 172.21.15.164:0/1624550506 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbf90036b90 0x7fbf90039050 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x55e0ac848950 tx=0x7fc0b4000f90 comp rx=0 tx=0).stop 2024-09-13T23:05:32.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.836+0000 7fc0bd324800 1 -- 172.21.15.164:0/1624550506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac858240 msgr2=0x55e0ac858660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.836+0000 7fc0bd324800 1 --2- 172.21.15.164:0/1624550506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac858240 0x55e0ac858660 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0025bf0 tx=0x7fc0b0002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.836+0000 7fc0bd324800 1 -- 172.21.15.164:0/1624550506 shutdown_connections 2024-09-13T23:05:32.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.836+0000 7fc0bd324800 1 --2- 172.21.15.164:0/1624550506 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbf90036b90 0x7fbf90039050 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.836+0000 7fc0bd324800 1 --2- 172.21.15.164:0/1624550506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac858240 0x55e0ac858660 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.837+0000 7fc0bd324800 1 -- 172.21.15.164:0/1624550506 >> 172.21.15.164:0/1624550506 conn(0x55e0ac84d1d0 msgr2=0x55e0ac84fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.837+0000 7fc0bd324800 1 -- 172.21.15.164:0/1624550506 shutdown_connections 2024-09-13T23:05:32.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.837+0000 7fc0bd324800 1 -- 172.21.15.164:0/1624550506 wait complete. 2024-09-13T23:05:32.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.837+0000 7fc0bd324800 1 -- 172.21.15.164:0/3584827610 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e0ac8454d0 msgr2=0x55e0ac8478c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.837+0000 7fc0bd324800 1 --2- 172.21.15.164:0/3584827610 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e0ac8454d0 0x55e0ac8478c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.837+0000 7fc0bd324800 1 -- 172.21.15.164:0/3584827610 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbfa0036b90 msgr2=0x7fbfa0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.837+0000 7fc0bd324800 1 --2- 172.21.15.164:0/3584827610 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbfa0036b90 0x7fbfa0039050 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0057000 tx=0x7fc0b0052000 comp rx=0 tx=0).stop 2024-09-13T23:05:32.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.837+0000 7fc0bd324800 1 -- 172.21.15.164:0/3584827610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac74dd60 msgr2=0x55e0ac840470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.837+0000 7fc0bd324800 1 --2- 172.21.15.164:0/3584827610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac74dd60 0x55e0ac840470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55e0ac8396f0 tx=0x7fc0ac001250 comp rx=0 tx=0).stop 2024-09-13T23:05:32.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.837+0000 7fc0bd324800 1 -- 172.21.15.164:0/3584827610 shutdown_connections 2024-09-13T23:05:32.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.837+0000 7fc0bd324800 1 --2- 172.21.15.164:0/3584827610 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e0ac8454d0 0x55e0ac8478c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.837+0000 7fc0bd324800 1 --2- 172.21.15.164:0/3584827610 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbfa0036b90 0x7fbfa0039050 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.837+0000 7fc0bd324800 1 --2- 172.21.15.164:0/3584827610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0ac74dd60 0x55e0ac840470 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.837+0000 7fc0bd324800 1 -- 172.21.15.164:0/3584827610 >> 172.21.15.164:0/3584827610 conn(0x55e0ac741db0 msgr2=0x55e0ac832b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.837+0000 7fc0bd324800 1 -- 172.21.15.164:0/3584827610 shutdown_connections 2024-09-13T23:05:32.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.837+0000 7fc0bd324800 1 -- 172.21.15.164:0/3584827610 wait complete. 2024-09-13T23:05:32.856 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:05:31.300851Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'waLZoBDF0VLOkYM37CyC8isknrCHqajGBMHCqpDw', 'active': True, 'create_date': '2024-09-13T23:05:32.823031Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:05:31.300826Z', 'tags': [], 'group_ids': []} 2024-09-13T23:05:32.857 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-13T23:05:32.857 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-13T23:05:32.857 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-13T23:05:32.905 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:32.905 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:32.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.905+0000 7f28b820e800 1 Processor -- start 2024-09-13T23:05:32.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.905+0000 7f28b820e800 1 -- start start 2024-09-13T23:05:32.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.905+0000 7f28b820e800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55e5ec3a9920 0x55e5ec3abd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.905+0000 7f28b820e800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e5ec265b30 con 0x55e5ec3a54e0 2024-09-13T23:05:32.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.905+0000 7f28b820e800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55e5ec247360 con 0x55e5ec3a9920 2024-09-13T23:05:32.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.906+0000 7f28ab119640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55e5ec3a9920 0x55e5ec3abd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.906+0000 7f28b391a640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55e5ec3a54e0 0x55e5ec3a58e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40802/0 (socket says 172.21.15.164:40802) 2024-09-13T23:05:32.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.906+0000 7f28b391a640 1 -- 172.21.15.164:0/1738216855 learned_addr learned my addr 172.21.15.164:0/1738216855 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:32.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.906+0000 7f28ab119640 1 -- 172.21.15.164:0/1738216855 >> v1:172.21.15.17:6789/0 conn(0x55e5ec3a54e0 legacy=0x55e5ec3a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.906+0000 7f28b3119640 1 -- 172.21.15.164:0/1738216855 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 665688097 0 0) 0x55e5ec265b30 con 0x55e5ec3a54e0 2024-09-13T23:05:32.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.906+0000 7f28ab119640 1 -- 172.21.15.164:0/1738216855 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5ec26de00 con 0x55e5ec3a9920 2024-09-13T23:05:32.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.908+0000 7f28ab119640 1 --2- 172.21.15.164:0/1738216855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec3a9920 0x55e5ec3abd10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f289c00a470 tx=0x7f289c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c107f6bee11c3e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.908+0000 7f28b3119640 1 -- 172.21.15.164:0/1738216855 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f289c053570 con 0x55e5ec3a9920 2024-09-13T23:05:32.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.908+0000 7f28b3119640 1 -- 172.21.15.164:0/1738216855 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f289c058070 con 0x55e5ec3a9920 2024-09-13T23:05:32.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.908+0000 7f28b3119640 1 -- 172.21.15.164:0/1738216855 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f289c053880 con 0x55e5ec3a9920 2024-09-13T23:05:32.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.909+0000 7f28b820e800 1 -- 172.21.15.164:0/1738216855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec3a9920 msgr2=0x55e5ec3abd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.909+0000 7f28b820e800 1 --2- 172.21.15.164:0/1738216855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec3a9920 0x55e5ec3abd10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f289c00a470 tx=0x7f289c045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:32.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.909+0000 7f28b820e800 1 -- 172.21.15.164:0/1738216855 shutdown_connections 2024-09-13T23:05:32.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.909+0000 7f28b820e800 1 --2- 172.21.15.164:0/1738216855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec3a9920 0x55e5ec3abd10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.909+0000 7f28b820e800 1 -- 172.21.15.164:0/1738216855 >> 172.21.15.164:0/1738216855 conn(0x55e5ec3a0e10 msgr2=0x55e5ec3a3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.909+0000 7f28b820e800 1 -- 172.21.15.164:0/1738216855 shutdown_connections 2024-09-13T23:05:32.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.909+0000 7f28b820e800 1 -- 172.21.15.164:0/1738216855 wait complete. 2024-09-13T23:05:32.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.923+0000 7f28b820e800 1 Processor -- start 2024-09-13T23:05:32.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.923+0000 7f28b820e800 1 -- start start 2024-09-13T23:05:32.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.923+0000 7f28b820e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec3a54e0 0x55e5ec319da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.923+0000 7f28b820e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e5ec2f2350 con 0x55e5ec3a54e0 2024-09-13T23:05:32.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.923+0000 7f28b391a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec3a54e0 0x55e5ec319da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.923+0000 7f28b391a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec3a54e0 0x55e5ec319da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56794/0 (socket says 172.21.15.164:56794) 2024-09-13T23:05:32.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.923+0000 7f28b391a640 1 -- 172.21.15.164:0/284001409 learned_addr learned my addr 172.21.15.164:0/284001409 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.924+0000 7f28b391a640 1 -- 172.21.15.164:0/284001409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5ec23fbc0 con 0x55e5ec3a54e0 2024-09-13T23:05:32.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.924+0000 7f28b391a640 1 --2- 172.21.15.164:0/284001409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec3a54e0 0x55e5ec319da0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f28a400b240 tx=0x7f28a400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d86fb7d9be2e99 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.924+0000 7f27a1e0b640 1 -- 172.21.15.164:0/284001409 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28a4008070 con 0x55e5ec3a54e0 2024-09-13T23:05:32.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.924+0000 7f27a1e0b640 1 -- 172.21.15.164:0/284001409 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28a400d500 con 0x55e5ec3a54e0 2024-09-13T23:05:32.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.924+0000 7f27a1e0b640 1 -- 172.21.15.164:0/284001409 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28a400d860 con 0x55e5ec3a54e0 2024-09-13T23:05:32.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.925+0000 7f28b820e800 1 -- 172.21.15.164:0/284001409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec3a54e0 msgr2=0x55e5ec319da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.925+0000 7f28b820e800 1 --2- 172.21.15.164:0/284001409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec3a54e0 0x55e5ec319da0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f28a400b240 tx=0x7f28a400b700 comp rx=0 tx=0).stop 2024-09-13T23:05:32.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.925+0000 7f28b820e800 1 -- 172.21.15.164:0/284001409 shutdown_connections 2024-09-13T23:05:32.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.925+0000 7f28b820e800 1 --2- 172.21.15.164:0/284001409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec3a54e0 0x55e5ec319da0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.925+0000 7f28b820e800 1 -- 172.21.15.164:0/284001409 >> 172.21.15.164:0/284001409 conn(0x55e5ec3a0e10 msgr2=0x55e5ec48ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.925+0000 7f28b820e800 1 -- 172.21.15.164:0/284001409 shutdown_connections 2024-09-13T23:05:32.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.925+0000 7f28b820e800 1 -- 172.21.15.164:0/284001409 wait complete. 2024-09-13T23:05:32.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.925+0000 7f28b820e800 1 Processor -- start 2024-09-13T23:05:32.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.925+0000 7f28b820e800 1 -- start start 2024-09-13T23:05:32.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.925+0000 7f28b820e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec3a54e0 0x55e5ec49d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.925+0000 7f28b820e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e5ec3ac550 con 0x55e5ec3a54e0 2024-09-13T23:05:32.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.925+0000 7f28b391a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec3a54e0 0x55e5ec49d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.925+0000 7f28b391a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec3a54e0 0x55e5ec49d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56802/0 (socket says 172.21.15.164:56802) 2024-09-13T23:05:32.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.925+0000 7f28b391a640 1 -- 172.21.15.164:0/3071454352 learned_addr learned my addr 172.21.15.164:0/3071454352 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.926+0000 7f28b391a640 1 -- 172.21.15.164:0/3071454352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5ec253fe0 con 0x55e5ec3a54e0 2024-09-13T23:05:32.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.926+0000 7f28b391a640 1 --2- 172.21.15.164:0/3071454352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec3a54e0 0x55e5ec49d0f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55e5ec3194a0 tx=0x7f28a4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.926+0000 7f279bfff640 1 -- 172.21.15.164:0/3071454352 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28a4019870 con 0x55e5ec3a54e0 2024-09-13T23:05:32.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.926+0000 7f279bfff640 1 -- 172.21.15.164:0/3071454352 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28a4019a10 con 0x55e5ec3a54e0 2024-09-13T23:05:32.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.926+0000 7f279bfff640 1 -- 172.21.15.164:0/3071454352 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28a4019d30 con 0x55e5ec3a54e0 2024-09-13T23:05:32.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.926+0000 7f28b820e800 1 -- 172.21.15.164:0/3071454352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5ec49d630 con 0x55e5ec3a54e0 2024-09-13T23:05:32.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.926+0000 7f28b820e800 1 -- 172.21.15.164:0/3071454352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5ec49db50 con 0x55e5ec3a54e0 2024-09-13T23:05:32.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.927+0000 7f279bfff640 1 -- 172.21.15.164:0/3071454352 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f28a4017040 con 0x55e5ec3a54e0 2024-09-13T23:05:32.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.927+0000 7f279bfff640 1 --2- 172.21.15.164:0/3071454352 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f279c036be0 0x7f279c0390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.927+0000 7f279bfff640 1 -- 172.21.15.164:0/3071454352 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f28a4015020 con 0x55e5ec3a54e0 2024-09-13T23:05:32.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.927+0000 7f28ab119640 1 --2- 172.21.15.164:0/3071454352 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f279c036be0 0x7f279c0390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.927+0000 7f28b820e800 1 --2- 172.21.15.164:0/3071454352 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e5ec3a9920 0x55e5ec4a4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.927+0000 7f28b820e800 1 -- 172.21.15.164:0/3071454352 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4a46e0 con 0x55e5ec3a9920 2024-09-13T23:05:32.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.927+0000 7f28b411b640 1 --2- 172.21.15.164:0/3071454352 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e5ec3a9920 0x55e5ec4a4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.928+0000 7f28ab119640 1 --2- 172.21.15.164:0/3071454352 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f279c036be0 0x7f279c0390a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f289c057000 tx=0x7f289c052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.928+0000 7f28b411b640 1 --2- 172.21.15.164:0/3071454352 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e5ec3a9920 0x55e5ec4a4160 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.928+0000 7f28b411b640 1 -- 172.21.15.164:0/3071454352 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28ac00a4a0 con 0x55e5ec3a9920 2024-09-13T23:05:32.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.928+0000 7f28b820e800 1 -- 172.21.15.164:0/3071454352 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4a1730 con 0x55e5ec3a9920 2024-09-13T23:05:32.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.928+0000 7f28b411b640 1 -- 172.21.15.164:0/3071454352 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f28ac00a4a0 con 0x55e5ec3a9920 2024-09-13T23:05:32.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.928+0000 7f28b820e800 1 -- 172.21.15.164:0/3071454352 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4a6500 con 0x55e5ec3a9920 2024-09-13T23:05:32.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.929+0000 7f28b411b640 1 -- 172.21.15.164:0/3071454352 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f28ac00a4a0 con 0x55e5ec3a9920 2024-09-13T23:05:32.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.929+0000 7f28b820e800 1 -- 172.21.15.164:0/3071454352 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4a5640 con 0x55e5ec3a9920 2024-09-13T23:05:32.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.929+0000 7f28b411b640 1 -- 172.21.15.164:0/3071454352 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f28ac00a4a0 con 0x55e5ec3a9920 2024-09-13T23:05:32.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.929+0000 7f28b820e800 1 -- 172.21.15.164:0/3071454352 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4a5a90 con 0x55e5ec3a9920 2024-09-13T23:05:32.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.929+0000 7f28b411b640 1 -- 172.21.15.164:0/3071454352 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f28ac00a4a0 con 0x55e5ec3a9920 2024-09-13T23:05:32.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.929+0000 7f28b820e800 1 Processor -- start 2024-09-13T23:05:32.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.929+0000 7f28b820e800 1 -- start start 2024-09-13T23:05:32.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.930+0000 7f28b820e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec4b4af0 0x55e5ec4b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.930+0000 7f28b820e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e5ec241580 con 0x55e5ec4b4af0 2024-09-13T23:05:32.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.930+0000 7f28ab119640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec4b4af0 0x55e5ec4b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.930+0000 7f28ab119640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec4b4af0 0x55e5ec4b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56818/0 (socket says 172.21.15.164:56818) 2024-09-13T23:05:32.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.930+0000 7f28ab119640 1 -- 172.21.15.164:0/1539026518 learned_addr learned my addr 172.21.15.164:0/1539026518 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.930+0000 7f28ab119640 1 -- 172.21.15.164:0/1539026518 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5ec4b5450 con 0x55e5ec4b4af0 2024-09-13T23:05:32.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.930+0000 7f28ab119640 1 --2- 172.21.15.164:0/1539026518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec4b4af0 0x55e5ec4b4f10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f289c025bf0 tx=0x7f289c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.931+0000 7f27997fa640 1 -- 172.21.15.164:0/1539026518 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f289c06f070 con 0x55e5ec4b4af0 2024-09-13T23:05:32.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.931+0000 7f27997fa640 1 -- 172.21.15.164:0/1539026518 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f289c05f550 con 0x55e5ec4b4af0 2024-09-13T23:05:32.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.931+0000 7f28b820e800 1 -- 172.21.15.164:0/1539026518 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5ec4b5680 con 0x55e5ec4b4af0 2024-09-13T23:05:32.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.931+0000 7f27997fa640 1 -- 172.21.15.164:0/1539026518 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f289c05f830 con 0x55e5ec4b4af0 2024-09-13T23:05:32.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.931+0000 7f28b820e800 1 -- 172.21.15.164:0/1539026518 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5ec4b8300 con 0x55e5ec4b4af0 2024-09-13T23:05:32.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.931+0000 7f27997fa640 1 -- 172.21.15.164:0/1539026518 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f289c05f9d0 con 0x55e5ec4b4af0 2024-09-13T23:05:32.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.932+0000 7f27997fa640 1 --2- 172.21.15.164:0/1539026518 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f278c036b90 0x7f278c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.932+0000 7f27997fa640 1 -- 172.21.15.164:0/1539026518 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f289c092c00 con 0x55e5ec4b4af0 2024-09-13T23:05:32.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.932+0000 7f28b411b640 1 --2- 172.21.15.164:0/1539026518 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f278c036b90 0x7f278c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.932+0000 7f28b820e800 1 Processor -- start 2024-09-13T23:05:32.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.932+0000 7f28b411b640 1 --2- 172.21.15.164:0/1539026518 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f278c036b90 0x7f278c039050 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x55e5ec4a5160 tx=0x7f28ac005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.932+0000 7f28b820e800 1 -- start start 2024-09-13T23:05:32.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.932+0000 7f28b820e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec4c1690 0x55e5ec4c1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.932+0000 7f28b820e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e5ec4985e0 con 0x55e5ec4c1690 2024-09-13T23:05:32.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.932+0000 7f28ab119640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec4c1690 0x55e5ec4c1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.933+0000 7f28ab119640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec4c1690 0x55e5ec4c1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56826/0 (socket says 172.21.15.164:56826) 2024-09-13T23:05:32.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.933+0000 7f28ab119640 1 -- 172.21.15.164:0/953561949 learned_addr learned my addr 172.21.15.164:0/953561949 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.933+0000 7f28ab119640 1 -- 172.21.15.164:0/953561949 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5ec4c2060 con 0x55e5ec4c1690 2024-09-13T23:05:32.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.933+0000 7f28ab119640 1 --2- 172.21.15.164:0/953561949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec4c1690 0x55e5ec4c1a90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f289c090fa0 tx=0x7f289c05c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eddf87a6251da68 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.933+0000 7f2792ffd640 1 -- 172.21.15.164:0/953561949 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f289c05c560 con 0x55e5ec4c1690 2024-09-13T23:05:32.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.933+0000 7f2792ffd640 1 -- 172.21.15.164:0/953561949 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f289c06bc10 con 0x55e5ec4c1690 2024-09-13T23:05:32.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.933+0000 7f2792ffd640 1 -- 172.21.15.164:0/953561949 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f289c06a560 con 0x55e5ec4c1690 2024-09-13T23:05:32.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.933+0000 7f28b820e800 1 -- 172.21.15.164:0/953561949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec4c1690 msgr2=0x55e5ec4c1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.933+0000 7f28b820e800 1 --2- 172.21.15.164:0/953561949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec4c1690 0x55e5ec4c1a90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f289c090fa0 tx=0x7f289c05c460 comp rx=0 tx=0).stop 2024-09-13T23:05:32.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.934+0000 7f28b820e800 1 -- 172.21.15.164:0/953561949 shutdown_connections 2024-09-13T23:05:32.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.934+0000 7f28b820e800 1 --2- 172.21.15.164:0/953561949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec4c1690 0x55e5ec4c1a90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.934+0000 7f28b820e800 1 -- 172.21.15.164:0/953561949 >> 172.21.15.164:0/953561949 conn(0x55e5ec4bd9f0 msgr2=0x55e5ec4bbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.934+0000 7f28b820e800 1 -- 172.21.15.164:0/953561949 shutdown_connections 2024-09-13T23:05:32.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.934+0000 7f28b820e800 1 -- 172.21.15.164:0/953561949 wait complete. 2024-09-13T23:05:32.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.934+0000 7f28b820e800 1 Processor -- start 2024-09-13T23:05:32.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.934+0000 7f28b820e800 1 -- start start 2024-09-13T23:05:32.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.934+0000 7f28b820e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec4c1690 0x55e5ec4c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.934+0000 7f28b820e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e5ec4c26d0 con 0x55e5ec4c1690 2024-09-13T23:05:32.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.934+0000 7f28ab119640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec4c1690 0x55e5ec4c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.934+0000 7f28ab119640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec4c1690 0x55e5ec4c8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56840/0 (socket says 172.21.15.164:56840) 2024-09-13T23:05:32.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.934+0000 7f28ab119640 1 -- 172.21.15.164:0/1995103013 learned_addr learned my addr 172.21.15.164:0/1995103013 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:32.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.934+0000 7f28ab119640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5ec4c9090 con 0x55e5ec4c1690 2024-09-13T23:05:32.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.935+0000 7f28ab119640 1 --2- 172.21.15.164:0/1995103013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec4c1690 0x55e5ec4c8b50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f289c053db0 tx=0x7f289c090f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.935+0000 7f27917fa640 1 -- 172.21.15.164:0/1995103013 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f289c06b620 con 0x55e5ec4c1690 2024-09-13T23:05:32.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.935+0000 7f27917fa640 1 -- 172.21.15.164:0/1995103013 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f289c08a040 con 0x55e5ec4c1690 2024-09-13T23:05:32.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.935+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5ec4c9320 con 0x55e5ec4c1690 2024-09-13T23:05:32.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.935+0000 7f27917fa640 1 -- 172.21.15.164:0/1995103013 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f289c0699e0 con 0x55e5ec4c1690 2024-09-13T23:05:32.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.935+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5ec4cbfd0 con 0x55e5ec4c1690 2024-09-13T23:05:32.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.936+0000 7f27917fa640 1 -- 172.21.15.164:0/1995103013 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f289c069b80 con 0x55e5ec4c1690 2024-09-13T23:05:32.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.936+0000 7f27917fa640 1 --2- 172.21.15.164:0/1995103013 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f277c036b40 0x7f277c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.936+0000 7f27917fa640 1 -- 172.21.15.164:0/1995103013 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f289c09cca0 con 0x55e5ec4c1690 2024-09-13T23:05:32.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.936+0000 7f28b411b640 1 --2- 172.21.15.164:0/1995103013 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f277c036b40 0x7f277c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.936+0000 7f28b411b640 1 --2- 172.21.15.164:0/1995103013 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f277c036b40 0x7f277c039000 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55e5ec49df10 tx=0x7f28ac01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.936+0000 7f28b820e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.937+0000 7f28b820e800 1 --2- 172.21.15.164:0/1995103013 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e5ec4d4690 0x55e5ec4d6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.937+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4d72a0 con 0x55e5ec4d4690 2024-09-13T23:05:32.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.937+0000 7f28b391a640 1 --2- 172.21.15.164:0/1995103013 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e5ec4d4690 0x55e5ec4d6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.937+0000 7f28b391a640 1 --2- 172.21.15.164:0/1995103013 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e5ec4d4690 0x55e5ec4d6b50 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.937+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.937+0000 7f28b820e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.937+0000 7f28b820e800 20 realm 2024-09-13T23:05:32.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.937+0000 7f28b820e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.937+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4d76b0 con 0x55e5ec4d4690 2024-09-13T23:05:32.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.937+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.937+0000 7f28b820e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.937+0000 7f28b820e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:32.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.937+0000 7f28b820e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.937+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4d7f80 con 0x55e5ec4d4690 2024-09-13T23:05:32.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.938+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.938+0000 7f28b820e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.938+0000 7f28b820e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.938+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4d8320 con 0x55e5ec4d4690 2024-09-13T23:05:32.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.938+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.938+0000 7f28b820e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:32.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.938+0000 7f28b820e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.938+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4d8b70 con 0x55e5ec4d4690 2024-09-13T23:05:32.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.938+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.938+0000 7f28b820e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:32.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.938+0000 7f28b820e800 20 searching for the correct realm 2024-09-13T23:05:32.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.938+0000 7f28b820e800 1 --2- 172.21.15.164:0/1995103013 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55e5ec4da8e0 0x55e5ec4dccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.938+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x55e5ec4da8e0 2024-09-13T23:05:32.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.938+0000 7f28ab119640 1 --2- 172.21.15.164:0/1995103013 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55e5ec4da8e0 0x55e5ec4dccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.939+0000 7f28ab119640 1 --2- 172.21.15.164:0/1995103013 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55e5ec4da8e0 0x55e5ec4dccd0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.939+0000 7f28ab119640 1 -- 172.21.15.164:0/1995103013 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f289c08bd70 con 0x55e5ec4da8e0 2024-09-13T23:05:32.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.939+0000 7f28ab119640 1 --2- 172.21.15.164:0/1995103013 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f289c05f040 0x7f289c0a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.939+0000 7f28ab119640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x7f289c05f040 2024-09-13T23:05:32.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.939+0000 7f28b411b640 1 --2- 172.21.15.164:0/1995103013 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f289c05f040 0x7f289c0a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.939+0000 7f28b411b640 1 --2- 172.21.15.164:0/1995103013 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f289c05f040 0x7f289c0a4780 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.939+0000 7f28b411b640 1 -- 172.21.15.164:0/1995103013 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28ac01f070 con 0x7f289c05f040 2024-09-13T23:05:32.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.939+0000 7f28b411b640 1 --2- 172.21.15.164:0/1995103013 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f28ac031040 0x7f28ac032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:32.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.939+0000 7f28b411b640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x7f28ac031040 2024-09-13T23:05:32.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.940+0000 7f28b391a640 1 --2- 172.21.15.164:0/1995103013 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f28ac031040 0x7f28ac032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:32.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.940+0000 7f28b391a640 1 --2- 172.21.15.164:0/1995103013 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f28ac031040 0x7f28ac032940 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:32.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.940+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a402d070 con 0x7f28ac031040 2024-09-13T23:05:32.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.940+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x55e5ec4d4690 2024-09-13T23:05:32.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.941+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.941+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x55e5ec4d4690 2024-09-13T23:05:32.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.941+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.941+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x7f28ac031040 2024-09-13T23:05:32.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.941+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a402d070 con 0x7f28ac031040 2024-09-13T23:05:32.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.941+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x7f28ac031040 2024-09-13T23:05:32.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.941+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a402d070 con 0x7f28ac031040 2024-09-13T23:05:32.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.941+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x7f289c05f040 2024-09-13T23:05:32.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.942+0000 7f28b411b640 1 -- 172.21.15.164:0/1995103013 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28ac01f070 con 0x7f289c05f040 2024-09-13T23:05:32.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.942+0000 7f28b411b640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x55e5ec4da8e0 2024-09-13T23:05:32.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.942+0000 7f28ab119640 1 -- 172.21.15.164:0/1995103013 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f289c08bd70 con 0x55e5ec4da8e0 2024-09-13T23:05:32.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.942+0000 7f28ab119640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x55e5ec4d4690 2024-09-13T23:05:32.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.942+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.942+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x7f28ac031040 2024-09-13T23:05:32.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.942+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a402d070 con 0x7f28ac031040 2024-09-13T23:05:32.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.942+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x55e5ec4d4690 2024-09-13T23:05:32.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.943+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.943+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x7f289c05f040 2024-09-13T23:05:32.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.943+0000 7f28b411b640 1 -- 172.21.15.164:0/1995103013 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f28ac01f070 con 0x7f289c05f040 2024-09-13T23:05:32.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.943+0000 7f28b411b640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x55e5ec4da8e0 2024-09-13T23:05:32.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.943+0000 7f28ab119640 1 -- 172.21.15.164:0/1995103013 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f289c08bd70 con 0x55e5ec4da8e0 2024-09-13T23:05:32.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.943+0000 7f28ab119640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x55e5ec4da8e0 2024-09-13T23:05:32.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.943+0000 7f28ab119640 1 -- 172.21.15.164:0/1995103013 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f289c08bd70 con 0x55e5ec4da8e0 2024-09-13T23:05:32.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.943+0000 7f28ab119640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x7f28ac031040 2024-09-13T23:05:32.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.944+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a402d070 con 0x7f28ac031040 2024-09-13T23:05:32.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.944+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x55e5ec4da8e0 2024-09-13T23:05:32.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.944+0000 7f28ab119640 1 -- 172.21.15.164:0/1995103013 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f289c08bd70 con 0x55e5ec4da8e0 2024-09-13T23:05:32.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.944+0000 7f28ab119640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x55e5ec4da8e0 2024-09-13T23:05:32.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.944+0000 7f28ab119640 1 -- 172.21.15.164:0/1995103013 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f289c08bd70 con 0x55e5ec4da8e0 2024-09-13T23:05:32.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.944+0000 7f28ab119640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x55e5ec4d4690 2024-09-13T23:05:32.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.944+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.944+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x55e5ec4d4690 2024-09-13T23:05:32.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.944+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.944+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x7f28ac031040 2024-09-13T23:05:32.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.945+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a402d070 con 0x7f28ac031040 2024-09-13T23:05:32.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.945+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x55e5ec4da8e0 2024-09-13T23:05:32.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.945+0000 7f28ab119640 1 -- 172.21.15.164:0/1995103013 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f289c08bd70 con 0x55e5ec4da8e0 2024-09-13T23:05:32.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.945+0000 7f28ab119640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x7f289c05f040 2024-09-13T23:05:32.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.945+0000 7f28b411b640 1 -- 172.21.15.164:0/1995103013 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28ac01f070 con 0x7f289c05f040 2024-09-13T23:05:32.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.945+0000 7f28b411b640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x55e5ec4d4690 2024-09-13T23:05:32.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.945+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.945+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x7f28ac031040 2024-09-13T23:05:32.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.946+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a402d070 con 0x7f28ac031040 2024-09-13T23:05:32.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.946+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x55e5ec4da8e0 2024-09-13T23:05:32.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.946+0000 7f28ab119640 1 -- 172.21.15.164:0/1995103013 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f289c08bd70 con 0x55e5ec4da8e0 2024-09-13T23:05:32.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.946+0000 7f28ab119640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x7f28ac031040 2024-09-13T23:05:32.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.946+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a402d070 con 0x7f28ac031040 2024-09-13T23:05:32.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.946+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x7f289c05f040 2024-09-13T23:05:32.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.946+0000 7f28b411b640 1 -- 172.21.15.164:0/1995103013 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28ac01f070 con 0x7f289c05f040 2024-09-13T23:05:32.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.946+0000 7f28b411b640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x55e5ec4da8e0 2024-09-13T23:05:32.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.947+0000 7f28ab119640 1 -- 172.21.15.164:0/1995103013 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f289c08bd70 con 0x55e5ec4da8e0 2024-09-13T23:05:32.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.947+0000 7f28ab119640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x7f28ac031040 2024-09-13T23:05:32.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.947+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a402d070 con 0x7f28ac031040 2024-09-13T23:05:32.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.947+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x55e5ec4d4690 2024-09-13T23:05:32.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.947+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.947+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd2e0 con 0x7f289c05f040 2024-09-13T23:05:32.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.947+0000 7f28b411b640 1 -- 172.21.15.164:0/1995103013 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28ac01f070 con 0x7f289c05f040 2024-09-13T23:05:32.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.947+0000 7f28b820e800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:32.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.947+0000 7f28b820e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:32.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.947+0000 7f28b820e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:32.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.947+0000 7f28b820e800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:32.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.947+0000 7f28b820e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:32.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.947+0000 7f28b820e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:32.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.947+0000 7f28b820e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.947+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4d94f0 con 0x55e5ec4d4690 2024-09-13T23:05:32.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.948+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.948+0000 7f28b820e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.948+0000 7f28b820e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.948+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4d9d90 con 0x55e5ec4d4690 2024-09-13T23:05:32.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.948+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.948+0000 7f28b820e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:32.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.948+0000 7f28b820e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.948+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dd760 con 0x55e5ec4d4690 2024-09-13T23:05:32.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.948+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.948+0000 7f28b820e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:32.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.948+0000 7f28b820e800 20 zone default found 2024-09-13T23:05:32.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.948+0000 7f28b820e800 4 Realm: () 2024-09-13T23:05:32.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.948+0000 7f28b820e800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:32.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.948+0000 7f28b820e800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:32.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.948+0000 7f28b820e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:32.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.948+0000 7f28b820e800 20 zonegroup default 2024-09-13T23:05:32.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.948+0000 7f28b820e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.948+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4d99f0 con 0x7f28ac031040 2024-09-13T23:05:32.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.949+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f28a402d070 con 0x7f28ac031040 2024-09-13T23:05:32.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.949+0000 7f28b820e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.949+0000 7f28b820e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.949+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4df640 con 0x55e5ec4da8e0 2024-09-13T23:05:32.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.949+0000 7f28ab119640 1 -- 172.21.15.164:0/1995103013 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f289c08bd70 con 0x55e5ec4da8e0 2024-09-13T23:05:32.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.949+0000 7f28b820e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.949+0000 7f28b820e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.949+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4dfa10 con 0x55e5ec4da8e0 2024-09-13T23:05:32.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.949+0000 7f28ab119640 1 -- 172.21.15.164:0/1995103013 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f289c08bd70 con 0x55e5ec4da8e0 2024-09-13T23:05:32.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.949+0000 7f28b820e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:32.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.949+0000 7f28b820e800 20 started sync module instance, tier type = 2024-09-13T23:05:32.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.949+0000 7f28b820e800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:32.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.949+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4deae0 con 0x7f289c05f040 2024-09-13T23:05:32.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.950+0000 7f28b411b640 1 -- 172.21.15.164:0/1995103013 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28ac040040 con 0x7f289c05f040 2024-09-13T23:05:32.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.950+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94446000402128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4de740 con 0x7f289c05f040 2024-09-13T23:05:32.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.950+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4e0940 con 0x55e5ec4d4690 2024-09-13T23:05:32.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.951+0000 7f28b411b640 1 -- 172.21.15.164:0/1995103013 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94446000402128] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28ac040040 con 0x7f289c05f040 2024-09-13T23:05:32.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.951+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.951+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94446000406128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4e0940 con 0x55e5ec4d4690 2024-09-13T23:05:32.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.951+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4e1340 con 0x55e5ec4da8e0 2024-09-13T23:05:32.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.953+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94446000406128] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.953+0000 7f28ab119640 1 -- 172.21.15.164:0/1995103013 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f289c08bd70 con 0x55e5ec4da8e0 2024-09-13T23:05:32.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.953+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94446000407696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4e16e0 con 0x55e5ec4da8e0 2024-09-13T23:05:32.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.953+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4e20e0 con 0x7f289c05f040 2024-09-13T23:05:32.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.954+0000 7f28ab119640 1 -- 172.21.15.164:0/1995103013 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94446000407696] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f289c08bd70 con 0x55e5ec4da8e0 2024-09-13T23:05:32.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.954+0000 7f28b411b640 1 -- 172.21.15.164:0/1995103013 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28ac040040 con 0x7f289c05f040 2024-09-13T23:05:32.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.954+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94446000410192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4e2500 con 0x7f289c05f040 2024-09-13T23:05:32.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.954+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4e2f20 con 0x55e5ec4d4690 2024-09-13T23:05:32.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.955+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.955+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94446000417296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4e2ee0 con 0x55e5ec4d4690 2024-09-13T23:05:32.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.955+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4e3ed0 con 0x7f28ac031040 2024-09-13T23:05:32.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.955+0000 7f28b411b640 1 -- 172.21.15.164:0/1995103013 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94446000410192] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28ac040040 con 0x7f289c05f040 2024-09-13T23:05:32.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.956+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a402d070 con 0x7f28ac031040 2024-09-13T23:05:32.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.956+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94446000421344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4e3ed0 con 0x7f28ac031040 2024-09-13T23:05:32.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.956+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4e4910 con 0x7f28ac031040 2024-09-13T23:05:32.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.956+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94446000417296] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.957+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94446000421344] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a402d070 con 0x7f28ac031040 2024-09-13T23:05:32.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.957+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a402d070 con 0x7f28ac031040 2024-09-13T23:05:32.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.957+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94446000413680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4e4460 con 0x7f28ac031040 2024-09-13T23:05:32.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.957+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4e4e20 con 0x7f28ac031040 2024-09-13T23:05:32.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.958+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a402d070 con 0x7f28ac031040 2024-09-13T23:05:32.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.958+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94446000425328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4e5240 con 0x7f28ac031040 2024-09-13T23:05:32.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.958+0000 7f28b820e800 20 add_watcher() i=0 2024-09-13T23:05:32.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.958+0000 7f28b820e800 20 add_watcher() i=1 2024-09-13T23:05:32.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.958+0000 7f28b820e800 20 add_watcher() i=2 2024-09-13T23:05:32.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.958+0000 7f28b820e800 20 add_watcher() i=3 2024-09-13T23:05:32.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.958+0000 7f28b820e800 20 add_watcher() i=4 2024-09-13T23:05:32.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.958+0000 7f28b820e800 20 add_watcher() i=5 2024-09-13T23:05:32.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.958+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94446000413680] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a402d070 con 0x7f28ac031040 2024-09-13T23:05:32.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.958+0000 7f28b820e800 20 add_watcher() i=6 2024-09-13T23:05:32.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.959+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94446000425328] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a402d070 con 0x7f28ac031040 2024-09-13T23:05:32.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.959+0000 7f28b820e800 20 add_watcher() i=7 2024-09-13T23:05:32.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.959+0000 7f28b820e800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:32.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.959+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4e3310 con 0x55e5ec4d4690 2024-09-13T23:05:32.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.959+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.959+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94446000419600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4e5760 con 0x55e5ec4d4690 2024-09-13T23:05:32.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.960+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94446000419600] v32'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.960+0000 7f2769fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:32.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.961+0000 7f28b820e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:32.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.961+0000 7f28b820e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:32.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.961+0000 7f28b820e800 5 note: GC not initialized 2024-09-13T23:05:32.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.961+0000 7f2768fe1640 20 reqs_thread_entry: start 2024-09-13T23:05:32.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.961+0000 7f28b820e800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:32.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.961+0000 7f28b820e800 20 Filter name: none 2024-09-13T23:05:32.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.961+0000 7f26e27fc640 20 reqs_thread_entry: start 2024-09-13T23:05:32.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.961+0000 7f28b820e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:05:32.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.961+0000 7f28b820e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:32.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.961+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec51b6a0 con 0x55e5ec4d4690 2024-09-13T23:05:32.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.962+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.962+0000 7f28b820e800 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T23:05:32.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.962+0000 7f28b820e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:05:32.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.962+0000 7f28b820e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:32.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.962+0000 7f28b820e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:32.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.962+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec521ef0 con 0x55e5ec4d4690 2024-09-13T23:05:32.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.963+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v32'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.963+0000 7f28b820e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:32.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.963+0000 7f28b820e800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:32.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.963+0000 7f28b820e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:05:32.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.963+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94446000674992 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec51d570 con 0x55e5ec4d4690 2024-09-13T23:05:32.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.963+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== watch-notify(notify (1) cookie 94446000417296 notify 137438953478 ret 0) ==== 774+0+0 (crc 0 0 0) 0x55e5ec49db50 con 0x55e5ec4d4690 2024-09-13T23:05:32.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.963+0000 7f2792ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 94446000417296 notifier 4379 bl.length()=732 2024-09-13T23:05:32.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.963+0000 7f2792ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:32.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.963+0000 7f2792ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:32.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.963+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(64 notify.4 [notify cookie 94446000674992 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.963+0000 7f2792ffd640 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2778003ea0 con 0x55e5ec4d4690 2024-09-13T23:05:32.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.963+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.963+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== watch-notify(notify_complete (2) cookie 94446000674992 notify 137438953478 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e5ec49d630 con 0x55e5ec4d4690 2024-09-13T23:05:32.986 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:05:31.300851Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:05:31.300826Z","tags":[],"group_ids":[]} 2024-09-13T23:05:32.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.964+0000 7f2769fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:32.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.964+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94446000419600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec51d0c0 con 0x55e5ec4d4690 2024-09-13T23:05:32.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.965+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94446000419600] v32'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.965+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94446000402128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec5193f0 con 0x7f289c05f040 2024-09-13T23:05:32.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.966+0000 7f28b411b640 1 -- 172.21.15.164:0/1995103013 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94446000402128] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28ac040040 con 0x7f289c05f040 2024-09-13T23:05:32.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.966+0000 7f28b820e800 20 remove_watcher() i=0 2024-09-13T23:05:32.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.966+0000 7f28b820e800 2 removed watcher, disabling cache 2024-09-13T23:05:32.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.966+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94446000406128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec5193f0 con 0x55e5ec4d4690 2024-09-13T23:05:32.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.967+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94446000406128] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.967+0000 7f28b820e800 20 remove_watcher() i=1 2024-09-13T23:05:32.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.967+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94446000407696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec5193f0 con 0x55e5ec4da8e0 2024-09-13T23:05:32.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.968+0000 7f28ab119640 1 -- 172.21.15.164:0/1995103013 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94446000407696] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f289c08bd70 con 0x55e5ec4da8e0 2024-09-13T23:05:32.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.968+0000 7f28b820e800 20 remove_watcher() i=2 2024-09-13T23:05:32.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.968+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94446000410192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4e0490 con 0x7f289c05f040 2024-09-13T23:05:32.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.969+0000 7f28b411b640 1 -- 172.21.15.164:0/1995103013 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94446000410192] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28ac040040 con 0x7f289c05f040 2024-09-13T23:05:32.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.969+0000 7f28b820e800 20 remove_watcher() i=3 2024-09-13T23:05:32.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.969+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94446000417296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4e0490 con 0x55e5ec4d4690 2024-09-13T23:05:32.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.971+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94446000417296] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a402d070 con 0x55e5ec4d4690 2024-09-13T23:05:32.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.971+0000 7f28b820e800 20 remove_watcher() i=4 2024-09-13T23:05:32.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.971+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94446000421344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4e0490 con 0x7f28ac031040 2024-09-13T23:05:32.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.971+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94446000421344] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a402d070 con 0x7f28ac031040 2024-09-13T23:05:32.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.972+0000 7f28b820e800 20 remove_watcher() i=5 2024-09-13T23:05:32.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.972+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94446000413680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4e39e0 con 0x7f28ac031040 2024-09-13T23:05:32.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.972+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94446000413680] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a402d070 con 0x7f28ac031040 2024-09-13T23:05:32.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.972+0000 7f28b820e800 20 remove_watcher() i=6 2024-09-13T23:05:32.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.972+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94446000425328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e5ec4e0490 con 0x7f28ac031040 2024-09-13T23:05:32.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.973+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94446000425328] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a402d070 con 0x7f28ac031040 2024-09-13T23:05:32.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.973+0000 7f28b820e800 20 remove_watcher() i=7 2024-09-13T23:05:32.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.973+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f28ac031040 msgr2=0x7f28ac032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.973+0000 7f28b820e800 1 --2- 172.21.15.164:0/1995103013 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f28ac031040 0x7f28ac032940 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.973+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e5ec4d4690 msgr2=0x55e5ec4d6b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.973+0000 7f28b820e800 1 --2- 172.21.15.164:0/1995103013 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e5ec4d4690 0x55e5ec4d6b50 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.973+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f289c05f040 msgr2=0x7f289c0a4780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.973+0000 7f28b820e800 1 --2- 172.21.15.164:0/1995103013 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f289c05f040 0x7f289c0a4780 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.974+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55e5ec4da8e0 msgr2=0x55e5ec4dccd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.974+0000 7f28b820e800 1 --2- 172.21.15.164:0/1995103013 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55e5ec4da8e0 0x55e5ec4dccd0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.974+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f277c036b40 msgr2=0x7f277c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.974+0000 7f28b820e800 1 --2- 172.21.15.164:0/1995103013 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f277c036b40 0x7f277c039000 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55e5ec49df10 tx=0x7f28ac01f000 comp rx=0 tx=0).stop 2024-09-13T23:05:32.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.974+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec4c1690 msgr2=0x55e5ec4c8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.974+0000 7f28b820e800 1 --2- 172.21.15.164:0/1995103013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec4c1690 0x55e5ec4c8b50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f289c053db0 tx=0x7f289c090f00 comp rx=0 tx=0).stop 2024-09-13T23:05:32.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.974+0000 7f28b391a640 1 -- 172.21.15.164:0/1995103013 reap_dead start 2024-09-13T23:05:32.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.974+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 shutdown_connections 2024-09-13T23:05:32.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.974+0000 7f28b820e800 1 --2- 172.21.15.164:0/1995103013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec4c1690 0x55e5ec4c8b50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.974+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 >> 172.21.15.164:0/1995103013 conn(0x55e5ec4bd9f0 msgr2=0x55e5ec4bbac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.974+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 shutdown_connections 2024-09-13T23:05:32.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.974+0000 7f28b820e800 1 -- 172.21.15.164:0/1995103013 wait complete. 2024-09-13T23:05:32.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.974+0000 7f28b820e800 1 -- 172.21.15.164:0/1539026518 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f278c036b90 msgr2=0x7f278c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.974+0000 7f28b820e800 1 --2- 172.21.15.164:0/1539026518 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f278c036b90 0x7f278c039050 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x55e5ec4a5160 tx=0x7f28ac005840 comp rx=0 tx=0).stop 2024-09-13T23:05:32.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.974+0000 7f28b820e800 1 -- 172.21.15.164:0/1539026518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec4b4af0 msgr2=0x55e5ec4b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.974+0000 7f28b820e800 1 --2- 172.21.15.164:0/1539026518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec4b4af0 0x55e5ec4b4f10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f289c025bf0 tx=0x7f289c002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.974+0000 7f28b820e800 1 -- 172.21.15.164:0/1539026518 shutdown_connections 2024-09-13T23:05:32.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.974+0000 7f28b820e800 1 --2- 172.21.15.164:0/1539026518 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f278c036b90 0x7f278c039050 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.974+0000 7f28b820e800 1 --2- 172.21.15.164:0/1539026518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec4b4af0 0x55e5ec4b4f10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.974+0000 7f28b820e800 1 -- 172.21.15.164:0/1539026518 >> 172.21.15.164:0/1539026518 conn(0x55e5ec4a9a80 msgr2=0x55e5ec4ac600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.974+0000 7f28b820e800 1 -- 172.21.15.164:0/1539026518 shutdown_connections 2024-09-13T23:05:32.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.974+0000 7f28b820e800 1 -- 172.21.15.164:0/1539026518 wait complete. 2024-09-13T23:05:32.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.974+0000 7f28b820e800 1 -- 172.21.15.164:0/3071454352 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e5ec3a9920 msgr2=0x55e5ec4a4160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.974+0000 7f28b820e800 1 --2- 172.21.15.164:0/3071454352 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e5ec3a9920 0x55e5ec4a4160 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.975+0000 7f28b820e800 1 -- 172.21.15.164:0/3071454352 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f279c036be0 msgr2=0x7f279c0390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.975+0000 7f28b820e800 1 --2- 172.21.15.164:0/3071454352 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f279c036be0 0x7f279c0390a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f289c057000 tx=0x7f289c052000 comp rx=0 tx=0).stop 2024-09-13T23:05:32.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.975+0000 7f28b820e800 1 -- 172.21.15.164:0/3071454352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec3a54e0 msgr2=0x55e5ec49d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:32.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.975+0000 7f28b820e800 1 --2- 172.21.15.164:0/3071454352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec3a54e0 0x55e5ec49d0f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55e5ec3194a0 tx=0x7f28a4000ed0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.975+0000 7f28b820e800 1 -- 172.21.15.164:0/3071454352 shutdown_connections 2024-09-13T23:05:32.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.975+0000 7f28b820e800 1 --2- 172.21.15.164:0/3071454352 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e5ec3a9920 0x55e5ec4a4160 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.975+0000 7f28b820e800 1 --2- 172.21.15.164:0/3071454352 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f279c036be0 0x7f279c0390a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.975+0000 7f28b820e800 1 --2- 172.21.15.164:0/3071454352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e5ec3a54e0 0x55e5ec49d0f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:32.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.975+0000 7f28b820e800 1 -- 172.21.15.164:0/3071454352 >> 172.21.15.164:0/3071454352 conn(0x55e5ec3a0e10 msgr2=0x55e5ec48e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:32.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.975+0000 7f28b820e800 1 -- 172.21.15.164:0/3071454352 shutdown_connections 2024-09-13T23:05:32.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:32.975+0000 7f28b820e800 1 -- 172.21.15.164:0/3071454352 wait complete. 2024-09-13T23:05:32.997 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:05:31.300851Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:05:31.300826Z', 'tags': [], 'group_ids': []} 2024-09-13T23:05:32.997 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T23:05:32.998 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T23:05:32.998 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T23:05:33.042 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:33.042 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:33.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.043+0000 7f6476213800 1 Processor -- start 2024-09-13T23:05:33.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.043+0000 7f6476213800 1 -- start start 2024-09-13T23:05:33.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.043+0000 7f6476213800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55bc9f775610 0x55bc9f804270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.043+0000 7f6476213800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bc9f6c0b30 con 0x55bc9f8047b0 2024-09-13T23:05:33.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.043+0000 7f6476213800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55bc9f6a2360 con 0x55bc9f775610 2024-09-13T23:05:33.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.043+0000 7f647186e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55bc9f775610 0x55bc9f804270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.043+0000 7f646bfff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55bc9f8047b0 0x55bc9f806ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40804/0 (socket says 172.21.15.164:40804) 2024-09-13T23:05:33.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.043+0000 7f647186e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55bc9f775610 0x55bc9f804270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56856/0 (socket says 172.21.15.164:56856) 2024-09-13T23:05:33.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.043+0000 7f646bfff640 1 -- 172.21.15.164:0/3873456643 learned_addr learned my addr 172.21.15.164:0/3873456643 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:33.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.043+0000 7f647186e640 1 -- 172.21.15.164:0/3873456643 >> v1:172.21.15.17:6789/0 conn(0x55bc9f8047b0 legacy=0x55bc9f806ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.043+0000 7f647186e640 1 -- 172.21.15.164:0/3873456643 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc9f6c8e00 con 0x55bc9f775610 2024-09-13T23:05:33.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.043+0000 7f647106d640 1 -- 172.21.15.164:0/3873456643 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1090813394 0 0) 0x55bc9f6c0b30 con 0x55bc9f8047b0 2024-09-13T23:05:33.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.045+0000 7f647186e640 1 --2- 172.21.15.164:0/3873456643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f775610 0x55bc9f804270 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f646400a470 tx=0x7f6464045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=603999204a034e32 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.045+0000 7f647106d640 1 -- 172.21.15.164:0/3873456643 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6464053570 con 0x55bc9f775610 2024-09-13T23:05:33.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.045+0000 7f647106d640 1 -- 172.21.15.164:0/3873456643 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6464058070 con 0x55bc9f775610 2024-09-13T23:05:33.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.045+0000 7f647106d640 1 -- 172.21.15.164:0/3873456643 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6464053880 con 0x55bc9f775610 2024-09-13T23:05:33.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.046+0000 7f6476213800 1 -- 172.21.15.164:0/3873456643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f775610 msgr2=0x55bc9f804270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.046+0000 7f6476213800 1 --2- 172.21.15.164:0/3873456643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f775610 0x55bc9f804270 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f646400a470 tx=0x7f6464045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:33.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.046+0000 7f6476213800 1 -- 172.21.15.164:0/3873456643 shutdown_connections 2024-09-13T23:05:33.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.046+0000 7f6476213800 1 --2- 172.21.15.164:0/3873456643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f775610 0x55bc9f804270 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.046+0000 7f6476213800 1 -- 172.21.15.164:0/3873456643 >> 172.21.15.164:0/3873456643 conn(0x55bc9f7fbde0 msgr2=0x55bc9f7fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.046+0000 7f6476213800 1 -- 172.21.15.164:0/3873456643 shutdown_connections 2024-09-13T23:05:33.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.046+0000 7f6476213800 1 -- 172.21.15.164:0/3873456643 wait complete. 2024-09-13T23:05:33.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.060+0000 7f6476213800 1 Processor -- start 2024-09-13T23:05:33.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.060+0000 7f6476213800 1 -- start start 2024-09-13T23:05:33.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.060+0000 7f6476213800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f775610 0x55bc9f8f06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.060+0000 7f6476213800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55bc9f74d330 con 0x55bc9f775610 2024-09-13T23:05:33.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.060+0000 7f647186e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f775610 0x55bc9f8f06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.061+0000 7f647186e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f775610 0x55bc9f8f06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56870/0 (socket says 172.21.15.164:56870) 2024-09-13T23:05:33.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.061+0000 7f647186e640 1 -- 172.21.15.164:0/1450073159 learned_addr learned my addr 172.21.15.164:0/1450073159 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.061+0000 7f647186e640 1 -- 172.21.15.164:0/1450073159 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc9f69abc0 con 0x55bc9f775610 2024-09-13T23:05:33.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.061+0000 7f647186e640 1 --2- 172.21.15.164:0/1450073159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f775610 0x55bc9f8f06b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6464005870 tx=0x7f6464051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0bb569cd37cd764 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.061+0000 7f635fe07640 1 -- 172.21.15.164:0/1450073159 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f646405c580 con 0x55bc9f775610 2024-09-13T23:05:33.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.061+0000 7f635fe07640 1 -- 172.21.15.164:0/1450073159 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6464063030 con 0x55bc9f775610 2024-09-13T23:05:33.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.061+0000 7f635fe07640 1 -- 172.21.15.164:0/1450073159 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f646405c850 con 0x55bc9f775610 2024-09-13T23:05:33.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.062+0000 7f6476213800 1 -- 172.21.15.164:0/1450073159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f775610 msgr2=0x55bc9f8f06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.062+0000 7f6476213800 1 --2- 172.21.15.164:0/1450073159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f775610 0x55bc9f8f06b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6464005870 tx=0x7f6464051000 comp rx=0 tx=0).stop 2024-09-13T23:05:33.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.062+0000 7f6476213800 1 -- 172.21.15.164:0/1450073159 shutdown_connections 2024-09-13T23:05:33.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.062+0000 7f6476213800 1 --2- 172.21.15.164:0/1450073159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f775610 0x55bc9f8f06b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.062+0000 7f6476213800 1 -- 172.21.15.164:0/1450073159 >> 172.21.15.164:0/1450073159 conn(0x55bc9f7fbde0 msgr2=0x55bc9f8ec070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.062+0000 7f6476213800 1 -- 172.21.15.164:0/1450073159 shutdown_connections 2024-09-13T23:05:33.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.062+0000 7f6476213800 1 -- 172.21.15.164:0/1450073159 wait complete. 2024-09-13T23:05:33.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.062+0000 7f6476213800 1 Processor -- start 2024-09-13T23:05:33.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.063+0000 7f6476213800 1 -- start start 2024-09-13T23:05:33.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.063+0000 7f6476213800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f775610 0x55bc9f801ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.063+0000 7f6476213800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55bc9f808680 con 0x55bc9f775610 2024-09-13T23:05:33.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.063+0000 7f647186e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f775610 0x55bc9f801ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.063+0000 7f647186e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f775610 0x55bc9f801ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56874/0 (socket says 172.21.15.164:56874) 2024-09-13T23:05:33.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.063+0000 7f647186e640 1 -- 172.21.15.164:0/2374102447 learned_addr learned my addr 172.21.15.164:0/2374102447 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.063+0000 7f647186e640 1 -- 172.21.15.164:0/2374102447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc9f6aefe0 con 0x55bc9f775610 2024-09-13T23:05:33.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.063+0000 7f647186e640 1 --2- 172.21.15.164:0/2374102447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f775610 0x55bc9f801ba0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6464025c20 tx=0x7f6464002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.064+0000 7f635e604640 1 -- 172.21.15.164:0/2374102447 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f646405cb70 con 0x55bc9f775610 2024-09-13T23:05:33.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.064+0000 7f635e604640 1 -- 172.21.15.164:0/2374102447 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f646405cd10 con 0x55bc9f775610 2024-09-13T23:05:33.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.064+0000 7f635e604640 1 -- 172.21.15.164:0/2374102447 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6464053440 con 0x55bc9f775610 2024-09-13T23:05:33.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.064+0000 7f6476213800 1 -- 172.21.15.164:0/2374102447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bc9f800290 con 0x55bc9f775610 2024-09-13T23:05:33.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.064+0000 7f6476213800 1 -- 172.21.15.164:0/2374102447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc9f800810 con 0x55bc9f775610 2024-09-13T23:05:33.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.065+0000 7f635e604640 1 -- 172.21.15.164:0/2374102447 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f64640535e0 con 0x55bc9f775610 2024-09-13T23:05:33.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.065+0000 7f635e604640 1 --2- 172.21.15.164:0/2374102447 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6358036be0 0x7f63580390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.065+0000 7f635e604640 1 -- 172.21.15.164:0/2374102447 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6464070070 con 0x55bc9f775610 2024-09-13T23:05:33.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.065+0000 7f646bfff640 1 --2- 172.21.15.164:0/2374102447 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6358036be0 0x7f63580390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.065+0000 7f6476213800 1 --2- 172.21.15.164:0/2374102447 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55bc9f8047b0 0x55bc9f901310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.065+0000 7f6476213800 1 -- 172.21.15.164:0/2374102447 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f901850 con 0x55bc9f8047b0 2024-09-13T23:05:33.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.065+0000 7f647206f640 1 --2- 172.21.15.164:0/2374102447 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55bc9f8047b0 0x55bc9f901310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.065+0000 7f646bfff640 1 --2- 172.21.15.164:0/2374102447 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6358036be0 0x7f63580390a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f645c000c00 tx=0x7f645c0013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.065+0000 7f647206f640 1 --2- 172.21.15.164:0/2374102447 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55bc9f8047b0 0x55bc9f901310 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.066+0000 7f647206f640 1 -- 172.21.15.164:0/2374102447 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f646c00a4a0 con 0x55bc9f8047b0 2024-09-13T23:05:33.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.066+0000 7f6476213800 1 -- 172.21.15.164:0/2374102447 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f9020a0 con 0x55bc9f8047b0 2024-09-13T23:05:33.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.066+0000 7f647206f640 1 -- 172.21.15.164:0/2374102447 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f646c00a4a0 con 0x55bc9f8047b0 2024-09-13T23:05:33.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.066+0000 7f6476213800 1 -- 172.21.15.164:0/2374102447 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f903490 con 0x55bc9f8047b0 2024-09-13T23:05:33.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.066+0000 7f647206f640 1 -- 172.21.15.164:0/2374102447 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f646c00a4a0 con 0x55bc9f8047b0 2024-09-13T23:05:33.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.066+0000 7f6476213800 1 -- 172.21.15.164:0/2374102447 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f9028f0 con 0x55bc9f8047b0 2024-09-13T23:05:33.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.066+0000 7f647206f640 1 -- 172.21.15.164:0/2374102447 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f646c00a4a0 con 0x55bc9f8047b0 2024-09-13T23:05:33.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.067+0000 7f6476213800 1 -- 172.21.15.164:0/2374102447 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f902d40 con 0x55bc9f8047b0 2024-09-13T23:05:33.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.067+0000 7f647206f640 1 -- 172.21.15.164:0/2374102447 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f646c00a4a0 con 0x55bc9f8047b0 2024-09-13T23:05:33.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.067+0000 7f6476213800 1 Processor -- start 2024-09-13T23:05:33.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.067+0000 7f6476213800 1 -- start start 2024-09-13T23:05:33.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.067+0000 7f6476213800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f911d40 0x55bc9f912160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.067+0000 7f6476213800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55bc9f8020e0 con 0x55bc9f911d40 2024-09-13T23:05:33.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.067+0000 7f646bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f911d40 0x55bc9f912160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.067+0000 7f646bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f911d40 0x55bc9f912160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56886/0 (socket says 172.21.15.164:56886) 2024-09-13T23:05:33.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.067+0000 7f646bfff640 1 -- 172.21.15.164:0/118910386 learned_addr learned my addr 172.21.15.164:0/118910386 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.068+0000 7f646bfff640 1 -- 172.21.15.164:0/118910386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc9f9126a0 con 0x55bc9f911d40 2024-09-13T23:05:33.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.068+0000 7f646bfff640 1 --2- 172.21.15.164:0/118910386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f911d40 0x55bc9f912160 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f645c00e610 tx=0x7f645c00ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.068+0000 7f63577fe640 1 -- 172.21.15.164:0/118910386 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f645c022070 con 0x55bc9f911d40 2024-09-13T23:05:33.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.068+0000 7f63577fe640 1 -- 172.21.15.164:0/118910386 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f645c009050 con 0x55bc9f911d40 2024-09-13T23:05:33.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.068+0000 7f6476213800 1 -- 172.21.15.164:0/118910386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bc9f912930 con 0x55bc9f911d40 2024-09-13T23:05:33.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.068+0000 7f63577fe640 1 -- 172.21.15.164:0/118910386 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f645c00d500 con 0x55bc9f911d40 2024-09-13T23:05:33.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.068+0000 7f6476213800 1 -- 172.21.15.164:0/118910386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc9f915610 con 0x55bc9f911d40 2024-09-13T23:05:33.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.069+0000 7f63577fe640 1 -- 172.21.15.164:0/118910386 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f645c025070 con 0x55bc9f911d40 2024-09-13T23:05:33.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.069+0000 7f63577fe640 1 --2- 172.21.15.164:0/118910386 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f634c036b40 0x7f634c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.069+0000 7f63577fe640 1 -- 172.21.15.164:0/118910386 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f645c04ded0 con 0x55bc9f911d40 2024-09-13T23:05:33.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.069+0000 7f647206f640 1 --2- 172.21.15.164:0/118910386 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f634c036b40 0x7f634c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.069+0000 7f6476213800 1 Processor -- start 2024-09-13T23:05:33.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.070+0000 7f647206f640 1 --2- 172.21.15.164:0/118910386 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f634c036b40 0x7f634c039000 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x55bc9f901f20 tx=0x7f646c005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.070+0000 7f6476213800 1 -- start start 2024-09-13T23:05:33.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.070+0000 7f6476213800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f91eab0 0x55bc9f91eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.070+0000 7f6476213800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55bc9f69c580 con 0x55bc9f91eab0 2024-09-13T23:05:33.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.070+0000 7f646bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f91eab0 0x55bc9f91eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.070+0000 7f646bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f91eab0 0x55bc9f91eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56900/0 (socket says 172.21.15.164:56900) 2024-09-13T23:05:33.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.070+0000 7f646bfff640 1 -- 172.21.15.164:0/3801605361 learned_addr learned my addr 172.21.15.164:0/3801605361 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.070+0000 7f646bfff640 1 -- 172.21.15.164:0/3801605361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc9f91f480 con 0x55bc9f91eab0 2024-09-13T23:05:33.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.070+0000 7f646bfff640 1 --2- 172.21.15.164:0/3801605361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f91eab0 0x55bc9f91eeb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f645c04c230 tx=0x7f645c0243f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da51be6e701707df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.070+0000 7f63557fa640 1 -- 172.21.15.164:0/3801605361 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f645c045070 con 0x55bc9f91eab0 2024-09-13T23:05:33.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.071+0000 7f63557fa640 1 -- 172.21.15.164:0/3801605361 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f645c045210 con 0x55bc9f91eab0 2024-09-13T23:05:33.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.071+0000 7f63557fa640 1 -- 172.21.15.164:0/3801605361 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f645c0453e0 con 0x55bc9f91eab0 2024-09-13T23:05:33.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.071+0000 7f6476213800 1 -- 172.21.15.164:0/3801605361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f91eab0 msgr2=0x55bc9f91eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.071+0000 7f6476213800 1 --2- 172.21.15.164:0/3801605361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f91eab0 0x55bc9f91eeb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f645c04c230 tx=0x7f645c0243f0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.071+0000 7f6476213800 1 -- 172.21.15.164:0/3801605361 shutdown_connections 2024-09-13T23:05:33.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.071+0000 7f6476213800 1 --2- 172.21.15.164:0/3801605361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f91eab0 0x55bc9f91eeb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.071+0000 7f6476213800 1 -- 172.21.15.164:0/3801605361 >> 172.21.15.164:0/3801605361 conn(0x55bc9f91ae10 msgr2=0x55bc9f918f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.071+0000 7f6476213800 1 -- 172.21.15.164:0/3801605361 shutdown_connections 2024-09-13T23:05:33.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.071+0000 7f6476213800 1 -- 172.21.15.164:0/3801605361 wait complete. 2024-09-13T23:05:33.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.071+0000 7f6476213800 1 Processor -- start 2024-09-13T23:05:33.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.071+0000 7f6476213800 1 -- start start 2024-09-13T23:05:33.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.071+0000 7f6476213800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f91eab0 0x55bc9f925e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.072+0000 7f6476213800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55bc9f91f970 con 0x55bc9f91eab0 2024-09-13T23:05:33.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.072+0000 7f646bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f91eab0 0x55bc9f925e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.072+0000 7f646bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f91eab0 0x55bc9f925e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56916/0 (socket says 172.21.15.164:56916) 2024-09-13T23:05:33.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.072+0000 7f646bfff640 1 -- 172.21.15.164:0/312587647 learned_addr learned my addr 172.21.15.164:0/312587647 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.072+0000 7f646bfff640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc9f9263a0 con 0x55bc9f91eab0 2024-09-13T23:05:33.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.072+0000 7f646bfff640 1 --2- 172.21.15.164:0/312587647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f91eab0 0x55bc9f925e60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f645c0266c0 tx=0x7f645c04c190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.072+0000 7f63437fe640 1 -- 172.21.15.164:0/312587647 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f645c045030 con 0x55bc9f91eab0 2024-09-13T23:05:33.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.072+0000 7f63437fe640 1 -- 172.21.15.164:0/312587647 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f645c025570 con 0x55bc9f91eab0 2024-09-13T23:05:33.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.072+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bc9f926630 con 0x55bc9f91eab0 2024-09-13T23:05:33.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.072+0000 7f63437fe640 1 -- 172.21.15.164:0/312587647 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f645c024680 con 0x55bc9f91eab0 2024-09-13T23:05:33.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.072+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc9f9292e0 con 0x55bc9f91eab0 2024-09-13T23:05:33.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.073+0000 7f63437fe640 1 -- 172.21.15.164:0/312587647 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f645c03b060 con 0x55bc9f91eab0 2024-09-13T23:05:33.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.073+0000 7f63437fe640 1 --2- 172.21.15.164:0/312587647 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f633c036b90 0x7f633c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.073+0000 7f63437fe640 1 -- 172.21.15.164:0/312587647 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f645c047260 con 0x55bc9f91eab0 2024-09-13T23:05:33.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.073+0000 7f647206f640 1 --2- 172.21.15.164:0/312587647 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f633c036b90 0x7f633c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.074+0000 7f6476213800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.074+0000 7f6476213800 1 --2- 172.21.15.164:0/312587647 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55bc9f931950 0x55bc9f933e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.074+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f934560 con 0x55bc9f931950 2024-09-13T23:05:33.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.074+0000 7f647206f640 1 --2- 172.21.15.164:0/312587647 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f633c036b90 0x7f633c039050 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55bc9f800c60 tx=0x7f646c01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.074+0000 7f647186e640 1 --2- 172.21.15.164:0/312587647 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55bc9f931950 0x55bc9f933e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.074+0000 7f647186e640 1 --2- 172.21.15.164:0/312587647 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55bc9f931950 0x55bc9f933e10 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.074+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f646407a020 con 0x55bc9f931950 2024-09-13T23:05:33.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.074+0000 7f6476213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.074+0000 7f6476213800 20 realm 2024-09-13T23:05:33.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.074+0000 7f6476213800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.074+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f934970 con 0x55bc9f931950 2024-09-13T23:05:33.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.075+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f646407a020 con 0x55bc9f931950 2024-09-13T23:05:33.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.075+0000 7f6476213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.075+0000 7f6476213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:33.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.075+0000 7f6476213800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.075+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f935240 con 0x55bc9f931950 2024-09-13T23:05:33.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.075+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f646407a020 con 0x55bc9f931950 2024-09-13T23:05:33.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.075+0000 7f6476213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.075+0000 7f6476213800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.075+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f9355e0 con 0x55bc9f931950 2024-09-13T23:05:33.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.075+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f646407a020 con 0x55bc9f931950 2024-09-13T23:05:33.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.075+0000 7f6476213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:33.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.075+0000 7f6476213800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.075+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f935a40 con 0x55bc9f931950 2024-09-13T23:05:33.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.076+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f646407a020 con 0x55bc9f931950 2024-09-13T23:05:33.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.076+0000 7f6476213800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:33.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.076+0000 7f6476213800 20 searching for the correct realm 2024-09-13T23:05:33.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.076+0000 7f6476213800 1 --2- 172.21.15.164:0/312587647 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55bc9f937a90 0x55bc9f939e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.076+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x55bc9f937a90 2024-09-13T23:05:33.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.076+0000 7f646bfff640 1 --2- 172.21.15.164:0/312587647 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55bc9f937a90 0x55bc9f939e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.076+0000 7f646bfff640 1 --2- 172.21.15.164:0/312587647 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55bc9f937a90 0x55bc9f939e80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.076+0000 7f646bfff640 1 -- 172.21.15.164:0/312587647 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645c024030 con 0x55bc9f937a90 2024-09-13T23:05:33.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.076+0000 7f646bfff640 1 --2- 172.21.15.164:0/312587647 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f645c027060 0x7f645c0119d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.076+0000 7f646bfff640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x7f645c027060 2024-09-13T23:05:33.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.076+0000 7f647206f640 1 --2- 172.21.15.164:0/312587647 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f645c027060 0x7f645c0119d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.077+0000 7f647206f640 1 --2- 172.21.15.164:0/312587647 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f645c027060 0x7f645c0119d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.077+0000 7f647206f640 1 -- 172.21.15.164:0/312587647 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646c01f070 con 0x7f645c027060 2024-09-13T23:05:33.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.077+0000 7f647206f640 1 --2- 172.21.15.164:0/312587647 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f646c031040 0x7f646c032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.077+0000 7f647206f640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x7f646c031040 2024-09-13T23:05:33.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.077+0000 7f647186e640 1 --2- 172.21.15.164:0/312587647 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f646c031040 0x7f646c032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.077+0000 7f647186e640 1 --2- 172.21.15.164:0/312587647 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f646c031040 0x7f646c032430 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.078+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646407a020 con 0x7f646c031040 2024-09-13T23:05:33.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.078+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x55bc9f931950 2024-09-13T23:05:33.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.078+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f646407a020 con 0x55bc9f931950 2024-09-13T23:05:33.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.078+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x55bc9f931950 2024-09-13T23:05:33.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.078+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646407a020 con 0x55bc9f931950 2024-09-13T23:05:33.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.078+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x7f646c031040 2024-09-13T23:05:33.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.078+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646407a020 con 0x7f646c031040 2024-09-13T23:05:33.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.078+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x7f646c031040 2024-09-13T23:05:33.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.079+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646407a020 con 0x7f646c031040 2024-09-13T23:05:33.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.079+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x7f645c027060 2024-09-13T23:05:33.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.079+0000 7f647206f640 1 -- 172.21.15.164:0/312587647 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646c01f070 con 0x7f645c027060 2024-09-13T23:05:33.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.079+0000 7f647206f640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x55bc9f937a90 2024-09-13T23:05:33.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.079+0000 7f646bfff640 1 -- 172.21.15.164:0/312587647 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645c024030 con 0x55bc9f937a90 2024-09-13T23:05:33.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.079+0000 7f646bfff640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x55bc9f931950 2024-09-13T23:05:33.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.079+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646407a020 con 0x55bc9f931950 2024-09-13T23:05:33.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.079+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x7f646c031040 2024-09-13T23:05:33.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.080+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646407a020 con 0x7f646c031040 2024-09-13T23:05:33.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.080+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x55bc9f931950 2024-09-13T23:05:33.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.080+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646407a020 con 0x55bc9f931950 2024-09-13T23:05:33.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.080+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x7f645c027060 2024-09-13T23:05:33.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.080+0000 7f647206f640 1 -- 172.21.15.164:0/312587647 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f646c01f070 con 0x7f645c027060 2024-09-13T23:05:33.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.080+0000 7f647206f640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x55bc9f937a90 2024-09-13T23:05:33.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.080+0000 7f646bfff640 1 -- 172.21.15.164:0/312587647 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645c024030 con 0x55bc9f937a90 2024-09-13T23:05:33.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.080+0000 7f646bfff640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x55bc9f937a90 2024-09-13T23:05:33.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.081+0000 7f646bfff640 1 -- 172.21.15.164:0/312587647 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645c024030 con 0x55bc9f937a90 2024-09-13T23:05:33.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.081+0000 7f646bfff640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x7f646c031040 2024-09-13T23:05:33.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.081+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646407a020 con 0x7f646c031040 2024-09-13T23:05:33.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.081+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x55bc9f937a90 2024-09-13T23:05:33.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.081+0000 7f646bfff640 1 -- 172.21.15.164:0/312587647 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645c024030 con 0x55bc9f937a90 2024-09-13T23:05:33.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.081+0000 7f646bfff640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x55bc9f937a90 2024-09-13T23:05:33.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.081+0000 7f646bfff640 1 -- 172.21.15.164:0/312587647 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645c024030 con 0x55bc9f937a90 2024-09-13T23:05:33.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.081+0000 7f646bfff640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x55bc9f931950 2024-09-13T23:05:33.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.082+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646407a020 con 0x55bc9f931950 2024-09-13T23:05:33.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.082+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x55bc9f931950 2024-09-13T23:05:33.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.082+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f646407a020 con 0x55bc9f931950 2024-09-13T23:05:33.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.082+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x7f646c031040 2024-09-13T23:05:33.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.082+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646407a020 con 0x7f646c031040 2024-09-13T23:05:33.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.082+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x55bc9f937a90 2024-09-13T23:05:33.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.082+0000 7f646bfff640 1 -- 172.21.15.164:0/312587647 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645c024030 con 0x55bc9f937a90 2024-09-13T23:05:33.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.082+0000 7f646bfff640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x7f645c027060 2024-09-13T23:05:33.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.082+0000 7f647206f640 1 -- 172.21.15.164:0/312587647 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646c01f070 con 0x7f645c027060 2024-09-13T23:05:33.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.083+0000 7f647206f640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x55bc9f931950 2024-09-13T23:05:33.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.083+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f646407a020 con 0x55bc9f931950 2024-09-13T23:05:33.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.083+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x7f646c031040 2024-09-13T23:05:33.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.083+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646407a020 con 0x7f646c031040 2024-09-13T23:05:33.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.083+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x55bc9f937a90 2024-09-13T23:05:33.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.083+0000 7f646bfff640 1 -- 172.21.15.164:0/312587647 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645c024030 con 0x55bc9f937a90 2024-09-13T23:05:33.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.083+0000 7f646bfff640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x7f646c031040 2024-09-13T23:05:33.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.084+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646407a020 con 0x7f646c031040 2024-09-13T23:05:33.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.084+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x7f645c027060 2024-09-13T23:05:33.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.084+0000 7f647206f640 1 -- 172.21.15.164:0/312587647 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646c01f070 con 0x7f645c027060 2024-09-13T23:05:33.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.084+0000 7f647206f640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x55bc9f937a90 2024-09-13T23:05:33.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.084+0000 7f646bfff640 1 -- 172.21.15.164:0/312587647 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f645c024030 con 0x55bc9f937a90 2024-09-13T23:05:33.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.084+0000 7f646bfff640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x7f646c031040 2024-09-13T23:05:33.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.084+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646407a020 con 0x7f646c031040 2024-09-13T23:05:33.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.084+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x55bc9f931950 2024-09-13T23:05:33.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.085+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f646407a020 con 0x55bc9f931950 2024-09-13T23:05:33.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.085+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93a530 con 0x7f645c027060 2024-09-13T23:05:33.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.085+0000 7f647206f640 1 -- 172.21.15.164:0/312587647 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f646c01f070 con 0x7f645c027060 2024-09-13T23:05:33.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.085+0000 7f6476213800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:33.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.085+0000 7f6476213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:33.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.085+0000 7f6476213800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:33.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.085+0000 7f6476213800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:33.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.085+0000 7f6476213800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:33.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.085+0000 7f6476213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:33.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.085+0000 7f6476213800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.085+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f936510 con 0x55bc9f931950 2024-09-13T23:05:33.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.085+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f646407a020 con 0x55bc9f931950 2024-09-13T23:05:33.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.085+0000 7f6476213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.085+0000 7f6476213800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.085+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f936db0 con 0x55bc9f931950 2024-09-13T23:05:33.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.085+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f646407a020 con 0x55bc9f931950 2024-09-13T23:05:33.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.085+0000 7f6476213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:33.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.085+0000 7f6476213800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.085+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f936150 con 0x55bc9f931950 2024-09-13T23:05:33.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.086+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f646407a020 con 0x55bc9f931950 2024-09-13T23:05:33.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.086+0000 7f6476213800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:33.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.086+0000 7f6476213800 20 zone default found 2024-09-13T23:05:33.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.086+0000 7f6476213800 4 Realm: () 2024-09-13T23:05:33.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.086+0000 7f6476213800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:33.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.086+0000 7f6476213800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:33.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.086+0000 7f6476213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:33.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.086+0000 7f6476213800 20 zonegroup default 2024-09-13T23:05:33.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.086+0000 7f6476213800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.086+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f936db0 con 0x7f646c031040 2024-09-13T23:05:33.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.086+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f646407a020 con 0x7f646c031040 2024-09-13T23:05:33.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.086+0000 7f6476213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.086+0000 7f6476213800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.086+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93c370 con 0x55bc9f937a90 2024-09-13T23:05:33.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.086+0000 7f646bfff640 1 -- 172.21.15.164:0/312587647 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f645c024030 con 0x55bc9f937a90 2024-09-13T23:05:33.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.086+0000 7f6476213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.086+0000 7f6476213800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.086+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93c710 con 0x55bc9f937a90 2024-09-13T23:05:33.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.086+0000 7f646bfff640 1 -- 172.21.15.164:0/312587647 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f645c024030 con 0x55bc9f937a90 2024-09-13T23:05:33.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.086+0000 7f6476213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.086+0000 7f6476213800 20 started sync module instance, tier type = 2024-09-13T23:05:33.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.086+0000 7f6476213800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:33.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.086+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93b810 con 0x7f645c027060 2024-09-13T23:05:33.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.087+0000 7f647206f640 1 -- 172.21.15.164:0/312587647 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646c040040 con 0x7f645c027060 2024-09-13T23:05:33.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.087+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94268619471920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93b470 con 0x7f645c027060 2024-09-13T23:05:33.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.088+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93d5f0 con 0x55bc9f931950 2024-09-13T23:05:33.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.088+0000 7f647206f640 1 -- 172.21.15.164:0/312587647 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94268619471920] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646c040040 con 0x7f645c027060 2024-09-13T23:05:33.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.089+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646407a020 con 0x55bc9f931950 2024-09-13T23:05:33.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.089+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94268619475744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93d5f0 con 0x55bc9f931950 2024-09-13T23:05:33.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.089+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93e030 con 0x55bc9f937a90 2024-09-13T23:05:33.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.090+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94268619475744] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646407a020 con 0x55bc9f931950 2024-09-13T23:05:33.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.090+0000 7f646bfff640 1 -- 172.21.15.164:0/312587647 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f645c024030 con 0x55bc9f937a90 2024-09-13T23:05:33.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.090+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94268619477312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93d560 con 0x55bc9f937a90 2024-09-13T23:05:33.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.090+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93eef0 con 0x7f645c027060 2024-09-13T23:05:33.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.091+0000 7f647206f640 1 -- 172.21.15.164:0/312587647 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646c040040 con 0x7f645c027060 2024-09-13T23:05:33.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.091+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94268619484192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93f6f0 con 0x7f645c027060 2024-09-13T23:05:33.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.091+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f940210 con 0x55bc9f931950 2024-09-13T23:05:33.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.091+0000 7f646bfff640 1 -- 172.21.15.164:0/312587647 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94268619477312] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f645c024030 con 0x55bc9f937a90 2024-09-13T23:05:33.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.092+0000 7f647206f640 1 -- 172.21.15.164:0/312587647 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94268619484192] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646c040040 con 0x7f645c027060 2024-09-13T23:05:33.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.092+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646407a020 con 0x55bc9f931950 2024-09-13T23:05:33.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.092+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94268619488480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f9401d0 con 0x55bc9f931950 2024-09-13T23:05:33.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.092+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f940ab0 con 0x7f646c031040 2024-09-13T23:05:33.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.093+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646407a020 con 0x7f646c031040 2024-09-13T23:05:33.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.093+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94268619490736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f940e80 con 0x7f646c031040 2024-09-13T23:05:33.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.093+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f9416d0 con 0x7f646c031040 2024-09-13T23:05:33.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.093+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94268619488480] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646407a020 con 0x55bc9f931950 2024-09-13T23:05:33.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.094+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646407a020 con 0x7f646c031040 2024-09-13T23:05:33.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.094+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94268619492992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f941750 con 0x7f646c031040 2024-09-13T23:05:33.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.094+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f942020 con 0x7f646c031040 2024-09-13T23:05:33.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.094+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94268619490736] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646407a020 con 0x7f646c031040 2024-09-13T23:05:33.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.095+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94268619492992] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646407a020 con 0x7f646c031040 2024-09-13T23:05:33.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.095+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646407a020 con 0x7f646c031040 2024-09-13T23:05:33.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.095+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94268619491792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f941750 con 0x7f646c031040 2024-09-13T23:05:33.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.095+0000 7f6476213800 20 add_watcher() i=0 2024-09-13T23:05:33.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.095+0000 7f6476213800 20 add_watcher() i=1 2024-09-13T23:05:33.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.095+0000 7f6476213800 20 add_watcher() i=2 2024-09-13T23:05:33.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.095+0000 7f6476213800 20 add_watcher() i=3 2024-09-13T23:05:33.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.095+0000 7f6476213800 20 add_watcher() i=4 2024-09-13T23:05:33.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.095+0000 7f6476213800 20 add_watcher() i=5 2024-09-13T23:05:33.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.095+0000 7f6476213800 20 add_watcher() i=6 2024-09-13T23:05:33.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.096+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94268619491792] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646407a020 con 0x7f646c031040 2024-09-13T23:05:33.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.096+0000 7f6476213800 20 add_watcher() i=7 2024-09-13T23:05:33.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.096+0000 7f6476213800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:33.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.096+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f945120 con 0x55bc9f931950 2024-09-13T23:05:33.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.096+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f646407a020 con 0x55bc9f931950 2024-09-13T23:05:33.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.096+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94268619494048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f9425a0 con 0x55bc9f931950 2024-09-13T23:05:33.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.097+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94268619494048] v32'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f646407a020 con 0x55bc9f931950 2024-09-13T23:05:33.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.097+0000 7f63237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:33.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.097+0000 7f6476213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:33.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.097+0000 7f6476213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:33.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.097+0000 7f6476213800 5 note: GC not initialized 2024-09-13T23:05:33.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.098+0000 7f63227fc640 20 reqs_thread_entry: start 2024-09-13T23:05:33.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.098+0000 7f6476213800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:33.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.098+0000 7f6476213800 20 Filter name: none 2024-09-13T23:05:33.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.098+0000 7f6293fff640 20 reqs_thread_entry: start 2024-09-13T23:05:33.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.098+0000 7f6476213800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.098+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f977e10 con 0x55bc9f931950 2024-09-13T23:05:33.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.098+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f646407a020 con 0x55bc9f931950 2024-09-13T23:05:33.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.099+0000 7f6476213800 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T23:05:33.118 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:05:31.300851Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:05:31.300826Z","tags":[],"group_ids":[]} 2024-09-13T23:05:33.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.099+0000 7f63237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:33.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.099+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94268619494048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f976880 con 0x55bc9f931950 2024-09-13T23:05:33.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.100+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94268619494048] v32'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f646407a020 con 0x55bc9f931950 2024-09-13T23:05:33.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.100+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94268619471920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f9412a0 con 0x7f645c027060 2024-09-13T23:05:33.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.101+0000 7f647206f640 1 -- 172.21.15.164:0/312587647 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94268619471920] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646c040040 con 0x7f645c027060 2024-09-13T23:05:33.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.101+0000 7f6476213800 20 remove_watcher() i=0 2024-09-13T23:05:33.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.101+0000 7f6476213800 2 removed watcher, disabling cache 2024-09-13T23:05:33.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.101+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94268619475744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f9412a0 con 0x55bc9f931950 2024-09-13T23:05:33.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.102+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94268619475744] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646407a020 con 0x55bc9f931950 2024-09-13T23:05:33.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.102+0000 7f6476213800 20 remove_watcher() i=1 2024-09-13T23:05:33.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.102+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94268619477312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93cb20 con 0x55bc9f937a90 2024-09-13T23:05:33.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.104+0000 7f646bfff640 1 -- 172.21.15.164:0/312587647 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94268619477312] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f645c024030 con 0x55bc9f937a90 2024-09-13T23:05:33.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.104+0000 7f6476213800 20 remove_watcher() i=2 2024-09-13T23:05:33.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.104+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94268619484192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f9412a0 con 0x7f645c027060 2024-09-13T23:05:33.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.104+0000 7f647206f640 1 -- 172.21.15.164:0/312587647 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94268619484192] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646c040040 con 0x7f645c027060 2024-09-13T23:05:33.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.104+0000 7f6476213800 20 remove_watcher() i=3 2024-09-13T23:05:33.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.104+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94268619488480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93d140 con 0x55bc9f931950 2024-09-13T23:05:33.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.105+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94268619488480] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646407a020 con 0x55bc9f931950 2024-09-13T23:05:33.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.105+0000 7f6476213800 20 remove_watcher() i=4 2024-09-13T23:05:33.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.105+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94268619490736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93fce0 con 0x7f646c031040 2024-09-13T23:05:33.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.106+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94268619490736] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646407a020 con 0x7f646c031040 2024-09-13T23:05:33.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.106+0000 7f6476213800 20 remove_watcher() i=5 2024-09-13T23:05:33.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.106+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94268619492992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93d140 con 0x7f646c031040 2024-09-13T23:05:33.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.107+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94268619492992] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646407a020 con 0x7f646c031040 2024-09-13T23:05:33.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.107+0000 7f6476213800 20 remove_watcher() i=6 2024-09-13T23:05:33.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.107+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94268619491792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc9f93d140 con 0x7f646c031040 2024-09-13T23:05:33.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.108+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94268619491792] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f646407a020 con 0x7f646c031040 2024-09-13T23:05:33.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.108+0000 7f6476213800 20 remove_watcher() i=7 2024-09-13T23:05:33.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.108+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f646c031040 msgr2=0x7f646c032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.108+0000 7f6476213800 1 --2- 172.21.15.164:0/312587647 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f646c031040 0x7f646c032430 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.108+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55bc9f931950 msgr2=0x55bc9f933e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.108+0000 7f6476213800 1 --2- 172.21.15.164:0/312587647 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55bc9f931950 0x55bc9f933e10 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.108+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f645c027060 msgr2=0x7f645c0119d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.108+0000 7f6476213800 1 --2- 172.21.15.164:0/312587647 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f645c027060 0x7f645c0119d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.108+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55bc9f937a90 msgr2=0x55bc9f939e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.108+0000 7f6476213800 1 --2- 172.21.15.164:0/312587647 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55bc9f937a90 0x55bc9f939e80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.108+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f633c036b90 msgr2=0x7f633c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.108+0000 7f6476213800 1 --2- 172.21.15.164:0/312587647 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f633c036b90 0x7f633c039050 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55bc9f800c60 tx=0x7f646c01f000 comp rx=0 tx=0).stop 2024-09-13T23:05:33.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.108+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f91eab0 msgr2=0x55bc9f925e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.108+0000 7f647186e640 1 -- 172.21.15.164:0/312587647 reap_dead start 2024-09-13T23:05:33.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.108+0000 7f6476213800 1 --2- 172.21.15.164:0/312587647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f91eab0 0x55bc9f925e60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f645c0266c0 tx=0x7f645c04c190 comp rx=0 tx=0).stop 2024-09-13T23:05:33.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.109+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 shutdown_connections 2024-09-13T23:05:33.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.109+0000 7f6476213800 1 --2- 172.21.15.164:0/312587647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f91eab0 0x55bc9f925e60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.109+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 >> 172.21.15.164:0/312587647 conn(0x55bc9f91ae10 msgr2=0x55bc9f918ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.109+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 shutdown_connections 2024-09-13T23:05:33.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.109+0000 7f6476213800 1 -- 172.21.15.164:0/312587647 wait complete. 2024-09-13T23:05:33.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.109+0000 7f6476213800 1 -- 172.21.15.164:0/118910386 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f634c036b40 msgr2=0x7f634c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.109+0000 7f6476213800 1 --2- 172.21.15.164:0/118910386 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f634c036b40 0x7f634c039000 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x55bc9f901f20 tx=0x7f646c005840 comp rx=0 tx=0).stop 2024-09-13T23:05:33.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.109+0000 7f6476213800 1 -- 172.21.15.164:0/118910386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f911d40 msgr2=0x55bc9f912160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.109+0000 7f6476213800 1 --2- 172.21.15.164:0/118910386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f911d40 0x55bc9f912160 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f645c00e610 tx=0x7f645c00ff90 comp rx=0 tx=0).stop 2024-09-13T23:05:33.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.109+0000 7f6476213800 1 -- 172.21.15.164:0/118910386 shutdown_connections 2024-09-13T23:05:33.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.109+0000 7f6476213800 1 --2- 172.21.15.164:0/118910386 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f634c036b40 0x7f634c039000 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.109+0000 7f6476213800 1 --2- 172.21.15.164:0/118910386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f911d40 0x55bc9f912160 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.109+0000 7f6476213800 1 -- 172.21.15.164:0/118910386 >> 172.21.15.164:0/118910386 conn(0x55bc9f906cd0 msgr2=0x55bc9f909850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.109+0000 7f6476213800 1 -- 172.21.15.164:0/118910386 shutdown_connections 2024-09-13T23:05:33.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.109+0000 7f6476213800 1 -- 172.21.15.164:0/118910386 wait complete. 2024-09-13T23:05:33.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.109+0000 7f6476213800 1 -- 172.21.15.164:0/2374102447 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55bc9f8047b0 msgr2=0x55bc9f901310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.109+0000 7f6476213800 1 --2- 172.21.15.164:0/2374102447 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55bc9f8047b0 0x55bc9f901310 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.109+0000 7f6476213800 1 -- 172.21.15.164:0/2374102447 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6358036be0 msgr2=0x7f63580390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.109+0000 7f6476213800 1 --2- 172.21.15.164:0/2374102447 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6358036be0 0x7f63580390a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f645c000c00 tx=0x7f645c0013b0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.109+0000 7f6476213800 1 -- 172.21.15.164:0/2374102447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f775610 msgr2=0x55bc9f801ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.109+0000 7f6476213800 1 --2- 172.21.15.164:0/2374102447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f775610 0x55bc9f801ba0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6464025c20 tx=0x7f6464002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.109+0000 7f6476213800 1 -- 172.21.15.164:0/2374102447 shutdown_connections 2024-09-13T23:05:33.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.109+0000 7f6476213800 1 --2- 172.21.15.164:0/2374102447 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55bc9f8047b0 0x55bc9f901310 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.109+0000 7f6476213800 1 --2- 172.21.15.164:0/2374102447 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6358036be0 0x7f63580390a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.109+0000 7f6476213800 1 --2- 172.21.15.164:0/2374102447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9f775610 0x55bc9f801ba0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.109+0000 7f6476213800 1 -- 172.21.15.164:0/2374102447 >> 172.21.15.164:0/2374102447 conn(0x55bc9f7fbde0 msgr2=0x55bc9f8ea8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.110+0000 7f6476213800 1 -- 172.21.15.164:0/2374102447 shutdown_connections 2024-09-13T23:05:33.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.110+0000 7f6476213800 1 -- 172.21.15.164:0/2374102447 wait complete. 2024-09-13T23:05:33.129 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:05:31.300851Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:05:31.300826Z', 'tags': [], 'group_ids': []} 2024-09-13T23:05:33.129 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T23:05:33.130 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T23:05:33.130 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T23:05:33.174 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:33.174 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:33.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.174+0000 7f952a00e800 1 Processor -- start 2024-09-13T23:05:33.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.174+0000 7f952a00e800 1 -- start start 2024-09-13T23:05:33.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.175+0000 7f952a00e800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55b9436ef990 0x55b9436f1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.175+0000 7f952a00e800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b9435abb30 con 0x55b9436eb550 2024-09-13T23:05:33.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.175+0000 7f952a00e800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55b94358d360 con 0x55b9436ef990 2024-09-13T23:05:33.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.175+0000 7f951ffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55b9436ef990 0x55b9436f1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.175+0000 7f952571a640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55b9436eb550 0x55b9436eb950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40810/0 (socket says 172.21.15.164:40810) 2024-09-13T23:05:33.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.175+0000 7f952571a640 1 -- 172.21.15.164:0/408279851 learned_addr learned my addr 172.21.15.164:0/408279851 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:33.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.175+0000 7f951ffff640 1 -- 172.21.15.164:0/408279851 >> v1:172.21.15.17:6789/0 conn(0x55b9436eb550 legacy=0x55b9436eb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.175+0000 7f951ffff640 1 -- 172.21.15.164:0/408279851 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9435b3e00 con 0x55b9436ef990 2024-09-13T23:05:33.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.177+0000 7f951ffff640 1 --2- 172.21.15.164:0/408279851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9436ef990 0x55b9436f1d80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f951000a470 tx=0x7f9510045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a8263292270ac68 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.177+0000 7f9524f19640 1 -- 172.21.15.164:0/408279851 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9510053570 con 0x55b9436ef990 2024-09-13T23:05:33.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.177+0000 7f9524f19640 1 -- 172.21.15.164:0/408279851 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9510058070 con 0x55b9436ef990 2024-09-13T23:05:33.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.177+0000 7f9524f19640 1 -- 172.21.15.164:0/408279851 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9510053880 con 0x55b9436ef990 2024-09-13T23:05:33.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.178+0000 7f952a00e800 1 -- 172.21.15.164:0/408279851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9436ef990 msgr2=0x55b9436f1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.178+0000 7f952a00e800 1 --2- 172.21.15.164:0/408279851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9436ef990 0x55b9436f1d80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f951000a470 tx=0x7f9510045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:33.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.178+0000 7f952a00e800 1 -- 172.21.15.164:0/408279851 shutdown_connections 2024-09-13T23:05:33.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.178+0000 7f952a00e800 1 --2- 172.21.15.164:0/408279851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9436ef990 0x55b9436f1d80 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.178+0000 7f952a00e800 1 -- 172.21.15.164:0/408279851 >> 172.21.15.164:0/408279851 conn(0x55b9436e6de0 msgr2=0x55b9436e9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.178+0000 7f952a00e800 1 -- 172.21.15.164:0/408279851 shutdown_connections 2024-09-13T23:05:33.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.178+0000 7f952a00e800 1 -- 172.21.15.164:0/408279851 wait complete. 2024-09-13T23:05:33.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.192+0000 7f952a00e800 1 Processor -- start 2024-09-13T23:05:33.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.192+0000 7f952a00e800 1 -- start start 2024-09-13T23:05:33.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.192+0000 7f952a00e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9436eb550 0x55b9436605a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.192+0000 7f952a00e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b943638330 con 0x55b9436eb550 2024-09-13T23:05:33.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.193+0000 7f952571a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9436eb550 0x55b9436605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.193+0000 7f952571a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9436eb550 0x55b9436605a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56926/0 (socket says 172.21.15.164:56926) 2024-09-13T23:05:33.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.193+0000 7f952571a640 1 -- 172.21.15.164:0/3608870213 learned_addr learned my addr 172.21.15.164:0/3608870213 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.193+0000 7f952571a640 1 -- 172.21.15.164:0/3608870213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b943585bc0 con 0x55b9436eb550 2024-09-13T23:05:33.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.193+0000 7f952571a640 1 --2- 172.21.15.164:0/3608870213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9436eb550 0x55b9436605a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9518001e10 tx=0x7f951800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7536f28a8000bc03 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.193+0000 7f9413606640 1 -- 172.21.15.164:0/3608870213 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9518012020 con 0x55b9436eb550 2024-09-13T23:05:33.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.193+0000 7f9413606640 1 -- 172.21.15.164:0/3608870213 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f951800e5a0 con 0x55b9436eb550 2024-09-13T23:05:33.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.193+0000 7f9413606640 1 -- 172.21.15.164:0/3608870213 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f951800e8e0 con 0x55b9436eb550 2024-09-13T23:05:33.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.194+0000 7f952a00e800 1 -- 172.21.15.164:0/3608870213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9436eb550 msgr2=0x55b9436605a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.194+0000 7f952a00e800 1 --2- 172.21.15.164:0/3608870213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9436eb550 0x55b9436605a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9518001e10 tx=0x7f951800b780 comp rx=0 tx=0).stop 2024-09-13T23:05:33.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.194+0000 7f952a00e800 1 -- 172.21.15.164:0/3608870213 shutdown_connections 2024-09-13T23:05:33.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.194+0000 7f952a00e800 1 --2- 172.21.15.164:0/3608870213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9436eb550 0x55b9436605a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.194+0000 7f952a00e800 1 -- 172.21.15.164:0/3608870213 >> 172.21.15.164:0/3608870213 conn(0x55b9436e6de0 msgr2=0x55b9437d6140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.194+0000 7f952a00e800 1 -- 172.21.15.164:0/3608870213 shutdown_connections 2024-09-13T23:05:33.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.194+0000 7f952a00e800 1 -- 172.21.15.164:0/3608870213 wait complete. 2024-09-13T23:05:33.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.194+0000 7f952a00e800 1 Processor -- start 2024-09-13T23:05:33.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.194+0000 7f952a00e800 1 -- start start 2024-09-13T23:05:33.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.195+0000 7f952a00e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9436eb550 0x55b9437e3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.195+0000 7f952a00e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b9436f25c0 con 0x55b9436eb550 2024-09-13T23:05:33.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.195+0000 7f952571a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9436eb550 0x55b9437e3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.195+0000 7f952571a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9436eb550 0x55b9437e3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56942/0 (socket says 172.21.15.164:56942) 2024-09-13T23:05:33.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.195+0000 7f952571a640 1 -- 172.21.15.164:0/3168501925 learned_addr learned my addr 172.21.15.164:0/3168501925 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.195+0000 7f952571a640 1 -- 172.21.15.164:0/3168501925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b943599fe0 con 0x55b9436eb550 2024-09-13T23:05:33.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.195+0000 7f952571a640 1 --2- 172.21.15.164:0/3168501925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9436eb550 0x55b9437e3260 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f951800b7c0 tx=0x7f9518000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.196+0000 7f9411e03640 1 -- 172.21.15.164:0/3168501925 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9518012030 con 0x55b9436eb550 2024-09-13T23:05:33.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.196+0000 7f9411e03640 1 -- 172.21.15.164:0/3168501925 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9518001470 con 0x55b9436eb550 2024-09-13T23:05:33.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.196+0000 7f9411e03640 1 -- 172.21.15.164:0/3168501925 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f951801a8d0 con 0x55b9436eb550 2024-09-13T23:05:33.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.196+0000 7f952a00e800 1 -- 172.21.15.164:0/3168501925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b9437e37a0 con 0x55b9436eb550 2024-09-13T23:05:33.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.196+0000 7f952a00e800 1 -- 172.21.15.164:0/3168501925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9437e3cc0 con 0x55b9436eb550 2024-09-13T23:05:33.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.196+0000 7f9411e03640 1 -- 172.21.15.164:0/3168501925 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9518015020 con 0x55b9436eb550 2024-09-13T23:05:33.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.197+0000 7f9411e03640 1 --2- 172.21.15.164:0/3168501925 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f940c036b90 0x7f940c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.197+0000 7f9411e03640 1 -- 172.21.15.164:0/3168501925 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9518020030 con 0x55b9436eb550 2024-09-13T23:05:33.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.197+0000 7f951ffff640 1 --2- 172.21.15.164:0/3168501925 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f940c036b90 0x7f940c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.197+0000 7f952a00e800 1 --2- 172.21.15.164:0/3168501925 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b9436ef990 0x55b9437ea2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.197+0000 7f952a00e800 1 -- 172.21.15.164:0/3168501925 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9437ea850 con 0x55b9436ef990 2024-09-13T23:05:33.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.197+0000 7f9525f1b640 1 --2- 172.21.15.164:0/3168501925 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b9436ef990 0x55b9437ea2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.197+0000 7f951ffff640 1 --2- 172.21.15.164:0/3168501925 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f940c036b90 0x7f940c039050 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9510057000 tx=0x7f9510052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.197+0000 7f9525f1b640 1 --2- 172.21.15.164:0/3168501925 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b9436ef990 0x55b9437ea2d0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.197+0000 7f9525f1b640 1 -- 172.21.15.164:0/3168501925 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f952000a4a0 con 0x55b9436ef990 2024-09-13T23:05:33.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.197+0000 7f952a00e800 1 -- 172.21.15.164:0/3168501925 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9437e78a0 con 0x55b9436ef990 2024-09-13T23:05:33.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.198+0000 7f9525f1b640 1 -- 172.21.15.164:0/3168501925 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f952000a4a0 con 0x55b9436ef990 2024-09-13T23:05:33.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.198+0000 7f952a00e800 1 -- 172.21.15.164:0/3168501925 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9437ec650 con 0x55b9436ef990 2024-09-13T23:05:33.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.198+0000 7f9525f1b640 1 -- 172.21.15.164:0/3168501925 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f952000a4a0 con 0x55b9436ef990 2024-09-13T23:05:33.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.198+0000 7f952a00e800 1 -- 172.21.15.164:0/3168501925 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9437eb790 con 0x55b9436ef990 2024-09-13T23:05:33.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.198+0000 7f9525f1b640 1 -- 172.21.15.164:0/3168501925 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f952000a4a0 con 0x55b9436ef990 2024-09-13T23:05:33.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.198+0000 7f952a00e800 1 -- 172.21.15.164:0/3168501925 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9437ebbe0 con 0x55b9436ef990 2024-09-13T23:05:33.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.199+0000 7f9525f1b640 1 -- 172.21.15.164:0/3168501925 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f952000a4a0 con 0x55b9436ef990 2024-09-13T23:05:33.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.199+0000 7f952a00e800 1 Processor -- start 2024-09-13T23:05:33.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.199+0000 7f952a00e800 1 -- start start 2024-09-13T23:05:33.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.199+0000 7f952a00e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9437dbf80 0x55b9437da5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.199+0000 7f952a00e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b943587580 con 0x55b9437dbf80 2024-09-13T23:05:33.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.200+0000 7f951ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9437dbf80 0x55b9437da5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.200+0000 7f951ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9437dbf80 0x55b9437da5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56944/0 (socket says 172.21.15.164:56944) 2024-09-13T23:05:33.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.200+0000 7f951ffff640 1 -- 172.21.15.164:0/2870613336 learned_addr learned my addr 172.21.15.164:0/2870613336 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.200+0000 7f951ffff640 1 -- 172.21.15.164:0/2870613336 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9437dc3a0 con 0x55b9437dbf80 2024-09-13T23:05:33.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.200+0000 7f951ffff640 1 --2- 172.21.15.164:0/2870613336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9437dbf80 0x55b9437da5d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9510045f50 tx=0x7f9510002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.200+0000 7f940affd640 1 -- 172.21.15.164:0/2870613336 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f951006f070 con 0x55b9437dbf80 2024-09-13T23:05:33.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.200+0000 7f940affd640 1 -- 172.21.15.164:0/2870613336 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f951005f550 con 0x55b9437dbf80 2024-09-13T23:05:33.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.200+0000 7f940affd640 1 -- 172.21.15.164:0/2870613336 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f951005f830 con 0x55b9437dbf80 2024-09-13T23:05:33.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.200+0000 7f952a00e800 1 -- 172.21.15.164:0/2870613336 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b9437dab70 con 0x55b9437dbf80 2024-09-13T23:05:33.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.200+0000 7f952a00e800 1 -- 172.21.15.164:0/2870613336 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9437db010 con 0x55b9437dbf80 2024-09-13T23:05:33.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.201+0000 7f940affd640 1 -- 172.21.15.164:0/2870613336 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f951005f9d0 con 0x55b9437dbf80 2024-09-13T23:05:33.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.201+0000 7f940affd640 1 --2- 172.21.15.164:0/2870613336 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9400036b40 0x7f9400039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.201+0000 7f940affd640 1 -- 172.21.15.164:0/2870613336 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9510092de0 con 0x55b9437dbf80 2024-09-13T23:05:33.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.201+0000 7f9525f1b640 1 --2- 172.21.15.164:0/2870613336 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9400036b40 0x7f9400039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.202+0000 7f952a00e800 1 Processor -- start 2024-09-13T23:05:33.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.202+0000 7f9525f1b640 1 --2- 172.21.15.164:0/2870613336 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9400036b40 0x7f9400039000 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x55b9437eb2b0 tx=0x7f9520005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.202+0000 7f952a00e800 1 -- start start 2024-09-13T23:05:33.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.202+0000 7f952a00e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b943809a20 0x55b943809e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.202+0000 7f952a00e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b9437de760 con 0x55b943809a20 2024-09-13T23:05:33.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.202+0000 7f951ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b943809a20 0x55b943809e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.202+0000 7f951ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b943809a20 0x55b943809e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56958/0 (socket says 172.21.15.164:56958) 2024-09-13T23:05:33.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.202+0000 7f951ffff640 1 -- 172.21.15.164:0/2816552251 learned_addr learned my addr 172.21.15.164:0/2816552251 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.202+0000 7f951ffff640 1 -- 172.21.15.164:0/2816552251 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b94380a3f0 con 0x55b943809a20 2024-09-13T23:05:33.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.202+0000 7f951ffff640 1 --2- 172.21.15.164:0/2816552251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b943809a20 0x55b943809e20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9510053f70 tx=0x7f951007cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49108c8a16b48f6f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.203+0000 7f9408ff9640 1 -- 172.21.15.164:0/2816552251 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f951006b410 con 0x55b943809a20 2024-09-13T23:05:33.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.203+0000 7f9408ff9640 1 -- 172.21.15.164:0/2816552251 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f951005fcc0 con 0x55b943809a20 2024-09-13T23:05:33.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.203+0000 7f9408ff9640 1 -- 172.21.15.164:0/2816552251 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f951006b5b0 con 0x55b943809a20 2024-09-13T23:05:33.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.203+0000 7f952a00e800 1 -- 172.21.15.164:0/2816552251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b943809a20 msgr2=0x55b943809e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.203+0000 7f952a00e800 1 --2- 172.21.15.164:0/2816552251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b943809a20 0x55b943809e20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9510053f70 tx=0x7f951007cbb0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.203+0000 7f952a00e800 1 -- 172.21.15.164:0/2816552251 shutdown_connections 2024-09-13T23:05:33.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.203+0000 7f952a00e800 1 --2- 172.21.15.164:0/2816552251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b943809a20 0x55b943809e20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.203+0000 7f952a00e800 1 -- 172.21.15.164:0/2816552251 >> 172.21.15.164:0/2816552251 conn(0x55b943805d80 msgr2=0x55b943803e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.203+0000 7f952a00e800 1 -- 172.21.15.164:0/2816552251 shutdown_connections 2024-09-13T23:05:33.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.203+0000 7f952a00e800 1 -- 172.21.15.164:0/2816552251 wait complete. 2024-09-13T23:05:33.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.203+0000 7f952a00e800 1 Processor -- start 2024-09-13T23:05:33.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.203+0000 7f952a00e800 1 -- start start 2024-09-13T23:05:33.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.204+0000 7f952a00e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b943809a20 0x55b943810ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.204+0000 7f952a00e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b94380aa60 con 0x55b943809a20 2024-09-13T23:05:33.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.204+0000 7f951ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b943809a20 0x55b943810ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.204+0000 7f951ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b943809a20 0x55b943810ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56968/0 (socket says 172.21.15.164:56968) 2024-09-13T23:05:33.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.204+0000 7f951ffff640 1 -- 172.21.15.164:0/61712738 learned_addr learned my addr 172.21.15.164:0/61712738 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.204+0000 7f951ffff640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b943811420 con 0x55b943809a20 2024-09-13T23:05:33.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.204+0000 7f951ffff640 1 --2- 172.21.15.164:0/61712738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b943809a20 0x55b943810ee0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f951006afd0 tx=0x7f95100910a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.204+0000 7f93f6ffd640 1 -- 172.21.15.164:0/61712738 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f951006b410 con 0x55b943809a20 2024-09-13T23:05:33.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.204+0000 7f93f6ffd640 1 -- 172.21.15.164:0/61712738 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f951005cca0 con 0x55b943809a20 2024-09-13T23:05:33.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.204+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b9438116b0 con 0x55b943809a20 2024-09-13T23:05:33.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.204+0000 7f93f6ffd640 1 -- 172.21.15.164:0/61712738 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f951006b5b0 con 0x55b943809a20 2024-09-13T23:05:33.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.204+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b943814360 con 0x55b943809a20 2024-09-13T23:05:33.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.205+0000 7f93f6ffd640 1 -- 172.21.15.164:0/61712738 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f951006a720 con 0x55b943809a20 2024-09-13T23:05:33.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.205+0000 7f93f6ffd640 1 --2- 172.21.15.164:0/61712738 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f93f0036b40 0x7f93f0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.205+0000 7f93f6ffd640 1 -- 172.21.15.164:0/61712738 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f951009cc80 con 0x55b943809a20 2024-09-13T23:05:33.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.206+0000 7f9525f1b640 1 --2- 172.21.15.164:0/61712738 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f93f0036b40 0x7f93f0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.206+0000 7f952a00e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.206+0000 7f952a00e800 1 --2- 172.21.15.164:0/61712738 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b94381ca20 0x55b94381eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.206+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b94381f630 con 0x55b94381ca20 2024-09-13T23:05:33.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.206+0000 7f952571a640 1 --2- 172.21.15.164:0/61712738 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b94381ca20 0x55b94381eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.206+0000 7f9525f1b640 1 --2- 172.21.15.164:0/61712738 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f93f0036b40 0x7f93f0039000 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55b9437e4480 tx=0x7f952001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.206+0000 7f952571a640 1 --2- 172.21.15.164:0/61712738 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b94381ca20 0x55b94381eee0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.206+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9518018950 con 0x55b94381ca20 2024-09-13T23:05:33.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.206+0000 7f952a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.206+0000 7f952a00e800 20 realm 2024-09-13T23:05:33.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.206+0000 7f952a00e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.206+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b94381fa40 con 0x55b94381ca20 2024-09-13T23:05:33.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.207+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9518018950 con 0x55b94381ca20 2024-09-13T23:05:33.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.207+0000 7f952a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.207+0000 7f952a00e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:33.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.207+0000 7f952a00e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.207+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b943820310 con 0x55b94381ca20 2024-09-13T23:05:33.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.207+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9518018950 con 0x55b94381ca20 2024-09-13T23:05:33.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.207+0000 7f952a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.207+0000 7f952a00e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.207+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9438206b0 con 0x55b94381ca20 2024-09-13T23:05:33.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.207+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9518018950 con 0x55b94381ca20 2024-09-13T23:05:33.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.207+0000 7f952a00e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:33.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.207+0000 7f952a00e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.207+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b943820b10 con 0x55b94381ca20 2024-09-13T23:05:33.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.207+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9518018950 con 0x55b94381ca20 2024-09-13T23:05:33.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.207+0000 7f952a00e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:33.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.207+0000 7f952a00e800 20 searching for the correct realm 2024-09-13T23:05:33.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.208+0000 7f952a00e800 1 --2- 172.21.15.164:0/61712738 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55b943822b60 0x55b943824f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.208+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x55b943822b60 2024-09-13T23:05:33.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.208+0000 7f951ffff640 1 --2- 172.21.15.164:0/61712738 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55b943822b60 0x55b943824f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.208+0000 7f951ffff640 1 --2- 172.21.15.164:0/61712738 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55b943822b60 0x55b943824f50 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.208+0000 7f951ffff640 1 -- 172.21.15.164:0/61712738 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9510051070 con 0x55b943822b60 2024-09-13T23:05:33.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.208+0000 7f951ffff640 1 --2- 172.21.15.164:0/61712738 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f951005f040 0x7f9510084850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.208+0000 7f951ffff640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x7f951005f040 2024-09-13T23:05:33.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.208+0000 7f9525f1b640 1 --2- 172.21.15.164:0/61712738 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f951005f040 0x7f9510084850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.209+0000 7f9525f1b640 1 --2- 172.21.15.164:0/61712738 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f951005f040 0x7f9510084850 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.209+0000 7f9525f1b640 1 -- 172.21.15.164:0/61712738 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f952001f070 con 0x7f951005f040 2024-09-13T23:05:33.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.209+0000 7f9525f1b640 1 --2- 172.21.15.164:0/61712738 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f9520031040 0x7f9520032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.209+0000 7f9525f1b640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x7f9520031040 2024-09-13T23:05:33.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.209+0000 7f952571a640 1 --2- 172.21.15.164:0/61712738 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f9520031040 0x7f9520032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.209+0000 7f952571a640 1 --2- 172.21.15.164:0/61712738 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f9520031040 0x7f9520032940 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.210+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9518018950 con 0x7f9520031040 2024-09-13T23:05:33.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.210+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x55b94381ca20 2024-09-13T23:05:33.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.210+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9518018950 con 0x55b94381ca20 2024-09-13T23:05:33.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.210+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x55b94381ca20 2024-09-13T23:05:33.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.210+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9518018950 con 0x55b94381ca20 2024-09-13T23:05:33.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.210+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x7f9520031040 2024-09-13T23:05:33.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.210+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9518018950 con 0x7f9520031040 2024-09-13T23:05:33.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.210+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x7f9520031040 2024-09-13T23:05:33.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.211+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9518018950 con 0x7f9520031040 2024-09-13T23:05:33.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.211+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x7f951005f040 2024-09-13T23:05:33.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.211+0000 7f9525f1b640 1 -- 172.21.15.164:0/61712738 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f952001f070 con 0x7f951005f040 2024-09-13T23:05:33.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.211+0000 7f9525f1b640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x55b943822b60 2024-09-13T23:05:33.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.211+0000 7f951ffff640 1 -- 172.21.15.164:0/61712738 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9510051070 con 0x55b943822b60 2024-09-13T23:05:33.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.211+0000 7f951ffff640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x55b94381ca20 2024-09-13T23:05:33.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.211+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9518018950 con 0x55b94381ca20 2024-09-13T23:05:33.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.211+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x7f9520031040 2024-09-13T23:05:33.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.212+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9518018950 con 0x7f9520031040 2024-09-13T23:05:33.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.212+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x55b94381ca20 2024-09-13T23:05:33.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.212+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9518018950 con 0x55b94381ca20 2024-09-13T23:05:33.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.212+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x7f951005f040 2024-09-13T23:05:33.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.212+0000 7f9525f1b640 1 -- 172.21.15.164:0/61712738 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f952001f070 con 0x7f951005f040 2024-09-13T23:05:33.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.212+0000 7f9525f1b640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x55b943822b60 2024-09-13T23:05:33.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.212+0000 7f951ffff640 1 -- 172.21.15.164:0/61712738 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9510051070 con 0x55b943822b60 2024-09-13T23:05:33.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.212+0000 7f951ffff640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x55b943822b60 2024-09-13T23:05:33.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.212+0000 7f951ffff640 1 -- 172.21.15.164:0/61712738 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9510051070 con 0x55b943822b60 2024-09-13T23:05:33.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.213+0000 7f951ffff640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x7f9520031040 2024-09-13T23:05:33.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.213+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9518018950 con 0x7f9520031040 2024-09-13T23:05:33.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.213+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x55b943822b60 2024-09-13T23:05:33.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.213+0000 7f951ffff640 1 -- 172.21.15.164:0/61712738 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9510051070 con 0x55b943822b60 2024-09-13T23:05:33.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.213+0000 7f951ffff640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x55b943822b60 2024-09-13T23:05:33.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.213+0000 7f951ffff640 1 -- 172.21.15.164:0/61712738 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9510051070 con 0x55b943822b60 2024-09-13T23:05:33.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.213+0000 7f951ffff640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x55b94381ca20 2024-09-13T23:05:33.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.213+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9518018950 con 0x55b94381ca20 2024-09-13T23:05:33.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.214+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x55b94381ca20 2024-09-13T23:05:33.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.214+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9518018950 con 0x55b94381ca20 2024-09-13T23:05:33.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.214+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x7f9520031040 2024-09-13T23:05:33.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.214+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9518018950 con 0x7f9520031040 2024-09-13T23:05:33.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.214+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x55b943822b60 2024-09-13T23:05:33.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.214+0000 7f951ffff640 1 -- 172.21.15.164:0/61712738 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9510051070 con 0x55b943822b60 2024-09-13T23:05:33.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.214+0000 7f951ffff640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x7f951005f040 2024-09-13T23:05:33.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.215+0000 7f9525f1b640 1 -- 172.21.15.164:0/61712738 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f952001f070 con 0x7f951005f040 2024-09-13T23:05:33.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.215+0000 7f9525f1b640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x55b94381ca20 2024-09-13T23:05:33.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.215+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9518018950 con 0x55b94381ca20 2024-09-13T23:05:33.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.215+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x7f9520031040 2024-09-13T23:05:33.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.215+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9518018950 con 0x7f9520031040 2024-09-13T23:05:33.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.215+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x55b943822b60 2024-09-13T23:05:33.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.215+0000 7f951ffff640 1 -- 172.21.15.164:0/61712738 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9510051070 con 0x55b943822b60 2024-09-13T23:05:33.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.215+0000 7f951ffff640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x7f9520031040 2024-09-13T23:05:33.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.216+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9518018950 con 0x7f9520031040 2024-09-13T23:05:33.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.216+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x7f951005f040 2024-09-13T23:05:33.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.216+0000 7f9525f1b640 1 -- 172.21.15.164:0/61712738 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f952001f070 con 0x7f951005f040 2024-09-13T23:05:33.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.216+0000 7f9525f1b640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x55b943822b60 2024-09-13T23:05:33.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.216+0000 7f951ffff640 1 -- 172.21.15.164:0/61712738 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9510051070 con 0x55b943822b60 2024-09-13T23:05:33.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.216+0000 7f951ffff640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x7f9520031040 2024-09-13T23:05:33.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.216+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9518018950 con 0x7f9520031040 2024-09-13T23:05:33.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.216+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x55b94381ca20 2024-09-13T23:05:33.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.217+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9518018950 con 0x55b94381ca20 2024-09-13T23:05:33.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.217+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b943825600 con 0x7f951005f040 2024-09-13T23:05:33.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.217+0000 7f9525f1b640 1 -- 172.21.15.164:0/61712738 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f952001f070 con 0x7f951005f040 2024-09-13T23:05:33.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.217+0000 7f952a00e800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:33.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.217+0000 7f952a00e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:33.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.217+0000 7f952a00e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:33.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.217+0000 7f952a00e800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:33.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.217+0000 7f952a00e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:33.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.217+0000 7f952a00e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:33.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.217+0000 7f952a00e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.217+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9438215b0 con 0x55b94381ca20 2024-09-13T23:05:33.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.217+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9518018950 con 0x55b94381ca20 2024-09-13T23:05:33.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.217+0000 7f952a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.217+0000 7f952a00e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.217+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b943821e50 con 0x55b94381ca20 2024-09-13T23:05:33.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.217+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9518018950 con 0x55b94381ca20 2024-09-13T23:05:33.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.217+0000 7f952a00e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:33.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.217+0000 7f952a00e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.217+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9438211f0 con 0x55b94381ca20 2024-09-13T23:05:33.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.218+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9518018950 con 0x55b94381ca20 2024-09-13T23:05:33.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.218+0000 7f952a00e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:33.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.218+0000 7f952a00e800 20 zone default found 2024-09-13T23:05:33.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.218+0000 7f952a00e800 4 Realm: () 2024-09-13T23:05:33.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.218+0000 7f952a00e800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:33.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.218+0000 7f952a00e800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:33.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.218+0000 7f952a00e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:33.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.218+0000 7f952a00e800 20 zonegroup default 2024-09-13T23:05:33.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.218+0000 7f952a00e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.218+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b943821e50 con 0x7f9520031040 2024-09-13T23:05:33.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.218+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9518018950 con 0x7f9520031040 2024-09-13T23:05:33.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.218+0000 7f952a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.218+0000 7f952a00e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.218+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b943827440 con 0x55b943822b60 2024-09-13T23:05:33.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.218+0000 7f951ffff640 1 -- 172.21.15.164:0/61712738 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9510051070 con 0x55b943822b60 2024-09-13T23:05:33.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.218+0000 7f952a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.218+0000 7f952a00e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.218+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9438277e0 con 0x55b943822b60 2024-09-13T23:05:33.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.219+0000 7f951ffff640 1 -- 172.21.15.164:0/61712738 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9510051070 con 0x55b943822b60 2024-09-13T23:05:33.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.219+0000 7f952a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.219+0000 7f952a00e800 20 started sync module instance, tier type = 2024-09-13T23:05:33.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.219+0000 7f952a00e800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:33.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.219+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9438268e0 con 0x7f951005f040 2024-09-13T23:05:33.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.220+0000 7f9525f1b640 1 -- 172.21.15.164:0/61712738 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9520040040 con 0x7f951005f040 2024-09-13T23:05:33.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.220+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94254189931776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b943828080 con 0x7f951005f040 2024-09-13T23:05:33.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.220+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9438288d0 con 0x55b94381ca20 2024-09-13T23:05:33.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.221+0000 7f9525f1b640 1 -- 172.21.15.164:0/61712738 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94254189931776] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9520040040 con 0x7f951005f040 2024-09-13T23:05:33.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.221+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9518018950 con 0x55b94381ca20 2024-09-13T23:05:33.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.221+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94254189935568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9438285c0 con 0x55b94381ca20 2024-09-13T23:05:33.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.221+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9438290c0 con 0x55b943822b60 2024-09-13T23:05:33.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.222+0000 7f951ffff640 1 -- 172.21.15.164:0/61712738 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9510051070 con 0x55b943822b60 2024-09-13T23:05:33.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.222+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94254189939632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b943829910 con 0x55b943822b60 2024-09-13T23:05:33.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.222+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b94382a410 con 0x7f951005f040 2024-09-13T23:05:33.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.222+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94254189935568] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9518018950 con 0x55b94381ca20 2024-09-13T23:05:33.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.223+0000 7f9525f1b640 1 -- 172.21.15.164:0/61712738 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9520040040 con 0x7f951005f040 2024-09-13T23:05:33.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.223+0000 7f951ffff640 1 -- 172.21.15.164:0/61712738 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94254189939632] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9510051070 con 0x55b943822b60 2024-09-13T23:05:33.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.223+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94254189944576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b94382a800 con 0x7f951005f040 2024-09-13T23:05:33.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.223+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b943829460 con 0x55b94381ca20 2024-09-13T23:05:33.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.224+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9518018950 con 0x55b94381ca20 2024-09-13T23:05:33.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.224+0000 7f9525f1b640 1 -- 172.21.15.164:0/61712738 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94254189944576] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9520040040 con 0x7f951005f040 2024-09-13T23:05:33.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.224+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94254189948272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b943829460 con 0x55b94381ca20 2024-09-13T23:05:33.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.224+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b94382b7e0 con 0x7f9520031040 2024-09-13T23:05:33.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.225+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94254189948272] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9518018950 con 0x55b94381ca20 2024-09-13T23:05:33.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.225+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9518018950 con 0x7f9520031040 2024-09-13T23:05:33.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.225+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94254189936688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b94382b7e0 con 0x7f9520031040 2024-09-13T23:05:33.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.225+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b94382c1f0 con 0x7f9520031040 2024-09-13T23:05:33.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.226+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94254189936688] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9518018950 con 0x7f9520031040 2024-09-13T23:05:33.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.227+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9518018950 con 0x7f9520031040 2024-09-13T23:05:33.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.227+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94254189949328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b94382c1f0 con 0x7f9520031040 2024-09-13T23:05:33.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.227+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b94382cbb0 con 0x7f9520031040 2024-09-13T23:05:33.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.227+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94254189949328] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9518018950 con 0x7f9520031040 2024-09-13T23:05:33.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.228+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9518018950 con 0x7f9520031040 2024-09-13T23:05:33.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.228+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94254189952592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b94382cbb0 con 0x7f9520031040 2024-09-13T23:05:33.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.228+0000 7f952a00e800 20 add_watcher() i=0 2024-09-13T23:05:33.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.228+0000 7f952a00e800 20 add_watcher() i=1 2024-09-13T23:05:33.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.228+0000 7f952a00e800 20 add_watcher() i=2 2024-09-13T23:05:33.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.228+0000 7f952a00e800 20 add_watcher() i=3 2024-09-13T23:05:33.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.228+0000 7f952a00e800 20 add_watcher() i=4 2024-09-13T23:05:33.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.228+0000 7f952a00e800 20 add_watcher() i=5 2024-09-13T23:05:33.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.228+0000 7f952a00e800 20 add_watcher() i=6 2024-09-13T23:05:33.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.228+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94254189952592] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9518018950 con 0x7f9520031040 2024-09-13T23:05:33.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.228+0000 7f952a00e800 20 add_watcher() i=7 2024-09-13T23:05:33.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.229+0000 7f952a00e800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:33.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.229+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b94382fed0 con 0x55b94381ca20 2024-09-13T23:05:33.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.229+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9518018950 con 0x55b94381ca20 2024-09-13T23:05:33.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.229+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94254189955184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b94382d140 con 0x55b94381ca20 2024-09-13T23:05:33.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.230+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94254189955184] v32'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9518018950 con 0x55b94381ca20 2024-09-13T23:05:33.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.230+0000 7f93db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:33.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.230+0000 7f952a00e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:33.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.230+0000 7f952a00e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:33.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.230+0000 7f952a00e800 5 note: GC not initialized 2024-09-13T23:05:33.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.230+0000 7f93da7e4640 20 reqs_thread_entry: start 2024-09-13T23:05:33.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.230+0000 7f952a00e800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:33.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.230+0000 7f952a00e800 20 Filter name: none 2024-09-13T23:05:33.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.230+0000 7f934bfff640 20 reqs_thread_entry: start 2024-09-13T23:05:33.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.230+0000 7f952a00e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.231+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b943862ea0 con 0x55b94381ca20 2024-09-13T23:05:33.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.231+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f9518018950 con 0x55b94381ca20 2024-09-13T23:05:33.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.231+0000 7f952a00e800 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T23:05:33.243 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:05:31.300851Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:05:31.300826Z","tags":[],"group_ids":[]} 2024-09-13T23:05:33.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.232+0000 7f93db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:33.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.232+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94254189955184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b943861910 con 0x55b94381ca20 2024-09-13T23:05:33.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.233+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94254189955184] v32'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9518018950 con 0x55b94381ca20 2024-09-13T23:05:33.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.233+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94254189931776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b94382c870 con 0x7f951005f040 2024-09-13T23:05:33.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.234+0000 7f9525f1b640 1 -- 172.21.15.164:0/61712738 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94254189931776] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9520040040 con 0x7f951005f040 2024-09-13T23:05:33.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.234+0000 7f952a00e800 20 remove_watcher() i=0 2024-09-13T23:05:33.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.234+0000 7f952a00e800 2 removed watcher, disabling cache 2024-09-13T23:05:33.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.234+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94254189935568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b94382c870 con 0x55b94381ca20 2024-09-13T23:05:33.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.235+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94254189935568] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9518018950 con 0x55b94381ca20 2024-09-13T23:05:33.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.235+0000 7f952a00e800 20 remove_watcher() i=1 2024-09-13T23:05:33.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.235+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94254189939632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b943827bd0 con 0x55b943822b60 2024-09-13T23:05:33.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.236+0000 7f951ffff640 1 -- 172.21.15.164:0/61712738 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94254189939632] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9510051070 con 0x55b943822b60 2024-09-13T23:05:33.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.236+0000 7f952a00e800 20 remove_watcher() i=2 2024-09-13T23:05:33.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.236+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94254189944576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b94382c870 con 0x7f951005f040 2024-09-13T23:05:33.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.236+0000 7f9525f1b640 1 -- 172.21.15.164:0/61712738 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94254189944576] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9520040040 con 0x7f951005f040 2024-09-13T23:05:33.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.237+0000 7f952a00e800 20 remove_watcher() i=3 2024-09-13T23:05:33.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.237+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94254189948272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b943829f00 con 0x55b94381ca20 2024-09-13T23:05:33.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.238+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94254189948272] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9518018950 con 0x55b94381ca20 2024-09-13T23:05:33.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.238+0000 7f952a00e800 20 remove_watcher() i=4 2024-09-13T23:05:33.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.238+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94254189936688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b94382c870 con 0x7f9520031040 2024-09-13T23:05:33.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.239+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94254189936688] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9518018950 con 0x7f9520031040 2024-09-13T23:05:33.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.239+0000 7f952a00e800 20 remove_watcher() i=5 2024-09-13T23:05:33.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.239+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94254189949328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b94382c870 con 0x7f9520031040 2024-09-13T23:05:33.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.240+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94254189949328] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9518018950 con 0x7f9520031040 2024-09-13T23:05:33.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.240+0000 7f952a00e800 20 remove_watcher() i=6 2024-09-13T23:05:33.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.240+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94254189952592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b94382c870 con 0x7f9520031040 2024-09-13T23:05:33.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94254189952592] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9518018950 con 0x7f9520031040 2024-09-13T23:05:33.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952a00e800 20 remove_watcher() i=7 2024-09-13T23:05:33.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f9520031040 msgr2=0x7f9520032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952a00e800 1 --2- 172.21.15.164:0/61712738 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f9520031040 0x7f9520032940 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b94381ca20 msgr2=0x55b94381eee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952a00e800 1 --2- 172.21.15.164:0/61712738 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b94381ca20 0x55b94381eee0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f951005f040 msgr2=0x7f9510084850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952a00e800 1 --2- 172.21.15.164:0/61712738 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f951005f040 0x7f9510084850 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55b943822b60 msgr2=0x55b943824f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952a00e800 1 --2- 172.21.15.164:0/61712738 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55b943822b60 0x55b943824f50 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f93f0036b40 msgr2=0x7f93f0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952a00e800 1 --2- 172.21.15.164:0/61712738 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f93f0036b40 0x7f93f0039000 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55b9437e4480 tx=0x7f952001f000 comp rx=0 tx=0).stop 2024-09-13T23:05:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b943809a20 msgr2=0x55b943810ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952a00e800 1 --2- 172.21.15.164:0/61712738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b943809a20 0x55b943810ee0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f951006afd0 tx=0x7f95100910a0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 reap_dead start 2024-09-13T23:05:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952571a640 1 -- 172.21.15.164:0/61712738 reap_dead start 2024-09-13T23:05:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 shutdown_connections 2024-09-13T23:05:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 >> 172.21.15.164:0/61712738 conn(0x55b943805d80 msgr2=0x55b943803e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 shutdown_connections 2024-09-13T23:05:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952a00e800 1 -- 172.21.15.164:0/61712738 wait complete. 2024-09-13T23:05:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952a00e800 1 -- 172.21.15.164:0/2870613336 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9400036b40 msgr2=0x7f9400039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952a00e800 1 --2- 172.21.15.164:0/2870613336 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9400036b40 0x7f9400039000 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x55b9437eb2b0 tx=0x7f9520005840 comp rx=0 tx=0).stop 2024-09-13T23:05:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952a00e800 1 -- 172.21.15.164:0/2870613336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9437dbf80 msgr2=0x55b9437da5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952a00e800 1 --2- 172.21.15.164:0/2870613336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9437dbf80 0x55b9437da5d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9510045f50 tx=0x7f9510002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952a00e800 1 -- 172.21.15.164:0/2870613336 shutdown_connections 2024-09-13T23:05:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952a00e800 1 --2- 172.21.15.164:0/2870613336 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9400036b40 0x7f9400039000 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952a00e800 1 --2- 172.21.15.164:0/2870613336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9437dbf80 0x55b9437da5d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952a00e800 1 -- 172.21.15.164:0/2870613336 >> 172.21.15.164:0/2870613336 conn(0x55b9437efbd0 msgr2=0x55b9437f2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952a00e800 1 -- 172.21.15.164:0/2870613336 shutdown_connections 2024-09-13T23:05:33.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.241+0000 7f952a00e800 1 -- 172.21.15.164:0/2870613336 wait complete. 2024-09-13T23:05:33.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.242+0000 7f952a00e800 1 -- 172.21.15.164:0/3168501925 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b9436ef990 msgr2=0x55b9437ea2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.242+0000 7f952a00e800 1 --2- 172.21.15.164:0/3168501925 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b9436ef990 0x55b9437ea2d0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.242+0000 7f952a00e800 1 -- 172.21.15.164:0/3168501925 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f940c036b90 msgr2=0x7f940c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.242+0000 7f952a00e800 1 --2- 172.21.15.164:0/3168501925 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f940c036b90 0x7f940c039050 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9510057000 tx=0x7f9510052000 comp rx=0 tx=0).stop 2024-09-13T23:05:33.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.242+0000 7f952a00e800 1 -- 172.21.15.164:0/3168501925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9436eb550 msgr2=0x55b9437e3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.242+0000 7f952a00e800 1 --2- 172.21.15.164:0/3168501925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9436eb550 0x55b9437e3260 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f951800b7c0 tx=0x7f9518000ed0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.242+0000 7f952a00e800 1 -- 172.21.15.164:0/3168501925 shutdown_connections 2024-09-13T23:05:33.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.242+0000 7f952a00e800 1 --2- 172.21.15.164:0/3168501925 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b9436ef990 0x55b9437ea2d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.242+0000 7f952a00e800 1 --2- 172.21.15.164:0/3168501925 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f940c036b90 0x7f940c039050 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.242+0000 7f952a00e800 1 --2- 172.21.15.164:0/3168501925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9436eb550 0x55b9437e3260 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.242+0000 7f952a00e800 1 -- 172.21.15.164:0/3168501925 >> 172.21.15.164:0/3168501925 conn(0x55b9436e6de0 msgr2=0x55b9437d49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.242+0000 7f952a00e800 1 -- 172.21.15.164:0/3168501925 shutdown_connections 2024-09-13T23:05:33.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.242+0000 7f952a00e800 1 -- 172.21.15.164:0/3168501925 wait complete. 2024-09-13T23:05:33.254 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:05:31.300851Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:05:31.300826Z', 'tags': [], 'group_ids': []} 2024-09-13T23:05:33.254 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-13T23:05:33.254 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-13T23:05:33.254 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-13T23:05:33.303 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:33.304 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:33.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.303+0000 7fc8fd413800 1 Processor -- start 2024-09-13T23:05:33.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.303+0000 7fc8fd413800 1 -- start start 2024-09-13T23:05:33.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.303+0000 7fc8fd413800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55a7dd6db4e0 0x55a7dd6db8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.303+0000 7fc8fd413800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a7dd59bb30 con 0x55a7dd6dbe20 2024-09-13T23:05:33.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.303+0000 7fc8fd413800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55a7dd57d360 con 0x55a7dd6db4e0 2024-09-13T23:05:33.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.304+0000 7fc8f8b44640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55a7dd6db4e0 0x55a7dd6db8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.304+0000 7fc8f0343640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55a7dd6dbe20 0x55a7dd6e09a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40822/0 (socket says 172.21.15.164:40822) 2024-09-13T23:05:33.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.304+0000 7fc8f0343640 1 -- 172.21.15.164:0/253661569 learned_addr learned my addr 172.21.15.164:0/253661569 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:33.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.304+0000 7fc8f3fff640 1 -- 172.21.15.164:0/253661569 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3347161243 0 0) 0x55a7dd59bb30 con 0x55a7dd6dbe20 2024-09-13T23:05:33.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.304+0000 7fc8f3fff640 1 -- 172.21.15.164:0/253661569 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8e4001e10 con 0x55a7dd6dbe20 2024-09-13T23:05:33.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.304+0000 7fc8f8b44640 1 -- 172.21.15.164:0/253661569 >> v1:172.21.15.17:6789/0 conn(0x55a7dd6dbe20 legacy=0x55a7dd6e09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.304+0000 7fc8f8b44640 1 -- 172.21.15.164:0/253661569 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7dd5a3e00 con 0x55a7dd6db4e0 2024-09-13T23:05:33.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.306+0000 7fc8f8b44640 1 --2- 172.21.15.164:0/253661569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd6db4e0 0x55a7dd6db8e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc8e800a470 tx=0x7fc8e8045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d0a0d2249b9506 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.306+0000 7fc8f3fff640 1 -- 172.21.15.164:0/253661569 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8e8059070 con 0x55a7dd6db4e0 2024-09-13T23:05:33.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.306+0000 7fc8f3fff640 1 -- 172.21.15.164:0/253661569 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8e8054570 con 0x55a7dd6db4e0 2024-09-13T23:05:33.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.306+0000 7fc8f3fff640 1 -- 172.21.15.164:0/253661569 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8e8054870 con 0x55a7dd6db4e0 2024-09-13T23:05:33.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.307+0000 7fc8fd413800 1 -- 172.21.15.164:0/253661569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd6db4e0 msgr2=0x55a7dd6db8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.307+0000 7fc8fd413800 1 --2- 172.21.15.164:0/253661569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd6db4e0 0x55a7dd6db8e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc8e800a470 tx=0x7fc8e8045920 comp rx=0 tx=0).stop 2024-09-13T23:05:33.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.307+0000 7fc8fd413800 1 -- 172.21.15.164:0/253661569 shutdown_connections 2024-09-13T23:05:33.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.307+0000 7fc8fd413800 1 --2- 172.21.15.164:0/253661569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd6db4e0 0x55a7dd6db8e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.307+0000 7fc8fd413800 1 -- 172.21.15.164:0/253661569 >> 172.21.15.164:0/253661569 conn(0x55a7dd6d6e10 msgr2=0x55a7dd6d9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.307+0000 7fc8fd413800 1 -- 172.21.15.164:0/253661569 shutdown_connections 2024-09-13T23:05:33.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.307+0000 7fc8fd413800 1 -- 172.21.15.164:0/253661569 wait complete. 2024-09-13T23:05:33.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.321+0000 7fc8fd413800 1 Processor -- start 2024-09-13T23:05:33.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.321+0000 7fc8fd413800 1 -- start start 2024-09-13T23:05:33.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.321+0000 7fc8fd413800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd6db4e0 0x55a7dd64fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.321+0000 7fc8fd413800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a7dd628350 con 0x55a7dd6db4e0 2024-09-13T23:05:33.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.321+0000 7fc8f8b44640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd6db4e0 0x55a7dd64fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.321+0000 7fc8f8b44640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd6db4e0 0x55a7dd64fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56978/0 (socket says 172.21.15.164:56978) 2024-09-13T23:05:33.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.321+0000 7fc8f8b44640 1 -- 172.21.15.164:0/1706639717 learned_addr learned my addr 172.21.15.164:0/1706639717 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.322+0000 7fc8f8b44640 1 -- 172.21.15.164:0/1706639717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7dd575bc0 con 0x55a7dd6db4e0 2024-09-13T23:05:33.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.322+0000 7fc8f8b44640 1 --2- 172.21.15.164:0/1706639717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd6db4e0 0x55a7dd64fda0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8025b20 tx=0x7fc8e804e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dfa2daf8fb359d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.322+0000 7fc7e6e0d640 1 -- 172.21.15.164:0/1706639717 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8e8062070 con 0x55a7dd6db4e0 2024-09-13T23:05:33.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.322+0000 7fc7e6e0d640 1 -- 172.21.15.164:0/1706639717 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8e800a170 con 0x55a7dd6db4e0 2024-09-13T23:05:33.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.322+0000 7fc7e6e0d640 1 -- 172.21.15.164:0/1706639717 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8e8059040 con 0x55a7dd6db4e0 2024-09-13T23:05:33.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.323+0000 7fc8fd413800 1 -- 172.21.15.164:0/1706639717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd6db4e0 msgr2=0x55a7dd64fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.323+0000 7fc8fd413800 1 --2- 172.21.15.164:0/1706639717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd6db4e0 0x55a7dd64fda0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8025b20 tx=0x7fc8e804e000 comp rx=0 tx=0).stop 2024-09-13T23:05:33.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.323+0000 7fc8fd413800 1 -- 172.21.15.164:0/1706639717 shutdown_connections 2024-09-13T23:05:33.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.323+0000 7fc8fd413800 1 --2- 172.21.15.164:0/1706639717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd6db4e0 0x55a7dd64fda0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.323+0000 7fc8fd413800 1 -- 172.21.15.164:0/1706639717 >> 172.21.15.164:0/1706639717 conn(0x55a7dd6d6e10 msgr2=0x55a7dd7c6010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.323+0000 7fc8fd413800 1 -- 172.21.15.164:0/1706639717 shutdown_connections 2024-09-13T23:05:33.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.323+0000 7fc8fd413800 1 -- 172.21.15.164:0/1706639717 wait complete. 2024-09-13T23:05:33.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.323+0000 7fc8fd413800 1 Processor -- start 2024-09-13T23:05:33.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.323+0000 7fc8fd413800 1 -- start start 2024-09-13T23:05:33.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.323+0000 7fc8fd413800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd6db4e0 0x55a7dd7d3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.323+0000 7fc8fd413800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a7dd6e2500 con 0x55a7dd6db4e0 2024-09-13T23:05:33.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.324+0000 7fc8f8b44640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd6db4e0 0x55a7dd7d3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.324+0000 7fc8f8b44640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd6db4e0 0x55a7dd7d3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56990/0 (socket says 172.21.15.164:56990) 2024-09-13T23:05:33.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.324+0000 7fc8f8b44640 1 -- 172.21.15.164:0/3556556806 learned_addr learned my addr 172.21.15.164:0/3556556806 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.324+0000 7fc8f8b44640 1 -- 172.21.15.164:0/3556556806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7dd589fe0 con 0x55a7dd6db4e0 2024-09-13T23:05:33.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.324+0000 7fc8f8b44640 1 --2- 172.21.15.164:0/3556556806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd6db4e0 0x55a7dd7d3130 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8045960 tx=0x7fc8e8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.324+0000 7fc7e560a640 1 -- 172.21.15.164:0/3556556806 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8e806c070 con 0x55a7dd6db4e0 2024-09-13T23:05:33.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.324+0000 7fc7e560a640 1 -- 172.21.15.164:0/3556556806 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8e8054bf0 con 0x55a7dd6db4e0 2024-09-13T23:05:33.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.324+0000 7fc8fd413800 1 -- 172.21.15.164:0/3556556806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a7dd7d3670 con 0x55a7dd6db4e0 2024-09-13T23:05:33.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.324+0000 7fc7e560a640 1 -- 172.21.15.164:0/3556556806 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8e8062070 con 0x55a7dd6db4e0 2024-09-13T23:05:33.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.324+0000 7fc8fd413800 1 -- 172.21.15.164:0/3556556806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7dd7d3b90 con 0x55a7dd6db4e0 2024-09-13T23:05:33.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.325+0000 7fc7e560a640 1 -- 172.21.15.164:0/3556556806 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc8e8065040 con 0x55a7dd6db4e0 2024-09-13T23:05:33.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.325+0000 7fc7e560a640 1 --2- 172.21.15.164:0/3556556806 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc7e0036b90 0x7fc7e0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.325+0000 7fc7e560a640 1 -- 172.21.15.164:0/3556556806 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc8e808f310 con 0x55a7dd6db4e0 2024-09-13T23:05:33.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.325+0000 7fc8f0343640 1 --2- 172.21.15.164:0/3556556806 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc7e0036b90 0x7fc7e0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.326+0000 7fc8fd413800 1 --2- 172.21.15.164:0/3556556806 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a7dd6dbe20 0x55a7dd7da1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.326+0000 7fc8fd413800 1 -- 172.21.15.164:0/3556556806 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd7da6e0 con 0x55a7dd6dbe20 2024-09-13T23:05:33.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.326+0000 7fc8f9345640 1 --2- 172.21.15.164:0/3556556806 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a7dd6dbe20 0x55a7dd7da1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.326+0000 7fc8f0343640 1 --2- 172.21.15.164:0/3556556806 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc7e0036b90 0x7fc7e0039050 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0000f60 tx=0x7fc8e00010a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.326+0000 7fc8f9345640 1 --2- 172.21.15.164:0/3556556806 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a7dd6dbe20 0x55a7dd7da1a0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.326+0000 7fc8f9345640 1 -- 172.21.15.164:0/3556556806 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8f400a4a0 con 0x55a7dd6dbe20 2024-09-13T23:05:33.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.326+0000 7fc8fd413800 1 -- 172.21.15.164:0/3556556806 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd7d7750 con 0x55a7dd6dbe20 2024-09-13T23:05:33.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.326+0000 7fc8f9345640 1 -- 172.21.15.164:0/3556556806 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc8f400a4a0 con 0x55a7dd6dbe20 2024-09-13T23:05:33.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.326+0000 7fc8fd413800 1 -- 172.21.15.164:0/3556556806 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd7dc4c0 con 0x55a7dd6dbe20 2024-09-13T23:05:33.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.327+0000 7fc8f9345640 1 -- 172.21.15.164:0/3556556806 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc8f400a4a0 con 0x55a7dd6dbe20 2024-09-13T23:05:33.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.327+0000 7fc8fd413800 1 -- 172.21.15.164:0/3556556806 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd7db600 con 0x55a7dd6dbe20 2024-09-13T23:05:33.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.327+0000 7fc8f9345640 1 -- 172.21.15.164:0/3556556806 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc8f400a4a0 con 0x55a7dd6dbe20 2024-09-13T23:05:33.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.327+0000 7fc8fd413800 1 -- 172.21.15.164:0/3556556806 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd7dba20 con 0x55a7dd6dbe20 2024-09-13T23:05:33.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.327+0000 7fc8f9345640 1 -- 172.21.15.164:0/3556556806 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc8f400a4a0 con 0x55a7dd6dbe20 2024-09-13T23:05:33.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.328+0000 7fc8fd413800 1 Processor -- start 2024-09-13T23:05:33.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.328+0000 7fc8fd413800 1 -- start start 2024-09-13T23:05:33.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.328+0000 7fc8fd413800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd7eaaf0 0x55a7dd7eaf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.328+0000 7fc8fd413800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a7dd577580 con 0x55a7dd7eaaf0 2024-09-13T23:05:33.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.328+0000 7fc8f0343640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd7eaaf0 0x55a7dd7eaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.328+0000 7fc8f0343640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd7eaaf0 0x55a7dd7eaf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:56996/0 (socket says 172.21.15.164:56996) 2024-09-13T23:05:33.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.328+0000 7fc8f0343640 1 -- 172.21.15.164:0/1554979542 learned_addr learned my addr 172.21.15.164:0/1554979542 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.328+0000 7fc8f0343640 1 -- 172.21.15.164:0/1554979542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7dd7eb450 con 0x55a7dd7eaaf0 2024-09-13T23:05:33.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.329+0000 7fc8f0343640 1 --2- 172.21.15.164:0/1554979542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd7eaaf0 0x55a7dd7eaf10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000bec0 tx=0x7fc8e000d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.329+0000 7fc7de7fc640 1 -- 172.21.15.164:0/1554979542 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8e001b550 con 0x55a7dd7eaaf0 2024-09-13T23:05:33.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.329+0000 7fc7de7fc640 1 -- 172.21.15.164:0/1554979542 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8e001b6f0 con 0x55a7dd7eaaf0 2024-09-13T23:05:33.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.329+0000 7fc8fd413800 1 -- 172.21.15.164:0/1554979542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a7dd7eb6e0 con 0x55a7dd7eaaf0 2024-09-13T23:05:33.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.329+0000 7fc7de7fc640 1 -- 172.21.15.164:0/1554979542 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8e001ba10 con 0x55a7dd7eaaf0 2024-09-13T23:05:33.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.329+0000 7fc8fd413800 1 -- 172.21.15.164:0/1554979542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7dd7ee3c0 con 0x55a7dd7eaaf0 2024-09-13T23:05:33.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.330+0000 7fc7de7fc640 1 -- 172.21.15.164:0/1554979542 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc8e0023020 con 0x55a7dd7eaaf0 2024-09-13T23:05:33.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.330+0000 7fc7de7fc640 1 --2- 172.21.15.164:0/1554979542 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc7d0036b90 0x7fc7d0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.330+0000 7fc7de7fc640 1 -- 172.21.15.164:0/1554979542 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc8e0021020 con 0x55a7dd7eaaf0 2024-09-13T23:05:33.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.330+0000 7fc8f9345640 1 --2- 172.21.15.164:0/1554979542 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc7d0036b90 0x7fc7d0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.330+0000 7fc8fd413800 1 Processor -- start 2024-09-13T23:05:33.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.330+0000 7fc8f9345640 1 --2- 172.21.15.164:0/1554979542 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc7d0036b90 0x7fc7d0039050 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55a7dd7db9a0 tx=0x7fc8f4005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.330+0000 7fc8fd413800 1 -- start start 2024-09-13T23:05:33.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.330+0000 7fc8fd413800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd7cb6b0 0x55a7dd7cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.330+0000 7fc8fd413800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a7dd7ce570 con 0x55a7dd7cb6b0 2024-09-13T23:05:33.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.331+0000 7fc8f0343640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd7cb6b0 0x55a7dd7cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.331+0000 7fc8f0343640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd7cb6b0 0x55a7dd7cbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57002/0 (socket says 172.21.15.164:57002) 2024-09-13T23:05:33.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.331+0000 7fc8f0343640 1 -- 172.21.15.164:0/2804534778 learned_addr learned my addr 172.21.15.164:0/2804534778 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.331+0000 7fc8f0343640 1 -- 172.21.15.164:0/2804534778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7dd7cc080 con 0x55a7dd7cb6b0 2024-09-13T23:05:33.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.331+0000 7fc8f0343640 1 --2- 172.21.15.164:0/2804534778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd7cb6b0 0x55a7dd7cbab0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc8e004d110 tx=0x7fc8e000ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca5011dd748718c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.331+0000 7fc7cffff640 1 -- 172.21.15.164:0/2804534778 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8e00197d0 con 0x55a7dd7cb6b0 2024-09-13T23:05:33.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.331+0000 7fc7cffff640 1 -- 172.21.15.164:0/2804534778 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8e0046070 con 0x55a7dd7cb6b0 2024-09-13T23:05:33.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.331+0000 7fc7cffff640 1 -- 172.21.15.164:0/2804534778 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8e0025410 con 0x55a7dd7cb6b0 2024-09-13T23:05:33.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.331+0000 7fc8fd413800 1 -- 172.21.15.164:0/2804534778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd7cb6b0 msgr2=0x55a7dd7cbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.331+0000 7fc8fd413800 1 --2- 172.21.15.164:0/2804534778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd7cb6b0 0x55a7dd7cbab0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc8e004d110 tx=0x7fc8e000ce40 comp rx=0 tx=0).stop 2024-09-13T23:05:33.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.332+0000 7fc8fd413800 1 -- 172.21.15.164:0/2804534778 shutdown_connections 2024-09-13T23:05:33.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.332+0000 7fc8fd413800 1 --2- 172.21.15.164:0/2804534778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd7cb6b0 0x55a7dd7cbab0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.332+0000 7fc8fd413800 1 -- 172.21.15.164:0/2804534778 >> 172.21.15.164:0/2804534778 conn(0x55a7dd7f3b60 msgr2=0x55a7dd7f1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.332+0000 7fc8fd413800 1 -- 172.21.15.164:0/2804534778 shutdown_connections 2024-09-13T23:05:33.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.332+0000 7fc8fd413800 1 -- 172.21.15.164:0/2804534778 wait complete. 2024-09-13T23:05:33.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.332+0000 7fc8fd413800 1 Processor -- start 2024-09-13T23:05:33.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.332+0000 7fc8fd413800 1 -- start start 2024-09-13T23:05:33.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.332+0000 7fc8fd413800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd7cb6b0 0x55a7dd800eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.332+0000 7fc8fd413800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a7dd7ca3e0 con 0x55a7dd7cb6b0 2024-09-13T23:05:33.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.332+0000 7fc8f0343640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd7cb6b0 0x55a7dd800eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.332+0000 7fc8f0343640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd7cb6b0 0x55a7dd800eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57018/0 (socket says 172.21.15.164:57018) 2024-09-13T23:05:33.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.332+0000 7fc8f0343640 1 -- 172.21.15.164:0/950626537 learned_addr learned my addr 172.21.15.164:0/950626537 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.332+0000 7fc8f0343640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7dd8013f0 con 0x55a7dd7cb6b0 2024-09-13T23:05:33.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.333+0000 7fc8f0343640 1 --2- 172.21.15.164:0/950626537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd7cb6b0 0x55a7dd800eb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000ce80 tx=0x7fc8e004d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.333+0000 7fc7ce7fc640 1 -- 172.21.15.164:0/950626537 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8e00197d0 con 0x55a7dd7cb6b0 2024-09-13T23:05:33.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.333+0000 7fc7ce7fc640 1 -- 172.21.15.164:0/950626537 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8e0040040 con 0x55a7dd7cb6b0 2024-09-13T23:05:33.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.333+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a7dd801680 con 0x55a7dd7cb6b0 2024-09-13T23:05:33.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.333+0000 7fc7ce7fc640 1 -- 172.21.15.164:0/950626537 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8e0041e40 con 0x55a7dd7cb6b0 2024-09-13T23:05:33.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.333+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7dd801680 con 0x55a7dd7cb6b0 2024-09-13T23:05:33.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.333+0000 7fc7ce7fc640 1 -- 172.21.15.164:0/950626537 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc8e000c360 con 0x55a7dd7cb6b0 2024-09-13T23:05:33.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.334+0000 7fc7ce7fc640 1 --2- 172.21.15.164:0/950626537 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc7c4036b90 0x7fc7c4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.334+0000 7fc7ce7fc640 1 -- 172.21.15.164:0/950626537 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc8e003bca0 con 0x55a7dd7cb6b0 2024-09-13T23:05:33.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.334+0000 7fc8f9345640 1 --2- 172.21.15.164:0/950626537 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc7c4036b90 0x7fc7c4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.334+0000 7fc8f9345640 1 --2- 172.21.15.164:0/950626537 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc7c4036b90 0x7fc7c4039050 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55a7dd7db120 tx=0x7fc8f401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.335+0000 7fc8fd413800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.335+0000 7fc8fd413800 1 --2- 172.21.15.164:0/950626537 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a7dd80c7d0 0x55a7dd80ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.335+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd80f3e0 con 0x55a7dd80c7d0 2024-09-13T23:05:33.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.335+0000 7fc8f8b44640 1 --2- 172.21.15.164:0/950626537 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a7dd80c7d0 0x55a7dd80ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.335+0000 7fc8f8b44640 1 --2- 172.21.15.164:0/950626537 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a7dd80c7d0 0x55a7dd80ec90 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.335+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.335+0000 7fc8fd413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.335+0000 7fc8fd413800 20 realm 2024-09-13T23:05:33.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.335+0000 7fc8fd413800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.335+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd80f7f0 con 0x55a7dd80c7d0 2024-09-13T23:05:33.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.335+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.335+0000 7fc8fd413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.335+0000 7fc8fd413800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:33.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.335+0000 7fc8fd413800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.335+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd8100c0 con 0x55a7dd80c7d0 2024-09-13T23:05:33.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.336+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.336+0000 7fc8fd413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.336+0000 7fc8fd413800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.336+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd810460 con 0x55a7dd80c7d0 2024-09-13T23:05:33.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.336+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.336+0000 7fc8fd413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:33.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.336+0000 7fc8fd413800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.336+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd810cb0 con 0x55a7dd80c7d0 2024-09-13T23:05:33.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.336+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.336+0000 7fc8fd413800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:33.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.336+0000 7fc8fd413800 20 searching for the correct realm 2024-09-13T23:05:33.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.336+0000 7fc8fd413800 1 --2- 172.21.15.164:0/950626537 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55a7dd812a20 0x55a7dd814e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.336+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x55a7dd812a20 2024-09-13T23:05:33.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.336+0000 7fc8f0343640 1 --2- 172.21.15.164:0/950626537 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55a7dd812a20 0x55a7dd814e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.337+0000 7fc8f0343640 1 --2- 172.21.15.164:0/950626537 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55a7dd812a20 0x55a7dd814e10 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.337+0000 7fc8f0343640 1 -- 172.21.15.164:0/950626537 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e0009050 con 0x55a7dd812a20 2024-09-13T23:05:33.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.337+0000 7fc8f0343640 1 --2- 172.21.15.164:0/950626537 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc8e0059040 0x7fc8e00246b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.337+0000 7fc8f0343640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x7fc8e0059040 2024-09-13T23:05:33.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.337+0000 7fc8f9345640 1 --2- 172.21.15.164:0/950626537 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc8e0059040 0x7fc8e00246b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.337+0000 7fc8f9345640 1 --2- 172.21.15.164:0/950626537 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc8e0059040 0x7fc8e00246b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.338+0000 7fc8f9345640 1 -- 172.21.15.164:0/950626537 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8f401f070 con 0x7fc8e0059040 2024-09-13T23:05:33.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.338+0000 7fc8f9345640 1 --2- 172.21.15.164:0/950626537 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc8f4031040 0x7fc8f4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.338+0000 7fc8f9345640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x7fc8f4031040 2024-09-13T23:05:33.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.338+0000 7fc8f8b44640 1 --2- 172.21.15.164:0/950626537 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc8f4031040 0x7fc8f4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.338+0000 7fc8f8b44640 1 --2- 172.21.15.164:0/950626537 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc8f4031040 0x7fc8f4032940 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.338+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e805c040 con 0x7fc8f4031040 2024-09-13T23:05:33.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.338+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x55a7dd80c7d0 2024-09-13T23:05:33.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.339+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.339+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x55a7dd80c7d0 2024-09-13T23:05:33.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.339+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.339+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x7fc8f4031040 2024-09-13T23:05:33.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.339+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e805c040 con 0x7fc8f4031040 2024-09-13T23:05:33.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.339+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x7fc8f4031040 2024-09-13T23:05:33.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.339+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e805c040 con 0x7fc8f4031040 2024-09-13T23:05:33.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.339+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x7fc8e0059040 2024-09-13T23:05:33.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.340+0000 7fc8f9345640 1 -- 172.21.15.164:0/950626537 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8f401f070 con 0x7fc8e0059040 2024-09-13T23:05:33.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.340+0000 7fc8f9345640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x55a7dd812a20 2024-09-13T23:05:33.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.340+0000 7fc8f0343640 1 -- 172.21.15.164:0/950626537 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e0009050 con 0x55a7dd812a20 2024-09-13T23:05:33.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.340+0000 7fc8f0343640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x55a7dd80c7d0 2024-09-13T23:05:33.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.340+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.340+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x7fc8f4031040 2024-09-13T23:05:33.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.340+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e805c040 con 0x7fc8f4031040 2024-09-13T23:05:33.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.340+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x55a7dd80c7d0 2024-09-13T23:05:33.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.341+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.341+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x7fc8e0059040 2024-09-13T23:05:33.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.341+0000 7fc8f9345640 1 -- 172.21.15.164:0/950626537 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc8f401f070 con 0x7fc8e0059040 2024-09-13T23:05:33.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.341+0000 7fc8f9345640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x55a7dd812a20 2024-09-13T23:05:33.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.341+0000 7fc8f0343640 1 -- 172.21.15.164:0/950626537 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e0009050 con 0x55a7dd812a20 2024-09-13T23:05:33.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.341+0000 7fc8f0343640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x55a7dd812a20 2024-09-13T23:05:33.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.341+0000 7fc8f0343640 1 -- 172.21.15.164:0/950626537 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e0009050 con 0x55a7dd812a20 2024-09-13T23:05:33.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.341+0000 7fc8f0343640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x7fc8f4031040 2024-09-13T23:05:33.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.342+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e805c040 con 0x7fc8f4031040 2024-09-13T23:05:33.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.342+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x55a7dd812a20 2024-09-13T23:05:33.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.342+0000 7fc8f0343640 1 -- 172.21.15.164:0/950626537 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e0009050 con 0x55a7dd812a20 2024-09-13T23:05:33.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.342+0000 7fc8f0343640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x55a7dd812a20 2024-09-13T23:05:33.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.342+0000 7fc8f0343640 1 -- 172.21.15.164:0/950626537 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e0009050 con 0x55a7dd812a20 2024-09-13T23:05:33.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.342+0000 7fc8f0343640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x55a7dd80c7d0 2024-09-13T23:05:33.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.342+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.342+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x55a7dd80c7d0 2024-09-13T23:05:33.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.343+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.343+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x7fc8f4031040 2024-09-13T23:05:33.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.343+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e805c040 con 0x7fc8f4031040 2024-09-13T23:05:33.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.343+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x55a7dd812a20 2024-09-13T23:05:33.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.343+0000 7fc8f0343640 1 -- 172.21.15.164:0/950626537 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e0009050 con 0x55a7dd812a20 2024-09-13T23:05:33.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.343+0000 7fc8f0343640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x7fc8e0059040 2024-09-13T23:05:33.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.343+0000 7fc8f9345640 1 -- 172.21.15.164:0/950626537 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8f401f070 con 0x7fc8e0059040 2024-09-13T23:05:33.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.343+0000 7fc8f9345640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x55a7dd80c7d0 2024-09-13T23:05:33.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.344+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.344+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x7fc8f4031040 2024-09-13T23:05:33.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.344+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e805c040 con 0x7fc8f4031040 2024-09-13T23:05:33.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.344+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x55a7dd812a20 2024-09-13T23:05:33.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.344+0000 7fc8f0343640 1 -- 172.21.15.164:0/950626537 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e0009050 con 0x55a7dd812a20 2024-09-13T23:05:33.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.344+0000 7fc8f0343640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x7fc8f4031040 2024-09-13T23:05:33.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.344+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e805c040 con 0x7fc8f4031040 2024-09-13T23:05:33.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.344+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x7fc8e0059040 2024-09-13T23:05:33.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.345+0000 7fc8f9345640 1 -- 172.21.15.164:0/950626537 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8f401f070 con 0x7fc8e0059040 2024-09-13T23:05:33.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.345+0000 7fc8f9345640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x55a7dd812a20 2024-09-13T23:05:33.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.345+0000 7fc8f0343640 1 -- 172.21.15.164:0/950626537 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e0009050 con 0x55a7dd812a20 2024-09-13T23:05:33.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.345+0000 7fc8f0343640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x7fc8f4031040 2024-09-13T23:05:33.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.345+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8e805c040 con 0x7fc8f4031040 2024-09-13T23:05:33.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.345+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x55a7dd80c7d0 2024-09-13T23:05:33.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.345+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.345+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd815420 con 0x7fc8e0059040 2024-09-13T23:05:33.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.346+0000 7fc8f9345640 1 -- 172.21.15.164:0/950626537 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8f401f070 con 0x7fc8e0059040 2024-09-13T23:05:33.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.346+0000 7fc8fd413800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:33.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.346+0000 7fc8fd413800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:33.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.346+0000 7fc8fd413800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:33.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.346+0000 7fc8fd413800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:33.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.346+0000 7fc8fd413800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:33.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.346+0000 7fc8fd413800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:33.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.346+0000 7fc8fd413800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.346+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd811630 con 0x55a7dd80c7d0 2024-09-13T23:05:33.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.346+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.346+0000 7fc8fd413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.346+0000 7fc8fd413800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.346+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd811a20 con 0x55a7dd80c7d0 2024-09-13T23:05:33.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.346+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.346+0000 7fc8fd413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:33.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.346+0000 7fc8fd413800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.346+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd811a20 con 0x55a7dd80c7d0 2024-09-13T23:05:33.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.346+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.346+0000 7fc8fd413800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:33.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.346+0000 7fc8fd413800 20 zone default found 2024-09-13T23:05:33.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.346+0000 7fc8fd413800 4 Realm: () 2024-09-13T23:05:33.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.346+0000 7fc8fd413800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:33.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.346+0000 7fc8fd413800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:33.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.346+0000 7fc8fd413800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:33.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.346+0000 7fc8fd413800 20 zonegroup default 2024-09-13T23:05:33.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.346+0000 7fc8fd413800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.346+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd811e40 con 0x7fc8f4031040 2024-09-13T23:05:33.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.347+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc8e805c040 con 0x7fc8f4031040 2024-09-13T23:05:33.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.347+0000 7fc8fd413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.347+0000 7fc8fd413800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.347+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd811e40 con 0x55a7dd812a20 2024-09-13T23:05:33.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.347+0000 7fc8f0343640 1 -- 172.21.15.164:0/950626537 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc8e0009050 con 0x55a7dd812a20 2024-09-13T23:05:33.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.347+0000 7fc8fd413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.347+0000 7fc8fd413800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.347+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd817380 con 0x55a7dd812a20 2024-09-13T23:05:33.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.347+0000 7fc8f0343640 1 -- 172.21.15.164:0/950626537 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc8e0009050 con 0x55a7dd812a20 2024-09-13T23:05:33.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.347+0000 7fc8fd413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.347+0000 7fc8fd413800 20 started sync module instance, tier type = 2024-09-13T23:05:33.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.347+0000 7fc8fd413800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:33.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.347+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd816720 con 0x7fc8e0059040 2024-09-13T23:05:33.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.348+0000 7fc8f9345640 1 -- 172.21.15.164:0/950626537 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8f4040040 con 0x7fc8e0059040 2024-09-13T23:05:33.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.348+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94179464145680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd816380 con 0x7fc8e0059040 2024-09-13T23:05:33.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.348+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd8182b0 con 0x55a7dd80c7d0 2024-09-13T23:05:33.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.349+0000 7fc8f9345640 1 -- 172.21.15.164:0/950626537 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94179464145680] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8f4040040 con 0x7fc8e0059040 2024-09-13T23:05:33.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.349+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.349+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94179464148960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd8182b0 con 0x55a7dd80c7d0 2024-09-13T23:05:33.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.349+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd818cd0 con 0x55a7dd812a20 2024-09-13T23:05:33.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.350+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94179464148960] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.350+0000 7fc8f0343640 1 -- 172.21.15.164:0/950626537 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e0009050 con 0x55a7dd812a20 2024-09-13T23:05:33.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.350+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94179464150528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd818220 con 0x55a7dd812a20 2024-09-13T23:05:33.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.350+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd819b90 con 0x7fc8e0059040 2024-09-13T23:05:33.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.351+0000 7fc8f0343640 1 -- 172.21.15.164:0/950626537 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94179464150528] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e0009050 con 0x55a7dd812a20 2024-09-13T23:05:33.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.351+0000 7fc8f9345640 1 -- 172.21.15.164:0/950626537 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8f4040040 con 0x7fc8e0059040 2024-09-13T23:05:33.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.351+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94179464156896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd819fb0 con 0x7fc8e0059040 2024-09-13T23:05:33.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.351+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd81a970 con 0x55a7dd80c7d0 2024-09-13T23:05:33.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.352+0000 7fc8f9345640 1 -- 172.21.15.164:0/950626537 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94179464156896] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8f4040040 con 0x7fc8e0059040 2024-09-13T23:05:33.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.352+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.352+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94179464160928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd819fb0 con 0x55a7dd80c7d0 2024-09-13T23:05:33.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.352+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd81b3c0 con 0x7fc8f4031040 2024-09-13T23:05:33.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.353+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94179464160928] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.353+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e805c040 con 0x7fc8f4031040 2024-09-13T23:05:33.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.353+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94179464163024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd819fb0 con 0x7fc8f4031040 2024-09-13T23:05:33.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.353+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd81bdd0 con 0x7fc8f4031040 2024-09-13T23:05:33.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.354+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e805c040 con 0x7fc8f4031040 2024-09-13T23:05:33.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.354+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94179464165664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd81c1f0 con 0x7fc8f4031040 2024-09-13T23:05:33.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.354+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd81ccf0 con 0x7fc8f4031040 2024-09-13T23:05:33.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.355+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94179464163024] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e805c040 con 0x7fc8f4031040 2024-09-13T23:05:33.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.355+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e805c040 con 0x7fc8f4031040 2024-09-13T23:05:33.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.355+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94179464169440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd81ccb0 con 0x7fc8f4031040 2024-09-13T23:05:33.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.355+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94179464165664] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e805c040 con 0x7fc8f4031040 2024-09-13T23:05:33.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.355+0000 7fc8fd413800 20 add_watcher() i=0 2024-09-13T23:05:33.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.355+0000 7fc8fd413800 20 add_watcher() i=1 2024-09-13T23:05:33.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.355+0000 7fc8fd413800 20 add_watcher() i=2 2024-09-13T23:05:33.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.355+0000 7fc8fd413800 20 add_watcher() i=3 2024-09-13T23:05:33.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.355+0000 7fc8fd413800 20 add_watcher() i=4 2024-09-13T23:05:33.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.355+0000 7fc8fd413800 20 add_watcher() i=5 2024-09-13T23:05:33.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.355+0000 7fc8fd413800 20 add_watcher() i=6 2024-09-13T23:05:33.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.356+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94179464169440] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e805c040 con 0x7fc8f4031040 2024-09-13T23:05:33.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.356+0000 7fc8fd413800 20 add_watcher() i=7 2024-09-13T23:05:33.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.356+0000 7fc8fd413800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:33.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.356+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd81fce0 con 0x55a7dd80c7d0 2024-09-13T23:05:33.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.357+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.357+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94179464157952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd81d160 con 0x55a7dd80c7d0 2024-09-13T23:05:33.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.358+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94179464157952] v32'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.358+0000 7fc7aefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:33.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.358+0000 7fc8fd413800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:33.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.358+0000 7fc8fd413800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:33.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.358+0000 7fc8fd413800 5 note: GC not initialized 2024-09-13T23:05:33.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.358+0000 7fc7adfe3640 20 reqs_thread_entry: start 2024-09-13T23:05:33.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.358+0000 7fc8fd413800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:33.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.358+0000 7fc8fd413800 20 Filter name: none 2024-09-13T23:05:33.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.358+0000 7fc71f7fe640 20 reqs_thread_entry: start 2024-09-13T23:05:33.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.358+0000 7fc8fd413800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:05:33.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.358+0000 7fc8fd413800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.358+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd853090 con 0x55a7dd80c7d0 2024-09-13T23:05:33.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.359+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.359+0000 7fc8fd413800 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T23:05:33.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.359+0000 7fc8fd413800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:05:33.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.359+0000 7fc8fd413800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:33.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.359+0000 7fc8fd413800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:33.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.359+0000 7fc8fd413800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-13T23:05:33.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.359+0000 7fc8fd413800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.359+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd853e20 con 0x7fc8e0059040 2024-09-13T23:05:33.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.359+0000 7fc8f9345640 1 -- 172.21.15.164:0/950626537 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7fc8f4040040 con 0x7fc8e0059040 2024-09-13T23:05:33.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.359+0000 7fc8fd413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.359+0000 7fc8fd413800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-13T23:05:33.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.359+0000 7fc8fd413800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-13T23:05:33.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.359+0000 7fc8fd413800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-13T23:05:33.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.359+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd859c70 con 0x55a7dd80c7d0 2024-09-13T23:05:33.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.360+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v32'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.360+0000 7fc8fd413800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:33.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.360+0000 7fc8fd413800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:33.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.360+0000 7fc8fd413800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:05:33.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.360+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94179464418896 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd856710 con 0x55a7dd80c7d0 2024-09-13T23:05:33.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.361+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== watch-notify(notify (1) cookie 94179464160928 notify 137438953479 ret 0) ==== 891+0+0 (crc 0 0 0) 0x55a7dd7d3b90 con 0x55a7dd80c7d0 2024-09-13T23:05:33.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.361+0000 7fc7cffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 94179464160928 notifier 4400 bl.length()=849 2024-09-13T23:05:33.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.361+0000 7fc7cffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:33.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.361+0000 7fc7cffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:33.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.361+0000 7fc7cffff640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc7bc003ea0 con 0x55a7dd80c7d0 2024-09-13T23:05:33.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.361+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(65 notify.4 [notify cookie 94179464418896 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.361+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.361+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== watch-notify(notify_complete (2) cookie 94179464418896 notify 137438953479 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a7dd7d3670 con 0x55a7dd80c7d0 2024-09-13T23:05:33.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.361+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd859650 con 0x7fc8e0059040 2024-09-13T23:05:33.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.362+0000 7fc8f9345640 1 -- 172.21.15.164:0/950626537 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7fc8f4040040 con 0x7fc8e0059040 2024-09-13T23:05:33.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.362+0000 7fc8fd413800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-13T23:05:33.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.362+0000 7fc8fd413800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-13T23:05:33.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.362+0000 7fc8fd413800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-13T23:05:33.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.362+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94179464418896 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd856710 con 0x7fc8e0059040 2024-09-13T23:05:33.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.362+0000 7fc8f9345640 1 -- 172.21.15.164:0/950626537 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== watch-notify(notify (1) cookie 94179464145680 notify 137438953475 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7fc8f4014420 con 0x7fc8e0059040 2024-09-13T23:05:33.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.362+0000 7fc7cf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94179464145680 notifier 4400 bl.length()=166 2024-09-13T23:05:33.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.362+0000 7fc7cf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-13T23:05:33.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.362+0000 7fc7cf7fe640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-13T23:05:33.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.362+0000 7fc8f9345640 1 -- 172.21.15.164:0/950626537 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(68 notify.0 [notify cookie 94179464418896 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc8f4040040 con 0x7fc8e0059040 2024-09-13T23:05:33.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.362+0000 7fc7cf7fe640 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc72c003400 con 0x7fc8e0059040 2024-09-13T23:05:33.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.363+0000 7fc8f9345640 1 -- 172.21.15.164:0/950626537 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8f4040040 con 0x7fc8e0059040 2024-09-13T23:05:33.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.363+0000 7fc8f9345640 1 -- 172.21.15.164:0/950626537 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== watch-notify(notify_complete (2) cookie 94179464418896 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc8f4024860 con 0x7fc8e0059040 2024-09-13T23:05:33.380 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:05:31.300851Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-13T23:05:33.360148Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:05:31.300826Z","tags":[],"group_ids":[]} 2024-09-13T23:05:33.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.364+0000 7fc7aefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:33.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.364+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94179464157952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd850dc0 con 0x55a7dd80c7d0 2024-09-13T23:05:33.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.365+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94179464157952] v32'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.365+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94179464145680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd850dc0 con 0x7fc8e0059040 2024-09-13T23:05:33.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.365+0000 7fc8f9345640 1 -- 172.21.15.164:0/950626537 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94179464145680] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8f4040040 con 0x7fc8e0059040 2024-09-13T23:05:33.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.365+0000 7fc8fd413800 20 remove_watcher() i=0 2024-09-13T23:05:33.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.366+0000 7fc8fd413800 2 removed watcher, disabling cache 2024-09-13T23:05:33.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.366+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94179464148960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd850dc0 con 0x55a7dd80c7d0 2024-09-13T23:05:33.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.367+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94179464148960] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.367+0000 7fc8fd413800 20 remove_watcher() i=1 2024-09-13T23:05:33.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.367+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94179464150528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd850dc0 con 0x55a7dd812a20 2024-09-13T23:05:33.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.368+0000 7fc8f0343640 1 -- 172.21.15.164:0/950626537 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94179464150528] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e0009050 con 0x55a7dd812a20 2024-09-13T23:05:33.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.368+0000 7fc8fd413800 20 remove_watcher() i=2 2024-09-13T23:05:33.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.368+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94179464156896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd816b10 con 0x7fc8e0059040 2024-09-13T23:05:33.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.369+0000 7fc8f9345640 1 -- 172.21.15.164:0/950626537 <== osd.2 v2:172.21.15.164:6808/3795914978 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94179464156896] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8f4040040 con 0x7fc8e0059040 2024-09-13T23:05:33.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.369+0000 7fc8fd413800 20 remove_watcher() i=3 2024-09-13T23:05:33.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.369+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94179464160928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd816b10 con 0x55a7dd80c7d0 2024-09-13T23:05:33.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.370+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94179464160928] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e805c040 con 0x55a7dd80c7d0 2024-09-13T23:05:33.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.370+0000 7fc8fd413800 20 remove_watcher() i=4 2024-09-13T23:05:33.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.370+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94179464163024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd81a6a0 con 0x7fc8f4031040 2024-09-13T23:05:33.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.371+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94179464163024] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e805c040 con 0x7fc8f4031040 2024-09-13T23:05:33.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.371+0000 7fc8fd413800 20 remove_watcher() i=5 2024-09-13T23:05:33.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.371+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94179464165664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd81aed0 con 0x7fc8f4031040 2024-09-13T23:05:33.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.372+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94179464165664] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e805c040 con 0x7fc8f4031040 2024-09-13T23:05:33.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.372+0000 7fc8fd413800 20 remove_watcher() i=6 2024-09-13T23:05:33.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.372+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94179464169440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7dd817e00 con 0x7fc8f4031040 2024-09-13T23:05:33.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94179464169440] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8e805c040 con 0x7fc8f4031040 2024-09-13T23:05:33.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8fd413800 20 remove_watcher() i=7 2024-09-13T23:05:33.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc8f4031040 msgr2=0x7fc8f4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8fd413800 1 --2- 172.21.15.164:0/950626537 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc8f4031040 0x7fc8f4032940 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a7dd80c7d0 msgr2=0x55a7dd80ec90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8fd413800 1 --2- 172.21.15.164:0/950626537 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a7dd80c7d0 0x55a7dd80ec90 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc8e0059040 msgr2=0x7fc8e00246b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8fd413800 1 --2- 172.21.15.164:0/950626537 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc8e0059040 0x7fc8e00246b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55a7dd812a20 msgr2=0x55a7dd814e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8fd413800 1 --2- 172.21.15.164:0/950626537 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55a7dd812a20 0x55a7dd814e10 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc7c4036b90 msgr2=0x7fc7c4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8fd413800 1 --2- 172.21.15.164:0/950626537 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc7c4036b90 0x7fc7c4039050 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55a7dd7db120 tx=0x7fc8f401f000 comp rx=0 tx=0).stop 2024-09-13T23:05:33.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd7cb6b0 msgr2=0x55a7dd800eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8f8b44640 1 -- 172.21.15.164:0/950626537 reap_dead start 2024-09-13T23:05:33.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8fd413800 1 --2- 172.21.15.164:0/950626537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd7cb6b0 0x55a7dd800eb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000ce80 tx=0x7fc8e004d070 comp rx=0 tx=0).stop 2024-09-13T23:05:33.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 shutdown_connections 2024-09-13T23:05:33.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8fd413800 1 --2- 172.21.15.164:0/950626537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd7cb6b0 0x55a7dd800eb0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 >> 172.21.15.164:0/950626537 conn(0x55a7dd7f3b60 msgr2=0x55a7dd7f1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 shutdown_connections 2024-09-13T23:05:33.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8fd413800 1 -- 172.21.15.164:0/950626537 wait complete. 2024-09-13T23:05:33.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8fd413800 1 -- 172.21.15.164:0/1554979542 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc7d0036b90 msgr2=0x7fc7d0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8fd413800 1 --2- 172.21.15.164:0/1554979542 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc7d0036b90 0x7fc7d0039050 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55a7dd7db9a0 tx=0x7fc8f4005840 comp rx=0 tx=0).stop 2024-09-13T23:05:33.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8fd413800 1 -- 172.21.15.164:0/1554979542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd7eaaf0 msgr2=0x55a7dd7eaf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8fd413800 1 --2- 172.21.15.164:0/1554979542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd7eaaf0 0x55a7dd7eaf10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000bec0 tx=0x7fc8e000d7a0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8fd413800 1 -- 172.21.15.164:0/1554979542 shutdown_connections 2024-09-13T23:05:33.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8fd413800 1 --2- 172.21.15.164:0/1554979542 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc7d0036b90 0x7fc7d0039050 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8fd413800 1 --2- 172.21.15.164:0/1554979542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd7eaaf0 0x55a7dd7eaf10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8fd413800 1 -- 172.21.15.164:0/1554979542 >> 172.21.15.164:0/1554979542 conn(0x55a7dd7dfa80 msgr2=0x55a7dd7e2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8fd413800 1 -- 172.21.15.164:0/1554979542 shutdown_connections 2024-09-13T23:05:33.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.373+0000 7fc8fd413800 1 -- 172.21.15.164:0/1554979542 wait complete. 2024-09-13T23:05:33.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.374+0000 7fc8fd413800 1 -- 172.21.15.164:0/3556556806 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a7dd6dbe20 msgr2=0x55a7dd7da1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.374+0000 7fc8fd413800 1 --2- 172.21.15.164:0/3556556806 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a7dd6dbe20 0x55a7dd7da1a0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.374+0000 7fc8fd413800 1 -- 172.21.15.164:0/3556556806 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc7e0036b90 msgr2=0x7fc7e0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.374+0000 7fc8fd413800 1 --2- 172.21.15.164:0/3556556806 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc7e0036b90 0x7fc7e0039050 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0000f60 tx=0x7fc8e00010a0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.374+0000 7fc8fd413800 1 -- 172.21.15.164:0/3556556806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd6db4e0 msgr2=0x55a7dd7d3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.374+0000 7fc8fd413800 1 --2- 172.21.15.164:0/3556556806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd6db4e0 0x55a7dd7d3130 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8045960 tx=0x7fc8e8002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.374+0000 7fc8fd413800 1 -- 172.21.15.164:0/3556556806 shutdown_connections 2024-09-13T23:05:33.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.374+0000 7fc8fd413800 1 --2- 172.21.15.164:0/3556556806 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a7dd6dbe20 0x55a7dd7da1a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.374+0000 7fc8fd413800 1 --2- 172.21.15.164:0/3556556806 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc7e0036b90 0x7fc7e0039050 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.374+0000 7fc8fd413800 1 --2- 172.21.15.164:0/3556556806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7dd6db4e0 0x55a7dd7d3130 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.374+0000 7fc8fd413800 1 -- 172.21.15.164:0/3556556806 >> 172.21.15.164:0/3556556806 conn(0x55a7dd6d6e10 msgr2=0x55a7dd7c48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.374+0000 7fc8fd413800 1 -- 172.21.15.164:0/3556556806 shutdown_connections 2024-09-13T23:05:33.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.374+0000 7fc8fd413800 1 -- 172.21.15.164:0/3556556806 wait complete. 2024-09-13T23:05:33.393 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:05:31.300851Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-13T23:05:33.360148Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:05:31.300826Z', 'tags': [], 'group_ids': []} 2024-09-13T23:05:33.393 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T23:05:33.393 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T23:05:33.393 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T23:05:33.438 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:33.438 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:33.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.438+0000 7fbd44887800 1 Processor -- start 2024-09-13T23:05:33.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.438+0000 7fbd44887800 1 -- start start 2024-09-13T23:05:33.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.438+0000 7fbd44887800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x560ba7758610 0x560ba77e7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.438+0000 7fbd44887800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560ba76a3b30 con 0x560ba77e77b0 2024-09-13T23:05:33.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.438+0000 7fbd44887800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x560ba7685360 con 0x560ba7758610 2024-09-13T23:05:33.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.438+0000 7fbd4237b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x560ba7758610 0x560ba77e7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.438+0000 7fbd41b7a640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x560ba77e77b0 0x560ba77e9ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40832/0 (socket says 172.21.15.164:40832) 2024-09-13T23:05:33.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.438+0000 7fbd41b7a640 1 -- 172.21.15.164:0/2205265322 learned_addr learned my addr 172.21.15.164:0/2205265322 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:33.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.439+0000 7fbd4237b640 1 -- 172.21.15.164:0/2205265322 >> v1:172.21.15.17:6789/0 conn(0x560ba77e77b0 legacy=0x560ba77e9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.439+0000 7fbd41379640 1 -- 172.21.15.164:0/2205265322 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1628124984 0 0) 0x560ba76a3b30 con 0x560ba77e77b0 2024-09-13T23:05:33.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.439+0000 7fbd4237b640 1 -- 172.21.15.164:0/2205265322 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ba76abe00 con 0x560ba7758610 2024-09-13T23:05:33.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.441+0000 7fbd4237b640 1 --2- 172.21.15.164:0/2205265322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7758610 0x560ba77e7270 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbd3400a470 tx=0x7fbd34045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a79b49f4ecd5d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.441+0000 7fbd41379640 1 -- 172.21.15.164:0/2205265322 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd34053570 con 0x560ba7758610 2024-09-13T23:05:33.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.441+0000 7fbd41379640 1 -- 172.21.15.164:0/2205265322 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd34058070 con 0x560ba7758610 2024-09-13T23:05:33.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.441+0000 7fbd41379640 1 -- 172.21.15.164:0/2205265322 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd34053880 con 0x560ba7758610 2024-09-13T23:05:33.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.441+0000 7fbd44887800 1 -- 172.21.15.164:0/2205265322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7758610 msgr2=0x560ba77e7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.441+0000 7fbd44887800 1 --2- 172.21.15.164:0/2205265322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7758610 0x560ba77e7270 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbd3400a470 tx=0x7fbd34045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:33.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.441+0000 7fbd44887800 1 -- 172.21.15.164:0/2205265322 shutdown_connections 2024-09-13T23:05:33.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.441+0000 7fbd44887800 1 --2- 172.21.15.164:0/2205265322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7758610 0x560ba77e7270 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.441+0000 7fbd44887800 1 -- 172.21.15.164:0/2205265322 >> 172.21.15.164:0/2205265322 conn(0x560ba77dede0 msgr2=0x560ba77e1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.441+0000 7fbd44887800 1 -- 172.21.15.164:0/2205265322 shutdown_connections 2024-09-13T23:05:33.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.441+0000 7fbd44887800 1 -- 172.21.15.164:0/2205265322 wait complete. 2024-09-13T23:05:33.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.455+0000 7fbd44887800 1 Processor -- start 2024-09-13T23:05:33.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.455+0000 7fbd44887800 1 -- start start 2024-09-13T23:05:33.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.455+0000 7fbd44887800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7758610 0x560ba77e4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.455+0000 7fbd44887800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560ba7730330 con 0x560ba7758610 2024-09-13T23:05:33.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.456+0000 7fbd4237b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7758610 0x560ba77e4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.456+0000 7fbd4237b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7758610 0x560ba77e4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57028/0 (socket says 172.21.15.164:57028) 2024-09-13T23:05:33.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.456+0000 7fbd4237b640 1 -- 172.21.15.164:0/1859949430 learned_addr learned my addr 172.21.15.164:0/1859949430 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.456+0000 7fbd4237b640 1 -- 172.21.15.164:0/1859949430 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ba767dbc0 con 0x560ba7758610 2024-09-13T23:05:33.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.456+0000 7fbd4237b640 1 --2- 172.21.15.164:0/1859949430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7758610 0x560ba77e4ba0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbd34005870 tx=0x7fbd34051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a138296e5771f65b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.456+0000 7fbc30608640 1 -- 172.21.15.164:0/1859949430 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd3405c580 con 0x560ba7758610 2024-09-13T23:05:33.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.456+0000 7fbc30608640 1 -- 172.21.15.164:0/1859949430 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd34063030 con 0x560ba7758610 2024-09-13T23:05:33.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.456+0000 7fbc30608640 1 -- 172.21.15.164:0/1859949430 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd3405c850 con 0x560ba7758610 2024-09-13T23:05:33.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.457+0000 7fbd44887800 1 -- 172.21.15.164:0/1859949430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7758610 msgr2=0x560ba77e4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.457+0000 7fbd44887800 1 --2- 172.21.15.164:0/1859949430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7758610 0x560ba77e4ba0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbd34005870 tx=0x7fbd34051000 comp rx=0 tx=0).stop 2024-09-13T23:05:33.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.457+0000 7fbd44887800 1 -- 172.21.15.164:0/1859949430 shutdown_connections 2024-09-13T23:05:33.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.457+0000 7fbd44887800 1 --2- 172.21.15.164:0/1859949430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7758610 0x560ba77e4ba0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.457+0000 7fbd44887800 1 -- 172.21.15.164:0/1859949430 >> 172.21.15.164:0/1859949430 conn(0x560ba77dede0 msgr2=0x560ba78cf070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.457+0000 7fbd44887800 1 -- 172.21.15.164:0/1859949430 shutdown_connections 2024-09-13T23:05:33.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.457+0000 7fbd44887800 1 -- 172.21.15.164:0/1859949430 wait complete. 2024-09-13T23:05:33.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.458+0000 7fbd44887800 1 Processor -- start 2024-09-13T23:05:33.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.458+0000 7fbd44887800 1 -- start start 2024-09-13T23:05:33.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.458+0000 7fbd44887800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7758610 0x560ba78dd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.458+0000 7fbd44887800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560ba77eb680 con 0x560ba7758610 2024-09-13T23:05:33.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.458+0000 7fbd4237b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7758610 0x560ba78dd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.458+0000 7fbd4237b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7758610 0x560ba78dd190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57038/0 (socket says 172.21.15.164:57038) 2024-09-13T23:05:33.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.458+0000 7fbd4237b640 1 -- 172.21.15.164:0/2168872277 learned_addr learned my addr 172.21.15.164:0/2168872277 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.458+0000 7fbd4237b640 1 -- 172.21.15.164:0/2168872277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ba7691fe0 con 0x560ba7758610 2024-09-13T23:05:33.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.458+0000 7fbd4237b640 1 --2- 172.21.15.164:0/2168872277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7758610 0x560ba78dd190 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbd34045f50 tx=0x7fbd34002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.459+0000 7fbc2ee05640 1 -- 172.21.15.164:0/2168872277 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd34078070 con 0x560ba7758610 2024-09-13T23:05:33.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.459+0000 7fbc2ee05640 1 -- 172.21.15.164:0/2168872277 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd34054a70 con 0x560ba7758610 2024-09-13T23:05:33.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.459+0000 7fbd44887800 1 -- 172.21.15.164:0/2168872277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ba78dd6d0 con 0x560ba7758610 2024-09-13T23:05:33.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.459+0000 7fbc2ee05640 1 -- 172.21.15.164:0/2168872277 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd34054d50 con 0x560ba7758610 2024-09-13T23:05:33.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.459+0000 7fbd44887800 1 -- 172.21.15.164:0/2168872277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ba78ddc50 con 0x560ba7758610 2024-09-13T23:05:33.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.460+0000 7fbc2ee05640 1 -- 172.21.15.164:0/2168872277 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbd3407b070 con 0x560ba7758610 2024-09-13T23:05:33.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.460+0000 7fbc2ee05640 1 --2- 172.21.15.164:0/2168872277 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbc28036b40 0x7fbc28039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.460+0000 7fbc2ee05640 1 -- 172.21.15.164:0/2168872277 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fbd34070070 con 0x560ba7758610 2024-09-13T23:05:33.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.460+0000 7fbd41b7a640 1 --2- 172.21.15.164:0/2168872277 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbc28036b40 0x7fbc28039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.460+0000 7fbd44887800 1 --2- 172.21.15.164:0/2168872277 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560ba77e77b0 0x560ba78e4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.460+0000 7fbd44887800 1 -- 172.21.15.164:0/2168872277 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ba78e4850 con 0x560ba77e77b0 2024-09-13T23:05:33.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.460+0000 7fbd42b7c640 1 --2- 172.21.15.164:0/2168872277 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560ba77e77b0 0x560ba78e4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.460+0000 7fbd41b7a640 1 --2- 172.21.15.164:0/2168872277 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbc28036b40 0x7fbc28039000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbd38000c00 tx=0x7fbd380013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.460+0000 7fbd42b7c640 1 --2- 172.21.15.164:0/2168872277 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560ba77e77b0 0x560ba78e4200 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.461+0000 7fbd42b7c640 1 -- 172.21.15.164:0/2168872277 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd3c00a4a0 con 0x560ba77e77b0 2024-09-13T23:05:33.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.461+0000 7fbd44887800 1 -- 172.21.15.164:0/2168872277 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ba78e1790 con 0x560ba77e77b0 2024-09-13T23:05:33.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.461+0000 7fbd42b7c640 1 -- 172.21.15.164:0/2168872277 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd3c00a4a0 con 0x560ba77e77b0 2024-09-13T23:05:33.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.461+0000 7fbd44887800 1 -- 172.21.15.164:0/2168872277 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ba78e66a0 con 0x560ba77e77b0 2024-09-13T23:05:33.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.461+0000 7fbd42b7c640 1 -- 172.21.15.164:0/2168872277 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbd3c00a4a0 con 0x560ba77e77b0 2024-09-13T23:05:33.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.461+0000 7fbd44887800 1 -- 172.21.15.164:0/2168872277 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ba78e5810 con 0x560ba77e77b0 2024-09-13T23:05:33.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.462+0000 7fbd42b7c640 1 -- 172.21.15.164:0/2168872277 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbd3c00a4a0 con 0x560ba77e77b0 2024-09-13T23:05:33.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.462+0000 7fbd44887800 1 -- 172.21.15.164:0/2168872277 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ba78e5c60 con 0x560ba77e77b0 2024-09-13T23:05:33.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.462+0000 7fbd42b7c640 1 -- 172.21.15.164:0/2168872277 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbd3c00a4a0 con 0x560ba77e77b0 2024-09-13T23:05:33.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.462+0000 7fbd44887800 1 Processor -- start 2024-09-13T23:05:33.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.462+0000 7fbd44887800 1 -- start start 2024-09-13T23:05:33.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.462+0000 7fbd44887800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba78f4c70 0x560ba78f5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.462+0000 7fbd44887800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560ba767f580 con 0x560ba78f4c70 2024-09-13T23:05:33.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.463+0000 7fbd41b7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba78f4c70 0x560ba78f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.463+0000 7fbd41b7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba78f4c70 0x560ba78f5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57052/0 (socket says 172.21.15.164:57052) 2024-09-13T23:05:33.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.463+0000 7fbd41b7a640 1 -- 172.21.15.164:0/849639857 learned_addr learned my addr 172.21.15.164:0/849639857 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.463+0000 7fbd41b7a640 1 -- 172.21.15.164:0/849639857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ba78f55d0 con 0x560ba78f4c70 2024-09-13T23:05:33.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.463+0000 7fbd41b7a640 1 --2- 172.21.15.164:0/849639857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba78f4c70 0x560ba78f5090 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbd3800e610 tx=0x7fbd3800ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.463+0000 7fbc27fff640 1 -- 172.21.15.164:0/849639857 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd38022070 con 0x560ba78f4c70 2024-09-13T23:05:33.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.463+0000 7fbc27fff640 1 -- 172.21.15.164:0/849639857 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd38009050 con 0x560ba78f4c70 2024-09-13T23:05:33.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.463+0000 7fbd44887800 1 -- 172.21.15.164:0/849639857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ba78f5860 con 0x560ba78f4c70 2024-09-13T23:05:33.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.463+0000 7fbc27fff640 1 -- 172.21.15.164:0/849639857 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd3800d500 con 0x560ba78f4c70 2024-09-13T23:05:33.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.463+0000 7fbd44887800 1 -- 172.21.15.164:0/849639857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ba78f8540 con 0x560ba78f4c70 2024-09-13T23:05:33.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.464+0000 7fbc27fff640 1 -- 172.21.15.164:0/849639857 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbd38025070 con 0x560ba78f4c70 2024-09-13T23:05:33.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.464+0000 7fbc27fff640 1 --2- 172.21.15.164:0/849639857 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbc1c036b90 0x7fbc1c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.464+0000 7fbc27fff640 1 -- 172.21.15.164:0/849639857 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fbd3804de80 con 0x560ba78f4c70 2024-09-13T23:05:33.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.464+0000 7fbd42b7c640 1 --2- 172.21.15.164:0/849639857 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbc1c036b90 0x7fbc1c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.464+0000 7fbd44887800 1 Processor -- start 2024-09-13T23:05:33.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.465+0000 7fbd42b7c640 1 --2- 172.21.15.164:0/849639857 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbc1c036b90 0x7fbc1c039050 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x560ba78e5330 tx=0x7fbd3c005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.465+0000 7fbd44887800 1 -- start start 2024-09-13T23:05:33.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.465+0000 7fbd44887800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7901990 0x560ba7901d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.465+0000 7fbd44887800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560ba77e3210 con 0x560ba7901990 2024-09-13T23:05:33.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.465+0000 7fbd41b7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7901990 0x560ba7901d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.465+0000 7fbd41b7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7901990 0x560ba7901d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57054/0 (socket says 172.21.15.164:57054) 2024-09-13T23:05:33.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.465+0000 7fbd41b7a640 1 -- 172.21.15.164:0/2603946507 learned_addr learned my addr 172.21.15.164:0/2603946507 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.465+0000 7fbd41b7a640 1 -- 172.21.15.164:0/2603946507 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ba7902360 con 0x560ba7901990 2024-09-13T23:05:33.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.465+0000 7fbd41b7a640 1 --2- 172.21.15.164:0/2603946507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7901990 0x560ba7901d90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbd38026fd0 tx=0x7fbd38024eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a254a19e3b2d455f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.465+0000 7fbc25ffb640 1 -- 172.21.15.164:0/2603946507 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd38025360 con 0x560ba7901990 2024-09-13T23:05:33.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.465+0000 7fbc25ffb640 1 -- 172.21.15.164:0/2603946507 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd38025500 con 0x560ba7901990 2024-09-13T23:05:33.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.465+0000 7fbc25ffb640 1 -- 172.21.15.164:0/2603946507 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd380257e0 con 0x560ba7901990 2024-09-13T23:05:33.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.466+0000 7fbd44887800 1 -- 172.21.15.164:0/2603946507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7901990 msgr2=0x560ba7901d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.466+0000 7fbd44887800 1 --2- 172.21.15.164:0/2603946507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7901990 0x560ba7901d90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbd38026fd0 tx=0x7fbd38024eb0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.466+0000 7fbd44887800 1 -- 172.21.15.164:0/2603946507 shutdown_connections 2024-09-13T23:05:33.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.466+0000 7fbd44887800 1 --2- 172.21.15.164:0/2603946507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7901990 0x560ba7901d90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.466+0000 7fbd44887800 1 -- 172.21.15.164:0/2603946507 >> 172.21.15.164:0/2603946507 conn(0x560ba78fdcf0 msgr2=0x560ba78fbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.466+0000 7fbd44887800 1 -- 172.21.15.164:0/2603946507 shutdown_connections 2024-09-13T23:05:33.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.466+0000 7fbd44887800 1 -- 172.21.15.164:0/2603946507 wait complete. 2024-09-13T23:05:33.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.466+0000 7fbd44887800 1 Processor -- start 2024-09-13T23:05:33.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.466+0000 7fbd44887800 1 -- start start 2024-09-13T23:05:33.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.466+0000 7fbd44887800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7901990 0x560ba7908e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.466+0000 7fbd44887800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560ba79029d0 con 0x560ba7901990 2024-09-13T23:05:33.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.467+0000 7fbd41b7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7901990 0x560ba7908e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.467+0000 7fbd41b7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7901990 0x560ba7908e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57064/0 (socket says 172.21.15.164:57064) 2024-09-13T23:05:33.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.467+0000 7fbd41b7a640 1 -- 172.21.15.164:0/4056930980 learned_addr learned my addr 172.21.15.164:0/4056930980 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.467+0000 7fbd41b7a640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ba79093d0 con 0x560ba7901990 2024-09-13T23:05:33.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.467+0000 7fbd41b7a640 1 --2- 172.21.15.164:0/4056930980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7901990 0x560ba7908e90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbd38024ef0 tx=0x7fbd3804c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.467+0000 7fbc13fff640 1 -- 172.21.15.164:0/4056930980 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd3803a070 con 0x560ba7901990 2024-09-13T23:05:33.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.467+0000 7fbc13fff640 1 -- 172.21.15.164:0/4056930980 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd3800d6a0 con 0x560ba7901990 2024-09-13T23:05:33.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.467+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ba7909660 con 0x560ba7901990 2024-09-13T23:05:33.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.467+0000 7fbc13fff640 1 -- 172.21.15.164:0/4056930980 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd380248b0 con 0x560ba7901990 2024-09-13T23:05:33.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.467+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ba790c310 con 0x560ba7901990 2024-09-13T23:05:33.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.468+0000 7fbc13fff640 1 -- 172.21.15.164:0/4056930980 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbd3803f2c0 con 0x560ba7901990 2024-09-13T23:05:33.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.469+0000 7fbd44887800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.469+0000 7fbc13fff640 1 --2- 172.21.15.164:0/4056930980 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbc0c036b90 0x7fbc0c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.469+0000 7fbc13fff640 1 -- 172.21.15.164:0/4056930980 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fbd3803d040 con 0x560ba7901990 2024-09-13T23:05:33.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.469+0000 7fbd42b7c640 1 --2- 172.21.15.164:0/4056930980 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbc0c036b90 0x7fbc0c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.469+0000 7fbd44887800 1 --2- 172.21.15.164:0/4056930980 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560ba7914900 0x560ba7916d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.469+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ba7917480 con 0x560ba7914900 2024-09-13T23:05:33.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.469+0000 7fbd4237b640 1 --2- 172.21.15.164:0/4056930980 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560ba7914900 0x560ba7916d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.469+0000 7fbd42b7c640 1 --2- 172.21.15.164:0/4056930980 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbc0c036b90 0x7fbc0c039050 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x560ba78e1720 tx=0x7fbd3c01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.469+0000 7fbd4237b640 1 --2- 172.21.15.164:0/4056930980 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560ba7914900 0x560ba7916d30 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.470+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd3407a030 con 0x560ba7914900 2024-09-13T23:05:33.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.470+0000 7fbd44887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.470+0000 7fbd44887800 20 realm 2024-09-13T23:05:33.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.470+0000 7fbd44887800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.470+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ba7917890 con 0x560ba7914900 2024-09-13T23:05:33.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.470+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd3407a030 con 0x560ba7914900 2024-09-13T23:05:33.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.470+0000 7fbd44887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.470+0000 7fbd44887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:33.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.470+0000 7fbd44887800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.470+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ba7918130 con 0x560ba7914900 2024-09-13T23:05:33.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.470+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd3407a030 con 0x560ba7914900 2024-09-13T23:05:33.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.470+0000 7fbd44887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.470+0000 7fbd44887800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.470+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ba79184d0 con 0x560ba7914900 2024-09-13T23:05:33.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.470+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd3407a030 con 0x560ba7914900 2024-09-13T23:05:33.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.470+0000 7fbd44887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:33.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.470+0000 7fbd44887800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.470+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ba7917d80 con 0x560ba7914900 2024-09-13T23:05:33.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.470+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbd3407a030 con 0x560ba7914900 2024-09-13T23:05:33.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.470+0000 7fbd44887800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:33.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.471+0000 7fbd44887800 20 searching for the correct realm 2024-09-13T23:05:33.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.471+0000 7fbd44887800 1 --2- 172.21.15.164:0/4056930980 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x560ba791a980 0x560ba791cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.471+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x560ba791a980 2024-09-13T23:05:33.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.471+0000 7fbd41b7a640 1 --2- 172.21.15.164:0/4056930980 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x560ba791a980 0x560ba791cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.471+0000 7fbd41b7a640 1 --2- 172.21.15.164:0/4056930980 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x560ba791a980 0x560ba791cdb0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.471+0000 7fbd41b7a640 1 -- 172.21.15.164:0/4056930980 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd38032070 con 0x560ba791a980 2024-09-13T23:05:33.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.471+0000 7fbd41b7a640 1 --2- 172.21.15.164:0/4056930980 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fbd38027060 0x7fbd3804c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.471+0000 7fbd41b7a640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x7fbd38027060 2024-09-13T23:05:33.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.471+0000 7fbd42b7c640 1 --2- 172.21.15.164:0/4056930980 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fbd38027060 0x7fbd3804c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.472+0000 7fbd42b7c640 1 --2- 172.21.15.164:0/4056930980 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fbd38027060 0x7fbd3804c550 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.472+0000 7fbd42b7c640 1 -- 172.21.15.164:0/4056930980 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3c01f070 con 0x7fbd38027060 2024-09-13T23:05:33.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.472+0000 7fbd42b7c640 1 --2- 172.21.15.164:0/4056930980 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fbd3c031040 0x7fbd3c032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.472+0000 7fbd42b7c640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x7fbd3c031040 2024-09-13T23:05:33.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.472+0000 7fbd4237b640 1 --2- 172.21.15.164:0/4056930980 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fbd3c031040 0x7fbd3c032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.472+0000 7fbd4237b640 1 --2- 172.21.15.164:0/4056930980 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fbd3c031040 0x7fbd3c032430 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.473+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3407a030 con 0x7fbd3c031040 2024-09-13T23:05:33.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.473+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x560ba7914900 2024-09-13T23:05:33.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.473+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbd3407a030 con 0x560ba7914900 2024-09-13T23:05:33.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.473+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x560ba7914900 2024-09-13T23:05:33.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.473+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3407a030 con 0x560ba7914900 2024-09-13T23:05:33.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.473+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x7fbd3c031040 2024-09-13T23:05:33.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.473+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3407a030 con 0x7fbd3c031040 2024-09-13T23:05:33.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.473+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x7fbd3c031040 2024-09-13T23:05:33.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.474+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3407a030 con 0x7fbd3c031040 2024-09-13T23:05:33.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.474+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x7fbd38027060 2024-09-13T23:05:33.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.474+0000 7fbd42b7c640 1 -- 172.21.15.164:0/4056930980 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3c01f070 con 0x7fbd38027060 2024-09-13T23:05:33.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.474+0000 7fbd42b7c640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x560ba791a980 2024-09-13T23:05:33.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.474+0000 7fbd41b7a640 1 -- 172.21.15.164:0/4056930980 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd38032070 con 0x560ba791a980 2024-09-13T23:05:33.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.474+0000 7fbd41b7a640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x560ba7914900 2024-09-13T23:05:33.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.474+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3407a030 con 0x560ba7914900 2024-09-13T23:05:33.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.474+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x7fbd3c031040 2024-09-13T23:05:33.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.474+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3407a030 con 0x7fbd3c031040 2024-09-13T23:05:33.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.474+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x560ba7914900 2024-09-13T23:05:33.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.475+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3407a030 con 0x560ba7914900 2024-09-13T23:05:33.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.475+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x7fbd38027060 2024-09-13T23:05:33.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.475+0000 7fbd42b7c640 1 -- 172.21.15.164:0/4056930980 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbd3c01f070 con 0x7fbd38027060 2024-09-13T23:05:33.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.475+0000 7fbd42b7c640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x560ba791a980 2024-09-13T23:05:33.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.475+0000 7fbd41b7a640 1 -- 172.21.15.164:0/4056930980 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3805f040 con 0x560ba791a980 2024-09-13T23:05:33.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.475+0000 7fbd41b7a640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x560ba791a980 2024-09-13T23:05:33.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.475+0000 7fbd41b7a640 1 -- 172.21.15.164:0/4056930980 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3805f040 con 0x560ba791a980 2024-09-13T23:05:33.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.475+0000 7fbd41b7a640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x7fbd3c031040 2024-09-13T23:05:33.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.476+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3407a030 con 0x7fbd3c031040 2024-09-13T23:05:33.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.476+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x560ba791a980 2024-09-13T23:05:33.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.476+0000 7fbd41b7a640 1 -- 172.21.15.164:0/4056930980 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3805f040 con 0x560ba791a980 2024-09-13T23:05:33.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.476+0000 7fbd41b7a640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x560ba791a980 2024-09-13T23:05:33.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.476+0000 7fbd41b7a640 1 -- 172.21.15.164:0/4056930980 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3805f040 con 0x560ba791a980 2024-09-13T23:05:33.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.476+0000 7fbd41b7a640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x560ba7914900 2024-09-13T23:05:33.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.476+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3407a030 con 0x560ba7914900 2024-09-13T23:05:33.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.476+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x560ba7914900 2024-09-13T23:05:33.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.476+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbd3407a030 con 0x560ba7914900 2024-09-13T23:05:33.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.477+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x7fbd3c031040 2024-09-13T23:05:33.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.477+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3407a030 con 0x7fbd3c031040 2024-09-13T23:05:33.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.477+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x560ba791a980 2024-09-13T23:05:33.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.477+0000 7fbd41b7a640 1 -- 172.21.15.164:0/4056930980 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3805f040 con 0x560ba791a980 2024-09-13T23:05:33.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.477+0000 7fbd41b7a640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x7fbd38027060 2024-09-13T23:05:33.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.477+0000 7fbd42b7c640 1 -- 172.21.15.164:0/4056930980 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3c01f070 con 0x7fbd38027060 2024-09-13T23:05:33.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.477+0000 7fbd42b7c640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x560ba7914900 2024-09-13T23:05:33.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.477+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbd3407a030 con 0x560ba7914900 2024-09-13T23:05:33.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.477+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x7fbd3c031040 2024-09-13T23:05:33.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.478+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3407a030 con 0x7fbd3c031040 2024-09-13T23:05:33.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.478+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x560ba791a980 2024-09-13T23:05:33.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.478+0000 7fbd41b7a640 1 -- 172.21.15.164:0/4056930980 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3805f040 con 0x560ba791a980 2024-09-13T23:05:33.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.478+0000 7fbd41b7a640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x7fbd3c031040 2024-09-13T23:05:33.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.478+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3407a030 con 0x7fbd3c031040 2024-09-13T23:05:33.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.478+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x7fbd38027060 2024-09-13T23:05:33.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.478+0000 7fbd42b7c640 1 -- 172.21.15.164:0/4056930980 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3c01f070 con 0x7fbd38027060 2024-09-13T23:05:33.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.479+0000 7fbd42b7c640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x560ba791a980 2024-09-13T23:05:33.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.479+0000 7fbd41b7a640 1 -- 172.21.15.164:0/4056930980 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3805f040 con 0x560ba791a980 2024-09-13T23:05:33.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.479+0000 7fbd41b7a640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ba791d480 con 0x7fbd3c031040 2024-09-13T23:05:33.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.479+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3407a030 con 0x7fbd3c031040 2024-09-13T23:05:33.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.479+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbd340a2040 con 0x560ba7914900 2024-09-13T23:05:33.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.479+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbd3407a030 con 0x560ba7914900 2024-09-13T23:05:33.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.479+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbd340a2040 con 0x7fbd38027060 2024-09-13T23:05:33.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.480+0000 7fbd42b7c640 1 -- 172.21.15.164:0/4056930980 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd3c01f070 con 0x7fbd38027060 2024-09-13T23:05:33.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.480+0000 7fbd44887800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:33.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.480+0000 7fbd44887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:33.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.480+0000 7fbd44887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:33.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.480+0000 7fbd44887800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:33.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.480+0000 7fbd44887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:33.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.480+0000 7fbd44887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:33.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.480+0000 7fbd44887800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.480+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ba7919450 con 0x560ba7914900 2024-09-13T23:05:33.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.480+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd3407a030 con 0x560ba7914900 2024-09-13T23:05:33.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.480+0000 7fbd44887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.480+0000 7fbd44887800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.480+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ba7919cf0 con 0x560ba7914900 2024-09-13T23:05:33.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.480+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbd3407a030 con 0x560ba7914900 2024-09-13T23:05:33.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.480+0000 7fbd44887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:33.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.480+0000 7fbd44887800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.480+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ba7919090 con 0x560ba7914900 2024-09-13T23:05:33.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.480+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbd3407a030 con 0x560ba7914900 2024-09-13T23:05:33.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.480+0000 7fbd44887800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:33.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.480+0000 7fbd44887800 20 zone default found 2024-09-13T23:05:33.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.480+0000 7fbd44887800 4 Realm: () 2024-09-13T23:05:33.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.480+0000 7fbd44887800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:33.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.480+0000 7fbd44887800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:33.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.480+0000 7fbd44887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:33.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.480+0000 7fbd44887800 20 zonegroup default 2024-09-13T23:05:33.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.480+0000 7fbd44887800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.480+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ba7919cf0 con 0x7fbd3c031040 2024-09-13T23:05:33.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.481+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbd3407a030 con 0x7fbd3c031040 2024-09-13T23:05:33.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.481+0000 7fbd44887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.481+0000 7fbd44887800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.481+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ba791f2e0 con 0x560ba791a980 2024-09-13T23:05:33.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.481+0000 7fbd41b7a640 1 -- 172.21.15.164:0/4056930980 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbd3805f040 con 0x560ba791a980 2024-09-13T23:05:33.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.481+0000 7fbd44887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.481+0000 7fbd44887800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.481+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ba791f680 con 0x560ba791a980 2024-09-13T23:05:33.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.481+0000 7fbd41b7a640 1 -- 172.21.15.164:0/4056930980 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbd3805f040 con 0x560ba791a980 2024-09-13T23:05:33.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.481+0000 7fbd44887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.481+0000 7fbd44887800 20 started sync module instance, tier type = 2024-09-13T23:05:33.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.481+0000 7fbd44887800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:33.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.481+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ba791e780 con 0x7fbd38027060 2024-09-13T23:05:33.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.482+0000 7fbd42b7c640 1 -- 172.21.15.164:0/4056930980 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3c040040 con 0x7fbd38027060 2024-09-13T23:05:33.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.482+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94608055987056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ba791e3e0 con 0x7fbd38027060 2024-09-13T23:05:33.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.482+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ba7920530 con 0x560ba7914900 2024-09-13T23:05:33.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.483+0000 7fbd42b7c640 1 -- 172.21.15.164:0/4056930980 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94608055987056] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3c040040 con 0x7fbd38027060 2024-09-13T23:05:33.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.484+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3407a030 con 0x560ba7914900 2024-09-13T23:05:33.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.484+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94608055990816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ba79204f0 con 0x560ba7914900 2024-09-13T23:05:33.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.484+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ba7920fc0 con 0x560ba791a980 2024-09-13T23:05:33.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.485+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94608055990816] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3407a030 con 0x560ba7914900 2024-09-13T23:05:33.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.485+0000 7fbd41b7a640 1 -- 172.21.15.164:0/4056930980 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3805f040 con 0x560ba791a980 2024-09-13T23:05:33.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.485+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94608055992384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ba7920460 con 0x560ba791a980 2024-09-13T23:05:33.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.485+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ba7921e80 con 0x7fbd38027060 2024-09-13T23:05:33.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.486+0000 7fbd41b7a640 1 -- 172.21.15.164:0/4056930980 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94608055992384] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3805f040 con 0x560ba791a980 2024-09-13T23:05:33.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.486+0000 7fbd42b7c640 1 -- 172.21.15.164:0/4056930980 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3c040040 con 0x7fbd38027060 2024-09-13T23:05:33.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.486+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94608055998928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ba79222a0 con 0x7fbd38027060 2024-09-13T23:05:33.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.486+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ba7922c60 con 0x560ba7914900 2024-09-13T23:05:33.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.487+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3407a030 con 0x560ba7914900 2024-09-13T23:05:33.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.487+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94608056002480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ba7923080 con 0x560ba7914900 2024-09-13T23:05:33.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.487+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ba7923b60 con 0x7fbd3c031040 2024-09-13T23:05:33.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.487+0000 7fbd42b7c640 1 -- 172.21.15.164:0/4056930980 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94608055998928] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3c040040 con 0x7fbd38027060 2024-09-13T23:05:33.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.488+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3407a030 con 0x7fbd3c031040 2024-09-13T23:05:33.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.488+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94608056002480] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3407a030 con 0x560ba7914900 2024-09-13T23:05:33.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.488+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94608056006256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ba7923b60 con 0x7fbd3c031040 2024-09-13T23:05:33.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.488+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ba7922bd0 con 0x7fbd3c031040 2024-09-13T23:05:33.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.489+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3407a030 con 0x7fbd3c031040 2024-09-13T23:05:33.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.489+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94608056003536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ba7924570 con 0x7fbd3c031040 2024-09-13T23:05:33.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.489+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ba7924f30 con 0x7fbd3c031040 2024-09-13T23:05:33.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.489+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94608056006256] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3407a030 con 0x7fbd3c031040 2024-09-13T23:05:33.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.490+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94608056003536] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3407a030 con 0x7fbd3c031040 2024-09-13T23:05:33.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.490+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3407a030 con 0x7fbd3c031040 2024-09-13T23:05:33.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.490+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94608056008896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ba79244e0 con 0x7fbd3c031040 2024-09-13T23:05:33.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.490+0000 7fbd44887800 20 add_watcher() i=0 2024-09-13T23:05:33.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.490+0000 7fbd44887800 20 add_watcher() i=1 2024-09-13T23:05:33.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.490+0000 7fbd44887800 20 add_watcher() i=2 2024-09-13T23:05:33.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.490+0000 7fbd44887800 20 add_watcher() i=3 2024-09-13T23:05:33.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.490+0000 7fbd44887800 20 add_watcher() i=4 2024-09-13T23:05:33.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.490+0000 7fbd44887800 20 add_watcher() i=5 2024-09-13T23:05:33.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.490+0000 7fbd44887800 20 add_watcher() i=6 2024-09-13T23:05:33.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.491+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94608056008896] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3407a030 con 0x7fbd3c031040 2024-09-13T23:05:33.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.491+0000 7fbd44887800 20 add_watcher() i=7 2024-09-13T23:05:33.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.491+0000 7fbd44887800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:33.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.491+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ba7927f60 con 0x560ba7914900 2024-09-13T23:05:33.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.491+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbd3407a030 con 0x560ba7914900 2024-09-13T23:05:33.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.491+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94608056011392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ba7925380 con 0x560ba7914900 2024-09-13T23:05:33.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.492+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94608056011392] v32'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd3407a030 con 0x560ba7914900 2024-09-13T23:05:33.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.492+0000 7fbbf8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:33.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.492+0000 7fbd44887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:33.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.492+0000 7fbd44887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:33.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.492+0000 7fbd44887800 5 note: GC not initialized 2024-09-13T23:05:33.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.492+0000 7fbb737fe640 20 reqs_thread_entry: start 2024-09-13T23:05:33.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.493+0000 7fbd44887800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:33.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.493+0000 7fbd44887800 20 Filter name: none 2024-09-13T23:05:33.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.493+0000 7fbb717fa640 20 reqs_thread_entry: start 2024-09-13T23:05:33.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.493+0000 7fbd44887800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.493+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ba795adc0 con 0x560ba7914900 2024-09-13T23:05:33.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.493+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7fbd3407a030 con 0x560ba7914900 2024-09-13T23:05:33.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.493+0000 7fbd44887800 20 rados_obj.operate() r=0 bl.length=673 2024-09-13T23:05:33.509 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:05:31.300851Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-13T23:05:33.360148Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:05:31.300826Z","tags":[],"group_ids":[]} 2024-09-13T23:05:33.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.494+0000 7fbbf8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:33.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.494+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94608056011392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ba795b300 con 0x560ba7914900 2024-09-13T23:05:33.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.495+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94608056011392] v32'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd3407a030 con 0x560ba7914900 2024-09-13T23:05:33.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.495+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94608055987056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ba7924a80 con 0x7fbd38027060 2024-09-13T23:05:33.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.496+0000 7fbd42b7c640 1 -- 172.21.15.164:0/4056930980 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94608055987056] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3c040040 con 0x7fbd38027060 2024-09-13T23:05:33.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.496+0000 7fbd44887800 20 remove_watcher() i=0 2024-09-13T23:05:33.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.496+0000 7fbd44887800 2 removed watcher, disabling cache 2024-09-13T23:05:33.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.496+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94608055990816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ba7924a80 con 0x560ba7914900 2024-09-13T23:05:33.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.497+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94608055990816] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3407a030 con 0x560ba7914900 2024-09-13T23:05:33.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.497+0000 7fbd44887800 20 remove_watcher() i=1 2024-09-13T23:05:33.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.497+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94608055992384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ba791fa20 con 0x560ba791a980 2024-09-13T23:05:33.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.498+0000 7fbd41b7a640 1 -- 172.21.15.164:0/4056930980 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94608055992384] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3805f040 con 0x560ba791a980 2024-09-13T23:05:33.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.498+0000 7fbd44887800 20 remove_watcher() i=2 2024-09-13T23:05:33.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.498+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94608055998928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ba7924a80 con 0x7fbd38027060 2024-09-13T23:05:33.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.499+0000 7fbd42b7c640 1 -- 172.21.15.164:0/4056930980 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94608055998928] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3c040040 con 0x7fbd38027060 2024-09-13T23:05:33.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.499+0000 7fbd44887800 20 remove_watcher() i=3 2024-09-13T23:05:33.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.499+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94608056002480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ba7920040 con 0x560ba7914900 2024-09-13T23:05:33.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.500+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94608056002480] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3407a030 con 0x560ba7914900 2024-09-13T23:05:33.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.500+0000 7fbd44887800 20 remove_watcher() i=4 2024-09-13T23:05:33.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.500+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94608056006256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ba79219d0 con 0x7fbd3c031040 2024-09-13T23:05:33.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.501+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94608056006256] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3407a030 con 0x7fbd3c031040 2024-09-13T23:05:33.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.501+0000 7fbd44887800 20 remove_watcher() i=5 2024-09-13T23:05:33.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.501+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94608056003536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ba7924a80 con 0x7fbd3c031040 2024-09-13T23:05:33.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.502+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94608056003536] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3407a030 con 0x7fbd3c031040 2024-09-13T23:05:33.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.502+0000 7fbd44887800 20 remove_watcher() i=6 2024-09-13T23:05:33.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.502+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94608056008896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ba7924a80 con 0x7fbd3c031040 2024-09-13T23:05:33.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.503+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94608056008896] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd3407a030 con 0x7fbd3c031040 2024-09-13T23:05:33.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.503+0000 7fbd44887800 20 remove_watcher() i=7 2024-09-13T23:05:33.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.503+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fbd3c031040 msgr2=0x7fbd3c032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.503+0000 7fbd44887800 1 --2- 172.21.15.164:0/4056930980 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fbd3c031040 0x7fbd3c032430 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.503+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560ba7914900 msgr2=0x560ba7916d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.503+0000 7fbd44887800 1 --2- 172.21.15.164:0/4056930980 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560ba7914900 0x560ba7916d30 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.503+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fbd38027060 msgr2=0x7fbd3804c550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.503+0000 7fbd44887800 1 --2- 172.21.15.164:0/4056930980 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fbd38027060 0x7fbd3804c550 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.503+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x560ba791a980 msgr2=0x560ba791cdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.503+0000 7fbd44887800 1 --2- 172.21.15.164:0/4056930980 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x560ba791a980 0x560ba791cdb0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.503+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbc0c036b90 msgr2=0x7fbc0c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.503+0000 7fbd44887800 1 --2- 172.21.15.164:0/4056930980 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbc0c036b90 0x7fbc0c039050 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x560ba78e1720 tx=0x7fbd3c01f000 comp rx=0 tx=0).stop 2024-09-13T23:05:33.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.503+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7901990 msgr2=0x560ba7908e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.503+0000 7fbd4237b640 1 -- 172.21.15.164:0/4056930980 reap_dead start 2024-09-13T23:05:33.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.503+0000 7fbd44887800 1 --2- 172.21.15.164:0/4056930980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7901990 0x560ba7908e90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbd38024ef0 tx=0x7fbd3804c140 comp rx=0 tx=0).stop 2024-09-13T23:05:33.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.503+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 shutdown_connections 2024-09-13T23:05:33.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.503+0000 7fbd44887800 1 --2- 172.21.15.164:0/4056930980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7901990 0x560ba7908e90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.503+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 >> 172.21.15.164:0/4056930980 conn(0x560ba78fdcf0 msgr2=0x560ba78fbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.503+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 shutdown_connections 2024-09-13T23:05:33.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.503+0000 7fbd44887800 1 -- 172.21.15.164:0/4056930980 wait complete. 2024-09-13T23:05:33.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.504+0000 7fbd44887800 1 -- 172.21.15.164:0/849639857 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbc1c036b90 msgr2=0x7fbc1c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.504+0000 7fbd44887800 1 --2- 172.21.15.164:0/849639857 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbc1c036b90 0x7fbc1c039050 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x560ba78e5330 tx=0x7fbd3c005840 comp rx=0 tx=0).stop 2024-09-13T23:05:33.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.504+0000 7fbd44887800 1 -- 172.21.15.164:0/849639857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba78f4c70 msgr2=0x560ba78f5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.504+0000 7fbd44887800 1 --2- 172.21.15.164:0/849639857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba78f4c70 0x560ba78f5090 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbd3800e610 tx=0x7fbd3800ff90 comp rx=0 tx=0).stop 2024-09-13T23:05:33.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.504+0000 7fbd44887800 1 -- 172.21.15.164:0/849639857 shutdown_connections 2024-09-13T23:05:33.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.504+0000 7fbd44887800 1 --2- 172.21.15.164:0/849639857 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbc1c036b90 0x7fbc1c039050 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.504+0000 7fbd44887800 1 --2- 172.21.15.164:0/849639857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba78f4c70 0x560ba78f5090 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.504+0000 7fbd44887800 1 -- 172.21.15.164:0/849639857 >> 172.21.15.164:0/849639857 conn(0x560ba78e9c00 msgr2=0x560ba78ec780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.504+0000 7fbd44887800 1 -- 172.21.15.164:0/849639857 shutdown_connections 2024-09-13T23:05:33.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.504+0000 7fbd44887800 1 -- 172.21.15.164:0/849639857 wait complete. 2024-09-13T23:05:33.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.504+0000 7fbd44887800 1 -- 172.21.15.164:0/2168872277 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560ba77e77b0 msgr2=0x560ba78e4200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.504+0000 7fbd44887800 1 --2- 172.21.15.164:0/2168872277 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560ba77e77b0 0x560ba78e4200 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.504+0000 7fbd44887800 1 -- 172.21.15.164:0/2168872277 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbc28036b40 msgr2=0x7fbc28039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.504+0000 7fbd44887800 1 --2- 172.21.15.164:0/2168872277 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbc28036b40 0x7fbc28039000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbd38000c00 tx=0x7fbd380013b0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.504+0000 7fbd44887800 1 -- 172.21.15.164:0/2168872277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7758610 msgr2=0x560ba78dd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.504+0000 7fbd44887800 1 --2- 172.21.15.164:0/2168872277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7758610 0x560ba78dd190 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbd34045f50 tx=0x7fbd34002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.504+0000 7fbd44887800 1 -- 172.21.15.164:0/2168872277 shutdown_connections 2024-09-13T23:05:33.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.504+0000 7fbd44887800 1 --2- 172.21.15.164:0/2168872277 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560ba77e77b0 0x560ba78e4200 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.504+0000 7fbd44887800 1 --2- 172.21.15.164:0/2168872277 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fbc28036b40 0x7fbc28039000 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.504+0000 7fbd44887800 1 --2- 172.21.15.164:0/2168872277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ba7758610 0x560ba78dd190 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.504+0000 7fbd44887800 1 -- 172.21.15.164:0/2168872277 >> 172.21.15.164:0/2168872277 conn(0x560ba77dede0 msgr2=0x560ba78cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.504+0000 7fbd44887800 1 -- 172.21.15.164:0/2168872277 shutdown_connections 2024-09-13T23:05:33.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.504+0000 7fbd44887800 1 -- 172.21.15.164:0/2168872277 wait complete. 2024-09-13T23:05:33.521 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:05:31.300851Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-13T23:05:33.360148Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:05:31.300826Z', 'tags': [], 'group_ids': []} 2024-09-13T23:05:33.521 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-13T23:05:33.521 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-13T23:05:33.522 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-13T23:05:33.568 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:33.568 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:33.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.568+0000 7f664c52c800 1 Processor -- start 2024-09-13T23:05:33.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.568+0000 7f664c52c800 1 -- start start 2024-09-13T23:05:33.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.568+0000 7f664c52c800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55701bb71920 0x55701bb73d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.568+0000 7f664c52c800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55701ba2db30 con 0x55701bb6d4e0 2024-09-13T23:05:33.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.568+0000 7f664c52c800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55701ba0f360 con 0x55701bb71920 2024-09-13T23:05:33.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.568+0000 7f6647ab6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55701bb71920 0x55701bb73d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.569+0000 7f66482b7640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55701bb6d4e0 0x55701bb6d8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40848/0 (socket says 172.21.15.164:40848) 2024-09-13T23:05:33.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.569+0000 7f66482b7640 1 -- 172.21.15.164:0/1771910928 learned_addr learned my addr 172.21.15.164:0/1771910928 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:33.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.569+0000 7f6647ab6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55701bb71920 0x55701bb73d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57080/0 (socket says 172.21.15.164:57080) 2024-09-13T23:05:33.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.569+0000 7f66472b5640 1 -- 172.21.15.164:0/1771910928 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3459488435 0 0) 0x55701ba2db30 con 0x55701bb6d4e0 2024-09-13T23:05:33.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.569+0000 7f66472b5640 1 -- 172.21.15.164:0/1771910928 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6630001e10 con 0x55701bb6d4e0 2024-09-13T23:05:33.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.569+0000 7f6647ab6640 1 -- 172.21.15.164:0/1771910928 >> v1:172.21.15.17:6789/0 conn(0x55701bb6d4e0 legacy=0x55701bb6d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.569+0000 7f6647ab6640 1 -- 172.21.15.164:0/1771910928 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55701ba35e00 con 0x55701bb71920 2024-09-13T23:05:33.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.571+0000 7f6647ab6640 1 --2- 172.21.15.164:0/1771910928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bb71920 0x55701bb73d10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f663c00a470 tx=0x7f663c045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58637b8af4fb3871 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.571+0000 7f66472b5640 1 -- 172.21.15.164:0/1771910928 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f663c059070 con 0x55701bb71920 2024-09-13T23:05:33.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.571+0000 7f66472b5640 1 -- 172.21.15.164:0/1771910928 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f663c054570 con 0x55701bb71920 2024-09-13T23:05:33.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.571+0000 7f66472b5640 1 -- 172.21.15.164:0/1771910928 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f663c054850 con 0x55701bb71920 2024-09-13T23:05:33.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.571+0000 7f664c52c800 1 -- 172.21.15.164:0/1771910928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bb71920 msgr2=0x55701bb73d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.571+0000 7f664c52c800 1 --2- 172.21.15.164:0/1771910928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bb71920 0x55701bb73d10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f663c00a470 tx=0x7f663c045920 comp rx=0 tx=0).stop 2024-09-13T23:05:33.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.571+0000 7f664c52c800 1 -- 172.21.15.164:0/1771910928 shutdown_connections 2024-09-13T23:05:33.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.571+0000 7f664c52c800 1 --2- 172.21.15.164:0/1771910928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bb71920 0x55701bb73d10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.571+0000 7f664c52c800 1 -- 172.21.15.164:0/1771910928 >> 172.21.15.164:0/1771910928 conn(0x55701bb68dd0 msgr2=0x55701bb6b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.571+0000 7f664c52c800 1 -- 172.21.15.164:0/1771910928 shutdown_connections 2024-09-13T23:05:33.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.571+0000 7f664c52c800 1 -- 172.21.15.164:0/1771910928 wait complete. 2024-09-13T23:05:33.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.585+0000 7f664c52c800 1 Processor -- start 2024-09-13T23:05:33.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.585+0000 7f664c52c800 1 -- start start 2024-09-13T23:05:33.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.585+0000 7f664c52c800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bb6d4e0 0x55701bae1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.585+0000 7f664c52c800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55701baba360 con 0x55701bb6d4e0 2024-09-13T23:05:33.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.586+0000 7f66482b7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bb6d4e0 0x55701bae1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.586+0000 7f66482b7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bb6d4e0 0x55701bae1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57096/0 (socket says 172.21.15.164:57096) 2024-09-13T23:05:33.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.586+0000 7f66482b7640 1 -- 172.21.15.164:0/254924339 learned_addr learned my addr 172.21.15.164:0/254924339 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.586+0000 7f66482b7640 1 -- 172.21.15.164:0/254924339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55701ba07bc0 con 0x55701bb6d4e0 2024-09-13T23:05:33.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.586+0000 7f66482b7640 1 --2- 172.21.15.164:0/254924339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bb6d4e0 0x55701bae1da0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6638001db0 tx=0x7f663800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5e39140873c852 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.587+0000 7f653660c640 1 -- 172.21.15.164:0/254924339 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6638012020 con 0x55701bb6d4e0 2024-09-13T23:05:33.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.587+0000 7f653660c640 1 -- 172.21.15.164:0/254924339 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f663800e5a0 con 0x55701bb6d4e0 2024-09-13T23:05:33.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.587+0000 7f653660c640 1 -- 172.21.15.164:0/254924339 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f663800e940 con 0x55701bb6d4e0 2024-09-13T23:05:33.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.587+0000 7f664c52c800 1 -- 172.21.15.164:0/254924339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bb6d4e0 msgr2=0x55701bae1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.587+0000 7f664c52c800 1 --2- 172.21.15.164:0/254924339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bb6d4e0 0x55701bae1da0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6638001db0 tx=0x7f663800b6c0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.587+0000 7f664c52c800 1 -- 172.21.15.164:0/254924339 shutdown_connections 2024-09-13T23:05:33.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.587+0000 7f664c52c800 1 --2- 172.21.15.164:0/254924339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bb6d4e0 0x55701bae1da0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.587+0000 7f664c52c800 1 -- 172.21.15.164:0/254924339 >> 172.21.15.164:0/254924339 conn(0x55701bb68dd0 msgr2=0x55701bc57f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.587+0000 7f664c52c800 1 -- 172.21.15.164:0/254924339 shutdown_connections 2024-09-13T23:05:33.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.587+0000 7f664c52c800 1 -- 172.21.15.164:0/254924339 wait complete. 2024-09-13T23:05:33.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.588+0000 7f664c52c800 1 Processor -- start 2024-09-13T23:05:33.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.588+0000 7f664c52c800 1 -- start start 2024-09-13T23:05:33.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.588+0000 7f664c52c800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bb6d4e0 0x55701bc65100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.588+0000 7f664c52c800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55701bb74550 con 0x55701bb6d4e0 2024-09-13T23:05:33.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.588+0000 7f66482b7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bb6d4e0 0x55701bc65100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.588+0000 7f66482b7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bb6d4e0 0x55701bc65100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57106/0 (socket says 172.21.15.164:57106) 2024-09-13T23:05:33.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.588+0000 7f66482b7640 1 -- 172.21.15.164:0/3708653507 learned_addr learned my addr 172.21.15.164:0/3708653507 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.588+0000 7f66482b7640 1 -- 172.21.15.164:0/3708653507 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55701ba1bfe0 con 0x55701bb6d4e0 2024-09-13T23:05:33.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.588+0000 7f66482b7640 1 --2- 172.21.15.164:0/3708653507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bb6d4e0 0x55701bc65100 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f663800c010 tx=0x7f6638000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.589+0000 7f6534e09640 1 -- 172.21.15.164:0/3708653507 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6638012030 con 0x55701bb6d4e0 2024-09-13T23:05:33.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.589+0000 7f6534e09640 1 -- 172.21.15.164:0/3708653507 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f663801a750 con 0x55701bb6d4e0 2024-09-13T23:05:33.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.589+0000 7f664c52c800 1 -- 172.21.15.164:0/3708653507 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55701bc65640 con 0x55701bb6d4e0 2024-09-13T23:05:33.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.589+0000 7f6534e09640 1 -- 172.21.15.164:0/3708653507 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f663801aa30 con 0x55701bb6d4e0 2024-09-13T23:05:33.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.589+0000 7f664c52c800 1 -- 172.21.15.164:0/3708653507 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55701bc65b60 con 0x55701bb6d4e0 2024-09-13T23:05:33.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.589+0000 7f6534e09640 1 -- 172.21.15.164:0/3708653507 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6638015020 con 0x55701bb6d4e0 2024-09-13T23:05:33.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.590+0000 7f6534e09640 1 --2- 172.21.15.164:0/3708653507 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6530036b90 0x7f6530039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.590+0000 7f6534e09640 1 -- 172.21.15.164:0/3708653507 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6638020030 con 0x55701bb6d4e0 2024-09-13T23:05:33.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.590+0000 7f6647ab6640 1 --2- 172.21.15.164:0/3708653507 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6530036b90 0x7f6530039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.590+0000 7f664c52c800 1 --2- 172.21.15.164:0/3708653507 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55701bb71920 0x55701bc6c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.590+0000 7f664c52c800 1 -- 172.21.15.164:0/3708653507 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55701bc6c6b0 con 0x55701bb71920 2024-09-13T23:05:33.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.590+0000 7f6648ab8640 1 --2- 172.21.15.164:0/3708653507 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55701bb71920 0x55701bc6c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.590+0000 7f6647ab6640 1 --2- 172.21.15.164:0/3708653507 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6530036b90 0x7f6530039050 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55701bb6e2e0 tx=0x7f663c050000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.590+0000 7f6648ab8640 1 --2- 172.21.15.164:0/3708653507 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55701bb71920 0x55701bc6c170 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.591+0000 7f6648ab8640 1 -- 172.21.15.164:0/3708653507 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f664000a4a0 con 0x55701bb71920 2024-09-13T23:05:33.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.591+0000 7f664c52c800 1 -- 172.21.15.164:0/3708653507 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55701bc69700 con 0x55701bb71920 2024-09-13T23:05:33.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.591+0000 7f6648ab8640 1 -- 172.21.15.164:0/3708653507 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f664000a4a0 con 0x55701bb71920 2024-09-13T23:05:33.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.591+0000 7f664c52c800 1 -- 172.21.15.164:0/3708653507 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55701bc6e470 con 0x55701bb71920 2024-09-13T23:05:33.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.591+0000 7f6648ab8640 1 -- 172.21.15.164:0/3708653507 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f664000a4a0 con 0x55701bb71920 2024-09-13T23:05:33.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.591+0000 7f664c52c800 1 -- 172.21.15.164:0/3708653507 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55701bc6d5e0 con 0x55701bb71920 2024-09-13T23:05:33.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.591+0000 7f6648ab8640 1 -- 172.21.15.164:0/3708653507 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f664000a4a0 con 0x55701bb71920 2024-09-13T23:05:33.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.591+0000 7f664c52c800 1 -- 172.21.15.164:0/3708653507 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55701bc6da30 con 0x55701bb71920 2024-09-13T23:05:33.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.592+0000 7f6648ab8640 1 -- 172.21.15.164:0/3708653507 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f664000a4a0 con 0x55701bb71920 2024-09-13T23:05:33.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.592+0000 7f664c52c800 1 Processor -- start 2024-09-13T23:05:33.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.592+0000 7f664c52c800 1 -- start start 2024-09-13T23:05:33.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.592+0000 7f664c52c800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bc7ca60 0x55701bc7ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.592+0000 7f664c52c800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55701ba09580 con 0x55701bc7ca60 2024-09-13T23:05:33.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.593+0000 7f6647ab6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bc7ca60 0x55701bc7ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.593+0000 7f6647ab6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bc7ca60 0x55701bc7ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57122/0 (socket says 172.21.15.164:57122) 2024-09-13T23:05:33.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.593+0000 7f6647ab6640 1 -- 172.21.15.164:0/3680727544 learned_addr learned my addr 172.21.15.164:0/3680727544 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.593+0000 7f6647ab6640 1 -- 172.21.15.164:0/3680727544 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55701bc7d3c0 con 0x55701bc7ca60 2024-09-13T23:05:33.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.593+0000 7f6647ab6640 1 --2- 172.21.15.164:0/3680727544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bc7ca60 0x55701bc7ce80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f663c045e50 tx=0x7f663c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.593+0000 7f652dffb640 1 -- 172.21.15.164:0/3680727544 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f663c059040 con 0x55701bc7ca60 2024-09-13T23:05:33.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.594+0000 7f652dffb640 1 -- 172.21.15.164:0/3680727544 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f663c06f070 con 0x55701bc7ca60 2024-09-13T23:05:33.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.594+0000 7f664c52c800 1 -- 172.21.15.164:0/3680727544 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55701bc7d5f0 con 0x55701bc7ca60 2024-09-13T23:05:33.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.594+0000 7f652dffb640 1 -- 172.21.15.164:0/3680727544 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f663c05f470 con 0x55701bc7ca60 2024-09-13T23:05:33.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.594+0000 7f664c52c800 1 -- 172.21.15.164:0/3680727544 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55701bc80270 con 0x55701bc7ca60 2024-09-13T23:05:33.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.594+0000 7f652dffb640 1 -- 172.21.15.164:0/3680727544 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f663c05f610 con 0x55701bc7ca60 2024-09-13T23:05:33.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.594+0000 7f652dffb640 1 --2- 172.21.15.164:0/3680727544 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6520036b90 0x7f6520039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.594+0000 7f652dffb640 1 -- 172.21.15.164:0/3680727544 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f663c091f80 con 0x55701bc7ca60 2024-09-13T23:05:33.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.595+0000 7f6648ab8640 1 --2- 172.21.15.164:0/3680727544 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6520036b90 0x7f6520039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.595+0000 7f664c52c800 1 Processor -- start 2024-09-13T23:05:33.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.595+0000 7f6648ab8640 1 --2- 172.21.15.164:0/3680727544 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6520036b90 0x7f6520039050 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55701bc6d100 tx=0x7f6640005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.595+0000 7f664c52c800 1 -- start start 2024-09-13T23:05:33.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.595+0000 7f664c52c800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bc89670 0x55701bc89a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.595+0000 7f664c52c800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55701bc60560 con 0x55701bc89670 2024-09-13T23:05:33.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.595+0000 7f6647ab6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bc89670 0x55701bc89a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.595+0000 7f6647ab6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bc89670 0x55701bc89a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57134/0 (socket says 172.21.15.164:57134) 2024-09-13T23:05:33.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.595+0000 7f6647ab6640 1 -- 172.21.15.164:0/2663309475 learned_addr learned my addr 172.21.15.164:0/2663309475 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.595+0000 7f6647ab6640 1 -- 172.21.15.164:0/2663309475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55701bc8a040 con 0x55701bc89670 2024-09-13T23:05:33.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.596+0000 7f6647ab6640 1 --2- 172.21.15.164:0/2663309475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bc89670 0x55701bc89a70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f663c0902b0 tx=0x7f663c0733c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4699fd67353043ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.596+0000 7f65277fe640 1 -- 172.21.15.164:0/2663309475 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f663c060a00 con 0x55701bc89670 2024-09-13T23:05:33.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.596+0000 7f65277fe640 1 -- 172.21.15.164:0/2663309475 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f663c084070 con 0x55701bc89670 2024-09-13T23:05:33.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.596+0000 7f65277fe640 1 -- 172.21.15.164:0/2663309475 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f663c074910 con 0x55701bc89670 2024-09-13T23:05:33.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.596+0000 7f664c52c800 1 -- 172.21.15.164:0/2663309475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bc89670 msgr2=0x55701bc89a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.596+0000 7f664c52c800 1 --2- 172.21.15.164:0/2663309475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bc89670 0x55701bc89a70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f663c0902b0 tx=0x7f663c0733c0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.596+0000 7f664c52c800 1 -- 172.21.15.164:0/2663309475 shutdown_connections 2024-09-13T23:05:33.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.596+0000 7f664c52c800 1 --2- 172.21.15.164:0/2663309475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bc89670 0x55701bc89a70 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.596+0000 7f664c52c800 1 -- 172.21.15.164:0/2663309475 >> 172.21.15.164:0/2663309475 conn(0x55701bc859d0 msgr2=0x55701bc83ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.596+0000 7f664c52c800 1 -- 172.21.15.164:0/2663309475 shutdown_connections 2024-09-13T23:05:33.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.596+0000 7f664c52c800 1 -- 172.21.15.164:0/2663309475 wait complete. 2024-09-13T23:05:33.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.596+0000 7f664c52c800 1 Processor -- start 2024-09-13T23:05:33.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.597+0000 7f664c52c800 1 -- start start 2024-09-13T23:05:33.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.597+0000 7f664c52c800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bc89670 0x55701bc90a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.597+0000 7f664c52c800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55701bc8a6b0 con 0x55701bc89670 2024-09-13T23:05:33.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.597+0000 7f6647ab6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bc89670 0x55701bc90a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.597+0000 7f6647ab6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bc89670 0x55701bc90a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57144/0 (socket says 172.21.15.164:57144) 2024-09-13T23:05:33.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.597+0000 7f6647ab6640 1 -- 172.21.15.164:0/2018717319 learned_addr learned my addr 172.21.15.164:0/2018717319 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.597+0000 7f6647ab6640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55701bc90fd0 con 0x55701bc89670 2024-09-13T23:05:33.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.597+0000 7f6647ab6640 1 --2- 172.21.15.164:0/2018717319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bc89670 0x55701bc90a90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f663c0902b0 tx=0x7f663c090240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.597+0000 7f6525ffb640 1 -- 172.21.15.164:0/2018717319 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f663c06ad10 con 0x55701bc89670 2024-09-13T23:05:33.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.597+0000 7f6525ffb640 1 -- 172.21.15.164:0/2018717319 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f663c009ac0 con 0x55701bc89670 2024-09-13T23:05:33.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.597+0000 7f6525ffb640 1 -- 172.21.15.164:0/2018717319 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f663c009da0 con 0x55701bc89670 2024-09-13T23:05:33.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.598+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55701bc91260 con 0x55701bc89670 2024-09-13T23:05:33.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.598+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55701bc93f10 con 0x55701bc89670 2024-09-13T23:05:33.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.598+0000 7f6525ffb640 1 -- 172.21.15.164:0/2018717319 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f663c09e020 con 0x55701bc89670 2024-09-13T23:05:33.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.598+0000 7f6525ffb640 1 --2- 172.21.15.164:0/2018717319 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6518036b40 0x7f6518039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.599+0000 7f6525ffb640 1 -- 172.21.15.164:0/2018717319 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f663c09c020 con 0x55701bc89670 2024-09-13T23:05:33.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.599+0000 7f6648ab8640 1 --2- 172.21.15.164:0/2018717319 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6518036b40 0x7f6518039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.599+0000 7f6648ab8640 1 --2- 172.21.15.164:0/2018717319 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6518036b40 0x7f6518039000 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55701bc69690 tx=0x7f664001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.599+0000 7f664c52c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.599+0000 7f664c52c800 1 --2- 172.21.15.164:0/2018717319 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55701bc9c5c0 0x55701bc9ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.599+0000 7f66482b7640 1 --2- 172.21.15.164:0/2018717319 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55701bc9c5c0 0x55701bc9ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.599+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55701bc9f1d0 con 0x55701bc9c5c0 2024-09-13T23:05:33.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.600+0000 7f66482b7640 1 --2- 172.21.15.164:0/2018717319 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55701bc9c5c0 0x55701bc9ea80 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.600+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.600+0000 7f664c52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.600+0000 7f664c52c800 20 realm 2024-09-13T23:05:33.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.600+0000 7f664c52c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.600+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55701bc9f5e0 con 0x55701bc9c5c0 2024-09-13T23:05:33.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.600+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.600+0000 7f664c52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.600+0000 7f664c52c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:33.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.600+0000 7f664c52c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.600+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55701bc9feb0 con 0x55701bc9c5c0 2024-09-13T23:05:33.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.600+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.600+0000 7f664c52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.600+0000 7f664c52c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.600+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55701bca0250 con 0x55701bc9c5c0 2024-09-13T23:05:33.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.601+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.601+0000 7f664c52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:33.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.601+0000 7f664c52c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.601+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55701bca0aa0 con 0x55701bc9c5c0 2024-09-13T23:05:33.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.601+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.601+0000 7f664c52c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:33.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.601+0000 7f664c52c800 20 searching for the correct realm 2024-09-13T23:05:33.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.601+0000 7f664c52c800 1 --2- 172.21.15.164:0/2018717319 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55701bca2810 0x55701bca4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.601+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x55701bca2810 2024-09-13T23:05:33.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.601+0000 7f6647ab6640 1 --2- 172.21.15.164:0/2018717319 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55701bca2810 0x55701bca4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.601+0000 7f6647ab6640 1 --2- 172.21.15.164:0/2018717319 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55701bca2810 0x55701bca4c00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.601+0000 7f6647ab6640 1 -- 172.21.15.164:0/2018717319 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f663c05c040 con 0x55701bca2810 2024-09-13T23:05:33.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.602+0000 7f6647ab6640 1 --2- 172.21.15.164:0/2018717319 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f663c075540 0x7f663c0a0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.602+0000 7f6647ab6640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x7f663c075540 2024-09-13T23:05:33.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.602+0000 7f6648ab8640 1 --2- 172.21.15.164:0/2018717319 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f663c075540 0x7f663c0a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.602+0000 7f6648ab8640 1 --2- 172.21.15.164:0/2018717319 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f663c075540 0x7f663c0a0890 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.602+0000 7f6648ab8640 1 -- 172.21.15.164:0/2018717319 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f664001f070 con 0x7f663c075540 2024-09-13T23:05:33.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.602+0000 7f6648ab8640 1 --2- 172.21.15.164:0/2018717319 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f6640031040 0x7f6640032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.602+0000 7f6648ab8640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x7f6640031040 2024-09-13T23:05:33.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.602+0000 7f66482b7640 1 --2- 172.21.15.164:0/2018717319 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f6640031040 0x7f6640032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.603+0000 7f66482b7640 1 --2- 172.21.15.164:0/2018717319 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f6640031040 0x7f6640032940 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.603+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6638018950 con 0x7f6640031040 2024-09-13T23:05:33.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.603+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x55701bc9c5c0 2024-09-13T23:05:33.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.603+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.603+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x55701bc9c5c0 2024-09-13T23:05:33.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.604+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.604+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x7f6640031040 2024-09-13T23:05:33.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.604+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6638018950 con 0x7f6640031040 2024-09-13T23:05:33.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.604+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x7f6640031040 2024-09-13T23:05:33.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.604+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6638018950 con 0x7f6640031040 2024-09-13T23:05:33.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.604+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x7f663c075540 2024-09-13T23:05:33.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.604+0000 7f6648ab8640 1 -- 172.21.15.164:0/2018717319 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f664001f070 con 0x7f663c075540 2024-09-13T23:05:33.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.604+0000 7f6648ab8640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x55701bca2810 2024-09-13T23:05:33.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.604+0000 7f6647ab6640 1 -- 172.21.15.164:0/2018717319 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f663c05c040 con 0x55701bca2810 2024-09-13T23:05:33.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.604+0000 7f6647ab6640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x55701bc9c5c0 2024-09-13T23:05:33.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.605+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.605+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x7f6640031040 2024-09-13T23:05:33.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.605+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6638018950 con 0x7f6640031040 2024-09-13T23:05:33.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.605+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x55701bc9c5c0 2024-09-13T23:05:33.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.605+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.605+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x7f663c075540 2024-09-13T23:05:33.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.605+0000 7f6648ab8640 1 -- 172.21.15.164:0/2018717319 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f664001f070 con 0x7f663c075540 2024-09-13T23:05:33.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.605+0000 7f6648ab8640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x55701bca2810 2024-09-13T23:05:33.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.606+0000 7f6647ab6640 1 -- 172.21.15.164:0/2018717319 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f663c05c040 con 0x55701bca2810 2024-09-13T23:05:33.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.606+0000 7f6647ab6640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x55701bca2810 2024-09-13T23:05:33.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.606+0000 7f6647ab6640 1 -- 172.21.15.164:0/2018717319 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f663c05c040 con 0x55701bca2810 2024-09-13T23:05:33.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.606+0000 7f6647ab6640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x7f6640031040 2024-09-13T23:05:33.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.606+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6638018950 con 0x7f6640031040 2024-09-13T23:05:33.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.606+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x55701bca2810 2024-09-13T23:05:33.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.606+0000 7f6647ab6640 1 -- 172.21.15.164:0/2018717319 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f663c05c040 con 0x55701bca2810 2024-09-13T23:05:33.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.606+0000 7f6647ab6640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x55701bca2810 2024-09-13T23:05:33.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.607+0000 7f6647ab6640 1 -- 172.21.15.164:0/2018717319 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f663c05c040 con 0x55701bca2810 2024-09-13T23:05:33.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.607+0000 7f6647ab6640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x55701bc9c5c0 2024-09-13T23:05:33.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.607+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.607+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x55701bc9c5c0 2024-09-13T23:05:33.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.607+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.607+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x7f6640031040 2024-09-13T23:05:33.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.607+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6638018950 con 0x7f6640031040 2024-09-13T23:05:33.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.607+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x55701bca2810 2024-09-13T23:05:33.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.607+0000 7f6647ab6640 1 -- 172.21.15.164:0/2018717319 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f663c05c040 con 0x55701bca2810 2024-09-13T23:05:33.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.607+0000 7f6647ab6640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x7f663c075540 2024-09-13T23:05:33.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.608+0000 7f6648ab8640 1 -- 172.21.15.164:0/2018717319 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f664001f070 con 0x7f663c075540 2024-09-13T23:05:33.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.608+0000 7f6648ab8640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x55701bc9c5c0 2024-09-13T23:05:33.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.608+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.608+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x7f6640031040 2024-09-13T23:05:33.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.608+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6638018950 con 0x7f6640031040 2024-09-13T23:05:33.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.608+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x55701bca2810 2024-09-13T23:05:33.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.608+0000 7f6647ab6640 1 -- 172.21.15.164:0/2018717319 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f663c05c040 con 0x55701bca2810 2024-09-13T23:05:33.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.608+0000 7f6647ab6640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x7f6640031040 2024-09-13T23:05:33.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.609+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6638018950 con 0x7f6640031040 2024-09-13T23:05:33.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.609+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x7f663c075540 2024-09-13T23:05:33.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.609+0000 7f6648ab8640 1 -- 172.21.15.164:0/2018717319 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f664001f070 con 0x7f663c075540 2024-09-13T23:05:33.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.609+0000 7f6648ab8640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x55701bca2810 2024-09-13T23:05:33.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.609+0000 7f6647ab6640 1 -- 172.21.15.164:0/2018717319 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f663c05c040 con 0x55701bca2810 2024-09-13T23:05:33.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.609+0000 7f6647ab6640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x7f6640031040 2024-09-13T23:05:33.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.609+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6638018950 con 0x7f6640031040 2024-09-13T23:05:33.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.609+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x55701bc9c5c0 2024-09-13T23:05:33.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.610+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.610+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55701bca51e0 con 0x7f663c075540 2024-09-13T23:05:33.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.610+0000 7f6648ab8640 1 -- 172.21.15.164:0/2018717319 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f664001f070 con 0x7f663c075540 2024-09-13T23:05:33.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.610+0000 7f664c52c800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:33.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.610+0000 7f664c52c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:33.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.610+0000 7f664c52c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:33.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.610+0000 7f664c52c800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:33.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.610+0000 7f664c52c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:33.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.610+0000 7f664c52c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:33.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.610+0000 7f664c52c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.610+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55701bca1450 con 0x55701bc9c5c0 2024-09-13T23:05:33.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.610+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.610+0000 7f664c52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.610+0000 7f664c52c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.610+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55701bca1cf0 con 0x55701bc9c5c0 2024-09-13T23:05:33.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.610+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.610+0000 7f664c52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:33.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.610+0000 7f664c52c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.610+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55701bca5660 con 0x55701bc9c5c0 2024-09-13T23:05:33.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.611+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.611+0000 7f664c52c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:33.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.611+0000 7f664c52c800 20 zone default found 2024-09-13T23:05:33.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.611+0000 7f664c52c800 4 Realm: () 2024-09-13T23:05:33.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.611+0000 7f664c52c800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:33.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.611+0000 7f664c52c800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:33.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.611+0000 7f664c52c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:33.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.611+0000 7f664c52c800 20 zonegroup default 2024-09-13T23:05:33.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.611+0000 7f664c52c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.611+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55701bca5b10 con 0x7f6640031040 2024-09-13T23:05:33.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.611+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6638018950 con 0x7f6640031040 2024-09-13T23:05:33.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.611+0000 7f664c52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.611+0000 7f664c52c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.611+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55701bca74f0 con 0x55701bca2810 2024-09-13T23:05:33.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.611+0000 7f6647ab6640 1 -- 172.21.15.164:0/2018717319 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f663c05c040 con 0x55701bca2810 2024-09-13T23:05:33.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.611+0000 7f664c52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.611+0000 7f664c52c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.611+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55701bca7910 con 0x55701bca2810 2024-09-13T23:05:33.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.611+0000 7f6647ab6640 1 -- 172.21.15.164:0/2018717319 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f663c05c040 con 0x55701bca2810 2024-09-13T23:05:33.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.611+0000 7f664c52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.611+0000 7f664c52c800 20 started sync module instance, tier type = 2024-09-13T23:05:33.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.612+0000 7f664c52c800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:33.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.612+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55701bca6980 con 0x7f663c075540 2024-09-13T23:05:33.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.612+0000 7f6648ab8640 1 -- 172.21.15.164:0/2018717319 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6640040040 con 0x7f663c075540 2024-09-13T23:05:33.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.613+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93939990949232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55701bca65e0 con 0x7f663c075540 2024-09-13T23:05:33.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.613+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55701bca8840 con 0x55701bc9c5c0 2024-09-13T23:05:33.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.613+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.613+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93939990954896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55701bca8ca0 con 0x55701bc9c5c0 2024-09-13T23:05:33.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.614+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55701bca97c0 con 0x55701bca2810 2024-09-13T23:05:33.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.614+0000 7f6648ab8640 1 -- 172.21.15.164:0/2018717319 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93939990949232] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6640040040 con 0x7f663c075540 2024-09-13T23:05:33.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.614+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93939990954896] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.615+0000 7f6647ab6640 1 -- 172.21.15.164:0/2018717319 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f663c05c040 con 0x55701bca2810 2024-09-13T23:05:33.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.615+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93939990958736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55701bca87b0 con 0x55701bca2810 2024-09-13T23:05:33.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.615+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55701bcaa0a0 con 0x7f663c075540 2024-09-13T23:05:33.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.616+0000 7f6647ab6640 1 -- 172.21.15.164:0/2018717319 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93939990958736] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f663c05c040 con 0x55701bca2810 2024-09-13T23:05:33.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.616+0000 7f6648ab8640 1 -- 172.21.15.164:0/2018717319 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6640040040 con 0x7f663c075540 2024-09-13T23:05:33.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.616+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93939990953328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55701bcaa060 con 0x7f663c075540 2024-09-13T23:05:33.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.616+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55701bcaab00 con 0x55701bc9c5c0 2024-09-13T23:05:33.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.617+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.617+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93939990963760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55701bcaab00 con 0x55701bc9c5c0 2024-09-13T23:05:33.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.617+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55701bcabaa0 con 0x7f6640031040 2024-09-13T23:05:33.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.617+0000 7f6648ab8640 1 -- 172.21.15.164:0/2018717319 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93939990953328] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6640040040 con 0x7f663c075540 2024-09-13T23:05:33.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.618+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6638018950 con 0x7f6640031040 2024-09-13T23:05:33.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.618+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93939990967664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55701bcaba60 con 0x7f6640031040 2024-09-13T23:05:33.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.618+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55701bcac4b0 con 0x7f6640031040 2024-09-13T23:05:33.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.618+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93939990963760] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.619+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6638018950 con 0x7f6640031040 2024-09-13T23:05:33.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.619+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93939990965952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55701bcac4b0 con 0x7f6640031040 2024-09-13T23:05:33.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.619+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55701bcaceb0 con 0x7f6640031040 2024-09-13T23:05:33.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.619+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93939990967664] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6638018950 con 0x7f6640031040 2024-09-13T23:05:33.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.620+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93939990965952] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6638018950 con 0x7f6640031040 2024-09-13T23:05:33.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.620+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6638018950 con 0x7f6640031040 2024-09-13T23:05:33.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.620+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93939990961072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55701bcac000 con 0x7f6640031040 2024-09-13T23:05:33.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.620+0000 7f664c52c800 20 add_watcher() i=0 2024-09-13T23:05:33.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.620+0000 7f664c52c800 20 add_watcher() i=1 2024-09-13T23:05:33.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.620+0000 7f664c52c800 20 add_watcher() i=2 2024-09-13T23:05:33.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.620+0000 7f664c52c800 20 add_watcher() i=3 2024-09-13T23:05:33.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.620+0000 7f664c52c800 20 add_watcher() i=4 2024-09-13T23:05:33.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.620+0000 7f664c52c800 20 add_watcher() i=5 2024-09-13T23:05:33.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.620+0000 7f664c52c800 20 add_watcher() i=6 2024-09-13T23:05:33.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.621+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93939990961072] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6638018950 con 0x7f6640031040 2024-09-13T23:05:33.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.621+0000 7f664c52c800 20 add_watcher() i=7 2024-09-13T23:05:33.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.621+0000 7f664c52c800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:33.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.621+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55701bcaffb0 con 0x55701bc9c5c0 2024-09-13T23:05:33.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.621+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.621+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93939990972864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55701bcad430 con 0x55701bc9c5c0 2024-09-13T23:05:33.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.622+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93939990972864] v32'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.622+0000 7f64fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:33.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.622+0000 7f664c52c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:33.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.622+0000 7f664c52c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:33.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.622+0000 7f664c52c800 5 note: GC not initialized 2024-09-13T23:05:33.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.622+0000 7f64fd7e2640 20 reqs_thread_entry: start 2024-09-13T23:05:33.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.622+0000 7f664c52c800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:33.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.622+0000 7f664c52c800 20 Filter name: none 2024-09-13T23:05:33.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.623+0000 7f646effd640 20 reqs_thread_entry: start 2024-09-13T23:05:33.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.623+0000 7f664c52c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:05:33.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.623+0000 7f664c52c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.623+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55701bce3120 con 0x55701bc9c5c0 2024-09-13T23:05:33.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.623+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.623+0000 7f664c52c800 20 rados_obj.operate() r=0 bl.length=673 2024-09-13T23:05:33.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.623+0000 7f664c52c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:05:33.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.623+0000 7f664c52c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:33.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.623+0000 7f664c52c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:33.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.623+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55701bce9da0 con 0x55701bc9c5c0 2024-09-13T23:05:33.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.624+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v32'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.624+0000 7f664c52c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:33.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.624+0000 7f664c52c800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:33.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.624+0000 7f664c52c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:05:33.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.624+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93939991222112 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55701bce5460 con 0x55701bc9c5c0 2024-09-13T23:05:33.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.624+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== watch-notify(notify (1) cookie 93939990963760 notify 137438953480 ret 0) ==== 800+0+0 (crc 0 0 0) 0x55701bc65b60 con 0x55701bc9c5c0 2024-09-13T23:05:33.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.624+0000 7f65277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 93939990963760 notifier 4414 bl.length()=758 2024-09-13T23:05:33.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.624+0000 7f65277fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:33.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.624+0000 7f65277fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:33.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.624+0000 7f65277fe640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f650c003ea0 con 0x55701bc9c5c0 2024-09-13T23:05:33.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.624+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(64 notify.4 [notify cookie 93939991222112 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.625+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.625+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== watch-notify(notify_complete (2) cookie 93939991222112 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55701bc65640 con 0x55701bc9c5c0 2024-09-13T23:05:33.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.625+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55701bce9760 con 0x55701bc9c5c0 2024-09-13T23:05:33.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.626+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(66 foo:foo1 [delete] v32'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.626+0000 7f664c52c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-13T23:05:33.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.626+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93939991222112 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55701bce4fb0 con 0x7f663c075540 2024-09-13T23:05:33.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.626+0000 7f6648ab8640 1 -- 172.21.15.164:0/2018717319 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== watch-notify(notify (1) cookie 93939990949232 notify 137438953476 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f66400247b0 con 0x7f663c075540 2024-09-13T23:05:33.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.626+0000 7f6526ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 93939990949232 notifier 4414 bl.length()=159 2024-09-13T23:05:33.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.626+0000 7f6526ffd640 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f647c0032c0 con 0x7f663c075540 2024-09-13T23:05:33.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.626+0000 7f6648ab8640 1 -- 172.21.15.164:0/2018717319 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(67 notify.0 [notify cookie 93939991222112 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6640040040 con 0x7f663c075540 2024-09-13T23:05:33.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.627+0000 7f6648ab8640 1 -- 172.21.15.164:0/2018717319 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6640040040 con 0x7f663c075540 2024-09-13T23:05:33.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.627+0000 7f6648ab8640 1 -- 172.21.15.164:0/2018717319 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== watch-notify(notify_complete (2) cookie 93939991222112 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6640024980 con 0x7f663c075540 2024-09-13T23:05:33.642 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:05:31.300851Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-13T23:05:33.360148Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:05:31.300826Z","tags":[],"group_ids":[]} 2024-09-13T23:05:33.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.628+0000 7f64fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:33.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.628+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93939990972864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55701bce4fb0 con 0x55701bc9c5c0 2024-09-13T23:05:33.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.628+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 93939990972864] v32'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.628+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93939990949232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55701bce0e90 con 0x7f663c075540 2024-09-13T23:05:33.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.629+0000 7f6648ab8640 1 -- 172.21.15.164:0/2018717319 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 93939990949232] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6640040040 con 0x7f663c075540 2024-09-13T23:05:33.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.630+0000 7f664c52c800 20 remove_watcher() i=0 2024-09-13T23:05:33.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.630+0000 7f664c52c800 2 removed watcher, disabling cache 2024-09-13T23:05:33.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.630+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93939990954896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55701bce0e90 con 0x55701bc9c5c0 2024-09-13T23:05:33.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.631+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 93939990954896] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.631+0000 7f664c52c800 20 remove_watcher() i=1 2024-09-13T23:05:33.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.631+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93939990958736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55701bce0e90 con 0x55701bca2810 2024-09-13T23:05:33.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.632+0000 7f6647ab6640 1 -- 172.21.15.164:0/2018717319 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 93939990958736] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f663c05c040 con 0x55701bca2810 2024-09-13T23:05:33.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.632+0000 7f664c52c800 20 remove_watcher() i=2 2024-09-13T23:05:33.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.632+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93939990953328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55701bce0e90 con 0x7f663c075540 2024-09-13T23:05:33.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.633+0000 7f6648ab8640 1 -- 172.21.15.164:0/2018717319 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 93939990953328] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6640040040 con 0x7f663c075540 2024-09-13T23:05:33.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.633+0000 7f664c52c800 20 remove_watcher() i=3 2024-09-13T23:05:33.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.633+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93939990963760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55701bce0e90 con 0x55701bc9c5c0 2024-09-13T23:05:33.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.634+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.1 v2:172.21.15.164:6800/4060509701 32 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 93939990963760] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6638018950 con 0x55701bc9c5c0 2024-09-13T23:05:33.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.634+0000 7f664c52c800 20 remove_watcher() i=4 2024-09-13T23:05:33.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.634+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93939990967664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55701bce0e90 con 0x7f6640031040 2024-09-13T23:05:33.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.635+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 93939990967664] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6638018950 con 0x7f6640031040 2024-09-13T23:05:33.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.635+0000 7f664c52c800 20 remove_watcher() i=5 2024-09-13T23:05:33.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.635+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93939990965952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55701bce0e90 con 0x7f6640031040 2024-09-13T23:05:33.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.636+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 93939990965952] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6638018950 con 0x7f6640031040 2024-09-13T23:05:33.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.636+0000 7f664c52c800 20 remove_watcher() i=6 2024-09-13T23:05:33.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.636+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93939990961072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55701bce0e90 con 0x7f6640031040 2024-09-13T23:05:33.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.637+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 93939990961072] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6638018950 con 0x7f6640031040 2024-09-13T23:05:33.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.637+0000 7f664c52c800 20 remove_watcher() i=7 2024-09-13T23:05:33.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.637+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f6640031040 msgr2=0x7f6640032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.637+0000 7f664c52c800 1 --2- 172.21.15.164:0/2018717319 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f6640031040 0x7f6640032940 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.637+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55701bc9c5c0 msgr2=0x55701bc9ea80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.637+0000 7f664c52c800 1 --2- 172.21.15.164:0/2018717319 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55701bc9c5c0 0x55701bc9ea80 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.637+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f663c075540 msgr2=0x7f663c0a0890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.637+0000 7f664c52c800 1 --2- 172.21.15.164:0/2018717319 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f663c075540 0x7f663c0a0890 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.637+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55701bca2810 msgr2=0x55701bca4c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.637+0000 7f664c52c800 1 --2- 172.21.15.164:0/2018717319 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55701bca2810 0x55701bca4c00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.637+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6518036b40 msgr2=0x7f6518039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.637+0000 7f664c52c800 1 --2- 172.21.15.164:0/2018717319 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6518036b40 0x7f6518039000 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55701bc69690 tx=0x7f664001f000 comp rx=0 tx=0).stop 2024-09-13T23:05:33.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.637+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bc89670 msgr2=0x55701bc90a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.637+0000 7f664c52c800 1 --2- 172.21.15.164:0/2018717319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bc89670 0x55701bc90a90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f663c0902b0 tx=0x7f663c090240 comp rx=0 tx=0).stop 2024-09-13T23:05:33.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.637+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 reap_dead start 2024-09-13T23:05:33.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.637+0000 7f66482b7640 1 -- 172.21.15.164:0/2018717319 reap_dead start 2024-09-13T23:05:33.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.637+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 shutdown_connections 2024-09-13T23:05:33.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.637+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 >> 172.21.15.164:0/2018717319 conn(0x55701bc859d0 msgr2=0x55701bc83aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.638+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 shutdown_connections 2024-09-13T23:05:33.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.638+0000 7f664c52c800 1 -- 172.21.15.164:0/2018717319 wait complete. 2024-09-13T23:05:33.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.638+0000 7f664c52c800 1 -- 172.21.15.164:0/3680727544 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6520036b90 msgr2=0x7f6520039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.638+0000 7f664c52c800 1 --2- 172.21.15.164:0/3680727544 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6520036b90 0x7f6520039050 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55701bc6d100 tx=0x7f6640005840 comp rx=0 tx=0).stop 2024-09-13T23:05:33.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.638+0000 7f664c52c800 1 -- 172.21.15.164:0/3680727544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bc7ca60 msgr2=0x55701bc7ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.638+0000 7f664c52c800 1 --2- 172.21.15.164:0/3680727544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bc7ca60 0x55701bc7ce80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f663c045e50 tx=0x7f663c002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.638+0000 7f664c52c800 1 -- 172.21.15.164:0/3680727544 shutdown_connections 2024-09-13T23:05:33.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.638+0000 7f664c52c800 1 --2- 172.21.15.164:0/3680727544 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6520036b90 0x7f6520039050 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.638+0000 7f664c52c800 1 --2- 172.21.15.164:0/3680727544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bc7ca60 0x55701bc7ce80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.638+0000 7f664c52c800 1 -- 172.21.15.164:0/3680727544 >> 172.21.15.164:0/3680727544 conn(0x55701bc719f0 msgr2=0x55701bc74570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.638+0000 7f664c52c800 1 -- 172.21.15.164:0/3680727544 shutdown_connections 2024-09-13T23:05:33.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.638+0000 7f664c52c800 1 -- 172.21.15.164:0/3680727544 wait complete. 2024-09-13T23:05:33.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.638+0000 7f664c52c800 1 -- 172.21.15.164:0/3708653507 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55701bb71920 msgr2=0x55701bc6c170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.638+0000 7f664c52c800 1 --2- 172.21.15.164:0/3708653507 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55701bb71920 0x55701bc6c170 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.638+0000 7f664c52c800 1 -- 172.21.15.164:0/3708653507 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6530036b90 msgr2=0x7f6530039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.638+0000 7f664c52c800 1 --2- 172.21.15.164:0/3708653507 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6530036b90 0x7f6530039050 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55701bb6e2e0 tx=0x7f663c050000 comp rx=0 tx=0).stop 2024-09-13T23:05:33.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.638+0000 7f664c52c800 1 -- 172.21.15.164:0/3708653507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bb6d4e0 msgr2=0x55701bc65100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.638+0000 7f664c52c800 1 --2- 172.21.15.164:0/3708653507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bb6d4e0 0x55701bc65100 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f663800c010 tx=0x7f6638000bc0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.638+0000 7f664c52c800 1 -- 172.21.15.164:0/3708653507 shutdown_connections 2024-09-13T23:05:33.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.638+0000 7f664c52c800 1 --2- 172.21.15.164:0/3708653507 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55701bb71920 0x55701bc6c170 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.638+0000 7f664c52c800 1 --2- 172.21.15.164:0/3708653507 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6530036b90 0x7f6530039050 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.638+0000 7f664c52c800 1 --2- 172.21.15.164:0/3708653507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55701bb6d4e0 0x55701bc65100 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.638+0000 7f664c52c800 1 -- 172.21.15.164:0/3708653507 >> 172.21.15.164:0/3708653507 conn(0x55701bb68dd0 msgr2=0x55701bc56830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.638+0000 7f664c52c800 1 -- 172.21.15.164:0/3708653507 shutdown_connections 2024-09-13T23:05:33.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.638+0000 7f664c52c800 1 -- 172.21.15.164:0/3708653507 wait complete. 2024-09-13T23:05:33.654 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:05:31.300851Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-13T23:05:33.360148Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:05:31.300826Z', 'tags': [], 'group_ids': []} 2024-09-13T23:05:33.654 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-13T23:05:33.654 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-13T23:05:33.654 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-13T23:05:33.699 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:33.699 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:33.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.699+0000 7f20ab539800 1 Processor -- start 2024-09-13T23:05:33.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.700+0000 7f20ab539800 1 -- start start 2024-09-13T23:05:33.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.700+0000 7f20ab539800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55a5f6180900 0x55a5f6182cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.700+0000 7f20ab539800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a5f603cb30 con 0x55a5f617c4c0 2024-09-13T23:05:33.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.700+0000 7f20ab539800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55a5f601e360 con 0x55a5f6180900 2024-09-13T23:05:33.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.700+0000 7f20a69d0640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55a5f6180900 0x55a5f6182cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.700+0000 7f20a71d1640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55a5f617c4c0 0x55a5f617c8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40856/0 (socket says 172.21.15.164:40856) 2024-09-13T23:05:33.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.700+0000 7f20a71d1640 1 -- 172.21.15.164:0/3771133634 learned_addr learned my addr 172.21.15.164:0/3771133634 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:33.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.700+0000 7f20a69d0640 1 -- 172.21.15.164:0/3771133634 >> v1:172.21.15.17:6789/0 conn(0x55a5f617c4c0 legacy=0x55a5f617c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.700+0000 7f20a69d0640 1 -- 172.21.15.164:0/3771133634 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5f6044e00 con 0x55a5f6180900 2024-09-13T23:05:33.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.702+0000 7f20a69d0640 1 --2- 172.21.15.164:0/3771133634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f6180900 0x55a5f6182cf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f209c00a470 tx=0x7f209c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=383de381ed500691 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.702+0000 7f20a61cf640 1 -- 172.21.15.164:0/3771133634 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c053570 con 0x55a5f6180900 2024-09-13T23:05:33.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.702+0000 7f20a61cf640 1 -- 172.21.15.164:0/3771133634 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209c058070 con 0x55a5f6180900 2024-09-13T23:05:33.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.702+0000 7f20a61cf640 1 -- 172.21.15.164:0/3771133634 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c053880 con 0x55a5f6180900 2024-09-13T23:05:33.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.703+0000 7f20ab539800 1 -- 172.21.15.164:0/3771133634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f6180900 msgr2=0x55a5f6182cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.703+0000 7f20ab539800 1 --2- 172.21.15.164:0/3771133634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f6180900 0x55a5f6182cf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f209c00a470 tx=0x7f209c045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:33.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.703+0000 7f20ab539800 1 -- 172.21.15.164:0/3771133634 shutdown_connections 2024-09-13T23:05:33.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.703+0000 7f20ab539800 1 --2- 172.21.15.164:0/3771133634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f6180900 0x55a5f6182cf0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.703+0000 7f20ab539800 1 -- 172.21.15.164:0/3771133634 >> 172.21.15.164:0/3771133634 conn(0x55a5f6177df0 msgr2=0x55a5f617a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.703+0000 7f20ab539800 1 -- 172.21.15.164:0/3771133634 shutdown_connections 2024-09-13T23:05:33.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.703+0000 7f20ab539800 1 -- 172.21.15.164:0/3771133634 wait complete. 2024-09-13T23:05:33.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.716+0000 7f20ab539800 1 Processor -- start 2024-09-13T23:05:33.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.717+0000 7f20ab539800 1 -- start start 2024-09-13T23:05:33.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.717+0000 7f20ab539800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f617c4c0 0x55a5f60f0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.717+0000 7f20ab539800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a5f60c9330 con 0x55a5f617c4c0 2024-09-13T23:05:33.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.717+0000 7f20a71d1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f617c4c0 0x55a5f60f0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.717+0000 7f20a71d1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f617c4c0 0x55a5f60f0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57166/0 (socket says 172.21.15.164:57166) 2024-09-13T23:05:33.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.717+0000 7f20a71d1640 1 -- 172.21.15.164:0/2678852649 learned_addr learned my addr 172.21.15.164:0/2678852649 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.717+0000 7f20a71d1640 1 -- 172.21.15.164:0/2678852649 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5f6016bc0 con 0x55a5f617c4c0 2024-09-13T23:05:33.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.718+0000 7f20a71d1640 1 --2- 172.21.15.164:0/2678852649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f617c4c0 0x55a5f60f0d80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f20980017a0 tx=0x7f2098001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5631c93064595888 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.718+0000 7f1f9560a640 1 -- 172.21.15.164:0/2678852649 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2098016070 con 0x55a5f617c4c0 2024-09-13T23:05:33.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.718+0000 7f1f9560a640 1 -- 172.21.15.164:0/2678852649 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2098004520 con 0x55a5f617c4c0 2024-09-13T23:05:33.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.718+0000 7f1f9560a640 1 -- 172.21.15.164:0/2678852649 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2098004820 con 0x55a5f617c4c0 2024-09-13T23:05:33.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.719+0000 7f20ab539800 1 -- 172.21.15.164:0/2678852649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f617c4c0 msgr2=0x55a5f60f0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.719+0000 7f20ab539800 1 --2- 172.21.15.164:0/2678852649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f617c4c0 0x55a5f60f0d80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f20980017a0 tx=0x7f2098001c60 comp rx=0 tx=0).stop 2024-09-13T23:05:33.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.719+0000 7f20ab539800 1 -- 172.21.15.164:0/2678852649 shutdown_connections 2024-09-13T23:05:33.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.719+0000 7f20ab539800 1 --2- 172.21.15.164:0/2678852649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f617c4c0 0x55a5f60f0d80 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.719+0000 7f20ab539800 1 -- 172.21.15.164:0/2678852649 >> 172.21.15.164:0/2678852649 conn(0x55a5f6177df0 msgr2=0x55a5f6267110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.719+0000 7f20ab539800 1 -- 172.21.15.164:0/2678852649 shutdown_connections 2024-09-13T23:05:33.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.719+0000 7f20ab539800 1 -- 172.21.15.164:0/2678852649 wait complete. 2024-09-13T23:05:33.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.719+0000 7f20ab539800 1 Processor -- start 2024-09-13T23:05:33.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.719+0000 7f20ab539800 1 -- start start 2024-09-13T23:05:33.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.719+0000 7f20ab539800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f617c4c0 0x55a5f626ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.719+0000 7f20ab539800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a5f6183530 con 0x55a5f617c4c0 2024-09-13T23:05:33.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.719+0000 7f20a71d1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f617c4c0 0x55a5f626ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.719+0000 7f20a71d1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f617c4c0 0x55a5f626ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57174/0 (socket says 172.21.15.164:57174) 2024-09-13T23:05:33.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.719+0000 7f20a71d1640 1 -- 172.21.15.164:0/3493061308 learned_addr learned my addr 172.21.15.164:0/3493061308 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.720+0000 7f20a71d1640 1 -- 172.21.15.164:0/3493061308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5f602afe0 con 0x55a5f617c4c0 2024-09-13T23:05:33.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.720+0000 7f20a71d1640 1 --2- 172.21.15.164:0/3493061308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f617c4c0 0x55a5f626ceb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2098000f80 tx=0x7f2098001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.720+0000 7f1f93e07640 1 -- 172.21.15.164:0/3493061308 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2098016040 con 0x55a5f617c4c0 2024-09-13T23:05:33.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.720+0000 7f1f93e07640 1 -- 172.21.15.164:0/3493061308 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2098011530 con 0x55a5f617c4c0 2024-09-13T23:05:33.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.720+0000 7f1f93e07640 1 -- 172.21.15.164:0/3493061308 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2098011890 con 0x55a5f617c4c0 2024-09-13T23:05:33.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.720+0000 7f20ab539800 1 -- 172.21.15.164:0/3493061308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a5f626b5a0 con 0x55a5f617c4c0 2024-09-13T23:05:33.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.720+0000 7f20ab539800 1 -- 172.21.15.164:0/3493061308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5f626bb20 con 0x55a5f617c4c0 2024-09-13T23:05:33.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.721+0000 7f1f93e07640 1 -- 172.21.15.164:0/3493061308 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f209801c3f0 con 0x55a5f617c4c0 2024-09-13T23:05:33.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.721+0000 7f1f93e07640 1 --2- 172.21.15.164:0/3493061308 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f8c036b90 0x7f1f8c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.721+0000 7f1f93e07640 1 -- 172.21.15.164:0/3493061308 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f209804bbc0 con 0x55a5f617c4c0 2024-09-13T23:05:33.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.721+0000 7f20a69d0640 1 --2- 172.21.15.164:0/3493061308 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f8c036b90 0x7f1f8c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.722+0000 7f20ab539800 1 --2- 172.21.15.164:0/3493061308 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a5f6180900 0x55a5f627d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.722+0000 7f20ab539800 1 -- 172.21.15.164:0/3493061308 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5f627dbc0 con 0x55a5f6180900 2024-09-13T23:05:33.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.722+0000 7f20a79d2640 1 --2- 172.21.15.164:0/3493061308 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a5f6180900 0x55a5f627d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.722+0000 7f20a69d0640 1 --2- 172.21.15.164:0/3493061308 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f8c036b90 0x7f1f8c039050 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f209c057000 tx=0x7f209c052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.722+0000 7f20a79d2640 1 --2- 172.21.15.164:0/3493061308 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a5f6180900 0x55a5f627d680 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.722+0000 7f20a79d2640 1 -- 172.21.15.164:0/3493061308 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20a00083e0 con 0x55a5f6180900 2024-09-13T23:05:33.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.722+0000 7f20ab539800 1 -- 172.21.15.164:0/3493061308 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5f627e410 con 0x55a5f6180900 2024-09-13T23:05:33.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.723+0000 7f20a79d2640 1 -- 172.21.15.164:0/3493061308 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f20a00083e0 con 0x55a5f6180900 2024-09-13T23:05:33.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.723+0000 7f20ab539800 1 -- 172.21.15.164:0/3493061308 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5f627f7c0 con 0x55a5f6180900 2024-09-13T23:05:33.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.723+0000 7f20a79d2640 1 -- 172.21.15.164:0/3493061308 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f20a00083e0 con 0x55a5f6180900 2024-09-13T23:05:33.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.723+0000 7f20ab539800 1 -- 172.21.15.164:0/3493061308 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5f627ec60 con 0x55a5f6180900 2024-09-13T23:05:33.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.723+0000 7f20a79d2640 1 -- 172.21.15.164:0/3493061308 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f20a00083e0 con 0x55a5f6180900 2024-09-13T23:05:33.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.723+0000 7f20ab539800 1 -- 172.21.15.164:0/3493061308 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5f627f050 con 0x55a5f6180900 2024-09-13T23:05:33.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.723+0000 7f20a79d2640 1 -- 172.21.15.164:0/3493061308 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f20a00083e0 con 0x55a5f6180900 2024-09-13T23:05:33.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.724+0000 7f20ab539800 1 Processor -- start 2024-09-13T23:05:33.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.724+0000 7f20ab539800 1 -- start start 2024-09-13T23:05:33.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.724+0000 7f20ab539800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f628e040 0x55a5f628e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.724+0000 7f20ab539800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a5f626d3f0 con 0x55a5f628e040 2024-09-13T23:05:33.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.724+0000 7f20a69d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f628e040 0x55a5f628e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.724+0000 7f20a69d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f628e040 0x55a5f628e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57190/0 (socket says 172.21.15.164:57190) 2024-09-13T23:05:33.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.724+0000 7f20a69d0640 1 -- 172.21.15.164:0/1959279163 learned_addr learned my addr 172.21.15.164:0/1959279163 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.724+0000 7f20a69d0640 1 -- 172.21.15.164:0/1959279163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5f628e9a0 con 0x55a5f628e040 2024-09-13T23:05:33.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.725+0000 7f20a69d0640 1 --2- 172.21.15.164:0/1959279163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f628e040 0x55a5f628e460 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f209c045f50 tx=0x7f209c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.725+0000 7f1f91602640 1 -- 172.21.15.164:0/1959279163 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c06f070 con 0x55a5f628e040 2024-09-13T23:05:33.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.725+0000 7f1f91602640 1 -- 172.21.15.164:0/1959279163 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209c05f550 con 0x55a5f628e040 2024-09-13T23:05:33.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.725+0000 7f20ab539800 1 -- 172.21.15.164:0/1959279163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a5f628ebd0 con 0x55a5f628e040 2024-09-13T23:05:33.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.725+0000 7f1f91602640 1 -- 172.21.15.164:0/1959279163 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c05f830 con 0x55a5f628e040 2024-09-13T23:05:33.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.725+0000 7f20ab539800 1 -- 172.21.15.164:0/1959279163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5f6291850 con 0x55a5f628e040 2024-09-13T23:05:33.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.725+0000 7f1f91602640 1 -- 172.21.15.164:0/1959279163 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f209c05f9d0 con 0x55a5f628e040 2024-09-13T23:05:33.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.726+0000 7f1f91602640 1 --2- 172.21.15.164:0/1959279163 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f80036b90 0x7f1f80039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.726+0000 7f1f91602640 1 -- 172.21.15.164:0/1959279163 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f209c092d50 con 0x55a5f628e040 2024-09-13T23:05:33.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.726+0000 7f20a79d2640 1 --2- 172.21.15.164:0/1959279163 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f80036b90 0x7f1f80039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.726+0000 7f20ab539800 1 Processor -- start 2024-09-13T23:05:33.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.726+0000 7f20ab539800 1 -- start start 2024-09-13T23:05:33.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.726+0000 7f20a79d2640 1 --2- 172.21.15.164:0/1959279163 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f80036b90 0x7f1f80039050 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x55a5f627e2f0 tx=0x7f20a0000f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.726+0000 7f20ab539800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f629abe0 0x55a5f629afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.726+0000 7f20ab539800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a5f6018580 con 0x55a5f629abe0 2024-09-13T23:05:33.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.726+0000 7f20a69d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f629abe0 0x55a5f629afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.726+0000 7f20a69d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f629abe0 0x55a5f629afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57192/0 (socket says 172.21.15.164:57192) 2024-09-13T23:05:33.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.726+0000 7f20a69d0640 1 -- 172.21.15.164:0/2568029808 learned_addr learned my addr 172.21.15.164:0/2568029808 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.727+0000 7f20a69d0640 1 -- 172.21.15.164:0/2568029808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5f629b5b0 con 0x55a5f629abe0 2024-09-13T23:05:33.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.727+0000 7f20a69d0640 1 --2- 172.21.15.164:0/2568029808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f629abe0 0x55a5f629afe0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f209c053da0 tx=0x7f209c07cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28507602d3e0ca6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.727+0000 7f1f8affd640 1 -- 172.21.15.164:0/2568029808 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c080070 con 0x55a5f629abe0 2024-09-13T23:05:33.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.727+0000 7f1f8affd640 1 -- 172.21.15.164:0/2568029808 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209c05fcc0 con 0x55a5f629abe0 2024-09-13T23:05:33.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.727+0000 7f1f8affd640 1 -- 172.21.15.164:0/2568029808 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c06a3a0 con 0x55a5f629abe0 2024-09-13T23:05:33.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.727+0000 7f20ab539800 1 -- 172.21.15.164:0/2568029808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f629abe0 msgr2=0x55a5f629afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.727+0000 7f20ab539800 1 --2- 172.21.15.164:0/2568029808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f629abe0 0x55a5f629afe0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f209c053da0 tx=0x7f209c07cea0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.727+0000 7f20ab539800 1 -- 172.21.15.164:0/2568029808 shutdown_connections 2024-09-13T23:05:33.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.727+0000 7f20ab539800 1 --2- 172.21.15.164:0/2568029808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f629abe0 0x55a5f629afe0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.727+0000 7f20ab539800 1 -- 172.21.15.164:0/2568029808 >> 172.21.15.164:0/2568029808 conn(0x55a5f6296f40 msgr2=0x55a5f6295040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.727+0000 7f20ab539800 1 -- 172.21.15.164:0/2568029808 shutdown_connections 2024-09-13T23:05:33.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.728+0000 7f20ab539800 1 -- 172.21.15.164:0/2568029808 wait complete. 2024-09-13T23:05:33.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.728+0000 7f20ab539800 1 Processor -- start 2024-09-13T23:05:33.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.728+0000 7f20ab539800 1 -- start start 2024-09-13T23:05:33.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.728+0000 7f20ab539800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f629abe0 0x55a5f62a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.728+0000 7f20ab539800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a5f629baa0 con 0x55a5f629abe0 2024-09-13T23:05:33.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.728+0000 7f20a69d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f629abe0 0x55a5f62a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.728+0000 7f20a69d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f629abe0 0x55a5f62a1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57208/0 (socket says 172.21.15.164:57208) 2024-09-13T23:05:33.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.728+0000 7f20a69d0640 1 -- 172.21.15.164:0/313982489 learned_addr learned my addr 172.21.15.164:0/313982489 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.728+0000 7f20a69d0640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5f62a2450 con 0x55a5f629abe0 2024-09-13T23:05:33.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.729+0000 7f20a69d0640 1 --2- 172.21.15.164:0/313982489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f629abe0 0x55a5f62a1f10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f209c06bfd0 tx=0x7f209c091010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.729+0000 7f1f897fa640 1 -- 172.21.15.164:0/313982489 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c06a720 con 0x55a5f629abe0 2024-09-13T23:05:33.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.729+0000 7f1f897fa640 1 -- 172.21.15.164:0/313982489 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209c06a8c0 con 0x55a5f629abe0 2024-09-13T23:05:33.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.729+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a5f62a26e0 con 0x55a5f629abe0 2024-09-13T23:05:33.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.729+0000 7f1f897fa640 1 -- 172.21.15.164:0/313982489 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c07c3f0 con 0x55a5f629abe0 2024-09-13T23:05:33.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.729+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5f62a26e0 con 0x55a5f629abe0 2024-09-13T23:05:33.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.729+0000 7f1f897fa640 1 -- 172.21.15.164:0/313982489 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f209c083070 con 0x55a5f629abe0 2024-09-13T23:05:33.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.730+0000 7f1f897fa640 1 --2- 172.21.15.164:0/313982489 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f70036b90 0x7f1f70039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.730+0000 7f1f897fa640 1 -- 172.21.15.164:0/313982489 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f209c0a5c50 con 0x55a5f629abe0 2024-09-13T23:05:33.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.730+0000 7f20a79d2640 1 --2- 172.21.15.164:0/313982489 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f70036b90 0x7f1f70039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.730+0000 7f20a79d2640 1 --2- 172.21.15.164:0/313982489 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f70036b90 0x7f1f70039050 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f20a000f010 tx=0x7f20a000c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.730+0000 7f20ab539800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.730+0000 7f20ab539800 1 --2- 172.21.15.164:0/313982489 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a5f62ad840 0x55a5f62afd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.730+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b0450 con 0x55a5f62ad840 2024-09-13T23:05:33.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.730+0000 7f20a71d1640 1 --2- 172.21.15.164:0/313982489 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a5f62ad840 0x55a5f62afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.731+0000 7f20a71d1640 1 --2- 172.21.15.164:0/313982489 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a5f62ad840 0x55a5f62afd00 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.731+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.731+0000 7f20ab539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.731+0000 7f20ab539800 20 realm 2024-09-13T23:05:33.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.731+0000 7f20ab539800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.731+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b0860 con 0x55a5f62ad840 2024-09-13T23:05:33.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.731+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.731+0000 7f20ab539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.731+0000 7f20ab539800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:33.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.731+0000 7f20ab539800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.731+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b1130 con 0x55a5f62ad840 2024-09-13T23:05:33.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.731+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.731+0000 7f20ab539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.731+0000 7f20ab539800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.731+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b14d0 con 0x55a5f62ad840 2024-09-13T23:05:33.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.732+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.732+0000 7f20ab539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:33.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.732+0000 7f20ab539800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.732+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b1d20 con 0x55a5f62ad840 2024-09-13T23:05:33.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.732+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.732+0000 7f20ab539800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:33.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.732+0000 7f20ab539800 20 searching for the correct realm 2024-09-13T23:05:33.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.732+0000 7f20ab539800 1 --2- 172.21.15.164:0/313982489 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55a5f62b3a90 0x55a5f62b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.732+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b6460 con 0x55a5f62b3a90 2024-09-13T23:05:33.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.732+0000 7f20a69d0640 1 --2- 172.21.15.164:0/313982489 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55a5f62b3a90 0x55a5f62b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.732+0000 7f20a69d0640 1 --2- 172.21.15.164:0/313982489 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55a5f62b3a90 0x55a5f62b5e80 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.733+0000 7f20a69d0640 1 -- 172.21.15.164:0/313982489 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c0a1020 con 0x55a5f62b3a90 2024-09-13T23:05:33.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.733+0000 7f20a69d0640 1 --2- 172.21.15.164:0/313982489 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f209c085070 0x7f209c0624c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.733+0000 7f20a69d0640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b6460 con 0x7f209c085070 2024-09-13T23:05:33.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.733+0000 7f20a79d2640 1 --2- 172.21.15.164:0/313982489 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f209c085070 0x7f209c0624c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.733+0000 7f20a79d2640 1 --2- 172.21.15.164:0/313982489 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f209c085070 0x7f209c0624c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.733+0000 7f20a79d2640 1 -- 172.21.15.164:0/313982489 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a002f040 con 0x7f209c085070 2024-09-13T23:05:33.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.733+0000 7f20a79d2640 1 --2- 172.21.15.164:0/313982489 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f20a0019040 0x7f20a0019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.733+0000 7f20a79d2640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b6460 con 0x7f20a0019040 2024-09-13T23:05:33.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.733+0000 7f20a71d1640 1 --2- 172.21.15.164:0/313982489 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f20a0019040 0x7f20a0019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.734+0000 7f20a71d1640 1 --2- 172.21.15.164:0/313982489 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f20a0019040 0x7f20a0019930 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.734+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2098019050 con 0x7f20a0019040 2024-09-13T23:05:33.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.734+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b6460 con 0x55a5f62ad840 2024-09-13T23:05:33.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.734+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.734+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b6460 con 0x55a5f62ad840 2024-09-13T23:05:33.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.734+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.734+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b6460 con 0x7f20a0019040 2024-09-13T23:05:33.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.735+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2098019050 con 0x7f20a0019040 2024-09-13T23:05:33.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.735+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b6460 con 0x7f20a0019040 2024-09-13T23:05:33.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.735+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2098019050 con 0x7f20a0019040 2024-09-13T23:05:33.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.735+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b6460 con 0x7f209c085070 2024-09-13T23:05:33.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.735+0000 7f20a79d2640 1 -- 172.21.15.164:0/313982489 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a002f040 con 0x7f209c085070 2024-09-13T23:05:33.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.735+0000 7f20a79d2640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b6460 con 0x55a5f62b3a90 2024-09-13T23:05:33.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.735+0000 7f20a69d0640 1 -- 172.21.15.164:0/313982489 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c0a1020 con 0x55a5f62b3a90 2024-09-13T23:05:33.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.735+0000 7f20a69d0640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b6460 con 0x55a5f62ad840 2024-09-13T23:05:33.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.736+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.736+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b6460 con 0x7f20a0019040 2024-09-13T23:05:33.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.736+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2098019050 con 0x7f20a0019040 2024-09-13T23:05:33.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.736+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b6460 con 0x55a5f62ad840 2024-09-13T23:05:33.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.736+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.736+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b6460 con 0x7f209c085070 2024-09-13T23:05:33.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.736+0000 7f20a79d2640 1 -- 172.21.15.164:0/313982489 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f20a002f040 con 0x7f209c085070 2024-09-13T23:05:33.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.736+0000 7f20a79d2640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b6460 con 0x55a5f62b3a90 2024-09-13T23:05:33.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.737+0000 7f20a69d0640 1 -- 172.21.15.164:0/313982489 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c0a1020 con 0x55a5f62b3a90 2024-09-13T23:05:33.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.737+0000 7f20a69d0640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b6460 con 0x55a5f62b3a90 2024-09-13T23:05:33.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.737+0000 7f20a69d0640 1 -- 172.21.15.164:0/313982489 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c0a1020 con 0x55a5f62b3a90 2024-09-13T23:05:33.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.737+0000 7f20a69d0640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b6460 con 0x7f20a0019040 2024-09-13T23:05:33.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.737+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2098019050 con 0x7f20a0019040 2024-09-13T23:05:33.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.737+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b6460 con 0x55a5f62b3a90 2024-09-13T23:05:33.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.737+0000 7f20a69d0640 1 -- 172.21.15.164:0/313982489 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c0a1020 con 0x55a5f62b3a90 2024-09-13T23:05:33.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.737+0000 7f20a69d0640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b6460 con 0x55a5f62b3a90 2024-09-13T23:05:33.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.737+0000 7f20a69d0640 1 -- 172.21.15.164:0/313982489 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c0a1020 con 0x55a5f62b3a90 2024-09-13T23:05:33.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.737+0000 7f20a69d0640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b6460 con 0x55a5f62ad840 2024-09-13T23:05:33.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.738+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.738+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b6460 con 0x55a5f62ad840 2024-09-13T23:05:33.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.738+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.738+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b6460 con 0x7f20a0019040 2024-09-13T23:05:33.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.738+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2098019050 con 0x7f20a0019040 2024-09-13T23:05:33.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.738+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b6460 con 0x55a5f62b3a90 2024-09-13T23:05:33.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.738+0000 7f20a69d0640 1 -- 172.21.15.164:0/313982489 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c0a1020 con 0x55a5f62b3a90 2024-09-13T23:05:33.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.738+0000 7f20a69d0640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b6460 con 0x7f209c085070 2024-09-13T23:05:33.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.739+0000 7f20a79d2640 1 -- 172.21.15.164:0/313982489 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a002f040 con 0x7f209c085070 2024-09-13T23:05:33.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.739+0000 7f20a79d2640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b6460 con 0x55a5f62ad840 2024-09-13T23:05:33.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.739+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.739+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b6460 con 0x7f20a0019040 2024-09-13T23:05:33.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.739+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2098019050 con 0x7f20a0019040 2024-09-13T23:05:33.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.739+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b6460 con 0x55a5f62b3a90 2024-09-13T23:05:33.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.739+0000 7f20a69d0640 1 -- 172.21.15.164:0/313982489 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c0a1020 con 0x55a5f62b3a90 2024-09-13T23:05:33.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.739+0000 7f20a69d0640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b6460 con 0x7f20a0019040 2024-09-13T23:05:33.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.740+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2098019050 con 0x7f20a0019040 2024-09-13T23:05:33.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.740+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2098036040 con 0x7f209c085070 2024-09-13T23:05:33.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.740+0000 7f20a79d2640 1 -- 172.21.15.164:0/313982489 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a002f040 con 0x7f209c085070 2024-09-13T23:05:33.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.740+0000 7f20a79d2640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2098036040 con 0x55a5f62b3a90 2024-09-13T23:05:33.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.740+0000 7f20a69d0640 1 -- 172.21.15.164:0/313982489 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c0a1020 con 0x55a5f62b3a90 2024-09-13T23:05:33.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.740+0000 7f20a69d0640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2098036040 con 0x7f20a0019040 2024-09-13T23:05:33.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.740+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2098019050 con 0x7f20a0019040 2024-09-13T23:05:33.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.740+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2098036040 con 0x55a5f62ad840 2024-09-13T23:05:33.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.741+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.741+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2098036040 con 0x7f209c085070 2024-09-13T23:05:33.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.741+0000 7f20a79d2640 1 -- 172.21.15.164:0/313982489 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a002f040 con 0x7f209c085070 2024-09-13T23:05:33.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.741+0000 7f20ab539800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:33.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.741+0000 7f20ab539800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:33.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.741+0000 7f20ab539800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:33.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.741+0000 7f20ab539800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:33.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.741+0000 7f20ab539800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:33.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.741+0000 7f20ab539800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:33.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.741+0000 7f20ab539800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.741+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b26a0 con 0x55a5f62ad840 2024-09-13T23:05:33.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.741+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.741+0000 7f20ab539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.741+0000 7f20ab539800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.741+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b2f40 con 0x55a5f62ad840 2024-09-13T23:05:33.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.741+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.741+0000 7f20ab539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:33.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.741+0000 7f20ab539800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.741+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b2f40 con 0x55a5f62ad840 2024-09-13T23:05:33.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.742+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.742+0000 7f20ab539800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:33.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.742+0000 7f20ab539800 20 zone default found 2024-09-13T23:05:33.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.742+0000 7f20ab539800 4 Realm: () 2024-09-13T23:05:33.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.742+0000 7f20ab539800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:33.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.742+0000 7f20ab539800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:33.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.742+0000 7f20ab539800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:33.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.742+0000 7f20ab539800 20 zonegroup default 2024-09-13T23:05:33.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.742+0000 7f20ab539800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.742+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b68e0 con 0x7f20a0019040 2024-09-13T23:05:33.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.742+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2098019050 con 0x7f20a0019040 2024-09-13T23:05:33.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.742+0000 7f20ab539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.742+0000 7f20ab539800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.742+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b82c0 con 0x55a5f62b3a90 2024-09-13T23:05:33.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.742+0000 7f20a69d0640 1 -- 172.21.15.164:0/313982489 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f209c0a1020 con 0x55a5f62b3a90 2024-09-13T23:05:33.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.742+0000 7f20ab539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.742+0000 7f20ab539800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.742+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b87d0 con 0x55a5f62b3a90 2024-09-13T23:05:33.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.742+0000 7f20a69d0640 1 -- 172.21.15.164:0/313982489 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f209c0a1020 con 0x55a5f62b3a90 2024-09-13T23:05:33.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.742+0000 7f20ab539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.743+0000 7f20ab539800 20 started sync module instance, tier type = 2024-09-13T23:05:33.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.743+0000 7f20ab539800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:33.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.743+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b7760 con 0x7f209c085070 2024-09-13T23:05:33.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.743+0000 7f20a79d2640 1 -- 172.21.15.164:0/313982489 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a002f040 con 0x7f209c085070 2024-09-13T23:05:33.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.744+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94171288009856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b7760 con 0x7f209c085070 2024-09-13T23:05:33.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.744+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b92b0 con 0x55a5f62ad840 2024-09-13T23:05:33.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.745+0000 7f20a79d2640 1 -- 172.21.15.164:0/313982489 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94171288009856] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a002f040 con 0x7f209c085070 2024-09-13T23:05:33.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.745+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.745+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94171288014240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b7760 con 0x55a5f62ad840 2024-09-13T23:05:33.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.745+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b9d70 con 0x55a5f62b3a90 2024-09-13T23:05:33.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.746+0000 7f20a69d0640 1 -- 172.21.15.164:0/313982489 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c0a1020 con 0x55a5f62b3a90 2024-09-13T23:05:33.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.746+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94171288016960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62ba610 con 0x55a5f62b3a90 2024-09-13T23:05:33.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.746+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62bb0b0 con 0x7f209c085070 2024-09-13T23:05:33.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.746+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94171288014240] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.747+0000 7f20a69d0640 1 -- 172.21.15.164:0/313982489 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94171288016960] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c0a1020 con 0x55a5f62b3a90 2024-09-13T23:05:33.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.747+0000 7f20a79d2640 1 -- 172.21.15.164:0/313982489 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a002f040 con 0x7f209c085070 2024-09-13T23:05:33.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.747+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94171288019296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b72b0 con 0x7f209c085070 2024-09-13T23:05:33.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.747+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62bb9c0 con 0x55a5f62ad840 2024-09-13T23:05:33.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.748+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.748+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94171288024272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62bb930 con 0x55a5f62ad840 2024-09-13T23:05:33.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.748+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62bc8f0 con 0x7f20a0019040 2024-09-13T23:05:33.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.748+0000 7f20a79d2640 1 -- 172.21.15.164:0/313982489 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94171288019296] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a002f040 con 0x7f209c085070 2024-09-13T23:05:33.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.749+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2098019050 con 0x7f20a0019040 2024-09-13T23:05:33.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.749+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94171288024272] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.749+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94171288028160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62bc8f0 con 0x7f20a0019040 2024-09-13T23:05:33.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.749+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62bbdb0 con 0x7f20a0019040 2024-09-13T23:05:33.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.750+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2098019050 con 0x7f20a0019040 2024-09-13T23:05:33.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.750+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94171288026544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62bd330 con 0x7f20a0019040 2024-09-13T23:05:33.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.750+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62bdd30 con 0x7f20a0019040 2024-09-13T23:05:33.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.750+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94171288028160] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2098019050 con 0x7f20a0019040 2024-09-13T23:05:33.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.751+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94171288026544] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2098019050 con 0x7f20a0019040 2024-09-13T23:05:33.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.751+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2098019050 con 0x7f20a0019040 2024-09-13T23:05:33.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.751+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94171288021920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62bda20 con 0x7f20a0019040 2024-09-13T23:05:33.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.751+0000 7f20ab539800 20 add_watcher() i=0 2024-09-13T23:05:33.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.751+0000 7f20ab539800 20 add_watcher() i=1 2024-09-13T23:05:33.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.751+0000 7f20ab539800 20 add_watcher() i=2 2024-09-13T23:05:33.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.751+0000 7f20ab539800 20 add_watcher() i=3 2024-09-13T23:05:33.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.751+0000 7f20ab539800 20 add_watcher() i=4 2024-09-13T23:05:33.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.751+0000 7f20ab539800 20 add_watcher() i=5 2024-09-13T23:05:33.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.751+0000 7f20ab539800 20 add_watcher() i=6 2024-09-13T23:05:33.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.752+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94171288021920] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2098019050 con 0x7f20a0019040 2024-09-13T23:05:33.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.752+0000 7f20ab539800 20 add_watcher() i=7 2024-09-13T23:05:33.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.752+0000 7f20ab539800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:33.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.752+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62c0df0 con 0x55a5f62ad840 2024-09-13T23:05:33.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.752+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.753+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94171288033552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62be1e0 con 0x55a5f62ad840 2024-09-13T23:05:33.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.753+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94171288033552] v32'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.754+0000 7f1f5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:33.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.754+0000 7f20ab539800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:33.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.754+0000 7f20ab539800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:33.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.754+0000 7f20ab539800 5 note: GC not initialized 2024-09-13T23:05:33.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.754+0000 7f1f5cfe1640 20 reqs_thread_entry: start 2024-09-13T23:05:33.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.754+0000 7f20ab539800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:33.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.754+0000 7f20ab539800 20 Filter name: none 2024-09-13T23:05:33.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.754+0000 7f1ed67fc640 20 reqs_thread_entry: start 2024-09-13T23:05:33.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.754+0000 7f20ab539800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:05:33.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.754+0000 7f20ab539800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.754+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62f4010 con 0x55a5f62ad840 2024-09-13T23:05:33.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.755+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.755+0000 7f20ab539800 20 rados_obj.operate() r=0 bl.length=582 2024-09-13T23:05:33.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.755+0000 7f20ab539800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:05:33.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.755+0000 7f20ab539800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:33.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.755+0000 7f20ab539800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:33.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.755+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62fa6d0 con 0x55a5f62ad840 2024-09-13T23:05:33.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.756+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v32'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.756+0000 7f20ab539800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:33.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.756+0000 7f20ab539800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:33.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.756+0000 7f20ab539800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:05:33.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.756+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94171288281232 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62f9420 con 0x55a5f62ad840 2024-09-13T23:05:33.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.756+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== watch-notify(notify (1) cookie 94171288024272 notify 137438953481 ret 0) ==== 774+0+0 (crc 0 0 0) 0x55a5f626bb20 con 0x55a5f62ad840 2024-09-13T23:05:33.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.756+0000 7f1f8affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94171288024272 notifier 4421 bl.length()=732 2024-09-13T23:05:33.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.756+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(64 notify.4 [notify cookie 94171288281232 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.756+0000 7f1f8affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:33.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.756+0000 7f1f8affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:33.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.756+0000 7f1f8affd640 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1f6c003ea0 con 0x55a5f62ad840 2024-09-13T23:05:33.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.756+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.757+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== watch-notify(notify_complete (2) cookie 94171288281232 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a5f626b5a0 con 0x55a5f62ad840 2024-09-13T23:05:33.776 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:05:31.300851Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-13T23:05:33.360148Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:05:31.300826Z","tags":[],"group_ids":[]} 2024-09-13T23:05:33.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.757+0000 7f1f5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:33.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.757+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94171288033552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62f1d60 con 0x55a5f62ad840 2024-09-13T23:05:33.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.758+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94171288033552] v32'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.758+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94171288009856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62f1d60 con 0x7f209c085070 2024-09-13T23:05:33.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.759+0000 7f20a79d2640 1 -- 172.21.15.164:0/313982489 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94171288009856] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a002f040 con 0x7f209c085070 2024-09-13T23:05:33.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.759+0000 7f20ab539800 20 remove_watcher() i=0 2024-09-13T23:05:33.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.759+0000 7f20ab539800 2 removed watcher, disabling cache 2024-09-13T23:05:33.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.759+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94171288014240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62f1d60 con 0x55a5f62ad840 2024-09-13T23:05:33.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.760+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94171288014240] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.760+0000 7f20ab539800 20 remove_watcher() i=1 2024-09-13T23:05:33.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.760+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94171288016960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62f1d60 con 0x55a5f62b3a90 2024-09-13T23:05:33.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.761+0000 7f20a69d0640 1 -- 172.21.15.164:0/313982489 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94171288016960] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c0a1020 con 0x55a5f62b3a90 2024-09-13T23:05:33.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.761+0000 7f20ab539800 20 remove_watcher() i=2 2024-09-13T23:05:33.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.761+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94171288019296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b9840 con 0x7f209c085070 2024-09-13T23:05:33.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.762+0000 7f20a79d2640 1 -- 172.21.15.164:0/313982489 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94171288019296] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a002f040 con 0x7f209c085070 2024-09-13T23:05:33.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.762+0000 7f20ab539800 20 remove_watcher() i=3 2024-09-13T23:05:33.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.762+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94171288024272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62ba160 con 0x55a5f62ad840 2024-09-13T23:05:33.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.763+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94171288024272] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2098019050 con 0x55a5f62ad840 2024-09-13T23:05:33.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.763+0000 7f20ab539800 20 remove_watcher() i=4 2024-09-13T23:05:33.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.763+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94171288028160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62b9840 con 0x7f20a0019040 2024-09-13T23:05:33.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.764+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94171288028160] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2098019050 con 0x7f20a0019040 2024-09-13T23:05:33.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.764+0000 7f20ab539800 20 remove_watcher() i=5 2024-09-13T23:05:33.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.764+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94171288026544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62bb4d0 con 0x7f20a0019040 2024-09-13T23:05:33.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.765+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94171288026544] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2098019050 con 0x7f20a0019040 2024-09-13T23:05:33.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.765+0000 7f20ab539800 20 remove_watcher() i=6 2024-09-13T23:05:33.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.765+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94171288021920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a5f62ba160 con 0x7f20a0019040 2024-09-13T23:05:33.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.766+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94171288021920] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2098019050 con 0x7f20a0019040 2024-09-13T23:05:33.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.766+0000 7f20ab539800 20 remove_watcher() i=7 2024-09-13T23:05:33.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.766+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f20a0019040 msgr2=0x7f20a0019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.766+0000 7f20ab539800 1 --2- 172.21.15.164:0/313982489 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f20a0019040 0x7f20a0019930 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.766+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a5f62ad840 msgr2=0x55a5f62afd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.766+0000 7f20ab539800 1 --2- 172.21.15.164:0/313982489 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a5f62ad840 0x55a5f62afd00 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.766+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f209c085070 msgr2=0x7f209c0624c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.766+0000 7f20ab539800 1 --2- 172.21.15.164:0/313982489 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f209c085070 0x7f209c0624c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.766+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55a5f62b3a90 msgr2=0x55a5f62b5e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.766+0000 7f20ab539800 1 --2- 172.21.15.164:0/313982489 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55a5f62b3a90 0x55a5f62b5e80 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.767+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f70036b90 msgr2=0x7f1f70039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.767+0000 7f20ab539800 1 --2- 172.21.15.164:0/313982489 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f70036b90 0x7f1f70039050 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f20a000f010 tx=0x7f20a000c040 comp rx=0 tx=0).stop 2024-09-13T23:05:33.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.767+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f629abe0 msgr2=0x55a5f62a1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.767+0000 7f20a71d1640 1 -- 172.21.15.164:0/313982489 reap_dead start 2024-09-13T23:05:33.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.767+0000 7f20ab539800 1 --2- 172.21.15.164:0/313982489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f629abe0 0x55a5f62a1f10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f209c06bfd0 tx=0x7f209c091010 comp rx=0 tx=0).stop 2024-09-13T23:05:33.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.767+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 shutdown_connections 2024-09-13T23:05:33.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.767+0000 7f20ab539800 1 --2- 172.21.15.164:0/313982489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f629abe0 0x55a5f62a1f10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.767+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 >> 172.21.15.164:0/313982489 conn(0x55a5f6296f40 msgr2=0x55a5f6295010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.767+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 shutdown_connections 2024-09-13T23:05:33.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.767+0000 7f20ab539800 1 -- 172.21.15.164:0/313982489 wait complete. 2024-09-13T23:05:33.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.767+0000 7f20ab539800 1 -- 172.21.15.164:0/1959279163 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f80036b90 msgr2=0x7f1f80039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.767+0000 7f20ab539800 1 --2- 172.21.15.164:0/1959279163 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f80036b90 0x7f1f80039050 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x55a5f627e2f0 tx=0x7f20a0000f90 comp rx=0 tx=0).stop 2024-09-13T23:05:33.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.767+0000 7f20ab539800 1 -- 172.21.15.164:0/1959279163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f628e040 msgr2=0x55a5f628e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.767+0000 7f20ab539800 1 --2- 172.21.15.164:0/1959279163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f628e040 0x55a5f628e460 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f209c045f50 tx=0x7f209c002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.767+0000 7f20ab539800 1 -- 172.21.15.164:0/1959279163 shutdown_connections 2024-09-13T23:05:33.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.767+0000 7f20ab539800 1 --2- 172.21.15.164:0/1959279163 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f80036b90 0x7f1f80039050 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.767+0000 7f20ab539800 1 --2- 172.21.15.164:0/1959279163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f628e040 0x55a5f628e460 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.767+0000 7f20ab539800 1 -- 172.21.15.164:0/1959279163 >> 172.21.15.164:0/1959279163 conn(0x55a5f6282fd0 msgr2=0x55a5f6285b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.767+0000 7f20ab539800 1 -- 172.21.15.164:0/1959279163 shutdown_connections 2024-09-13T23:05:33.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.767+0000 7f20ab539800 1 -- 172.21.15.164:0/1959279163 wait complete. 2024-09-13T23:05:33.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.767+0000 7f20ab539800 1 -- 172.21.15.164:0/3493061308 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a5f6180900 msgr2=0x55a5f627d680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.767+0000 7f20ab539800 1 --2- 172.21.15.164:0/3493061308 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a5f6180900 0x55a5f627d680 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.767+0000 7f20ab539800 1 -- 172.21.15.164:0/3493061308 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f8c036b90 msgr2=0x7f1f8c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.767+0000 7f20ab539800 1 --2- 172.21.15.164:0/3493061308 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f8c036b90 0x7f1f8c039050 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f209c057000 tx=0x7f209c052000 comp rx=0 tx=0).stop 2024-09-13T23:05:33.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.768+0000 7f20ab539800 1 -- 172.21.15.164:0/3493061308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f617c4c0 msgr2=0x55a5f626ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.768+0000 7f20ab539800 1 --2- 172.21.15.164:0/3493061308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f617c4c0 0x55a5f626ceb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2098000f80 tx=0x7f2098001250 comp rx=0 tx=0).stop 2024-09-13T23:05:33.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.768+0000 7f20ab539800 1 -- 172.21.15.164:0/3493061308 shutdown_connections 2024-09-13T23:05:33.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.768+0000 7f20ab539800 1 --2- 172.21.15.164:0/3493061308 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a5f6180900 0x55a5f627d680 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.768+0000 7f20ab539800 1 --2- 172.21.15.164:0/3493061308 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f8c036b90 0x7f1f8c039050 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.768+0000 7f20ab539800 1 --2- 172.21.15.164:0/3493061308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a5f617c4c0 0x55a5f626ceb0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.768+0000 7f20ab539800 1 -- 172.21.15.164:0/3493061308 >> 172.21.15.164:0/3493061308 conn(0x55a5f6177df0 msgr2=0x55a5f6265a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.768+0000 7f20ab539800 1 -- 172.21.15.164:0/3493061308 shutdown_connections 2024-09-13T23:05:33.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.768+0000 7f20ab539800 1 -- 172.21.15.164:0/3493061308 wait complete. 2024-09-13T23:05:33.788 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:05:31.300851Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-13T23:05:33.360148Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:05:31.300826Z', 'tags': [], 'group_ids': []} 2024-09-13T23:05:33.788 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-13T23:05:33.788 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-13T23:05:33.788 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-13T23:05:33.836 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:33.836 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:33.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.836+0000 7fb5ee630800 1 Processor -- start 2024-09-13T23:05:33.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.836+0000 7fb5ee630800 1 -- start start 2024-09-13T23:05:33.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.836+0000 7fb5ee630800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5644a58d4920 0x5644a58d6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.836+0000 7fb5ee630800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5644a5790b30 con 0x5644a58d04e0 2024-09-13T23:05:33.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.836+0000 7fb5ee630800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x5644a5772360 con 0x5644a58d4920 2024-09-13T23:05:33.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.836+0000 7fb5e9072640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5644a58d4920 0x5644a58d6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.836+0000 7fb5e9873640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x5644a58d04e0 0x5644a58d08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40870/0 (socket says 172.21.15.164:40870) 2024-09-13T23:05:33.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.837+0000 7fb5e9873640 1 -- 172.21.15.164:0/2508921197 learned_addr learned my addr 172.21.15.164:0/2508921197 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:33.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.837+0000 7fb5e8871640 1 -- 172.21.15.164:0/2508921197 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2679869349 0 0) 0x5644a5790b30 con 0x5644a58d04e0 2024-09-13T23:05:33.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.837+0000 7fb5e8871640 1 -- 172.21.15.164:0/2508921197 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5d4001e10 con 0x5644a58d04e0 2024-09-13T23:05:33.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.837+0000 7fb5e9072640 1 -- 172.21.15.164:0/2508921197 >> v1:172.21.15.17:6789/0 conn(0x5644a58d04e0 legacy=0x5644a58d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.837+0000 7fb5e9072640 1 -- 172.21.15.164:0/2508921197 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644a5798e00 con 0x5644a58d4920 2024-09-13T23:05:33.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.839+0000 7fb5e9072640 1 --2- 172.21.15.164:0/2508921197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a58d4920 0x5644a58d6d10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb5e000a470 tx=0x7fb5e0045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86434b5ebf077a14 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.839+0000 7fb5e8871640 1 -- 172.21.15.164:0/2508921197 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5e0059070 con 0x5644a58d4920 2024-09-13T23:05:33.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.839+0000 7fb5e8871640 1 -- 172.21.15.164:0/2508921197 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e0054570 con 0x5644a58d4920 2024-09-13T23:05:33.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.839+0000 7fb5e8871640 1 -- 172.21.15.164:0/2508921197 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5e0054870 con 0x5644a58d4920 2024-09-13T23:05:33.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.839+0000 7fb5ee630800 1 -- 172.21.15.164:0/2508921197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a58d4920 msgr2=0x5644a58d6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.839+0000 7fb5ee630800 1 --2- 172.21.15.164:0/2508921197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a58d4920 0x5644a58d6d10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb5e000a470 tx=0x7fb5e0045920 comp rx=0 tx=0).stop 2024-09-13T23:05:33.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.839+0000 7fb5ee630800 1 -- 172.21.15.164:0/2508921197 shutdown_connections 2024-09-13T23:05:33.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.839+0000 7fb5ee630800 1 --2- 172.21.15.164:0/2508921197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a58d4920 0x5644a58d6d10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.839+0000 7fb5ee630800 1 -- 172.21.15.164:0/2508921197 >> 172.21.15.164:0/2508921197 conn(0x5644a58cbe10 msgr2=0x5644a58ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.839+0000 7fb5ee630800 1 -- 172.21.15.164:0/2508921197 shutdown_connections 2024-09-13T23:05:33.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.839+0000 7fb5ee630800 1 -- 172.21.15.164:0/2508921197 wait complete. 2024-09-13T23:05:33.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.853+0000 7fb5ee630800 1 Processor -- start 2024-09-13T23:05:33.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.853+0000 7fb5ee630800 1 -- start start 2024-09-13T23:05:33.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.854+0000 7fb5ee630800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a58d04e0 0x5644a59c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.854+0000 7fb5ee630800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5644a581d350 con 0x5644a58d04e0 2024-09-13T23:05:33.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.854+0000 7fb5e9873640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a58d04e0 0x5644a59c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.854+0000 7fb5e9873640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a58d04e0 0x5644a59c28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57226/0 (socket says 172.21.15.164:57226) 2024-09-13T23:05:33.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.854+0000 7fb5e9873640 1 -- 172.21.15.164:0/1954044309 learned_addr learned my addr 172.21.15.164:0/1954044309 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.854+0000 7fb5e9873640 1 -- 172.21.15.164:0/1954044309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644a576abc0 con 0x5644a58d04e0 2024-09-13T23:05:33.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.854+0000 7fb5e9873640 1 --2- 172.21.15.164:0/1954044309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a58d04e0 0x5644a59c28c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc001e30 tx=0x7fb5dc00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f7ee1cb6872ad7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.855+0000 7fb4d7e07640 1 -- 172.21.15.164:0/1954044309 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5dc012020 con 0x5644a58d04e0 2024-09-13T23:05:33.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.855+0000 7fb4d7e07640 1 -- 172.21.15.164:0/1954044309 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5dc00e5a0 con 0x5644a58d04e0 2024-09-13T23:05:33.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.855+0000 7fb4d7e07640 1 -- 172.21.15.164:0/1954044309 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5dc00e8e0 con 0x5644a58d04e0 2024-09-13T23:05:33.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.855+0000 7fb5ee630800 1 -- 172.21.15.164:0/1954044309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a58d04e0 msgr2=0x5644a59c28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.855+0000 7fb5ee630800 1 --2- 172.21.15.164:0/1954044309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a58d04e0 0x5644a59c28c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc001e30 tx=0x7fb5dc00b780 comp rx=0 tx=0).stop 2024-09-13T23:05:33.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.855+0000 7fb5ee630800 1 -- 172.21.15.164:0/1954044309 shutdown_connections 2024-09-13T23:05:33.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.855+0000 7fb5ee630800 1 --2- 172.21.15.164:0/1954044309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a58d04e0 0x5644a59c28c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.855+0000 7fb5ee630800 1 -- 172.21.15.164:0/1954044309 >> 172.21.15.164:0/1954044309 conn(0x5644a58cbe10 msgr2=0x5644a59b9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.855+0000 7fb5ee630800 1 -- 172.21.15.164:0/1954044309 shutdown_connections 2024-09-13T23:05:33.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.855+0000 7fb5ee630800 1 -- 172.21.15.164:0/1954044309 wait complete. 2024-09-13T23:05:33.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.856+0000 7fb5ee630800 1 Processor -- start 2024-09-13T23:05:33.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.856+0000 7fb5ee630800 1 -- start start 2024-09-13T23:05:33.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.856+0000 7fb5ee630800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a58d04e0 0x5644a59ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.856+0000 7fb5ee630800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5644a58d7550 con 0x5644a58d04e0 2024-09-13T23:05:33.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.856+0000 7fb5e9873640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a58d04e0 0x5644a59ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.856+0000 7fb5e9873640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a58d04e0 0x5644a59ca2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57230/0 (socket says 172.21.15.164:57230) 2024-09-13T23:05:33.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.856+0000 7fb5e9873640 1 -- 172.21.15.164:0/3096396309 learned_addr learned my addr 172.21.15.164:0/3096396309 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.857+0000 7fb5e9873640 1 -- 172.21.15.164:0/3096396309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644a577efe0 con 0x5644a58d04e0 2024-09-13T23:05:33.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.857+0000 7fb5e9873640 1 --2- 172.21.15.164:0/3096396309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a58d04e0 0x5644a59ca2b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc001e30 tx=0x7fb5dc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.857+0000 7fb4d6604640 1 -- 172.21.15.164:0/3096396309 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5dc012030 con 0x5644a58d04e0 2024-09-13T23:05:33.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.857+0000 7fb4d6604640 1 -- 172.21.15.164:0/3096396309 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5dc001490 con 0x5644a58d04e0 2024-09-13T23:05:33.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.857+0000 7fb4d6604640 1 -- 172.21.15.164:0/3096396309 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5dc01a8f0 con 0x5644a58d04e0 2024-09-13T23:05:33.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.857+0000 7fb5ee630800 1 -- 172.21.15.164:0/3096396309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644a59ca7f0 con 0x5644a58d04e0 2024-09-13T23:05:33.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.857+0000 7fb5ee630800 1 -- 172.21.15.164:0/3096396309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644a59cad10 con 0x5644a58d04e0 2024-09-13T23:05:33.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.858+0000 7fb4d6604640 1 -- 172.21.15.164:0/3096396309 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb5dc015020 con 0x5644a58d04e0 2024-09-13T23:05:33.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.858+0000 7fb4d6604640 1 --2- 172.21.15.164:0/3096396309 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb4d0036b90 0x7fb4d0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.858+0000 7fb4d6604640 1 -- 172.21.15.164:0/3096396309 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb5dc020030 con 0x5644a58d04e0 2024-09-13T23:05:33.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.858+0000 7fb5e9072640 1 --2- 172.21.15.164:0/3096396309 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb4d0036b90 0x7fb4d0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.858+0000 7fb5ee630800 1 --2- 172.21.15.164:0/3096396309 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5644a58d4920 0x5644a59d1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.858+0000 7fb5ee630800 1 -- 172.21.15.164:0/3096396309 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644a59d1860 con 0x5644a58d4920 2024-09-13T23:05:33.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.858+0000 7fb5ea074640 1 --2- 172.21.15.164:0/3096396309 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5644a58d4920 0x5644a59d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.858+0000 7fb5e9072640 1 --2- 172.21.15.164:0/3096396309 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb4d0036b90 0x7fb4d0039050 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x5644a58d12e0 tx=0x7fb5e0050000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.859+0000 7fb5ea074640 1 --2- 172.21.15.164:0/3096396309 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5644a58d4920 0x5644a59d1320 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.859+0000 7fb5ea074640 1 -- 172.21.15.164:0/3096396309 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5e400a4a0 con 0x5644a58d4920 2024-09-13T23:05:33.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.859+0000 7fb5ee630800 1 -- 172.21.15.164:0/3096396309 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644a59ce840 con 0x5644a58d4920 2024-09-13T23:05:33.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.859+0000 7fb5ea074640 1 -- 172.21.15.164:0/3096396309 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb5e400a4a0 con 0x5644a58d4920 2024-09-13T23:05:33.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.859+0000 7fb5ee630800 1 -- 172.21.15.164:0/3096396309 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644a59d32a0 con 0x5644a58d4920 2024-09-13T23:05:33.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.859+0000 7fb5ea074640 1 -- 172.21.15.164:0/3096396309 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb5e400a4a0 con 0x5644a58d4920 2024-09-13T23:05:33.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.859+0000 7fb5ee630800 1 -- 172.21.15.164:0/3096396309 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644a59d2140 con 0x5644a58d4920 2024-09-13T23:05:33.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.860+0000 7fb5ea074640 1 -- 172.21.15.164:0/3096396309 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb5e400a4a0 con 0x5644a58d4920 2024-09-13T23:05:33.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.860+0000 7fb5ee630800 1 -- 172.21.15.164:0/3096396309 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644a59d2560 con 0x5644a58d4920 2024-09-13T23:05:33.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.860+0000 7fb5ea074640 1 -- 172.21.15.164:0/3096396309 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb5e400a4a0 con 0x5644a58d4920 2024-09-13T23:05:33.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.860+0000 7fb5ee630800 1 Processor -- start 2024-09-13T23:05:33.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.860+0000 7fb5ee630800 1 -- start start 2024-09-13T23:05:33.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.860+0000 7fb5ee630800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a59e1c30 0x5644a59e2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.860+0000 7fb5ee630800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5644a576c580 con 0x5644a59e1c30 2024-09-13T23:05:33.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.861+0000 7fb5e9072640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a59e1c30 0x5644a59e2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.861+0000 7fb5e9072640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a59e1c30 0x5644a59e2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57238/0 (socket says 172.21.15.164:57238) 2024-09-13T23:05:33.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.861+0000 7fb5e9072640 1 -- 172.21.15.164:0/368990806 learned_addr learned my addr 172.21.15.164:0/368990806 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.861+0000 7fb5e9072640 1 -- 172.21.15.164:0/368990806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644a59e25b0 con 0x5644a59e1c30 2024-09-13T23:05:33.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.861+0000 7fb5e9072640 1 --2- 172.21.15.164:0/368990806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a59e1c30 0x5644a59e2070 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0025af0 tx=0x7fb5e0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.861+0000 7fb4cf7fe640 1 -- 172.21.15.164:0/368990806 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5e0070070 con 0x5644a59e1c30 2024-09-13T23:05:33.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.861+0000 7fb4cf7fe640 1 -- 172.21.15.164:0/368990806 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e005f470 con 0x5644a59e1c30 2024-09-13T23:05:33.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.861+0000 7fb5ee630800 1 -- 172.21.15.164:0/368990806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644a59e2840 con 0x5644a59e1c30 2024-09-13T23:05:33.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.861+0000 7fb4cf7fe640 1 -- 172.21.15.164:0/368990806 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5e0059040 con 0x5644a59e1c30 2024-09-13T23:05:33.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.861+0000 7fb5ee630800 1 -- 172.21.15.164:0/368990806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644a59e54d0 con 0x5644a59e1c30 2024-09-13T23:05:33.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.862+0000 7fb4cf7fe640 1 -- 172.21.15.164:0/368990806 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb5e0073070 con 0x5644a59e1c30 2024-09-13T23:05:33.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.862+0000 7fb4cf7fe640 1 --2- 172.21.15.164:0/368990806 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb4c4036b90 0x7fb4c4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.862+0000 7fb4cf7fe640 1 -- 172.21.15.164:0/368990806 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb5e0068070 con 0x5644a59e1c30 2024-09-13T23:05:33.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.862+0000 7fb5ea074640 1 --2- 172.21.15.164:0/368990806 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb4c4036b90 0x7fb4c4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.863+0000 7fb5ee630800 1 Processor -- start 2024-09-13T23:05:33.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.863+0000 7fb5ea074640 1 --2- 172.21.15.164:0/368990806 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb4c4036b90 0x7fb4c4039050 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x5644a59d24e0 tx=0x7fb5e4005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.863+0000 7fb5ee630800 1 -- start start 2024-09-13T23:05:33.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.863+0000 7fb5ee630800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a59ee8a0 0x5644a59eeca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.863+0000 7fb5ee630800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5644a59c3070 con 0x5644a59ee8a0 2024-09-13T23:05:33.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.863+0000 7fb5e9072640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a59ee8a0 0x5644a59eeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.863+0000 7fb5e9072640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a59ee8a0 0x5644a59eeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57250/0 (socket says 172.21.15.164:57250) 2024-09-13T23:05:33.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.863+0000 7fb5e9072640 1 -- 172.21.15.164:0/116365917 learned_addr learned my addr 172.21.15.164:0/116365917 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.863+0000 7fb5e9072640 1 -- 172.21.15.164:0/116365917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644a59ef270 con 0x5644a59ee8a0 2024-09-13T23:05:33.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.863+0000 7fb5e9072640 1 --2- 172.21.15.164:0/116365917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a59ee8a0 0x5644a59eeca0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb5e008f960 tx=0x7fb5e005eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ae049fbcab8c17 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.863+0000 7fb4cd7fa640 1 -- 172.21.15.164:0/116365917 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5e0074c60 con 0x5644a59ee8a0 2024-09-13T23:05:33.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.864+0000 7fb4cd7fa640 1 -- 172.21.15.164:0/116365917 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e0009790 con 0x5644a59ee8a0 2024-09-13T23:05:33.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.864+0000 7fb4cd7fa640 1 -- 172.21.15.164:0/116365917 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5e005e3d0 con 0x5644a59ee8a0 2024-09-13T23:05:33.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.864+0000 7fb5ee630800 1 -- 172.21.15.164:0/116365917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a59ee8a0 msgr2=0x5644a59eeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.864+0000 7fb5ee630800 1 --2- 172.21.15.164:0/116365917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a59ee8a0 0x5644a59eeca0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb5e008f960 tx=0x7fb5e005eb20 comp rx=0 tx=0).stop 2024-09-13T23:05:33.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.864+0000 7fb5ee630800 1 -- 172.21.15.164:0/116365917 shutdown_connections 2024-09-13T23:05:33.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.864+0000 7fb5ee630800 1 --2- 172.21.15.164:0/116365917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a59ee8a0 0x5644a59eeca0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.864+0000 7fb5ee630800 1 -- 172.21.15.164:0/116365917 >> 172.21.15.164:0/116365917 conn(0x5644a59eac00 msgr2=0x5644a59e8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.864+0000 7fb5ee630800 1 -- 172.21.15.164:0/116365917 shutdown_connections 2024-09-13T23:05:33.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.864+0000 7fb5ee630800 1 -- 172.21.15.164:0/116365917 wait complete. 2024-09-13T23:05:33.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.864+0000 7fb5ee630800 1 Processor -- start 2024-09-13T23:05:33.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.864+0000 7fb5ee630800 1 -- start start 2024-09-13T23:05:33.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.865+0000 7fb5ee630800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a59ee8a0 0x5644a59f5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.865+0000 7fb5ee630800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5644a59ef8e0 con 0x5644a59ee8a0 2024-09-13T23:05:33.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.865+0000 7fb5e9072640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a59ee8a0 0x5644a59f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.865+0000 7fb5e9072640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a59ee8a0 0x5644a59f5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57258/0 (socket says 172.21.15.164:57258) 2024-09-13T23:05:33.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.865+0000 7fb5e9072640 1 -- 172.21.15.164:0/4149841117 learned_addr learned my addr 172.21.15.164:0/4149841117 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.865+0000 7fb5e9072640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644a59f62a0 con 0x5644a59ee8a0 2024-09-13T23:05:33.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.865+0000 7fb5e9072640 1 --2- 172.21.15.164:0/4149841117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a59ee8a0 0x5644a59f5d60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb5e005f000 tx=0x7fb5e008f8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.865+0000 7fb4bb7fe640 1 -- 172.21.15.164:0/4149841117 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5e0096070 con 0x5644a59ee8a0 2024-09-13T23:05:33.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.865+0000 7fb4bb7fe640 1 -- 172.21.15.164:0/4149841117 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e0073d90 con 0x5644a59ee8a0 2024-09-13T23:05:33.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.865+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644a59f6530 con 0x5644a59ee8a0 2024-09-13T23:05:33.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.865+0000 7fb4bb7fe640 1 -- 172.21.15.164:0/4149841117 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5e008d050 con 0x5644a59ee8a0 2024-09-13T23:05:33.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.865+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644a59f91e0 con 0x5644a59ee8a0 2024-09-13T23:05:33.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.866+0000 7fb4bb7fe640 1 -- 172.21.15.164:0/4149841117 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb5e0099070 con 0x5644a59ee8a0 2024-09-13T23:05:33.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.866+0000 7fb4bb7fe640 1 --2- 172.21.15.164:0/4149841117 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb4b4036b90 0x7fb4b4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.866+0000 7fb4bb7fe640 1 -- 172.21.15.164:0/4149841117 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb5e0062070 con 0x5644a59ee8a0 2024-09-13T23:05:33.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.867+0000 7fb5ea074640 1 --2- 172.21.15.164:0/4149841117 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb4b4036b90 0x7fb4b4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.867+0000 7fb5ea074640 1 --2- 172.21.15.164:0/4149841117 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb4b4036b90 0x7fb4b4039050 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x5644a59d3030 tx=0x7fb5e401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.867+0000 7fb5ee630800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.867+0000 7fb5ee630800 1 --2- 172.21.15.164:0/4149841117 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5644a5a01870 0x5644a5a03d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.867+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a04480 con 0x5644a5a01870 2024-09-13T23:05:33.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.867+0000 7fb5e9873640 1 --2- 172.21.15.164:0/4149841117 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5644a5a01870 0x5644a5a03d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.868+0000 7fb5e9873640 1 --2- 172.21.15.164:0/4149841117 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5644a5a01870 0x5644a5a03d30 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.868+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.868+0000 7fb5ee630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.868+0000 7fb5ee630800 20 realm 2024-09-13T23:05:33.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.868+0000 7fb5ee630800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.868+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a04890 con 0x5644a5a01870 2024-09-13T23:05:33.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.868+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.868+0000 7fb5ee630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.868+0000 7fb5ee630800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:33.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.868+0000 7fb5ee630800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.868+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a05160 con 0x5644a5a01870 2024-09-13T23:05:33.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.868+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.868+0000 7fb5ee630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.868+0000 7fb5ee630800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.868+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a05500 con 0x5644a5a01870 2024-09-13T23:05:33.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.868+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.868+0000 7fb5ee630800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:33.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.868+0000 7fb5ee630800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.868+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a05d50 con 0x5644a5a01870 2024-09-13T23:05:33.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.869+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.869+0000 7fb5ee630800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:33.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.869+0000 7fb5ee630800 20 searching for the correct realm 2024-09-13T23:05:33.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.869+0000 7fb5ee630800 1 --2- 172.21.15.164:0/4149841117 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5644a5a07ac0 0x5644a5a09eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.869+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x5644a5a07ac0 2024-09-13T23:05:33.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.869+0000 7fb5e9072640 1 --2- 172.21.15.164:0/4149841117 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5644a5a07ac0 0x5644a5a09eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.869+0000 7fb5e9072640 1 --2- 172.21.15.164:0/4149841117 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5644a5a07ac0 0x5644a5a09eb0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.869+0000 7fb5e9072640 1 -- 172.21.15.164:0/4149841117 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e0098030 con 0x5644a5a07ac0 2024-09-13T23:05:33.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.870+0000 7fb5e9072640 1 --2- 172.21.15.164:0/4149841117 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fb5e009b060 0x7fb5e006b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.870+0000 7fb5e9072640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x7fb5e009b060 2024-09-13T23:05:33.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.870+0000 7fb5ea074640 1 --2- 172.21.15.164:0/4149841117 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fb5e009b060 0x7fb5e006b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.870+0000 7fb5ea074640 1 --2- 172.21.15.164:0/4149841117 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fb5e009b060 0x7fb5e006b870 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.870+0000 7fb5ea074640 1 -- 172.21.15.164:0/4149841117 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e401f070 con 0x7fb5e009b060 2024-09-13T23:05:33.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.870+0000 7fb5ea074640 1 --2- 172.21.15.164:0/4149841117 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fb5e4031040 0x7fb5e4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.870+0000 7fb5ea074640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x7fb5e4031040 2024-09-13T23:05:33.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.870+0000 7fb5e9873640 1 --2- 172.21.15.164:0/4149841117 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fb5e4031040 0x7fb5e4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.871+0000 7fb5e9873640 1 --2- 172.21.15.164:0/4149841117 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fb5e4031040 0x7fb5e4032940 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.871+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5dc01ac70 con 0x7fb5e4031040 2024-09-13T23:05:33.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.871+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x5644a5a01870 2024-09-13T23:05:33.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.871+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.871+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x5644a5a01870 2024-09-13T23:05:33.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.871+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.871+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x7fb5e4031040 2024-09-13T23:05:33.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.872+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5dc01ac70 con 0x7fb5e4031040 2024-09-13T23:05:33.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.872+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x7fb5e4031040 2024-09-13T23:05:33.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.872+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5dc01ac70 con 0x7fb5e4031040 2024-09-13T23:05:33.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.872+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x7fb5e009b060 2024-09-13T23:05:33.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.872+0000 7fb5ea074640 1 -- 172.21.15.164:0/4149841117 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e401f070 con 0x7fb5e009b060 2024-09-13T23:05:33.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.872+0000 7fb5ea074640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x5644a5a07ac0 2024-09-13T23:05:33.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.872+0000 7fb5e9072640 1 -- 172.21.15.164:0/4149841117 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e0098030 con 0x5644a5a07ac0 2024-09-13T23:05:33.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.872+0000 7fb5e9072640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x5644a5a01870 2024-09-13T23:05:33.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.873+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.873+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x7fb5e4031040 2024-09-13T23:05:33.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.873+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5dc01ac70 con 0x7fb5e4031040 2024-09-13T23:05:33.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.873+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x5644a5a01870 2024-09-13T23:05:33.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.873+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.873+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x7fb5e009b060 2024-09-13T23:05:33.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.873+0000 7fb5ea074640 1 -- 172.21.15.164:0/4149841117 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb5e401f070 con 0x7fb5e009b060 2024-09-13T23:05:33.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.873+0000 7fb5ea074640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x5644a5a07ac0 2024-09-13T23:05:33.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.874+0000 7fb5e9072640 1 -- 172.21.15.164:0/4149841117 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e00aa040 con 0x5644a5a07ac0 2024-09-13T23:05:33.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.874+0000 7fb5e9072640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x5644a5a07ac0 2024-09-13T23:05:33.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.874+0000 7fb5e9072640 1 -- 172.21.15.164:0/4149841117 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e00aa040 con 0x5644a5a07ac0 2024-09-13T23:05:33.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.874+0000 7fb5e9072640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x7fb5e4031040 2024-09-13T23:05:33.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.874+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5dc01ac70 con 0x7fb5e4031040 2024-09-13T23:05:33.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.874+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x5644a5a07ac0 2024-09-13T23:05:33.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.874+0000 7fb5e9072640 1 -- 172.21.15.164:0/4149841117 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e00aa040 con 0x5644a5a07ac0 2024-09-13T23:05:33.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.874+0000 7fb5e9072640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x5644a5a07ac0 2024-09-13T23:05:33.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.875+0000 7fb5e9072640 1 -- 172.21.15.164:0/4149841117 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e00aa040 con 0x5644a5a07ac0 2024-09-13T23:05:33.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.875+0000 7fb5e9072640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x5644a5a01870 2024-09-13T23:05:33.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.875+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.875+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x5644a5a01870 2024-09-13T23:05:33.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.875+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.875+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x7fb5e4031040 2024-09-13T23:05:33.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.875+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5dc01ac70 con 0x7fb5e4031040 2024-09-13T23:05:33.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.875+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x5644a5a07ac0 2024-09-13T23:05:33.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.875+0000 7fb5e9072640 1 -- 172.21.15.164:0/4149841117 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e00aa040 con 0x5644a5a07ac0 2024-09-13T23:05:33.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.875+0000 7fb5e9072640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x7fb5e009b060 2024-09-13T23:05:33.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.876+0000 7fb5ea074640 1 -- 172.21.15.164:0/4149841117 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e401f070 con 0x7fb5e009b060 2024-09-13T23:05:33.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.876+0000 7fb5ea074640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x5644a5a01870 2024-09-13T23:05:33.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.876+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.876+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x7fb5e4031040 2024-09-13T23:05:33.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.876+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5dc01ac70 con 0x7fb5e4031040 2024-09-13T23:05:33.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.876+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x5644a5a07ac0 2024-09-13T23:05:33.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.876+0000 7fb5e9072640 1 -- 172.21.15.164:0/4149841117 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e00aa040 con 0x5644a5a07ac0 2024-09-13T23:05:33.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.876+0000 7fb5e9072640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x7fb5e4031040 2024-09-13T23:05:33.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.877+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5dc01ac70 con 0x7fb5e4031040 2024-09-13T23:05:33.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.877+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x7fb5e009b060 2024-09-13T23:05:33.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.877+0000 7fb5ea074640 1 -- 172.21.15.164:0/4149841117 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e401f070 con 0x7fb5e009b060 2024-09-13T23:05:33.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.877+0000 7fb5ea074640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x5644a5a07ac0 2024-09-13T23:05:33.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.877+0000 7fb5e9072640 1 -- 172.21.15.164:0/4149841117 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e00aa040 con 0x5644a5a07ac0 2024-09-13T23:05:33.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.877+0000 7fb5e9072640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x7fb5e4031040 2024-09-13T23:05:33.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.877+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5dc01ac70 con 0x7fb5e4031040 2024-09-13T23:05:33.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.877+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x5644a5a01870 2024-09-13T23:05:33.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.878+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.878+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a4c0 con 0x7fb5e009b060 2024-09-13T23:05:33.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.878+0000 7fb5ea074640 1 -- 172.21.15.164:0/4149841117 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e401f070 con 0x7fb5e009b060 2024-09-13T23:05:33.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.878+0000 7fb5ee630800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:33.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.878+0000 7fb5ee630800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:33.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.878+0000 7fb5ee630800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:33.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.878+0000 7fb5ee630800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:33.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.878+0000 7fb5ee630800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:33.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.878+0000 7fb5ee630800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:33.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.878+0000 7fb5ee630800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.878+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a066d0 con 0x5644a5a01870 2024-09-13T23:05:33.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.878+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.878+0000 7fb5ee630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.878+0000 7fb5ee630800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.878+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a06f70 con 0x5644a5a01870 2024-09-13T23:05:33.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.878+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.879+0000 7fb5ee630800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:33.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.879+0000 7fb5ee630800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.879+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0a940 con 0x5644a5a01870 2024-09-13T23:05:33.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.879+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.879+0000 7fb5ee630800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:33.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.879+0000 7fb5ee630800 20 zone default found 2024-09-13T23:05:33.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.879+0000 7fb5ee630800 4 Realm: () 2024-09-13T23:05:33.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.879+0000 7fb5ee630800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:33.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.879+0000 7fb5ee630800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:33.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.879+0000 7fb5ee630800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:33.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.879+0000 7fb5ee630800 20 zonegroup default 2024-09-13T23:05:33.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.879+0000 7fb5ee630800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.879+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a06bd0 con 0x7fb5e4031040 2024-09-13T23:05:33.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.879+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb5dc01ac70 con 0x7fb5e4031040 2024-09-13T23:05:33.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.879+0000 7fb5ee630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.879+0000 7fb5ee630800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.879+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0c820 con 0x5644a5a07ac0 2024-09-13T23:05:33.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.879+0000 7fb5e9072640 1 -- 172.21.15.164:0/4149841117 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb5e00aa040 con 0x5644a5a07ac0 2024-09-13T23:05:33.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.879+0000 7fb5ee630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.879+0000 7fb5ee630800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.879+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0cbc0 con 0x5644a5a07ac0 2024-09-13T23:05:33.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.880+0000 7fb5e9072640 1 -- 172.21.15.164:0/4149841117 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb5e00aa040 con 0x5644a5a07ac0 2024-09-13T23:05:33.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.880+0000 7fb5ee630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:33.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.880+0000 7fb5ee630800 20 started sync module instance, tier type = 2024-09-13T23:05:33.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.880+0000 7fb5ee630800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:33.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.880+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0bcc0 con 0x7fb5e009b060 2024-09-13T23:05:33.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.881+0000 7fb5ea074640 1 -- 172.21.15.164:0/4149841117 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e4040040 con 0x7fb5e009b060 2024-09-13T23:05:33.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.881+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94852836540592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0b920 con 0x7fb5e009b060 2024-09-13T23:05:33.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.881+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0dac0 con 0x5644a5a01870 2024-09-13T23:05:33.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.882+0000 7fb5ea074640 1 -- 172.21.15.164:0/4149841117 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94852836540592] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e4040040 con 0x7fb5e009b060 2024-09-13T23:05:33.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.882+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.882+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94852836544496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0dac0 con 0x5644a5a01870 2024-09-13T23:05:33.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.882+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0e480 con 0x5644a5a07ac0 2024-09-13T23:05:33.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.883+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94852836544496] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.883+0000 7fb5e9072640 1 -- 172.21.15.164:0/4149841117 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e00aa040 con 0x5644a5a07ac0 2024-09-13T23:05:33.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.883+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94852836546064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0da30 con 0x5644a5a07ac0 2024-09-13T23:05:33.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.883+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0f340 con 0x7fb5e009b060 2024-09-13T23:05:33.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.884+0000 7fb5e9072640 1 -- 172.21.15.164:0/4149841117 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94852836546064] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e00aa040 con 0x5644a5a07ac0 2024-09-13T23:05:33.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.884+0000 7fb5ea074640 1 -- 172.21.15.164:0/4149841117 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e4040040 con 0x7fb5e009b060 2024-09-13T23:05:33.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.884+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94852836552336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a0f2b0 con 0x7fb5e009b060 2024-09-13T23:05:33.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.884+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a10200 con 0x5644a5a01870 2024-09-13T23:05:33.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.885+0000 7fb5ea074640 1 -- 172.21.15.164:0/4149841117 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94852836552336] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e4040040 con 0x7fb5e009b060 2024-09-13T23:05:33.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.885+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.885+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94852836554544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a10200 con 0x5644a5a01870 2024-09-13T23:05:33.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.885+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a10bc0 con 0x7fb5e4031040 2024-09-13T23:05:33.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.886+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94852836554544] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.887+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5dc01ac70 con 0x7fb5e4031040 2024-09-13T23:05:33.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.887+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94852836559088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a10200 con 0x7fb5e4031040 2024-09-13T23:05:33.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.887+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a115d0 con 0x7fb5e4031040 2024-09-13T23:05:33.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.888+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5dc01ac70 con 0x7fb5e4031040 2024-09-13T23:05:33.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.888+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94852836561184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a119f0 con 0x7fb5e4031040 2024-09-13T23:05:33.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.888+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a124d0 con 0x7fb5e4031040 2024-09-13T23:05:33.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.888+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94852836559088] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5dc01ac70 con 0x7fb5e4031040 2024-09-13T23:05:33.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.889+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94852836561184] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5dc01ac70 con 0x7fb5e4031040 2024-09-13T23:05:33.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.889+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5dc01ac70 con 0x7fb5e4031040 2024-09-13T23:05:33.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.889+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94852836564960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a11540 con 0x7fb5e4031040 2024-09-13T23:05:33.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.889+0000 7fb5ee630800 20 add_watcher() i=0 2024-09-13T23:05:33.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.889+0000 7fb5ee630800 20 add_watcher() i=1 2024-09-13T23:05:33.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.889+0000 7fb5ee630800 20 add_watcher() i=2 2024-09-13T23:05:33.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.889+0000 7fb5ee630800 20 add_watcher() i=3 2024-09-13T23:05:33.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.889+0000 7fb5ee630800 20 add_watcher() i=4 2024-09-13T23:05:33.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.889+0000 7fb5ee630800 20 add_watcher() i=5 2024-09-13T23:05:33.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.889+0000 7fb5ee630800 20 add_watcher() i=6 2024-09-13T23:05:33.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.889+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94852836564960] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5dc01ac70 con 0x7fb5e4031040 2024-09-13T23:05:33.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.889+0000 7fb5ee630800 20 add_watcher() i=7 2024-09-13T23:05:33.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.889+0000 7fb5ee630800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:33.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.889+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a155d0 con 0x5644a5a01870 2024-09-13T23:05:33.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.890+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.890+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94852836556112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a12a50 con 0x5644a5a01870 2024-09-13T23:05:33.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.891+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94852836556112] v32'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.891+0000 7fb49b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:33.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.891+0000 7fb5ee630800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:33.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.891+0000 7fb5ee630800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:33.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.891+0000 7fb5ee630800 5 note: GC not initialized 2024-09-13T23:05:33.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.891+0000 7fb49a7fc640 20 reqs_thread_entry: start 2024-09-13T23:05:33.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.891+0000 7fb5ee630800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:33.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.891+0000 7fb5ee630800 20 Filter name: none 2024-09-13T23:05:33.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.892+0000 7fb40bfff640 20 reqs_thread_entry: start 2024-09-13T23:05:33.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.892+0000 7fb5ee630800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:05:33.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.892+0000 7fb5ee630800 20 rados->read ofs=0 len=0 2024-09-13T23:05:33.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.892+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a487c0 con 0x5644a5a01870 2024-09-13T23:05:33.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.892+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.892+0000 7fb5ee630800 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T23:05:33.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.892+0000 7fb5ee630800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:05:33.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.892+0000 7fb5ee630800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:33.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.892+0000 7fb5ee630800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:33.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.892+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a4efb0 con 0x5644a5a01870 2024-09-13T23:05:33.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.893+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.893+0000 7fb5ee630800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:33.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.893+0000 7fb5ee630800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:33.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.893+0000 7fb5ee630800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:05:33.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.893+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94852836813168 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a4a630 con 0x5644a5a01870 2024-09-13T23:05:33.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.894+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== watch-notify(notify (1) cookie 94852836554544 notify 137438953482 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fb5dc033040 con 0x5644a5a01870 2024-09-13T23:05:33.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.894+0000 7fb4cd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953482 cookie 94852836554544 notifier 4428 bl.length()=567 2024-09-13T23:05:33.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.894+0000 7fb4cd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:33.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.894+0000 7fb4cd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:33.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.894+0000 7fb4cd7fa640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb4ac003ea0 con 0x5644a5a01870 2024-09-13T23:05:33.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.894+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(64 notify.4 [notify cookie 94852836813168 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.894+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== watch-notify(notify_complete (2) cookie 94852836813168 notify 137438953482 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5644a59cad10 con 0x5644a5a01870 2024-09-13T23:05:33.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.894+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.894+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a4e970 con 0x7fb5e009b060 2024-09-13T23:05:33.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.895+0000 7fb5ea074640 1 -- 172.21.15.164:0/4149841117 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(66 foo:foo2 [delete] v32'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e4040040 con 0x7fb5e009b060 2024-09-13T23:05:33.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.895+0000 7fb5ee630800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-13T23:05:33.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.895+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94852836813168 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a4a180 con 0x7fb5e009b060 2024-09-13T23:05:33.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.895+0000 7fb5ea074640 1 -- 172.21.15.164:0/4149841117 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== watch-notify(notify (1) cookie 94852836540592 notify 137438953477 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7fb5e40247b0 con 0x7fb5e009b060 2024-09-13T23:05:33.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.895+0000 7fb5ea074640 1 -- 172.21.15.164:0/4149841117 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(67 notify.0 [notify cookie 94852836813168 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb5e4040040 con 0x7fb5e009b060 2024-09-13T23:05:33.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.895+0000 7fb4ccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94852836540592 notifier 4428 bl.length()=159 2024-09-13T23:05:33.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.895+0000 7fb4ccff9640 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb4140032c0 con 0x7fb5e009b060 2024-09-13T23:05:33.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.896+0000 7fb5ea074640 1 -- 172.21.15.164:0/4149841117 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== watch-notify(notify_complete (2) cookie 94852836813168 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb5e4024a50 con 0x7fb5e009b060 2024-09-13T23:05:33.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.896+0000 7fb5ea074640 1 -- 172.21.15.164:0/4149841117 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e4040040 con 0x7fb5e009b060 2024-09-13T23:05:33.909 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:05:31.300851Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:05:31.300826Z","tags":[],"group_ids":[]} 2024-09-13T23:05:33.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.897+0000 7fb49b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:33.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.897+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94852836556112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a46510 con 0x5644a5a01870 2024-09-13T23:05:33.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.898+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94852836556112] v32'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.898+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94852836540592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a46510 con 0x7fb5e009b060 2024-09-13T23:05:33.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.899+0000 7fb5ea074640 1 -- 172.21.15.164:0/4149841117 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94852836540592] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e4040040 con 0x7fb5e009b060 2024-09-13T23:05:33.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.899+0000 7fb5ee630800 20 remove_watcher() i=0 2024-09-13T23:05:33.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.899+0000 7fb5ee630800 2 removed watcher, disabling cache 2024-09-13T23:05:33.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.899+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94852836544496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a46510 con 0x5644a5a01870 2024-09-13T23:05:33.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.900+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94852836544496] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.900+0000 7fb5ee630800 20 remove_watcher() i=1 2024-09-13T23:05:33.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.900+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94852836546064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a46510 con 0x5644a5a07ac0 2024-09-13T23:05:33.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.901+0000 7fb5e9072640 1 -- 172.21.15.164:0/4149841117 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94852836546064] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e00aa040 con 0x5644a5a07ac0 2024-09-13T23:05:33.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.901+0000 7fb5ee630800 20 remove_watcher() i=2 2024-09-13T23:05:33.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.901+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94852836552336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a4a630 con 0x7fb5e009b060 2024-09-13T23:05:33.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.902+0000 7fb5ea074640 1 -- 172.21.15.164:0/4149841117 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94852836552336] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e4040040 con 0x7fb5e009b060 2024-09-13T23:05:33.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.902+0000 7fb5ee630800 20 remove_watcher() i=3 2024-09-13T23:05:33.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.902+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94852836554544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a4a630 con 0x5644a5a01870 2024-09-13T23:05:33.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.903+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94852836554544] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5dc01ac70 con 0x5644a5a01870 2024-09-13T23:05:33.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.903+0000 7fb5ee630800 20 remove_watcher() i=4 2024-09-13T23:05:33.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.903+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94852836559088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a4a630 con 0x7fb5e4031040 2024-09-13T23:05:33.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.905+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94852836559088] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5dc01ac70 con 0x7fb5e4031040 2024-09-13T23:05:33.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.905+0000 7fb5ee630800 20 remove_watcher() i=5 2024-09-13T23:05:33.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.905+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94852836561184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a4a630 con 0x7fb5e4031040 2024-09-13T23:05:33.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.905+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94852836561184] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5dc01ac70 con 0x7fb5e4031040 2024-09-13T23:05:33.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.905+0000 7fb5ee630800 20 remove_watcher() i=6 2024-09-13T23:05:33.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.905+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94852836564960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644a5a4a630 con 0x7fb5e4031040 2024-09-13T23:05:33.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.906+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94852836564960] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5dc01ac70 con 0x7fb5e4031040 2024-09-13T23:05:33.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.906+0000 7fb5ee630800 20 remove_watcher() i=7 2024-09-13T23:05:33.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.906+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fb5e4031040 msgr2=0x7fb5e4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.906+0000 7fb5ee630800 1 --2- 172.21.15.164:0/4149841117 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fb5e4031040 0x7fb5e4032940 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.906+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5644a5a01870 msgr2=0x5644a5a03d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.907+0000 7fb5ee630800 1 --2- 172.21.15.164:0/4149841117 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5644a5a01870 0x5644a5a03d30 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.907+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fb5e009b060 msgr2=0x7fb5e006b870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.907+0000 7fb5ee630800 1 --2- 172.21.15.164:0/4149841117 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fb5e009b060 0x7fb5e006b870 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.907+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5644a5a07ac0 msgr2=0x5644a5a09eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.907+0000 7fb5ee630800 1 --2- 172.21.15.164:0/4149841117 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5644a5a07ac0 0x5644a5a09eb0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.907+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb4b4036b90 msgr2=0x7fb4b4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.907+0000 7fb5ee630800 1 --2- 172.21.15.164:0/4149841117 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb4b4036b90 0x7fb4b4039050 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x5644a59d3030 tx=0x7fb5e401f000 comp rx=0 tx=0).stop 2024-09-13T23:05:33.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.907+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a59ee8a0 msgr2=0x5644a59f5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.907+0000 7fb5ee630800 1 --2- 172.21.15.164:0/4149841117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a59ee8a0 0x5644a59f5d60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb5e005f000 tx=0x7fb5e008f8c0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.907+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 reap_dead start 2024-09-13T23:05:33.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.907+0000 7fb5e9873640 1 -- 172.21.15.164:0/4149841117 reap_dead start 2024-09-13T23:05:33.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.907+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 shutdown_connections 2024-09-13T23:05:33.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.907+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 >> 172.21.15.164:0/4149841117 conn(0x5644a59eac00 msgr2=0x5644a59e8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.907+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 shutdown_connections 2024-09-13T23:05:33.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.907+0000 7fb5ee630800 1 -- 172.21.15.164:0/4149841117 wait complete. 2024-09-13T23:05:33.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.907+0000 7fb5ee630800 1 -- 172.21.15.164:0/368990806 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb4c4036b90 msgr2=0x7fb4c4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.907+0000 7fb5ee630800 1 --2- 172.21.15.164:0/368990806 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb4c4036b90 0x7fb4c4039050 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x5644a59d24e0 tx=0x7fb5e4005840 comp rx=0 tx=0).stop 2024-09-13T23:05:33.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.907+0000 7fb5ee630800 1 -- 172.21.15.164:0/368990806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a59e1c30 msgr2=0x5644a59e2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.907+0000 7fb5ee630800 1 --2- 172.21.15.164:0/368990806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a59e1c30 0x5644a59e2070 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0025af0 tx=0x7fb5e0002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.907+0000 7fb5ee630800 1 -- 172.21.15.164:0/368990806 shutdown_connections 2024-09-13T23:05:33.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.907+0000 7fb5ee630800 1 --2- 172.21.15.164:0/368990806 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb4c4036b90 0x7fb4c4039050 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.907+0000 7fb5ee630800 1 --2- 172.21.15.164:0/368990806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a59e1c30 0x5644a59e2070 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.907+0000 7fb5ee630800 1 -- 172.21.15.164:0/368990806 >> 172.21.15.164:0/368990806 conn(0x5644a59d6bc0 msgr2=0x5644a59d9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.907+0000 7fb5ee630800 1 -- 172.21.15.164:0/368990806 shutdown_connections 2024-09-13T23:05:33.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.907+0000 7fb5ee630800 1 -- 172.21.15.164:0/368990806 wait complete. 2024-09-13T23:05:33.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.907+0000 7fb5ee630800 1 -- 172.21.15.164:0/3096396309 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5644a58d4920 msgr2=0x5644a59d1320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.907+0000 7fb5ee630800 1 --2- 172.21.15.164:0/3096396309 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5644a58d4920 0x5644a59d1320 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.908+0000 7fb5ee630800 1 -- 172.21.15.164:0/3096396309 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb4d0036b90 msgr2=0x7fb4d0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.908+0000 7fb5ee630800 1 --2- 172.21.15.164:0/3096396309 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb4d0036b90 0x7fb4d0039050 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x5644a58d12e0 tx=0x7fb5e0050000 comp rx=0 tx=0).stop 2024-09-13T23:05:33.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.908+0000 7fb5ee630800 1 -- 172.21.15.164:0/3096396309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a58d04e0 msgr2=0x5644a59ca2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.908+0000 7fb5ee630800 1 --2- 172.21.15.164:0/3096396309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a58d04e0 0x5644a59ca2b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc001e30 tx=0x7fb5dc000ed0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.908+0000 7fb5ee630800 1 -- 172.21.15.164:0/3096396309 shutdown_connections 2024-09-13T23:05:33.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.908+0000 7fb5ee630800 1 --2- 172.21.15.164:0/3096396309 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5644a58d4920 0x5644a59d1320 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.908+0000 7fb5ee630800 1 --2- 172.21.15.164:0/3096396309 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb4d0036b90 0x7fb4d0039050 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.908+0000 7fb5ee630800 1 --2- 172.21.15.164:0/3096396309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644a58d04e0 0x5644a59ca2b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.908+0000 7fb5ee630800 1 -- 172.21.15.164:0/3096396309 >> 172.21.15.164:0/3096396309 conn(0x5644a58cbe10 msgr2=0x5644a59b8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.908+0000 7fb5ee630800 1 -- 172.21.15.164:0/3096396309 shutdown_connections 2024-09-13T23:05:33.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.908+0000 7fb5ee630800 1 -- 172.21.15.164:0/3096396309 wait complete. 2024-09-13T23:05:33.924 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:05:31.300851Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:05:31.300826Z', 'tags': [], 'group_ids': []} 2024-09-13T23:05:33.924 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-13T23:05:33.925 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-13T23:05:33.925 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-13T23:05:33.969 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:33.969 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:33.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.969+0000 7f81b9341800 1 Processor -- start 2024-09-13T23:05:33.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.969+0000 7f81b9341800 1 -- start start 2024-09-13T23:05:33.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.970+0000 7f81b9341800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x560b0ea0d4c0 0x560b0ea0d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.970+0000 7f81b9341800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560b0e8cdb30 con 0x560b0ea0de00 2024-09-13T23:05:33.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.970+0000 7f81b9341800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x560b0e8af360 con 0x560b0ea0d4c0 2024-09-13T23:05:33.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.970+0000 7f81b5090640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x560b0ea0d4c0 0x560b0ea0d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.970+0000 7f81b488f640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x560b0ea0de00 0x560b0ea12980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40872/0 (socket says 172.21.15.164:40872) 2024-09-13T23:05:33.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.970+0000 7f81b488f640 1 -- 172.21.15.164:0/1152146571 learned_addr learned my addr 172.21.15.164:0/1152146571 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:33.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.970+0000 7f81affff640 1 -- 172.21.15.164:0/1152146571 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1137671253 0 0) 0x560b0e8cdb30 con 0x560b0ea0de00 2024-09-13T23:05:33.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.970+0000 7f81affff640 1 -- 172.21.15.164:0/1152146571 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81a4001e10 con 0x560b0ea0de00 2024-09-13T23:05:33.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.970+0000 7f81b5090640 1 -- 172.21.15.164:0/1152146571 >> v1:172.21.15.17:6789/0 conn(0x560b0ea0de00 legacy=0x560b0ea12980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.970+0000 7f81b5090640 1 -- 172.21.15.164:0/1152146571 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b0e8d5e00 con 0x560b0ea0d4c0 2024-09-13T23:05:33.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.972+0000 7f81b5090640 1 --2- 172.21.15.164:0/1152146571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0ea0d4c0 0x560b0ea0d8c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f81a8005fd0 tx=0x7f81a8045b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4fc15272fc7046 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.972+0000 7f81affff640 1 -- 172.21.15.164:0/1152146571 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81a8055070 con 0x560b0ea0d4c0 2024-09-13T23:05:33.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.972+0000 7f81affff640 1 -- 172.21.15.164:0/1152146571 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a8051540 con 0x560b0ea0d4c0 2024-09-13T23:05:33.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.972+0000 7f81affff640 1 -- 172.21.15.164:0/1152146571 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81a8051840 con 0x560b0ea0d4c0 2024-09-13T23:05:33.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.973+0000 7f81b9341800 1 -- 172.21.15.164:0/1152146571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0ea0d4c0 msgr2=0x560b0ea0d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.973+0000 7f81b9341800 1 --2- 172.21.15.164:0/1152146571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0ea0d4c0 0x560b0ea0d8c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f81a8005fd0 tx=0x7f81a8045b30 comp rx=0 tx=0).stop 2024-09-13T23:05:33.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.973+0000 7f81b9341800 1 -- 172.21.15.164:0/1152146571 shutdown_connections 2024-09-13T23:05:33.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.973+0000 7f81b9341800 1 --2- 172.21.15.164:0/1152146571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0ea0d4c0 0x560b0ea0d8c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.973+0000 7f81b9341800 1 -- 172.21.15.164:0/1152146571 >> 172.21.15.164:0/1152146571 conn(0x560b0ea08df0 msgr2=0x560b0ea0b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.973+0000 7f81b9341800 1 -- 172.21.15.164:0/1152146571 shutdown_connections 2024-09-13T23:05:33.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.973+0000 7f81b9341800 1 -- 172.21.15.164:0/1152146571 wait complete. 2024-09-13T23:05:33.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.987+0000 7f81b9341800 1 Processor -- start 2024-09-13T23:05:33.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.987+0000 7f81b9341800 1 -- start start 2024-09-13T23:05:33.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.987+0000 7f81b9341800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0ea0d4c0 0x560b0e981d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.987+0000 7f81b9341800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560b0e95a330 con 0x560b0ea0d4c0 2024-09-13T23:05:33.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.987+0000 7f81b5090640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0ea0d4c0 0x560b0e981d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.987+0000 7f81b5090640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0ea0d4c0 0x560b0e981d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57276/0 (socket says 172.21.15.164:57276) 2024-09-13T23:05:33.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.987+0000 7f81b5090640 1 -- 172.21.15.164:0/1518529652 learned_addr learned my addr 172.21.15.164:0/1518529652 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.988+0000 7f81b5090640 1 -- 172.21.15.164:0/1518529652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b0e8a7bc0 con 0x560b0ea0d4c0 2024-09-13T23:05:33.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.988+0000 7f81b5090640 1 --2- 172.21.15.164:0/1518529652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0ea0d4c0 0x560b0e981d80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f81a8000f80 tx=0x7f81a8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ae0106d6d3f18d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.988+0000 7f80a3606640 1 -- 172.21.15.164:0/1518529652 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81a8055040 con 0x560b0ea0d4c0 2024-09-13T23:05:33.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.988+0000 7f80a3606640 1 -- 172.21.15.164:0/1518529652 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a8051a00 con 0x560b0ea0d4c0 2024-09-13T23:05:33.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.988+0000 7f80a3606640 1 -- 172.21.15.164:0/1518529652 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81a8051ce0 con 0x560b0ea0d4c0 2024-09-13T23:05:33.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.989+0000 7f81b9341800 1 -- 172.21.15.164:0/1518529652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0ea0d4c0 msgr2=0x560b0e981d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:33.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.989+0000 7f81b9341800 1 --2- 172.21.15.164:0/1518529652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0ea0d4c0 0x560b0e981d80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f81a8000f80 tx=0x7f81a8051000 comp rx=0 tx=0).stop 2024-09-13T23:05:33.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.989+0000 7f81b9341800 1 -- 172.21.15.164:0/1518529652 shutdown_connections 2024-09-13T23:05:33.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.989+0000 7f81b9341800 1 --2- 172.21.15.164:0/1518529652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0ea0d4c0 0x560b0e981d80 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:33.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.989+0000 7f81b9341800 1 -- 172.21.15.164:0/1518529652 >> 172.21.15.164:0/1518529652 conn(0x560b0ea08df0 msgr2=0x560b0eaf7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:33.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.989+0000 7f81b9341800 1 -- 172.21.15.164:0/1518529652 shutdown_connections 2024-09-13T23:05:33.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.989+0000 7f81b9341800 1 -- 172.21.15.164:0/1518529652 wait complete. 2024-09-13T23:05:33.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.989+0000 7f81b9341800 1 Processor -- start 2024-09-13T23:05:33.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.989+0000 7f81b9341800 1 -- start start 2024-09-13T23:05:33.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.989+0000 7f81b9341800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0ea0d4c0 0x560b0eb04f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.989+0000 7f81b9341800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560b0ea144e0 con 0x560b0ea0d4c0 2024-09-13T23:05:33.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.990+0000 7f81b5090640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0ea0d4c0 0x560b0eb04f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.990+0000 7f81b5090640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0ea0d4c0 0x560b0eb04f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57278/0 (socket says 172.21.15.164:57278) 2024-09-13T23:05:33.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.990+0000 7f81b5090640 1 -- 172.21.15.164:0/395448536 learned_addr learned my addr 172.21.15.164:0/395448536 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:33.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.990+0000 7f81b5090640 1 -- 172.21.15.164:0/395448536 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b0e8bbfe0 con 0x560b0ea0d4c0 2024-09-13T23:05:33.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.990+0000 7f81b5090640 1 --2- 172.21.15.164:0/395448536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0ea0d4c0 0x560b0eb04f30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f81a8025960 tx=0x7f81a8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.990+0000 7f80a1e03640 1 -- 172.21.15.164:0/395448536 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81a8071020 con 0x560b0ea0d4c0 2024-09-13T23:05:33.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.990+0000 7f80a1e03640 1 -- 172.21.15.164:0/395448536 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a805a8c0 con 0x560b0ea0d4c0 2024-09-13T23:05:33.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.990+0000 7f81b9341800 1 -- 172.21.15.164:0/395448536 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b0eb05470 con 0x560b0ea0d4c0 2024-09-13T23:05:33.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.990+0000 7f80a1e03640 1 -- 172.21.15.164:0/395448536 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81a8055030 con 0x560b0ea0d4c0 2024-09-13T23:05:33.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.990+0000 7f81b9341800 1 -- 172.21.15.164:0/395448536 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b0eb05990 con 0x560b0ea0d4c0 2024-09-13T23:05:33.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.991+0000 7f80a1e03640 1 -- 172.21.15.164:0/395448536 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f81a8074020 con 0x560b0ea0d4c0 2024-09-13T23:05:33.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.991+0000 7f80a1e03640 1 --2- 172.21.15.164:0/395448536 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f809c036b90 0x7f809c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.991+0000 7f80a1e03640 1 -- 172.21.15.164:0/395448536 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f81a806a040 con 0x560b0ea0d4c0 2024-09-13T23:05:33.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.991+0000 7f81b488f640 1 --2- 172.21.15.164:0/395448536 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f809c036b90 0x7f809c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.991+0000 7f81b9341800 1 --2- 172.21.15.164:0/395448536 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560b0ea0de00 0x560b0eb0bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:33.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.991+0000 7f81b9341800 1 -- 172.21.15.164:0/395448536 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb0c570 con 0x560b0ea0de00 2024-09-13T23:05:33.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.992+0000 7f81b5891640 1 --2- 172.21.15.164:0/395448536 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560b0ea0de00 0x560b0eb0bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:33.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.992+0000 7f81b488f640 1 --2- 172.21.15.164:0/395448536 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f809c036b90 0x7f809c039050 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f81a0000f60 tx=0x7f81a00010a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.992+0000 7f81b5891640 1 --2- 172.21.15.164:0/395448536 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560b0ea0de00 0x560b0eb0bfa0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:33.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.992+0000 7f81b5891640 1 -- 172.21.15.164:0/395448536 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81b00083e0 con 0x560b0ea0de00 2024-09-13T23:05:33.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.992+0000 7f81b9341800 1 -- 172.21.15.164:0/395448536 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb09530 con 0x560b0ea0de00 2024-09-13T23:05:34.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.992+0000 7f81b5891640 1 -- 172.21.15.164:0/395448536 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f81b00083e0 con 0x560b0ea0de00 2024-09-13T23:05:34.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.992+0000 7f81b9341800 1 -- 172.21.15.164:0/395448536 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb0e370 con 0x560b0ea0de00 2024-09-13T23:05:34.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.993+0000 7f81b5891640 1 -- 172.21.15.164:0/395448536 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f81b00083e0 con 0x560b0ea0de00 2024-09-13T23:05:34.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.993+0000 7f81b9341800 1 -- 172.21.15.164:0/395448536 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb0d4e0 con 0x560b0ea0de00 2024-09-13T23:05:34.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.993+0000 7f81b5891640 1 -- 172.21.15.164:0/395448536 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f81b00083e0 con 0x560b0ea0de00 2024-09-13T23:05:34.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.993+0000 7f81b9341800 1 -- 172.21.15.164:0/395448536 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb0d8d0 con 0x560b0ea0de00 2024-09-13T23:05:34.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.993+0000 7f81b5891640 1 -- 172.21.15.164:0/395448536 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f81b00083e0 con 0x560b0ea0de00 2024-09-13T23:05:34.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.994+0000 7f81b9341800 1 Processor -- start 2024-09-13T23:05:34.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.994+0000 7f81b9341800 1 -- start start 2024-09-13T23:05:34.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.994+0000 7f81b9341800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0eb1c980 0x560b0eb1cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.994+0000 7f81b9341800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560b0e8a9580 con 0x560b0eb1c980 2024-09-13T23:05:34.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.994+0000 7f81b488f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0eb1c980 0x560b0eb1cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.994+0000 7f81b488f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0eb1c980 0x560b0eb1cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57282/0 (socket says 172.21.15.164:57282) 2024-09-13T23:05:34.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.994+0000 7f81b488f640 1 -- 172.21.15.164:0/4127897929 learned_addr learned my addr 172.21.15.164:0/4127897929 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:34.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.994+0000 7f81b488f640 1 -- 172.21.15.164:0/4127897929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b0eb1d2e0 con 0x560b0eb1c980 2024-09-13T23:05:34.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.995+0000 7f81b488f640 1 --2- 172.21.15.164:0/4127897929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0eb1c980 0x560b0eb1cda0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f81a000bec0 tx=0x7f81a000d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.995+0000 7f809affd640 1 -- 172.21.15.164:0/4127897929 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81a001b550 con 0x560b0eb1c980 2024-09-13T23:05:34.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.995+0000 7f809affd640 1 -- 172.21.15.164:0/4127897929 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a001b6f0 con 0x560b0eb1c980 2024-09-13T23:05:34.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.995+0000 7f809affd640 1 -- 172.21.15.164:0/4127897929 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81a001ba10 con 0x560b0eb1c980 2024-09-13T23:05:34.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.995+0000 7f81b9341800 1 -- 172.21.15.164:0/4127897929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b0eb1d570 con 0x560b0eb1c980 2024-09-13T23:05:34.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.995+0000 7f81b9341800 1 -- 172.21.15.164:0/4127897929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b0eb20250 con 0x560b0eb1c980 2024-09-13T23:05:34.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.995+0000 7f809affd640 1 -- 172.21.15.164:0/4127897929 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f81a0023020 con 0x560b0eb1c980 2024-09-13T23:05:34.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.996+0000 7f809affd640 1 --2- 172.21.15.164:0/4127897929 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f808c036b90 0x7f808c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.996+0000 7f809affd640 1 -- 172.21.15.164:0/4127897929 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f81a0021020 con 0x560b0eb1c980 2024-09-13T23:05:34.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.996+0000 7f81b5891640 1 --2- 172.21.15.164:0/4127897929 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f808c036b90 0x7f808c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.996+0000 7f81b9341800 1 Processor -- start 2024-09-13T23:05:34.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.996+0000 7f81b9341800 1 -- start start 2024-09-13T23:05:34.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.996+0000 7f81b5891640 1 --2- 172.21.15.164:0/4127897929 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f808c036b90 0x7f808c039050 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x560b0eb0d000 tx=0x7f81b0000f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.996+0000 7f81b9341800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0eafd5d0 0x560b0eafd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.996+0000 7f81b9341800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560b0eb00490 con 0x560b0eafd5d0 2024-09-13T23:05:34.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.997+0000 7f81b488f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0eafd5d0 0x560b0eafd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.997+0000 7f81b488f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0eafd5d0 0x560b0eafd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57294/0 (socket says 172.21.15.164:57294) 2024-09-13T23:05:34.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.997+0000 7f81b488f640 1 -- 172.21.15.164:0/2927963878 learned_addr learned my addr 172.21.15.164:0/2927963878 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:34.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.997+0000 7f81b488f640 1 -- 172.21.15.164:0/2927963878 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b0eafdfa0 con 0x560b0eafd5d0 2024-09-13T23:05:34.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.997+0000 7f81b488f640 1 --2- 172.21.15.164:0/2927963878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0eafd5d0 0x560b0eafd9d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f81a004d110 tx=0x7f81a000ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8239fe4051e08f9f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.997+0000 7f8098ff9640 1 -- 172.21.15.164:0/2927963878 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81a00197d0 con 0x560b0eafd5d0 2024-09-13T23:05:34.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.997+0000 7f8098ff9640 1 -- 172.21.15.164:0/2927963878 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a0046070 con 0x560b0eafd5d0 2024-09-13T23:05:34.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.997+0000 7f8098ff9640 1 -- 172.21.15.164:0/2927963878 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81a0025a60 con 0x560b0eafd5d0 2024-09-13T23:05:34.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.998+0000 7f81b9341800 1 -- 172.21.15.164:0/2927963878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0eafd5d0 msgr2=0x560b0eafd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.998+0000 7f81b9341800 1 --2- 172.21.15.164:0/2927963878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0eafd5d0 0x560b0eafd9d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f81a004d110 tx=0x7f81a000ce40 comp rx=0 tx=0).stop 2024-09-13T23:05:34.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.998+0000 7f81b9341800 1 -- 172.21.15.164:0/2927963878 shutdown_connections 2024-09-13T23:05:34.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.998+0000 7f81b9341800 1 --2- 172.21.15.164:0/2927963878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0eafd5d0 0x560b0eafd9d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.998+0000 7f81b9341800 1 -- 172.21.15.164:0/2927963878 >> 172.21.15.164:0/2927963878 conn(0x560b0eb259f0 msgr2=0x560b0eb23af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:34.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.998+0000 7f81b9341800 1 -- 172.21.15.164:0/2927963878 shutdown_connections 2024-09-13T23:05:34.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.998+0000 7f81b9341800 1 -- 172.21.15.164:0/2927963878 wait complete. 2024-09-13T23:05:34.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.998+0000 7f81b9341800 1 Processor -- start 2024-09-13T23:05:34.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.998+0000 7f81b9341800 1 -- start start 2024-09-13T23:05:34.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.998+0000 7f81b9341800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0eafd5d0 0x560b0eb32d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.998+0000 7f81b9341800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560b0eafc300 con 0x560b0eafd5d0 2024-09-13T23:05:34.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.998+0000 7f81b488f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0eafd5d0 0x560b0eb32d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.998+0000 7f81b488f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0eafd5d0 0x560b0eb32d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57302/0 (socket says 172.21.15.164:57302) 2024-09-13T23:05:34.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.998+0000 7f81b488f640 1 -- 172.21.15.164:0/3855401045 learned_addr learned my addr 172.21.15.164:0/3855401045 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:34.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.999+0000 7f81b488f640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b0eb332b0 con 0x560b0eafd5d0 2024-09-13T23:05:34.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.999+0000 7f81b488f640 1 --2- 172.21.15.164:0/3855401045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0eafd5d0 0x560b0eb32d70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f81a000cf90 tx=0x7f81a004d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.999+0000 7f808affd640 1 -- 172.21.15.164:0/3855401045 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81a0040b80 con 0x560b0eafd5d0 2024-09-13T23:05:34.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.999+0000 7f808affd640 1 -- 172.21.15.164:0/3855401045 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a0040040 con 0x560b0eafd5d0 2024-09-13T23:05:34.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.999+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b0eb33540 con 0x560b0eafd5d0 2024-09-13T23:05:34.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.999+0000 7f808affd640 1 -- 172.21.15.164:0/3855401045 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81a000c360 con 0x560b0eafd5d0 2024-09-13T23:05:34.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:33.999+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b0eb33540 con 0x560b0eafd5d0 2024-09-13T23:05:34.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.000+0000 7f808affd640 1 -- 172.21.15.164:0/3855401045 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f81a000c500 con 0x560b0eafd5d0 2024-09-13T23:05:34.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.000+0000 7f808affd640 1 --2- 172.21.15.164:0/3855401045 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8080036b90 0x7f8080039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.000+0000 7f808affd640 1 -- 172.21.15.164:0/3855401045 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f81a001c070 con 0x560b0eafd5d0 2024-09-13T23:05:34.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.000+0000 7f81b5891640 1 --2- 172.21.15.164:0/3855401045 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8080036b90 0x7f8080039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.000+0000 7f81b9341800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.000+0000 7f81b9341800 1 --2- 172.21.15.164:0/3855401045 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560b0eb3e5b0 0x560b0eb40a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.000+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb411c0 con 0x560b0eb3e5b0 2024-09-13T23:05:34.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.000+0000 7f81b5090640 1 --2- 172.21.15.164:0/3855401045 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560b0eb3e5b0 0x560b0eb40a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.000+0000 7f81b5891640 1 --2- 172.21.15.164:0/3855401045 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8080036b90 0x7f8080039050 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f81b000f010 tx=0x7f81b000c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.001+0000 7f81b5090640 1 --2- 172.21.15.164:0/3855401045 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560b0eb3e5b0 0x560b0eb40a70 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.001+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81a8057030 con 0x560b0eb3e5b0 2024-09-13T23:05:34.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.001+0000 7f81b9341800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.001+0000 7f81b9341800 20 realm 2024-09-13T23:05:34.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.001+0000 7f81b9341800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.001+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb415d0 con 0x560b0eb3e5b0 2024-09-13T23:05:34.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.001+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81a8057030 con 0x560b0eb3e5b0 2024-09-13T23:05:34.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.001+0000 7f81b9341800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.001+0000 7f81b9341800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:34.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.001+0000 7f81b9341800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.001+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb41ea0 con 0x560b0eb3e5b0 2024-09-13T23:05:34.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.001+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81a8057030 con 0x560b0eb3e5b0 2024-09-13T23:05:34.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.001+0000 7f81b9341800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.001+0000 7f81b9341800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.001+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb42240 con 0x560b0eb3e5b0 2024-09-13T23:05:34.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.002+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f81a8057030 con 0x560b0eb3e5b0 2024-09-13T23:05:34.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.002+0000 7f81b9341800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:34.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.002+0000 7f81b9341800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.002+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb426a0 con 0x560b0eb3e5b0 2024-09-13T23:05:34.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.002+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f81a8057030 con 0x560b0eb3e5b0 2024-09-13T23:05:34.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.002+0000 7f81b9341800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:34.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.002+0000 7f81b9341800 20 searching for the correct realm 2024-09-13T23:05:34.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.002+0000 7f81b9341800 1 --2- 172.21.15.164:0/3855401045 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x560b0eb446a0 0x560b0eb46a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.002+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x560b0eb446a0 2024-09-13T23:05:34.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.002+0000 7f81b488f640 1 --2- 172.21.15.164:0/3855401045 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x560b0eb446a0 0x560b0eb46a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.002+0000 7f81b488f640 1 --2- 172.21.15.164:0/3855401045 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x560b0eb446a0 0x560b0eb46a90 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.002+0000 7f81b488f640 1 -- 172.21.15.164:0/3855401045 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a0055070 con 0x560b0eb446a0 2024-09-13T23:05:34.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.002+0000 7f81b488f640 1 --2- 172.21.15.164:0/3855401045 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f81a0043b70 0x7f81a003a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.002+0000 7f81b488f640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x7f81a0043b70 2024-09-13T23:05:34.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.003+0000 7f81b5891640 1 --2- 172.21.15.164:0/3855401045 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f81a0043b70 0x7f81a003a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.003+0000 7f81b5891640 1 --2- 172.21.15.164:0/3855401045 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f81a0043b70 0x7f81a003a440 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.003+0000 7f81b5891640 1 -- 172.21.15.164:0/3855401045 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b002f040 con 0x7f81a0043b70 2024-09-13T23:05:34.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.003+0000 7f81b5891640 1 --2- 172.21.15.164:0/3855401045 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f81b0019040 0x7f81b0019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.003+0000 7f81b5891640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x7f81b0019040 2024-09-13T23:05:34.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.003+0000 7f81b5090640 1 --2- 172.21.15.164:0/3855401045 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f81b0019040 0x7f81b0019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.004+0000 7f81b5090640 1 --2- 172.21.15.164:0/3855401045 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f81b0019040 0x7f81b0019930 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.004+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a8057030 con 0x7f81b0019040 2024-09-13T23:05:34.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.004+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x560b0eb3e5b0 2024-09-13T23:05:34.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.004+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f81a8057030 con 0x560b0eb3e5b0 2024-09-13T23:05:34.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.004+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x560b0eb3e5b0 2024-09-13T23:05:34.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.005+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a8057030 con 0x560b0eb3e5b0 2024-09-13T23:05:34.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.005+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x7f81b0019040 2024-09-13T23:05:34.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.005+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a8057030 con 0x7f81b0019040 2024-09-13T23:05:34.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.005+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x7f81b0019040 2024-09-13T23:05:34.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.005+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a8057030 con 0x7f81b0019040 2024-09-13T23:05:34.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.005+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x7f81a0043b70 2024-09-13T23:05:34.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.005+0000 7f81b5891640 1 -- 172.21.15.164:0/3855401045 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b002f040 con 0x7f81a0043b70 2024-09-13T23:05:34.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.005+0000 7f81b5891640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x560b0eb446a0 2024-09-13T23:05:34.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.005+0000 7f81b488f640 1 -- 172.21.15.164:0/3855401045 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a0055070 con 0x560b0eb446a0 2024-09-13T23:05:34.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.006+0000 7f81b488f640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x560b0eb3e5b0 2024-09-13T23:05:34.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.006+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a8057030 con 0x560b0eb3e5b0 2024-09-13T23:05:34.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.006+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x7f81b0019040 2024-09-13T23:05:34.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.006+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a8057030 con 0x7f81b0019040 2024-09-13T23:05:34.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.006+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x560b0eb3e5b0 2024-09-13T23:05:34.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.006+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a8057030 con 0x560b0eb3e5b0 2024-09-13T23:05:34.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.006+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x7f81a0043b70 2024-09-13T23:05:34.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.006+0000 7f81b5891640 1 -- 172.21.15.164:0/3855401045 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f81b002f040 con 0x7f81a0043b70 2024-09-13T23:05:34.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.006+0000 7f81b5891640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x560b0eb446a0 2024-09-13T23:05:34.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.007+0000 7f81b488f640 1 -- 172.21.15.164:0/3855401045 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a0055070 con 0x560b0eb446a0 2024-09-13T23:05:34.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.007+0000 7f81b488f640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x560b0eb446a0 2024-09-13T23:05:34.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.007+0000 7f81b488f640 1 -- 172.21.15.164:0/3855401045 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a0055070 con 0x560b0eb446a0 2024-09-13T23:05:34.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.007+0000 7f81b488f640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x7f81b0019040 2024-09-13T23:05:34.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.007+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a8057030 con 0x7f81b0019040 2024-09-13T23:05:34.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.007+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x560b0eb446a0 2024-09-13T23:05:34.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.007+0000 7f81b488f640 1 -- 172.21.15.164:0/3855401045 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a0055070 con 0x560b0eb446a0 2024-09-13T23:05:34.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.007+0000 7f81b488f640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x560b0eb446a0 2024-09-13T23:05:34.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.008+0000 7f81b488f640 1 -- 172.21.15.164:0/3855401045 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a0055070 con 0x560b0eb446a0 2024-09-13T23:05:34.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.008+0000 7f81b488f640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x560b0eb3e5b0 2024-09-13T23:05:34.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.008+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a8057030 con 0x560b0eb3e5b0 2024-09-13T23:05:34.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.008+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x560b0eb3e5b0 2024-09-13T23:05:34.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.008+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f81a8057030 con 0x560b0eb3e5b0 2024-09-13T23:05:34.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.008+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x7f81b0019040 2024-09-13T23:05:34.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.008+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a8057030 con 0x7f81b0019040 2024-09-13T23:05:34.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.008+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x560b0eb446a0 2024-09-13T23:05:34.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.009+0000 7f81b488f640 1 -- 172.21.15.164:0/3855401045 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a0055070 con 0x560b0eb446a0 2024-09-13T23:05:34.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.009+0000 7f81b488f640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x7f81a0043b70 2024-09-13T23:05:34.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.009+0000 7f81b5891640 1 -- 172.21.15.164:0/3855401045 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b002f040 con 0x7f81a0043b70 2024-09-13T23:05:34.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.009+0000 7f81b5891640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x560b0eb3e5b0 2024-09-13T23:05:34.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.009+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f81a8057030 con 0x560b0eb3e5b0 2024-09-13T23:05:34.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.009+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x7f81b0019040 2024-09-13T23:05:34.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.009+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a8057030 con 0x7f81b0019040 2024-09-13T23:05:34.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.009+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x560b0eb446a0 2024-09-13T23:05:34.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.010+0000 7f81b488f640 1 -- 172.21.15.164:0/3855401045 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a0055070 con 0x560b0eb446a0 2024-09-13T23:05:34.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.010+0000 7f81b488f640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x7f81b0019040 2024-09-13T23:05:34.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.010+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a8057030 con 0x7f81b0019040 2024-09-13T23:05:34.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.010+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x7f81a0043b70 2024-09-13T23:05:34.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.010+0000 7f81b5891640 1 -- 172.21.15.164:0/3855401045 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b002f040 con 0x7f81a0043b70 2024-09-13T23:05:34.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.010+0000 7f81b5891640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x560b0eb446a0 2024-09-13T23:05:34.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.010+0000 7f81b488f640 1 -- 172.21.15.164:0/3855401045 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a0055070 con 0x560b0eb446a0 2024-09-13T23:05:34.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.010+0000 7f81b488f640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x7f81b0019040 2024-09-13T23:05:34.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.011+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a8057030 con 0x7f81b0019040 2024-09-13T23:05:34.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.011+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x560b0eb3e5b0 2024-09-13T23:05:34.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.011+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f81a8057030 con 0x560b0eb3e5b0 2024-09-13T23:05:34.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.011+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47160 con 0x7f81a0043b70 2024-09-13T23:05:34.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.011+0000 7f81b5891640 1 -- 172.21.15.164:0/3855401045 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b002f040 con 0x7f81a0043b70 2024-09-13T23:05:34.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.011+0000 7f81b9341800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:34.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.011+0000 7f81b9341800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:34.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.011+0000 7f81b9341800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:34.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.011+0000 7f81b9341800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:34.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.011+0000 7f81b9341800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:34.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.011+0000 7f81b9341800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:34.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.011+0000 7f81b9341800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.011+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb43170 con 0x560b0eb3e5b0 2024-09-13T23:05:34.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.011+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81a8057030 con 0x560b0eb3e5b0 2024-09-13T23:05:34.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.011+0000 7f81b9341800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.011+0000 7f81b9341800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.011+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb43560 con 0x560b0eb3e5b0 2024-09-13T23:05:34.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.012+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f81a8057030 con 0x560b0eb3e5b0 2024-09-13T23:05:34.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.012+0000 7f81b9341800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:34.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.012+0000 7f81b9341800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.012+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb43560 con 0x560b0eb3e5b0 2024-09-13T23:05:34.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.012+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f81a8057030 con 0x560b0eb3e5b0 2024-09-13T23:05:34.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.012+0000 7f81b9341800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:34.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.012+0000 7f81b9341800 20 zone default found 2024-09-13T23:05:34.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.012+0000 7f81b9341800 4 Realm: () 2024-09-13T23:05:34.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.012+0000 7f81b9341800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:34.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.012+0000 7f81b9341800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:34.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.012+0000 7f81b9341800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:34.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.012+0000 7f81b9341800 20 zonegroup default 2024-09-13T23:05:34.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.012+0000 7f81b9341800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.012+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb43980 con 0x7f81b0019040 2024-09-13T23:05:34.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.012+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f81a8057030 con 0x7f81b0019040 2024-09-13T23:05:34.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.012+0000 7f81b9341800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.012+0000 7f81b9341800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.012+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb43980 con 0x560b0eb446a0 2024-09-13T23:05:34.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.012+0000 7f81b488f640 1 -- 172.21.15.164:0/3855401045 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f81a0055070 con 0x560b0eb446a0 2024-09-13T23:05:34.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.013+0000 7f81b9341800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.013+0000 7f81b9341800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.013+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb48fc0 con 0x560b0eb446a0 2024-09-13T23:05:34.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.013+0000 7f81b488f640 1 -- 172.21.15.164:0/3855401045 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f81a0055070 con 0x560b0eb446a0 2024-09-13T23:05:34.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.013+0000 7f81b9341800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.013+0000 7f81b9341800 20 started sync module instance, tier type = 2024-09-13T23:05:34.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.013+0000 7f81b9341800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:34.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.013+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb48460 con 0x7f81a0043b70 2024-09-13T23:05:34.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.014+0000 7f81b5891640 1 -- 172.21.15.164:0/3855401045 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b002f040 con 0x7f81a0043b70 2024-09-13T23:05:34.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.014+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94605491341664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb48460 con 0x7f81a0043b70 2024-09-13T23:05:34.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.014+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb499e0 con 0x560b0eb3e5b0 2024-09-13T23:05:34.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.015+0000 7f81b5891640 1 -- 172.21.15.164:0/3855401045 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94605491341664] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b002f040 con 0x7f81a0043b70 2024-09-13T23:05:34.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.015+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a8057030 con 0x560b0eb3e5b0 2024-09-13T23:05:34.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.015+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94605491344592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb48460 con 0x560b0eb3e5b0 2024-09-13T23:05:34.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.015+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb4a480 con 0x560b0eb446a0 2024-09-13T23:05:34.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.016+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94605491344592] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a8057030 con 0x560b0eb3e5b0 2024-09-13T23:05:34.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.016+0000 7f81b488f640 1 -- 172.21.15.164:0/3855401045 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a0055070 con 0x560b0eb446a0 2024-09-13T23:05:34.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.016+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94605491347312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb4a820 con 0x560b0eb446a0 2024-09-13T23:05:34.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.016+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb4b280 con 0x7f81a0043b70 2024-09-13T23:05:34.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.017+0000 7f81b488f640 1 -- 172.21.15.164:0/3855401045 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94605491347312] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a0055070 con 0x560b0eb446a0 2024-09-13T23:05:34.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.017+0000 7f81b5891640 1 -- 172.21.15.164:0/3855401045 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b002f040 con 0x7f81a0043b70 2024-09-13T23:05:34.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.017+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94605491339184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb4b670 con 0x7f81a0043b70 2024-09-13T23:05:34.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.017+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb4c090 con 0x560b0eb3e5b0 2024-09-13T23:05:34.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.018+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a8057030 con 0x560b0eb3e5b0 2024-09-13T23:05:34.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.018+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94605491354496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb4c050 con 0x560b0eb3e5b0 2024-09-13T23:05:34.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.018+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb4d050 con 0x7f81b0019040 2024-09-13T23:05:34.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.018+0000 7f81b5891640 1 -- 172.21.15.164:0/3855401045 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94605491339184] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b002f040 con 0x7f81a0043b70 2024-09-13T23:05:34.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.019+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94605491354496] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a8057030 con 0x560b0eb3e5b0 2024-09-13T23:05:34.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.019+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a8057030 con 0x7f81b0019040 2024-09-13T23:05:34.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.019+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94605491350880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb4c230 con 0x7f81b0019040 2024-09-13T23:05:34.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.019+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb4d8f0 con 0x7f81b0019040 2024-09-13T23:05:34.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.020+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a8057030 con 0x7f81b0019040 2024-09-13T23:05:34.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.020+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94605491359920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb4d980 con 0x7f81b0019040 2024-09-13T23:05:34.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.020+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb4e470 con 0x7f81b0019040 2024-09-13T23:05:34.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.020+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94605491350880] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a8057030 con 0x7f81b0019040 2024-09-13T23:05:34.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.021+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94605491359920] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a8057030 con 0x7f81b0019040 2024-09-13T23:05:34.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.021+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a8057030 con 0x7f81b0019040 2024-09-13T23:05:34.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.021+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94605491363648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb4d4d0 con 0x7f81b0019040 2024-09-13T23:05:34.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.021+0000 7f81b9341800 20 add_watcher() i=0 2024-09-13T23:05:34.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.021+0000 7f81b9341800 20 add_watcher() i=1 2024-09-13T23:05:34.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.021+0000 7f81b9341800 20 add_watcher() i=2 2024-09-13T23:05:34.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.021+0000 7f81b9341800 20 add_watcher() i=3 2024-09-13T23:05:34.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.021+0000 7f81b9341800 20 add_watcher() i=4 2024-09-13T23:05:34.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.021+0000 7f81b9341800 20 add_watcher() i=5 2024-09-13T23:05:34.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.021+0000 7f81b9341800 20 add_watcher() i=6 2024-09-13T23:05:34.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.022+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94605491363648] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a8057030 con 0x7f81b0019040 2024-09-13T23:05:34.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.022+0000 7f81b9341800 20 add_watcher() i=7 2024-09-13T23:05:34.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.022+0000 7f81b9341800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:34.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.022+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb51570 con 0x560b0eb3e5b0 2024-09-13T23:05:34.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.023+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f81a8057030 con 0x560b0eb3e5b0 2024-09-13T23:05:34.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.023+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94605491358544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb4e9f0 con 0x560b0eb3e5b0 2024-09-13T23:05:34.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.024+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94605491358544] v32'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f81a8057030 con 0x560b0eb3e5b0 2024-09-13T23:05:34.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.024+0000 7f806b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:34.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.024+0000 7f81b9341800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:34.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.024+0000 7f81b9341800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:34.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.024+0000 7f81b9341800 5 note: GC not initialized 2024-09-13T23:05:34.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.024+0000 7f806a7e4640 20 reqs_thread_entry: start 2024-09-13T23:05:34.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.024+0000 7f81b9341800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:34.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.024+0000 7f81b9341800 20 Filter name: none 2024-09-13T23:05:34.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.024+0000 7f7fdbfff640 20 reqs_thread_entry: start 2024-09-13T23:05:34.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.024+0000 7f81b9341800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.024+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb84290 con 0x560b0eb3e5b0 2024-09-13T23:05:34.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.025+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f81a8057030 con 0x560b0eb3e5b0 2024-09-13T23:05:34.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.025+0000 7f81b9341800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:05:34.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.025+0000 7f81b9341800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.025+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb84c80 con 0x560b0eb3e5b0 2024-09-13T23:05:34.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.025+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f81a8057030 con 0x560b0eb3e5b0 2024-09-13T23:05:34.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.025+0000 7f81b9341800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:05:34.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.025+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb85c90 con 0x7f81a0043b70 2024-09-13T23:05:34.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.025+0000 7f81b5891640 1 -- 172.21.15.164:0/3855401045 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f81b002f040 con 0x7f81a0043b70 2024-09-13T23:05:34.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.026+0000 7f806b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:34.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.026+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94605491358544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb82080 con 0x560b0eb3e5b0 2024-09-13T23:05:34.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.027+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94605491358544] v32'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f81a8057030 con 0x560b0eb3e5b0 2024-09-13T23:05:34.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.027+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94605491341664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb82080 con 0x7f81a0043b70 2024-09-13T23:05:34.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.028+0000 7f81b5891640 1 -- 172.21.15.164:0/3855401045 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94605491341664] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b002f040 con 0x7f81a0043b70 2024-09-13T23:05:34.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.028+0000 7f81b9341800 20 remove_watcher() i=0 2024-09-13T23:05:34.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.028+0000 7f81b9341800 2 removed watcher, disabling cache 2024-09-13T23:05:34.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.028+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94605491344592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb82080 con 0x560b0eb3e5b0 2024-09-13T23:05:34.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.029+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94605491344592] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a8057030 con 0x560b0eb3e5b0 2024-09-13T23:05:34.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.029+0000 7f81b9341800 20 remove_watcher() i=1 2024-09-13T23:05:34.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.029+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94605491347312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb82080 con 0x560b0eb446a0 2024-09-13T23:05:34.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.030+0000 7f81b488f640 1 -- 172.21.15.164:0/3855401045 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94605491347312] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a0055070 con 0x560b0eb446a0 2024-09-13T23:05:34.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.030+0000 7f81b9341800 20 remove_watcher() i=2 2024-09-13T23:05:34.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.030+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94605491339184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb494d0 con 0x7f81a0043b70 2024-09-13T23:05:34.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.031+0000 7f81b5891640 1 -- 172.21.15.164:0/3855401045 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94605491339184] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b002f040 con 0x7f81a0043b70 2024-09-13T23:05:34.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.031+0000 7f81b9341800 20 remove_watcher() i=3 2024-09-13T23:05:34.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.031+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94605491354496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47fb0 con 0x560b0eb3e5b0 2024-09-13T23:05:34.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.032+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94605491354496] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a8057030 con 0x560b0eb3e5b0 2024-09-13T23:05:34.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.032+0000 7f81b9341800 20 remove_watcher() i=4 2024-09-13T23:05:34.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.032+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94605491350880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb494d0 con 0x7f81b0019040 2024-09-13T23:05:34.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.033+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94605491350880] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a8057030 con 0x7f81b0019040 2024-09-13T23:05:34.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.033+0000 7f81b9341800 20 remove_watcher() i=5 2024-09-13T23:05:34.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.033+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94605491359920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb47fb0 con 0x7f81b0019040 2024-09-13T23:05:34.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.034+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94605491359920] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a8057030 con 0x7f81b0019040 2024-09-13T23:05:34.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.034+0000 7f81b9341800 20 remove_watcher() i=6 2024-09-13T23:05:34.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.034+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94605491363648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0eb4ad60 con 0x7f81b0019040 2024-09-13T23:05:34.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.035+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94605491363648] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a8057030 con 0x7f81b0019040 2024-09-13T23:05:34.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.035+0000 7f81b9341800 20 remove_watcher() i=7 2024-09-13T23:05:34.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.035+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f81b0019040 msgr2=0x7f81b0019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.035+0000 7f81b9341800 1 --2- 172.21.15.164:0/3855401045 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f81b0019040 0x7f81b0019930 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.035+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560b0eb3e5b0 msgr2=0x560b0eb40a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.035+0000 7f81b9341800 1 --2- 172.21.15.164:0/3855401045 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560b0eb3e5b0 0x560b0eb40a70 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.035+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f81a0043b70 msgr2=0x7f81a003a440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.035+0000 7f81b9341800 1 --2- 172.21.15.164:0/3855401045 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f81a0043b70 0x7f81a003a440 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.035+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x560b0eb446a0 msgr2=0x560b0eb46a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.035+0000 7f81b9341800 1 --2- 172.21.15.164:0/3855401045 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x560b0eb446a0 0x560b0eb46a90 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.035+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8080036b90 msgr2=0x7f8080039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.035+0000 7f81b9341800 1 --2- 172.21.15.164:0/3855401045 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8080036b90 0x7f8080039050 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f81b000f010 tx=0x7f81b000c040 comp rx=0 tx=0).stop 2024-09-13T23:05:34.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.035+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0eafd5d0 msgr2=0x560b0eb32d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.035+0000 7f81b9341800 1 --2- 172.21.15.164:0/3855401045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0eafd5d0 0x560b0eb32d70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f81a000cf90 tx=0x7f81a004d070 comp rx=0 tx=0).stop 2024-09-13T23:05:34.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.035+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 reap_dead start 2024-09-13T23:05:34.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.035+0000 7f81b5090640 1 -- 172.21.15.164:0/3855401045 reap_dead start 2024-09-13T23:05:34.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.035+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 shutdown_connections 2024-09-13T23:05:34.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.035+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 >> 172.21.15.164:0/3855401045 conn(0x560b0eb259f0 msgr2=0x560b0eb23ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:34.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.036+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 shutdown_connections 2024-09-13T23:05:34.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.036+0000 7f81b9341800 1 -- 172.21.15.164:0/3855401045 wait complete. 2024-09-13T23:05:34.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.036+0000 7f81b9341800 1 -- 172.21.15.164:0/4127897929 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f808c036b90 msgr2=0x7f808c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.036+0000 7f81b9341800 1 --2- 172.21.15.164:0/4127897929 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f808c036b90 0x7f808c039050 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x560b0eb0d000 tx=0x7f81b0000f90 comp rx=0 tx=0).stop 2024-09-13T23:05:34.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.036+0000 7f81b9341800 1 -- 172.21.15.164:0/4127897929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0eb1c980 msgr2=0x560b0eb1cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.036+0000 7f81b9341800 1 --2- 172.21.15.164:0/4127897929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0eb1c980 0x560b0eb1cda0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f81a000bec0 tx=0x7f81a000d7a0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.036+0000 7f81b9341800 1 -- 172.21.15.164:0/4127897929 shutdown_connections 2024-09-13T23:05:34.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.036+0000 7f81b9341800 1 --2- 172.21.15.164:0/4127897929 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f808c036b90 0x7f808c039050 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.036+0000 7f81b9341800 1 --2- 172.21.15.164:0/4127897929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0eb1c980 0x560b0eb1cda0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.036+0000 7f81b9341800 1 -- 172.21.15.164:0/4127897929 >> 172.21.15.164:0/4127897929 conn(0x560b0eb11910 msgr2=0x560b0eb14490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:34.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.036+0000 7f81b9341800 1 -- 172.21.15.164:0/4127897929 shutdown_connections 2024-09-13T23:05:34.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.036+0000 7f81b9341800 1 -- 172.21.15.164:0/4127897929 wait complete. 2024-09-13T23:05:34.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.036+0000 7f81b9341800 1 -- 172.21.15.164:0/395448536 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560b0ea0de00 msgr2=0x560b0eb0bfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.036+0000 7f81b9341800 1 --2- 172.21.15.164:0/395448536 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560b0ea0de00 0x560b0eb0bfa0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.036+0000 7f81b9341800 1 -- 172.21.15.164:0/395448536 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f809c036b90 msgr2=0x7f809c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.036+0000 7f81b9341800 1 --2- 172.21.15.164:0/395448536 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f809c036b90 0x7f809c039050 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f81a0000f60 tx=0x7f81a00010a0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.036+0000 7f81b9341800 1 -- 172.21.15.164:0/395448536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0ea0d4c0 msgr2=0x560b0eb04f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.036+0000 7f81b9341800 1 --2- 172.21.15.164:0/395448536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0ea0d4c0 0x560b0eb04f30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f81a8025960 tx=0x7f81a8003330 comp rx=0 tx=0).stop 2024-09-13T23:05:34.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.036+0000 7f81b9341800 1 -- 172.21.15.164:0/395448536 shutdown_connections 2024-09-13T23:05:34.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.036+0000 7f81b9341800 1 --2- 172.21.15.164:0/395448536 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560b0ea0de00 0x560b0eb0bfa0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.036+0000 7f81b9341800 1 --2- 172.21.15.164:0/395448536 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f809c036b90 0x7f809c039050 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.036+0000 7f81b9341800 1 --2- 172.21.15.164:0/395448536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b0ea0d4c0 0x560b0eb04f30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.036+0000 7f81b9341800 1 -- 172.21.15.164:0/395448536 >> 172.21.15.164:0/395448536 conn(0x560b0ea08df0 msgr2=0x560b0eaf67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:34.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.036+0000 7f81b9341800 1 -- 172.21.15.164:0/395448536 shutdown_connections 2024-09-13T23:05:34.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.036+0000 7f81b9341800 1 -- 172.21.15.164:0/395448536 wait complete. 2024-09-13T23:05:34.051 INFO:teuthology.orchestra.run.smithi164.stdout:[] 2024-09-13T23:05:34.051 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T23:05:34.051 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-13T23:05:34.051 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-13T23:05:34.052 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-13T23:05:34.096 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:34.097 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:34.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.096+0000 7feb62e36800 1 Processor -- start 2024-09-13T23:05:34.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.096+0000 7feb62e36800 1 -- start start 2024-09-13T23:05:34.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.096+0000 7feb62e36800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x558484074990 0x558484076d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.096+0000 7feb62e36800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558483f30b30 con 0x558484070550 2024-09-13T23:05:34.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.096+0000 7feb62e36800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x558483f12360 con 0x558484074990 2024-09-13T23:05:34.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.097+0000 7feb57fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x558484074990 0x558484076d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.097+0000 7feb5e152640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x558484070550 0x558484070950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40880/0 (socket says 172.21.15.164:40880) 2024-09-13T23:05:34.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.097+0000 7feb5e152640 1 -- 172.21.15.164:0/2207581564 learned_addr learned my addr 172.21.15.164:0/2207581564 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:34.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.097+0000 7feb57fff640 1 -- 172.21.15.164:0/2207581564 >> v1:172.21.15.17:6789/0 conn(0x558484070550 legacy=0x558484070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.097+0000 7feb57fff640 1 -- 172.21.15.164:0/2207581564 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558483f38e00 con 0x558484074990 2024-09-13T23:05:34.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.097+0000 7feb5d951640 1 -- 172.21.15.164:0/2207581564 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 768420298 0 0) 0x558483f30b30 con 0x558484070550 2024-09-13T23:05:34.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.099+0000 7feb57fff640 1 --2- 172.21.15.164:0/2207581564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558484074990 0x558484076d80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7feb4800a470 tx=0x7feb48045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b358a982b661ce06 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.099+0000 7feb5d951640 1 -- 172.21.15.164:0/2207581564 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb48053570 con 0x558484074990 2024-09-13T23:05:34.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.099+0000 7feb5d951640 1 -- 172.21.15.164:0/2207581564 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb48058070 con 0x558484074990 2024-09-13T23:05:34.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.099+0000 7feb5d951640 1 -- 172.21.15.164:0/2207581564 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb48053880 con 0x558484074990 2024-09-13T23:05:34.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.099+0000 7feb62e36800 1 -- 172.21.15.164:0/2207581564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558484074990 msgr2=0x558484076d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.099+0000 7feb62e36800 1 --2- 172.21.15.164:0/2207581564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558484074990 0x558484076d80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7feb4800a470 tx=0x7feb48045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:34.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.099+0000 7feb62e36800 1 -- 172.21.15.164:0/2207581564 shutdown_connections 2024-09-13T23:05:34.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.099+0000 7feb62e36800 1 --2- 172.21.15.164:0/2207581564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558484074990 0x558484076d80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.099+0000 7feb62e36800 1 -- 172.21.15.164:0/2207581564 >> 172.21.15.164:0/2207581564 conn(0x55848406bde0 msgr2=0x55848406e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:34.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.099+0000 7feb62e36800 1 -- 172.21.15.164:0/2207581564 shutdown_connections 2024-09-13T23:05:34.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.100+0000 7feb62e36800 1 -- 172.21.15.164:0/2207581564 wait complete. 2024-09-13T23:05:34.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.114+0000 7feb62e36800 1 Processor -- start 2024-09-13T23:05:34.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.114+0000 7feb62e36800 1 -- start start 2024-09-13T23:05:34.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.114+0000 7feb62e36800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558484070550 0x55848415f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.114+0000 7feb62e36800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x558483fbd330 con 0x558484070550 2024-09-13T23:05:34.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.114+0000 7feb5e152640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558484070550 0x55848415f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.114+0000 7feb5e152640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558484070550 0x55848415f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57320/0 (socket says 172.21.15.164:57320) 2024-09-13T23:05:34.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.114+0000 7feb5e152640 1 -- 172.21.15.164:0/1345133982 learned_addr learned my addr 172.21.15.164:0/1345133982 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:34.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.114+0000 7feb5e152640 1 -- 172.21.15.164:0/1345133982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558483f0abc0 con 0x558484070550 2024-09-13T23:05:34.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.115+0000 7feb5e152640 1 --2- 172.21.15.164:0/1345133982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558484070550 0x55848415f5a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7feb5000b240 tx=0x7feb5000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d4732e425a16c4d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.115+0000 7fea4c608640 1 -- 172.21.15.164:0/1345133982 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb50008070 con 0x558484070550 2024-09-13T23:05:34.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.115+0000 7fea4c608640 1 -- 172.21.15.164:0/1345133982 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb5000d500 con 0x558484070550 2024-09-13T23:05:34.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.115+0000 7fea4c608640 1 -- 172.21.15.164:0/1345133982 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb5000d860 con 0x558484070550 2024-09-13T23:05:34.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.115+0000 7feb62e36800 1 -- 172.21.15.164:0/1345133982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558484070550 msgr2=0x55848415f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.115+0000 7feb62e36800 1 --2- 172.21.15.164:0/1345133982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558484070550 0x55848415f5a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7feb5000b240 tx=0x7feb5000b700 comp rx=0 tx=0).stop 2024-09-13T23:05:34.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.116+0000 7feb62e36800 1 -- 172.21.15.164:0/1345133982 shutdown_connections 2024-09-13T23:05:34.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.116+0000 7feb62e36800 1 --2- 172.21.15.164:0/1345133982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558484070550 0x55848415f5a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.116+0000 7feb62e36800 1 -- 172.21.15.164:0/1345133982 >> 172.21.15.164:0/1345133982 conn(0x55848406bde0 msgr2=0x55848415af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:34.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.116+0000 7feb62e36800 1 -- 172.21.15.164:0/1345133982 shutdown_connections 2024-09-13T23:05:34.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.116+0000 7feb62e36800 1 -- 172.21.15.164:0/1345133982 wait complete. 2024-09-13T23:05:34.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.116+0000 7feb62e36800 1 Processor -- start 2024-09-13T23:05:34.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.116+0000 7feb62e36800 1 -- start start 2024-09-13T23:05:34.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.116+0000 7feb62e36800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558484070550 0x558483fe5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.116+0000 7feb62e36800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5584840775c0 con 0x558484070550 2024-09-13T23:05:34.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.116+0000 7feb5e152640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558484070550 0x558483fe5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.116+0000 7feb5e152640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558484070550 0x558483fe5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57330/0 (socket says 172.21.15.164:57330) 2024-09-13T23:05:34.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.116+0000 7feb5e152640 1 -- 172.21.15.164:0/4168413609 learned_addr learned my addr 172.21.15.164:0/4168413609 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:34.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.117+0000 7feb5e152640 1 -- 172.21.15.164:0/4168413609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558483f1efe0 con 0x558484070550 2024-09-13T23:05:34.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.117+0000 7feb5e152640 1 --2- 172.21.15.164:0/4168413609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558484070550 0x558483fe5560 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x558484160400 tx=0x7feb50000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.117+0000 7fea4ae05640 1 -- 172.21.15.164:0/4168413609 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb50019870 con 0x558484070550 2024-09-13T23:05:34.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.117+0000 7fea4ae05640 1 -- 172.21.15.164:0/4168413609 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb50019a10 con 0x558484070550 2024-09-13T23:05:34.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.117+0000 7feb62e36800 1 -- 172.21.15.164:0/4168413609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55848416adb0 con 0x558484070550 2024-09-13T23:05:34.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.117+0000 7fea4ae05640 1 -- 172.21.15.164:0/4168413609 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb50019d30 con 0x558484070550 2024-09-13T23:05:34.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.117+0000 7feb62e36800 1 -- 172.21.15.164:0/4168413609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55848416b270 con 0x558484070550 2024-09-13T23:05:34.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.118+0000 7fea4ae05640 1 -- 172.21.15.164:0/4168413609 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7feb50017040 con 0x558484070550 2024-09-13T23:05:34.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.118+0000 7fea4ae05640 1 --2- 172.21.15.164:0/4168413609 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fea44036b90 0x7fea44039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.118+0000 7fea4ae05640 1 -- 172.21.15.164:0/4168413609 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7feb50015020 con 0x558484070550 2024-09-13T23:05:34.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.118+0000 7feb57fff640 1 --2- 172.21.15.164:0/4168413609 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fea44036b90 0x7fea44039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.118+0000 7feb62e36800 1 --2- 172.21.15.164:0/4168413609 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x558484074990 0x55848416f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.118+0000 7feb62e36800 1 -- 172.21.15.164:0/4168413609 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55848416f6e0 con 0x558484074990 2024-09-13T23:05:34.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.118+0000 7feb5e953640 1 --2- 172.21.15.164:0/4168413609 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x558484074990 0x55848416f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.119+0000 7feb57fff640 1 --2- 172.21.15.164:0/4168413609 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fea44036b90 0x7fea44039050 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feb48057000 tx=0x7feb48052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.119+0000 7feb5e953640 1 --2- 172.21.15.164:0/4168413609 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x558484074990 0x55848416f0e0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.119+0000 7feb5e953640 1 -- 172.21.15.164:0/4168413609 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb5800a4a0 con 0x558484074990 2024-09-13T23:05:34.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.119+0000 7feb62e36800 1 -- 172.21.15.164:0/4168413609 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55848416c690 con 0x558484074990 2024-09-13T23:05:34.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.119+0000 7feb5e953640 1 -- 172.21.15.164:0/4168413609 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feb5800a4a0 con 0x558484074990 2024-09-13T23:05:34.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.119+0000 7feb62e36800 1 -- 172.21.15.164:0/4168413609 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558484171500 con 0x558484074990 2024-09-13T23:05:34.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.120+0000 7feb5e953640 1 -- 172.21.15.164:0/4168413609 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7feb5800a4a0 con 0x558484074990 2024-09-13T23:05:34.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.120+0000 7feb62e36800 1 -- 172.21.15.164:0/4168413609 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558484170640 con 0x558484074990 2024-09-13T23:05:34.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.120+0000 7feb5e953640 1 -- 172.21.15.164:0/4168413609 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feb5800a4a0 con 0x558484074990 2024-09-13T23:05:34.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.120+0000 7feb62e36800 1 -- 172.21.15.164:0/4168413609 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558484170a60 con 0x558484074990 2024-09-13T23:05:34.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.120+0000 7feb5e953640 1 -- 172.21.15.164:0/4168413609 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7feb5800a4a0 con 0x558484074990 2024-09-13T23:05:34.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.120+0000 7feb62e36800 1 Processor -- start 2024-09-13T23:05:34.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.120+0000 7feb62e36800 1 -- start start 2024-09-13T23:05:34.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.121+0000 7feb62e36800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55848417fb30 0x55848417ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.121+0000 7feb62e36800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x558483f0c580 con 0x55848417fb30 2024-09-13T23:05:34.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.121+0000 7feb57fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55848417fb30 0x55848417ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.121+0000 7feb57fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55848417fb30 0x55848417ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57342/0 (socket says 172.21.15.164:57342) 2024-09-13T23:05:34.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.121+0000 7feb57fff640 1 -- 172.21.15.164:0/681852232 learned_addr learned my addr 172.21.15.164:0/681852232 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:34.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.121+0000 7feb57fff640 1 -- 172.21.15.164:0/681852232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558484180490 con 0x55848417fb30 2024-09-13T23:05:34.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.121+0000 7feb57fff640 1 --2- 172.21.15.164:0/681852232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55848417fb30 0x55848417ff50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7feb48025bf0 tx=0x7feb48002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.121+0000 7fea43fff640 1 -- 172.21.15.164:0/681852232 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb4806f070 con 0x55848417fb30 2024-09-13T23:05:34.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.121+0000 7fea43fff640 1 -- 172.21.15.164:0/681852232 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb4805f550 con 0x55848417fb30 2024-09-13T23:05:34.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.121+0000 7feb62e36800 1 -- 172.21.15.164:0/681852232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5584841806c0 con 0x55848417fb30 2024-09-13T23:05:34.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.122+0000 7fea43fff640 1 -- 172.21.15.164:0/681852232 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb4805f830 con 0x55848417fb30 2024-09-13T23:05:34.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.122+0000 7feb62e36800 1 -- 172.21.15.164:0/681852232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558484183340 con 0x55848417fb30 2024-09-13T23:05:34.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.122+0000 7fea43fff640 1 -- 172.21.15.164:0/681852232 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7feb4805f9d0 con 0x55848417fb30 2024-09-13T23:05:34.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.122+0000 7fea43fff640 1 --2- 172.21.15.164:0/681852232 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fea38036b90 0x7fea38039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.122+0000 7fea43fff640 1 -- 172.21.15.164:0/681852232 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7feb48092c00 con 0x55848417fb30 2024-09-13T23:05:34.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.123+0000 7feb5e953640 1 --2- 172.21.15.164:0/681852232 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fea38036b90 0x7fea38039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.123+0000 7feb62e36800 1 Processor -- start 2024-09-13T23:05:34.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.123+0000 7feb5e953640 1 --2- 172.21.15.164:0/681852232 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fea38036b90 0x7fea38039050 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x5584841709e0 tx=0x7feb58005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.123+0000 7feb62e36800 1 -- start start 2024-09-13T23:05:34.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.123+0000 7feb62e36800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55848418c6d0 0x55848418cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.123+0000 7feb62e36800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55848415fd50 con 0x55848418c6d0 2024-09-13T23:05:34.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.123+0000 7feb57fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55848418c6d0 0x55848418cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.123+0000 7feb57fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55848418c6d0 0x55848418cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57348/0 (socket says 172.21.15.164:57348) 2024-09-13T23:05:34.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.123+0000 7feb57fff640 1 -- 172.21.15.164:0/4018560460 learned_addr learned my addr 172.21.15.164:0/4018560460 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:34.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.123+0000 7feb57fff640 1 -- 172.21.15.164:0/4018560460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55848418d0a0 con 0x55848418c6d0 2024-09-13T23:05:34.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.124+0000 7feb57fff640 1 --2- 172.21.15.164:0/4018560460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55848418c6d0 0x55848418cad0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7feb48090fa0 tx=0x7feb4805c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364d75c555a8d697 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.124+0000 7fea41ffb640 1 -- 172.21.15.164:0/4018560460 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb4805c560 con 0x55848418c6d0 2024-09-13T23:05:34.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.124+0000 7fea41ffb640 1 -- 172.21.15.164:0/4018560460 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb4806bc10 con 0x55848418c6d0 2024-09-13T23:05:34.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.124+0000 7fea41ffb640 1 -- 172.21.15.164:0/4018560460 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb4806a560 con 0x55848418c6d0 2024-09-13T23:05:34.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.124+0000 7feb62e36800 1 -- 172.21.15.164:0/4018560460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55848418c6d0 msgr2=0x55848418cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.124+0000 7feb62e36800 1 --2- 172.21.15.164:0/4018560460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55848418c6d0 0x55848418cad0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7feb48090fa0 tx=0x7feb4805c460 comp rx=0 tx=0).stop 2024-09-13T23:05:34.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.124+0000 7feb62e36800 1 -- 172.21.15.164:0/4018560460 shutdown_connections 2024-09-13T23:05:34.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.124+0000 7feb62e36800 1 --2- 172.21.15.164:0/4018560460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55848418c6d0 0x55848418cad0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.124+0000 7feb62e36800 1 -- 172.21.15.164:0/4018560460 >> 172.21.15.164:0/4018560460 conn(0x558484188a30 msgr2=0x558484186b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:34.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.124+0000 7feb62e36800 1 -- 172.21.15.164:0/4018560460 shutdown_connections 2024-09-13T23:05:34.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.124+0000 7feb62e36800 1 -- 172.21.15.164:0/4018560460 wait complete. 2024-09-13T23:05:34.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.124+0000 7feb62e36800 1 Processor -- start 2024-09-13T23:05:34.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.125+0000 7feb62e36800 1 -- start start 2024-09-13T23:05:34.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.125+0000 7feb62e36800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55848418c6d0 0x558484193b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.125+0000 7feb62e36800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55848418d710 con 0x55848418c6d0 2024-09-13T23:05:34.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.125+0000 7feb57fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55848418c6d0 0x558484193b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.125+0000 7feb57fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55848418c6d0 0x558484193b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57364/0 (socket says 172.21.15.164:57364) 2024-09-13T23:05:34.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.125+0000 7feb57fff640 1 -- 172.21.15.164:0/3971306465 learned_addr learned my addr 172.21.15.164:0/3971306465 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:34.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.125+0000 7feb57fff640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584841940d0 con 0x55848418c6d0 2024-09-13T23:05:34.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.125+0000 7feb57fff640 1 --2- 172.21.15.164:0/3971306465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55848418c6d0 0x558484193b90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7feb48069740 tx=0x7feb48090f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.125+0000 7fea2ffff640 1 -- 172.21.15.164:0/3971306465 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb4806b750 con 0x55848418c6d0 2024-09-13T23:05:34.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.125+0000 7fea2ffff640 1 -- 172.21.15.164:0/3971306465 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb48092e50 con 0x55848418c6d0 2024-09-13T23:05:34.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.125+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558484194360 con 0x55848418c6d0 2024-09-13T23:05:34.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.125+0000 7fea2ffff640 1 -- 172.21.15.164:0/3971306465 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb480699e0 con 0x55848418c6d0 2024-09-13T23:05:34.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.126+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558484197010 con 0x55848418c6d0 2024-09-13T23:05:34.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.126+0000 7fea2ffff640 1 -- 172.21.15.164:0/3971306465 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7feb48069b80 con 0x55848418c6d0 2024-09-13T23:05:34.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.127+0000 7fea2ffff640 1 --2- 172.21.15.164:0/3971306465 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fea28036b90 0x7fea28039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.127+0000 7fea2ffff640 1 -- 172.21.15.164:0/3971306465 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7feb4809cca0 con 0x55848418c6d0 2024-09-13T23:05:34.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.127+0000 7feb5e953640 1 --2- 172.21.15.164:0/3971306465 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fea28036b90 0x7fea28039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.127+0000 7feb62e36800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.127+0000 7feb62e36800 1 --2- 172.21.15.164:0/3971306465 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55848419f600 0x5584841a1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.127+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5584841a2210 con 0x55848419f600 2024-09-13T23:05:34.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.127+0000 7feb5e152640 1 --2- 172.21.15.164:0/3971306465 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55848419f600 0x5584841a1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.127+0000 7feb5e953640 1 --2- 172.21.15.164:0/3971306465 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fea28036b90 0x7fea28039050 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x558484170160 tx=0x7feb5801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.127+0000 7feb5e152640 1 --2- 172.21.15.164:0/3971306465 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55848419f600 0x5584841a1ac0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.128+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb5002d070 con 0x55848419f600 2024-09-13T23:05:34.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.128+0000 7feb62e36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.128+0000 7feb62e36800 20 realm 2024-09-13T23:05:34.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.128+0000 7feb62e36800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.128+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5584841a2620 con 0x55848419f600 2024-09-13T23:05:34.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.128+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb5002d070 con 0x55848419f600 2024-09-13T23:05:34.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.128+0000 7feb62e36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.128+0000 7feb62e36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:34.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.128+0000 7feb62e36800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.128+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5584841a2ef0 con 0x55848419f600 2024-09-13T23:05:34.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.128+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb5002d070 con 0x55848419f600 2024-09-13T23:05:34.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.128+0000 7feb62e36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.128+0000 7feb62e36800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.128+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5584841a3290 con 0x55848419f600 2024-09-13T23:05:34.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.128+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feb5002d070 con 0x55848419f600 2024-09-13T23:05:34.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.128+0000 7feb62e36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:34.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.129+0000 7feb62e36800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.129+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5584841a3730 con 0x55848419f600 2024-09-13T23:05:34.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.129+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7feb5002d070 con 0x55848419f600 2024-09-13T23:05:34.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.129+0000 7feb62e36800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:34.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.129+0000 7feb62e36800 20 searching for the correct realm 2024-09-13T23:05:34.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.129+0000 7feb62e36800 1 --2- 172.21.15.164:0/3971306465 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5584841a5730 0x5584841a7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.129+0000 7feb57fff640 1 --2- 172.21.15.164:0/3971306465 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5584841a5730 0x5584841a7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.129+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x5584841a5730 2024-09-13T23:05:34.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.129+0000 7feb57fff640 1 --2- 172.21.15.164:0/3971306465 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5584841a5730 0x5584841a7b40 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.129+0000 7feb57fff640 1 -- 172.21.15.164:0/3971306465 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb4808bd70 con 0x5584841a5730 2024-09-13T23:05:34.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.129+0000 7feb57fff640 1 --2- 172.21.15.164:0/3971306465 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7feb4805f040 0x7feb48068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.129+0000 7feb57fff640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x7feb4805f040 2024-09-13T23:05:34.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.130+0000 7feb5e953640 1 --2- 172.21.15.164:0/3971306465 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7feb4805f040 0x7feb48068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.130+0000 7feb5e953640 1 --2- 172.21.15.164:0/3971306465 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7feb4805f040 0x7feb48068320 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.130+0000 7feb5e953640 1 -- 172.21.15.164:0/3971306465 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb5801f070 con 0x7feb4805f040 2024-09-13T23:05:34.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.130+0000 7feb5e953640 1 --2- 172.21.15.164:0/3971306465 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7feb58031040 0x7feb58032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.130+0000 7feb5e953640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x7feb58031040 2024-09-13T23:05:34.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.130+0000 7feb5e152640 1 --2- 172.21.15.164:0/3971306465 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7feb58031040 0x7feb58032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.131+0000 7feb5e152640 1 --2- 172.21.15.164:0/3971306465 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7feb58031040 0x7feb58032940 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.131+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb5002d070 con 0x7feb58031040 2024-09-13T23:05:34.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.131+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x55848419f600 2024-09-13T23:05:34.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.131+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7feb5002d070 con 0x55848419f600 2024-09-13T23:05:34.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.131+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x55848419f600 2024-09-13T23:05:34.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.132+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb5002d070 con 0x55848419f600 2024-09-13T23:05:34.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.132+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x7feb58031040 2024-09-13T23:05:34.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.132+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb5002d070 con 0x7feb58031040 2024-09-13T23:05:34.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.132+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x7feb58031040 2024-09-13T23:05:34.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.132+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb5002d070 con 0x7feb58031040 2024-09-13T23:05:34.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.132+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x7feb4805f040 2024-09-13T23:05:34.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.132+0000 7feb5e953640 1 -- 172.21.15.164:0/3971306465 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb5801f070 con 0x7feb4805f040 2024-09-13T23:05:34.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.132+0000 7feb5e953640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x5584841a5730 2024-09-13T23:05:34.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.133+0000 7feb57fff640 1 -- 172.21.15.164:0/3971306465 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb4808bd70 con 0x5584841a5730 2024-09-13T23:05:34.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.133+0000 7feb57fff640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x55848419f600 2024-09-13T23:05:34.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.133+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb5002d070 con 0x55848419f600 2024-09-13T23:05:34.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.133+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x7feb58031040 2024-09-13T23:05:34.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.133+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb5002d070 con 0x7feb58031040 2024-09-13T23:05:34.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.133+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x55848419f600 2024-09-13T23:05:34.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.134+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb5002d070 con 0x55848419f600 2024-09-13T23:05:34.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.134+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x7feb4805f040 2024-09-13T23:05:34.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.134+0000 7feb5e953640 1 -- 172.21.15.164:0/3971306465 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7feb5801f070 con 0x7feb4805f040 2024-09-13T23:05:34.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.134+0000 7feb5e953640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x5584841a5730 2024-09-13T23:05:34.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.134+0000 7feb57fff640 1 -- 172.21.15.164:0/3971306465 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb4808bd70 con 0x5584841a5730 2024-09-13T23:05:34.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.134+0000 7feb57fff640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x5584841a5730 2024-09-13T23:05:34.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.135+0000 7feb57fff640 1 -- 172.21.15.164:0/3971306465 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb4808bd70 con 0x5584841a5730 2024-09-13T23:05:34.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.135+0000 7feb57fff640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x7feb58031040 2024-09-13T23:05:34.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.135+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb5002d070 con 0x7feb58031040 2024-09-13T23:05:34.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.135+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x5584841a5730 2024-09-13T23:05:34.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.135+0000 7feb57fff640 1 -- 172.21.15.164:0/3971306465 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb4808bd70 con 0x5584841a5730 2024-09-13T23:05:34.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.135+0000 7feb57fff640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x5584841a5730 2024-09-13T23:05:34.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.135+0000 7feb57fff640 1 -- 172.21.15.164:0/3971306465 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb4808bd70 con 0x5584841a5730 2024-09-13T23:05:34.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.135+0000 7feb57fff640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x55848419f600 2024-09-13T23:05:34.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.136+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb5002d070 con 0x55848419f600 2024-09-13T23:05:34.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.136+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x55848419f600 2024-09-13T23:05:34.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.136+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7feb5002d070 con 0x55848419f600 2024-09-13T23:05:34.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.136+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x7feb58031040 2024-09-13T23:05:34.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.136+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb5002d070 con 0x7feb58031040 2024-09-13T23:05:34.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.136+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x5584841a5730 2024-09-13T23:05:34.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.136+0000 7feb57fff640 1 -- 172.21.15.164:0/3971306465 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb4808bd70 con 0x5584841a5730 2024-09-13T23:05:34.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.136+0000 7feb57fff640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x7feb4805f040 2024-09-13T23:05:34.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.137+0000 7feb5e953640 1 -- 172.21.15.164:0/3971306465 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb5801f070 con 0x7feb4805f040 2024-09-13T23:05:34.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.137+0000 7feb5e953640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x55848419f600 2024-09-13T23:05:34.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.137+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7feb5002d070 con 0x55848419f600 2024-09-13T23:05:34.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.137+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x7feb58031040 2024-09-13T23:05:34.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.137+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb5002d070 con 0x7feb58031040 2024-09-13T23:05:34.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.137+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x5584841a5730 2024-09-13T23:05:34.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.137+0000 7feb57fff640 1 -- 172.21.15.164:0/3971306465 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb4808bd70 con 0x5584841a5730 2024-09-13T23:05:34.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.137+0000 7feb57fff640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x7feb58031040 2024-09-13T23:05:34.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.138+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb5002d070 con 0x7feb58031040 2024-09-13T23:05:34.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.138+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x7feb4805f040 2024-09-13T23:05:34.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.138+0000 7feb5e953640 1 -- 172.21.15.164:0/3971306465 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb5801f070 con 0x7feb4805f040 2024-09-13T23:05:34.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.138+0000 7feb5e953640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x5584841a5730 2024-09-13T23:05:34.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.138+0000 7feb57fff640 1 -- 172.21.15.164:0/3971306465 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb4808bd70 con 0x5584841a5730 2024-09-13T23:05:34.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.138+0000 7feb57fff640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x7feb58031040 2024-09-13T23:05:34.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.138+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb5002d070 con 0x7feb58031040 2024-09-13T23:05:34.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.138+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x55848419f600 2024-09-13T23:05:34.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.139+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7feb5002d070 con 0x55848419f600 2024-09-13T23:05:34.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.139+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8210 con 0x7feb4805f040 2024-09-13T23:05:34.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.139+0000 7feb5e953640 1 -- 172.21.15.164:0/3971306465 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb5801f070 con 0x7feb4805f040 2024-09-13T23:05:34.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.139+0000 7feb62e36800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:34.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.139+0000 7feb62e36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:34.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.139+0000 7feb62e36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:34.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.139+0000 7feb62e36800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:34.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.139+0000 7feb62e36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:34.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.139+0000 7feb62e36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:34.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.139+0000 7feb62e36800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.139+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5584841a41d0 con 0x55848419f600 2024-09-13T23:05:34.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.139+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb5002d070 con 0x55848419f600 2024-09-13T23:05:34.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.139+0000 7feb62e36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.139+0000 7feb62e36800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.139+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5584841a4a70 con 0x55848419f600 2024-09-13T23:05:34.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.139+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feb5002d070 con 0x55848419f600 2024-09-13T23:05:34.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.139+0000 7feb62e36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:34.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.139+0000 7feb62e36800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.139+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5584841a3e10 con 0x55848419f600 2024-09-13T23:05:34.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.140+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7feb5002d070 con 0x55848419f600 2024-09-13T23:05:34.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.140+0000 7feb62e36800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:34.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.140+0000 7feb62e36800 20 zone default found 2024-09-13T23:05:34.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.140+0000 7feb62e36800 4 Realm: () 2024-09-13T23:05:34.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.140+0000 7feb62e36800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:34.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.140+0000 7feb62e36800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:34.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.140+0000 7feb62e36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:34.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.140+0000 7feb62e36800 20 zonegroup default 2024-09-13T23:05:34.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.140+0000 7feb62e36800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.140+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5584841a8690 con 0x7feb58031040 2024-09-13T23:05:34.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.140+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7feb5002d070 con 0x7feb58031040 2024-09-13T23:05:34.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.140+0000 7feb62e36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.140+0000 7feb62e36800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.140+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5584841aa520 con 0x5584841a5730 2024-09-13T23:05:34.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.140+0000 7feb57fff640 1 -- 172.21.15.164:0/3971306465 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feb4808bd70 con 0x5584841a5730 2024-09-13T23:05:34.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.140+0000 7feb62e36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.140+0000 7feb62e36800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.140+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5584841aa8c0 con 0x5584841a5730 2024-09-13T23:05:34.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.140+0000 7feb57fff640 1 -- 172.21.15.164:0/3971306465 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feb4808bd70 con 0x5584841a5730 2024-09-13T23:05:34.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.140+0000 7feb62e36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.140+0000 7feb62e36800 20 started sync module instance, tier type = 2024-09-13T23:05:34.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.140+0000 7feb62e36800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:34.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.140+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584841a9960 con 0x7feb4805f040 2024-09-13T23:05:34.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.142+0000 7feb5e953640 1 -- 172.21.15.164:0/3971306465 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb58040040 con 0x7feb4805f040 2024-09-13T23:05:34.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.142+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94027640380752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584841aa170 con 0x7feb4805f040 2024-09-13T23:05:34.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.142+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584841ab5c0 con 0x55848419f600 2024-09-13T23:05:34.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.142+0000 7feb5e953640 1 -- 172.21.15.164:0/3971306465 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94027640380752] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb58040040 con 0x7feb4805f040 2024-09-13T23:05:34.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.143+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb5002d070 con 0x55848419f600 2024-09-13T23:05:34.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.143+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94027640385088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584841ab9b0 con 0x55848419f600 2024-09-13T23:05:34.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.143+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584841ac3d0 con 0x5584841a5730 2024-09-13T23:05:34.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.144+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94027640385088] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb5002d070 con 0x55848419f600 2024-09-13T23:05:34.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.144+0000 7feb57fff640 1 -- 172.21.15.164:0/3971306465 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb4808bd70 con 0x5584841a5730 2024-09-13T23:05:34.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.144+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94027640389312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584841ac7f0 con 0x5584841a5730 2024-09-13T23:05:34.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.144+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584841ad1f0 con 0x7feb4805f040 2024-09-13T23:05:34.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.145+0000 7feb57fff640 1 -- 172.21.15.164:0/3971306465 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94027640389312] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb4808bd70 con 0x5584841a5730 2024-09-13T23:05:34.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.145+0000 7feb5e953640 1 -- 172.21.15.164:0/3971306465 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb58040040 con 0x7feb4805f040 2024-09-13T23:05:34.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.145+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94027640386240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584841ad5e0 con 0x7feb4805f040 2024-09-13T23:05:34.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.145+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584841ae060 con 0x55848419f600 2024-09-13T23:05:34.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.146+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb5002d070 con 0x55848419f600 2024-09-13T23:05:34.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.146+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94027640396624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584841ae020 con 0x55848419f600 2024-09-13T23:05:34.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.146+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584841aef70 con 0x7feb58031040 2024-09-13T23:05:34.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.146+0000 7feb5e953640 1 -- 172.21.15.164:0/3971306465 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94027640386240] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb58040040 con 0x7feb4805f040 2024-09-13T23:05:34.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.147+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94027640396624] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb5002d070 con 0x55848419f600 2024-09-13T23:05:34.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.147+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb5002d070 con 0x7feb58031040 2024-09-13T23:05:34.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.147+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94027640392960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584841aeac0 con 0x7feb58031040 2024-09-13T23:05:34.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.147+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584841af4c0 con 0x7feb58031040 2024-09-13T23:05:34.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.148+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94027640392960] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb5002d070 con 0x7feb58031040 2024-09-13T23:05:34.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.148+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb5002d070 con 0x7feb58031040 2024-09-13T23:05:34.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.148+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94027640398848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584841af480 con 0x7feb58031040 2024-09-13T23:05:34.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.148+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584841afe40 con 0x7feb58031040 2024-09-13T23:05:34.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.149+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94027640398848] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb5002d070 con 0x7feb58031040 2024-09-13T23:05:34.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.149+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb5002d070 con 0x7feb58031040 2024-09-13T23:05:34.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.149+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94027640404848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584841af480 con 0x7feb58031040 2024-09-13T23:05:34.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.149+0000 7feb62e36800 20 add_watcher() i=0 2024-09-13T23:05:34.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.149+0000 7feb62e36800 20 add_watcher() i=1 2024-09-13T23:05:34.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.149+0000 7feb62e36800 20 add_watcher() i=2 2024-09-13T23:05:34.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.149+0000 7feb62e36800 20 add_watcher() i=3 2024-09-13T23:05:34.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.149+0000 7feb62e36800 20 add_watcher() i=4 2024-09-13T23:05:34.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.149+0000 7feb62e36800 20 add_watcher() i=5 2024-09-13T23:05:34.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.149+0000 7feb62e36800 20 add_watcher() i=6 2024-09-13T23:05:34.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.150+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94027640404848] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb5002d070 con 0x7feb58031040 2024-09-13T23:05:34.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.150+0000 7feb62e36800 20 add_watcher() i=7 2024-09-13T23:05:34.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.150+0000 7feb62e36800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:34.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.150+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5584841b3260 con 0x55848419f600 2024-09-13T23:05:34.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.151+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7feb5002d070 con 0x55848419f600 2024-09-13T23:05:34.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.151+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94027640402336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584841b0760 con 0x55848419f600 2024-09-13T23:05:34.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.152+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94027640402336] v32'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feb5002d070 con 0x55848419f600 2024-09-13T23:05:34.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.152+0000 7fea14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:34.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.152+0000 7feb62e36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:34.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.152+0000 7feb62e36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:34.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.152+0000 7feb62e36800 5 note: GC not initialized 2024-09-13T23:05:34.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.152+0000 7fe98f7fe640 20 reqs_thread_entry: start 2024-09-13T23:05:34.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.152+0000 7feb62e36800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:34.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.152+0000 7feb62e36800 20 Filter name: none 2024-09-13T23:05:34.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.152+0000 7fe98d7fa640 20 reqs_thread_entry: start 2024-09-13T23:05:34.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.152+0000 7feb62e36800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.152+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5584841e61a0 con 0x55848419f600 2024-09-13T23:05:34.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.153+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7feb5002d070 con 0x55848419f600 2024-09-13T23:05:34.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.153+0000 7feb62e36800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:05:34.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.153+0000 7feb62e36800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.153+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5584841e6b90 con 0x55848419f600 2024-09-13T23:05:34.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.153+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7feb5002d070 con 0x55848419f600 2024-09-13T23:05:34.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.153+0000 7feb62e36800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:05:34.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.153+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5584841e7ba0 con 0x7feb4805f040 2024-09-13T23:05:34.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.153+0000 7feb5e953640 1 -- 172.21.15.164:0/3971306465 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7feb58040040 con 0x7feb4805f040 2024-09-13T23:05:34.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.154+0000 7fea14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:34.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.154+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94027640402336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584841e3fb0 con 0x55848419f600 2024-09-13T23:05:34.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.155+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94027640402336] v32'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feb5002d070 con 0x55848419f600 2024-09-13T23:05:34.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.155+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94027640380752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584841cede0 con 0x7feb4805f040 2024-09-13T23:05:34.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.156+0000 7feb5e953640 1 -- 172.21.15.164:0/3971306465 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94027640380752] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb58040040 con 0x7feb4805f040 2024-09-13T23:05:34.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.156+0000 7feb62e36800 20 remove_watcher() i=0 2024-09-13T23:05:34.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.156+0000 7feb62e36800 2 removed watcher, disabling cache 2024-09-13T23:05:34.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.156+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94027640385088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584841e3fb0 con 0x55848419f600 2024-09-13T23:05:34.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.157+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94027640385088] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb5002d070 con 0x55848419f600 2024-09-13T23:05:34.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.157+0000 7feb62e36800 20 remove_watcher() i=1 2024-09-13T23:05:34.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.157+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94027640389312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584841cede0 con 0x5584841a5730 2024-09-13T23:05:34.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.158+0000 7feb57fff640 1 -- 172.21.15.164:0/3971306465 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94027640389312] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb4808bd70 con 0x5584841a5730 2024-09-13T23:05:34.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.158+0000 7feb62e36800 20 remove_watcher() i=2 2024-09-13T23:05:34.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.158+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94027640386240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584841e3fb0 con 0x7feb4805f040 2024-09-13T23:05:34.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.159+0000 7feb5e953640 1 -- 172.21.15.164:0/3971306465 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94027640386240] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb58040040 con 0x7feb4805f040 2024-09-13T23:05:34.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.159+0000 7feb62e36800 20 remove_watcher() i=3 2024-09-13T23:05:34.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.159+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94027640396624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584841e3fb0 con 0x55848419f600 2024-09-13T23:05:34.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.160+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94027640396624] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb5002d070 con 0x55848419f600 2024-09-13T23:05:34.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.160+0000 7feb62e36800 20 remove_watcher() i=4 2024-09-13T23:05:34.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.160+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94027640392960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584841e3fb0 con 0x7feb58031040 2024-09-13T23:05:34.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.161+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94027640392960] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb5002d070 con 0x7feb58031040 2024-09-13T23:05:34.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.161+0000 7feb62e36800 20 remove_watcher() i=5 2024-09-13T23:05:34.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.161+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94027640398848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584841e3fb0 con 0x7feb58031040 2024-09-13T23:05:34.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.162+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94027640398848] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb5002d070 con 0x7feb58031040 2024-09-13T23:05:34.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.162+0000 7feb62e36800 20 remove_watcher() i=6 2024-09-13T23:05:34.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.162+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94027640404848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5584841e3fb0 con 0x7feb58031040 2024-09-13T23:05:34.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.163+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94027640404848] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb5002d070 con 0x7feb58031040 2024-09-13T23:05:34.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.163+0000 7feb62e36800 20 remove_watcher() i=7 2024-09-13T23:05:34.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.163+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7feb58031040 msgr2=0x7feb58032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.163+0000 7feb62e36800 1 --2- 172.21.15.164:0/3971306465 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7feb58031040 0x7feb58032940 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.163+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55848419f600 msgr2=0x5584841a1ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.163+0000 7feb62e36800 1 --2- 172.21.15.164:0/3971306465 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55848419f600 0x5584841a1ac0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.163+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7feb4805f040 msgr2=0x7feb48068320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.163+0000 7feb62e36800 1 --2- 172.21.15.164:0/3971306465 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7feb4805f040 0x7feb48068320 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.163+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5584841a5730 msgr2=0x5584841a7b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.163+0000 7feb62e36800 1 --2- 172.21.15.164:0/3971306465 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5584841a5730 0x5584841a7b40 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.163+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fea28036b90 msgr2=0x7fea28039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.163+0000 7feb62e36800 1 --2- 172.21.15.164:0/3971306465 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fea28036b90 0x7fea28039050 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x558484170160 tx=0x7feb5801f000 comp rx=0 tx=0).stop 2024-09-13T23:05:34.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.163+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55848418c6d0 msgr2=0x558484193b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.163+0000 7feb5e152640 1 -- 172.21.15.164:0/3971306465 reap_dead start 2024-09-13T23:05:34.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.163+0000 7feb62e36800 1 --2- 172.21.15.164:0/3971306465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55848418c6d0 0x558484193b90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7feb48069740 tx=0x7feb48090f00 comp rx=0 tx=0).stop 2024-09-13T23:05:34.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.163+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 shutdown_connections 2024-09-13T23:05:34.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.163+0000 7feb62e36800 1 --2- 172.21.15.164:0/3971306465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55848418c6d0 0x558484193b90 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.163+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 >> 172.21.15.164:0/3971306465 conn(0x558484188a30 msgr2=0x558484186b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:34.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.163+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 shutdown_connections 2024-09-13T23:05:34.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.163+0000 7feb62e36800 1 -- 172.21.15.164:0/3971306465 wait complete. 2024-09-13T23:05:34.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.164+0000 7feb62e36800 1 -- 172.21.15.164:0/681852232 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fea38036b90 msgr2=0x7fea38039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.164+0000 7feb62e36800 1 --2- 172.21.15.164:0/681852232 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fea38036b90 0x7fea38039050 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x5584841709e0 tx=0x7feb58005840 comp rx=0 tx=0).stop 2024-09-13T23:05:34.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.164+0000 7feb62e36800 1 -- 172.21.15.164:0/681852232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55848417fb30 msgr2=0x55848417ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.164+0000 7feb62e36800 1 --2- 172.21.15.164:0/681852232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55848417fb30 0x55848417ff50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7feb48025bf0 tx=0x7feb48002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.164+0000 7feb62e36800 1 -- 172.21.15.164:0/681852232 shutdown_connections 2024-09-13T23:05:34.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.164+0000 7feb62e36800 1 --2- 172.21.15.164:0/681852232 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fea38036b90 0x7fea38039050 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.164+0000 7feb62e36800 1 --2- 172.21.15.164:0/681852232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55848417fb30 0x55848417ff50 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.164+0000 7feb62e36800 1 -- 172.21.15.164:0/681852232 >> 172.21.15.164:0/681852232 conn(0x558484174ac0 msgr2=0x558484177640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:34.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.164+0000 7feb62e36800 1 -- 172.21.15.164:0/681852232 shutdown_connections 2024-09-13T23:05:34.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.164+0000 7feb62e36800 1 -- 172.21.15.164:0/681852232 wait complete. 2024-09-13T23:05:34.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.164+0000 7feb62e36800 1 -- 172.21.15.164:0/4168413609 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x558484074990 msgr2=0x55848416f0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.164+0000 7feb62e36800 1 --2- 172.21.15.164:0/4168413609 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x558484074990 0x55848416f0e0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.164+0000 7feb62e36800 1 -- 172.21.15.164:0/4168413609 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fea44036b90 msgr2=0x7fea44039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.164+0000 7feb62e36800 1 --2- 172.21.15.164:0/4168413609 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fea44036b90 0x7fea44039050 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feb48057000 tx=0x7feb48052000 comp rx=0 tx=0).stop 2024-09-13T23:05:34.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.164+0000 7feb62e36800 1 -- 172.21.15.164:0/4168413609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558484070550 msgr2=0x558483fe5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.164+0000 7feb62e36800 1 --2- 172.21.15.164:0/4168413609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558484070550 0x558483fe5560 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x558484160400 tx=0x7feb50000ed0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.164+0000 7feb62e36800 1 -- 172.21.15.164:0/4168413609 shutdown_connections 2024-09-13T23:05:34.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.164+0000 7feb62e36800 1 --2- 172.21.15.164:0/4168413609 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x558484074990 0x55848416f0e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.164+0000 7feb62e36800 1 --2- 172.21.15.164:0/4168413609 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fea44036b90 0x7fea44039050 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.164+0000 7feb62e36800 1 --2- 172.21.15.164:0/4168413609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558484070550 0x558483fe5560 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.164+0000 7feb62e36800 1 -- 172.21.15.164:0/4168413609 >> 172.21.15.164:0/4168413609 conn(0x55848406bde0 msgr2=0x558484159810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:34.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.164+0000 7feb62e36800 1 -- 172.21.15.164:0/4168413609 shutdown_connections 2024-09-13T23:05:34.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.164+0000 7feb62e36800 1 -- 172.21.15.164:0/4168413609 wait complete. 2024-09-13T23:05:34.175 INFO:teuthology.orchestra.run.smithi164.stdout:[] 2024-09-13T23:05:34.175 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T23:05:34.310 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:05:34.311 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-13T23:05:34.311 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-13T23:05:34.311 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-13T23:05:34.356 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:34.356 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:34.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.356+0000 7f2317340800 1 Processor -- start 2024-09-13T23:05:34.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.356+0000 7f2317340800 1 -- start start 2024-09-13T23:05:34.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.356+0000 7f2317340800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5567a4bdea60 0x5567a4be0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.356+0000 7f2317340800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5567a4a99b30 con 0x5567a4bda760 2024-09-13T23:05:34.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.356+0000 7f2317340800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x5567a4a7b360 con 0x5567a4bdea60 2024-09-13T23:05:34.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.357+0000 7f230a8c9640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5567a4bdea60 0x5567a4be0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.357+0000 7f23130ca640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x5567a4bda760 0x5567a4bdab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40886/0 (socket says 172.21.15.164:40886) 2024-09-13T23:05:34.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.357+0000 7f23130ca640 1 -- 172.21.15.164:0/1366896242 learned_addr learned my addr 172.21.15.164:0/1366896242 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:34.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.357+0000 7f230a8c9640 1 -- 172.21.15.164:0/1366896242 >> v1:172.21.15.17:6789/0 conn(0x5567a4bda760 legacy=0x5567a4bdab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.357+0000 7f230a8c9640 1 -- 172.21.15.164:0/1366896242 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567a4aa1e00 con 0x5567a4bdea60 2024-09-13T23:05:34.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.359+0000 7f230a8c9640 1 --2- 172.21.15.164:0/1366896242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4bdea60 0x5567a4be0e50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f22fc00a470 tx=0x7f22fc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c3e874bc94f6f01 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.359+0000 7f23128c9640 1 -- 172.21.15.164:0/1366896242 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22fc053570 con 0x5567a4bdea60 2024-09-13T23:05:34.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.359+0000 7f23128c9640 1 -- 172.21.15.164:0/1366896242 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22fc058070 con 0x5567a4bdea60 2024-09-13T23:05:34.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.359+0000 7f23128c9640 1 -- 172.21.15.164:0/1366896242 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22fc053880 con 0x5567a4bdea60 2024-09-13T23:05:34.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.359+0000 7f2317340800 1 -- 172.21.15.164:0/1366896242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4bdea60 msgr2=0x5567a4be0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.359+0000 7f2317340800 1 --2- 172.21.15.164:0/1366896242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4bdea60 0x5567a4be0e50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f22fc00a470 tx=0x7f22fc045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:34.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.359+0000 7f2317340800 1 -- 172.21.15.164:0/1366896242 shutdown_connections 2024-09-13T23:05:34.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.359+0000 7f2317340800 1 --2- 172.21.15.164:0/1366896242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4bdea60 0x5567a4be0e50 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.359+0000 7f2317340800 1 -- 172.21.15.164:0/1366896242 >> 172.21.15.164:0/1366896242 conn(0x5567a4bd5ff0 msgr2=0x5567a4bd8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:34.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.359+0000 7f2317340800 1 -- 172.21.15.164:0/1366896242 shutdown_connections 2024-09-13T23:05:34.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.359+0000 7f2317340800 1 -- 172.21.15.164:0/1366896242 wait complete. 2024-09-13T23:05:34.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.373+0000 7f2317340800 1 Processor -- start 2024-09-13T23:05:34.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.373+0000 7f2317340800 1 -- start start 2024-09-13T23:05:34.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.373+0000 7f2317340800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4bda760 0x5567a4cc9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.373+0000 7f2317340800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5567a4b26330 con 0x5567a4bda760 2024-09-13T23:05:34.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.373+0000 7f23130ca640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4bda760 0x5567a4cc9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.373+0000 7f23130ca640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4bda760 0x5567a4cc9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57380/0 (socket says 172.21.15.164:57380) 2024-09-13T23:05:34.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.373+0000 7f23130ca640 1 -- 172.21.15.164:0/4187690294 learned_addr learned my addr 172.21.15.164:0/4187690294 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:34.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.374+0000 7f23130ca640 1 -- 172.21.15.164:0/4187690294 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567a4a73bc0 con 0x5567a4bda760 2024-09-13T23:05:34.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.374+0000 7f23130ca640 1 --2- 172.21.15.164:0/4187690294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4bda760 0x5567a4cc9860 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2304001e10 tx=0x7f230400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995ca533bd53c5e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.374+0000 7f220160a640 1 -- 172.21.15.164:0/4187690294 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2304012020 con 0x5567a4bda760 2024-09-13T23:05:34.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.374+0000 7f220160a640 1 -- 172.21.15.164:0/4187690294 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f230400e5a0 con 0x5567a4bda760 2024-09-13T23:05:34.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.374+0000 7f220160a640 1 -- 172.21.15.164:0/4187690294 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f230400e8e0 con 0x5567a4bda760 2024-09-13T23:05:34.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.375+0000 7f2317340800 1 -- 172.21.15.164:0/4187690294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4bda760 msgr2=0x5567a4cc9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.375+0000 7f2317340800 1 --2- 172.21.15.164:0/4187690294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4bda760 0x5567a4cc9860 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2304001e10 tx=0x7f230400b780 comp rx=0 tx=0).stop 2024-09-13T23:05:34.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.375+0000 7f2317340800 1 -- 172.21.15.164:0/4187690294 shutdown_connections 2024-09-13T23:05:34.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.375+0000 7f2317340800 1 --2- 172.21.15.164:0/4187690294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4bda760 0x5567a4cc9860 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.375+0000 7f2317340800 1 -- 172.21.15.164:0/4187690294 >> 172.21.15.164:0/4187690294 conn(0x5567a4bd5ff0 msgr2=0x5567a4cc5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:34.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.375+0000 7f2317340800 1 -- 172.21.15.164:0/4187690294 shutdown_connections 2024-09-13T23:05:34.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.375+0000 7f2317340800 1 -- 172.21.15.164:0/4187690294 wait complete. 2024-09-13T23:05:34.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.375+0000 7f2317340800 1 Processor -- start 2024-09-13T23:05:34.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.375+0000 7f2317340800 1 -- start start 2024-09-13T23:05:34.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.375+0000 7f2317340800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4bda760 0x5567a4cd1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.375+0000 7f2317340800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5567a4be1690 con 0x5567a4bda760 2024-09-13T23:05:34.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.376+0000 7f23130ca640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4bda760 0x5567a4cd1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.376+0000 7f23130ca640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4bda760 0x5567a4cd1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57392/0 (socket says 172.21.15.164:57392) 2024-09-13T23:05:34.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.376+0000 7f23130ca640 1 -- 172.21.15.164:0/3353609606 learned_addr learned my addr 172.21.15.164:0/3353609606 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:34.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.376+0000 7f23130ca640 1 -- 172.21.15.164:0/3353609606 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567a4a87fe0 con 0x5567a4bda760 2024-09-13T23:05:34.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.376+0000 7f23130ca640 1 --2- 172.21.15.164:0/3353609606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4bda760 0x5567a4cd1260 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f230400b7c0 tx=0x7f2304000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.376+0000 7f21ffe07640 1 -- 172.21.15.164:0/3353609606 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2304012030 con 0x5567a4bda760 2024-09-13T23:05:34.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.376+0000 7f21ffe07640 1 -- 172.21.15.164:0/3353609606 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2304001470 con 0x5567a4bda760 2024-09-13T23:05:34.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.376+0000 7f21ffe07640 1 -- 172.21.15.164:0/3353609606 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f230401a8d0 con 0x5567a4bda760 2024-09-13T23:05:34.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.376+0000 7f2317340800 1 -- 172.21.15.164:0/3353609606 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5567a4cd17a0 con 0x5567a4bda760 2024-09-13T23:05:34.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.376+0000 7f2317340800 1 -- 172.21.15.164:0/3353609606 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567a4cd1cc0 con 0x5567a4bda760 2024-09-13T23:05:34.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.377+0000 7f21ffe07640 1 -- 172.21.15.164:0/3353609606 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2304015020 con 0x5567a4bda760 2024-09-13T23:05:34.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.377+0000 7f21ffe07640 1 --2- 172.21.15.164:0/3353609606 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f21f8036b90 0x7f21f8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.377+0000 7f21ffe07640 1 -- 172.21.15.164:0/3353609606 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2304020030 con 0x5567a4bda760 2024-09-13T23:05:34.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.377+0000 7f230a8c9640 1 --2- 172.21.15.164:0/3353609606 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f21f8036b90 0x7f21f8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.377+0000 7f2317340800 1 --2- 172.21.15.164:0/3353609606 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5567a4bdea60 0x5567a4cd82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.377+0000 7f2317340800 1 -- 172.21.15.164:0/3353609606 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567a4cd8810 con 0x5567a4bdea60 2024-09-13T23:05:34.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.378+0000 7f23138cb640 1 --2- 172.21.15.164:0/3353609606 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5567a4bdea60 0x5567a4cd82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.378+0000 7f230a8c9640 1 --2- 172.21.15.164:0/3353609606 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f21f8036b90 0x7f21f8039050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f22fc057000 tx=0x7f22fc052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.378+0000 7f23138cb640 1 --2- 172.21.15.164:0/3353609606 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5567a4bdea60 0x5567a4cd82d0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.378+0000 7f23138cb640 1 -- 172.21.15.164:0/3353609606 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f230c00a4a0 con 0x5567a4bdea60 2024-09-13T23:05:34.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.378+0000 7f2317340800 1 -- 172.21.15.164:0/3353609606 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567a4cd58a0 con 0x5567a4bdea60 2024-09-13T23:05:34.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.378+0000 7f23138cb640 1 -- 172.21.15.164:0/3353609606 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f230c00a4a0 con 0x5567a4bdea60 2024-09-13T23:05:34.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.378+0000 7f2317340800 1 -- 172.21.15.164:0/3353609606 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567a4cda650 con 0x5567a4bdea60 2024-09-13T23:05:34.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.379+0000 7f23138cb640 1 -- 172.21.15.164:0/3353609606 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f230c00a4a0 con 0x5567a4bdea60 2024-09-13T23:05:34.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.379+0000 7f2317340800 1 -- 172.21.15.164:0/3353609606 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567a4cd9880 con 0x5567a4bdea60 2024-09-13T23:05:34.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.379+0000 7f23138cb640 1 -- 172.21.15.164:0/3353609606 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f230c00a4a0 con 0x5567a4bdea60 2024-09-13T23:05:34.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.379+0000 7f2317340800 1 -- 172.21.15.164:0/3353609606 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567a4cd9cd0 con 0x5567a4bdea60 2024-09-13T23:05:34.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.379+0000 7f23138cb640 1 -- 172.21.15.164:0/3353609606 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f230c00a4a0 con 0x5567a4bdea60 2024-09-13T23:05:34.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.379+0000 7f2317340800 1 Processor -- start 2024-09-13T23:05:34.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.380+0000 7f2317340800 1 -- start start 2024-09-13T23:05:34.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.380+0000 7f2317340800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4b50740 0x5567a4b4ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.380+0000 7f2317340800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5567a4a75580 con 0x5567a4b50740 2024-09-13T23:05:34.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.380+0000 7f230a8c9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4b50740 0x5567a4b4ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.380+0000 7f230a8c9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4b50740 0x5567a4b4ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57400/0 (socket says 172.21.15.164:57400) 2024-09-13T23:05:34.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.380+0000 7f230a8c9640 1 -- 172.21.15.164:0/1415847926 learned_addr learned my addr 172.21.15.164:0/1415847926 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:34.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.380+0000 7f230a8c9640 1 -- 172.21.15.164:0/1415847926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567a4b50b60 con 0x5567a4b50740 2024-09-13T23:05:34.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.380+0000 7f230a8c9640 1 --2- 172.21.15.164:0/1415847926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4b50740 0x5567a4b4ed90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f22fc045f50 tx=0x7f22fc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.380+0000 7f21fd602640 1 -- 172.21.15.164:0/1415847926 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22fc06f070 con 0x5567a4b50740 2024-09-13T23:05:34.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.381+0000 7f21fd602640 1 -- 172.21.15.164:0/1415847926 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22fc05f550 con 0x5567a4b50740 2024-09-13T23:05:34.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.381+0000 7f21fd602640 1 -- 172.21.15.164:0/1415847926 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22fc05f830 con 0x5567a4b50740 2024-09-13T23:05:34.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.381+0000 7f2317340800 1 -- 172.21.15.164:0/1415847926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5567a4b4f330 con 0x5567a4b50740 2024-09-13T23:05:34.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.381+0000 7f2317340800 1 -- 172.21.15.164:0/1415847926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567a4b4f7d0 con 0x5567a4b50740 2024-09-13T23:05:34.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.381+0000 7f21fd602640 1 -- 172.21.15.164:0/1415847926 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f22fc05f9d0 con 0x5567a4b50740 2024-09-13T23:05:34.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.381+0000 7f21fd602640 1 --2- 172.21.15.164:0/1415847926 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f21ec036b40 0x7f21ec039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.381+0000 7f21fd602640 1 -- 172.21.15.164:0/1415847926 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f22fc092da0 con 0x5567a4b50740 2024-09-13T23:05:34.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.382+0000 7f23138cb640 1 --2- 172.21.15.164:0/1415847926 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f21ec036b40 0x7f21ec039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.382+0000 7f2317340800 1 Processor -- start 2024-09-13T23:05:34.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.382+0000 7f2317340800 1 -- start start 2024-09-13T23:05:34.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.382+0000 7f23138cb640 1 --2- 172.21.15.164:0/1415847926 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f21ec036b40 0x7f21ec039000 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x5567a4cd93a0 tx=0x7f230c005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.382+0000 7f2317340800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4cf7a40 0x5567a4cf7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.382+0000 7f2317340800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5567a4cca010 con 0x5567a4cf7a40 2024-09-13T23:05:34.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.382+0000 7f230a8c9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4cf7a40 0x5567a4cf7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.382+0000 7f230a8c9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4cf7a40 0x5567a4cf7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57414/0 (socket says 172.21.15.164:57414) 2024-09-13T23:05:34.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.382+0000 7f230a8c9640 1 -- 172.21.15.164:0/1774465723 learned_addr learned my addr 172.21.15.164:0/1774465723 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:34.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.382+0000 7f230a8c9640 1 -- 172.21.15.164:0/1774465723 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567a4cf8410 con 0x5567a4cf7a40 2024-09-13T23:05:34.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.383+0000 7f230a8c9640 1 --2- 172.21.15.164:0/1774465723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4cf7a40 0x5567a4cf7e40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f22fc053f70 tx=0x7f22fc07ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d043d2b2686fa537 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.383+0000 7f21f6ffd640 1 -- 172.21.15.164:0/1774465723 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22fc080070 con 0x5567a4cf7a40 2024-09-13T23:05:34.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.383+0000 7f21f6ffd640 1 -- 172.21.15.164:0/1774465723 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22fc05fcc0 con 0x5567a4cf7a40 2024-09-13T23:05:34.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.383+0000 7f21f6ffd640 1 -- 172.21.15.164:0/1774465723 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22fc06a3a0 con 0x5567a4cf7a40 2024-09-13T23:05:34.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.383+0000 7f2317340800 1 -- 172.21.15.164:0/1774465723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4cf7a40 msgr2=0x5567a4cf7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.383+0000 7f2317340800 1 --2- 172.21.15.164:0/1774465723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4cf7a40 0x5567a4cf7e40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f22fc053f70 tx=0x7f22fc07ce80 comp rx=0 tx=0).stop 2024-09-13T23:05:34.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.383+0000 7f2317340800 1 -- 172.21.15.164:0/1774465723 shutdown_connections 2024-09-13T23:05:34.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.383+0000 7f2317340800 1 --2- 172.21.15.164:0/1774465723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4cf7a40 0x5567a4cf7e40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.383+0000 7f2317340800 1 -- 172.21.15.164:0/1774465723 >> 172.21.15.164:0/1774465723 conn(0x5567a4cf3da0 msgr2=0x5567a4cf1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:34.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.383+0000 7f2317340800 1 -- 172.21.15.164:0/1774465723 shutdown_connections 2024-09-13T23:05:34.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.383+0000 7f2317340800 1 -- 172.21.15.164:0/1774465723 wait complete. 2024-09-13T23:05:34.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.383+0000 7f2317340800 1 Processor -- start 2024-09-13T23:05:34.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.384+0000 7f2317340800 1 -- start start 2024-09-13T23:05:34.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.384+0000 7f2317340800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4cf7a40 0x5567a4cfef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.384+0000 7f2317340800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5567a4cf8a80 con 0x5567a4cf7a40 2024-09-13T23:05:34.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.384+0000 7f230a8c9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4cf7a40 0x5567a4cfef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.384+0000 7f230a8c9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4cf7a40 0x5567a4cfef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57422/0 (socket says 172.21.15.164:57422) 2024-09-13T23:05:34.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.384+0000 7f230a8c9640 1 -- 172.21.15.164:0/1756267223 learned_addr learned my addr 172.21.15.164:0/1756267223 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:34.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.384+0000 7f230a8c9640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567a4cff440 con 0x5567a4cf7a40 2024-09-13T23:05:34.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.384+0000 7f230a8c9640 1 --2- 172.21.15.164:0/1756267223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4cf7a40 0x5567a4cfef00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f22fc06afd0 tx=0x7f22fc091060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.384+0000 7f21f57fa640 1 -- 172.21.15.164:0/1756267223 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22fc06a720 con 0x5567a4cf7a40 2024-09-13T23:05:34.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.385+0000 7f21f57fa640 1 -- 172.21.15.164:0/1756267223 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22fc096070 con 0x5567a4cf7a40 2024-09-13T23:05:34.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.385+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5567a4cff6d0 con 0x5567a4cf7a40 2024-09-13T23:05:34.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.385+0000 7f21f57fa640 1 -- 172.21.15.164:0/1756267223 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22fc06a9f0 con 0x5567a4cf7a40 2024-09-13T23:05:34.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.385+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567a4d02380 con 0x5567a4cf7a40 2024-09-13T23:05:34.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.385+0000 7f21f57fa640 1 -- 172.21.15.164:0/1756267223 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f22fc098070 con 0x5567a4cf7a40 2024-09-13T23:05:34.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.385+0000 7f21f57fa640 1 --2- 172.21.15.164:0/1756267223 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f21dc036b40 0x7f21dc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.385+0000 7f21f57fa640 1 -- 172.21.15.164:0/1756267223 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f22fc086cb0 con 0x5567a4cf7a40 2024-09-13T23:05:34.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.386+0000 7f23138cb640 1 --2- 172.21.15.164:0/1756267223 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f21dc036b40 0x7f21dc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.386+0000 7f2317340800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.386+0000 7f2317340800 1 --2- 172.21.15.164:0/1756267223 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5567a4d0a990 0x5567a4d0ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.386+0000 7f23138cb640 1 --2- 172.21.15.164:0/1756267223 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f21dc036b40 0x7f21dc039000 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x5567a4cd57f0 tx=0x7f230c01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.386+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d0d5a0 con 0x5567a4d0a990 2024-09-13T23:05:34.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.386+0000 7f23130ca640 1 --2- 172.21.15.164:0/1756267223 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5567a4d0a990 0x5567a4d0ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.386+0000 7f23130ca640 1 --2- 172.21.15.164:0/1756267223 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5567a4d0a990 0x5567a4d0ce50 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.387+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2304018950 con 0x5567a4d0a990 2024-09-13T23:05:34.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.387+0000 7f2317340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.387+0000 7f2317340800 20 realm 2024-09-13T23:05:34.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.387+0000 7f2317340800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.387+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d0d9b0 con 0x5567a4d0a990 2024-09-13T23:05:34.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.387+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2304018950 con 0x5567a4d0a990 2024-09-13T23:05:34.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.387+0000 7f2317340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.387+0000 7f2317340800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:34.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.387+0000 7f2317340800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.387+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d0e280 con 0x5567a4d0a990 2024-09-13T23:05:34.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.387+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2304018950 con 0x5567a4d0a990 2024-09-13T23:05:34.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.387+0000 7f2317340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.387+0000 7f2317340800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.387+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d0e620 con 0x5567a4d0a990 2024-09-13T23:05:34.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.387+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2304018950 con 0x5567a4d0a990 2024-09-13T23:05:34.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.387+0000 7f2317340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:34.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.387+0000 7f2317340800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.387+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d0ea80 con 0x5567a4d0a990 2024-09-13T23:05:34.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.388+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2304018950 con 0x5567a4d0a990 2024-09-13T23:05:34.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.388+0000 7f2317340800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:34.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.388+0000 7f2317340800 20 searching for the correct realm 2024-09-13T23:05:34.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.388+0000 7f2317340800 1 --2- 172.21.15.164:0/1756267223 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5567a4d10ad0 0x5567a4d12ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.388+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x5567a4d10ad0 2024-09-13T23:05:34.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.388+0000 7f230a8c9640 1 --2- 172.21.15.164:0/1756267223 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5567a4d10ad0 0x5567a4d12ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.388+0000 7f230a8c9640 1 --2- 172.21.15.164:0/1756267223 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5567a4d10ad0 0x5567a4d12ec0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.388+0000 7f230a8c9640 1 -- 172.21.15.164:0/1756267223 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22fc082030 con 0x5567a4d10ad0 2024-09-13T23:05:34.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.388+0000 7f230a8c9640 1 --2- 172.21.15.164:0/1756267223 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f22fc085070 0x7f22fc0a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.388+0000 7f230a8c9640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x7f22fc085070 2024-09-13T23:05:34.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.388+0000 7f23138cb640 1 --2- 172.21.15.164:0/1756267223 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f22fc085070 0x7f22fc0a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.389+0000 7f23138cb640 1 --2- 172.21.15.164:0/1756267223 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f22fc085070 0x7f22fc0a3800 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.389+0000 7f23138cb640 1 -- 172.21.15.164:0/1756267223 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f230c01f070 con 0x7f22fc085070 2024-09-13T23:05:34.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.389+0000 7f23138cb640 1 --2- 172.21.15.164:0/1756267223 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f230c031040 0x7f230c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.389+0000 7f23138cb640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x7f230c031040 2024-09-13T23:05:34.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.389+0000 7f23130ca640 1 --2- 172.21.15.164:0/1756267223 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f230c031040 0x7f230c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.389+0000 7f23130ca640 1 --2- 172.21.15.164:0/1756267223 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f230c031040 0x7f230c032940 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.390+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2304018950 con 0x7f230c031040 2024-09-13T23:05:34.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.390+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x5567a4d0a990 2024-09-13T23:05:34.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.390+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2304018950 con 0x5567a4d0a990 2024-09-13T23:05:34.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.390+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x5567a4d0a990 2024-09-13T23:05:34.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.390+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2304018950 con 0x5567a4d0a990 2024-09-13T23:05:34.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.390+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x7f230c031040 2024-09-13T23:05:34.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.390+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2304018950 con 0x7f230c031040 2024-09-13T23:05:34.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.390+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x7f230c031040 2024-09-13T23:05:34.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.391+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2304018950 con 0x7f230c031040 2024-09-13T23:05:34.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.391+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x7f22fc085070 2024-09-13T23:05:34.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.391+0000 7f23138cb640 1 -- 172.21.15.164:0/1756267223 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f230c01f070 con 0x7f22fc085070 2024-09-13T23:05:34.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.391+0000 7f23138cb640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x5567a4d10ad0 2024-09-13T23:05:34.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.391+0000 7f230a8c9640 1 -- 172.21.15.164:0/1756267223 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22fc082030 con 0x5567a4d10ad0 2024-09-13T23:05:34.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.391+0000 7f230a8c9640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x5567a4d0a990 2024-09-13T23:05:34.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.391+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2304018950 con 0x5567a4d0a990 2024-09-13T23:05:34.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.391+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x7f230c031040 2024-09-13T23:05:34.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.392+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2304018950 con 0x7f230c031040 2024-09-13T23:05:34.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.392+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x5567a4d0a990 2024-09-13T23:05:34.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.392+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2304018950 con 0x5567a4d0a990 2024-09-13T23:05:34.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.392+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x7f22fc085070 2024-09-13T23:05:34.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.392+0000 7f23138cb640 1 -- 172.21.15.164:0/1756267223 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f230c01f070 con 0x7f22fc085070 2024-09-13T23:05:34.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.392+0000 7f23138cb640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x5567a4d10ad0 2024-09-13T23:05:34.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.392+0000 7f230a8c9640 1 -- 172.21.15.164:0/1756267223 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22fc082030 con 0x5567a4d10ad0 2024-09-13T23:05:34.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.392+0000 7f230a8c9640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x5567a4d10ad0 2024-09-13T23:05:34.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.392+0000 7f230a8c9640 1 -- 172.21.15.164:0/1756267223 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22fc082030 con 0x5567a4d10ad0 2024-09-13T23:05:34.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.392+0000 7f230a8c9640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x7f230c031040 2024-09-13T23:05:34.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.393+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2304018950 con 0x7f230c031040 2024-09-13T23:05:34.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.393+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x5567a4d10ad0 2024-09-13T23:05:34.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.393+0000 7f230a8c9640 1 -- 172.21.15.164:0/1756267223 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22fc082030 con 0x5567a4d10ad0 2024-09-13T23:05:34.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.393+0000 7f230a8c9640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x5567a4d10ad0 2024-09-13T23:05:34.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.393+0000 7f230a8c9640 1 -- 172.21.15.164:0/1756267223 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22fc082030 con 0x5567a4d10ad0 2024-09-13T23:05:34.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.393+0000 7f230a8c9640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x5567a4d0a990 2024-09-13T23:05:34.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.393+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2304018950 con 0x5567a4d0a990 2024-09-13T23:05:34.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.393+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x5567a4d0a990 2024-09-13T23:05:34.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.393+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2304018950 con 0x5567a4d0a990 2024-09-13T23:05:34.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.393+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x7f230c031040 2024-09-13T23:05:34.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.393+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2304018950 con 0x7f230c031040 2024-09-13T23:05:34.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.393+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x5567a4d10ad0 2024-09-13T23:05:34.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.393+0000 7f230a8c9640 1 -- 172.21.15.164:0/1756267223 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22fc082030 con 0x5567a4d10ad0 2024-09-13T23:05:34.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.393+0000 7f230a8c9640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x7f22fc085070 2024-09-13T23:05:34.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.393+0000 7f23138cb640 1 -- 172.21.15.164:0/1756267223 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f230c01f070 con 0x7f22fc085070 2024-09-13T23:05:34.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.393+0000 7f23138cb640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x5567a4d0a990 2024-09-13T23:05:34.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.394+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2304018950 con 0x5567a4d0a990 2024-09-13T23:05:34.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.394+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x7f230c031040 2024-09-13T23:05:34.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.394+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2304018950 con 0x7f230c031040 2024-09-13T23:05:34.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.394+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x5567a4d10ad0 2024-09-13T23:05:34.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.394+0000 7f230a8c9640 1 -- 172.21.15.164:0/1756267223 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22fc082030 con 0x5567a4d10ad0 2024-09-13T23:05:34.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.394+0000 7f230a8c9640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x7f230c031040 2024-09-13T23:05:34.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.394+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2304018950 con 0x7f230c031040 2024-09-13T23:05:34.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.395+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x7f22fc085070 2024-09-13T23:05:34.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.395+0000 7f23138cb640 1 -- 172.21.15.164:0/1756267223 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f230c01f070 con 0x7f22fc085070 2024-09-13T23:05:34.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.395+0000 7f23138cb640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x5567a4d10ad0 2024-09-13T23:05:34.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.395+0000 7f230a8c9640 1 -- 172.21.15.164:0/1756267223 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22fc082030 con 0x5567a4d10ad0 2024-09-13T23:05:34.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.395+0000 7f230a8c9640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x7f230c031040 2024-09-13T23:05:34.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.395+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2304018950 con 0x7f230c031040 2024-09-13T23:05:34.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.395+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x5567a4d0a990 2024-09-13T23:05:34.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.395+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2304018950 con 0x5567a4d0a990 2024-09-13T23:05:34.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.396+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d13570 con 0x7f22fc085070 2024-09-13T23:05:34.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.396+0000 7f23138cb640 1 -- 172.21.15.164:0/1756267223 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f230c01f070 con 0x7f22fc085070 2024-09-13T23:05:34.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.396+0000 7f2317340800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:34.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.396+0000 7f2317340800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:34.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.396+0000 7f2317340800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:34.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.396+0000 7f2317340800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:34.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.396+0000 7f2317340800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:34.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.396+0000 7f2317340800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:34.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.396+0000 7f2317340800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.396+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d0f520 con 0x5567a4d0a990 2024-09-13T23:05:34.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.396+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2304018950 con 0x5567a4d0a990 2024-09-13T23:05:34.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.396+0000 7f2317340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.396+0000 7f2317340800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.396+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d0fdc0 con 0x5567a4d0a990 2024-09-13T23:05:34.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.396+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2304018950 con 0x5567a4d0a990 2024-09-13T23:05:34.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.396+0000 7f2317340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:34.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.396+0000 7f2317340800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.396+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d0f160 con 0x5567a4d0a990 2024-09-13T23:05:34.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.397+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2304018950 con 0x5567a4d0a990 2024-09-13T23:05:34.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.397+0000 7f2317340800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:34.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.397+0000 7f2317340800 20 zone default found 2024-09-13T23:05:34.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.397+0000 7f2317340800 4 Realm: () 2024-09-13T23:05:34.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.397+0000 7f2317340800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:34.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.397+0000 7f2317340800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:34.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.397+0000 7f2317340800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:34.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.397+0000 7f2317340800 20 zonegroup default 2024-09-13T23:05:34.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.397+0000 7f2317340800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.397+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d139d0 con 0x7f230c031040 2024-09-13T23:05:34.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.397+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2304018950 con 0x7f230c031040 2024-09-13T23:05:34.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.397+0000 7f2317340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.397+0000 7f2317340800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.397+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d15860 con 0x5567a4d10ad0 2024-09-13T23:05:34.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.397+0000 7f230a8c9640 1 -- 172.21.15.164:0/1756267223 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f22fc082030 con 0x5567a4d10ad0 2024-09-13T23:05:34.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.397+0000 7f2317340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.397+0000 7f2317340800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.397+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d15c00 con 0x5567a4d10ad0 2024-09-13T23:05:34.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.397+0000 7f230a8c9640 1 -- 172.21.15.164:0/1756267223 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f22fc082030 con 0x5567a4d10ad0 2024-09-13T23:05:34.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.397+0000 7f2317340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.397+0000 7f2317340800 20 started sync module instance, tier type = 2024-09-13T23:05:34.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.397+0000 7f2317340800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:34.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.397+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d14ca0 con 0x7f22fc085070 2024-09-13T23:05:34.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.398+0000 7f23138cb640 1 -- 172.21.15.164:0/1756267223 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f230c040040 con 0x7f22fc085070 2024-09-13T23:05:34.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.398+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93903635173568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d14900 con 0x7f22fc085070 2024-09-13T23:05:34.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.398+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d16a70 con 0x5567a4d0a990 2024-09-13T23:05:34.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.399+0000 7f23138cb640 1 -- 172.21.15.164:0/1756267223 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93903635173568] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f230c040040 con 0x7f22fc085070 2024-09-13T23:05:34.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.399+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2304018950 con 0x5567a4d0a990 2024-09-13T23:05:34.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.399+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93903635177376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d16a70 con 0x5567a4d0a990 2024-09-13T23:05:34.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.400+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d17470 con 0x5567a4d10ad0 2024-09-13T23:05:34.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.401+0000 7f230a8c9640 1 -- 172.21.15.164:0/1756267223 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22fc082030 con 0x5567a4d10ad0 2024-09-13T23:05:34.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.401+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93903635181440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d17d10 con 0x5567a4d10ad0 2024-09-13T23:05:34.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.401+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d18760 con 0x7f22fc085070 2024-09-13T23:05:34.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.401+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93903635177376] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2304018950 con 0x5567a4d0a990 2024-09-13T23:05:34.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.401+0000 7f230a8c9640 1 -- 172.21.15.164:0/1756267223 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93903635181440] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22fc082030 con 0x5567a4d10ad0 2024-09-13T23:05:34.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.402+0000 7f23138cb640 1 -- 172.21.15.164:0/1756267223 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f230c040040 con 0x7f22fc085070 2024-09-13T23:05:34.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.402+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93903635183712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d165c0 con 0x7f22fc085070 2024-09-13T23:05:34.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.402+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d19030 con 0x5567a4d0a990 2024-09-13T23:05:34.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.403+0000 7f23138cb640 1 -- 172.21.15.164:0/1756267223 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93903635183712] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f230c040040 con 0x7f22fc085070 2024-09-13T23:05:34.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.403+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2304018950 con 0x5567a4d0a990 2024-09-13T23:05:34.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.403+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93903635186256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d19030 con 0x5567a4d0a990 2024-09-13T23:05:34.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.403+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d19a80 con 0x7f230c031040 2024-09-13T23:05:34.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.404+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93903635186256] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2304018950 con 0x5567a4d0a990 2024-09-13T23:05:34.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.404+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2304018950 con 0x7f230c031040 2024-09-13T23:05:34.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.404+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93903635191184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d19030 con 0x7f230c031040 2024-09-13T23:05:34.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.404+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d1a4c0 con 0x7f230c031040 2024-09-13T23:05:34.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.405+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93903635191184] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2304018950 con 0x7f230c031040 2024-09-13T23:05:34.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.405+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2304018950 con 0x7f230c031040 2024-09-13T23:05:34.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.406+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93903635188880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d1a4c0 con 0x7f230c031040 2024-09-13T23:05:34.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.406+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d1ae80 con 0x7f230c031040 2024-09-13T23:05:34.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.406+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2304018950 con 0x7f230c031040 2024-09-13T23:05:34.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.407+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93903635188880] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2304018950 con 0x7f230c031040 2024-09-13T23:05:34.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.407+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93903635196368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d1b2e0 con 0x7f230c031040 2024-09-13T23:05:34.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.407+0000 7f2317340800 20 add_watcher() i=0 2024-09-13T23:05:34.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.407+0000 7f2317340800 20 add_watcher() i=1 2024-09-13T23:05:34.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.407+0000 7f2317340800 20 add_watcher() i=2 2024-09-13T23:05:34.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.407+0000 7f2317340800 20 add_watcher() i=3 2024-09-13T23:05:34.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.407+0000 7f2317340800 20 add_watcher() i=4 2024-09-13T23:05:34.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.407+0000 7f2317340800 20 add_watcher() i=5 2024-09-13T23:05:34.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.407+0000 7f2317340800 20 add_watcher() i=6 2024-09-13T23:05:34.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.407+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93903635196368] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2304018950 con 0x7f230c031040 2024-09-13T23:05:34.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.407+0000 7f2317340800 20 add_watcher() i=7 2024-09-13T23:05:34.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.407+0000 7f2317340800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:34.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.407+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d1b2e0 con 0x5567a4d0a990 2024-09-13T23:05:34.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.408+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2304018950 con 0x5567a4d0a990 2024-09-13T23:05:34.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.408+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93903635197424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d1b2e0 con 0x5567a4d0a990 2024-09-13T23:05:34.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.409+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93903635197424] v32'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2304018950 con 0x5567a4d0a990 2024-09-13T23:05:34.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.409+0000 7f21c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:34.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.409+0000 7f2317340800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:34.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.409+0000 7f2317340800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:34.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.409+0000 7f2317340800 5 note: GC not initialized 2024-09-13T23:05:34.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.409+0000 7f21c8fe1640 20 reqs_thread_entry: start 2024-09-13T23:05:34.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.409+0000 7f2317340800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:34.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.409+0000 7f2317340800 20 Filter name: none 2024-09-13T23:05:34.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.409+0000 7f21427fc640 20 reqs_thread_entry: start 2024-09-13T23:05:34.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.410+0000 7f2317340800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.410+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d512c0 con 0x5567a4d0a990 2024-09-13T23:05:34.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.410+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2304018950 con 0x5567a4d0a990 2024-09-13T23:05:34.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.410+0000 7f2317340800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:05:34.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.410+0000 7f2317340800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.410+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d51cb0 con 0x5567a4d0a990 2024-09-13T23:05:34.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.410+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2304018950 con 0x5567a4d0a990 2024-09-13T23:05:34.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.410+0000 7f2317340800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:05:34.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.410+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d52cc0 con 0x7f22fc085070 2024-09-13T23:05:34.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.411+0000 7f23138cb640 1 -- 172.21.15.164:0/1756267223 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f230c040040 con 0x7f22fc085070 2024-09-13T23:05:34.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.411+0000 7f21c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:34.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.411+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93903635197424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d4f070 con 0x5567a4d0a990 2024-09-13T23:05:34.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.412+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93903635197424] v32'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2304018950 con 0x5567a4d0a990 2024-09-13T23:05:34.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.412+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93903635173568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d4f070 con 0x7f22fc085070 2024-09-13T23:05:34.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.413+0000 7f23138cb640 1 -- 172.21.15.164:0/1756267223 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93903635173568] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f230c040040 con 0x7f22fc085070 2024-09-13T23:05:34.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.413+0000 7f2317340800 20 remove_watcher() i=0 2024-09-13T23:05:34.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.413+0000 7f2317340800 2 removed watcher, disabling cache 2024-09-13T23:05:34.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.413+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93903635177376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d4f070 con 0x5567a4d0a990 2024-09-13T23:05:34.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.414+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93903635177376] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2304018950 con 0x5567a4d0a990 2024-09-13T23:05:34.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.415+0000 7f2317340800 20 remove_watcher() i=1 2024-09-13T23:05:34.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.415+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93903635181440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d4f070 con 0x5567a4d10ad0 2024-09-13T23:05:34.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.415+0000 7f230a8c9640 1 -- 172.21.15.164:0/1756267223 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93903635181440] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22fc082030 con 0x5567a4d10ad0 2024-09-13T23:05:34.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.415+0000 7f2317340800 20 remove_watcher() i=2 2024-09-13T23:05:34.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.415+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93903635183712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d15fa0 con 0x7f22fc085070 2024-09-13T23:05:34.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.416+0000 7f23138cb640 1 -- 172.21.15.164:0/1756267223 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93903635183712] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f230c040040 con 0x7f22fc085070 2024-09-13T23:05:34.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.416+0000 7f2317340800 20 remove_watcher() i=3 2024-09-13T23:05:34.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.416+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93903635186256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d17860 con 0x5567a4d0a990 2024-09-13T23:05:34.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.417+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93903635186256] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2304018950 con 0x5567a4d0a990 2024-09-13T23:05:34.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.417+0000 7f2317340800 20 remove_watcher() i=4 2024-09-13T23:05:34.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.417+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93903635191184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d18250 con 0x7f230c031040 2024-09-13T23:05:34.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.418+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93903635191184] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2304018950 con 0x7f230c031040 2024-09-13T23:05:34.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.418+0000 7f2317340800 20 remove_watcher() i=5 2024-09-13T23:05:34.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.418+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93903635188880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d19590 con 0x7f230c031040 2024-09-13T23:05:34.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.419+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93903635188880] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2304018950 con 0x7f230c031040 2024-09-13T23:05:34.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.419+0000 7f2317340800 20 remove_watcher() i=6 2024-09-13T23:05:34.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.419+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93903635196368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567a4d18c90 con 0x7f230c031040 2024-09-13T23:05:34.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93903635196368] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2304018950 con 0x7f230c031040 2024-09-13T23:05:34.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f2317340800 20 remove_watcher() i=7 2024-09-13T23:05:34.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f230c031040 msgr2=0x7f230c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f2317340800 1 --2- 172.21.15.164:0/1756267223 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f230c031040 0x7f230c032940 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5567a4d0a990 msgr2=0x5567a4d0ce50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f2317340800 1 --2- 172.21.15.164:0/1756267223 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5567a4d0a990 0x5567a4d0ce50 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f22fc085070 msgr2=0x7f22fc0a3800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f2317340800 1 --2- 172.21.15.164:0/1756267223 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f22fc085070 0x7f22fc0a3800 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5567a4d10ad0 msgr2=0x5567a4d12ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f2317340800 1 --2- 172.21.15.164:0/1756267223 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5567a4d10ad0 0x5567a4d12ec0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f21dc036b40 msgr2=0x7f21dc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f2317340800 1 --2- 172.21.15.164:0/1756267223 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f21dc036b40 0x7f21dc039000 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x5567a4cd57f0 tx=0x7f230c01f000 comp rx=0 tx=0).stop 2024-09-13T23:05:34.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4cf7a40 msgr2=0x5567a4cfef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f2317340800 1 --2- 172.21.15.164:0/1756267223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4cf7a40 0x5567a4cfef00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f22fc06afd0 tx=0x7f22fc091060 comp rx=0 tx=0).stop 2024-09-13T23:05:34.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 reap_dead start 2024-09-13T23:05:34.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f23130ca640 1 -- 172.21.15.164:0/1756267223 reap_dead start 2024-09-13T23:05:34.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 shutdown_connections 2024-09-13T23:05:34.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 >> 172.21.15.164:0/1756267223 conn(0x5567a4cf3da0 msgr2=0x5567a4cf1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:34.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 shutdown_connections 2024-09-13T23:05:34.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f2317340800 1 -- 172.21.15.164:0/1756267223 wait complete. 2024-09-13T23:05:34.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f2317340800 1 -- 172.21.15.164:0/1415847926 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f21ec036b40 msgr2=0x7f21ec039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f2317340800 1 --2- 172.21.15.164:0/1415847926 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f21ec036b40 0x7f21ec039000 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x5567a4cd93a0 tx=0x7f230c005840 comp rx=0 tx=0).stop 2024-09-13T23:05:34.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f2317340800 1 -- 172.21.15.164:0/1415847926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4b50740 msgr2=0x5567a4b4ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f2317340800 1 --2- 172.21.15.164:0/1415847926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4b50740 0x5567a4b4ed90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f22fc045f50 tx=0x7f22fc002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f2317340800 1 -- 172.21.15.164:0/1415847926 shutdown_connections 2024-09-13T23:05:34.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f2317340800 1 --2- 172.21.15.164:0/1415847926 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f21ec036b40 0x7f21ec039000 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f2317340800 1 --2- 172.21.15.164:0/1415847926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4b50740 0x5567a4b4ed90 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f2317340800 1 -- 172.21.15.164:0/1415847926 >> 172.21.15.164:0/1415847926 conn(0x5567a4cddbf0 msgr2=0x5567a4ce0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:34.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f2317340800 1 -- 172.21.15.164:0/1415847926 shutdown_connections 2024-09-13T23:05:34.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.421+0000 7f2317340800 1 -- 172.21.15.164:0/1415847926 wait complete. 2024-09-13T23:05:34.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.422+0000 7f2317340800 1 -- 172.21.15.164:0/3353609606 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5567a4bdea60 msgr2=0x5567a4cd82d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.422+0000 7f2317340800 1 --2- 172.21.15.164:0/3353609606 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5567a4bdea60 0x5567a4cd82d0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.422+0000 7f2317340800 1 -- 172.21.15.164:0/3353609606 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f21f8036b90 msgr2=0x7f21f8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.422+0000 7f2317340800 1 --2- 172.21.15.164:0/3353609606 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f21f8036b90 0x7f21f8039050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f22fc057000 tx=0x7f22fc052000 comp rx=0 tx=0).stop 2024-09-13T23:05:34.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.422+0000 7f2317340800 1 -- 172.21.15.164:0/3353609606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4bda760 msgr2=0x5567a4cd1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.422+0000 7f2317340800 1 --2- 172.21.15.164:0/3353609606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4bda760 0x5567a4cd1260 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f230400b7c0 tx=0x7f2304000ed0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.422+0000 7f2317340800 1 -- 172.21.15.164:0/3353609606 shutdown_connections 2024-09-13T23:05:34.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.422+0000 7f2317340800 1 --2- 172.21.15.164:0/3353609606 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5567a4bdea60 0x5567a4cd82d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.422+0000 7f2317340800 1 --2- 172.21.15.164:0/3353609606 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f21f8036b90 0x7f21f8039050 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.422+0000 7f2317340800 1 --2- 172.21.15.164:0/3353609606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567a4bda760 0x5567a4cd1260 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.422+0000 7f2317340800 1 -- 172.21.15.164:0/3353609606 >> 172.21.15.164:0/3353609606 conn(0x5567a4bd5ff0 msgr2=0x5567a4cc3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:34.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.422+0000 7f2317340800 1 -- 172.21.15.164:0/3353609606 shutdown_connections 2024-09-13T23:05:34.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.422+0000 7f2317340800 1 -- 172.21.15.164:0/3353609606 wait complete. 2024-09-13T23:05:34.438 INFO:teuthology.orchestra.run.smithi164.stdout:["myfoo"] 2024-09-13T23:05:34.439 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-13T23:05:34.512 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:05:34.513 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-13T23:05:34.513 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-13T23:05:34.513 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-13T23:05:34.556 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:34.556 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:34.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.555+0000 7f995ec11800 1 Processor -- start 2024-09-13T23:05:34.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.555+0000 7f995ec11800 1 -- start start 2024-09-13T23:05:34.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.555+0000 7f995ec11800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55da78d5e540 0x55da78d5e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.555+0000 7f995ec11800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55da78c1eb30 con 0x55da78d5ee80 2024-09-13T23:05:34.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.555+0000 7f995ec11800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55da78c00360 con 0x55da78d5e540 2024-09-13T23:05:34.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.556+0000 7f995a267640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55da78d5e540 0x55da78d5e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.556+0000 7f9959a66640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55da78d5ee80 0x55da78d63a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40902/0 (socket says 172.21.15.164:40902) 2024-09-13T23:05:34.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.556+0000 7f9959a66640 1 -- 172.21.15.164:0/2769958551 learned_addr learned my addr 172.21.15.164:0/2769958551 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:34.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.556+0000 7f995a267640 1 -- 172.21.15.164:0/2769958551 >> v1:172.21.15.17:6789/0 conn(0x55da78d5ee80 legacy=0x55da78d63a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.556+0000 7f995a267640 1 -- 172.21.15.164:0/2769958551 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da78c26e00 con 0x55da78d5e540 2024-09-13T23:05:34.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.558+0000 7f995a267640 1 --2- 172.21.15.164:0/2769958551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78d5e540 0x55da78d5e940 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f994c00a470 tx=0x7f994c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7219bdf927a91242 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.558+0000 7f9959265640 1 -- 172.21.15.164:0/2769958551 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f994c053570 con 0x55da78d5e540 2024-09-13T23:05:34.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.558+0000 7f9959265640 1 -- 172.21.15.164:0/2769958551 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f994c058070 con 0x55da78d5e540 2024-09-13T23:05:34.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.558+0000 7f9959265640 1 -- 172.21.15.164:0/2769958551 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f994c053880 con 0x55da78d5e540 2024-09-13T23:05:34.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.558+0000 7f995ec11800 1 -- 172.21.15.164:0/2769958551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78d5e540 msgr2=0x55da78d5e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.558+0000 7f995ec11800 1 --2- 172.21.15.164:0/2769958551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78d5e540 0x55da78d5e940 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f994c00a470 tx=0x7f994c045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:34.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.558+0000 7f995ec11800 1 -- 172.21.15.164:0/2769958551 shutdown_connections 2024-09-13T23:05:34.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.558+0000 7f995ec11800 1 --2- 172.21.15.164:0/2769958551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78d5e540 0x55da78d5e940 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.558+0000 7f995ec11800 1 -- 172.21.15.164:0/2769958551 >> 172.21.15.164:0/2769958551 conn(0x55da78d59dd0 msgr2=0x55da78d5c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:34.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.558+0000 7f995ec11800 1 -- 172.21.15.164:0/2769958551 shutdown_connections 2024-09-13T23:05:34.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.558+0000 7f995ec11800 1 -- 172.21.15.164:0/2769958551 wait complete. 2024-09-13T23:05:34.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.572+0000 7f995ec11800 1 Processor -- start 2024-09-13T23:05:34.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.573+0000 7f995ec11800 1 -- start start 2024-09-13T23:05:34.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.573+0000 7f995ec11800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78d5e540 0x55da78cd3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.573+0000 7f995ec11800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55da78cab320 con 0x55da78d5e540 2024-09-13T23:05:34.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.573+0000 7f995a267640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78d5e540 0x55da78cd3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.573+0000 7f995a267640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78d5e540 0x55da78cd3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57448/0 (socket says 172.21.15.164:57448) 2024-09-13T23:05:34.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.573+0000 7f995a267640 1 -- 172.21.15.164:0/2648093416 learned_addr learned my addr 172.21.15.164:0/2648093416 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:34.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.573+0000 7f995a267640 1 -- 172.21.15.164:0/2648093416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da78bf8bc0 con 0x55da78d5e540 2024-09-13T23:05:34.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.573+0000 7f995a267640 1 --2- 172.21.15.164:0/2648093416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78d5e540 0x55da78cd3590 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f994c025c20 tx=0x7f994c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a74d9e0717b96b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.574+0000 7f9848608640 1 -- 172.21.15.164:0/2648093416 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f994c053ba0 con 0x55da78d5e540 2024-09-13T23:05:34.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.574+0000 7f9848608640 1 -- 172.21.15.164:0/2648093416 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f994c063030 con 0x55da78d5e540 2024-09-13T23:05:34.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.574+0000 7f9848608640 1 -- 172.21.15.164:0/2648093416 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f994c053440 con 0x55da78d5e540 2024-09-13T23:05:34.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.574+0000 7f995ec11800 1 -- 172.21.15.164:0/2648093416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78d5e540 msgr2=0x55da78cd3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.574+0000 7f995ec11800 1 --2- 172.21.15.164:0/2648093416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78d5e540 0x55da78cd3590 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f994c025c20 tx=0x7f994c051000 comp rx=0 tx=0).stop 2024-09-13T23:05:34.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.574+0000 7f995ec11800 1 -- 172.21.15.164:0/2648093416 shutdown_connections 2024-09-13T23:05:34.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.574+0000 7f995ec11800 1 --2- 172.21.15.164:0/2648093416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78d5e540 0x55da78cd3590 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.574+0000 7f995ec11800 1 -- 172.21.15.164:0/2648093416 >> 172.21.15.164:0/2648093416 conn(0x55da78d59dd0 msgr2=0x55da78e490f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:34.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.574+0000 7f995ec11800 1 -- 172.21.15.164:0/2648093416 shutdown_connections 2024-09-13T23:05:34.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.574+0000 7f995ec11800 1 -- 172.21.15.164:0/2648093416 wait complete. 2024-09-13T23:05:34.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.575+0000 7f995ec11800 1 Processor -- start 2024-09-13T23:05:34.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.575+0000 7f995ec11800 1 -- start start 2024-09-13T23:05:34.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.575+0000 7f995ec11800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78d5e540 0x55da78e561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.575+0000 7f995ec11800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55da78d65560 con 0x55da78d5e540 2024-09-13T23:05:34.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.575+0000 7f995a267640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78d5e540 0x55da78e561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.575+0000 7f995a267640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78d5e540 0x55da78e561b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57460/0 (socket says 172.21.15.164:57460) 2024-09-13T23:05:34.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.575+0000 7f995a267640 1 -- 172.21.15.164:0/1509925163 learned_addr learned my addr 172.21.15.164:0/1509925163 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:34.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.576+0000 7f995a267640 1 -- 172.21.15.164:0/1509925163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da78c0cfe0 con 0x55da78d5e540 2024-09-13T23:05:34.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.576+0000 7f995a267640 1 --2- 172.21.15.164:0/1509925163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78d5e540 0x55da78e561b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x55da78cd2c90 tx=0x7f994c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.576+0000 7f9846e05640 1 -- 172.21.15.164:0/1509925163 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f994c078070 con 0x55da78d5e540 2024-09-13T23:05:34.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.576+0000 7f9846e05640 1 -- 172.21.15.164:0/1509925163 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f994c053570 con 0x55da78d5e540 2024-09-13T23:05:34.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.576+0000 7f995ec11800 1 -- 172.21.15.164:0/1509925163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da78e566f0 con 0x55da78d5e540 2024-09-13T23:05:34.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.576+0000 7f9846e05640 1 -- 172.21.15.164:0/1509925163 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f994c053850 con 0x55da78d5e540 2024-09-13T23:05:34.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.576+0000 7f995ec11800 1 -- 172.21.15.164:0/1509925163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da78e56c70 con 0x55da78d5e540 2024-09-13T23:05:34.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.577+0000 7f9846e05640 1 -- 172.21.15.164:0/1509925163 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f994c07b070 con 0x55da78d5e540 2024-09-13T23:05:34.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.577+0000 7f9846e05640 1 --2- 172.21.15.164:0/1509925163 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9840036b40 0x7f9840039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.577+0000 7f9846e05640 1 -- 172.21.15.164:0/1509925163 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f994c070070 con 0x55da78d5e540 2024-09-13T23:05:34.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.577+0000 7f9959a66640 1 --2- 172.21.15.164:0/1509925163 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9840036b40 0x7f9840039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.577+0000 7f995ec11800 1 --2- 172.21.15.164:0/1509925163 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55da78d5ee80 0x55da78e5d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.577+0000 7f995ec11800 1 -- 172.21.15.164:0/1509925163 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da78e5d840 con 0x55da78d5ee80 2024-09-13T23:05:34.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.577+0000 7f995aa68640 1 --2- 172.21.15.164:0/1509925163 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55da78d5ee80 0x55da78e5d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.577+0000 7f9959a66640 1 --2- 172.21.15.164:0/1509925163 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9840036b40 0x7f9840039000 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9950001d90 tx=0x7f99500012f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.578+0000 7f995aa68640 1 --2- 172.21.15.164:0/1509925163 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55da78d5ee80 0x55da78e5d220 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.578+0000 7f995aa68640 1 -- 172.21.15.164:0/1509925163 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f995400a4a0 con 0x55da78d5ee80 2024-09-13T23:05:34.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.578+0000 7f995ec11800 1 -- 172.21.15.164:0/1509925163 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da78e5a7d0 con 0x55da78d5ee80 2024-09-13T23:05:34.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.578+0000 7f995aa68640 1 -- 172.21.15.164:0/1509925163 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f995400a4a0 con 0x55da78d5ee80 2024-09-13T23:05:34.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.578+0000 7f995ec11800 1 -- 172.21.15.164:0/1509925163 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da78e5f6b0 con 0x55da78d5ee80 2024-09-13T23:05:34.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.578+0000 7f995aa68640 1 -- 172.21.15.164:0/1509925163 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f995400a4a0 con 0x55da78d5ee80 2024-09-13T23:05:34.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.578+0000 7f995ec11800 1 -- 172.21.15.164:0/1509925163 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da78e5e790 con 0x55da78d5ee80 2024-09-13T23:05:34.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.579+0000 7f995aa68640 1 -- 172.21.15.164:0/1509925163 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f995400a4a0 con 0x55da78d5ee80 2024-09-13T23:05:34.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.579+0000 7f995ec11800 1 -- 172.21.15.164:0/1509925163 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da78e5ebe0 con 0x55da78d5ee80 2024-09-13T23:05:34.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.579+0000 7f995aa68640 1 -- 172.21.15.164:0/1509925163 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f995400a4a0 con 0x55da78d5ee80 2024-09-13T23:05:34.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.579+0000 7f995ec11800 1 Processor -- start 2024-09-13T23:05:34.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.579+0000 7f995ec11800 1 -- start start 2024-09-13T23:05:34.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.579+0000 7f995ec11800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78e4ef10 0x55da78e4d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.580+0000 7f995ec11800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55da78bfa580 con 0x55da78e4ef10 2024-09-13T23:05:34.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.580+0000 7f9959a66640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78e4ef10 0x55da78e4d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.580+0000 7f9959a66640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78e4ef10 0x55da78e4d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57466/0 (socket says 172.21.15.164:57466) 2024-09-13T23:05:34.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.580+0000 7f9959a66640 1 -- 172.21.15.164:0/1648821675 learned_addr learned my addr 172.21.15.164:0/1648821675 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:34.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.580+0000 7f9959a66640 1 -- 172.21.15.164:0/1648821675 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da78e4f330 con 0x55da78e4ef10 2024-09-13T23:05:34.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.580+0000 7f9959a66640 1 --2- 172.21.15.164:0/1648821675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78e4ef10 0x55da78e4d560 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f995000efd0 tx=0x7f995000d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.580+0000 7f983ffff640 1 -- 172.21.15.164:0/1648821675 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f995001b550 con 0x55da78e4ef10 2024-09-13T23:05:34.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.580+0000 7f983ffff640 1 -- 172.21.15.164:0/1648821675 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f995001b6f0 con 0x55da78e4ef10 2024-09-13T23:05:34.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.580+0000 7f983ffff640 1 -- 172.21.15.164:0/1648821675 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f995001b9f0 con 0x55da78e4ef10 2024-09-13T23:05:34.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.580+0000 7f995ec11800 1 -- 172.21.15.164:0/1648821675 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da78e4db60 con 0x55da78e4ef10 2024-09-13T23:05:34.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.580+0000 7f995ec11800 1 -- 172.21.15.164:0/1648821675 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da78e4e060 con 0x55da78e4ef10 2024-09-13T23:05:34.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.581+0000 7f983ffff640 1 -- 172.21.15.164:0/1648821675 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9950023020 con 0x55da78e4ef10 2024-09-13T23:05:34.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.581+0000 7f983ffff640 1 --2- 172.21.15.164:0/1648821675 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9834036b90 0x7f9834039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.581+0000 7f983ffff640 1 -- 172.21.15.164:0/1648821675 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9950021020 con 0x55da78e4ef10 2024-09-13T23:05:34.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.581+0000 7f995aa68640 1 --2- 172.21.15.164:0/1648821675 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9834036b90 0x7f9834039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.582+0000 7f995ec11800 1 Processor -- start 2024-09-13T23:05:34.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.582+0000 7f995aa68640 1 --2- 172.21.15.164:0/1648821675 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9834036b90 0x7f9834039050 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55da78e5e2b0 tx=0x7f9954005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.582+0000 7f995ec11800 1 -- start start 2024-09-13T23:05:34.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.582+0000 7f995ec11800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78e7cba0 0x55da78e7cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.582+0000 7f995ec11800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55da78e516b0 con 0x55da78e7cba0 2024-09-13T23:05:34.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.582+0000 7f9959a66640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78e7cba0 0x55da78e7cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.582+0000 7f9959a66640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78e7cba0 0x55da78e7cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57474/0 (socket says 172.21.15.164:57474) 2024-09-13T23:05:34.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.582+0000 7f9959a66640 1 -- 172.21.15.164:0/3583872805 learned_addr learned my addr 172.21.15.164:0/3583872805 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:34.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.582+0000 7f9959a66640 1 -- 172.21.15.164:0/3583872805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da78e7d570 con 0x55da78e7cba0 2024-09-13T23:05:34.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.583+0000 7f9959a66640 1 --2- 172.21.15.164:0/3583872805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78e7cba0 0x55da78e7cfa0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9950024b00 tx=0x7f9950024c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6babfe1da2c243b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.583+0000 7f983dffb640 1 -- 172.21.15.164:0/3583872805 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9950025410 con 0x55da78e7cba0 2024-09-13T23:05:34.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.583+0000 7f983dffb640 1 -- 172.21.15.164:0/3583872805 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9950046070 con 0x55da78e7cba0 2024-09-13T23:05:34.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.583+0000 7f983dffb640 1 -- 172.21.15.164:0/3583872805 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9950019320 con 0x55da78e7cba0 2024-09-13T23:05:34.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.583+0000 7f995ec11800 1 -- 172.21.15.164:0/3583872805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78e7cba0 msgr2=0x55da78e7cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.583+0000 7f995ec11800 1 --2- 172.21.15.164:0/3583872805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78e7cba0 0x55da78e7cfa0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9950024b00 tx=0x7f9950024c20 comp rx=0 tx=0).stop 2024-09-13T23:05:34.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.583+0000 7f995ec11800 1 -- 172.21.15.164:0/3583872805 shutdown_connections 2024-09-13T23:05:34.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.583+0000 7f995ec11800 1 --2- 172.21.15.164:0/3583872805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78e7cba0 0x55da78e7cfa0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.583+0000 7f995ec11800 1 -- 172.21.15.164:0/3583872805 >> 172.21.15.164:0/3583872805 conn(0x55da78e78f00 msgr2=0x55da78e77000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:34.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.583+0000 7f995ec11800 1 -- 172.21.15.164:0/3583872805 shutdown_connections 2024-09-13T23:05:34.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.583+0000 7f995ec11800 1 -- 172.21.15.164:0/3583872805 wait complete. 2024-09-13T23:05:34.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.584+0000 7f995ec11800 1 Processor -- start 2024-09-13T23:05:34.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.584+0000 7f995ec11800 1 -- start start 2024-09-13T23:05:34.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.584+0000 7f995ec11800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78e7cba0 0x55da78e840a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.584+0000 7f995ec11800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55da78e7dbe0 con 0x55da78e7cba0 2024-09-13T23:05:34.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.584+0000 7f9959a66640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78e7cba0 0x55da78e840a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.584+0000 7f9959a66640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78e7cba0 0x55da78e840a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57476/0 (socket says 172.21.15.164:57476) 2024-09-13T23:05:34.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.584+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 learned_addr learned my addr 172.21.15.164:0/2039181712 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:34.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.584+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da78e845e0 con 0x55da78e7cba0 2024-09-13T23:05:34.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.584+0000 7f9959a66640 1 --2- 172.21.15.164:0/2039181712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78e7cba0 0x55da78e840a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f995004bfc0 tx=0x7f995004d030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.585+0000 7f982bfff640 1 -- 172.21.15.164:0/2039181712 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9950024370 con 0x55da78e7cba0 2024-09-13T23:05:34.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.585+0000 7f982bfff640 1 -- 172.21.15.164:0/2039181712 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9950024510 con 0x55da78e7cba0 2024-09-13T23:05:34.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.585+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da78e84870 con 0x55da78e7cba0 2024-09-13T23:05:34.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.585+0000 7f982bfff640 1 -- 172.21.15.164:0/2039181712 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9950040930 con 0x55da78e7cba0 2024-09-13T23:05:34.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.585+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da78e84870 con 0x55da78e7cba0 2024-09-13T23:05:34.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.585+0000 7f982bfff640 1 -- 172.21.15.164:0/2039181712 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9950040ad0 con 0x55da78e7cba0 2024-09-13T23:05:34.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.586+0000 7f982bfff640 1 --2- 172.21.15.164:0/2039181712 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9824036b90 0x7f9824039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.586+0000 7f982bfff640 1 -- 172.21.15.164:0/2039181712 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f995003aca0 con 0x55da78e7cba0 2024-09-13T23:05:34.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.586+0000 7f995aa68640 1 --2- 172.21.15.164:0/2039181712 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9824036b90 0x7f9824039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.586+0000 7f995ec11800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.586+0000 7f995ec11800 1 --2- 172.21.15.164:0/2039181712 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55da78e8f9d0 0x55da78e91e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.586+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da78e925e0 con 0x55da78e8f9d0 2024-09-13T23:05:34.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.586+0000 7f995aa68640 1 --2- 172.21.15.164:0/2039181712 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9824036b90 0x7f9824039050 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55da78e5a740 tx=0x7f995401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.586+0000 7f995a267640 1 --2- 172.21.15.164:0/2039181712 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55da78e8f9d0 0x55da78e91e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.586+0000 7f995a267640 1 --2- 172.21.15.164:0/2039181712 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55da78e8f9d0 0x55da78e91e90 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.587+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.587+0000 7f995ec11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.587+0000 7f995ec11800 20 realm 2024-09-13T23:05:34.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.587+0000 7f995ec11800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.587+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da78e929f0 con 0x55da78e8f9d0 2024-09-13T23:05:34.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.587+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.587+0000 7f995ec11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.587+0000 7f995ec11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:34.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.587+0000 7f995ec11800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.587+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da78e932c0 con 0x55da78e8f9d0 2024-09-13T23:05:34.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.587+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.587+0000 7f995ec11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.587+0000 7f995ec11800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.587+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da78e93660 con 0x55da78e8f9d0 2024-09-13T23:05:34.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.587+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.587+0000 7f995ec11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:34.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.587+0000 7f995ec11800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.587+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da78e92f10 con 0x55da78e8f9d0 2024-09-13T23:05:34.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.588+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.588+0000 7f995ec11800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:34.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.588+0000 7f995ec11800 20 searching for the correct realm 2024-09-13T23:05:34.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.588+0000 7f995ec11800 1 --2- 172.21.15.164:0/2039181712 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55da78e95b00 0x55da78e97ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.588+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e985a0 con 0x55da78e95b00 2024-09-13T23:05:34.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.588+0000 7f9959a66640 1 --2- 172.21.15.164:0/2039181712 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55da78e95b00 0x55da78e97ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.588+0000 7f9959a66640 1 --2- 172.21.15.164:0/2039181712 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55da78e95b00 0x55da78e97ef0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.588+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9950055070 con 0x55da78e95b00 2024-09-13T23:05:34.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.588+0000 7f9959a66640 1 --2- 172.21.15.164:0/2039181712 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f99500234d0 0x7f9950015500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.588+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e985a0 con 0x7f99500234d0 2024-09-13T23:05:34.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.588+0000 7f995aa68640 1 --2- 172.21.15.164:0/2039181712 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f99500234d0 0x7f9950015500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.589+0000 7f995aa68640 1 --2- 172.21.15.164:0/2039181712 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f99500234d0 0x7f9950015500 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.589+0000 7f995aa68640 1 -- 172.21.15.164:0/2039181712 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f995401f070 con 0x7f99500234d0 2024-09-13T23:05:34.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.589+0000 7f995aa68640 1 --2- 172.21.15.164:0/2039181712 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f9954031040 0x7f9954032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.589+0000 7f995aa68640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e985a0 con 0x7f9954031040 2024-09-13T23:05:34.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.589+0000 7f995a267640 1 --2- 172.21.15.164:0/2039181712 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f9954031040 0x7f9954032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.590+0000 7f995a267640 1 --2- 172.21.15.164:0/2039181712 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f9954031040 0x7f9954032430 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.590+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x7f9954031040 2024-09-13T23:05:34.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.590+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e985a0 con 0x55da78e8f9d0 2024-09-13T23:05:34.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.590+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.590+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e985a0 con 0x55da78e8f9d0 2024-09-13T23:05:34.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.590+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.590+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e985a0 con 0x7f9954031040 2024-09-13T23:05:34.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.591+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x7f9954031040 2024-09-13T23:05:34.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.591+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e985a0 con 0x7f9954031040 2024-09-13T23:05:34.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.591+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x7f9954031040 2024-09-13T23:05:34.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.591+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e985a0 con 0x7f99500234d0 2024-09-13T23:05:34.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.591+0000 7f995aa68640 1 -- 172.21.15.164:0/2039181712 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f995401f070 con 0x7f99500234d0 2024-09-13T23:05:34.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.591+0000 7f995aa68640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e985a0 con 0x55da78e95b00 2024-09-13T23:05:34.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.591+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9950055070 con 0x55da78e95b00 2024-09-13T23:05:34.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.591+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e985a0 con 0x55da78e8f9d0 2024-09-13T23:05:34.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.592+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.592+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e985a0 con 0x7f9954031040 2024-09-13T23:05:34.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.592+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x7f9954031040 2024-09-13T23:05:34.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.592+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e985a0 con 0x55da78e8f9d0 2024-09-13T23:05:34.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.592+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.592+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e985a0 con 0x7f99500234d0 2024-09-13T23:05:34.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.592+0000 7f995aa68640 1 -- 172.21.15.164:0/2039181712 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f995401f070 con 0x7f99500234d0 2024-09-13T23:05:34.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.592+0000 7f995aa68640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e985a0 con 0x55da78e95b00 2024-09-13T23:05:34.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.592+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9950055070 con 0x55da78e95b00 2024-09-13T23:05:34.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.593+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e985a0 con 0x55da78e95b00 2024-09-13T23:05:34.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.593+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9950055070 con 0x55da78e95b00 2024-09-13T23:05:34.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.593+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e985a0 con 0x7f9954031040 2024-09-13T23:05:34.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.593+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x7f9954031040 2024-09-13T23:05:34.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.593+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e985a0 con 0x55da78e95b00 2024-09-13T23:05:34.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.593+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9950055070 con 0x55da78e95b00 2024-09-13T23:05:34.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.593+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e985a0 con 0x55da78e95b00 2024-09-13T23:05:34.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.594+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9950055070 con 0x55da78e95b00 2024-09-13T23:05:34.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.594+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e985a0 con 0x55da78e8f9d0 2024-09-13T23:05:34.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.594+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.594+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e985a0 con 0x55da78e8f9d0 2024-09-13T23:05:34.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.594+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.594+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e985a0 con 0x7f9954031040 2024-09-13T23:05:34.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.594+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x7f9954031040 2024-09-13T23:05:34.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.594+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e985a0 con 0x55da78e95b00 2024-09-13T23:05:34.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.595+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9950055070 con 0x55da78e95b00 2024-09-13T23:05:34.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.595+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e985a0 con 0x7f99500234d0 2024-09-13T23:05:34.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.595+0000 7f995aa68640 1 -- 172.21.15.164:0/2039181712 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f995401f070 con 0x7f99500234d0 2024-09-13T23:05:34.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.595+0000 7f995aa68640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e985a0 con 0x55da78e8f9d0 2024-09-13T23:05:34.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.595+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.595+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e985a0 con 0x7f9954031040 2024-09-13T23:05:34.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.595+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x7f9954031040 2024-09-13T23:05:34.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.595+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e985a0 con 0x55da78e95b00 2024-09-13T23:05:34.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.596+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9950055070 con 0x55da78e95b00 2024-09-13T23:05:34.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.596+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e985a0 con 0x7f9954031040 2024-09-13T23:05:34.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.596+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x7f9954031040 2024-09-13T23:05:34.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.596+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f994c0a4040 con 0x7f99500234d0 2024-09-13T23:05:34.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.596+0000 7f995aa68640 1 -- 172.21.15.164:0/2039181712 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f995401f070 con 0x7f99500234d0 2024-09-13T23:05:34.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.596+0000 7f995aa68640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f994c0a4040 con 0x55da78e95b00 2024-09-13T23:05:34.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.596+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9950055070 con 0x55da78e95b00 2024-09-13T23:05:34.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.596+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f994c0a4040 con 0x7f9954031040 2024-09-13T23:05:34.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.597+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x7f9954031040 2024-09-13T23:05:34.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.597+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f994c0a4040 con 0x55da78e8f9d0 2024-09-13T23:05:34.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.597+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.597+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f994c0a4040 con 0x7f99500234d0 2024-09-13T23:05:34.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.597+0000 7f995aa68640 1 -- 172.21.15.164:0/2039181712 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f995401f070 con 0x7f99500234d0 2024-09-13T23:05:34.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.597+0000 7f995ec11800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:34.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.597+0000 7f995ec11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:34.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.597+0000 7f995ec11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:34.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.597+0000 7f995ec11800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:34.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.597+0000 7f995ec11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:34.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.597+0000 7f995ec11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:34.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.597+0000 7f995ec11800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.597+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da78e94580 con 0x55da78e8f9d0 2024-09-13T23:05:34.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.598+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.598+0000 7f995ec11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.598+0000 7f995ec11800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.598+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da78e941c0 con 0x55da78e8f9d0 2024-09-13T23:05:34.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.598+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.598+0000 7f995ec11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:34.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.598+0000 7f995ec11800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.598+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da78e941d0 con 0x55da78e8f9d0 2024-09-13T23:05:34.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.598+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.598+0000 7f995ec11800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:34.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.598+0000 7f995ec11800 20 zone default found 2024-09-13T23:05:34.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.598+0000 7f995ec11800 4 Realm: () 2024-09-13T23:05:34.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.598+0000 7f995ec11800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:34.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.598+0000 7f995ec11800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:34.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.598+0000 7f995ec11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:34.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.598+0000 7f995ec11800 20 zonegroup default 2024-09-13T23:05:34.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.598+0000 7f995ec11800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.598+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da78e98a20 con 0x7f9954031040 2024-09-13T23:05:34.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.598+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f994c07a030 con 0x7f9954031040 2024-09-13T23:05:34.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.598+0000 7f995ec11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.598+0000 7f995ec11800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.598+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da78e9a8b0 con 0x55da78e95b00 2024-09-13T23:05:34.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.599+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9950055070 con 0x55da78e95b00 2024-09-13T23:05:34.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.599+0000 7f995ec11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.599+0000 7f995ec11800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.599+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da78e9ac50 con 0x55da78e95b00 2024-09-13T23:05:34.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.599+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9950055070 con 0x55da78e95b00 2024-09-13T23:05:34.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.599+0000 7f995ec11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.599+0000 7f995ec11800 20 started sync module instance, tier type = 2024-09-13T23:05:34.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.599+0000 7f995ec11800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:34.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.599+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99cf0 con 0x7f99500234d0 2024-09-13T23:05:34.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.600+0000 7f995aa68640 1 -- 172.21.15.164:0/2039181712 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9954040040 con 0x7f99500234d0 2024-09-13T23:05:34.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.600+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94396819808528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99950 con 0x7f99500234d0 2024-09-13T23:05:34.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.600+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da78e9b990 con 0x55da78e8f9d0 2024-09-13T23:05:34.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.601+0000 7f995aa68640 1 -- 172.21.15.164:0/2039181712 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94396819808528] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9954040040 con 0x7f99500234d0 2024-09-13T23:05:34.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.601+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.601+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94396819812336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da78e9b8c0 con 0x55da78e8f9d0 2024-09-13T23:05:34.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.601+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da78e9c410 con 0x55da78e95b00 2024-09-13T23:05:34.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.602+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94396819812336] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.602+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9950055070 con 0x55da78e95b00 2024-09-13T23:05:34.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.602+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94396819813392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da78e9b830 con 0x55da78e95b00 2024-09-13T23:05:34.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.602+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da78e9d2d0 con 0x7f99500234d0 2024-09-13T23:05:34.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.603+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94396819813392] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9950055070 con 0x55da78e95b00 2024-09-13T23:05:34.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.603+0000 7f995aa68640 1 -- 172.21.15.164:0/2039181712 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9954040040 con 0x7f99500234d0 2024-09-13T23:05:34.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.603+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94396819820064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da78e9d6f0 con 0x7f99500234d0 2024-09-13T23:05:34.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.604+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da78e9e0b0 con 0x55da78e8f9d0 2024-09-13T23:05:34.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.604+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.604+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94396819823616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da78e9e4d0 con 0x55da78e8f9d0 2024-09-13T23:05:34.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.604+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da78e9efd0 con 0x7f9954031040 2024-09-13T23:05:34.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.604+0000 7f995aa68640 1 -- 172.21.15.164:0/2039181712 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94396819820064] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9954040040 con 0x7f99500234d0 2024-09-13T23:05:34.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.605+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c07a030 con 0x7f9954031040 2024-09-13T23:05:34.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.605+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94396819827392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da78e9ef90 con 0x7f9954031040 2024-09-13T23:05:34.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.605+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da78e9f9e0 con 0x7f9954031040 2024-09-13T23:05:34.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.606+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94396819823616] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.606+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94396819827392] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c07a030 con 0x7f9954031040 2024-09-13T23:05:34.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.606+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c07a030 con 0x7f9954031040 2024-09-13T23:05:34.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.606+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94396819821120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da78e9f530 con 0x7f9954031040 2024-09-13T23:05:34.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.607+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da78e9fef0 con 0x7f9954031040 2024-09-13T23:05:34.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.608+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c07a030 con 0x7f9954031040 2024-09-13T23:05:34.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.608+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94396819831360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da78ea0310 con 0x7f9954031040 2024-09-13T23:05:34.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.608+0000 7f995ec11800 20 add_watcher() i=0 2024-09-13T23:05:34.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.608+0000 7f995ec11800 20 add_watcher() i=1 2024-09-13T23:05:34.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.608+0000 7f995ec11800 20 add_watcher() i=2 2024-09-13T23:05:34.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.608+0000 7f995ec11800 20 add_watcher() i=3 2024-09-13T23:05:34.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.608+0000 7f995ec11800 20 add_watcher() i=4 2024-09-13T23:05:34.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.608+0000 7f995ec11800 20 add_watcher() i=5 2024-09-13T23:05:34.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.608+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94396819821120] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c07a030 con 0x7f9954031040 2024-09-13T23:05:34.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.608+0000 7f995ec11800 20 add_watcher() i=6 2024-09-13T23:05:34.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.608+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94396819831360] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c07a030 con 0x7f9954031040 2024-09-13T23:05:34.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.608+0000 7f995ec11800 20 add_watcher() i=7 2024-09-13T23:05:34.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.608+0000 7f995ec11800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:34.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.608+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55da78ea0310 con 0x55da78e8f9d0 2024-09-13T23:05:34.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.609+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.609+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94396819832416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da78ea0280 con 0x55da78e8f9d0 2024-09-13T23:05:34.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.611+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94396819832416] v32'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.611+0000 7f9810fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:34.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.611+0000 7f995ec11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:34.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.611+0000 7f995ec11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:34.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.611+0000 7f995ec11800 5 note: GC not initialized 2024-09-13T23:05:34.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.612+0000 7f978b7fe640 20 reqs_thread_entry: start 2024-09-13T23:05:34.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.612+0000 7f995ec11800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:34.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.612+0000 7f995ec11800 20 Filter name: none 2024-09-13T23:05:34.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.612+0000 7f97897fa640 20 reqs_thread_entry: start 2024-09-13T23:05:34.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.612+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78ed5e10 con 0x55da78e95b00 2024-09-13T23:05:34.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.612+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9950055070 con 0x55da78e95b00 2024-09-13T23:05:34.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.612+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78ed5e10 con 0x55da78e95b00 2024-09-13T23:05:34.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.612+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9950055070 con 0x55da78e95b00 2024-09-13T23:05:34.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.612+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78ed5e10 con 0x55da78e8f9d0 2024-09-13T23:05:34.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.613+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.613+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e94580 con 0x55da78e8f9d0 2024-09-13T23:05:34.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.613+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v32'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.613+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e94580 con 0x7f99500234d0 2024-09-13T23:05:34.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.613+0000 7f995aa68640 1 -- 172.21.15.164:0/2039181712 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9954040040 con 0x7f99500234d0 2024-09-13T23:05:34.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.613+0000 7f995aa68640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99cf0 con 0x55da78e95b00 2024-09-13T23:05:34.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.613+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9950055070 con 0x55da78e95b00 2024-09-13T23:05:34.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.613+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99cf0 con 0x55da78e8f9d0 2024-09-13T23:05:34.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.614+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.614+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99cf0 con 0x55da78e95b00 2024-09-13T23:05:34.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.614+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9950055070 con 0x55da78e95b00 2024-09-13T23:05:34.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.614+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99cf0 con 0x7f99500234d0 2024-09-13T23:05:34.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.614+0000 7f995aa68640 1 -- 172.21.15.164:0/2039181712 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9954040040 con 0x7f99500234d0 2024-09-13T23:05:34.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.614+0000 7f995aa68640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99cf0 con 0x55da78e95b00 2024-09-13T23:05:34.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.614+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9950055070 con 0x55da78e95b00 2024-09-13T23:05:34.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.614+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99cf0 con 0x55da78e8f9d0 2024-09-13T23:05:34.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.615+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.615+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99cf0 con 0x7f9954031040 2024-09-13T23:05:34.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.615+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x7f9954031040 2024-09-13T23:05:34.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.615+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99cf0 con 0x7f9954031040 2024-09-13T23:05:34.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.615+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(74 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x7f9954031040 2024-09-13T23:05:34.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.615+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99cf0 con 0x55da78e95b00 2024-09-13T23:05:34.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.615+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9950055070 con 0x55da78e95b00 2024-09-13T23:05:34.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.616+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99cf0 con 0x7f9954031040 2024-09-13T23:05:34.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.616+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(76 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x7f9954031040 2024-09-13T23:05:34.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.616+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99cf0 con 0x7f9954031040 2024-09-13T23:05:34.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.616+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(77 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x7f9954031040 2024-09-13T23:05:34.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.616+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99cf0 con 0x7f9954031040 2024-09-13T23:05:34.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.616+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(78 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x7f9954031040 2024-09-13T23:05:34.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.616+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99cf0 con 0x55da78e95b00 2024-09-13T23:05:34.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.616+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(79 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9950055070 con 0x55da78e95b00 2024-09-13T23:05:34.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.616+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99cf0 con 0x7f99500234d0 2024-09-13T23:05:34.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.617+0000 7f995aa68640 1 -- 172.21.15.164:0/2039181712 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(80 [pgnls start_epoch 32 out=70b] v32'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7f9954040040 con 0x7f99500234d0 2024-09-13T23:05:34.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.617+0000 7f995aa68640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99cf0 con 0x55da78e8f9d0 2024-09-13T23:05:34.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.617+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(81 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.617+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99cf0 con 0x55da78e8f9d0 2024-09-13T23:05:34.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.617+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(82 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.617+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99cf0 con 0x55da78e95b00 2024-09-13T23:05:34.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.617+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 <== osd.3 v2:172.21.15.164:6816/93809510 21 ==== osd_op_reply(83 [pgnls start_epoch 32 out=127b] v32'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f9950055070 con 0x55da78e95b00 2024-09-13T23:05:34.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.617+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99cf0 con 0x7f99500234d0 2024-09-13T23:05:34.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.618+0000 7f995aa68640 1 -- 172.21.15.164:0/2039181712 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(84 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9954040040 con 0x7f99500234d0 2024-09-13T23:05:34.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.618+0000 7f995aa68640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99cf0 con 0x7f9954031040 2024-09-13T23:05:34.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.618+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(85 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x7f9954031040 2024-09-13T23:05:34.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.618+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99cf0 con 0x55da78e8f9d0 2024-09-13T23:05:34.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.618+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(86 [pgnls start_epoch 32 out=49b] v32'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.618+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99cf0 con 0x7f9954031040 2024-09-13T23:05:34.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.618+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(87 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x7f9954031040 2024-09-13T23:05:34.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.618+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99cf0 con 0x55da78e95b00 2024-09-13T23:05:34.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.619+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 <== osd.3 v2:172.21.15.164:6816/93809510 22 ==== osd_op_reply(88 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9950055070 con 0x55da78e95b00 2024-09-13T23:05:34.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.619+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99cf0 con 0x7f99500234d0 2024-09-13T23:05:34.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.619+0000 7f995aa68640 1 -- 172.21.15.164:0/2039181712 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(89 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9954040040 con 0x7f99500234d0 2024-09-13T23:05:34.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.619+0000 7f995aa68640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99cf0 con 0x7f9954031040 2024-09-13T23:05:34.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.619+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(90 [pgnls start_epoch 32 out=49b] v32'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x7f9954031040 2024-09-13T23:05:34.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.619+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99cf0 con 0x55da78e8f9d0 2024-09-13T23:05:34.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.619+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(91 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.619+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99cf0 con 0x55da78e95b00 2024-09-13T23:05:34.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.619+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 <== osd.3 v2:172.21.15.164:6816/93809510 23 ==== osd_op_reply(92 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9950055070 con 0x55da78e95b00 2024-09-13T23:05:34.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.620+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55da78e99cf0 con 0x7f99500234d0 2024-09-13T23:05:34.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.620+0000 7f995aa68640 1 -- 172.21.15.164:0/2039181712 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(93 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9954040040 con 0x7f99500234d0 2024-09-13T23:05:34.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.620+0000 7f995ec11800 20 RGWRados::pool_iterate: got myfoo 2024-09-13T23:05:34.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.620+0000 7f995ec11800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 2024-09-13T23:05:34.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.621+0000 7f9810fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:34.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.621+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94396819832416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da78e94580 con 0x55da78e8f9d0 2024-09-13T23:05:34.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.622+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94396819832416] v32'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.622+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94396819808528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da78ed40d0 con 0x7f99500234d0 2024-09-13T23:05:34.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.622+0000 7f995aa68640 1 -- 172.21.15.164:0/2039181712 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94396819808528] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9954040040 con 0x7f99500234d0 2024-09-13T23:05:34.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.623+0000 7f995ec11800 20 remove_watcher() i=0 2024-09-13T23:05:34.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.623+0000 7f995ec11800 2 removed watcher, disabling cache 2024-09-13T23:05:34.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.623+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94396819812336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da78ed40d0 con 0x55da78e8f9d0 2024-09-13T23:05:34.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.623+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94396819812336] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.624+0000 7f995ec11800 20 remove_watcher() i=1 2024-09-13T23:05:34.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.624+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94396819813392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da78ed40d0 con 0x55da78e95b00 2024-09-13T23:05:34.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.624+0000 7f9959a66640 1 -- 172.21.15.164:0/2039181712 <== osd.3 v2:172.21.15.164:6816/93809510 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94396819813392] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9950055070 con 0x55da78e95b00 2024-09-13T23:05:34.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.625+0000 7f995ec11800 20 remove_watcher() i=2 2024-09-13T23:05:34.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.625+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94396819820064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da78e9fe60 con 0x7f99500234d0 2024-09-13T23:05:34.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.625+0000 7f995aa68640 1 -- 172.21.15.164:0/2039181712 <== osd.2 v2:172.21.15.164:6808/3795914978 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94396819820064] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9954040040 con 0x7f99500234d0 2024-09-13T23:05:34.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.625+0000 7f995ec11800 20 remove_watcher() i=3 2024-09-13T23:05:34.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.626+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94396819823616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da78e9fe60 con 0x55da78e8f9d0 2024-09-13T23:05:34.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.626+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.1 v2:172.21.15.164:6800/4060509701 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94396819823616] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c07a030 con 0x55da78e8f9d0 2024-09-13T23:05:34.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.626+0000 7f995ec11800 20 remove_watcher() i=4 2024-09-13T23:05:34.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.626+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94396819827392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da78e9dc00 con 0x7f9954031040 2024-09-13T23:05:34.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.627+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94396819827392] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c07a030 con 0x7f9954031040 2024-09-13T23:05:34.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.627+0000 7f995ec11800 20 remove_watcher() i=5 2024-09-13T23:05:34.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.627+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94396819821120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da78e9fe60 con 0x7f9954031040 2024-09-13T23:05:34.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.629+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94396819821120] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c07a030 con 0x7f9954031040 2024-09-13T23:05:34.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.629+0000 7f995ec11800 20 remove_watcher() i=6 2024-09-13T23:05:34.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.629+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94396819831360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55da78e9fe60 con 0x7f9954031040 2024-09-13T23:05:34.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 <== osd.0 v2:172.21.15.17:6800/489863589 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94396819831360] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c07a030 con 0x7f9954031040 2024-09-13T23:05:34.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995ec11800 20 remove_watcher() i=7 2024-09-13T23:05:34.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f9954031040 msgr2=0x7f9954032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995ec11800 1 --2- 172.21.15.164:0/2039181712 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f9954031040 0x7f9954032430 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55da78e8f9d0 msgr2=0x55da78e91e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995ec11800 1 --2- 172.21.15.164:0/2039181712 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55da78e8f9d0 0x55da78e91e90 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f99500234d0 msgr2=0x7f9950015500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995ec11800 1 --2- 172.21.15.164:0/2039181712 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f99500234d0 0x7f9950015500 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55da78e95b00 msgr2=0x55da78e97ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995ec11800 1 --2- 172.21.15.164:0/2039181712 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55da78e95b00 0x55da78e97ef0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9824036b90 msgr2=0x7f9824039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995ec11800 1 --2- 172.21.15.164:0/2039181712 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9824036b90 0x7f9824039050 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55da78e5a740 tx=0x7f995401f000 comp rx=0 tx=0).stop 2024-09-13T23:05:34.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78e7cba0 msgr2=0x55da78e840a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995a267640 1 -- 172.21.15.164:0/2039181712 reap_dead start 2024-09-13T23:05:34.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995ec11800 1 --2- 172.21.15.164:0/2039181712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78e7cba0 0x55da78e840a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f995004bfc0 tx=0x7f995004d030 comp rx=0 tx=0).stop 2024-09-13T23:05:34.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 shutdown_connections 2024-09-13T23:05:34.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995ec11800 1 --2- 172.21.15.164:0/2039181712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78e7cba0 0x55da78e840a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 >> 172.21.15.164:0/2039181712 conn(0x55da78e78f00 msgr2=0x55da78e76fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:34.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 shutdown_connections 2024-09-13T23:05:34.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995ec11800 1 -- 172.21.15.164:0/2039181712 wait complete. 2024-09-13T23:05:34.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995ec11800 1 -- 172.21.15.164:0/1648821675 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9834036b90 msgr2=0x7f9834039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995ec11800 1 --2- 172.21.15.164:0/1648821675 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9834036b90 0x7f9834039050 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55da78e5e2b0 tx=0x7f9954005840 comp rx=0 tx=0).stop 2024-09-13T23:05:34.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995ec11800 1 -- 172.21.15.164:0/1648821675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78e4ef10 msgr2=0x55da78e4d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995ec11800 1 --2- 172.21.15.164:0/1648821675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78e4ef10 0x55da78e4d560 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f995000efd0 tx=0x7f995000d7a0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995ec11800 1 -- 172.21.15.164:0/1648821675 shutdown_connections 2024-09-13T23:05:34.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995ec11800 1 --2- 172.21.15.164:0/1648821675 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9834036b90 0x7f9834039050 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995ec11800 1 --2- 172.21.15.164:0/1648821675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78e4ef10 0x55da78e4d560 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995ec11800 1 -- 172.21.15.164:0/1648821675 >> 172.21.15.164:0/1648821675 conn(0x55da78e62bc0 msgr2=0x55da78e65740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:34.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995ec11800 1 -- 172.21.15.164:0/1648821675 shutdown_connections 2024-09-13T23:05:34.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.630+0000 7f995ec11800 1 -- 172.21.15.164:0/1648821675 wait complete. 2024-09-13T23:05:34.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.631+0000 7f995ec11800 1 -- 172.21.15.164:0/1509925163 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55da78d5ee80 msgr2=0x55da78e5d220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.631+0000 7f995ec11800 1 --2- 172.21.15.164:0/1509925163 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55da78d5ee80 0x55da78e5d220 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.631+0000 7f995ec11800 1 -- 172.21.15.164:0/1509925163 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9840036b40 msgr2=0x7f9840039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.631+0000 7f995ec11800 1 --2- 172.21.15.164:0/1509925163 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9840036b40 0x7f9840039000 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9950001d90 tx=0x7f99500012f0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.631+0000 7f995ec11800 1 -- 172.21.15.164:0/1509925163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78d5e540 msgr2=0x55da78e561b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.631+0000 7f995ec11800 1 --2- 172.21.15.164:0/1509925163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78d5e540 0x55da78e561b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x55da78cd2c90 tx=0x7f994c002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.631+0000 7f995ec11800 1 -- 172.21.15.164:0/1509925163 shutdown_connections 2024-09-13T23:05:34.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.631+0000 7f995ec11800 1 --2- 172.21.15.164:0/1509925163 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55da78d5ee80 0x55da78e5d220 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.631+0000 7f995ec11800 1 --2- 172.21.15.164:0/1509925163 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9840036b40 0x7f9840039000 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.631+0000 7f995ec11800 1 --2- 172.21.15.164:0/1509925163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da78d5e540 0x55da78e561b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.631+0000 7f995ec11800 1 -- 172.21.15.164:0/1509925163 >> 172.21.15.164:0/1509925163 conn(0x55da78d59dd0 msgr2=0x55da78e47960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:34.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.631+0000 7f995ec11800 1 -- 172.21.15.164:0/1509925163 shutdown_connections 2024-09-13T23:05:34.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.631+0000 7f995ec11800 1 -- 172.21.15.164:0/1509925163 wait complete. 2024-09-13T23:05:34.665 INFO:teuthology.orchestra.run.smithi164.stdout:["myfoo"] 2024-09-13T23:05:34.665 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-13T23:05:34.675 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:05:34.686 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:05:34.695 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:05:34.741 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-13T23:05:34.768 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:05:34.800 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:05:34.830 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:05:34.830 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T23:05:34.830 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T23:05:34.830 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-13T23:05:34.874 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:34.875 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:34.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.874+0000 7f7d07321800 1 Processor -- start 2024-09-13T23:05:34.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.874+0000 7f7d07321800 1 -- start start 2024-09-13T23:05:34.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.874+0000 7f7d07321800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x563a20d55e90 0x563a20de5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.874+0000 7f7d07321800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563a20ca1b30 con 0x563a20de5680 2024-09-13T23:05:34.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.874+0000 7f7d07321800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x563a20c83360 con 0x563a20d55e90 2024-09-13T23:05:34.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.874+0000 7f7d030ac640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x563a20d55e90 0x563a20de5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.874+0000 7f7d028ab640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x563a20de5680 0x563a20de7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40908/0 (socket says 172.21.15.164:40908) 2024-09-13T23:05:34.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.874+0000 7f7d028ab640 1 -- 172.21.15.164:0/1646565048 learned_addr learned my addr 172.21.15.164:0/1646565048 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:34.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.875+0000 7f7d030ac640 1 -- 172.21.15.164:0/1646565048 >> v1:172.21.15.17:6789/0 conn(0x563a20de5680 legacy=0x563a20de7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.875+0000 7f7d030ac640 1 -- 172.21.15.164:0/1646565048 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a20ca9e00 con 0x563a20d55e90 2024-09-13T23:05:34.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.877+0000 7f7d030ac640 1 --2- 172.21.15.164:0/1646565048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20d55e90 0x563a20de5140 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400a470 tx=0x7f7cf4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a77ac3363b67e30 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.877+0000 7f7d020aa640 1 -- 172.21.15.164:0/1646565048 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cf4053570 con 0x563a20d55e90 2024-09-13T23:05:34.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.877+0000 7f7d020aa640 1 -- 172.21.15.164:0/1646565048 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf4058070 con 0x563a20d55e90 2024-09-13T23:05:34.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.877+0000 7f7d020aa640 1 -- 172.21.15.164:0/1646565048 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cf4053880 con 0x563a20d55e90 2024-09-13T23:05:34.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.877+0000 7f7d07321800 1 -- 172.21.15.164:0/1646565048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20d55e90 msgr2=0x563a20de5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.877+0000 7f7d07321800 1 --2- 172.21.15.164:0/1646565048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20d55e90 0x563a20de5140 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400a470 tx=0x7f7cf4045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:34.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.877+0000 7f7d07321800 1 -- 172.21.15.164:0/1646565048 shutdown_connections 2024-09-13T23:05:34.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.877+0000 7f7d07321800 1 --2- 172.21.15.164:0/1646565048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20d55e90 0x563a20de5140 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.877+0000 7f7d07321800 1 -- 172.21.15.164:0/1646565048 >> 172.21.15.164:0/1646565048 conn(0x563a20ddcdf0 msgr2=0x563a20ddf210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:34.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.877+0000 7f7d07321800 1 -- 172.21.15.164:0/1646565048 shutdown_connections 2024-09-13T23:05:34.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.877+0000 7f7d07321800 1 -- 172.21.15.164:0/1646565048 wait complete. 2024-09-13T23:05:34.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.891+0000 7f7d07321800 1 Processor -- start 2024-09-13T23:05:34.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.891+0000 7f7d07321800 1 -- start start 2024-09-13T23:05:34.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.891+0000 7f7d07321800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20d55e90 0x563a20ed1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.891+0000 7f7d07321800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563a20d2e330 con 0x563a20d55e90 2024-09-13T23:05:34.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.892+0000 7f7d030ac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20d55e90 0x563a20ed1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.892+0000 7f7d030ac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20d55e90 0x563a20ed1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57500/0 (socket says 172.21.15.164:57500) 2024-09-13T23:05:34.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.892+0000 7f7d030ac640 1 -- 172.21.15.164:0/2309593796 learned_addr learned my addr 172.21.15.164:0/2309593796 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:34.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.892+0000 7f7d030ac640 1 -- 172.21.15.164:0/2309593796 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a20c7bbc0 con 0x563a20d55e90 2024-09-13T23:05:34.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.892+0000 7f7d030ac640 1 --2- 172.21.15.164:0/2309593796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20d55e90 0x563a20ed1880 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4025c20 tx=0x7f7cf4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4673759972ceb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.892+0000 7f7bf160a640 1 -- 172.21.15.164:0/2309593796 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cf405c580 con 0x563a20d55e90 2024-09-13T23:05:34.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.892+0000 7f7bf160a640 1 -- 172.21.15.164:0/2309593796 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf4063030 con 0x563a20d55e90 2024-09-13T23:05:34.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.892+0000 7f7bf160a640 1 -- 172.21.15.164:0/2309593796 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cf405c850 con 0x563a20d55e90 2024-09-13T23:05:34.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.893+0000 7f7d07321800 1 -- 172.21.15.164:0/2309593796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20d55e90 msgr2=0x563a20ed1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.893+0000 7f7d07321800 1 --2- 172.21.15.164:0/2309593796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20d55e90 0x563a20ed1880 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4025c20 tx=0x7f7cf4051000 comp rx=0 tx=0).stop 2024-09-13T23:05:34.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.893+0000 7f7d07321800 1 -- 172.21.15.164:0/2309593796 shutdown_connections 2024-09-13T23:05:34.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.893+0000 7f7d07321800 1 --2- 172.21.15.164:0/2309593796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20d55e90 0x563a20ed1880 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.893+0000 7f7d07321800 1 -- 172.21.15.164:0/2309593796 >> 172.21.15.164:0/2309593796 conn(0x563a20ddcdf0 msgr2=0x563a20ecd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:34.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.893+0000 7f7d07321800 1 -- 172.21.15.164:0/2309593796 shutdown_connections 2024-09-13T23:05:34.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.893+0000 7f7d07321800 1 -- 172.21.15.164:0/2309593796 wait complete. 2024-09-13T23:05:34.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.893+0000 7f7d07321800 1 Processor -- start 2024-09-13T23:05:34.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.893+0000 7f7d07321800 1 -- start start 2024-09-13T23:05:34.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.894+0000 7f7d07321800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20d55e90 0x563a20ed91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.894+0000 7f7d07321800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563a20de95f0 con 0x563a20d55e90 2024-09-13T23:05:34.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.894+0000 7f7d030ac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20d55e90 0x563a20ed91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.894+0000 7f7d030ac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20d55e90 0x563a20ed91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57502/0 (socket says 172.21.15.164:57502) 2024-09-13T23:05:34.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.894+0000 7f7d030ac640 1 -- 172.21.15.164:0/3935474048 learned_addr learned my addr 172.21.15.164:0/3935474048 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:34.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.894+0000 7f7d030ac640 1 -- 172.21.15.164:0/3935474048 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a20c8ffe0 con 0x563a20d55e90 2024-09-13T23:05:34.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.894+0000 7f7d030ac640 1 --2- 172.21.15.164:0/3935474048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20d55e90 0x563a20ed91c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400a330 tx=0x7f7cf4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.894+0000 7f7befe07640 1 -- 172.21.15.164:0/3935474048 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cf406c030 con 0x563a20d55e90 2024-09-13T23:05:34.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.894+0000 7f7befe07640 1 -- 172.21.15.164:0/3935474048 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf405c580 con 0x563a20d55e90 2024-09-13T23:05:34.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.894+0000 7f7befe07640 1 -- 172.21.15.164:0/3935474048 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cf405c880 con 0x563a20d55e90 2024-09-13T23:05:34.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.894+0000 7f7d07321800 1 -- 172.21.15.164:0/3935474048 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563a20ed9700 con 0x563a20d55e90 2024-09-13T23:05:34.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.895+0000 7f7d07321800 1 -- 172.21.15.164:0/3935474048 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a20ed9c80 con 0x563a20d55e90 2024-09-13T23:05:34.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.895+0000 7f7befe07640 1 -- 172.21.15.164:0/3935474048 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7cf4053440 con 0x563a20d55e90 2024-09-13T23:05:34.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.895+0000 7f7befe07640 1 --2- 172.21.15.164:0/3935474048 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7be8036ce0 0x7f7be80391a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.896+0000 7f7befe07640 1 -- 172.21.15.164:0/3935474048 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7cf4070020 con 0x563a20d55e90 2024-09-13T23:05:34.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.896+0000 7f7d028ab640 1 --2- 172.21.15.164:0/3935474048 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7be8036ce0 0x7f7be80391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.896+0000 7f7d07321800 1 --2- 172.21.15.164:0/3935474048 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563a20de5680 0x563a20ee0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.896+0000 7f7d07321800 1 -- 172.21.15.164:0/3935474048 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20ee07b0 con 0x563a20de5680 2024-09-13T23:05:34.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.896+0000 7f7d038ad640 1 --2- 172.21.15.164:0/3935474048 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563a20de5680 0x563a20ee0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.896+0000 7f7d028ab640 1 --2- 172.21.15.164:0/3935474048 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7be8036ce0 0x7f7be80391a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8000f60 tx=0x7f7cf80012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.896+0000 7f7d038ad640 1 --2- 172.21.15.164:0/3935474048 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563a20de5680 0x563a20ee0230 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.896+0000 7f7d038ad640 1 -- 172.21.15.164:0/3935474048 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7cfc00a4a0 con 0x563a20de5680 2024-09-13T23:05:34.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.896+0000 7f7d07321800 1 -- 172.21.15.164:0/3935474048 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20edd800 con 0x563a20de5680 2024-09-13T23:05:34.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.897+0000 7f7d038ad640 1 -- 172.21.15.164:0/3935474048 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7cfc00a4a0 con 0x563a20de5680 2024-09-13T23:05:34.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.897+0000 7f7d07321800 1 -- 172.21.15.164:0/3935474048 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20ee2620 con 0x563a20de5680 2024-09-13T23:05:34.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.897+0000 7f7d038ad640 1 -- 172.21.15.164:0/3935474048 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7cfc00a4a0 con 0x563a20de5680 2024-09-13T23:05:34.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.897+0000 7f7d07321800 1 -- 172.21.15.164:0/3935474048 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20ee1850 con 0x563a20de5680 2024-09-13T23:05:34.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.897+0000 7f7d038ad640 1 -- 172.21.15.164:0/3935474048 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7cfc00a4a0 con 0x563a20de5680 2024-09-13T23:05:34.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.897+0000 7f7d07321800 1 -- 172.21.15.164:0/3935474048 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20ee1ca0 con 0x563a20de5680 2024-09-13T23:05:34.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.897+0000 7f7d038ad640 1 -- 172.21.15.164:0/3935474048 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7cfc00a4a0 con 0x563a20de5680 2024-09-13T23:05:34.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.898+0000 7f7d07321800 1 Processor -- start 2024-09-13T23:05:34.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.898+0000 7f7d07321800 1 -- start start 2024-09-13T23:05:34.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.898+0000 7f7d07321800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20de2b10 0x563a20de1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.898+0000 7f7d07321800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563a20c7d580 con 0x563a20de2b10 2024-09-13T23:05:34.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.898+0000 7f7d028ab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20de2b10 0x563a20de1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.898+0000 7f7d028ab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20de2b10 0x563a20de1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57514/0 (socket says 172.21.15.164:57514) 2024-09-13T23:05:34.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.898+0000 7f7d028ab640 1 -- 172.21.15.164:0/706903736 learned_addr learned my addr 172.21.15.164:0/706903736 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:34.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.899+0000 7f7d028ab640 1 -- 172.21.15.164:0/706903736 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a20de2f30 con 0x563a20de2b10 2024-09-13T23:05:34.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.899+0000 7f7d028ab640 1 --2- 172.21.15.164:0/706903736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20de2b10 0x563a20de1160 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8001ed0 tx=0x7f7cf800d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.899+0000 7f7bed602640 1 -- 172.21.15.164:0/706903736 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cf801b550 con 0x563a20de2b10 2024-09-13T23:05:34.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.899+0000 7f7bed602640 1 -- 172.21.15.164:0/706903736 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf801b6f0 con 0x563a20de2b10 2024-09-13T23:05:34.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.899+0000 7f7d07321800 1 -- 172.21.15.164:0/706903736 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563a20de1760 con 0x563a20de2b10 2024-09-13T23:05:34.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.899+0000 7f7bed602640 1 -- 172.21.15.164:0/706903736 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cf801b9d0 con 0x563a20de2b10 2024-09-13T23:05:34.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.899+0000 7f7d07321800 1 -- 172.21.15.164:0/706903736 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a20de1c60 con 0x563a20de2b10 2024-09-13T23:05:34.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.900+0000 7f7bed602640 1 -- 172.21.15.164:0/706903736 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7cf8023020 con 0x563a20de2b10 2024-09-13T23:05:34.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.900+0000 7f7bed602640 1 --2- 172.21.15.164:0/706903736 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7bdc036b90 0x7f7bdc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.900+0000 7f7bed602640 1 -- 172.21.15.164:0/706903736 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7cf8021020 con 0x563a20de2b10 2024-09-13T23:05:34.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.900+0000 7f7d038ad640 1 --2- 172.21.15.164:0/706903736 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7bdc036b90 0x7f7bdc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.900+0000 7f7d07321800 1 Processor -- start 2024-09-13T23:05:34.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.900+0000 7f7d038ad640 1 --2- 172.21.15.164:0/706903736 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7bdc036b90 0x7f7bdc039050 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x563a20ee1370 tx=0x7f7cfc005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.900+0000 7f7d07321800 1 -- start start 2024-09-13T23:05:34.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.900+0000 7f7d07321800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20effac0 0x563a20effec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.900+0000 7f7d07321800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563a20ed1fd0 con 0x563a20effac0 2024-09-13T23:05:34.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.901+0000 7f7d028ab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20effac0 0x563a20effec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.901+0000 7f7d028ab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20effac0 0x563a20effec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57516/0 (socket says 172.21.15.164:57516) 2024-09-13T23:05:34.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.901+0000 7f7d028ab640 1 -- 172.21.15.164:0/648715720 learned_addr learned my addr 172.21.15.164:0/648715720 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:34.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.901+0000 7f7d028ab640 1 -- 172.21.15.164:0/648715720 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a20f00490 con 0x563a20effac0 2024-09-13T23:05:34.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.901+0000 7f7d028ab640 1 --2- 172.21.15.164:0/648715720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20effac0 0x563a20effec0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7cf804d050 tx=0x7f7cf804d160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4801607584c352ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.901+0000 7f7be6ffd640 1 -- 172.21.15.164:0/648715720 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cf8046070 con 0x563a20effac0 2024-09-13T23:05:34.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.901+0000 7f7be6ffd640 1 -- 172.21.15.164:0/648715720 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf8019320 con 0x563a20effac0 2024-09-13T23:05:34.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.901+0000 7f7be6ffd640 1 -- 172.21.15.164:0/648715720 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cf800cc60 con 0x563a20effac0 2024-09-13T23:05:34.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.902+0000 7f7d07321800 1 -- 172.21.15.164:0/648715720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20effac0 msgr2=0x563a20effec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.902+0000 7f7d07321800 1 --2- 172.21.15.164:0/648715720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20effac0 0x563a20effec0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7cf804d050 tx=0x7f7cf804d160 comp rx=0 tx=0).stop 2024-09-13T23:05:34.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.902+0000 7f7d07321800 1 -- 172.21.15.164:0/648715720 shutdown_connections 2024-09-13T23:05:34.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.902+0000 7f7d07321800 1 --2- 172.21.15.164:0/648715720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20effac0 0x563a20effec0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.902+0000 7f7d07321800 1 -- 172.21.15.164:0/648715720 >> 172.21.15.164:0/648715720 conn(0x563a20efbe20 msgr2=0x563a20ef9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:34.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.902+0000 7f7d07321800 1 -- 172.21.15.164:0/648715720 shutdown_connections 2024-09-13T23:05:34.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.902+0000 7f7d07321800 1 -- 172.21.15.164:0/648715720 wait complete. 2024-09-13T23:05:34.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.902+0000 7f7d07321800 1 Processor -- start 2024-09-13T23:05:34.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.902+0000 7f7d07321800 1 -- start start 2024-09-13T23:05:34.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.902+0000 7f7d07321800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20effac0 0x563a20f06fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.902+0000 7f7d07321800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563a20f00b00 con 0x563a20effac0 2024-09-13T23:05:34.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.902+0000 7f7d028ab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20effac0 0x563a20f06fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.902+0000 7f7d028ab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20effac0 0x563a20f06fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57528/0 (socket says 172.21.15.164:57528) 2024-09-13T23:05:34.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.903+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 learned_addr learned my addr 172.21.15.164:0/145019022 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:34.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.903+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a20f074e0 con 0x563a20effac0 2024-09-13T23:05:34.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.903+0000 7f7d028ab640 1 --2- 172.21.15.164:0/145019022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20effac0 0x563a20f06fa0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8019f50 tx=0x7f7cf804cfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.903+0000 7f7be57fa640 1 -- 172.21.15.164:0/145019022 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cf8033030 con 0x563a20effac0 2024-09-13T23:05:34.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.903+0000 7f7be57fa640 1 -- 172.21.15.164:0/145019022 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf8040600 con 0x563a20effac0 2024-09-13T23:05:34.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.903+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563a20f07770 con 0x563a20effac0 2024-09-13T23:05:34.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.903+0000 7f7be57fa640 1 -- 172.21.15.164:0/145019022 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cf8046050 con 0x563a20effac0 2024-09-13T23:05:34.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.903+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a20f07770 con 0x563a20effac0 2024-09-13T23:05:34.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.904+0000 7f7be57fa640 1 -- 172.21.15.164:0/145019022 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7cf8036030 con 0x563a20effac0 2024-09-13T23:05:34.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.904+0000 7f7be57fa640 1 --2- 172.21.15.164:0/145019022 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7bcc036b90 0x7f7bcc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.904+0000 7f7be57fa640 1 -- 172.21.15.164:0/145019022 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7cf8034070 con 0x563a20effac0 2024-09-13T23:05:34.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.904+0000 7f7d038ad640 1 --2- 172.21.15.164:0/145019022 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7bcc036b90 0x7f7bcc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.904+0000 7f7d07321800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.904+0000 7f7d07321800 1 --2- 172.21.15.164:0/145019022 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563a20f128e0 0x563a20f14da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.904+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20f154f0 con 0x563a20f128e0 2024-09-13T23:05:34.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.905+0000 7f7d030ac640 1 --2- 172.21.15.164:0/145019022 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563a20f128e0 0x563a20f14da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.905+0000 7f7d038ad640 1 --2- 172.21.15.164:0/145019022 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7bcc036b90 0x7f7bcc039050 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x563a20edd750 tx=0x7f7cfc01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.905+0000 7f7d030ac640 1 --2- 172.21.15.164:0/145019022 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563a20f128e0 0x563a20f14da0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.905+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7cf407b070 con 0x563a20f128e0 2024-09-13T23:05:34.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.905+0000 7f7d07321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.905+0000 7f7d07321800 20 realm 2024-09-13T23:05:34.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.905+0000 7f7d07321800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.905+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20f15900 con 0x563a20f128e0 2024-09-13T23:05:34.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.905+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7cf407b070 con 0x563a20f128e0 2024-09-13T23:05:34.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.905+0000 7f7d07321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.905+0000 7f7d07321800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:34.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.905+0000 7f7d07321800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.905+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20f161d0 con 0x563a20f128e0 2024-09-13T23:05:34.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.905+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7cf407b070 con 0x563a20f128e0 2024-09-13T23:05:34.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.905+0000 7f7d07321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.905+0000 7f7d07321800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.905+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20f16570 con 0x563a20f128e0 2024-09-13T23:05:34.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.906+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7cf407b070 con 0x563a20f128e0 2024-09-13T23:05:34.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.906+0000 7f7d07321800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:34.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.906+0000 7f7d07321800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.906+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20f169d0 con 0x563a20f128e0 2024-09-13T23:05:34.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.906+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7cf407b070 con 0x563a20f128e0 2024-09-13T23:05:34.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.906+0000 7f7d07321800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:34.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.906+0000 7f7d07321800 20 searching for the correct realm 2024-09-13T23:05:34.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.906+0000 7f7d07321800 1 --2- 172.21.15.164:0/145019022 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563a20f18a20 0x563a20f1ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.906+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x563a20f18a20 2024-09-13T23:05:34.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.906+0000 7f7d028ab640 1 --2- 172.21.15.164:0/145019022 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563a20f18a20 0x563a20f1ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.906+0000 7f7d028ab640 1 --2- 172.21.15.164:0/145019022 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563a20f18a20 0x563a20f1ae10 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.907+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf8009050 con 0x563a20f18a20 2024-09-13T23:05:34.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.907+0000 7f7d028ab640 1 --2- 172.21.15.164:0/145019022 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7cf8059040 0x7f7cf804f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.907+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x7f7cf8059040 2024-09-13T23:05:34.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.907+0000 7f7d038ad640 1 --2- 172.21.15.164:0/145019022 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7cf8059040 0x7f7cf804f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.907+0000 7f7d038ad640 1 --2- 172.21.15.164:0/145019022 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7cf8059040 0x7f7cf804f860 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.907+0000 7f7d038ad640 1 -- 172.21.15.164:0/145019022 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cfc01f070 con 0x7f7cf8059040 2024-09-13T23:05:34.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.907+0000 7f7d038ad640 1 --2- 172.21.15.164:0/145019022 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7cfc031040 0x7f7cfc032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:34.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.907+0000 7f7d038ad640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x7f7cfc031040 2024-09-13T23:05:34.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.908+0000 7f7d030ac640 1 --2- 172.21.15.164:0/145019022 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7cfc031040 0x7f7cfc032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:34.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.908+0000 7f7d030ac640 1 --2- 172.21.15.164:0/145019022 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7cfc031040 0x7f7cfc032430 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:34.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.908+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf407b070 con 0x7f7cfc031040 2024-09-13T23:05:34.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.908+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x563a20f128e0 2024-09-13T23:05:34.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.908+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7cf407b070 con 0x563a20f128e0 2024-09-13T23:05:34.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.908+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x563a20f128e0 2024-09-13T23:05:34.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.909+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf407b070 con 0x563a20f128e0 2024-09-13T23:05:34.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.909+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x7f7cfc031040 2024-09-13T23:05:34.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.909+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf407b070 con 0x7f7cfc031040 2024-09-13T23:05:34.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.909+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x7f7cfc031040 2024-09-13T23:05:34.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.909+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf407b070 con 0x7f7cfc031040 2024-09-13T23:05:34.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.909+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x7f7cf8059040 2024-09-13T23:05:34.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.909+0000 7f7d038ad640 1 -- 172.21.15.164:0/145019022 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cfc01f070 con 0x7f7cf8059040 2024-09-13T23:05:34.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.909+0000 7f7d038ad640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x563a20f18a20 2024-09-13T23:05:34.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.910+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf8009050 con 0x563a20f18a20 2024-09-13T23:05:34.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.910+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x563a20f128e0 2024-09-13T23:05:34.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.910+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf407b070 con 0x563a20f128e0 2024-09-13T23:05:34.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.910+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x7f7cfc031040 2024-09-13T23:05:34.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.910+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf407b070 con 0x7f7cfc031040 2024-09-13T23:05:34.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.910+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x563a20f128e0 2024-09-13T23:05:34.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.910+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf407b070 con 0x563a20f128e0 2024-09-13T23:05:34.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.910+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x7f7cf8059040 2024-09-13T23:05:34.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.911+0000 7f7d038ad640 1 -- 172.21.15.164:0/145019022 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7cfc01f070 con 0x7f7cf8059040 2024-09-13T23:05:34.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.911+0000 7f7d038ad640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x563a20f18a20 2024-09-13T23:05:34.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.911+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf8009050 con 0x563a20f18a20 2024-09-13T23:05:34.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.911+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x563a20f18a20 2024-09-13T23:05:34.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.911+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf8009050 con 0x563a20f18a20 2024-09-13T23:05:34.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.911+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x7f7cfc031040 2024-09-13T23:05:34.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.911+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf407b070 con 0x7f7cfc031040 2024-09-13T23:05:34.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.911+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x563a20f18a20 2024-09-13T23:05:34.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.912+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf8009050 con 0x563a20f18a20 2024-09-13T23:05:34.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.912+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x563a20f18a20 2024-09-13T23:05:34.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.912+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf8009050 con 0x563a20f18a20 2024-09-13T23:05:34.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.912+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x563a20f128e0 2024-09-13T23:05:34.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.912+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf407b070 con 0x563a20f128e0 2024-09-13T23:05:34.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.912+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x563a20f128e0 2024-09-13T23:05:34.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.912+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7cf407b070 con 0x563a20f128e0 2024-09-13T23:05:34.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.912+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x7f7cfc031040 2024-09-13T23:05:34.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.913+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf407b070 con 0x7f7cfc031040 2024-09-13T23:05:34.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.913+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x563a20f18a20 2024-09-13T23:05:34.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.913+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf8009050 con 0x563a20f18a20 2024-09-13T23:05:34.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.913+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x7f7cf8059040 2024-09-13T23:05:34.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.913+0000 7f7d038ad640 1 -- 172.21.15.164:0/145019022 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cfc01f070 con 0x7f7cf8059040 2024-09-13T23:05:34.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.913+0000 7f7d038ad640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x563a20f128e0 2024-09-13T23:05:34.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.913+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7cf407b070 con 0x563a20f128e0 2024-09-13T23:05:34.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.913+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x7f7cfc031040 2024-09-13T23:05:34.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.914+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf407b070 con 0x7f7cfc031040 2024-09-13T23:05:34.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.914+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x563a20f18a20 2024-09-13T23:05:34.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.914+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf8009050 con 0x563a20f18a20 2024-09-13T23:05:34.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.914+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x7f7cfc031040 2024-09-13T23:05:34.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.914+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf407b070 con 0x7f7cfc031040 2024-09-13T23:05:34.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.914+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x7f7cf8059040 2024-09-13T23:05:34.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.915+0000 7f7d038ad640 1 -- 172.21.15.164:0/145019022 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cfc01f070 con 0x7f7cf8059040 2024-09-13T23:05:34.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.915+0000 7f7d038ad640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x563a20f18a20 2024-09-13T23:05:34.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.915+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf8009050 con 0x563a20f18a20 2024-09-13T23:05:34.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.915+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x7f7cfc031040 2024-09-13T23:05:34.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.915+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf407b070 con 0x7f7cfc031040 2024-09-13T23:05:34.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.915+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x563a20f128e0 2024-09-13T23:05:34.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.915+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7cf407b070 con 0x563a20f128e0 2024-09-13T23:05:34.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.915+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1b4c0 con 0x7f7cf8059040 2024-09-13T23:05:34.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.916+0000 7f7d038ad640 1 -- 172.21.15.164:0/145019022 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cfc01f070 con 0x7f7cf8059040 2024-09-13T23:05:34.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.916+0000 7f7d07321800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:34.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.916+0000 7f7d07321800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:34.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.916+0000 7f7d07321800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:34.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.916+0000 7f7d07321800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:34.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.916+0000 7f7d07321800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:34.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.916+0000 7f7d07321800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:34.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.916+0000 7f7d07321800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.916+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20f174a0 con 0x563a20f128e0 2024-09-13T23:05:34.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.916+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7cf407b070 con 0x563a20f128e0 2024-09-13T23:05:34.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.916+0000 7f7d07321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.916+0000 7f7d07321800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.916+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20f17890 con 0x563a20f128e0 2024-09-13T23:05:34.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.916+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7cf407b070 con 0x563a20f128e0 2024-09-13T23:05:34.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.916+0000 7f7d07321800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:34.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.916+0000 7f7d07321800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.916+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20f17890 con 0x563a20f128e0 2024-09-13T23:05:34.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.916+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7cf407b070 con 0x563a20f128e0 2024-09-13T23:05:34.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.916+0000 7f7d07321800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:34.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.916+0000 7f7d07321800 20 zone default found 2024-09-13T23:05:34.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.916+0000 7f7d07321800 4 Realm: () 2024-09-13T23:05:34.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.916+0000 7f7d07321800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:34.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.916+0000 7f7d07321800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:34.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.916+0000 7f7d07321800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:34.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.916+0000 7f7d07321800 20 zonegroup default 2024-09-13T23:05:34.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.916+0000 7f7d07321800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.916+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20f17cb0 con 0x7f7cfc031040 2024-09-13T23:05:34.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.917+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7cf407b070 con 0x7f7cfc031040 2024-09-13T23:05:34.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.917+0000 7f7d07321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.917+0000 7f7d07321800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.917+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20f17cb0 con 0x563a20f18a20 2024-09-13T23:05:34.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.917+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7cf8009050 con 0x563a20f18a20 2024-09-13T23:05:34.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.917+0000 7f7d07321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.917+0000 7f7d07321800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.917+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1d300 con 0x563a20f18a20 2024-09-13T23:05:34.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.917+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7cf8009050 con 0x563a20f18a20 2024-09-13T23:05:34.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.917+0000 7f7d07321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:34.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.917+0000 7f7d07321800 20 started sync module instance, tier type = 2024-09-13T23:05:34.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.917+0000 7f7d07321800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:34.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.917+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1c7a0 con 0x7f7cf8059040 2024-09-13T23:05:34.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.918+0000 7f7d038ad640 1 -- 172.21.15.164:0/145019022 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cfc040040 con 0x7f7cf8059040 2024-09-13T23:05:34.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.918+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94807660809104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1c400 con 0x7f7cf8059040 2024-09-13T23:05:34.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.918+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1e170 con 0x563a20f128e0 2024-09-13T23:05:34.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.919+0000 7f7d038ad640 1 -- 172.21.15.164:0/145019022 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94807660809104] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cfc040040 con 0x7f7cf8059040 2024-09-13T23:05:34.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.919+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf407b070 con 0x563a20f128e0 2024-09-13T23:05:34.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.919+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94807660811936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1e170 con 0x563a20f128e0 2024-09-13T23:05:34.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.920+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1ebe0 con 0x563a20f18a20 2024-09-13T23:05:34.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.921+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf8009050 con 0x563a20f18a20 2024-09-13T23:05:34.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.921+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94807660816080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1f480 con 0x563a20f18a20 2024-09-13T23:05:34.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.921+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1ff20 con 0x7f7cf8059040 2024-09-13T23:05:34.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.922+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94807660816080] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf8009050 con 0x563a20f18a20 2024-09-13T23:05:34.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.922+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94807660811936] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf407b070 con 0x563a20f128e0 2024-09-13T23:05:34.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.922+0000 7f7d038ad640 1 -- 172.21.15.164:0/145019022 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cfc040040 con 0x7f7cf8059040 2024-09-13T23:05:34.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.922+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94807660813504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a20f1efd0 con 0x7f7cf8059040 2024-09-13T23:05:34.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.922+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a20f20800 con 0x563a20f128e0 2024-09-13T23:05:34.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.923+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf407b070 con 0x563a20f128e0 2024-09-13T23:05:34.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.923+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94807660823312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a20f20790 con 0x563a20f128e0 2024-09-13T23:05:34.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.923+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a20f217b0 con 0x7f7cfc031040 2024-09-13T23:05:34.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.923+0000 7f7d038ad640 1 -- 172.21.15.164:0/145019022 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94807660813504] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cfc040040 con 0x7f7cf8059040 2024-09-13T23:05:34.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.924+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf407b070 con 0x7f7cfc031040 2024-09-13T23:05:34.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.924+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94807660820976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a20f217b0 con 0x7f7cfc031040 2024-09-13T23:05:34.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.924+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a20f221c0 con 0x7f7cfc031040 2024-09-13T23:05:34.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.924+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94807660823312] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf407b070 con 0x563a20f128e0 2024-09-13T23:05:34.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.925+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94807660820976] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf407b070 con 0x7f7cfc031040 2024-09-13T23:05:34.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.925+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf407b070 con 0x7f7cfc031040 2024-09-13T23:05:34.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.925+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94807660827280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a20f21d10 con 0x7f7cfc031040 2024-09-13T23:05:34.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.925+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a20f22a60 con 0x7f7cfc031040 2024-09-13T23:05:34.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.926+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf407b070 con 0x7f7cfc031040 2024-09-13T23:05:34.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.926+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94807660827280] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf407b070 con 0x7f7cfc031040 2024-09-13T23:05:34.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.926+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94807660832176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a20f21d10 con 0x7f7cfc031040 2024-09-13T23:05:34.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.926+0000 7f7d07321800 20 add_watcher() i=0 2024-09-13T23:05:34.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.926+0000 7f7d07321800 20 add_watcher() i=1 2024-09-13T23:05:34.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.926+0000 7f7d07321800 20 add_watcher() i=2 2024-09-13T23:05:34.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.926+0000 7f7d07321800 20 add_watcher() i=3 2024-09-13T23:05:34.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.926+0000 7f7d07321800 20 add_watcher() i=4 2024-09-13T23:05:34.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.926+0000 7f7d07321800 20 add_watcher() i=5 2024-09-13T23:05:34.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.926+0000 7f7d07321800 20 add_watcher() i=6 2024-09-13T23:05:34.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.927+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94807660832176] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf407b070 con 0x7f7cfc031040 2024-09-13T23:05:34.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.927+0000 7f7d07321800 20 add_watcher() i=7 2024-09-13T23:05:34.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.927+0000 7f7d07321800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:34.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.927+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20f25a30 con 0x563a20f128e0 2024-09-13T23:05:34.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.927+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7cf407b070 con 0x563a20f128e0 2024-09-13T23:05:34.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.927+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94807660825488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a20f22ef0 con 0x563a20f128e0 2024-09-13T23:05:34.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.928+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94807660825488] v32'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7cf407b070 con 0x563a20f128e0 2024-09-13T23:05:34.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.928+0000 7f7bb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:34.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.929+0000 7f7d07321800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:34.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.929+0000 7f7d07321800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:34.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.929+0000 7f7d07321800 5 note: GC not initialized 2024-09-13T23:05:34.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.929+0000 7f7bb8fe1640 20 reqs_thread_entry: start 2024-09-13T23:05:34.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.929+0000 7f7d07321800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:34.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.929+0000 7f7d07321800 20 Filter name: none 2024-09-13T23:05:34.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.929+0000 7f7b327fc640 20 reqs_thread_entry: start 2024-09-13T23:05:34.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.929+0000 7f7d07321800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.929+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20f58d20 con 0x7f7cf8059040 2024-09-13T23:05:34.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.930+0000 7f7d038ad640 1 -- 172.21.15.164:0/145019022 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f7cfc040040 con 0x7f7cf8059040 2024-09-13T23:05:34.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.930+0000 7f7d07321800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:05:34.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.930+0000 7f7d07321800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.930+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:63 8.15 8:aa4f46c1:root::.bucket.meta.myfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20f59690 con 0x563a20f18a20 2024-09-13T23:05:34.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.930+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(63 .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f7cf8009050 con 0x563a20f18a20 2024-09-13T23:05:34.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.930+0000 7f7d07321800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:05:34.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.930+0000 7f7d07321800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T23:05:34.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.930+0000 7f7d07321800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.930+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20f5ad60 con 0x7f7cf8059040 2024-09-13T23:05:34.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.930+0000 7f7d038ad640 1 -- 172.21.15.164:0/145019022 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f7cfc040040 con 0x7f7cf8059040 2024-09-13T23:05:34.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.930+0000 7f7d07321800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:05:34.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.930+0000 7f7d07321800 20 rados->read ofs=0 len=0 2024-09-13T23:05:34.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.930+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:65 8.15 8:aa4f46c1:root::.bucket.meta.myfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20f5ad60 con 0x563a20f18a20 2024-09-13T23:05:34.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.931+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(65 .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f7cf8009050 con 0x563a20f18a20 2024-09-13T23:05:34.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.931+0000 7f7d07321800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:05:34.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.931+0000 7f7d07321800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T23:05:34.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.931+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:66 4.14 4:29473231:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20f5a6d0 con 0x563a20f18a20 2024-09-13T23:05:34.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.931+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:67 4.4 4:21c197e9:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20f5f5f0 con 0x7f7cfc031040 2024-09-13T23:05:34.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.931+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:68 4.1c 4:3980393e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20f62090 con 0x7f7cfc031040 2024-09-13T23:05:34.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.931+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:69 4.3c 4:3c3df72e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20f64960 con 0x563a20f128e0 2024-09-13T23:05:34.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.931+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:70 4.37 4:ec9f5977:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20f672e0 con 0x7f7cfc031040 2024-09-13T23:05:34.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.931+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 4.17 4:ea5fb2d4:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20f69d70 con 0x7f7cfc031040 2024-09-13T23:05:34.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.931+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:72 4.30 4:0d33cc25:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20f6c6f0 con 0x563a20f18a20 2024-09-13T23:05:34.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.931+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:73 4.2b 4:d7ffec3e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20f6ef60 con 0x563a20f128e0 2024-09-13T23:05:34.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.931+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 4.3e 4:7f41df37:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20f71810 con 0x7f7cf8059040 2024-09-13T23:05:34.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.931+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:75 4.5 4:a1ee3102:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20f74220 con 0x563a20f18a20 2024-09-13T23:05:34.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.931+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:76 4.30 4:0c251f7e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563a20f74220 con 0x563a20f18a20 2024-09-13T23:05:34.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.931+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(70 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7cf407b070 con 0x7f7cfc031040 2024-09-13T23:05:34.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.931+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(67 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7cf407b070 con 0x7f7cfc031040 2024-09-13T23:05:34.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.931+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(68 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7cf407b070 con 0x7f7cfc031040 2024-09-13T23:05:34.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.931+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(71 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7cf407b070 con 0x7f7cfc031040 2024-09-13T23:05:34.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.931+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(69 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7cf407b070 con 0x563a20f128e0 2024-09-13T23:05:34.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.931+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(66 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7cf8009050 con 0x563a20f18a20 2024-09-13T23:05:34.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.932+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(72 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7cf8009050 con 0x563a20f18a20 2024-09-13T23:05:34.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.932+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(75 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7cf8009050 con 0x563a20f18a20 2024-09-13T23:05:34.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.932+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(73 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7cf407b070 con 0x563a20f128e0 2024-09-13T23:05:34.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.932+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(76 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f7cf8009050 con 0x563a20f18a20 2024-09-13T23:05:34.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.932+0000 7f7d038ad640 1 -- 172.21.15.164:0/145019022 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(74 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7cfc040040 con 0x7f7cf8059040 2024-09-13T23:05:34.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.932+0000 7f7bb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:34.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.932+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94807660825488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a20f56760 con 0x563a20f128e0 2024-09-13T23:05:34.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.933+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94807660825488] v32'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7cf407b070 con 0x563a20f128e0 2024-09-13T23:05:34.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.933+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94807660809104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a20f56760 con 0x7f7cf8059040 2024-09-13T23:05:34.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.934+0000 7f7d038ad640 1 -- 172.21.15.164:0/145019022 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94807660809104] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cfc040040 con 0x7f7cf8059040 2024-09-13T23:05:34.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.934+0000 7f7d07321800 20 remove_watcher() i=0 2024-09-13T23:05:34.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.934+0000 7f7d07321800 2 removed watcher, disabling cache 2024-09-13T23:05:34.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.934+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94807660811936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a20f56760 con 0x563a20f128e0 2024-09-13T23:05:34.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.936+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94807660811936] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf407b070 con 0x563a20f128e0 2024-09-13T23:05:34.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.936+0000 7f7d07321800 20 remove_watcher() i=1 2024-09-13T23:05:34.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.936+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94807660816080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a20f56760 con 0x563a20f18a20 2024-09-13T23:05:34.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.936+0000 7f7d028ab640 1 -- 172.21.15.164:0/145019022 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94807660816080] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf8009050 con 0x563a20f18a20 2024-09-13T23:05:34.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.937+0000 7f7d07321800 20 remove_watcher() i=2 2024-09-13T23:05:34.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.937+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94807660813504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a20f56760 con 0x7f7cf8059040 2024-09-13T23:05:34.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.937+0000 7f7d038ad640 1 -- 172.21.15.164:0/145019022 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94807660813504] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cfc040040 con 0x7f7cf8059040 2024-09-13T23:05:34.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.937+0000 7f7d07321800 20 remove_watcher() i=3 2024-09-13T23:05:34.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.937+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94807660823312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a20f56760 con 0x563a20f128e0 2024-09-13T23:05:34.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.938+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94807660823312] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf407b070 con 0x563a20f128e0 2024-09-13T23:05:34.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.939+0000 7f7d07321800 20 remove_watcher() i=4 2024-09-13T23:05:34.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.939+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94807660820976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a20f56760 con 0x7f7cfc031040 2024-09-13T23:05:34.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.939+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94807660820976] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf407b070 con 0x7f7cfc031040 2024-09-13T23:05:34.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.939+0000 7f7d07321800 20 remove_watcher() i=5 2024-09-13T23:05:34.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.939+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94807660827280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a20f56760 con 0x7f7cfc031040 2024-09-13T23:05:34.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.940+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94807660827280] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf407b070 con 0x7f7cfc031040 2024-09-13T23:05:34.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.940+0000 7f7d07321800 20 remove_watcher() i=6 2024-09-13T23:05:34.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.940+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94807660832176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563a20f56760 con 0x7f7cfc031040 2024-09-13T23:05:34.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.941+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94807660832176] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf407b070 con 0x7f7cfc031040 2024-09-13T23:05:34.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.941+0000 7f7d07321800 20 remove_watcher() i=7 2024-09-13T23:05:34.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.941+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7cfc031040 msgr2=0x7f7cfc032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.941+0000 7f7d07321800 1 --2- 172.21.15.164:0/145019022 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7cfc031040 0x7f7cfc032430 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.941+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563a20f128e0 msgr2=0x563a20f14da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.941+0000 7f7d07321800 1 --2- 172.21.15.164:0/145019022 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563a20f128e0 0x563a20f14da0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.941+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7cf8059040 msgr2=0x7f7cf804f860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.941+0000 7f7d07321800 1 --2- 172.21.15.164:0/145019022 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7cf8059040 0x7f7cf804f860 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.941+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563a20f18a20 msgr2=0x563a20f1ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.941+0000 7f7d07321800 1 --2- 172.21.15.164:0/145019022 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563a20f18a20 0x563a20f1ae10 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.942+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7bcc036b90 msgr2=0x7f7bcc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.942+0000 7f7d07321800 1 --2- 172.21.15.164:0/145019022 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7bcc036b90 0x7f7bcc039050 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x563a20edd750 tx=0x7f7cfc01f000 comp rx=0 tx=0).stop 2024-09-13T23:05:34.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.942+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20effac0 msgr2=0x563a20f06fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.942+0000 7f7d07321800 1 --2- 172.21.15.164:0/145019022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20effac0 0x563a20f06fa0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8019f50 tx=0x7f7cf804cfb0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.942+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 reap_dead start 2024-09-13T23:05:34.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.942+0000 7f7d030ac640 1 -- 172.21.15.164:0/145019022 reap_dead start 2024-09-13T23:05:34.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.942+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 shutdown_connections 2024-09-13T23:05:34.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.942+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 >> 172.21.15.164:0/145019022 conn(0x563a20efbe20 msgr2=0x563a20ef9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:34.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.942+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 shutdown_connections 2024-09-13T23:05:34.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.942+0000 7f7d07321800 1 -- 172.21.15.164:0/145019022 wait complete. 2024-09-13T23:05:34.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.942+0000 7f7d07321800 1 -- 172.21.15.164:0/706903736 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7bdc036b90 msgr2=0x7f7bdc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.942+0000 7f7d07321800 1 --2- 172.21.15.164:0/706903736 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7bdc036b90 0x7f7bdc039050 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x563a20ee1370 tx=0x7f7cfc005840 comp rx=0 tx=0).stop 2024-09-13T23:05:34.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.942+0000 7f7d07321800 1 -- 172.21.15.164:0/706903736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20de2b10 msgr2=0x563a20de1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.942+0000 7f7d07321800 1 --2- 172.21.15.164:0/706903736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20de2b10 0x563a20de1160 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8001ed0 tx=0x7f7cf800d7a0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.942+0000 7f7d07321800 1 -- 172.21.15.164:0/706903736 shutdown_connections 2024-09-13T23:05:34.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.942+0000 7f7d07321800 1 --2- 172.21.15.164:0/706903736 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7bdc036b90 0x7f7bdc039050 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.942+0000 7f7d07321800 1 --2- 172.21.15.164:0/706903736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20de2b10 0x563a20de1160 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.942+0000 7f7d07321800 1 -- 172.21.15.164:0/706903736 >> 172.21.15.164:0/706903736 conn(0x563a20ee5b40 msgr2=0x563a20ee86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:34.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.942+0000 7f7d07321800 1 -- 172.21.15.164:0/706903736 shutdown_connections 2024-09-13T23:05:34.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.942+0000 7f7d07321800 1 -- 172.21.15.164:0/706903736 wait complete. 2024-09-13T23:05:34.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.942+0000 7f7d07321800 1 -- 172.21.15.164:0/3935474048 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563a20de5680 msgr2=0x563a20ee0230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.942+0000 7f7d07321800 1 --2- 172.21.15.164:0/3935474048 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563a20de5680 0x563a20ee0230 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.943+0000 7f7d07321800 1 -- 172.21.15.164:0/3935474048 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7be8036ce0 msgr2=0x7f7be80391a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.943+0000 7f7d07321800 1 --2- 172.21.15.164:0/3935474048 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7be8036ce0 0x7f7be80391a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8000f60 tx=0x7f7cf80012b0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.943+0000 7f7d07321800 1 -- 172.21.15.164:0/3935474048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20d55e90 msgr2=0x563a20ed91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:34.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.943+0000 7f7d07321800 1 --2- 172.21.15.164:0/3935474048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20d55e90 0x563a20ed91c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400a330 tx=0x7f7cf4002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.943+0000 7f7d07321800 1 -- 172.21.15.164:0/3935474048 shutdown_connections 2024-09-13T23:05:34.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.943+0000 7f7d07321800 1 --2- 172.21.15.164:0/3935474048 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563a20de5680 0x563a20ee0230 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.943+0000 7f7d07321800 1 --2- 172.21.15.164:0/3935474048 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7be8036ce0 0x7f7be80391a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.943+0000 7f7d07321800 1 --2- 172.21.15.164:0/3935474048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563a20d55e90 0x563a20ed91c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:34.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.943+0000 7f7d07321800 1 -- 172.21.15.164:0/3935474048 >> 172.21.15.164:0/3935474048 conn(0x563a20ddcdf0 msgr2=0x563a20ecbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:34.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.943+0000 7f7d07321800 1 -- 172.21.15.164:0/3935474048 shutdown_connections 2024-09-13T23:05:34.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:34.943+0000 7f7d07321800 1 -- 172.21.15.164:0/3935474048 wait complete. 2024-09-13T23:05:34.960 INFO:teuthology.orchestra.run.smithi164.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"4d3c0b48-20ce-488a-b409-36cc6d9502d0","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1","marker":"a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-13T23:05:34.305746Z","creation_time":"2024-09-13T23:05:34.302827Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-13T23:05:34.960 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '4d3c0b48-20ce-488a-b409-36cc6d9502d0', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1', 'marker': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T23:05:34.305746Z', 'creation_time': '2024-09-13T23:05:34.302827Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T23:05:34.961 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-13T23:05:34.961 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-13T23:05:34.961 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-13T23:05:35.008 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:35.008 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:35.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.004+0000 7f4c80f39800 1 Processor -- start 2024-09-13T23:05:35.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.004+0000 7f4c80f39800 1 -- start start 2024-09-13T23:05:35.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.004+0000 7f4c80f39800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x555d4ffef8e0 0x555d4fff1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.004+0000 7f4c80f39800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555d4feaab30 con 0x555d4ff5ee10 2024-09-13T23:05:35.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.004+0000 7f4c80f39800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x555d4fe8c360 con 0x555d4ffef8e0 2024-09-13T23:05:35.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.005+0000 7f4c77fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x555d4ffef8e0 0x555d4fff1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.005+0000 7f4c7cbd1640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x555d4ff5ee10 0x555d4ffee1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40920/0 (socket says 172.21.15.164:40920) 2024-09-13T23:05:35.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.005+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/2115749111 learned_addr learned my addr 172.21.15.164:0/2115749111 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:35.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.005+0000 7f4c77fff640 1 -- 172.21.15.164:0/2115749111 >> v1:172.21.15.17:6789/0 conn(0x555d4ff5ee10 legacy=0x555d4ffee1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.005+0000 7f4c77fff640 1 -- 172.21.15.164:0/2115749111 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d4feb2e00 con 0x555d4ffef8e0 2024-09-13T23:05:35.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.007+0000 7f4c77fff640 1 --2- 172.21.15.164:0/2115749111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d4ffef8e0 0x555d4fff1cd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800a470 tx=0x7f4c68045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7cb08ac8658e80 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.007+0000 7f4c777fe640 1 -- 172.21.15.164:0/2115749111 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c68053570 con 0x555d4ffef8e0 2024-09-13T23:05:35.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.007+0000 7f4c777fe640 1 -- 172.21.15.164:0/2115749111 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c68058070 con 0x555d4ffef8e0 2024-09-13T23:05:35.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.007+0000 7f4c777fe640 1 -- 172.21.15.164:0/2115749111 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c68053880 con 0x555d4ffef8e0 2024-09-13T23:05:35.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.007+0000 7f4c80f39800 1 -- 172.21.15.164:0/2115749111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d4ffef8e0 msgr2=0x555d4fff1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.007+0000 7f4c80f39800 1 --2- 172.21.15.164:0/2115749111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d4ffef8e0 0x555d4fff1cd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800a470 tx=0x7f4c68045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:35.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.007+0000 7f4c80f39800 1 -- 172.21.15.164:0/2115749111 shutdown_connections 2024-09-13T23:05:35.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.007+0000 7f4c80f39800 1 --2- 172.21.15.164:0/2115749111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d4ffef8e0 0x555d4fff1cd0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.007+0000 7f4c80f39800 1 -- 172.21.15.164:0/2115749111 >> 172.21.15.164:0/2115749111 conn(0x555d4ffe5df0 msgr2=0x555d4ffe8210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.008+0000 7f4c80f39800 1 -- 172.21.15.164:0/2115749111 shutdown_connections 2024-09-13T23:05:35.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.008+0000 7f4c80f39800 1 -- 172.21.15.164:0/2115749111 wait complete. 2024-09-13T23:05:35.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.021+0000 7f4c80f39800 1 Processor -- start 2024-09-13T23:05:35.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.021+0000 7f4c80f39800 1 -- start start 2024-09-13T23:05:35.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.022+0000 7f4c80f39800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d4ff5ee10 0x555d500da840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.022+0000 7f4c80f39800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x555d4ff37330 con 0x555d4ff5ee10 2024-09-13T23:05:35.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.022+0000 7f4c7cbd1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d4ff5ee10 0x555d500da840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.022+0000 7f4c7cbd1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d4ff5ee10 0x555d500da840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57556/0 (socket says 172.21.15.164:57556) 2024-09-13T23:05:35.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.022+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/3031759141 learned_addr learned my addr 172.21.15.164:0/3031759141 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.022+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/3031759141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d4fe84bc0 con 0x555d4ff5ee10 2024-09-13T23:05:35.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.022+0000 7f4c7cbd1640 1 --2- 172.21.15.164:0/3031759141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d4ff5ee10 0x555d500da840 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4c70001e10 tx=0x7f4c7000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b082a179de6e0bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.023+0000 7f4b6ae05640 1 -- 172.21.15.164:0/3031759141 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c70012020 con 0x555d4ff5ee10 2024-09-13T23:05:35.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.023+0000 7f4b6ae05640 1 -- 172.21.15.164:0/3031759141 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c7000e5a0 con 0x555d4ff5ee10 2024-09-13T23:05:35.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.023+0000 7f4b6ae05640 1 -- 172.21.15.164:0/3031759141 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c7000e8e0 con 0x555d4ff5ee10 2024-09-13T23:05:35.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.023+0000 7f4c80f39800 1 -- 172.21.15.164:0/3031759141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d4ff5ee10 msgr2=0x555d500da840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.023+0000 7f4c80f39800 1 --2- 172.21.15.164:0/3031759141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d4ff5ee10 0x555d500da840 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4c70001e10 tx=0x7f4c7000b780 comp rx=0 tx=0).stop 2024-09-13T23:05:35.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.023+0000 7f4c80f39800 1 -- 172.21.15.164:0/3031759141 shutdown_connections 2024-09-13T23:05:35.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.023+0000 7f4c80f39800 1 --2- 172.21.15.164:0/3031759141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d4ff5ee10 0x555d500da840 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.023+0000 7f4c80f39800 1 -- 172.21.15.164:0/3031759141 >> 172.21.15.164:0/3031759141 conn(0x555d4ffe5df0 msgr2=0x555d500d6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.023+0000 7f4c80f39800 1 -- 172.21.15.164:0/3031759141 shutdown_connections 2024-09-13T23:05:35.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.023+0000 7f4c80f39800 1 -- 172.21.15.164:0/3031759141 wait complete. 2024-09-13T23:05:35.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.024+0000 7f4c80f39800 1 Processor -- start 2024-09-13T23:05:35.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.024+0000 7f4c80f39800 1 -- start start 2024-09-13T23:05:35.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.024+0000 7f4c80f39800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d4ff5ee10 0x555d500e2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.024+0000 7f4c80f39800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x555d4fff2600 con 0x555d4ff5ee10 2024-09-13T23:05:35.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.024+0000 7f4c7cbd1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d4ff5ee10 0x555d500e2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.024+0000 7f4c7cbd1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d4ff5ee10 0x555d500e2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57564/0 (socket says 172.21.15.164:57564) 2024-09-13T23:05:35.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.024+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/2762149751 learned_addr learned my addr 172.21.15.164:0/2762149751 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.024+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/2762149751 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d4fe98fe0 con 0x555d4ff5ee10 2024-09-13T23:05:35.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.024+0000 7f4c7cbd1640 1 --2- 172.21.15.164:0/2762149751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d4ff5ee10 0x555d500e2210 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000b7c0 tx=0x7f4c70000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.025+0000 7f4b69602640 1 -- 172.21.15.164:0/2762149751 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c70012030 con 0x555d4ff5ee10 2024-09-13T23:05:35.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.025+0000 7f4b69602640 1 -- 172.21.15.164:0/2762149751 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c70001470 con 0x555d4ff5ee10 2024-09-13T23:05:35.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.025+0000 7f4c80f39800 1 -- 172.21.15.164:0/2762149751 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d500e2750 con 0x555d4ff5ee10 2024-09-13T23:05:35.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.025+0000 7f4b69602640 1 -- 172.21.15.164:0/2762149751 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c7001a8d0 con 0x555d4ff5ee10 2024-09-13T23:05:35.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.025+0000 7f4c80f39800 1 -- 172.21.15.164:0/2762149751 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d500e2c70 con 0x555d4ff5ee10 2024-09-13T23:05:35.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.025+0000 7f4b69602640 1 -- 172.21.15.164:0/2762149751 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4c70015020 con 0x555d4ff5ee10 2024-09-13T23:05:35.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.026+0000 7f4b69602640 1 --2- 172.21.15.164:0/2762149751 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4b64036b90 0x7f4b64039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.026+0000 7f4b69602640 1 -- 172.21.15.164:0/2762149751 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4c70020030 con 0x555d4ff5ee10 2024-09-13T23:05:35.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.026+0000 7f4c77fff640 1 --2- 172.21.15.164:0/2762149751 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4b64036b90 0x7f4b64039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.026+0000 7f4c80f39800 1 --2- 172.21.15.164:0/2762149751 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x555d4ffef8e0 0x555d500e9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.026+0000 7f4c80f39800 1 -- 172.21.15.164:0/2762149751 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d500e97c0 con 0x555d4ffef8e0 2024-09-13T23:05:35.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.026+0000 7f4c7d3d2640 1 --2- 172.21.15.164:0/2762149751 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x555d4ffef8e0 0x555d500e9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.026+0000 7f4c77fff640 1 --2- 172.21.15.164:0/2762149751 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4b64036b90 0x7f4b64039050 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4c68057000 tx=0x7f4c68052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.026+0000 7f4c7d3d2640 1 --2- 172.21.15.164:0/2762149751 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x555d4ffef8e0 0x555d500e9280 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.026+0000 7f4c7d3d2640 1 -- 172.21.15.164:0/2762149751 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c7800a4a0 con 0x555d4ffef8e0 2024-09-13T23:05:35.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.027+0000 7f4c80f39800 1 -- 172.21.15.164:0/2762149751 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d500e6850 con 0x555d4ffef8e0 2024-09-13T23:05:35.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.027+0000 7f4c7d3d2640 1 -- 172.21.15.164:0/2762149751 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4c7800a4a0 con 0x555d4ffef8e0 2024-09-13T23:05:35.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.027+0000 7f4c80f39800 1 -- 172.21.15.164:0/2762149751 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d500eb600 con 0x555d4ffef8e0 2024-09-13T23:05:35.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.027+0000 7f4c7d3d2640 1 -- 172.21.15.164:0/2762149751 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4c7800a4a0 con 0x555d4ffef8e0 2024-09-13T23:05:35.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.027+0000 7f4c80f39800 1 -- 172.21.15.164:0/2762149751 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d500ea830 con 0x555d4ffef8e0 2024-09-13T23:05:35.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.027+0000 7f4c7d3d2640 1 -- 172.21.15.164:0/2762149751 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4c7800a4a0 con 0x555d4ffef8e0 2024-09-13T23:05:35.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.027+0000 7f4c80f39800 1 -- 172.21.15.164:0/2762149751 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d500eac80 con 0x555d4ffef8e0 2024-09-13T23:05:35.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.028+0000 7f4c7d3d2640 1 -- 172.21.15.164:0/2762149751 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4c7800a4a0 con 0x555d4ffef8e0 2024-09-13T23:05:35.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.028+0000 7f4c80f39800 1 Processor -- start 2024-09-13T23:05:35.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.028+0000 7f4c80f39800 1 -- start start 2024-09-13T23:05:35.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.028+0000 7f4c80f39800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d500f9c10 0x555d500fa030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.028+0000 7f4c80f39800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x555d4fe86580 con 0x555d500f9c10 2024-09-13T23:05:35.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.028+0000 7f4c77fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d500f9c10 0x555d500fa030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.028+0000 7f4c77fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d500f9c10 0x555d500fa030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57580/0 (socket says 172.21.15.164:57580) 2024-09-13T23:05:35.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.028+0000 7f4c77fff640 1 -- 172.21.15.164:0/4293319280 learned_addr learned my addr 172.21.15.164:0/4293319280 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.029+0000 7f4c77fff640 1 -- 172.21.15.164:0/4293319280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d500fa570 con 0x555d500f9c10 2024-09-13T23:05:35.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.029+0000 7f4c77fff640 1 --2- 172.21.15.164:0/4293319280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d500f9c10 0x555d500fa030 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4c68045f50 tx=0x7f4c68002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.029+0000 7f4b627fc640 1 -- 172.21.15.164:0/4293319280 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c6806f070 con 0x555d500f9c10 2024-09-13T23:05:35.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.029+0000 7f4c80f39800 1 -- 172.21.15.164:0/4293319280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d500fa7a0 con 0x555d500f9c10 2024-09-13T23:05:35.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.029+0000 7f4b627fc640 1 -- 172.21.15.164:0/4293319280 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c6805f550 con 0x555d500f9c10 2024-09-13T23:05:35.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.029+0000 7f4b627fc640 1 -- 172.21.15.164:0/4293319280 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c6805f830 con 0x555d500f9c10 2024-09-13T23:05:35.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.029+0000 7f4c80f39800 1 -- 172.21.15.164:0/4293319280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d500fd420 con 0x555d500f9c10 2024-09-13T23:05:35.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.030+0000 7f4b627fc640 1 -- 172.21.15.164:0/4293319280 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4c6805f9d0 con 0x555d500f9c10 2024-09-13T23:05:35.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.030+0000 7f4b627fc640 1 --2- 172.21.15.164:0/4293319280 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4b54036b40 0x7f4b54039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.030+0000 7f4b627fc640 1 -- 172.21.15.164:0/4293319280 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4c68092cc0 con 0x555d500f9c10 2024-09-13T23:05:35.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.030+0000 7f4c7d3d2640 1 --2- 172.21.15.164:0/4293319280 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4b54036b40 0x7f4b54039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.030+0000 7f4c80f39800 1 Processor -- start 2024-09-13T23:05:35.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.030+0000 7f4c7d3d2640 1 --2- 172.21.15.164:0/4293319280 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4b54036b40 0x7f4b54039000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x555d500ea350 tx=0x7f4c78005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.030+0000 7f4c80f39800 1 -- start start 2024-09-13T23:05:35.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.031+0000 7f4c80f39800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d50106800 0x555d50106c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.031+0000 7f4c80f39800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x555d500daff0 con 0x555d50106800 2024-09-13T23:05:35.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.031+0000 7f4c77fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d50106800 0x555d50106c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.031+0000 7f4c77fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d50106800 0x555d50106c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57594/0 (socket says 172.21.15.164:57594) 2024-09-13T23:05:35.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.031+0000 7f4c77fff640 1 -- 172.21.15.164:0/3877723030 learned_addr learned my addr 172.21.15.164:0/3877723030 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.031+0000 7f4c77fff640 1 -- 172.21.15.164:0/3877723030 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d501071d0 con 0x555d50106800 2024-09-13T23:05:35.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.031+0000 7f4c77fff640 1 --2- 172.21.15.164:0/3877723030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d50106800 0x555d50106c00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4c680059a0 tx=0x7f4c6806baa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d0b1da43595370 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.031+0000 7f4b53fff640 1 -- 172.21.15.164:0/3877723030 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c6805fdf0 con 0x555d50106800 2024-09-13T23:05:35.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.031+0000 7f4b53fff640 1 -- 172.21.15.164:0/3877723030 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c6806a3a0 con 0x555d50106800 2024-09-13T23:05:35.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.031+0000 7f4b53fff640 1 -- 172.21.15.164:0/3877723030 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c68000ed0 con 0x555d50106800 2024-09-13T23:05:35.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.032+0000 7f4c80f39800 1 -- 172.21.15.164:0/3877723030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d50106800 msgr2=0x555d50106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.032+0000 7f4c80f39800 1 --2- 172.21.15.164:0/3877723030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d50106800 0x555d50106c00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4c680059a0 tx=0x7f4c6806baa0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.032+0000 7f4c80f39800 1 -- 172.21.15.164:0/3877723030 shutdown_connections 2024-09-13T23:05:35.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.032+0000 7f4c80f39800 1 --2- 172.21.15.164:0/3877723030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d50106800 0x555d50106c00 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.032+0000 7f4c80f39800 1 -- 172.21.15.164:0/3877723030 >> 172.21.15.164:0/3877723030 conn(0x555d50102b60 msgr2=0x555d50100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.032+0000 7f4c80f39800 1 -- 172.21.15.164:0/3877723030 shutdown_connections 2024-09-13T23:05:35.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.032+0000 7f4c80f39800 1 -- 172.21.15.164:0/3877723030 wait complete. 2024-09-13T23:05:35.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.032+0000 7f4c80f39800 1 Processor -- start 2024-09-13T23:05:35.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.032+0000 7f4c80f39800 1 -- start start 2024-09-13T23:05:35.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.033+0000 7f4c80f39800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d50106800 0x555d5010dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.033+0000 7f4c80f39800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x555d50107840 con 0x555d50106800 2024-09-13T23:05:35.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.033+0000 7f4c77fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d50106800 0x555d5010dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.033+0000 7f4c77fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d50106800 0x555d5010dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57596/0 (socket says 172.21.15.164:57596) 2024-09-13T23:05:35.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.033+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 learned_addr learned my addr 172.21.15.164:0/24861946 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.033+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d5010e200 con 0x555d50106800 2024-09-13T23:05:35.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.033+0000 7f4c77fff640 1 --2- 172.21.15.164:0/24861946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d50106800 0x555d5010dcc0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4c6808ff80 tx=0x7f4c68091040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.033+0000 7f4b527fc640 1 -- 172.21.15.164:0/24861946 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c680695d0 con 0x555d50106800 2024-09-13T23:05:35.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.033+0000 7f4b527fc640 1 -- 172.21.15.164:0/24861946 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c68069770 con 0x555d50106800 2024-09-13T23:05:35.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.033+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d5010e490 con 0x555d50106800 2024-09-13T23:05:35.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.033+0000 7f4b527fc640 1 -- 172.21.15.164:0/24861946 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c68069a50 con 0x555d50106800 2024-09-13T23:05:35.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.033+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d50111140 con 0x555d50106800 2024-09-13T23:05:35.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.034+0000 7f4b527fc640 1 -- 172.21.15.164:0/24861946 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4c6807c3f0 con 0x555d50106800 2024-09-13T23:05:35.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.034+0000 7f4b527fc640 1 --2- 172.21.15.164:0/24861946 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4b48036b90 0x7f4b48039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.034+0000 7f4b527fc640 1 -- 172.21.15.164:0/24861946 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4c68086c60 con 0x555d50106800 2024-09-13T23:05:35.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.034+0000 7f4c7d3d2640 1 --2- 172.21.15.164:0/24861946 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4b48036b90 0x7f4b48039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.035+0000 7f4c80f39800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.035+0000 7f4c80f39800 1 --2- 172.21.15.164:0/24861946 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x555d501197b0 0x555d5011bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.035+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d5011c3c0 con 0x555d501197b0 2024-09-13T23:05:35.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.035+0000 7f4c7cbd1640 1 --2- 172.21.15.164:0/24861946 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x555d501197b0 0x555d5011bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.035+0000 7f4c7d3d2640 1 --2- 172.21.15.164:0/24861946 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4b48036b90 0x7f4b48039050 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x555d500e67a0 tx=0x7f4c7801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.035+0000 7f4c7cbd1640 1 --2- 172.21.15.164:0/24861946 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x555d501197b0 0x555d5011bc70 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.035+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.035+0000 7f4c80f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.035+0000 7f4c80f39800 20 realm 2024-09-13T23:05:35.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.035+0000 7f4c80f39800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.035+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d5011c7d0 con 0x555d501197b0 2024-09-13T23:05:35.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.036+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.036+0000 7f4c80f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.036+0000 7f4c80f39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:35.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.036+0000 7f4c80f39800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.036+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d0a0 con 0x555d501197b0 2024-09-13T23:05:35.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.036+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.036+0000 7f4c80f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.036+0000 7f4c80f39800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.036+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d440 con 0x555d501197b0 2024-09-13T23:05:35.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.036+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.036+0000 7f4c80f39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:35.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.036+0000 7f4c80f39800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.036+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x555d501197b0 2024-09-13T23:05:35.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.036+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.036+0000 7f4c80f39800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:35.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.036+0000 7f4c80f39800 20 searching for the correct realm 2024-09-13T23:05:35.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.036+0000 7f4c80f39800 1 --2- 172.21.15.164:0/24861946 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x555d5011f890 0x555d50121ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.036+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d501223b0 con 0x555d5011f890 2024-09-13T23:05:35.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.036+0000 7f4c77fff640 1 --2- 172.21.15.164:0/24861946 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x555d5011f890 0x555d50121ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.037+0000 7f4c77fff640 1 --2- 172.21.15.164:0/24861946 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x555d5011f890 0x555d50121ce0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.037+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c68098070 con 0x555d5011f890 2024-09-13T23:05:35.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.037+0000 7f4c77fff640 1 --2- 172.21.15.164:0/24861946 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f4c68085020 0x7f4c68073410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.037+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d501223b0 con 0x7f4c68085020 2024-09-13T23:05:35.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.037+0000 7f4c7d3d2640 1 --2- 172.21.15.164:0/24861946 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f4c68085020 0x7f4c68073410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.037+0000 7f4c7d3d2640 1 --2- 172.21.15.164:0/24861946 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f4c68085020 0x7f4c68073410 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.038+0000 7f4c7d3d2640 1 -- 172.21.15.164:0/24861946 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7801f070 con 0x7f4c68085020 2024-09-13T23:05:35.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.038+0000 7f4c7d3d2640 1 --2- 172.21.15.164:0/24861946 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f4c78031040 0x7f4c78032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.038+0000 7f4c7d3d2640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d501223b0 con 0x7f4c78031040 2024-09-13T23:05:35.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.038+0000 7f4c7cbd1640 1 --2- 172.21.15.164:0/24861946 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f4c78031040 0x7f4c78032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.038+0000 7f4c7cbd1640 1 --2- 172.21.15.164:0/24861946 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f4c78031040 0x7f4c78032940 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.038+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c70018950 con 0x7f4c78031040 2024-09-13T23:05:35.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.038+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x555d501197b0 2024-09-13T23:05:35.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.039+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.039+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x555d501197b0 2024-09-13T23:05:35.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.039+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.039+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x7f4c78031040 2024-09-13T23:05:35.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.039+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c70018950 con 0x7f4c78031040 2024-09-13T23:05:35.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.039+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x7f4c78031040 2024-09-13T23:05:35.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.039+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c70018950 con 0x7f4c78031040 2024-09-13T23:05:35.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.039+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x7f4c68085020 2024-09-13T23:05:35.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.039+0000 7f4c7d3d2640 1 -- 172.21.15.164:0/24861946 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7801f070 con 0x7f4c68085020 2024-09-13T23:05:35.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.040+0000 7f4c7d3d2640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x555d5011f890 2024-09-13T23:05:35.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.040+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c68098070 con 0x555d5011f890 2024-09-13T23:05:35.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.040+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x555d501197b0 2024-09-13T23:05:35.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.040+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.040+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x7f4c78031040 2024-09-13T23:05:35.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.040+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c70018950 con 0x7f4c78031040 2024-09-13T23:05:35.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.040+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x555d501197b0 2024-09-13T23:05:35.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.040+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.040+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x7f4c68085020 2024-09-13T23:05:35.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.041+0000 7f4c7d3d2640 1 -- 172.21.15.164:0/24861946 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4c7801f070 con 0x7f4c68085020 2024-09-13T23:05:35.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.041+0000 7f4c7d3d2640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x555d5011f890 2024-09-13T23:05:35.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.041+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c68098070 con 0x555d5011f890 2024-09-13T23:05:35.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.041+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x555d5011f890 2024-09-13T23:05:35.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.041+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c68098070 con 0x555d5011f890 2024-09-13T23:05:35.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.041+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x7f4c78031040 2024-09-13T23:05:35.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.041+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c70018950 con 0x7f4c78031040 2024-09-13T23:05:35.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.041+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x555d5011f890 2024-09-13T23:05:35.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.041+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c68098070 con 0x555d5011f890 2024-09-13T23:05:35.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.042+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x555d5011f890 2024-09-13T23:05:35.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.042+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c68098070 con 0x555d5011f890 2024-09-13T23:05:35.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.042+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x555d501197b0 2024-09-13T23:05:35.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.042+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.042+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x555d501197b0 2024-09-13T23:05:35.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.042+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.042+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x7f4c78031040 2024-09-13T23:05:35.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.042+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c70018950 con 0x7f4c78031040 2024-09-13T23:05:35.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.042+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x555d5011f890 2024-09-13T23:05:35.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.043+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c68098070 con 0x555d5011f890 2024-09-13T23:05:35.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.043+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x7f4c68085020 2024-09-13T23:05:35.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.043+0000 7f4c7d3d2640 1 -- 172.21.15.164:0/24861946 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7801f070 con 0x7f4c68085020 2024-09-13T23:05:35.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.043+0000 7f4c7d3d2640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x555d501197b0 2024-09-13T23:05:35.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.043+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.043+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x7f4c78031040 2024-09-13T23:05:35.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.043+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c70018950 con 0x7f4c78031040 2024-09-13T23:05:35.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.043+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x555d5011f890 2024-09-13T23:05:35.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.044+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c68098070 con 0x555d5011f890 2024-09-13T23:05:35.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.044+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x7f4c78031040 2024-09-13T23:05:35.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.044+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c70018950 con 0x7f4c78031040 2024-09-13T23:05:35.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.044+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x7f4c68085020 2024-09-13T23:05:35.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.044+0000 7f4c7d3d2640 1 -- 172.21.15.164:0/24861946 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7801f070 con 0x7f4c68085020 2024-09-13T23:05:35.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.044+0000 7f4c7d3d2640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x555d5011f890 2024-09-13T23:05:35.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.044+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c68098070 con 0x555d5011f890 2024-09-13T23:05:35.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.044+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x7f4c78031040 2024-09-13T23:05:35.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.045+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c70018950 con 0x7f4c78031040 2024-09-13T23:05:35.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.045+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x555d501197b0 2024-09-13T23:05:35.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.045+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.045+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4c7005f040 con 0x7f4c68085020 2024-09-13T23:05:35.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.045+0000 7f4c7d3d2640 1 -- 172.21.15.164:0/24861946 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7801f070 con 0x7f4c68085020 2024-09-13T23:05:35.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.045+0000 7f4c80f39800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:35.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.045+0000 7f4c80f39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:35.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.045+0000 7f4c80f39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:35.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.045+0000 7f4c80f39800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:35.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.045+0000 7f4c80f39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:35.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.045+0000 7f4c80f39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:35.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.045+0000 7f4c80f39800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.045+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d5011d8a0 con 0x555d501197b0 2024-09-13T23:05:35.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.045+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.045+0000 7f4c80f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.045+0000 7f4c80f39800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.045+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d5011e1b0 con 0x555d501197b0 2024-09-13T23:05:35.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.046+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.046+0000 7f4c80f39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:35.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.046+0000 7f4c80f39800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.046+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d5011e1b0 con 0x555d501197b0 2024-09-13T23:05:35.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.046+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.046+0000 7f4c80f39800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:35.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.046+0000 7f4c80f39800 20 zone default found 2024-09-13T23:05:35.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.046+0000 7f4c80f39800 4 Realm: () 2024-09-13T23:05:35.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.046+0000 7f4c80f39800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:35.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.046+0000 7f4c80f39800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:35.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.046+0000 7f4c80f39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:35.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.046+0000 7f4c80f39800 20 zonegroup default 2024-09-13T23:05:35.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.046+0000 7f4c80f39800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.046+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d5011e5d0 con 0x7f4c78031040 2024-09-13T23:05:35.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.046+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4c70018950 con 0x7f4c78031040 2024-09-13T23:05:35.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.046+0000 7f4c80f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.046+0000 7f4c80f39800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.046+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d5011e9f0 con 0x555d5011f890 2024-09-13T23:05:35.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.047+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4c68098070 con 0x555d5011f890 2024-09-13T23:05:35.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.047+0000 7f4c80f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.047+0000 7f4c80f39800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.047+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d50124210 con 0x555d5011f890 2024-09-13T23:05:35.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.047+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4c68098070 con 0x555d5011f890 2024-09-13T23:05:35.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.047+0000 7f4c80f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.047+0000 7f4c80f39800 20 started sync module instance, tier type = 2024-09-13T23:05:35.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.047+0000 7f4c80f39800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:35.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.047+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d501236b0 con 0x7f4c68085020 2024-09-13T23:05:35.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.048+0000 7f4c7d3d2640 1 -- 172.21.15.164:0/24861946 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c78040040 con 0x7f4c68085020 2024-09-13T23:05:35.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.048+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93859263689216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d501245b0 con 0x7f4c68085020 2024-09-13T23:05:35.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.048+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d50124e00 con 0x555d501197b0 2024-09-13T23:05:35.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.049+0000 7f4c7d3d2640 1 -- 172.21.15.164:0/24861946 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93859263689216] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c78040040 con 0x7f4c68085020 2024-09-13T23:05:35.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.049+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.049+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93859263694256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d50124e80 con 0x555d501197b0 2024-09-13T23:05:35.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.050+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d50125710 con 0x555d5011f890 2024-09-13T23:05:35.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.051+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93859263694256] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.051+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c68098070 con 0x555d5011f890 2024-09-13T23:05:35.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.051+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93859263695792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d50125b00 con 0x555d5011f890 2024-09-13T23:05:35.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.051+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d50126500 con 0x7f4c68085020 2024-09-13T23:05:35.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.052+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93859263695792] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c68098070 con 0x555d5011f890 2024-09-13T23:05:35.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.052+0000 7f4c7d3d2640 1 -- 172.21.15.164:0/24861946 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c78040040 con 0x7f4c68085020 2024-09-13T23:05:35.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.052+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93859263697040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d50126920 con 0x7f4c68085020 2024-09-13T23:05:35.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.052+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d50127340 con 0x555d501197b0 2024-09-13T23:05:35.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.053+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.053+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93859263704624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d50127300 con 0x555d501197b0 2024-09-13T23:05:35.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.053+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d501282f0 con 0x7f4c78031040 2024-09-13T23:05:35.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.053+0000 7f4c7d3d2640 1 -- 172.21.15.164:0/24861946 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93859263697040] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c78040040 con 0x7f4c68085020 2024-09-13T23:05:35.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.054+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c70018950 con 0x7f4c78031040 2024-09-13T23:05:35.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.054+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93859263704624] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.054+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93859263708672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d501282f0 con 0x7f4c78031040 2024-09-13T23:05:35.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.054+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d50127650 con 0x7f4c78031040 2024-09-13T23:05:35.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.055+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93859263708672] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c70018950 con 0x7f4c78031040 2024-09-13T23:05:35.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.055+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c70018950 con 0x7f4c78031040 2024-09-13T23:05:35.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.055+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93859263701008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d50128880 con 0x7f4c78031040 2024-09-13T23:05:35.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.055+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d50129240 con 0x7f4c78031040 2024-09-13T23:05:35.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.056+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93859263701008] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c70018950 con 0x7f4c78031040 2024-09-13T23:05:35.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.056+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c70018950 con 0x7f4c78031040 2024-09-13T23:05:35.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.056+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93859263706704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d50129240 con 0x7f4c78031040 2024-09-13T23:05:35.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.056+0000 7f4c80f39800 20 add_watcher() i=0 2024-09-13T23:05:35.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.056+0000 7f4c80f39800 20 add_watcher() i=1 2024-09-13T23:05:35.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.056+0000 7f4c80f39800 20 add_watcher() i=2 2024-09-13T23:05:35.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.056+0000 7f4c80f39800 20 add_watcher() i=3 2024-09-13T23:05:35.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.056+0000 7f4c80f39800 20 add_watcher() i=4 2024-09-13T23:05:35.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.056+0000 7f4c80f39800 20 add_watcher() i=5 2024-09-13T23:05:35.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.056+0000 7f4c80f39800 20 add_watcher() i=6 2024-09-13T23:05:35.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.057+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93859263706704] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c70018950 con 0x7f4c78031040 2024-09-13T23:05:35.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.057+0000 7f4c80f39800 20 add_watcher() i=7 2024-09-13T23:05:35.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.057+0000 7f4c80f39800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:35.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.057+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d5012c550 con 0x555d501197b0 2024-09-13T23:05:35.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.057+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.057+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93859263713024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d501297d0 con 0x555d501197b0 2024-09-13T23:05:35.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.058+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93859263713024] v32'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.058+0000 7f4b32fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:35.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.058+0000 7f4c80f39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:35.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.058+0000 7f4c80f39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:35.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.058+0000 7f4c80f39800 5 note: GC not initialized 2024-09-13T23:05:35.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.058+0000 7f4b31fe3640 20 reqs_thread_entry: start 2024-09-13T23:05:35.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.058+0000 7f4c80f39800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:35.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.059+0000 7f4c80f39800 20 Filter name: none 2024-09-13T23:05:35.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.059+0000 7f4aa37fe640 20 reqs_thread_entry: start 2024-09-13T23:05:35.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.059+0000 7f4c80f39800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.059+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d5015f4f0 con 0x555d501197b0 2024-09-13T23:05:35.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.059+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.059+0000 7f4c80f39800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:05:35.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.059+0000 7f4c80f39800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.059+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d5015fee0 con 0x555d501197b0 2024-09-13T23:05:35.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.059+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.059+0000 7f4c80f39800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:05:35.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.059+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d50160ef0 con 0x7f4c68085020 2024-09-13T23:05:35.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.060+0000 7f4c7d3d2640 1 -- 172.21.15.164:0/24861946 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f4c78040040 con 0x7f4c68085020 2024-09-13T23:05:35.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.060+0000 7f4c80f39800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.060+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d5015e680 con 0x7f4c68085020 2024-09-13T23:05:35.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.060+0000 7f4c7d3d2640 1 -- 172.21.15.164:0/24861946 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4c78040040 con 0x7f4c68085020 2024-09-13T23:05:35.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.060+0000 7f4c80f39800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:05:35.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.060+0000 7f4c80f39800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.060+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:66 8.15 8:aa4f46c1:root::.bucket.meta.myfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d50160be0 con 0x555d5011f890 2024-09-13T23:05:35.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.060+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(66 .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4c68098070 con 0x555d5011f890 2024-09-13T23:05:35.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.060+0000 7f4c80f39800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:05:35.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.060+0000 7f4c80f39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T23:05:35.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.060+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 4.14 4:29473231:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d50160170 con 0x555d5011f890 2024-09-13T23:05:35.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.060+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:68 4.4 4:21c197e9:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d50165770 con 0x7f4c78031040 2024-09-13T23:05:35.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.061+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 4.1c 4:3980393e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d50168080 con 0x7f4c78031040 2024-09-13T23:05:35.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.061+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:70 4.3c 4:3c3df72e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d5016ad70 con 0x555d501197b0 2024-09-13T23:05:35.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.061+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 4.37 4:ec9f5977:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d5016dc30 con 0x7f4c78031040 2024-09-13T23:05:35.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.061+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 4.17 4:ea5fb2d4:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d50170af0 con 0x7f4c78031040 2024-09-13T23:05:35.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.061+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:73 4.30 4:0d33cc25:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d50173960 con 0x555d5011f890 2024-09-13T23:05:35.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.061+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:74 4.2b 4:d7ffec3e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d501767d0 con 0x555d501197b0 2024-09-13T23:05:35.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.061+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:75 4.3e 4:7f41df37:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d50165770 con 0x7f4c68085020 2024-09-13T23:05:35.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.061+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(67 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4c68098070 con 0x555d5011f890 2024-09-13T23:05:35.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.061+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:76 4.5 4:a1ee3102:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d50170af0 con 0x555d5011f890 2024-09-13T23:05:35.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.061+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:77 4.30 4:0c251f7e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d501767d0 con 0x555d5011f890 2024-09-13T23:05:35.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.061+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(73 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4c68098070 con 0x555d5011f890 2024-09-13T23:05:35.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.061+0000 7f4c7d3d2640 1 -- 172.21.15.164:0/24861946 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(75 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4c78040040 con 0x7f4c68085020 2024-09-13T23:05:35.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.061+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(70 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.061+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(74 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.061+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(68 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4c70018950 con 0x7f4c78031040 2024-09-13T23:05:35.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.061+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(76 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4c68098070 con 0x555d5011f890 2024-09-13T23:05:35.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.061+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(71 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4c70018950 con 0x7f4c78031040 2024-09-13T23:05:35.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.061+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(77 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f4c68098070 con 0x555d5011f890 2024-09-13T23:05:35.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.061+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(69 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4c70018950 con 0x7f4c78031040 2024-09-13T23:05:35.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.061+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(72 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4c70018950 con 0x7f4c78031040 2024-09-13T23:05:35.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.062+0000 7f4b32fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:35.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.062+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93859263713024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d5015d300 con 0x555d501197b0 2024-09-13T23:05:35.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.063+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 93859263713024] v32'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.063+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93859263689216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d5015d300 con 0x7f4c68085020 2024-09-13T23:05:35.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.064+0000 7f4c7d3d2640 1 -- 172.21.15.164:0/24861946 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 93859263689216] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c78040040 con 0x7f4c68085020 2024-09-13T23:05:35.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.064+0000 7f4c80f39800 20 remove_watcher() i=0 2024-09-13T23:05:35.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.064+0000 7f4c80f39800 2 removed watcher, disabling cache 2024-09-13T23:05:35.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.064+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93859263694256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d5015d300 con 0x555d501197b0 2024-09-13T23:05:35.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.065+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 93859263694256] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.065+0000 7f4c80f39800 20 remove_watcher() i=1 2024-09-13T23:05:35.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.065+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93859263695792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d5015d300 con 0x555d5011f890 2024-09-13T23:05:35.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.066+0000 7f4c77fff640 1 -- 172.21.15.164:0/24861946 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 93859263695792] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c68098070 con 0x555d5011f890 2024-09-13T23:05:35.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.066+0000 7f4c80f39800 20 remove_watcher() i=2 2024-09-13T23:05:35.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.066+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93859263697040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d5015d300 con 0x7f4c68085020 2024-09-13T23:05:35.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.067+0000 7f4c7d3d2640 1 -- 172.21.15.164:0/24861946 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 93859263697040] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c78040040 con 0x7f4c68085020 2024-09-13T23:05:35.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.067+0000 7f4c80f39800 20 remove_watcher() i=3 2024-09-13T23:05:35.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.067+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93859263704624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d5015d300 con 0x555d501197b0 2024-09-13T23:05:35.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.069+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 93859263704624] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c70018950 con 0x555d501197b0 2024-09-13T23:05:35.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.069+0000 7f4c80f39800 20 remove_watcher() i=4 2024-09-13T23:05:35.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.069+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93859263708672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d5015d300 con 0x7f4c78031040 2024-09-13T23:05:35.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.069+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 93859263708672] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c70018950 con 0x7f4c78031040 2024-09-13T23:05:35.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.069+0000 7f4c80f39800 20 remove_watcher() i=5 2024-09-13T23:05:35.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.070+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93859263701008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d5015d300 con 0x7f4c78031040 2024-09-13T23:05:35.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.070+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 93859263701008] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c70018950 con 0x7f4c78031040 2024-09-13T23:05:35.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.070+0000 7f4c80f39800 20 remove_watcher() i=6 2024-09-13T23:05:35.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.070+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93859263706704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d5015d300 con 0x7f4c78031040 2024-09-13T23:05:35.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.071+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 93859263706704] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c70018950 con 0x7f4c78031040 2024-09-13T23:05:35.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.071+0000 7f4c80f39800 20 remove_watcher() i=7 2024-09-13T23:05:35.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.071+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f4c78031040 msgr2=0x7f4c78032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.071+0000 7f4c80f39800 1 --2- 172.21.15.164:0/24861946 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f4c78031040 0x7f4c78032940 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.072+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x555d501197b0 msgr2=0x555d5011bc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.072+0000 7f4c80f39800 1 --2- 172.21.15.164:0/24861946 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x555d501197b0 0x555d5011bc70 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.072+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f4c68085020 msgr2=0x7f4c68073410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.072+0000 7f4c80f39800 1 --2- 172.21.15.164:0/24861946 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f4c68085020 0x7f4c68073410 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.072+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x555d5011f890 msgr2=0x555d50121ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.072+0000 7f4c80f39800 1 --2- 172.21.15.164:0/24861946 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x555d5011f890 0x555d50121ce0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.072+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4b48036b90 msgr2=0x7f4b48039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.072+0000 7f4c80f39800 1 --2- 172.21.15.164:0/24861946 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4b48036b90 0x7f4b48039050 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x555d500e67a0 tx=0x7f4c7801f000 comp rx=0 tx=0).stop 2024-09-13T23:05:35.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.072+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d50106800 msgr2=0x555d5010dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.072+0000 7f4c80f39800 1 --2- 172.21.15.164:0/24861946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d50106800 0x555d5010dcc0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4c6808ff80 tx=0x7f4c68091040 comp rx=0 tx=0).stop 2024-09-13T23:05:35.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.072+0000 7f4c7cbd1640 1 -- 172.21.15.164:0/24861946 reap_dead start 2024-09-13T23:05:35.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.072+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 shutdown_connections 2024-09-13T23:05:35.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.072+0000 7f4c80f39800 1 --2- 172.21.15.164:0/24861946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d50106800 0x555d5010dcc0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.072+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 >> 172.21.15.164:0/24861946 conn(0x555d50102b60 msgr2=0x555d50100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.072+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 shutdown_connections 2024-09-13T23:05:35.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.072+0000 7f4c80f39800 1 -- 172.21.15.164:0/24861946 wait complete. 2024-09-13T23:05:35.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.072+0000 7f4c80f39800 1 -- 172.21.15.164:0/4293319280 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4b54036b40 msgr2=0x7f4b54039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.072+0000 7f4c80f39800 1 --2- 172.21.15.164:0/4293319280 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4b54036b40 0x7f4b54039000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x555d500ea350 tx=0x7f4c78005840 comp rx=0 tx=0).stop 2024-09-13T23:05:35.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.072+0000 7f4c80f39800 1 -- 172.21.15.164:0/4293319280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d500f9c10 msgr2=0x555d500fa030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.072+0000 7f4c80f39800 1 --2- 172.21.15.164:0/4293319280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d500f9c10 0x555d500fa030 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4c68045f50 tx=0x7f4c68002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.072+0000 7f4c80f39800 1 -- 172.21.15.164:0/4293319280 shutdown_connections 2024-09-13T23:05:35.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.072+0000 7f4c80f39800 1 --2- 172.21.15.164:0/4293319280 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4b54036b40 0x7f4b54039000 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.072+0000 7f4c80f39800 1 --2- 172.21.15.164:0/4293319280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d500f9c10 0x555d500fa030 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.072+0000 7f4c80f39800 1 -- 172.21.15.164:0/4293319280 >> 172.21.15.164:0/4293319280 conn(0x555d500eeba0 msgr2=0x555d500f1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.072+0000 7f4c80f39800 1 -- 172.21.15.164:0/4293319280 shutdown_connections 2024-09-13T23:05:35.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.072+0000 7f4c80f39800 1 -- 172.21.15.164:0/4293319280 wait complete. 2024-09-13T23:05:35.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.073+0000 7f4c80f39800 1 -- 172.21.15.164:0/2762149751 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x555d4ffef8e0 msgr2=0x555d500e9280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.073+0000 7f4c80f39800 1 --2- 172.21.15.164:0/2762149751 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x555d4ffef8e0 0x555d500e9280 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.073+0000 7f4c80f39800 1 -- 172.21.15.164:0/2762149751 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4b64036b90 msgr2=0x7f4b64039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.073+0000 7f4c80f39800 1 --2- 172.21.15.164:0/2762149751 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4b64036b90 0x7f4b64039050 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4c68057000 tx=0x7f4c68052000 comp rx=0 tx=0).stop 2024-09-13T23:05:35.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.073+0000 7f4c80f39800 1 -- 172.21.15.164:0/2762149751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d4ff5ee10 msgr2=0x555d500e2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.073+0000 7f4c80f39800 1 --2- 172.21.15.164:0/2762149751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d4ff5ee10 0x555d500e2210 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000b7c0 tx=0x7f4c70000ed0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.073+0000 7f4c80f39800 1 -- 172.21.15.164:0/2762149751 shutdown_connections 2024-09-13T23:05:35.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.073+0000 7f4c80f39800 1 --2- 172.21.15.164:0/2762149751 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x555d4ffef8e0 0x555d500e9280 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.073+0000 7f4c80f39800 1 --2- 172.21.15.164:0/2762149751 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4b64036b90 0x7f4b64039050 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.073+0000 7f4c80f39800 1 --2- 172.21.15.164:0/2762149751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d4ff5ee10 0x555d500e2210 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.073+0000 7f4c80f39800 1 -- 172.21.15.164:0/2762149751 >> 172.21.15.164:0/2762149751 conn(0x555d4ffe5df0 msgr2=0x555d500d4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.073+0000 7f4c80f39800 1 -- 172.21.15.164:0/2762149751 shutdown_connections 2024-09-13T23:05:35.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.073+0000 7f4c80f39800 1 -- 172.21.15.164:0/2762149751 wait complete. 2024-09-13T23:05:35.103 INFO:teuthology.orchestra.run.smithi164.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"4d3c0b48-20ce-488a-b409-36cc6d9502d0","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1","marker":"a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-13T23:05:34.305746Z","creation_time":"2024-09-13T23:05:34.302827Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}}] 2024-09-13T23:05:35.104 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '4d3c0b48-20ce-488a-b409-36cc6d9502d0', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1', 'marker': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T23:05:34.305746Z', 'creation_time': '2024-09-13T23:05:34.302827Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-13T23:05:35.110 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T23:05:35.111 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T23:05:35.111 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T23:05:35.111 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-13T23:05:35.157 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:35.157 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:35.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.156+0000 7f65f6f40800 1 Processor -- start 2024-09-13T23:05:35.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.156+0000 7f65f6f40800 1 -- start start 2024-09-13T23:05:35.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.156+0000 7f65f6f40800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x562e20319970 0x562e2031bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.156+0000 7f65f6f40800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562e201d4b30 con 0x562e20289630 2024-09-13T23:05:35.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.156+0000 7f65f6f40800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x562e201b6360 con 0x562e20319970 2024-09-13T23:05:35.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.157+0000 7f65f24d0640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x562e20319970 0x562e2031bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.157+0000 7f65f2cd1640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x562e20289630 0x562e20318250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40936/0 (socket says 172.21.15.164:40936) 2024-09-13T23:05:35.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.157+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2326949171 learned_addr learned my addr 172.21.15.164:0/2326949171 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:35.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.157+0000 7f65f24d0640 1 -- 172.21.15.164:0/2326949171 >> v1:172.21.15.17:6789/0 conn(0x562e20289630 legacy=0x562e20318250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.157+0000 7f65f24d0640 1 -- 172.21.15.164:0/2326949171 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e201dce00 con 0x562e20319970 2024-09-13T23:05:35.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.159+0000 7f65f24d0640 1 --2- 172.21.15.164:0/2326949171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20319970 0x562e2031bd60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f65e800a470 tx=0x7f65e8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd6ed30c78477a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.159+0000 7f65f1ccf640 1 -- 172.21.15.164:0/2326949171 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65e8053570 con 0x562e20319970 2024-09-13T23:05:35.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.159+0000 7f65f1ccf640 1 -- 172.21.15.164:0/2326949171 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e8058070 con 0x562e20319970 2024-09-13T23:05:35.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.159+0000 7f65f1ccf640 1 -- 172.21.15.164:0/2326949171 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65e8053880 con 0x562e20319970 2024-09-13T23:05:35.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.159+0000 7f65f6f40800 1 -- 172.21.15.164:0/2326949171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20319970 msgr2=0x562e2031bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.159+0000 7f65f6f40800 1 --2- 172.21.15.164:0/2326949171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20319970 0x562e2031bd60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f65e800a470 tx=0x7f65e8045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:35.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.159+0000 7f65f6f40800 1 -- 172.21.15.164:0/2326949171 shutdown_connections 2024-09-13T23:05:35.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.159+0000 7f65f6f40800 1 --2- 172.21.15.164:0/2326949171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20319970 0x562e2031bd60 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.159+0000 7f65f6f40800 1 -- 172.21.15.164:0/2326949171 >> 172.21.15.164:0/2326949171 conn(0x562e2030fde0 msgr2=0x562e20312200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.159+0000 7f65f6f40800 1 -- 172.21.15.164:0/2326949171 shutdown_connections 2024-09-13T23:05:35.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.159+0000 7f65f6f40800 1 -- 172.21.15.164:0/2326949171 wait complete. 2024-09-13T23:05:35.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.173+0000 7f65f6f40800 1 Processor -- start 2024-09-13T23:05:35.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.173+0000 7f65f6f40800 1 -- start start 2024-09-13T23:05:35.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.173+0000 7f65f6f40800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20289630 0x562e20315b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.173+0000 7f65f6f40800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562e20261330 con 0x562e20289630 2024-09-13T23:05:35.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.174+0000 7f65f2cd1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20289630 0x562e20315b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.174+0000 7f65f2cd1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20289630 0x562e20315b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57618/0 (socket says 172.21.15.164:57618) 2024-09-13T23:05:35.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.174+0000 7f65f2cd1640 1 -- 172.21.15.164:0/3283217417 learned_addr learned my addr 172.21.15.164:0/3283217417 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.174+0000 7f65f2cd1640 1 -- 172.21.15.164:0/3283217417 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e201aebc0 con 0x562e20289630 2024-09-13T23:05:35.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.174+0000 7f65f2cd1640 1 --2- 172.21.15.164:0/3283217417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20289630 0x562e20315b80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f65e4001610 tx=0x7f65e4001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b746a8c6265289 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.174+0000 7f64e0e09640 1 -- 172.21.15.164:0/3283217417 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65e4004520 con 0x562e20289630 2024-09-13T23:05:35.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.174+0000 7f64e0e09640 1 -- 172.21.15.164:0/3283217417 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e40046c0 con 0x562e20289630 2024-09-13T23:05:35.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.174+0000 7f64e0e09640 1 -- 172.21.15.164:0/3283217417 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65e4004a20 con 0x562e20289630 2024-09-13T23:05:35.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.175+0000 7f65f6f40800 1 -- 172.21.15.164:0/3283217417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20289630 msgr2=0x562e20315b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.175+0000 7f65f6f40800 1 --2- 172.21.15.164:0/3283217417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20289630 0x562e20315b80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f65e4001610 tx=0x7f65e4001ad0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.175+0000 7f65f6f40800 1 -- 172.21.15.164:0/3283217417 shutdown_connections 2024-09-13T23:05:35.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.175+0000 7f65f6f40800 1 --2- 172.21.15.164:0/3283217417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20289630 0x562e20315b80 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.175+0000 7f65f6f40800 1 -- 172.21.15.164:0/3283217417 >> 172.21.15.164:0/3283217417 conn(0x562e2030fde0 msgr2=0x562e20400230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.175+0000 7f65f6f40800 1 -- 172.21.15.164:0/3283217417 shutdown_connections 2024-09-13T23:05:35.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.175+0000 7f65f6f40800 1 -- 172.21.15.164:0/3283217417 wait complete. 2024-09-13T23:05:35.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.175+0000 7f65f6f40800 1 Processor -- start 2024-09-13T23:05:35.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.176+0000 7f65f6f40800 1 -- start start 2024-09-13T23:05:35.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.176+0000 7f65f6f40800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20289630 0x562e2040e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.176+0000 7f65f6f40800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562e2031c690 con 0x562e20289630 2024-09-13T23:05:35.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.176+0000 7f65f2cd1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20289630 0x562e2040e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.176+0000 7f65f2cd1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20289630 0x562e2040e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57624/0 (socket says 172.21.15.164:57624) 2024-09-13T23:05:35.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.176+0000 7f65f2cd1640 1 -- 172.21.15.164:0/749981466 learned_addr learned my addr 172.21.15.164:0/749981466 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.176+0000 7f65f2cd1640 1 -- 172.21.15.164:0/749981466 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e201c2fe0 con 0x562e20289630 2024-09-13T23:05:35.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.176+0000 7f65f2cd1640 1 --2- 172.21.15.164:0/749981466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20289630 0x562e2040e440 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f65e4001b10 tx=0x7f65e4000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.176+0000 7f64df606640 1 -- 172.21.15.164:0/749981466 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65e4014530 con 0x562e20289630 2024-09-13T23:05:35.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.176+0000 7f64df606640 1 -- 172.21.15.164:0/749981466 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e4023070 con 0x562e20289630 2024-09-13T23:05:35.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.176+0000 7f65f6f40800 1 -- 172.21.15.164:0/749981466 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e2040e980 con 0x562e20289630 2024-09-13T23:05:35.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.176+0000 7f64df606640 1 -- 172.21.15.164:0/749981466 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65e4014880 con 0x562e20289630 2024-09-13T23:05:35.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.177+0000 7f65f6f40800 1 -- 172.21.15.164:0/749981466 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e2040eea0 con 0x562e20289630 2024-09-13T23:05:35.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.177+0000 7f64df606640 1 -- 172.21.15.164:0/749981466 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f65e4010070 con 0x562e20289630 2024-09-13T23:05:35.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.177+0000 7f64df606640 1 --2- 172.21.15.164:0/749981466 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64d8036b90 0x7f64d8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.178+0000 7f64df606640 1 -- 172.21.15.164:0/749981466 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f65e404c8b0 con 0x562e20289630 2024-09-13T23:05:35.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.178+0000 7f65f24d0640 1 --2- 172.21.15.164:0/749981466 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64d8036b90 0x7f64d8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.178+0000 7f65f6f40800 1 --2- 172.21.15.164:0/749981466 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562e20319970 0x562e204154b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.178+0000 7f65f6f40800 1 -- 172.21.15.164:0/749981466 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e20415a80 con 0x562e20319970 2024-09-13T23:05:35.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.178+0000 7f65f34d2640 1 --2- 172.21.15.164:0/749981466 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562e20319970 0x562e204154b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.178+0000 7f65f24d0640 1 --2- 172.21.15.164:0/749981466 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64d8036b90 0x7f64d8039050 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f65e8057000 tx=0x7f65e8052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.178+0000 7f65f34d2640 1 --2- 172.21.15.164:0/749981466 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562e20319970 0x562e204154b0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.178+0000 7f65f34d2640 1 -- 172.21.15.164:0/749981466 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65ec0083e0 con 0x562e20319970 2024-09-13T23:05:35.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.178+0000 7f65f6f40800 1 -- 172.21.15.164:0/749981466 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e20412a60 con 0x562e20319970 2024-09-13T23:05:35.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.179+0000 7f65f34d2640 1 -- 172.21.15.164:0/749981466 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f65ec0083e0 con 0x562e20319970 2024-09-13T23:05:35.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.179+0000 7f65f6f40800 1 -- 172.21.15.164:0/749981466 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e20417860 con 0x562e20319970 2024-09-13T23:05:35.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.179+0000 7f65f34d2640 1 -- 172.21.15.164:0/749981466 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f65ec0083e0 con 0x562e20319970 2024-09-13T23:05:35.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.179+0000 7f65f6f40800 1 -- 172.21.15.164:0/749981466 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e20416a90 con 0x562e20319970 2024-09-13T23:05:35.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.179+0000 7f65f34d2640 1 -- 172.21.15.164:0/749981466 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f65ec0083e0 con 0x562e20319970 2024-09-13T23:05:35.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.179+0000 7f65f6f40800 1 -- 172.21.15.164:0/749981466 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e20416e80 con 0x562e20319970 2024-09-13T23:05:35.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.179+0000 7f65f34d2640 1 -- 172.21.15.164:0/749981466 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f65ec0083e0 con 0x562e20319970 2024-09-13T23:05:35.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.180+0000 7f65f6f40800 1 Processor -- start 2024-09-13T23:05:35.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.180+0000 7f65f6f40800 1 -- start start 2024-09-13T23:05:35.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.180+0000 7f65f6f40800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20425ea0 0x562e204262c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.180+0000 7f65f6f40800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562e201b0580 con 0x562e20425ea0 2024-09-13T23:05:35.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.180+0000 7f65f24d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20425ea0 0x562e204262c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.180+0000 7f65f24d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20425ea0 0x562e204262c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57632/0 (socket says 172.21.15.164:57632) 2024-09-13T23:05:35.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.180+0000 7f65f24d0640 1 -- 172.21.15.164:0/4201001109 learned_addr learned my addr 172.21.15.164:0/4201001109 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.181+0000 7f65f24d0640 1 -- 172.21.15.164:0/4201001109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e20426800 con 0x562e20425ea0 2024-09-13T23:05:35.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.181+0000 7f65f24d0640 1 --2- 172.21.15.164:0/4201001109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20425ea0 0x562e204262c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f65e8025bf0 tx=0x7f65e8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.181+0000 7f64dce01640 1 -- 172.21.15.164:0/4201001109 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65e806f070 con 0x562e20425ea0 2024-09-13T23:05:35.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.181+0000 7f64dce01640 1 -- 172.21.15.164:0/4201001109 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e805f550 con 0x562e20425ea0 2024-09-13T23:05:35.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.181+0000 7f65f6f40800 1 -- 172.21.15.164:0/4201001109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e20426a30 con 0x562e20425ea0 2024-09-13T23:05:35.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.181+0000 7f64dce01640 1 -- 172.21.15.164:0/4201001109 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65e805f830 con 0x562e20425ea0 2024-09-13T23:05:35.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.181+0000 7f65f6f40800 1 -- 172.21.15.164:0/4201001109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e204296b0 con 0x562e20425ea0 2024-09-13T23:05:35.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.182+0000 7f64dce01640 1 -- 172.21.15.164:0/4201001109 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f65e805f9d0 con 0x562e20425ea0 2024-09-13T23:05:35.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.182+0000 7f64dce01640 1 --2- 172.21.15.164:0/4201001109 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64cc036b90 0x7f64cc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.182+0000 7f64dce01640 1 -- 172.21.15.164:0/4201001109 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f65e8092b50 con 0x562e20425ea0 2024-09-13T23:05:35.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.182+0000 7f65f34d2640 1 --2- 172.21.15.164:0/4201001109 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64cc036b90 0x7f64cc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.182+0000 7f65f6f40800 1 Processor -- start 2024-09-13T23:05:35.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.182+0000 7f65f34d2640 1 --2- 172.21.15.164:0/4201001109 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64cc036b90 0x7f64cc039050 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x562e204165b0 tx=0x7f65ec000f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.182+0000 7f65f6f40800 1 -- start start 2024-09-13T23:05:35.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.183+0000 7f65f6f40800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20432a40 0x562e20432e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.183+0000 7f65f6f40800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562e20314250 con 0x562e20432a40 2024-09-13T23:05:35.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.183+0000 7f65f24d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20432a40 0x562e20432e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.183+0000 7f65f24d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20432a40 0x562e20432e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57636/0 (socket says 172.21.15.164:57636) 2024-09-13T23:05:35.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.183+0000 7f65f24d0640 1 -- 172.21.15.164:0/4177395330 learned_addr learned my addr 172.21.15.164:0/4177395330 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.183+0000 7f65f24d0640 1 -- 172.21.15.164:0/4177395330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e20433410 con 0x562e20432a40 2024-09-13T23:05:35.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.183+0000 7f65f24d0640 1 --2- 172.21.15.164:0/4177395330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20432a40 0x562e20432e40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f65e8090f70 tx=0x7f65e807cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439b752617e39aee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.183+0000 7f64d67fc640 1 -- 172.21.15.164:0/4177395330 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65e806b410 con 0x562e20432a40 2024-09-13T23:05:35.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.183+0000 7f64d67fc640 1 -- 172.21.15.164:0/4177395330 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e805fcc0 con 0x562e20432a40 2024-09-13T23:05:35.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.183+0000 7f64d67fc640 1 -- 172.21.15.164:0/4177395330 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65e806b5b0 con 0x562e20432a40 2024-09-13T23:05:35.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.184+0000 7f65f6f40800 1 -- 172.21.15.164:0/4177395330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20432a40 msgr2=0x562e20432e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.184+0000 7f65f6f40800 1 --2- 172.21.15.164:0/4177395330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20432a40 0x562e20432e40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f65e8090f70 tx=0x7f65e807cb80 comp rx=0 tx=0).stop 2024-09-13T23:05:35.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.184+0000 7f65f6f40800 1 -- 172.21.15.164:0/4177395330 shutdown_connections 2024-09-13T23:05:35.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.184+0000 7f65f6f40800 1 --2- 172.21.15.164:0/4177395330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20432a40 0x562e20432e40 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.184+0000 7f65f6f40800 1 -- 172.21.15.164:0/4177395330 >> 172.21.15.164:0/4177395330 conn(0x562e2042eda0 msgr2=0x562e2042cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.184+0000 7f65f6f40800 1 -- 172.21.15.164:0/4177395330 shutdown_connections 2024-09-13T23:05:35.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.184+0000 7f65f6f40800 1 -- 172.21.15.164:0/4177395330 wait complete. 2024-09-13T23:05:35.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.184+0000 7f65f6f40800 1 Processor -- start 2024-09-13T23:05:35.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.184+0000 7f65f6f40800 1 -- start start 2024-09-13T23:05:35.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.184+0000 7f65f6f40800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20432a40 0x562e20439f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.185+0000 7f65f6f40800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562e20433a80 con 0x562e20432a40 2024-09-13T23:05:35.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.185+0000 7f65f24d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20432a40 0x562e20439f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.185+0000 7f65f24d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20432a40 0x562e20439f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57646/0 (socket says 172.21.15.164:57646) 2024-09-13T23:05:35.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.185+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 learned_addr learned my addr 172.21.15.164:0/2134300659 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.185+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e2043a4c0 con 0x562e20432a40 2024-09-13T23:05:35.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.185+0000 7f65f24d0640 1 --2- 172.21.15.164:0/2134300659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20432a40 0x562e20439f80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f65e808fe60 tx=0x7f65e8090ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.185+0000 7f64d4ff9640 1 -- 172.21.15.164:0/2134300659 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65e805cca0 con 0x562e20432a40 2024-09-13T23:05:35.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.185+0000 7f64d4ff9640 1 -- 172.21.15.164:0/2134300659 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e805ce40 con 0x562e20432a40 2024-09-13T23:05:35.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.185+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e2043a750 con 0x562e20432a40 2024-09-13T23:05:35.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.185+0000 7f64d4ff9640 1 -- 172.21.15.164:0/2134300659 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65e806a850 con 0x562e20432a40 2024-09-13T23:05:35.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.185+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e2043a750 con 0x562e20432a40 2024-09-13T23:05:35.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.186+0000 7f64d4ff9640 1 -- 172.21.15.164:0/2134300659 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f65e80a2060 con 0x562e20432a40 2024-09-13T23:05:35.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.186+0000 7f64d4ff9640 1 --2- 172.21.15.164:0/2134300659 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64bc036b90 0x7f64bc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.186+0000 7f64d4ff9640 1 -- 172.21.15.164:0/2134300659 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f65e8098070 con 0x562e20432a40 2024-09-13T23:05:35.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.186+0000 7f65f34d2640 1 --2- 172.21.15.164:0/2134300659 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64bc036b90 0x7f64bc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.187+0000 7f65f6f40800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.187+0000 7f65f6f40800 1 --2- 172.21.15.164:0/2134300659 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562e204457f0 0x562e20447cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.187+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e20448400 con 0x562e204457f0 2024-09-13T23:05:35.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.187+0000 7f65f34d2640 1 --2- 172.21.15.164:0/2134300659 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64bc036b90 0x7f64bc039050 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f65ec00f010 tx=0x7f65ec00c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.187+0000 7f65f2cd1640 1 --2- 172.21.15.164:0/2134300659 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562e204457f0 0x562e20447cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.187+0000 7f65f2cd1640 1 --2- 172.21.15.164:0/2134300659 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562e204457f0 0x562e20447cb0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.187+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65e400f030 con 0x562e204457f0 2024-09-13T23:05:35.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.187+0000 7f65f6f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.187+0000 7f65f6f40800 20 realm 2024-09-13T23:05:35.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.187+0000 7f65f6f40800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.187+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e20448810 con 0x562e204457f0 2024-09-13T23:05:35.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.188+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65e400f030 con 0x562e204457f0 2024-09-13T23:05:35.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.188+0000 7f65f6f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.188+0000 7f65f6f40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:35.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.188+0000 7f65f6f40800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.188+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e204490e0 con 0x562e204457f0 2024-09-13T23:05:35.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.188+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65e400f030 con 0x562e204457f0 2024-09-13T23:05:35.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.188+0000 7f65f6f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.188+0000 7f65f6f40800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.188+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e20449480 con 0x562e204457f0 2024-09-13T23:05:35.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.188+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f65e400f030 con 0x562e204457f0 2024-09-13T23:05:35.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.188+0000 7f65f6f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:35.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.188+0000 7f65f6f40800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.188+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e204498e0 con 0x562e204457f0 2024-09-13T23:05:35.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.188+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f65e400f030 con 0x562e204457f0 2024-09-13T23:05:35.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.188+0000 7f65f6f40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:35.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.188+0000 7f65f6f40800 20 searching for the correct realm 2024-09-13T23:05:35.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.188+0000 7f65f6f40800 1 --2- 172.21.15.164:0/2134300659 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x562e2044b930 0x562e2044dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.188+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2044e3d0 con 0x562e2044b930 2024-09-13T23:05:35.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.189+0000 7f65f24d0640 1 --2- 172.21.15.164:0/2134300659 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x562e2044b930 0x562e2044dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.189+0000 7f65f24d0640 1 --2- 172.21.15.164:0/2134300659 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x562e2044b930 0x562e2044dd20 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.189+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e8051070 con 0x562e2044b930 2024-09-13T23:05:35.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.189+0000 7f65f24d0640 1 --2- 172.21.15.164:0/2134300659 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f65e805f040 0x7f65e80702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.189+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2044e3d0 con 0x7f65e805f040 2024-09-13T23:05:35.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.189+0000 7f65f34d2640 1 --2- 172.21.15.164:0/2134300659 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f65e805f040 0x7f65e80702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.189+0000 7f65f34d2640 1 --2- 172.21.15.164:0/2134300659 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f65e805f040 0x7f65e80702b0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.190+0000 7f65f34d2640 1 -- 172.21.15.164:0/2134300659 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ec02f040 con 0x7f65e805f040 2024-09-13T23:05:35.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.190+0000 7f65f34d2640 1 --2- 172.21.15.164:0/2134300659 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f65ec019040 0x7f65ec019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.190+0000 7f65f34d2640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2044e3d0 con 0x7f65ec019040 2024-09-13T23:05:35.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.190+0000 7f65f2cd1640 1 --2- 172.21.15.164:0/2134300659 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f65ec019040 0x7f65ec019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.190+0000 7f65f2cd1640 1 --2- 172.21.15.164:0/2134300659 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f65ec019040 0x7f65ec019930 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.191+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e400f030 con 0x7f65ec019040 2024-09-13T23:05:35.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.191+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2044e3d0 con 0x562e204457f0 2024-09-13T23:05:35.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.191+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f65e400f030 con 0x562e204457f0 2024-09-13T23:05:35.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.191+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2044e3d0 con 0x562e204457f0 2024-09-13T23:05:35.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.191+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e400f030 con 0x562e204457f0 2024-09-13T23:05:35.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.191+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2044e3d0 con 0x7f65ec019040 2024-09-13T23:05:35.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.191+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e400f030 con 0x7f65ec019040 2024-09-13T23:05:35.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.191+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2044e3d0 con 0x7f65ec019040 2024-09-13T23:05:35.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.192+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e400f030 con 0x7f65ec019040 2024-09-13T23:05:35.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.192+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2044e3d0 con 0x7f65e805f040 2024-09-13T23:05:35.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.192+0000 7f65f34d2640 1 -- 172.21.15.164:0/2134300659 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ec02f040 con 0x7f65e805f040 2024-09-13T23:05:35.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.192+0000 7f65f34d2640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2044e3d0 con 0x562e2044b930 2024-09-13T23:05:35.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.192+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e8051070 con 0x562e2044b930 2024-09-13T23:05:35.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.192+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2044e3d0 con 0x562e204457f0 2024-09-13T23:05:35.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.192+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e400f030 con 0x562e204457f0 2024-09-13T23:05:35.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.192+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2044e3d0 con 0x7f65ec019040 2024-09-13T23:05:35.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.193+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e400f030 con 0x7f65ec019040 2024-09-13T23:05:35.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.193+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2044e3d0 con 0x562e204457f0 2024-09-13T23:05:35.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.193+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e400f030 con 0x562e204457f0 2024-09-13T23:05:35.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.193+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2044e3d0 con 0x7f65e805f040 2024-09-13T23:05:35.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.193+0000 7f65f34d2640 1 -- 172.21.15.164:0/2134300659 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f65ec02f040 con 0x7f65e805f040 2024-09-13T23:05:35.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.193+0000 7f65f34d2640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2044e3d0 con 0x562e2044b930 2024-09-13T23:05:35.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.193+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e8051070 con 0x562e2044b930 2024-09-13T23:05:35.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.193+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2044e3d0 con 0x562e2044b930 2024-09-13T23:05:35.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.194+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e8051070 con 0x562e2044b930 2024-09-13T23:05:35.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.194+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2044e3d0 con 0x7f65ec019040 2024-09-13T23:05:35.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.194+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e400f030 con 0x7f65ec019040 2024-09-13T23:05:35.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.194+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2044e3d0 con 0x562e2044b930 2024-09-13T23:05:35.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.194+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e8051070 con 0x562e2044b930 2024-09-13T23:05:35.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.194+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2044e3d0 con 0x562e2044b930 2024-09-13T23:05:35.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.194+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e8051070 con 0x562e2044b930 2024-09-13T23:05:35.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.195+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2044e3d0 con 0x562e204457f0 2024-09-13T23:05:35.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.195+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e400f030 con 0x562e204457f0 2024-09-13T23:05:35.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.195+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2044e3d0 con 0x562e204457f0 2024-09-13T23:05:35.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.195+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f65e400f030 con 0x562e204457f0 2024-09-13T23:05:35.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.195+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2044e3d0 con 0x7f65ec019040 2024-09-13T23:05:35.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.195+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e400f030 con 0x7f65ec019040 2024-09-13T23:05:35.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.195+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2044e3d0 con 0x562e2044b930 2024-09-13T23:05:35.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.196+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e8051070 con 0x562e2044b930 2024-09-13T23:05:35.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.196+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2044e3d0 con 0x7f65e805f040 2024-09-13T23:05:35.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.196+0000 7f65f34d2640 1 -- 172.21.15.164:0/2134300659 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ec02f040 con 0x7f65e805f040 2024-09-13T23:05:35.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.196+0000 7f65f34d2640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2044e3d0 con 0x562e204457f0 2024-09-13T23:05:35.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.196+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f65e400f030 con 0x562e204457f0 2024-09-13T23:05:35.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.196+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2044e3d0 con 0x7f65ec019040 2024-09-13T23:05:35.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.196+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e400f030 con 0x7f65ec019040 2024-09-13T23:05:35.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.196+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2044e3d0 con 0x562e2044b930 2024-09-13T23:05:35.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.197+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e8051070 con 0x562e2044b930 2024-09-13T23:05:35.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.197+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e2044e3d0 con 0x7f65ec019040 2024-09-13T23:05:35.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.197+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e400f030 con 0x7f65ec019040 2024-09-13T23:05:35.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.197+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65e405f040 con 0x7f65e805f040 2024-09-13T23:05:35.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.197+0000 7f65f34d2640 1 -- 172.21.15.164:0/2134300659 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ec02f040 con 0x7f65e805f040 2024-09-13T23:05:35.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.197+0000 7f65f34d2640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65e405f040 con 0x562e2044b930 2024-09-13T23:05:35.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.197+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e8051070 con 0x562e2044b930 2024-09-13T23:05:35.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.197+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65e405f040 con 0x7f65ec019040 2024-09-13T23:05:35.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.198+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65e400f030 con 0x7f65ec019040 2024-09-13T23:05:35.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.198+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65e405f040 con 0x562e204457f0 2024-09-13T23:05:35.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.198+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f65e400f030 con 0x562e204457f0 2024-09-13T23:05:35.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.198+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65e405f040 con 0x7f65e805f040 2024-09-13T23:05:35.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.198+0000 7f65f34d2640 1 -- 172.21.15.164:0/2134300659 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ec02f040 con 0x7f65e805f040 2024-09-13T23:05:35.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.198+0000 7f65f6f40800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:35.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.198+0000 7f65f6f40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:35.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.198+0000 7f65f6f40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:35.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.198+0000 7f65f6f40800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:35.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.198+0000 7f65f6f40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:35.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.198+0000 7f65f6f40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:35.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.198+0000 7f65f6f40800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.198+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2044a250 con 0x562e204457f0 2024-09-13T23:05:35.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.198+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65e400f030 con 0x562e204457f0 2024-09-13T23:05:35.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.198+0000 7f65f6f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.198+0000 7f65f6f40800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.198+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2044a640 con 0x562e204457f0 2024-09-13T23:05:35.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.199+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f65e400f030 con 0x562e204457f0 2024-09-13T23:05:35.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.199+0000 7f65f6f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:35.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.199+0000 7f65f6f40800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.199+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2044a640 con 0x562e204457f0 2024-09-13T23:05:35.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.199+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f65e400f030 con 0x562e204457f0 2024-09-13T23:05:35.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.199+0000 7f65f6f40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:35.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.199+0000 7f65f6f40800 20 zone default found 2024-09-13T23:05:35.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.199+0000 7f65f6f40800 4 Realm: () 2024-09-13T23:05:35.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.199+0000 7f65f6f40800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:35.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.199+0000 7f65f6f40800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:35.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.199+0000 7f65f6f40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:35.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.199+0000 7f65f6f40800 20 zonegroup default 2024-09-13T23:05:35.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.199+0000 7f65f6f40800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.199+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2044aa60 con 0x7f65ec019040 2024-09-13T23:05:35.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.199+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f65e400f030 con 0x7f65ec019040 2024-09-13T23:05:35.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.199+0000 7f65f6f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.199+0000 7f65f6f40800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.199+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2044aa60 con 0x562e2044b930 2024-09-13T23:05:35.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.199+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f65e8051070 con 0x562e2044b930 2024-09-13T23:05:35.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.199+0000 7f65f6f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.200+0000 7f65f6f40800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.200+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e20450210 con 0x562e2044b930 2024-09-13T23:05:35.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.200+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f65e8051070 con 0x562e2044b930 2024-09-13T23:05:35.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.200+0000 7f65f6f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.200+0000 7f65f6f40800 20 started sync module instance, tier type = 2024-09-13T23:05:35.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.200+0000 7f65f6f40800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:35.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.200+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2044f6b0 con 0x7f65e805f040 2024-09-13T23:05:35.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.201+0000 7f65f34d2640 1 -- 172.21.15.164:0/2134300659 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ec02f040 con 0x7f65e805f040 2024-09-13T23:05:35.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.201+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94756109876224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2044f6b0 con 0x7f65e805f040 2024-09-13T23:05:35.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.201+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e20450d00 con 0x562e204457f0 2024-09-13T23:05:35.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.202+0000 7f65f34d2640 1 -- 172.21.15.164:0/2134300659 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94756109876224] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ec02f040 con 0x7f65e805f040 2024-09-13T23:05:35.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.202+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400f030 con 0x562e204457f0 2024-09-13T23:05:35.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.202+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94756109879248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2044f6b0 con 0x562e204457f0 2024-09-13T23:05:35.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.202+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e204517b0 con 0x562e2044b930 2024-09-13T23:05:35.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.203+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94756109879248] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400f030 con 0x562e204457f0 2024-09-13T23:05:35.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.203+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e8051070 con 0x562e2044b930 2024-09-13T23:05:35.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.203+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94756109873664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e2044f620 con 0x562e2044b930 2024-09-13T23:05:35.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.203+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e20452670 con 0x7f65e805f040 2024-09-13T23:05:35.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.204+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94756109873664] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e8051070 con 0x562e2044b930 2024-09-13T23:05:35.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.204+0000 7f65f34d2640 1 -- 172.21.15.164:0/2134300659 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ec02f040 con 0x7f65e805f040 2024-09-13T23:05:35.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.204+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94756109885888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e20452a90 con 0x7f65e805f040 2024-09-13T23:05:35.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.204+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e20453450 con 0x562e204457f0 2024-09-13T23:05:35.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.205+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400f030 con 0x562e204457f0 2024-09-13T23:05:35.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.205+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94756109889440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e20453870 con 0x562e204457f0 2024-09-13T23:05:35.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.205+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e20454370 con 0x7f65ec019040 2024-09-13T23:05:35.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.205+0000 7f65f34d2640 1 -- 172.21.15.164:0/2134300659 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94756109885888] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ec02f040 con 0x7f65e805f040 2024-09-13T23:05:35.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.206+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94756109889440] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400f030 con 0x562e204457f0 2024-09-13T23:05:35.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.206+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400f030 con 0x7f65ec019040 2024-09-13T23:05:35.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.206+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94756109893216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e204533c0 con 0x7f65ec019040 2024-09-13T23:05:35.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.206+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e20454c10 con 0x7f65ec019040 2024-09-13T23:05:35.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.207+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94756109893216] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400f030 con 0x7f65ec019040 2024-09-13T23:05:35.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.207+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400f030 con 0x7f65ec019040 2024-09-13T23:05:35.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.207+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94756109886944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e204533c0 con 0x7f65ec019040 2024-09-13T23:05:35.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.207+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e204551b0 con 0x7f65ec019040 2024-09-13T23:05:35.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.208+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94756109886944] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400f030 con 0x7f65ec019040 2024-09-13T23:05:35.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.208+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400f030 con 0x7f65ec019040 2024-09-13T23:05:35.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.208+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94756109896864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e20455170 con 0x7f65ec019040 2024-09-13T23:05:35.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.208+0000 7f65f6f40800 20 add_watcher() i=0 2024-09-13T23:05:35.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.208+0000 7f65f6f40800 20 add_watcher() i=1 2024-09-13T23:05:35.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.208+0000 7f65f6f40800 20 add_watcher() i=2 2024-09-13T23:05:35.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.208+0000 7f65f6f40800 20 add_watcher() i=3 2024-09-13T23:05:35.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.208+0000 7f65f6f40800 20 add_watcher() i=4 2024-09-13T23:05:35.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.208+0000 7f65f6f40800 20 add_watcher() i=5 2024-09-13T23:05:35.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.208+0000 7f65f6f40800 20 add_watcher() i=6 2024-09-13T23:05:35.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.209+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94756109896864] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400f030 con 0x7f65ec019040 2024-09-13T23:05:35.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.209+0000 7f65f6f40800 20 add_watcher() i=7 2024-09-13T23:05:35.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.209+0000 7f65f6f40800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:35.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.209+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e20458600 con 0x562e204457f0 2024-09-13T23:05:35.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.210+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f65e400f030 con 0x562e204457f0 2024-09-13T23:05:35.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.210+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94756109895120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e20455b20 con 0x562e204457f0 2024-09-13T23:05:35.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.211+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94756109895120] v32'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f65e400f030 con 0x562e204457f0 2024-09-13T23:05:35.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.211+0000 7f64a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:35.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.211+0000 7f65f6f40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:35.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.211+0000 7f65f6f40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:35.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.211+0000 7f65f6f40800 5 note: GC not initialized 2024-09-13T23:05:35.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.211+0000 7f6423fff640 20 reqs_thread_entry: start 2024-09-13T23:05:35.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.211+0000 7f65f6f40800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:35.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.211+0000 7f65f6f40800 20 Filter name: none 2024-09-13T23:05:35.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.211+0000 7f6421ffb640 20 reqs_thread_entry: start 2024-09-13T23:05:35.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.211+0000 7f65f6f40800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.211+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2048b920 con 0x7f65e805f040 2024-09-13T23:05:35.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.212+0000 7f65f34d2640 1 -- 172.21.15.164:0/2134300659 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f65ec02f040 con 0x7f65e805f040 2024-09-13T23:05:35.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.212+0000 7f65f6f40800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:05:35.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.212+0000 7f65f6f40800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.212+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:63 8.15 8:aa4f46c1:root::.bucket.meta.myfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2048c2e0 con 0x562e2044b930 2024-09-13T23:05:35.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.212+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(63 .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f65e8051070 con 0x562e2044b930 2024-09-13T23:05:35.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.212+0000 7f65f6f40800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:05:35.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.212+0000 7f65f6f40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T23:05:35.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.212+0000 7f65f6f40800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.212+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2048d9b0 con 0x7f65e805f040 2024-09-13T23:05:35.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.212+0000 7f65f34d2640 1 -- 172.21.15.164:0/2134300659 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f65ec02f040 con 0x7f65e805f040 2024-09-13T23:05:35.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.212+0000 7f65f6f40800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:05:35.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.212+0000 7f65f6f40800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.212+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:65 8.15 8:aa4f46c1:root::.bucket.meta.myfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2048d9b0 con 0x562e2044b930 2024-09-13T23:05:35.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.213+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(65 .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f65e8051070 con 0x562e2044b930 2024-09-13T23:05:35.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.213+0000 7f65f6f40800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:05:35.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.213+0000 7f65f6f40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T23:05:35.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.213+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:66 4.14 4:29473231:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2048d190 con 0x562e2044b930 2024-09-13T23:05:35.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.213+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:67 4.4 4:21c197e9:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e20492240 con 0x7f65ec019040 2024-09-13T23:05:35.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.213+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:68 4.1c 4:3980393e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e20494ab0 con 0x7f65ec019040 2024-09-13T23:05:35.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.213+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:69 4.3c 4:3c3df72e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e20497320 con 0x562e204457f0 2024-09-13T23:05:35.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.213+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:70 4.37 4:ec9f5977:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e20499b90 con 0x7f65ec019040 2024-09-13T23:05:35.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.213+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 4.17 4:ea5fb2d4:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2049c950 con 0x7f65ec019040 2024-09-13T23:05:35.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.213+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:72 4.30 4:0d33cc25:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e2049f240 con 0x562e2044b930 2024-09-13T23:05:35.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.213+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:73 4.2b 4:d7ffec3e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e204a1ab0 con 0x562e204457f0 2024-09-13T23:05:35.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.213+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 4.3e 4:7f41df37:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e204a4320 con 0x7f65e805f040 2024-09-13T23:05:35.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.213+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:75 4.5 4:a1ee3102:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e204a6d30 con 0x562e2044b930 2024-09-13T23:05:35.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.213+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:76 4.30 4:0c251f7e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e204a9a20 con 0x562e2044b930 2024-09-13T23:05:35.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.213+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(67 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f65e400f030 con 0x7f65ec019040 2024-09-13T23:05:35.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.213+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(70 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f65e400f030 con 0x7f65ec019040 2024-09-13T23:05:35.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.213+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(68 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f65e400f030 con 0x7f65ec019040 2024-09-13T23:05:35.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.213+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(71 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f65e400f030 con 0x7f65ec019040 2024-09-13T23:05:35.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.213+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(66 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f65e8051070 con 0x562e2044b930 2024-09-13T23:05:35.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.213+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(69 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f65e400f030 con 0x562e204457f0 2024-09-13T23:05:35.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.213+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(72 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f65e8051070 con 0x562e2044b930 2024-09-13T23:05:35.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.213+0000 7f65f34d2640 1 -- 172.21.15.164:0/2134300659 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(74 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f65ec02f040 con 0x7f65e805f040 2024-09-13T23:05:35.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.214+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(75 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f65e8051070 con 0x562e2044b930 2024-09-13T23:05:35.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.214+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(73 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f65e400f030 con 0x562e204457f0 2024-09-13T23:05:35.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.214+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(76 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f65e8051070 con 0x562e2044b930 2024-09-13T23:05:35.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.215+0000 7f64a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:35.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.215+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94756109895120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e20489380 con 0x562e204457f0 2024-09-13T23:05:35.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.216+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94756109895120] v32'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f65e400f030 con 0x562e204457f0 2024-09-13T23:05:35.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.216+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94756109876224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e20489380 con 0x7f65e805f040 2024-09-13T23:05:35.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.217+0000 7f65f34d2640 1 -- 172.21.15.164:0/2134300659 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94756109876224] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ec02f040 con 0x7f65e805f040 2024-09-13T23:05:35.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.217+0000 7f65f6f40800 20 remove_watcher() i=0 2024-09-13T23:05:35.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.217+0000 7f65f6f40800 2 removed watcher, disabling cache 2024-09-13T23:05:35.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.217+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94756109879248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e20489380 con 0x562e204457f0 2024-09-13T23:05:35.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.218+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94756109879248] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400f030 con 0x562e204457f0 2024-09-13T23:05:35.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.218+0000 7f65f6f40800 20 remove_watcher() i=1 2024-09-13T23:05:35.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.218+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94756109873664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e20489380 con 0x562e2044b930 2024-09-13T23:05:35.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.219+0000 7f65f24d0640 1 -- 172.21.15.164:0/2134300659 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94756109873664] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e8051070 con 0x562e2044b930 2024-09-13T23:05:35.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.219+0000 7f65f6f40800 20 remove_watcher() i=2 2024-09-13T23:05:35.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.219+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94756109885888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e20489380 con 0x7f65e805f040 2024-09-13T23:05:35.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.220+0000 7f65f34d2640 1 -- 172.21.15.164:0/2134300659 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94756109885888] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ec02f040 con 0x7f65e805f040 2024-09-13T23:05:35.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.220+0000 7f65f6f40800 20 remove_watcher() i=3 2024-09-13T23:05:35.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.220+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94756109889440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e20489380 con 0x562e204457f0 2024-09-13T23:05:35.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.221+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94756109889440] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400f030 con 0x562e204457f0 2024-09-13T23:05:35.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.221+0000 7f65f6f40800 20 remove_watcher() i=4 2024-09-13T23:05:35.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.221+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94756109893216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e20489380 con 0x7f65ec019040 2024-09-13T23:05:35.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.222+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94756109893216] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400f030 con 0x7f65ec019040 2024-09-13T23:05:35.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.222+0000 7f65f6f40800 20 remove_watcher() i=5 2024-09-13T23:05:35.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.222+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94756109886944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e20489380 con 0x7f65ec019040 2024-09-13T23:05:35.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.222+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94756109886944] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400f030 con 0x7f65ec019040 2024-09-13T23:05:35.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.222+0000 7f65f6f40800 20 remove_watcher() i=6 2024-09-13T23:05:35.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.223+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94756109896864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e20489380 con 0x7f65ec019040 2024-09-13T23:05:35.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.223+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94756109896864] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65e400f030 con 0x7f65ec019040 2024-09-13T23:05:35.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.223+0000 7f65f6f40800 20 remove_watcher() i=7 2024-09-13T23:05:35.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.224+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f65ec019040 msgr2=0x7f65ec019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.224+0000 7f65f6f40800 1 --2- 172.21.15.164:0/2134300659 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f65ec019040 0x7f65ec019930 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.224+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562e204457f0 msgr2=0x562e20447cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.224+0000 7f65f6f40800 1 --2- 172.21.15.164:0/2134300659 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562e204457f0 0x562e20447cb0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.224+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f65e805f040 msgr2=0x7f65e80702b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.224+0000 7f65f6f40800 1 --2- 172.21.15.164:0/2134300659 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f65e805f040 0x7f65e80702b0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.224+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x562e2044b930 msgr2=0x562e2044dd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.224+0000 7f65f6f40800 1 --2- 172.21.15.164:0/2134300659 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x562e2044b930 0x562e2044dd20 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.224+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64bc036b90 msgr2=0x7f64bc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.224+0000 7f65f6f40800 1 --2- 172.21.15.164:0/2134300659 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64bc036b90 0x7f64bc039050 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f65ec00f010 tx=0x7f65ec00c040 comp rx=0 tx=0).stop 2024-09-13T23:05:35.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.224+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20432a40 msgr2=0x562e20439f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.224+0000 7f65f6f40800 1 --2- 172.21.15.164:0/2134300659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20432a40 0x562e20439f80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f65e808fe60 tx=0x7f65e8090ed0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.224+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 reap_dead start 2024-09-13T23:05:35.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.224+0000 7f65f2cd1640 1 -- 172.21.15.164:0/2134300659 reap_dead start 2024-09-13T23:05:35.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.224+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 shutdown_connections 2024-09-13T23:05:35.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.224+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 >> 172.21.15.164:0/2134300659 conn(0x562e2042eda0 msgr2=0x562e2042ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.224+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 shutdown_connections 2024-09-13T23:05:35.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.224+0000 7f65f6f40800 1 -- 172.21.15.164:0/2134300659 wait complete. 2024-09-13T23:05:35.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.224+0000 7f65f6f40800 1 -- 172.21.15.164:0/4201001109 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64cc036b90 msgr2=0x7f64cc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.224+0000 7f65f6f40800 1 --2- 172.21.15.164:0/4201001109 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64cc036b90 0x7f64cc039050 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x562e204165b0 tx=0x7f65ec000f90 comp rx=0 tx=0).stop 2024-09-13T23:05:35.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.224+0000 7f65f6f40800 1 -- 172.21.15.164:0/4201001109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20425ea0 msgr2=0x562e204262c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.224+0000 7f65f6f40800 1 --2- 172.21.15.164:0/4201001109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20425ea0 0x562e204262c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f65e8025bf0 tx=0x7f65e8002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.224+0000 7f65f6f40800 1 -- 172.21.15.164:0/4201001109 shutdown_connections 2024-09-13T23:05:35.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.224+0000 7f65f6f40800 1 --2- 172.21.15.164:0/4201001109 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64cc036b90 0x7f64cc039050 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.224+0000 7f65f6f40800 1 --2- 172.21.15.164:0/4201001109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20425ea0 0x562e204262c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.224+0000 7f65f6f40800 1 -- 172.21.15.164:0/4201001109 >> 172.21.15.164:0/4201001109 conn(0x562e2041ae30 msgr2=0x562e2041d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.224+0000 7f65f6f40800 1 -- 172.21.15.164:0/4201001109 shutdown_connections 2024-09-13T23:05:35.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.224+0000 7f65f6f40800 1 -- 172.21.15.164:0/4201001109 wait complete. 2024-09-13T23:05:35.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.225+0000 7f65f6f40800 1 -- 172.21.15.164:0/749981466 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562e20319970 msgr2=0x562e204154b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.225+0000 7f65f6f40800 1 --2- 172.21.15.164:0/749981466 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562e20319970 0x562e204154b0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.225+0000 7f65f6f40800 1 -- 172.21.15.164:0/749981466 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64d8036b90 msgr2=0x7f64d8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.225+0000 7f65f6f40800 1 --2- 172.21.15.164:0/749981466 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64d8036b90 0x7f64d8039050 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f65e8057000 tx=0x7f65e8052000 comp rx=0 tx=0).stop 2024-09-13T23:05:35.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.225+0000 7f65f6f40800 1 -- 172.21.15.164:0/749981466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20289630 msgr2=0x562e2040e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.225+0000 7f65f6f40800 1 --2- 172.21.15.164:0/749981466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20289630 0x562e2040e440 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f65e4001b10 tx=0x7f65e4000f40 comp rx=0 tx=0).stop 2024-09-13T23:05:35.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.225+0000 7f65f6f40800 1 -- 172.21.15.164:0/749981466 shutdown_connections 2024-09-13T23:05:35.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.225+0000 7f65f6f40800 1 --2- 172.21.15.164:0/749981466 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562e20319970 0x562e204154b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.225+0000 7f65f6f40800 1 --2- 172.21.15.164:0/749981466 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64d8036b90 0x7f64d8039050 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.225+0000 7f65f6f40800 1 --2- 172.21.15.164:0/749981466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e20289630 0x562e2040e440 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.225+0000 7f65f6f40800 1 -- 172.21.15.164:0/749981466 >> 172.21.15.164:0/749981466 conn(0x562e2030fde0 msgr2=0x562e203ffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.225+0000 7f65f6f40800 1 -- 172.21.15.164:0/749981466 shutdown_connections 2024-09-13T23:05:35.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.225+0000 7f65f6f40800 1 -- 172.21.15.164:0/749981466 wait complete. 2024-09-13T23:05:35.248 INFO:teuthology.orchestra.run.smithi164.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"4d3c0b48-20ce-488a-b409-36cc6d9502d0","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1","marker":"a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-13T23:05:34.305746Z","creation_time":"2024-09-13T23:05:34.302827Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-13T23:05:35.249 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '4d3c0b48-20ce-488a-b409-36cc6d9502d0', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1', 'marker': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T23:05:34.305746Z', 'creation_time': '2024-09-13T23:05:34.302827Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T23:05:35.249 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-13T23:05:35.249 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-13T23:05:35.249 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-13T23:05:35.295 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:35.335 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:35.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.294+0000 7f7b51010800 1 Processor -- start 2024-09-13T23:05:35.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.294+0000 7f7b51010800 1 -- start start 2024-09-13T23:05:35.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.294+0000 7f7b51010800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55e977688650 0x55e9777171e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.294+0000 7f7b51010800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e9775d3b30 con 0x55e977717720 2024-09-13T23:05:35.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.294+0000 7f7b51010800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55e9775b5360 con 0x55e977688650 2024-09-13T23:05:35.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.294+0000 7f7b4c6c1640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55e977688650 0x55e9777171e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.294+0000 7f7b4bec0640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55e977717720 0x55e977719b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40946/0 (socket says 172.21.15.164:40946) 2024-09-13T23:05:35.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.294+0000 7f7b4bec0640 1 -- 172.21.15.164:0/3004088210 learned_addr learned my addr 172.21.15.164:0/3004088210 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:35.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.295+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/3004088210 >> v1:172.21.15.17:6789/0 conn(0x55e977717720 legacy=0x55e977719b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.295+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/3004088210 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9775dbe00 con 0x55e977688650 2024-09-13T23:05:35.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.296+0000 7f7b4c6c1640 1 --2- 172.21.15.164:0/3004088210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977688650 0x55e9777171e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00a470 tx=0x7f7b3c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13d0120db362b806 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.297+0000 7f7b4b6bf640 1 -- 172.21.15.164:0/3004088210 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b3c053570 con 0x55e977688650 2024-09-13T23:05:35.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.297+0000 7f7b4b6bf640 1 -- 172.21.15.164:0/3004088210 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b3c058070 con 0x55e977688650 2024-09-13T23:05:35.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.297+0000 7f7b4b6bf640 1 -- 172.21.15.164:0/3004088210 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b3c053880 con 0x55e977688650 2024-09-13T23:05:35.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.297+0000 7f7b51010800 1 -- 172.21.15.164:0/3004088210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977688650 msgr2=0x55e9777171e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.297+0000 7f7b51010800 1 --2- 172.21.15.164:0/3004088210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977688650 0x55e9777171e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00a470 tx=0x7f7b3c045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:35.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.297+0000 7f7b51010800 1 -- 172.21.15.164:0/3004088210 shutdown_connections 2024-09-13T23:05:35.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.297+0000 7f7b51010800 1 --2- 172.21.15.164:0/3004088210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977688650 0x55e9777171e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.297+0000 7f7b51010800 1 -- 172.21.15.164:0/3004088210 >> 172.21.15.164:0/3004088210 conn(0x55e97770edb0 msgr2=0x55e9777111d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.297+0000 7f7b51010800 1 -- 172.21.15.164:0/3004088210 shutdown_connections 2024-09-13T23:05:35.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.297+0000 7f7b51010800 1 -- 172.21.15.164:0/3004088210 wait complete. 2024-09-13T23:05:35.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.311+0000 7f7b51010800 1 Processor -- start 2024-09-13T23:05:35.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.311+0000 7f7b51010800 1 -- start start 2024-09-13T23:05:35.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.311+0000 7f7b51010800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977688650 0x55e977803880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.311+0000 7f7b51010800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e977660360 con 0x55e977688650 2024-09-13T23:05:35.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.312+0000 7f7b4c6c1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977688650 0x55e977803880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.312+0000 7f7b4c6c1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977688650 0x55e977803880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57664/0 (socket says 172.21.15.164:57664) 2024-09-13T23:05:35.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.312+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/1711392748 learned_addr learned my addr 172.21.15.164:0/1711392748 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.312+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/1711392748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9775adbc0 con 0x55e977688650 2024-09-13T23:05:35.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.312+0000 7f7b4c6c1640 1 --2- 172.21.15.164:0/1711392748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977688650 0x55e977803880 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c025c20 tx=0x7f7b3c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b09c07dfe524a919 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.312+0000 7f7a3a60c640 1 -- 172.21.15.164:0/1711392748 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b3c05c580 con 0x55e977688650 2024-09-13T23:05:35.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.312+0000 7f7a3a60c640 1 -- 172.21.15.164:0/1711392748 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b3c063030 con 0x55e977688650 2024-09-13T23:05:35.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.312+0000 7f7a3a60c640 1 -- 172.21.15.164:0/1711392748 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b3c05c850 con 0x55e977688650 2024-09-13T23:05:35.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.313+0000 7f7b51010800 1 -- 172.21.15.164:0/1711392748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977688650 msgr2=0x55e977803880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.313+0000 7f7b51010800 1 --2- 172.21.15.164:0/1711392748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977688650 0x55e977803880 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c025c20 tx=0x7f7b3c051000 comp rx=0 tx=0).stop 2024-09-13T23:05:35.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.313+0000 7f7b51010800 1 -- 172.21.15.164:0/1711392748 shutdown_connections 2024-09-13T23:05:35.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.313+0000 7f7b51010800 1 --2- 172.21.15.164:0/1711392748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977688650 0x55e977803880 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.313+0000 7f7b51010800 1 -- 172.21.15.164:0/1711392748 >> 172.21.15.164:0/1711392748 conn(0x55e97770edb0 msgr2=0x55e9777ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.313+0000 7f7b51010800 1 -- 172.21.15.164:0/1711392748 shutdown_connections 2024-09-13T23:05:35.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.313+0000 7f7b51010800 1 -- 172.21.15.164:0/1711392748 wait complete. 2024-09-13T23:05:35.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.313+0000 7f7b51010800 1 Processor -- start 2024-09-13T23:05:35.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.313+0000 7f7b51010800 1 -- start start 2024-09-13T23:05:35.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.313+0000 7f7b51010800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977688650 0x55e977714b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.313+0000 7f7b51010800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e97771b620 con 0x55e977688650 2024-09-13T23:05:35.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.314+0000 7f7b4c6c1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977688650 0x55e977714b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.314+0000 7f7b4c6c1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977688650 0x55e977714b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57666/0 (socket says 172.21.15.164:57666) 2024-09-13T23:05:35.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.314+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/3035782146 learned_addr learned my addr 172.21.15.164:0/3035782146 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.314+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/3035782146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9775c1fe0 con 0x55e977688650 2024-09-13T23:05:35.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.314+0000 7f7b4c6c1640 1 --2- 172.21.15.164:0/3035782146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977688650 0x55e977714b10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x55e9778046e0 tx=0x7f7b3c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.314+0000 7f7a38e09640 1 -- 172.21.15.164:0/3035782146 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b3c054ad0 con 0x55e977688650 2024-09-13T23:05:35.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.314+0000 7f7a38e09640 1 -- 172.21.15.164:0/3035782146 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b3c054c70 con 0x55e977688650 2024-09-13T23:05:35.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.314+0000 7f7a38e09640 1 -- 172.21.15.164:0/3035782146 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b3c068420 con 0x55e977688650 2024-09-13T23:05:35.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.314+0000 7f7b51010800 1 -- 172.21.15.164:0/3035782146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e977713200 con 0x55e977688650 2024-09-13T23:05:35.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.315+0000 7f7b51010800 1 -- 172.21.15.164:0/3035782146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e977713720 con 0x55e977688650 2024-09-13T23:05:35.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.315+0000 7f7a38e09640 1 -- 172.21.15.164:0/3035782146 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7b3c0685c0 con 0x55e977688650 2024-09-13T23:05:35.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.315+0000 7f7a38e09640 1 --2- 172.21.15.164:0/3035782146 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7a34036b40 0x7f7a34039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.315+0000 7f7a38e09640 1 -- 172.21.15.164:0/3035782146 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7b3c070030 con 0x55e977688650 2024-09-13T23:05:35.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.315+0000 7f7b4bec0640 1 --2- 172.21.15.164:0/3035782146 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7a34036b40 0x7f7a34039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.316+0000 7f7b51010800 1 --2- 172.21.15.164:0/3035782146 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e977717720 0x55e977814590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.316+0000 7f7b51010800 1 -- 172.21.15.164:0/3035782146 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e977814ad0 con 0x55e977717720 2024-09-13T23:05:35.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.316+0000 7f7b4cec2640 1 --2- 172.21.15.164:0/3035782146 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e977717720 0x55e977814590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.316+0000 7f7b4bec0640 1 --2- 172.21.15.164:0/3035782146 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7a34036b40 0x7f7a34039000 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7b40001d90 tx=0x7f7b400012f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.316+0000 7f7b4cec2640 1 --2- 172.21.15.164:0/3035782146 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e977717720 0x55e977814590 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.316+0000 7f7b4cec2640 1 -- 172.21.15.164:0/3035782146 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b4400a4a0 con 0x55e977717720 2024-09-13T23:05:35.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.316+0000 7f7b51010800 1 -- 172.21.15.164:0/3035782146 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e977815320 con 0x55e977717720 2024-09-13T23:05:35.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.317+0000 7f7b4cec2640 1 -- 172.21.15.164:0/3035782146 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b4400a4a0 con 0x55e977717720 2024-09-13T23:05:35.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.317+0000 7f7b51010800 1 -- 172.21.15.164:0/3035782146 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9778166d0 con 0x55e977717720 2024-09-13T23:05:35.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.317+0000 7f7b4cec2640 1 -- 172.21.15.164:0/3035782146 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7b4400a4a0 con 0x55e977717720 2024-09-13T23:05:35.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.317+0000 7f7b51010800 1 -- 172.21.15.164:0/3035782146 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e977815b70 con 0x55e977717720 2024-09-13T23:05:35.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.317+0000 7f7b4cec2640 1 -- 172.21.15.164:0/3035782146 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b4400a4a0 con 0x55e977717720 2024-09-13T23:05:35.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.317+0000 7f7b51010800 1 -- 172.21.15.164:0/3035782146 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e977815fc0 con 0x55e977717720 2024-09-13T23:05:35.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.317+0000 7f7b4cec2640 1 -- 172.21.15.164:0/3035782146 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7b4400a4a0 con 0x55e977717720 2024-09-13T23:05:35.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.318+0000 7f7b51010800 1 Processor -- start 2024-09-13T23:05:35.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.318+0000 7f7b51010800 1 -- start start 2024-09-13T23:05:35.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.318+0000 7f7b51010800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977824fb0 0x55e9778253d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.318+0000 7f7b51010800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e977715050 con 0x55e977824fb0 2024-09-13T23:05:35.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.318+0000 7f7b4bec0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977824fb0 0x55e9778253d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.318+0000 7f7b4bec0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977824fb0 0x55e9778253d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57674/0 (socket says 172.21.15.164:57674) 2024-09-13T23:05:35.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.318+0000 7f7b4bec0640 1 -- 172.21.15.164:0/4217195941 learned_addr learned my addr 172.21.15.164:0/4217195941 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.318+0000 7f7b4bec0640 1 -- 172.21.15.164:0/4217195941 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e977825910 con 0x55e977824fb0 2024-09-13T23:05:35.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.318+0000 7f7b4bec0640 1 --2- 172.21.15.164:0/4217195941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977824fb0 0x55e9778253d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000efd0 tx=0x7f7b4000d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.319+0000 7f7a327fc640 1 -- 172.21.15.164:0/4217195941 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b4001b550 con 0x55e977824fb0 2024-09-13T23:05:35.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.319+0000 7f7a327fc640 1 -- 172.21.15.164:0/4217195941 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b4001b6f0 con 0x55e977824fb0 2024-09-13T23:05:35.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.319+0000 7f7b51010800 1 -- 172.21.15.164:0/4217195941 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e977825ba0 con 0x55e977824fb0 2024-09-13T23:05:35.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.319+0000 7f7a327fc640 1 -- 172.21.15.164:0/4217195941 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b4001b9f0 con 0x55e977824fb0 2024-09-13T23:05:35.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.319+0000 7f7b51010800 1 -- 172.21.15.164:0/4217195941 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e977828880 con 0x55e977824fb0 2024-09-13T23:05:35.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.319+0000 7f7a327fc640 1 -- 172.21.15.164:0/4217195941 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7b40023020 con 0x55e977824fb0 2024-09-13T23:05:35.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.320+0000 7f7a327fc640 1 --2- 172.21.15.164:0/4217195941 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7a24036b40 0x7f7a24039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.320+0000 7f7a327fc640 1 -- 172.21.15.164:0/4217195941 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7b40021020 con 0x55e977824fb0 2024-09-13T23:05:35.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.320+0000 7f7b4cec2640 1 --2- 172.21.15.164:0/4217195941 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7a24036b40 0x7f7a24039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.320+0000 7f7b51010800 1 Processor -- start 2024-09-13T23:05:35.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.320+0000 7f7b51010800 1 -- start start 2024-09-13T23:05:35.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.320+0000 7f7b4cec2640 1 --2- 172.21.15.164:0/4217195941 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7a24036b40 0x7f7a24039000 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55e9778151d0 tx=0x7f7b44005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.320+0000 7f7b51010800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977831cc0 0x55e9778320c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.320+0000 7f7b51010800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e9775af580 con 0x55e977831cc0 2024-09-13T23:05:35.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.320+0000 7f7b4bec0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977831cc0 0x55e9778320c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.320+0000 7f7b4bec0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977831cc0 0x55e9778320c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57686/0 (socket says 172.21.15.164:57686) 2024-09-13T23:05:35.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.320+0000 7f7b4bec0640 1 -- 172.21.15.164:0/1103981987 learned_addr learned my addr 172.21.15.164:0/1103981987 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.321+0000 7f7b4bec0640 1 -- 172.21.15.164:0/1103981987 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e977832690 con 0x55e977831cc0 2024-09-13T23:05:35.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.321+0000 7f7b4bec0640 1 --2- 172.21.15.164:0/1103981987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977831cc0 0x55e9778320c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7b4001bbb0 tx=0x7f7b40024990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b69b8770615a9e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.321+0000 7f7a2b7fe640 1 -- 172.21.15.164:0/1103981987 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b40024cb0 con 0x55e977831cc0 2024-09-13T23:05:35.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.321+0000 7f7a2b7fe640 1 -- 172.21.15.164:0/1103981987 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b40025410 con 0x55e977831cc0 2024-09-13T23:05:35.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.321+0000 7f7a2b7fe640 1 -- 172.21.15.164:0/1103981987 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b4001bc60 con 0x55e977831cc0 2024-09-13T23:05:35.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.321+0000 7f7b51010800 1 -- 172.21.15.164:0/1103981987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977831cc0 msgr2=0x55e9778320c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.321+0000 7f7b51010800 1 --2- 172.21.15.164:0/1103981987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977831cc0 0x55e9778320c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7b4001bbb0 tx=0x7f7b40024990 comp rx=0 tx=0).stop 2024-09-13T23:05:35.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.321+0000 7f7b51010800 1 -- 172.21.15.164:0/1103981987 shutdown_connections 2024-09-13T23:05:35.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.321+0000 7f7b51010800 1 --2- 172.21.15.164:0/1103981987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977831cc0 0x55e9778320c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.321+0000 7f7b51010800 1 -- 172.21.15.164:0/1103981987 >> 172.21.15.164:0/1103981987 conn(0x55e97782e020 msgr2=0x55e97782c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.321+0000 7f7b51010800 1 -- 172.21.15.164:0/1103981987 shutdown_connections 2024-09-13T23:05:35.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.321+0000 7f7b51010800 1 -- 172.21.15.164:0/1103981987 wait complete. 2024-09-13T23:05:35.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.322+0000 7f7b51010800 1 Processor -- start 2024-09-13T23:05:35.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.322+0000 7f7b51010800 1 -- start start 2024-09-13T23:05:35.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.322+0000 7f7b51010800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977831cc0 0x55e977838ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.322+0000 7f7b51010800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e977832b80 con 0x55e977831cc0 2024-09-13T23:05:35.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.322+0000 7f7b4bec0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977831cc0 0x55e977838ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.322+0000 7f7b4bec0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977831cc0 0x55e977838ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57696/0 (socket says 172.21.15.164:57696) 2024-09-13T23:05:35.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.322+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 learned_addr learned my addr 172.21.15.164:0/892654526 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.322+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e977839530 con 0x55e977831cc0 2024-09-13T23:05:35.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.323+0000 7f7b4bec0640 1 --2- 172.21.15.164:0/892654526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977831cc0 0x55e977838ff0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7b4001bbb0 tx=0x7f7b4004d080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.323+0000 7f7a29ffb640 1 -- 172.21.15.164:0/892654526 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b40024cb0 con 0x55e977831cc0 2024-09-13T23:05:35.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.323+0000 7f7a29ffb640 1 -- 172.21.15.164:0/892654526 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b40040980 con 0x55e977831cc0 2024-09-13T23:05:35.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.323+0000 7f7a29ffb640 1 -- 172.21.15.164:0/892654526 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b40040c80 con 0x55e977831cc0 2024-09-13T23:05:35.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.323+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e977839530 con 0x55e977831cc0 2024-09-13T23:05:35.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.323+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e977839530 con 0x55e977831cc0 2024-09-13T23:05:35.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.323+0000 7f7a29ffb640 1 -- 172.21.15.164:0/892654526 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7b40040210 con 0x55e977831cc0 2024-09-13T23:05:35.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.324+0000 7f7a29ffb640 1 --2- 172.21.15.164:0/892654526 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7a14036b90 0x7f7a14039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.324+0000 7f7a29ffb640 1 -- 172.21.15.164:0/892654526 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7b4003aca0 con 0x55e977831cc0 2024-09-13T23:05:35.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.324+0000 7f7b4cec2640 1 --2- 172.21.15.164:0/892654526 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7a14036b90 0x7f7a14039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.324+0000 7f7b51010800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.324+0000 7f7b51010800 1 --2- 172.21.15.164:0/892654526 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e977844780 0x55e977846c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.324+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e977847390 con 0x55e977844780 2024-09-13T23:05:35.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.324+0000 7f7b4c6c1640 1 --2- 172.21.15.164:0/892654526 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e977844780 0x55e977846c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.324+0000 7f7b4cec2640 1 --2- 172.21.15.164:0/892654526 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7a14036b90 0x7f7a14039050 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x55e977713b10 tx=0x7f7b4401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.324+0000 7f7b4c6c1640 1 --2- 172.21.15.164:0/892654526 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e977844780 0x55e977846c40 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.325+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.325+0000 7f7b51010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.325+0000 7f7b51010800 20 realm 2024-09-13T23:05:35.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.325+0000 7f7b51010800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.325+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9778477a0 con 0x55e977844780 2024-09-13T23:05:35.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.325+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.325+0000 7f7b51010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.325+0000 7f7b51010800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:35.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.325+0000 7f7b51010800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.325+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e977848070 con 0x55e977844780 2024-09-13T23:05:35.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.325+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.325+0000 7f7b51010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.325+0000 7f7b51010800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.325+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e977848410 con 0x55e977844780 2024-09-13T23:05:35.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.325+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.325+0000 7f7b51010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:35.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.325+0000 7f7b51010800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.325+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e977848870 con 0x55e977844780 2024-09-13T23:05:35.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.325+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.325+0000 7f7b51010800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:35.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.325+0000 7f7b51010800 20 searching for the correct realm 2024-09-13T23:05:35.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.325+0000 7f7b51010800 1 --2- 172.21.15.164:0/892654526 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55e97784a8c0 0x55e97784ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.325+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x55e97784a8c0 2024-09-13T23:05:35.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.326+0000 7f7b4bec0640 1 --2- 172.21.15.164:0/892654526 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55e97784a8c0 0x55e97784ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.326+0000 7f7b4bec0640 1 --2- 172.21.15.164:0/892654526 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55e97784a8c0 0x55e97784ccb0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.326+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b40009050 con 0x55e97784a8c0 2024-09-13T23:05:35.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.326+0000 7f7b4bec0640 1 --2- 172.21.15.164:0/892654526 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7b40059040 0x7f7b4001e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.326+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x7f7b40059040 2024-09-13T23:05:35.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.326+0000 7f7b4cec2640 1 --2- 172.21.15.164:0/892654526 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7b40059040 0x7f7b4001e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.327+0000 7f7b4cec2640 1 --2- 172.21.15.164:0/892654526 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7b40059040 0x7f7b4001e0d0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.327+0000 7f7b4cec2640 1 -- 172.21.15.164:0/892654526 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4401f070 con 0x7f7b40059040 2024-09-13T23:05:35.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.327+0000 7f7b4cec2640 1 --2- 172.21.15.164:0/892654526 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7b44031040 0x7f7b44032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.327+0000 7f7b4cec2640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x7f7b44031040 2024-09-13T23:05:35.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.327+0000 7f7b4c6c1640 1 --2- 172.21.15.164:0/892654526 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7b44031040 0x7f7b44032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.327+0000 7f7b4c6c1640 1 --2- 172.21.15.164:0/892654526 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7b44031040 0x7f7b44032430 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.328+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3c051070 con 0x7f7b44031040 2024-09-13T23:05:35.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.328+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x55e977844780 2024-09-13T23:05:35.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.328+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.328+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x55e977844780 2024-09-13T23:05:35.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.328+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.328+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x7f7b44031040 2024-09-13T23:05:35.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.328+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3c051070 con 0x7f7b44031040 2024-09-13T23:05:35.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.328+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x7f7b44031040 2024-09-13T23:05:35.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.329+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3c051070 con 0x7f7b44031040 2024-09-13T23:05:35.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.329+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x7f7b40059040 2024-09-13T23:05:35.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.329+0000 7f7b4cec2640 1 -- 172.21.15.164:0/892654526 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4401f070 con 0x7f7b40059040 2024-09-13T23:05:35.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.329+0000 7f7b4cec2640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x55e97784a8c0 2024-09-13T23:05:35.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.329+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b40009050 con 0x55e97784a8c0 2024-09-13T23:05:35.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.329+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x55e977844780 2024-09-13T23:05:35.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.329+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.329+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x7f7b44031040 2024-09-13T23:05:35.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.330+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3c051070 con 0x7f7b44031040 2024-09-13T23:05:35.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.330+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x55e977844780 2024-09-13T23:05:35.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.330+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.330+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x7f7b40059040 2024-09-13T23:05:35.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.330+0000 7f7b4cec2640 1 -- 172.21.15.164:0/892654526 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7b4401f070 con 0x7f7b40059040 2024-09-13T23:05:35.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.330+0000 7f7b4cec2640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x55e97784a8c0 2024-09-13T23:05:35.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.330+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b40009050 con 0x55e97784a8c0 2024-09-13T23:05:35.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.330+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x55e97784a8c0 2024-09-13T23:05:35.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.331+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b40009050 con 0x55e97784a8c0 2024-09-13T23:05:35.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.331+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x7f7b44031040 2024-09-13T23:05:35.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.331+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3c051070 con 0x7f7b44031040 2024-09-13T23:05:35.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.331+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x55e97784a8c0 2024-09-13T23:05:35.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.331+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b40009050 con 0x55e97784a8c0 2024-09-13T23:05:35.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.331+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x55e97784a8c0 2024-09-13T23:05:35.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.331+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b40009050 con 0x55e97784a8c0 2024-09-13T23:05:35.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.331+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x55e977844780 2024-09-13T23:05:35.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.332+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.332+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x55e977844780 2024-09-13T23:05:35.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.332+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.332+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x7f7b44031040 2024-09-13T23:05:35.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.332+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3c051070 con 0x7f7b44031040 2024-09-13T23:05:35.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.332+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x55e97784a8c0 2024-09-13T23:05:35.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.333+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b40009050 con 0x55e97784a8c0 2024-09-13T23:05:35.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.333+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x7f7b40059040 2024-09-13T23:05:35.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.333+0000 7f7b4cec2640 1 -- 172.21.15.164:0/892654526 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4401f070 con 0x7f7b40059040 2024-09-13T23:05:35.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.333+0000 7f7b4cec2640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x55e977844780 2024-09-13T23:05:35.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.333+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.333+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x7f7b44031040 2024-09-13T23:05:35.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.333+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3c051070 con 0x7f7b44031040 2024-09-13T23:05:35.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.333+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x55e97784a8c0 2024-09-13T23:05:35.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.334+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b40009050 con 0x55e97784a8c0 2024-09-13T23:05:35.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.334+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x7f7b44031040 2024-09-13T23:05:35.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.334+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3c051070 con 0x7f7b44031040 2024-09-13T23:05:35.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.334+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x7f7b40059040 2024-09-13T23:05:35.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.334+0000 7f7b4cec2640 1 -- 172.21.15.164:0/892654526 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4401f070 con 0x7f7b40059040 2024-09-13T23:05:35.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.334+0000 7f7b4cec2640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x55e97784a8c0 2024-09-13T23:05:35.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.334+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b40009050 con 0x55e97784a8c0 2024-09-13T23:05:35.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.334+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x7f7b44031040 2024-09-13T23:05:35.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.335+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b3c051070 con 0x7f7b44031040 2024-09-13T23:05:35.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.335+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x55e977844780 2024-09-13T23:05:35.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.335+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.335+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d380 con 0x7f7b40059040 2024-09-13T23:05:35.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.335+0000 7f7b4cec2640 1 -- 172.21.15.164:0/892654526 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4401f070 con 0x7f7b40059040 2024-09-13T23:05:35.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.335+0000 7f7b51010800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:35.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.335+0000 7f7b51010800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:35.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.335+0000 7f7b51010800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:35.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.335+0000 7f7b51010800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:35.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.335+0000 7f7b51010800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:35.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.335+0000 7f7b51010800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:35.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.335+0000 7f7b51010800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.335+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e977849340 con 0x55e977844780 2024-09-13T23:05:35.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.335+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.335+0000 7f7b51010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.335+0000 7f7b51010800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.335+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e977849be0 con 0x55e977844780 2024-09-13T23:05:35.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.336+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.336+0000 7f7b51010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:35.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.336+0000 7f7b51010800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.336+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e977848f80 con 0x55e977844780 2024-09-13T23:05:35.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.336+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.336+0000 7f7b51010800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:35.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.336+0000 7f7b51010800 20 zone default found 2024-09-13T23:05:35.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.336+0000 7f7b51010800 4 Realm: () 2024-09-13T23:05:35.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.336+0000 7f7b51010800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:35.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.336+0000 7f7b51010800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:35.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.336+0000 7f7b51010800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:35.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.336+0000 7f7b51010800 20 zonegroup default 2024-09-13T23:05:35.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.336+0000 7f7b51010800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.336+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e97784d800 con 0x7f7b44031040 2024-09-13T23:05:35.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.336+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7b3c051070 con 0x7f7b44031040 2024-09-13T23:05:35.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.336+0000 7f7b51010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.336+0000 7f7b51010800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.336+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e97784f690 con 0x55e97784a8c0 2024-09-13T23:05:35.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.336+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b40009050 con 0x55e97784a8c0 2024-09-13T23:05:35.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.337+0000 7f7b51010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.337+0000 7f7b51010800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.337+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e97784fa30 con 0x55e97784a8c0 2024-09-13T23:05:35.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.337+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b40009050 con 0x55e97784a8c0 2024-09-13T23:05:35.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.337+0000 7f7b51010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.337+0000 7f7b51010800 20 started sync module instance, tier type = 2024-09-13T23:05:35.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.337+0000 7f7b51010800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:35.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.337+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e97784ead0 con 0x7f7b40059040 2024-09-13T23:05:35.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.338+0000 7f7b4cec2640 1 -- 172.21.15.164:0/892654526 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b44040040 con 0x7f7b40059040 2024-09-13T23:05:35.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.338+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94461220941552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e977850280 con 0x7f7b40059040 2024-09-13T23:05:35.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.338+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e977850ad0 con 0x55e977844780 2024-09-13T23:05:35.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.339+0000 7f7b4cec2640 1 -- 172.21.15.164:0/892654526 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94461220941552] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b44040040 con 0x7f7b40059040 2024-09-13T23:05:35.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.339+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.339+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94461220945360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e977850700 con 0x55e977844780 2024-09-13T23:05:35.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.339+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9778511e0 con 0x55e97784a8c0 2024-09-13T23:05:35.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.340+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94461220945360] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.340+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b40009050 con 0x55e97784a8c0 2024-09-13T23:05:35.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.340+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94461220949136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9778515d0 con 0x55e97784a8c0 2024-09-13T23:05:35.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.340+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e977851ff0 con 0x7f7b40059040 2024-09-13T23:05:35.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.341+0000 7f7b4cec2640 1 -- 172.21.15.164:0/892654526 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b44040040 con 0x7f7b40059040 2024-09-13T23:05:35.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.341+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94461220952800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e977852890 con 0x7f7b40059040 2024-09-13T23:05:35.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.341+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9778533b0 con 0x55e977844780 2024-09-13T23:05:35.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.341+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94461220949136] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b40009050 con 0x55e97784a8c0 2024-09-13T23:05:35.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.342+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.342+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94461220957824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e977853370 con 0x55e977844780 2024-09-13T23:05:35.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.342+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e977853e10 con 0x7f7b44031040 2024-09-13T23:05:35.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.342+0000 7f7b4cec2640 1 -- 172.21.15.164:0/892654526 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94461220952800] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b44040040 con 0x7f7b40059040 2024-09-13T23:05:35.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.343+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94461220957824] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.343+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3c051070 con 0x7f7b44031040 2024-09-13T23:05:35.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.343+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94461220946416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e977853e10 con 0x7f7b44031040 2024-09-13T23:05:35.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.343+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9778546b0 con 0x7f7b44031040 2024-09-13T23:05:35.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.344+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94461220946416] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3c051070 con 0x7f7b44031040 2024-09-13T23:05:35.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.344+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3c051070 con 0x7f7b44031040 2024-09-13T23:05:35.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.344+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94461220960576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e977853e10 con 0x7f7b44031040 2024-09-13T23:05:35.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.344+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e977854cd0 con 0x7f7b44031040 2024-09-13T23:05:35.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.345+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94461220960576] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3c051070 con 0x7f7b44031040 2024-09-13T23:05:35.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.345+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3c051070 con 0x7f7b44031040 2024-09-13T23:05:35.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.345+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94461220962816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e977854cd0 con 0x7f7b44031040 2024-09-13T23:05:35.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.345+0000 7f7b51010800 20 add_watcher() i=0 2024-09-13T23:05:35.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.345+0000 7f7b51010800 20 add_watcher() i=1 2024-09-13T23:05:35.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.346+0000 7f7b51010800 20 add_watcher() i=2 2024-09-13T23:05:35.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.346+0000 7f7b51010800 20 add_watcher() i=3 2024-09-13T23:05:35.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.346+0000 7f7b51010800 20 add_watcher() i=4 2024-09-13T23:05:35.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.346+0000 7f7b51010800 20 add_watcher() i=5 2024-09-13T23:05:35.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.346+0000 7f7b51010800 20 add_watcher() i=6 2024-09-13T23:05:35.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.346+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94461220962816] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3c051070 con 0x7f7b44031040 2024-09-13T23:05:35.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.346+0000 7f7b51010800 20 add_watcher() i=7 2024-09-13T23:05:35.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.346+0000 7f7b51010800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:35.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.346+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9778580d0 con 0x55e977844780 2024-09-13T23:05:35.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.347+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.347+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94461220964848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9778555f0 con 0x55e977844780 2024-09-13T23:05:35.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.348+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94461220964848] v32'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.348+0000 7f7a02fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:35.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.348+0000 7f7b51010800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:35.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.348+0000 7f7b51010800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:35.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.348+0000 7f7b51010800 5 note: GC not initialized 2024-09-13T23:05:35.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.348+0000 7f7a01fdb640 20 reqs_thread_entry: start 2024-09-13T23:05:35.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.348+0000 7f7b51010800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:35.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.348+0000 7f7b51010800 20 Filter name: none 2024-09-13T23:05:35.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.348+0000 7f79737fe640 20 reqs_thread_entry: start 2024-09-13T23:05:35.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.348+0000 7f7b51010800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.348+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e97788b040 con 0x55e977844780 2024-09-13T23:05:35.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.349+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.349+0000 7f7b51010800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:05:35.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.349+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e97788c590 con 0x7f7b40059040 2024-09-13T23:05:35.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.349+0000 7f7b4cec2640 1 -- 172.21.15.164:0/892654526 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f7b44040040 con 0x7f7b40059040 2024-09-13T23:05:35.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.349+0000 7f7b51010800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.349+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 8.15 8:aa4f46c1:root::.bucket.meta.myfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e97788c590 con 0x55e97784a8c0 2024-09-13T23:05:35.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.350+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f7b40009050 con 0x55e97784a8c0 2024-09-13T23:05:35.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.350+0000 7f7b51010800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:05:35.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.350+0000 7f7b51010800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T23:05:35.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.350+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:65 4.14 4:29473231:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e97788dfe0 con 0x55e97784a8c0 2024-09-13T23:05:35.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.350+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:66 4.4 4:21c197e9:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e977890c90 con 0x7f7b44031040 2024-09-13T23:05:35.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.350+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:67 4.1c 4:3980393e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9778939c0 con 0x7f7b44031040 2024-09-13T23:05:35.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.350+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 4.3c 4:3c3df72e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e977896610 con 0x55e977844780 2024-09-13T23:05:35.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.350+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 4.37 4:ec9f5977:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9778939c0 con 0x7f7b44031040 2024-09-13T23:05:35.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.350+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:70 4.17 4:ea5fb2d4:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e97789b7b0 con 0x7f7b44031040 2024-09-13T23:05:35.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.350+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:71 4.30 4:0d33cc25:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e97789e040 con 0x55e97784a8c0 2024-09-13T23:05:35.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.350+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:72 4.2b 4:d7ffec3e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9778a08b0 con 0x55e977844780 2024-09-13T23:05:35.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.350+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:73 4.3e 4:7f41df37:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9778a32e0 con 0x7f7b40059040 2024-09-13T23:05:35.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.350+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:74 4.5 4:a1ee3102:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9778a32e0 con 0x55e97784a8c0 2024-09-13T23:05:35.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.350+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:75 4.30 4:0c251f7e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9778a8470 con 0x55e97784a8c0 2024-09-13T23:05:35.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.350+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(65 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7b40009050 con 0x55e97784a8c0 2024-09-13T23:05:35.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.350+0000 7f7b4cec2640 1 -- 172.21.15.164:0/892654526 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(73 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7b44040040 con 0x7f7b40059040 2024-09-13T23:05:35.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.350+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(68 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.350+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(71 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7b40009050 con 0x55e97784a8c0 2024-09-13T23:05:35.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.350+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(72 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.350+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(74 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7b40009050 con 0x55e97784a8c0 2024-09-13T23:05:35.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.350+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(66 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7b3c051070 con 0x7f7b44031040 2024-09-13T23:05:35.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.350+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(75 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f7b40009050 con 0x55e97784a8c0 2024-09-13T23:05:35.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.350+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(69 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7b3c051070 con 0x7f7b44031040 2024-09-13T23:05:35.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.350+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(67 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7b3c051070 con 0x7f7b44031040 2024-09-13T23:05:35.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.350+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(70 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f7b3c051070 con 0x7f7b44031040 2024-09-13T23:05:35.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.351+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e97788db30 con 0x7f7b40059040 2024-09-13T23:05:35.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.351+0000 7f7b4cec2640 1 -- 172.21.15.164:0/892654526 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(76 foo.buckets [call] v32'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7b44040040 con 0x7f7b40059040 2024-09-13T23:05:35.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.352+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e97788db30 con 0x7f7b40059040 2024-09-13T23:05:35.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.352+0000 7f7b4cec2640 1 -- 172.21.15.164:0/892654526 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(77 foo.buckets [call] v32'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7b44040040 con 0x7f7b40059040 2024-09-13T23:05:35.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.352+0000 7f7b51010800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.352+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9778a83f0 con 0x55e977844780 2024-09-13T23:05:35.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.353+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.353+0000 7f7b51010800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:05:35.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.353+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e9778a83f0 con 0x7f7b40059040 2024-09-13T23:05:35.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.353+0000 7f7b4cec2640 1 -- 172.21.15.164:0/892654526 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7f7b44040040 con 0x7f7b40059040 2024-09-13T23:05:35.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.354+0000 7f7a02fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:35.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.354+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94461220964848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9778a7e80 con 0x55e977844780 2024-09-13T23:05:35.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.355+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94461220964848] v32'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.355+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94461220941552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e9778549c0 con 0x7f7b40059040 2024-09-13T23:05:35.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.356+0000 7f7b4cec2640 1 -- 172.21.15.164:0/892654526 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94461220941552] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b44040040 con 0x7f7b40059040 2024-09-13T23:05:35.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.356+0000 7f7b51010800 20 remove_watcher() i=0 2024-09-13T23:05:35.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.356+0000 7f7b51010800 2 removed watcher, disabling cache 2024-09-13T23:05:35.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.356+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94461220945360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e97784eef0 con 0x55e977844780 2024-09-13T23:05:35.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.357+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94461220945360] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.357+0000 7f7b51010800 20 remove_watcher() i=1 2024-09-13T23:05:35.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.357+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94461220949136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e97784fdd0 con 0x55e97784a8c0 2024-09-13T23:05:35.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.358+0000 7f7b4bec0640 1 -- 172.21.15.164:0/892654526 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94461220949136] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b40009050 con 0x55e97784a8c0 2024-09-13T23:05:35.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.358+0000 7f7b51010800 20 remove_watcher() i=2 2024-09-13T23:05:35.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.358+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94461220952800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e97784fdd0 con 0x7f7b40059040 2024-09-13T23:05:35.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.359+0000 7f7b4cec2640 1 -- 172.21.15.164:0/892654526 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94461220952800] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b44040040 con 0x7f7b40059040 2024-09-13T23:05:35.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.359+0000 7f7b51010800 20 remove_watcher() i=3 2024-09-13T23:05:35.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.359+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94461220957824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e97784fdd0 con 0x55e977844780 2024-09-13T23:05:35.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.360+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94461220957824] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3c051070 con 0x55e977844780 2024-09-13T23:05:35.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.360+0000 7f7b51010800 20 remove_watcher() i=4 2024-09-13T23:05:35.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.360+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94461220946416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e97784fdd0 con 0x7f7b44031040 2024-09-13T23:05:35.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.361+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94461220946416] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3c051070 con 0x7f7b44031040 2024-09-13T23:05:35.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.361+0000 7f7b51010800 20 remove_watcher() i=5 2024-09-13T23:05:35.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.361+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94461220960576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e977852e80 con 0x7f7b44031040 2024-09-13T23:05:35.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.362+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94461220960576] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3c051070 con 0x7f7b44031040 2024-09-13T23:05:35.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.362+0000 7f7b51010800 20 remove_watcher() i=6 2024-09-13T23:05:35.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.362+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94461220962816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e977852e80 con 0x7f7b44031040 2024-09-13T23:05:35.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.363+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94461220962816] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b3c051070 con 0x7f7b44031040 2024-09-13T23:05:35.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.363+0000 7f7b51010800 20 remove_watcher() i=7 2024-09-13T23:05:35.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.363+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7b44031040 msgr2=0x7f7b44032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.363+0000 7f7b51010800 1 --2- 172.21.15.164:0/892654526 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7b44031040 0x7f7b44032430 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.363+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e977844780 msgr2=0x55e977846c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.363+0000 7f7b51010800 1 --2- 172.21.15.164:0/892654526 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e977844780 0x55e977846c40 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.363+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7b40059040 msgr2=0x7f7b4001e0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.363+0000 7f7b51010800 1 --2- 172.21.15.164:0/892654526 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7b40059040 0x7f7b4001e0d0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.363+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55e97784a8c0 msgr2=0x55e97784ccb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.363+0000 7f7b51010800 1 --2- 172.21.15.164:0/892654526 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55e97784a8c0 0x55e97784ccb0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.363+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7a14036b90 msgr2=0x7f7a14039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.363+0000 7f7b51010800 1 --2- 172.21.15.164:0/892654526 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7a14036b90 0x7f7a14039050 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x55e977713b10 tx=0x7f7b4401f000 comp rx=0 tx=0).stop 2024-09-13T23:05:35.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.363+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977831cc0 msgr2=0x55e977838ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.363+0000 7f7b51010800 1 --2- 172.21.15.164:0/892654526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977831cc0 0x55e977838ff0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7b4001bbb0 tx=0x7f7b4004d080 comp rx=0 tx=0).stop 2024-09-13T23:05:35.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.363+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 reap_dead start 2024-09-13T23:05:35.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.363+0000 7f7b4c6c1640 1 -- 172.21.15.164:0/892654526 reap_dead start 2024-09-13T23:05:35.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.363+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 shutdown_connections 2024-09-13T23:05:35.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.363+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 >> 172.21.15.164:0/892654526 conn(0x55e97782e020 msgr2=0x55e97782c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.364+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 shutdown_connections 2024-09-13T23:05:35.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.364+0000 7f7b51010800 1 -- 172.21.15.164:0/892654526 wait complete. 2024-09-13T23:05:35.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.364+0000 7f7b51010800 1 -- 172.21.15.164:0/4217195941 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7a24036b40 msgr2=0x7f7a24039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.364+0000 7f7b51010800 1 --2- 172.21.15.164:0/4217195941 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7a24036b40 0x7f7a24039000 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55e9778151d0 tx=0x7f7b44005840 comp rx=0 tx=0).stop 2024-09-13T23:05:35.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.364+0000 7f7b51010800 1 -- 172.21.15.164:0/4217195941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977824fb0 msgr2=0x55e9778253d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.364+0000 7f7b51010800 1 --2- 172.21.15.164:0/4217195941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977824fb0 0x55e9778253d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000efd0 tx=0x7f7b4000d7a0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.364+0000 7f7b51010800 1 -- 172.21.15.164:0/4217195941 shutdown_connections 2024-09-13T23:05:35.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.364+0000 7f7b51010800 1 --2- 172.21.15.164:0/4217195941 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7a24036b40 0x7f7a24039000 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.364+0000 7f7b51010800 1 --2- 172.21.15.164:0/4217195941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977824fb0 0x55e9778253d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.364+0000 7f7b51010800 1 -- 172.21.15.164:0/4217195941 >> 172.21.15.164:0/4217195941 conn(0x55e977819f90 msgr2=0x55e97781cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.364+0000 7f7b51010800 1 -- 172.21.15.164:0/4217195941 shutdown_connections 2024-09-13T23:05:35.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.364+0000 7f7b51010800 1 -- 172.21.15.164:0/4217195941 wait complete. 2024-09-13T23:05:35.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.364+0000 7f7b51010800 1 -- 172.21.15.164:0/3035782146 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e977717720 msgr2=0x55e977814590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.364+0000 7f7b51010800 1 --2- 172.21.15.164:0/3035782146 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e977717720 0x55e977814590 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.364+0000 7f7b51010800 1 -- 172.21.15.164:0/3035782146 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7a34036b40 msgr2=0x7f7a34039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.364+0000 7f7b51010800 1 --2- 172.21.15.164:0/3035782146 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7a34036b40 0x7f7a34039000 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7b40001d90 tx=0x7f7b400012f0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.364+0000 7f7b51010800 1 -- 172.21.15.164:0/3035782146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977688650 msgr2=0x55e977714b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.364+0000 7f7b51010800 1 --2- 172.21.15.164:0/3035782146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977688650 0x55e977714b10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x55e9778046e0 tx=0x7f7b3c002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.364+0000 7f7b51010800 1 -- 172.21.15.164:0/3035782146 shutdown_connections 2024-09-13T23:05:35.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.364+0000 7f7b51010800 1 --2- 172.21.15.164:0/3035782146 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e977717720 0x55e977814590 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.364+0000 7f7b51010800 1 --2- 172.21.15.164:0/3035782146 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7a34036b40 0x7f7a34039000 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.364+0000 7f7b51010800 1 --2- 172.21.15.164:0/3035782146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e977688650 0x55e977714b10 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.364+0000 7f7b51010800 1 -- 172.21.15.164:0/3035782146 >> 172.21.15.164:0/3035782146 conn(0x55e97770edb0 msgr2=0x55e9777fdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.364+0000 7f7b51010800 1 -- 172.21.15.164:0/3035782146 shutdown_connections 2024-09-13T23:05:35.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.364+0000 7f7b51010800 1 -- 172.21.15.164:0/3035782146 wait complete. 2024-09-13T23:05:35.408 INFO:teuthology.orchestra.run.smithi164.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-09-13T23:05:35.353545Z","last_stats_update":"2024-09-13T23:05:35.352550Z"} 2024-09-13T23:05:35.408 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-13T23:05:35.353545Z', 'last_stats_update': '2024-09-13T23:05:35.352550Z'} 2024-09-13T23:05:35.413 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:05:35.413 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-13T23:05:35.413 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-13T23:05:35.414 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-13T23:05:35.462 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:35.463 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:35.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.462+0000 7f37e5d51800 1 Processor -- start 2024-09-13T23:05:35.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.462+0000 7f37e5d51800 1 -- start start 2024-09-13T23:05:35.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.462+0000 7f37e5d51800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55816acdfa00 0x55816acdfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.462+0000 7f37e5d51800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55816aba0b30 con 0x55816ace0340 2024-09-13T23:05:35.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.462+0000 7f37e5d51800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55816ab82360 con 0x55816acdfa00 2024-09-13T23:05:35.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.462+0000 7f37e3845640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55816acdfa00 0x55816acdfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.462+0000 7f37dbfff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55816ace0340 0x55816ace6aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40962/0 (socket says 172.21.15.164:40962) 2024-09-13T23:05:35.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.462+0000 7f37dbfff640 1 -- 172.21.15.164:0/1430101142 learned_addr learned my addr 172.21.15.164:0/1430101142 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:35.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.462+0000 7f37e3845640 1 -- 172.21.15.164:0/1430101142 >> v1:172.21.15.17:6789/0 conn(0x55816ace0340 legacy=0x55816ace6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.462+0000 7f37e3845640 1 -- 172.21.15.164:0/1430101142 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55816aba8e00 con 0x55816acdfa00 2024-09-13T23:05:35.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.464+0000 7f37e3845640 1 --2- 172.21.15.164:0/1430101142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816acdfa00 0x55816acdfe00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f37d400a470 tx=0x7f37d4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c39c9591abe1383 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.464+0000 7f37e3044640 1 -- 172.21.15.164:0/1430101142 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d4053570 con 0x55816acdfa00 2024-09-13T23:05:35.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.464+0000 7f37e3044640 1 -- 172.21.15.164:0/1430101142 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d4058070 con 0x55816acdfa00 2024-09-13T23:05:35.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.464+0000 7f37e3044640 1 -- 172.21.15.164:0/1430101142 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d4053880 con 0x55816acdfa00 2024-09-13T23:05:35.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.465+0000 7f37e5d51800 1 -- 172.21.15.164:0/1430101142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816acdfa00 msgr2=0x55816acdfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.465+0000 7f37e5d51800 1 --2- 172.21.15.164:0/1430101142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816acdfa00 0x55816acdfe00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f37d400a470 tx=0x7f37d4045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:35.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.465+0000 7f37e5d51800 1 -- 172.21.15.164:0/1430101142 shutdown_connections 2024-09-13T23:05:35.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.465+0000 7f37e5d51800 1 --2- 172.21.15.164:0/1430101142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816acdfa00 0x55816acdfe00 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.465+0000 7f37e5d51800 1 -- 172.21.15.164:0/1430101142 >> 172.21.15.164:0/1430101142 conn(0x55816acdb550 msgr2=0x55816acdd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.465+0000 7f37e5d51800 1 -- 172.21.15.164:0/1430101142 shutdown_connections 2024-09-13T23:05:35.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.465+0000 7f37e5d51800 1 -- 172.21.15.164:0/1430101142 wait complete. 2024-09-13T23:05:35.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.479+0000 7f37e5d51800 1 Processor -- start 2024-09-13T23:05:35.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.479+0000 7f37e5d51800 1 -- start start 2024-09-13T23:05:35.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.479+0000 7f37e5d51800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816acdfa00 0x55816add08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.479+0000 7f37e5d51800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55816ac2d360 con 0x55816acdfa00 2024-09-13T23:05:35.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.479+0000 7f37e3845640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816acdfa00 0x55816add08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.479+0000 7f37e3845640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816acdfa00 0x55816add08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57712/0 (socket says 172.21.15.164:57712) 2024-09-13T23:05:35.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.479+0000 7f37e3845640 1 -- 172.21.15.164:0/3567366177 learned_addr learned my addr 172.21.15.164:0/3567366177 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.480+0000 7f37e3845640 1 -- 172.21.15.164:0/3567366177 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55816ab7abc0 con 0x55816acdfa00 2024-09-13T23:05:35.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.480+0000 7f37e3845640 1 --2- 172.21.15.164:0/3567366177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816acdfa00 0x55816add08a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f37d4025c20 tx=0x7f37d4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf6f861d67e0ae95 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.480+0000 7f36d1e0b640 1 -- 172.21.15.164:0/3567366177 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d4053ba0 con 0x55816acdfa00 2024-09-13T23:05:35.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.480+0000 7f36d1e0b640 1 -- 172.21.15.164:0/3567366177 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d4063030 con 0x55816acdfa00 2024-09-13T23:05:35.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.480+0000 7f36d1e0b640 1 -- 172.21.15.164:0/3567366177 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d4053440 con 0x55816acdfa00 2024-09-13T23:05:35.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.481+0000 7f37e5d51800 1 -- 172.21.15.164:0/3567366177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816acdfa00 msgr2=0x55816add08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.481+0000 7f37e5d51800 1 --2- 172.21.15.164:0/3567366177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816acdfa00 0x55816add08a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f37d4025c20 tx=0x7f37d4051000 comp rx=0 tx=0).stop 2024-09-13T23:05:35.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.481+0000 7f37e5d51800 1 -- 172.21.15.164:0/3567366177 shutdown_connections 2024-09-13T23:05:35.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.481+0000 7f37e5d51800 1 --2- 172.21.15.164:0/3567366177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816acdfa00 0x55816add08a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.481+0000 7f37e5d51800 1 -- 172.21.15.164:0/3567366177 >> 172.21.15.164:0/3567366177 conn(0x55816acdb550 msgr2=0x55816adcc260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.481+0000 7f37e5d51800 1 -- 172.21.15.164:0/3567366177 shutdown_connections 2024-09-13T23:05:35.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.481+0000 7f37e5d51800 1 -- 172.21.15.164:0/3567366177 wait complete. 2024-09-13T23:05:35.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.481+0000 7f37e5d51800 1 Processor -- start 2024-09-13T23:05:35.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.481+0000 7f37e5d51800 1 -- start start 2024-09-13T23:05:35.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.481+0000 7f37e5d51800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816acdfa00 0x55816add8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.481+0000 7f37e5d51800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55816ace8600 con 0x55816acdfa00 2024-09-13T23:05:35.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.481+0000 7f37e3845640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816acdfa00 0x55816add8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.481+0000 7f37e3845640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816acdfa00 0x55816add8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57714/0 (socket says 172.21.15.164:57714) 2024-09-13T23:05:35.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.481+0000 7f37e3845640 1 -- 172.21.15.164:0/3219421948 learned_addr learned my addr 172.21.15.164:0/3219421948 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.482+0000 7f37e3845640 1 -- 172.21.15.164:0/3219421948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55816ab8efe0 con 0x55816acdfa00 2024-09-13T23:05:35.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.482+0000 7f37e3845640 1 --2- 172.21.15.164:0/3219421948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816acdfa00 0x55816add8200 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x55816add1700 tx=0x7f37d4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.482+0000 7f36cbfff640 1 -- 172.21.15.164:0/3219421948 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d4078070 con 0x55816acdfa00 2024-09-13T23:05:35.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.482+0000 7f36cbfff640 1 -- 172.21.15.164:0/3219421948 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d4053570 con 0x55816acdfa00 2024-09-13T23:05:35.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.482+0000 7f37e5d51800 1 -- 172.21.15.164:0/3219421948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55816add8740 con 0x55816acdfa00 2024-09-13T23:05:35.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.482+0000 7f36cbfff640 1 -- 172.21.15.164:0/3219421948 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d4053850 con 0x55816acdfa00 2024-09-13T23:05:35.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.482+0000 7f37e5d51800 1 -- 172.21.15.164:0/3219421948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55816add8cc0 con 0x55816acdfa00 2024-09-13T23:05:35.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.483+0000 7f36cbfff640 1 -- 172.21.15.164:0/3219421948 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f37d407b070 con 0x55816acdfa00 2024-09-13T23:05:35.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.483+0000 7f36cbfff640 1 --2- 172.21.15.164:0/3219421948 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f36cc036b90 0x7f36cc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.483+0000 7f36cbfff640 1 -- 172.21.15.164:0/3219421948 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f37d4070070 con 0x55816acdfa00 2024-09-13T23:05:35.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.483+0000 7f37dbfff640 1 --2- 172.21.15.164:0/3219421948 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f36cc036b90 0x7f36cc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.483+0000 7f37e5d51800 1 --2- 172.21.15.164:0/3219421948 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55816ace0340 0x55816addf270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.483+0000 7f37e5d51800 1 -- 172.21.15.164:0/3219421948 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55816addf800 con 0x55816ace0340 2024-09-13T23:05:35.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.483+0000 7f37e4046640 1 --2- 172.21.15.164:0/3219421948 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55816ace0340 0x55816addf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.483+0000 7f37dbfff640 1 --2- 172.21.15.164:0/3219421948 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f36cc036b90 0x7f36cc039050 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f37cc000f60 tx=0x7f37cc0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.484+0000 7f37e4046640 1 --2- 172.21.15.164:0/3219421948 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55816ace0340 0x55816addf270 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.484+0000 7f37e4046640 1 -- 172.21.15.164:0/3219421948 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37dc00a4a0 con 0x55816ace0340 2024-09-13T23:05:35.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.484+0000 7f37e5d51800 1 -- 172.21.15.164:0/3219421948 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55816addc840 con 0x55816ace0340 2024-09-13T23:05:35.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.484+0000 7f37e4046640 1 -- 172.21.15.164:0/3219421948 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37dc00a4a0 con 0x55816ace0340 2024-09-13T23:05:35.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.484+0000 7f37e5d51800 1 -- 172.21.15.164:0/3219421948 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55816ade1640 con 0x55816ace0340 2024-09-13T23:05:35.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.484+0000 7f37e4046640 1 -- 172.21.15.164:0/3219421948 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f37dc00a4a0 con 0x55816ace0340 2024-09-13T23:05:35.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.484+0000 7f37e5d51800 1 -- 172.21.15.164:0/3219421948 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55816ade0720 con 0x55816ace0340 2024-09-13T23:05:35.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.485+0000 7f37e4046640 1 -- 172.21.15.164:0/3219421948 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f37dc00a4a0 con 0x55816ace0340 2024-09-13T23:05:35.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.485+0000 7f37e5d51800 1 -- 172.21.15.164:0/3219421948 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55816ade0b70 con 0x55816ace0340 2024-09-13T23:05:35.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.485+0000 7f37e4046640 1 -- 172.21.15.164:0/3219421948 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f37dc00a4a0 con 0x55816ace0340 2024-09-13T23:05:35.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.485+0000 7f37e5d51800 1 Processor -- start 2024-09-13T23:05:35.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.485+0000 7f37e5d51800 1 -- start start 2024-09-13T23:05:35.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.485+0000 7f37e5d51800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816adefbb0 0x55816adeffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.485+0000 7f37e5d51800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55816ab7c580 con 0x55816adefbb0 2024-09-13T23:05:35.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.486+0000 7f37dbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816adefbb0 0x55816adeffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.486+0000 7f37dbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816adefbb0 0x55816adeffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57722/0 (socket says 172.21.15.164:57722) 2024-09-13T23:05:35.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.486+0000 7f37dbfff640 1 -- 172.21.15.164:0/2599778836 learned_addr learned my addr 172.21.15.164:0/2599778836 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.486+0000 7f37dbfff640 1 -- 172.21.15.164:0/2599778836 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55816adf0510 con 0x55816adefbb0 2024-09-13T23:05:35.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.486+0000 7f37dbfff640 1 --2- 172.21.15.164:0/2599778836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816adefbb0 0x55816adeffd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f37cc001ed0 tx=0x7f37cc00d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.486+0000 7f36c97fa640 1 -- 172.21.15.164:0/2599778836 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37cc01b550 con 0x55816adefbb0 2024-09-13T23:05:35.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.486+0000 7f36c97fa640 1 -- 172.21.15.164:0/2599778836 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37cc01b6f0 con 0x55816adefbb0 2024-09-13T23:05:35.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.486+0000 7f37e5d51800 1 -- 172.21.15.164:0/2599778836 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55816adf07a0 con 0x55816adefbb0 2024-09-13T23:05:35.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.486+0000 7f36c97fa640 1 -- 172.21.15.164:0/2599778836 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37cc01b9d0 con 0x55816adefbb0 2024-09-13T23:05:35.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.486+0000 7f37e5d51800 1 -- 172.21.15.164:0/2599778836 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55816adf3480 con 0x55816adefbb0 2024-09-13T23:05:35.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.487+0000 7f36c97fa640 1 -- 172.21.15.164:0/2599778836 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f37cc023020 con 0x55816adefbb0 2024-09-13T23:05:35.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.487+0000 7f36c97fa640 1 --2- 172.21.15.164:0/2599778836 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f36bc036b80 0x7f36bc039040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.487+0000 7f36c97fa640 1 -- 172.21.15.164:0/2599778836 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f37cc021020 con 0x55816adefbb0 2024-09-13T23:05:35.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.487+0000 7f37e4046640 1 --2- 172.21.15.164:0/2599778836 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f36bc036b80 0x7f36bc039040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.488+0000 7f37e5d51800 1 Processor -- start 2024-09-13T23:05:35.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.488+0000 7f37e5d51800 1 -- start start 2024-09-13T23:05:35.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.488+0000 7f37e4046640 1 --2- 172.21.15.164:0/2599778836 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f36bc036b80 0x7f36bc039040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x55816ade0240 tx=0x7f37dc005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.488+0000 7f37e5d51800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816ace1cc0 0x55816ace20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.488+0000 7f37e5d51800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55816add0ff0 con 0x55816ace1cc0 2024-09-13T23:05:35.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.488+0000 7f37dbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816ace1cc0 0x55816ace20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.488+0000 7f37dbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816ace1cc0 0x55816ace20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57724/0 (socket says 172.21.15.164:57724) 2024-09-13T23:05:35.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.488+0000 7f37dbfff640 1 -- 172.21.15.164:0/3602465273 learned_addr learned my addr 172.21.15.164:0/3602465273 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.488+0000 7f37dbfff640 1 -- 172.21.15.164:0/3602465273 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55816ace2690 con 0x55816ace1cc0 2024-09-13T23:05:35.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.488+0000 7f37dbfff640 1 --2- 172.21.15.164:0/3602465273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816ace1cc0 0x55816ace20c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f37cc04d100 tx=0x7f37cc019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a2140c2f1c9c72 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.488+0000 7f36c2ffd640 1 -- 172.21.15.164:0/3602465273 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37cc0258e0 con 0x55816ace1cc0 2024-09-13T23:05:35.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.488+0000 7f36c2ffd640 1 -- 172.21.15.164:0/3602465273 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37cc025410 con 0x55816ace1cc0 2024-09-13T23:05:35.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.489+0000 7f36c2ffd640 1 -- 172.21.15.164:0/3602465273 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37cc025a80 con 0x55816ace1cc0 2024-09-13T23:05:35.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.489+0000 7f37e5d51800 1 -- 172.21.15.164:0/3602465273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816ace1cc0 msgr2=0x55816ace20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.489+0000 7f37e5d51800 1 --2- 172.21.15.164:0/3602465273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816ace1cc0 0x55816ace20c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f37cc04d100 tx=0x7f37cc019ce0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.489+0000 7f37e5d51800 1 -- 172.21.15.164:0/3602465273 shutdown_connections 2024-09-13T23:05:35.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.489+0000 7f37e5d51800 1 --2- 172.21.15.164:0/3602465273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816ace1cc0 0x55816ace20c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.489+0000 7f37e5d51800 1 -- 172.21.15.164:0/3602465273 >> 172.21.15.164:0/3602465273 conn(0x55816adf8c20 msgr2=0x55816adf6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.489+0000 7f37e5d51800 1 -- 172.21.15.164:0/3602465273 shutdown_connections 2024-09-13T23:05:35.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.489+0000 7f37e5d51800 1 -- 172.21.15.164:0/3602465273 wait complete. 2024-09-13T23:05:35.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.489+0000 7f37e5d51800 1 Processor -- start 2024-09-13T23:05:35.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.489+0000 7f37e5d51800 1 -- start start 2024-09-13T23:05:35.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.489+0000 7f37e5d51800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816ace1cc0 0x55816ae05fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.489+0000 7f37e5d51800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55816ace09f0 con 0x55816ace1cc0 2024-09-13T23:05:35.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.490+0000 7f37dbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816ace1cc0 0x55816ae05fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.490+0000 7f37dbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816ace1cc0 0x55816ae05fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57732/0 (socket says 172.21.15.164:57732) 2024-09-13T23:05:35.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.490+0000 7f37dbfff640 1 -- 172.21.15.164:0/599495929 learned_addr learned my addr 172.21.15.164:0/599495929 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.490+0000 7f37dbfff640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55816ae06510 con 0x55816ace1cc0 2024-09-13T23:05:35.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.490+0000 7f37dbfff640 1 --2- 172.21.15.164:0/599495929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816ace1cc0 0x55816ae05fd0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f37cc04d1c0 tx=0x7f37cc04d090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.490+0000 7f36c17fa640 1 -- 172.21.15.164:0/599495929 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37cc00cc60 con 0x55816ace1cc0 2024-09-13T23:05:35.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.490+0000 7f36c17fa640 1 -- 172.21.15.164:0/599495929 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37cc00ce00 con 0x55816ace1cc0 2024-09-13T23:05:35.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.490+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55816ae067a0 con 0x55816ace1cc0 2024-09-13T23:05:35.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.490+0000 7f36c17fa640 1 -- 172.21.15.164:0/599495929 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37cc040990 con 0x55816ace1cc0 2024-09-13T23:05:35.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.490+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55816ae067a0 con 0x55816ace1cc0 2024-09-13T23:05:35.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.491+0000 7f36c17fa640 1 -- 172.21.15.164:0/599495929 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f37cc040b30 con 0x55816ace1cc0 2024-09-13T23:05:35.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.491+0000 7f36c17fa640 1 --2- 172.21.15.164:0/599495929 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f36ac036b90 0x7f36ac039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.491+0000 7f36c17fa640 1 -- 172.21.15.164:0/599495929 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f37cc035070 con 0x55816ace1cc0 2024-09-13T23:05:35.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.491+0000 7f37e4046640 1 --2- 172.21.15.164:0/599495929 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f36ac036b90 0x7f36ac039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.492+0000 7f37e4046640 1 --2- 172.21.15.164:0/599495929 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f36ac036b90 0x7f36ac039050 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55816addc790 tx=0x7f37dc01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.492+0000 7f37e5d51800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.492+0000 7f37e5d51800 1 --2- 172.21.15.164:0/599495929 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55816ae118f0 0x55816ae13db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.492+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55816ae14500 con 0x55816ae118f0 2024-09-13T23:05:35.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.492+0000 7f37e3845640 1 --2- 172.21.15.164:0/599495929 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55816ae118f0 0x55816ae13db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.492+0000 7f37e3845640 1 --2- 172.21.15.164:0/599495929 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55816ae118f0 0x55816ae13db0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.493+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37d407a030 con 0x55816ae118f0 2024-09-13T23:05:35.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.493+0000 7f37e5d51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.493+0000 7f37e5d51800 20 realm 2024-09-13T23:05:35.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.493+0000 7f37e5d51800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.493+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55816ae14910 con 0x55816ae118f0 2024-09-13T23:05:35.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.493+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37d407a030 con 0x55816ae118f0 2024-09-13T23:05:35.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.493+0000 7f37e5d51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.493+0000 7f37e5d51800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:35.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.493+0000 7f37e5d51800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.493+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55816ae151e0 con 0x55816ae118f0 2024-09-13T23:05:35.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.493+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37d407a030 con 0x55816ae118f0 2024-09-13T23:05:35.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.493+0000 7f37e5d51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.493+0000 7f37e5d51800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.493+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55816ae15580 con 0x55816ae118f0 2024-09-13T23:05:35.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.493+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37d407a030 con 0x55816ae118f0 2024-09-13T23:05:35.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.493+0000 7f37e5d51800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:35.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.493+0000 7f37e5d51800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.493+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55816ae15dd0 con 0x55816ae118f0 2024-09-13T23:05:35.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.494+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f37d407a030 con 0x55816ae118f0 2024-09-13T23:05:35.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.494+0000 7f37e5d51800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:35.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.494+0000 7f37e5d51800 20 searching for the correct realm 2024-09-13T23:05:35.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.494+0000 7f37e5d51800 1 --2- 172.21.15.164:0/599495929 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55816ae17b40 0x55816ae19f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.494+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x55816ae17b40 2024-09-13T23:05:35.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.494+0000 7f37dbfff640 1 --2- 172.21.15.164:0/599495929 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55816ae17b40 0x55816ae19f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.494+0000 7f37dbfff640 1 --2- 172.21.15.164:0/599495929 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55816ae17b40 0x55816ae19f30 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.494+0000 7f37dbfff640 1 -- 172.21.15.164:0/599495929 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37cc03f020 con 0x55816ae17b40 2024-09-13T23:05:35.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.494+0000 7f37dbfff640 1 --2- 172.21.15.164:0/599495929 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f37cc042070 0x7f37cc039420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.494+0000 7f37dbfff640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x7f37cc042070 2024-09-13T23:05:35.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.494+0000 7f37e4046640 1 --2- 172.21.15.164:0/599495929 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f37cc042070 0x7f37cc039420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.495+0000 7f37e4046640 1 --2- 172.21.15.164:0/599495929 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f37cc042070 0x7f37cc039420 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.495+0000 7f37e4046640 1 -- 172.21.15.164:0/599495929 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37dc01f070 con 0x7f37cc042070 2024-09-13T23:05:35.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.495+0000 7f37e4046640 1 --2- 172.21.15.164:0/599495929 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f37dc031040 0x7f37dc032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.495+0000 7f37e4046640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x7f37dc031040 2024-09-13T23:05:35.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.495+0000 7f37e3845640 1 --2- 172.21.15.164:0/599495929 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f37dc031040 0x7f37dc032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.495+0000 7f37e3845640 1 --2- 172.21.15.164:0/599495929 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f37dc031040 0x7f37dc032940 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.496+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d407a030 con 0x7f37dc031040 2024-09-13T23:05:35.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.496+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x55816ae118f0 2024-09-13T23:05:35.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.496+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f37d407a030 con 0x55816ae118f0 2024-09-13T23:05:35.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.496+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x55816ae118f0 2024-09-13T23:05:35.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.496+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d407a030 con 0x55816ae118f0 2024-09-13T23:05:35.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.496+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x7f37dc031040 2024-09-13T23:05:35.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.496+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d407a030 con 0x7f37dc031040 2024-09-13T23:05:35.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.496+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x7f37dc031040 2024-09-13T23:05:35.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.496+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d407a030 con 0x7f37dc031040 2024-09-13T23:05:35.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.496+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x7f37cc042070 2024-09-13T23:05:35.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.497+0000 7f37e4046640 1 -- 172.21.15.164:0/599495929 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37dc01f070 con 0x7f37cc042070 2024-09-13T23:05:35.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.497+0000 7f37e4046640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x55816ae17b40 2024-09-13T23:05:35.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.497+0000 7f37dbfff640 1 -- 172.21.15.164:0/599495929 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37cc03f020 con 0x55816ae17b40 2024-09-13T23:05:35.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.497+0000 7f37dbfff640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x55816ae118f0 2024-09-13T23:05:35.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.497+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d407a030 con 0x55816ae118f0 2024-09-13T23:05:35.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.497+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x7f37dc031040 2024-09-13T23:05:35.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.497+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d407a030 con 0x7f37dc031040 2024-09-13T23:05:35.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.497+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x55816ae118f0 2024-09-13T23:05:35.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.498+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d407a030 con 0x55816ae118f0 2024-09-13T23:05:35.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.498+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x7f37cc042070 2024-09-13T23:05:35.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.498+0000 7f37e4046640 1 -- 172.21.15.164:0/599495929 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f37dc01f070 con 0x7f37cc042070 2024-09-13T23:05:35.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.498+0000 7f37e4046640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x55816ae17b40 2024-09-13T23:05:35.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.498+0000 7f37dbfff640 1 -- 172.21.15.164:0/599495929 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37cc03f020 con 0x55816ae17b40 2024-09-13T23:05:35.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.498+0000 7f37dbfff640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x55816ae17b40 2024-09-13T23:05:35.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.498+0000 7f37dbfff640 1 -- 172.21.15.164:0/599495929 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37cc03f020 con 0x55816ae17b40 2024-09-13T23:05:35.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.498+0000 7f37dbfff640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x7f37dc031040 2024-09-13T23:05:35.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.499+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d407a030 con 0x7f37dc031040 2024-09-13T23:05:35.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.499+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x55816ae17b40 2024-09-13T23:05:35.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.499+0000 7f37dbfff640 1 -- 172.21.15.164:0/599495929 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37cc03f020 con 0x55816ae17b40 2024-09-13T23:05:35.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.499+0000 7f37dbfff640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x55816ae17b40 2024-09-13T23:05:35.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.499+0000 7f37dbfff640 1 -- 172.21.15.164:0/599495929 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37cc03f020 con 0x55816ae17b40 2024-09-13T23:05:35.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.499+0000 7f37dbfff640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x55816ae118f0 2024-09-13T23:05:35.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.499+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d407a030 con 0x55816ae118f0 2024-09-13T23:05:35.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.499+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x55816ae118f0 2024-09-13T23:05:35.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.499+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f37d407a030 con 0x55816ae118f0 2024-09-13T23:05:35.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.499+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x7f37dc031040 2024-09-13T23:05:35.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.500+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d407a030 con 0x7f37dc031040 2024-09-13T23:05:35.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.500+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x55816ae17b40 2024-09-13T23:05:35.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.500+0000 7f37dbfff640 1 -- 172.21.15.164:0/599495929 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37cc03f020 con 0x55816ae17b40 2024-09-13T23:05:35.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.500+0000 7f37dbfff640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x7f37cc042070 2024-09-13T23:05:35.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.500+0000 7f37e4046640 1 -- 172.21.15.164:0/599495929 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37dc01f070 con 0x7f37cc042070 2024-09-13T23:05:35.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.500+0000 7f37e4046640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x55816ae118f0 2024-09-13T23:05:35.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.501+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f37d407a030 con 0x55816ae118f0 2024-09-13T23:05:35.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.501+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x7f37dc031040 2024-09-13T23:05:35.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.501+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d407a030 con 0x7f37dc031040 2024-09-13T23:05:35.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.501+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x55816ae17b40 2024-09-13T23:05:35.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.501+0000 7f37dbfff640 1 -- 172.21.15.164:0/599495929 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37cc03f020 con 0x55816ae17b40 2024-09-13T23:05:35.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.501+0000 7f37dbfff640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x7f37dc031040 2024-09-13T23:05:35.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.501+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d407a030 con 0x7f37dc031040 2024-09-13T23:05:35.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.501+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x7f37cc042070 2024-09-13T23:05:35.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.502+0000 7f37e4046640 1 -- 172.21.15.164:0/599495929 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37dc01f070 con 0x7f37cc042070 2024-09-13T23:05:35.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.502+0000 7f37e4046640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x55816ae17b40 2024-09-13T23:05:35.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.502+0000 7f37dbfff640 1 -- 172.21.15.164:0/599495929 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37cc03f020 con 0x55816ae17b40 2024-09-13T23:05:35.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.502+0000 7f37dbfff640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x7f37dc031040 2024-09-13T23:05:35.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.502+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d407a030 con 0x7f37dc031040 2024-09-13T23:05:35.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.502+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x55816ae118f0 2024-09-13T23:05:35.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.502+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f37d407a030 con 0x55816ae118f0 2024-09-13T23:05:35.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.502+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1a510 con 0x7f37cc042070 2024-09-13T23:05:35.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.503+0000 7f37e4046640 1 -- 172.21.15.164:0/599495929 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37dc01f070 con 0x7f37cc042070 2024-09-13T23:05:35.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.503+0000 7f37e5d51800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:35.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.503+0000 7f37e5d51800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:35.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.503+0000 7f37e5d51800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:35.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.503+0000 7f37e5d51800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:35.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.503+0000 7f37e5d51800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:35.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.503+0000 7f37e5d51800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:35.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.503+0000 7f37e5d51800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.503+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55816ae16780 con 0x55816ae118f0 2024-09-13T23:05:35.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.503+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37d407a030 con 0x55816ae118f0 2024-09-13T23:05:35.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.503+0000 7f37e5d51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.503+0000 7f37e5d51800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.503+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55816ae16b70 con 0x55816ae118f0 2024-09-13T23:05:35.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.503+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f37d407a030 con 0x55816ae118f0 2024-09-13T23:05:35.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.503+0000 7f37e5d51800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:35.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.503+0000 7f37e5d51800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.503+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55816ae16b70 con 0x55816ae118f0 2024-09-13T23:05:35.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.503+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f37d407a030 con 0x55816ae118f0 2024-09-13T23:05:35.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.503+0000 7f37e5d51800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:35.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.503+0000 7f37e5d51800 20 zone default found 2024-09-13T23:05:35.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.503+0000 7f37e5d51800 4 Realm: () 2024-09-13T23:05:35.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.503+0000 7f37e5d51800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:35.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.503+0000 7f37e5d51800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:35.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.503+0000 7f37e5d51800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:35.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.503+0000 7f37e5d51800 20 zonegroup default 2024-09-13T23:05:35.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.503+0000 7f37e5d51800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.503+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55816ae16f90 con 0x7f37dc031040 2024-09-13T23:05:35.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.504+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f37d407a030 con 0x7f37dc031040 2024-09-13T23:05:35.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.504+0000 7f37e5d51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.504+0000 7f37e5d51800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.504+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55816ae16f90 con 0x55816ae17b40 2024-09-13T23:05:35.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.504+0000 7f37dbfff640 1 -- 172.21.15.164:0/599495929 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f37cc03f020 con 0x55816ae17b40 2024-09-13T23:05:35.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.504+0000 7f37e5d51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.504+0000 7f37e5d51800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.504+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1c440 con 0x55816ae17b40 2024-09-13T23:05:35.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.504+0000 7f37dbfff640 1 -- 172.21.15.164:0/599495929 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f37cc03f020 con 0x55816ae17b40 2024-09-13T23:05:35.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.504+0000 7f37e5d51800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.504+0000 7f37e5d51800 20 started sync module instance, tier type = 2024-09-13T23:05:35.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.504+0000 7f37e5d51800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:35.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.504+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1b810 con 0x7f37cc042070 2024-09-13T23:05:35.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.505+0000 7f37e4046640 1 -- 172.21.15.164:0/599495929 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37dc040040 con 0x7f37cc042070 2024-09-13T23:05:35.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.505+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94014332320768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1cd50 con 0x7f37cc042070 2024-09-13T23:05:35.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.505+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1d5a0 con 0x55816ae118f0 2024-09-13T23:05:35.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.506+0000 7f37e4046640 1 -- 172.21.15.164:0/599495929 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94014332320768] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37dc040040 con 0x7f37cc042070 2024-09-13T23:05:35.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.506+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d407a030 con 0x55816ae118f0 2024-09-13T23:05:35.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.507+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94014332324000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1d2b0 con 0x55816ae118f0 2024-09-13T23:05:35.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.507+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1dd70 con 0x55816ae17b40 2024-09-13T23:05:35.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.507+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94014332324000] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d407a030 con 0x55816ae118f0 2024-09-13T23:05:35.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.508+0000 7f37dbfff640 1 -- 172.21.15.164:0/599495929 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37cc03f020 con 0x55816ae17b40 2024-09-13T23:05:35.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.508+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94014332328000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1e160 con 0x55816ae17b40 2024-09-13T23:05:35.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.508+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1eb60 con 0x7f37cc042070 2024-09-13T23:05:35.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.509+0000 7f37dbfff640 1 -- 172.21.15.164:0/599495929 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94014332328000] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37cc03f020 con 0x55816ae17b40 2024-09-13T23:05:35.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.509+0000 7f37e4046640 1 -- 172.21.15.164:0/599495929 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37dc040040 con 0x7f37cc042070 2024-09-13T23:05:35.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.509+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94014332325120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1ef80 con 0x7f37cc042070 2024-09-13T23:05:35.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.509+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1f9d0 con 0x55816ae118f0 2024-09-13T23:05:35.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.510+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d407a030 con 0x55816ae118f0 2024-09-13T23:05:35.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.510+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94014332335296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55816ae1f990 con 0x55816ae118f0 2024-09-13T23:05:35.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.510+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55816ae20990 con 0x7f37dc031040 2024-09-13T23:05:35.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.510+0000 7f37e4046640 1 -- 172.21.15.164:0/599495929 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94014332325120] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37dc040040 con 0x7f37cc042070 2024-09-13T23:05:35.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.511+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d407a030 con 0x7f37dc031040 2024-09-13T23:05:35.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.511+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94014332335296] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d407a030 con 0x55816ae118f0 2024-09-13T23:05:35.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.511+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94014332339392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55816ae20990 con 0x7f37dc031040 2024-09-13T23:05:35.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.511+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55816ae20ef0 con 0x7f37dc031040 2024-09-13T23:05:35.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.512+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94014332339392] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d407a030 con 0x7f37dc031040 2024-09-13T23:05:35.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.512+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d407a030 con 0x7f37dc031040 2024-09-13T23:05:35.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.512+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94014332331632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55816ae20ef0 con 0x7f37dc031040 2024-09-13T23:05:35.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.512+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55816ae218b0 con 0x7f37dc031040 2024-09-13T23:05:35.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.513+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94014332331632] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d407a030 con 0x7f37dc031040 2024-09-13T23:05:35.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.513+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d407a030 con 0x7f37dc031040 2024-09-13T23:05:35.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.513+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94014332337424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55816ae218b0 con 0x7f37dc031040 2024-09-13T23:05:35.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.513+0000 7f37e5d51800 20 add_watcher() i=0 2024-09-13T23:05:35.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.513+0000 7f37e5d51800 20 add_watcher() i=1 2024-09-13T23:05:35.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.513+0000 7f37e5d51800 20 add_watcher() i=2 2024-09-13T23:05:35.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.513+0000 7f37e5d51800 20 add_watcher() i=3 2024-09-13T23:05:35.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.513+0000 7f37e5d51800 20 add_watcher() i=4 2024-09-13T23:05:35.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.513+0000 7f37e5d51800 20 add_watcher() i=5 2024-09-13T23:05:35.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.513+0000 7f37e5d51800 20 add_watcher() i=6 2024-09-13T23:05:35.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.514+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94014332337424] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d407a030 con 0x7f37dc031040 2024-09-13T23:05:35.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.514+0000 7f37e5d51800 20 add_watcher() i=7 2024-09-13T23:05:35.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.514+0000 7f37e5d51800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:35.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.514+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55816ae24ba0 con 0x55816ae118f0 2024-09-13T23:05:35.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.514+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f37d407a030 con 0x55816ae118f0 2024-09-13T23:05:35.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.514+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94014332343664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55816ae21e40 con 0x55816ae118f0 2024-09-13T23:05:35.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.515+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94014332343664] v32'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f37d407a030 con 0x55816ae118f0 2024-09-13T23:05:35.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.515+0000 7f3699fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:35.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.515+0000 7f37e5d51800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:35.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.515+0000 7f37e5d51800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:35.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.515+0000 7f37e5d51800 5 note: GC not initialized 2024-09-13T23:05:35.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.515+0000 7f3698fe1640 20 reqs_thread_entry: start 2024-09-13T23:05:35.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.515+0000 7f37e5d51800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:35.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.516+0000 7f37e5d51800 20 Filter name: none 2024-09-13T23:05:35.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.516+0000 7f36127fc640 20 reqs_thread_entry: start 2024-09-13T23:05:35.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.516+0000 7f37e5d51800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:05:35.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.516+0000 7f37e5d51800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.516+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55816ae580d0 con 0x55816ae118f0 2024-09-13T23:05:35.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.516+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f37d407a030 con 0x55816ae118f0 2024-09-13T23:05:35.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.516+0000 7f37e5d51800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:05:35.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.516+0000 7f37e5d51800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:05:35.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.516+0000 7f37e5d51800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:35.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.516+0000 7f37e5d51800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:35.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.516+0000 7f37e5d51800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:05:35.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.516+0000 7f37e5d51800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.516+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55816ae5a1b0 con 0x7f37cc042070 2024-09-13T23:05:35.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.516+0000 7f37e4046640 1 -- 172.21.15.164:0/599495929 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f37dc040040 con 0x7f37cc042070 2024-09-13T23:05:35.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.516+0000 7f37e5d51800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:05:35.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.516+0000 7f37e5d51800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:05:35.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.516+0000 7f37e5d51800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:05:35.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.516+0000 7f37e5d51800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 : miss 2024-09-13T23:05:35.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.516+0000 7f37e5d51800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.516+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 8.15 8:aa4f46c1:root::.bucket.meta.myfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55816ae5ba30 con 0x55816ae17b40 2024-09-13T23:05:35.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.517+0000 7f37dbfff640 1 -- 172.21.15.164:0/599495929 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f37cc03f020 con 0x55816ae17b40 2024-09-13T23:05:35.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.517+0000 7f37e5d51800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:05:35.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.517+0000 7f37e5d51800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 info.flags=0x17 2024-09-13T23:05:35.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.517+0000 7f37e5d51800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 to cache LRU end 2024-09-13T23:05:35.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.517+0000 7f37e5d51800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:35.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.517+0000 7f37e5d51800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:05:35.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.517+0000 7f37e5d51800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 2024-09-13T23:05:35.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.517+0000 7f37e5d51800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-13T23:05:35.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.517+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55816ae5d1b0 con 0x7f37cc042070 2024-09-13T23:05:35.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.518+0000 7f37e4046640 1 -- 172.21.15.164:0/599495929 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(65 foo.buckets [call] v32'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f37dc040040 con 0x7f37cc042070 2024-09-13T23:05:35.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.518+0000 7f37e5d51800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-13T23:05:35.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.518+0000 7f37e5d51800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.518+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55816ae5cd00 con 0x7f37cc042070 2024-09-13T23:05:35.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.518+0000 7f37e4046640 1 -- 172.21.15.164:0/599495929 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f37dc040040 con 0x7f37cc042070 2024-09-13T23:05:35.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.518+0000 7f37e5d51800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:05:35.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.518+0000 7f37e5d51800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-13T23:05:35.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.518+0000 7f37e5d51800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:05:35.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.518+0000 7f37e5d51800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:35.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.518+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55816ae631c0 con 0x7f37cc042070 2024-09-13T23:05:35.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.519+0000 7f37e4046640 1 -- 172.21.15.164:0/599495929 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v32'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f37dc040040 con 0x7f37cc042070 2024-09-13T23:05:35.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.519+0000 7f37e5d51800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T23:05:35.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.519+0000 7f37e5d51800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:05:35.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.519+0000 7f37e5d51800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T23:05:35.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.519+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94014332595408 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55816ae606d0 con 0x7f37dc031040 2024-09-13T23:05:35.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.520+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== watch-notify(notify (1) cookie 94014332331632 notify 137438953474 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55816add8cc0 con 0x7f37dc031040 2024-09-13T23:05:35.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.520+0000 7f36c2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94014332331632 notifier 4491 bl.length()=338 2024-09-13T23:05:35.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.520+0000 7f36c2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T23:05:35.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.520+0000 7f36c2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:05:35.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.520+0000 7f36c2ffd640 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f36a8003ea0 con 0x7f37dc031040 2024-09-13T23:05:35.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.520+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(68 notify.6 [notify cookie 94014332595408 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f37d407a030 con 0x7f37dc031040 2024-09-13T23:05:35.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.520+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d407a030 con 0x7f37dc031040 2024-09-13T23:05:35.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.520+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== watch-notify(notify_complete (2) cookie 94014332595408 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55816add8740 con 0x7f37dc031040 2024-09-13T23:05:35.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.521+0000 7f3699fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:35.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.521+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94014332343664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55816ae55e40 con 0x55816ae118f0 2024-09-13T23:05:35.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.522+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94014332343664] v32'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f37d407a030 con 0x55816ae118f0 2024-09-13T23:05:35.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.522+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94014332320768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55816ae55e40 con 0x7f37cc042070 2024-09-13T23:05:35.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.523+0000 7f37e4046640 1 -- 172.21.15.164:0/599495929 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94014332320768] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37dc040040 con 0x7f37cc042070 2024-09-13T23:05:35.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.523+0000 7f37e5d51800 20 remove_watcher() i=0 2024-09-13T23:05:35.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.523+0000 7f37e5d51800 2 removed watcher, disabling cache 2024-09-13T23:05:35.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.523+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94014332324000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55816ae55e40 con 0x55816ae118f0 2024-09-13T23:05:35.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.524+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94014332324000] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d407a030 con 0x55816ae118f0 2024-09-13T23:05:35.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.524+0000 7f37e5d51800 20 remove_watcher() i=1 2024-09-13T23:05:35.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.524+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94014332328000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55816ae55e40 con 0x55816ae17b40 2024-09-13T23:05:35.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.525+0000 7f37dbfff640 1 -- 172.21.15.164:0/599495929 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94014332328000] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37cc03f020 con 0x55816ae17b40 2024-09-13T23:05:35.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.525+0000 7f37e5d51800 20 remove_watcher() i=2 2024-09-13T23:05:35.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.525+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94014332325120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55816ae55e40 con 0x7f37cc042070 2024-09-13T23:05:35.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.526+0000 7f37e4046640 1 -- 172.21.15.164:0/599495929 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94014332325120] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37dc040040 con 0x7f37cc042070 2024-09-13T23:05:35.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.526+0000 7f37e5d51800 20 remove_watcher() i=3 2024-09-13T23:05:35.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.526+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94014332335296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55816ae55e40 con 0x55816ae118f0 2024-09-13T23:05:35.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.527+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94014332335296] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d407a030 con 0x55816ae118f0 2024-09-13T23:05:35.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.527+0000 7f37e5d51800 20 remove_watcher() i=4 2024-09-13T23:05:35.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.527+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94014332339392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55816ae55e40 con 0x7f37dc031040 2024-09-13T23:05:35.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.528+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94014332339392] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d407a030 con 0x7f37dc031040 2024-09-13T23:05:35.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.528+0000 7f37e5d51800 20 remove_watcher() i=5 2024-09-13T23:05:35.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.528+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94014332331632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55816ae55e40 con 0x7f37dc031040 2024-09-13T23:05:35.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.529+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94014332331632] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d407a030 con 0x7f37dc031040 2024-09-13T23:05:35.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.529+0000 7f37e5d51800 20 remove_watcher() i=6 2024-09-13T23:05:35.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.529+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94014332337424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55816ae55e40 con 0x7f37dc031040 2024-09-13T23:05:35.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.529+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94014332337424] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d407a030 con 0x7f37dc031040 2024-09-13T23:05:35.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.529+0000 7f37e5d51800 20 remove_watcher() i=7 2024-09-13T23:05:35.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.530+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f37dc031040 msgr2=0x7f37dc032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.530+0000 7f37e5d51800 1 --2- 172.21.15.164:0/599495929 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f37dc031040 0x7f37dc032940 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.530+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55816ae118f0 msgr2=0x55816ae13db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.530+0000 7f37e5d51800 1 --2- 172.21.15.164:0/599495929 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55816ae118f0 0x55816ae13db0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.530+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f37cc042070 msgr2=0x7f37cc039420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.530+0000 7f37e5d51800 1 --2- 172.21.15.164:0/599495929 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f37cc042070 0x7f37cc039420 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.530+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55816ae17b40 msgr2=0x55816ae19f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.530+0000 7f37e5d51800 1 --2- 172.21.15.164:0/599495929 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55816ae17b40 0x55816ae19f30 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.530+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f36ac036b90 msgr2=0x7f36ac039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.530+0000 7f37e5d51800 1 --2- 172.21.15.164:0/599495929 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f36ac036b90 0x7f36ac039050 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55816addc790 tx=0x7f37dc01f000 comp rx=0 tx=0).stop 2024-09-13T23:05:35.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.530+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816ace1cc0 msgr2=0x55816ae05fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.530+0000 7f37e3845640 1 -- 172.21.15.164:0/599495929 reap_dead start 2024-09-13T23:05:35.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.530+0000 7f37e5d51800 1 --2- 172.21.15.164:0/599495929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816ace1cc0 0x55816ae05fd0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f37cc04d1c0 tx=0x7f37cc04d090 comp rx=0 tx=0).stop 2024-09-13T23:05:35.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.530+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 shutdown_connections 2024-09-13T23:05:35.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.530+0000 7f37e5d51800 1 --2- 172.21.15.164:0/599495929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816ace1cc0 0x55816ae05fd0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.530+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 >> 172.21.15.164:0/599495929 conn(0x55816adf8c20 msgr2=0x55816adf6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.530+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 shutdown_connections 2024-09-13T23:05:35.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.530+0000 7f37e5d51800 1 -- 172.21.15.164:0/599495929 wait complete. 2024-09-13T23:05:35.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.530+0000 7f37e5d51800 1 -- 172.21.15.164:0/2599778836 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f36bc036b80 msgr2=0x7f36bc039040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.530+0000 7f37e5d51800 1 --2- 172.21.15.164:0/2599778836 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f36bc036b80 0x7f36bc039040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x55816ade0240 tx=0x7f37dc005840 comp rx=0 tx=0).stop 2024-09-13T23:05:35.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.530+0000 7f37e5d51800 1 -- 172.21.15.164:0/2599778836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816adefbb0 msgr2=0x55816adeffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.530+0000 7f37e5d51800 1 --2- 172.21.15.164:0/2599778836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816adefbb0 0x55816adeffd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f37cc001ed0 tx=0x7f37cc00d7a0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.530+0000 7f37e5d51800 1 -- 172.21.15.164:0/2599778836 shutdown_connections 2024-09-13T23:05:35.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.530+0000 7f37e5d51800 1 --2- 172.21.15.164:0/2599778836 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f36bc036b80 0x7f36bc039040 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.530+0000 7f37e5d51800 1 --2- 172.21.15.164:0/2599778836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816adefbb0 0x55816adeffd0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.530+0000 7f37e5d51800 1 -- 172.21.15.164:0/2599778836 >> 172.21.15.164:0/2599778836 conn(0x55816ade4b40 msgr2=0x55816ade76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.530+0000 7f37e5d51800 1 -- 172.21.15.164:0/2599778836 shutdown_connections 2024-09-13T23:05:35.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.530+0000 7f37e5d51800 1 -- 172.21.15.164:0/2599778836 wait complete. 2024-09-13T23:05:35.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.531+0000 7f37e5d51800 1 -- 172.21.15.164:0/3219421948 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55816ace0340 msgr2=0x55816addf270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.531+0000 7f37e5d51800 1 --2- 172.21.15.164:0/3219421948 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55816ace0340 0x55816addf270 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.531+0000 7f37e5d51800 1 -- 172.21.15.164:0/3219421948 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f36cc036b90 msgr2=0x7f36cc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.531+0000 7f37e5d51800 1 --2- 172.21.15.164:0/3219421948 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f36cc036b90 0x7f36cc039050 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f37cc000f60 tx=0x7f37cc0012b0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.531+0000 7f37e5d51800 1 -- 172.21.15.164:0/3219421948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816acdfa00 msgr2=0x55816add8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.531+0000 7f37e5d51800 1 --2- 172.21.15.164:0/3219421948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816acdfa00 0x55816add8200 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x55816add1700 tx=0x7f37d4002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.531+0000 7f37e5d51800 1 -- 172.21.15.164:0/3219421948 shutdown_connections 2024-09-13T23:05:35.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.531+0000 7f37e5d51800 1 --2- 172.21.15.164:0/3219421948 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55816ace0340 0x55816addf270 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.531+0000 7f37e5d51800 1 --2- 172.21.15.164:0/3219421948 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f36cc036b90 0x7f36cc039050 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.531+0000 7f37e5d51800 1 --2- 172.21.15.164:0/3219421948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55816acdfa00 0x55816add8200 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.531+0000 7f37e5d51800 1 -- 172.21.15.164:0/3219421948 >> 172.21.15.164:0/3219421948 conn(0x55816acdb550 msgr2=0x55816adcab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.531+0000 7f37e5d51800 1 -- 172.21.15.164:0/3219421948 shutdown_connections 2024-09-13T23:05:35.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.531+0000 7f37e5d51800 1 -- 172.21.15.164:0/3219421948 wait complete. 2024-09-13T23:05:35.547 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T23:05:35.547 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T23:05:35.548 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-13T23:05:35.600 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:35.600 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:35.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.599+0000 7f8c78c0f800 1 Processor -- start 2024-09-13T23:05:35.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.599+0000 7f8c78c0f800 1 -- start start 2024-09-13T23:05:35.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.599+0000 7f8c78c0f800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x560cfc000590 0x560cfc000990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.599+0000 7f8c78c0f800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560cfbec0b30 con 0x560cfc000ed0 2024-09-13T23:05:35.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.599+0000 7f8c78c0f800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x560cfbea2360 con 0x560cfc000590 2024-09-13T23:05:35.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.600+0000 7f8c76703640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x560cfc000590 0x560cfc000990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.600+0000 7f8c75f02640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x560cfc000ed0 0x560cfc005a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40974/0 (socket says 172.21.15.164:40974) 2024-09-13T23:05:35.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.600+0000 7f8c75f02640 1 -- 172.21.15.164:0/3439458304 learned_addr learned my addr 172.21.15.164:0/3439458304 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:35.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.600+0000 7f8c76703640 1 -- 172.21.15.164:0/3439458304 >> v1:172.21.15.17:6789/0 conn(0x560cfc000ed0 legacy=0x560cfc005a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.600+0000 7f8c76703640 1 -- 172.21.15.164:0/3439458304 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cfbec8e00 con 0x560cfc000590 2024-09-13T23:05:35.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.602+0000 7f8c76703640 1 --2- 172.21.15.164:0/3439458304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc000590 0x560cfc000990 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8c7000a470 tx=0x7f8c70045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7658ef4d382b968b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.602+0000 7f8c75701640 1 -- 172.21.15.164:0/3439458304 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c70053570 con 0x560cfc000590 2024-09-13T23:05:35.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.602+0000 7f8c75701640 1 -- 172.21.15.164:0/3439458304 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c70058070 con 0x560cfc000590 2024-09-13T23:05:35.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.602+0000 7f8c75701640 1 -- 172.21.15.164:0/3439458304 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c70053880 con 0x560cfc000590 2024-09-13T23:05:35.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.603+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3439458304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc000590 msgr2=0x560cfc000990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.603+0000 7f8c78c0f800 1 --2- 172.21.15.164:0/3439458304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc000590 0x560cfc000990 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8c7000a470 tx=0x7f8c70045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:35.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.603+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3439458304 shutdown_connections 2024-09-13T23:05:35.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.603+0000 7f8c78c0f800 1 --2- 172.21.15.164:0/3439458304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc000590 0x560cfc000990 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.603+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3439458304 >> 172.21.15.164:0/3439458304 conn(0x560cfbffbe20 msgr2=0x560cfbffe240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.603+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3439458304 shutdown_connections 2024-09-13T23:05:35.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.603+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3439458304 wait complete. 2024-09-13T23:05:35.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.617+0000 7f8c78c0f800 1 Processor -- start 2024-09-13T23:05:35.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.617+0000 7f8c78c0f800 1 -- start start 2024-09-13T23:05:35.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.617+0000 7f8c78c0f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc000590 0x560cfc0ef8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.617+0000 7f8c78c0f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560cfbf4d370 con 0x560cfc000590 2024-09-13T23:05:35.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.618+0000 7f8c76703640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc000590 0x560cfc0ef8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.618+0000 7f8c76703640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc000590 0x560cfc0ef8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57748/0 (socket says 172.21.15.164:57748) 2024-09-13T23:05:35.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.618+0000 7f8c76703640 1 -- 172.21.15.164:0/2988927936 learned_addr learned my addr 172.21.15.164:0/2988927936 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.618+0000 7f8c76703640 1 -- 172.21.15.164:0/2988927936 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cfbe9abc0 con 0x560cfc000590 2024-09-13T23:05:35.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.618+0000 7f8c76703640 1 --2- 172.21.15.164:0/2988927936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc000590 0x560cfc0ef8a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8c70025c20 tx=0x7f8c70051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ec6830edabc7a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.618+0000 7f8b64608640 1 -- 172.21.15.164:0/2988927936 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c7005c580 con 0x560cfc000590 2024-09-13T23:05:35.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.618+0000 7f8b64608640 1 -- 172.21.15.164:0/2988927936 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c70063030 con 0x560cfc000590 2024-09-13T23:05:35.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.618+0000 7f8b64608640 1 -- 172.21.15.164:0/2988927936 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c7005c850 con 0x560cfc000590 2024-09-13T23:05:35.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.619+0000 7f8c78c0f800 1 -- 172.21.15.164:0/2988927936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc000590 msgr2=0x560cfc0ef8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.619+0000 7f8c78c0f800 1 --2- 172.21.15.164:0/2988927936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc000590 0x560cfc0ef8a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8c70025c20 tx=0x7f8c70051000 comp rx=0 tx=0).stop 2024-09-13T23:05:35.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.619+0000 7f8c78c0f800 1 -- 172.21.15.164:0/2988927936 shutdown_connections 2024-09-13T23:05:35.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.619+0000 7f8c78c0f800 1 --2- 172.21.15.164:0/2988927936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc000590 0x560cfc0ef8a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.619+0000 7f8c78c0f800 1 -- 172.21.15.164:0/2988927936 >> 172.21.15.164:0/2988927936 conn(0x560cfbffbe20 msgr2=0x560cfc0eb260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.619+0000 7f8c78c0f800 1 -- 172.21.15.164:0/2988927936 shutdown_connections 2024-09-13T23:05:35.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.619+0000 7f8c78c0f800 1 -- 172.21.15.164:0/2988927936 wait complete. 2024-09-13T23:05:35.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.619+0000 7f8c78c0f800 1 Processor -- start 2024-09-13T23:05:35.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.619+0000 7f8c78c0f800 1 -- start start 2024-09-13T23:05:35.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.620+0000 7f8c78c0f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc000590 0x560cfc0f7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.620+0000 7f8c78c0f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560cfc0075b0 con 0x560cfc000590 2024-09-13T23:05:35.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.620+0000 7f8c76703640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc000590 0x560cfc0f7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.620+0000 7f8c76703640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc000590 0x560cfc0f7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57756/0 (socket says 172.21.15.164:57756) 2024-09-13T23:05:35.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.620+0000 7f8c76703640 1 -- 172.21.15.164:0/1262301651 learned_addr learned my addr 172.21.15.164:0/1262301651 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.620+0000 7f8c76703640 1 -- 172.21.15.164:0/1262301651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cfbeaefe0 con 0x560cfc000590 2024-09-13T23:05:35.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.620+0000 7f8c76703640 1 --2- 172.21.15.164:0/1262301651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc000590 0x560cfc0f7220 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x560cfc0f0700 tx=0x7f8c70002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.620+0000 7f8b62e05640 1 -- 172.21.15.164:0/1262301651 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c70054ad0 con 0x560cfc000590 2024-09-13T23:05:35.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.620+0000 7f8b62e05640 1 -- 172.21.15.164:0/1262301651 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c70054c70 con 0x560cfc000590 2024-09-13T23:05:35.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.620+0000 7f8c78c0f800 1 -- 172.21.15.164:0/1262301651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560cfc0f7760 con 0x560cfc000590 2024-09-13T23:05:35.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.620+0000 7f8b62e05640 1 -- 172.21.15.164:0/1262301651 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c70068420 con 0x560cfc000590 2024-09-13T23:05:35.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.620+0000 7f8c78c0f800 1 -- 172.21.15.164:0/1262301651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cfc0f7c80 con 0x560cfc000590 2024-09-13T23:05:35.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.621+0000 7f8b62e05640 1 -- 172.21.15.164:0/1262301651 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8c700685c0 con 0x560cfc000590 2024-09-13T23:05:35.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.621+0000 7f8b62e05640 1 --2- 172.21.15.164:0/1262301651 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8b5c036b90 0x7f8b5c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.621+0000 7f8b62e05640 1 -- 172.21.15.164:0/1262301651 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8c70070030 con 0x560cfc000590 2024-09-13T23:05:35.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.622+0000 7f8c75f02640 1 --2- 172.21.15.164:0/1262301651 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8b5c036b90 0x7f8b5c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.622+0000 7f8c78c0f800 1 --2- 172.21.15.164:0/1262301651 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560cfc000ed0 0x560cfc0fe290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.622+0000 7f8c78c0f800 1 -- 172.21.15.164:0/1262301651 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560cfc0fe7d0 con 0x560cfc000ed0 2024-09-13T23:05:35.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.622+0000 7f8c76f04640 1 --2- 172.21.15.164:0/1262301651 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560cfc000ed0 0x560cfc0fe290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.622+0000 7f8c75f02640 1 --2- 172.21.15.164:0/1262301651 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8b5c036b90 0x7f8b5c039050 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8c60000f60 tx=0x7f8c600012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.622+0000 7f8c76f04640 1 --2- 172.21.15.164:0/1262301651 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560cfc000ed0 0x560cfc0fe290 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.622+0000 7f8c76f04640 1 -- 172.21.15.164:0/1262301651 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c6800a4a0 con 0x560cfc000ed0 2024-09-13T23:05:35.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.622+0000 7f8c78c0f800 1 -- 172.21.15.164:0/1262301651 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560cfc0fb860 con 0x560cfc000ed0 2024-09-13T23:05:35.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.623+0000 7f8c76f04640 1 -- 172.21.15.164:0/1262301651 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8c6800a4a0 con 0x560cfc000ed0 2024-09-13T23:05:35.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.623+0000 7f8c78c0f800 1 -- 172.21.15.164:0/1262301651 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560cfc100660 con 0x560cfc000ed0 2024-09-13T23:05:35.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.623+0000 7f8c76f04640 1 -- 172.21.15.164:0/1262301651 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8c6800a4a0 con 0x560cfc000ed0 2024-09-13T23:05:35.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.623+0000 7f8c78c0f800 1 -- 172.21.15.164:0/1262301651 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560cfc0ff890 con 0x560cfc000ed0 2024-09-13T23:05:35.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.623+0000 7f8c76f04640 1 -- 172.21.15.164:0/1262301651 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8c6800a4a0 con 0x560cfc000ed0 2024-09-13T23:05:35.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.623+0000 7f8c78c0f800 1 -- 172.21.15.164:0/1262301651 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560cfc0ffc30 con 0x560cfc000ed0 2024-09-13T23:05:35.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.623+0000 7f8c76f04640 1 -- 172.21.15.164:0/1262301651 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8c6800a4a0 con 0x560cfc000ed0 2024-09-13T23:05:35.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.624+0000 7f8c78c0f800 1 Processor -- start 2024-09-13T23:05:35.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.624+0000 7f8c78c0f800 1 -- start start 2024-09-13T23:05:35.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.624+0000 7f8c78c0f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfbf756c0 0x560cfc112a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.624+0000 7f8c78c0f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560cfbe9c580 con 0x560cfbf756c0 2024-09-13T23:05:35.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.624+0000 7f8c75f02640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfbf756c0 0x560cfc112a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.624+0000 7f8c75f02640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfbf756c0 0x560cfc112a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57762/0 (socket says 172.21.15.164:57762) 2024-09-13T23:05:35.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.624+0000 7f8c75f02640 1 -- 172.21.15.164:0/906109534 learned_addr learned my addr 172.21.15.164:0/906109534 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.624+0000 7f8c75f02640 1 -- 172.21.15.164:0/906109534 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cfc112fb0 con 0x560cfbf756c0 2024-09-13T23:05:35.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.625+0000 7f8c75f02640 1 --2- 172.21.15.164:0/906109534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfbf756c0 0x560cfc112a70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8c60001ed0 tx=0x7f8c6000d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.625+0000 7f8b5bfff640 1 -- 172.21.15.164:0/906109534 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c6001b550 con 0x560cfbf756c0 2024-09-13T23:05:35.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.625+0000 7f8b5bfff640 1 -- 172.21.15.164:0/906109534 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c6001b6f0 con 0x560cfbf756c0 2024-09-13T23:05:35.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.625+0000 7f8c78c0f800 1 -- 172.21.15.164:0/906109534 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560cfc1131e0 con 0x560cfbf756c0 2024-09-13T23:05:35.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.625+0000 7f8b5bfff640 1 -- 172.21.15.164:0/906109534 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c6001b9d0 con 0x560cfbf756c0 2024-09-13T23:05:35.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.625+0000 7f8c78c0f800 1 -- 172.21.15.164:0/906109534 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cfc1136e0 con 0x560cfbf756c0 2024-09-13T23:05:35.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.626+0000 7f8b5bfff640 1 -- 172.21.15.164:0/906109534 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8c60023020 con 0x560cfbf756c0 2024-09-13T23:05:35.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.626+0000 7f8b5bfff640 1 --2- 172.21.15.164:0/906109534 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8b50036b90 0x7f8b50039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.626+0000 7f8b5bfff640 1 -- 172.21.15.164:0/906109534 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8c60021020 con 0x560cfbf756c0 2024-09-13T23:05:35.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.626+0000 7f8c76f04640 1 --2- 172.21.15.164:0/906109534 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8b50036b90 0x7f8b50039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.626+0000 7f8c78c0f800 1 Processor -- start 2024-09-13T23:05:35.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.626+0000 7f8c76f04640 1 --2- 172.21.15.164:0/906109534 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8b50036b90 0x7f8b50039050 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x560cfc0ff0a0 tx=0x7f8c68005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.626+0000 7f8c78c0f800 1 -- start start 2024-09-13T23:05:35.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.626+0000 7f8c78c0f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc11cb00 0x560cfc11cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.626+0000 7f8c78c0f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560cfc0efff0 con 0x560cfc11cb00 2024-09-13T23:05:35.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.626+0000 7f8c75f02640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc11cb00 0x560cfc11cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.627+0000 7f8c75f02640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc11cb00 0x560cfc11cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57764/0 (socket says 172.21.15.164:57764) 2024-09-13T23:05:35.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.627+0000 7f8c75f02640 1 -- 172.21.15.164:0/1870137791 learned_addr learned my addr 172.21.15.164:0/1870137791 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.627+0000 7f8c75f02640 1 -- 172.21.15.164:0/1870137791 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cfc11d4d0 con 0x560cfc11cb00 2024-09-13T23:05:35.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.627+0000 7f8c75f02640 1 --2- 172.21.15.164:0/1870137791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc11cb00 0x560cfc11cf00 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8c6004d100 tx=0x7f8c60019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7a8d5567c05b86 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.627+0000 7f8b59ffb640 1 -- 172.21.15.164:0/1870137791 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c600258e0 con 0x560cfc11cb00 2024-09-13T23:05:35.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.627+0000 7f8b59ffb640 1 -- 172.21.15.164:0/1870137791 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c60025410 con 0x560cfc11cb00 2024-09-13T23:05:35.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.627+0000 7f8b59ffb640 1 -- 172.21.15.164:0/1870137791 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c60025a80 con 0x560cfc11cb00 2024-09-13T23:05:35.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.627+0000 7f8c78c0f800 1 -- 172.21.15.164:0/1870137791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc11cb00 msgr2=0x560cfc11cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.628+0000 7f8c78c0f800 1 --2- 172.21.15.164:0/1870137791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc11cb00 0x560cfc11cf00 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8c6004d100 tx=0x7f8c60019ce0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.628+0000 7f8c78c0f800 1 -- 172.21.15.164:0/1870137791 shutdown_connections 2024-09-13T23:05:35.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.628+0000 7f8c78c0f800 1 --2- 172.21.15.164:0/1870137791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc11cb00 0x560cfc11cf00 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.628+0000 7f8c78c0f800 1 -- 172.21.15.164:0/1870137791 >> 172.21.15.164:0/1870137791 conn(0x560cfc118e60 msgr2=0x560cfc116f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.628+0000 7f8c78c0f800 1 -- 172.21.15.164:0/1870137791 shutdown_connections 2024-09-13T23:05:35.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.628+0000 7f8c78c0f800 1 -- 172.21.15.164:0/1870137791 wait complete. 2024-09-13T23:05:35.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.628+0000 7f8c78c0f800 1 Processor -- start 2024-09-13T23:05:35.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.628+0000 7f8c78c0f800 1 -- start start 2024-09-13T23:05:35.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.628+0000 7f8c78c0f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc11cb00 0x560cfc124010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.628+0000 7f8c78c0f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560cfc11db40 con 0x560cfc11cb00 2024-09-13T23:05:35.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.628+0000 7f8c75f02640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc11cb00 0x560cfc124010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.628+0000 7f8c75f02640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc11cb00 0x560cfc124010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57770/0 (socket says 172.21.15.164:57770) 2024-09-13T23:05:35.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.628+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 learned_addr learned my addr 172.21.15.164:0/3974663131 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.629+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cfc124550 con 0x560cfc11cb00 2024-09-13T23:05:35.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.629+0000 7f8c75f02640 1 --2- 172.21.15.164:0/3974663131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc11cb00 0x560cfc124010 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8c60019d20 tx=0x7f8c6004d090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.629+0000 7f8b47fff640 1 -- 172.21.15.164:0/3974663131 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c6000cc60 con 0x560cfc11cb00 2024-09-13T23:05:35.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.629+0000 7f8b47fff640 1 -- 172.21.15.164:0/3974663131 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c6000ce00 con 0x560cfc11cb00 2024-09-13T23:05:35.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.629+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560cfc1247e0 con 0x560cfc11cb00 2024-09-13T23:05:35.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.629+0000 7f8b47fff640 1 -- 172.21.15.164:0/3974663131 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c60040990 con 0x560cfc11cb00 2024-09-13T23:05:35.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.629+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cfc1247e0 con 0x560cfc11cb00 2024-09-13T23:05:35.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.630+0000 7f8b47fff640 1 -- 172.21.15.164:0/3974663131 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8c60040b30 con 0x560cfc11cb00 2024-09-13T23:05:35.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.630+0000 7f8b47fff640 1 --2- 172.21.15.164:0/3974663131 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8b40036b40 0x7f8b40039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.630+0000 7f8b47fff640 1 -- 172.21.15.164:0/3974663131 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8c60035070 con 0x560cfc11cb00 2024-09-13T23:05:35.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.630+0000 7f8c76f04640 1 --2- 172.21.15.164:0/3974663131 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8b40036b40 0x7f8b40039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.630+0000 7f8c76f04640 1 --2- 172.21.15.164:0/3974663131 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8b40036b40 0x7f8b40039000 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x560cfc0ff070 tx=0x7f8c6801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.630+0000 7f8c78c0f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.630+0000 7f8c78c0f800 1 --2- 172.21.15.164:0/3974663131 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560cfc12f930 0x560cfc131df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.630+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560cfc132540 con 0x560cfc12f930 2024-09-13T23:05:35.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.631+0000 7f8c76703640 1 --2- 172.21.15.164:0/3974663131 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560cfc12f930 0x560cfc131df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.631+0000 7f8c76703640 1 --2- 172.21.15.164:0/3974663131 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560cfc12f930 0x560cfc131df0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.631+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c70051070 con 0x560cfc12f930 2024-09-13T23:05:35.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.631+0000 7f8c78c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.631+0000 7f8c78c0f800 20 realm 2024-09-13T23:05:35.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.631+0000 7f8c78c0f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.631+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560cfc132950 con 0x560cfc12f930 2024-09-13T23:05:35.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.631+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c70051070 con 0x560cfc12f930 2024-09-13T23:05:35.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.631+0000 7f8c78c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.631+0000 7f8c78c0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:35.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.631+0000 7f8c78c0f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.631+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560cfc133220 con 0x560cfc12f930 2024-09-13T23:05:35.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.632+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c70051070 con 0x560cfc12f930 2024-09-13T23:05:35.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.632+0000 7f8c78c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.632+0000 7f8c78c0f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.632+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560cfc1335c0 con 0x560cfc12f930 2024-09-13T23:05:35.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.632+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8c70051070 con 0x560cfc12f930 2024-09-13T23:05:35.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.632+0000 7f8c78c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:35.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.632+0000 7f8c78c0f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.632+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560cfc133e10 con 0x560cfc12f930 2024-09-13T23:05:35.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.632+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8c70051070 con 0x560cfc12f930 2024-09-13T23:05:35.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.632+0000 7f8c78c0f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:35.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.632+0000 7f8c78c0f800 20 searching for the correct realm 2024-09-13T23:05:35.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.632+0000 7f8c78c0f800 1 --2- 172.21.15.164:0/3974663131 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x560cfc135b80 0x560cfc137f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.632+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x560cfc135b80 2024-09-13T23:05:35.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.632+0000 7f8c75f02640 1 --2- 172.21.15.164:0/3974663131 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x560cfc135b80 0x560cfc137f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.633+0000 7f8c75f02640 1 --2- 172.21.15.164:0/3974663131 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x560cfc135b80 0x560cfc137f70 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.633+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c6003f020 con 0x560cfc135b80 2024-09-13T23:05:35.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.633+0000 7f8c75f02640 1 --2- 172.21.15.164:0/3974663131 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f8c60042070 0x7f8c6002f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.633+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x7f8c60042070 2024-09-13T23:05:35.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.633+0000 7f8c76f04640 1 --2- 172.21.15.164:0/3974663131 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f8c60042070 0x7f8c6002f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.633+0000 7f8c76f04640 1 --2- 172.21.15.164:0/3974663131 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f8c60042070 0x7f8c6002f430 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.633+0000 7f8c76f04640 1 -- 172.21.15.164:0/3974663131 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c6801f070 con 0x7f8c60042070 2024-09-13T23:05:35.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.633+0000 7f8c76f04640 1 --2- 172.21.15.164:0/3974663131 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f8c68031040 0x7f8c68032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.633+0000 7f8c76f04640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x7f8c68031040 2024-09-13T23:05:35.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.634+0000 7f8c76703640 1 --2- 172.21.15.164:0/3974663131 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f8c68031040 0x7f8c68032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.634+0000 7f8c76703640 1 --2- 172.21.15.164:0/3974663131 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f8c68031040 0x7f8c68032430 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.634+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c70051070 con 0x7f8c68031040 2024-09-13T23:05:35.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.634+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x560cfc12f930 2024-09-13T23:05:35.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.635+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8c70051070 con 0x560cfc12f930 2024-09-13T23:05:35.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.635+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x560cfc12f930 2024-09-13T23:05:35.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.635+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c70051070 con 0x560cfc12f930 2024-09-13T23:05:35.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.635+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x7f8c68031040 2024-09-13T23:05:35.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.635+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c70051070 con 0x7f8c68031040 2024-09-13T23:05:35.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.635+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x7f8c68031040 2024-09-13T23:05:35.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.635+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c70051070 con 0x7f8c68031040 2024-09-13T23:05:35.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.635+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x7f8c60042070 2024-09-13T23:05:35.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.636+0000 7f8c76f04640 1 -- 172.21.15.164:0/3974663131 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c6801f070 con 0x7f8c60042070 2024-09-13T23:05:35.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.636+0000 7f8c76f04640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x560cfc135b80 2024-09-13T23:05:35.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.636+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c6005d040 con 0x560cfc135b80 2024-09-13T23:05:35.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.636+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x560cfc12f930 2024-09-13T23:05:35.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.636+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c70051070 con 0x560cfc12f930 2024-09-13T23:05:35.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.636+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x7f8c68031040 2024-09-13T23:05:35.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.636+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c70051070 con 0x7f8c68031040 2024-09-13T23:05:35.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.636+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x560cfc12f930 2024-09-13T23:05:35.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.637+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c70051070 con 0x560cfc12f930 2024-09-13T23:05:35.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.637+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x7f8c60042070 2024-09-13T23:05:35.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.637+0000 7f8c76f04640 1 -- 172.21.15.164:0/3974663131 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8c6801f070 con 0x7f8c60042070 2024-09-13T23:05:35.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.637+0000 7f8c76f04640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x560cfc135b80 2024-09-13T23:05:35.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.637+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c6005d040 con 0x560cfc135b80 2024-09-13T23:05:35.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.637+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x560cfc135b80 2024-09-13T23:05:35.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.637+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c6005d040 con 0x560cfc135b80 2024-09-13T23:05:35.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.637+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x7f8c68031040 2024-09-13T23:05:35.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.638+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c70051070 con 0x7f8c68031040 2024-09-13T23:05:35.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.638+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x560cfc135b80 2024-09-13T23:05:35.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.638+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c6005d040 con 0x560cfc135b80 2024-09-13T23:05:35.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.638+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x560cfc135b80 2024-09-13T23:05:35.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.638+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c6005d040 con 0x560cfc135b80 2024-09-13T23:05:35.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.638+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x560cfc12f930 2024-09-13T23:05:35.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.638+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c70051070 con 0x560cfc12f930 2024-09-13T23:05:35.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.638+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x560cfc12f930 2024-09-13T23:05:35.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.638+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8c70051070 con 0x560cfc12f930 2024-09-13T23:05:35.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.638+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x7f8c68031040 2024-09-13T23:05:35.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.639+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c70051070 con 0x7f8c68031040 2024-09-13T23:05:35.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.639+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x560cfc135b80 2024-09-13T23:05:35.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.639+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c6005d040 con 0x560cfc135b80 2024-09-13T23:05:35.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.639+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x7f8c60042070 2024-09-13T23:05:35.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.639+0000 7f8c76f04640 1 -- 172.21.15.164:0/3974663131 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c6801f070 con 0x7f8c60042070 2024-09-13T23:05:35.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.639+0000 7f8c76f04640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x560cfc12f930 2024-09-13T23:05:35.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.639+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8c70051070 con 0x560cfc12f930 2024-09-13T23:05:35.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.639+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x7f8c68031040 2024-09-13T23:05:35.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.640+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c70051070 con 0x7f8c68031040 2024-09-13T23:05:35.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.640+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x560cfc135b80 2024-09-13T23:05:35.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.640+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c6005d040 con 0x560cfc135b80 2024-09-13T23:05:35.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.640+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x7f8c68031040 2024-09-13T23:05:35.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.640+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c70051070 con 0x7f8c68031040 2024-09-13T23:05:35.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.640+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x7f8c60042070 2024-09-13T23:05:35.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.640+0000 7f8c76f04640 1 -- 172.21.15.164:0/3974663131 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c6801f070 con 0x7f8c60042070 2024-09-13T23:05:35.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.640+0000 7f8c76f04640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x560cfc135b80 2024-09-13T23:05:35.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.641+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c6005d040 con 0x560cfc135b80 2024-09-13T23:05:35.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.641+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x7f8c68031040 2024-09-13T23:05:35.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.641+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c70051070 con 0x7f8c68031040 2024-09-13T23:05:35.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.641+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x560cfc12f930 2024-09-13T23:05:35.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.641+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8c70051070 con 0x560cfc12f930 2024-09-13T23:05:35.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.641+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560cfc138530 con 0x7f8c60042070 2024-09-13T23:05:35.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.642+0000 7f8c76f04640 1 -- 172.21.15.164:0/3974663131 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c6801f070 con 0x7f8c60042070 2024-09-13T23:05:35.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.642+0000 7f8c78c0f800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:35.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.642+0000 7f8c78c0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:35.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.642+0000 7f8c78c0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:35.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.642+0000 7f8c78c0f800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:35.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.642+0000 7f8c78c0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:35.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.642+0000 7f8c78c0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:35.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.642+0000 7f8c78c0f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.642+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560cfc134790 con 0x560cfc12f930 2024-09-13T23:05:35.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.642+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c70051070 con 0x560cfc12f930 2024-09-13T23:05:35.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.642+0000 7f8c78c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.642+0000 7f8c78c0f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.642+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560cfc135030 con 0x560cfc12f930 2024-09-13T23:05:35.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.642+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8c70051070 con 0x560cfc12f930 2024-09-13T23:05:35.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.642+0000 7f8c78c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:35.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.642+0000 7f8c78c0f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.642+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560cfc135030 con 0x560cfc12f930 2024-09-13T23:05:35.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.642+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8c70051070 con 0x560cfc12f930 2024-09-13T23:05:35.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.642+0000 7f8c78c0f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:35.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.642+0000 7f8c78c0f800 20 zone default found 2024-09-13T23:05:35.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.642+0000 7f8c78c0f800 4 Realm: () 2024-09-13T23:05:35.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.642+0000 7f8c78c0f800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:35.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.642+0000 7f8c78c0f800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:35.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.642+0000 7f8c78c0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:35.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.642+0000 7f8c78c0f800 20 zonegroup default 2024-09-13T23:05:35.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.642+0000 7f8c78c0f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.642+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560cfc1389b0 con 0x7f8c68031040 2024-09-13T23:05:35.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.643+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8c70051070 con 0x7f8c68031040 2024-09-13T23:05:35.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.643+0000 7f8c78c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.643+0000 7f8c78c0f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.643+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560cfc13a3f0 con 0x560cfc135b80 2024-09-13T23:05:35.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.643+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8c6005d040 con 0x560cfc135b80 2024-09-13T23:05:35.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.643+0000 7f8c78c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.643+0000 7f8c78c0f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.643+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560cfc13a8b0 con 0x560cfc135b80 2024-09-13T23:05:35.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.643+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8c6005d040 con 0x560cfc135b80 2024-09-13T23:05:35.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.643+0000 7f8c78c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.643+0000 7f8c78c0f800 20 started sync module instance, tier type = 2024-09-13T23:05:35.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.643+0000 7f8c78c0f800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:35.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.643+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560cfc139830 con 0x7f8c60042070 2024-09-13T23:05:35.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.644+0000 7f8c76f04640 1 -- 172.21.15.164:0/3974663131 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c68040040 con 0x7f8c60042070 2024-09-13T23:05:35.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.644+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94613768739872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560cfc139490 con 0x7f8c60042070 2024-09-13T23:05:35.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.644+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560cfc13b7e0 con 0x560cfc12f930 2024-09-13T23:05:35.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.645+0000 7f8c76f04640 1 -- 172.21.15.164:0/3974663131 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94613768739872] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c68040040 con 0x7f8c60042070 2024-09-13T23:05:35.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.646+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c70051070 con 0x560cfc12f930 2024-09-13T23:05:35.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.646+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94613768744208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560cfc13b7e0 con 0x560cfc12f930 2024-09-13T23:05:35.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.646+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560cfc13c200 con 0x560cfc135b80 2024-09-13T23:05:35.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.646+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c6005d040 con 0x560cfc135b80 2024-09-13T23:05:35.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.646+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94613768748272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560cfc13caa0 con 0x560cfc135b80 2024-09-13T23:05:35.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.646+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560cfc13d520 con 0x7f8c60042070 2024-09-13T23:05:35.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.647+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94613768744208] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c70051070 con 0x560cfc12f930 2024-09-13T23:05:35.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.647+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94613768748272] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c6005d040 con 0x560cfc135b80 2024-09-13T23:05:35.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.648+0000 7f8c76f04640 1 -- 172.21.15.164:0/3974663131 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c68040040 con 0x7f8c60042070 2024-09-13T23:05:35.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.648+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94613768750576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560cfc13b330 con 0x7f8c60042070 2024-09-13T23:05:35.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.648+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560cfc13ddf0 con 0x560cfc12f930 2024-09-13T23:05:35.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.648+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c70051070 con 0x560cfc12f930 2024-09-13T23:05:35.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.649+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94613768755520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560cfc13dda0 con 0x560cfc12f930 2024-09-13T23:05:35.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.649+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560cfc13eda0 con 0x7f8c68031040 2024-09-13T23:05:35.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.649+0000 7f8c76f04640 1 -- 172.21.15.164:0/3974663131 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94613768750576] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c68040040 con 0x7f8c60042070 2024-09-13T23:05:35.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.651+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94613768755520] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c70051070 con 0x560cfc12f930 2024-09-13T23:05:35.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.652+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c70051070 con 0x7f8c68031040 2024-09-13T23:05:35.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.652+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94613768753168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560cfc13e8b0 con 0x7f8c68031040 2024-09-13T23:05:35.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.652+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560cfc13f640 con 0x7f8c68031040 2024-09-13T23:05:35.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.652+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94613768753168] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c70051070 con 0x7f8c68031040 2024-09-13T23:05:35.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.653+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c70051070 con 0x7f8c68031040 2024-09-13T23:05:35.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.653+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94613768757648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560cfc13e8b0 con 0x7f8c68031040 2024-09-13T23:05:35.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.653+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560cfc13fc60 con 0x7f8c68031040 2024-09-13T23:05:35.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.654+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c70051070 con 0x7f8c68031040 2024-09-13T23:05:35.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.654+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94613768763312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560cfc140080 con 0x7f8c68031040 2024-09-13T23:05:35.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.654+0000 7f8c78c0f800 20 add_watcher() i=0 2024-09-13T23:05:35.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.654+0000 7f8c78c0f800 20 add_watcher() i=1 2024-09-13T23:05:35.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.654+0000 7f8c78c0f800 20 add_watcher() i=2 2024-09-13T23:05:35.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.654+0000 7f8c78c0f800 20 add_watcher() i=3 2024-09-13T23:05:35.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.654+0000 7f8c78c0f800 20 add_watcher() i=4 2024-09-13T23:05:35.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.654+0000 7f8c78c0f800 20 add_watcher() i=5 2024-09-13T23:05:35.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.654+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94613768757648] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c70051070 con 0x7f8c68031040 2024-09-13T23:05:35.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.654+0000 7f8c78c0f800 20 add_watcher() i=6 2024-09-13T23:05:35.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.654+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94613768763312] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c70051070 con 0x7f8c68031040 2024-09-13T23:05:35.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.654+0000 7f8c78c0f800 20 add_watcher() i=7 2024-09-13T23:05:35.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.654+0000 7f8c78c0f800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:35.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.655+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560cfc13f190 con 0x560cfc12f930 2024-09-13T23:05:35.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.655+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8c70051070 con 0x560cfc12f930 2024-09-13T23:05:35.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.655+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94613768761744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560cfc140590 con 0x560cfc12f930 2024-09-13T23:05:35.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.656+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94613768761744] v32'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8c70051070 con 0x560cfc12f930 2024-09-13T23:05:35.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.656+0000 7f8b2cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:35.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.656+0000 7f8c78c0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:35.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.656+0000 7f8c78c0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:35.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.656+0000 7f8c78c0f800 5 note: GC not initialized 2024-09-13T23:05:35.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.656+0000 7f8aa77fe640 20 reqs_thread_entry: start 2024-09-13T23:05:35.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.656+0000 7f8c78c0f800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:35.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.656+0000 7f8c78c0f800 20 Filter name: none 2024-09-13T23:05:35.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.657+0000 7f8aa57fa640 20 reqs_thread_entry: start 2024-09-13T23:05:35.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.657+0000 7f8c78c0f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T23:05:35.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.657+0000 7f8c78c0f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.657+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560cfc176520 con 0x7f8c68031040 2024-09-13T23:05:35.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.657+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f8c70051070 con 0x7f8c68031040 2024-09-13T23:05:35.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.657+0000 7f8c78c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.657+0000 7f8c78c0f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T23:05:35.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.657+0000 7f8c78c0f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:05:35.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.657+0000 7f8c78c0f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T23:05:35.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.657+0000 7f8c78c0f800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.657+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560cfc174b60 con 0x7f8c68031040 2024-09-13T23:05:35.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.657+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f8c70051070 con 0x7f8c68031040 2024-09-13T23:05:35.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.657+0000 7f8c78c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.657+0000 7f8c78c0f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T23:05:35.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.657+0000 7f8c78c0f800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:05:35.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.658+0000 7f8c78c0f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T23:05:35.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.658+0000 7f8c78c0f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T23:05:35.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.658+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560cfc175430 con 0x7f8c68031040 2024-09-13T23:05:35.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.659+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v32'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f8c70051070 con 0x7f8c68031040 2024-09-13T23:05:35.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.659+0000 7f8c78c0f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T23:05:35.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.659+0000 7f8c78c0f800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:05:35.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.659+0000 7f8c78c0f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T23:05:35.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.659+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94613768982400 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560cfc1755e0 con 0x7f8c68031040 2024-09-13T23:05:35.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.659+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== watch-notify(notify (1) cookie 94613768753168 notify 137438953475 ret 0) ==== 598+0+0 (crc 0 0 0) 0x560cfc175f70 con 0x7f8c68031040 2024-09-13T23:05:35.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.659+0000 7f8b59ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94613768753168 notifier 4498 bl.length()=556 2024-09-13T23:05:35.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.659+0000 7f8b59ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T23:05:35.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.659+0000 7f8b59ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:05:35.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.659+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(65 notify.5 [notify cookie 94613768982400 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8c70051070 con 0x7f8c68031040 2024-09-13T23:05:35.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.659+0000 7f8b59ffb640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f8b3c003ea0 con 0x7f8c68031040 2024-09-13T23:05:35.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.659+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c70051070 con 0x7f8c68031040 2024-09-13T23:05:35.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.659+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== watch-notify(notify_complete (2) cookie 94613768982400 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8c70097040 con 0x7f8c68031040 2024-09-13T23:05:35.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.659+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560cfc1754e0 con 0x7f8c68031040 2024-09-13T23:05:35.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.660+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f8c70051070 con 0x7f8c68031040 2024-09-13T23:05:35.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.660+0000 7f8c78c0f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T23:05:35.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.660+0000 7f8c78c0f800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:05:35.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.660+0000 7f8c78c0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T23:05:35.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.660+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94613768982240 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560cfc17a030 con 0x560cfc135b80 2024-09-13T23:05:35.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.661+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== watch-notify(notify (1) cookie 94613768748272 notify 137438953474 ret 0) ==== 219+0+0 (crc 0 0 0) 0x560cfc124550 con 0x560cfc135b80 2024-09-13T23:05:35.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.661+0000 7f8b597fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94613768748272 notifier 4498 bl.length()=177 2024-09-13T23:05:35.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.661+0000 7f8b597fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T23:05:35.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.661+0000 7f8b597fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:05:35.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.661+0000 7f8b597fa640 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f8aac003400 con 0x560cfc135b80 2024-09-13T23:05:35.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.661+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(68 notify.2 [notify cookie 94613768982240 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8c6005d040 con 0x560cfc135b80 2024-09-13T23:05:35.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.661+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== watch-notify(notify_complete (2) cookie 94613768982240 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560cfc11d4d0 con 0x560cfc135b80 2024-09-13T23:05:35.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.661+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c6005d040 con 0x560cfc135b80 2024-09-13T23:05:35.679 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T23:05:35.659544Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:05:35.659516Z","tags":[],"group_ids":[]} 2024-09-13T23:05:35.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.662+0000 7f8b2cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:35.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.662+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94613768761744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560cfc1741e0 con 0x560cfc12f930 2024-09-13T23:05:35.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.663+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94613768761744] v32'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8c70051070 con 0x560cfc12f930 2024-09-13T23:05:35.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.663+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94613768739872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560cfc1741e0 con 0x7f8c60042070 2024-09-13T23:05:35.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.664+0000 7f8c76f04640 1 -- 172.21.15.164:0/3974663131 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94613768739872] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c68040040 con 0x7f8c60042070 2024-09-13T23:05:35.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.664+0000 7f8c78c0f800 20 remove_watcher() i=0 2024-09-13T23:05:35.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.664+0000 7f8c78c0f800 2 removed watcher, disabling cache 2024-09-13T23:05:35.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.664+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94613768744208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560cfc1741e0 con 0x560cfc12f930 2024-09-13T23:05:35.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.665+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94613768744208] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c70051070 con 0x560cfc12f930 2024-09-13T23:05:35.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.665+0000 7f8c78c0f800 20 remove_watcher() i=1 2024-09-13T23:05:35.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.665+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94613768748272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560cfc1741e0 con 0x560cfc135b80 2024-09-13T23:05:35.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.666+0000 7f8c75f02640 1 -- 172.21.15.164:0/3974663131 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94613768748272] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c6005d040 con 0x560cfc135b80 2024-09-13T23:05:35.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.666+0000 7f8c78c0f800 20 remove_watcher() i=2 2024-09-13T23:05:35.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.666+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94613768750576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560cfc1741e0 con 0x7f8c60042070 2024-09-13T23:05:35.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.667+0000 7f8c76f04640 1 -- 172.21.15.164:0/3974663131 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94613768750576] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c68040040 con 0x7f8c60042070 2024-09-13T23:05:35.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.667+0000 7f8c78c0f800 20 remove_watcher() i=3 2024-09-13T23:05:35.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.667+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94613768755520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560cfc1741e0 con 0x560cfc12f930 2024-09-13T23:05:35.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.668+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94613768755520] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c70051070 con 0x560cfc12f930 2024-09-13T23:05:35.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.668+0000 7f8c78c0f800 20 remove_watcher() i=4 2024-09-13T23:05:35.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.668+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94613768753168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560cfc1741e0 con 0x7f8c68031040 2024-09-13T23:05:35.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.670+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94613768753168] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c70051070 con 0x7f8c68031040 2024-09-13T23:05:35.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.670+0000 7f8c78c0f800 20 remove_watcher() i=5 2024-09-13T23:05:35.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.670+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94613768757648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560cfc1741e0 con 0x7f8c68031040 2024-09-13T23:05:35.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.671+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94613768757648] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c70051070 con 0x7f8c68031040 2024-09-13T23:05:35.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.671+0000 7f8c78c0f800 20 remove_watcher() i=6 2024-09-13T23:05:35.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.671+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94613768763312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560cfc1741e0 con 0x7f8c68031040 2024-09-13T23:05:35.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.672+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 <== osd.0 v2:172.21.15.17:6800/489863589 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94613768763312] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c70051070 con 0x7f8c68031040 2024-09-13T23:05:35.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.672+0000 7f8c78c0f800 20 remove_watcher() i=7 2024-09-13T23:05:35.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.672+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f8c68031040 msgr2=0x7f8c68032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.672+0000 7f8c78c0f800 1 --2- 172.21.15.164:0/3974663131 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f8c68031040 0x7f8c68032430 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.672+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560cfc12f930 msgr2=0x560cfc131df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.672+0000 7f8c78c0f800 1 --2- 172.21.15.164:0/3974663131 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560cfc12f930 0x560cfc131df0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.672+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f8c60042070 msgr2=0x7f8c6002f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.672+0000 7f8c78c0f800 1 --2- 172.21.15.164:0/3974663131 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f8c60042070 0x7f8c6002f430 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.672+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x560cfc135b80 msgr2=0x560cfc137f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.672+0000 7f8c78c0f800 1 --2- 172.21.15.164:0/3974663131 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x560cfc135b80 0x560cfc137f70 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.672+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8b40036b40 msgr2=0x7f8b40039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.672+0000 7f8c78c0f800 1 --2- 172.21.15.164:0/3974663131 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8b40036b40 0x7f8b40039000 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x560cfc0ff070 tx=0x7f8c6801f000 comp rx=0 tx=0).stop 2024-09-13T23:05:35.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.672+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc11cb00 msgr2=0x560cfc124010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.672+0000 7f8c76703640 1 -- 172.21.15.164:0/3974663131 reap_dead start 2024-09-13T23:05:35.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.672+0000 7f8c78c0f800 1 --2- 172.21.15.164:0/3974663131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc11cb00 0x560cfc124010 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8c60019d20 tx=0x7f8c6004d090 comp rx=0 tx=0).stop 2024-09-13T23:05:35.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.672+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 shutdown_connections 2024-09-13T23:05:35.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.672+0000 7f8c78c0f800 1 --2- 172.21.15.164:0/3974663131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc11cb00 0x560cfc124010 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.672+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 >> 172.21.15.164:0/3974663131 conn(0x560cfc118e60 msgr2=0x560cfc116f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.672+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 shutdown_connections 2024-09-13T23:05:35.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.672+0000 7f8c78c0f800 1 -- 172.21.15.164:0/3974663131 wait complete. 2024-09-13T23:05:35.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.673+0000 7f8c78c0f800 1 -- 172.21.15.164:0/906109534 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8b50036b90 msgr2=0x7f8b50039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.673+0000 7f8c78c0f800 1 --2- 172.21.15.164:0/906109534 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8b50036b90 0x7f8b50039050 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x560cfc0ff0a0 tx=0x7f8c68005840 comp rx=0 tx=0).stop 2024-09-13T23:05:35.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.673+0000 7f8c78c0f800 1 -- 172.21.15.164:0/906109534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfbf756c0 msgr2=0x560cfc112a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.673+0000 7f8c78c0f800 1 --2- 172.21.15.164:0/906109534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfbf756c0 0x560cfc112a70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8c60001ed0 tx=0x7f8c6000d7a0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.673+0000 7f8c78c0f800 1 -- 172.21.15.164:0/906109534 shutdown_connections 2024-09-13T23:05:35.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.673+0000 7f8c78c0f800 1 --2- 172.21.15.164:0/906109534 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8b50036b90 0x7f8b50039050 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.673+0000 7f8c78c0f800 1 --2- 172.21.15.164:0/906109534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfbf756c0 0x560cfc112a70 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.673+0000 7f8c78c0f800 1 -- 172.21.15.164:0/906109534 >> 172.21.15.164:0/906109534 conn(0x560cfc103c70 msgr2=0x560cfc1067f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.673+0000 7f8c78c0f800 1 -- 172.21.15.164:0/906109534 shutdown_connections 2024-09-13T23:05:35.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.673+0000 7f8c78c0f800 1 -- 172.21.15.164:0/906109534 wait complete. 2024-09-13T23:05:35.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.673+0000 7f8c78c0f800 1 -- 172.21.15.164:0/1262301651 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560cfc000ed0 msgr2=0x560cfc0fe290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.673+0000 7f8c78c0f800 1 --2- 172.21.15.164:0/1262301651 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560cfc000ed0 0x560cfc0fe290 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.673+0000 7f8c78c0f800 1 -- 172.21.15.164:0/1262301651 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8b5c036b90 msgr2=0x7f8b5c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.673+0000 7f8c78c0f800 1 --2- 172.21.15.164:0/1262301651 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8b5c036b90 0x7f8b5c039050 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8c60000f60 tx=0x7f8c600012b0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.673+0000 7f8c78c0f800 1 -- 172.21.15.164:0/1262301651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc000590 msgr2=0x560cfc0f7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.673+0000 7f8c78c0f800 1 --2- 172.21.15.164:0/1262301651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc000590 0x560cfc0f7220 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x560cfc0f0700 tx=0x7f8c70002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.673+0000 7f8c78c0f800 1 -- 172.21.15.164:0/1262301651 shutdown_connections 2024-09-13T23:05:35.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.673+0000 7f8c78c0f800 1 --2- 172.21.15.164:0/1262301651 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560cfc000ed0 0x560cfc0fe290 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.673+0000 7f8c78c0f800 1 --2- 172.21.15.164:0/1262301651 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8b5c036b90 0x7f8b5c039050 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.673+0000 7f8c78c0f800 1 --2- 172.21.15.164:0/1262301651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560cfc000590 0x560cfc0f7220 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.673+0000 7f8c78c0f800 1 -- 172.21.15.164:0/1262301651 >> 172.21.15.164:0/1262301651 conn(0x560cfbffbe20 msgr2=0x560cfc0e9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.673+0000 7f8c78c0f800 1 -- 172.21.15.164:0/1262301651 shutdown_connections 2024-09-13T23:05:35.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.673+0000 7f8c78c0f800 1 -- 172.21.15.164:0/1262301651 wait complete. 2024-09-13T23:05:35.690 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T23:05:35.659544Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:05:35.659516Z', 'tags': [], 'group_ids': []} 2024-09-13T23:05:35.695 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T23:05:35.700 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:05:35.700 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-13T23:05:35.700 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-13T23:05:35.700 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-13T23:05:35.743 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:35.743 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:35.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.742+0000 7f5043f24800 1 Processor -- start 2024-09-13T23:05:35.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.742+0000 7f5043f24800 1 -- start start 2024-09-13T23:05:35.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.743+0000 7f5043f24800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x555dc945b610 0x555dc94ea270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.743+0000 7f5043f24800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555dc93a6b30 con 0x555dc94ea7b0 2024-09-13T23:05:35.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.743+0000 7f5043f24800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x555dc9388360 con 0x555dc945b610 2024-09-13T23:05:35.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.743+0000 7f503fce0640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x555dc945b610 0x555dc94ea270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.743+0000 7f503f4df640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x555dc94ea7b0 0x555dc94ecba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40978/0 (socket says 172.21.15.164:40978) 2024-09-13T23:05:35.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.743+0000 7f503f4df640 1 -- 172.21.15.164:0/719270828 learned_addr learned my addr 172.21.15.164:0/719270828 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:35.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.743+0000 7f503fce0640 1 -- 172.21.15.164:0/719270828 >> v1:172.21.15.17:6789/0 conn(0x555dc94ea7b0 legacy=0x555dc94ecba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.743+0000 7f503fce0640 1 -- 172.21.15.164:0/719270828 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dc93aee00 con 0x555dc945b610 2024-09-13T23:05:35.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.745+0000 7f503fce0640 1 --2- 172.21.15.164:0/719270828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc945b610 0x555dc94ea270 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f503000a470 tx=0x7f5030045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9046b131e156da5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.745+0000 7f503ecde640 1 -- 172.21.15.164:0/719270828 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5030053570 con 0x555dc945b610 2024-09-13T23:05:35.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.745+0000 7f503ecde640 1 -- 172.21.15.164:0/719270828 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5030058070 con 0x555dc945b610 2024-09-13T23:05:35.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.745+0000 7f503ecde640 1 -- 172.21.15.164:0/719270828 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5030053880 con 0x555dc945b610 2024-09-13T23:05:35.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.746+0000 7f5043f24800 1 -- 172.21.15.164:0/719270828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc945b610 msgr2=0x555dc94ea270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.746+0000 7f5043f24800 1 --2- 172.21.15.164:0/719270828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc945b610 0x555dc94ea270 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f503000a470 tx=0x7f5030045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:35.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.746+0000 7f5043f24800 1 -- 172.21.15.164:0/719270828 shutdown_connections 2024-09-13T23:05:35.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.746+0000 7f5043f24800 1 --2- 172.21.15.164:0/719270828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc945b610 0x555dc94ea270 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.746+0000 7f5043f24800 1 -- 172.21.15.164:0/719270828 >> 172.21.15.164:0/719270828 conn(0x555dc94e1de0 msgr2=0x555dc94e4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.746+0000 7f5043f24800 1 -- 172.21.15.164:0/719270828 shutdown_connections 2024-09-13T23:05:35.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.746+0000 7f5043f24800 1 -- 172.21.15.164:0/719270828 wait complete. 2024-09-13T23:05:35.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.760+0000 7f5043f24800 1 Processor -- start 2024-09-13T23:05:35.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.760+0000 7f5043f24800 1 -- start start 2024-09-13T23:05:35.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.760+0000 7f5043f24800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc945b610 0x555dc95d68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.760+0000 7f5043f24800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x555dc9433330 con 0x555dc945b610 2024-09-13T23:05:35.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.760+0000 7f503fce0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc945b610 0x555dc95d68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.760+0000 7f503fce0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc945b610 0x555dc95d68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57782/0 (socket says 172.21.15.164:57782) 2024-09-13T23:05:35.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.760+0000 7f503fce0640 1 -- 172.21.15.164:0/4205635667 learned_addr learned my addr 172.21.15.164:0/4205635667 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.761+0000 7f503fce0640 1 -- 172.21.15.164:0/4205635667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dc9380bc0 con 0x555dc945b610 2024-09-13T23:05:35.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.761+0000 7f503fce0640 1 --2- 172.21.15.164:0/4205635667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc945b610 0x555dc95d68b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5030025c20 tx=0x7f5030051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408adc99b73b26 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.761+0000 7f4f2de0b640 1 -- 172.21.15.164:0/4205635667 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f503005c580 con 0x555dc945b610 2024-09-13T23:05:35.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.761+0000 7f4f2de0b640 1 -- 172.21.15.164:0/4205635667 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5030063030 con 0x555dc945b610 2024-09-13T23:05:35.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.761+0000 7f4f2de0b640 1 -- 172.21.15.164:0/4205635667 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f503005c850 con 0x555dc945b610 2024-09-13T23:05:35.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.762+0000 7f5043f24800 1 -- 172.21.15.164:0/4205635667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc945b610 msgr2=0x555dc95d68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.762+0000 7f5043f24800 1 --2- 172.21.15.164:0/4205635667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc945b610 0x555dc95d68b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5030025c20 tx=0x7f5030051000 comp rx=0 tx=0).stop 2024-09-13T23:05:35.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.762+0000 7f5043f24800 1 -- 172.21.15.164:0/4205635667 shutdown_connections 2024-09-13T23:05:35.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.762+0000 7f5043f24800 1 --2- 172.21.15.164:0/4205635667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc945b610 0x555dc95d68b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.762+0000 7f5043f24800 1 -- 172.21.15.164:0/4205635667 >> 172.21.15.164:0/4205635667 conn(0x555dc94e1de0 msgr2=0x555dc95d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.762+0000 7f5043f24800 1 -- 172.21.15.164:0/4205635667 shutdown_connections 2024-09-13T23:05:35.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.762+0000 7f5043f24800 1 -- 172.21.15.164:0/4205635667 wait complete. 2024-09-13T23:05:35.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.762+0000 7f5043f24800 1 Processor -- start 2024-09-13T23:05:35.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.762+0000 7f5043f24800 1 -- start start 2024-09-13T23:05:35.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.762+0000 7f5043f24800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc945b610 0x555dc95de230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.762+0000 7f5043f24800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x555dc94ee680 con 0x555dc945b610 2024-09-13T23:05:35.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.762+0000 7f503fce0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc945b610 0x555dc95de230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.762+0000 7f503fce0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc945b610 0x555dc95de230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57790/0 (socket says 172.21.15.164:57790) 2024-09-13T23:05:35.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.762+0000 7f503fce0640 1 -- 172.21.15.164:0/329887619 learned_addr learned my addr 172.21.15.164:0/329887619 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.763+0000 7f503fce0640 1 -- 172.21.15.164:0/329887619 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dc9394fe0 con 0x555dc945b610 2024-09-13T23:05:35.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.763+0000 7f503fce0640 1 --2- 172.21.15.164:0/329887619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc945b610 0x555dc95de230 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x555dc95d7710 tx=0x7f5030002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.763+0000 7f4f27fff640 1 -- 172.21.15.164:0/329887619 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5030054ad0 con 0x555dc945b610 2024-09-13T23:05:35.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.763+0000 7f4f27fff640 1 -- 172.21.15.164:0/329887619 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5030054c70 con 0x555dc945b610 2024-09-13T23:05:35.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.763+0000 7f5043f24800 1 -- 172.21.15.164:0/329887619 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555dc95de770 con 0x555dc945b610 2024-09-13T23:05:35.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.763+0000 7f4f27fff640 1 -- 172.21.15.164:0/329887619 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5030068420 con 0x555dc945b610 2024-09-13T23:05:35.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.763+0000 7f5043f24800 1 -- 172.21.15.164:0/329887619 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dc95dec90 con 0x555dc945b610 2024-09-13T23:05:35.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.764+0000 7f4f27fff640 1 -- 172.21.15.164:0/329887619 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f50300685c0 con 0x555dc945b610 2024-09-13T23:05:35.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.764+0000 7f4f27fff640 1 --2- 172.21.15.164:0/329887619 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4f28036b90 0x7f4f28039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.764+0000 7f4f27fff640 1 -- 172.21.15.164:0/329887619 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5030070030 con 0x555dc945b610 2024-09-13T23:05:35.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.764+0000 7f503f4df640 1 --2- 172.21.15.164:0/329887619 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4f28036b90 0x7f4f28039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.764+0000 7f5043f24800 1 --2- 172.21.15.164:0/329887619 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x555dc94ea7b0 0x555dc95e52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.764+0000 7f5043f24800 1 -- 172.21.15.164:0/329887619 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555dc95e5830 con 0x555dc94ea7b0 2024-09-13T23:05:35.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.764+0000 7f50404e1640 1 --2- 172.21.15.164:0/329887619 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x555dc94ea7b0 0x555dc95e52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.764+0000 7f503f4df640 1 --2- 172.21.15.164:0/329887619 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4f28036b90 0x7f4f28039050 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5034000f60 tx=0x7f50340012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.765+0000 7f50404e1640 1 --2- 172.21.15.164:0/329887619 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x555dc94ea7b0 0x555dc95e52a0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.765+0000 7f50404e1640 1 -- 172.21.15.164:0/329887619 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f503800a4a0 con 0x555dc94ea7b0 2024-09-13T23:05:35.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.765+0000 7f5043f24800 1 -- 172.21.15.164:0/329887619 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555dc95e2870 con 0x555dc94ea7b0 2024-09-13T23:05:35.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.765+0000 7f50404e1640 1 -- 172.21.15.164:0/329887619 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f503800a4a0 con 0x555dc94ea7b0 2024-09-13T23:05:35.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.765+0000 7f5043f24800 1 -- 172.21.15.164:0/329887619 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555dc95e76a0 con 0x555dc94ea7b0 2024-09-13T23:05:35.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.765+0000 7f50404e1640 1 -- 172.21.15.164:0/329887619 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f503800a4a0 con 0x555dc94ea7b0 2024-09-13T23:05:35.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.765+0000 7f5043f24800 1 -- 172.21.15.164:0/329887619 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555dc95e68d0 con 0x555dc94ea7b0 2024-09-13T23:05:35.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.766+0000 7f50404e1640 1 -- 172.21.15.164:0/329887619 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f503800a4a0 con 0x555dc94ea7b0 2024-09-13T23:05:35.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.766+0000 7f5043f24800 1 -- 172.21.15.164:0/329887619 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555dc95e6d20 con 0x555dc94ea7b0 2024-09-13T23:05:35.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.766+0000 7f50404e1640 1 -- 172.21.15.164:0/329887619 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f503800a4a0 con 0x555dc94ea7b0 2024-09-13T23:05:35.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.766+0000 7f5043f24800 1 Processor -- start 2024-09-13T23:05:35.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.766+0000 7f5043f24800 1 -- start start 2024-09-13T23:05:35.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.766+0000 7f5043f24800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc95f5cb0 0x555dc95f60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.766+0000 7f5043f24800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x555dc9382580 con 0x555dc95f5cb0 2024-09-13T23:05:35.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.767+0000 7f503f4df640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc95f5cb0 0x555dc95f60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.767+0000 7f503f4df640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc95f5cb0 0x555dc95f60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57798/0 (socket says 172.21.15.164:57798) 2024-09-13T23:05:35.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.767+0000 7f503f4df640 1 -- 172.21.15.164:0/4052391940 learned_addr learned my addr 172.21.15.164:0/4052391940 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.767+0000 7f503f4df640 1 -- 172.21.15.164:0/4052391940 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dc95f6610 con 0x555dc95f5cb0 2024-09-13T23:05:35.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.767+0000 7f503f4df640 1 --2- 172.21.15.164:0/4052391940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc95f5cb0 0x555dc95f60d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5034001ed0 tx=0x7f503400d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.767+0000 7f4f257fa640 1 -- 172.21.15.164:0/4052391940 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f503401b550 con 0x555dc95f5cb0 2024-09-13T23:05:35.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.767+0000 7f4f257fa640 1 -- 172.21.15.164:0/4052391940 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f503401b6f0 con 0x555dc95f5cb0 2024-09-13T23:05:35.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.767+0000 7f5043f24800 1 -- 172.21.15.164:0/4052391940 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555dc95f68a0 con 0x555dc95f5cb0 2024-09-13T23:05:35.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.767+0000 7f4f257fa640 1 -- 172.21.15.164:0/4052391940 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f503401b9d0 con 0x555dc95f5cb0 2024-09-13T23:05:35.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.767+0000 7f5043f24800 1 -- 172.21.15.164:0/4052391940 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dc95f9580 con 0x555dc95f5cb0 2024-09-13T23:05:35.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.768+0000 7f4f257fa640 1 -- 172.21.15.164:0/4052391940 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5034023020 con 0x555dc95f5cb0 2024-09-13T23:05:35.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.768+0000 7f4f257fa640 1 --2- 172.21.15.164:0/4052391940 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4f18036b90 0x7f4f18039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.768+0000 7f4f257fa640 1 -- 172.21.15.164:0/4052391940 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5034021020 con 0x555dc95f5cb0 2024-09-13T23:05:35.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.768+0000 7f50404e1640 1 --2- 172.21.15.164:0/4052391940 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4f18036b90 0x7f4f18039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.769+0000 7f5043f24800 1 Processor -- start 2024-09-13T23:05:35.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.769+0000 7f50404e1640 1 --2- 172.21.15.164:0/4052391940 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4f18036b90 0x7f4f18039050 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x555dc95e63f0 tx=0x7f5038005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.769+0000 7f5043f24800 1 -- start start 2024-09-13T23:05:35.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.769+0000 7f5043f24800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc96029c0 0x555dc9602dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.769+0000 7f5043f24800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x555dc95d7000 con 0x555dc96029c0 2024-09-13T23:05:35.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.769+0000 7f503f4df640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc96029c0 0x555dc9602dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.769+0000 7f503f4df640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc96029c0 0x555dc9602dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57808/0 (socket says 172.21.15.164:57808) 2024-09-13T23:05:35.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.769+0000 7f503f4df640 1 -- 172.21.15.164:0/841672198 learned_addr learned my addr 172.21.15.164:0/841672198 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.769+0000 7f503f4df640 1 -- 172.21.15.164:0/841672198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dc9603390 con 0x555dc96029c0 2024-09-13T23:05:35.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.769+0000 7f503f4df640 1 --2- 172.21.15.164:0/841672198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc96029c0 0x555dc9602dc0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f503404d100 tx=0x7f5034019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43259cff28372a2f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.770+0000 7f4f1effd640 1 -- 172.21.15.164:0/841672198 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50340258e0 con 0x555dc96029c0 2024-09-13T23:05:35.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.770+0000 7f4f1effd640 1 -- 172.21.15.164:0/841672198 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5034025410 con 0x555dc96029c0 2024-09-13T23:05:35.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.770+0000 7f4f1effd640 1 -- 172.21.15.164:0/841672198 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5034025a80 con 0x555dc96029c0 2024-09-13T23:05:35.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.770+0000 7f5043f24800 1 -- 172.21.15.164:0/841672198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc96029c0 msgr2=0x555dc9602dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.770+0000 7f5043f24800 1 --2- 172.21.15.164:0/841672198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc96029c0 0x555dc9602dc0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f503404d100 tx=0x7f5034019ce0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.770+0000 7f5043f24800 1 -- 172.21.15.164:0/841672198 shutdown_connections 2024-09-13T23:05:35.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.770+0000 7f5043f24800 1 --2- 172.21.15.164:0/841672198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc96029c0 0x555dc9602dc0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.770+0000 7f5043f24800 1 -- 172.21.15.164:0/841672198 >> 172.21.15.164:0/841672198 conn(0x555dc95fed20 msgr2=0x555dc95fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.770+0000 7f5043f24800 1 -- 172.21.15.164:0/841672198 shutdown_connections 2024-09-13T23:05:35.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.770+0000 7f5043f24800 1 -- 172.21.15.164:0/841672198 wait complete. 2024-09-13T23:05:35.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.770+0000 7f5043f24800 1 Processor -- start 2024-09-13T23:05:35.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.770+0000 7f5043f24800 1 -- start start 2024-09-13T23:05:35.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.771+0000 7f5043f24800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc96029c0 0x555dc9609e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.771+0000 7f5043f24800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x555dc9603a00 con 0x555dc96029c0 2024-09-13T23:05:35.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.771+0000 7f503f4df640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc96029c0 0x555dc9609e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.771+0000 7f503f4df640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc96029c0 0x555dc9609e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57822/0 (socket says 172.21.15.164:57822) 2024-09-13T23:05:35.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.771+0000 7f503f4df640 1 -- 172.21.15.164:0/3953906428 learned_addr learned my addr 172.21.15.164:0/3953906428 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.771+0000 7f503f4df640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dc960a3b0 con 0x555dc96029c0 2024-09-13T23:05:35.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.771+0000 7f503f4df640 1 --2- 172.21.15.164:0/3953906428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc96029c0 0x555dc9609e70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5034019d20 tx=0x7f503404d090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.771+0000 7f4f1d7fa640 1 -- 172.21.15.164:0/3953906428 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f503400cc60 con 0x555dc96029c0 2024-09-13T23:05:35.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.771+0000 7f4f1d7fa640 1 -- 172.21.15.164:0/3953906428 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f503400ce00 con 0x555dc96029c0 2024-09-13T23:05:35.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.771+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555dc960a640 con 0x555dc96029c0 2024-09-13T23:05:35.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.771+0000 7f4f1d7fa640 1 -- 172.21.15.164:0/3953906428 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5034040990 con 0x555dc96029c0 2024-09-13T23:05:35.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.771+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dc960a640 con 0x555dc96029c0 2024-09-13T23:05:35.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.772+0000 7f4f1d7fa640 1 -- 172.21.15.164:0/3953906428 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5034040b30 con 0x555dc96029c0 2024-09-13T23:05:35.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.772+0000 7f4f1d7fa640 1 --2- 172.21.15.164:0/3953906428 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4f08036b90 0x7f4f08039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.772+0000 7f4f1d7fa640 1 -- 172.21.15.164:0/3953906428 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5034035070 con 0x555dc96029c0 2024-09-13T23:05:35.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.772+0000 7f50404e1640 1 --2- 172.21.15.164:0/3953906428 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4f08036b90 0x7f4f08039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.773+0000 7f5043f24800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.773+0000 7f5043f24800 1 --2- 172.21.15.164:0/3953906428 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x555dc9615730 0x555dc9617bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.773+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555dc9618340 con 0x555dc9615730 2024-09-13T23:05:35.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.773+0000 7f503fce0640 1 --2- 172.21.15.164:0/3953906428 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x555dc9615730 0x555dc9617bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.773+0000 7f50404e1640 1 --2- 172.21.15.164:0/3953906428 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4f08036b90 0x7f4f08039050 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x555dc95e27c0 tx=0x7f503801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.773+0000 7f503fce0640 1 --2- 172.21.15.164:0/3953906428 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x555dc9615730 0x555dc9617bf0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.773+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5030051070 con 0x555dc9615730 2024-09-13T23:05:35.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.773+0000 7f5043f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.773+0000 7f5043f24800 20 realm 2024-09-13T23:05:35.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.773+0000 7f5043f24800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.773+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555dc9618750 con 0x555dc9615730 2024-09-13T23:05:35.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.774+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5030051070 con 0x555dc9615730 2024-09-13T23:05:35.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.774+0000 7f5043f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.774+0000 7f5043f24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:35.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.774+0000 7f5043f24800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.774+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555dc9619020 con 0x555dc9615730 2024-09-13T23:05:35.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.774+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5030051070 con 0x555dc9615730 2024-09-13T23:05:35.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.774+0000 7f5043f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.774+0000 7f5043f24800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.774+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555dc96193c0 con 0x555dc9615730 2024-09-13T23:05:35.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.774+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5030051070 con 0x555dc9615730 2024-09-13T23:05:35.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.774+0000 7f5043f24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:35.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.774+0000 7f5043f24800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.774+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555dc9619820 con 0x555dc9615730 2024-09-13T23:05:35.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.774+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5030051070 con 0x555dc9615730 2024-09-13T23:05:35.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.774+0000 7f5043f24800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:35.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.774+0000 7f5043f24800 20 searching for the correct realm 2024-09-13T23:05:35.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.774+0000 7f5043f24800 1 --2- 172.21.15.164:0/3953906428 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x555dc961b870 0x555dc961dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.774+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x555dc961b870 2024-09-13T23:05:35.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.774+0000 7f503f4df640 1 --2- 172.21.15.164:0/3953906428 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x555dc961b870 0x555dc961dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.775+0000 7f503f4df640 1 --2- 172.21.15.164:0/3953906428 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x555dc961b870 0x555dc961dc60 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.775+0000 7f503f4df640 1 -- 172.21.15.164:0/3953906428 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f503403f020 con 0x555dc961b870 2024-09-13T23:05:35.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.775+0000 7f503f4df640 1 --2- 172.21.15.164:0/3953906428 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f5034042070 0x7f503402f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.775+0000 7f503f4df640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x7f5034042070 2024-09-13T23:05:35.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.775+0000 7f50404e1640 1 --2- 172.21.15.164:0/3953906428 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f5034042070 0x7f503402f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.775+0000 7f50404e1640 1 --2- 172.21.15.164:0/3953906428 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f5034042070 0x7f503402f430 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.776+0000 7f50404e1640 1 -- 172.21.15.164:0/3953906428 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f503801f070 con 0x7f5034042070 2024-09-13T23:05:35.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.776+0000 7f50404e1640 1 --2- 172.21.15.164:0/3953906428 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f5038031040 0x7f5038032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.776+0000 7f50404e1640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x7f5038031040 2024-09-13T23:05:35.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.776+0000 7f503fce0640 1 --2- 172.21.15.164:0/3953906428 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f5038031040 0x7f5038032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.776+0000 7f503fce0640 1 --2- 172.21.15.164:0/3953906428 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f5038031040 0x7f5038032430 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.777+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5030051070 con 0x7f5038031040 2024-09-13T23:05:35.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.777+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x555dc9615730 2024-09-13T23:05:35.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.777+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5030051070 con 0x555dc9615730 2024-09-13T23:05:35.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.777+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x555dc9615730 2024-09-13T23:05:35.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.777+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5030051070 con 0x555dc9615730 2024-09-13T23:05:35.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.777+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x7f5038031040 2024-09-13T23:05:35.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.777+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5030051070 con 0x7f5038031040 2024-09-13T23:05:35.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.777+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x7f5038031040 2024-09-13T23:05:35.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.777+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5030051070 con 0x7f5038031040 2024-09-13T23:05:35.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.777+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x7f5034042070 2024-09-13T23:05:35.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.778+0000 7f50404e1640 1 -- 172.21.15.164:0/3953906428 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f503801f070 con 0x7f5034042070 2024-09-13T23:05:35.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.778+0000 7f50404e1640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x555dc961b870 2024-09-13T23:05:35.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.778+0000 7f503f4df640 1 -- 172.21.15.164:0/3953906428 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f503403f020 con 0x555dc961b870 2024-09-13T23:05:35.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.778+0000 7f503f4df640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x555dc9615730 2024-09-13T23:05:35.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.778+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5030051070 con 0x555dc9615730 2024-09-13T23:05:35.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.778+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x7f5038031040 2024-09-13T23:05:35.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.779+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5030051070 con 0x7f5038031040 2024-09-13T23:05:35.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.779+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x555dc9615730 2024-09-13T23:05:35.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.779+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5030051070 con 0x555dc9615730 2024-09-13T23:05:35.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.779+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x7f5034042070 2024-09-13T23:05:35.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.779+0000 7f50404e1640 1 -- 172.21.15.164:0/3953906428 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f503801f070 con 0x7f5034042070 2024-09-13T23:05:35.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.779+0000 7f50404e1640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x555dc961b870 2024-09-13T23:05:35.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.779+0000 7f503f4df640 1 -- 172.21.15.164:0/3953906428 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f503403f020 con 0x555dc961b870 2024-09-13T23:05:35.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.779+0000 7f503f4df640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x555dc961b870 2024-09-13T23:05:35.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.779+0000 7f503f4df640 1 -- 172.21.15.164:0/3953906428 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f503403f020 con 0x555dc961b870 2024-09-13T23:05:35.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.779+0000 7f503f4df640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x7f5038031040 2024-09-13T23:05:35.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.780+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5030051070 con 0x7f5038031040 2024-09-13T23:05:35.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.780+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x555dc961b870 2024-09-13T23:05:35.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.780+0000 7f503f4df640 1 -- 172.21.15.164:0/3953906428 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f503403f020 con 0x555dc961b870 2024-09-13T23:05:35.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.780+0000 7f503f4df640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x555dc961b870 2024-09-13T23:05:35.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.780+0000 7f503f4df640 1 -- 172.21.15.164:0/3953906428 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f503403f020 con 0x555dc961b870 2024-09-13T23:05:35.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.780+0000 7f503f4df640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x555dc9615730 2024-09-13T23:05:35.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.780+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5030051070 con 0x555dc9615730 2024-09-13T23:05:35.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.780+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x555dc9615730 2024-09-13T23:05:35.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.781+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5030051070 con 0x555dc9615730 2024-09-13T23:05:35.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.781+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x7f5038031040 2024-09-13T23:05:35.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.781+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5030051070 con 0x7f5038031040 2024-09-13T23:05:35.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.781+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x555dc961b870 2024-09-13T23:05:35.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.781+0000 7f503f4df640 1 -- 172.21.15.164:0/3953906428 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f503403f020 con 0x555dc961b870 2024-09-13T23:05:35.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.781+0000 7f503f4df640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x7f5034042070 2024-09-13T23:05:35.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.781+0000 7f50404e1640 1 -- 172.21.15.164:0/3953906428 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f503801f070 con 0x7f5034042070 2024-09-13T23:05:35.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.781+0000 7f50404e1640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x555dc9615730 2024-09-13T23:05:35.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.782+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5030051070 con 0x555dc9615730 2024-09-13T23:05:35.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.782+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x7f5038031040 2024-09-13T23:05:35.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.782+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5030051070 con 0x7f5038031040 2024-09-13T23:05:35.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.782+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x555dc961b870 2024-09-13T23:05:35.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.782+0000 7f503f4df640 1 -- 172.21.15.164:0/3953906428 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f503403f020 con 0x555dc961b870 2024-09-13T23:05:35.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.782+0000 7f503f4df640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x7f5038031040 2024-09-13T23:05:35.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.782+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5030051070 con 0x7f5038031040 2024-09-13T23:05:35.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.782+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x7f5034042070 2024-09-13T23:05:35.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.783+0000 7f50404e1640 1 -- 172.21.15.164:0/3953906428 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f503801f070 con 0x7f5034042070 2024-09-13T23:05:35.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.783+0000 7f50404e1640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x555dc961b870 2024-09-13T23:05:35.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.783+0000 7f503f4df640 1 -- 172.21.15.164:0/3953906428 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f503403f020 con 0x555dc961b870 2024-09-13T23:05:35.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.783+0000 7f503f4df640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x7f5038031040 2024-09-13T23:05:35.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.783+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5030051070 con 0x7f5038031040 2024-09-13T23:05:35.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.783+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x555dc9615730 2024-09-13T23:05:35.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.783+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5030051070 con 0x555dc9615730 2024-09-13T23:05:35.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.783+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e310 con 0x7f5034042070 2024-09-13T23:05:35.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.784+0000 7f50404e1640 1 -- 172.21.15.164:0/3953906428 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f503801f070 con 0x7f5034042070 2024-09-13T23:05:35.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.784+0000 7f5043f24800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:35.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.784+0000 7f5043f24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:35.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.784+0000 7f5043f24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:35.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.784+0000 7f5043f24800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:35.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.784+0000 7f5043f24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:35.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.784+0000 7f5043f24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:35.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.784+0000 7f5043f24800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.784+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555dc961a290 con 0x555dc9615730 2024-09-13T23:05:35.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.784+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5030051070 con 0x555dc9615730 2024-09-13T23:05:35.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.784+0000 7f5043f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.784+0000 7f5043f24800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.784+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555dc961ab30 con 0x555dc9615730 2024-09-13T23:05:35.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.784+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5030051070 con 0x555dc9615730 2024-09-13T23:05:35.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.784+0000 7f5043f24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:35.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.784+0000 7f5043f24800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.784+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555dc9619ed0 con 0x555dc9615730 2024-09-13T23:05:35.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.784+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5030051070 con 0x555dc9615730 2024-09-13T23:05:35.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.784+0000 7f5043f24800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:35.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.784+0000 7f5043f24800 20 zone default found 2024-09-13T23:05:35.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.784+0000 7f5043f24800 4 Realm: () 2024-09-13T23:05:35.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.784+0000 7f5043f24800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:35.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.784+0000 7f5043f24800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:35.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.784+0000 7f5043f24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:35.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.784+0000 7f5043f24800 20 zonegroup default 2024-09-13T23:05:35.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.784+0000 7f5043f24800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.784+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555dc961e770 con 0x7f5038031040 2024-09-13T23:05:35.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.785+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5030051070 con 0x7f5038031040 2024-09-13T23:05:35.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.785+0000 7f5043f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.785+0000 7f5043f24800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.785+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555dc9620600 con 0x555dc961b870 2024-09-13T23:05:35.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.785+0000 7f503f4df640 1 -- 172.21.15.164:0/3953906428 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f503403f020 con 0x555dc961b870 2024-09-13T23:05:35.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.785+0000 7f5043f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.785+0000 7f5043f24800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.785+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555dc96209a0 con 0x555dc961b870 2024-09-13T23:05:35.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.785+0000 7f503f4df640 1 -- 172.21.15.164:0/3953906428 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f503403f020 con 0x555dc961b870 2024-09-13T23:05:35.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.785+0000 7f5043f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.785+0000 7f5043f24800 20 started sync module instance, tier type = 2024-09-13T23:05:35.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.785+0000 7f5043f24800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:35.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.785+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555dc961fa40 con 0x7f5034042070 2024-09-13T23:05:35.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.786+0000 7f50404e1640 1 -- 172.21.15.164:0/3953906428 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5038040040 con 0x7f5034042070 2024-09-13T23:05:35.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.786+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93861298959760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555dc9620d40 con 0x7f5034042070 2024-09-13T23:05:35.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.786+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555dc9621700 con 0x555dc9615730 2024-09-13T23:05:35.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.787+0000 7f50404e1640 1 -- 172.21.15.164:0/3953906428 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93861298959760] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5038040040 con 0x7f5034042070 2024-09-13T23:05:35.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.787+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5030051070 con 0x555dc9615730 2024-09-13T23:05:35.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.787+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93861298962080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555dc9621700 con 0x555dc9615730 2024-09-13T23:05:35.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.787+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555dc9622120 con 0x555dc961b870 2024-09-13T23:05:35.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.788+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93861298962080] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5030051070 con 0x555dc9615730 2024-09-13T23:05:35.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.788+0000 7f503f4df640 1 -- 172.21.15.164:0/3953906428 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f503403f020 con 0x555dc961b870 2024-09-13T23:05:35.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.789+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93861298967120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555dc9621670 con 0x555dc961b870 2024-09-13T23:05:35.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.789+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555dc9622fe0 con 0x7f5034042070 2024-09-13T23:05:35.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.790+0000 7f50404e1640 1 -- 172.21.15.164:0/3953906428 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5038040040 con 0x7f5034042070 2024-09-13T23:05:35.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.790+0000 7f503f4df640 1 -- 172.21.15.164:0/3953906428 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93861298967120] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f503403f020 con 0x555dc961b870 2024-09-13T23:05:35.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.790+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93861298973968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555dc96237e0 con 0x7f5034042070 2024-09-13T23:05:35.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.790+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555dc9622550 con 0x555dc9615730 2024-09-13T23:05:35.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.791+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5030051070 con 0x555dc9615730 2024-09-13T23:05:35.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.791+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93861298978256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555dc9622510 con 0x555dc9615730 2024-09-13T23:05:35.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.791+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555dc9624d60 con 0x7f5038031040 2024-09-13T23:05:35.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.791+0000 7f50404e1640 1 -- 172.21.15.164:0/3953906428 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93861298973968] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5038040040 con 0x7f5034042070 2024-09-13T23:05:35.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.792+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5030051070 con 0x7f5038031040 2024-09-13T23:05:35.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.792+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93861298980976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555dc9624d60 con 0x7f5038031040 2024-09-13T23:05:35.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.792+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555dc96257a0 con 0x7f5038031040 2024-09-13T23:05:35.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.792+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93861298978256] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5030051070 con 0x555dc9615730 2024-09-13T23:05:35.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.793+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93861298980976] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5030051070 con 0x7f5038031040 2024-09-13T23:05:35.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.793+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5030051070 con 0x7f5038031040 2024-09-13T23:05:35.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.793+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93861298975280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555dc96252f0 con 0x7f5038031040 2024-09-13T23:05:35.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.793+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555dc9625cb0 con 0x7f5038031040 2024-09-13T23:05:35.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.794+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93861298975280] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5030051070 con 0x7f5038031040 2024-09-13T23:05:35.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.794+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5030051070 con 0x7f5038031040 2024-09-13T23:05:35.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.794+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93861298979312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555dc9625cb0 con 0x7f5038031040 2024-09-13T23:05:35.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.794+0000 7f5043f24800 20 add_watcher() i=0 2024-09-13T23:05:35.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.794+0000 7f5043f24800 20 add_watcher() i=1 2024-09-13T23:05:35.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.794+0000 7f5043f24800 20 add_watcher() i=2 2024-09-13T23:05:35.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.794+0000 7f5043f24800 20 add_watcher() i=3 2024-09-13T23:05:35.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.794+0000 7f5043f24800 20 add_watcher() i=4 2024-09-13T23:05:35.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.794+0000 7f5043f24800 20 add_watcher() i=5 2024-09-13T23:05:35.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.794+0000 7f5043f24800 20 add_watcher() i=6 2024-09-13T23:05:35.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.795+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93861298979312] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5030051070 con 0x7f5038031040 2024-09-13T23:05:35.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.795+0000 7f5043f24800 20 add_watcher() i=7 2024-09-13T23:05:35.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.795+0000 7f5043f24800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:35.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.795+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555dc9628f90 con 0x555dc9615730 2024-09-13T23:05:35.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.795+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5030051070 con 0x555dc9615730 2024-09-13T23:05:35.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.795+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93861298985328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555dc9626240 con 0x555dc9615730 2024-09-13T23:05:35.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.796+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93861298985328] v32'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5030051070 con 0x555dc9615730 2024-09-13T23:05:35.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.796+0000 7f4ef5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:35.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.796+0000 7f5043f24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:35.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.796+0000 7f5043f24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:35.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.796+0000 7f5043f24800 5 note: GC not initialized 2024-09-13T23:05:35.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.796+0000 7f4ef4fe1640 20 reqs_thread_entry: start 2024-09-13T23:05:35.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.796+0000 7f5043f24800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:35.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.797+0000 7f5043f24800 20 Filter name: none 2024-09-13T23:05:35.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.797+0000 7f4e6e7fc640 20 reqs_thread_entry: start 2024-09-13T23:05:35.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.797+0000 7f5043f24800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.797+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555dc965bed0 con 0x7f5034042070 2024-09-13T23:05:35.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.797+0000 7f50404e1640 1 -- 172.21.15.164:0/3953906428 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f5038040040 con 0x7f5034042070 2024-09-13T23:05:35.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.797+0000 7f5043f24800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:05:35.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.798+0000 7f4ef5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:35.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.798+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93861298985328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555dc9659d30 con 0x555dc9615730 2024-09-13T23:05:35.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.799+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93861298985328] v32'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5030051070 con 0x555dc9615730 2024-09-13T23:05:35.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.799+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93861298959760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555dc9659d30 con 0x7f5034042070 2024-09-13T23:05:35.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.800+0000 7f50404e1640 1 -- 172.21.15.164:0/3953906428 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93861298959760] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5038040040 con 0x7f5034042070 2024-09-13T23:05:35.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.800+0000 7f5043f24800 20 remove_watcher() i=0 2024-09-13T23:05:35.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.800+0000 7f5043f24800 2 removed watcher, disabling cache 2024-09-13T23:05:35.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.800+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93861298962080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555dc9659d30 con 0x555dc9615730 2024-09-13T23:05:35.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.801+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93861298962080] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5030051070 con 0x555dc9615730 2024-09-13T23:05:35.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.801+0000 7f5043f24800 20 remove_watcher() i=1 2024-09-13T23:05:35.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.802+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93861298967120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555dc9659d30 con 0x555dc961b870 2024-09-13T23:05:35.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.802+0000 7f503f4df640 1 -- 172.21.15.164:0/3953906428 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93861298967120] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f503403f020 con 0x555dc961b870 2024-09-13T23:05:35.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.802+0000 7f5043f24800 20 remove_watcher() i=2 2024-09-13T23:05:35.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.802+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93861298973968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555dc961f590 con 0x7f5034042070 2024-09-13T23:05:35.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.803+0000 7f50404e1640 1 -- 172.21.15.164:0/3953906428 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93861298973968] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5038040040 con 0x7f5034042070 2024-09-13T23:05:35.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.803+0000 7f5043f24800 20 remove_watcher() i=3 2024-09-13T23:05:35.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.803+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93861298978256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555dc9621250 con 0x555dc9615730 2024-09-13T23:05:35.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.804+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93861298978256] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5030051070 con 0x555dc9615730 2024-09-13T23:05:35.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.804+0000 7f5043f24800 20 remove_watcher() i=4 2024-09-13T23:05:35.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.804+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93861298980976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555dc961f590 con 0x7f5038031040 2024-09-13T23:05:35.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.805+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93861298980976] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5030051070 con 0x7f5038031040 2024-09-13T23:05:35.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.805+0000 7f5043f24800 20 remove_watcher() i=5 2024-09-13T23:05:35.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.805+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93861298975280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555dc9623dd0 con 0x7f5038031040 2024-09-13T23:05:35.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.806+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93861298975280] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5030051070 con 0x7f5038031040 2024-09-13T23:05:35.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.806+0000 7f5043f24800 20 remove_watcher() i=6 2024-09-13T23:05:35.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.806+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93861298979312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555dc9621250 con 0x7f5038031040 2024-09-13T23:05:35.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.807+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93861298979312] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5030051070 con 0x7f5038031040 2024-09-13T23:05:35.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.807+0000 7f5043f24800 20 remove_watcher() i=7 2024-09-13T23:05:35.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.807+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f5038031040 msgr2=0x7f5038032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.807+0000 7f5043f24800 1 --2- 172.21.15.164:0/3953906428 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f5038031040 0x7f5038032430 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.807+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x555dc9615730 msgr2=0x555dc9617bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.807+0000 7f5043f24800 1 --2- 172.21.15.164:0/3953906428 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x555dc9615730 0x555dc9617bf0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.807+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f5034042070 msgr2=0x7f503402f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.807+0000 7f5043f24800 1 --2- 172.21.15.164:0/3953906428 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f5034042070 0x7f503402f430 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.807+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x555dc961b870 msgr2=0x555dc961dc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.807+0000 7f5043f24800 1 --2- 172.21.15.164:0/3953906428 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x555dc961b870 0x555dc961dc60 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.808+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4f08036b90 msgr2=0x7f4f08039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.808+0000 7f5043f24800 1 --2- 172.21.15.164:0/3953906428 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4f08036b90 0x7f4f08039050 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x555dc95e27c0 tx=0x7f503801f000 comp rx=0 tx=0).stop 2024-09-13T23:05:35.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.808+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc96029c0 msgr2=0x555dc9609e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.808+0000 7f5043f24800 1 --2- 172.21.15.164:0/3953906428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc96029c0 0x555dc9609e70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5034019d20 tx=0x7f503404d090 comp rx=0 tx=0).stop 2024-09-13T23:05:35.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.808+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 reap_dead start 2024-09-13T23:05:35.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.808+0000 7f503fce0640 1 -- 172.21.15.164:0/3953906428 reap_dead start 2024-09-13T23:05:35.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.808+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 shutdown_connections 2024-09-13T23:05:35.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.808+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 >> 172.21.15.164:0/3953906428 conn(0x555dc95fed20 msgr2=0x555dc95fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.808+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 shutdown_connections 2024-09-13T23:05:35.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.808+0000 7f5043f24800 1 -- 172.21.15.164:0/3953906428 wait complete. 2024-09-13T23:05:35.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.808+0000 7f5043f24800 1 -- 172.21.15.164:0/4052391940 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4f18036b90 msgr2=0x7f4f18039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.808+0000 7f5043f24800 1 --2- 172.21.15.164:0/4052391940 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4f18036b90 0x7f4f18039050 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x555dc95e63f0 tx=0x7f5038005840 comp rx=0 tx=0).stop 2024-09-13T23:05:35.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.808+0000 7f5043f24800 1 -- 172.21.15.164:0/4052391940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc95f5cb0 msgr2=0x555dc95f60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.808+0000 7f5043f24800 1 --2- 172.21.15.164:0/4052391940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc95f5cb0 0x555dc95f60d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5034001ed0 tx=0x7f503400d7a0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.808+0000 7f5043f24800 1 -- 172.21.15.164:0/4052391940 shutdown_connections 2024-09-13T23:05:35.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.808+0000 7f5043f24800 1 --2- 172.21.15.164:0/4052391940 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4f18036b90 0x7f4f18039050 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.808+0000 7f5043f24800 1 --2- 172.21.15.164:0/4052391940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc95f5cb0 0x555dc95f60d0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.808+0000 7f5043f24800 1 -- 172.21.15.164:0/4052391940 >> 172.21.15.164:0/4052391940 conn(0x555dc95eac40 msgr2=0x555dc95ed7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.808+0000 7f5043f24800 1 -- 172.21.15.164:0/4052391940 shutdown_connections 2024-09-13T23:05:35.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.808+0000 7f5043f24800 1 -- 172.21.15.164:0/4052391940 wait complete. 2024-09-13T23:05:35.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.808+0000 7f5043f24800 1 -- 172.21.15.164:0/329887619 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x555dc94ea7b0 msgr2=0x555dc95e52a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.808+0000 7f5043f24800 1 --2- 172.21.15.164:0/329887619 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x555dc94ea7b0 0x555dc95e52a0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.809+0000 7f5043f24800 1 -- 172.21.15.164:0/329887619 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4f28036b90 msgr2=0x7f4f28039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.809+0000 7f5043f24800 1 --2- 172.21.15.164:0/329887619 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4f28036b90 0x7f4f28039050 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5034000f60 tx=0x7f50340012b0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.809+0000 7f5043f24800 1 -- 172.21.15.164:0/329887619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc945b610 msgr2=0x555dc95de230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.809+0000 7f5043f24800 1 --2- 172.21.15.164:0/329887619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc945b610 0x555dc95de230 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x555dc95d7710 tx=0x7f5030002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.809+0000 7f5043f24800 1 -- 172.21.15.164:0/329887619 shutdown_connections 2024-09-13T23:05:35.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.809+0000 7f5043f24800 1 --2- 172.21.15.164:0/329887619 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x555dc94ea7b0 0x555dc95e52a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.809+0000 7f5043f24800 1 --2- 172.21.15.164:0/329887619 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4f28036b90 0x7f4f28039050 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.809+0000 7f5043f24800 1 --2- 172.21.15.164:0/329887619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555dc945b610 0x555dc95de230 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.809+0000 7f5043f24800 1 -- 172.21.15.164:0/329887619 >> 172.21.15.164:0/329887619 conn(0x555dc94e1de0 msgr2=0x555dc95d0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.809+0000 7f5043f24800 1 -- 172.21.15.164:0/329887619 shutdown_connections 2024-09-13T23:05:35.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.809+0000 7f5043f24800 1 -- 172.21.15.164:0/329887619 wait complete. 2024-09-13T23:05:35.822 INFO:teuthology.orchestra.run.smithi164.stdout:{"key":"bucket:myfoo","ver":{"tag":"_oaedshqjgxYcenkJFs0wcff","ver":2},"mtime":"2024-09-13T23:05:35.520357Z","data":{"bucket":{"name":"myfoo","marker":"a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1","bucket_id":"a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-09-13T23:05:34.302827Z","linked":false,"has_bucket_info":false}} 2024-09-13T23:05:35.823 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_oaedshqjgxYcenkJFs0wcff', 'ver': 2}, 'mtime': '2024-09-13T23:05:35.520357Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1', 'bucket_id': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-13T23:05:34.302827Z', 'linked': False, 'has_bucket_info': False}} 2024-09-13T23:05:35.823 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1'] 2024-09-13T23:05:35.823 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1'] 2024-09-13T23:05:35.823 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 2024-09-13T23:05:35.912 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:35.912 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:35.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.911+0000 7f4280f0c800 1 Processor -- start 2024-09-13T23:05:35.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.911+0000 7f4280f0c800 1 -- start start 2024-09-13T23:05:35.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.911+0000 7f4280f0c800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55e40c688e30 0x55e40c7181e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.911+0000 7f4280f0c800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e40c5d4b30 con 0x55e40c718720 2024-09-13T23:05:35.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.911+0000 7f4280f0c800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55e40c5b6360 con 0x55e40c688e30 2024-09-13T23:05:35.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.912+0000 7f42761ff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55e40c718720 0x55e40c71ab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:40988/0 (socket says 172.21.15.164:40988) 2024-09-13T23:05:35.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.912+0000 7f427ea00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55e40c688e30 0x55e40c7181e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.912+0000 7f42761ff640 1 -- 172.21.15.164:0/1043581329 learned_addr learned my addr 172.21.15.164:0/1043581329 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:35.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.912+0000 7f427ea00640 1 -- 172.21.15.164:0/1043581329 >> v1:172.21.15.17:6789/0 conn(0x55e40c718720 legacy=0x55e40c71ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.912+0000 7f427ea00640 1 -- 172.21.15.164:0/1043581329 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e40c5dce00 con 0x55e40c688e30 2024-09-13T23:05:35.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.914+0000 7f427ea00640 1 --2- 172.21.15.164:0/1043581329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c688e30 0x55e40c7181e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f427000a470 tx=0x7f4270045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1eb3572aa59bde0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.914+0000 7f427e1ff640 1 -- 172.21.15.164:0/1043581329 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4270053570 con 0x55e40c688e30 2024-09-13T23:05:35.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.914+0000 7f427e1ff640 1 -- 172.21.15.164:0/1043581329 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4270058070 con 0x55e40c688e30 2024-09-13T23:05:35.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.914+0000 7f427e1ff640 1 -- 172.21.15.164:0/1043581329 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4270053880 con 0x55e40c688e30 2024-09-13T23:05:35.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.914+0000 7f4280f0c800 1 -- 172.21.15.164:0/1043581329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c688e30 msgr2=0x55e40c7181e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.914+0000 7f4280f0c800 1 --2- 172.21.15.164:0/1043581329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c688e30 0x55e40c7181e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f427000a470 tx=0x7f4270045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:35.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.914+0000 7f4280f0c800 1 -- 172.21.15.164:0/1043581329 shutdown_connections 2024-09-13T23:05:35.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.914+0000 7f4280f0c800 1 --2- 172.21.15.164:0/1043581329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c688e30 0x55e40c7181e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.914+0000 7f4280f0c800 1 -- 172.21.15.164:0/1043581329 >> 172.21.15.164:0/1043581329 conn(0x55e40c70fe10 msgr2=0x55e40c712230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.914+0000 7f4280f0c800 1 -- 172.21.15.164:0/1043581329 shutdown_connections 2024-09-13T23:05:35.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.915+0000 7f4280f0c800 1 -- 172.21.15.164:0/1043581329 wait complete. 2024-09-13T23:05:35.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.928+0000 7f4280f0c800 1 Processor -- start 2024-09-13T23:05:35.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.929+0000 7f4280f0c800 1 -- start start 2024-09-13T23:05:35.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.929+0000 7f4280f0c800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c688e30 0x55e40c804930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.929+0000 7f4280f0c800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e40c661350 con 0x55e40c688e30 2024-09-13T23:05:35.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.929+0000 7f427ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c688e30 0x55e40c804930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.929+0000 7f427ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c688e30 0x55e40c804930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57836/0 (socket says 172.21.15.164:57836) 2024-09-13T23:05:35.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.929+0000 7f427ea00640 1 -- 172.21.15.164:0/3918202741 learned_addr learned my addr 172.21.15.164:0/3918202741 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.929+0000 7f427ea00640 1 -- 172.21.15.164:0/3918202741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e40c5aebc0 con 0x55e40c688e30 2024-09-13T23:05:35.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.929+0000 7f427ea00640 1 --2- 172.21.15.164:0/3918202741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c688e30 0x55e40c804930 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4270025c20 tx=0x7f4270051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e583cd074a079695 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.930+0000 7f416ce09640 1 -- 172.21.15.164:0/3918202741 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f427005c580 con 0x55e40c688e30 2024-09-13T23:05:35.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.930+0000 7f416ce09640 1 -- 172.21.15.164:0/3918202741 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4270063030 con 0x55e40c688e30 2024-09-13T23:05:35.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.930+0000 7f416ce09640 1 -- 172.21.15.164:0/3918202741 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f427005c850 con 0x55e40c688e30 2024-09-13T23:05:35.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.930+0000 7f4280f0c800 1 -- 172.21.15.164:0/3918202741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c688e30 msgr2=0x55e40c804930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.930+0000 7f4280f0c800 1 --2- 172.21.15.164:0/3918202741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c688e30 0x55e40c804930 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4270025c20 tx=0x7f4270051000 comp rx=0 tx=0).stop 2024-09-13T23:05:35.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.930+0000 7f4280f0c800 1 -- 172.21.15.164:0/3918202741 shutdown_connections 2024-09-13T23:05:35.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.930+0000 7f4280f0c800 1 --2- 172.21.15.164:0/3918202741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c688e30 0x55e40c804930 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.930+0000 7f4280f0c800 1 -- 172.21.15.164:0/3918202741 >> 172.21.15.164:0/3918202741 conn(0x55e40c70fe10 msgr2=0x55e40c8002f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.930+0000 7f4280f0c800 1 -- 172.21.15.164:0/3918202741 shutdown_connections 2024-09-13T23:05:35.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.930+0000 7f4280f0c800 1 -- 172.21.15.164:0/3918202741 wait complete. 2024-09-13T23:05:35.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.931+0000 7f4280f0c800 1 Processor -- start 2024-09-13T23:05:35.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.931+0000 7f4280f0c800 1 -- start start 2024-09-13T23:05:35.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.931+0000 7f4280f0c800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c688e30 0x55e40c715b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.931+0000 7f4280f0c800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e40c71c620 con 0x55e40c688e30 2024-09-13T23:05:35.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.931+0000 7f427ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c688e30 0x55e40c715b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.931+0000 7f427ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c688e30 0x55e40c715b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57840/0 (socket says 172.21.15.164:57840) 2024-09-13T23:05:35.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.931+0000 7f427ea00640 1 -- 172.21.15.164:0/487712403 learned_addr learned my addr 172.21.15.164:0/487712403 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.931+0000 7f427ea00640 1 -- 172.21.15.164:0/487712403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e40c5c2fe0 con 0x55e40c688e30 2024-09-13T23:05:35.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.931+0000 7f427ea00640 1 --2- 172.21.15.164:0/487712403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c688e30 0x55e40c715b10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x55e40c805790 tx=0x7f4270002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.932+0000 7f416b606640 1 -- 172.21.15.164:0/487712403 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4270054ad0 con 0x55e40c688e30 2024-09-13T23:05:35.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.932+0000 7f416b606640 1 -- 172.21.15.164:0/487712403 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4270054c70 con 0x55e40c688e30 2024-09-13T23:05:35.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.932+0000 7f416b606640 1 -- 172.21.15.164:0/487712403 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4270068420 con 0x55e40c688e30 2024-09-13T23:05:35.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.932+0000 7f4280f0c800 1 -- 172.21.15.164:0/487712403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e40c714200 con 0x55e40c688e30 2024-09-13T23:05:35.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.932+0000 7f4280f0c800 1 -- 172.21.15.164:0/487712403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e40c714720 con 0x55e40c688e30 2024-09-13T23:05:35.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.932+0000 7f416b606640 1 -- 172.21.15.164:0/487712403 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f42700685c0 con 0x55e40c688e30 2024-09-13T23:05:35.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.933+0000 7f416b606640 1 --2- 172.21.15.164:0/487712403 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4164036b40 0x7f4164039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.933+0000 7f416b606640 1 -- 172.21.15.164:0/487712403 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4270070030 con 0x55e40c688e30 2024-09-13T23:05:35.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.933+0000 7f42761ff640 1 --2- 172.21.15.164:0/487712403 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4164036b40 0x7f4164039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.933+0000 7f4280f0c800 1 --2- 172.21.15.164:0/487712403 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e40c718720 0x55e40c815680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.933+0000 7f4280f0c800 1 -- 172.21.15.164:0/487712403 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e40c815bc0 con 0x55e40c718720 2024-09-13T23:05:35.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.933+0000 7f427f201640 1 --2- 172.21.15.164:0/487712403 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e40c718720 0x55e40c815680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.933+0000 7f42761ff640 1 --2- 172.21.15.164:0/487712403 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4164036b40 0x7f4164039000 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4268000f60 tx=0x7f42680012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.933+0000 7f427f201640 1 --2- 172.21.15.164:0/487712403 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e40c718720 0x55e40c815680 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.933+0000 7f427f201640 1 -- 172.21.15.164:0/487712403 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f427800a4a0 con 0x55e40c718720 2024-09-13T23:05:35.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.933+0000 7f4280f0c800 1 -- 172.21.15.164:0/487712403 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e40c816410 con 0x55e40c718720 2024-09-13T23:05:35.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.934+0000 7f427f201640 1 -- 172.21.15.164:0/487712403 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f427800a4a0 con 0x55e40c718720 2024-09-13T23:05:35.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.934+0000 7f4280f0c800 1 -- 172.21.15.164:0/487712403 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e40c8177c0 con 0x55e40c718720 2024-09-13T23:05:35.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.934+0000 7f427f201640 1 -- 172.21.15.164:0/487712403 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f427800a4a0 con 0x55e40c718720 2024-09-13T23:05:35.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.934+0000 7f4280f0c800 1 -- 172.21.15.164:0/487712403 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e40c816c60 con 0x55e40c718720 2024-09-13T23:05:35.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.934+0000 7f427f201640 1 -- 172.21.15.164:0/487712403 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f427800a4a0 con 0x55e40c718720 2024-09-13T23:05:35.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.934+0000 7f4280f0c800 1 -- 172.21.15.164:0/487712403 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e40c8170b0 con 0x55e40c718720 2024-09-13T23:05:35.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.935+0000 7f427f201640 1 -- 172.21.15.164:0/487712403 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f427800a4a0 con 0x55e40c718720 2024-09-13T23:05:35.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.935+0000 7f4280f0c800 1 Processor -- start 2024-09-13T23:05:35.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.935+0000 7f4280f0c800 1 -- start start 2024-09-13T23:05:35.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.935+0000 7f4280f0c800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c826050 0x55e40c826470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.935+0000 7f4280f0c800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e40c716050 con 0x55e40c826050 2024-09-13T23:05:35.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.935+0000 7f42761ff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c826050 0x55e40c826470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.935+0000 7f42761ff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c826050 0x55e40c826470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57852/0 (socket says 172.21.15.164:57852) 2024-09-13T23:05:35.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.935+0000 7f42761ff640 1 -- 172.21.15.164:0/3498900015 learned_addr learned my addr 172.21.15.164:0/3498900015 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.936+0000 7f42761ff640 1 -- 172.21.15.164:0/3498900015 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e40c8269b0 con 0x55e40c826050 2024-09-13T23:05:35.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.936+0000 7f42761ff640 1 --2- 172.21.15.164:0/3498900015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c826050 0x55e40c826470 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4268001ed0 tx=0x7f426800d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.936+0000 7f4168e01640 1 -- 172.21.15.164:0/3498900015 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f426801b550 con 0x55e40c826050 2024-09-13T23:05:35.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.936+0000 7f4168e01640 1 -- 172.21.15.164:0/3498900015 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f426801b6f0 con 0x55e40c826050 2024-09-13T23:05:35.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.936+0000 7f4280f0c800 1 -- 172.21.15.164:0/3498900015 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e40c826c40 con 0x55e40c826050 2024-09-13T23:05:35.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.936+0000 7f4168e01640 1 -- 172.21.15.164:0/3498900015 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f426801b9d0 con 0x55e40c826050 2024-09-13T23:05:35.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.936+0000 7f4280f0c800 1 -- 172.21.15.164:0/3498900015 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e40c829920 con 0x55e40c826050 2024-09-13T23:05:35.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.937+0000 7f4168e01640 1 -- 172.21.15.164:0/3498900015 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4268023020 con 0x55e40c826050 2024-09-13T23:05:35.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.937+0000 7f4168e01640 1 --2- 172.21.15.164:0/3498900015 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4158036b90 0x7f4158039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.937+0000 7f4168e01640 1 -- 172.21.15.164:0/3498900015 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4268021020 con 0x55e40c826050 2024-09-13T23:05:35.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.937+0000 7f427f201640 1 --2- 172.21.15.164:0/3498900015 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4158036b90 0x7f4158039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.937+0000 7f4280f0c800 1 Processor -- start 2024-09-13T23:05:35.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.937+0000 7f4280f0c800 1 -- start start 2024-09-13T23:05:35.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.937+0000 7f427f201640 1 --2- 172.21.15.164:0/3498900015 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4158036b90 0x7f4158039050 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x55e40c8162f0 tx=0x7f4278005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.938+0000 7f4280f0c800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c832d10 0x55e40c833110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.938+0000 7f4280f0c800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e40c5b0580 con 0x55e40c832d10 2024-09-13T23:05:35.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.938+0000 7f42761ff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c832d10 0x55e40c833110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.938+0000 7f42761ff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c832d10 0x55e40c833110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57864/0 (socket says 172.21.15.164:57864) 2024-09-13T23:05:35.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.938+0000 7f42761ff640 1 -- 172.21.15.164:0/1778549747 learned_addr learned my addr 172.21.15.164:0/1778549747 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.938+0000 7f42761ff640 1 -- 172.21.15.164:0/1778549747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e40c8336e0 con 0x55e40c832d10 2024-09-13T23:05:35.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.938+0000 7f42761ff640 1 --2- 172.21.15.164:0/1778549747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c832d10 0x55e40c833110 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f426804d100 tx=0x7f4268019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ad6b0b83eb2c01 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.938+0000 7f41627fc640 1 -- 172.21.15.164:0/1778549747 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42680258e0 con 0x55e40c832d10 2024-09-13T23:05:35.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.938+0000 7f41627fc640 1 -- 172.21.15.164:0/1778549747 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4268025410 con 0x55e40c832d10 2024-09-13T23:05:35.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.938+0000 7f41627fc640 1 -- 172.21.15.164:0/1778549747 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4268025a80 con 0x55e40c832d10 2024-09-13T23:05:35.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.939+0000 7f4280f0c800 1 -- 172.21.15.164:0/1778549747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c832d10 msgr2=0x55e40c833110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.939+0000 7f4280f0c800 1 --2- 172.21.15.164:0/1778549747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c832d10 0x55e40c833110 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f426804d100 tx=0x7f4268019ce0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.939+0000 7f4280f0c800 1 -- 172.21.15.164:0/1778549747 shutdown_connections 2024-09-13T23:05:35.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.939+0000 7f4280f0c800 1 --2- 172.21.15.164:0/1778549747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c832d10 0x55e40c833110 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.939+0000 7f4280f0c800 1 -- 172.21.15.164:0/1778549747 >> 172.21.15.164:0/1778549747 conn(0x55e40c82f0c0 msgr2=0x55e40c82d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.939+0000 7f4280f0c800 1 -- 172.21.15.164:0/1778549747 shutdown_connections 2024-09-13T23:05:35.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.939+0000 7f4280f0c800 1 -- 172.21.15.164:0/1778549747 wait complete. 2024-09-13T23:05:35.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.939+0000 7f4280f0c800 1 Processor -- start 2024-09-13T23:05:35.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.939+0000 7f4280f0c800 1 -- start start 2024-09-13T23:05:35.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.939+0000 7f4280f0c800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c832d10 0x55e40c83a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.939+0000 7f4280f0c800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e40c833b70 con 0x55e40c832d10 2024-09-13T23:05:35.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.939+0000 7f42761ff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c832d10 0x55e40c83a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.939+0000 7f42761ff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c832d10 0x55e40c83a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57870/0 (socket says 172.21.15.164:57870) 2024-09-13T23:05:35.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.939+0000 7f42761ff640 1 -- 172.21.15.164:0/2240588499 learned_addr learned my addr 172.21.15.164:0/2240588499 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:35.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.940+0000 7f42761ff640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e40c83a630 con 0x55e40c832d10 2024-09-13T23:05:35.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.940+0000 7f42761ff640 1 --2- 172.21.15.164:0/2240588499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c832d10 0x55e40c83a0f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f426804d1c0 tx=0x7f426804d090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.940+0000 7f4160ff9640 1 -- 172.21.15.164:0/2240588499 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f426800cc60 con 0x55e40c832d10 2024-09-13T23:05:35.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.940+0000 7f4160ff9640 1 -- 172.21.15.164:0/2240588499 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f426800ce00 con 0x55e40c832d10 2024-09-13T23:05:35.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.940+0000 7f4160ff9640 1 -- 172.21.15.164:0/2240588499 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4268040990 con 0x55e40c832d10 2024-09-13T23:05:35.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.940+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e40c83a8c0 con 0x55e40c832d10 2024-09-13T23:05:35.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.940+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e40c83a8c0 con 0x55e40c832d10 2024-09-13T23:05:35.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.941+0000 7f4160ff9640 1 -- 172.21.15.164:0/2240588499 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4268040b30 con 0x55e40c832d10 2024-09-13T23:05:35.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.941+0000 7f4160ff9640 1 --2- 172.21.15.164:0/2240588499 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4148036b90 0x7f4148039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.941+0000 7f4160ff9640 1 -- 172.21.15.164:0/2240588499 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4268035070 con 0x55e40c832d10 2024-09-13T23:05:35.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.941+0000 7f427f201640 1 --2- 172.21.15.164:0/2240588499 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4148036b90 0x7f4148039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.941+0000 7f427f201640 1 --2- 172.21.15.164:0/2240588499 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4148036b90 0x7f4148039050 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55e40c714b40 tx=0x7f427801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.942+0000 7f4280f0c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.942+0000 7f4280f0c800 1 --2- 172.21.15.164:0/2240588499 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e40c845a10 0x55e40c847ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.942+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e40c848620 con 0x55e40c845a10 2024-09-13T23:05:35.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.942+0000 7f427ea00640 1 --2- 172.21.15.164:0/2240588499 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e40c845a10 0x55e40c847ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.942+0000 7f427ea00640 1 --2- 172.21.15.164:0/2240588499 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e40c845a10 0x55e40c847ed0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.942+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4270051070 con 0x55e40c845a10 2024-09-13T23:05:35.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.942+0000 7f4280f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.942+0000 7f4280f0c800 20 realm 2024-09-13T23:05:35.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.942+0000 7f4280f0c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.942+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e40c848a30 con 0x55e40c845a10 2024-09-13T23:05:35.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.943+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4270051070 con 0x55e40c845a10 2024-09-13T23:05:35.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.943+0000 7f4280f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.943+0000 7f4280f0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:35.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.943+0000 7f4280f0c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.943+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e40c849300 con 0x55e40c845a10 2024-09-13T23:05:35.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.943+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4270051070 con 0x55e40c845a10 2024-09-13T23:05:35.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.943+0000 7f4280f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.943+0000 7f4280f0c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.943+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e40c8496a0 con 0x55e40c845a10 2024-09-13T23:05:35.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.943+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4270051070 con 0x55e40c845a10 2024-09-13T23:05:35.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.943+0000 7f4280f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:35.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.943+0000 7f4280f0c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.943+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e40c849ef0 con 0x55e40c845a10 2024-09-13T23:05:35.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.943+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4270051070 con 0x55e40c845a10 2024-09-13T23:05:35.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.943+0000 7f4280f0c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:35.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.943+0000 7f4280f0c800 20 searching for the correct realm 2024-09-13T23:05:35.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.943+0000 7f4280f0c800 1 --2- 172.21.15.164:0/2240588499 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55e40c84bc60 0x55e40c84e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.943+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x55e40c84bc60 2024-09-13T23:05:35.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.944+0000 7f42761ff640 1 --2- 172.21.15.164:0/2240588499 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55e40c84bc60 0x55e40c84e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.944+0000 7f42761ff640 1 --2- 172.21.15.164:0/2240588499 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55e40c84bc60 0x55e40c84e050 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.944+0000 7f42761ff640 1 -- 172.21.15.164:0/2240588499 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f426803f020 con 0x55e40c84bc60 2024-09-13T23:05:35.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.944+0000 7f42761ff640 1 --2- 172.21.15.164:0/2240588499 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f4268033b80 0x7f426804d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.944+0000 7f42761ff640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x7f4268033b80 2024-09-13T23:05:35.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.944+0000 7f427f201640 1 --2- 172.21.15.164:0/2240588499 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f4268033b80 0x7f426804d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.944+0000 7f427f201640 1 --2- 172.21.15.164:0/2240588499 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f4268033b80 0x7f426804d990 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.945+0000 7f427f201640 1 -- 172.21.15.164:0/2240588499 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427801f070 con 0x7f4268033b80 2024-09-13T23:05:35.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.945+0000 7f427f201640 1 --2- 172.21.15.164:0/2240588499 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f4278031040 0x7f4278032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:35.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.945+0000 7f427f201640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x7f4278031040 2024-09-13T23:05:35.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.945+0000 7f427ea00640 1 --2- 172.21.15.164:0/2240588499 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f4278031040 0x7f4278032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:35.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.945+0000 7f427ea00640 1 --2- 172.21.15.164:0/2240588499 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f4278031040 0x7f4278032430 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:35.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.946+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4270051070 con 0x7f4278031040 2024-09-13T23:05:35.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.946+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x55e40c845a10 2024-09-13T23:05:35.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.946+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4270051070 con 0x55e40c845a10 2024-09-13T23:05:35.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.946+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x55e40c845a10 2024-09-13T23:05:35.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.946+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4270051070 con 0x55e40c845a10 2024-09-13T23:05:35.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.946+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x7f4278031040 2024-09-13T23:05:35.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.946+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4270051070 con 0x7f4278031040 2024-09-13T23:05:35.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.946+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x7f4278031040 2024-09-13T23:05:35.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.947+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4270051070 con 0x7f4278031040 2024-09-13T23:05:35.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.947+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x7f4268033b80 2024-09-13T23:05:35.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.947+0000 7f427f201640 1 -- 172.21.15.164:0/2240588499 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427801f070 con 0x7f4268033b80 2024-09-13T23:05:35.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.947+0000 7f427f201640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x55e40c84bc60 2024-09-13T23:05:35.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.947+0000 7f42761ff640 1 -- 172.21.15.164:0/2240588499 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f426805d040 con 0x55e40c84bc60 2024-09-13T23:05:35.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.947+0000 7f42761ff640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x55e40c845a10 2024-09-13T23:05:35.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.947+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4270051070 con 0x55e40c845a10 2024-09-13T23:05:35.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.947+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x7f4278031040 2024-09-13T23:05:35.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.948+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4270051070 con 0x7f4278031040 2024-09-13T23:05:35.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.948+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x55e40c845a10 2024-09-13T23:05:35.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.948+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4270051070 con 0x55e40c845a10 2024-09-13T23:05:35.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.948+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x7f4268033b80 2024-09-13T23:05:35.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.948+0000 7f427f201640 1 -- 172.21.15.164:0/2240588499 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f427801f070 con 0x7f4268033b80 2024-09-13T23:05:35.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.948+0000 7f427f201640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x55e40c84bc60 2024-09-13T23:05:35.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.948+0000 7f42761ff640 1 -- 172.21.15.164:0/2240588499 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f426805d040 con 0x55e40c84bc60 2024-09-13T23:05:35.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.948+0000 7f42761ff640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x55e40c84bc60 2024-09-13T23:05:35.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.949+0000 7f42761ff640 1 -- 172.21.15.164:0/2240588499 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f426805d040 con 0x55e40c84bc60 2024-09-13T23:05:35.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.949+0000 7f42761ff640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x7f4278031040 2024-09-13T23:05:35.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.949+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4270051070 con 0x7f4278031040 2024-09-13T23:05:35.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.949+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x55e40c84bc60 2024-09-13T23:05:35.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.949+0000 7f42761ff640 1 -- 172.21.15.164:0/2240588499 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f426805d040 con 0x55e40c84bc60 2024-09-13T23:05:35.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.949+0000 7f42761ff640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x55e40c84bc60 2024-09-13T23:05:35.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.949+0000 7f42761ff640 1 -- 172.21.15.164:0/2240588499 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f426805d040 con 0x55e40c84bc60 2024-09-13T23:05:35.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.949+0000 7f42761ff640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x55e40c845a10 2024-09-13T23:05:35.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.950+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4270051070 con 0x55e40c845a10 2024-09-13T23:05:35.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.950+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x55e40c845a10 2024-09-13T23:05:35.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.950+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4270051070 con 0x55e40c845a10 2024-09-13T23:05:35.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.950+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x7f4278031040 2024-09-13T23:05:35.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.950+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4270051070 con 0x7f4278031040 2024-09-13T23:05:35.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.950+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x55e40c84bc60 2024-09-13T23:05:35.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.950+0000 7f42761ff640 1 -- 172.21.15.164:0/2240588499 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f426805d040 con 0x55e40c84bc60 2024-09-13T23:05:35.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.950+0000 7f42761ff640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x7f4268033b80 2024-09-13T23:05:35.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.951+0000 7f427f201640 1 -- 172.21.15.164:0/2240588499 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427801f070 con 0x7f4268033b80 2024-09-13T23:05:35.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.951+0000 7f427f201640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x55e40c845a10 2024-09-13T23:05:35.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.951+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4270051070 con 0x55e40c845a10 2024-09-13T23:05:35.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.951+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x7f4278031040 2024-09-13T23:05:35.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.951+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4270051070 con 0x7f4278031040 2024-09-13T23:05:35.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.951+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x55e40c84bc60 2024-09-13T23:05:35.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.951+0000 7f42761ff640 1 -- 172.21.15.164:0/2240588499 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f426805d040 con 0x55e40c84bc60 2024-09-13T23:05:35.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.951+0000 7f42761ff640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x7f4278031040 2024-09-13T23:05:35.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.952+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4270051070 con 0x7f4278031040 2024-09-13T23:05:35.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.952+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x7f4268033b80 2024-09-13T23:05:35.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.952+0000 7f427f201640 1 -- 172.21.15.164:0/2240588499 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427801f070 con 0x7f4268033b80 2024-09-13T23:05:35.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.952+0000 7f427f201640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x55e40c84bc60 2024-09-13T23:05:35.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.952+0000 7f42761ff640 1 -- 172.21.15.164:0/2240588499 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f426805d040 con 0x55e40c84bc60 2024-09-13T23:05:35.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.952+0000 7f42761ff640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x7f4278031040 2024-09-13T23:05:35.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.952+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4270051070 con 0x7f4278031040 2024-09-13T23:05:35.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.952+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x55e40c845a10 2024-09-13T23:05:35.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.953+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4270051070 con 0x55e40c845a10 2024-09-13T23:05:35.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.953+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84e630 con 0x7f4268033b80 2024-09-13T23:05:35.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.953+0000 7f427f201640 1 -- 172.21.15.164:0/2240588499 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f427801f070 con 0x7f4268033b80 2024-09-13T23:05:35.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.953+0000 7f4280f0c800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:35.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.953+0000 7f4280f0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:35.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.953+0000 7f4280f0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:35.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.953+0000 7f4280f0c800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:35.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.953+0000 7f4280f0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:35.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.953+0000 7f4280f0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:35.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.953+0000 7f4280f0c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.953+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84a8a0 con 0x55e40c845a10 2024-09-13T23:05:35.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.953+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4270051070 con 0x55e40c845a10 2024-09-13T23:05:35.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.953+0000 7f4280f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.953+0000 7f4280f0c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.953+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84b140 con 0x55e40c845a10 2024-09-13T23:05:35.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.953+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4270051070 con 0x55e40c845a10 2024-09-13T23:05:35.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.953+0000 7f4280f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:35.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.953+0000 7f4280f0c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.953+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84b140 con 0x55e40c845a10 2024-09-13T23:05:35.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.954+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4270051070 con 0x55e40c845a10 2024-09-13T23:05:35.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.954+0000 7f4280f0c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:35.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.954+0000 7f4280f0c800 20 zone default found 2024-09-13T23:05:35.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.954+0000 7f4280f0c800 4 Realm: () 2024-09-13T23:05:35.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.954+0000 7f4280f0c800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:35.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.954+0000 7f4280f0c800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:35.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.954+0000 7f4280f0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:35.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.954+0000 7f4280f0c800 20 zonegroup default 2024-09-13T23:05:35.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.954+0000 7f4280f0c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.954+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84eab0 con 0x7f4278031040 2024-09-13T23:05:35.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.954+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4270051070 con 0x7f4278031040 2024-09-13T23:05:35.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.954+0000 7f4280f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.954+0000 7f4280f0c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.954+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e40c850520 con 0x55e40c84bc60 2024-09-13T23:05:35.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.954+0000 7f42761ff640 1 -- 172.21.15.164:0/2240588499 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f426805d040 con 0x55e40c84bc60 2024-09-13T23:05:35.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.954+0000 7f4280f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.954+0000 7f4280f0c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.954+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e40c8509f0 con 0x55e40c84bc60 2024-09-13T23:05:35.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.955+0000 7f42761ff640 1 -- 172.21.15.164:0/2240588499 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f426805d040 con 0x55e40c84bc60 2024-09-13T23:05:35.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.955+0000 7f4280f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:35.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.955+0000 7f4280f0c800 20 started sync module instance, tier type = 2024-09-13T23:05:35.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.955+0000 7f4280f0c800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:35.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.955+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c84f930 con 0x7f4268033b80 2024-09-13T23:05:35.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.956+0000 7f427f201640 1 -- 172.21.15.164:0/2240588499 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4278040040 con 0x7f4268033b80 2024-09-13T23:05:35.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.956+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94437950946592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c850140 con 0x7f4268033b80 2024-09-13T23:05:35.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.956+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c851830 con 0x55e40c845a10 2024-09-13T23:05:35.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.957+0000 7f427f201640 1 -- 172.21.15.164:0/2240588499 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94437950946592] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4278040040 con 0x7f4268033b80 2024-09-13T23:05:35.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.957+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4270051070 con 0x55e40c845a10 2024-09-13T23:05:35.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.957+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94437950950992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c851c20 con 0x55e40c845a10 2024-09-13T23:05:35.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.957+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c852660 con 0x55e40c84bc60 2024-09-13T23:05:35.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.958+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94437950950992] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4270051070 con 0x55e40c845a10 2024-09-13T23:05:35.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.958+0000 7f42761ff640 1 -- 172.21.15.164:0/2240588499 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f426805d040 con 0x55e40c84bc60 2024-09-13T23:05:35.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.958+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94437950955824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c852a00 con 0x55e40c84bc60 2024-09-13T23:05:35.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.958+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c853420 con 0x7f4268033b80 2024-09-13T23:05:35.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.959+0000 7f42761ff640 1 -- 172.21.15.164:0/2240588499 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94437950955824] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f426805d040 con 0x55e40c84bc60 2024-09-13T23:05:35.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.959+0000 7f427f201640 1 -- 172.21.15.164:0/2240588499 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4278040040 con 0x7f4268033b80 2024-09-13T23:05:35.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.959+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94437950959376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c853840 con 0x7f4268033b80 2024-09-13T23:05:35.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.959+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c854270 con 0x55e40c845a10 2024-09-13T23:05:35.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.960+0000 7f427f201640 1 -- 172.21.15.164:0/2240588499 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94437950959376] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4278040040 con 0x7f4268033b80 2024-09-13T23:05:35.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.960+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4270051070 con 0x55e40c845a10 2024-09-13T23:05:35.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.960+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94437950952048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c854230 con 0x55e40c845a10 2024-09-13T23:05:35.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.960+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c854cf0 con 0x7f4278031040 2024-09-13T23:05:35.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.961+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94437950952048] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4270051070 con 0x55e40c845a10 2024-09-13T23:05:35.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.961+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4270051070 con 0x7f4278031040 2024-09-13T23:05:35.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.961+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94437950965760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c854230 con 0x7f4278031040 2024-09-13T23:05:35.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.961+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c855700 con 0x7f4278031040 2024-09-13T23:05:35.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.962+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94437950965760] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4270051070 con 0x7f4278031040 2024-09-13T23:05:35.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.963+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4270051070 con 0x7f4278031040 2024-09-13T23:05:35.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.963+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94437950963552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c855700 con 0x7f4278031040 2024-09-13T23:05:35.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.963+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c8560c0 con 0x7f4278031040 2024-09-13T23:05:35.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.963+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94437950963552] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4270051070 con 0x7f4278031040 2024-09-13T23:05:35.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.963+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4270051070 con 0x7f4278031040 2024-09-13T23:05:35.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.964+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94437950968880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c8560c0 con 0x7f4278031040 2024-09-13T23:05:35.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.964+0000 7f4280f0c800 20 add_watcher() i=0 2024-09-13T23:05:35.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.964+0000 7f4280f0c800 20 add_watcher() i=1 2024-09-13T23:05:35.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.964+0000 7f4280f0c800 20 add_watcher() i=2 2024-09-13T23:05:35.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.964+0000 7f4280f0c800 20 add_watcher() i=3 2024-09-13T23:05:35.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.964+0000 7f4280f0c800 20 add_watcher() i=4 2024-09-13T23:05:35.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.964+0000 7f4280f0c800 20 add_watcher() i=5 2024-09-13T23:05:35.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.964+0000 7f4280f0c800 20 add_watcher() i=6 2024-09-13T23:05:35.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.964+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94437950968880] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4270051070 con 0x7f4278031040 2024-09-13T23:05:35.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.964+0000 7f4280f0c800 20 add_watcher() i=7 2024-09-13T23:05:35.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.964+0000 7f4280f0c800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:35.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.964+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e40c8594c0 con 0x55e40c845a10 2024-09-13T23:05:35.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.965+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4270051070 con 0x55e40c845a10 2024-09-13T23:05:35.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.965+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94437950971360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c8569e0 con 0x55e40c845a10 2024-09-13T23:05:35.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.966+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94437950971360] v32'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4270051070 con 0x55e40c845a10 2024-09-13T23:05:35.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.966+0000 7f41357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:35.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.966+0000 7f4280f0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:35.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.966+0000 7f4280f0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:35.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.966+0000 7f4280f0c800 5 note: GC not initialized 2024-09-13T23:05:35.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.966+0000 7f40affff640 20 reqs_thread_entry: start 2024-09-13T23:05:35.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.966+0000 7f4280f0c800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:35.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.966+0000 7f4280f0c800 20 Filter name: none 2024-09-13T23:05:35.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.966+0000 7f40adffb640 20 reqs_thread_entry: start 2024-09-13T23:05:35.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.967+0000 7f4280f0c800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T23:05:35.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.967+0000 7f4280f0c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.967+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e40c88c960 con 0x7f4278031040 2024-09-13T23:05:35.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.967+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f4270051070 con 0x7f4278031040 2024-09-13T23:05:35.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.967+0000 7f4280f0c800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T23:05:35.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.967+0000 7f4280f0c800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T23:05:35.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.967+0000 7f4280f0c800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:05:35.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.967+0000 7f4280f0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:35.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.967+0000 7f4280f0c800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:05:35.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.967+0000 7f4280f0c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.967+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e40c88ea40 con 0x7f4268033b80 2024-09-13T23:05:35.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.968+0000 7f427f201640 1 -- 172.21.15.164:0/2240588499 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4278040040 con 0x7f4268033b80 2024-09-13T23:05:35.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.968+0000 7f4280f0c800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:05:35.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.968+0000 7f4280f0c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:05:35.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.968+0000 7f4280f0c800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:05:35.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.968+0000 7f4280f0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 : miss 2024-09-13T23:05:35.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.968+0000 7f4280f0c800 20 rados->read ofs=0 len=0 2024-09-13T23:05:35.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.968+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 8.15 8:aa4f46c1:root::.bucket.meta.myfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e40c8904e0 con 0x55e40c84bc60 2024-09-13T23:05:35.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.968+0000 7f42761ff640 1 -- 172.21.15.164:0/2240588499 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f426805d040 con 0x55e40c84bc60 2024-09-13T23:05:35.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.968+0000 7f4280f0c800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:05:35.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.968+0000 7f4280f0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 info.flags=0x17 2024-09-13T23:05:35.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.968+0000 7f4280f0c800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 to cache LRU end 2024-09-13T23:05:35.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.968+0000 7f4280f0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:35.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.968+0000 7f4280f0c800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:05:35.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.968+0000 7f4280f0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 2024-09-13T23:05:35.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.968+0000 7f4280f0c800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-13T23:05:35.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.968+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c894b40 con 0x7f4268033b80 2024-09-13T23:05:35.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.969+0000 7f427f201640 1 -- 172.21.15.164:0/2240588499 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(65 foo.buckets [call] v32'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4278040040 con 0x7f4268033b80 2024-09-13T23:05:35.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.969+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:66 8.15 8:aa4f46c1:root::.bucket.meta.myfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c89aaa0 con 0x55e40c84bc60 2024-09-13T23:05:35.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.970+0000 7f42761ff640 1 -- 172.21.15.164:0/2240588499 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(66 .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v32'4 uv4 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f426805d040 con 0x55e40c84bc60 2024-09-13T23:05:35.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.970+0000 7f4280f0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 info.flags=0x17 2024-09-13T23:05:35.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.970+0000 7f4280f0c800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 to cache LRU end 2024-09-13T23:05:35.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.970+0000 7f4280f0c800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:05:35.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.970+0000 7f4280f0c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1, ofs0, ns] 2024-09-13T23:05:35.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.970+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94437951208848 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e40c894f70 con 0x7f4278031040 2024-09-13T23:05:35.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.971+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== watch-notify(notify (1) cookie 94437950965760 notify 137438953476 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7f4270083040 con 0x7f4278031040 2024-09-13T23:05:35.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.971+0000 7f41627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94437950965760 notifier 4512 bl.length()=752 2024-09-13T23:05:35.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.971+0000 7f41627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 info.flags=0x17 2024-09-13T23:05:35.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.971+0000 7f41627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 to cache LRU end 2024-09-13T23:05:35.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.971+0000 7f41627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:05:35.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.971+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(67 notify.5 [notify cookie 94437951208848 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4270051070 con 0x7f4278031040 2024-09-13T23:05:35.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.971+0000 7f41627fc640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4144003ea0 con 0x7f4278031040 2024-09-13T23:05:35.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.971+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4270051070 con 0x7f4278031040 2024-09-13T23:05:35.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.971+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== watch-notify(notify_complete (2) cookie 94437951208848 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e40c714720 con 0x7f4278031040 2024-09-13T23:05:35.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.971+0000 7f4280f0c800 20 handle_bi_update(): bucket=:myfoo[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1]): orig_sources= new_sources= 2024-09-13T23:05:35.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.971+0000 7f4280f0c800 20 handle_bi_update(): bucket=:myfoo[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1]): potential sources added=[] removed=[] 2024-09-13T23:05:35.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.971+0000 7f4280f0c800 20 handle_bi_update(): bucket=:myfoo[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1]): orig_dests= new_dests= 2024-09-13T23:05:35.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.971+0000 7f4280f0c800 20 handle_bi_update(): bucket=:myfoo[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1]): potential dests added=[] removed=[] 2024-09-13T23:05:35.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.971+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c88fd90 con 0x7f4278031040 2024-09-13T23:05:35.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.972+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(69 fud.buckets [call] v32'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4270051070 con 0x7f4278031040 2024-09-13T23:05:35.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.972+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c89a270 con 0x7f4268033b80 2024-09-13T23:05:35.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.973+0000 7f427f201640 1 -- 172.21.15.164:0/2240588499 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f4278040040 con 0x7f4268033b80 2024-09-13T23:05:35.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.973+0000 7f4280f0c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T23:05:35.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.973+0000 7f4280f0c800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:05:35.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.973+0000 7f4280f0c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T23:05:35.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.973+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94437951208848 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e40c899710 con 0x7f4278031040 2024-09-13T23:05:35.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.974+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== watch-notify(notify (1) cookie 94437950963552 notify 137438953477 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55e40c714200 con 0x7f4278031040 2024-09-13T23:05:35.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.974+0000 7f41627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94437950963552 notifier 4512 bl.length()=314 2024-09-13T23:05:35.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.974+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(71 notify.6 [notify cookie 94437951208848 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4270051070 con 0x7f4278031040 2024-09-13T23:05:35.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.974+0000 7f41627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T23:05:35.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.974+0000 7f41627fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:05:35.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.974+0000 7f41627fc640 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4144003ea0 con 0x7f4278031040 2024-09-13T23:05:35.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.974+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== watch-notify(notify_complete (2) cookie 94437951208848 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e40c5c2fe0 con 0x7f4278031040 2024-09-13T23:05:35.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.974+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4270051070 con 0x7f4278031040 2024-09-13T23:05:35.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.975+0000 7f41357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:35.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.975+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94437950971360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c88a6d0 con 0x55e40c845a10 2024-09-13T23:05:35.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.976+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94437950971360] v32'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4270051070 con 0x55e40c845a10 2024-09-13T23:05:35.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.976+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94437950946592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c88a6d0 con 0x7f4268033b80 2024-09-13T23:05:35.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.977+0000 7f427f201640 1 -- 172.21.15.164:0/2240588499 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94437950946592] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4278040040 con 0x7f4268033b80 2024-09-13T23:05:35.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.977+0000 7f4280f0c800 20 remove_watcher() i=0 2024-09-13T23:05:35.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.977+0000 7f4280f0c800 2 removed watcher, disabling cache 2024-09-13T23:05:35.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.977+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94437950950992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c88a6d0 con 0x55e40c845a10 2024-09-13T23:05:35.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.978+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94437950950992] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4270051070 con 0x55e40c845a10 2024-09-13T23:05:35.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.978+0000 7f4280f0c800 20 remove_watcher() i=1 2024-09-13T23:05:35.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.978+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94437950955824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c88a6d0 con 0x55e40c84bc60 2024-09-13T23:05:35.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.979+0000 7f42761ff640 1 -- 172.21.15.164:0/2240588499 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94437950955824] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f426805d040 con 0x55e40c84bc60 2024-09-13T23:05:35.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.979+0000 7f4280f0c800 20 remove_watcher() i=2 2024-09-13T23:05:35.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.979+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94437950959376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c88a6d0 con 0x7f4268033b80 2024-09-13T23:05:35.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.980+0000 7f427f201640 1 -- 172.21.15.164:0/2240588499 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94437950959376] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4278040040 con 0x7f4268033b80 2024-09-13T23:05:35.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.980+0000 7f4280f0c800 20 remove_watcher() i=3 2024-09-13T23:05:35.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.980+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94437950952048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c88a6d0 con 0x55e40c845a10 2024-09-13T23:05:35.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.981+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94437950952048] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4270051070 con 0x55e40c845a10 2024-09-13T23:05:35.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.981+0000 7f4280f0c800 20 remove_watcher() i=4 2024-09-13T23:05:35.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.981+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94437950965760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c88a6d0 con 0x7f4278031040 2024-09-13T23:05:35.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.982+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 27 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94437950965760] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4270051070 con 0x7f4278031040 2024-09-13T23:05:35.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.982+0000 7f4280f0c800 20 remove_watcher() i=5 2024-09-13T23:05:35.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.982+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94437950963552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c88a6d0 con 0x7f4278031040 2024-09-13T23:05:35.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.983+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 28 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94437950963552] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4270051070 con 0x7f4278031040 2024-09-13T23:05:35.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.983+0000 7f4280f0c800 20 remove_watcher() i=6 2024-09-13T23:05:35.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.983+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94437950968880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e40c88a6d0 con 0x7f4278031040 2024-09-13T23:05:35.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.984+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 <== osd.0 v2:172.21.15.17:6800/489863589 29 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94437950968880] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4270051070 con 0x7f4278031040 2024-09-13T23:05:35.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.984+0000 7f4280f0c800 20 remove_watcher() i=7 2024-09-13T23:05:35.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.984+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f4278031040 msgr2=0x7f4278032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.984+0000 7f4280f0c800 1 --2- 172.21.15.164:0/2240588499 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f4278031040 0x7f4278032430 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.984+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e40c845a10 msgr2=0x55e40c847ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.984+0000 7f4280f0c800 1 --2- 172.21.15.164:0/2240588499 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e40c845a10 0x55e40c847ed0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.984+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f4268033b80 msgr2=0x7f426804d990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.984+0000 7f4280f0c800 1 --2- 172.21.15.164:0/2240588499 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f4268033b80 0x7f426804d990 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.984+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55e40c84bc60 msgr2=0x55e40c84e050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.984+0000 7f4280f0c800 1 --2- 172.21.15.164:0/2240588499 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55e40c84bc60 0x55e40c84e050 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.984+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4148036b90 msgr2=0x7f4148039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.984+0000 7f4280f0c800 1 --2- 172.21.15.164:0/2240588499 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4148036b90 0x7f4148039050 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55e40c714b40 tx=0x7f427801f000 comp rx=0 tx=0).stop 2024-09-13T23:05:35.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.984+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c832d10 msgr2=0x55e40c83a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.984+0000 7f427ea00640 1 -- 172.21.15.164:0/2240588499 reap_dead start 2024-09-13T23:05:35.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.984+0000 7f4280f0c800 1 --2- 172.21.15.164:0/2240588499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c832d10 0x55e40c83a0f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f426804d1c0 tx=0x7f426804d090 comp rx=0 tx=0).stop 2024-09-13T23:05:35.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.984+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 shutdown_connections 2024-09-13T23:05:35.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.984+0000 7f4280f0c800 1 --2- 172.21.15.164:0/2240588499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c832d10 0x55e40c83a0f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.984+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 >> 172.21.15.164:0/2240588499 conn(0x55e40c82f0c0 msgr2=0x55e40c82d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.984+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 shutdown_connections 2024-09-13T23:05:35.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.984+0000 7f4280f0c800 1 -- 172.21.15.164:0/2240588499 wait complete. 2024-09-13T23:05:35.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.985+0000 7f4280f0c800 1 -- 172.21.15.164:0/3498900015 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4158036b90 msgr2=0x7f4158039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.985+0000 7f4280f0c800 1 --2- 172.21.15.164:0/3498900015 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4158036b90 0x7f4158039050 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x55e40c8162f0 tx=0x7f4278005840 comp rx=0 tx=0).stop 2024-09-13T23:05:35.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.985+0000 7f4280f0c800 1 -- 172.21.15.164:0/3498900015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c826050 msgr2=0x55e40c826470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.985+0000 7f4280f0c800 1 --2- 172.21.15.164:0/3498900015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c826050 0x55e40c826470 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4268001ed0 tx=0x7f426800d7a0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.985+0000 7f4280f0c800 1 -- 172.21.15.164:0/3498900015 shutdown_connections 2024-09-13T23:05:35.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.985+0000 7f4280f0c800 1 --2- 172.21.15.164:0/3498900015 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4158036b90 0x7f4158039050 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.985+0000 7f4280f0c800 1 --2- 172.21.15.164:0/3498900015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c826050 0x55e40c826470 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.985+0000 7f4280f0c800 1 -- 172.21.15.164:0/3498900015 >> 172.21.15.164:0/3498900015 conn(0x55e40c81afe0 msgr2=0x55e40c81db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:35.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.985+0000 7f4280f0c800 1 -- 172.21.15.164:0/3498900015 shutdown_connections 2024-09-13T23:05:35.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.985+0000 7f4280f0c800 1 -- 172.21.15.164:0/3498900015 wait complete. 2024-09-13T23:05:35.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.985+0000 7f4280f0c800 1 -- 172.21.15.164:0/487712403 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e40c718720 msgr2=0x55e40c815680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.985+0000 7f4280f0c800 1 --2- 172.21.15.164:0/487712403 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e40c718720 0x55e40c815680 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.985+0000 7f4280f0c800 1 -- 172.21.15.164:0/487712403 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4164036b40 msgr2=0x7f4164039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.985+0000 7f4280f0c800 1 --2- 172.21.15.164:0/487712403 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4164036b40 0x7f4164039000 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4268000f60 tx=0x7f42680012b0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.985+0000 7f4280f0c800 1 -- 172.21.15.164:0/487712403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c688e30 msgr2=0x55e40c715b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:35.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.985+0000 7f4280f0c800 1 --2- 172.21.15.164:0/487712403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c688e30 0x55e40c715b10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x55e40c805790 tx=0x7f4270002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.985+0000 7f4280f0c800 1 -- 172.21.15.164:0/487712403 shutdown_connections 2024-09-13T23:05:35.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.985+0000 7f4280f0c800 1 --2- 172.21.15.164:0/487712403 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e40c718720 0x55e40c815680 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:35.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.985+0000 7f4280f0c800 1 --2- 172.21.15.164:0/487712403 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4164036b40 0x7f4164039000 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.985+0000 7f4280f0c800 1 --2- 172.21.15.164:0/487712403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e40c688e30 0x55e40c715b10 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.985+0000 7f4280f0c800 1 -- 172.21.15.164:0/487712403 >> 172.21.15.164:0/487712403 conn(0x55e40c70fe10 msgr2=0x55e40c7feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.985+0000 7f4280f0c800 1 -- 172.21.15.164:0/487712403 shutdown_connections 2024-09-13T23:05:36.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:35.985+0000 7f4280f0c800 1 -- 172.21.15.164:0/487712403 wait complete. 2024-09-13T23:05:36.001 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-13T23:05:36.001 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-13T23:05:36.001 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-13T23:05:36.045 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:36.045 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:36.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.044+0000 7f6bebd22800 1 Processor -- start 2024-09-13T23:05:36.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.044+0000 7f6bebd22800 1 -- start start 2024-09-13T23:05:36.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.045+0000 7f6bebd22800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55dca0b9cdb0 0x55dca0b9f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.045+0000 7f6bebd22800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dca0a55b30 con 0x55dca0b0a5f0 2024-09-13T23:05:36.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.045+0000 7f6bebd22800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55dca0a37360 con 0x55dca0b9cdb0 2024-09-13T23:05:36.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.045+0000 7f6be72ab640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55dca0b9cdb0 0x55dca0b9f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.045+0000 7f6be7aac640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55dca0b0a5f0 0x55dca0b9b690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:41000/0 (socket says 172.21.15.164:41000) 2024-09-13T23:05:36.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.045+0000 7f6be7aac640 1 -- 172.21.15.164:0/3487594266 learned_addr learned my addr 172.21.15.164:0/3487594266 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:36.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.045+0000 7f6be72ab640 1 -- 172.21.15.164:0/3487594266 >> v1:172.21.15.17:6789/0 conn(0x55dca0b0a5f0 legacy=0x55dca0b9b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.045+0000 7f6be72ab640 1 -- 172.21.15.164:0/3487594266 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dca0a5de00 con 0x55dca0b9cdb0 2024-09-13T23:05:36.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.047+0000 7f6be72ab640 1 --2- 172.21.15.164:0/3487594266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0b9cdb0 0x55dca0b9f1a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc00a470 tx=0x7f6bdc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e6c379b6be0076 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.047+0000 7f6be6aaa640 1 -- 172.21.15.164:0/3487594266 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bdc053570 con 0x55dca0b9cdb0 2024-09-13T23:05:36.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.047+0000 7f6be6aaa640 1 -- 172.21.15.164:0/3487594266 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bdc058070 con 0x55dca0b9cdb0 2024-09-13T23:05:36.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.047+0000 7f6be6aaa640 1 -- 172.21.15.164:0/3487594266 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bdc053880 con 0x55dca0b9cdb0 2024-09-13T23:05:36.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.048+0000 7f6bebd22800 1 -- 172.21.15.164:0/3487594266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0b9cdb0 msgr2=0x55dca0b9f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.048+0000 7f6bebd22800 1 --2- 172.21.15.164:0/3487594266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0b9cdb0 0x55dca0b9f1a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc00a470 tx=0x7f6bdc045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:36.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.048+0000 7f6bebd22800 1 -- 172.21.15.164:0/3487594266 shutdown_connections 2024-09-13T23:05:36.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.048+0000 7f6bebd22800 1 --2- 172.21.15.164:0/3487594266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0b9cdb0 0x55dca0b9f1a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.048+0000 7f6bebd22800 1 -- 172.21.15.164:0/3487594266 >> 172.21.15.164:0/3487594266 conn(0x55dca0b90de0 msgr2=0x55dca0b93200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.048+0000 7f6bebd22800 1 -- 172.21.15.164:0/3487594266 shutdown_connections 2024-09-13T23:05:36.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.048+0000 7f6bebd22800 1 -- 172.21.15.164:0/3487594266 wait complete. 2024-09-13T23:05:36.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.062+0000 7f6bebd22800 1 Processor -- start 2024-09-13T23:05:36.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.062+0000 7f6bebd22800 1 -- start start 2024-09-13T23:05:36.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.062+0000 7f6bebd22800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0b0a5f0 0x55dca0c87a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.062+0000 7f6bebd22800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55dca0ae2330 con 0x55dca0b0a5f0 2024-09-13T23:05:36.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.062+0000 7f6be7aac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0b0a5f0 0x55dca0c87a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.062+0000 7f6be7aac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0b0a5f0 0x55dca0c87a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57896/0 (socket says 172.21.15.164:57896) 2024-09-13T23:05:36.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.062+0000 7f6be7aac640 1 -- 172.21.15.164:0/4250335184 learned_addr learned my addr 172.21.15.164:0/4250335184 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.063+0000 7f6be7aac640 1 -- 172.21.15.164:0/4250335184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dca0a2fbc0 con 0x55dca0b0a5f0 2024-09-13T23:05:36.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.063+0000 7f6be7aac640 1 --2- 172.21.15.164:0/4250335184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0b0a5f0 0x55dca0c87a80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6bd80017a0 tx=0x7f6bd8001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=863c38ae1e6bc188 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.063+0000 7f6ad5e0b640 1 -- 172.21.15.164:0/4250335184 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bd8016070 con 0x55dca0b0a5f0 2024-09-13T23:05:36.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.063+0000 7f6ad5e0b640 1 -- 172.21.15.164:0/4250335184 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bd8004520 con 0x55dca0b0a5f0 2024-09-13T23:05:36.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.063+0000 7f6ad5e0b640 1 -- 172.21.15.164:0/4250335184 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bd8004820 con 0x55dca0b0a5f0 2024-09-13T23:05:36.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.064+0000 7f6bebd22800 1 -- 172.21.15.164:0/4250335184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0b0a5f0 msgr2=0x55dca0c87a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.064+0000 7f6bebd22800 1 --2- 172.21.15.164:0/4250335184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0b0a5f0 0x55dca0c87a80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6bd80017a0 tx=0x7f6bd8001c60 comp rx=0 tx=0).stop 2024-09-13T23:05:36.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.064+0000 7f6bebd22800 1 -- 172.21.15.164:0/4250335184 shutdown_connections 2024-09-13T23:05:36.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.064+0000 7f6bebd22800 1 --2- 172.21.15.164:0/4250335184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0b0a5f0 0x55dca0c87a80 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.064+0000 7f6bebd22800 1 -- 172.21.15.164:0/4250335184 >> 172.21.15.164:0/4250335184 conn(0x55dca0b90de0 msgr2=0x55dca0c83440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.064+0000 7f6bebd22800 1 -- 172.21.15.164:0/4250335184 shutdown_connections 2024-09-13T23:05:36.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.064+0000 7f6bebd22800 1 -- 172.21.15.164:0/4250335184 wait complete. 2024-09-13T23:05:36.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.064+0000 7f6bebd22800 1 Processor -- start 2024-09-13T23:05:36.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.064+0000 7f6bebd22800 1 -- start start 2024-09-13T23:05:36.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.064+0000 7f6bebd22800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0b0a5f0 0x55dca0c8f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.064+0000 7f6bebd22800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55dca0b9f980 con 0x55dca0b0a5f0 2024-09-13T23:05:36.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.065+0000 7f6be7aac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0b0a5f0 0x55dca0c8f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.065+0000 7f6be7aac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0b0a5f0 0x55dca0c8f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57908/0 (socket says 172.21.15.164:57908) 2024-09-13T23:05:36.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.065+0000 7f6be7aac640 1 -- 172.21.15.164:0/2358717137 learned_addr learned my addr 172.21.15.164:0/2358717137 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.065+0000 7f6be7aac640 1 -- 172.21.15.164:0/2358717137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dca0a43fe0 con 0x55dca0b0a5f0 2024-09-13T23:05:36.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.065+0000 7f6be7aac640 1 --2- 172.21.15.164:0/2358717137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0b0a5f0 0x55dca0c8f480 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8014040 tx=0x7f6bd8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.065+0000 7f6acffff640 1 -- 172.21.15.164:0/2358717137 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bd8020070 con 0x55dca0b0a5f0 2024-09-13T23:05:36.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.065+0000 7f6acffff640 1 -- 172.21.15.164:0/2358717137 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bd8011550 con 0x55dca0b0a5f0 2024-09-13T23:05:36.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.065+0000 7f6acffff640 1 -- 172.21.15.164:0/2358717137 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bd8016040 con 0x55dca0b0a5f0 2024-09-13T23:05:36.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.065+0000 7f6bebd22800 1 -- 172.21.15.164:0/2358717137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dca0c8f9c0 con 0x55dca0b0a5f0 2024-09-13T23:05:36.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.065+0000 7f6bebd22800 1 -- 172.21.15.164:0/2358717137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dca0c8ff40 con 0x55dca0b0a5f0 2024-09-13T23:05:36.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.066+0000 7f6acffff640 1 -- 172.21.15.164:0/2358717137 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6bd8023070 con 0x55dca0b0a5f0 2024-09-13T23:05:36.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.066+0000 7f6acffff640 1 --2- 172.21.15.164:0/2358717137 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6ad0036b40 0x7f6ad0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.066+0000 7f6acffff640 1 -- 172.21.15.164:0/2358717137 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6bd804bfc0 con 0x55dca0b0a5f0 2024-09-13T23:05:36.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.066+0000 7f6be72ab640 1 --2- 172.21.15.164:0/2358717137 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6ad0036b40 0x7f6ad0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.066+0000 7f6bebd22800 1 --2- 172.21.15.164:0/2358717137 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55dca0b9cdb0 0x55dca0c964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.066+0000 7f6bebd22800 1 -- 172.21.15.164:0/2358717137 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dca0c96a70 con 0x55dca0b9cdb0 2024-09-13T23:05:36.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.067+0000 7f6be82ad640 1 --2- 172.21.15.164:0/2358717137 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55dca0b9cdb0 0x55dca0c964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.067+0000 7f6be72ab640 1 --2- 172.21.15.164:0/2358717137 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6ad0036b40 0x7f6ad0039000 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc057000 tx=0x7f6bdc052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.067+0000 7f6be82ad640 1 --2- 172.21.15.164:0/2358717137 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55dca0b9cdb0 0x55dca0c964f0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.067+0000 7f6be82ad640 1 -- 172.21.15.164:0/2358717137 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6be00083e0 con 0x55dca0b9cdb0 2024-09-13T23:05:36.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.067+0000 7f6bebd22800 1 -- 172.21.15.164:0/2358717137 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dca0c93aa0 con 0x55dca0b9cdb0 2024-09-13T23:05:36.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.067+0000 7f6be82ad640 1 -- 172.21.15.164:0/2358717137 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6be00083e0 con 0x55dca0b9cdb0 2024-09-13T23:05:36.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.067+0000 7f6bebd22800 1 -- 172.21.15.164:0/2358717137 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dca0c98890 con 0x55dca0b9cdb0 2024-09-13T23:05:36.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.068+0000 7f6be82ad640 1 -- 172.21.15.164:0/2358717137 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6be00083e0 con 0x55dca0b9cdb0 2024-09-13T23:05:36.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.068+0000 7f6bebd22800 1 -- 172.21.15.164:0/2358717137 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dca0c97ac0 con 0x55dca0b9cdb0 2024-09-13T23:05:36.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.068+0000 7f6be82ad640 1 -- 172.21.15.164:0/2358717137 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6be00083e0 con 0x55dca0b9cdb0 2024-09-13T23:05:36.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.068+0000 7f6bebd22800 1 -- 172.21.15.164:0/2358717137 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dca0c97eb0 con 0x55dca0b9cdb0 2024-09-13T23:05:36.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.068+0000 7f6be82ad640 1 -- 172.21.15.164:0/2358717137 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6be00083e0 con 0x55dca0b9cdb0 2024-09-13T23:05:36.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.069+0000 7f6bebd22800 1 Processor -- start 2024-09-13T23:05:36.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.069+0000 7f6bebd22800 1 -- start start 2024-09-13T23:05:36.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.069+0000 7f6bebd22800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0ca6ed0 0x55dca0ca72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.069+0000 7f6bebd22800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55dca0a31580 con 0x55dca0ca6ed0 2024-09-13T23:05:36.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.069+0000 7f6be72ab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0ca6ed0 0x55dca0ca72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.069+0000 7f6be72ab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0ca6ed0 0x55dca0ca72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57924/0 (socket says 172.21.15.164:57924) 2024-09-13T23:05:36.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.069+0000 7f6be72ab640 1 -- 172.21.15.164:0/1826857047 learned_addr learned my addr 172.21.15.164:0/1826857047 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.069+0000 7f6be72ab640 1 -- 172.21.15.164:0/1826857047 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dca0ca7830 con 0x55dca0ca6ed0 2024-09-13T23:05:36.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.069+0000 7f6be72ab640 1 --2- 172.21.15.164:0/1826857047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0ca6ed0 0x55dca0ca72f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc025bf0 tx=0x7f6bdc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.070+0000 7f6acd7fa640 1 -- 172.21.15.164:0/1826857047 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bdc070070 con 0x55dca0ca6ed0 2024-09-13T23:05:36.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.070+0000 7f6acd7fa640 1 -- 172.21.15.164:0/1826857047 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bdc06c450 con 0x55dca0ca6ed0 2024-09-13T23:05:36.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.070+0000 7f6bebd22800 1 -- 172.21.15.164:0/1826857047 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dca0ca7a60 con 0x55dca0ca6ed0 2024-09-13T23:05:36.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.070+0000 7f6acd7fa640 1 -- 172.21.15.164:0/1826857047 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bdc06c770 con 0x55dca0ca6ed0 2024-09-13T23:05:36.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.070+0000 7f6bebd22800 1 -- 172.21.15.164:0/1826857047 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dca0caa6e0 con 0x55dca0ca6ed0 2024-09-13T23:05:36.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.070+0000 7f6acd7fa640 1 -- 172.21.15.164:0/1826857047 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6bdc073070 con 0x55dca0ca6ed0 2024-09-13T23:05:36.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.070+0000 7f6acd7fa640 1 --2- 172.21.15.164:0/1826857047 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6ac0036b90 0x7f6ac0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.070+0000 7f6acd7fa640 1 -- 172.21.15.164:0/1826857047 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6bdc092b50 con 0x55dca0ca6ed0 2024-09-13T23:05:36.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.071+0000 7f6be82ad640 1 --2- 172.21.15.164:0/1826857047 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6ac0036b90 0x7f6ac0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.071+0000 7f6bebd22800 1 Processor -- start 2024-09-13T23:05:36.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.071+0000 7f6be82ad640 1 --2- 172.21.15.164:0/1826857047 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6ac0036b90 0x7f6ac0039050 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x55dca0c975e0 tx=0x7f6be0000f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.071+0000 7f6bebd22800 1 -- start start 2024-09-13T23:05:36.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.071+0000 7f6bebd22800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0cb3ae0 0x55dca0cb3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.071+0000 7f6bebd22800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55dca0c88230 con 0x55dca0cb3ae0 2024-09-13T23:05:36.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.071+0000 7f6be72ab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0cb3ae0 0x55dca0cb3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.071+0000 7f6be72ab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0cb3ae0 0x55dca0cb3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57934/0 (socket says 172.21.15.164:57934) 2024-09-13T23:05:36.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.071+0000 7f6be72ab640 1 -- 172.21.15.164:0/52028056 learned_addr learned my addr 172.21.15.164:0/52028056 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.071+0000 7f6be72ab640 1 -- 172.21.15.164:0/52028056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dca0cb44b0 con 0x55dca0cb3ae0 2024-09-13T23:05:36.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.072+0000 7f6be72ab640 1 --2- 172.21.15.164:0/52028056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0cb3ae0 0x55dca0cb3ee0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc090ef0 tx=0x7f6bdc06b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca89c0d409819986 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.072+0000 7f6ac6ffd640 1 -- 172.21.15.164:0/52028056 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bdc083030 con 0x55dca0cb3ae0 2024-09-13T23:05:36.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.072+0000 7f6ac6ffd640 1 -- 172.21.15.164:0/52028056 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bdc000ed0 con 0x55dca0cb3ae0 2024-09-13T23:05:36.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.072+0000 7f6ac6ffd640 1 -- 172.21.15.164:0/52028056 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bdc05c3a0 con 0x55dca0cb3ae0 2024-09-13T23:05:36.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.072+0000 7f6bebd22800 1 -- 172.21.15.164:0/52028056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0cb3ae0 msgr2=0x55dca0cb3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.072+0000 7f6bebd22800 1 --2- 172.21.15.164:0/52028056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0cb3ae0 0x55dca0cb3ee0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc090ef0 tx=0x7f6bdc06b9b0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.072+0000 7f6bebd22800 1 -- 172.21.15.164:0/52028056 shutdown_connections 2024-09-13T23:05:36.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.072+0000 7f6bebd22800 1 --2- 172.21.15.164:0/52028056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0cb3ae0 0x55dca0cb3ee0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.072+0000 7f6bebd22800 1 -- 172.21.15.164:0/52028056 >> 172.21.15.164:0/52028056 conn(0x55dca0cafe40 msgr2=0x55dca0cadf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.072+0000 7f6bebd22800 1 -- 172.21.15.164:0/52028056 shutdown_connections 2024-09-13T23:05:36.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.072+0000 7f6bebd22800 1 -- 172.21.15.164:0/52028056 wait complete. 2024-09-13T23:05:36.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.072+0000 7f6bebd22800 1 Processor -- start 2024-09-13T23:05:36.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.073+0000 7f6bebd22800 1 -- start start 2024-09-13T23:05:36.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.073+0000 7f6bebd22800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0cb3ae0 0x55dca0cbafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.073+0000 7f6bebd22800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55dca0cb4b20 con 0x55dca0cb3ae0 2024-09-13T23:05:36.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.073+0000 7f6be72ab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0cb3ae0 0x55dca0cbafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.073+0000 7f6be72ab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0cb3ae0 0x55dca0cbafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57940/0 (socket says 172.21.15.164:57940) 2024-09-13T23:05:36.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.073+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 learned_addr learned my addr 172.21.15.164:0/3185640164 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.073+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dca0cbb520 con 0x55dca0cb3ae0 2024-09-13T23:05:36.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.073+0000 7f6be72ab640 1 --2- 172.21.15.164:0/3185640164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0cb3ae0 0x55dca0cbafe0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc052b50 tx=0x7f6bdc090e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.074+0000 7f6ac57fa640 1 -- 172.21.15.164:0/3185640164 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bdc06be40 con 0x55dca0cb3ae0 2024-09-13T23:05:36.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.074+0000 7f6ac57fa640 1 -- 172.21.15.164:0/3185640164 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bdc06cb20 con 0x55dca0cb3ae0 2024-09-13T23:05:36.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.074+0000 7f6ac57fa640 1 -- 172.21.15.164:0/3185640164 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bdc092310 con 0x55dca0cb3ae0 2024-09-13T23:05:36.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.074+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dca0cbb7b0 con 0x55dca0cb3ae0 2024-09-13T23:05:36.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.074+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dca0cbe460 con 0x55dca0cb3ae0 2024-09-13T23:05:36.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.074+0000 7f6ac57fa640 1 -- 172.21.15.164:0/3185640164 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6bdc069050 con 0x55dca0cb3ae0 2024-09-13T23:05:36.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.074+0000 7f6ac57fa640 1 --2- 172.21.15.164:0/3185640164 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6ab0036b90 0x7f6ab0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.075+0000 7f6ac57fa640 1 -- 172.21.15.164:0/3185640164 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6bdc098070 con 0x55dca0cb3ae0 2024-09-13T23:05:36.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.075+0000 7f6be82ad640 1 --2- 172.21.15.164:0/3185640164 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6ab0036b90 0x7f6ab0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.075+0000 7f6be82ad640 1 --2- 172.21.15.164:0/3185640164 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6ab0036b90 0x7f6ab0039050 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6be000f010 tx=0x7f6be000c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.075+0000 7f6bebd22800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.075+0000 7f6bebd22800 1 --2- 172.21.15.164:0/3185640164 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55dca0cc6b60 0x55dca0cc9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.075+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cc9770 con 0x55dca0cc6b60 2024-09-13T23:05:36.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.075+0000 7f6be7aac640 1 --2- 172.21.15.164:0/3185640164 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55dca0cc6b60 0x55dca0cc9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.076+0000 7f6be7aac640 1 --2- 172.21.15.164:0/3185640164 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55dca0cc6b60 0x55dca0cc9020 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.076+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.076+0000 7f6bebd22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.076+0000 7f6bebd22800 20 realm 2024-09-13T23:05:36.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.076+0000 7f6bebd22800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.076+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cc9b80 con 0x55dca0cc6b60 2024-09-13T23:05:36.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.076+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.076+0000 7f6bebd22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.076+0000 7f6bebd22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:36.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.076+0000 7f6bebd22800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.076+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cca450 con 0x55dca0cc6b60 2024-09-13T23:05:36.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.076+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.076+0000 7f6bebd22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.076+0000 7f6bebd22800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.076+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cca7f0 con 0x55dca0cc6b60 2024-09-13T23:05:36.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.077+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.077+0000 7f6bebd22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:36.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.077+0000 7f6bebd22800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.077+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccb040 con 0x55dca0cc6b60 2024-09-13T23:05:36.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.077+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.077+0000 7f6bebd22800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:36.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.077+0000 7f6bebd22800 20 searching for the correct realm 2024-09-13T23:05:36.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.077+0000 7f6bebd22800 1 --2- 172.21.15.164:0/3185640164 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55dca0cccdb0 0x55dca0ccf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.077+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x55dca0cccdb0 2024-09-13T23:05:36.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.077+0000 7f6be72ab640 1 --2- 172.21.15.164:0/3185640164 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55dca0cccdb0 0x55dca0ccf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.077+0000 7f6be72ab640 1 --2- 172.21.15.164:0/3185640164 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55dca0cccdb0 0x55dca0ccf1a0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.078+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bdc0a2020 con 0x55dca0cccdb0 2024-09-13T23:05:36.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.078+0000 7f6be72ab640 1 --2- 172.21.15.164:0/3185640164 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f6bdc06b3b0 0x7f6bdc08b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.078+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.078+0000 7f6be82ad640 1 --2- 172.21.15.164:0/3185640164 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f6bdc06b3b0 0x7f6bdc08b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.078+0000 7f6be82ad640 1 --2- 172.21.15.164:0/3185640164 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f6bdc06b3b0 0x7f6bdc08b810 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.078+0000 7f6be82ad640 1 -- 172.21.15.164:0/3185640164 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6be002f040 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.078+0000 7f6be82ad640 1 --2- 172.21.15.164:0/3185640164 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f6be0019040 0x7f6be0019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.078+0000 7f6be82ad640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x7f6be0019040 2024-09-13T23:05:36.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.078+0000 7f6be7aac640 1 --2- 172.21.15.164:0/3185640164 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f6be0019040 0x7f6be0019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.079+0000 7f6be7aac640 1 --2- 172.21.15.164:0/3185640164 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f6be0019040 0x7f6be0019930 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.079+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bd802c070 con 0x7f6be0019040 2024-09-13T23:05:36.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.079+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x55dca0cc6b60 2024-09-13T23:05:36.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.079+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.079+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x55dca0cc6b60 2024-09-13T23:05:36.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.080+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.080+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x7f6be0019040 2024-09-13T23:05:36.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.080+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bd802c070 con 0x7f6be0019040 2024-09-13T23:05:36.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.080+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x7f6be0019040 2024-09-13T23:05:36.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.080+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bd802c070 con 0x7f6be0019040 2024-09-13T23:05:36.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.080+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.080+0000 7f6be82ad640 1 -- 172.21.15.164:0/3185640164 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6be002f040 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.080+0000 7f6be82ad640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x55dca0cccdb0 2024-09-13T23:05:36.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.081+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bdc0a2020 con 0x55dca0cccdb0 2024-09-13T23:05:36.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.081+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x55dca0cc6b60 2024-09-13T23:05:36.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.081+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.081+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x7f6be0019040 2024-09-13T23:05:36.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.081+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bd802c070 con 0x7f6be0019040 2024-09-13T23:05:36.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.081+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x55dca0cc6b60 2024-09-13T23:05:36.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.081+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.081+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.082+0000 7f6be82ad640 1 -- 172.21.15.164:0/3185640164 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6be002f040 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.082+0000 7f6be82ad640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x55dca0cccdb0 2024-09-13T23:05:36.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.082+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bdc0a2020 con 0x55dca0cccdb0 2024-09-13T23:05:36.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.082+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x55dca0cccdb0 2024-09-13T23:05:36.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.082+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bdc0a2020 con 0x55dca0cccdb0 2024-09-13T23:05:36.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.082+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x7f6be0019040 2024-09-13T23:05:36.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.082+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bd802c070 con 0x7f6be0019040 2024-09-13T23:05:36.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.082+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x55dca0cccdb0 2024-09-13T23:05:36.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.082+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bdc0a2020 con 0x55dca0cccdb0 2024-09-13T23:05:36.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.082+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x55dca0cccdb0 2024-09-13T23:05:36.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.083+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bdc0a2020 con 0x55dca0cccdb0 2024-09-13T23:05:36.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.083+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x55dca0cc6b60 2024-09-13T23:05:36.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.083+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.083+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x55dca0cc6b60 2024-09-13T23:05:36.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.083+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.083+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x7f6be0019040 2024-09-13T23:05:36.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.083+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bd802c070 con 0x7f6be0019040 2024-09-13T23:05:36.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.083+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x55dca0cccdb0 2024-09-13T23:05:36.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.083+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bdc0a2020 con 0x55dca0cccdb0 2024-09-13T23:05:36.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.083+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.084+0000 7f6be82ad640 1 -- 172.21.15.164:0/3185640164 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6be002f040 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.084+0000 7f6be82ad640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x55dca0cc6b60 2024-09-13T23:05:36.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.084+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.084+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x7f6be0019040 2024-09-13T23:05:36.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.084+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bd802c070 con 0x7f6be0019040 2024-09-13T23:05:36.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.084+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x55dca0cccdb0 2024-09-13T23:05:36.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.084+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bdc0a2020 con 0x55dca0cccdb0 2024-09-13T23:05:36.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.084+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x7f6be0019040 2024-09-13T23:05:36.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.085+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bd802c070 con 0x7f6be0019040 2024-09-13T23:05:36.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.085+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.085+0000 7f6be82ad640 1 -- 172.21.15.164:0/3185640164 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6be002f040 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.085+0000 7f6be82ad640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x55dca0cccdb0 2024-09-13T23:05:36.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.085+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bdc0a2020 con 0x55dca0cccdb0 2024-09-13T23:05:36.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.085+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x7f6be0019040 2024-09-13T23:05:36.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.086+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bd802c070 con 0x7f6be0019040 2024-09-13T23:05:36.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.086+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x55dca0cc6b60 2024-09-13T23:05:36.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.086+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.086+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccf7b0 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.086+0000 7f6be82ad640 1 -- 172.21.15.164:0/3185640164 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6be002f040 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.086+0000 7f6bebd22800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:36.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.086+0000 7f6bebd22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:36.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.086+0000 7f6bebd22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:36.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.086+0000 7f6bebd22800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:36.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.086+0000 7f6bebd22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:36.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.086+0000 7f6bebd22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:36.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.086+0000 7f6bebd22800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.086+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccb9c0 con 0x55dca0cc6b60 2024-09-13T23:05:36.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.086+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.086+0000 7f6bebd22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.086+0000 7f6bebd22800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.086+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccc260 con 0x55dca0cc6b60 2024-09-13T23:05:36.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.087+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.087+0000 7f6bebd22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:36.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.087+0000 7f6bebd22800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.087+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccfc30 con 0x55dca0cc6b60 2024-09-13T23:05:36.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.087+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.087+0000 7f6bebd22800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:36.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.087+0000 7f6bebd22800 20 zone default found 2024-09-13T23:05:36.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.087+0000 7f6bebd22800 4 Realm: () 2024-09-13T23:05:36.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.087+0000 7f6bebd22800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:36.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.087+0000 7f6bebd22800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:36.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.087+0000 7f6bebd22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:36.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.087+0000 7f6bebd22800 20 zonegroup default 2024-09-13T23:05:36.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.087+0000 7f6bebd22800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.087+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ccbec0 con 0x7f6be0019040 2024-09-13T23:05:36.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.087+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x7f6be0019040 2024-09-13T23:05:36.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.087+0000 7f6bebd22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.087+0000 7f6bebd22800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.087+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cd1b40 con 0x55dca0cccdb0 2024-09-13T23:05:36.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.087+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6bdc0a2020 con 0x55dca0cccdb0 2024-09-13T23:05:36.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.087+0000 7f6bebd22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.087+0000 7f6bebd22800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.087+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cd1f30 con 0x55dca0cccdb0 2024-09-13T23:05:36.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.088+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6bdc0a2020 con 0x55dca0cccdb0 2024-09-13T23:05:36.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.088+0000 7f6bebd22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.088+0000 7f6bebd22800 20 started sync module instance, tier type = 2024-09-13T23:05:36.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.088+0000 7f6bebd22800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:36.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.088+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cd0fe0 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.089+0000 7f6be82ad640 1 -- 172.21.15.164:0/3185640164 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6be002f040 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.089+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94406078960864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cd0fe0 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.089+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cd29b0 con 0x55dca0cc6b60 2024-09-13T23:05:36.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.090+0000 7f6be82ad640 1 -- 172.21.15.164:0/3185640164 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94406078960864] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6be002f040 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.090+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.090+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94406078965472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cd0fe0 con 0x55dca0cc6b60 2024-09-13T23:05:36.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.090+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cd3450 con 0x55dca0cccdb0 2024-09-13T23:05:36.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.091+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94406078965472] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.091+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bdc0a2020 con 0x55dca0cccdb0 2024-09-13T23:05:36.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.091+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94406078958384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cd0f50 con 0x55dca0cccdb0 2024-09-13T23:05:36.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.091+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cd4310 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.092+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94406078958384] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bdc0a2020 con 0x55dca0cccdb0 2024-09-13T23:05:36.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.092+0000 7f6be82ad640 1 -- 172.21.15.164:0/3185640164 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6be002f040 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.093+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94406078971488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cd4730 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.093+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cd50f0 con 0x55dca0cc6b60 2024-09-13T23:05:36.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.094+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.094+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94406078975040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cd5060 con 0x55dca0cc6b60 2024-09-13T23:05:36.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.094+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cd60c0 con 0x7f6be0019040 2024-09-13T23:05:36.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.094+0000 7f6be82ad640 1 -- 172.21.15.164:0/3185640164 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94406078971488] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6be002f040 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.095+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94406078975040] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.095+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x7f6be0019040 2024-09-13T23:05:36.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.095+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94406078978992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cd6080 con 0x7f6be0019040 2024-09-13T23:05:36.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.095+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cd6960 con 0x7f6be0019040 2024-09-13T23:05:36.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.096+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x7f6be0019040 2024-09-13T23:05:36.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.096+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94406078981296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cd5600 con 0x7f6be0019040 2024-09-13T23:05:36.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.096+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cd7470 con 0x7f6be0019040 2024-09-13T23:05:36.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.096+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94406078978992] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x7f6be0019040 2024-09-13T23:05:36.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.097+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94406078981296] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x7f6be0019040 2024-09-13T23:05:36.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.097+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x7f6be0019040 2024-09-13T23:05:36.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.097+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94406078984064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cd68d0 con 0x7f6be0019040 2024-09-13T23:05:36.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.097+0000 7f6bebd22800 20 add_watcher() i=0 2024-09-13T23:05:36.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.097+0000 7f6bebd22800 20 add_watcher() i=1 2024-09-13T23:05:36.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.097+0000 7f6bebd22800 20 add_watcher() i=2 2024-09-13T23:05:36.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.097+0000 7f6bebd22800 20 add_watcher() i=3 2024-09-13T23:05:36.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.097+0000 7f6bebd22800 20 add_watcher() i=4 2024-09-13T23:05:36.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.097+0000 7f6bebd22800 20 add_watcher() i=5 2024-09-13T23:05:36.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.097+0000 7f6bebd22800 20 add_watcher() i=6 2024-09-13T23:05:36.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.098+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94406078984064] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x7f6be0019040 2024-09-13T23:05:36.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.098+0000 7f6bebd22800 20 add_watcher() i=7 2024-09-13T23:05:36.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.098+0000 7f6bebd22800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:36.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.098+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cda4a0 con 0x55dca0cc6b60 2024-09-13T23:05:36.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.098+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.098+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94406078972544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cd7920 con 0x55dca0cc6b60 2024-09-13T23:05:36.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.099+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94406078972544] v32'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.099+0000 7f6a9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:36.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.099+0000 7f6bebd22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:36.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.099+0000 7f6bebd22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:36.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.099+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce2de0 con 0x55dca0cc6b60 2024-09-13T23:05:36.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.100+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.100+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce34b0 con 0x7f6be0019040 2024-09-13T23:05:36.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.101+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x7f6be0019040 2024-09-13T23:05:36.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.101+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce34b0 con 0x55dca0cccdb0 2024-09-13T23:05:36.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.102+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6bdc0a2020 con 0x55dca0cccdb0 2024-09-13T23:05:36.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.102+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce3540 con 0x55dca0cc6b60 2024-09-13T23:05:36.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.103+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'113 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.103+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce3540 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.104+0000 7f6be82ad640 1 -- 172.21.15.164:0/3185640164 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'32 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6be002f040 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.104+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce3b50 con 0x55dca0cccdb0 2024-09-13T23:05:36.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.106+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'21 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6bdc0a2020 con 0x55dca0cccdb0 2024-09-13T23:05:36.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.106+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce4000 con 0x55dca0cc6b60 2024-09-13T23:05:36.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.107+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.107+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce4000 con 0x7f6be0019040 2024-09-13T23:05:36.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.108+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'21 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x7f6be0019040 2024-09-13T23:05:36.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.108+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce4000 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.109+0000 7f6be82ad640 1 -- 172.21.15.164:0/3185640164 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6be002f040 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.109+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cdea90 con 0x55dca0cccdb0 2024-09-13T23:05:36.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.110+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6bdc0a2020 con 0x55dca0cccdb0 2024-09-13T23:05:36.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.110+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cdea90 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.111+0000 7f6be82ad640 1 -- 172.21.15.164:0/3185640164 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6be002f040 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.111+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cdea90 con 0x7f6be0019040 2024-09-13T23:05:36.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.112+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x7f6be0019040 2024-09-13T23:05:36.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.112+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cdea90 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.113+0000 7f6be82ad640 1 -- 172.21.15.164:0/3185640164 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6be002f040 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.113+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce4b60 con 0x7f6be0019040 2024-09-13T23:05:36.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.114+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'27 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x7f6be0019040 2024-09-13T23:05:36.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.114+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce4b60 con 0x55dca0cc6b60 2024-09-13T23:05:36.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.115+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'114 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.115+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce4b60 con 0x55dca0cccdb0 2024-09-13T23:05:36.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.116+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bdc0a2020 con 0x55dca0cccdb0 2024-09-13T23:05:36.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.116+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce4b60 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.117+0000 7f6be82ad640 1 -- 172.21.15.164:0/3185640164 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'34 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6be002f040 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.117+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce4b60 con 0x55dca0cccdb0 2024-09-13T23:05:36.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.118+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bdc0a2020 con 0x55dca0cccdb0 2024-09-13T23:05:36.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.118+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce4b60 con 0x55dca0cc6b60 2024-09-13T23:05:36.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.119+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.119+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce4b60 con 0x55dca0cc6b60 2024-09-13T23:05:36.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.120+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'115 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.120+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce4b60 con 0x55dca0cccdb0 2024-09-13T23:05:36.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.121+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bdc0a2020 con 0x55dca0cccdb0 2024-09-13T23:05:36.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.121+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce4b60 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.122+0000 7f6be82ad640 1 -- 172.21.15.164:0/3185640164 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6be002f040 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.122+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce4b60 con 0x55dca0cccdb0 2024-09-13T23:05:36.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.123+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bdc0a2020 con 0x55dca0cccdb0 2024-09-13T23:05:36.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.123+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce4b60 con 0x55dca0cccdb0 2024-09-13T23:05:36.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.124+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 <== osd.3 v2:172.21.15.164:6816/93809510 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bdc0a2020 con 0x55dca0cccdb0 2024-09-13T23:05:36.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.124+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce4b60 con 0x55dca0cccdb0 2024-09-13T23:05:36.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.125+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 <== osd.3 v2:172.21.15.164:6816/93809510 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bdc0a2020 con 0x55dca0cccdb0 2024-09-13T23:05:36.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.125+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce4b60 con 0x55dca0cccdb0 2024-09-13T23:05:36.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.126+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 <== osd.3 v2:172.21.15.164:6816/93809510 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bdc0a2020 con 0x55dca0cccdb0 2024-09-13T23:05:36.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.126+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce4b60 con 0x7f6be0019040 2024-09-13T23:05:36.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.128+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x7f6be0019040 2024-09-13T23:05:36.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.128+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce4b60 con 0x55dca0cccdb0 2024-09-13T23:05:36.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.129+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 <== osd.3 v2:172.21.15.164:6816/93809510 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bdc0a2020 con 0x55dca0cccdb0 2024-09-13T23:05:36.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.129+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce4b60 con 0x7f6be0019040 2024-09-13T23:05:36.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.130+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x7f6be0019040 2024-09-13T23:05:36.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.130+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce4d30 con 0x55dca0cccdb0 2024-09-13T23:05:36.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.131+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 <== osd.3 v2:172.21.15.164:6816/93809510 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bdc0a2020 con 0x55dca0cccdb0 2024-09-13T23:05:36.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.131+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce4d30 con 0x7f6be0019040 2024-09-13T23:05:36.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.132+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'28 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x7f6be0019040 2024-09-13T23:05:36.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.132+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce4d30 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.133+0000 7f6be82ad640 1 -- 172.21.15.164:0/3185640164 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6be002f040 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.133+0000 7f6a9cfe1640 20 reqs_thread_entry: start 2024-09-13T23:05:36.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.133+0000 7f6bebd22800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:36.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.133+0000 7f6bebd22800 20 Filter name: none 2024-09-13T23:05:36.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.134+0000 7f6a167fc640 20 reqs_thread_entry: start 2024-09-13T23:05:36.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.134+0000 7f6bebd22800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T23:05:36.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.134+0000 7f6bebd22800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.134+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dca0d0fa40 con 0x7f6be0019040 2024-09-13T23:05:36.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.134+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f6bd802c070 con 0x7f6be0019040 2024-09-13T23:05:36.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.134+0000 7f6bebd22800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T23:05:36.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.134+0000 7f6bebd22800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T23:05:36.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.134+0000 7f6bebd22800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:05:36.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.134+0000 7f6bebd22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:36.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.134+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dca0d12410 con 0x7f6be0019040 2024-09-13T23:05:36.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.135+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f6bd802c070 con 0x7f6be0019040 2024-09-13T23:05:36.137 INFO:teuthology.orchestra.run.smithi164.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-13T23:05:36.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.135+0000 7f6a9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:36.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.135+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94406078972544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0ce1f60 con 0x55dca0cc6b60 2024-09-13T23:05:36.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.137+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94406078972544] v32'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.137+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94406078960864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cd4280 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.139+0000 7f6be82ad640 1 -- 172.21.15.164:0/3185640164 <== osd.2 v2:172.21.15.164:6808/3795914978 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94406078960864] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6be002f040 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.139+0000 7f6bebd22800 20 remove_watcher() i=0 2024-09-13T23:05:36.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.139+0000 7f6bebd22800 2 removed watcher, disabling cache 2024-09-13T23:05:36.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.139+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94406078965472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cd4280 con 0x55dca0cc6b60 2024-09-13T23:05:36.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.140+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94406078965472] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.140+0000 7f6bebd22800 20 remove_watcher() i=1 2024-09-13T23:05:36.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.140+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94406078958384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cd4280 con 0x55dca0cccdb0 2024-09-13T23:05:36.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.141+0000 7f6be72ab640 1 -- 172.21.15.164:0/3185640164 <== osd.3 v2:172.21.15.164:6816/93809510 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94406078958384] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bdc0a2020 con 0x55dca0cccdb0 2024-09-13T23:05:36.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.141+0000 7f6bebd22800 20 remove_watcher() i=2 2024-09-13T23:05:36.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.141+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94406078971488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cd26e0 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.142+0000 7f6be82ad640 1 -- 172.21.15.164:0/3185640164 <== osd.2 v2:172.21.15.164:6808/3795914978 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94406078971488] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6be002f040 con 0x7f6bdc06b3b0 2024-09-13T23:05:36.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.142+0000 7f6bebd22800 20 remove_watcher() i=3 2024-09-13T23:05:36.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.142+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94406078975040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cd0b30 con 0x55dca0cc6b60 2024-09-13T23:05:36.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.143+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94406078975040] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x55dca0cc6b60 2024-09-13T23:05:36.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.143+0000 7f6bebd22800 20 remove_watcher() i=4 2024-09-13T23:05:36.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.143+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94406078978992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cd26e0 con 0x7f6be0019040 2024-09-13T23:05:36.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.144+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94406078978992] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x7f6be0019040 2024-09-13T23:05:36.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.144+0000 7f6bebd22800 20 remove_watcher() i=5 2024-09-13T23:05:36.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.144+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94406078981296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cd4c40 con 0x7f6be0019040 2024-09-13T23:05:36.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.145+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.0 v2:172.21.15.17:6800/489863589 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94406078981296] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x7f6be0019040 2024-09-13T23:05:36.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.145+0000 7f6bebd22800 20 remove_watcher() i=6 2024-09-13T23:05:36.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.145+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94406078984064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dca0cd4c40 con 0x7f6be0019040 2024-09-13T23:05:36.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.146+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 <== osd.0 v2:172.21.15.17:6800/489863589 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94406078984064] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bd802c070 con 0x7f6be0019040 2024-09-13T23:05:36.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.146+0000 7f6bebd22800 20 remove_watcher() i=7 2024-09-13T23:05:36.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.146+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f6be0019040 msgr2=0x7f6be0019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.146+0000 7f6bebd22800 1 --2- 172.21.15.164:0/3185640164 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f6be0019040 0x7f6be0019930 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.146+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55dca0cc6b60 msgr2=0x55dca0cc9020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.146+0000 7f6bebd22800 1 --2- 172.21.15.164:0/3185640164 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55dca0cc6b60 0x55dca0cc9020 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.147+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f6bdc06b3b0 msgr2=0x7f6bdc08b810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.147+0000 7f6bebd22800 1 --2- 172.21.15.164:0/3185640164 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f6bdc06b3b0 0x7f6bdc08b810 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.147+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55dca0cccdb0 msgr2=0x55dca0ccf1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.147+0000 7f6bebd22800 1 --2- 172.21.15.164:0/3185640164 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55dca0cccdb0 0x55dca0ccf1a0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.147+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6ab0036b90 msgr2=0x7f6ab0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.147+0000 7f6bebd22800 1 --2- 172.21.15.164:0/3185640164 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6ab0036b90 0x7f6ab0039050 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6be000f010 tx=0x7f6be000c040 comp rx=0 tx=0).stop 2024-09-13T23:05:36.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.147+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0cb3ae0 msgr2=0x55dca0cbafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.147+0000 7f6be7aac640 1 -- 172.21.15.164:0/3185640164 reap_dead start 2024-09-13T23:05:36.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.147+0000 7f6bebd22800 1 --2- 172.21.15.164:0/3185640164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0cb3ae0 0x55dca0cbafe0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc052b50 tx=0x7f6bdc090e50 comp rx=0 tx=0).stop 2024-09-13T23:05:36.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.147+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 shutdown_connections 2024-09-13T23:05:36.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.147+0000 7f6bebd22800 1 --2- 172.21.15.164:0/3185640164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0cb3ae0 0x55dca0cbafe0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.147+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 >> 172.21.15.164:0/3185640164 conn(0x55dca0cafe40 msgr2=0x55dca0cadf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.147+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 shutdown_connections 2024-09-13T23:05:36.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.147+0000 7f6bebd22800 1 -- 172.21.15.164:0/3185640164 wait complete. 2024-09-13T23:05:36.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.147+0000 7f6bebd22800 1 -- 172.21.15.164:0/1826857047 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6ac0036b90 msgr2=0x7f6ac0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.147+0000 7f6bebd22800 1 --2- 172.21.15.164:0/1826857047 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6ac0036b90 0x7f6ac0039050 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x55dca0c975e0 tx=0x7f6be0000f90 comp rx=0 tx=0).stop 2024-09-13T23:05:36.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.147+0000 7f6bebd22800 1 -- 172.21.15.164:0/1826857047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0ca6ed0 msgr2=0x55dca0ca72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.147+0000 7f6bebd22800 1 --2- 172.21.15.164:0/1826857047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0ca6ed0 0x55dca0ca72f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc025bf0 tx=0x7f6bdc002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.147+0000 7f6bebd22800 1 -- 172.21.15.164:0/1826857047 shutdown_connections 2024-09-13T23:05:36.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.147+0000 7f6bebd22800 1 --2- 172.21.15.164:0/1826857047 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6ac0036b90 0x7f6ac0039050 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.147+0000 7f6bebd22800 1 --2- 172.21.15.164:0/1826857047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0ca6ed0 0x55dca0ca72f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.147+0000 7f6bebd22800 1 -- 172.21.15.164:0/1826857047 >> 172.21.15.164:0/1826857047 conn(0x55dca0c9be60 msgr2=0x55dca0c9e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.147+0000 7f6bebd22800 1 -- 172.21.15.164:0/1826857047 shutdown_connections 2024-09-13T23:05:36.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.147+0000 7f6bebd22800 1 -- 172.21.15.164:0/1826857047 wait complete. 2024-09-13T23:05:36.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.148+0000 7f6bebd22800 1 -- 172.21.15.164:0/2358717137 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55dca0b9cdb0 msgr2=0x55dca0c964f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.148+0000 7f6bebd22800 1 --2- 172.21.15.164:0/2358717137 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55dca0b9cdb0 0x55dca0c964f0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.148+0000 7f6bebd22800 1 -- 172.21.15.164:0/2358717137 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6ad0036b40 msgr2=0x7f6ad0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.148+0000 7f6bebd22800 1 --2- 172.21.15.164:0/2358717137 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6ad0036b40 0x7f6ad0039000 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc057000 tx=0x7f6bdc052000 comp rx=0 tx=0).stop 2024-09-13T23:05:36.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.148+0000 7f6bebd22800 1 -- 172.21.15.164:0/2358717137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0b0a5f0 msgr2=0x55dca0c8f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.148+0000 7f6bebd22800 1 --2- 172.21.15.164:0/2358717137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0b0a5f0 0x55dca0c8f480 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8014040 tx=0x7f6bd8001250 comp rx=0 tx=0).stop 2024-09-13T23:05:36.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.148+0000 7f6bebd22800 1 -- 172.21.15.164:0/2358717137 shutdown_connections 2024-09-13T23:05:36.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.148+0000 7f6bebd22800 1 --2- 172.21.15.164:0/2358717137 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55dca0b9cdb0 0x55dca0c964f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.148+0000 7f6bebd22800 1 --2- 172.21.15.164:0/2358717137 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6ad0036b40 0x7f6ad0039000 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.148+0000 7f6bebd22800 1 --2- 172.21.15.164:0/2358717137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dca0b0a5f0 0x55dca0c8f480 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.148+0000 7f6bebd22800 1 -- 172.21.15.164:0/2358717137 >> 172.21.15.164:0/2358717137 conn(0x55dca0b90de0 msgr2=0x55dca0c81cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.148+0000 7f6bebd22800 1 -- 172.21.15.164:0/2358717137 shutdown_connections 2024-09-13T23:05:36.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.148+0000 7f6bebd22800 1 -- 172.21.15.164:0/2358717137 wait complete. 2024-09-13T23:05:36.158 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T23:05:36.158 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-13T23:05:36.158 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-13T23:05:36.159 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-13T23:05:36.205 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:36.205 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:36.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.204+0000 7fd8cf230800 1 Processor -- start 2024-09-13T23:05:36.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.205+0000 7fd8cf230800 1 -- start start 2024-09-13T23:05:36.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.205+0000 7fd8cf230800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x561f24410920 0x561f24412d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.205+0000 7fd8cf230800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561f242ccb30 con 0x561f2440c4e0 2024-09-13T23:05:36.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.205+0000 7fd8cf230800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x561f242ae360 con 0x561f24410920 2024-09-13T23:05:36.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.205+0000 7fd8c1d4a640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x561f24410920 0x561f24412d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.205+0000 7fd8ca54b640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x561f2440c4e0 0x561f2440c8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:41012/0 (socket says 172.21.15.164:41012) 2024-09-13T23:05:36.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.205+0000 7fd8ca54b640 1 -- 172.21.15.164:0/2234194534 learned_addr learned my addr 172.21.15.164:0/2234194534 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:36.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.205+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/2234194534 >> v1:172.21.15.17:6789/0 conn(0x561f2440c4e0 legacy=0x561f2440c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.205+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/2234194534 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f242d4e00 con 0x561f24410920 2024-09-13T23:05:36.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.205+0000 7fd8c9d4a640 1 -- 172.21.15.164:0/2234194534 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1277621321 0 0) 0x561f242ccb30 con 0x561f2440c4e0 2024-09-13T23:05:36.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.207+0000 7fd8c1d4a640 1 --2- 172.21.15.164:0/2234194534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f24410920 0x561f24412d10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400a470 tx=0x7fd8b4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78eb44eb5849398 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.207+0000 7fd8c9d4a640 1 -- 172.21.15.164:0/2234194534 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8b4053570 con 0x561f24410920 2024-09-13T23:05:36.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.207+0000 7fd8c9d4a640 1 -- 172.21.15.164:0/2234194534 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8b4058070 con 0x561f24410920 2024-09-13T23:05:36.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.207+0000 7fd8c9d4a640 1 -- 172.21.15.164:0/2234194534 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8b4053880 con 0x561f24410920 2024-09-13T23:05:36.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.208+0000 7fd8cf230800 1 -- 172.21.15.164:0/2234194534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f24410920 msgr2=0x561f24412d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.208+0000 7fd8cf230800 1 --2- 172.21.15.164:0/2234194534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f24410920 0x561f24412d10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400a470 tx=0x7fd8b4045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:36.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.208+0000 7fd8cf230800 1 -- 172.21.15.164:0/2234194534 shutdown_connections 2024-09-13T23:05:36.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.208+0000 7fd8cf230800 1 --2- 172.21.15.164:0/2234194534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f24410920 0x561f24412d10 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.208+0000 7fd8cf230800 1 -- 172.21.15.164:0/2234194534 >> 172.21.15.164:0/2234194534 conn(0x561f24407db0 msgr2=0x561f2440a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.208+0000 7fd8cf230800 1 -- 172.21.15.164:0/2234194534 shutdown_connections 2024-09-13T23:05:36.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.208+0000 7fd8cf230800 1 -- 172.21.15.164:0/2234194534 wait complete. 2024-09-13T23:05:36.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.222+0000 7fd8cf230800 1 Processor -- start 2024-09-13T23:05:36.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.222+0000 7fd8cf230800 1 -- start start 2024-09-13T23:05:36.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.222+0000 7fd8cf230800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f2440c4e0 0x561f244fb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.222+0000 7fd8cf230800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561f24359360 con 0x561f2440c4e0 2024-09-13T23:05:36.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.222+0000 7fd8ca54b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f2440c4e0 0x561f244fb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.222+0000 7fd8ca54b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f2440c4e0 0x561f244fb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57954/0 (socket says 172.21.15.164:57954) 2024-09-13T23:05:36.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.222+0000 7fd8ca54b640 1 -- 172.21.15.164:0/843695666 learned_addr learned my addr 172.21.15.164:0/843695666 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.223+0000 7fd8ca54b640 1 -- 172.21.15.164:0/843695666 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f242a6bc0 con 0x561f2440c4e0 2024-09-13T23:05:36.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.223+0000 7fd8ca54b640 1 --2- 172.21.15.164:0/843695666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f2440c4e0 0x561f244fb520 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc00b240 tx=0x7fd8bc00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7cc6d271cf53b95 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.223+0000 7fd7b8608640 1 -- 172.21.15.164:0/843695666 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8bc008070 con 0x561f2440c4e0 2024-09-13T23:05:36.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.223+0000 7fd7b8608640 1 -- 172.21.15.164:0/843695666 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8bc00d500 con 0x561f2440c4e0 2024-09-13T23:05:36.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.223+0000 7fd7b8608640 1 -- 172.21.15.164:0/843695666 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8bc00d860 con 0x561f2440c4e0 2024-09-13T23:05:36.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.224+0000 7fd8cf230800 1 -- 172.21.15.164:0/843695666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f2440c4e0 msgr2=0x561f244fb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.224+0000 7fd8cf230800 1 --2- 172.21.15.164:0/843695666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f2440c4e0 0x561f244fb520 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc00b240 tx=0x7fd8bc00b700 comp rx=0 tx=0).stop 2024-09-13T23:05:36.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.224+0000 7fd8cf230800 1 -- 172.21.15.164:0/843695666 shutdown_connections 2024-09-13T23:05:36.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.224+0000 7fd8cf230800 1 --2- 172.21.15.164:0/843695666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f2440c4e0 0x561f244fb520 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.224+0000 7fd8cf230800 1 -- 172.21.15.164:0/843695666 >> 172.21.15.164:0/843695666 conn(0x561f24407db0 msgr2=0x561f244f6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.224+0000 7fd8cf230800 1 -- 172.21.15.164:0/843695666 shutdown_connections 2024-09-13T23:05:36.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.224+0000 7fd8cf230800 1 -- 172.21.15.164:0/843695666 wait complete. 2024-09-13T23:05:36.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.224+0000 7fd8cf230800 1 Processor -- start 2024-09-13T23:05:36.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.224+0000 7fd8cf230800 1 -- start start 2024-09-13T23:05:36.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.224+0000 7fd8cf230800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f2440c4e0 0x561f24504090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.224+0000 7fd8cf230800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561f24413550 con 0x561f2440c4e0 2024-09-13T23:05:36.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.225+0000 7fd8ca54b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f2440c4e0 0x561f24504090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.225+0000 7fd8ca54b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f2440c4e0 0x561f24504090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57962/0 (socket says 172.21.15.164:57962) 2024-09-13T23:05:36.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.225+0000 7fd8ca54b640 1 -- 172.21.15.164:0/4217676430 learned_addr learned my addr 172.21.15.164:0/4217676430 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.225+0000 7fd8ca54b640 1 -- 172.21.15.164:0/4217676430 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f242bafe0 con 0x561f2440c4e0 2024-09-13T23:05:36.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.225+0000 7fd8ca54b640 1 --2- 172.21.15.164:0/4217676430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f2440c4e0 0x561f24504090 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x561f244fc380 tx=0x7fd8bc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.225+0000 7fd7b6e05640 1 -- 172.21.15.164:0/4217676430 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8bc019870 con 0x561f2440c4e0 2024-09-13T23:05:36.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.225+0000 7fd7b6e05640 1 -- 172.21.15.164:0/4217676430 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8bc019a10 con 0x561f2440c4e0 2024-09-13T23:05:36.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.225+0000 7fd8cf230800 1 -- 172.21.15.164:0/4217676430 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f245045d0 con 0x561f2440c4e0 2024-09-13T23:05:36.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.225+0000 7fd7b6e05640 1 -- 172.21.15.164:0/4217676430 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8bc019d30 con 0x561f2440c4e0 2024-09-13T23:05:36.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.225+0000 7fd8cf230800 1 -- 172.21.15.164:0/4217676430 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f24504af0 con 0x561f2440c4e0 2024-09-13T23:05:36.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.226+0000 7fd7b6e05640 1 -- 172.21.15.164:0/4217676430 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd8bc017040 con 0x561f2440c4e0 2024-09-13T23:05:36.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.226+0000 7fd7b6e05640 1 --2- 172.21.15.164:0/4217676430 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd7b0036be0 0x7fd7b00390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.226+0000 7fd7b6e05640 1 -- 172.21.15.164:0/4217676430 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd8bc015020 con 0x561f2440c4e0 2024-09-13T23:05:36.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.226+0000 7fd8c1d4a640 1 --2- 172.21.15.164:0/4217676430 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd7b0036be0 0x7fd7b00390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.227+0000 7fd8cf230800 1 --2- 172.21.15.164:0/4217676430 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x561f24410920 0x561f2450b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.227+0000 7fd8cf230800 1 -- 172.21.15.164:0/4217676430 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f2450b680 con 0x561f24410920 2024-09-13T23:05:36.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.227+0000 7fd8cad4c640 1 --2- 172.21.15.164:0/4217676430 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x561f24410920 0x561f2450b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.227+0000 7fd8c1d4a640 1 --2- 172.21.15.164:0/4217676430 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd7b0036be0 0x7fd7b00390a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4057000 tx=0x7fd8b4052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.227+0000 7fd8cad4c640 1 --2- 172.21.15.164:0/4217676430 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x561f24410920 0x561f2450b100 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.227+0000 7fd8cad4c640 1 -- 172.21.15.164:0/4217676430 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8c400a4a0 con 0x561f24410920 2024-09-13T23:05:36.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.227+0000 7fd8cf230800 1 -- 172.21.15.164:0/4217676430 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f245086d0 con 0x561f24410920 2024-09-13T23:05:36.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.227+0000 7fd8cad4c640 1 -- 172.21.15.164:0/4217676430 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd8c400a4a0 con 0x561f24410920 2024-09-13T23:05:36.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.228+0000 7fd8cf230800 1 -- 172.21.15.164:0/4217676430 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f2450d4a0 con 0x561f24410920 2024-09-13T23:05:36.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.228+0000 7fd8cad4c640 1 -- 172.21.15.164:0/4217676430 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd8c400a4a0 con 0x561f24410920 2024-09-13T23:05:36.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.228+0000 7fd8cf230800 1 -- 172.21.15.164:0/4217676430 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f2450c5e0 con 0x561f24410920 2024-09-13T23:05:36.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.228+0000 7fd8cad4c640 1 -- 172.21.15.164:0/4217676430 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd8c400a4a0 con 0x561f24410920 2024-09-13T23:05:36.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.228+0000 7fd8cf230800 1 -- 172.21.15.164:0/4217676430 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f2450ca30 con 0x561f24410920 2024-09-13T23:05:36.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.228+0000 7fd8cad4c640 1 -- 172.21.15.164:0/4217676430 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd8c400a4a0 con 0x561f24410920 2024-09-13T23:05:36.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.229+0000 7fd8cf230800 1 Processor -- start 2024-09-13T23:05:36.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.229+0000 7fd8cf230800 1 -- start start 2024-09-13T23:05:36.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.229+0000 7fd8cf230800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f2451ba90 0x561f2451beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.229+0000 7fd8cf230800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561f242a8580 con 0x561f2451ba90 2024-09-13T23:05:36.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.229+0000 7fd8c1d4a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f2451ba90 0x561f2451beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.229+0000 7fd8c1d4a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f2451ba90 0x561f2451beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57964/0 (socket says 172.21.15.164:57964) 2024-09-13T23:05:36.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.229+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/3157805295 learned_addr learned my addr 172.21.15.164:0/3157805295 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.229+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/3157805295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f2451c3f0 con 0x561f2451ba90 2024-09-13T23:05:36.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.230+0000 7fd8c1d4a640 1 --2- 172.21.15.164:0/3157805295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f2451ba90 0x561f2451beb0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4025bf0 tx=0x7fd8b4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.230+0000 7fd7affff640 1 -- 172.21.15.164:0/3157805295 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8b4072560 con 0x561f2451ba90 2024-09-13T23:05:36.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.230+0000 7fd7affff640 1 -- 172.21.15.164:0/3157805295 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8b4072700 con 0x561f2451ba90 2024-09-13T23:05:36.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.230+0000 7fd8cf230800 1 -- 172.21.15.164:0/3157805295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f2451c620 con 0x561f2451ba90 2024-09-13T23:05:36.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.230+0000 7fd7affff640 1 -- 172.21.15.164:0/3157805295 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8b40729e0 con 0x561f2451ba90 2024-09-13T23:05:36.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.230+0000 7fd8cf230800 1 -- 172.21.15.164:0/3157805295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f2451f2a0 con 0x561f2451ba90 2024-09-13T23:05:36.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.230+0000 7fd7affff640 1 -- 172.21.15.164:0/3157805295 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd8b407b440 con 0x561f2451ba90 2024-09-13T23:05:36.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.231+0000 7fd7affff640 1 --2- 172.21.15.164:0/3157805295 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd7a4036b90 0x7fd7a4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.231+0000 7fd7affff640 1 -- 172.21.15.164:0/3157805295 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd8b4092ea0 con 0x561f2451ba90 2024-09-13T23:05:36.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.231+0000 7fd8cad4c640 1 --2- 172.21.15.164:0/3157805295 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd7a4036b90 0x7fd7a4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.231+0000 7fd8cf230800 1 Processor -- start 2024-09-13T23:05:36.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.231+0000 7fd8cad4c640 1 --2- 172.21.15.164:0/3157805295 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd7a4036b90 0x7fd7a4039050 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x561f2450c100 tx=0x7fd8c4005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.231+0000 7fd8cf230800 1 -- start start 2024-09-13T23:05:36.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.231+0000 7fd8cf230800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f24528680 0x561f24528a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.231+0000 7fd8cf230800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561f244fbcd0 con 0x561f24528680 2024-09-13T23:05:36.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.231+0000 7fd8c1d4a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f24528680 0x561f24528a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.232+0000 7fd8c1d4a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f24528680 0x561f24528a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57980/0 (socket says 172.21.15.164:57980) 2024-09-13T23:05:36.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.232+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/50631478 learned_addr learned my addr 172.21.15.164:0/50631478 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.232+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/50631478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f24529050 con 0x561f24528680 2024-09-13T23:05:36.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.232+0000 7fd8c1d4a640 1 --2- 172.21.15.164:0/50631478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f24528680 0x561f24528a80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd8b40911d0 tx=0x7fd8b4071e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a392ee817887eae9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.232+0000 7fd7adffb640 1 -- 172.21.15.164:0/50631478 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8b407bc50 con 0x561f24528680 2024-09-13T23:05:36.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.232+0000 7fd7adffb640 1 -- 172.21.15.164:0/50631478 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8b40713d0 con 0x561f24528680 2024-09-13T23:05:36.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.232+0000 7fd7adffb640 1 -- 172.21.15.164:0/50631478 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8b407bdf0 con 0x561f24528680 2024-09-13T23:05:36.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.232+0000 7fd8cf230800 1 -- 172.21.15.164:0/50631478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f24528680 msgr2=0x561f24528a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.232+0000 7fd8cf230800 1 --2- 172.21.15.164:0/50631478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f24528680 0x561f24528a80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd8b40911d0 tx=0x7fd8b4071e60 comp rx=0 tx=0).stop 2024-09-13T23:05:36.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.232+0000 7fd8cf230800 1 -- 172.21.15.164:0/50631478 shutdown_connections 2024-09-13T23:05:36.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.232+0000 7fd8cf230800 1 --2- 172.21.15.164:0/50631478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f24528680 0x561f24528a80 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.233+0000 7fd8cf230800 1 -- 172.21.15.164:0/50631478 >> 172.21.15.164:0/50631478 conn(0x561f245249e0 msgr2=0x561f24522ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.233+0000 7fd8cf230800 1 -- 172.21.15.164:0/50631478 shutdown_connections 2024-09-13T23:05:36.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.233+0000 7fd8cf230800 1 -- 172.21.15.164:0/50631478 wait complete. 2024-09-13T23:05:36.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.233+0000 7fd8cf230800 1 Processor -- start 2024-09-13T23:05:36.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.233+0000 7fd8cf230800 1 -- start start 2024-09-13T23:05:36.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.233+0000 7fd8cf230800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f24528680 0x561f2452fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.233+0000 7fd8cf230800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561f245296c0 con 0x561f24528680 2024-09-13T23:05:36.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.233+0000 7fd8c1d4a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f24528680 0x561f2452fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.233+0000 7fd8c1d4a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f24528680 0x561f2452fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:57986/0 (socket says 172.21.15.164:57986) 2024-09-13T23:05:36.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.233+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/1484657489 learned_addr learned my addr 172.21.15.164:0/1484657489 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.233+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f245300d0 con 0x561f24528680 2024-09-13T23:05:36.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.234+0000 7fd8c1d4a640 1 --2- 172.21.15.164:0/1484657489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f24528680 0x561f2452fb90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4045f50 tx=0x7fd8b4091160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.234+0000 7fd79bfff640 1 -- 172.21.15.164:0/1484657489 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8b405f560 con 0x561f24528680 2024-09-13T23:05:36.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.234+0000 7fd79bfff640 1 -- 172.21.15.164:0/1484657489 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8b40523a0 con 0x561f24528680 2024-09-13T23:05:36.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.234+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f24530360 con 0x561f24528680 2024-09-13T23:05:36.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.234+0000 7fd79bfff640 1 -- 172.21.15.164:0/1484657489 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8b4072b80 con 0x561f24528680 2024-09-13T23:05:36.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.234+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f24533010 con 0x561f24528680 2024-09-13T23:05:36.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.234+0000 7fd79bfff640 1 -- 172.21.15.164:0/1484657489 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd8b407b730 con 0x561f24528680 2024-09-13T23:05:36.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.235+0000 7fd79bfff640 1 --2- 172.21.15.164:0/1484657489 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd794036b40 0x7fd794039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.235+0000 7fd79bfff640 1 -- 172.21.15.164:0/1484657489 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd8b40a3c50 con 0x561f24528680 2024-09-13T23:05:36.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.235+0000 7fd8cad4c640 1 --2- 172.21.15.164:0/1484657489 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd794036b40 0x7fd794039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.235+0000 7fd8cad4c640 1 --2- 172.21.15.164:0/1484657489 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd794036b40 0x7fd794039000 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x561f24504eb0 tx=0x7fd8c401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.235+0000 7fd8cf230800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.235+0000 7fd8cf230800 1 --2- 172.21.15.164:0/1484657489 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x561f2453b650 0x561f2453db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.235+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f2453e260 con 0x561f2453b650 2024-09-13T23:05:36.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.236+0000 7fd8ca54b640 1 --2- 172.21.15.164:0/1484657489 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x561f2453b650 0x561f2453db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.236+0000 7fd8ca54b640 1 --2- 172.21.15.164:0/1484657489 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x561f2453b650 0x561f2453db10 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.236+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8bc02d070 con 0x561f2453b650 2024-09-13T23:05:36.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.236+0000 7fd8cf230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.236+0000 7fd8cf230800 20 realm 2024-09-13T23:05:36.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.236+0000 7fd8cf230800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.236+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f2453e670 con 0x561f2453b650 2024-09-13T23:05:36.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.236+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8bc02d070 con 0x561f2453b650 2024-09-13T23:05:36.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.236+0000 7fd8cf230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.236+0000 7fd8cf230800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:36.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.236+0000 7fd8cf230800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.236+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f2453ef40 con 0x561f2453b650 2024-09-13T23:05:36.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.237+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8bc02d070 con 0x561f2453b650 2024-09-13T23:05:36.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.237+0000 7fd8cf230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.237+0000 7fd8cf230800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.237+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f2453f2e0 con 0x561f2453b650 2024-09-13T23:05:36.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.237+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd8bc02d070 con 0x561f2453b650 2024-09-13T23:05:36.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.237+0000 7fd8cf230800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:36.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.237+0000 7fd8cf230800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.237+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f2453fb30 con 0x561f2453b650 2024-09-13T23:05:36.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.237+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd8bc02d070 con 0x561f2453b650 2024-09-13T23:05:36.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.237+0000 7fd8cf230800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:36.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.237+0000 7fd8cf230800 20 searching for the correct realm 2024-09-13T23:05:36.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.237+0000 7fd8cf230800 1 --2- 172.21.15.164:0/1484657489 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x561f245418a0 0x561f24543c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.237+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x561f245418a0 2024-09-13T23:05:36.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.237+0000 7fd8c1d4a640 1 --2- 172.21.15.164:0/1484657489 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x561f245418a0 0x561f24543c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.237+0000 7fd8c1d4a640 1 --2- 172.21.15.164:0/1484657489 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x561f245418a0 0x561f24543c90 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.238+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/1484657489 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8b4078020 con 0x561f245418a0 2024-09-13T23:05:36.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.238+0000 7fd8c1d4a640 1 --2- 172.21.15.164:0/1484657489 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fd8b405f040 0x7fd8b4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.238+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x7fd8b405f040 2024-09-13T23:05:36.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.238+0000 7fd8cad4c640 1 --2- 172.21.15.164:0/1484657489 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fd8b405f040 0x7fd8b4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.238+0000 7fd8cad4c640 1 --2- 172.21.15.164:0/1484657489 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fd8b405f040 0x7fd8b4068760 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.238+0000 7fd8cad4c640 1 -- 172.21.15.164:0/1484657489 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8c401f070 con 0x7fd8b405f040 2024-09-13T23:05:36.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.238+0000 7fd8cad4c640 1 --2- 172.21.15.164:0/1484657489 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fd8c4031040 0x7fd8c4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.238+0000 7fd8cad4c640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x7fd8c4031040 2024-09-13T23:05:36.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.239+0000 7fd8ca54b640 1 --2- 172.21.15.164:0/1484657489 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fd8c4031040 0x7fd8c4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.239+0000 7fd8ca54b640 1 --2- 172.21.15.164:0/1484657489 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fd8c4031040 0x7fd8c4032940 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.239+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8bc02d070 con 0x7fd8c4031040 2024-09-13T23:05:36.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.239+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x561f2453b650 2024-09-13T23:05:36.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.239+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd8bc02d070 con 0x561f2453b650 2024-09-13T23:05:36.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.239+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x561f2453b650 2024-09-13T23:05:36.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.240+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8bc02d070 con 0x561f2453b650 2024-09-13T23:05:36.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.240+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x7fd8c4031040 2024-09-13T23:05:36.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.240+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8bc02d070 con 0x7fd8c4031040 2024-09-13T23:05:36.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.240+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x7fd8c4031040 2024-09-13T23:05:36.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.240+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8bc02d070 con 0x7fd8c4031040 2024-09-13T23:05:36.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.240+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x7fd8b405f040 2024-09-13T23:05:36.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.240+0000 7fd8cad4c640 1 -- 172.21.15.164:0/1484657489 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8c401f070 con 0x7fd8b405f040 2024-09-13T23:05:36.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.240+0000 7fd8cad4c640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x561f245418a0 2024-09-13T23:05:36.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.240+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/1484657489 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8b4078020 con 0x561f245418a0 2024-09-13T23:05:36.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.240+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x561f2453b650 2024-09-13T23:05:36.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.241+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8bc02d070 con 0x561f2453b650 2024-09-13T23:05:36.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.241+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x7fd8c4031040 2024-09-13T23:05:36.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.241+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8bc02d070 con 0x7fd8c4031040 2024-09-13T23:05:36.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.241+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x561f2453b650 2024-09-13T23:05:36.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.241+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8bc02d070 con 0x561f2453b650 2024-09-13T23:05:36.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.241+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x7fd8b405f040 2024-09-13T23:05:36.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.241+0000 7fd8cad4c640 1 -- 172.21.15.164:0/1484657489 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd8c401f070 con 0x7fd8b405f040 2024-09-13T23:05:36.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.241+0000 7fd8cad4c640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x561f245418a0 2024-09-13T23:05:36.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.242+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/1484657489 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8b4078020 con 0x561f245418a0 2024-09-13T23:05:36.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.242+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x561f245418a0 2024-09-13T23:05:36.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.242+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/1484657489 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8b4078020 con 0x561f245418a0 2024-09-13T23:05:36.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.242+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x7fd8c4031040 2024-09-13T23:05:36.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.242+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8bc02d070 con 0x7fd8c4031040 2024-09-13T23:05:36.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.242+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x561f245418a0 2024-09-13T23:05:36.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.242+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/1484657489 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8b4078020 con 0x561f245418a0 2024-09-13T23:05:36.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.242+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x561f245418a0 2024-09-13T23:05:36.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.243+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/1484657489 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8b4078020 con 0x561f245418a0 2024-09-13T23:05:36.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.243+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x561f2453b650 2024-09-13T23:05:36.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.243+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8bc02d070 con 0x561f2453b650 2024-09-13T23:05:36.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.243+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x561f2453b650 2024-09-13T23:05:36.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.243+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd8bc02d070 con 0x561f2453b650 2024-09-13T23:05:36.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.243+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x7fd8c4031040 2024-09-13T23:05:36.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.243+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8bc02d070 con 0x7fd8c4031040 2024-09-13T23:05:36.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.243+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x561f245418a0 2024-09-13T23:05:36.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.243+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/1484657489 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8b4078020 con 0x561f245418a0 2024-09-13T23:05:36.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.243+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x7fd8b405f040 2024-09-13T23:05:36.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.244+0000 7fd8cad4c640 1 -- 172.21.15.164:0/1484657489 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8c401f070 con 0x7fd8b405f040 2024-09-13T23:05:36.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.244+0000 7fd8cad4c640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x561f2453b650 2024-09-13T23:05:36.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.244+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd8bc02d070 con 0x561f2453b650 2024-09-13T23:05:36.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.244+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x7fd8c4031040 2024-09-13T23:05:36.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.244+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8bc02d070 con 0x7fd8c4031040 2024-09-13T23:05:36.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.244+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x561f245418a0 2024-09-13T23:05:36.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.244+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/1484657489 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8b4078020 con 0x561f245418a0 2024-09-13T23:05:36.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.244+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x7fd8c4031040 2024-09-13T23:05:36.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.245+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8bc02d070 con 0x7fd8c4031040 2024-09-13T23:05:36.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.245+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x7fd8b405f040 2024-09-13T23:05:36.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.245+0000 7fd8cad4c640 1 -- 172.21.15.164:0/1484657489 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8c401f070 con 0x7fd8b405f040 2024-09-13T23:05:36.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.245+0000 7fd8cad4c640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x561f245418a0 2024-09-13T23:05:36.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.245+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/1484657489 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8b4078020 con 0x561f245418a0 2024-09-13T23:05:36.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.245+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x7fd8c4031040 2024-09-13T23:05:36.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.245+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8bc02d070 con 0x7fd8c4031040 2024-09-13T23:05:36.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.245+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x561f2453b650 2024-09-13T23:05:36.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.246+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd8bc02d070 con 0x561f2453b650 2024-09-13T23:05:36.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.246+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f245442a0 con 0x7fd8b405f040 2024-09-13T23:05:36.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.246+0000 7fd8cad4c640 1 -- 172.21.15.164:0/1484657489 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8c401f070 con 0x7fd8b405f040 2024-09-13T23:05:36.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.246+0000 7fd8cf230800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:36.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.246+0000 7fd8cf230800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:36.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.246+0000 7fd8cf230800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:36.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.246+0000 7fd8cf230800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:36.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.246+0000 7fd8cf230800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:36.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.246+0000 7fd8cf230800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:36.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.246+0000 7fd8cf230800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.246+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f245404b0 con 0x561f2453b650 2024-09-13T23:05:36.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.246+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8bc02d070 con 0x561f2453b650 2024-09-13T23:05:36.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.246+0000 7fd8cf230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.246+0000 7fd8cf230800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.246+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f24540d50 con 0x561f2453b650 2024-09-13T23:05:36.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.246+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd8bc02d070 con 0x561f2453b650 2024-09-13T23:05:36.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.246+0000 7fd8cf230800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:36.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.246+0000 7fd8cf230800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.246+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f24544720 con 0x561f2453b650 2024-09-13T23:05:36.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.247+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd8bc02d070 con 0x561f2453b650 2024-09-13T23:05:36.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.247+0000 7fd8cf230800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:36.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.247+0000 7fd8cf230800 20 zone default found 2024-09-13T23:05:36.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.247+0000 7fd8cf230800 4 Realm: () 2024-09-13T23:05:36.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.247+0000 7fd8cf230800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:36.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.247+0000 7fd8cf230800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:36.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.247+0000 7fd8cf230800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:36.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.247+0000 7fd8cf230800 20 zonegroup default 2024-09-13T23:05:36.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.247+0000 7fd8cf230800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.247+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f245409b0 con 0x7fd8c4031040 2024-09-13T23:05:36.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.247+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd8bc02d070 con 0x7fd8c4031040 2024-09-13T23:05:36.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.247+0000 7fd8cf230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.247+0000 7fd8cf230800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.247+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f24546600 con 0x561f245418a0 2024-09-13T23:05:36.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.247+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/1484657489 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd8b4078020 con 0x561f245418a0 2024-09-13T23:05:36.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.247+0000 7fd8cf230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.247+0000 7fd8cf230800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.247+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f24546a30 con 0x561f245418a0 2024-09-13T23:05:36.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.248+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/1484657489 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd8b4078020 con 0x561f245418a0 2024-09-13T23:05:36.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.248+0000 7fd8cf230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.248+0000 7fd8cf230800 20 started sync module instance, tier type = 2024-09-13T23:05:36.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.248+0000 7fd8cf230800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:36.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.248+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f24545aa0 con 0x7fd8b405f040 2024-09-13T23:05:36.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.249+0000 7fd8cad4c640 1 -- 172.21.15.164:0/1484657489 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8c4040040 con 0x7fd8b405f040 2024-09-13T23:05:36.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.249+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94691753483920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f24547340 con 0x7fd8b405f040 2024-09-13T23:05:36.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.249+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f24547b90 con 0x561f2453b650 2024-09-13T23:05:36.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.250+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8bc02d070 con 0x561f2453b650 2024-09-13T23:05:36.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.250+0000 7fd8cad4c640 1 -- 172.21.15.164:0/1484657489 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94691753483920] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8c4040040 con 0x7fd8b405f040 2024-09-13T23:05:36.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.250+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94691753488016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f245477e0 con 0x561f2453b650 2024-09-13T23:05:36.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.250+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f24548300 con 0x561f245418a0 2024-09-13T23:05:36.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.251+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94691753488016] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8bc02d070 con 0x561f2453b650 2024-09-13T23:05:36.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.251+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/1484657489 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8b4078020 con 0x561f245418a0 2024-09-13T23:05:36.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.251+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94691753491920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f245486f0 con 0x561f245418a0 2024-09-13T23:05:36.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.251+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f245490f0 con 0x7fd8b405f040 2024-09-13T23:05:36.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.252+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/1484657489 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94691753491920] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8b4078020 con 0x561f245418a0 2024-09-13T23:05:36.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.252+0000 7fd8cad4c640 1 -- 172.21.15.164:0/1484657489 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8c4040040 con 0x7fd8b405f040 2024-09-13T23:05:36.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.252+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94691753489072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f245494e0 con 0x7fd8b405f040 2024-09-13T23:05:36.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.252+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f24549f40 con 0x561f2453b650 2024-09-13T23:05:36.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.253+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8bc02d070 con 0x561f2453b650 2024-09-13T23:05:36.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.253+0000 7fd8cad4c640 1 -- 172.21.15.164:0/1484657489 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94691753489072] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8c4040040 con 0x7fd8b405f040 2024-09-13T23:05:36.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.253+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94691753499168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f24549f40 con 0x561f2453b650 2024-09-13T23:05:36.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.253+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f24548c40 con 0x7fd8c4031040 2024-09-13T23:05:36.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.254+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8bc02d070 con 0x7fd8c4031040 2024-09-13T23:05:36.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.254+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94691753503152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f24549f40 con 0x7fd8c4031040 2024-09-13T23:05:36.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.254+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f2454b900 con 0x7fd8c4031040 2024-09-13T23:05:36.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.254+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94691753499168] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8bc02d070 con 0x561f2453b650 2024-09-13T23:05:36.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.255+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94691753503152] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8bc02d070 con 0x7fd8c4031040 2024-09-13T23:05:36.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.255+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8bc02d070 con 0x7fd8c4031040 2024-09-13T23:05:36.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.255+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94691753504208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f2454b8c0 con 0x7fd8c4031040 2024-09-13T23:05:36.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.255+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f2454bda0 con 0x7fd8c4031040 2024-09-13T23:05:36.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.256+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94691753504208] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8bc02d070 con 0x7fd8c4031040 2024-09-13T23:05:36.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.256+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8bc02d070 con 0x7fd8c4031040 2024-09-13T23:05:36.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.256+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94691753501488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f2454bd60 con 0x7fd8c4031040 2024-09-13T23:05:36.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.256+0000 7fd8cf230800 20 add_watcher() i=0 2024-09-13T23:05:36.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.256+0000 7fd8cf230800 20 add_watcher() i=1 2024-09-13T23:05:36.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.256+0000 7fd8cf230800 20 add_watcher() i=2 2024-09-13T23:05:36.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.256+0000 7fd8cf230800 20 add_watcher() i=3 2024-09-13T23:05:36.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.256+0000 7fd8cf230800 20 add_watcher() i=4 2024-09-13T23:05:36.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.256+0000 7fd8cf230800 20 add_watcher() i=5 2024-09-13T23:05:36.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.256+0000 7fd8cf230800 20 add_watcher() i=6 2024-09-13T23:05:36.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.257+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94691753501488] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8bc02d070 con 0x7fd8c4031040 2024-09-13T23:05:36.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.257+0000 7fd8cf230800 20 add_watcher() i=7 2024-09-13T23:05:36.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.257+0000 7fd8cf230800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:36.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.257+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f2454f1c0 con 0x561f2453b650 2024-09-13T23:05:36.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.258+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd8bc02d070 con 0x561f2453b650 2024-09-13T23:05:36.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.258+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94691753505776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f2454c670 con 0x561f2453b650 2024-09-13T23:05:36.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.259+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94691753505776] v32'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd8bc02d070 con 0x561f2453b650 2024-09-13T23:05:36.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.259+0000 7fd780fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:36.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.259+0000 7fd8cf230800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:36.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.259+0000 7fd8cf230800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:36.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.259+0000 7fd8cf230800 5 note: GC not initialized 2024-09-13T23:05:36.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.259+0000 7fd6fb7fe640 20 reqs_thread_entry: start 2024-09-13T23:05:36.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.259+0000 7fd8cf230800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:36.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.259+0000 7fd8cf230800 20 Filter name: none 2024-09-13T23:05:36.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.259+0000 7fd6f97fa640 20 reqs_thread_entry: start 2024-09-13T23:05:36.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.259+0000 7fd8cf230800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T23:05:36.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.259+0000 7fd8cf230800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.259+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f245825e0 con 0x7fd8c4031040 2024-09-13T23:05:36.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.260+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fd8bc02d070 con 0x7fd8c4031040 2024-09-13T23:05:36.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.260+0000 7fd8cf230800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T23:05:36.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.260+0000 7fd8cf230800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T23:05:36.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.260+0000 7fd8cf230800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:05:36.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.260+0000 7fd8cf230800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:36.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.260+0000 7fd8cf230800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:05:36.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.260+0000 7fd8cf230800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.260+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f245846c0 con 0x7fd8b405f040 2024-09-13T23:05:36.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.260+0000 7fd8cad4c640 1 -- 172.21.15.164:0/1484657489 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd8c4040040 con 0x7fd8b405f040 2024-09-13T23:05:36.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.260+0000 7fd8cf230800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:05:36.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.260+0000 7fd8cf230800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:05:36.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.260+0000 7fd8cf230800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:05:36.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.260+0000 7fd8cf230800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 : miss 2024-09-13T23:05:36.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.260+0000 7fd8cf230800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.261+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 8.15 8:aa4f46c1:root::.bucket.meta.myfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f24586140 con 0x561f245418a0 2024-09-13T23:05:36.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.261+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/1484657489 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fd8b4078020 con 0x561f245418a0 2024-09-13T23:05:36.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.261+0000 7fd8cf230800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:05:36.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.261+0000 7fd8cf230800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 info.flags=0x17 2024-09-13T23:05:36.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.261+0000 7fd8cf230800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 to cache LRU end 2024-09-13T23:05:36.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.261+0000 7fd8cf230800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:36.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.261+0000 7fd8cf230800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:05:36.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.261+0000 7fd8cf230800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 2024-09-13T23:05:36.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.261+0000 7fd8cf230800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-13T23:05:36.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.261+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f24589860 con 0x7fd8c4031040 2024-09-13T23:05:36.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.262+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(65 fud.buckets [call] v32'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd8bc02d070 con 0x7fd8c4031040 2024-09-13T23:05:36.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.262+0000 7fd8cf230800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-13T23:05:36.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.262+0000 7fd8cf230800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.262+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f245888c0 con 0x7fd8b405f040 2024-09-13T23:05:36.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.262+0000 7fd8cad4c640 1 -- 172.21.15.164:0/1484657489 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7fd8c4040040 con 0x7fd8b405f040 2024-09-13T23:05:36.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.262+0000 7fd8cf230800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:05:36.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.262+0000 7fd8cf230800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-13T23:05:36.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.262+0000 7fd8cf230800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:05:36.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.262+0000 7fd8cf230800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:36.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.262+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f2458d570 con 0x7fd8b405f040 2024-09-13T23:05:36.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.263+0000 7fd8cad4c640 1 -- 172.21.15.164:0/1484657489 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v32'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7fd8c4040040 con 0x7fd8b405f040 2024-09-13T23:05:36.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.263+0000 7fd8cf230800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T23:05:36.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.264+0000 7fd8cf230800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:05:36.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.264+0000 7fd8cf230800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T23:05:36.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.264+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94691753774928 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f2458a280 con 0x7fd8c4031040 2024-09-13T23:05:36.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.264+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== watch-notify(notify (1) cookie 94691753504208 notify 137438953478 ret 0) ==== 380+0+0 (crc 0 0 0) 0x561f24504af0 con 0x7fd8c4031040 2024-09-13T23:05:36.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.264+0000 7fd7adffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 94691753504208 notifier 4526 bl.length()=338 2024-09-13T23:05:36.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.264+0000 7fd7adffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T23:05:36.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.264+0000 7fd7adffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:05:36.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.264+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(68 notify.6 [notify cookie 94691753774928 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd8bc02d070 con 0x7fd8c4031040 2024-09-13T23:05:36.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.264+0000 7fd7adffb640 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd790003ea0 con 0x7fd8c4031040 2024-09-13T23:05:36.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.264+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8bc02d070 con 0x7fd8c4031040 2024-09-13T23:05:36.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.264+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== watch-notify(notify_complete (2) cookie 94691753774928 notify 137438953478 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561f245045d0 con 0x7fd8c4031040 2024-09-13T23:05:36.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.265+0000 7fd780fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:36.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.265+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94691753505776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f24580330 con 0x561f2453b650 2024-09-13T23:05:36.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.266+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94691753505776] v32'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd8bc02d070 con 0x561f2453b650 2024-09-13T23:05:36.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.266+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94691753483920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f24580330 con 0x7fd8b405f040 2024-09-13T23:05:36.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.267+0000 7fd8cad4c640 1 -- 172.21.15.164:0/1484657489 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94691753483920] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8c4040040 con 0x7fd8b405f040 2024-09-13T23:05:36.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.267+0000 7fd8cf230800 20 remove_watcher() i=0 2024-09-13T23:05:36.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.267+0000 7fd8cf230800 2 removed watcher, disabling cache 2024-09-13T23:05:36.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.267+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94691753488016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f24580330 con 0x561f2453b650 2024-09-13T23:05:36.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.268+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94691753488016] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8bc02d070 con 0x561f2453b650 2024-09-13T23:05:36.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.268+0000 7fd8cf230800 20 remove_watcher() i=1 2024-09-13T23:05:36.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.268+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94691753491920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f24580330 con 0x561f245418a0 2024-09-13T23:05:36.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.269+0000 7fd8c1d4a640 1 -- 172.21.15.164:0/1484657489 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94691753491920] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8b4078020 con 0x561f245418a0 2024-09-13T23:05:36.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.269+0000 7fd8cf230800 20 remove_watcher() i=2 2024-09-13T23:05:36.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.269+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94691753489072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f2454b3f0 con 0x7fd8b405f040 2024-09-13T23:05:36.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.270+0000 7fd8cad4c640 1 -- 172.21.15.164:0/1484657489 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94691753489072] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8c4040040 con 0x7fd8b405f040 2024-09-13T23:05:36.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.270+0000 7fd8cf230800 20 remove_watcher() i=3 2024-09-13T23:05:36.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.270+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94691753499168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f24545e90 con 0x561f2453b650 2024-09-13T23:05:36.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.271+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94691753499168] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8bc02d070 con 0x561f2453b650 2024-09-13T23:05:36.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.271+0000 7fd8cf230800 20 remove_watcher() i=4 2024-09-13T23:05:36.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.271+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94691753503152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f2454b3f0 con 0x7fd8c4031040 2024-09-13T23:05:36.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.272+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94691753503152] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8bc02d070 con 0x7fd8c4031040 2024-09-13T23:05:36.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.272+0000 7fd8cf230800 20 remove_watcher() i=5 2024-09-13T23:05:36.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.272+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94691753504208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f24545e90 con 0x7fd8c4031040 2024-09-13T23:05:36.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.273+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94691753504208] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8bc02d070 con 0x7fd8c4031040 2024-09-13T23:05:36.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.273+0000 7fd8cf230800 20 remove_watcher() i=6 2024-09-13T23:05:36.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.273+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94691753501488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f2454b3f0 con 0x7fd8c4031040 2024-09-13T23:05:36.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.274+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94691753501488] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8bc02d070 con 0x7fd8c4031040 2024-09-13T23:05:36.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.274+0000 7fd8cf230800 20 remove_watcher() i=7 2024-09-13T23:05:36.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.274+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fd8c4031040 msgr2=0x7fd8c4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.274+0000 7fd8cf230800 1 --2- 172.21.15.164:0/1484657489 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fd8c4031040 0x7fd8c4032940 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.274+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x561f2453b650 msgr2=0x561f2453db10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.274+0000 7fd8cf230800 1 --2- 172.21.15.164:0/1484657489 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x561f2453b650 0x561f2453db10 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.274+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fd8b405f040 msgr2=0x7fd8b4068760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.274+0000 7fd8cf230800 1 --2- 172.21.15.164:0/1484657489 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fd8b405f040 0x7fd8b4068760 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.274+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x561f245418a0 msgr2=0x561f24543c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.274+0000 7fd8cf230800 1 --2- 172.21.15.164:0/1484657489 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x561f245418a0 0x561f24543c90 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.274+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd794036b40 msgr2=0x7fd794039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.274+0000 7fd8cf230800 1 --2- 172.21.15.164:0/1484657489 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd794036b40 0x7fd794039000 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x561f24504eb0 tx=0x7fd8c401f000 comp rx=0 tx=0).stop 2024-09-13T23:05:36.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.274+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f24528680 msgr2=0x561f2452fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.274+0000 7fd8ca54b640 1 -- 172.21.15.164:0/1484657489 reap_dead start 2024-09-13T23:05:36.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.274+0000 7fd8cf230800 1 --2- 172.21.15.164:0/1484657489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f24528680 0x561f2452fb90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4045f50 tx=0x7fd8b4091160 comp rx=0 tx=0).stop 2024-09-13T23:05:36.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.274+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 shutdown_connections 2024-09-13T23:05:36.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.274+0000 7fd8cf230800 1 --2- 172.21.15.164:0/1484657489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f24528680 0x561f2452fb90 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.274+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 >> 172.21.15.164:0/1484657489 conn(0x561f245249e0 msgr2=0x561f24522ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.274+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 shutdown_connections 2024-09-13T23:05:36.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.274+0000 7fd8cf230800 1 -- 172.21.15.164:0/1484657489 wait complete. 2024-09-13T23:05:36.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.274+0000 7fd8cf230800 1 -- 172.21.15.164:0/3157805295 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd7a4036b90 msgr2=0x7fd7a4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.274+0000 7fd8cf230800 1 --2- 172.21.15.164:0/3157805295 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd7a4036b90 0x7fd7a4039050 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x561f2450c100 tx=0x7fd8c4005840 comp rx=0 tx=0).stop 2024-09-13T23:05:36.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.274+0000 7fd8cf230800 1 -- 172.21.15.164:0/3157805295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f2451ba90 msgr2=0x561f2451beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.274+0000 7fd8cf230800 1 --2- 172.21.15.164:0/3157805295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f2451ba90 0x561f2451beb0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4025bf0 tx=0x7fd8b4002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.274+0000 7fd8cf230800 1 -- 172.21.15.164:0/3157805295 shutdown_connections 2024-09-13T23:05:36.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.274+0000 7fd8cf230800 1 --2- 172.21.15.164:0/3157805295 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd7a4036b90 0x7fd7a4039050 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.274+0000 7fd8cf230800 1 --2- 172.21.15.164:0/3157805295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f2451ba90 0x561f2451beb0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.275+0000 7fd8cf230800 1 -- 172.21.15.164:0/3157805295 >> 172.21.15.164:0/3157805295 conn(0x561f24510a20 msgr2=0x561f245135a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.275+0000 7fd8cf230800 1 -- 172.21.15.164:0/3157805295 shutdown_connections 2024-09-13T23:05:36.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.275+0000 7fd8cf230800 1 -- 172.21.15.164:0/3157805295 wait complete. 2024-09-13T23:05:36.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.275+0000 7fd8cf230800 1 -- 172.21.15.164:0/4217676430 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x561f24410920 msgr2=0x561f2450b100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.275+0000 7fd8cf230800 1 --2- 172.21.15.164:0/4217676430 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x561f24410920 0x561f2450b100 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.275+0000 7fd8cf230800 1 -- 172.21.15.164:0/4217676430 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd7b0036be0 msgr2=0x7fd7b00390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.275+0000 7fd8cf230800 1 --2- 172.21.15.164:0/4217676430 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd7b0036be0 0x7fd7b00390a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4057000 tx=0x7fd8b4052000 comp rx=0 tx=0).stop 2024-09-13T23:05:36.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.275+0000 7fd8cf230800 1 -- 172.21.15.164:0/4217676430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f2440c4e0 msgr2=0x561f24504090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.275+0000 7fd8cf230800 1 --2- 172.21.15.164:0/4217676430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f2440c4e0 0x561f24504090 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x561f244fc380 tx=0x7fd8bc000ed0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.275+0000 7fd8cf230800 1 -- 172.21.15.164:0/4217676430 shutdown_connections 2024-09-13T23:05:36.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.275+0000 7fd8cf230800 1 --2- 172.21.15.164:0/4217676430 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x561f24410920 0x561f2450b100 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.275+0000 7fd8cf230800 1 --2- 172.21.15.164:0/4217676430 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd7b0036be0 0x7fd7b00390a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.275+0000 7fd8cf230800 1 --2- 172.21.15.164:0/4217676430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f2440c4e0 0x561f24504090 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.275+0000 7fd8cf230800 1 -- 172.21.15.164:0/4217676430 >> 172.21.15.164:0/4217676430 conn(0x561f24407db0 msgr2=0x561f244f5830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.275+0000 7fd8cf230800 1 -- 172.21.15.164:0/4217676430 shutdown_connections 2024-09-13T23:05:36.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.275+0000 7fd8cf230800 1 -- 172.21.15.164:0/4217676430 wait complete. 2024-09-13T23:05:36.327 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1'] 2024-09-13T23:05:36.327 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1'] 2024-09-13T23:05:36.328 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 2024-09-13T23:05:36.376 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:36.376 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:36.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.375+0000 7f9f48211800 1 Processor -- start 2024-09-13T23:05:36.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.375+0000 7f9f48211800 1 -- start start 2024-09-13T23:05:36.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.375+0000 7f9f48211800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55b2bb01ed20 0x55b2bb021110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.375+0000 7f9f48211800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b2baed7b30 con 0x55b2baf8be10 2024-09-13T23:05:36.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.375+0000 7f9f48211800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55b2baeb9360 con 0x55b2bb01ed20 2024-09-13T23:05:36.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.376+0000 7f9f3b19b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55b2bb01ed20 0x55b2bb021110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.376+0000 7f9f4399c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55b2baf8be10 0x55b2bb01d600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:41020/0 (socket says 172.21.15.164:41020) 2024-09-13T23:05:36.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.376+0000 7f9f4399c640 1 -- 172.21.15.164:0/1464014179 learned_addr learned my addr 172.21.15.164:0/1464014179 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:36.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.376+0000 7f9f3b19b640 1 -- 172.21.15.164:0/1464014179 >> v1:172.21.15.17:6789/0 conn(0x55b2baf8be10 legacy=0x55b2bb01d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.376+0000 7f9f3b19b640 1 -- 172.21.15.164:0/1464014179 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2baedfe00 con 0x55b2bb01ed20 2024-09-13T23:05:36.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.378+0000 7f9f3b19b640 1 --2- 172.21.15.164:0/1464014179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2bb01ed20 0x55b2bb021110 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c00a470 tx=0x7f9f2c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d85d2ce9b8ee2811 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.378+0000 7f9f4319b640 1 -- 172.21.15.164:0/1464014179 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f2c053570 con 0x55b2bb01ed20 2024-09-13T23:05:36.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.378+0000 7f9f4319b640 1 -- 172.21.15.164:0/1464014179 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f2c058070 con 0x55b2bb01ed20 2024-09-13T23:05:36.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.378+0000 7f9f4319b640 1 -- 172.21.15.164:0/1464014179 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f2c053880 con 0x55b2bb01ed20 2024-09-13T23:05:36.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.379+0000 7f9f48211800 1 -- 172.21.15.164:0/1464014179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2bb01ed20 msgr2=0x55b2bb021110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.379+0000 7f9f48211800 1 --2- 172.21.15.164:0/1464014179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2bb01ed20 0x55b2bb021110 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c00a470 tx=0x7f9f2c045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:36.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.379+0000 7f9f48211800 1 -- 172.21.15.164:0/1464014179 shutdown_connections 2024-09-13T23:05:36.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.379+0000 7f9f48211800 1 --2- 172.21.15.164:0/1464014179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2bb01ed20 0x55b2bb021110 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.379+0000 7f9f48211800 1 -- 172.21.15.164:0/1464014179 >> 172.21.15.164:0/1464014179 conn(0x55b2bb012e10 msgr2=0x55b2bb015230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.379+0000 7f9f48211800 1 -- 172.21.15.164:0/1464014179 shutdown_connections 2024-09-13T23:05:36.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.379+0000 7f9f48211800 1 -- 172.21.15.164:0/1464014179 wait complete. 2024-09-13T23:05:36.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.393+0000 7f9f48211800 1 Processor -- start 2024-09-13T23:05:36.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.393+0000 7f9f48211800 1 -- start start 2024-09-13T23:05:36.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.393+0000 7f9f48211800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2baf8be10 0x55b2bb109b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.393+0000 7f9f48211800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b2baf64350 con 0x55b2baf8be10 2024-09-13T23:05:36.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.393+0000 7f9f4399c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2baf8be10 0x55b2bb109b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.393+0000 7f9f4399c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2baf8be10 0x55b2bb109b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58000/0 (socket says 172.21.15.164:58000) 2024-09-13T23:05:36.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.393+0000 7f9f4399c640 1 -- 172.21.15.164:0/235650912 learned_addr learned my addr 172.21.15.164:0/235650912 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.394+0000 7f9f4399c640 1 -- 172.21.15.164:0/235650912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2baeb1bc0 con 0x55b2baf8be10 2024-09-13T23:05:36.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.394+0000 7f9f4399c640 1 --2- 172.21.15.164:0/235650912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2baf8be10 0x55b2bb109b40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9f34001e10 tx=0x7f9f3400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59e09613e7e101c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.394+0000 7f9e31e0b640 1 -- 172.21.15.164:0/235650912 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f34012020 con 0x55b2baf8be10 2024-09-13T23:05:36.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.394+0000 7f9e31e0b640 1 -- 172.21.15.164:0/235650912 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f3400e5a0 con 0x55b2baf8be10 2024-09-13T23:05:36.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.394+0000 7f9e31e0b640 1 -- 172.21.15.164:0/235650912 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f3400e8e0 con 0x55b2baf8be10 2024-09-13T23:05:36.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.395+0000 7f9f48211800 1 -- 172.21.15.164:0/235650912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2baf8be10 msgr2=0x55b2bb109b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.395+0000 7f9f48211800 1 --2- 172.21.15.164:0/235650912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2baf8be10 0x55b2bb109b40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9f34001e10 tx=0x7f9f3400b780 comp rx=0 tx=0).stop 2024-09-13T23:05:36.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.395+0000 7f9f48211800 1 -- 172.21.15.164:0/235650912 shutdown_connections 2024-09-13T23:05:36.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.395+0000 7f9f48211800 1 --2- 172.21.15.164:0/235650912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2baf8be10 0x55b2bb109b40 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.395+0000 7f9f48211800 1 -- 172.21.15.164:0/235650912 >> 172.21.15.164:0/235650912 conn(0x55b2bb012e10 msgr2=0x55b2bb105500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.395+0000 7f9f48211800 1 -- 172.21.15.164:0/235650912 shutdown_connections 2024-09-13T23:05:36.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.395+0000 7f9f48211800 1 -- 172.21.15.164:0/235650912 wait complete. 2024-09-13T23:05:36.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.395+0000 7f9f48211800 1 Processor -- start 2024-09-13T23:05:36.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.395+0000 7f9f48211800 1 -- start start 2024-09-13T23:05:36.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.395+0000 7f9f48211800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2baf8be10 0x55b2bb111520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.395+0000 7f9f48211800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b2bb021920 con 0x55b2baf8be10 2024-09-13T23:05:36.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.395+0000 7f9f4399c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2baf8be10 0x55b2bb111520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.395+0000 7f9f4399c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2baf8be10 0x55b2bb111520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58002/0 (socket says 172.21.15.164:58002) 2024-09-13T23:05:36.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.395+0000 7f9f4399c640 1 -- 172.21.15.164:0/4290835905 learned_addr learned my addr 172.21.15.164:0/4290835905 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.396+0000 7f9f4399c640 1 -- 172.21.15.164:0/4290835905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2baec5fe0 con 0x55b2baf8be10 2024-09-13T23:05:36.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.396+0000 7f9f4399c640 1 --2- 172.21.15.164:0/4290835905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2baf8be10 0x55b2bb111520 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9f34001e10 tx=0x7f9f34000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.396+0000 7f9e2bfff640 1 -- 172.21.15.164:0/4290835905 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f34012030 con 0x55b2baf8be10 2024-09-13T23:05:36.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.396+0000 7f9e2bfff640 1 -- 172.21.15.164:0/4290835905 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f3401a7a0 con 0x55b2baf8be10 2024-09-13T23:05:36.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.396+0000 7f9e2bfff640 1 -- 172.21.15.164:0/4290835905 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f3401aac0 con 0x55b2baf8be10 2024-09-13T23:05:36.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.396+0000 7f9f48211800 1 -- 172.21.15.164:0/4290835905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2bb111a60 con 0x55b2baf8be10 2024-09-13T23:05:36.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.396+0000 7f9f48211800 1 -- 172.21.15.164:0/4290835905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2bb111f80 con 0x55b2baf8be10 2024-09-13T23:05:36.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.397+0000 7f9e2bfff640 1 -- 172.21.15.164:0/4290835905 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9f34015020 con 0x55b2baf8be10 2024-09-13T23:05:36.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.397+0000 7f9e2bfff640 1 --2- 172.21.15.164:0/4290835905 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9e2c036b40 0x7f9e2c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.397+0000 7f9e2bfff640 1 -- 172.21.15.164:0/4290835905 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9f34020030 con 0x55b2baf8be10 2024-09-13T23:05:36.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.397+0000 7f9f3b19b640 1 --2- 172.21.15.164:0/4290835905 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9e2c036b40 0x7f9e2c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.397+0000 7f9f48211800 1 --2- 172.21.15.164:0/4290835905 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b2bb01ed20 0x55b2bb118590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.397+0000 7f9f48211800 1 -- 172.21.15.164:0/4290835905 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb118ad0 con 0x55b2bb01ed20 2024-09-13T23:05:36.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.397+0000 7f9f4419d640 1 --2- 172.21.15.164:0/4290835905 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b2bb01ed20 0x55b2bb118590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.398+0000 7f9f3b19b640 1 --2- 172.21.15.164:0/4290835905 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9e2c036b40 0x7f9e2c039000 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c057000 tx=0x7f9f2c052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.398+0000 7f9f4419d640 1 --2- 172.21.15.164:0/4290835905 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b2bb01ed20 0x55b2bb118590 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.398+0000 7f9f4419d640 1 -- 172.21.15.164:0/4290835905 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f3c00a4a0 con 0x55b2bb01ed20 2024-09-13T23:05:36.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.398+0000 7f9f48211800 1 -- 172.21.15.164:0/4290835905 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb115b60 con 0x55b2bb01ed20 2024-09-13T23:05:36.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.398+0000 7f9f4419d640 1 -- 172.21.15.164:0/4290835905 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9f3c00a4a0 con 0x55b2bb01ed20 2024-09-13T23:05:36.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.398+0000 7f9f48211800 1 -- 172.21.15.164:0/4290835905 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb11a8d0 con 0x55b2bb01ed20 2024-09-13T23:05:36.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.399+0000 7f9f4419d640 1 -- 172.21.15.164:0/4290835905 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9f3c00a4a0 con 0x55b2bb01ed20 2024-09-13T23:05:36.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.399+0000 7f9f48211800 1 -- 172.21.15.164:0/4290835905 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb119b00 con 0x55b2bb01ed20 2024-09-13T23:05:36.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.399+0000 7f9f4419d640 1 -- 172.21.15.164:0/4290835905 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9f3c00a4a0 con 0x55b2bb01ed20 2024-09-13T23:05:36.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.399+0000 7f9f48211800 1 -- 172.21.15.164:0/4290835905 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb119f50 con 0x55b2bb01ed20 2024-09-13T23:05:36.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.399+0000 7f9f4419d640 1 -- 172.21.15.164:0/4290835905 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9f3c00a4a0 con 0x55b2bb01ed20 2024-09-13T23:05:36.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.399+0000 7f9f48211800 1 Processor -- start 2024-09-13T23:05:36.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.399+0000 7f9f48211800 1 -- start start 2024-09-13T23:05:36.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.400+0000 7f9f48211800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2bb128ec0 0x55b2bb1292e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.400+0000 7f9f48211800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b2baeb3580 con 0x55b2bb128ec0 2024-09-13T23:05:36.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.400+0000 7f9f3b19b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2bb128ec0 0x55b2bb1292e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.400+0000 7f9f3b19b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2bb128ec0 0x55b2bb1292e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58018/0 (socket says 172.21.15.164:58018) 2024-09-13T23:05:36.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.400+0000 7f9f3b19b640 1 -- 172.21.15.164:0/893950463 learned_addr learned my addr 172.21.15.164:0/893950463 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.400+0000 7f9f3b19b640 1 -- 172.21.15.164:0/893950463 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2bb129820 con 0x55b2bb128ec0 2024-09-13T23:05:36.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.400+0000 7f9f3b19b640 1 --2- 172.21.15.164:0/893950463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2bb128ec0 0x55b2bb1292e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c025bf0 tx=0x7f9f2c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.400+0000 7f9e29ffb640 1 -- 172.21.15.164:0/893950463 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f2c070070 con 0x55b2bb128ec0 2024-09-13T23:05:36.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.400+0000 7f9e29ffb640 1 -- 172.21.15.164:0/893950463 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f2c06c450 con 0x55b2bb128ec0 2024-09-13T23:05:36.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.400+0000 7f9f48211800 1 -- 172.21.15.164:0/893950463 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2bb129a50 con 0x55b2bb128ec0 2024-09-13T23:05:36.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.400+0000 7f9e29ffb640 1 -- 172.21.15.164:0/893950463 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f2c06c770 con 0x55b2bb128ec0 2024-09-13T23:05:36.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.401+0000 7f9f48211800 1 -- 172.21.15.164:0/893950463 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2bb12c6d0 con 0x55b2bb128ec0 2024-09-13T23:05:36.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.401+0000 7f9e29ffb640 1 -- 172.21.15.164:0/893950463 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9f2c073070 con 0x55b2bb128ec0 2024-09-13T23:05:36.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.401+0000 7f9e29ffb640 1 --2- 172.21.15.164:0/893950463 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9e1c036b90 0x7f9e1c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.401+0000 7f9e29ffb640 1 -- 172.21.15.164:0/893950463 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9f2c092b90 con 0x55b2bb128ec0 2024-09-13T23:05:36.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.401+0000 7f9f4419d640 1 --2- 172.21.15.164:0/893950463 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9e1c036b90 0x7f9e1c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.402+0000 7f9f48211800 1 Processor -- start 2024-09-13T23:05:36.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.402+0000 7f9f4419d640 1 --2- 172.21.15.164:0/893950463 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9e1c036b90 0x7f9e1c039050 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55b2bb119620 tx=0x7f9f3c005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.402+0000 7f9f48211800 1 -- start start 2024-09-13T23:05:36.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.402+0000 7f9f48211800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2bb135ad0 0x55b2bb135ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.402+0000 7f9f48211800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b2bb10a2f0 con 0x55b2bb135ad0 2024-09-13T23:05:36.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.402+0000 7f9f3b19b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2bb135ad0 0x55b2bb135ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.402+0000 7f9f3b19b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2bb135ad0 0x55b2bb135ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58028/0 (socket says 172.21.15.164:58028) 2024-09-13T23:05:36.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.402+0000 7f9f3b19b640 1 -- 172.21.15.164:0/1352625885 learned_addr learned my addr 172.21.15.164:0/1352625885 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.402+0000 7f9f3b19b640 1 -- 172.21.15.164:0/1352625885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2bb1364a0 con 0x55b2bb135ad0 2024-09-13T23:05:36.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.402+0000 7f9f3b19b640 1 --2- 172.21.15.164:0/1352625885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2bb135ad0 0x55b2bb135ed0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c090ef0 tx=0x7f9f2c06b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f794e83ec3f0290 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.403+0000 7f9e22ffd640 1 -- 172.21.15.164:0/1352625885 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f2c083030 con 0x55b2bb135ad0 2024-09-13T23:05:36.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.403+0000 7f9e22ffd640 1 -- 172.21.15.164:0/1352625885 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f2c000ed0 con 0x55b2bb135ad0 2024-09-13T23:05:36.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.403+0000 7f9e22ffd640 1 -- 172.21.15.164:0/1352625885 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f2c05c3a0 con 0x55b2bb135ad0 2024-09-13T23:05:36.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.403+0000 7f9f48211800 1 -- 172.21.15.164:0/1352625885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2bb135ad0 msgr2=0x55b2bb135ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.403+0000 7f9f48211800 1 --2- 172.21.15.164:0/1352625885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2bb135ad0 0x55b2bb135ed0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c090ef0 tx=0x7f9f2c06b9b0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.403+0000 7f9f48211800 1 -- 172.21.15.164:0/1352625885 shutdown_connections 2024-09-13T23:05:36.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.403+0000 7f9f48211800 1 --2- 172.21.15.164:0/1352625885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2bb135ad0 0x55b2bb135ed0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.403+0000 7f9f48211800 1 -- 172.21.15.164:0/1352625885 >> 172.21.15.164:0/1352625885 conn(0x55b2bb131e30 msgr2=0x55b2bb12ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.403+0000 7f9f48211800 1 -- 172.21.15.164:0/1352625885 shutdown_connections 2024-09-13T23:05:36.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.403+0000 7f9f48211800 1 -- 172.21.15.164:0/1352625885 wait complete. 2024-09-13T23:05:36.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.403+0000 7f9f48211800 1 Processor -- start 2024-09-13T23:05:36.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.403+0000 7f9f48211800 1 -- start start 2024-09-13T23:05:36.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.404+0000 7f9f48211800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2bb135ad0 0x55b2bb13cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.404+0000 7f9f48211800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b2bb136b10 con 0x55b2bb135ad0 2024-09-13T23:05:36.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.404+0000 7f9f3b19b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2bb135ad0 0x55b2bb13cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.404+0000 7f9f3b19b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2bb135ad0 0x55b2bb13cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58038/0 (socket says 172.21.15.164:58038) 2024-09-13T23:05:36.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.404+0000 7f9f3b19b640 1 -- 172.21.15.164:0/2434293660 learned_addr learned my addr 172.21.15.164:0/2434293660 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.404+0000 7f9f3b19b640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2bb13d510 con 0x55b2bb135ad0 2024-09-13T23:05:36.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.404+0000 7f9f3b19b640 1 --2- 172.21.15.164:0/2434293660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2bb135ad0 0x55b2bb13cfd0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c052b50 tx=0x7f9f2c090e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.404+0000 7f9e217fa640 1 -- 172.21.15.164:0/2434293660 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f2c06be40 con 0x55b2bb135ad0 2024-09-13T23:05:36.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.404+0000 7f9e217fa640 1 -- 172.21.15.164:0/2434293660 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f2c06cb20 con 0x55b2bb135ad0 2024-09-13T23:05:36.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.404+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2bb13d7a0 con 0x55b2bb135ad0 2024-09-13T23:05:36.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.404+0000 7f9e217fa640 1 -- 172.21.15.164:0/2434293660 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f2c092350 con 0x55b2bb135ad0 2024-09-13T23:05:36.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.405+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2bb140450 con 0x55b2bb135ad0 2024-09-13T23:05:36.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.405+0000 7f9e217fa640 1 -- 172.21.15.164:0/2434293660 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9f2c069050 con 0x55b2bb135ad0 2024-09-13T23:05:36.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.405+0000 7f9e217fa640 1 --2- 172.21.15.164:0/2434293660 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9e0c036b90 0x7f9e0c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.405+0000 7f9e217fa640 1 -- 172.21.15.164:0/2434293660 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9f2c098070 con 0x55b2bb135ad0 2024-09-13T23:05:36.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.406+0000 7f9f4419d640 1 --2- 172.21.15.164:0/2434293660 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9e0c036b90 0x7f9e0c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.406+0000 7f9f4419d640 1 --2- 172.21.15.164:0/2434293660 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9e0c036b90 0x7f9e0c039050 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55b2bb115ab0 tx=0x7f9f3c01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.406+0000 7f9f48211800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.406+0000 7f9f48211800 1 --2- 172.21.15.164:0/2434293660 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b2bb148b50 0x55b2bb14b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.406+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb14b760 con 0x55b2bb148b50 2024-09-13T23:05:36.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.406+0000 7f9f4399c640 1 --2- 172.21.15.164:0/2434293660 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b2bb148b50 0x55b2bb14b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.407+0000 7f9f4399c640 1 --2- 172.21.15.164:0/2434293660 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b2bb148b50 0x55b2bb14b010 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.407+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f3400dcd0 con 0x55b2bb148b50 2024-09-13T23:05:36.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.407+0000 7f9f48211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.407+0000 7f9f48211800 20 realm 2024-09-13T23:05:36.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.407+0000 7f9f48211800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.407+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb14bb70 con 0x55b2bb148b50 2024-09-13T23:05:36.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.407+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f3400dcd0 con 0x55b2bb148b50 2024-09-13T23:05:36.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.407+0000 7f9f48211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.407+0000 7f9f48211800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:36.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.407+0000 7f9f48211800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.407+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb14c440 con 0x55b2bb148b50 2024-09-13T23:05:36.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.407+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f3400dcd0 con 0x55b2bb148b50 2024-09-13T23:05:36.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.407+0000 7f9f48211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.407+0000 7f9f48211800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.407+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb14c7e0 con 0x55b2bb148b50 2024-09-13T23:05:36.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.408+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9f3400dcd0 con 0x55b2bb148b50 2024-09-13T23:05:36.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.408+0000 7f9f48211800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:36.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.408+0000 7f9f48211800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.408+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb14d030 con 0x55b2bb148b50 2024-09-13T23:05:36.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.408+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9f3400dcd0 con 0x55b2bb148b50 2024-09-13T23:05:36.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.408+0000 7f9f48211800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:36.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.408+0000 7f9f48211800 20 searching for the correct realm 2024-09-13T23:05:36.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.408+0000 7f9f48211800 1 --2- 172.21.15.164:0/2434293660 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55b2bb14eda0 0x55b2bb151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.408+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x55b2bb14eda0 2024-09-13T23:05:36.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.408+0000 7f9f3b19b640 1 --2- 172.21.15.164:0/2434293660 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55b2bb14eda0 0x55b2bb151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.408+0000 7f9f3b19b640 1 --2- 172.21.15.164:0/2434293660 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55b2bb14eda0 0x55b2bb151190 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.408+0000 7f9f3b19b640 1 -- 172.21.15.164:0/2434293660 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f2c0a2020 con 0x55b2bb14eda0 2024-09-13T23:05:36.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.409+0000 7f9f3b19b640 1 --2- 172.21.15.164:0/2434293660 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f9f2c06b3b0 0x7f9f2c08b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.409+0000 7f9f3b19b640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.409+0000 7f9f4419d640 1 --2- 172.21.15.164:0/2434293660 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f9f2c06b3b0 0x7f9f2c08b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.409+0000 7f9f4419d640 1 --2- 172.21.15.164:0/2434293660 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f9f2c06b3b0 0x7f9f2c08b810 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.409+0000 7f9f4419d640 1 -- 172.21.15.164:0/2434293660 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3c01f070 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.409+0000 7f9f4419d640 1 --2- 172.21.15.164:0/2434293660 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f9f3c031040 0x7f9f3c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.409+0000 7f9f4419d640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x7f9f3c031040 2024-09-13T23:05:36.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.409+0000 7f9f4399c640 1 --2- 172.21.15.164:0/2434293660 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f9f3c031040 0x7f9f3c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.410+0000 7f9f4399c640 1 --2- 172.21.15.164:0/2434293660 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f9f3c031040 0x7f9f3c032940 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.410+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3400dcd0 con 0x7f9f3c031040 2024-09-13T23:05:36.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.410+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x55b2bb148b50 2024-09-13T23:05:36.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.410+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9f3400dcd0 con 0x55b2bb148b50 2024-09-13T23:05:36.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.410+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x55b2bb148b50 2024-09-13T23:05:36.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.411+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3400dcd0 con 0x55b2bb148b50 2024-09-13T23:05:36.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.411+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x7f9f3c031040 2024-09-13T23:05:36.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.411+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3400dcd0 con 0x7f9f3c031040 2024-09-13T23:05:36.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.411+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x7f9f3c031040 2024-09-13T23:05:36.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.411+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3400dcd0 con 0x7f9f3c031040 2024-09-13T23:05:36.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.411+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.411+0000 7f9f4419d640 1 -- 172.21.15.164:0/2434293660 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3c01f070 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.411+0000 7f9f4419d640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x55b2bb14eda0 2024-09-13T23:05:36.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.412+0000 7f9f3b19b640 1 -- 172.21.15.164:0/2434293660 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f2c0a2020 con 0x55b2bb14eda0 2024-09-13T23:05:36.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.412+0000 7f9f3b19b640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x55b2bb148b50 2024-09-13T23:05:36.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.412+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3400dcd0 con 0x55b2bb148b50 2024-09-13T23:05:36.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.412+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x7f9f3c031040 2024-09-13T23:05:36.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.412+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3400dcd0 con 0x7f9f3c031040 2024-09-13T23:05:36.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.412+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x55b2bb148b50 2024-09-13T23:05:36.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.412+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3400dcd0 con 0x55b2bb148b50 2024-09-13T23:05:36.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.412+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.413+0000 7f9f4419d640 1 -- 172.21.15.164:0/2434293660 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9f3c01f070 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.413+0000 7f9f4419d640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x55b2bb14eda0 2024-09-13T23:05:36.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.413+0000 7f9f3b19b640 1 -- 172.21.15.164:0/2434293660 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f2c0a2020 con 0x55b2bb14eda0 2024-09-13T23:05:36.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.413+0000 7f9f3b19b640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x55b2bb14eda0 2024-09-13T23:05:36.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.413+0000 7f9f3b19b640 1 -- 172.21.15.164:0/2434293660 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f2c0a2020 con 0x55b2bb14eda0 2024-09-13T23:05:36.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.413+0000 7f9f3b19b640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x7f9f3c031040 2024-09-13T23:05:36.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.413+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3400dcd0 con 0x7f9f3c031040 2024-09-13T23:05:36.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.413+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x55b2bb14eda0 2024-09-13T23:05:36.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.413+0000 7f9f3b19b640 1 -- 172.21.15.164:0/2434293660 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f2c0a2020 con 0x55b2bb14eda0 2024-09-13T23:05:36.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.413+0000 7f9f3b19b640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x55b2bb14eda0 2024-09-13T23:05:36.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.414+0000 7f9f3b19b640 1 -- 172.21.15.164:0/2434293660 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f2c0a2020 con 0x55b2bb14eda0 2024-09-13T23:05:36.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.414+0000 7f9f3b19b640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x55b2bb148b50 2024-09-13T23:05:36.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.414+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3400dcd0 con 0x55b2bb148b50 2024-09-13T23:05:36.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.414+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x55b2bb148b50 2024-09-13T23:05:36.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.414+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9f3400dcd0 con 0x55b2bb148b50 2024-09-13T23:05:36.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.414+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x7f9f3c031040 2024-09-13T23:05:36.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.414+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3400dcd0 con 0x7f9f3c031040 2024-09-13T23:05:36.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.414+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x55b2bb14eda0 2024-09-13T23:05:36.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.415+0000 7f9f3b19b640 1 -- 172.21.15.164:0/2434293660 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f2c0a2020 con 0x55b2bb14eda0 2024-09-13T23:05:36.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.415+0000 7f9f3b19b640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.415+0000 7f9f4419d640 1 -- 172.21.15.164:0/2434293660 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3c01f070 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.415+0000 7f9f4419d640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x55b2bb148b50 2024-09-13T23:05:36.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.415+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9f3400dcd0 con 0x55b2bb148b50 2024-09-13T23:05:36.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.415+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x7f9f3c031040 2024-09-13T23:05:36.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.415+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3400dcd0 con 0x7f9f3c031040 2024-09-13T23:05:36.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.415+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x55b2bb14eda0 2024-09-13T23:05:36.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.416+0000 7f9f3b19b640 1 -- 172.21.15.164:0/2434293660 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f2c0a2020 con 0x55b2bb14eda0 2024-09-13T23:05:36.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.416+0000 7f9f3b19b640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x7f9f3c031040 2024-09-13T23:05:36.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.416+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3400dcd0 con 0x7f9f3c031040 2024-09-13T23:05:36.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.416+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.416+0000 7f9f4419d640 1 -- 172.21.15.164:0/2434293660 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3c01f070 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.416+0000 7f9f4419d640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x55b2bb14eda0 2024-09-13T23:05:36.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.416+0000 7f9f3b19b640 1 -- 172.21.15.164:0/2434293660 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f2c0a2020 con 0x55b2bb14eda0 2024-09-13T23:05:36.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.416+0000 7f9f3b19b640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x7f9f3c031040 2024-09-13T23:05:36.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.417+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3400dcd0 con 0x7f9f3c031040 2024-09-13T23:05:36.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.417+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x55b2bb148b50 2024-09-13T23:05:36.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.417+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9f3400dcd0 con 0x55b2bb148b50 2024-09-13T23:05:36.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.417+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151770 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.417+0000 7f9f4419d640 1 -- 172.21.15.164:0/2434293660 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3c01f070 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.417+0000 7f9f48211800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:36.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.417+0000 7f9f48211800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:36.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.417+0000 7f9f48211800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:36.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.417+0000 7f9f48211800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:36.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.417+0000 7f9f48211800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:36.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.417+0000 7f9f48211800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:36.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.417+0000 7f9f48211800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.417+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb14d9b0 con 0x55b2bb148b50 2024-09-13T23:05:36.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.417+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f3400dcd0 con 0x55b2bb148b50 2024-09-13T23:05:36.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.417+0000 7f9f48211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.418+0000 7f9f48211800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.418+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb14e250 con 0x55b2bb148b50 2024-09-13T23:05:36.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.418+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9f3400dcd0 con 0x55b2bb148b50 2024-09-13T23:05:36.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.418+0000 7f9f48211800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:36.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.418+0000 7f9f48211800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.418+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb151bf0 con 0x55b2bb148b50 2024-09-13T23:05:36.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.418+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9f3400dcd0 con 0x55b2bb148b50 2024-09-13T23:05:36.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.418+0000 7f9f48211800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:36.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.418+0000 7f9f48211800 20 zone default found 2024-09-13T23:05:36.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.418+0000 7f9f48211800 4 Realm: () 2024-09-13T23:05:36.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.418+0000 7f9f48211800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:36.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.418+0000 7f9f48211800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:36.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.418+0000 7f9f48211800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:36.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.418+0000 7f9f48211800 20 zonegroup default 2024-09-13T23:05:36.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.418+0000 7f9f48211800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.418+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb14deb0 con 0x7f9f3c031040 2024-09-13T23:05:36.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.418+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9f3400dcd0 con 0x7f9f3c031040 2024-09-13T23:05:36.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.418+0000 7f9f48211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.418+0000 7f9f48211800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.418+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb153b00 con 0x55b2bb14eda0 2024-09-13T23:05:36.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.419+0000 7f9f3b19b640 1 -- 172.21.15.164:0/2434293660 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9f2c0a2020 con 0x55b2bb14eda0 2024-09-13T23:05:36.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.419+0000 7f9f48211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.419+0000 7f9f48211800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.419+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb153ed0 con 0x55b2bb14eda0 2024-09-13T23:05:36.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.419+0000 7f9f3b19b640 1 -- 172.21.15.164:0/2434293660 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9f2c0a2020 con 0x55b2bb14eda0 2024-09-13T23:05:36.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.419+0000 7f9f48211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.419+0000 7f9f48211800 20 started sync module instance, tier type = 2024-09-13T23:05:36.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.419+0000 7f9f48211800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:36.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.419+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb152fa0 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.420+0000 7f9f4419d640 1 -- 172.21.15.164:0/2434293660 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3c040040 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.420+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94226131268496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb1547e0 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.420+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb155030 con 0x55b2bb148b50 2024-09-13T23:05:36.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.421+0000 7f9f4419d640 1 -- 172.21.15.164:0/2434293660 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94226131268496] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3c040040 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.421+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400dcd0 con 0x55b2bb148b50 2024-09-13T23:05:36.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.421+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94226131272496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb154c80 con 0x55b2bb148b50 2024-09-13T23:05:36.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.421+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb155750 con 0x55b2bb14eda0 2024-09-13T23:05:36.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.422+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94226131272496] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400dcd0 con 0x55b2bb148b50 2024-09-13T23:05:36.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.423+0000 7f9f3b19b640 1 -- 172.21.15.164:0/2434293660 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f2c0a2020 con 0x55b2bb14eda0 2024-09-13T23:05:36.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.423+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94226131276352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb155b70 con 0x55b2bb14eda0 2024-09-13T23:05:36.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.423+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb156570 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.424+0000 7f9f4419d640 1 -- 172.21.15.164:0/2434293660 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3c040040 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.424+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94226131280000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb156e40 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.424+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb1578f0 con 0x55b2bb148b50 2024-09-13T23:05:36.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.424+0000 7f9f3b19b640 1 -- 172.21.15.164:0/2434293660 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94226131276352] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f2c0a2020 con 0x55b2bb14eda0 2024-09-13T23:05:36.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.425+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400dcd0 con 0x55b2bb148b50 2024-09-13T23:05:36.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.425+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94226131273552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb1578f0 con 0x55b2bb148b50 2024-09-13T23:05:36.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.425+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb158360 con 0x7f9f3c031040 2024-09-13T23:05:36.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.425+0000 7f9f4419d640 1 -- 172.21.15.164:0/2434293660 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94226131280000] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3c040040 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.426+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400dcd0 con 0x7f9f3c031040 2024-09-13T23:05:36.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.426+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94226131273552] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400dcd0 con 0x55b2bb148b50 2024-09-13T23:05:36.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.426+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94226131287632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb158320 con 0x7f9f3c031040 2024-09-13T23:05:36.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.426+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb1573d0 con 0x7f9f3c031040 2024-09-13T23:05:36.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.427+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94226131287632] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400dcd0 con 0x7f9f3c031040 2024-09-13T23:05:36.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.427+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400dcd0 con 0x7f9f3c031040 2024-09-13T23:05:36.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.427+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94226131282320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb1588c0 con 0x7f9f3c031040 2024-09-13T23:05:36.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.427+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb159280 con 0x7f9f3c031040 2024-09-13T23:05:36.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.428+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400dcd0 con 0x7f9f3c031040 2024-09-13T23:05:36.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.428+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94226131291600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb1596a0 con 0x7f9f3c031040 2024-09-13T23:05:36.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.428+0000 7f9f48211800 20 add_watcher() i=0 2024-09-13T23:05:36.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.428+0000 7f9f48211800 20 add_watcher() i=1 2024-09-13T23:05:36.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.428+0000 7f9f48211800 20 add_watcher() i=2 2024-09-13T23:05:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.428+0000 7f9f48211800 20 add_watcher() i=3 2024-09-13T23:05:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.428+0000 7f9f48211800 20 add_watcher() i=4 2024-09-13T23:05:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.428+0000 7f9f48211800 20 add_watcher() i=5 2024-09-13T23:05:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.428+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94226131282320] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400dcd0 con 0x7f9f3c031040 2024-09-13T23:05:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.428+0000 7f9f48211800 20 add_watcher() i=6 2024-09-13T23:05:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.429+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94226131291600] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400dcd0 con 0x7f9f3c031040 2024-09-13T23:05:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.429+0000 7f9f48211800 20 add_watcher() i=7 2024-09-13T23:05:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.429+0000 7f9f48211800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.429+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb1573d0 con 0x55b2bb148b50 2024-09-13T23:05:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.429+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9f3400dcd0 con 0x55b2bb148b50 2024-09-13T23:05:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.429+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94226131284944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb159b70 con 0x55b2bb148b50 2024-09-13T23:05:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.430+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94226131284944] v32'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9f3400dcd0 con 0x55b2bb148b50 2024-09-13T23:05:36.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.430+0000 7f9df9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:36.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.430+0000 7f9f48211800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:36.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.430+0000 7f9f48211800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:36.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.430+0000 7f9f48211800 5 note: GC not initialized 2024-09-13T23:05:36.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.431+0000 7f9df8fe1640 20 reqs_thread_entry: start 2024-09-13T23:05:36.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.431+0000 7f9f48211800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:36.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.431+0000 7f9f48211800 20 Filter name: none 2024-09-13T23:05:36.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.431+0000 7f9d727fc640 20 reqs_thread_entry: start 2024-09-13T23:05:36.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.431+0000 7f9f48211800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:05:36.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.431+0000 7f9f48211800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.431+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb18faa0 con 0x55b2bb148b50 2024-09-13T23:05:36.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.431+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9f3400dcd0 con 0x55b2bb148b50 2024-09-13T23:05:36.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.431+0000 7f9f48211800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:05:36.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.431+0000 7f9f48211800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:05:36.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.431+0000 7f9f48211800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:36.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.431+0000 7f9f48211800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:36.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.431+0000 7f9f48211800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:05:36.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.431+0000 7f9f48211800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.431+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb18f5f0 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.432+0000 7f9f4419d640 1 -- 172.21.15.164:0/2434293660 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f9f3c040040 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.432+0000 7f9f48211800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:05:36.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.432+0000 7f9f48211800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:05:36.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.432+0000 7f9f48211800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:05:36.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.432+0000 7f9f48211800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 : miss 2024-09-13T23:05:36.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.432+0000 7f9f48211800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.432+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 8.15 8:aa4f46c1:root::.bucket.meta.myfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb1937c0 con 0x55b2bb14eda0 2024-09-13T23:05:36.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.432+0000 7f9f3b19b640 1 -- 172.21.15.164:0/2434293660 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f9f2c0a2020 con 0x55b2bb14eda0 2024-09-13T23:05:36.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.432+0000 7f9f48211800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:05:36.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.432+0000 7f9f48211800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 info.flags=0x17 2024-09-13T23:05:36.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.432+0000 7f9f48211800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 to cache LRU end 2024-09-13T23:05:36.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.432+0000 7f9f48211800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:36.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.432+0000 7f9f48211800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:05:36.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.432+0000 7f9f48211800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 2024-09-13T23:05:36.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.432+0000 7f9f48211800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-13T23:05:36.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.432+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb197cc0 con 0x7f9f3c031040 2024-09-13T23:05:36.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.433+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(65 fud.buckets [call] v32'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9f3400dcd0 con 0x7f9f3c031040 2024-09-13T23:05:36.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.434+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:66 8.15 8:aa4f46c1:root::.bucket.meta.myfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb19db30 con 0x55b2bb14eda0 2024-09-13T23:05:36.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.435+0000 7f9f3b19b640 1 -- 172.21.15.164:0/2434293660 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(66 .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v32'5 uv5 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f9f2c0a2020 con 0x55b2bb14eda0 2024-09-13T23:05:36.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.435+0000 7f9f48211800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 info.flags=0x17 2024-09-13T23:05:36.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.435+0000 7f9f48211800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 to cache LRU end 2024-09-13T23:05:36.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.435+0000 7f9f48211800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:05:36.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.435+0000 7f9f48211800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1, ofs0, ns] 2024-09-13T23:05:36.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.435+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94226131529872 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb1980f0 con 0x7f9f3c031040 2024-09-13T23:05:36.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.435+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== watch-notify(notify (1) cookie 94226131287632 notify 137438953479 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55b2bb111f80 con 0x7f9f3c031040 2024-09-13T23:05:36.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.435+0000 7f9e22ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 94226131287632 notifier 4533 bl.length()=752 2024-09-13T23:05:36.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.435+0000 7f9e22ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 info.flags=0x17 2024-09-13T23:05:36.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.435+0000 7f9e22ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 to cache LRU end 2024-09-13T23:05:36.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.435+0000 7f9e22ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:05:36.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.435+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(67 notify.5 [notify cookie 94226131529872 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9f3400dcd0 con 0x7f9f3c031040 2024-09-13T23:05:36.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.435+0000 7f9e22ffd640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9e08003ea0 con 0x7f9f3c031040 2024-09-13T23:05:36.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.435+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400dcd0 con 0x7f9f3c031040 2024-09-13T23:05:36.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.435+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== watch-notify(notify_complete (2) cookie 94226131529872 notify 137438953479 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b2bb111a60 con 0x7f9f3c031040 2024-09-13T23:05:36.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.435+0000 7f9f48211800 20 handle_bi_update(): bucket=:myfoo[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1]): orig_sources= new_sources= 2024-09-13T23:05:36.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.435+0000 7f9f48211800 20 handle_bi_update(): bucket=:myfoo[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1]): potential sources added=[] removed=[] 2024-09-13T23:05:36.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.435+0000 7f9f48211800 20 handle_bi_update(): bucket=:myfoo[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1]): orig_dests= new_dests= 2024-09-13T23:05:36.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.435+0000 7f9f48211800 20 handle_bi_update(): bucket=:myfoo[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1]): potential dests added=[] removed=[] 2024-09-13T23:05:36.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.435+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb19c3e0 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.436+0000 7f9f4419d640 1 -- 172.21.15.164:0/2434293660 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(69 foo.buckets [call] v32'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9f3c040040 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.436+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb193090 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.437+0000 7f9f4419d640 1 -- 172.21.15.164:0/2434293660 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f9f3c040040 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.437+0000 7f9f48211800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T23:05:36.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.437+0000 7f9f48211800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:05:36.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.437+0000 7f9f48211800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T23:05:36.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.437+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94226131529872 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb19c890 con 0x7f9f3c031040 2024-09-13T23:05:36.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.438+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== watch-notify(notify (1) cookie 94226131282320 notify 137438953480 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55b2baec5fe0 con 0x7f9f3c031040 2024-09-13T23:05:36.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.438+0000 7f9e22ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94226131282320 notifier 4533 bl.length()=314 2024-09-13T23:05:36.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.438+0000 7f9e22ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T23:05:36.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.438+0000 7f9e22ffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:05:36.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.438+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(71 notify.6 [notify cookie 94226131529872 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9f3400dcd0 con 0x7f9f3c031040 2024-09-13T23:05:36.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.438+0000 7f9e22ffd640 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9e08003ea0 con 0x7f9f3c031040 2024-09-13T23:05:36.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.438+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400dcd0 con 0x7f9f3c031040 2024-09-13T23:05:36.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.438+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== watch-notify(notify_complete (2) cookie 94226131529872 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b2baeb1bc0 con 0x7f9f3c031040 2024-09-13T23:05:36.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.439+0000 7f9df9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:36.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.439+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94226131284944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb18d7f0 con 0x55b2bb148b50 2024-09-13T23:05:36.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.440+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94226131284944] v32'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9f3400dcd0 con 0x55b2bb148b50 2024-09-13T23:05:36.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.440+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94226131268496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb18d7f0 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.441+0000 7f9f4419d640 1 -- 172.21.15.164:0/2434293660 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94226131268496] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3c040040 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.441+0000 7f9f48211800 20 remove_watcher() i=0 2024-09-13T23:05:36.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.441+0000 7f9f48211800 2 removed watcher, disabling cache 2024-09-13T23:05:36.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.441+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94226131272496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb18d7f0 con 0x55b2bb148b50 2024-09-13T23:05:36.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.442+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94226131272496] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400dcd0 con 0x55b2bb148b50 2024-09-13T23:05:36.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.442+0000 7f9f48211800 20 remove_watcher() i=1 2024-09-13T23:05:36.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.442+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94226131276352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb18d7f0 con 0x55b2bb14eda0 2024-09-13T23:05:36.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.443+0000 7f9f3b19b640 1 -- 172.21.15.164:0/2434293660 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94226131276352] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f2c0a2020 con 0x55b2bb14eda0 2024-09-13T23:05:36.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.443+0000 7f9f48211800 20 remove_watcher() i=2 2024-09-13T23:05:36.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.443+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94226131280000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb18d7f0 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.444+0000 7f9f4419d640 1 -- 172.21.15.164:0/2434293660 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94226131280000] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3c040040 con 0x7f9f2c06b3b0 2024-09-13T23:05:36.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.444+0000 7f9f48211800 20 remove_watcher() i=3 2024-09-13T23:05:36.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.444+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94226131273552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb18d7f0 con 0x55b2bb148b50 2024-09-13T23:05:36.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.445+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94226131273552] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400dcd0 con 0x55b2bb148b50 2024-09-13T23:05:36.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.445+0000 7f9f48211800 20 remove_watcher() i=4 2024-09-13T23:05:36.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.445+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94226131287632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb18d7f0 con 0x7f9f3c031040 2024-09-13T23:05:36.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.446+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94226131287632] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400dcd0 con 0x7f9f3c031040 2024-09-13T23:05:36.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.446+0000 7f9f48211800 20 remove_watcher() i=5 2024-09-13T23:05:36.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.446+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94226131282320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb18d7f0 con 0x7f9f3c031040 2024-09-13T23:05:36.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.447+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.0 v2:172.21.15.17:6800/489863589 27 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94226131282320] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400dcd0 con 0x7f9f3c031040 2024-09-13T23:05:36.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.447+0000 7f9f48211800 20 remove_watcher() i=6 2024-09-13T23:05:36.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.447+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94226131291600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2bb18d7f0 con 0x7f9f3c031040 2024-09-13T23:05:36.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.448+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 <== osd.0 v2:172.21.15.17:6800/489863589 28 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94226131291600] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400dcd0 con 0x7f9f3c031040 2024-09-13T23:05:36.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.448+0000 7f9f48211800 20 remove_watcher() i=7 2024-09-13T23:05:36.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.448+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f9f3c031040 msgr2=0x7f9f3c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.448+0000 7f9f48211800 1 --2- 172.21.15.164:0/2434293660 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f9f3c031040 0x7f9f3c032940 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.448+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b2bb148b50 msgr2=0x55b2bb14b010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.448+0000 7f9f48211800 1 --2- 172.21.15.164:0/2434293660 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b2bb148b50 0x55b2bb14b010 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.448+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f9f2c06b3b0 msgr2=0x7f9f2c08b810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.448+0000 7f9f48211800 1 --2- 172.21.15.164:0/2434293660 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f9f2c06b3b0 0x7f9f2c08b810 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.448+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55b2bb14eda0 msgr2=0x55b2bb151190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.448+0000 7f9f48211800 1 --2- 172.21.15.164:0/2434293660 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55b2bb14eda0 0x55b2bb151190 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.449+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9e0c036b90 msgr2=0x7f9e0c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.449+0000 7f9f48211800 1 --2- 172.21.15.164:0/2434293660 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9e0c036b90 0x7f9e0c039050 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55b2bb115ab0 tx=0x7f9f3c01f000 comp rx=0 tx=0).stop 2024-09-13T23:05:36.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.449+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2bb135ad0 msgr2=0x55b2bb13cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.449+0000 7f9f4399c640 1 -- 172.21.15.164:0/2434293660 reap_dead start 2024-09-13T23:05:36.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.449+0000 7f9f48211800 1 --2- 172.21.15.164:0/2434293660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2bb135ad0 0x55b2bb13cfd0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c052b50 tx=0x7f9f2c090e50 comp rx=0 tx=0).stop 2024-09-13T23:05:36.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.449+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 shutdown_connections 2024-09-13T23:05:36.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.449+0000 7f9f48211800 1 --2- 172.21.15.164:0/2434293660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2bb135ad0 0x55b2bb13cfd0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.449+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 >> 172.21.15.164:0/2434293660 conn(0x55b2bb131e30 msgr2=0x55b2bb12ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.449+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 shutdown_connections 2024-09-13T23:05:36.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.449+0000 7f9f48211800 1 -- 172.21.15.164:0/2434293660 wait complete. 2024-09-13T23:05:36.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.449+0000 7f9f48211800 1 -- 172.21.15.164:0/893950463 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9e1c036b90 msgr2=0x7f9e1c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.449+0000 7f9f48211800 1 --2- 172.21.15.164:0/893950463 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9e1c036b90 0x7f9e1c039050 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55b2bb119620 tx=0x7f9f3c005840 comp rx=0 tx=0).stop 2024-09-13T23:05:36.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.449+0000 7f9f48211800 1 -- 172.21.15.164:0/893950463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2bb128ec0 msgr2=0x55b2bb1292e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.449+0000 7f9f48211800 1 --2- 172.21.15.164:0/893950463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2bb128ec0 0x55b2bb1292e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c025bf0 tx=0x7f9f2c002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.449+0000 7f9f48211800 1 -- 172.21.15.164:0/893950463 shutdown_connections 2024-09-13T23:05:36.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.449+0000 7f9f48211800 1 --2- 172.21.15.164:0/893950463 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9e1c036b90 0x7f9e1c039050 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.449+0000 7f9f48211800 1 --2- 172.21.15.164:0/893950463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2bb128ec0 0x55b2bb1292e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.449+0000 7f9f48211800 1 -- 172.21.15.164:0/893950463 >> 172.21.15.164:0/893950463 conn(0x55b2bb11de50 msgr2=0x55b2bb1209d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.449+0000 7f9f48211800 1 -- 172.21.15.164:0/893950463 shutdown_connections 2024-09-13T23:05:36.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.449+0000 7f9f48211800 1 -- 172.21.15.164:0/893950463 wait complete. 2024-09-13T23:05:36.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.449+0000 7f9f48211800 1 -- 172.21.15.164:0/4290835905 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b2bb01ed20 msgr2=0x55b2bb118590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.449+0000 7f9f48211800 1 --2- 172.21.15.164:0/4290835905 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b2bb01ed20 0x55b2bb118590 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.450+0000 7f9f48211800 1 -- 172.21.15.164:0/4290835905 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9e2c036b40 msgr2=0x7f9e2c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.450+0000 7f9f48211800 1 --2- 172.21.15.164:0/4290835905 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9e2c036b40 0x7f9e2c039000 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c057000 tx=0x7f9f2c052000 comp rx=0 tx=0).stop 2024-09-13T23:05:36.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.450+0000 7f9f48211800 1 -- 172.21.15.164:0/4290835905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2baf8be10 msgr2=0x55b2bb111520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.450+0000 7f9f48211800 1 --2- 172.21.15.164:0/4290835905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2baf8be10 0x55b2bb111520 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9f34001e10 tx=0x7f9f34000ed0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.450+0000 7f9f48211800 1 -- 172.21.15.164:0/4290835905 shutdown_connections 2024-09-13T23:05:36.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.450+0000 7f9f48211800 1 --2- 172.21.15.164:0/4290835905 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b2bb01ed20 0x55b2bb118590 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.450+0000 7f9f48211800 1 --2- 172.21.15.164:0/4290835905 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9e2c036b40 0x7f9e2c039000 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.450+0000 7f9f48211800 1 --2- 172.21.15.164:0/4290835905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b2baf8be10 0x55b2bb111520 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.450+0000 7f9f48211800 1 -- 172.21.15.164:0/4290835905 >> 172.21.15.164:0/4290835905 conn(0x55b2bb012e10 msgr2=0x55b2bb103dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.450+0000 7f9f48211800 1 -- 172.21.15.164:0/4290835905 shutdown_connections 2024-09-13T23:05:36.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.450+0000 7f9f48211800 1 -- 172.21.15.164:0/4290835905 wait complete. 2024-09-13T23:05:36.469 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-13T23:05:36.469 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-13T23:05:36.469 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-13T23:05:36.513 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:36.513 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:36.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.512+0000 7fcfe1b42800 1 Processor -- start 2024-09-13T23:05:36.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.512+0000 7fcfe1b42800 1 -- start start 2024-09-13T23:05:36.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.513+0000 7fcfe1b42800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x558c3dcf34c0 0x558c3dcf38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.513+0000 7fcfe1b42800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558c3dbb3b30 con 0x558c3dcf3e00 2024-09-13T23:05:36.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.513+0000 7fcfe1b42800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x558c3db95360 con 0x558c3dcf34c0 2024-09-13T23:05:36.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.513+0000 7fcfdd890640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x558c3dcf34c0 0x558c3dcf38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.513+0000 7fcfdd08f640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x558c3dcf3e00 0x558c3dcf8980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:41036/0 (socket says 172.21.15.164:41036) 2024-09-13T23:05:36.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.513+0000 7fcfdd08f640 1 -- 172.21.15.164:0/4161754501 learned_addr learned my addr 172.21.15.164:0/4161754501 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:36.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.513+0000 7fcfdd890640 1 -- 172.21.15.164:0/4161754501 >> v1:172.21.15.17:6789/0 conn(0x558c3dcf3e00 legacy=0x558c3dcf8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.513+0000 7fcfdd890640 1 -- 172.21.15.164:0/4161754501 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c3dbbbe00 con 0x558c3dcf34c0 2024-09-13T23:05:36.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.515+0000 7fcfdd890640 1 --2- 172.21.15.164:0/4161754501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3dcf34c0 0x558c3dcf38c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fcfd000a470 tx=0x7fcfd0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d29c77db72936079 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.515+0000 7fcfdc88e640 1 -- 172.21.15.164:0/4161754501 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfd0053570 con 0x558c3dcf34c0 2024-09-13T23:05:36.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.515+0000 7fcfdc88e640 1 -- 172.21.15.164:0/4161754501 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfd0058070 con 0x558c3dcf34c0 2024-09-13T23:05:36.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.515+0000 7fcfdc88e640 1 -- 172.21.15.164:0/4161754501 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfd0053880 con 0x558c3dcf34c0 2024-09-13T23:05:36.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.516+0000 7fcfe1b42800 1 -- 172.21.15.164:0/4161754501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3dcf34c0 msgr2=0x558c3dcf38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.516+0000 7fcfe1b42800 1 --2- 172.21.15.164:0/4161754501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3dcf34c0 0x558c3dcf38c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fcfd000a470 tx=0x7fcfd0045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:36.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.516+0000 7fcfe1b42800 1 -- 172.21.15.164:0/4161754501 shutdown_connections 2024-09-13T23:05:36.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.516+0000 7fcfe1b42800 1 --2- 172.21.15.164:0/4161754501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3dcf34c0 0x558c3dcf38c0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.516+0000 7fcfe1b42800 1 -- 172.21.15.164:0/4161754501 >> 172.21.15.164:0/4161754501 conn(0x558c3dceedf0 msgr2=0x558c3dcf1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.516+0000 7fcfe1b42800 1 -- 172.21.15.164:0/4161754501 shutdown_connections 2024-09-13T23:05:36.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.516+0000 7fcfe1b42800 1 -- 172.21.15.164:0/4161754501 wait complete. 2024-09-13T23:05:36.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.530+0000 7fcfe1b42800 1 Processor -- start 2024-09-13T23:05:36.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.530+0000 7fcfe1b42800 1 -- start start 2024-09-13T23:05:36.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.530+0000 7fcfe1b42800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3dcf34c0 0x558c3dde2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.530+0000 7fcfe1b42800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x558c3dc40330 con 0x558c3dcf34c0 2024-09-13T23:05:36.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.530+0000 7fcfdd890640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3dcf34c0 0x558c3dde2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.530+0000 7fcfdd890640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3dcf34c0 0x558c3dde2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58056/0 (socket says 172.21.15.164:58056) 2024-09-13T23:05:36.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.530+0000 7fcfdd890640 1 -- 172.21.15.164:0/2916108351 learned_addr learned my addr 172.21.15.164:0/2916108351 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.531+0000 7fcfdd890640 1 -- 172.21.15.164:0/2916108351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c3db8dbc0 con 0x558c3dcf34c0 2024-09-13T23:05:36.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.531+0000 7fcfdd890640 1 --2- 172.21.15.164:0/2916108351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3dcf34c0 0x558c3dde2770 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0025c20 tx=0x7fcfd0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b355ebf6cff6ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.531+0000 7fcecbe07640 1 -- 172.21.15.164:0/2916108351 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfd005c580 con 0x558c3dcf34c0 2024-09-13T23:05:36.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.531+0000 7fcecbe07640 1 -- 172.21.15.164:0/2916108351 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfd0063030 con 0x558c3dcf34c0 2024-09-13T23:05:36.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.531+0000 7fcecbe07640 1 -- 172.21.15.164:0/2916108351 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfd005c850 con 0x558c3dcf34c0 2024-09-13T23:05:36.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.532+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2916108351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3dcf34c0 msgr2=0x558c3dde2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.532+0000 7fcfe1b42800 1 --2- 172.21.15.164:0/2916108351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3dcf34c0 0x558c3dde2770 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0025c20 tx=0x7fcfd0051000 comp rx=0 tx=0).stop 2024-09-13T23:05:36.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.532+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2916108351 shutdown_connections 2024-09-13T23:05:36.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.532+0000 7fcfe1b42800 1 --2- 172.21.15.164:0/2916108351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3dcf34c0 0x558c3dde2770 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.532+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2916108351 >> 172.21.15.164:0/2916108351 conn(0x558c3dceedf0 msgr2=0x558c3ddde130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.532+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2916108351 shutdown_connections 2024-09-13T23:05:36.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.532+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2916108351 wait complete. 2024-09-13T23:05:36.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.532+0000 7fcfe1b42800 1 Processor -- start 2024-09-13T23:05:36.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.532+0000 7fcfe1b42800 1 -- start start 2024-09-13T23:05:36.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.532+0000 7fcfe1b42800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3dcf34c0 0x558c3dc67dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.532+0000 7fcfe1b42800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x558c3dcfa4e0 con 0x558c3dcf34c0 2024-09-13T23:05:36.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.532+0000 7fcfdd890640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3dcf34c0 0x558c3dc67dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.532+0000 7fcfdd890640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3dcf34c0 0x558c3dc67dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58072/0 (socket says 172.21.15.164:58072) 2024-09-13T23:05:36.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.532+0000 7fcfdd890640 1 -- 172.21.15.164:0/4209546571 learned_addr learned my addr 172.21.15.164:0/4209546571 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.533+0000 7fcfdd890640 1 -- 172.21.15.164:0/4209546571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c3dba1fe0 con 0x558c3dcf34c0 2024-09-13T23:05:36.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.533+0000 7fcfdd890640 1 --2- 172.21.15.164:0/4209546571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3dcf34c0 0x558c3dc67dc0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x558c3dde35d0 tx=0x7fcfd0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.533+0000 7fceca604640 1 -- 172.21.15.164:0/4209546571 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfd0054ad0 con 0x558c3dcf34c0 2024-09-13T23:05:36.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.533+0000 7fceca604640 1 -- 172.21.15.164:0/4209546571 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfd0054c70 con 0x558c3dcf34c0 2024-09-13T23:05:36.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.533+0000 7fcfe1b42800 1 -- 172.21.15.164:0/4209546571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c3ddebc10 con 0x558c3dcf34c0 2024-09-13T23:05:36.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.533+0000 7fceca604640 1 -- 172.21.15.164:0/4209546571 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfd0068420 con 0x558c3dcf34c0 2024-09-13T23:05:36.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.533+0000 7fcfe1b42800 1 -- 172.21.15.164:0/4209546571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c3ddf0570 con 0x558c3dcf34c0 2024-09-13T23:05:36.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.534+0000 7fceca604640 1 -- 172.21.15.164:0/4209546571 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fcfd00685c0 con 0x558c3dcf34c0 2024-09-13T23:05:36.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.534+0000 7fceca604640 1 --2- 172.21.15.164:0/4209546571 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fcec4036b90 0x7fcec4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.534+0000 7fceca604640 1 -- 172.21.15.164:0/4209546571 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fcfd0070030 con 0x558c3dcf34c0 2024-09-13T23:05:36.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.534+0000 7fcfdd08f640 1 --2- 172.21.15.164:0/4209546571 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fcec4036b90 0x7fcec4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.534+0000 7fcfe1b42800 1 --2- 172.21.15.164:0/4209546571 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x558c3dcf3e00 0x558c3ddf4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.534+0000 7fcfe1b42800 1 -- 172.21.15.164:0/4209546571 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c3ddf49b0 con 0x558c3dcf3e00 2024-09-13T23:05:36.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.534+0000 7fcfde091640 1 --2- 172.21.15.164:0/4209546571 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x558c3dcf3e00 0x558c3ddf4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.534+0000 7fcfdd08f640 1 --2- 172.21.15.164:0/4209546571 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fcec4036b90 0x7fcec4039050 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4000f60 tx=0x7fcfd40012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.535+0000 7fcfde091640 1 --2- 172.21.15.164:0/4209546571 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x558c3dcf3e00 0x558c3ddf4390 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.535+0000 7fcfde091640 1 -- 172.21.15.164:0/4209546571 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcfd800a4a0 con 0x558c3dcf3e00 2024-09-13T23:05:36.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.535+0000 7fcfe1b42800 1 -- 172.21.15.164:0/4209546571 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c3ddf1960 con 0x558c3dcf3e00 2024-09-13T23:05:36.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.535+0000 7fcfde091640 1 -- 172.21.15.164:0/4209546571 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcfd800a4a0 con 0x558c3dcf3e00 2024-09-13T23:05:36.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.535+0000 7fcfe1b42800 1 -- 172.21.15.164:0/4209546571 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c3ddf6820 con 0x558c3dcf3e00 2024-09-13T23:05:36.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.535+0000 7fcfde091640 1 -- 172.21.15.164:0/4209546571 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcfd800a4a0 con 0x558c3dcf3e00 2024-09-13T23:05:36.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.535+0000 7fcfe1b42800 1 -- 172.21.15.164:0/4209546571 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c3ddf5a50 con 0x558c3dcf3e00 2024-09-13T23:05:36.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.536+0000 7fcfde091640 1 -- 172.21.15.164:0/4209546571 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcfd800a4a0 con 0x558c3dcf3e00 2024-09-13T23:05:36.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.536+0000 7fcfe1b42800 1 -- 172.21.15.164:0/4209546571 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c3ddf5ea0 con 0x558c3dcf3e00 2024-09-13T23:05:36.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.536+0000 7fcfde091640 1 -- 172.21.15.164:0/4209546571 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcfd800a4a0 con 0x558c3dcf3e00 2024-09-13T23:05:36.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.536+0000 7fcfe1b42800 1 Processor -- start 2024-09-13T23:05:36.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.536+0000 7fcfe1b42800 1 -- start start 2024-09-13T23:05:36.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.536+0000 7fcfe1b42800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3de04e10 0x558c3de05230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.536+0000 7fcfe1b42800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x558c3db8f580 con 0x558c3de04e10 2024-09-13T23:05:36.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.537+0000 7fcfdd08f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3de04e10 0x558c3de05230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.537+0000 7fcfdd08f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3de04e10 0x558c3de05230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58076/0 (socket says 172.21.15.164:58076) 2024-09-13T23:05:36.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.537+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2116918857 learned_addr learned my addr 172.21.15.164:0/2116918857 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.537+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2116918857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c3de05770 con 0x558c3de04e10 2024-09-13T23:05:36.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.537+0000 7fcfdd08f640 1 --2- 172.21.15.164:0/2116918857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3de04e10 0x558c3de05230 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4001ed0 tx=0x7fcfd400d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.537+0000 7fcec37fe640 1 -- 172.21.15.164:0/2116918857 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfd401b550 con 0x558c3de04e10 2024-09-13T23:05:36.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.537+0000 7fcec37fe640 1 -- 172.21.15.164:0/2116918857 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfd401b6f0 con 0x558c3de04e10 2024-09-13T23:05:36.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.537+0000 7fcec37fe640 1 -- 172.21.15.164:0/2116918857 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfd401b9d0 con 0x558c3de04e10 2024-09-13T23:05:36.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.537+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2116918857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c3de05a00 con 0x558c3de04e10 2024-09-13T23:05:36.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.537+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2116918857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c3de086e0 con 0x558c3de04e10 2024-09-13T23:05:36.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.538+0000 7fcec37fe640 1 -- 172.21.15.164:0/2116918857 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fcfd4023020 con 0x558c3de04e10 2024-09-13T23:05:36.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.538+0000 7fcec37fe640 1 --2- 172.21.15.164:0/2116918857 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fceb8036b90 0x7fceb8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.538+0000 7fcec37fe640 1 -- 172.21.15.164:0/2116918857 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fcfd4021020 con 0x558c3de04e10 2024-09-13T23:05:36.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.538+0000 7fcfde091640 1 --2- 172.21.15.164:0/2116918857 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fceb8036b90 0x7fceb8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.539+0000 7fcfe1b42800 1 Processor -- start 2024-09-13T23:05:36.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.539+0000 7fcfde091640 1 --2- 172.21.15.164:0/2116918857 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fceb8036b90 0x7fceb8039050 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x558c3ddf5570 tx=0x7fcfd8005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.539+0000 7fcfe1b42800 1 -- start start 2024-09-13T23:05:36.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.539+0000 7fcfe1b42800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3de11b20 0x558c3de11f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.539+0000 7fcfe1b42800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x558c3dde2ec0 con 0x558c3de11b20 2024-09-13T23:05:36.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.539+0000 7fcfdd08f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3de11b20 0x558c3de11f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.539+0000 7fcfdd08f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3de11b20 0x558c3de11f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58090/0 (socket says 172.21.15.164:58090) 2024-09-13T23:05:36.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.539+0000 7fcfdd08f640 1 -- 172.21.15.164:0/438263682 learned_addr learned my addr 172.21.15.164:0/438263682 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.539+0000 7fcfdd08f640 1 -- 172.21.15.164:0/438263682 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c3de124f0 con 0x558c3de11b20 2024-09-13T23:05:36.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.539+0000 7fcfdd08f640 1 --2- 172.21.15.164:0/438263682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3de11b20 0x558c3de11f20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcfd404d100 tx=0x7fcfd4019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e222e09fb70a46b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.540+0000 7fcec17fa640 1 -- 172.21.15.164:0/438263682 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfd40258e0 con 0x558c3de11b20 2024-09-13T23:05:36.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.540+0000 7fcec17fa640 1 -- 172.21.15.164:0/438263682 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfd4025410 con 0x558c3de11b20 2024-09-13T23:05:36.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.540+0000 7fcec17fa640 1 -- 172.21.15.164:0/438263682 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfd4025a80 con 0x558c3de11b20 2024-09-13T23:05:36.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.540+0000 7fcfe1b42800 1 -- 172.21.15.164:0/438263682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3de11b20 msgr2=0x558c3de11f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.540+0000 7fcfe1b42800 1 --2- 172.21.15.164:0/438263682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3de11b20 0x558c3de11f20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcfd404d100 tx=0x7fcfd4019ce0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.540+0000 7fcfe1b42800 1 -- 172.21.15.164:0/438263682 shutdown_connections 2024-09-13T23:05:36.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.540+0000 7fcfe1b42800 1 --2- 172.21.15.164:0/438263682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3de11b20 0x558c3de11f20 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.540+0000 7fcfe1b42800 1 -- 172.21.15.164:0/438263682 >> 172.21.15.164:0/438263682 conn(0x558c3de0de80 msgr2=0x558c3de0bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.540+0000 7fcfe1b42800 1 -- 172.21.15.164:0/438263682 shutdown_connections 2024-09-13T23:05:36.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.540+0000 7fcfe1b42800 1 -- 172.21.15.164:0/438263682 wait complete. 2024-09-13T23:05:36.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.540+0000 7fcfe1b42800 1 Processor -- start 2024-09-13T23:05:36.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.540+0000 7fcfe1b42800 1 -- start start 2024-09-13T23:05:36.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.541+0000 7fcfe1b42800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3de11b20 0x558c3de19030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.541+0000 7fcfe1b42800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x558c3de12b60 con 0x558c3de11b20 2024-09-13T23:05:36.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.541+0000 7fcfdd08f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3de11b20 0x558c3de19030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.541+0000 7fcfdd08f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3de11b20 0x558c3de19030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58094/0 (socket says 172.21.15.164:58094) 2024-09-13T23:05:36.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.541+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 learned_addr learned my addr 172.21.15.164:0/2432628551 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.541+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c3de19570 con 0x558c3de11b20 2024-09-13T23:05:36.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.541+0000 7fcfdd08f640 1 --2- 172.21.15.164:0/2432628551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3de11b20 0x558c3de19030 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fcfd404d1c0 tx=0x7fcfd404d090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.541+0000 7fceaf7fe640 1 -- 172.21.15.164:0/2432628551 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfd400cc60 con 0x558c3de11b20 2024-09-13T23:05:36.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.541+0000 7fceaf7fe640 1 -- 172.21.15.164:0/2432628551 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfd400ce00 con 0x558c3de11b20 2024-09-13T23:05:36.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.541+0000 7fceaf7fe640 1 -- 172.21.15.164:0/2432628551 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfd4040990 con 0x558c3de11b20 2024-09-13T23:05:36.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.541+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c3de19800 con 0x558c3de11b20 2024-09-13T23:05:36.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.541+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c3de19800 con 0x558c3de11b20 2024-09-13T23:05:36.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.542+0000 7fceaf7fe640 1 -- 172.21.15.164:0/2432628551 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fcfd4040b30 con 0x558c3de11b20 2024-09-13T23:05:36.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.542+0000 7fceaf7fe640 1 --2- 172.21.15.164:0/2432628551 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fcea8036b40 0x7fcea8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.542+0000 7fceaf7fe640 1 -- 172.21.15.164:0/2432628551 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fcfd4035070 con 0x558c3de11b20 2024-09-13T23:05:36.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.542+0000 7fcfde091640 1 --2- 172.21.15.164:0/2432628551 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fcea8036b40 0x7fcea8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.543+0000 7fcfde091640 1 --2- 172.21.15.164:0/2432628551 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fcea8036b40 0x7fcea8039000 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x558c3ddf18b0 tx=0x7fcfd801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.543+0000 7fcfe1b42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.543+0000 7fcfe1b42800 1 --2- 172.21.15.164:0/2432628551 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x558c3de24960 0x558c3de26e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.543+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c3de27570 con 0x558c3de24960 2024-09-13T23:05:36.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.543+0000 7fcfdd890640 1 --2- 172.21.15.164:0/2432628551 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x558c3de24960 0x558c3de26e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.543+0000 7fcfdd890640 1 --2- 172.21.15.164:0/2432628551 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x558c3de24960 0x558c3de26e20 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.544+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.544+0000 7fcfe1b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.544+0000 7fcfe1b42800 20 realm 2024-09-13T23:05:36.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.544+0000 7fcfe1b42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.544+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c3de27980 con 0x558c3de24960 2024-09-13T23:05:36.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.544+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.544+0000 7fcfe1b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.544+0000 7fcfe1b42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:36.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.544+0000 7fcfe1b42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.544+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c3de28250 con 0x558c3de24960 2024-09-13T23:05:36.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.544+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.544+0000 7fcfe1b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.544+0000 7fcfe1b42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.544+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c3de285f0 con 0x558c3de24960 2024-09-13T23:05:36.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.544+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.544+0000 7fcfe1b42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:36.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.544+0000 7fcfe1b42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.544+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c3de28e40 con 0x558c3de24960 2024-09-13T23:05:36.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.545+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.545+0000 7fcfe1b42800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:36.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.545+0000 7fcfe1b42800 20 searching for the correct realm 2024-09-13T23:05:36.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.545+0000 7fcfe1b42800 1 --2- 172.21.15.164:0/2432628551 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x558c3de2abb0 0x558c3de2cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.545+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x558c3de2abb0 2024-09-13T23:05:36.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.545+0000 7fcfdd08f640 1 --2- 172.21.15.164:0/2432628551 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x558c3de2abb0 0x558c3de2cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.545+0000 7fcfdd08f640 1 --2- 172.21.15.164:0/2432628551 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x558c3de2abb0 0x558c3de2cfa0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.545+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfd403f020 con 0x558c3de2abb0 2024-09-13T23:05:36.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.545+0000 7fcfdd08f640 1 --2- 172.21.15.164:0/2432628551 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fcfd4033b80 0x7fcfd404d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.545+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x7fcfd4033b80 2024-09-13T23:05:36.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.545+0000 7fcfde091640 1 --2- 172.21.15.164:0/2432628551 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fcfd4033b80 0x7fcfd404d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.546+0000 7fcfde091640 1 --2- 172.21.15.164:0/2432628551 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fcfd4033b80 0x7fcfd404d990 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.546+0000 7fcfde091640 1 -- 172.21.15.164:0/2432628551 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfd801f070 con 0x7fcfd4033b80 2024-09-13T23:05:36.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.546+0000 7fcfde091640 1 --2- 172.21.15.164:0/2432628551 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fcfd8031040 0x7fcfd8032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.546+0000 7fcfde091640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x7fcfd8031040 2024-09-13T23:05:36.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.546+0000 7fcfdd890640 1 --2- 172.21.15.164:0/2432628551 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fcfd8031040 0x7fcfd8032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.547+0000 7fcfdd890640 1 --2- 172.21.15.164:0/2432628551 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fcfd8031040 0x7fcfd8032430 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.547+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.547+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x558c3de24960 2024-09-13T23:05:36.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.547+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.547+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x558c3de24960 2024-09-13T23:05:36.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.547+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.547+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x7fcfd8031040 2024-09-13T23:05:36.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.548+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.548+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x7fcfd8031040 2024-09-13T23:05:36.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.548+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.548+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x7fcfd4033b80 2024-09-13T23:05:36.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.548+0000 7fcfde091640 1 -- 172.21.15.164:0/2432628551 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfd801f070 con 0x7fcfd4033b80 2024-09-13T23:05:36.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.548+0000 7fcfde091640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x558c3de2abb0 2024-09-13T23:05:36.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.548+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfd405d040 con 0x558c3de2abb0 2024-09-13T23:05:36.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.548+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x558c3de24960 2024-09-13T23:05:36.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.549+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.549+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x7fcfd8031040 2024-09-13T23:05:36.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.549+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.549+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x558c3de24960 2024-09-13T23:05:36.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.549+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.549+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x7fcfd4033b80 2024-09-13T23:05:36.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.549+0000 7fcfde091640 1 -- 172.21.15.164:0/2432628551 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcfd801f070 con 0x7fcfd4033b80 2024-09-13T23:05:36.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.549+0000 7fcfde091640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x558c3de2abb0 2024-09-13T23:05:36.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.550+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfd405d040 con 0x558c3de2abb0 2024-09-13T23:05:36.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.550+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x558c3de2abb0 2024-09-13T23:05:36.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.550+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfd405d040 con 0x558c3de2abb0 2024-09-13T23:05:36.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.550+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x7fcfd8031040 2024-09-13T23:05:36.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.550+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.550+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x558c3de2abb0 2024-09-13T23:05:36.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.550+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfd405d040 con 0x558c3de2abb0 2024-09-13T23:05:36.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.550+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x558c3de2abb0 2024-09-13T23:05:36.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.551+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfd405d040 con 0x558c3de2abb0 2024-09-13T23:05:36.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.551+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x558c3de24960 2024-09-13T23:05:36.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.551+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.551+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x558c3de24960 2024-09-13T23:05:36.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.551+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.551+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x7fcfd8031040 2024-09-13T23:05:36.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.551+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.551+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x558c3de2abb0 2024-09-13T23:05:36.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.552+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfd405d040 con 0x558c3de2abb0 2024-09-13T23:05:36.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.552+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x7fcfd4033b80 2024-09-13T23:05:36.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.552+0000 7fcfde091640 1 -- 172.21.15.164:0/2432628551 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfd801f070 con 0x7fcfd4033b80 2024-09-13T23:05:36.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.552+0000 7fcfde091640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x558c3de24960 2024-09-13T23:05:36.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.552+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.552+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x7fcfd8031040 2024-09-13T23:05:36.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.552+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.552+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x558c3de2abb0 2024-09-13T23:05:36.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.553+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfd405d040 con 0x558c3de2abb0 2024-09-13T23:05:36.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.553+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x7fcfd8031040 2024-09-13T23:05:36.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.553+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.553+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x7fcfd4033b80 2024-09-13T23:05:36.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.553+0000 7fcfde091640 1 -- 172.21.15.164:0/2432628551 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfd801f070 con 0x7fcfd4033b80 2024-09-13T23:05:36.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.553+0000 7fcfde091640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x558c3de2abb0 2024-09-13T23:05:36.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.553+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfd405d040 con 0x558c3de2abb0 2024-09-13T23:05:36.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.553+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x7fcfd8031040 2024-09-13T23:05:36.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.554+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.554+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x558c3de24960 2024-09-13T23:05:36.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.554+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.554+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d560 con 0x7fcfd4033b80 2024-09-13T23:05:36.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.554+0000 7fcfde091640 1 -- 172.21.15.164:0/2432628551 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfd801f070 con 0x7fcfd4033b80 2024-09-13T23:05:36.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.554+0000 7fcfe1b42800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:36.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.554+0000 7fcfe1b42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:36.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.554+0000 7fcfe1b42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:36.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.554+0000 7fcfe1b42800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:36.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.554+0000 7fcfe1b42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:36.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.554+0000 7fcfe1b42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:36.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.554+0000 7fcfe1b42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.554+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c3de297f0 con 0x558c3de24960 2024-09-13T23:05:36.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.554+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.554+0000 7fcfe1b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.554+0000 7fcfe1b42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.554+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2a090 con 0x558c3de24960 2024-09-13T23:05:36.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.555+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.555+0000 7fcfe1b42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:36.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.555+0000 7fcfe1b42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.555+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2a090 con 0x558c3de24960 2024-09-13T23:05:36.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.555+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.555+0000 7fcfe1b42800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:36.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.555+0000 7fcfe1b42800 20 zone default found 2024-09-13T23:05:36.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.555+0000 7fcfe1b42800 4 Realm: () 2024-09-13T23:05:36.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.555+0000 7fcfe1b42800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:36.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.555+0000 7fcfe1b42800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:36.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.555+0000 7fcfe1b42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:36.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.555+0000 7fcfe1b42800 20 zonegroup default 2024-09-13T23:05:36.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.555+0000 7fcfe1b42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.555+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2d9e0 con 0x7fcfd8031040 2024-09-13T23:05:36.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.555+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.555+0000 7fcfe1b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.555+0000 7fcfe1b42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.555+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2f440 con 0x558c3de2abb0 2024-09-13T23:05:36.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.555+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcfd405d040 con 0x558c3de2abb0 2024-09-13T23:05:36.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.556+0000 7fcfe1b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.556+0000 7fcfe1b42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.556+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2f910 con 0x558c3de2abb0 2024-09-13T23:05:36.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.556+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcfd405d040 con 0x558c3de2abb0 2024-09-13T23:05:36.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.556+0000 7fcfe1b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.556+0000 7fcfe1b42800 20 started sync module instance, tier type = 2024-09-13T23:05:36.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.556+0000 7fcfe1b42800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:36.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.556+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2e860 con 0x7fcfd4033b80 2024-09-13T23:05:36.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.557+0000 7fcfde091640 1 -- 172.21.15.164:0/2432628551 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfd8040040 con 0x7fcfd4033b80 2024-09-13T23:05:36.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.557+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94060822064208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2e4c0 con 0x7fcfd4033b80 2024-09-13T23:05:36.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.557+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de30840 con 0x558c3de24960 2024-09-13T23:05:36.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.558+0000 7fcfde091640 1 -- 172.21.15.164:0/2432628551 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94060822064208] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfd8040040 con 0x7fcfd4033b80 2024-09-13T23:05:36.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.558+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.558+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94060822068592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de30840 con 0x558c3de24960 2024-09-13T23:05:36.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.558+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de31240 con 0x558c3de2abb0 2024-09-13T23:05:36.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.559+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfd405d040 con 0x558c3de2abb0 2024-09-13T23:05:36.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.559+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94060822072656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de31a90 con 0x558c3de2abb0 2024-09-13T23:05:36.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.559+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de32550 con 0x7fcfd4033b80 2024-09-13T23:05:36.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.559+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94060822068592] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.560+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94060822072656] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfd405d040 con 0x558c3de2abb0 2024-09-13T23:05:36.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.560+0000 7fcfde091640 1 -- 172.21.15.164:0/2432628551 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfd8040040 con 0x7fcfd4033b80 2024-09-13T23:05:36.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.560+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94060822074848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de30390 con 0x7fcfd4033b80 2024-09-13T23:05:36.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.560+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de32e20 con 0x558c3de24960 2024-09-13T23:05:36.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.561+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.561+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94060822079856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de32dd0 con 0x558c3de24960 2024-09-13T23:05:36.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.561+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de33dd0 con 0x7fcfd8031040 2024-09-13T23:05:36.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.561+0000 7fcfde091640 1 -- 172.21.15.164:0/2432628551 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94060822074848] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfd8040040 con 0x7fcfd4033b80 2024-09-13T23:05:36.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.562+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.562+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94060822077472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de33d90 con 0x7fcfd8031040 2024-09-13T23:05:36.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.562+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de34790 con 0x7fcfd8031040 2024-09-13T23:05:36.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.562+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94060822079856] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.563+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94060822077472] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.563+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.563+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94060822086304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de338e0 con 0x7fcfd8031040 2024-09-13T23:05:36.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.563+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de35030 con 0x7fcfd8031040 2024-09-13T23:05:36.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.565+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94060822086304] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.565+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.565+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94060822082064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de338e0 con 0x7fcfd8031040 2024-09-13T23:05:36.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.565+0000 7fcfe1b42800 20 add_watcher() i=0 2024-09-13T23:05:36.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.565+0000 7fcfe1b42800 20 add_watcher() i=1 2024-09-13T23:05:36.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.565+0000 7fcfe1b42800 20 add_watcher() i=2 2024-09-13T23:05:36.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.565+0000 7fcfe1b42800 20 add_watcher() i=3 2024-09-13T23:05:36.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.565+0000 7fcfe1b42800 20 add_watcher() i=4 2024-09-13T23:05:36.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.565+0000 7fcfe1b42800 20 add_watcher() i=5 2024-09-13T23:05:36.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.565+0000 7fcfe1b42800 20 add_watcher() i=6 2024-09-13T23:05:36.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.566+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94060822082064] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.566+0000 7fcfe1b42800 20 add_watcher() i=7 2024-09-13T23:05:36.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.566+0000 7fcfe1b42800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:36.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.566+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c3de38030 con 0x558c3de24960 2024-09-13T23:05:36.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.566+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.566+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94060822088208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de35520 con 0x558c3de24960 2024-09-13T23:05:36.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.567+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94060822088208] v32'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.567+0000 7fce8f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:36.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.567+0000 7fcfe1b42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:36.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.567+0000 7fcfe1b42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:36.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.567+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de37e40 con 0x558c3de24960 2024-09-13T23:05:36.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.568+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.568+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de411a0 con 0x7fcfd8031040 2024-09-13T23:05:36.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.569+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.569+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de411a0 con 0x558c3de2abb0 2024-09-13T23:05:36.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.570+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcfd405d040 con 0x558c3de2abb0 2024-09-13T23:05:36.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.570+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de41540 con 0x558c3de24960 2024-09-13T23:05:36.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.571+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'122 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.571+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de41540 con 0x7fcfd4033b80 2024-09-13T23:05:36.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.572+0000 7fcfde091640 1 -- 172.21.15.164:0/2432628551 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'35 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcfd8040040 con 0x7fcfd4033b80 2024-09-13T23:05:36.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.572+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de41ad0 con 0x558c3de2abb0 2024-09-13T23:05:36.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.573+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'23 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcfd405d040 con 0x558c3de2abb0 2024-09-13T23:05:36.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.573+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de41ad0 con 0x558c3de24960 2024-09-13T23:05:36.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.574+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.574+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de41ad0 con 0x7fcfd8031040 2024-09-13T23:05:36.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.575+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'23 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.575+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de41ad0 con 0x7fcfd4033b80 2024-09-13T23:05:36.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.576+0000 7fcfde091640 1 -- 172.21.15.164:0/2432628551 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcfd8040040 con 0x7fcfd4033b80 2024-09-13T23:05:36.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.576+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de420c0 con 0x558c3de2abb0 2024-09-13T23:05:36.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.577+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcfd405d040 con 0x558c3de2abb0 2024-09-13T23:05:36.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.577+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de420c0 con 0x7fcfd4033b80 2024-09-13T23:05:36.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.578+0000 7fcfde091640 1 -- 172.21.15.164:0/2432628551 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'36 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfd8040040 con 0x7fcfd4033b80 2024-09-13T23:05:36.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.578+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de42630 con 0x7fcfd8031040 2024-09-13T23:05:36.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.579+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.579+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de42630 con 0x7fcfd4033b80 2024-09-13T23:05:36.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.580+0000 7fcfde091640 1 -- 172.21.15.164:0/2432628551 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfd8040040 con 0x7fcfd4033b80 2024-09-13T23:05:36.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.580+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de42ae0 con 0x7fcfd8031040 2024-09-13T23:05:36.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.582+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'29 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.582+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de42ae0 con 0x558c3de24960 2024-09-13T23:05:36.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.583+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'123 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.583+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de42ae0 con 0x558c3de2abb0 2024-09-13T23:05:36.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.584+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'29 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfd405d040 con 0x558c3de2abb0 2024-09-13T23:05:36.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.584+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de42ae0 con 0x7fcfd4033b80 2024-09-13T23:05:36.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.585+0000 7fcfde091640 1 -- 172.21.15.164:0/2432628551 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'37 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfd8040040 con 0x7fcfd4033b80 2024-09-13T23:05:36.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.585+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de42ae0 con 0x558c3de2abb0 2024-09-13T23:05:36.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.586+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfd405d040 con 0x558c3de2abb0 2024-09-13T23:05:36.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.586+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de42ae0 con 0x558c3de24960 2024-09-13T23:05:36.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.587+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.587+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de42ae0 con 0x558c3de24960 2024-09-13T23:05:36.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.588+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'124 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.588+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de42ae0 con 0x558c3de2abb0 2024-09-13T23:05:36.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.589+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'30 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfd405d040 con 0x558c3de2abb0 2024-09-13T23:05:36.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.589+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de42ae0 con 0x7fcfd4033b80 2024-09-13T23:05:36.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.590+0000 7fcfde091640 1 -- 172.21.15.164:0/2432628551 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfd8040040 con 0x7fcfd4033b80 2024-09-13T23:05:36.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.590+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de42ae0 con 0x558c3de2abb0 2024-09-13T23:05:36.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.591+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfd405d040 con 0x558c3de2abb0 2024-09-13T23:05:36.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.591+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de42ae0 con 0x558c3de2abb0 2024-09-13T23:05:36.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.592+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfd405d040 con 0x558c3de2abb0 2024-09-13T23:05:36.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.592+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de42ae0 con 0x558c3de2abb0 2024-09-13T23:05:36.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.593+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfd405d040 con 0x558c3de2abb0 2024-09-13T23:05:36.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.593+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de42ae0 con 0x558c3de2abb0 2024-09-13T23:05:36.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.594+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfd405d040 con 0x558c3de2abb0 2024-09-13T23:05:36.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.594+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de42ae0 con 0x7fcfd8031040 2024-09-13T23:05:36.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.595+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.595+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de42ae0 con 0x558c3de2abb0 2024-09-13T23:05:36.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.596+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfd405d040 con 0x558c3de2abb0 2024-09-13T23:05:36.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.596+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de42ae0 con 0x7fcfd8031040 2024-09-13T23:05:36.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.597+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.597+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de42ae0 con 0x558c3de2abb0 2024-09-13T23:05:36.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.598+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'31 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfd405d040 con 0x558c3de2abb0 2024-09-13T23:05:36.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.598+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de42ae0 con 0x7fcfd8031040 2024-09-13T23:05:36.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.600+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'30 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.600+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de42ae0 con 0x7fcfd4033b80 2024-09-13T23:05:36.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.601+0000 7fcfde091640 1 -- 172.21.15.164:0/2432628551 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfd8040040 con 0x7fcfd4033b80 2024-09-13T23:05:36.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.601+0000 7fce8e7fc640 20 reqs_thread_entry: start 2024-09-13T23:05:36.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.601+0000 7fcfe1b42800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:36.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.601+0000 7fcfe1b42800 20 Filter name: none 2024-09-13T23:05:36.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.601+0000 7fcdfffff640 20 reqs_thread_entry: start 2024-09-13T23:05:36.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.601+0000 7fcfe1b42800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T23:05:36.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.601+0000 7fcfe1b42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.601+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c3de6d910 con 0x7fcfd8031040 2024-09-13T23:05:36.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.602+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.602+0000 7fcfe1b42800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T23:05:36.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.602+0000 7fcfe1b42800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T23:05:36.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.602+0000 7fcfe1b42800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:05:36.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.602+0000 7fcfe1b42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:36.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.602+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c3de702e0 con 0x7fcfd8031040 2024-09-13T23:05:36.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.602+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.602+0000 7fcfe1b42800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-13T23:05:36.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.602+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de6e2c0 con 0x7fcfd8031040 2024-09-13T23:05:36.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.603+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v32'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.603+0000 7fcfe1b42800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T23:05:36.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.603+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94060822326816 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c3de708a0 con 0x558c3de2abb0 2024-09-13T23:05:36.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.603+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 26 ==== watch-notify(notify (1) cookie 94060822072656 notify 137438953475 ret 0) ==== 212+0+0 (crc 0 0 0) 0x558c3de41b20 con 0x558c3de2abb0 2024-09-13T23:05:36.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.603+0000 7fcec17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94060822072656 notifier 4540 bl.length()=170 2024-09-13T23:05:36.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.603+0000 7fcec17fa640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fcea0003d60 con 0x558c3de2abb0 2024-09-13T23:05:36.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.603+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 27 ==== osd_op_reply(97 notify.2 [notify cookie 94060822326816 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcfd405d040 con 0x558c3de2abb0 2024-09-13T23:05:36.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.604+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfd405d040 con 0x558c3de2abb0 2024-09-13T23:05:36.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.604+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 29 ==== watch-notify(notify_complete (2) cookie 94060822326816 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558c3de124f0 con 0x558c3de2abb0 2024-09-13T23:05:36.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.604+0000 7fcfe1b42800 10 removing email index: 2024-09-13T23:05:36.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.604+0000 7fcfe1b42800 10 removing user buckets index 2024-09-13T23:05:36.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.604+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de70820 con 0x7fcfd8031040 2024-09-13T23:05:36.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.605+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 27 ==== osd_op_reply(99 fud.buckets [delete] v32'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.605+0000 7fcfe1b42800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-13T23:05:36.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.605+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94060822333472 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c3de6fe30 con 0x7fcfd8031040 2024-09-13T23:05:36.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.605+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 28 ==== watch-notify(notify (1) cookie 94060822086304 notify 137438953481 ret 0) ==== 202+0+0 (crc 0 0 0) 0x558c3de37b20 con 0x7fcfd8031040 2024-09-13T23:05:36.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.605+0000 7fcec0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94060822086304 notifier 4540 bl.length()=160 2024-09-13T23:05:36.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.605+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 29 ==== osd_op_reply(100 notify.6 [notify cookie 94060822333472 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.605+0000 7fcec0ff9640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fce080032c0 con 0x7fcfd8031040 2024-09-13T23:05:36.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.606+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 30 ==== watch-notify(notify_complete (2) cookie 94060822333472 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcfd0097040 con 0x7fcfd8031040 2024-09-13T23:05:36.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.606+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 31 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.606+0000 7fcfe1b42800 10 removing user index: fud 2024-09-13T23:05:36.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.606+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de70820 con 0x7fcfd8031040 2024-09-13T23:05:36.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.607+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 32 ==== osd_op_reply(102 fud [call,call,delete] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.607+0000 7fcfe1b42800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-13T23:05:36.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.607+0000 7fcfe1b42800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T23:05:36.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.607+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94060822333472 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c3de6ee20 con 0x7fcfd8031040 2024-09-13T23:05:36.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.607+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 33 ==== watch-notify(notify (1) cookie 94060822077472 notify 137438953482 ret 0) ==== 194+0+0 (crc 0 0 0) 0x7fcfd0097040 con 0x7fcfd8031040 2024-09-13T23:05:36.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.607+0000 7fcec17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953482 cookie 94060822077472 notifier 4540 bl.length()=152 2024-09-13T23:05:36.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.607+0000 7fcec17fa640 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fcea0003d60 con 0x7fcfd8031040 2024-09-13T23:05:36.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.607+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 34 ==== osd_op_reply(103 notify.5 [notify cookie 94060822333472 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.608+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 35 ==== watch-notify(notify_complete (2) cookie 94060822333472 notify 137438953482 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558c3ddf0570 con 0x7fcfd8031040 2024-09-13T23:05:36.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.608+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 36 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.609+0000 7fce8f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:36.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.609+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94060822088208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de70820 con 0x558c3de24960 2024-09-13T23:05:36.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.610+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94060822088208] v32'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.610+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94060822064208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de70820 con 0x7fcfd4033b80 2024-09-13T23:05:36.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.610+0000 7fcfde091640 1 -- 172.21.15.164:0/2432628551 <== osd.2 v2:172.21.15.164:6808/3795914978 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94060822064208] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfd8040040 con 0x7fcfd4033b80 2024-09-13T23:05:36.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.611+0000 7fcfe1b42800 20 remove_watcher() i=0 2024-09-13T23:05:36.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.611+0000 7fcfe1b42800 2 removed watcher, disabling cache 2024-09-13T23:05:36.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.611+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94060822068592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de70820 con 0x558c3de24960 2024-09-13T23:05:36.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.612+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94060822068592] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.612+0000 7fcfe1b42800 20 remove_watcher() i=1 2024-09-13T23:05:36.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.612+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94060822072656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de2fd70 con 0x558c3de2abb0 2024-09-13T23:05:36.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.613+0000 7fcfdd08f640 1 -- 172.21.15.164:0/2432628551 <== osd.3 v2:172.21.15.164:6816/93809510 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94060822072656] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfd405d040 con 0x558c3de2abb0 2024-09-13T23:05:36.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.613+0000 7fcfe1b42800 20 remove_watcher() i=2 2024-09-13T23:05:36.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.613+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94060822074848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de70820 con 0x7fcfd4033b80 2024-09-13T23:05:36.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.614+0000 7fcfde091640 1 -- 172.21.15.164:0/2432628551 <== osd.2 v2:172.21.15.164:6808/3795914978 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94060822074848] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfd8040040 con 0x7fcfd4033b80 2024-09-13T23:05:36.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.614+0000 7fcfe1b42800 20 remove_watcher() i=3 2024-09-13T23:05:36.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.614+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94060822079856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de315e0 con 0x558c3de24960 2024-09-13T23:05:36.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.615+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94060822079856] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x558c3de24960 2024-09-13T23:05:36.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.615+0000 7fcfe1b42800 20 remove_watcher() i=4 2024-09-13T23:05:36.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.615+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94060822077472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de70820 con 0x7fcfd8031040 2024-09-13T23:05:36.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.616+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 37 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94060822077472] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.616+0000 7fcfe1b42800 20 remove_watcher() i=5 2024-09-13T23:05:36.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.616+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94060822086304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de32970 con 0x7fcfd8031040 2024-09-13T23:05:36.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.617+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 38 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94060822086304] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.617+0000 7fcfe1b42800 20 remove_watcher() i=6 2024-09-13T23:05:36.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.617+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94060822082064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c3de70820 con 0x7fcfd8031040 2024-09-13T23:05:36.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.618+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 <== osd.0 v2:172.21.15.17:6800/489863589 39 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94060822082064] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfd0051070 con 0x7fcfd8031040 2024-09-13T23:05:36.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.618+0000 7fcfe1b42800 20 remove_watcher() i=7 2024-09-13T23:05:36.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.618+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fcfd8031040 msgr2=0x7fcfd8032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.618+0000 7fcfe1b42800 1 --2- 172.21.15.164:0/2432628551 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fcfd8031040 0x7fcfd8032430 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.618+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x558c3de24960 msgr2=0x558c3de26e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.618+0000 7fcfe1b42800 1 --2- 172.21.15.164:0/2432628551 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x558c3de24960 0x558c3de26e20 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.618+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fcfd4033b80 msgr2=0x7fcfd404d990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.618+0000 7fcfe1b42800 1 --2- 172.21.15.164:0/2432628551 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fcfd4033b80 0x7fcfd404d990 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.618+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x558c3de2abb0 msgr2=0x558c3de2cfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.618+0000 7fcfe1b42800 1 --2- 172.21.15.164:0/2432628551 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x558c3de2abb0 0x558c3de2cfa0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.618+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fcea8036b40 msgr2=0x7fcea8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.618+0000 7fcfe1b42800 1 --2- 172.21.15.164:0/2432628551 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fcea8036b40 0x7fcea8039000 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x558c3ddf18b0 tx=0x7fcfd801f000 comp rx=0 tx=0).stop 2024-09-13T23:05:36.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.618+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3de11b20 msgr2=0x558c3de19030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.618+0000 7fcfdd890640 1 -- 172.21.15.164:0/2432628551 reap_dead start 2024-09-13T23:05:36.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.618+0000 7fcfe1b42800 1 --2- 172.21.15.164:0/2432628551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3de11b20 0x558c3de19030 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fcfd404d1c0 tx=0x7fcfd404d090 comp rx=0 tx=0).stop 2024-09-13T23:05:36.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.618+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 shutdown_connections 2024-09-13T23:05:36.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.618+0000 7fcfe1b42800 1 --2- 172.21.15.164:0/2432628551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3de11b20 0x558c3de19030 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.618+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 >> 172.21.15.164:0/2432628551 conn(0x558c3de0de80 msgr2=0x558c3de0bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.618+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 shutdown_connections 2024-09-13T23:05:36.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.618+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2432628551 wait complete. 2024-09-13T23:05:36.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.619+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2116918857 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fceb8036b90 msgr2=0x7fceb8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.619+0000 7fcfe1b42800 1 --2- 172.21.15.164:0/2116918857 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fceb8036b90 0x7fceb8039050 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x558c3ddf5570 tx=0x7fcfd8005840 comp rx=0 tx=0).stop 2024-09-13T23:05:36.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.619+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2116918857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3de04e10 msgr2=0x558c3de05230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.619+0000 7fcfe1b42800 1 --2- 172.21.15.164:0/2116918857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3de04e10 0x558c3de05230 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4001ed0 tx=0x7fcfd400d7a0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.619+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2116918857 shutdown_connections 2024-09-13T23:05:36.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.619+0000 7fcfe1b42800 1 --2- 172.21.15.164:0/2116918857 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fceb8036b90 0x7fceb8039050 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.619+0000 7fcfe1b42800 1 --2- 172.21.15.164:0/2116918857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3de04e10 0x558c3de05230 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.619+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2116918857 >> 172.21.15.164:0/2116918857 conn(0x558c3ddf9da0 msgr2=0x558c3ddfc920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.619+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2116918857 shutdown_connections 2024-09-13T23:05:36.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.619+0000 7fcfe1b42800 1 -- 172.21.15.164:0/2116918857 wait complete. 2024-09-13T23:05:36.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.619+0000 7fcfe1b42800 1 -- 172.21.15.164:0/4209546571 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x558c3dcf3e00 msgr2=0x558c3ddf4390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.619+0000 7fcfe1b42800 1 --2- 172.21.15.164:0/4209546571 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x558c3dcf3e00 0x558c3ddf4390 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.619+0000 7fcfe1b42800 1 -- 172.21.15.164:0/4209546571 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fcec4036b90 msgr2=0x7fcec4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.619+0000 7fcfe1b42800 1 --2- 172.21.15.164:0/4209546571 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fcec4036b90 0x7fcec4039050 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4000f60 tx=0x7fcfd40012b0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.619+0000 7fcfe1b42800 1 -- 172.21.15.164:0/4209546571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3dcf34c0 msgr2=0x558c3dc67dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.619+0000 7fcfe1b42800 1 --2- 172.21.15.164:0/4209546571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3dcf34c0 0x558c3dc67dc0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x558c3dde35d0 tx=0x7fcfd0002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.619+0000 7fcfe1b42800 1 -- 172.21.15.164:0/4209546571 shutdown_connections 2024-09-13T23:05:36.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.619+0000 7fcfe1b42800 1 --2- 172.21.15.164:0/4209546571 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x558c3dcf3e00 0x558c3ddf4390 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.619+0000 7fcfe1b42800 1 --2- 172.21.15.164:0/4209546571 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fcec4036b90 0x7fcec4039050 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.619+0000 7fcfe1b42800 1 --2- 172.21.15.164:0/4209546571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c3dcf34c0 0x558c3dc67dc0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.619+0000 7fcfe1b42800 1 -- 172.21.15.164:0/4209546571 >> 172.21.15.164:0/4209546571 conn(0x558c3dceedf0 msgr2=0x558c3dddc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.619+0000 7fcfe1b42800 1 -- 172.21.15.164:0/4209546571 shutdown_connections 2024-09-13T23:05:36.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.619+0000 7fcfe1b42800 1 -- 172.21.15.164:0/4209546571 wait complete. 2024-09-13T23:05:36.629 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T23:05:36.630 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T23:05:36.630 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-13T23:05:36.684 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:36.684 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:36.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.683+0000 7f7774640800 1 Processor -- start 2024-09-13T23:05:36.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.683+0000 7f7774640800 1 -- start start 2024-09-13T23:05:36.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.684+0000 7f7774640800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x561d9f1f3530 0x561d9f287680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.684+0000 7f7774640800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561d9f13db30 con 0x561d9f1f4640 2024-09-13T23:05:36.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.684+0000 7f7774640800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x561d9f11f360 con 0x561d9f1f3530 2024-09-13T23:05:36.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.684+0000 7f776bfff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x561d9f1f3530 0x561d9f287680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.684+0000 7f7772134640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x561d9f1f4640 0x561d9f1f2e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:41050/0 (socket says 172.21.15.164:41050) 2024-09-13T23:05:36.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.684+0000 7f7772134640 1 -- 172.21.15.164:0/2098043265 learned_addr learned my addr 172.21.15.164:0/2098043265 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:36.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.684+0000 7f776bfff640 1 -- 172.21.15.164:0/2098043265 >> v1:172.21.15.17:6789/0 conn(0x561d9f1f4640 legacy=0x561d9f1f2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.684+0000 7f776bfff640 1 -- 172.21.15.164:0/2098043265 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d9f145e00 con 0x561d9f1f3530 2024-09-13T23:05:36.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.686+0000 7f776bfff640 1 --2- 172.21.15.164:0/2098043265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f1f3530 0x561d9f287680 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f775c00a470 tx=0x7f775c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=958d15126c93fa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.686+0000 7f7771933640 1 -- 172.21.15.164:0/2098043265 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f775c053570 con 0x561d9f1f3530 2024-09-13T23:05:36.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.687+0000 7f7771933640 1 -- 172.21.15.164:0/2098043265 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f775c058070 con 0x561d9f1f3530 2024-09-13T23:05:36.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.687+0000 7f7771933640 1 -- 172.21.15.164:0/2098043265 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f775c053880 con 0x561d9f1f3530 2024-09-13T23:05:36.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.687+0000 7f7774640800 1 -- 172.21.15.164:0/2098043265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f1f3530 msgr2=0x561d9f287680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.687+0000 7f7774640800 1 --2- 172.21.15.164:0/2098043265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f1f3530 0x561d9f287680 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f775c00a470 tx=0x7f775c045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:36.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.687+0000 7f7774640800 1 -- 172.21.15.164:0/2098043265 shutdown_connections 2024-09-13T23:05:36.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.687+0000 7f7774640800 1 --2- 172.21.15.164:0/2098043265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f1f3530 0x561d9f287680 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.687+0000 7f7774640800 1 -- 172.21.15.164:0/2098043265 >> 172.21.15.164:0/2098043265 conn(0x561d9f27a010 msgr2=0x561d9f27c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.687+0000 7f7774640800 1 -- 172.21.15.164:0/2098043265 shutdown_connections 2024-09-13T23:05:36.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.687+0000 7f7774640800 1 -- 172.21.15.164:0/2098043265 wait complete. 2024-09-13T23:05:36.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.701+0000 7f7774640800 1 Processor -- start 2024-09-13T23:05:36.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.701+0000 7f7774640800 1 -- start start 2024-09-13T23:05:36.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.701+0000 7f7774640800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f1f3530 0x561d9f36fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.701+0000 7f7774640800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561d9f1ca450 con 0x561d9f1f3530 2024-09-13T23:05:36.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.702+0000 7f7772134640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f1f3530 0x561d9f36fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.702+0000 7f7772134640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f1f3530 0x561d9f36fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58118/0 (socket says 172.21.15.164:58118) 2024-09-13T23:05:36.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.702+0000 7f7772134640 1 -- 172.21.15.164:0/2067229003 learned_addr learned my addr 172.21.15.164:0/2067229003 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.702+0000 7f7772134640 1 -- 172.21.15.164:0/2067229003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d9f117bc0 con 0x561d9f1f3530 2024-09-13T23:05:36.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.702+0000 7f7772134640 1 --2- 172.21.15.164:0/2067229003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f1f3530 0x561d9f36fb60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7764001d80 tx=0x7f7764001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c829cf4f41412e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.702+0000 7f7660608640 1 -- 172.21.15.164:0/2067229003 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7764013030 con 0x561d9f1f3530 2024-09-13T23:05:36.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.702+0000 7f7660608640 1 -- 172.21.15.164:0/2067229003 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f776400e470 con 0x561d9f1f3530 2024-09-13T23:05:36.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.702+0000 7f7660608640 1 -- 172.21.15.164:0/2067229003 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f776400e810 con 0x561d9f1f3530 2024-09-13T23:05:36.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.703+0000 7f7774640800 1 -- 172.21.15.164:0/2067229003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f1f3530 msgr2=0x561d9f36fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.703+0000 7f7774640800 1 --2- 172.21.15.164:0/2067229003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f1f3530 0x561d9f36fb60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7764001d80 tx=0x7f7764001e70 comp rx=0 tx=0).stop 2024-09-13T23:05:36.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.703+0000 7f7774640800 1 -- 172.21.15.164:0/2067229003 shutdown_connections 2024-09-13T23:05:36.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.703+0000 7f7774640800 1 --2- 172.21.15.164:0/2067229003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f1f3530 0x561d9f36fb60 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.703+0000 7f7774640800 1 -- 172.21.15.164:0/2067229003 >> 172.21.15.164:0/2067229003 conn(0x561d9f27a010 msgr2=0x561d9f36b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.703+0000 7f7774640800 1 -- 172.21.15.164:0/2067229003 shutdown_connections 2024-09-13T23:05:36.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.703+0000 7f7774640800 1 -- 172.21.15.164:0/2067229003 wait complete. 2024-09-13T23:05:36.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.703+0000 7f7774640800 1 Processor -- start 2024-09-13T23:05:36.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.703+0000 7f7774640800 1 -- start start 2024-09-13T23:05:36.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.704+0000 7f7774640800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f1f4640 0x561d9f3777b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.704+0000 7f7774640800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561d9f1f3c20 con 0x561d9f1f4640 2024-09-13T23:05:36.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.704+0000 7f7772134640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f1f4640 0x561d9f3777b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.704+0000 7f7772134640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f1f4640 0x561d9f3777b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58124/0 (socket says 172.21.15.164:58124) 2024-09-13T23:05:36.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.704+0000 7f7772134640 1 -- 172.21.15.164:0/3282756200 learned_addr learned my addr 172.21.15.164:0/3282756200 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.704+0000 7f7772134640 1 -- 172.21.15.164:0/3282756200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d9f12bfe0 con 0x561d9f1f4640 2024-09-13T23:05:36.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.704+0000 7f7772134640 1 --2- 172.21.15.164:0/3282756200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f1f4640 0x561d9f3777b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7764004000 tx=0x7f7764000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.704+0000 7f765ee05640 1 -- 172.21.15.164:0/3282756200 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7764027070 con 0x561d9f1f4640 2024-09-13T23:05:36.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.704+0000 7f765ee05640 1 -- 172.21.15.164:0/3282756200 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7764001400 con 0x561d9f1f4640 2024-09-13T23:05:36.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.704+0000 7f7774640800 1 -- 172.21.15.164:0/3282756200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d9f377cf0 con 0x561d9f1f4640 2024-09-13T23:05:36.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.704+0000 7f765ee05640 1 -- 172.21.15.164:0/3282756200 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7764019a20 con 0x561d9f1f4640 2024-09-13T23:05:36.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.705+0000 7f7774640800 1 -- 172.21.15.164:0/3282756200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d9f378210 con 0x561d9f1f4640 2024-09-13T23:05:36.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.705+0000 7f765ee05640 1 -- 172.21.15.164:0/3282756200 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f776402a070 con 0x561d9f1f4640 2024-09-13T23:05:36.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.705+0000 7f765ee05640 1 --2- 172.21.15.164:0/3282756200 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7658036b40 0x7f7658039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.705+0000 7f765ee05640 1 -- 172.21.15.164:0/3282756200 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f776401f070 con 0x561d9f1f4640 2024-09-13T23:05:36.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.706+0000 7f776bfff640 1 --2- 172.21.15.164:0/3282756200 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7658036b40 0x7f7658039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.706+0000 7f7774640800 1 --2- 172.21.15.164:0/3282756200 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x561d9f37c810 0x561d9f37ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.706+0000 7f7774640800 1 -- 172.21.15.164:0/3282756200 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d9f37f140 con 0x561d9f37c810 2024-09-13T23:05:36.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.706+0000 7f7772935640 1 --2- 172.21.15.164:0/3282756200 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x561d9f37c810 0x561d9f37ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.706+0000 7f776bfff640 1 --2- 172.21.15.164:0/3282756200 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7658036b40 0x7f7658039000 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f775c057000 tx=0x7f775c052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.706+0000 7f7772935640 1 --2- 172.21.15.164:0/3282756200 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x561d9f37c810 0x561d9f37ec00 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.706+0000 7f7772935640 1 -- 172.21.15.164:0/3282756200 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f776c00a4a0 con 0x561d9f37c810 2024-09-13T23:05:36.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.706+0000 7f7774640800 1 -- 172.21.15.164:0/3282756200 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d9f37bdf0 con 0x561d9f37c810 2024-09-13T23:05:36.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.707+0000 7f7772935640 1 -- 172.21.15.164:0/3282756200 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f776c00a4a0 con 0x561d9f37c810 2024-09-13T23:05:36.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.707+0000 7f7774640800 1 -- 172.21.15.164:0/3282756200 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d9f380f80 con 0x561d9f37c810 2024-09-13T23:05:36.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.707+0000 7f7772935640 1 -- 172.21.15.164:0/3282756200 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f776c00a4a0 con 0x561d9f37c810 2024-09-13T23:05:36.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.707+0000 7f7774640800 1 -- 172.21.15.164:0/3282756200 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3801b0 con 0x561d9f37c810 2024-09-13T23:05:36.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.707+0000 7f7772935640 1 -- 172.21.15.164:0/3282756200 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f776c00a4a0 con 0x561d9f37c810 2024-09-13T23:05:36.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.707+0000 7f7774640800 1 -- 172.21.15.164:0/3282756200 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d9f380550 con 0x561d9f37c810 2024-09-13T23:05:36.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.708+0000 7f7772935640 1 -- 172.21.15.164:0/3282756200 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f776c00a4a0 con 0x561d9f37c810 2024-09-13T23:05:36.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.708+0000 7f7774640800 1 Processor -- start 2024-09-13T23:05:36.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.708+0000 7f7774640800 1 -- start start 2024-09-13T23:05:36.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.708+0000 7f7774640800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f38f5c0 0x561d9f38f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.708+0000 7f7774640800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561d9f119580 con 0x561d9f38f5c0 2024-09-13T23:05:36.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.708+0000 7f776bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f38f5c0 0x561d9f38f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.708+0000 7f776bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f38f5c0 0x561d9f38f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58130/0 (socket says 172.21.15.164:58130) 2024-09-13T23:05:36.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.708+0000 7f776bfff640 1 -- 172.21.15.164:0/2504656675 learned_addr learned my addr 172.21.15.164:0/2504656675 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.709+0000 7f776bfff640 1 -- 172.21.15.164:0/2504656675 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d9f38ff20 con 0x561d9f38f5c0 2024-09-13T23:05:36.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.709+0000 7f776bfff640 1 --2- 172.21.15.164:0/2504656675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f38f5c0 0x561d9f38f9e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f775c025bf0 tx=0x7f775c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.709+0000 7f7657fff640 1 -- 172.21.15.164:0/2504656675 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f775c06f070 con 0x561d9f38f5c0 2024-09-13T23:05:36.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.709+0000 7f7657fff640 1 -- 172.21.15.164:0/2504656675 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f775c05f550 con 0x561d9f38f5c0 2024-09-13T23:05:36.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.709+0000 7f7774640800 1 -- 172.21.15.164:0/2504656675 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d9f390150 con 0x561d9f38f5c0 2024-09-13T23:05:36.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.709+0000 7f7657fff640 1 -- 172.21.15.164:0/2504656675 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f775c05f830 con 0x561d9f38f5c0 2024-09-13T23:05:36.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.709+0000 7f7774640800 1 -- 172.21.15.164:0/2504656675 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d9f392dd0 con 0x561d9f38f5c0 2024-09-13T23:05:36.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.710+0000 7f7657fff640 1 -- 172.21.15.164:0/2504656675 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f775c05f9d0 con 0x561d9f38f5c0 2024-09-13T23:05:36.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.710+0000 7f7657fff640 1 --2- 172.21.15.164:0/2504656675 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f764c036b90 0x7f764c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.710+0000 7f7657fff640 1 -- 172.21.15.164:0/2504656675 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f775c092bd0 con 0x561d9f38f5c0 2024-09-13T23:05:36.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.710+0000 7f7772935640 1 --2- 172.21.15.164:0/2504656675 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f764c036b90 0x7f764c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.710+0000 7f7774640800 1 Processor -- start 2024-09-13T23:05:36.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.710+0000 7f7772935640 1 --2- 172.21.15.164:0/2504656675 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f764c036b90 0x7f764c039050 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x561d9f37fcd0 tx=0x7f776c005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.710+0000 7f7774640800 1 -- start start 2024-09-13T23:05:36.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.711+0000 7f7774640800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f39c160 0x561d9f39c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.711+0000 7f7774640800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561d9f370310 con 0x561d9f39c160 2024-09-13T23:05:36.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.711+0000 7f776bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f39c160 0x561d9f39c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.711+0000 7f776bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f39c160 0x561d9f39c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58132/0 (socket says 172.21.15.164:58132) 2024-09-13T23:05:36.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.711+0000 7f776bfff640 1 -- 172.21.15.164:0/3413762590 learned_addr learned my addr 172.21.15.164:0/3413762590 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.711+0000 7f776bfff640 1 -- 172.21.15.164:0/3413762590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d9f39cb30 con 0x561d9f39c160 2024-09-13T23:05:36.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.711+0000 7f776bfff640 1 --2- 172.21.15.164:0/3413762590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f39c160 0x561d9f39c560 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f775c090f70 tx=0x7f775c0911f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6caa0cc8edb444cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.711+0000 7f7655ffb640 1 -- 172.21.15.164:0/3413762590 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f775c06b930 con 0x561d9f39c160 2024-09-13T23:05:36.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.711+0000 7f7655ffb640 1 -- 172.21.15.164:0/3413762590 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f775c06b410 con 0x561d9f39c160 2024-09-13T23:05:36.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.711+0000 7f7655ffb640 1 -- 172.21.15.164:0/3413762590 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f775c06bad0 con 0x561d9f39c160 2024-09-13T23:05:36.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.712+0000 7f7774640800 1 -- 172.21.15.164:0/3413762590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f39c160 msgr2=0x561d9f39c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.712+0000 7f7774640800 1 --2- 172.21.15.164:0/3413762590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f39c160 0x561d9f39c560 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f775c090f70 tx=0x7f775c0911f0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.712+0000 7f7774640800 1 -- 172.21.15.164:0/3413762590 shutdown_connections 2024-09-13T23:05:36.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.712+0000 7f7774640800 1 --2- 172.21.15.164:0/3413762590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f39c160 0x561d9f39c560 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.712+0000 7f7774640800 1 -- 172.21.15.164:0/3413762590 >> 172.21.15.164:0/3413762590 conn(0x561d9f3984c0 msgr2=0x561d9f3965c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.712+0000 7f7774640800 1 -- 172.21.15.164:0/3413762590 shutdown_connections 2024-09-13T23:05:36.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.712+0000 7f7774640800 1 -- 172.21.15.164:0/3413762590 wait complete. 2024-09-13T23:05:36.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.712+0000 7f7774640800 1 Processor -- start 2024-09-13T23:05:36.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.712+0000 7f7774640800 1 -- start start 2024-09-13T23:05:36.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.712+0000 7f7774640800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f39c160 0x561d9f3a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.712+0000 7f7774640800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561d9f39d1a0 con 0x561d9f39c160 2024-09-13T23:05:36.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.713+0000 7f776bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f39c160 0x561d9f3a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.713+0000 7f776bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f39c160 0x561d9f3a3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58134/0 (socket says 172.21.15.164:58134) 2024-09-13T23:05:36.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.713+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 learned_addr learned my addr 172.21.15.164:0/2273558703 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.713+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d9f3a3b40 con 0x561d9f39c160 2024-09-13T23:05:36.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.713+0000 7f776bfff640 1 --2- 172.21.15.164:0/2273558703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f39c160 0x561d9f3a3600 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f775c06afd0 tx=0x7f775c090ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.713+0000 7f7643fff640 1 -- 172.21.15.164:0/2273558703 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f775c05cca0 con 0x561d9f39c160 2024-09-13T23:05:36.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.713+0000 7f7643fff640 1 -- 172.21.15.164:0/2273558703 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f775c05ce40 con 0x561d9f39c160 2024-09-13T23:05:36.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.713+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d9f3a3dd0 con 0x561d9f39c160 2024-09-13T23:05:36.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.713+0000 7f7643fff640 1 -- 172.21.15.164:0/2273558703 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f775c06a720 con 0x561d9f39c160 2024-09-13T23:05:36.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.713+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d9f3a6a80 con 0x561d9f39c160 2024-09-13T23:05:36.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.714+0000 7f7643fff640 1 -- 172.21.15.164:0/2273558703 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f775c06a8c0 con 0x561d9f39c160 2024-09-13T23:05:36.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.714+0000 7f7643fff640 1 --2- 172.21.15.164:0/2273558703 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f763c036aa0 0x7f763c038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.714+0000 7f7643fff640 1 -- 172.21.15.164:0/2273558703 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f775c098070 con 0x561d9f39c160 2024-09-13T23:05:36.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.714+0000 7f7772935640 1 --2- 172.21.15.164:0/2273558703 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f763c036aa0 0x7f763c038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.715+0000 7f7772935640 1 --2- 172.21.15.164:0/2273558703 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f763c036aa0 0x7f763c038f60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x561d9f37bd40 tx=0x7f776c01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.715+0000 7f7774640800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.715+0000 7f7774640800 1 --2- 172.21.15.164:0/2273558703 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x561d9f3af120 0x561d9f3b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.715+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b1d30 con 0x561d9f3af120 2024-09-13T23:05:36.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.715+0000 7f7772134640 1 --2- 172.21.15.164:0/2273558703 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x561d9f3af120 0x561d9f3b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.715+0000 7f7772134640 1 --2- 172.21.15.164:0/2273558703 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x561d9f3af120 0x561d9f3b15e0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.715+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7764029030 con 0x561d9f3af120 2024-09-13T23:05:36.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.716+0000 7f7774640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.716+0000 7f7774640800 20 realm 2024-09-13T23:05:36.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.716+0000 7f7774640800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.716+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b2100 con 0x561d9f3af120 2024-09-13T23:05:36.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.716+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7764029030 con 0x561d9f3af120 2024-09-13T23:05:36.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.716+0000 7f7774640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.716+0000 7f7774640800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:36.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.716+0000 7f7774640800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.716+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b29d0 con 0x561d9f3af120 2024-09-13T23:05:36.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.716+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7764029030 con 0x561d9f3af120 2024-09-13T23:05:36.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.716+0000 7f7774640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.716+0000 7f7774640800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.716+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b2d70 con 0x561d9f3af120 2024-09-13T23:05:36.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.716+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7764029030 con 0x561d9f3af120 2024-09-13T23:05:36.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.716+0000 7f7774640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:36.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.716+0000 7f7774640800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.716+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b35c0 con 0x561d9f3af120 2024-09-13T23:05:36.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.717+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7764029030 con 0x561d9f3af120 2024-09-13T23:05:36.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.717+0000 7f7774640800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:36.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.717+0000 7f7774640800 20 searching for the correct realm 2024-09-13T23:05:36.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.717+0000 7f7774640800 1 --2- 172.21.15.164:0/2273558703 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x561d9f3b5330 0x561d9f3b7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.717+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b7d30 con 0x561d9f3b5330 2024-09-13T23:05:36.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.717+0000 7f776bfff640 1 --2- 172.21.15.164:0/2273558703 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x561d9f3b5330 0x561d9f3b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.717+0000 7f776bfff640 1 --2- 172.21.15.164:0/2273558703 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x561d9f3b5330 0x561d9f3b7720 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.717+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775c0a2020 con 0x561d9f3b5330 2024-09-13T23:05:36.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.717+0000 7f776bfff640 1 --2- 172.21.15.164:0/2273558703 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f775c05f040 0x7f775c0a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.717+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b7d30 con 0x7f775c05f040 2024-09-13T23:05:36.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.717+0000 7f7772935640 1 --2- 172.21.15.164:0/2273558703 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f775c05f040 0x7f775c0a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.718+0000 7f7772935640 1 --2- 172.21.15.164:0/2273558703 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f775c05f040 0x7f775c0a5440 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.718+0000 7f7772935640 1 -- 172.21.15.164:0/2273558703 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f776c01f070 con 0x7f775c05f040 2024-09-13T23:05:36.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.718+0000 7f7772935640 1 --2- 172.21.15.164:0/2273558703 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f776c031040 0x7f776c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.718+0000 7f7772935640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b7d30 con 0x7f776c031040 2024-09-13T23:05:36.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.718+0000 7f7772134640 1 --2- 172.21.15.164:0/2273558703 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f776c031040 0x7f776c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.718+0000 7f7772134640 1 --2- 172.21.15.164:0/2273558703 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f776c031040 0x7f776c032940 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.719+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7764029030 con 0x7f776c031040 2024-09-13T23:05:36.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.719+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b7d30 con 0x561d9f3af120 2024-09-13T23:05:36.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.719+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7764029030 con 0x561d9f3af120 2024-09-13T23:05:36.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.719+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b7d30 con 0x561d9f3af120 2024-09-13T23:05:36.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.719+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7764029030 con 0x561d9f3af120 2024-09-13T23:05:36.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.719+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b7d30 con 0x7f776c031040 2024-09-13T23:05:36.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.719+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7764029030 con 0x7f776c031040 2024-09-13T23:05:36.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.719+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b7d30 con 0x7f776c031040 2024-09-13T23:05:36.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.720+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7764029030 con 0x7f776c031040 2024-09-13T23:05:36.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.720+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b7d30 con 0x7f775c05f040 2024-09-13T23:05:36.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.720+0000 7f7772935640 1 -- 172.21.15.164:0/2273558703 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f776c01f070 con 0x7f775c05f040 2024-09-13T23:05:36.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.720+0000 7f7772935640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b7d30 con 0x561d9f3b5330 2024-09-13T23:05:36.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.720+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775c0a2020 con 0x561d9f3b5330 2024-09-13T23:05:36.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.720+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b7d30 con 0x561d9f3af120 2024-09-13T23:05:36.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.720+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7764029030 con 0x561d9f3af120 2024-09-13T23:05:36.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.720+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b7d30 con 0x7f776c031040 2024-09-13T23:05:36.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.721+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7764029030 con 0x7f776c031040 2024-09-13T23:05:36.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.721+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b7d30 con 0x561d9f3af120 2024-09-13T23:05:36.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.721+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7764029030 con 0x561d9f3af120 2024-09-13T23:05:36.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.721+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b7d30 con 0x7f775c05f040 2024-09-13T23:05:36.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.721+0000 7f7772935640 1 -- 172.21.15.164:0/2273558703 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f776c01f070 con 0x7f775c05f040 2024-09-13T23:05:36.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.721+0000 7f7772935640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b7d30 con 0x561d9f3b5330 2024-09-13T23:05:36.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.721+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775c0a2020 con 0x561d9f3b5330 2024-09-13T23:05:36.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.721+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b7d30 con 0x561d9f3b5330 2024-09-13T23:05:36.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.721+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775c0a2020 con 0x561d9f3b5330 2024-09-13T23:05:36.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.721+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b7d30 con 0x7f776c031040 2024-09-13T23:05:36.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.722+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7764029030 con 0x7f776c031040 2024-09-13T23:05:36.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.722+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b7d30 con 0x561d9f3b5330 2024-09-13T23:05:36.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.722+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775c0a2020 con 0x561d9f3b5330 2024-09-13T23:05:36.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.722+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b7d30 con 0x561d9f3b5330 2024-09-13T23:05:36.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.722+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775c0a2020 con 0x561d9f3b5330 2024-09-13T23:05:36.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.722+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b7d30 con 0x561d9f3af120 2024-09-13T23:05:36.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.722+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7764029030 con 0x561d9f3af120 2024-09-13T23:05:36.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.722+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b7d30 con 0x561d9f3af120 2024-09-13T23:05:36.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.723+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7764029030 con 0x561d9f3af120 2024-09-13T23:05:36.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.723+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b7d30 con 0x7f776c031040 2024-09-13T23:05:36.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.723+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7764029030 con 0x7f776c031040 2024-09-13T23:05:36.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.723+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b7d30 con 0x561d9f3b5330 2024-09-13T23:05:36.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.723+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775c0a2020 con 0x561d9f3b5330 2024-09-13T23:05:36.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.723+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b7d30 con 0x7f775c05f040 2024-09-13T23:05:36.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.723+0000 7f7772935640 1 -- 172.21.15.164:0/2273558703 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f776c01f070 con 0x7f775c05f040 2024-09-13T23:05:36.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.723+0000 7f7772935640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b7d30 con 0x561d9f3af120 2024-09-13T23:05:36.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.724+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7764029030 con 0x561d9f3af120 2024-09-13T23:05:36.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.724+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b7d30 con 0x7f776c031040 2024-09-13T23:05:36.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.724+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7764029030 con 0x7f776c031040 2024-09-13T23:05:36.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.724+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7764055040 con 0x561d9f3b5330 2024-09-13T23:05:36.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.724+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775c0a2020 con 0x561d9f3b5330 2024-09-13T23:05:36.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.724+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7764055040 con 0x7f776c031040 2024-09-13T23:05:36.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.725+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7764029030 con 0x7f776c031040 2024-09-13T23:05:36.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.725+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7764055040 con 0x7f775c05f040 2024-09-13T23:05:36.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.725+0000 7f7772935640 1 -- 172.21.15.164:0/2273558703 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f776c01f070 con 0x7f775c05f040 2024-09-13T23:05:36.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.725+0000 7f7772935640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7764055040 con 0x561d9f3b5330 2024-09-13T23:05:36.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.725+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775c0a2020 con 0x561d9f3b5330 2024-09-13T23:05:36.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.725+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7764055040 con 0x7f776c031040 2024-09-13T23:05:36.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.726+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7764029030 con 0x7f776c031040 2024-09-13T23:05:36.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.726+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7764055040 con 0x561d9f3af120 2024-09-13T23:05:36.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.726+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7764029030 con 0x561d9f3af120 2024-09-13T23:05:36.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.726+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7764055040 con 0x7f775c05f040 2024-09-13T23:05:36.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.726+0000 7f7772935640 1 -- 172.21.15.164:0/2273558703 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f776c01f070 con 0x7f775c05f040 2024-09-13T23:05:36.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.726+0000 7f7774640800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:36.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.726+0000 7f7774640800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:36.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.726+0000 7f7774640800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:36.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.726+0000 7f7774640800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:36.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.726+0000 7f7774640800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:36.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.726+0000 7f7774640800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:36.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.726+0000 7f7774640800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.726+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b3e10 con 0x561d9f3af120 2024-09-13T23:05:36.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.726+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7764029030 con 0x561d9f3af120 2024-09-13T23:05:36.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.726+0000 7f7774640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.726+0000 7f7774640800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.726+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b4200 con 0x561d9f3af120 2024-09-13T23:05:36.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.727+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7764029030 con 0x561d9f3af120 2024-09-13T23:05:36.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.727+0000 7f7774640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:36.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.727+0000 7f7774640800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.727+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b4200 con 0x561d9f3af120 2024-09-13T23:05:36.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.727+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7764029030 con 0x561d9f3af120 2024-09-13T23:05:36.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.727+0000 7f7774640800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:36.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.727+0000 7f7774640800 20 zone default found 2024-09-13T23:05:36.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.727+0000 7f7774640800 4 Realm: () 2024-09-13T23:05:36.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.727+0000 7f7774640800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:36.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.727+0000 7f7774640800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:36.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.727+0000 7f7774640800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:36.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.727+0000 7f7774640800 20 zonegroup default 2024-09-13T23:05:36.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.727+0000 7f7774640800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.727+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b81b0 con 0x7f776c031040 2024-09-13T23:05:36.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.728+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7764029030 con 0x7f776c031040 2024-09-13T23:05:36.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.728+0000 7f7774640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.728+0000 7f7774640800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.728+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b9b90 con 0x561d9f3b5330 2024-09-13T23:05:36.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.728+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f775c0a2020 con 0x561d9f3b5330 2024-09-13T23:05:36.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.728+0000 7f7774640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.728+0000 7f7774640800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.728+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b9f30 con 0x561d9f3b5330 2024-09-13T23:05:36.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.728+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f775c0a2020 con 0x561d9f3b5330 2024-09-13T23:05:36.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.728+0000 7f7774640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.728+0000 7f7774640800 20 started sync module instance, tier type = 2024-09-13T23:05:36.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.728+0000 7f7774640800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:36.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.728+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3b9030 con 0x7f775c05f040 2024-09-13T23:05:36.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.729+0000 7f7772935640 1 -- 172.21.15.164:0/2273558703 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f776c040040 con 0x7f775c05f040 2024-09-13T23:05:36.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.729+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94685225520000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3ba2d0 con 0x7f775c05f040 2024-09-13T23:05:36.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.729+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3bab60 con 0x561d9f3af120 2024-09-13T23:05:36.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.730+0000 7f7772935640 1 -- 172.21.15.164:0/2273558703 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94685225520000] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f776c040040 con 0x7f775c05f040 2024-09-13T23:05:36.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.730+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7764029030 con 0x561d9f3af120 2024-09-13T23:05:36.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.730+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94685225522256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3ba780 con 0x561d9f3af120 2024-09-13T23:05:36.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.730+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3bb5f0 con 0x561d9f3b5330 2024-09-13T23:05:36.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.731+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94685225522256] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7764029030 con 0x561d9f3af120 2024-09-13T23:05:36.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.731+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775c0a2020 con 0x561d9f3b5330 2024-09-13T23:05:36.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.731+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94685225525968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3ba6f0 con 0x561d9f3b5330 2024-09-13T23:05:36.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.732+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3bc4e0 con 0x7f775c05f040 2024-09-13T23:05:36.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.732+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94685225525968] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775c0a2020 con 0x561d9f3b5330 2024-09-13T23:05:36.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.733+0000 7f7772935640 1 -- 172.21.15.164:0/2273558703 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f776c040040 con 0x7f775c05f040 2024-09-13T23:05:36.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.733+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94685225533488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3bc900 con 0x7f775c05f040 2024-09-13T23:05:36.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.733+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3bd2c0 con 0x561d9f3af120 2024-09-13T23:05:36.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.733+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7764029030 con 0x561d9f3af120 2024-09-13T23:05:36.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.733+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94685225537040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3bd230 con 0x561d9f3af120 2024-09-13T23:05:36.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.733+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3be290 con 0x7f776c031040 2024-09-13T23:05:36.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.734+0000 7f7772935640 1 -- 172.21.15.164:0/2273558703 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94685225533488] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f776c040040 con 0x7f775c05f040 2024-09-13T23:05:36.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.734+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94685225537040] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7764029030 con 0x561d9f3af120 2024-09-13T23:05:36.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.734+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7764029030 con 0x7f776c031040 2024-09-13T23:05:36.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.734+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94685225540992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3be250 con 0x7f776c031040 2024-09-13T23:05:36.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.734+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3beb30 con 0x7f776c031040 2024-09-13T23:05:36.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.735+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94685225540992] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7764029030 con 0x7f776c031040 2024-09-13T23:05:36.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.736+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7764029030 con 0x7f776c031040 2024-09-13T23:05:36.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.736+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94685225534544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3be250 con 0x7f776c031040 2024-09-13T23:05:36.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.736+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3bf120 con 0x7f776c031040 2024-09-13T23:05:36.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.737+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94685225534544] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7764029030 con 0x7f776c031040 2024-09-13T23:05:36.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.737+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7764029030 con 0x7f776c031040 2024-09-13T23:05:36.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.737+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94685225543184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3bf0e0 con 0x7f776c031040 2024-09-13T23:05:36.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.737+0000 7f7774640800 20 add_watcher() i=0 2024-09-13T23:05:36.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.737+0000 7f7774640800 20 add_watcher() i=1 2024-09-13T23:05:36.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.737+0000 7f7774640800 20 add_watcher() i=2 2024-09-13T23:05:36.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.737+0000 7f7774640800 20 add_watcher() i=3 2024-09-13T23:05:36.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.737+0000 7f7774640800 20 add_watcher() i=4 2024-09-13T23:05:36.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.737+0000 7f7774640800 20 add_watcher() i=5 2024-09-13T23:05:36.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.737+0000 7f7774640800 20 add_watcher() i=6 2024-09-13T23:05:36.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.738+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94685225543184] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7764029030 con 0x7f776c031040 2024-09-13T23:05:36.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.738+0000 7f7774640800 20 add_watcher() i=7 2024-09-13T23:05:36.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.738+0000 7f7774640800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:36.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.738+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3c2540 con 0x561d9f3af120 2024-09-13T23:05:36.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.738+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7764029030 con 0x561d9f3af120 2024-09-13T23:05:36.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.738+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94685225545216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3bfa90 con 0x561d9f3af120 2024-09-13T23:05:36.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.739+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94685225545216] v32'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7764029030 con 0x561d9f3af120 2024-09-13T23:05:36.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.739+0000 7f7628fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:36.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.739+0000 7f7774640800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:36.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.739+0000 7f7774640800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:36.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.739+0000 7f7774640800 5 note: GC not initialized 2024-09-13T23:05:36.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.739+0000 7f75a37fe640 20 reqs_thread_entry: start 2024-09-13T23:05:36.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.739+0000 7f7774640800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:36.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.740+0000 7f7774640800 20 Filter name: none 2024-09-13T23:05:36.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.740+0000 7f75a17fa640 20 reqs_thread_entry: start 2024-09-13T23:05:36.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.740+0000 7f7774640800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-13T23:05:36.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.740+0000 7f7774640800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.740+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3f5bb0 con 0x7f776c031040 2024-09-13T23:05:36.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.740+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7f7764029030 con 0x7f776c031040 2024-09-13T23:05:36.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.740+0000 7f7774640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.740+0000 7f7774640800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-13T23:05:36.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.740+0000 7f7774640800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T23:05:36.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.740+0000 7f7774640800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T23:05:36.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.740+0000 7f7774640800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.740+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3f4140 con 0x7f776c031040 2024-09-13T23:05:36.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.740+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f7764029030 con 0x7f776c031040 2024-09-13T23:05:36.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.740+0000 7f7774640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.740+0000 7f7774640800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T23:05:36.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.740+0000 7f7774640800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:05:36.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.740+0000 7f7774640800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T23:05:36.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.740+0000 7f7774640800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T23:05:36.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.740+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3f88c0 con 0x7f776c031040 2024-09-13T23:05:36.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.742+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v32'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7f7764029030 con 0x7f776c031040 2024-09-13T23:05:36.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.742+0000 7f7774640800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-13T23:05:36.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.742+0000 7f7774640800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T23:05:36.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.742+0000 7f7774640800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-13T23:05:36.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.742+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94685225779840 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3f9430 con 0x7f775c05f040 2024-09-13T23:05:36.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.742+0000 7f7772935640 1 -- 172.21.15.164:0/2273558703 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== watch-notify(notify (1) cookie 94685225533488 notify 137438953490 ret 0) ==== 652+0+0 (crc 0 0 0) 0x7f776c024680 con 0x7f775c05f040 2024-09-13T23:05:36.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.742+0000 7f7655ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 94685225533488 notifier 4547 bl.length()=610 2024-09-13T23:05:36.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.742+0000 7f7655ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-13T23:05:36.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.742+0000 7f7655ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T23:05:36.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.742+0000 7f7655ffb640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7638003ea0 con 0x7f775c05f040 2024-09-13T23:05:36.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.742+0000 7f7772935640 1 -- 172.21.15.164:0/2273558703 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(65 notify.3 [notify cookie 94685225779840 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f776c040040 con 0x7f775c05f040 2024-09-13T23:05:36.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.742+0000 7f7772935640 1 -- 172.21.15.164:0/2273558703 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f776c040040 con 0x7f775c05f040 2024-09-13T23:05:36.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.742+0000 7f7772935640 1 -- 172.21.15.164:0/2273558703 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== watch-notify(notify_complete (2) cookie 94685225779840 notify 137438953490 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f776c024850 con 0x7f775c05f040 2024-09-13T23:05:36.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.742+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3f8250 con 0x7f776c031040 2024-09-13T23:05:36.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.744+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v32'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f7764029030 con 0x7f776c031040 2024-09-13T23:05:36.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.744+0000 7f7774640800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T23:05:36.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.744+0000 7f7774640800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:05:36.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.744+0000 7f7774640800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T23:05:36.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.744+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94685225779744 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3f9390 con 0x561d9f3b5330 2024-09-13T23:05:36.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.744+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== watch-notify(notify (1) cookie 94685225525968 notify 137438953476 ret 0) ==== 234+0+0 (crc 0 0 0) 0x561d9f3a3dd0 con 0x561d9f3b5330 2024-09-13T23:05:36.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.744+0000 7f76557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94685225525968 notifier 4547 bl.length()=192 2024-09-13T23:05:36.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.744+0000 7f76557fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T23:05:36.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.744+0000 7f76557fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:05:36.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.744+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(68 notify.2 [notify cookie 94685225779744 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f775c0a2020 con 0x561d9f3b5330 2024-09-13T23:05:36.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.744+0000 7f76557fa640 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f75a8003400 con 0x561d9f3b5330 2024-09-13T23:05:36.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.744+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775c0a2020 con 0x561d9f3b5330 2024-09-13T23:05:36.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.744+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== watch-notify(notify_complete (2) cookie 94685225779744 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561d9f3a3b40 con 0x561d9f3b5330 2024-09-13T23:05:36.760 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T23:05:36.742460Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:05:36.742450Z","tags":[],"group_ids":[]} 2024-09-13T23:05:36.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.745+0000 7f7628fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:36.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.745+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94685225545216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3f36d0 con 0x561d9f3af120 2024-09-13T23:05:36.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.746+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94685225545216] v32'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7764029030 con 0x561d9f3af120 2024-09-13T23:05:36.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.746+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94685225520000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3f36d0 con 0x7f775c05f040 2024-09-13T23:05:36.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.747+0000 7f7772935640 1 -- 172.21.15.164:0/2273558703 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94685225520000] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f776c040040 con 0x7f775c05f040 2024-09-13T23:05:36.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.747+0000 7f7774640800 20 remove_watcher() i=0 2024-09-13T23:05:36.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.747+0000 7f7774640800 2 removed watcher, disabling cache 2024-09-13T23:05:36.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.747+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94685225522256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3f36d0 con 0x561d9f3af120 2024-09-13T23:05:36.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.748+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94685225522256] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7764029030 con 0x561d9f3af120 2024-09-13T23:05:36.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.748+0000 7f7774640800 20 remove_watcher() i=1 2024-09-13T23:05:36.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.748+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94685225525968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3f36d0 con 0x561d9f3b5330 2024-09-13T23:05:36.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.749+0000 7f776bfff640 1 -- 172.21.15.164:0/2273558703 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94685225525968] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775c0a2020 con 0x561d9f3b5330 2024-09-13T23:05:36.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.749+0000 7f7774640800 20 remove_watcher() i=2 2024-09-13T23:05:36.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.749+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94685225533488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3f36d0 con 0x7f775c05f040 2024-09-13T23:05:36.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.750+0000 7f7772935640 1 -- 172.21.15.164:0/2273558703 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94685225533488] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f776c040040 con 0x7f775c05f040 2024-09-13T23:05:36.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.750+0000 7f7774640800 20 remove_watcher() i=3 2024-09-13T23:05:36.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.750+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94685225537040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3f36d0 con 0x561d9f3af120 2024-09-13T23:05:36.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.751+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94685225537040] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7764029030 con 0x561d9f3af120 2024-09-13T23:05:36.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.751+0000 7f7774640800 20 remove_watcher() i=4 2024-09-13T23:05:36.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.751+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94685225540992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3f36d0 con 0x7f776c031040 2024-09-13T23:05:36.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.752+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94685225540992] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7764029030 con 0x7f776c031040 2024-09-13T23:05:36.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.752+0000 7f7774640800 20 remove_watcher() i=5 2024-09-13T23:05:36.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.752+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94685225534544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3f36d0 con 0x7f776c031040 2024-09-13T23:05:36.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.753+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94685225534544] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7764029030 con 0x7f776c031040 2024-09-13T23:05:36.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.753+0000 7f7774640800 20 remove_watcher() i=6 2024-09-13T23:05:36.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.753+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94685225543184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d9f3f36d0 con 0x7f776c031040 2024-09-13T23:05:36.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.754+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94685225543184] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7764029030 con 0x7f776c031040 2024-09-13T23:05:36.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.754+0000 7f7774640800 20 remove_watcher() i=7 2024-09-13T23:05:36.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.755+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f776c031040 msgr2=0x7f776c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.755+0000 7f7774640800 1 --2- 172.21.15.164:0/2273558703 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f776c031040 0x7f776c032940 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.755+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x561d9f3af120 msgr2=0x561d9f3b15e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.755+0000 7f7774640800 1 --2- 172.21.15.164:0/2273558703 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x561d9f3af120 0x561d9f3b15e0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.755+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f775c05f040 msgr2=0x7f775c0a5440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.755+0000 7f7774640800 1 --2- 172.21.15.164:0/2273558703 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f775c05f040 0x7f775c0a5440 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.755+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x561d9f3b5330 msgr2=0x561d9f3b7720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.755+0000 7f7774640800 1 --2- 172.21.15.164:0/2273558703 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x561d9f3b5330 0x561d9f3b7720 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.755+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f763c036aa0 msgr2=0x7f763c038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.755+0000 7f7774640800 1 --2- 172.21.15.164:0/2273558703 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f763c036aa0 0x7f763c038f60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x561d9f37bd40 tx=0x7f776c01f000 comp rx=0 tx=0).stop 2024-09-13T23:05:36.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.755+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f39c160 msgr2=0x561d9f3a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.755+0000 7f7772134640 1 -- 172.21.15.164:0/2273558703 reap_dead start 2024-09-13T23:05:36.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.755+0000 7f7774640800 1 --2- 172.21.15.164:0/2273558703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f39c160 0x561d9f3a3600 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f775c06afd0 tx=0x7f775c090ed0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.755+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 shutdown_connections 2024-09-13T23:05:36.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.755+0000 7f7774640800 1 --2- 172.21.15.164:0/2273558703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f39c160 0x561d9f3a3600 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.755+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 >> 172.21.15.164:0/2273558703 conn(0x561d9f3984c0 msgr2=0x561d9f396590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.755+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 shutdown_connections 2024-09-13T23:05:36.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.755+0000 7f7774640800 1 -- 172.21.15.164:0/2273558703 wait complete. 2024-09-13T23:05:36.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.755+0000 7f7774640800 1 -- 172.21.15.164:0/2504656675 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f764c036b90 msgr2=0x7f764c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.755+0000 7f7774640800 1 --2- 172.21.15.164:0/2504656675 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f764c036b90 0x7f764c039050 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x561d9f37fcd0 tx=0x7f776c005840 comp rx=0 tx=0).stop 2024-09-13T23:05:36.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.755+0000 7f7774640800 1 -- 172.21.15.164:0/2504656675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f38f5c0 msgr2=0x561d9f38f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.755+0000 7f7774640800 1 --2- 172.21.15.164:0/2504656675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f38f5c0 0x561d9f38f9e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f775c025bf0 tx=0x7f775c002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.755+0000 7f7774640800 1 -- 172.21.15.164:0/2504656675 shutdown_connections 2024-09-13T23:05:36.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.755+0000 7f7774640800 1 --2- 172.21.15.164:0/2504656675 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f764c036b90 0x7f764c039050 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.755+0000 7f7774640800 1 --2- 172.21.15.164:0/2504656675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f38f5c0 0x561d9f38f9e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.755+0000 7f7774640800 1 -- 172.21.15.164:0/2504656675 >> 172.21.15.164:0/2504656675 conn(0x561d9f384550 msgr2=0x561d9f3870d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.755+0000 7f7774640800 1 -- 172.21.15.164:0/2504656675 shutdown_connections 2024-09-13T23:05:36.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.755+0000 7f7774640800 1 -- 172.21.15.164:0/2504656675 wait complete. 2024-09-13T23:05:36.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.756+0000 7f7774640800 1 -- 172.21.15.164:0/3282756200 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x561d9f37c810 msgr2=0x561d9f37ec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.756+0000 7f7774640800 1 --2- 172.21.15.164:0/3282756200 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x561d9f37c810 0x561d9f37ec00 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.756+0000 7f7774640800 1 -- 172.21.15.164:0/3282756200 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7658036b40 msgr2=0x7f7658039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.756+0000 7f7774640800 1 --2- 172.21.15.164:0/3282756200 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7658036b40 0x7f7658039000 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f775c057000 tx=0x7f775c052000 comp rx=0 tx=0).stop 2024-09-13T23:05:36.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.756+0000 7f7774640800 1 -- 172.21.15.164:0/3282756200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f1f4640 msgr2=0x561d9f3777b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.756+0000 7f7774640800 1 --2- 172.21.15.164:0/3282756200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f1f4640 0x561d9f3777b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7764004000 tx=0x7f7764000bc0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.756+0000 7f7774640800 1 -- 172.21.15.164:0/3282756200 shutdown_connections 2024-09-13T23:05:36.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.756+0000 7f7774640800 1 --2- 172.21.15.164:0/3282756200 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x561d9f37c810 0x561d9f37ec00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.756+0000 7f7774640800 1 --2- 172.21.15.164:0/3282756200 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7658036b40 0x7f7658039000 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.756+0000 7f7774640800 1 --2- 172.21.15.164:0/3282756200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d9f1f4640 0x561d9f3777b0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.756+0000 7f7774640800 1 -- 172.21.15.164:0/3282756200 >> 172.21.15.164:0/3282756200 conn(0x561d9f27a010 msgr2=0x561d9f369dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.756+0000 7f7774640800 1 -- 172.21.15.164:0/3282756200 shutdown_connections 2024-09-13T23:05:36.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.756+0000 7f7774640800 1 -- 172.21.15.164:0/3282756200 wait complete. 2024-09-13T23:05:36.771 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T23:05:36.742460Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:05:36.742450Z', 'tags': [], 'group_ids': []} 2024-09-13T23:05:36.771 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T23:05:36.772 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T23:05:36.772 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-13T23:05:36.820 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:36.820 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:36.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.819+0000 7f7c23f23800 1 Processor -- start 2024-09-13T23:05:36.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.819+0000 7f7c23f23800 1 -- start start 2024-09-13T23:05:36.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.819+0000 7f7c23f23800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5567ec5bd4e0 0x5567ec5bd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.819+0000 7f7c23f23800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5567ec47db30 con 0x5567ec5bde20 2024-09-13T23:05:36.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.819+0000 7f7c23f23800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x5567ec45f360 con 0x5567ec5bd4e0 2024-09-13T23:05:36.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.820+0000 7f7c1fc4e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5567ec5bd4e0 0x5567ec5bd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.820+0000 7f7c1f44d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x5567ec5bde20 0x5567ec5c29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:41060/0 (socket says 172.21.15.164:41060) 2024-09-13T23:05:36.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.820+0000 7f7c1f44d640 1 -- 172.21.15.164:0/865195640 learned_addr learned my addr 172.21.15.164:0/865195640 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:36.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.820+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/865195640 >> v1:172.21.15.17:6789/0 conn(0x5567ec5bde20 legacy=0x5567ec5c29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.820+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/865195640 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567ec485e00 con 0x5567ec5bd4e0 2024-09-13T23:05:36.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.822+0000 7f7c1fc4e640 1 --2- 172.21.15.164:0/865195640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec5bd4e0 0x5567ec5bd8e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7c10005fd0 tx=0x7f7c10045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1dd89afc7a480c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.822+0000 7f7c1ec4c640 1 -- 172.21.15.164:0/865195640 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c10058530 con 0x5567ec5bd4e0 2024-09-13T23:05:36.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.822+0000 7f7c1ec4c640 1 -- 172.21.15.164:0/865195640 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c100586d0 con 0x5567ec5bd4e0 2024-09-13T23:05:36.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.822+0000 7f7c1ec4c640 1 -- 172.21.15.164:0/865195640 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c100589d0 con 0x5567ec5bd4e0 2024-09-13T23:05:36.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.822+0000 7f7c23f23800 1 -- 172.21.15.164:0/865195640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec5bd4e0 msgr2=0x5567ec5bd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.822+0000 7f7c23f23800 1 --2- 172.21.15.164:0/865195640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec5bd4e0 0x5567ec5bd8e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7c10005fd0 tx=0x7f7c10045c30 comp rx=0 tx=0).stop 2024-09-13T23:05:36.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.822+0000 7f7c23f23800 1 -- 172.21.15.164:0/865195640 shutdown_connections 2024-09-13T23:05:36.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.822+0000 7f7c23f23800 1 --2- 172.21.15.164:0/865195640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec5bd4e0 0x5567ec5bd8e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.822+0000 7f7c23f23800 1 -- 172.21.15.164:0/865195640 >> 172.21.15.164:0/865195640 conn(0x5567ec5b8e10 msgr2=0x5567ec5bb230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.822+0000 7f7c23f23800 1 -- 172.21.15.164:0/865195640 shutdown_connections 2024-09-13T23:05:36.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.822+0000 7f7c23f23800 1 -- 172.21.15.164:0/865195640 wait complete. 2024-09-13T23:05:36.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.837+0000 7f7c23f23800 1 Processor -- start 2024-09-13T23:05:36.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.837+0000 7f7c23f23800 1 -- start start 2024-09-13T23:05:36.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.837+0000 7f7c23f23800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec5bd4e0 0x5567ec5c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.837+0000 7f7c23f23800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5567ec50a350 con 0x5567ec5bd4e0 2024-09-13T23:05:36.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.837+0000 7f7c1fc4e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec5bd4e0 0x5567ec5c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.837+0000 7f7c1fc4e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec5bd4e0 0x5567ec5c6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58150/0 (socket says 172.21.15.164:58150) 2024-09-13T23:05:36.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.837+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/3844652965 learned_addr learned my addr 172.21.15.164:0/3844652965 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.838+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/3844652965 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567ec457bc0 con 0x5567ec5bd4e0 2024-09-13T23:05:36.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.838+0000 7f7c1fc4e640 1 --2- 172.21.15.164:0/3844652965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec5bd4e0 0x5567ec5c6e70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7c1000a3f0 tx=0x7f7c10051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f52f624820850d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.838+0000 7f7b0de0b640 1 -- 172.21.15.164:0/3844652965 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c100589b0 con 0x5567ec5bd4e0 2024-09-13T23:05:36.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.838+0000 7f7b0de0b640 1 -- 172.21.15.164:0/3844652965 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c10068070 con 0x5567ec5bd4e0 2024-09-13T23:05:36.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.838+0000 7f7b0de0b640 1 -- 172.21.15.164:0/3844652965 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c10058c80 con 0x5567ec5bd4e0 2024-09-13T23:05:36.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.839+0000 7f7c23f23800 1 -- 172.21.15.164:0/3844652965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec5bd4e0 msgr2=0x5567ec5c6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.839+0000 7f7c23f23800 1 --2- 172.21.15.164:0/3844652965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec5bd4e0 0x5567ec5c6e70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7c1000a3f0 tx=0x7f7c10051000 comp rx=0 tx=0).stop 2024-09-13T23:05:36.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.839+0000 7f7c23f23800 1 -- 172.21.15.164:0/3844652965 shutdown_connections 2024-09-13T23:05:36.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.839+0000 7f7c23f23800 1 --2- 172.21.15.164:0/3844652965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec5bd4e0 0x5567ec5c6e70 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.839+0000 7f7c23f23800 1 -- 172.21.15.164:0/3844652965 >> 172.21.15.164:0/3844652965 conn(0x5567ec5b8e10 msgr2=0x5567ec6a9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.839+0000 7f7c23f23800 1 -- 172.21.15.164:0/3844652965 shutdown_connections 2024-09-13T23:05:36.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.839+0000 7f7c23f23800 1 -- 172.21.15.164:0/3844652965 wait complete. 2024-09-13T23:05:36.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.839+0000 7f7c23f23800 1 Processor -- start 2024-09-13T23:05:36.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.839+0000 7f7c23f23800 1 -- start start 2024-09-13T23:05:36.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.839+0000 7f7c23f23800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec5bd4e0 0x5567ec6b7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.839+0000 7f7c23f23800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5567ec5c44a0 con 0x5567ec5bd4e0 2024-09-13T23:05:36.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.839+0000 7f7c1fc4e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec5bd4e0 0x5567ec6b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.840+0000 7f7c1fc4e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec5bd4e0 0x5567ec6b7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58154/0 (socket says 172.21.15.164:58154) 2024-09-13T23:05:36.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.840+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/75712257 learned_addr learned my addr 172.21.15.164:0/75712257 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.840+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/75712257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567ec46bfe0 con 0x5567ec5bd4e0 2024-09-13T23:05:36.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.840+0000 7f7c1fc4e640 1 --2- 172.21.15.164:0/75712257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec5bd4e0 0x5567ec6b7400 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7c1000a3f0 tx=0x7f7c10003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.840+0000 7f7b07fff640 1 -- 172.21.15.164:0/75712257 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c10063650 con 0x5567ec5bd4e0 2024-09-13T23:05:36.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.840+0000 7f7b07fff640 1 -- 172.21.15.164:0/75712257 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c100637f0 con 0x5567ec5bd4e0 2024-09-13T23:05:36.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.840+0000 7f7c23f23800 1 -- 172.21.15.164:0/75712257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5567ec6b7940 con 0x5567ec5bd4e0 2024-09-13T23:05:36.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.840+0000 7f7b07fff640 1 -- 172.21.15.164:0/75712257 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c10063ad0 con 0x5567ec5bd4e0 2024-09-13T23:05:36.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.840+0000 7f7c23f23800 1 -- 172.21.15.164:0/75712257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567ec6b7e60 con 0x5567ec5bd4e0 2024-09-13T23:05:36.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.841+0000 7f7b07fff640 1 -- 172.21.15.164:0/75712257 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7c10074020 con 0x5567ec5bd4e0 2024-09-13T23:05:36.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.841+0000 7f7b07fff640 1 --2- 172.21.15.164:0/75712257 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7b08036b40 0x7f7b08039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.841+0000 7f7b07fff640 1 -- 172.21.15.164:0/75712257 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7c100908e0 con 0x5567ec5bd4e0 2024-09-13T23:05:36.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.841+0000 7f7c1f44d640 1 --2- 172.21.15.164:0/75712257 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7b08036b40 0x7f7b08039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.841+0000 7f7c23f23800 1 --2- 172.21.15.164:0/75712257 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5567ec5bde20 0x5567ec6be470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.841+0000 7f7c23f23800 1 -- 172.21.15.164:0/75712257 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6be9b0 con 0x5567ec5bde20 2024-09-13T23:05:36.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.841+0000 7f7c2044f640 1 --2- 172.21.15.164:0/75712257 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5567ec5bde20 0x5567ec6be470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.842+0000 7f7c1f44d640 1 --2- 172.21.15.164:0/75712257 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7b08036b40 0x7f7b08039000 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7c14000f60 tx=0x7f7c140012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.842+0000 7f7c2044f640 1 --2- 172.21.15.164:0/75712257 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5567ec5bde20 0x5567ec6be470 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.842+0000 7f7c2044f640 1 -- 172.21.15.164:0/75712257 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c180083e0 con 0x5567ec5bde20 2024-09-13T23:05:36.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.842+0000 7f7c23f23800 1 -- 172.21.15.164:0/75712257 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6bba20 con 0x5567ec5bde20 2024-09-13T23:05:36.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.842+0000 7f7c2044f640 1 -- 172.21.15.164:0/75712257 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7c180083e0 con 0x5567ec5bde20 2024-09-13T23:05:36.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.842+0000 7f7c23f23800 1 -- 172.21.15.164:0/75712257 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6c07d0 con 0x5567ec5bde20 2024-09-13T23:05:36.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.843+0000 7f7c2044f640 1 -- 172.21.15.164:0/75712257 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7c180083e0 con 0x5567ec5bde20 2024-09-13T23:05:36.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.843+0000 7f7c23f23800 1 -- 172.21.15.164:0/75712257 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6bfa00 con 0x5567ec5bde20 2024-09-13T23:05:36.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.843+0000 7f7c2044f640 1 -- 172.21.15.164:0/75712257 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7c180083e0 con 0x5567ec5bde20 2024-09-13T23:05:36.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.843+0000 7f7c23f23800 1 -- 172.21.15.164:0/75712257 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6bfdf0 con 0x5567ec5bde20 2024-09-13T23:05:36.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.843+0000 7f7c2044f640 1 -- 172.21.15.164:0/75712257 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7c180083e0 con 0x5567ec5bde20 2024-09-13T23:05:36.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.843+0000 7f7c23f23800 1 Processor -- start 2024-09-13T23:05:36.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.844+0000 7f7c23f23800 1 -- start start 2024-09-13T23:05:36.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.844+0000 7f7c23f23800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec6cee10 0x5567ec6cf230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.844+0000 7f7c23f23800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5567ec459580 con 0x5567ec6cee10 2024-09-13T23:05:36.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.844+0000 7f7c1f44d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec6cee10 0x5567ec6cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.844+0000 7f7c1f44d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec6cee10 0x5567ec6cf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58168/0 (socket says 172.21.15.164:58168) 2024-09-13T23:05:36.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.844+0000 7f7c1f44d640 1 -- 172.21.15.164:0/3267888088 learned_addr learned my addr 172.21.15.164:0/3267888088 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.844+0000 7f7c1f44d640 1 -- 172.21.15.164:0/3267888088 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567ec6cf770 con 0x5567ec6cee10 2024-09-13T23:05:36.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.844+0000 7f7c1f44d640 1 --2- 172.21.15.164:0/3267888088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec6cee10 0x5567ec6cf230 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7c14001ed0 tx=0x7f7c1400d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.844+0000 7f7b057fa640 1 -- 172.21.15.164:0/3267888088 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c1401b550 con 0x5567ec6cee10 2024-09-13T23:05:36.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.844+0000 7f7b057fa640 1 -- 172.21.15.164:0/3267888088 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c1401b6f0 con 0x5567ec6cee10 2024-09-13T23:05:36.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.844+0000 7f7c23f23800 1 -- 172.21.15.164:0/3267888088 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5567ec6cfa00 con 0x5567ec6cee10 2024-09-13T23:05:36.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.844+0000 7f7b057fa640 1 -- 172.21.15.164:0/3267888088 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c1401b9d0 con 0x5567ec6cee10 2024-09-13T23:05:36.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.845+0000 7f7c23f23800 1 -- 172.21.15.164:0/3267888088 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567ec6d26e0 con 0x5567ec6cee10 2024-09-13T23:05:36.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.845+0000 7f7b057fa640 1 -- 172.21.15.164:0/3267888088 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7c14023020 con 0x5567ec6cee10 2024-09-13T23:05:36.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.845+0000 7f7b057fa640 1 --2- 172.21.15.164:0/3267888088 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7af8036b90 0x7f7af8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.845+0000 7f7b057fa640 1 -- 172.21.15.164:0/3267888088 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7c14021020 con 0x5567ec6cee10 2024-09-13T23:05:36.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.846+0000 7f7c2044f640 1 --2- 172.21.15.164:0/3267888088 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7af8036b90 0x7f7af8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.846+0000 7f7c23f23800 1 Processor -- start 2024-09-13T23:05:36.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.846+0000 7f7c2044f640 1 --2- 172.21.15.164:0/3267888088 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7af8036b90 0x7f7af8039050 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x5567ec6bf520 tx=0x7f7c18000f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.846+0000 7f7c23f23800 1 -- start start 2024-09-13T23:05:36.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.846+0000 7f7c23f23800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec6dbb20 0x5567ec6dbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.846+0000 7f7c23f23800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5567ec5c5450 con 0x5567ec6dbb20 2024-09-13T23:05:36.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.846+0000 7f7c1f44d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec6dbb20 0x5567ec6dbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.846+0000 7f7c1f44d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec6dbb20 0x5567ec6dbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58178/0 (socket says 172.21.15.164:58178) 2024-09-13T23:05:36.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.846+0000 7f7c1f44d640 1 -- 172.21.15.164:0/732965892 learned_addr learned my addr 172.21.15.164:0/732965892 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.846+0000 7f7c1f44d640 1 -- 172.21.15.164:0/732965892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567ec6dc4f0 con 0x5567ec6dbb20 2024-09-13T23:05:36.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.847+0000 7f7c1f44d640 1 --2- 172.21.15.164:0/732965892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec6dbb20 0x5567ec6dbf20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7c1404d100 tx=0x7f7c14019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55c111e89625589 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.847+0000 7f7afeffd640 1 -- 172.21.15.164:0/732965892 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c140258e0 con 0x5567ec6dbb20 2024-09-13T23:05:36.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.847+0000 7f7afeffd640 1 -- 172.21.15.164:0/732965892 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c14025410 con 0x5567ec6dbb20 2024-09-13T23:05:36.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.847+0000 7f7afeffd640 1 -- 172.21.15.164:0/732965892 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c14025a80 con 0x5567ec6dbb20 2024-09-13T23:05:36.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.847+0000 7f7c23f23800 1 -- 172.21.15.164:0/732965892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec6dbb20 msgr2=0x5567ec6dbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.847+0000 7f7c23f23800 1 --2- 172.21.15.164:0/732965892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec6dbb20 0x5567ec6dbf20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7c1404d100 tx=0x7f7c14019ce0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.847+0000 7f7c23f23800 1 -- 172.21.15.164:0/732965892 shutdown_connections 2024-09-13T23:05:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.847+0000 7f7c23f23800 1 --2- 172.21.15.164:0/732965892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec6dbb20 0x5567ec6dbf20 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.847+0000 7f7c23f23800 1 -- 172.21.15.164:0/732965892 >> 172.21.15.164:0/732965892 conn(0x5567ec6d7e80 msgr2=0x5567ec6d5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.847+0000 7f7c23f23800 1 -- 172.21.15.164:0/732965892 shutdown_connections 2024-09-13T23:05:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.847+0000 7f7c23f23800 1 -- 172.21.15.164:0/732965892 wait complete. 2024-09-13T23:05:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.847+0000 7f7c23f23800 1 Processor -- start 2024-09-13T23:05:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.848+0000 7f7c23f23800 1 -- start start 2024-09-13T23:05:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.848+0000 7f7c23f23800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec6dbb20 0x5567ec6e3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.848+0000 7f7c23f23800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5567ec6dcb60 con 0x5567ec6dbb20 2024-09-13T23:05:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.848+0000 7f7c1f44d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec6dbb20 0x5567ec6e3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.848+0000 7f7c1f44d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec6dbb20 0x5567ec6e3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58184/0 (socket says 172.21.15.164:58184) 2024-09-13T23:05:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.848+0000 7f7c1f44d640 1 -- 172.21.15.164:0/4005957120 learned_addr learned my addr 172.21.15.164:0/4005957120 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.848+0000 7f7c1f44d640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567ec6e3570 con 0x5567ec6dbb20 2024-09-13T23:05:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.848+0000 7f7c1f44d640 1 --2- 172.21.15.164:0/4005957120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec6dbb20 0x5567ec6e3030 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7c1404d1c0 tx=0x7f7c1404d090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.848+0000 7f7afd7fa640 1 -- 172.21.15.164:0/4005957120 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c1400cc60 con 0x5567ec6dbb20 2024-09-13T23:05:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.848+0000 7f7afd7fa640 1 -- 172.21.15.164:0/4005957120 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c1400ce00 con 0x5567ec6dbb20 2024-09-13T23:05:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.848+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5567ec6e3800 con 0x5567ec6dbb20 2024-09-13T23:05:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.848+0000 7f7afd7fa640 1 -- 172.21.15.164:0/4005957120 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c14040990 con 0x5567ec6dbb20 2024-09-13T23:05:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.848+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567ec6e3800 con 0x5567ec6dbb20 2024-09-13T23:05:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.849+0000 7f7afd7fa640 1 -- 172.21.15.164:0/4005957120 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7c14040b30 con 0x5567ec6dbb20 2024-09-13T23:05:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.849+0000 7f7afd7fa640 1 --2- 172.21.15.164:0/4005957120 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7ae8036b90 0x7f7ae8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.849+0000 7f7afd7fa640 1 -- 172.21.15.164:0/4005957120 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7c14035070 con 0x5567ec6dbb20 2024-09-13T23:05:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.849+0000 7f7c2044f640 1 --2- 172.21.15.164:0/4005957120 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7ae8036b90 0x7f7ae8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.850+0000 7f7c2044f640 1 --2- 172.21.15.164:0/4005957120 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7ae8036b90 0x7f7ae8039050 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7c1800f010 tx=0x7f7c1800c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.850+0000 7f7c23f23800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.850+0000 7f7c23f23800 1 --2- 172.21.15.164:0/4005957120 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5567ec6ee950 0x5567ec6f0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.850+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f1560 con 0x5567ec6ee950 2024-09-13T23:05:36.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.850+0000 7f7c1fc4e640 1 --2- 172.21.15.164:0/4005957120 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5567ec6ee950 0x5567ec6f0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.850+0000 7f7c1fc4e640 1 --2- 172.21.15.164:0/4005957120 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5567ec6ee950 0x5567ec6f0e10 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.851+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.851+0000 7f7c23f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.851+0000 7f7c23f23800 20 realm 2024-09-13T23:05:36.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.851+0000 7f7c23f23800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.851+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f1970 con 0x5567ec6ee950 2024-09-13T23:05:36.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.851+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.851+0000 7f7c23f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.851+0000 7f7c23f23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:36.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.851+0000 7f7c23f23800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.851+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f2240 con 0x5567ec6ee950 2024-09-13T23:05:36.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.851+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.851+0000 7f7c23f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.851+0000 7f7c23f23800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.851+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f25e0 con 0x5567ec6ee950 2024-09-13T23:05:36.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.851+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.851+0000 7f7c23f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:36.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.851+0000 7f7c23f23800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.851+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f2e30 con 0x5567ec6ee950 2024-09-13T23:05:36.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.852+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.852+0000 7f7c23f23800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:36.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.852+0000 7f7c23f23800 20 searching for the correct realm 2024-09-13T23:05:36.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.852+0000 7f7c23f23800 1 --2- 172.21.15.164:0/4005957120 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5567ec6f4ba0 0x5567ec6f6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.852+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x5567ec6f4ba0 2024-09-13T23:05:36.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.852+0000 7f7c1f44d640 1 --2- 172.21.15.164:0/4005957120 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5567ec6f4ba0 0x5567ec6f6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.852+0000 7f7c1f44d640 1 --2- 172.21.15.164:0/4005957120 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5567ec6f4ba0 0x5567ec6f6f90 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.852+0000 7f7c1f44d640 1 -- 172.21.15.164:0/4005957120 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c1403f020 con 0x5567ec6f4ba0 2024-09-13T23:05:36.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.852+0000 7f7c1f44d640 1 --2- 172.21.15.164:0/4005957120 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7c14042070 0x7f7c14039420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.852+0000 7f7c1f44d640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x7f7c14042070 2024-09-13T23:05:36.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.853+0000 7f7c2044f640 1 --2- 172.21.15.164:0/4005957120 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7c14042070 0x7f7c14039420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.853+0000 7f7c2044f640 1 --2- 172.21.15.164:0/4005957120 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7c14042070 0x7f7c14039420 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.853+0000 7f7c2044f640 1 -- 172.21.15.164:0/4005957120 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c1802f040 con 0x7f7c14042070 2024-09-13T23:05:36.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.853+0000 7f7c2044f640 1 --2- 172.21.15.164:0/4005957120 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7c18019040 0x7f7c18019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.853+0000 7f7c2044f640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x7f7c18019040 2024-09-13T23:05:36.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.853+0000 7f7c1fc4e640 1 --2- 172.21.15.164:0/4005957120 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7c18019040 0x7f7c18019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.854+0000 7f7c1fc4e640 1 --2- 172.21.15.164:0/4005957120 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7c18019040 0x7f7c18019930 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.854+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c10076410 con 0x7f7c18019040 2024-09-13T23:05:36.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.854+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x5567ec6ee950 2024-09-13T23:05:36.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.854+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.854+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x5567ec6ee950 2024-09-13T23:05:36.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.854+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.854+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x7f7c18019040 2024-09-13T23:05:36.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.855+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c10076410 con 0x7f7c18019040 2024-09-13T23:05:36.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.855+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x7f7c18019040 2024-09-13T23:05:36.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.855+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c10076410 con 0x7f7c18019040 2024-09-13T23:05:36.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.855+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x7f7c14042070 2024-09-13T23:05:36.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.855+0000 7f7c2044f640 1 -- 172.21.15.164:0/4005957120 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c1802f040 con 0x7f7c14042070 2024-09-13T23:05:36.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.855+0000 7f7c2044f640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x5567ec6f4ba0 2024-09-13T23:05:36.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.855+0000 7f7c1f44d640 1 -- 172.21.15.164:0/4005957120 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c1403f020 con 0x5567ec6f4ba0 2024-09-13T23:05:36.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.855+0000 7f7c1f44d640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x5567ec6ee950 2024-09-13T23:05:36.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.855+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.855+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x7f7c18019040 2024-09-13T23:05:36.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.856+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c10076410 con 0x7f7c18019040 2024-09-13T23:05:36.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.856+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x5567ec6ee950 2024-09-13T23:05:36.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.856+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.856+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x7f7c14042070 2024-09-13T23:05:36.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.856+0000 7f7c2044f640 1 -- 172.21.15.164:0/4005957120 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7c1802f040 con 0x7f7c14042070 2024-09-13T23:05:36.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.856+0000 7f7c2044f640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x5567ec6f4ba0 2024-09-13T23:05:36.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.856+0000 7f7c1f44d640 1 -- 172.21.15.164:0/4005957120 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c1403f020 con 0x5567ec6f4ba0 2024-09-13T23:05:36.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.856+0000 7f7c1f44d640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x5567ec6f4ba0 2024-09-13T23:05:36.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.857+0000 7f7c1f44d640 1 -- 172.21.15.164:0/4005957120 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c1403f020 con 0x5567ec6f4ba0 2024-09-13T23:05:36.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.857+0000 7f7c1f44d640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x7f7c18019040 2024-09-13T23:05:36.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.857+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c10076410 con 0x7f7c18019040 2024-09-13T23:05:36.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.857+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x5567ec6f4ba0 2024-09-13T23:05:36.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.857+0000 7f7c1f44d640 1 -- 172.21.15.164:0/4005957120 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c1403f020 con 0x5567ec6f4ba0 2024-09-13T23:05:36.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.857+0000 7f7c1f44d640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x5567ec6f4ba0 2024-09-13T23:05:36.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.857+0000 7f7c1f44d640 1 -- 172.21.15.164:0/4005957120 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c1403f020 con 0x5567ec6f4ba0 2024-09-13T23:05:36.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.857+0000 7f7c1f44d640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x5567ec6ee950 2024-09-13T23:05:36.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.858+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.858+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x5567ec6ee950 2024-09-13T23:05:36.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.858+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.858+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x7f7c18019040 2024-09-13T23:05:36.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.858+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c10076410 con 0x7f7c18019040 2024-09-13T23:05:36.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.858+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x5567ec6f4ba0 2024-09-13T23:05:36.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.858+0000 7f7c1f44d640 1 -- 172.21.15.164:0/4005957120 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c1403f020 con 0x5567ec6f4ba0 2024-09-13T23:05:36.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.858+0000 7f7c1f44d640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x7f7c14042070 2024-09-13T23:05:36.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.859+0000 7f7c2044f640 1 -- 172.21.15.164:0/4005957120 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c1802f040 con 0x7f7c14042070 2024-09-13T23:05:36.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.859+0000 7f7c2044f640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x5567ec6ee950 2024-09-13T23:05:36.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.859+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.859+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x7f7c18019040 2024-09-13T23:05:36.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.859+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c10076410 con 0x7f7c18019040 2024-09-13T23:05:36.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.859+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x5567ec6f4ba0 2024-09-13T23:05:36.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.859+0000 7f7c1f44d640 1 -- 172.21.15.164:0/4005957120 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c1403f020 con 0x5567ec6f4ba0 2024-09-13T23:05:36.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.860+0000 7f7c1f44d640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x7f7c18019040 2024-09-13T23:05:36.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.860+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c10076410 con 0x7f7c18019040 2024-09-13T23:05:36.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.860+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x7f7c14042070 2024-09-13T23:05:36.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.860+0000 7f7c2044f640 1 -- 172.21.15.164:0/4005957120 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c1802f040 con 0x7f7c14042070 2024-09-13T23:05:36.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.860+0000 7f7c2044f640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x5567ec6f4ba0 2024-09-13T23:05:36.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.860+0000 7f7c1f44d640 1 -- 172.21.15.164:0/4005957120 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c1403f020 con 0x5567ec6f4ba0 2024-09-13T23:05:36.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.860+0000 7f7c1f44d640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x7f7c18019040 2024-09-13T23:05:36.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.861+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c10076410 con 0x7f7c18019040 2024-09-13T23:05:36.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.861+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x5567ec6ee950 2024-09-13T23:05:36.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.861+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.861+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f7570 con 0x7f7c14042070 2024-09-13T23:05:36.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.861+0000 7f7c2044f640 1 -- 172.21.15.164:0/4005957120 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c1802f040 con 0x7f7c14042070 2024-09-13T23:05:36.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.861+0000 7f7c23f23800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:36.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.861+0000 7f7c23f23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:36.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.861+0000 7f7c23f23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:36.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.861+0000 7f7c23f23800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:36.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.861+0000 7f7c23f23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:36.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.861+0000 7f7c23f23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:36.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.861+0000 7f7c23f23800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.861+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f37b0 con 0x5567ec6ee950 2024-09-13T23:05:36.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.861+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.861+0000 7f7c23f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.861+0000 7f7c23f23800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.861+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f3ba0 con 0x5567ec6ee950 2024-09-13T23:05:36.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.862+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.862+0000 7f7c23f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:36.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.862+0000 7f7c23f23800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.862+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f3ba0 con 0x5567ec6ee950 2024-09-13T23:05:36.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.862+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.862+0000 7f7c23f23800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:36.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.862+0000 7f7c23f23800 20 zone default found 2024-09-13T23:05:36.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.862+0000 7f7c23f23800 4 Realm: () 2024-09-13T23:05:36.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.862+0000 7f7c23f23800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:36.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.862+0000 7f7c23f23800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:36.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.862+0000 7f7c23f23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:36.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.862+0000 7f7c23f23800 20 zonegroup default 2024-09-13T23:05:36.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.862+0000 7f7c23f23800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.862+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f3fc0 con 0x7f7c18019040 2024-09-13T23:05:36.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.862+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x7f7c18019040 2024-09-13T23:05:36.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.862+0000 7f7c23f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.862+0000 7f7c23f23800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.862+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f3fc0 con 0x5567ec6f4ba0 2024-09-13T23:05:36.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.863+0000 7f7c1f44d640 1 -- 172.21.15.164:0/4005957120 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7c1403f020 con 0x5567ec6f4ba0 2024-09-13T23:05:36.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.863+0000 7f7c23f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.863+0000 7f7c23f23800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.863+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f9470 con 0x5567ec6f4ba0 2024-09-13T23:05:36.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.863+0000 7f7c1f44d640 1 -- 172.21.15.164:0/4005957120 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7c1403f020 con 0x5567ec6f4ba0 2024-09-13T23:05:36.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.863+0000 7f7c23f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:36.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.863+0000 7f7c23f23800 20 started sync module instance, tier type = 2024-09-13T23:05:36.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.863+0000 7f7c23f23800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:36.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.863+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f8870 con 0x7f7c14042070 2024-09-13T23:05:36.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.864+0000 7f7c2044f640 1 -- 172.21.15.164:0/4005957120 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c1802f040 con 0x7f7c14042070 2024-09-13T23:05:36.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.864+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93904836726128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f8870 con 0x7f7c14042070 2024-09-13T23:05:36.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.864+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f9fa0 con 0x5567ec6ee950 2024-09-13T23:05:36.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.865+0000 7f7c2044f640 1 -- 172.21.15.164:0/4005957120 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93904836726128] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c1802f040 con 0x7f7c14042070 2024-09-13T23:05:36.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.865+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.865+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93904836729488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f8870 con 0x5567ec6ee950 2024-09-13T23:05:36.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.865+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6faa90 con 0x5567ec6f4ba0 2024-09-13T23:05:36.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.866+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93904836729488] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.867+0000 7f7c1f44d640 1 -- 172.21.15.164:0/4005957120 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c1403f020 con 0x5567ec6f4ba0 2024-09-13T23:05:36.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.867+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93904836723648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6f87e0 con 0x5567ec6f4ba0 2024-09-13T23:05:36.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.867+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6fb950 con 0x7f7c14042070 2024-09-13T23:05:36.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.868+0000 7f7c1f44d640 1 -- 172.21.15.164:0/4005957120 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93904836723648] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c1403f020 con 0x5567ec6f4ba0 2024-09-13T23:05:36.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.868+0000 7f7c2044f640 1 -- 172.21.15.164:0/4005957120 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c1802f040 con 0x7f7c14042070 2024-09-13T23:05:36.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.868+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93904836736160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6fbd70 con 0x7f7c14042070 2024-09-13T23:05:36.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.868+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6fc730 con 0x5567ec6ee950 2024-09-13T23:05:36.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.869+0000 7f7c2044f640 1 -- 172.21.15.164:0/4005957120 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93904836736160] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c1802f040 con 0x7f7c14042070 2024-09-13T23:05:36.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.869+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.869+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93904836740192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6fbd70 con 0x5567ec6ee950 2024-09-13T23:05:36.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.869+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6fd140 con 0x7f7c18019040 2024-09-13T23:05:36.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.870+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93904836740192] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.870+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x7f7c18019040 2024-09-13T23:05:36.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.870+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93904836737696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6fd140 con 0x7f7c18019040 2024-09-13T23:05:36.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.870+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6fdb00 con 0x7f7c18019040 2024-09-13T23:05:36.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.871+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x7f7c18019040 2024-09-13T23:05:36.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.871+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93904836744784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6fdf60 con 0x7f7c18019040 2024-09-13T23:05:36.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.871+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6fea60 con 0x7f7c18019040 2024-09-13T23:05:36.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.871+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93904836737696] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x7f7c18019040 2024-09-13T23:05:36.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.872+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x7f7c18019040 2024-09-13T23:05:36.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.872+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93904836748624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6fea20 con 0x7f7c18019040 2024-09-13T23:05:36.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.872+0000 7f7c23f23800 20 add_watcher() i=0 2024-09-13T23:05:36.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.872+0000 7f7c23f23800 20 add_watcher() i=1 2024-09-13T23:05:36.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.872+0000 7f7c23f23800 20 add_watcher() i=2 2024-09-13T23:05:36.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.872+0000 7f7c23f23800 20 add_watcher() i=3 2024-09-13T23:05:36.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.872+0000 7f7c23f23800 20 add_watcher() i=4 2024-09-13T23:05:36.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.872+0000 7f7c23f23800 20 add_watcher() i=5 2024-09-13T23:05:36.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.872+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93904836744784] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x7f7c18019040 2024-09-13T23:05:36.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.872+0000 7f7c23f23800 20 add_watcher() i=6 2024-09-13T23:05:36.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.873+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93904836748624] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x7f7c18019040 2024-09-13T23:05:36.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.873+0000 7f7c23f23800 20 add_watcher() i=7 2024-09-13T23:05:36.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.873+0000 7f7c23f23800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:36.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.873+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6fda70 con 0x5567ec6ee950 2024-09-13T23:05:36.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.873+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.873+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93904836745840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec6fee50 con 0x5567ec6ee950 2024-09-13T23:05:36.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.874+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93904836745840] v32'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.874+0000 7f7ad5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:36.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.874+0000 7f7c23f23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:36.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.874+0000 7f7c23f23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:36.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.874+0000 7f7c23f23800 5 note: GC not initialized 2024-09-13T23:05:36.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.875+0000 7f7ad4fe1640 20 reqs_thread_entry: start 2024-09-13T23:05:36.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.875+0000 7f7c23f23800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:36.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.875+0000 7f7c23f23800 20 Filter name: none 2024-09-13T23:05:36.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.875+0000 7f7a4e7fc640 20 reqs_thread_entry: start 2024-09-13T23:05:36.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.875+0000 7f7c23f23800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-13T23:05:36.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.875+0000 7f7c23f23800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.875+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567ec734ee0 con 0x7f7c18019040 2024-09-13T23:05:36.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.876+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f7c10076410 con 0x7f7c18019040 2024-09-13T23:05:36.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.876+0000 7f7c23f23800 20 rados_obj.operate() r=0 bl.length=419 2024-09-13T23:05:36.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.876+0000 7f7c23f23800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-13T23:05:36.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.876+0000 7f7c23f23800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T23:05:36.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.876+0000 7f7c23f23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:36.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.876+0000 7f7c23f23800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:05:36.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.876+0000 7f7c23f23800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.876+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567ec734930 con 0x7f7c14042070 2024-09-13T23:05:36.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.876+0000 7f7c2044f640 1 -- 172.21.15.164:0/4005957120 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f7c1802f040 con 0x7f7c14042070 2024-09-13T23:05:36.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.876+0000 7f7c23f23800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:05:36.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.876+0000 7f7c23f23800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:05:36.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.876+0000 7f7c23f23800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:05:36.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.876+0000 7f7c23f23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 : miss 2024-09-13T23:05:36.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.876+0000 7f7c23f23800 20 rados->read ofs=0 len=0 2024-09-13T23:05:36.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.876+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 8.15 8:aa4f46c1:root::.bucket.meta.myfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567ec738680 con 0x5567ec6f4ba0 2024-09-13T23:05:36.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.877+0000 7f7c1f44d640 1 -- 172.21.15.164:0/4005957120 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f7c1403f020 con 0x5567ec6f4ba0 2024-09-13T23:05:36.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.877+0000 7f7c23f23800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:05:36.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.877+0000 7f7c23f23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 info.flags=0x17 2024-09-13T23:05:36.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.877+0000 7f7c23f23800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 to cache LRU end 2024-09-13T23:05:36.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.877+0000 7f7c23f23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:36.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.877+0000 7f7c23f23800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:05:36.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.877+0000 7f7c23f23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 2024-09-13T23:05:36.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.877+0000 7f7c23f23800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-13T23:05:36.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.877+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec73ce30 con 0x7f7c14042070 2024-09-13T23:05:36.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.878+0000 7f7c2044f640 1 -- 172.21.15.164:0/4005957120 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(65 foo.buckets [call] v32'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7c1802f040 con 0x7f7c14042070 2024-09-13T23:05:36.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.878+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 8.18 8:1ee4a648:root::.bucket.meta.testx%3amyfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1:head [create,call version.inc in=38b,writefull 0~412 in=412b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec740740 con 0x5567ec6ee950 2024-09-13T23:05:36.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.879+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 [create,call,writefull 0~412,setxattr (203)] v32'12 uv12 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.879+0000 7f7c23f23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 info.flags=0x7 2024-09-13T23:05:36.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.879+0000 7f7c23f23800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 to cache LRU end 2024-09-13T23:05:36.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.879+0000 7f7c23f23800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-13T23:05:36.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.879+0000 7f7c23f23800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1, ofs0, ns] 2024-09-13T23:05:36.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.879+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 93904837010800 in=859b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567ec7401f0 con 0x5567ec6ee950 2024-09-13T23:05:36.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.879+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== watch-notify(notify (1) cookie 93904836740192 notify 137438953483 ret 0) ==== 889+0+0 (crc 0 0 0) 0x5567ec73cc30 con 0x5567ec6ee950 2024-09-13T23:05:36.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.879+0000 7f7afeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953483 cookie 93904836740192 notifier 4554 bl.length()=847 2024-09-13T23:05:36.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.879+0000 7f7afeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 info.flags=0x7 2024-09-13T23:05:36.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.879+0000 7f7afeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 to cache LRU end 2024-09-13T23:05:36.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.879+0000 7f7afeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-13T23:05:36.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.879+0000 7f7afeffd640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7ae4003ea0 con 0x5567ec6ee950 2024-09-13T23:05:36.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.880+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(67 notify.4 [notify cookie 93904837010800 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.880+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.880+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== watch-notify(notify_complete (2) cookie 93904837010800 notify 137438953483 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7c10085040 con 0x5567ec6ee950 2024-09-13T23:05:36.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.880+0000 7f7c23f23800 20 handle_bi_update(): bucket=testx:myfoo[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1]): orig_sources= new_sources= 2024-09-13T23:05:36.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.880+0000 7f7c23f23800 20 handle_bi_update(): bucket=testx:myfoo[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1]): potential sources added=[] removed=[] 2024-09-13T23:05:36.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.880+0000 7f7c23f23800 20 handle_bi_update(): bucket=testx:myfoo[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1]): orig_dests= new_dests= 2024-09-13T23:05:36.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.880+0000 7f7c23f23800 20 handle_bi_update(): bucket=testx:myfoo[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1]): potential dests added=[] removed=[] 2024-09-13T23:05:36.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.880+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec73c060 con 0x5567ec6ee950 2024-09-13T23:05:36.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.881+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v32'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.881+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec73c060 con 0x5567ec6ee950 2024-09-13T23:05:36.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.882+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v32'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.882+0000 7f7c23f23800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-13T23:05:36.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.882+0000 7f7c23f23800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-13T23:05:36.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.882+0000 7f7c23f23800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-13T23:05:36.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.882+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 93904837000112 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567ec740df0 con 0x5567ec6ee950 2024-09-13T23:05:36.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.882+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== watch-notify(notify (1) cookie 93904836740192 notify 137438953484 ret 0) ==== 390+0+0 (crc 0 0 0) 0x5567ec73f580 con 0x5567ec6ee950 2024-09-13T23:05:36.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.882+0000 7f7afe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 93904836740192 notifier 4554 bl.length()=348 2024-09-13T23:05:36.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.882+0000 7f7afe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-13T23:05:36.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.882+0000 7f7afe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-13T23:05:36.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.882+0000 7f7afe7fc640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7a54003400 con 0x5567ec6ee950 2024-09-13T23:05:36.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.882+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(71 notify.4 [notify cookie 93904837000112 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.883+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 32 ==== watch-notify(notify_complete (2) cookie 93904837000112 notify 137438953484 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7c10085040 con 0x5567ec6ee950 2024-09-13T23:05:36.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.883+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 33 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.883+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec73c060 con 0x7f7c14042070 2024-09-13T23:05:36.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.884+0000 7f7c2044f640 1 -- 172.21.15.164:0/4005957120 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(73 myfoo [call,delete] v32'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f7c1802f040 con 0x7f7c14042070 2024-09-13T23:05:36.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.884+0000 7f7c23f23800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-13T23:05:36.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.884+0000 7f7c23f23800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T23:05:36.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.884+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93904837000112 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567ec73d560 con 0x7f7c18019040 2024-09-13T23:05:36.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.884+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== watch-notify(notify (1) cookie 93904836744784 notify 137438953483 ret 0) ==== 191+0+0 (crc 0 0 0) 0x7f7c10085040 con 0x7f7c18019040 2024-09-13T23:05:36.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.884+0000 7f7afeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953483 cookie 93904836744784 notifier 4554 bl.length()=149 2024-09-13T23:05:36.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.884+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(74 notify.6 [notify cookie 93904837000112 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7c10076410 con 0x7f7c18019040 2024-09-13T23:05:36.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.884+0000 7f7afeffd640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7ae4003ea0 con 0x7f7c18019040 2024-09-13T23:05:36.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.884+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x7f7c18019040 2024-09-13T23:05:36.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.884+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== watch-notify(notify_complete (2) cookie 93904837000112 notify 137438953483 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5567ec6b7e60 con 0x7f7c18019040 2024-09-13T23:05:36.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.884+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:76 8.15 8:aa4f46c1:root::.bucket.meta.myfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec73c060 con 0x5567ec6f4ba0 2024-09-13T23:05:36.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.885+0000 7f7c1f44d640 1 -- 172.21.15.164:0/4005957120 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(76 .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 [call,delete] v32'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f7c1403f020 con 0x5567ec6f4ba0 2024-09-13T23:05:36.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.885+0000 7f7c23f23800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 from cache 2024-09-13T23:05:36.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.885+0000 7f7c23f23800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1, ofs0, ns] 2024-09-13T23:05:36.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.885+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:77 7.3 7:c609908c:::notify.5:head [notify cookie 93904836988192 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5567ec73c060 con 0x7f7c18019040 2024-09-13T23:05:36.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.886+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== watch-notify(notify (1) cookie 93904836737696 notify 137438953484 ret 0) ==== 248+0+0 (crc 0 0 0) 0x5567ec6b7e60 con 0x7f7c18019040 2024-09-13T23:05:36.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.886+0000 7f7afe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 93904836737696 notifier 4554 bl.length()=206 2024-09-13T23:05:36.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.886+0000 7f7afe7fc640 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7a540033c0 con 0x7f7c18019040 2024-09-13T23:05:36.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.886+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(77 notify.5 [notify cookie 93904836988192 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7c10076410 con 0x7f7c18019040 2024-09-13T23:05:36.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.886+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(78 notify.5 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x7f7c18019040 2024-09-13T23:05:36.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.886+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== watch-notify(notify_complete (2) cookie 93904836988192 notify 137438953484 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5567ec6b7940 con 0x7f7c18019040 2024-09-13T23:05:36.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.887+0000 7f7ad5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:36.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.887+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93904836745840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec732a90 con 0x5567ec6ee950 2024-09-13T23:05:36.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.888+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 34 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 93904836745840] v32'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.888+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93904836726128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec732a90 con 0x7f7c14042070 2024-09-13T23:05:36.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.889+0000 7f7c2044f640 1 -- 172.21.15.164:0/4005957120 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 93904836726128] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c1802f040 con 0x7f7c14042070 2024-09-13T23:05:36.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.889+0000 7f7c23f23800 20 remove_watcher() i=0 2024-09-13T23:05:36.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.889+0000 7f7c23f23800 2 removed watcher, disabling cache 2024-09-13T23:05:36.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.889+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93904836729488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec732a90 con 0x5567ec6ee950 2024-09-13T23:05:36.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.890+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 35 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 93904836729488] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.890+0000 7f7c23f23800 20 remove_watcher() i=1 2024-09-13T23:05:36.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.890+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93904836723648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec732a90 con 0x5567ec6f4ba0 2024-09-13T23:05:36.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.891+0000 7f7c1f44d640 1 -- 172.21.15.164:0/4005957120 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 93904836723648] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c1403f020 con 0x5567ec6f4ba0 2024-09-13T23:05:36.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.891+0000 7f7c23f23800 20 remove_watcher() i=2 2024-09-13T23:05:36.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.891+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93904836736160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec732a90 con 0x7f7c14042070 2024-09-13T23:05:36.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.892+0000 7f7c2044f640 1 -- 172.21.15.164:0/4005957120 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 93904836736160] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c1802f040 con 0x7f7c14042070 2024-09-13T23:05:36.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.892+0000 7f7c23f23800 20 remove_watcher() i=3 2024-09-13T23:05:36.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.892+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93904836740192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec732a90 con 0x5567ec6ee950 2024-09-13T23:05:36.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.893+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.1 v2:172.21.15.164:6800/4060509701 36 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 93904836740192] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x5567ec6ee950 2024-09-13T23:05:36.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.893+0000 7f7c23f23800 20 remove_watcher() i=4 2024-09-13T23:05:36.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.893+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93904836737696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec732a90 con 0x7f7c18019040 2024-09-13T23:05:36.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.894+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 93904836737696] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x7f7c18019040 2024-09-13T23:05:36.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.894+0000 7f7c23f23800 20 remove_watcher() i=5 2024-09-13T23:05:36.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.894+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93904836744784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec732a90 con 0x7f7c18019040 2024-09-13T23:05:36.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.895+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.0 v2:172.21.15.17:6800/489863589 27 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 93904836744784] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x7f7c18019040 2024-09-13T23:05:36.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.895+0000 7f7c23f23800 20 remove_watcher() i=6 2024-09-13T23:05:36.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.895+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93904836748624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5567ec732a90 con 0x7f7c18019040 2024-09-13T23:05:36.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.896+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 <== osd.0 v2:172.21.15.17:6800/489863589 28 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 93904836748624] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c10076410 con 0x7f7c18019040 2024-09-13T23:05:36.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.896+0000 7f7c23f23800 20 remove_watcher() i=7 2024-09-13T23:05:36.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.896+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7c18019040 msgr2=0x7f7c18019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.896+0000 7f7c23f23800 1 --2- 172.21.15.164:0/4005957120 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7c18019040 0x7f7c18019930 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.896+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5567ec6ee950 msgr2=0x5567ec6f0e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.896+0000 7f7c23f23800 1 --2- 172.21.15.164:0/4005957120 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5567ec6ee950 0x5567ec6f0e10 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.896+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7c14042070 msgr2=0x7f7c14039420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.896+0000 7f7c23f23800 1 --2- 172.21.15.164:0/4005957120 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7c14042070 0x7f7c14039420 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.896+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5567ec6f4ba0 msgr2=0x5567ec6f6f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.896+0000 7f7c23f23800 1 --2- 172.21.15.164:0/4005957120 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5567ec6f4ba0 0x5567ec6f6f90 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.896+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7ae8036b90 msgr2=0x7f7ae8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.896+0000 7f7c23f23800 1 --2- 172.21.15.164:0/4005957120 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7ae8036b90 0x7f7ae8039050 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7c1800f010 tx=0x7f7c1800c040 comp rx=0 tx=0).stop 2024-09-13T23:05:36.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.896+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec6dbb20 msgr2=0x5567ec6e3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.896+0000 7f7c23f23800 1 --2- 172.21.15.164:0/4005957120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec6dbb20 0x5567ec6e3030 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7c1404d1c0 tx=0x7f7c1404d090 comp rx=0 tx=0).stop 2024-09-13T23:05:36.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.896+0000 7f7c1fc4e640 1 -- 172.21.15.164:0/4005957120 reap_dead start 2024-09-13T23:05:36.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.896+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 shutdown_connections 2024-09-13T23:05:36.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.896+0000 7f7c23f23800 1 --2- 172.21.15.164:0/4005957120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec6dbb20 0x5567ec6e3030 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.896+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 >> 172.21.15.164:0/4005957120 conn(0x5567ec6d7e80 msgr2=0x5567ec6d5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.896+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 shutdown_connections 2024-09-13T23:05:36.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.896+0000 7f7c23f23800 1 -- 172.21.15.164:0/4005957120 wait complete. 2024-09-13T23:05:36.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.896+0000 7f7c23f23800 1 -- 172.21.15.164:0/3267888088 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7af8036b90 msgr2=0x7f7af8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.896+0000 7f7c23f23800 1 --2- 172.21.15.164:0/3267888088 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7af8036b90 0x7f7af8039050 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x5567ec6bf520 tx=0x7f7c18000f90 comp rx=0 tx=0).stop 2024-09-13T23:05:36.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.896+0000 7f7c23f23800 1 -- 172.21.15.164:0/3267888088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec6cee10 msgr2=0x5567ec6cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.896+0000 7f7c23f23800 1 --2- 172.21.15.164:0/3267888088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec6cee10 0x5567ec6cf230 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7c14001ed0 tx=0x7f7c1400d7a0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.896+0000 7f7c23f23800 1 -- 172.21.15.164:0/3267888088 shutdown_connections 2024-09-13T23:05:36.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.896+0000 7f7c23f23800 1 --2- 172.21.15.164:0/3267888088 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7af8036b90 0x7f7af8039050 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.896+0000 7f7c23f23800 1 --2- 172.21.15.164:0/3267888088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec6cee10 0x5567ec6cf230 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.896+0000 7f7c23f23800 1 -- 172.21.15.164:0/3267888088 >> 172.21.15.164:0/3267888088 conn(0x5567ec6c3da0 msgr2=0x5567ec6c6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.897+0000 7f7c23f23800 1 -- 172.21.15.164:0/3267888088 shutdown_connections 2024-09-13T23:05:36.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.897+0000 7f7c23f23800 1 -- 172.21.15.164:0/3267888088 wait complete. 2024-09-13T23:05:36.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.897+0000 7f7c23f23800 1 -- 172.21.15.164:0/75712257 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5567ec5bde20 msgr2=0x5567ec6be470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.897+0000 7f7c23f23800 1 --2- 172.21.15.164:0/75712257 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5567ec5bde20 0x5567ec6be470 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.897+0000 7f7c23f23800 1 -- 172.21.15.164:0/75712257 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7b08036b40 msgr2=0x7f7b08039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.897+0000 7f7c23f23800 1 --2- 172.21.15.164:0/75712257 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7b08036b40 0x7f7b08039000 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7c14000f60 tx=0x7f7c140012b0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.897+0000 7f7c23f23800 1 -- 172.21.15.164:0/75712257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec5bd4e0 msgr2=0x5567ec6b7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.897+0000 7f7c23f23800 1 --2- 172.21.15.164:0/75712257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec5bd4e0 0x5567ec6b7400 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7c1000a3f0 tx=0x7f7c10003330 comp rx=0 tx=0).stop 2024-09-13T23:05:36.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.897+0000 7f7c23f23800 1 -- 172.21.15.164:0/75712257 shutdown_connections 2024-09-13T23:05:36.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.897+0000 7f7c23f23800 1 --2- 172.21.15.164:0/75712257 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5567ec5bde20 0x5567ec6be470 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.897+0000 7f7c23f23800 1 --2- 172.21.15.164:0/75712257 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7b08036b40 0x7f7b08039000 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.897+0000 7f7c23f23800 1 --2- 172.21.15.164:0/75712257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5567ec5bd4e0 0x5567ec6b7400 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.897+0000 7f7c23f23800 1 -- 172.21.15.164:0/75712257 >> 172.21.15.164:0/75712257 conn(0x5567ec5b8e10 msgr2=0x5567ec6a8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.897+0000 7f7c23f23800 1 -- 172.21.15.164:0/75712257 shutdown_connections 2024-09-13T23:05:36.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.897+0000 7f7c23f23800 1 -- 172.21.15.164:0/75712257 wait complete. 2024-09-13T23:05:36.917 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-13T23:05:36.917 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-13T23:05:36.918 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-13T23:05:36.963 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:36.963 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:36.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.962+0000 7fca07236800 1 Processor -- start 2024-09-13T23:05:36.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.962+0000 7fca07236800 1 -- start start 2024-09-13T23:05:36.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.962+0000 7fca07236800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55c5cf9805c0 0x55c5cf9809c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.962+0000 7fca07236800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c5cf83fb30 con 0x55c5cf980f00 2024-09-13T23:05:36.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.962+0000 7fca07236800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55c5cf821360 con 0x55c5cf9805c0 2024-09-13T23:05:36.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.963+0000 7fca02552640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55c5cf9805c0 0x55c5cf9809c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.963+0000 7fc9fbfff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55c5cf980f00 0x55c5cf985a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:41064/0 (socket says 172.21.15.164:41064) 2024-09-13T23:05:36.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.963+0000 7fc9fbfff640 1 -- 172.21.15.164:0/2830173460 learned_addr learned my addr 172.21.15.164:0/2830173460 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:36.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.963+0000 7fca02552640 1 -- 172.21.15.164:0/2830173460 >> v1:172.21.15.17:6789/0 conn(0x55c5cf980f00 legacy=0x55c5cf985a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.963+0000 7fca02552640 1 -- 172.21.15.164:0/2830173460 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5cf847e00 con 0x55c5cf9805c0 2024-09-13T23:05:36.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.965+0000 7fca02552640 1 --2- 172.21.15.164:0/2830173460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cf9805c0 0x55c5cf9809c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400a470 tx=0x7fc9f4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=623e0cdea68740d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.965+0000 7fca01d51640 1 -- 172.21.15.164:0/2830173460 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9f4053570 con 0x55c5cf9805c0 2024-09-13T23:05:36.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.965+0000 7fca01d51640 1 -- 172.21.15.164:0/2830173460 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9f4058070 con 0x55c5cf9805c0 2024-09-13T23:05:36.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.965+0000 7fca01d51640 1 -- 172.21.15.164:0/2830173460 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9f4053880 con 0x55c5cf9805c0 2024-09-13T23:05:36.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.965+0000 7fca07236800 1 -- 172.21.15.164:0/2830173460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cf9805c0 msgr2=0x55c5cf9809c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.965+0000 7fca07236800 1 --2- 172.21.15.164:0/2830173460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cf9805c0 0x55c5cf9809c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400a470 tx=0x7fc9f4045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:36.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.965+0000 7fca07236800 1 -- 172.21.15.164:0/2830173460 shutdown_connections 2024-09-13T23:05:36.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.965+0000 7fca07236800 1 --2- 172.21.15.164:0/2830173460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cf9805c0 0x55c5cf9809c0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.965+0000 7fca07236800 1 -- 172.21.15.164:0/2830173460 >> 172.21.15.164:0/2830173460 conn(0x55c5cf97bed0 msgr2=0x55c5cf97e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.965+0000 7fca07236800 1 -- 172.21.15.164:0/2830173460 shutdown_connections 2024-09-13T23:05:36.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.965+0000 7fca07236800 1 -- 172.21.15.164:0/2830173460 wait complete. 2024-09-13T23:05:36.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.979+0000 7fca07236800 1 Processor -- start 2024-09-13T23:05:36.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.979+0000 7fca07236800 1 -- start start 2024-09-13T23:05:36.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.979+0000 7fca07236800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cf9805c0 0x55c5cfa6f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.980+0000 7fca07236800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c5cf8cc330 con 0x55c5cf9805c0 2024-09-13T23:05:36.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.980+0000 7fca02552640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cf9805c0 0x55c5cfa6f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.980+0000 7fca02552640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cf9805c0 0x55c5cfa6f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58204/0 (socket says 172.21.15.164:58204) 2024-09-13T23:05:36.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.980+0000 7fca02552640 1 -- 172.21.15.164:0/1765005502 learned_addr learned my addr 172.21.15.164:0/1765005502 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.980+0000 7fca02552640 1 -- 172.21.15.164:0/1765005502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5cf819bc0 con 0x55c5cf9805c0 2024-09-13T23:05:36.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.980+0000 7fca02552640 1 --2- 172.21.15.164:0/1765005502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cf9805c0 0x55c5cfa6f8e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4025c20 tx=0x7fc9f4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63a7f665c1db35d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.981+0000 7fc8f0608640 1 -- 172.21.15.164:0/1765005502 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9f405c580 con 0x55c5cf9805c0 2024-09-13T23:05:36.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.981+0000 7fc8f0608640 1 -- 172.21.15.164:0/1765005502 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9f4063030 con 0x55c5cf9805c0 2024-09-13T23:05:36.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.981+0000 7fc8f0608640 1 -- 172.21.15.164:0/1765005502 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9f405c850 con 0x55c5cf9805c0 2024-09-13T23:05:36.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.981+0000 7fca07236800 1 -- 172.21.15.164:0/1765005502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cf9805c0 msgr2=0x55c5cfa6f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:36.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.981+0000 7fca07236800 1 --2- 172.21.15.164:0/1765005502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cf9805c0 0x55c5cfa6f8e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4025c20 tx=0x7fc9f4051000 comp rx=0 tx=0).stop 2024-09-13T23:05:36.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.981+0000 7fca07236800 1 -- 172.21.15.164:0/1765005502 shutdown_connections 2024-09-13T23:05:36.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.981+0000 7fca07236800 1 --2- 172.21.15.164:0/1765005502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cf9805c0 0x55c5cfa6f8e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:36.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.981+0000 7fca07236800 1 -- 172.21.15.164:0/1765005502 >> 172.21.15.164:0/1765005502 conn(0x55c5cf97bed0 msgr2=0x55c5cfa6b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:36.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.981+0000 7fca07236800 1 -- 172.21.15.164:0/1765005502 shutdown_connections 2024-09-13T23:05:36.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.981+0000 7fca07236800 1 -- 172.21.15.164:0/1765005502 wait complete. 2024-09-13T23:05:36.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.982+0000 7fca07236800 1 Processor -- start 2024-09-13T23:05:36.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.982+0000 7fca07236800 1 -- start start 2024-09-13T23:05:36.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.982+0000 7fca07236800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cf9805c0 0x55c5cf8f5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.982+0000 7fca07236800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c5cf9875e0 con 0x55c5cf9805c0 2024-09-13T23:05:36.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.982+0000 7fca02552640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cf9805c0 0x55c5cf8f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.982+0000 7fca02552640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cf9805c0 0x55c5cf8f5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58212/0 (socket says 172.21.15.164:58212) 2024-09-13T23:05:36.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.982+0000 7fca02552640 1 -- 172.21.15.164:0/3084305893 learned_addr learned my addr 172.21.15.164:0/3084305893 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:36.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.982+0000 7fca02552640 1 -- 172.21.15.164:0/3084305893 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5cf82dfe0 con 0x55c5cf9805c0 2024-09-13T23:05:36.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.983+0000 7fca02552640 1 --2- 172.21.15.164:0/3084305893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cf9805c0 0x55c5cf8f5e80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x55c5cfa70740 tx=0x7fc9f4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.983+0000 7fc8eee05640 1 -- 172.21.15.164:0/3084305893 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9f4054ad0 con 0x55c5cf9805c0 2024-09-13T23:05:36.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.983+0000 7fc8eee05640 1 -- 172.21.15.164:0/3084305893 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9f4054c70 con 0x55c5cf9805c0 2024-09-13T23:05:36.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.983+0000 7fca07236800 1 -- 172.21.15.164:0/3084305893 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c5cf8f4570 con 0x55c5cf9805c0 2024-09-13T23:05:36.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.983+0000 7fc8eee05640 1 -- 172.21.15.164:0/3084305893 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9f4068420 con 0x55c5cf9805c0 2024-09-13T23:05:36.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.983+0000 7fca07236800 1 -- 172.21.15.164:0/3084305893 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5cf8f4a90 con 0x55c5cf9805c0 2024-09-13T23:05:36.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.984+0000 7fc8eee05640 1 -- 172.21.15.164:0/3084305893 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc9f40685c0 con 0x55c5cf9805c0 2024-09-13T23:05:36.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.984+0000 7fc8eee05640 1 --2- 172.21.15.164:0/3084305893 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc8e8036b90 0x7fc8e8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.984+0000 7fc8eee05640 1 -- 172.21.15.164:0/3084305893 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc9f4070030 con 0x55c5cf9805c0 2024-09-13T23:05:36.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.984+0000 7fc9fbfff640 1 --2- 172.21.15.164:0/3084305893 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc8e8036b90 0x7fc8e8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.984+0000 7fca07236800 1 --2- 172.21.15.164:0/3084305893 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c5cf980f00 0x55c5cfa80670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:36.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.984+0000 7fca07236800 1 -- 172.21.15.164:0/3084305893 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfa80bb0 con 0x55c5cf980f00 2024-09-13T23:05:36.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.984+0000 7fca02d53640 1 --2- 172.21.15.164:0/3084305893 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c5cf980f00 0x55c5cfa80670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:36.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.984+0000 7fc9fbfff640 1 --2- 172.21.15.164:0/3084305893 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc8e8036b90 0x7fc8e8039050 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec000f60 tx=0x7fc9ec0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.984+0000 7fca02d53640 1 --2- 172.21.15.164:0/3084305893 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c5cf980f00 0x55c5cfa80670 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:36.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.985+0000 7fca02d53640 1 -- 172.21.15.164:0/3084305893 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9fc00a4a0 con 0x55c5cf980f00 2024-09-13T23:05:36.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.985+0000 7fca07236800 1 -- 172.21.15.164:0/3084305893 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfa80fb0 con 0x55c5cf980f00 2024-09-13T23:05:36.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.985+0000 7fca02d53640 1 -- 172.21.15.164:0/3084305893 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc9fc00a4a0 con 0x55c5cf980f00 2024-09-13T23:05:36.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.985+0000 7fca07236800 1 -- 172.21.15.164:0/3084305893 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfa828b0 con 0x55c5cf980f00 2024-09-13T23:05:36.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.985+0000 7fca02d53640 1 -- 172.21.15.164:0/3084305893 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc9fc00a4a0 con 0x55c5cf980f00 2024-09-13T23:05:36.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.985+0000 7fca07236800 1 -- 172.21.15.164:0/3084305893 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfa81ae0 con 0x55c5cf980f00 2024-09-13T23:05:37.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.985+0000 7fca02d53640 1 -- 172.21.15.164:0/3084305893 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc9fc00a4a0 con 0x55c5cf980f00 2024-09-13T23:05:37.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.985+0000 7fca07236800 1 -- 172.21.15.164:0/3084305893 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfa81f30 con 0x55c5cf980f00 2024-09-13T23:05:37.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.986+0000 7fca02d53640 1 -- 172.21.15.164:0/3084305893 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc9fc00a4a0 con 0x55c5cf980f00 2024-09-13T23:05:37.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.986+0000 7fca07236800 1 Processor -- start 2024-09-13T23:05:37.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.986+0000 7fca07236800 1 -- start start 2024-09-13T23:05:37.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.986+0000 7fca07236800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cfa90ea0 0x55c5cfa912c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.986+0000 7fca07236800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c5cf81b580 con 0x55c5cfa90ea0 2024-09-13T23:05:37.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.987+0000 7fc9fbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cfa90ea0 0x55c5cfa912c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.987+0000 7fc9fbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cfa90ea0 0x55c5cfa912c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58222/0 (socket says 172.21.15.164:58222) 2024-09-13T23:05:37.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.987+0000 7fc9fbfff640 1 -- 172.21.15.164:0/3257934640 learned_addr learned my addr 172.21.15.164:0/3257934640 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.987+0000 7fc9fbfff640 1 -- 172.21.15.164:0/3257934640 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5cfa91800 con 0x55c5cfa90ea0 2024-09-13T23:05:37.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.987+0000 7fc9fbfff640 1 --2- 172.21.15.164:0/3257934640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cfa90ea0 0x55c5cfa912c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec001ed0 tx=0x7fc9ec00d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.987+0000 7fc8e7fff640 1 -- 172.21.15.164:0/3257934640 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9ec01b550 con 0x55c5cfa90ea0 2024-09-13T23:05:37.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.987+0000 7fc8e7fff640 1 -- 172.21.15.164:0/3257934640 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9ec01b6f0 con 0x55c5cfa90ea0 2024-09-13T23:05:37.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.987+0000 7fca07236800 1 -- 172.21.15.164:0/3257934640 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c5cfa91a90 con 0x55c5cfa90ea0 2024-09-13T23:05:37.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.987+0000 7fc8e7fff640 1 -- 172.21.15.164:0/3257934640 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9ec01b9d0 con 0x55c5cfa90ea0 2024-09-13T23:05:37.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.987+0000 7fca07236800 1 -- 172.21.15.164:0/3257934640 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5cfa94770 con 0x55c5cfa90ea0 2024-09-13T23:05:37.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.988+0000 7fc8e7fff640 1 -- 172.21.15.164:0/3257934640 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc9ec023020 con 0x55c5cfa90ea0 2024-09-13T23:05:37.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.988+0000 7fc8e7fff640 1 --2- 172.21.15.164:0/3257934640 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc8dc036b90 0x7fc8dc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.988+0000 7fc8e7fff640 1 -- 172.21.15.164:0/3257934640 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc9ec021020 con 0x55c5cfa90ea0 2024-09-13T23:05:37.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.988+0000 7fca02d53640 1 --2- 172.21.15.164:0/3257934640 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc8dc036b90 0x7fc8dc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.989+0000 7fca07236800 1 Processor -- start 2024-09-13T23:05:37.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.989+0000 7fca02d53640 1 --2- 172.21.15.164:0/3257934640 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc8dc036b90 0x7fc8dc039050 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55c5cfa81600 tx=0x7fc9fc005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.989+0000 7fca07236800 1 -- start start 2024-09-13T23:05:37.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.989+0000 7fca07236800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cfa9dbb0 0x55c5cfa9dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.989+0000 7fca07236800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c5cfa70030 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.989+0000 7fc9fbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cfa9dbb0 0x55c5cfa9dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.989+0000 7fc9fbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cfa9dbb0 0x55c5cfa9dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58226/0 (socket says 172.21.15.164:58226) 2024-09-13T23:05:37.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.989+0000 7fc9fbfff640 1 -- 172.21.15.164:0/2686588204 learned_addr learned my addr 172.21.15.164:0/2686588204 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.990+0000 7fc9fbfff640 1 -- 172.21.15.164:0/2686588204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5cfa9e580 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.990+0000 7fc9fbfff640 1 --2- 172.21.15.164:0/2686588204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cfa9dbb0 0x55c5cfa9dfb0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec04d100 tx=0x7fc9ec019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93a4c45dfe4a96c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.990+0000 7fc8e5ffb640 1 -- 172.21.15.164:0/2686588204 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9ec0258e0 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.990+0000 7fc8e5ffb640 1 -- 172.21.15.164:0/2686588204 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9ec025410 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.990+0000 7fc8e5ffb640 1 -- 172.21.15.164:0/2686588204 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9ec025a80 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.990+0000 7fca07236800 1 -- 172.21.15.164:0/2686588204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cfa9dbb0 msgr2=0x55c5cfa9dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.990+0000 7fca07236800 1 --2- 172.21.15.164:0/2686588204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cfa9dbb0 0x55c5cfa9dfb0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec04d100 tx=0x7fc9ec019ce0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.990+0000 7fca07236800 1 -- 172.21.15.164:0/2686588204 shutdown_connections 2024-09-13T23:05:37.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.990+0000 7fca07236800 1 --2- 172.21.15.164:0/2686588204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cfa9dbb0 0x55c5cfa9dfb0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.990+0000 7fca07236800 1 -- 172.21.15.164:0/2686588204 >> 172.21.15.164:0/2686588204 conn(0x55c5cfa99f10 msgr2=0x55c5cfa98010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.990+0000 7fca07236800 1 -- 172.21.15.164:0/2686588204 shutdown_connections 2024-09-13T23:05:37.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.990+0000 7fca07236800 1 -- 172.21.15.164:0/2686588204 wait complete. 2024-09-13T23:05:37.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.991+0000 7fca07236800 1 Processor -- start 2024-09-13T23:05:37.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.991+0000 7fca07236800 1 -- start start 2024-09-13T23:05:37.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.991+0000 7fca07236800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cfaa5330 0x55c5cfaa5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.991+0000 7fca07236800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c5cfa9ebf0 con 0x55c5cfaa5330 2024-09-13T23:05:37.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.991+0000 7fc9fbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cfaa5330 0x55c5cfaa5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.991+0000 7fc9fbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cfaa5330 0x55c5cfaa5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58232/0 (socket says 172.21.15.164:58232) 2024-09-13T23:05:37.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.991+0000 7fc9fbfff640 1 -- 172.21.15.164:0/4102383434 learned_addr learned my addr 172.21.15.164:0/4102383434 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.991+0000 7fc9fbfff640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5cfaa5c90 con 0x55c5cfaa5330 2024-09-13T23:05:37.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.991+0000 7fc9fbfff640 1 --2- 172.21.15.164:0/4102383434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cfaa5330 0x55c5cfaa5750 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec019f50 tx=0x7fc9ec04d090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.992+0000 7fc8d3fff640 1 -- 172.21.15.164:0/4102383434 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9ec00cc60 con 0x55c5cfaa5330 2024-09-13T23:05:37.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.992+0000 7fc8d3fff640 1 -- 172.21.15.164:0/4102383434 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9ec00ce00 con 0x55c5cfaa5330 2024-09-13T23:05:37.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.992+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c5cfaa5f20 con 0x55c5cfaa5330 2024-09-13T23:05:37.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.992+0000 7fc8d3fff640 1 -- 172.21.15.164:0/4102383434 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9ec040990 con 0x55c5cfaa5330 2024-09-13T23:05:37.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.992+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5cfaa5f20 con 0x55c5cfaa5330 2024-09-13T23:05:37.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.992+0000 7fc8d3fff640 1 -- 172.21.15.164:0/4102383434 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc9ec040bf0 con 0x55c5cfaa5330 2024-09-13T23:05:37.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.993+0000 7fc8d3fff640 1 --2- 172.21.15.164:0/4102383434 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc8cc036b40 0x7fc8cc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.993+0000 7fc8d3fff640 1 -- 172.21.15.164:0/4102383434 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc9ec035070 con 0x55c5cfaa5330 2024-09-13T23:05:37.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.993+0000 7fca02d53640 1 --2- 172.21.15.164:0/4102383434 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc8cc036b40 0x7fc8cc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.993+0000 7fca07236800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.993+0000 7fca07236800 1 --2- 172.21.15.164:0/4102383434 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c5cfab0fd0 0x55c5cfab3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.993+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab3be0 con 0x55c5cfab0fd0 2024-09-13T23:05:37.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.993+0000 7fca02552640 1 --2- 172.21.15.164:0/4102383434 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c5cfab0fd0 0x55c5cfab3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.993+0000 7fca02d53640 1 --2- 172.21.15.164:0/4102383434 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc8cc036b40 0x7fc8cc039000 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55c5cf8f5580 tx=0x7fc9fc01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.994+0000 7fca02552640 1 --2- 172.21.15.164:0/4102383434 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c5cfab0fd0 0x55c5cfab3490 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.994+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9f4051070 con 0x55c5cfab0fd0 2024-09-13T23:05:37.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.994+0000 7fca07236800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.994+0000 7fca07236800 20 realm 2024-09-13T23:05:37.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.994+0000 7fca07236800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.994+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab3ff0 con 0x55c5cfab0fd0 2024-09-13T23:05:37.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.994+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9f4051070 con 0x55c5cfab0fd0 2024-09-13T23:05:37.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.994+0000 7fca07236800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.994+0000 7fca07236800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:37.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.994+0000 7fca07236800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.994+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab48c0 con 0x55c5cfab0fd0 2024-09-13T23:05:37.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.994+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9f4051070 con 0x55c5cfab0fd0 2024-09-13T23:05:37.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.994+0000 7fca07236800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.994+0000 7fca07236800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.994+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab4c60 con 0x55c5cfab0fd0 2024-09-13T23:05:37.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.994+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc9f4051070 con 0x55c5cfab0fd0 2024-09-13T23:05:37.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.995+0000 7fca07236800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:37.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.995+0000 7fca07236800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.995+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab50c0 con 0x55c5cfab0fd0 2024-09-13T23:05:37.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.995+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc9f4051070 con 0x55c5cfab0fd0 2024-09-13T23:05:37.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.995+0000 7fca07236800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:37.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.995+0000 7fca07236800 20 searching for the correct realm 2024-09-13T23:05:37.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.995+0000 7fca07236800 1 --2- 172.21.15.164:0/4102383434 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55c5cfab7110 0x55c5cfab9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.995+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x55c5cfab7110 2024-09-13T23:05:37.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.995+0000 7fc9fbfff640 1 --2- 172.21.15.164:0/4102383434 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55c5cfab7110 0x55c5cfab9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.995+0000 7fc9fbfff640 1 --2- 172.21.15.164:0/4102383434 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55c5cfab7110 0x55c5cfab9500 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.995+0000 7fc9fbfff640 1 -- 172.21.15.164:0/4102383434 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ec03f020 con 0x55c5cfab7110 2024-09-13T23:05:37.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.995+0000 7fc9fbfff640 1 --2- 172.21.15.164:0/4102383434 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x55c5cfa9dbb0 0x7fc9ec040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.995+0000 7fc9fbfff640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.995+0000 7fca02d53640 1 --2- 172.21.15.164:0/4102383434 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x55c5cfa9dbb0 0x7fc9ec040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.996+0000 7fca02d53640 1 --2- 172.21.15.164:0/4102383434 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x55c5cfa9dbb0 0x7fc9ec040340 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.996+0000 7fca02d53640 1 -- 172.21.15.164:0/4102383434 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9fc01f070 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.996+0000 7fca02d53640 1 --2- 172.21.15.164:0/4102383434 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc9fc031040 0x7fc9fc032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.996+0000 7fca02d53640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x7fc9fc031040 2024-09-13T23:05:37.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.996+0000 7fca02552640 1 --2- 172.21.15.164:0/4102383434 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc9fc031040 0x7fc9fc032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.997+0000 7fca02552640 1 --2- 172.21.15.164:0/4102383434 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc9fc031040 0x7fc9fc032430 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.997+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f4051070 con 0x7fc9fc031040 2024-09-13T23:05:37.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.997+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x55c5cfab0fd0 2024-09-13T23:05:37.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.997+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc9f4051070 con 0x55c5cfab0fd0 2024-09-13T23:05:37.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.997+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x55c5cfab0fd0 2024-09-13T23:05:37.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.997+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f4051070 con 0x55c5cfab0fd0 2024-09-13T23:05:37.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.997+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x7fc9fc031040 2024-09-13T23:05:37.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.998+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f4051070 con 0x7fc9fc031040 2024-09-13T23:05:37.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.998+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x7fc9fc031040 2024-09-13T23:05:37.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.998+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f4051070 con 0x7fc9fc031040 2024-09-13T23:05:37.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.998+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.998+0000 7fca02d53640 1 -- 172.21.15.164:0/4102383434 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9fc01f070 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.998+0000 7fca02d53640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x55c5cfab7110 2024-09-13T23:05:37.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.998+0000 7fc9fbfff640 1 -- 172.21.15.164:0/4102383434 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ec03f020 con 0x55c5cfab7110 2024-09-13T23:05:37.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.998+0000 7fc9fbfff640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x55c5cfab0fd0 2024-09-13T23:05:37.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.998+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f4051070 con 0x55c5cfab0fd0 2024-09-13T23:05:37.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.998+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x7fc9fc031040 2024-09-13T23:05:37.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.999+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f4051070 con 0x7fc9fc031040 2024-09-13T23:05:37.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.999+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x55c5cfab0fd0 2024-09-13T23:05:37.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.999+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f4051070 con 0x55c5cfab0fd0 2024-09-13T23:05:37.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.999+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.999+0000 7fca02d53640 1 -- 172.21.15.164:0/4102383434 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc9fc01f070 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.999+0000 7fca02d53640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x55c5cfab7110 2024-09-13T23:05:37.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.999+0000 7fc9fbfff640 1 -- 172.21.15.164:0/4102383434 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ec03f020 con 0x55c5cfab7110 2024-09-13T23:05:37.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:36.999+0000 7fc9fbfff640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x55c5cfab7110 2024-09-13T23:05:37.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.000+0000 7fc9fbfff640 1 -- 172.21.15.164:0/4102383434 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ec03f020 con 0x55c5cfab7110 2024-09-13T23:05:37.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.000+0000 7fc9fbfff640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x7fc9fc031040 2024-09-13T23:05:37.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.000+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f4051070 con 0x7fc9fc031040 2024-09-13T23:05:37.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.000+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x55c5cfab7110 2024-09-13T23:05:37.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.000+0000 7fc9fbfff640 1 -- 172.21.15.164:0/4102383434 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ec03f020 con 0x55c5cfab7110 2024-09-13T23:05:37.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.000+0000 7fc9fbfff640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x55c5cfab7110 2024-09-13T23:05:37.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.000+0000 7fc9fbfff640 1 -- 172.21.15.164:0/4102383434 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ec03f020 con 0x55c5cfab7110 2024-09-13T23:05:37.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.000+0000 7fc9fbfff640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x55c5cfab0fd0 2024-09-13T23:05:37.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.001+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f4051070 con 0x55c5cfab0fd0 2024-09-13T23:05:37.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.001+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x55c5cfab0fd0 2024-09-13T23:05:37.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.001+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc9f4051070 con 0x55c5cfab0fd0 2024-09-13T23:05:37.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.001+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x7fc9fc031040 2024-09-13T23:05:37.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.001+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f4051070 con 0x7fc9fc031040 2024-09-13T23:05:37.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.001+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x55c5cfab7110 2024-09-13T23:05:37.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.002+0000 7fc9fbfff640 1 -- 172.21.15.164:0/4102383434 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ec03f020 con 0x55c5cfab7110 2024-09-13T23:05:37.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.002+0000 7fc9fbfff640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.002+0000 7fca02d53640 1 -- 172.21.15.164:0/4102383434 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9fc01f070 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.002+0000 7fca02d53640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x55c5cfab0fd0 2024-09-13T23:05:37.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.002+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc9f4051070 con 0x55c5cfab0fd0 2024-09-13T23:05:37.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.002+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x7fc9fc031040 2024-09-13T23:05:37.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.002+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f4051070 con 0x7fc9fc031040 2024-09-13T23:05:37.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.003+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x55c5cfab7110 2024-09-13T23:05:37.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.003+0000 7fc9fbfff640 1 -- 172.21.15.164:0/4102383434 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ec03f020 con 0x55c5cfab7110 2024-09-13T23:05:37.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.003+0000 7fc9fbfff640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x7fc9fc031040 2024-09-13T23:05:37.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.003+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f4051070 con 0x7fc9fc031040 2024-09-13T23:05:37.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.003+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.003+0000 7fca02d53640 1 -- 172.21.15.164:0/4102383434 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9fc01f070 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.003+0000 7fca02d53640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x55c5cfab7110 2024-09-13T23:05:37.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.003+0000 7fc9fbfff640 1 -- 172.21.15.164:0/4102383434 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9ec03f020 con 0x55c5cfab7110 2024-09-13T23:05:37.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.003+0000 7fc9fbfff640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x7fc9fc031040 2024-09-13T23:05:37.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.004+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f4051070 con 0x7fc9fc031040 2024-09-13T23:05:37.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.004+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x55c5cfab0fd0 2024-09-13T23:05:37.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.004+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc9f4051070 con 0x55c5cfab0fd0 2024-09-13T23:05:37.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.004+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab9bd0 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.004+0000 7fca02d53640 1 -- 172.21.15.164:0/4102383434 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9fc01f070 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.004+0000 7fca07236800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:37.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.004+0000 7fca07236800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:37.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.004+0000 7fca07236800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:37.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.004+0000 7fca07236800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:37.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.004+0000 7fca07236800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:37.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.004+0000 7fca07236800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:37.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.004+0000 7fca07236800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.004+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab5b60 con 0x55c5cfab0fd0 2024-09-13T23:05:37.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.004+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9f4051070 con 0x55c5cfab0fd0 2024-09-13T23:05:37.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.004+0000 7fca07236800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.004+0000 7fca07236800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.004+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab6400 con 0x55c5cfab0fd0 2024-09-13T23:05:37.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.005+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc9f4051070 con 0x55c5cfab0fd0 2024-09-13T23:05:37.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.005+0000 7fca07236800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:37.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.005+0000 7fca07236800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.005+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfab57a0 con 0x55c5cfab0fd0 2024-09-13T23:05:37.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.005+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc9f4051070 con 0x55c5cfab0fd0 2024-09-13T23:05:37.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.005+0000 7fca07236800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:37.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.005+0000 7fca07236800 20 zone default found 2024-09-13T23:05:37.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.005+0000 7fca07236800 4 Realm: () 2024-09-13T23:05:37.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.005+0000 7fca07236800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:37.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.005+0000 7fca07236800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:37.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.005+0000 7fca07236800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:37.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.005+0000 7fca07236800 20 zonegroup default 2024-09-13T23:05:37.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.005+0000 7fca07236800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.005+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfaba050 con 0x7fc9fc031040 2024-09-13T23:05:37.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.005+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc9f4051070 con 0x7fc9fc031040 2024-09-13T23:05:37.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.005+0000 7fca07236800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.005+0000 7fca07236800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.005+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfabbee0 con 0x55c5cfab7110 2024-09-13T23:05:37.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.006+0000 7fc9fbfff640 1 -- 172.21.15.164:0/4102383434 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc9ec03f020 con 0x55c5cfab7110 2024-09-13T23:05:37.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.006+0000 7fca07236800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.006+0000 7fca07236800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.006+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfabc280 con 0x55c5cfab7110 2024-09-13T23:05:37.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.006+0000 7fc9fbfff640 1 -- 172.21.15.164:0/4102383434 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc9ec03f020 con 0x55c5cfab7110 2024-09-13T23:05:37.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.006+0000 7fca07236800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.006+0000 7fca07236800 20 started sync module instance, tier type = 2024-09-13T23:05:37.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.006+0000 7fca07236800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:37.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.006+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfabb320 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.007+0000 7fca02d53640 1 -- 172.21.15.164:0/4102383434 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9fc040040 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.007+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94308081053296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfabc620 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.007+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfabcfe0 con 0x55c5cfab0fd0 2024-09-13T23:05:37.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.008+0000 7fca02d53640 1 -- 172.21.15.164:0/4102383434 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94308081053296] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9fc040040 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.008+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f4051070 con 0x55c5cfab0fd0 2024-09-13T23:05:37.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.008+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94308081055568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfabcfe0 con 0x55c5cfab0fd0 2024-09-13T23:05:37.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.008+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfabd9e0 con 0x55c5cfab7110 2024-09-13T23:05:37.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.009+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94308081055568] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f4051070 con 0x55c5cfab0fd0 2024-09-13T23:05:37.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.009+0000 7fc9fbfff640 1 -- 172.21.15.164:0/4102383434 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9ec03f020 con 0x55c5cfab7110 2024-09-13T23:05:37.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.009+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94308081060656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfabcf50 con 0x55c5cfab7110 2024-09-13T23:05:37.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.009+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfabe7a0 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.010+0000 7fc9fbfff640 1 -- 172.21.15.164:0/4102383434 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94308081060656] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9ec03f020 con 0x55c5cfab7110 2024-09-13T23:05:37.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.010+0000 7fca02d53640 1 -- 172.21.15.164:0/4102383434 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9fc040040 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.010+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94308081065424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfabeb90 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.010+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfabf5b0 con 0x55c5cfab0fd0 2024-09-13T23:05:37.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.011+0000 7fca02d53640 1 -- 172.21.15.164:0/4102383434 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94308081065424] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9fc040040 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.011+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f4051070 con 0x55c5cfab0fd0 2024-09-13T23:05:37.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.011+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94308081070240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfabf570 con 0x55c5cfab0fd0 2024-09-13T23:05:37.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.011+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfac0030 con 0x7fc9fc031040 2024-09-13T23:05:37.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.012+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94308081070240] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f4051070 con 0x55c5cfab0fd0 2024-09-13T23:05:37.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.013+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f4051070 con 0x7fc9fc031040 2024-09-13T23:05:37.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.013+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94308081066480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfabfff0 con 0x7fc9fc031040 2024-09-13T23:05:37.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.013+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfac0a70 con 0x7fc9fc031040 2024-09-13T23:05:37.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.014+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94308081066480] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f4051070 con 0x7fc9fc031040 2024-09-13T23:05:37.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.014+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f4051070 con 0x7fc9fc031040 2024-09-13T23:05:37.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.014+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94308081072960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfac0c70 con 0x7fc9fc031040 2024-09-13T23:05:37.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.014+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfac14c0 con 0x7fc9fc031040 2024-09-13T23:05:37.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.015+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94308081072960] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f4051070 con 0x7fc9fc031040 2024-09-13T23:05:37.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.015+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f4051070 con 0x7fc9fc031040 2024-09-13T23:05:37.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.015+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94308081076640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfac1330 con 0x7fc9fc031040 2024-09-13T23:05:37.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.015+0000 7fca07236800 20 add_watcher() i=0 2024-09-13T23:05:37.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.015+0000 7fca07236800 20 add_watcher() i=1 2024-09-13T23:05:37.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.015+0000 7fca07236800 20 add_watcher() i=2 2024-09-13T23:05:37.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.015+0000 7fca07236800 20 add_watcher() i=3 2024-09-13T23:05:37.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.015+0000 7fca07236800 20 add_watcher() i=4 2024-09-13T23:05:37.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.015+0000 7fca07236800 20 add_watcher() i=5 2024-09-13T23:05:37.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.015+0000 7fca07236800 20 add_watcher() i=6 2024-09-13T23:05:37.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.016+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94308081076640] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f4051070 con 0x7fc9fc031040 2024-09-13T23:05:37.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.016+0000 7fca07236800 20 add_watcher() i=7 2024-09-13T23:05:37.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.016+0000 7fca07236800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:37.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.016+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfac48a0 con 0x55c5cfab0fd0 2024-09-13T23:05:37.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.016+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc9f4051070 con 0x55c5cfab0fd0 2024-09-13T23:05:37.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.017+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94308081077760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfac1dc0 con 0x55c5cfab0fd0 2024-09-13T23:05:37.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.018+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94308081077760] v32'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc9f4051070 con 0x55c5cfab0fd0 2024-09-13T23:05:37.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.018+0000 7fc8b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:37.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.018+0000 7fca07236800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:37.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.018+0000 7fca07236800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:37.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.018+0000 7fca07236800 5 note: GC not initialized 2024-09-13T23:05:37.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.018+0000 7fc8337fe640 20 reqs_thread_entry: start 2024-09-13T23:05:37.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.018+0000 7fca07236800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:37.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.018+0000 7fca07236800 20 Filter name: none 2024-09-13T23:05:37.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.018+0000 7fc8317fa640 20 reqs_thread_entry: start 2024-09-13T23:05:37.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.018+0000 7fca07236800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.018+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfaf77a0 con 0x55c5cfab0fd0 2024-09-13T23:05:37.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.019+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7fc9f4051070 con 0x55c5cfab0fd0 2024-09-13T23:05:37.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.019+0000 7fca07236800 20 rados_obj.operate() r=0 bl.length=193 2024-09-13T23:05:37.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.020+0000 7fc8b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:37.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.020+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94308081077760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfaf5660 con 0x55c5cfab0fd0 2024-09-13T23:05:37.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.021+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94308081077760] v32'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc9f4051070 con 0x55c5cfab0fd0 2024-09-13T23:05:37.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.021+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94308081053296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfaf5660 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.022+0000 7fca02d53640 1 -- 172.21.15.164:0/4102383434 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94308081053296] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9fc040040 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.022+0000 7fca07236800 20 remove_watcher() i=0 2024-09-13T23:05:37.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.022+0000 7fca07236800 2 removed watcher, disabling cache 2024-09-13T23:05:37.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.022+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94308081055568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfaf5660 con 0x55c5cfab0fd0 2024-09-13T23:05:37.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.023+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94308081055568] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f4051070 con 0x55c5cfab0fd0 2024-09-13T23:05:37.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.023+0000 7fca07236800 20 remove_watcher() i=1 2024-09-13T23:05:37.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.023+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94308081060656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfaf5660 con 0x55c5cfab7110 2024-09-13T23:05:37.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.024+0000 7fc9fbfff640 1 -- 172.21.15.164:0/4102383434 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94308081060656] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9ec03f020 con 0x55c5cfab7110 2024-09-13T23:05:37.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.024+0000 7fca07236800 20 remove_watcher() i=2 2024-09-13T23:05:37.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.024+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94308081065424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfabcb30 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.025+0000 7fca02d53640 1 -- 172.21.15.164:0/4102383434 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94308081065424] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9fc040040 con 0x55c5cfa9dbb0 2024-09-13T23:05:37.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.025+0000 7fca07236800 20 remove_watcher() i=3 2024-09-13T23:05:37.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.025+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94308081070240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfabddd0 con 0x55c5cfab0fd0 2024-09-13T23:05:37.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.026+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94308081070240] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f4051070 con 0x55c5cfab0fd0 2024-09-13T23:05:37.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.026+0000 7fca07236800 20 remove_watcher() i=4 2024-09-13T23:05:37.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.026+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94308081066480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfabcb30 con 0x7fc9fc031040 2024-09-13T23:05:37.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.027+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94308081066480] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f4051070 con 0x7fc9fc031040 2024-09-13T23:05:37.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.027+0000 7fca07236800 20 remove_watcher() i=5 2024-09-13T23:05:37.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.027+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94308081072960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfabf0a0 con 0x7fc9fc031040 2024-09-13T23:05:37.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.028+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94308081072960] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f4051070 con 0x7fc9fc031040 2024-09-13T23:05:37.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.028+0000 7fca07236800 20 remove_watcher() i=6 2024-09-13T23:05:37.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.028+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94308081076640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c5cfabcb30 con 0x7fc9fc031040 2024-09-13T23:05:37.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.029+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94308081076640] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f4051070 con 0x7fc9fc031040 2024-09-13T23:05:37.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.029+0000 7fca07236800 20 remove_watcher() i=7 2024-09-13T23:05:37.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.029+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc9fc031040 msgr2=0x7fc9fc032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.029+0000 7fca07236800 1 --2- 172.21.15.164:0/4102383434 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc9fc031040 0x7fc9fc032430 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.029+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c5cfab0fd0 msgr2=0x55c5cfab3490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.029+0000 7fca07236800 1 --2- 172.21.15.164:0/4102383434 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c5cfab0fd0 0x55c5cfab3490 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.029+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x55c5cfa9dbb0 msgr2=0x7fc9ec040340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.029+0000 7fca07236800 1 --2- 172.21.15.164:0/4102383434 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x55c5cfa9dbb0 0x7fc9ec040340 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.029+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55c5cfab7110 msgr2=0x55c5cfab9500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.029+0000 7fca07236800 1 --2- 172.21.15.164:0/4102383434 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55c5cfab7110 0x55c5cfab9500 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.029+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc8cc036b40 msgr2=0x7fc8cc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.029+0000 7fca07236800 1 --2- 172.21.15.164:0/4102383434 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc8cc036b40 0x7fc8cc039000 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55c5cf8f5580 tx=0x7fc9fc01f000 comp rx=0 tx=0).stop 2024-09-13T23:05:37.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.029+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cfaa5330 msgr2=0x55c5cfaa5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.029+0000 7fca07236800 1 --2- 172.21.15.164:0/4102383434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cfaa5330 0x55c5cfaa5750 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec019f50 tx=0x7fc9ec04d090 comp rx=0 tx=0).stop 2024-09-13T23:05:37.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.029+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 reap_dead start 2024-09-13T23:05:37.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.029+0000 7fca02552640 1 -- 172.21.15.164:0/4102383434 reap_dead start 2024-09-13T23:05:37.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.029+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 shutdown_connections 2024-09-13T23:05:37.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.029+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 >> 172.21.15.164:0/4102383434 conn(0x55c5cfa99f10 msgr2=0x55c5cfa97fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.029+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 shutdown_connections 2024-09-13T23:05:37.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.029+0000 7fca07236800 1 -- 172.21.15.164:0/4102383434 wait complete. 2024-09-13T23:05:37.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.030+0000 7fca07236800 1 -- 172.21.15.164:0/3257934640 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc8dc036b90 msgr2=0x7fc8dc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.030+0000 7fca07236800 1 --2- 172.21.15.164:0/3257934640 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc8dc036b90 0x7fc8dc039050 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55c5cfa81600 tx=0x7fc9fc005840 comp rx=0 tx=0).stop 2024-09-13T23:05:37.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.030+0000 7fca07236800 1 -- 172.21.15.164:0/3257934640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cfa90ea0 msgr2=0x55c5cfa912c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.030+0000 7fca07236800 1 --2- 172.21.15.164:0/3257934640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cfa90ea0 0x55c5cfa912c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec001ed0 tx=0x7fc9ec00d7a0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.030+0000 7fca07236800 1 -- 172.21.15.164:0/3257934640 shutdown_connections 2024-09-13T23:05:37.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.030+0000 7fca07236800 1 --2- 172.21.15.164:0/3257934640 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc8dc036b90 0x7fc8dc039050 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.030+0000 7fca07236800 1 --2- 172.21.15.164:0/3257934640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cfa90ea0 0x55c5cfa912c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.030+0000 7fca07236800 1 -- 172.21.15.164:0/3257934640 >> 172.21.15.164:0/3257934640 conn(0x55c5cfa85e30 msgr2=0x55c5cfa889b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.030+0000 7fca07236800 1 -- 172.21.15.164:0/3257934640 shutdown_connections 2024-09-13T23:05:37.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.030+0000 7fca07236800 1 -- 172.21.15.164:0/3257934640 wait complete. 2024-09-13T23:05:37.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.030+0000 7fca07236800 1 -- 172.21.15.164:0/3084305893 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c5cf980f00 msgr2=0x55c5cfa80670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.030+0000 7fca07236800 1 --2- 172.21.15.164:0/3084305893 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c5cf980f00 0x55c5cfa80670 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.030+0000 7fca07236800 1 -- 172.21.15.164:0/3084305893 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc8e8036b90 msgr2=0x7fc8e8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.030+0000 7fca07236800 1 --2- 172.21.15.164:0/3084305893 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc8e8036b90 0x7fc8e8039050 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec000f60 tx=0x7fc9ec0012b0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.030+0000 7fca07236800 1 -- 172.21.15.164:0/3084305893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cf9805c0 msgr2=0x55c5cf8f5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.030+0000 7fca07236800 1 --2- 172.21.15.164:0/3084305893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cf9805c0 0x55c5cf8f5e80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x55c5cfa70740 tx=0x7fc9f4002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.030+0000 7fca07236800 1 -- 172.21.15.164:0/3084305893 shutdown_connections 2024-09-13T23:05:37.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.030+0000 7fca07236800 1 --2- 172.21.15.164:0/3084305893 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c5cf980f00 0x55c5cfa80670 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.030+0000 7fca07236800 1 --2- 172.21.15.164:0/3084305893 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc8e8036b90 0x7fc8e8039050 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.030+0000 7fca07236800 1 --2- 172.21.15.164:0/3084305893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c5cf9805c0 0x55c5cf8f5e80 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.030+0000 7fca07236800 1 -- 172.21.15.164:0/3084305893 >> 172.21.15.164:0/3084305893 conn(0x55c5cf97bed0 msgr2=0x55c5cfa69b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.030+0000 7fca07236800 1 -- 172.21.15.164:0/3084305893 shutdown_connections 2024-09-13T23:05:37.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.030+0000 7fca07236800 1 -- 172.21.15.164:0/3084305893 wait complete. 2024-09-13T23:05:37.049 INFO:teuthology.orchestra.run.smithi164.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"J7rRIFf6KxB9tZsGhRmKLcUG","ver":2},"mtime":"2024-09-13T23:05:36.882948Z","data":{"bucket":{"name":"myfoo","marker":"a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1","bucket_id":"a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-09-13T23:05:34.302827Z","linked":true,"has_bucket_info":false}} 2024-09-13T23:05:37.049 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'J7rRIFf6KxB9tZsGhRmKLcUG', 'ver': 2}, 'mtime': '2024-09-13T23:05:36.882948Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1', 'bucket_id': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-13T23:05:34.302827Z', 'linked': True, 'has_bucket_info': False}} 2024-09-13T23:05:37.049 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-13T23:05:37.049 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-13T23:05:37.050 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-13T23:05:37.096 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:37.097 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:37.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.095+0000 7f89ed73e800 1 Processor -- start 2024-09-13T23:05:37.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.096+0000 7f89ed73e800 1 -- start start 2024-09-13T23:05:37.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.096+0000 7f89ed73e800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55c9736a9d60 0x55c9736ac150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.096+0000 7f89ed73e800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c973562b30 con 0x55c9736175f0 2024-09-13T23:05:37.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.096+0000 7f89ed73e800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55c973544360 con 0x55c9736a9d60 2024-09-13T23:05:37.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.096+0000 7f89e3fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55c9736a9d60 0x55c9736ac150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.096+0000 7f89e9434640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55c9736175f0 0x55c9736a8640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:41072/0 (socket says 172.21.15.164:41072) 2024-09-13T23:05:37.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.096+0000 7f89e9434640 1 -- 172.21.15.164:0/102672417 learned_addr learned my addr 172.21.15.164:0/102672417 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:37.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.096+0000 7f89e3fff640 1 -- 172.21.15.164:0/102672417 >> v1:172.21.15.17:6789/0 conn(0x55c9736175f0 legacy=0x55c9736a8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.096+0000 7f89e3fff640 1 -- 172.21.15.164:0/102672417 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c97356ae00 con 0x55c9736a9d60 2024-09-13T23:05:37.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.098+0000 7f89e3fff640 1 --2- 172.21.15.164:0/102672417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9736a9d60 0x55c9736ac150 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f89d400a470 tx=0x7f89d4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453d21cccbf8b83b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.098+0000 7f89e8c33640 1 -- 172.21.15.164:0/102672417 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89d4053570 con 0x55c9736a9d60 2024-09-13T23:05:37.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.098+0000 7f89e8c33640 1 -- 172.21.15.164:0/102672417 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d4058070 con 0x55c9736a9d60 2024-09-13T23:05:37.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.098+0000 7f89e8c33640 1 -- 172.21.15.164:0/102672417 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89d4053880 con 0x55c9736a9d60 2024-09-13T23:05:37.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.099+0000 7f89ed73e800 1 -- 172.21.15.164:0/102672417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9736a9d60 msgr2=0x55c9736ac150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.099+0000 7f89ed73e800 1 --2- 172.21.15.164:0/102672417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9736a9d60 0x55c9736ac150 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f89d400a470 tx=0x7f89d4045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:37.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.099+0000 7f89ed73e800 1 -- 172.21.15.164:0/102672417 shutdown_connections 2024-09-13T23:05:37.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.099+0000 7f89ed73e800 1 --2- 172.21.15.164:0/102672417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9736a9d60 0x55c9736ac150 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.099+0000 7f89ed73e800 1 -- 172.21.15.164:0/102672417 >> 172.21.15.164:0/102672417 conn(0x55c97369ddb0 msgr2=0x55c9736a01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.099+0000 7f89ed73e800 1 -- 172.21.15.164:0/102672417 shutdown_connections 2024-09-13T23:05:37.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.099+0000 7f89ed73e800 1 -- 172.21.15.164:0/102672417 wait complete. 2024-09-13T23:05:37.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.112+0000 7f89ed73e800 1 Processor -- start 2024-09-13T23:05:37.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.112+0000 7f89ed73e800 1 -- start start 2024-09-13T23:05:37.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.112+0000 7f89ed73e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9736175f0 0x55c973794a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.112+0000 7f89ed73e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c9735ef360 con 0x55c9736175f0 2024-09-13T23:05:37.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.113+0000 7f89e9434640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9736175f0 0x55c973794a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.113+0000 7f89e9434640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9736175f0 0x55c973794a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58256/0 (socket says 172.21.15.164:58256) 2024-09-13T23:05:37.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.113+0000 7f89e9434640 1 -- 172.21.15.164:0/925035034 learned_addr learned my addr 172.21.15.164:0/925035034 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.113+0000 7f89e9434640 1 -- 172.21.15.164:0/925035034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c97353cbc0 con 0x55c9736175f0 2024-09-13T23:05:37.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.113+0000 7f89e9434640 1 --2- 172.21.15.164:0/925035034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9736175f0 0x55c973794a80 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f89dc001e10 tx=0x7f89dc00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=219376ab2a5a742b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.113+0000 7f88d7606640 1 -- 172.21.15.164:0/925035034 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89dc012020 con 0x55c9736175f0 2024-09-13T23:05:37.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.113+0000 7f88d7606640 1 -- 172.21.15.164:0/925035034 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89dc00e5a0 con 0x55c9736175f0 2024-09-13T23:05:37.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.114+0000 7f88d7606640 1 -- 172.21.15.164:0/925035034 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89dc00e8e0 con 0x55c9736175f0 2024-09-13T23:05:37.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.114+0000 7f89ed73e800 1 -- 172.21.15.164:0/925035034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9736175f0 msgr2=0x55c973794a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.114+0000 7f89ed73e800 1 --2- 172.21.15.164:0/925035034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9736175f0 0x55c973794a80 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f89dc001e10 tx=0x7f89dc00b780 comp rx=0 tx=0).stop 2024-09-13T23:05:37.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.114+0000 7f89ed73e800 1 -- 172.21.15.164:0/925035034 shutdown_connections 2024-09-13T23:05:37.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.114+0000 7f89ed73e800 1 --2- 172.21.15.164:0/925035034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9736175f0 0x55c973794a80 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.114+0000 7f89ed73e800 1 -- 172.21.15.164:0/925035034 >> 172.21.15.164:0/925035034 conn(0x55c97369ddb0 msgr2=0x55c973790440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.114+0000 7f89ed73e800 1 -- 172.21.15.164:0/925035034 shutdown_connections 2024-09-13T23:05:37.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.114+0000 7f89ed73e800 1 -- 172.21.15.164:0/925035034 wait complete. 2024-09-13T23:05:37.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.114+0000 7f89ed73e800 1 Processor -- start 2024-09-13T23:05:37.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.115+0000 7f89ed73e800 1 -- start start 2024-09-13T23:05:37.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.115+0000 7f89ed73e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9736175f0 0x55c97379c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.115+0000 7f89ed73e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c9736ac930 con 0x55c9736175f0 2024-09-13T23:05:37.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.115+0000 7f89e9434640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9736175f0 0x55c97379c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.115+0000 7f89e9434640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9736175f0 0x55c97379c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58266/0 (socket says 172.21.15.164:58266) 2024-09-13T23:05:37.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.115+0000 7f89e9434640 1 -- 172.21.15.164:0/1327201303 learned_addr learned my addr 172.21.15.164:0/1327201303 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.115+0000 7f89e9434640 1 -- 172.21.15.164:0/1327201303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c973550fe0 con 0x55c9736175f0 2024-09-13T23:05:37.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.115+0000 7f89e9434640 1 --2- 172.21.15.164:0/1327201303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9736175f0 0x55c97379c460 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f89dc00b7c0 tx=0x7f89dc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.116+0000 7f88d5e03640 1 -- 172.21.15.164:0/1327201303 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89dc012030 con 0x55c9736175f0 2024-09-13T23:05:37.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.116+0000 7f88d5e03640 1 -- 172.21.15.164:0/1327201303 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89dc001470 con 0x55c9736175f0 2024-09-13T23:05:37.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.116+0000 7f89ed73e800 1 -- 172.21.15.164:0/1327201303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c97379c9a0 con 0x55c9736175f0 2024-09-13T23:05:37.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.116+0000 7f88d5e03640 1 -- 172.21.15.164:0/1327201303 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89dc01a8d0 con 0x55c9736175f0 2024-09-13T23:05:37.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.116+0000 7f89ed73e800 1 -- 172.21.15.164:0/1327201303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c97379cec0 con 0x55c9736175f0 2024-09-13T23:05:37.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.116+0000 7f88d5e03640 1 -- 172.21.15.164:0/1327201303 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f89dc015020 con 0x55c9736175f0 2024-09-13T23:05:37.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.117+0000 7f88d5e03640 1 --2- 172.21.15.164:0/1327201303 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f88d0036b90 0x7f88d0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.117+0000 7f88d5e03640 1 -- 172.21.15.164:0/1327201303 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f89dc020030 con 0x55c9736175f0 2024-09-13T23:05:37.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.117+0000 7f89e3fff640 1 --2- 172.21.15.164:0/1327201303 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f88d0036b90 0x7f88d0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.117+0000 7f89ed73e800 1 --2- 172.21.15.164:0/1327201303 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c9736a9d60 0x55c9737a34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.117+0000 7f89ed73e800 1 -- 172.21.15.164:0/1327201303 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9737a3a10 con 0x55c9736a9d60 2024-09-13T23:05:37.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.117+0000 7f89e9c35640 1 --2- 172.21.15.164:0/1327201303 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c9736a9d60 0x55c9737a34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.117+0000 7f89e3fff640 1 --2- 172.21.15.164:0/1327201303 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f88d0036b90 0x7f88d0039050 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f89d4057000 tx=0x7f89d4052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.117+0000 7f89e9c35640 1 --2- 172.21.15.164:0/1327201303 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c9736a9d60 0x55c9737a34d0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.117+0000 7f89e9c35640 1 -- 172.21.15.164:0/1327201303 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89e400a4a0 con 0x55c9736a9d60 2024-09-13T23:05:37.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.118+0000 7f89ed73e800 1 -- 172.21.15.164:0/1327201303 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9737a0aa0 con 0x55c9736a9d60 2024-09-13T23:05:37.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.118+0000 7f89e9c35640 1 -- 172.21.15.164:0/1327201303 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f89e400a4a0 con 0x55c9736a9d60 2024-09-13T23:05:37.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.118+0000 7f89ed73e800 1 -- 172.21.15.164:0/1327201303 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9737a5850 con 0x55c9736a9d60 2024-09-13T23:05:37.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.118+0000 7f89e9c35640 1 -- 172.21.15.164:0/1327201303 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f89e400a4a0 con 0x55c9736a9d60 2024-09-13T23:05:37.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.118+0000 7f89ed73e800 1 -- 172.21.15.164:0/1327201303 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9737a4a80 con 0x55c9736a9d60 2024-09-13T23:05:37.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.118+0000 7f89e9c35640 1 -- 172.21.15.164:0/1327201303 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f89e400a4a0 con 0x55c9736a9d60 2024-09-13T23:05:37.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.118+0000 7f89ed73e800 1 -- 172.21.15.164:0/1327201303 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9737a4ed0 con 0x55c9736a9d60 2024-09-13T23:05:37.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.119+0000 7f89e9c35640 1 -- 172.21.15.164:0/1327201303 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f89e400a4a0 con 0x55c9736a9d60 2024-09-13T23:05:37.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.119+0000 7f89ed73e800 1 Processor -- start 2024-09-13T23:05:37.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.119+0000 7f89ed73e800 1 -- start start 2024-09-13T23:05:37.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.119+0000 7f89ed73e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9737b3e40 0x55c9737b4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.119+0000 7f89ed73e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c97353e580 con 0x55c9737b3e40 2024-09-13T23:05:37.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.119+0000 7f89e3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9737b3e40 0x55c9737b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.119+0000 7f89e3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9737b3e40 0x55c9737b4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58278/0 (socket says 172.21.15.164:58278) 2024-09-13T23:05:37.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.119+0000 7f89e3fff640 1 -- 172.21.15.164:0/3944719347 learned_addr learned my addr 172.21.15.164:0/3944719347 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.120+0000 7f89e3fff640 1 -- 172.21.15.164:0/3944719347 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9737b47a0 con 0x55c9737b3e40 2024-09-13T23:05:37.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.120+0000 7f89e3fff640 1 --2- 172.21.15.164:0/3944719347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9737b3e40 0x55c9737b4260 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f89d4045f50 tx=0x7f89d4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.120+0000 7f88ceffd640 1 -- 172.21.15.164:0/3944719347 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89d406f070 con 0x55c9737b3e40 2024-09-13T23:05:37.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.120+0000 7f88ceffd640 1 -- 172.21.15.164:0/3944719347 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d405f550 con 0x55c9737b3e40 2024-09-13T23:05:37.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.120+0000 7f89ed73e800 1 -- 172.21.15.164:0/3944719347 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9737b49d0 con 0x55c9737b3e40 2024-09-13T23:05:37.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.120+0000 7f88ceffd640 1 -- 172.21.15.164:0/3944719347 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89d405f830 con 0x55c9737b3e40 2024-09-13T23:05:37.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.120+0000 7f89ed73e800 1 -- 172.21.15.164:0/3944719347 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9737b7650 con 0x55c9737b3e40 2024-09-13T23:05:37.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.121+0000 7f88ceffd640 1 -- 172.21.15.164:0/3944719347 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f89d405f9d0 con 0x55c9737b3e40 2024-09-13T23:05:37.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.121+0000 7f88ceffd640 1 --2- 172.21.15.164:0/3944719347 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f88c0036b90 0x7f88c0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.121+0000 7f88ceffd640 1 -- 172.21.15.164:0/3944719347 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f89d4092d50 con 0x55c9737b3e40 2024-09-13T23:05:37.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.121+0000 7f89e9c35640 1 --2- 172.21.15.164:0/3944719347 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f88c0036b90 0x7f88c0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.121+0000 7f89ed73e800 1 Processor -- start 2024-09-13T23:05:37.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.121+0000 7f89e9c35640 1 --2- 172.21.15.164:0/3944719347 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f88c0036b90 0x7f88c0039050 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55c9737a45a0 tx=0x7f89e4005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.121+0000 7f89ed73e800 1 -- start start 2024-09-13T23:05:37.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.122+0000 7f89ed73e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9737c09e0 0x55c9737c0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.122+0000 7f89ed73e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c973795230 con 0x55c9737c09e0 2024-09-13T23:05:37.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.122+0000 7f89e3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9737c09e0 0x55c9737c0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.122+0000 7f89e3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9737c09e0 0x55c9737c0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58286/0 (socket says 172.21.15.164:58286) 2024-09-13T23:05:37.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.122+0000 7f89e3fff640 1 -- 172.21.15.164:0/2183725704 learned_addr learned my addr 172.21.15.164:0/2183725704 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.122+0000 7f89e3fff640 1 -- 172.21.15.164:0/2183725704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9737c13b0 con 0x55c9737c09e0 2024-09-13T23:05:37.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.122+0000 7f89e3fff640 1 --2- 172.21.15.164:0/2183725704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9737c09e0 0x55c9737c0de0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f89d4053da0 tx=0x7f89d407cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12b4e925fbd775d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.122+0000 7f88ccff9640 1 -- 172.21.15.164:0/2183725704 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89d4080070 con 0x55c9737c09e0 2024-09-13T23:05:37.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.122+0000 7f88ccff9640 1 -- 172.21.15.164:0/2183725704 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d405fcc0 con 0x55c9737c09e0 2024-09-13T23:05:37.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.122+0000 7f88ccff9640 1 -- 172.21.15.164:0/2183725704 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89d406a3a0 con 0x55c9737c09e0 2024-09-13T23:05:37.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.123+0000 7f89ed73e800 1 -- 172.21.15.164:0/2183725704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9737c09e0 msgr2=0x55c9737c0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.123+0000 7f89ed73e800 1 --2- 172.21.15.164:0/2183725704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9737c09e0 0x55c9737c0de0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f89d4053da0 tx=0x7f89d407cea0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.123+0000 7f89ed73e800 1 -- 172.21.15.164:0/2183725704 shutdown_connections 2024-09-13T23:05:37.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.123+0000 7f89ed73e800 1 --2- 172.21.15.164:0/2183725704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9737c09e0 0x55c9737c0de0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.123+0000 7f89ed73e800 1 -- 172.21.15.164:0/2183725704 >> 172.21.15.164:0/2183725704 conn(0x55c9737bcd40 msgr2=0x55c9737bae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.123+0000 7f89ed73e800 1 -- 172.21.15.164:0/2183725704 shutdown_connections 2024-09-13T23:05:37.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.123+0000 7f89ed73e800 1 -- 172.21.15.164:0/2183725704 wait complete. 2024-09-13T23:05:37.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.123+0000 7f89ed73e800 1 Processor -- start 2024-09-13T23:05:37.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.123+0000 7f89ed73e800 1 -- start start 2024-09-13T23:05:37.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.123+0000 7f89ed73e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9737c09e0 0x55c9737c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.123+0000 7f89ed73e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c9737c1a20 con 0x55c9737c09e0 2024-09-13T23:05:37.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.124+0000 7f89e3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9737c09e0 0x55c9737c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.124+0000 7f89e3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9737c09e0 0x55c9737c7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58290/0 (socket says 172.21.15.164:58290) 2024-09-13T23:05:37.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.124+0000 7f89e3fff640 1 -- 172.21.15.164:0/2121118265 learned_addr learned my addr 172.21.15.164:0/2121118265 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.124+0000 7f89e3fff640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9737c83e0 con 0x55c9737c09e0 2024-09-13T23:05:37.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.124+0000 7f89e3fff640 1 --2- 172.21.15.164:0/2121118265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9737c09e0 0x55c9737c7ea0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f89d406bfd0 tx=0x7f89d4091010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.124+0000 7f88beffd640 1 -- 172.21.15.164:0/2121118265 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89d406a720 con 0x55c9737c09e0 2024-09-13T23:05:37.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.124+0000 7f88beffd640 1 -- 172.21.15.164:0/2121118265 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d406a8c0 con 0x55c9737c09e0 2024-09-13T23:05:37.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.124+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9737c8670 con 0x55c9737c09e0 2024-09-13T23:05:37.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.124+0000 7f88beffd640 1 -- 172.21.15.164:0/2121118265 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89d407c3f0 con 0x55c9737c09e0 2024-09-13T23:05:37.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.124+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9737cb320 con 0x55c9737c09e0 2024-09-13T23:05:37.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.125+0000 7f88beffd640 1 -- 172.21.15.164:0/2121118265 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f89d4083070 con 0x55c9737c09e0 2024-09-13T23:05:37.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.125+0000 7f88beffd640 1 --2- 172.21.15.164:0/2121118265 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f88b4036b90 0x7f88b4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.125+0000 7f88beffd640 1 -- 172.21.15.164:0/2121118265 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f89d40a5c50 con 0x55c9737c09e0 2024-09-13T23:05:37.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.125+0000 7f89e9c35640 1 --2- 172.21.15.164:0/2121118265 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f88b4036b90 0x7f88b4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.126+0000 7f89e9c35640 1 --2- 172.21.15.164:0/2121118265 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f88b4036b90 0x7f88b4039050 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x55c9737a09f0 tx=0x7f89e401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.126+0000 7f89ed73e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.126+0000 7f89ed73e800 1 --2- 172.21.15.164:0/2121118265 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c9737d37d0 0x55c9737d5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.126+0000 7f89e9434640 1 --2- 172.21.15.164:0/2121118265 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c9737d37d0 0x55c9737d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.126+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9737d63e0 con 0x55c9737d37d0 2024-09-13T23:05:37.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.126+0000 7f89e9434640 1 --2- 172.21.15.164:0/2121118265 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c9737d37d0 0x55c9737d5c90 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.127+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.127+0000 7f89ed73e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.127+0000 7f89ed73e800 20 realm 2024-09-13T23:05:37.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.127+0000 7f89ed73e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.127+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9737d67f0 con 0x55c9737d37d0 2024-09-13T23:05:37.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.127+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.127+0000 7f89ed73e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.127+0000 7f89ed73e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:37.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.127+0000 7f89ed73e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.127+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9737d70c0 con 0x55c9737d37d0 2024-09-13T23:05:37.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.127+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.127+0000 7f89ed73e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.127+0000 7f89ed73e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.127+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9737d7460 con 0x55c9737d37d0 2024-09-13T23:05:37.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.127+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.128+0000 7f89ed73e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:37.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.128+0000 7f89ed73e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.128+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9737d7cb0 con 0x55c9737d37d0 2024-09-13T23:05:37.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.128+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.128+0000 7f89ed73e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:37.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.128+0000 7f89ed73e800 20 searching for the correct realm 2024-09-13T23:05:37.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.128+0000 7f89ed73e800 1 --2- 172.21.15.164:0/2121118265 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55c9737d9a20 0x55c9737dbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.128+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x55c9737d9a20 2024-09-13T23:05:37.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.128+0000 7f89e3fff640 1 --2- 172.21.15.164:0/2121118265 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55c9737d9a20 0x55c9737dbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.128+0000 7f89e3fff640 1 --2- 172.21.15.164:0/2121118265 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55c9737d9a20 0x55c9737dbe10 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.129+0000 7f89e3fff640 1 -- 172.21.15.164:0/2121118265 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89d40a1020 con 0x55c9737d9a20 2024-09-13T23:05:37.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.129+0000 7f89e3fff640 1 --2- 172.21.15.164:0/2121118265 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f89d4085070 0x7f89d40624c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.129+0000 7f89e3fff640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x7f89d4085070 2024-09-13T23:05:37.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.129+0000 7f89e9c35640 1 --2- 172.21.15.164:0/2121118265 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f89d4085070 0x7f89d40624c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.129+0000 7f89e9c35640 1 --2- 172.21.15.164:0/2121118265 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f89d4085070 0x7f89d40624c0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.129+0000 7f89e9c35640 1 -- 172.21.15.164:0/2121118265 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e401f070 con 0x7f89d4085070 2024-09-13T23:05:37.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.129+0000 7f89e9c35640 1 --2- 172.21.15.164:0/2121118265 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f89e4031040 0x7f89e4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.129+0000 7f89e9c35640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x7f89e4031040 2024-09-13T23:05:37.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.130+0000 7f89e9434640 1 --2- 172.21.15.164:0/2121118265 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f89e4031040 0x7f89e4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.130+0000 7f89e9434640 1 --2- 172.21.15.164:0/2121118265 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f89e4031040 0x7f89e4032940 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.130+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89dc018950 con 0x7f89e4031040 2024-09-13T23:05:37.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.130+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x55c9737d37d0 2024-09-13T23:05:37.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.131+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.131+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x55c9737d37d0 2024-09-13T23:05:37.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.131+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.131+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x7f89e4031040 2024-09-13T23:05:37.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.131+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89dc018950 con 0x7f89e4031040 2024-09-13T23:05:37.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.131+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x7f89e4031040 2024-09-13T23:05:37.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.131+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89dc018950 con 0x7f89e4031040 2024-09-13T23:05:37.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.131+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x7f89d4085070 2024-09-13T23:05:37.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.131+0000 7f89e9c35640 1 -- 172.21.15.164:0/2121118265 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e401f070 con 0x7f89d4085070 2024-09-13T23:05:37.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.132+0000 7f89e9c35640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x55c9737d9a20 2024-09-13T23:05:37.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.132+0000 7f89e3fff640 1 -- 172.21.15.164:0/2121118265 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89d40a1020 con 0x55c9737d9a20 2024-09-13T23:05:37.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.132+0000 7f89e3fff640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x55c9737d37d0 2024-09-13T23:05:37.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.132+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.132+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x7f89e4031040 2024-09-13T23:05:37.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.132+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89dc018950 con 0x7f89e4031040 2024-09-13T23:05:37.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.132+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x55c9737d37d0 2024-09-13T23:05:37.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.133+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.133+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x7f89d4085070 2024-09-13T23:05:37.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.133+0000 7f89e9c35640 1 -- 172.21.15.164:0/2121118265 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f89e401f070 con 0x7f89d4085070 2024-09-13T23:05:37.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.133+0000 7f89e9c35640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x55c9737d9a20 2024-09-13T23:05:37.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.133+0000 7f89e3fff640 1 -- 172.21.15.164:0/2121118265 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89d40a1020 con 0x55c9737d9a20 2024-09-13T23:05:37.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.133+0000 7f89e3fff640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x55c9737d9a20 2024-09-13T23:05:37.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.133+0000 7f89e3fff640 1 -- 172.21.15.164:0/2121118265 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89d40a1020 con 0x55c9737d9a20 2024-09-13T23:05:37.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.133+0000 7f89e3fff640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x7f89e4031040 2024-09-13T23:05:37.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.134+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89dc018950 con 0x7f89e4031040 2024-09-13T23:05:37.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.134+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x55c9737d9a20 2024-09-13T23:05:37.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.134+0000 7f89e3fff640 1 -- 172.21.15.164:0/2121118265 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89d40a1020 con 0x55c9737d9a20 2024-09-13T23:05:37.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.134+0000 7f89e3fff640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x55c9737d9a20 2024-09-13T23:05:37.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.134+0000 7f89e3fff640 1 -- 172.21.15.164:0/2121118265 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89d40a1020 con 0x55c9737d9a20 2024-09-13T23:05:37.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.134+0000 7f89e3fff640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x55c9737d37d0 2024-09-13T23:05:37.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.134+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.134+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x55c9737d37d0 2024-09-13T23:05:37.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.135+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.135+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x7f89e4031040 2024-09-13T23:05:37.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.135+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89dc018950 con 0x7f89e4031040 2024-09-13T23:05:37.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.135+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x55c9737d9a20 2024-09-13T23:05:37.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.135+0000 7f89e3fff640 1 -- 172.21.15.164:0/2121118265 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89d40a1020 con 0x55c9737d9a20 2024-09-13T23:05:37.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.135+0000 7f89e3fff640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x7f89d4085070 2024-09-13T23:05:37.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.135+0000 7f89e9c35640 1 -- 172.21.15.164:0/2121118265 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e401f070 con 0x7f89d4085070 2024-09-13T23:05:37.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.135+0000 7f89e9c35640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x55c9737d37d0 2024-09-13T23:05:37.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.136+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.136+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x7f89e4031040 2024-09-13T23:05:37.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.136+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89dc018950 con 0x7f89e4031040 2024-09-13T23:05:37.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.136+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x55c9737d9a20 2024-09-13T23:05:37.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.136+0000 7f89e3fff640 1 -- 172.21.15.164:0/2121118265 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89d40a1020 con 0x55c9737d9a20 2024-09-13T23:05:37.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.136+0000 7f89e3fff640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x7f89e4031040 2024-09-13T23:05:37.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.136+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89dc018950 con 0x7f89e4031040 2024-09-13T23:05:37.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.136+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x7f89d4085070 2024-09-13T23:05:37.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.137+0000 7f89e9c35640 1 -- 172.21.15.164:0/2121118265 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e401f070 con 0x7f89d4085070 2024-09-13T23:05:37.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.137+0000 7f89e9c35640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x55c9737d9a20 2024-09-13T23:05:37.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.137+0000 7f89e3fff640 1 -- 172.21.15.164:0/2121118265 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89d40a1020 con 0x55c9737d9a20 2024-09-13T23:05:37.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.137+0000 7f89e3fff640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x7f89e4031040 2024-09-13T23:05:37.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.137+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89dc018950 con 0x7f89e4031040 2024-09-13T23:05:37.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.137+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x55c9737d37d0 2024-09-13T23:05:37.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.137+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.137+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc420 con 0x7f89d4085070 2024-09-13T23:05:37.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.138+0000 7f89e9c35640 1 -- 172.21.15.164:0/2121118265 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e401f070 con 0x7f89d4085070 2024-09-13T23:05:37.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.138+0000 7f89ed73e800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:37.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.138+0000 7f89ed73e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:37.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.138+0000 7f89ed73e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:37.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.138+0000 7f89ed73e800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:37.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.138+0000 7f89ed73e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:37.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.138+0000 7f89ed73e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:37.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.138+0000 7f89ed73e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.138+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9737d8630 con 0x55c9737d37d0 2024-09-13T23:05:37.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.138+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.138+0000 7f89ed73e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.138+0000 7f89ed73e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.138+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9737d8ed0 con 0x55c9737d37d0 2024-09-13T23:05:37.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.138+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.138+0000 7f89ed73e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:37.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.138+0000 7f89ed73e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.138+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9737d8ed0 con 0x55c9737d37d0 2024-09-13T23:05:37.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.138+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.138+0000 7f89ed73e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:37.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.138+0000 7f89ed73e800 20 zone default found 2024-09-13T23:05:37.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.138+0000 7f89ed73e800 4 Realm: () 2024-09-13T23:05:37.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.138+0000 7f89ed73e800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:37.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.138+0000 7f89ed73e800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:37.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.138+0000 7f89ed73e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:37.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.138+0000 7f89ed73e800 20 zonegroup default 2024-09-13T23:05:37.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.139+0000 7f89ed73e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.139+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dc8a0 con 0x7f89e4031040 2024-09-13T23:05:37.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.139+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x7f89e4031040 2024-09-13T23:05:37.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.139+0000 7f89ed73e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.139+0000 7f89ed73e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.139+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9737de280 con 0x55c9737d9a20 2024-09-13T23:05:37.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.139+0000 7f89e3fff640 1 -- 172.21.15.164:0/2121118265 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f89d40a1020 con 0x55c9737d9a20 2024-09-13T23:05:37.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.139+0000 7f89ed73e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.139+0000 7f89ed73e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.139+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9737de740 con 0x55c9737d9a20 2024-09-13T23:05:37.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.139+0000 7f89e3fff640 1 -- 172.21.15.164:0/2121118265 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f89d40a1020 con 0x55c9737d9a20 2024-09-13T23:05:37.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.139+0000 7f89ed73e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.139+0000 7f89ed73e800 20 started sync module instance, tier type = 2024-09-13T23:05:37.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.139+0000 7f89ed73e800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:37.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.139+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9737dd720 con 0x7f89d4085070 2024-09-13T23:05:37.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.140+0000 7f89e9c35640 1 -- 172.21.15.164:0/2121118265 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e4040040 con 0x7f89d4085070 2024-09-13T23:05:37.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.140+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94323714415376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9737df050 con 0x7f89d4085070 2024-09-13T23:05:37.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.140+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9737df8a0 con 0x55c9737d37d0 2024-09-13T23:05:37.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.141+0000 7f89e9c35640 1 -- 172.21.15.164:0/2121118265 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94323714415376] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e4040040 con 0x7f89d4085070 2024-09-13T23:05:37.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.142+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.142+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94323714419616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9737df4f0 con 0x55c9737d37d0 2024-09-13T23:05:37.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.142+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9737e0010 con 0x55c9737d9a20 2024-09-13T23:05:37.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.143+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94323714419616] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.143+0000 7f89e3fff640 1 -- 172.21.15.164:0/2121118265 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89d40a1020 con 0x55c9737d9a20 2024-09-13T23:05:37.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.143+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94323714423520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9737e0400 con 0x55c9737d9a20 2024-09-13T23:05:37.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.143+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9737e0e00 con 0x7f89d4085070 2024-09-13T23:05:37.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.144+0000 7f89e3fff640 1 -- 172.21.15.164:0/2121118265 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94323714423520] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89d40a1020 con 0x55c9737d9a20 2024-09-13T23:05:37.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.144+0000 7f89e9c35640 1 -- 172.21.15.164:0/2121118265 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e4040040 con 0x7f89d4085070 2024-09-13T23:05:37.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.144+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94323714420672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9737e11f0 con 0x7f89d4085070 2024-09-13T23:05:37.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.144+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9737e1c50 con 0x55c9737d37d0 2024-09-13T23:05:37.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.145+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.145+0000 7f89e9c35640 1 -- 172.21.15.164:0/2121118265 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94323714420672] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e4040040 con 0x7f89d4085070 2024-09-13T23:05:37.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.145+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94323714430768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9737e1c50 con 0x55c9737d37d0 2024-09-13T23:05:37.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.145+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9737e0950 con 0x7f89e4031040 2024-09-13T23:05:37.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.146+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94323714430768] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.148+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x7f89e4031040 2024-09-13T23:05:37.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.148+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94323714432080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9737e26c0 con 0x7f89e4031040 2024-09-13T23:05:37.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.148+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9737e3080 con 0x7f89e4031040 2024-09-13T23:05:37.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.149+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94323714432080] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x7f89e4031040 2024-09-13T23:05:37.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.149+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x7f89e4031040 2024-09-13T23:05:37.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.149+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94323714433136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9737e3080 con 0x7f89e4031040 2024-09-13T23:05:37.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.149+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9737e3a90 con 0x7f89e4031040 2024-09-13T23:05:37.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.151+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94323714433136] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x7f89e4031040 2024-09-13T23:05:37.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.151+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x7f89e4031040 2024-09-13T23:05:37.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.151+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94323714436528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9737e3a90 con 0x7f89e4031040 2024-09-13T23:05:37.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.152+0000 7f89ed73e800 20 add_watcher() i=0 2024-09-13T23:05:37.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.152+0000 7f89ed73e800 20 add_watcher() i=1 2024-09-13T23:05:37.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.152+0000 7f89ed73e800 20 add_watcher() i=2 2024-09-13T23:05:37.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.152+0000 7f89ed73e800 20 add_watcher() i=3 2024-09-13T23:05:37.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.152+0000 7f89ed73e800 20 add_watcher() i=4 2024-09-13T23:05:37.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.152+0000 7f89ed73e800 20 add_watcher() i=5 2024-09-13T23:05:37.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.152+0000 7f89ed73e800 20 add_watcher() i=6 2024-09-13T23:05:37.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.152+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94323714436528] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x7f89e4031040 2024-09-13T23:05:37.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.152+0000 7f89ed73e800 20 add_watcher() i=7 2024-09-13T23:05:37.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.153+0000 7f89ed73e800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:37.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.153+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9737e6e00 con 0x55c9737d37d0 2024-09-13T23:05:37.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.153+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.153+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94323714451440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9737e3c00 con 0x55c9737d37d0 2024-09-13T23:05:37.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.154+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94323714451440] v32'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.154+0000 7f889f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:37.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.154+0000 7f89ed73e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:37.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.154+0000 7f89ed73e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:37.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.154+0000 7f89ed73e800 5 note: GC not initialized 2024-09-13T23:05:37.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.154+0000 7f889e7e4640 20 reqs_thread_entry: start 2024-09-13T23:05:37.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.154+0000 7f89ed73e800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:37.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.154+0000 7f89ed73e800 20 Filter name: none 2024-09-13T23:05:37.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.154+0000 7f880ffff640 20 reqs_thread_entry: start 2024-09-13T23:05:37.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.155+0000 7f89ed73e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:05:37.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.155+0000 7f89ed73e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.155+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c97381a330 con 0x55c9737d37d0 2024-09-13T23:05:37.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.155+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.155+0000 7f89ed73e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:05:37.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.155+0000 7f89ed73e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:05:37.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.155+0000 7f89ed73e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:37.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.155+0000 7f89ed73e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:37.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.155+0000 7f89ed73e800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-13T23:05:37.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.155+0000 7f89ed73e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.155+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c973819e50 con 0x55c9737d37d0 2024-09-13T23:05:37.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.155+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.155+0000 7f89ed73e800 20 rados_obj.operate() r=0 bl.length=193 2024-09-13T23:05:37.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.155+0000 7f89ed73e800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-13T23:05:37.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.155+0000 7f89ed73e800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-13T23:05:37.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.155+0000 7f89ed73e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 : miss 2024-09-13T23:05:37.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.155+0000 7f89ed73e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.155+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 8.18 8:1ee4a648:root::.bucket.meta.testx%3amyfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c97381dc40 con 0x55c9737d37d0 2024-09-13T23:05:37.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.156+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 [call out=48b,stat out=16b,read 0~412 out=412b,getxattrs out=298b] v0'0 uv12 ondisk = 0) ==== 338+0+774 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.156+0000 7f89ed73e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-13T23:05:37.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.156+0000 7f89ed73e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 info.flags=0x17 2024-09-13T23:05:37.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.156+0000 7f89ed73e800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 to cache LRU end 2024-09-13T23:05:37.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.156+0000 7f89ed73e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:37.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.156+0000 7f89ed73e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-13T23:05:37.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.156+0000 7f89ed73e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 2024-09-13T23:05:37.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.156+0000 7f89ed73e800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-13T23:05:37.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.156+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c973822240 con 0x55c9737d37d0 2024-09-13T23:05:37.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.157+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v32'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.157+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:66 8.15 8:aa4f46c1:root::.bucket.meta.myfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1:head [create,call version.inc in=38b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c973825b50 con 0x55c9737d9a20 2024-09-13T23:05:37.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.158+0000 7f89e3fff640 1 -- 172.21.15.164:0/2121118265 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(66 .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 [create,call,writefull 0~379,setxattr (123)] v32'7 uv7 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7f89d40a1020 con 0x55c9737d9a20 2024-09-13T23:05:37.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.158+0000 7f89ed73e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 info.flags=0x7 2024-09-13T23:05:37.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.158+0000 7f89ed73e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 to cache LRU end 2024-09-13T23:05:37.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.158+0000 7f89ed73e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:05:37.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.158+0000 7f89ed73e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1, ofs0, ns] 2024-09-13T23:05:37.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.158+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94323714700928 in=740b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c973825220 con 0x7f89e4031040 2024-09-13T23:05:37.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.158+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== watch-notify(notify (1) cookie 94323714432080 notify 137438953485 ret 0) ==== 770+0+0 (crc 0 0 0) 0x55c97381e030 con 0x7f89e4031040 2024-09-13T23:05:37.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.158+0000 7f88ccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953485 cookie 94323714432080 notifier 4568 bl.length()=728 2024-09-13T23:05:37.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.158+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(67 notify.5 [notify cookie 94323714700928 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f89dc018950 con 0x7f89e4031040 2024-09-13T23:05:37.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.159+0000 7f88ccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 info.flags=0x7 2024-09-13T23:05:37.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.159+0000 7f88ccff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 to cache LRU end 2024-09-13T23:05:37.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.159+0000 7f88ccff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:05:37.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.159+0000 7f88ccff9640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f88ac003ea0 con 0x7f89e4031040 2024-09-13T23:05:37.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.159+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x7f89e4031040 2024-09-13T23:05:37.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.159+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== watch-notify(notify_complete (2) cookie 94323714700928 notify 137438953485 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c97381c170 con 0x7f89e4031040 2024-09-13T23:05:37.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.159+0000 7f89ed73e800 20 handle_bi_update(): bucket=:myfoo[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1]): orig_sources= new_sources= 2024-09-13T23:05:37.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.159+0000 7f89ed73e800 20 handle_bi_update(): bucket=:myfoo[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1]): potential sources added=[] removed=[] 2024-09-13T23:05:37.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.159+0000 7f89ed73e800 20 handle_bi_update(): bucket=:myfoo[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1]): orig_dests= new_dests= 2024-09-13T23:05:37.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.159+0000 7f89ed73e800 20 handle_bi_update(): bucket=:myfoo[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1]): potential dests added=[] removed=[] 2024-09-13T23:05:37.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.159+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c973825320 con 0x7f89d4085070 2024-09-13T23:05:37.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.160+0000 7f89e9c35640 1 -- 172.21.15.164:0/2121118265 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(69 foo.buckets [call] v32'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f89e4040040 con 0x7f89d4085070 2024-09-13T23:05:37.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.160+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c973824810 con 0x7f89d4085070 2024-09-13T23:05:37.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.161+0000 7f89e9c35640 1 -- 172.21.15.164:0/2121118265 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f89e4040040 con 0x7f89d4085070 2024-09-13T23:05:37.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.161+0000 7f89ed73e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T23:05:37.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.161+0000 7f89ed73e800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:05:37.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.161+0000 7f89ed73e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T23:05:37.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.161+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94323714707056 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c973826150 con 0x7f89e4031040 2024-09-13T23:05:37.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.161+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== watch-notify(notify (1) cookie 94323714433136 notify 137438953486 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55c97379cec0 con 0x7f89e4031040 2024-09-13T23:05:37.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.161+0000 7f88ccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953486 cookie 94323714433136 notifier 4568 bl.length()=314 2024-09-13T23:05:37.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.161+0000 7f88ccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T23:05:37.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.161+0000 7f88ccff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:05:37.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.161+0000 7f88ccff9640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f88ac003ea0 con 0x7f89e4031040 2024-09-13T23:05:37.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.161+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(71 notify.6 [notify cookie 94323714707056 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f89dc018950 con 0x7f89e4031040 2024-09-13T23:05:37.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.162+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x7f89e4031040 2024-09-13T23:05:37.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.162+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== watch-notify(notify_complete (2) cookie 94323714707056 notify 137438953486 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c97379c9a0 con 0x7f89e4031040 2024-09-13T23:05:37.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.162+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c973824e70 con 0x55c9737d37d0 2024-09-13T23:05:37.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.163+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(73 testx/myfoo [call,delete] v32'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.163+0000 7f89ed73e800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-13T23:05:37.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.163+0000 7f89ed73e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-13T23:05:37.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.163+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94323714707056 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9738225f0 con 0x55c9737d37d0 2024-09-13T23:05:37.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.163+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== watch-notify(notify (1) cookie 94323714430768 notify 137438953485 ret 0) ==== 197+0+0 (crc 0 0 0) 0x55c97379c9a0 con 0x55c9737d37d0 2024-09-13T23:05:37.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.163+0000 7f88bffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953485 cookie 94323714430768 notifier 4568 bl.length()=155 2024-09-13T23:05:37.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.163+0000 7f88bffff640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f881c0032c0 con 0x55c9737d37d0 2024-09-13T23:05:37.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.163+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(74 notify.4 [notify cookie 94323714707056 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.163+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== watch-notify(notify_complete (2) cookie 94323714707056 notify 137438953485 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c973550fe0 con 0x55c9737d37d0 2024-09-13T23:05:37.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.163+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.163+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:76 8.18 8:1ee4a648:root::.bucket.meta.testx%3amyfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c973825530 con 0x55c9737d37d0 2024-09-13T23:05:37.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.164+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 32 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 [call,delete] v32'13 uv13 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.164+0000 7f89ed73e800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 from cache 2024-09-13T23:05:37.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.164+0000 7f89ed73e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1, ofs0, ns] 2024-09-13T23:05:37.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.164+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [notify cookie 94323714707056 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c973825530 con 0x55c9737d37d0 2024-09-13T23:05:37.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.164+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 33 ==== watch-notify(notify (1) cookie 94323714430768 notify 137438953486 ret 0) ==== 254+0+0 (crc 0 0 0) 0x55c973550fe0 con 0x55c9737d37d0 2024-09-13T23:05:37.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.164+0000 7f88ccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953486 cookie 94323714430768 notifier 4568 bl.length()=212 2024-09-13T23:05:37.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.164+0000 7f88ccff9640 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f88ac003ea0 con 0x55c9737d37d0 2024-09-13T23:05:37.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.165+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 34 ==== osd_op_reply(77 notify.4 [notify cookie 94323714707056 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.165+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 35 ==== osd_op_reply(78 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.165+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 36 ==== watch-notify(notify_complete (2) cookie 94323714707056 notify 137438953486 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c97353cbc0 con 0x55c9737d37d0 2024-09-13T23:05:37.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.166+0000 7f889f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:37.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.166+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94323714451440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9738180a0 con 0x55c9737d37d0 2024-09-13T23:05:37.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.167+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 37 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94323714451440] v32'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.167+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94323714415376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9738180a0 con 0x7f89d4085070 2024-09-13T23:05:37.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.168+0000 7f89e9c35640 1 -- 172.21.15.164:0/2121118265 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94323714415376] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e4040040 con 0x7f89d4085070 2024-09-13T23:05:37.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.168+0000 7f89ed73e800 20 remove_watcher() i=0 2024-09-13T23:05:37.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.168+0000 7f89ed73e800 2 removed watcher, disabling cache 2024-09-13T23:05:37.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.168+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94323714419616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9738180a0 con 0x55c9737d37d0 2024-09-13T23:05:37.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.169+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 38 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94323714419616] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.169+0000 7f89ed73e800 20 remove_watcher() i=1 2024-09-13T23:05:37.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.169+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94323714423520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9738180a0 con 0x55c9737d9a20 2024-09-13T23:05:37.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.170+0000 7f89e3fff640 1 -- 172.21.15.164:0/2121118265 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94323714423520] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89d40a1020 con 0x55c9737d9a20 2024-09-13T23:05:37.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.170+0000 7f89ed73e800 20 remove_watcher() i=2 2024-09-13T23:05:37.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.170+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94323714420672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9737deba0 con 0x7f89d4085070 2024-09-13T23:05:37.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.171+0000 7f89e9c35640 1 -- 172.21.15.164:0/2121118265 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94323714420672] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e4040040 con 0x7f89d4085070 2024-09-13T23:05:37.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.171+0000 7f89ed73e800 20 remove_watcher() i=3 2024-09-13T23:05:37.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.171+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94323714430768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9737ddb10 con 0x55c9737d37d0 2024-09-13T23:05:37.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.172+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.1 v2:172.21.15.164:6800/4060509701 39 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94323714430768] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x55c9737d37d0 2024-09-13T23:05:37.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.172+0000 7f89ed73e800 20 remove_watcher() i=4 2024-09-13T23:05:37.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.172+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94323714432080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9737ddb10 con 0x7f89e4031040 2024-09-13T23:05:37.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.174+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94323714432080] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x7f89e4031040 2024-09-13T23:05:37.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.174+0000 7f89ed73e800 20 remove_watcher() i=5 2024-09-13T23:05:37.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.174+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94323714433136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9737ddb10 con 0x7f89e4031040 2024-09-13T23:05:37.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.175+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94323714433136] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x7f89e4031040 2024-09-13T23:05:37.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.175+0000 7f89ed73e800 20 remove_watcher() i=6 2024-09-13T23:05:37.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.175+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94323714436528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9737ddb10 con 0x7f89e4031040 2024-09-13T23:05:37.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.175+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 <== osd.0 v2:172.21.15.17:6800/489863589 27 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94323714436528] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89dc018950 con 0x7f89e4031040 2024-09-13T23:05:37.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.175+0000 7f89ed73e800 20 remove_watcher() i=7 2024-09-13T23:05:37.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.176+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f89e4031040 msgr2=0x7f89e4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.176+0000 7f89ed73e800 1 --2- 172.21.15.164:0/2121118265 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f89e4031040 0x7f89e4032940 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.176+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c9737d37d0 msgr2=0x55c9737d5c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.176+0000 7f89ed73e800 1 --2- 172.21.15.164:0/2121118265 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c9737d37d0 0x55c9737d5c90 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.176+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f89d4085070 msgr2=0x7f89d40624c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.176+0000 7f89ed73e800 1 --2- 172.21.15.164:0/2121118265 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f89d4085070 0x7f89d40624c0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.176+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55c9737d9a20 msgr2=0x55c9737dbe10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.176+0000 7f89ed73e800 1 --2- 172.21.15.164:0/2121118265 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55c9737d9a20 0x55c9737dbe10 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.176+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f88b4036b90 msgr2=0x7f88b4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.176+0000 7f89ed73e800 1 --2- 172.21.15.164:0/2121118265 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f88b4036b90 0x7f88b4039050 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x55c9737a09f0 tx=0x7f89e401f000 comp rx=0 tx=0).stop 2024-09-13T23:05:37.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.176+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9737c09e0 msgr2=0x55c9737c7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.176+0000 7f89ed73e800 1 --2- 172.21.15.164:0/2121118265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9737c09e0 0x55c9737c7ea0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f89d406bfd0 tx=0x7f89d4091010 comp rx=0 tx=0).stop 2024-09-13T23:05:37.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.176+0000 7f89e9434640 1 -- 172.21.15.164:0/2121118265 reap_dead start 2024-09-13T23:05:37.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.176+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 shutdown_connections 2024-09-13T23:05:37.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.176+0000 7f89ed73e800 1 --2- 172.21.15.164:0/2121118265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9737c09e0 0x55c9737c7ea0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.176+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 >> 172.21.15.164:0/2121118265 conn(0x55c9737bcd40 msgr2=0x55c9737bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.176+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 shutdown_connections 2024-09-13T23:05:37.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.176+0000 7f89ed73e800 1 -- 172.21.15.164:0/2121118265 wait complete. 2024-09-13T23:05:37.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.176+0000 7f89ed73e800 1 -- 172.21.15.164:0/3944719347 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f88c0036b90 msgr2=0x7f88c0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.176+0000 7f89ed73e800 1 --2- 172.21.15.164:0/3944719347 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f88c0036b90 0x7f88c0039050 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55c9737a45a0 tx=0x7f89e4005840 comp rx=0 tx=0).stop 2024-09-13T23:05:37.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.176+0000 7f89ed73e800 1 -- 172.21.15.164:0/3944719347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9737b3e40 msgr2=0x55c9737b4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.176+0000 7f89ed73e800 1 --2- 172.21.15.164:0/3944719347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9737b3e40 0x55c9737b4260 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f89d4045f50 tx=0x7f89d4002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.176+0000 7f89ed73e800 1 -- 172.21.15.164:0/3944719347 shutdown_connections 2024-09-13T23:05:37.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.176+0000 7f89ed73e800 1 --2- 172.21.15.164:0/3944719347 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f88c0036b90 0x7f88c0039050 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.176+0000 7f89ed73e800 1 --2- 172.21.15.164:0/3944719347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9737b3e40 0x55c9737b4260 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.176+0000 7f89ed73e800 1 -- 172.21.15.164:0/3944719347 >> 172.21.15.164:0/3944719347 conn(0x55c9737a8dd0 msgr2=0x55c9737ab950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.176+0000 7f89ed73e800 1 -- 172.21.15.164:0/3944719347 shutdown_connections 2024-09-13T23:05:37.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.176+0000 7f89ed73e800 1 -- 172.21.15.164:0/3944719347 wait complete. 2024-09-13T23:05:37.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.177+0000 7f89ed73e800 1 -- 172.21.15.164:0/1327201303 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c9736a9d60 msgr2=0x55c9737a34d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.177+0000 7f89ed73e800 1 --2- 172.21.15.164:0/1327201303 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c9736a9d60 0x55c9737a34d0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.177+0000 7f89ed73e800 1 -- 172.21.15.164:0/1327201303 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f88d0036b90 msgr2=0x7f88d0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.177+0000 7f89ed73e800 1 --2- 172.21.15.164:0/1327201303 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f88d0036b90 0x7f88d0039050 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f89d4057000 tx=0x7f89d4052000 comp rx=0 tx=0).stop 2024-09-13T23:05:37.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.177+0000 7f89ed73e800 1 -- 172.21.15.164:0/1327201303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9736175f0 msgr2=0x55c97379c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.177+0000 7f89ed73e800 1 --2- 172.21.15.164:0/1327201303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9736175f0 0x55c97379c460 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f89dc00b7c0 tx=0x7f89dc000ed0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.177+0000 7f89ed73e800 1 -- 172.21.15.164:0/1327201303 shutdown_connections 2024-09-13T23:05:37.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.177+0000 7f89ed73e800 1 --2- 172.21.15.164:0/1327201303 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c9736a9d60 0x55c9737a34d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.177+0000 7f89ed73e800 1 --2- 172.21.15.164:0/1327201303 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f88d0036b90 0x7f88d0039050 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.177+0000 7f89ed73e800 1 --2- 172.21.15.164:0/1327201303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9736175f0 0x55c97379c460 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.177+0000 7f89ed73e800 1 -- 172.21.15.164:0/1327201303 >> 172.21.15.164:0/1327201303 conn(0x55c97369ddb0 msgr2=0x55c97378ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.177+0000 7f89ed73e800 1 -- 172.21.15.164:0/1327201303 shutdown_connections 2024-09-13T23:05:37.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.177+0000 7f89ed73e800 1 -- 172.21.15.164:0/1327201303 wait complete. 2024-09-13T23:05:37.190 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T23:05:37.190 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T23:05:37.190 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-13T23:05:37.236 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:37.236 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:37.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.235+0000 7f66f8410800 1 Processor -- start 2024-09-13T23:05:37.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.235+0000 7f66f8410800 1 -- start start 2024-09-13T23:05:37.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.235+0000 7f66f8410800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55b753922e30 0x55b7539b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.235+0000 7f66f8410800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b75386eb30 con 0x55b7539b2720 2024-09-13T23:05:37.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.235+0000 7f66f8410800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55b753850360 con 0x55b753922e30 2024-09-13T23:05:37.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.236+0000 7f66f3af7640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55b753922e30 0x55b7539b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.236+0000 7f66f32f6640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55b7539b2720 0x55b7539b4b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:41080/0 (socket says 172.21.15.164:41080) 2024-09-13T23:05:37.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.236+0000 7f66f32f6640 1 -- 172.21.15.164:0/2550231427 learned_addr learned my addr 172.21.15.164:0/2550231427 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:37.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.236+0000 7f66f3af7640 1 -- 172.21.15.164:0/2550231427 >> v1:172.21.15.17:6789/0 conn(0x55b7539b2720 legacy=0x55b7539b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.236+0000 7f66f3af7640 1 -- 172.21.15.164:0/2550231427 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b753876e00 con 0x55b753922e30 2024-09-13T23:05:37.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.238+0000 7f66f3af7640 1 --2- 172.21.15.164:0/2550231427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753922e30 0x55b7539b21e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00a470 tx=0x7f66dc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add111acba7d20d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.238+0000 7f66f2af5640 1 -- 172.21.15.164:0/2550231427 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66dc053570 con 0x55b753922e30 2024-09-13T23:05:37.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.238+0000 7f66f2af5640 1 -- 172.21.15.164:0/2550231427 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66dc058070 con 0x55b753922e30 2024-09-13T23:05:37.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.238+0000 7f66f2af5640 1 -- 172.21.15.164:0/2550231427 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66dc053880 con 0x55b753922e30 2024-09-13T23:05:37.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.239+0000 7f66f8410800 1 -- 172.21.15.164:0/2550231427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753922e30 msgr2=0x55b7539b21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.239+0000 7f66f8410800 1 --2- 172.21.15.164:0/2550231427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753922e30 0x55b7539b21e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00a470 tx=0x7f66dc045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:37.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.239+0000 7f66f8410800 1 -- 172.21.15.164:0/2550231427 shutdown_connections 2024-09-13T23:05:37.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.239+0000 7f66f8410800 1 --2- 172.21.15.164:0/2550231427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753922e30 0x55b7539b21e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.239+0000 7f66f8410800 1 -- 172.21.15.164:0/2550231427 >> 172.21.15.164:0/2550231427 conn(0x55b7539a9dd0 msgr2=0x55b7539ac1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.239+0000 7f66f8410800 1 -- 172.21.15.164:0/2550231427 shutdown_connections 2024-09-13T23:05:37.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.239+0000 7f66f8410800 1 -- 172.21.15.164:0/2550231427 wait complete. 2024-09-13T23:05:37.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.253+0000 7f66f8410800 1 Processor -- start 2024-09-13T23:05:37.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.253+0000 7f66f8410800 1 -- start start 2024-09-13T23:05:37.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.253+0000 7f66f8410800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753922e30 0x55b753a9e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.253+0000 7f66f8410800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b7538fb360 con 0x55b753922e30 2024-09-13T23:05:37.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.253+0000 7f66f3af7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753922e30 0x55b753a9e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.253+0000 7f66f3af7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753922e30 0x55b753a9e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58294/0 (socket says 172.21.15.164:58294) 2024-09-13T23:05:37.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.253+0000 7f66f3af7640 1 -- 172.21.15.164:0/3347977948 learned_addr learned my addr 172.21.15.164:0/3347977948 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.254+0000 7f66f3af7640 1 -- 172.21.15.164:0/3347977948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b753848bc0 con 0x55b753922e30 2024-09-13T23:05:37.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.254+0000 7f66f3af7640 1 --2- 172.21.15.164:0/3347977948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753922e30 0x55b753a9e880 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f66dc025c20 tx=0x7f66dc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729829a3fd4cb332 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.254+0000 7f65e1e0b640 1 -- 172.21.15.164:0/3347977948 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66dc05c580 con 0x55b753922e30 2024-09-13T23:05:37.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.254+0000 7f65e1e0b640 1 -- 172.21.15.164:0/3347977948 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66dc063030 con 0x55b753922e30 2024-09-13T23:05:37.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.254+0000 7f65e1e0b640 1 -- 172.21.15.164:0/3347977948 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66dc05c850 con 0x55b753922e30 2024-09-13T23:05:37.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.255+0000 7f66f8410800 1 -- 172.21.15.164:0/3347977948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753922e30 msgr2=0x55b753a9e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.255+0000 7f66f8410800 1 --2- 172.21.15.164:0/3347977948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753922e30 0x55b753a9e880 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f66dc025c20 tx=0x7f66dc051000 comp rx=0 tx=0).stop 2024-09-13T23:05:37.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.255+0000 7f66f8410800 1 -- 172.21.15.164:0/3347977948 shutdown_connections 2024-09-13T23:05:37.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.255+0000 7f66f8410800 1 --2- 172.21.15.164:0/3347977948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753922e30 0x55b753a9e880 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.255+0000 7f66f8410800 1 -- 172.21.15.164:0/3347977948 >> 172.21.15.164:0/3347977948 conn(0x55b7539a9dd0 msgr2=0x55b753a9a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.255+0000 7f66f8410800 1 -- 172.21.15.164:0/3347977948 shutdown_connections 2024-09-13T23:05:37.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.255+0000 7f66f8410800 1 -- 172.21.15.164:0/3347977948 wait complete. 2024-09-13T23:05:37.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.255+0000 7f66f8410800 1 Processor -- start 2024-09-13T23:05:37.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.255+0000 7f66f8410800 1 -- start start 2024-09-13T23:05:37.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.255+0000 7f66f8410800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753922e30 0x55b7539afb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.255+0000 7f66f8410800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b7539b6620 con 0x55b753922e30 2024-09-13T23:05:37.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.256+0000 7f66f3af7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753922e30 0x55b7539afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.256+0000 7f66f3af7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753922e30 0x55b7539afb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58308/0 (socket says 172.21.15.164:58308) 2024-09-13T23:05:37.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.256+0000 7f66f3af7640 1 -- 172.21.15.164:0/3793156998 learned_addr learned my addr 172.21.15.164:0/3793156998 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.256+0000 7f66f3af7640 1 -- 172.21.15.164:0/3793156998 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b75385cfe0 con 0x55b753922e30 2024-09-13T23:05:37.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.256+0000 7f66f3af7640 1 --2- 172.21.15.164:0/3793156998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753922e30 0x55b7539afb10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00a330 tx=0x7f66dc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.256+0000 7f65dbfff640 1 -- 172.21.15.164:0/3793156998 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66dc06c030 con 0x55b753922e30 2024-09-13T23:05:37.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.256+0000 7f65dbfff640 1 -- 172.21.15.164:0/3793156998 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66dc05c580 con 0x55b753922e30 2024-09-13T23:05:37.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.256+0000 7f66f8410800 1 -- 172.21.15.164:0/3793156998 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7539ae200 con 0x55b753922e30 2024-09-13T23:05:37.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.256+0000 7f65dbfff640 1 -- 172.21.15.164:0/3793156998 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66dc05c860 con 0x55b753922e30 2024-09-13T23:05:37.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.256+0000 7f66f8410800 1 -- 172.21.15.164:0/3793156998 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7539ae780 con 0x55b753922e30 2024-09-13T23:05:37.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.257+0000 7f65dbfff640 1 -- 172.21.15.164:0/3793156998 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f66dc053440 con 0x55b753922e30 2024-09-13T23:05:37.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.257+0000 7f65dbfff640 1 --2- 172.21.15.164:0/3793156998 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f65dc036b40 0x7f65dc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.257+0000 7f65dbfff640 1 -- 172.21.15.164:0/3793156998 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f66dc070020 con 0x55b753922e30 2024-09-13T23:05:37.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.257+0000 7f66f32f6640 1 --2- 172.21.15.164:0/3793156998 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f65dc036b40 0x7f65dc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.257+0000 7f66f8410800 1 --2- 172.21.15.164:0/3793156998 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b7539b2720 0x55b753aaf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.257+0000 7f66f8410800 1 -- 172.21.15.164:0/3793156998 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b753aafaf0 con 0x55b7539b2720 2024-09-13T23:05:37.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.258+0000 7f66f42f8640 1 --2- 172.21.15.164:0/3793156998 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b7539b2720 0x55b753aaf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.258+0000 7f66f32f6640 1 --2- 172.21.15.164:0/3793156998 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f65dc036b40 0x7f65dc039000 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f66e4000f60 tx=0x7f66e40012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.258+0000 7f66f42f8640 1 --2- 172.21.15.164:0/3793156998 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b7539b2720 0x55b753aaf5b0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.258+0000 7f66f42f8640 1 -- 172.21.15.164:0/3793156998 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66ec00a4a0 con 0x55b7539b2720 2024-09-13T23:05:37.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.258+0000 7f66f8410800 1 -- 172.21.15.164:0/3793156998 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b753ab0340 con 0x55b7539b2720 2024-09-13T23:05:37.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.258+0000 7f66f42f8640 1 -- 172.21.15.164:0/3793156998 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f66ec00a4a0 con 0x55b7539b2720 2024-09-13T23:05:37.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.259+0000 7f66f8410800 1 -- 172.21.15.164:0/3793156998 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b753ab16f0 con 0x55b7539b2720 2024-09-13T23:05:37.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.259+0000 7f66f42f8640 1 -- 172.21.15.164:0/3793156998 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f66ec00a4a0 con 0x55b7539b2720 2024-09-13T23:05:37.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.259+0000 7f66f8410800 1 -- 172.21.15.164:0/3793156998 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b753ab0b90 con 0x55b7539b2720 2024-09-13T23:05:37.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.259+0000 7f66f42f8640 1 -- 172.21.15.164:0/3793156998 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f66ec00a4a0 con 0x55b7539b2720 2024-09-13T23:05:37.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.259+0000 7f66f8410800 1 -- 172.21.15.164:0/3793156998 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b753ab0fe0 con 0x55b7539b2720 2024-09-13T23:05:37.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.259+0000 7f66f42f8640 1 -- 172.21.15.164:0/3793156998 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f66ec00a4a0 con 0x55b7539b2720 2024-09-13T23:05:37.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.260+0000 7f66f8410800 1 Processor -- start 2024-09-13T23:05:37.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.260+0000 7f66f8410800 1 -- start start 2024-09-13T23:05:37.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.260+0000 7f66f8410800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753abff40 0x55b753ac0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.260+0000 7f66f8410800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b7539b0050 con 0x55b753abff40 2024-09-13T23:05:37.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.260+0000 7f66f32f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753abff40 0x55b753ac0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.260+0000 7f66f32f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753abff40 0x55b753ac0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58324/0 (socket says 172.21.15.164:58324) 2024-09-13T23:05:37.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.260+0000 7f66f32f6640 1 -- 172.21.15.164:0/116139757 learned_addr learned my addr 172.21.15.164:0/116139757 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.261+0000 7f66f32f6640 1 -- 172.21.15.164:0/116139757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b753ac08a0 con 0x55b753abff40 2024-09-13T23:05:37.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.261+0000 7f66f32f6640 1 --2- 172.21.15.164:0/116139757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753abff40 0x55b753ac0360 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f66e4001ed0 tx=0x7f66e400d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.261+0000 7f65d97fa640 1 -- 172.21.15.164:0/116139757 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66e401b550 con 0x55b753abff40 2024-09-13T23:05:37.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.261+0000 7f65d97fa640 1 -- 172.21.15.164:0/116139757 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e401b6f0 con 0x55b753abff40 2024-09-13T23:05:37.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.261+0000 7f65d97fa640 1 -- 172.21.15.164:0/116139757 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66e401b9d0 con 0x55b753abff40 2024-09-13T23:05:37.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.261+0000 7f66f8410800 1 -- 172.21.15.164:0/116139757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b753ac0b30 con 0x55b753abff40 2024-09-13T23:05:37.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.261+0000 7f66f8410800 1 -- 172.21.15.164:0/116139757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b753ac3810 con 0x55b753abff40 2024-09-13T23:05:37.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.262+0000 7f65d97fa640 1 -- 172.21.15.164:0/116139757 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f66e4023020 con 0x55b753abff40 2024-09-13T23:05:37.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.262+0000 7f65d97fa640 1 --2- 172.21.15.164:0/116139757 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f65cc036b90 0x7f65cc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.262+0000 7f65d97fa640 1 -- 172.21.15.164:0/116139757 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f66e4021020 con 0x55b753abff40 2024-09-13T23:05:37.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.262+0000 7f66f42f8640 1 --2- 172.21.15.164:0/116139757 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f65cc036b90 0x7f65cc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.262+0000 7f66f8410800 1 Processor -- start 2024-09-13T23:05:37.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.262+0000 7f66f8410800 1 -- start start 2024-09-13T23:05:37.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.262+0000 7f66f42f8640 1 --2- 172.21.15.164:0/116139757 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f65cc036b90 0x7f65cc039050 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55b753ab01f0 tx=0x7f66ec005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.262+0000 7f66f8410800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753accc50 0x55b753acd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.262+0000 7f66f8410800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b75384a580 con 0x55b753accc50 2024-09-13T23:05:37.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.263+0000 7f66f32f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753accc50 0x55b753acd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.263+0000 7f66f32f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753accc50 0x55b753acd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58334/0 (socket says 172.21.15.164:58334) 2024-09-13T23:05:37.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.263+0000 7f66f32f6640 1 -- 172.21.15.164:0/3641499854 learned_addr learned my addr 172.21.15.164:0/3641499854 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.263+0000 7f66f32f6640 1 -- 172.21.15.164:0/3641499854 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b753acd620 con 0x55b753accc50 2024-09-13T23:05:37.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.263+0000 7f66f32f6640 1 --2- 172.21.15.164:0/3641499854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753accc50 0x55b753acd050 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f66e404d100 tx=0x7f66e4019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f3261016c35893d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.263+0000 7f65d2ffd640 1 -- 172.21.15.164:0/3641499854 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66e4025410 con 0x55b753accc50 2024-09-13T23:05:37.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.263+0000 7f65d2ffd640 1 -- 172.21.15.164:0/3641499854 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e4019320 con 0x55b753accc50 2024-09-13T23:05:37.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.263+0000 7f65d2ffd640 1 -- 172.21.15.164:0/3641499854 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66e40255b0 con 0x55b753accc50 2024-09-13T23:05:37.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.264+0000 7f66f8410800 1 -- 172.21.15.164:0/3641499854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753accc50 msgr2=0x55b753acd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.264+0000 7f66f8410800 1 --2- 172.21.15.164:0/3641499854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753accc50 0x55b753acd050 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f66e404d100 tx=0x7f66e4019ce0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.264+0000 7f66f8410800 1 -- 172.21.15.164:0/3641499854 shutdown_connections 2024-09-13T23:05:37.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.264+0000 7f66f8410800 1 --2- 172.21.15.164:0/3641499854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753accc50 0x55b753acd050 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.264+0000 7f66f8410800 1 -- 172.21.15.164:0/3641499854 >> 172.21.15.164:0/3641499854 conn(0x55b753ac8fb0 msgr2=0x55b753ac70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.264+0000 7f66f8410800 1 -- 172.21.15.164:0/3641499854 shutdown_connections 2024-09-13T23:05:37.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.264+0000 7f66f8410800 1 -- 172.21.15.164:0/3641499854 wait complete. 2024-09-13T23:05:37.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.264+0000 7f66f8410800 1 Processor -- start 2024-09-13T23:05:37.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.264+0000 7f66f8410800 1 -- start start 2024-09-13T23:05:37.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.264+0000 7f66f8410800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753accc50 0x55b753ad3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.264+0000 7f66f8410800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b753acdb10 con 0x55b753accc50 2024-09-13T23:05:37.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.264+0000 7f66f32f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753accc50 0x55b753ad3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.264+0000 7f66f32f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753accc50 0x55b753ad3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58338/0 (socket says 172.21.15.164:58338) 2024-09-13T23:05:37.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.264+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 learned_addr learned my addr 172.21.15.164:0/307472235 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.265+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b753ad4520 con 0x55b753accc50 2024-09-13T23:05:37.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.265+0000 7f66f32f6640 1 --2- 172.21.15.164:0/307472235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753accc50 0x55b753ad3fe0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f66e401bfb0 tx=0x7f66e404d090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.265+0000 7f65d17fa640 1 -- 172.21.15.164:0/307472235 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66e4040990 con 0x55b753accc50 2024-09-13T23:05:37.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.265+0000 7f65d17fa640 1 -- 172.21.15.164:0/307472235 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e4040b30 con 0x55b753accc50 2024-09-13T23:05:37.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.265+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b753ad47b0 con 0x55b753accc50 2024-09-13T23:05:37.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.265+0000 7f65d17fa640 1 -- 172.21.15.164:0/307472235 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66e4040d80 con 0x55b753accc50 2024-09-13T23:05:37.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.265+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b753ad47b0 con 0x55b753accc50 2024-09-13T23:05:37.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.266+0000 7f65d17fa640 1 -- 172.21.15.164:0/307472235 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f66e4040350 con 0x55b753accc50 2024-09-13T23:05:37.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.266+0000 7f65d17fa640 1 --2- 172.21.15.164:0/307472235 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f65bc036b40 0x7f65bc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.266+0000 7f65d17fa640 1 -- 172.21.15.164:0/307472235 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f66e4035070 con 0x55b753accc50 2024-09-13T23:05:37.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.266+0000 7f66f42f8640 1 --2- 172.21.15.164:0/307472235 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f65bc036b40 0x7f65bc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.267+0000 7f66f42f8640 1 --2- 172.21.15.164:0/307472235 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f65bc036b40 0x7f65bc039000 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55b7539aeb70 tx=0x7f66ec01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.267+0000 7f66f8410800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.267+0000 7f66f8410800 1 --2- 172.21.15.164:0/307472235 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b753adf910 0x55b753ae1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.267+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae2520 con 0x55b753adf910 2024-09-13T23:05:37.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.267+0000 7f66f3af7640 1 --2- 172.21.15.164:0/307472235 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b753adf910 0x55b753ae1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.267+0000 7f66f3af7640 1 --2- 172.21.15.164:0/307472235 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b753adf910 0x55b753ae1dd0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.267+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.268+0000 7f66f8410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.268+0000 7f66f8410800 20 realm 2024-09-13T23:05:37.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.268+0000 7f66f8410800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.268+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae2930 con 0x55b753adf910 2024-09-13T23:05:37.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.268+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.268+0000 7f66f8410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.268+0000 7f66f8410800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:37.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.268+0000 7f66f8410800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.268+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae3200 con 0x55b753adf910 2024-09-13T23:05:37.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.268+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.268+0000 7f66f8410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.268+0000 7f66f8410800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.268+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae35a0 con 0x55b753adf910 2024-09-13T23:05:37.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.268+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.268+0000 7f66f8410800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:37.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.268+0000 7f66f8410800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.268+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae3df0 con 0x55b753adf910 2024-09-13T23:05:37.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.269+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.269+0000 7f66f8410800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:37.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.269+0000 7f66f8410800 20 searching for the correct realm 2024-09-13T23:05:37.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.269+0000 7f66f8410800 1 --2- 172.21.15.164:0/307472235 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55b753ae5b60 0x55b753ae7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.269+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x55b753ae5b60 2024-09-13T23:05:37.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.269+0000 7f66f32f6640 1 --2- 172.21.15.164:0/307472235 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55b753ae5b60 0x55b753ae7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.269+0000 7f66f32f6640 1 --2- 172.21.15.164:0/307472235 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55b753ae5b60 0x55b753ae7f50 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.269+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e4057040 con 0x55b753ae5b60 2024-09-13T23:05:37.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.269+0000 7f66f32f6640 1 --2- 172.21.15.164:0/307472235 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f66e402fbd0 0x7f66e4023950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.269+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x7f66e402fbd0 2024-09-13T23:05:37.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.269+0000 7f66f42f8640 1 --2- 172.21.15.164:0/307472235 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f66e402fbd0 0x7f66e4023950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.270+0000 7f66f42f8640 1 --2- 172.21.15.164:0/307472235 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f66e402fbd0 0x7f66e4023950 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.270+0000 7f66f42f8640 1 -- 172.21.15.164:0/307472235 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66ec01f070 con 0x7f66e402fbd0 2024-09-13T23:05:37.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.270+0000 7f66f42f8640 1 --2- 172.21.15.164:0/307472235 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f66ec031040 0x7f66ec032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.270+0000 7f66f42f8640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x7f66ec031040 2024-09-13T23:05:37.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.270+0000 7f66f3af7640 1 --2- 172.21.15.164:0/307472235 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f66ec031040 0x7f66ec032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.271+0000 7f66f3af7640 1 --2- 172.21.15.164:0/307472235 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f66ec031040 0x7f66ec032430 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.271+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.271+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x55b753adf910 2024-09-13T23:05:37.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.271+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.271+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x55b753adf910 2024-09-13T23:05:37.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.271+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.271+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x7f66ec031040 2024-09-13T23:05:37.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.272+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.272+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x7f66ec031040 2024-09-13T23:05:37.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.272+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.272+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x7f66e402fbd0 2024-09-13T23:05:37.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.272+0000 7f66f42f8640 1 -- 172.21.15.164:0/307472235 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66ec01f070 con 0x7f66e402fbd0 2024-09-13T23:05:37.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.272+0000 7f66f42f8640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x55b753ae5b60 2024-09-13T23:05:37.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.272+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e4057040 con 0x55b753ae5b60 2024-09-13T23:05:37.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.272+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x55b753adf910 2024-09-13T23:05:37.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.272+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.272+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x7f66ec031040 2024-09-13T23:05:37.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.273+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.273+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x55b753adf910 2024-09-13T23:05:37.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.273+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.273+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x7f66e402fbd0 2024-09-13T23:05:37.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.273+0000 7f66f42f8640 1 -- 172.21.15.164:0/307472235 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f66ec01f070 con 0x7f66e402fbd0 2024-09-13T23:05:37.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.273+0000 7f66f42f8640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x55b753ae5b60 2024-09-13T23:05:37.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.273+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e4057040 con 0x55b753ae5b60 2024-09-13T23:05:37.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.273+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x55b753ae5b60 2024-09-13T23:05:37.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.274+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e4057040 con 0x55b753ae5b60 2024-09-13T23:05:37.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.274+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x7f66ec031040 2024-09-13T23:05:37.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.274+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.274+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x55b753ae5b60 2024-09-13T23:05:37.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.274+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e4057040 con 0x55b753ae5b60 2024-09-13T23:05:37.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.274+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x55b753ae5b60 2024-09-13T23:05:37.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.274+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e4057040 con 0x55b753ae5b60 2024-09-13T23:05:37.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.274+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x55b753adf910 2024-09-13T23:05:37.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.274+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.275+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x55b753adf910 2024-09-13T23:05:37.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.275+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.275+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x7f66ec031040 2024-09-13T23:05:37.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.275+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.275+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x55b753ae5b60 2024-09-13T23:05:37.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.275+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e4057040 con 0x55b753ae5b60 2024-09-13T23:05:37.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.275+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x7f66e402fbd0 2024-09-13T23:05:37.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.275+0000 7f66f42f8640 1 -- 172.21.15.164:0/307472235 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66ec01f070 con 0x7f66e402fbd0 2024-09-13T23:05:37.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.275+0000 7f66f42f8640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x55b753adf910 2024-09-13T23:05:37.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.276+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.276+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x7f66ec031040 2024-09-13T23:05:37.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.276+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.276+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x55b753ae5b60 2024-09-13T23:05:37.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.276+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e4057040 con 0x55b753ae5b60 2024-09-13T23:05:37.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.276+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x7f66ec031040 2024-09-13T23:05:37.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.277+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.277+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x7f66e402fbd0 2024-09-13T23:05:37.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.277+0000 7f66f42f8640 1 -- 172.21.15.164:0/307472235 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66ec01f070 con 0x7f66e402fbd0 2024-09-13T23:05:37.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.277+0000 7f66f42f8640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x55b753ae5b60 2024-09-13T23:05:37.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.277+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e4057040 con 0x55b753ae5b60 2024-09-13T23:05:37.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.277+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x7f66ec031040 2024-09-13T23:05:37.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.277+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.277+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x55b753adf910 2024-09-13T23:05:37.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.278+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.278+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae8530 con 0x7f66e402fbd0 2024-09-13T23:05:37.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.278+0000 7f66f42f8640 1 -- 172.21.15.164:0/307472235 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66ec01f070 con 0x7f66e402fbd0 2024-09-13T23:05:37.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.278+0000 7f66f8410800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:37.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.278+0000 7f66f8410800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:37.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.278+0000 7f66f8410800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:37.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.278+0000 7f66f8410800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:37.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.278+0000 7f66f8410800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:37.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.278+0000 7f66f8410800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:37.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.278+0000 7f66f8410800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.278+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae47a0 con 0x55b753adf910 2024-09-13T23:05:37.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.278+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.278+0000 7f66f8410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.278+0000 7f66f8410800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.278+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae4b90 con 0x55b753adf910 2024-09-13T23:05:37.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.279+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.279+0000 7f66f8410800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:37.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.279+0000 7f66f8410800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.279+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae4b90 con 0x55b753adf910 2024-09-13T23:05:37.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.279+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.279+0000 7f66f8410800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:37.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.279+0000 7f66f8410800 20 zone default found 2024-09-13T23:05:37.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.279+0000 7f66f8410800 4 Realm: () 2024-09-13T23:05:37.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.279+0000 7f66f8410800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:37.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.279+0000 7f66f8410800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:37.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.279+0000 7f66f8410800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:37.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.279+0000 7f66f8410800 20 zonegroup default 2024-09-13T23:05:37.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.279+0000 7f66f8410800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.279+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae4fb0 con 0x7f66ec031040 2024-09-13T23:05:37.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.279+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.279+0000 7f66f8410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.279+0000 7f66f8410800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.279+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae4fe0 con 0x55b753ae5b60 2024-09-13T23:05:37.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.279+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f66e4057040 con 0x55b753ae5b60 2024-09-13T23:05:37.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.280+0000 7f66f8410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.280+0000 7f66f8410800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.280+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b753aea490 con 0x55b753ae5b60 2024-09-13T23:05:37.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.280+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f66e4057040 con 0x55b753ae5b60 2024-09-13T23:05:37.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.280+0000 7f66f8410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.280+0000 7f66f8410800 20 started sync module instance, tier type = 2024-09-13T23:05:37.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.280+0000 7f66f8410800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:37.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.280+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae9830 con 0x7f66e402fbd0 2024-09-13T23:05:37.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.281+0000 7f66f42f8640 1 -- 172.21.15.164:0/307472235 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66ec040040 con 0x7f66e402fbd0 2024-09-13T23:05:37.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.281+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94245871328288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753aeada0 con 0x7f66e402fbd0 2024-09-13T23:05:37.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.281+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753aeb5f0 con 0x55b753adf910 2024-09-13T23:05:37.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.282+0000 7f66f42f8640 1 -- 172.21.15.164:0/307472235 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94245871328288] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66ec040040 con 0x7f66e402fbd0 2024-09-13T23:05:37.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.282+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.282+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94245871331568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753aeb300 con 0x55b753adf910 2024-09-13T23:05:37.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.282+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753aebe20 con 0x55b753ae5b60 2024-09-13T23:05:37.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.283+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66e4057040 con 0x55b753ae5b60 2024-09-13T23:05:37.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.283+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94245871335664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753aec6c0 con 0x55b753ae5b60 2024-09-13T23:05:37.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.283+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753aed170 con 0x7f66e402fbd0 2024-09-13T23:05:37.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.283+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94245871331568] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.284+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94245871335664] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66e4057040 con 0x55b753ae5b60 2024-09-13T23:05:37.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.284+0000 7f66f42f8640 1 -- 172.21.15.164:0/307472235 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66ec040040 con 0x7f66e402fbd0 2024-09-13T23:05:37.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.284+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94245871338000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753aead50 con 0x7f66e402fbd0 2024-09-13T23:05:37.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.284+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753aedb80 con 0x55b753adf910 2024-09-13T23:05:37.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.285+0000 7f66f42f8640 1 -- 172.21.15.164:0/307472235 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94245871338000] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66ec040040 con 0x7f66e402fbd0 2024-09-13T23:05:37.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.285+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.285+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94245871340624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753aedb80 con 0x55b753adf910 2024-09-13T23:05:37.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.285+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753aee450 con 0x7f66ec031040 2024-09-13T23:05:37.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.286+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94245871340624] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.286+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.286+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94245871343312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753aedfa0 con 0x7f66ec031040 2024-09-13T23:05:37.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.286+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753aeeea0 con 0x7f66ec031040 2024-09-13T23:05:37.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.287+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94245871343312] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.287+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.287+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94245871348144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753aedfa0 con 0x7f66ec031040 2024-09-13T23:05:37.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.287+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753aef8e0 con 0x7f66ec031040 2024-09-13T23:05:37.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.288+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94245871348144] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.288+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.288+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94245871344848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753aef8e0 con 0x7f66ec031040 2024-09-13T23:05:37.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.289+0000 7f66f8410800 20 add_watcher() i=0 2024-09-13T23:05:37.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.289+0000 7f66f8410800 20 add_watcher() i=1 2024-09-13T23:05:37.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.289+0000 7f66f8410800 20 add_watcher() i=2 2024-09-13T23:05:37.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.289+0000 7f66f8410800 20 add_watcher() i=3 2024-09-13T23:05:37.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.289+0000 7f66f8410800 20 add_watcher() i=4 2024-09-13T23:05:37.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.289+0000 7f66f8410800 20 add_watcher() i=5 2024-09-13T23:05:37.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.289+0000 7f66f8410800 20 add_watcher() i=6 2024-09-13T23:05:37.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.289+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94245871344848] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.289+0000 7f66f8410800 20 add_watcher() i=7 2024-09-13T23:05:37.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.289+0000 7f66f8410800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:37.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.290+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b753af2c10 con 0x55b753adf910 2024-09-13T23:05:37.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.290+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.290+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94245871363648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753aefa50 con 0x55b753adf910 2024-09-13T23:05:37.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.291+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94245871363648] v32'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.291+0000 7f65a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:37.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.291+0000 7f66f8410800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:37.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.291+0000 7f66f8410800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:37.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.291+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753af2060 con 0x55b753adf910 2024-09-13T23:05:37.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.292+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.292+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afbd90 con 0x7f66ec031040 2024-09-13T23:05:37.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.294+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.294+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afbd90 con 0x55b753ae5b60 2024-09-13T23:05:37.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.295+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f66e4057040 con 0x55b753ae5b60 2024-09-13T23:05:37.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.295+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afc150 con 0x55b753adf910 2024-09-13T23:05:37.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.296+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'135 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.296+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afc130 con 0x7f66e402fbd0 2024-09-13T23:05:37.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.297+0000 7f66f42f8640 1 -- 172.21.15.164:0/307472235 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'38 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f66ec040040 con 0x7f66e402fbd0 2024-09-13T23:05:37.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.297+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afc6a0 con 0x55b753ae5b60 2024-09-13T23:05:37.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.298+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'25 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f66e4057040 con 0x55b753ae5b60 2024-09-13T23:05:37.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.298+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afc6a0 con 0x55b753adf910 2024-09-13T23:05:37.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.299+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.299+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afc750 con 0x7f66ec031040 2024-09-13T23:05:37.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.300+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'25 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.300+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afc750 con 0x7f66e402fbd0 2024-09-13T23:05:37.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.301+0000 7f66f42f8640 1 -- 172.21.15.164:0/307472235 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f66ec040040 con 0x7f66e402fbd0 2024-09-13T23:05:37.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.301+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afcea0 con 0x55b753ae5b60 2024-09-13T23:05:37.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.302+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f66e4057040 con 0x55b753ae5b60 2024-09-13T23:05:37.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.302+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afcea0 con 0x7f66e402fbd0 2024-09-13T23:05:37.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.303+0000 7f66f42f8640 1 -- 172.21.15.164:0/307472235 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'39 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f66ec040040 con 0x7f66e402fbd0 2024-09-13T23:05:37.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.303+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afd410 con 0x7f66ec031040 2024-09-13T23:05:37.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.304+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.304+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afd410 con 0x7f66e402fbd0 2024-09-13T23:05:37.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.305+0000 7f66f42f8640 1 -- 172.21.15.164:0/307472235 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f66ec040040 con 0x7f66e402fbd0 2024-09-13T23:05:37.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.305+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afd4a0 con 0x7f66ec031040 2024-09-13T23:05:37.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.306+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'31 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.306+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afd4a0 con 0x55b753adf910 2024-09-13T23:05:37.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.307+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'136 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.307+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afd4a0 con 0x55b753ae5b60 2024-09-13T23:05:37.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.308+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'32 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f66e4057040 con 0x55b753ae5b60 2024-09-13T23:05:37.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.308+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afd530 con 0x7f66e402fbd0 2024-09-13T23:05:37.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.309+0000 7f66f42f8640 1 -- 172.21.15.164:0/307472235 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'40 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f66ec040040 con 0x7f66e402fbd0 2024-09-13T23:05:37.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.309+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afd530 con 0x55b753ae5b60 2024-09-13T23:05:37.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.310+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f66e4057040 con 0x55b753ae5b60 2024-09-13T23:05:37.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.310+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afd530 con 0x55b753adf910 2024-09-13T23:05:37.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.311+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.311+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afd530 con 0x55b753adf910 2024-09-13T23:05:37.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.312+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'137 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.312+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afd530 con 0x55b753ae5b60 2024-09-13T23:05:37.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.313+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'33 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f66e4057040 con 0x55b753ae5b60 2024-09-13T23:05:37.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.313+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afd530 con 0x7f66e402fbd0 2024-09-13T23:05:37.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.314+0000 7f66f42f8640 1 -- 172.21.15.164:0/307472235 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f66ec040040 con 0x7f66e402fbd0 2024-09-13T23:05:37.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.314+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afd530 con 0x55b753ae5b60 2024-09-13T23:05:37.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.315+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f66e4057040 con 0x55b753ae5b60 2024-09-13T23:05:37.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.315+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afd530 con 0x55b753ae5b60 2024-09-13T23:05:37.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.316+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f66e4057040 con 0x55b753ae5b60 2024-09-13T23:05:37.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.316+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afd530 con 0x55b753ae5b60 2024-09-13T23:05:37.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.317+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f66e4057040 con 0x55b753ae5b60 2024-09-13T23:05:37.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.317+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afd530 con 0x55b753ae5b60 2024-09-13T23:05:37.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.318+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f66e4057040 con 0x55b753ae5b60 2024-09-13T23:05:37.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.318+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afd530 con 0x7f66ec031040 2024-09-13T23:05:37.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.319+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.319+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afd530 con 0x55b753ae5b60 2024-09-13T23:05:37.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.320+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f66e4057040 con 0x55b753ae5b60 2024-09-13T23:05:37.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.320+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afd4a0 con 0x7f66ec031040 2024-09-13T23:05:37.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.321+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.321+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afd4a0 con 0x55b753ae5b60 2024-09-13T23:05:37.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.322+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'34 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f66e4057040 con 0x55b753ae5b60 2024-09-13T23:05:37.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.322+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afd410 con 0x7f66ec031040 2024-09-13T23:05:37.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.323+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'32 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.323+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753af1c80 con 0x7f66e402fbd0 2024-09-13T23:05:37.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.324+0000 7f66f42f8640 1 -- 172.21.15.164:0/307472235 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f66ec040040 con 0x7f66e402fbd0 2024-09-13T23:05:37.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.324+0000 7f65a8fe1640 20 reqs_thread_entry: start 2024-09-13T23:05:37.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.325+0000 7f66f8410800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:37.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.325+0000 7f66f8410800 20 Filter name: none 2024-09-13T23:05:37.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.325+0000 7f65227fc640 20 reqs_thread_entry: start 2024-09-13T23:05:37.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.325+0000 7f66f8410800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-13T23:05:37.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.325+0000 7f66f8410800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.325+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b753b286f0 con 0x7f66ec031040 2024-09-13T23:05:37.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.325+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.325+0000 7f66f8410800 20 rados_obj.operate() r=0 bl.length=419 2024-09-13T23:05:37.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.325+0000 7f66f8410800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-13T23:05:37.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.325+0000 7f66f8410800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T23:05:37.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.325+0000 7f66f8410800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:37.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.325+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b753b281b0 con 0x55b753adf910 2024-09-13T23:05:37.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.325+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.325+0000 7f66f8410800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-13T23:05:37.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.326+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753b281b0 con 0x7f66ec031040 2024-09-13T23:05:37.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.326+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v32'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.326+0000 7f66f8410800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T23:05:37.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.327+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94245871590512 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b753b2b550 con 0x55b753ae5b60 2024-09-13T23:05:37.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.327+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 26 ==== watch-notify(notify (1) cookie 94245871335664 notify 137438953477 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55b753afc750 con 0x55b753ae5b60 2024-09-13T23:05:37.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.327+0000 7f65d2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94245871335664 notifier 4575 bl.length()=170 2024-09-13T23:05:37.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.327+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 27 ==== osd_op_reply(97 notify.2 [notify cookie 94245871590512 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f66e4057040 con 0x55b753ae5b60 2024-09-13T23:05:37.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.327+0000 7f65d2ffd640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f65b8003d60 con 0x55b753ae5b60 2024-09-13T23:05:37.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.327+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66e4057040 con 0x55b753ae5b60 2024-09-13T23:05:37.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.327+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 29 ==== watch-notify(notify_complete (2) cookie 94245871590512 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b753acd620 con 0x55b753ae5b60 2024-09-13T23:05:37.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.327+0000 7f66f8410800 10 removing email index: 2024-09-13T23:05:37.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.327+0000 7f66f8410800 10 removing user buckets index 2024-09-13T23:05:37.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.327+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753b29110 con 0x55b753adf910 2024-09-13T23:05:37.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.328+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v32'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.328+0000 7f66f8410800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-13T23:05:37.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.328+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94245871590512 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b753b2b550 con 0x55b753adf910 2024-09-13T23:05:37.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.328+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== watch-notify(notify (1) cookie 94245871340624 notify 137438953487 ret 0) ==== 217+0+0 (crc 0 0 0) 0x55b753ad4520 con 0x55b753adf910 2024-09-13T23:05:37.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.328+0000 7f65d27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953487 cookie 94245871340624 notifier 4575 bl.length()=175 2024-09-13T23:05:37.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.328+0000 7f65d27fc640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f65280032c0 con 0x55b753adf910 2024-09-13T23:05:37.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.328+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 32 ==== osd_op_reply(100 notify.4 [notify cookie 94245871590512 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.329+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 33 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.329+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 34 ==== watch-notify(notify_complete (2) cookie 94245871590512 notify 137438953487 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f66dc0853f0 con 0x55b753adf910 2024-09-13T23:05:37.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.329+0000 7f66f8410800 10 removing user index: testx$tenanteduser 2024-09-13T23:05:37.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.329+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753b2d1e0 con 0x7f66ec031040 2024-09-13T23:05:37.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.330+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v32'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.330+0000 7f66f8410800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-13T23:05:37.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.330+0000 7f66f8410800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-13T23:05:37.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.330+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94245871604192 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b753b2a100 con 0x7f66e402fbd0 2024-09-13T23:05:37.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.330+0000 7f66f42f8640 1 -- 172.21.15.164:0/307472235 <== osd.2 v2:172.21.15.164:6808/3795914978 18 ==== watch-notify(notify (1) cookie 94245871338000 notify 137438953491 ret 0) ==== 209+0+0 (crc 0 0 0) 0x55b753afcea0 con 0x7f66e402fbd0 2024-09-13T23:05:37.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.330+0000 7f65d2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953491 cookie 94245871338000 notifier 4575 bl.length()=167 2024-09-13T23:05:37.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.330+0000 7f65d2ffd640 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f65b8003d60 con 0x7f66e402fbd0 2024-09-13T23:05:37.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.330+0000 7f66f42f8640 1 -- 172.21.15.164:0/307472235 <== osd.2 v2:172.21.15.164:6808/3795914978 19 ==== osd_op_reply(103 notify.3 [notify cookie 94245871604192 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f66ec040040 con 0x7f66e402fbd0 2024-09-13T23:05:37.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.330+0000 7f66f42f8640 1 -- 172.21.15.164:0/307472235 <== osd.2 v2:172.21.15.164:6808/3795914978 20 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66ec040040 con 0x7f66e402fbd0 2024-09-13T23:05:37.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.330+0000 7f66f42f8640 1 -- 172.21.15.164:0/307472235 <== osd.2 v2:172.21.15.164:6808/3795914978 21 ==== watch-notify(notify_complete (2) cookie 94245871604192 notify 137438953491 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b753afd240 con 0x7f66e402fbd0 2024-09-13T23:05:37.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.331+0000 7f65a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:37.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.331+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94245871363648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753afb060 con 0x55b753adf910 2024-09-13T23:05:37.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.332+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 35 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94245871363648] v32'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.332+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94245871328288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753af2640 con 0x7f66e402fbd0 2024-09-13T23:05:37.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.333+0000 7f66f42f8640 1 -- 172.21.15.164:0/307472235 <== osd.2 v2:172.21.15.164:6808/3795914978 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94245871328288] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66ec040040 con 0x7f66e402fbd0 2024-09-13T23:05:37.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.333+0000 7f66f8410800 20 remove_watcher() i=0 2024-09-13T23:05:37.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.333+0000 7f66f8410800 2 removed watcher, disabling cache 2024-09-13T23:05:37.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.333+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94245871331568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae9c20 con 0x55b753adf910 2024-09-13T23:05:37.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.334+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 36 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94245871331568] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.334+0000 7f66f8410800 20 remove_watcher() i=1 2024-09-13T23:05:37.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.335+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94245871335664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae9c20 con 0x55b753ae5b60 2024-09-13T23:05:37.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.335+0000 7f66f32f6640 1 -- 172.21.15.164:0/307472235 <== osd.3 v2:172.21.15.164:6816/93809510 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94245871335664] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66e4057040 con 0x55b753ae5b60 2024-09-13T23:05:37.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.335+0000 7f66f8410800 20 remove_watcher() i=2 2024-09-13T23:05:37.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.335+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94245871338000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae9c20 con 0x7f66e402fbd0 2024-09-13T23:05:37.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.336+0000 7f66f42f8640 1 -- 172.21.15.164:0/307472235 <== osd.2 v2:172.21.15.164:6808/3795914978 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94245871338000] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66ec040040 con 0x7f66e402fbd0 2024-09-13T23:05:37.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.336+0000 7f66f8410800 20 remove_watcher() i=3 2024-09-13T23:05:37.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.336+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94245871340624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae9c20 con 0x55b753adf910 2024-09-13T23:05:37.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.338+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.1 v2:172.21.15.164:6800/4060509701 37 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94245871340624] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x55b753adf910 2024-09-13T23:05:37.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.338+0000 7f66f8410800 20 remove_watcher() i=4 2024-09-13T23:05:37.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.338+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94245871343312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753aecc50 con 0x7f66ec031040 2024-09-13T23:05:37.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.339+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 27 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94245871343312] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.339+0000 7f66f8410800 20 remove_watcher() i=5 2024-09-13T23:05:37.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.339+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94245871348144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753ae9c20 con 0x7f66ec031040 2024-09-13T23:05:37.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.340+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 28 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94245871348144] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.340+0000 7f66f8410800 20 remove_watcher() i=6 2024-09-13T23:05:37.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.340+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94245871344848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b753aed6d0 con 0x7f66ec031040 2024-09-13T23:05:37.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.341+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 <== osd.0 v2:172.21.15.17:6800/489863589 29 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94245871344848] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66dc07b070 con 0x7f66ec031040 2024-09-13T23:05:37.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.341+0000 7f66f8410800 20 remove_watcher() i=7 2024-09-13T23:05:37.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.341+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f66ec031040 msgr2=0x7f66ec032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.341+0000 7f66f8410800 1 --2- 172.21.15.164:0/307472235 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f66ec031040 0x7f66ec032430 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.341+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b753adf910 msgr2=0x55b753ae1dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.341+0000 7f66f8410800 1 --2- 172.21.15.164:0/307472235 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b753adf910 0x55b753ae1dd0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.341+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f66e402fbd0 msgr2=0x7f66e4023950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.341+0000 7f66f8410800 1 --2- 172.21.15.164:0/307472235 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f66e402fbd0 0x7f66e4023950 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.341+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55b753ae5b60 msgr2=0x55b753ae7f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.341+0000 7f66f8410800 1 --2- 172.21.15.164:0/307472235 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55b753ae5b60 0x55b753ae7f50 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.341+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f65bc036b40 msgr2=0x7f65bc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.341+0000 7f66f8410800 1 --2- 172.21.15.164:0/307472235 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f65bc036b40 0x7f65bc039000 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55b7539aeb70 tx=0x7f66ec01f000 comp rx=0 tx=0).stop 2024-09-13T23:05:37.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.341+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753accc50 msgr2=0x55b753ad3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.341+0000 7f66f8410800 1 --2- 172.21.15.164:0/307472235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753accc50 0x55b753ad3fe0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f66e401bfb0 tx=0x7f66e404d090 comp rx=0 tx=0).stop 2024-09-13T23:05:37.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.341+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 reap_dead start 2024-09-13T23:05:37.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.341+0000 7f66f3af7640 1 -- 172.21.15.164:0/307472235 reap_dead start 2024-09-13T23:05:37.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.341+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 shutdown_connections 2024-09-13T23:05:37.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.341+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 >> 172.21.15.164:0/307472235 conn(0x55b753ac8fb0 msgr2=0x55b753ac7080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.341+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 shutdown_connections 2024-09-13T23:05:37.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.341+0000 7f66f8410800 1 -- 172.21.15.164:0/307472235 wait complete. 2024-09-13T23:05:37.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.341+0000 7f66f8410800 1 -- 172.21.15.164:0/116139757 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f65cc036b90 msgr2=0x7f65cc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.341+0000 7f66f8410800 1 --2- 172.21.15.164:0/116139757 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f65cc036b90 0x7f65cc039050 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55b753ab01f0 tx=0x7f66ec005840 comp rx=0 tx=0).stop 2024-09-13T23:05:37.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.341+0000 7f66f8410800 1 -- 172.21.15.164:0/116139757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753abff40 msgr2=0x55b753ac0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.341+0000 7f66f8410800 1 --2- 172.21.15.164:0/116139757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753abff40 0x55b753ac0360 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f66e4001ed0 tx=0x7f66e400d7a0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.341+0000 7f66f8410800 1 -- 172.21.15.164:0/116139757 shutdown_connections 2024-09-13T23:05:37.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.341+0000 7f66f8410800 1 --2- 172.21.15.164:0/116139757 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f65cc036b90 0x7f65cc039050 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.341+0000 7f66f8410800 1 --2- 172.21.15.164:0/116139757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753abff40 0x55b753ac0360 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.341+0000 7f66f8410800 1 -- 172.21.15.164:0/116139757 >> 172.21.15.164:0/116139757 conn(0x55b753ab4ed0 msgr2=0x55b753ab7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.342+0000 7f66f8410800 1 -- 172.21.15.164:0/116139757 shutdown_connections 2024-09-13T23:05:37.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.342+0000 7f66f8410800 1 -- 172.21.15.164:0/116139757 wait complete. 2024-09-13T23:05:37.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.342+0000 7f66f8410800 1 -- 172.21.15.164:0/3793156998 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b7539b2720 msgr2=0x55b753aaf5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.342+0000 7f66f8410800 1 --2- 172.21.15.164:0/3793156998 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b7539b2720 0x55b753aaf5b0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.342+0000 7f66f8410800 1 -- 172.21.15.164:0/3793156998 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f65dc036b40 msgr2=0x7f65dc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.342+0000 7f66f8410800 1 --2- 172.21.15.164:0/3793156998 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f65dc036b40 0x7f65dc039000 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f66e4000f60 tx=0x7f66e40012b0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.342+0000 7f66f8410800 1 -- 172.21.15.164:0/3793156998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753922e30 msgr2=0x55b7539afb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.342+0000 7f66f8410800 1 --2- 172.21.15.164:0/3793156998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753922e30 0x55b7539afb10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00a330 tx=0x7f66dc002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.342+0000 7f66f8410800 1 -- 172.21.15.164:0/3793156998 shutdown_connections 2024-09-13T23:05:37.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.342+0000 7f66f8410800 1 --2- 172.21.15.164:0/3793156998 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b7539b2720 0x55b753aaf5b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.342+0000 7f66f8410800 1 --2- 172.21.15.164:0/3793156998 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f65dc036b40 0x7f65dc039000 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.342+0000 7f66f8410800 1 --2- 172.21.15.164:0/3793156998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b753922e30 0x55b7539afb10 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.342+0000 7f66f8410800 1 -- 172.21.15.164:0/3793156998 >> 172.21.15.164:0/3793156998 conn(0x55b7539a9dd0 msgr2=0x55b753a98ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.342+0000 7f66f8410800 1 -- 172.21.15.164:0/3793156998 shutdown_connections 2024-09-13T23:05:37.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.342+0000 7f66f8410800 1 -- 172.21.15.164:0/3793156998 wait complete. 2024-09-13T23:05:37.359 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-13T23:05:37.362 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-13T23:05:37.405 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:05:37.405 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-13T23:05:37.406 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-13T23:05:37.406 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-13T23:05:37.453 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:37.453 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:37.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.452+0000 7f527b740800 1 Processor -- start 2024-09-13T23:05:37.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.452+0000 7f527b740800 1 -- start start 2024-09-13T23:05:37.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.452+0000 7f527b740800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5559a784e920 0x5559a7850d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.452+0000 7f527b740800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5559a770ab30 con 0x5559a784a4e0 2024-09-13T23:05:37.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.452+0000 7f527b740800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x5559a76ec360 con 0x5559a784e920 2024-09-13T23:05:37.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.452+0000 7f5276cd0640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5559a784e920 0x5559a7850d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.452+0000 7f52774d1640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x5559a784a4e0 0x5559a784a8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:41088/0 (socket says 172.21.15.164:41088) 2024-09-13T23:05:37.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.452+0000 7f52774d1640 1 -- 172.21.15.164:0/3614938124 learned_addr learned my addr 172.21.15.164:0/3614938124 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:37.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.453+0000 7f5276cd0640 1 -- 172.21.15.164:0/3614938124 >> v1:172.21.15.17:6789/0 conn(0x5559a784a4e0 legacy=0x5559a784a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.453+0000 7f5276cd0640 1 -- 172.21.15.164:0/3614938124 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559a7712e00 con 0x5559a784e920 2024-09-13T23:05:37.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.454+0000 7f5276cd0640 1 --2- 172.21.15.164:0/3614938124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a784e920 0x5559a7850d10 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f526c00a470 tx=0x7f526c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b34f630b74afd32 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.454+0000 7f52764cf640 1 -- 172.21.15.164:0/3614938124 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f526c053570 con 0x5559a784e920 2024-09-13T23:05:37.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.455+0000 7f52764cf640 1 -- 172.21.15.164:0/3614938124 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f526c058070 con 0x5559a784e920 2024-09-13T23:05:37.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.455+0000 7f52764cf640 1 -- 172.21.15.164:0/3614938124 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f526c053880 con 0x5559a784e920 2024-09-13T23:05:37.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.455+0000 7f527b740800 1 -- 172.21.15.164:0/3614938124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a784e920 msgr2=0x5559a7850d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.455+0000 7f527b740800 1 --2- 172.21.15.164:0/3614938124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a784e920 0x5559a7850d10 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f526c00a470 tx=0x7f526c045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:37.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.455+0000 7f527b740800 1 -- 172.21.15.164:0/3614938124 shutdown_connections 2024-09-13T23:05:37.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.455+0000 7f527b740800 1 --2- 172.21.15.164:0/3614938124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a784e920 0x5559a7850d10 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.455+0000 7f527b740800 1 -- 172.21.15.164:0/3614938124 >> 172.21.15.164:0/3614938124 conn(0x5559a7845db0 msgr2=0x5559a78481d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.455+0000 7f527b740800 1 -- 172.21.15.164:0/3614938124 shutdown_connections 2024-09-13T23:05:37.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.455+0000 7f527b740800 1 -- 172.21.15.164:0/3614938124 wait complete. 2024-09-13T23:05:37.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.469+0000 7f527b740800 1 Processor -- start 2024-09-13T23:05:37.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.469+0000 7f527b740800 1 -- start start 2024-09-13T23:05:37.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.469+0000 7f527b740800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a784a4e0 0x5559a77bf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.469+0000 7f527b740800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5559a7797360 con 0x5559a784a4e0 2024-09-13T23:05:37.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.470+0000 7f52774d1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a784a4e0 0x5559a77bf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.470+0000 7f52774d1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a784a4e0 0x5559a77bf5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58360/0 (socket says 172.21.15.164:58360) 2024-09-13T23:05:37.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.470+0000 7f52774d1640 1 -- 172.21.15.164:0/3936047857 learned_addr learned my addr 172.21.15.164:0/3936047857 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.470+0000 7f52774d1640 1 -- 172.21.15.164:0/3936047857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559a76e4bc0 con 0x5559a784a4e0 2024-09-13T23:05:37.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.470+0000 7f52774d1640 1 --2- 172.21.15.164:0/3936047857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a784a4e0 0x5559a77bf5c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5268001e10 tx=0x7f526800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161aea52a9b08d52 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.470+0000 7f516560a640 1 -- 172.21.15.164:0/3936047857 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5268012020 con 0x5559a784a4e0 2024-09-13T23:05:37.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.470+0000 7f516560a640 1 -- 172.21.15.164:0/3936047857 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f526800e5a0 con 0x5559a784a4e0 2024-09-13T23:05:37.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.470+0000 7f516560a640 1 -- 172.21.15.164:0/3936047857 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f526800e8e0 con 0x5559a784a4e0 2024-09-13T23:05:37.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.471+0000 7f527b740800 1 -- 172.21.15.164:0/3936047857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a784a4e0 msgr2=0x5559a77bf5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.471+0000 7f527b740800 1 --2- 172.21.15.164:0/3936047857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a784a4e0 0x5559a77bf5c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5268001e10 tx=0x7f526800b780 comp rx=0 tx=0).stop 2024-09-13T23:05:37.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.471+0000 7f527b740800 1 -- 172.21.15.164:0/3936047857 shutdown_connections 2024-09-13T23:05:37.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.471+0000 7f527b740800 1 --2- 172.21.15.164:0/3936047857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a784a4e0 0x5559a77bf5c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.471+0000 7f527b740800 1 -- 172.21.15.164:0/3936047857 >> 172.21.15.164:0/3936047857 conn(0x5559a7845db0 msgr2=0x5559a7935120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.471+0000 7f527b740800 1 -- 172.21.15.164:0/3936047857 shutdown_connections 2024-09-13T23:05:37.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.471+0000 7f527b740800 1 -- 172.21.15.164:0/3936047857 wait complete. 2024-09-13T23:05:37.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.471+0000 7f527b740800 1 Processor -- start 2024-09-13T23:05:37.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.472+0000 7f527b740800 1 -- start start 2024-09-13T23:05:37.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.472+0000 7f527b740800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a784a4e0 0x5559a793aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.472+0000 7f527b740800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5559a7851550 con 0x5559a784a4e0 2024-09-13T23:05:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.472+0000 7f52774d1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a784a4e0 0x5559a793aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.472+0000 7f52774d1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a784a4e0 0x5559a793aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58368/0 (socket says 172.21.15.164:58368) 2024-09-13T23:05:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.472+0000 7f52774d1640 1 -- 172.21.15.164:0/1352749649 learned_addr learned my addr 172.21.15.164:0/1352749649 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.472+0000 7f52774d1640 1 -- 172.21.15.164:0/1352749649 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559a76f8fe0 con 0x5559a784a4e0 2024-09-13T23:05:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.472+0000 7f52774d1640 1 --2- 172.21.15.164:0/1352749649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a784a4e0 0x5559a793aec0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f526800b7c0 tx=0x7f5268000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.473+0000 7f5163e07640 1 -- 172.21.15.164:0/1352749649 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5268012030 con 0x5559a784a4e0 2024-09-13T23:05:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.473+0000 7f5163e07640 1 -- 172.21.15.164:0/1352749649 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5268001470 con 0x5559a784a4e0 2024-09-13T23:05:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.473+0000 7f527b740800 1 -- 172.21.15.164:0/1352749649 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559a79395b0 con 0x5559a784a4e0 2024-09-13T23:05:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.473+0000 7f5163e07640 1 -- 172.21.15.164:0/1352749649 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f526801a8d0 con 0x5559a784a4e0 2024-09-13T23:05:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.473+0000 7f527b740800 1 -- 172.21.15.164:0/1352749649 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559a7939ad0 con 0x5559a784a4e0 2024-09-13T23:05:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.473+0000 7f5163e07640 1 -- 172.21.15.164:0/1352749649 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5268015020 con 0x5559a784a4e0 2024-09-13T23:05:37.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.474+0000 7f5163e07640 1 --2- 172.21.15.164:0/1352749649 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f515c036b90 0x7f515c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.474+0000 7f5163e07640 1 -- 172.21.15.164:0/1352749649 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5268020030 con 0x5559a784a4e0 2024-09-13T23:05:37.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.474+0000 7f5276cd0640 1 --2- 172.21.15.164:0/1352749649 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f515c036b90 0x7f515c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.474+0000 7f527b740800 1 --2- 172.21.15.164:0/1352749649 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5559a784e920 0x5559a794b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.474+0000 7f527b740800 1 -- 172.21.15.164:0/1352749649 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559a794bb70 con 0x5559a784e920 2024-09-13T23:05:37.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.474+0000 7f5277cd2640 1 --2- 172.21.15.164:0/1352749649 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5559a784e920 0x5559a794b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.474+0000 7f5276cd0640 1 --2- 172.21.15.164:0/1352749649 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f515c036b90 0x7f515c039050 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f526c057000 tx=0x7f526c052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.474+0000 7f5277cd2640 1 --2- 172.21.15.164:0/1352749649 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5559a784e920 0x5559a794b630 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.474+0000 7f5277cd2640 1 -- 172.21.15.164:0/1352749649 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f527000a4a0 con 0x5559a784e920 2024-09-13T23:05:37.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.474+0000 7f527b740800 1 -- 172.21.15.164:0/1352749649 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559a794c3c0 con 0x5559a784e920 2024-09-13T23:05:37.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.475+0000 7f5277cd2640 1 -- 172.21.15.164:0/1352749649 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f527000a4a0 con 0x5559a784e920 2024-09-13T23:05:37.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.475+0000 7f527b740800 1 -- 172.21.15.164:0/1352749649 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559a794d770 con 0x5559a784e920 2024-09-13T23:05:37.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.475+0000 7f5277cd2640 1 -- 172.21.15.164:0/1352749649 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f527000a4a0 con 0x5559a784e920 2024-09-13T23:05:37.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.475+0000 7f527b740800 1 -- 172.21.15.164:0/1352749649 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559a794cc10 con 0x5559a784e920 2024-09-13T23:05:37.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.475+0000 7f5277cd2640 1 -- 172.21.15.164:0/1352749649 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f527000a4a0 con 0x5559a784e920 2024-09-13T23:05:37.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.475+0000 7f527b740800 1 -- 172.21.15.164:0/1352749649 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559a794d060 con 0x5559a784e920 2024-09-13T23:05:37.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.476+0000 7f5277cd2640 1 -- 172.21.15.164:0/1352749649 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f527000a4a0 con 0x5559a784e920 2024-09-13T23:05:37.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.476+0000 7f527b740800 1 Processor -- start 2024-09-13T23:05:37.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.476+0000 7f527b740800 1 -- start start 2024-09-13T23:05:37.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.476+0000 7f527b740800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a795bfb0 0x5559a795c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.476+0000 7f527b740800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5559a793b400 con 0x5559a795bfb0 2024-09-13T23:05:37.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.476+0000 7f5276cd0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a795bfb0 0x5559a795c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.476+0000 7f5276cd0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a795bfb0 0x5559a795c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58376/0 (socket says 172.21.15.164:58376) 2024-09-13T23:05:37.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.476+0000 7f5276cd0640 1 -- 172.21.15.164:0/4186026009 learned_addr learned my addr 172.21.15.164:0/4186026009 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.477+0000 7f5276cd0640 1 -- 172.21.15.164:0/4186026009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559a795c910 con 0x5559a795bfb0 2024-09-13T23:05:37.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.477+0000 7f5276cd0640 1 --2- 172.21.15.164:0/4186026009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a795bfb0 0x5559a795c3d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f526c045f50 tx=0x7f526c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.477+0000 7f5161602640 1 -- 172.21.15.164:0/4186026009 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f526c06f070 con 0x5559a795bfb0 2024-09-13T23:05:37.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.477+0000 7f5161602640 1 -- 172.21.15.164:0/4186026009 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f526c05f550 con 0x5559a795bfb0 2024-09-13T23:05:37.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.477+0000 7f5161602640 1 -- 172.21.15.164:0/4186026009 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f526c05f830 con 0x5559a795bfb0 2024-09-13T23:05:37.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.477+0000 7f527b740800 1 -- 172.21.15.164:0/4186026009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559a795cb40 con 0x5559a795bfb0 2024-09-13T23:05:37.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.477+0000 7f527b740800 1 -- 172.21.15.164:0/4186026009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559a795f7c0 con 0x5559a795bfb0 2024-09-13T23:05:37.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.478+0000 7f5161602640 1 -- 172.21.15.164:0/4186026009 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f526c05f9d0 con 0x5559a795bfb0 2024-09-13T23:05:37.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.478+0000 7f5161602640 1 --2- 172.21.15.164:0/4186026009 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5150036b90 0x7f5150039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.478+0000 7f5161602640 1 -- 172.21.15.164:0/4186026009 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f526c092d10 con 0x5559a795bfb0 2024-09-13T23:05:37.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.478+0000 7f5277cd2640 1 --2- 172.21.15.164:0/4186026009 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5150036b90 0x7f5150039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.478+0000 7f527b740800 1 Processor -- start 2024-09-13T23:05:37.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.478+0000 7f5277cd2640 1 --2- 172.21.15.164:0/4186026009 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5150036b90 0x7f5150039050 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x5559a794c270 tx=0x7f5270005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.478+0000 7f527b740800 1 -- start start 2024-09-13T23:05:37.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.478+0000 7f527b740800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a7968b50 0x5559a7968f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.478+0000 7f527b740800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5559a76e6580 con 0x5559a7968b50 2024-09-13T23:05:37.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.479+0000 7f5276cd0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a7968b50 0x5559a7968f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.479+0000 7f5276cd0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a7968b50 0x5559a7968f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58382/0 (socket says 172.21.15.164:58382) 2024-09-13T23:05:37.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.479+0000 7f5276cd0640 1 -- 172.21.15.164:0/2057282474 learned_addr learned my addr 172.21.15.164:0/2057282474 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.479+0000 7f5276cd0640 1 -- 172.21.15.164:0/2057282474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559a7969520 con 0x5559a7968b50 2024-09-13T23:05:37.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.479+0000 7f5276cd0640 1 --2- 172.21.15.164:0/2057282474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a7968b50 0x5559a7968f50 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f526c053da0 tx=0x7f526c091310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa0979b80021b11 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.479+0000 7f515affd640 1 -- 172.21.15.164:0/2057282474 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f526c080070 con 0x5559a7968b50 2024-09-13T23:05:37.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.479+0000 7f515affd640 1 -- 172.21.15.164:0/2057282474 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f526c08ce50 con 0x5559a7968b50 2024-09-13T23:05:37.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.479+0000 7f515affd640 1 -- 172.21.15.164:0/2057282474 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f526c06b540 con 0x5559a7968b50 2024-09-13T23:05:37.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.480+0000 7f527b740800 1 -- 172.21.15.164:0/2057282474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a7968b50 msgr2=0x5559a7968f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.480+0000 7f527b740800 1 --2- 172.21.15.164:0/2057282474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a7968b50 0x5559a7968f50 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f526c053da0 tx=0x7f526c091310 comp rx=0 tx=0).stop 2024-09-13T23:05:37.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.480+0000 7f527b740800 1 -- 172.21.15.164:0/2057282474 shutdown_connections 2024-09-13T23:05:37.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.480+0000 7f527b740800 1 --2- 172.21.15.164:0/2057282474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a7968b50 0x5559a7968f50 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.480+0000 7f527b740800 1 -- 172.21.15.164:0/2057282474 >> 172.21.15.164:0/2057282474 conn(0x5559a7964eb0 msgr2=0x5559a7962fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.480+0000 7f527b740800 1 -- 172.21.15.164:0/2057282474 shutdown_connections 2024-09-13T23:05:37.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.480+0000 7f527b740800 1 -- 172.21.15.164:0/2057282474 wait complete. 2024-09-13T23:05:37.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.480+0000 7f527b740800 1 Processor -- start 2024-09-13T23:05:37.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.480+0000 7f527b740800 1 -- start start 2024-09-13T23:05:37.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.480+0000 7f527b740800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a7968b50 0x5559a796fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.480+0000 7f527b740800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5559a7969a10 con 0x5559a7968b50 2024-09-13T23:05:37.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.480+0000 7f5276cd0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a7968b50 0x5559a796fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.480+0000 7f5276cd0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a7968b50 0x5559a796fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58384/0 (socket says 172.21.15.164:58384) 2024-09-13T23:05:37.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.480+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 learned_addr learned my addr 172.21.15.164:0/2890833193 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.481+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559a7970420 con 0x5559a7968b50 2024-09-13T23:05:37.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.481+0000 7f5276cd0640 1 --2- 172.21.15.164:0/2890833193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a7968b50 0x5559a796fee0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f526c053da0 tx=0x7f526c090fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.481+0000 7f51597fa640 1 -- 172.21.15.164:0/2890833193 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f526c05cca0 con 0x5559a7968b50 2024-09-13T23:05:37.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.481+0000 7f51597fa640 1 -- 172.21.15.164:0/2890833193 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f526c05ce40 con 0x5559a7968b50 2024-09-13T23:05:37.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.481+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559a79706b0 con 0x5559a7968b50 2024-09-13T23:05:37.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.481+0000 7f51597fa640 1 -- 172.21.15.164:0/2890833193 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f526c06a850 con 0x5559a7968b50 2024-09-13T23:05:37.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.481+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559a79706b0 con 0x5559a7968b50 2024-09-13T23:05:37.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.482+0000 7f51597fa640 1 -- 172.21.15.164:0/2890833193 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f526c083070 con 0x5559a7968b50 2024-09-13T23:05:37.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.482+0000 7f51597fa640 1 --2- 172.21.15.164:0/2890833193 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5140036b90 0x7f5140039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.482+0000 7f51597fa640 1 -- 172.21.15.164:0/2890833193 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f526c09cca0 con 0x5559a7968b50 2024-09-13T23:05:37.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.482+0000 7f5277cd2640 1 --2- 172.21.15.164:0/2890833193 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5140036b90 0x7f5140039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.483+0000 7f5277cd2640 1 --2- 172.21.15.164:0/2890833193 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5140036b90 0x7f5140039050 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x5559a793a570 tx=0x7f527001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.483+0000 7f527b740800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.483+0000 7f527b740800 1 --2- 172.21.15.164:0/2890833193 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5559a797b720 0x5559a797dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.483+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559a797e330 con 0x5559a797b720 2024-09-13T23:05:37.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.483+0000 7f52774d1640 1 --2- 172.21.15.164:0/2890833193 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5559a797b720 0x5559a797dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.483+0000 7f52774d1640 1 --2- 172.21.15.164:0/2890833193 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5559a797b720 0x5559a797dbe0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.483+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.483+0000 7f527b740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.483+0000 7f527b740800 20 realm 2024-09-13T23:05:37.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.483+0000 7f527b740800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.483+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559a797e740 con 0x5559a797b720 2024-09-13T23:05:37.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.484+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.484+0000 7f527b740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.484+0000 7f527b740800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:37.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.484+0000 7f527b740800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.484+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559a797f010 con 0x5559a797b720 2024-09-13T23:05:37.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.484+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.484+0000 7f527b740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.484+0000 7f527b740800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.484+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559a797f3b0 con 0x5559a797b720 2024-09-13T23:05:37.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.484+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.484+0000 7f527b740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:37.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.484+0000 7f527b740800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.484+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559a797fc00 con 0x5559a797b720 2024-09-13T23:05:37.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.484+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.484+0000 7f527b740800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:37.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.484+0000 7f527b740800 20 searching for the correct realm 2024-09-13T23:05:37.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.484+0000 7f527b740800 1 --2- 172.21.15.164:0/2890833193 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5559a7981970 0x5559a7983d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.484+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559a7984370 con 0x5559a7981970 2024-09-13T23:05:37.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.484+0000 7f5276cd0640 1 --2- 172.21.15.164:0/2890833193 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5559a7981970 0x5559a7983d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.485+0000 7f5276cd0640 1 --2- 172.21.15.164:0/2890833193 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5559a7981970 0x5559a7983d60 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.485+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.485+0000 7f5276cd0640 1 --2- 172.21.15.164:0/2890833193 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f526c085070 0x7f526c0a4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.485+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559a7984370 con 0x7f526c085070 2024-09-13T23:05:37.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.485+0000 7f5277cd2640 1 --2- 172.21.15.164:0/2890833193 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f526c085070 0x7f526c0a4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.485+0000 7f5277cd2640 1 --2- 172.21.15.164:0/2890833193 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f526c085070 0x7f526c0a4800 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.486+0000 7f5277cd2640 1 -- 172.21.15.164:0/2890833193 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f527001f070 con 0x7f526c085070 2024-09-13T23:05:37.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.486+0000 7f5277cd2640 1 --2- 172.21.15.164:0/2890833193 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f5270031040 0x7f5270032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.486+0000 7f5277cd2640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559a7984370 con 0x7f5270031040 2024-09-13T23:05:37.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.486+0000 7f52774d1640 1 --2- 172.21.15.164:0/2890833193 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f5270031040 0x7f5270032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.486+0000 7f52774d1640 1 --2- 172.21.15.164:0/2890833193 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f5270031040 0x7f5270032940 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.486+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5268018950 con 0x7f5270031040 2024-09-13T23:05:37.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.486+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559a7984370 con 0x5559a797b720 2024-09-13T23:05:37.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.487+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.487+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559a7984370 con 0x5559a797b720 2024-09-13T23:05:37.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.487+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.487+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559a7984370 con 0x7f5270031040 2024-09-13T23:05:37.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.487+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5268018950 con 0x7f5270031040 2024-09-13T23:05:37.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.487+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559a7984370 con 0x7f5270031040 2024-09-13T23:05:37.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.487+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5268018950 con 0x7f5270031040 2024-09-13T23:05:37.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.487+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559a7984370 con 0x7f526c085070 2024-09-13T23:05:37.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.487+0000 7f5277cd2640 1 -- 172.21.15.164:0/2890833193 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f527001f070 con 0x7f526c085070 2024-09-13T23:05:37.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.487+0000 7f5277cd2640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559a7984370 con 0x5559a7981970 2024-09-13T23:05:37.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.488+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.488+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559a7984370 con 0x5559a797b720 2024-09-13T23:05:37.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.488+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.488+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559a7984370 con 0x7f5270031040 2024-09-13T23:05:37.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.488+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5268018950 con 0x7f5270031040 2024-09-13T23:05:37.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.488+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559a7984370 con 0x5559a797b720 2024-09-13T23:05:37.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.488+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.488+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559a7984370 con 0x7f526c085070 2024-09-13T23:05:37.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.489+0000 7f5277cd2640 1 -- 172.21.15.164:0/2890833193 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f527001f070 con 0x7f526c085070 2024-09-13T23:05:37.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.489+0000 7f5277cd2640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559a7984370 con 0x5559a7981970 2024-09-13T23:05:37.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.489+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.489+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559a7984370 con 0x5559a7981970 2024-09-13T23:05:37.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.489+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.489+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559a7984370 con 0x7f5270031040 2024-09-13T23:05:37.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.489+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5268018950 con 0x7f5270031040 2024-09-13T23:05:37.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.489+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559a7984370 con 0x5559a7981970 2024-09-13T23:05:37.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.489+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.489+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559a7984370 con 0x5559a7981970 2024-09-13T23:05:37.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.490+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.490+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559a7984370 con 0x5559a797b720 2024-09-13T23:05:37.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.490+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.490+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559a7984370 con 0x5559a797b720 2024-09-13T23:05:37.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.490+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.490+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559a7984370 con 0x7f5270031040 2024-09-13T23:05:37.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.490+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5268018950 con 0x7f5270031040 2024-09-13T23:05:37.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.490+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559a7984370 con 0x5559a7981970 2024-09-13T23:05:37.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.490+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.490+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559a7984370 con 0x7f526c085070 2024-09-13T23:05:37.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.491+0000 7f5277cd2640 1 -- 172.21.15.164:0/2890833193 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f527001f070 con 0x7f526c085070 2024-09-13T23:05:37.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.491+0000 7f5277cd2640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559a7984370 con 0x5559a797b720 2024-09-13T23:05:37.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.491+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.491+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559a7984370 con 0x7f5270031040 2024-09-13T23:05:37.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.491+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5268018950 con 0x7f5270031040 2024-09-13T23:05:37.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.491+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559a7984370 con 0x5559a7981970 2024-09-13T23:05:37.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.491+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.491+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5559a7984370 con 0x7f5270031040 2024-09-13T23:05:37.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.492+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5268018950 con 0x7f5270031040 2024-09-13T23:05:37.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.492+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5268055040 con 0x7f526c085070 2024-09-13T23:05:37.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.492+0000 7f5277cd2640 1 -- 172.21.15.164:0/2890833193 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f527001f070 con 0x7f526c085070 2024-09-13T23:05:37.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.492+0000 7f5277cd2640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5268055040 con 0x5559a7981970 2024-09-13T23:05:37.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.492+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.492+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5268055040 con 0x7f5270031040 2024-09-13T23:05:37.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.492+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5268018950 con 0x7f5270031040 2024-09-13T23:05:37.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.492+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5268055040 con 0x5559a797b720 2024-09-13T23:05:37.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.493+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.493+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5268055040 con 0x7f526c085070 2024-09-13T23:05:37.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.493+0000 7f5277cd2640 1 -- 172.21.15.164:0/2890833193 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f527001f070 con 0x7f526c085070 2024-09-13T23:05:37.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.493+0000 7f527b740800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:37.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.493+0000 7f527b740800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:37.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.493+0000 7f527b740800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:37.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.493+0000 7f527b740800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:37.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.493+0000 7f527b740800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:37.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.493+0000 7f527b740800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:37.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.493+0000 7f527b740800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.493+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559a7980580 con 0x5559a797b720 2024-09-13T23:05:37.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.493+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.493+0000 7f527b740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.493+0000 7f527b740800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.493+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559a7980e20 con 0x5559a797b720 2024-09-13T23:05:37.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.493+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.493+0000 7f527b740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:37.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.493+0000 7f527b740800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.494+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559a7980e20 con 0x5559a797b720 2024-09-13T23:05:37.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.494+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.494+0000 7f527b740800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:37.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.494+0000 7f527b740800 20 zone default found 2024-09-13T23:05:37.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.494+0000 7f527b740800 4 Realm: () 2024-09-13T23:05:37.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.494+0000 7f527b740800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:37.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.494+0000 7f527b740800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:37.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.494+0000 7f527b740800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:37.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.494+0000 7f527b740800 20 zonegroup default 2024-09-13T23:05:37.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.494+0000 7f527b740800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.494+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559a79847f0 con 0x7f5270031040 2024-09-13T23:05:37.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.494+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5268018950 con 0x7f5270031040 2024-09-13T23:05:37.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.494+0000 7f527b740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.494+0000 7f527b740800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.494+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559a7986200 con 0x5559a7981970 2024-09-13T23:05:37.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.494+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.494+0000 7f527b740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.494+0000 7f527b740800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.494+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559a7986af0 con 0x5559a7981970 2024-09-13T23:05:37.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.494+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.495+0000 7f527b740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.495+0000 7f527b740800 20 started sync module instance, tier type = 2024-09-13T23:05:37.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.495+0000 7f527b740800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:37.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.495+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7985670 con 0x7f526c085070 2024-09-13T23:05:37.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.496+0000 7f5277cd2640 1 -- 172.21.15.164:0/2890833193 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5270040040 con 0x7f526c085070 2024-09-13T23:05:37.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.496+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93843552227776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7986e90 con 0x7f526c085070 2024-09-13T23:05:37.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.496+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a79876e0 con 0x5559a797b720 2024-09-13T23:05:37.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.497+0000 7f5277cd2640 1 -- 172.21.15.164:0/2890833193 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93843552227776] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5270040040 con 0x7f526c085070 2024-09-13T23:05:37.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.497+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.497+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93843552235152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7987760 con 0x5559a797b720 2024-09-13T23:05:37.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.497+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7988120 con 0x5559a7981970 2024-09-13T23:05:37.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.498+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93843552235152] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.498+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.498+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93843552236208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a79876d0 con 0x5559a7981970 2024-09-13T23:05:37.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.498+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7988f90 con 0x7f526c085070 2024-09-13T23:05:37.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.499+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93843552236208] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.499+0000 7f5277cd2640 1 -- 172.21.15.164:0/2890833193 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5270040040 con 0x7f526c085070 2024-09-13T23:05:37.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.499+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93843552242400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a79893b0 con 0x7f526c085070 2024-09-13T23:05:37.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.499+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7989d70 con 0x5559a797b720 2024-09-13T23:05:37.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.500+0000 7f5277cd2640 1 -- 172.21.15.164:0/2890833193 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93843552242400] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5270040040 con 0x7f526c085070 2024-09-13T23:05:37.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.500+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.500+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93843552243936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7989d70 con 0x5559a797b720 2024-09-13T23:05:37.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.501+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a798a770 con 0x7f5270031040 2024-09-13T23:05:37.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.502+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5268018950 con 0x7f5270031040 2024-09-13T23:05:37.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.502+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93843552248448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a798a6a0 con 0x7f5270031040 2024-09-13T23:05:37.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.502+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93843552243936] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.502+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a79898c0 con 0x7f5270031040 2024-09-13T23:05:37.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.502+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93843552248448] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5268018950 con 0x7f5270031040 2024-09-13T23:05:37.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.503+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5268018950 con 0x7f5270031040 2024-09-13T23:05:37.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.503+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93843552252336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a798ab60 con 0x7f5270031040 2024-09-13T23:05:37.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.503+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a798bb30 con 0x7f5270031040 2024-09-13T23:05:37.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.504+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93843552252336] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5268018950 con 0x7f5270031040 2024-09-13T23:05:37.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.504+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5268018950 con 0x7f5270031040 2024-09-13T23:05:37.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.504+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93843552245952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a798bb30 con 0x7f5270031040 2024-09-13T23:05:37.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.504+0000 7f527b740800 20 add_watcher() i=0 2024-09-13T23:05:37.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.504+0000 7f527b740800 20 add_watcher() i=1 2024-09-13T23:05:37.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.504+0000 7f527b740800 20 add_watcher() i=2 2024-09-13T23:05:37.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.504+0000 7f527b740800 20 add_watcher() i=3 2024-09-13T23:05:37.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.504+0000 7f527b740800 20 add_watcher() i=4 2024-09-13T23:05:37.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.504+0000 7f527b740800 20 add_watcher() i=5 2024-09-13T23:05:37.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.504+0000 7f527b740800 20 add_watcher() i=6 2024-09-13T23:05:37.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.505+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93843552245952] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5268018950 con 0x7f5270031040 2024-09-13T23:05:37.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.505+0000 7f527b740800 20 add_watcher() i=7 2024-09-13T23:05:37.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.505+0000 7f527b740800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:37.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.505+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559a798ef50 con 0x5559a797b720 2024-09-13T23:05:37.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.505+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.505+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93843552254032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a798c450 con 0x5559a797b720 2024-09-13T23:05:37.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.506+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93843552254032] v32'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.506+0000 7f512dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:37.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.506+0000 7f527b740800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:37.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.506+0000 7f527b740800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:37.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.506+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a798ed70 con 0x5559a797b720 2024-09-13T23:05:37.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.507+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.507+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7998060 con 0x7f5270031040 2024-09-13T23:05:37.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.508+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5268018950 con 0x7f5270031040 2024-09-13T23:05:37.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.508+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7998060 con 0x5559a7981970 2024-09-13T23:05:37.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.509+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.509+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7998440 con 0x5559a797b720 2024-09-13T23:05:37.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.510+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'140 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.510+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7998420 con 0x7f526c085070 2024-09-13T23:05:37.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.511+0000 7f5277cd2640 1 -- 172.21.15.164:0/2890833193 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'41 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5270040040 con 0x7f526c085070 2024-09-13T23:05:37.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.511+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a79989b0 con 0x5559a7981970 2024-09-13T23:05:37.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.512+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'27 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.512+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a79989b0 con 0x5559a797b720 2024-09-13T23:05:37.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.513+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.513+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a79989b0 con 0x7f5270031040 2024-09-13T23:05:37.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.514+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'27 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5268018950 con 0x7f5270031040 2024-09-13T23:05:37.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.514+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a79989b0 con 0x7f526c085070 2024-09-13T23:05:37.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.515+0000 7f5277cd2640 1 -- 172.21.15.164:0/2890833193 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5270040040 con 0x7f526c085070 2024-09-13T23:05:37.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.515+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7999080 con 0x5559a7981970 2024-09-13T23:05:37.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.516+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.516+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7999080 con 0x7f526c085070 2024-09-13T23:05:37.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.517+0000 7f5277cd2640 1 -- 172.21.15.164:0/2890833193 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'42 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5270040040 con 0x7f526c085070 2024-09-13T23:05:37.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.517+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a79995f0 con 0x7f5270031040 2024-09-13T23:05:37.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.518+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5268018950 con 0x7f5270031040 2024-09-13T23:05:37.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.518+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7999680 con 0x7f526c085070 2024-09-13T23:05:37.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.519+0000 7f5277cd2640 1 -- 172.21.15.164:0/2890833193 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5270040040 con 0x7f526c085070 2024-09-13T23:05:37.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.519+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7999a40 con 0x7f5270031040 2024-09-13T23:05:37.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.520+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'33 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5268018950 con 0x7f5270031040 2024-09-13T23:05:37.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.520+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7999a40 con 0x5559a797b720 2024-09-13T23:05:37.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.521+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'141 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.521+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7999a40 con 0x5559a7981970 2024-09-13T23:05:37.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.522+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'35 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.522+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7999a40 con 0x7f526c085070 2024-09-13T23:05:37.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.523+0000 7f5277cd2640 1 -- 172.21.15.164:0/2890833193 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'43 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5270040040 con 0x7f526c085070 2024-09-13T23:05:37.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.523+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7999a40 con 0x5559a7981970 2024-09-13T23:05:37.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.524+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.524+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7999a40 con 0x5559a797b720 2024-09-13T23:05:37.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.525+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.525+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7999a40 con 0x5559a797b720 2024-09-13T23:05:37.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.527+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'142 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.527+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7999a40 con 0x5559a7981970 2024-09-13T23:05:37.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.527+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'36 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.528+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7999a40 con 0x7f526c085070 2024-09-13T23:05:37.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.529+0000 7f5277cd2640 1 -- 172.21.15.164:0/2890833193 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'27 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5270040040 con 0x7f526c085070 2024-09-13T23:05:37.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.529+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7999a40 con 0x5559a7981970 2024-09-13T23:05:37.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.530+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.530+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7999a40 con 0x5559a7981970 2024-09-13T23:05:37.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.531+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.531+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7999a40 con 0x5559a7981970 2024-09-13T23:05:37.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.532+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.532+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7999a40 con 0x5559a7981970 2024-09-13T23:05:37.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.533+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.533+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7999a40 con 0x7f5270031040 2024-09-13T23:05:37.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.534+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5268018950 con 0x7f5270031040 2024-09-13T23:05:37.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.534+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7999a40 con 0x5559a7981970 2024-09-13T23:05:37.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.535+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.535+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7999a40 con 0x7f5270031040 2024-09-13T23:05:37.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.536+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5268018950 con 0x7f5270031040 2024-09-13T23:05:37.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.536+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7999a40 con 0x5559a7981970 2024-09-13T23:05:37.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.537+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.537+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7999a40 con 0x7f5270031040 2024-09-13T23:05:37.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.538+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'34 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5268018950 con 0x7f5270031040 2024-09-13T23:05:37.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.538+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a7999a40 con 0x7f526c085070 2024-09-13T23:05:37.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.539+0000 7f5277cd2640 1 -- 172.21.15.164:0/2890833193 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5270040040 con 0x7f526c085070 2024-09-13T23:05:37.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.540+0000 7f512cfe1640 20 reqs_thread_entry: start 2024-09-13T23:05:37.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.540+0000 7f527b740800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:37.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.540+0000 7f527b740800 20 Filter name: none 2024-09-13T23:05:37.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.540+0000 7f50a67fc640 20 reqs_thread_entry: start 2024-09-13T23:05:37.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.540+0000 7f527b740800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:05:37.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.540+0000 7f527b740800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.540+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559a79c49c0 con 0x7f526c085070 2024-09-13T23:05:37.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.540+0000 7f5277cd2640 1 -- 172.21.15.164:0/2890833193 <== osd.2 v2:172.21.15.164:6808/3795914978 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5270040040 con 0x7f526c085070 2024-09-13T23:05:37.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.540+0000 7f527b740800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:05:37.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.540+0000 7f527b740800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:05:37.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.540+0000 7f527b740800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:05:37.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.540+0000 7f527b740800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 : miss 2024-09-13T23:05:37.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.540+0000 7f527b740800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.540+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:95 8.15 8:aa4f46c1:root::.bucket.meta.myfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559a79c6440 con 0x5559a7981970 2024-09-13T23:05:37.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.541+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 26 ==== osd_op_reply(95 .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.541+0000 7f527b740800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:05:37.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.541+0000 7f527b740800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 info.flags=0x17 2024-09-13T23:05:37.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.541+0000 7f527b740800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 to cache LRU end 2024-09-13T23:05:37.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.541+0000 7f527b740800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:37.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.541+0000 7f527b740800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:05:37.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.541+0000 7f527b740800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 2024-09-13T23:05:37.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.541+0000 7f527b740800 20 get_obj_state: octx=0x7f5268016e90 obj=myfoo:four state=0x5559a79c7728 s->prefetch_data=0 2024-09-13T23:05:37.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.541+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:96 3.0s0 3:03e9790e:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559a79c8550 con 0x7f5270031040 2024-09-13T23:05:37.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.541+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(96 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1_four [getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+865 (crc 0 0 0) 0x7f5268018950 con 0x7f5270031040 2024-09-13T23:05:37.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.541+0000 7f527b740800 10 manifest: total_size = 4 2024-09-13T23:05:37.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.541+0000 7f527b740800 20 get_obj_state: setting s->obj_tag to a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.6379246011987472293 2024-09-13T23:05:37.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.541+0000 7f527b740800 20 get_obj_state: octx=0x7f5268016e90 obj=myfoo:four state=0x5559a79c7728 s->prefetch_data=0 2024-09-13T23:05:37.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.541+0000 7f527b740800 20 prepare_atomic_modification: state is not atomic. state=0x5559a79c7728 2024-09-13T23:05:37.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.541+0000 7f527b740800 20 bucket index object: :.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.6 2024-09-13T23:05:37.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.541+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:97 4.30 4:0d33cc25:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a79cce90 con 0x5559a7981970 2024-09-13T23:05:37.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.542+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 27 ==== osd_op_reply(97 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.6 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.542+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:98 3.0s0 3:03e9790e:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a79cce90 con 0x7f5270031040 2024-09-13T23:05:37.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.544+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(98 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1_four [call] v32'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7f5268018950 con 0x7f5270031040 2024-09-13T23:05:37.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.544+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:99 4.30 4:0d33cc25:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a79cd920 con 0x5559a7981970 2024-09-13T23:05:37.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.545+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 28 ==== osd_op_reply(99 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.6 [stat,call,call] v32'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.545+0000 7f515affd640 20 handle_completion(): completion ok for obj=four 2024-09-13T23:05:37.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.545+0000 7f512dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:37.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.545+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93843552254032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a79cd920 con 0x5559a797b720 2024-09-13T23:05:37.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.546+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 93843552254032] v32'143 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.546+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93843552227776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a79cd920 con 0x7f526c085070 2024-09-13T23:05:37.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.547+0000 7f5277cd2640 1 -- 172.21.15.164:0/2890833193 <== osd.2 v2:172.21.15.164:6808/3795914978 19 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 93843552227776] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5270040040 con 0x7f526c085070 2024-09-13T23:05:37.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.547+0000 7f527b740800 20 remove_watcher() i=0 2024-09-13T23:05:37.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.547+0000 7f527b740800 2 removed watcher, disabling cache 2024-09-13T23:05:37.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.547+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93843552235152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a79851c0 con 0x5559a797b720 2024-09-13T23:05:37.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.548+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 93843552235152] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.548+0000 7f527b740800 20 remove_watcher() i=1 2024-09-13T23:05:37.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.548+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93843552236208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a79851c0 con 0x5559a7981970 2024-09-13T23:05:37.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.549+0000 7f5276cd0640 1 -- 172.21.15.164:0/2890833193 <== osd.3 v2:172.21.15.164:6816/93809510 29 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 93843552236208] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f526c082030 con 0x5559a7981970 2024-09-13T23:05:37.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.549+0000 7f527b740800 20 remove_watcher() i=2 2024-09-13T23:05:37.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.549+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93843552242400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a79851c0 con 0x7f526c085070 2024-09-13T23:05:37.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.550+0000 7f5277cd2640 1 -- 172.21.15.164:0/2890833193 <== osd.2 v2:172.21.15.164:6808/3795914978 20 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 93843552242400] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5270040040 con 0x7f526c085070 2024-09-13T23:05:37.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.550+0000 7f527b740800 20 remove_watcher() i=3 2024-09-13T23:05:37.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.550+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93843552243936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a79851c0 con 0x5559a797b720 2024-09-13T23:05:37.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.551+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 93843552243936] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5268018950 con 0x5559a797b720 2024-09-13T23:05:37.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.551+0000 7f527b740800 20 remove_watcher() i=4 2024-09-13T23:05:37.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.551+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93843552248448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a79890e0 con 0x7f5270031040 2024-09-13T23:05:37.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.552+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 93843552248448] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5268018950 con 0x7f5270031040 2024-09-13T23:05:37.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.552+0000 7f527b740800 20 remove_watcher() i=5 2024-09-13T23:05:37.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.552+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93843552252336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a79851c0 con 0x7f5270031040 2024-09-13T23:05:37.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.554+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.0 v2:172.21.15.17:6800/489863589 27 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 93843552252336] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5268018950 con 0x7f5270031040 2024-09-13T23:05:37.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.554+0000 7f527b740800 20 remove_watcher() i=6 2024-09-13T23:05:37.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.554+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93843552245952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5559a798a280 con 0x7f5270031040 2024-09-13T23:05:37.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 <== osd.0 v2:172.21.15.17:6800/489863589 28 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 93843552245952] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5268018950 con 0x7f5270031040 2024-09-13T23:05:37.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f527b740800 20 remove_watcher() i=7 2024-09-13T23:05:37.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f5270031040 msgr2=0x7f5270032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f527b740800 1 --2- 172.21.15.164:0/2890833193 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f5270031040 0x7f5270032940 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5559a797b720 msgr2=0x5559a797dbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f527b740800 1 --2- 172.21.15.164:0/2890833193 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5559a797b720 0x5559a797dbe0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f526c085070 msgr2=0x7f526c0a4800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f527b740800 1 --2- 172.21.15.164:0/2890833193 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f526c085070 0x7f526c0a4800 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5559a7981970 msgr2=0x5559a7983d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f527b740800 1 --2- 172.21.15.164:0/2890833193 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5559a7981970 0x5559a7983d60 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5140036b90 msgr2=0x7f5140039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f527b740800 1 --2- 172.21.15.164:0/2890833193 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5140036b90 0x7f5140039050 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x5559a793a570 tx=0x7f527001f000 comp rx=0 tx=0).stop 2024-09-13T23:05:37.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a7968b50 msgr2=0x5559a796fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f52774d1640 1 -- 172.21.15.164:0/2890833193 reap_dead start 2024-09-13T23:05:37.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f527b740800 1 --2- 172.21.15.164:0/2890833193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a7968b50 0x5559a796fee0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f526c053da0 tx=0x7f526c090fd0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 shutdown_connections 2024-09-13T23:05:37.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f527b740800 1 --2- 172.21.15.164:0/2890833193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a7968b50 0x5559a796fee0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 >> 172.21.15.164:0/2890833193 conn(0x5559a7964eb0 msgr2=0x5559a7962f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 shutdown_connections 2024-09-13T23:05:37.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f527b740800 1 -- 172.21.15.164:0/2890833193 wait complete. 2024-09-13T23:05:37.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f527b740800 1 -- 172.21.15.164:0/4186026009 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5150036b90 msgr2=0x7f5150039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f527b740800 1 --2- 172.21.15.164:0/4186026009 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5150036b90 0x7f5150039050 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x5559a794c270 tx=0x7f5270005840 comp rx=0 tx=0).stop 2024-09-13T23:05:37.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f527b740800 1 -- 172.21.15.164:0/4186026009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a795bfb0 msgr2=0x5559a795c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f527b740800 1 --2- 172.21.15.164:0/4186026009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a795bfb0 0x5559a795c3d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f526c045f50 tx=0x7f526c002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f527b740800 1 -- 172.21.15.164:0/4186026009 shutdown_connections 2024-09-13T23:05:37.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f527b740800 1 --2- 172.21.15.164:0/4186026009 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5150036b90 0x7f5150039050 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f527b740800 1 --2- 172.21.15.164:0/4186026009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a795bfb0 0x5559a795c3d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f527b740800 1 -- 172.21.15.164:0/4186026009 >> 172.21.15.164:0/4186026009 conn(0x5559a7950f40 msgr2=0x5559a7953ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f527b740800 1 -- 172.21.15.164:0/4186026009 shutdown_connections 2024-09-13T23:05:37.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.555+0000 7f527b740800 1 -- 172.21.15.164:0/4186026009 wait complete. 2024-09-13T23:05:37.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.556+0000 7f527b740800 1 -- 172.21.15.164:0/1352749649 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5559a784e920 msgr2=0x5559a794b630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.556+0000 7f527b740800 1 --2- 172.21.15.164:0/1352749649 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5559a784e920 0x5559a794b630 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.556+0000 7f527b740800 1 -- 172.21.15.164:0/1352749649 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f515c036b90 msgr2=0x7f515c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.556+0000 7f527b740800 1 --2- 172.21.15.164:0/1352749649 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f515c036b90 0x7f515c039050 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f526c057000 tx=0x7f526c052000 comp rx=0 tx=0).stop 2024-09-13T23:05:37.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.556+0000 7f527b740800 1 -- 172.21.15.164:0/1352749649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a784a4e0 msgr2=0x5559a793aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.556+0000 7f527b740800 1 --2- 172.21.15.164:0/1352749649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a784a4e0 0x5559a793aec0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f526800b7c0 tx=0x7f5268000ed0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.556+0000 7f527b740800 1 -- 172.21.15.164:0/1352749649 shutdown_connections 2024-09-13T23:05:37.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.556+0000 7f527b740800 1 --2- 172.21.15.164:0/1352749649 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5559a784e920 0x5559a794b630 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.556+0000 7f527b740800 1 --2- 172.21.15.164:0/1352749649 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f515c036b90 0x7f515c039050 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.556+0000 7f527b740800 1 --2- 172.21.15.164:0/1352749649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559a784a4e0 0x5559a793aec0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.556+0000 7f527b740800 1 -- 172.21.15.164:0/1352749649 >> 172.21.15.164:0/1352749649 conn(0x5559a7845db0 msgr2=0x5559a7933a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.556+0000 7f527b740800 1 -- 172.21.15.164:0/1352749649 shutdown_connections 2024-09-13T23:05:37.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.556+0000 7f527b740800 1 -- 172.21.15.164:0/1352749649 wait complete. 2024-09-13T23:05:37.566 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T23:05:37.566 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T23:05:37.566 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-13T23:05:37.610 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:37.610 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:37.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.610+0000 7f7f58f42800 1 Processor -- start 2024-09-13T23:05:37.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.610+0000 7f7f58f42800 1 -- start start 2024-09-13T23:05:37.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.610+0000 7f7f58f42800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x559d3543ddb0 0x559d354401a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.610+0000 7f7f58f42800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559d352f6b30 con 0x559d353ab5f0 2024-09-13T23:05:37.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.610+0000 7f7f58f42800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x559d352d8360 con 0x559d3543ddb0 2024-09-13T23:05:37.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.610+0000 7f7f4ffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x559d3543ddb0 0x559d354401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.610+0000 7f7f54c97640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x559d353ab5f0 0x559d3543c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:41094/0 (socket says 172.21.15.164:41094) 2024-09-13T23:05:37.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.610+0000 7f7f54c97640 1 -- 172.21.15.164:0/1787155296 learned_addr learned my addr 172.21.15.164:0/1787155296 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:37.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.610+0000 7f7f4ffff640 1 -- 172.21.15.164:0/1787155296 >> v1:172.21.15.17:6789/0 conn(0x559d353ab5f0 legacy=0x559d3543c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.610+0000 7f7f4ffff640 1 -- 172.21.15.164:0/1787155296 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d352fee00 con 0x559d3543ddb0 2024-09-13T23:05:37.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.612+0000 7f7f4ffff640 1 --2- 172.21.15.164:0/1787155296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d3543ddb0 0x559d354401a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7f4000a470 tx=0x7f7f40045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eca4ce5cbd543e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.612+0000 7f7f4f7fe640 1 -- 172.21.15.164:0/1787155296 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f40053570 con 0x559d3543ddb0 2024-09-13T23:05:37.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.612+0000 7f7f4f7fe640 1 -- 172.21.15.164:0/1787155296 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f40058070 con 0x559d3543ddb0 2024-09-13T23:05:37.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.612+0000 7f7f4f7fe640 1 -- 172.21.15.164:0/1787155296 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f40053880 con 0x559d3543ddb0 2024-09-13T23:05:37.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.613+0000 7f7f58f42800 1 -- 172.21.15.164:0/1787155296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d3543ddb0 msgr2=0x559d354401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.613+0000 7f7f58f42800 1 --2- 172.21.15.164:0/1787155296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d3543ddb0 0x559d354401a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7f4000a470 tx=0x7f7f40045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:37.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.613+0000 7f7f58f42800 1 -- 172.21.15.164:0/1787155296 shutdown_connections 2024-09-13T23:05:37.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.613+0000 7f7f58f42800 1 --2- 172.21.15.164:0/1787155296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d3543ddb0 0x559d354401a0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.613+0000 7f7f58f42800 1 -- 172.21.15.164:0/1787155296 >> 172.21.15.164:0/1787155296 conn(0x559d35431de0 msgr2=0x559d35434200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.613+0000 7f7f58f42800 1 -- 172.21.15.164:0/1787155296 shutdown_connections 2024-09-13T23:05:37.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.613+0000 7f7f58f42800 1 -- 172.21.15.164:0/1787155296 wait complete. 2024-09-13T23:05:37.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.627+0000 7f7f58f42800 1 Processor -- start 2024-09-13T23:05:37.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.627+0000 7f7f58f42800 1 -- start start 2024-09-13T23:05:37.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.627+0000 7f7f58f42800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d353ab5f0 0x559d35528a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.627+0000 7f7f58f42800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559d35383330 con 0x559d353ab5f0 2024-09-13T23:05:37.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.628+0000 7f7f54c97640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d353ab5f0 0x559d35528a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.628+0000 7f7f54c97640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d353ab5f0 0x559d35528a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58406/0 (socket says 172.21.15.164:58406) 2024-09-13T23:05:37.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.628+0000 7f7f54c97640 1 -- 172.21.15.164:0/3726806123 learned_addr learned my addr 172.21.15.164:0/3726806123 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.628+0000 7f7f54c97640 1 -- 172.21.15.164:0/3726806123 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d352d0bc0 con 0x559d353ab5f0 2024-09-13T23:05:37.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.628+0000 7f7f54c97640 1 --2- 172.21.15.164:0/3726806123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d353ab5f0 0x559d35528a80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7f48001e10 tx=0x7f7f4800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1590abbdc3b436b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.628+0000 7f7e42e05640 1 -- 172.21.15.164:0/3726806123 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f48012020 con 0x559d353ab5f0 2024-09-13T23:05:37.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.628+0000 7f7e42e05640 1 -- 172.21.15.164:0/3726806123 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f4800e5a0 con 0x559d353ab5f0 2024-09-13T23:05:37.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.628+0000 7f7e42e05640 1 -- 172.21.15.164:0/3726806123 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f4800e8e0 con 0x559d353ab5f0 2024-09-13T23:05:37.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.629+0000 7f7f58f42800 1 -- 172.21.15.164:0/3726806123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d353ab5f0 msgr2=0x559d35528a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.629+0000 7f7f58f42800 1 --2- 172.21.15.164:0/3726806123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d353ab5f0 0x559d35528a80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7f48001e10 tx=0x7f7f4800b780 comp rx=0 tx=0).stop 2024-09-13T23:05:37.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.629+0000 7f7f58f42800 1 -- 172.21.15.164:0/3726806123 shutdown_connections 2024-09-13T23:05:37.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.629+0000 7f7f58f42800 1 --2- 172.21.15.164:0/3726806123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d353ab5f0 0x559d35528a80 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.629+0000 7f7f58f42800 1 -- 172.21.15.164:0/3726806123 >> 172.21.15.164:0/3726806123 conn(0x559d35431de0 msgr2=0x559d35524440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.629+0000 7f7f58f42800 1 -- 172.21.15.164:0/3726806123 shutdown_connections 2024-09-13T23:05:37.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.629+0000 7f7f58f42800 1 -- 172.21.15.164:0/3726806123 wait complete. 2024-09-13T23:05:37.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.629+0000 7f7f58f42800 1 Processor -- start 2024-09-13T23:05:37.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.630+0000 7f7f58f42800 1 -- start start 2024-09-13T23:05:37.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.630+0000 7f7f58f42800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d353ab5f0 0x559d35530480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.630+0000 7f7f58f42800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559d35440980 con 0x559d353ab5f0 2024-09-13T23:05:37.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.630+0000 7f7f54c97640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d353ab5f0 0x559d35530480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.630+0000 7f7f54c97640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d353ab5f0 0x559d35530480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58412/0 (socket says 172.21.15.164:58412) 2024-09-13T23:05:37.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.630+0000 7f7f54c97640 1 -- 172.21.15.164:0/34744330 learned_addr learned my addr 172.21.15.164:0/34744330 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.630+0000 7f7f54c97640 1 -- 172.21.15.164:0/34744330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d352e4fe0 con 0x559d353ab5f0 2024-09-13T23:05:37.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.630+0000 7f7f54c97640 1 --2- 172.21.15.164:0/34744330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d353ab5f0 0x559d35530480 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7f4800b7c0 tx=0x7f7f48000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.631+0000 7f7e41602640 1 -- 172.21.15.164:0/34744330 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f48012030 con 0x559d353ab5f0 2024-09-13T23:05:37.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.631+0000 7f7e41602640 1 -- 172.21.15.164:0/34744330 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f48001470 con 0x559d353ab5f0 2024-09-13T23:05:37.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.631+0000 7f7f58f42800 1 -- 172.21.15.164:0/34744330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d355309c0 con 0x559d353ab5f0 2024-09-13T23:05:37.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.631+0000 7f7e41602640 1 -- 172.21.15.164:0/34744330 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f4801a8d0 con 0x559d353ab5f0 2024-09-13T23:05:37.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.631+0000 7f7f58f42800 1 -- 172.21.15.164:0/34744330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d35530ee0 con 0x559d353ab5f0 2024-09-13T23:05:37.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.632+0000 7f7e41602640 1 -- 172.21.15.164:0/34744330 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7f48015020 con 0x559d353ab5f0 2024-09-13T23:05:37.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.632+0000 7f7e41602640 1 --2- 172.21.15.164:0/34744330 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7e3c036b90 0x7f7e3c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.632+0000 7f7e41602640 1 -- 172.21.15.164:0/34744330 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7f48020030 con 0x559d353ab5f0 2024-09-13T23:05:37.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.632+0000 7f7f4ffff640 1 --2- 172.21.15.164:0/34744330 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7e3c036b90 0x7f7e3c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.632+0000 7f7f58f42800 1 --2- 172.21.15.164:0/34744330 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559d3543ddb0 0x559d355374f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.632+0000 7f7f58f42800 1 -- 172.21.15.164:0/34744330 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d35537a70 con 0x559d3543ddb0 2024-09-13T23:05:37.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.632+0000 7f7f55498640 1 --2- 172.21.15.164:0/34744330 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559d3543ddb0 0x559d355374f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.632+0000 7f7f4ffff640 1 --2- 172.21.15.164:0/34744330 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7e3c036b90 0x7f7e3c039050 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7f40057000 tx=0x7f7f40052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.632+0000 7f7f55498640 1 --2- 172.21.15.164:0/34744330 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559d3543ddb0 0x559d355374f0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.633+0000 7f7f55498640 1 -- 172.21.15.164:0/34744330 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7f5000a4a0 con 0x559d3543ddb0 2024-09-13T23:05:37.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.633+0000 7f7f58f42800 1 -- 172.21.15.164:0/34744330 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d35534aa0 con 0x559d3543ddb0 2024-09-13T23:05:37.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.633+0000 7f7f55498640 1 -- 172.21.15.164:0/34744330 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7f5000a4a0 con 0x559d3543ddb0 2024-09-13T23:05:37.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.633+0000 7f7f58f42800 1 -- 172.21.15.164:0/34744330 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d35539870 con 0x559d3543ddb0 2024-09-13T23:05:37.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.633+0000 7f7f55498640 1 -- 172.21.15.164:0/34744330 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7f5000a4a0 con 0x559d3543ddb0 2024-09-13T23:05:37.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.633+0000 7f7f58f42800 1 -- 172.21.15.164:0/34744330 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d355389b0 con 0x559d3543ddb0 2024-09-13T23:05:37.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.633+0000 7f7f55498640 1 -- 172.21.15.164:0/34744330 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7f5000a4a0 con 0x559d3543ddb0 2024-09-13T23:05:37.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.633+0000 7f7f58f42800 1 -- 172.21.15.164:0/34744330 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d35538dd0 con 0x559d3543ddb0 2024-09-13T23:05:37.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.634+0000 7f7f55498640 1 -- 172.21.15.164:0/34744330 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7f5000a4a0 con 0x559d3543ddb0 2024-09-13T23:05:37.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.634+0000 7f7f58f42800 1 Processor -- start 2024-09-13T23:05:37.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.634+0000 7f7f58f42800 1 -- start start 2024-09-13T23:05:37.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.634+0000 7f7f58f42800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d35547ea0 0x559d355482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.634+0000 7f7f58f42800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559d352d2580 con 0x559d35547ea0 2024-09-13T23:05:37.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.635+0000 7f7f4ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d35547ea0 0x559d355482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.635+0000 7f7f4ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d35547ea0 0x559d355482c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58426/0 (socket says 172.21.15.164:58426) 2024-09-13T23:05:37.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.635+0000 7f7f4ffff640 1 -- 172.21.15.164:0/205555312 learned_addr learned my addr 172.21.15.164:0/205555312 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.635+0000 7f7f4ffff640 1 -- 172.21.15.164:0/205555312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d35548800 con 0x559d35547ea0 2024-09-13T23:05:37.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.635+0000 7f7f4ffff640 1 --2- 172.21.15.164:0/205555312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d35547ea0 0x559d355482c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7f40045f50 tx=0x7f7f40002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.635+0000 7f7e3a7fc640 1 -- 172.21.15.164:0/205555312 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f4006f070 con 0x559d35547ea0 2024-09-13T23:05:37.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.635+0000 7f7e3a7fc640 1 -- 172.21.15.164:0/205555312 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f4005f550 con 0x559d35547ea0 2024-09-13T23:05:37.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.635+0000 7f7f58f42800 1 -- 172.21.15.164:0/205555312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d35548a30 con 0x559d35547ea0 2024-09-13T23:05:37.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.635+0000 7f7e3a7fc640 1 -- 172.21.15.164:0/205555312 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f4005f830 con 0x559d35547ea0 2024-09-13T23:05:37.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.635+0000 7f7f58f42800 1 -- 172.21.15.164:0/205555312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d3554b6b0 con 0x559d35547ea0 2024-09-13T23:05:37.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.636+0000 7f7e3a7fc640 1 -- 172.21.15.164:0/205555312 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7f4005f9d0 con 0x559d35547ea0 2024-09-13T23:05:37.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.636+0000 7f7e3a7fc640 1 --2- 172.21.15.164:0/205555312 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7e2c036b90 0x7f7e2c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.636+0000 7f7e3a7fc640 1 -- 172.21.15.164:0/205555312 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7f40092d50 con 0x559d35547ea0 2024-09-13T23:05:37.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.636+0000 7f7f55498640 1 --2- 172.21.15.164:0/205555312 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7e2c036b90 0x7f7e2c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.636+0000 7f7f58f42800 1 Processor -- start 2024-09-13T23:05:37.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.637+0000 7f7f55498640 1 --2- 172.21.15.164:0/205555312 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7e2c036b90 0x7f7e2c039050 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x559d35538d50 tx=0x7f7f50005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.637+0000 7f7f58f42800 1 -- start start 2024-09-13T23:05:37.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.637+0000 7f7f58f42800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d35554a40 0x559d35554e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.637+0000 7f7f58f42800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559d35529230 con 0x559d35554a40 2024-09-13T23:05:37.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.637+0000 7f7f4ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d35554a40 0x559d35554e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.637+0000 7f7f4ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d35554a40 0x559d35554e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58432/0 (socket says 172.21.15.164:58432) 2024-09-13T23:05:37.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.637+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2665993449 learned_addr learned my addr 172.21.15.164:0/2665993449 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.637+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2665993449 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d35555410 con 0x559d35554a40 2024-09-13T23:05:37.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.637+0000 7f7f4ffff640 1 --2- 172.21.15.164:0/2665993449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d35554a40 0x559d35554e40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7f40053da0 tx=0x7f7f4007cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eec3e37942540d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.638+0000 7f7e2bfff640 1 -- 172.21.15.164:0/2665993449 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f40080070 con 0x559d35554a40 2024-09-13T23:05:37.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.638+0000 7f7e2bfff640 1 -- 172.21.15.164:0/2665993449 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f4005fcc0 con 0x559d35554a40 2024-09-13T23:05:37.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.638+0000 7f7e2bfff640 1 -- 172.21.15.164:0/2665993449 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f4006a3a0 con 0x559d35554a40 2024-09-13T23:05:37.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.638+0000 7f7f58f42800 1 -- 172.21.15.164:0/2665993449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d35554a40 msgr2=0x559d35554e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.638+0000 7f7f58f42800 1 --2- 172.21.15.164:0/2665993449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d35554a40 0x559d35554e40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7f40053da0 tx=0x7f7f4007cea0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.638+0000 7f7f58f42800 1 -- 172.21.15.164:0/2665993449 shutdown_connections 2024-09-13T23:05:37.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.638+0000 7f7f58f42800 1 --2- 172.21.15.164:0/2665993449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d35554a40 0x559d35554e40 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.638+0000 7f7f58f42800 1 -- 172.21.15.164:0/2665993449 >> 172.21.15.164:0/2665993449 conn(0x559d35550da0 msgr2=0x559d3554eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.638+0000 7f7f58f42800 1 -- 172.21.15.164:0/2665993449 shutdown_connections 2024-09-13T23:05:37.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.638+0000 7f7f58f42800 1 -- 172.21.15.164:0/2665993449 wait complete. 2024-09-13T23:05:37.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.638+0000 7f7f58f42800 1 Processor -- start 2024-09-13T23:05:37.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.638+0000 7f7f58f42800 1 -- start start 2024-09-13T23:05:37.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.639+0000 7f7f58f42800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d35554a40 0x559d3555bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.639+0000 7f7f58f42800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559d35555a80 con 0x559d35554a40 2024-09-13T23:05:37.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.639+0000 7f7f4ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d35554a40 0x559d3555bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.639+0000 7f7f4ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d35554a40 0x559d3555bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58440/0 (socket says 172.21.15.164:58440) 2024-09-13T23:05:37.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.639+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 learned_addr learned my addr 172.21.15.164:0/2843117029 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.639+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d3555c440 con 0x559d35554a40 2024-09-13T23:05:37.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.639+0000 7f7f4ffff640 1 --2- 172.21.15.164:0/2843117029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d35554a40 0x559d3555bf00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7f4007cc50 tx=0x7f7f40091010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.639+0000 7f7e2a7fc640 1 -- 172.21.15.164:0/2843117029 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f4006a720 con 0x559d35554a40 2024-09-13T23:05:37.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.639+0000 7f7e2a7fc640 1 -- 172.21.15.164:0/2843117029 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f40096070 con 0x559d35554a40 2024-09-13T23:05:37.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.639+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d3555c6d0 con 0x559d35554a40 2024-09-13T23:05:37.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.639+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d3555f380 con 0x559d35554a40 2024-09-13T23:05:37.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.639+0000 7f7e2a7fc640 1 -- 172.21.15.164:0/2843117029 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f4006a9f0 con 0x559d35554a40 2024-09-13T23:05:37.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.640+0000 7f7e2a7fc640 1 -- 172.21.15.164:0/2843117029 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7f40083070 con 0x559d35554a40 2024-09-13T23:05:37.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.640+0000 7f7e2a7fc640 1 --2- 172.21.15.164:0/2843117029 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7e20036af0 0x7f7e20038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.640+0000 7f7e2a7fc640 1 -- 172.21.15.164:0/2843117029 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7f4009ccd0 con 0x559d35554a40 2024-09-13T23:05:37.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.640+0000 7f7f55498640 1 --2- 172.21.15.164:0/2843117029 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7e20036af0 0x7f7e20038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.641+0000 7f7f55498640 1 --2- 172.21.15.164:0/2843117029 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7e20036af0 0x7f7e20038fb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x559d355384d0 tx=0x7f7f5001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.641+0000 7f7f58f42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.641+0000 7f7f58f42800 1 --2- 172.21.15.164:0/2843117029 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559d355679f0 0x559d35569eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.641+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d3556a600 con 0x559d355679f0 2024-09-13T23:05:37.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.641+0000 7f7f54c97640 1 --2- 172.21.15.164:0/2843117029 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559d355679f0 0x559d35569eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.641+0000 7f7f54c97640 1 --2- 172.21.15.164:0/2843117029 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559d355679f0 0x559d35569eb0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.641+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7f48018950 con 0x559d355679f0 2024-09-13T23:05:37.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.641+0000 7f7f58f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.641+0000 7f7f58f42800 20 realm 2024-09-13T23:05:37.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.641+0000 7f7f58f42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.642+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d3556aa10 con 0x559d355679f0 2024-09-13T23:05:37.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.642+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7f48018950 con 0x559d355679f0 2024-09-13T23:05:37.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.642+0000 7f7f58f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.642+0000 7f7f58f42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:37.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.642+0000 7f7f58f42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.642+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d3556b2e0 con 0x559d355679f0 2024-09-13T23:05:37.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.642+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7f48018950 con 0x559d355679f0 2024-09-13T23:05:37.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.642+0000 7f7f58f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.642+0000 7f7f58f42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.642+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d3556b680 con 0x559d355679f0 2024-09-13T23:05:37.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.642+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7f48018950 con 0x559d355679f0 2024-09-13T23:05:37.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.642+0000 7f7f58f42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:37.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.642+0000 7f7f58f42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.642+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d3556bae0 con 0x559d355679f0 2024-09-13T23:05:37.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.642+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7f48018950 con 0x559d355679f0 2024-09-13T23:05:37.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.642+0000 7f7f58f42800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:37.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.642+0000 7f7f58f42800 20 searching for the correct realm 2024-09-13T23:05:37.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.642+0000 7f7f58f42800 1 --2- 172.21.15.164:0/2843117029 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x559d3556dad0 0x559d3556ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.642+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x559d3556dad0 2024-09-13T23:05:37.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.643+0000 7f7f4ffff640 1 --2- 172.21.15.164:0/2843117029 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x559d3556dad0 0x559d3556ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.643+0000 7f7f4ffff640 1 --2- 172.21.15.164:0/2843117029 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x559d3556dad0 0x559d3556ff40 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.643+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f40082030 con 0x559d3556dad0 2024-09-13T23:05:37.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.643+0000 7f7f4ffff640 1 --2- 172.21.15.164:0/2843117029 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7f40085070 0x7f7f400527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.643+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x7f7f40085070 2024-09-13T23:05:37.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.643+0000 7f7f55498640 1 --2- 172.21.15.164:0/2843117029 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7f40085070 0x7f7f400527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.643+0000 7f7f55498640 1 --2- 172.21.15.164:0/2843117029 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7f40085070 0x7f7f400527e0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.644+0000 7f7f55498640 1 -- 172.21.15.164:0/2843117029 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f5001f070 con 0x7f7f40085070 2024-09-13T23:05:37.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.644+0000 7f7f55498640 1 --2- 172.21.15.164:0/2843117029 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7f50031040 0x7f7f50032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.644+0000 7f7f55498640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x7f7f50031040 2024-09-13T23:05:37.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.644+0000 7f7f54c97640 1 --2- 172.21.15.164:0/2843117029 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7f50031040 0x7f7f50032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.644+0000 7f7f54c97640 1 --2- 172.21.15.164:0/2843117029 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7f50031040 0x7f7f50032940 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.645+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f48018950 con 0x7f7f50031040 2024-09-13T23:05:37.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.645+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x559d355679f0 2024-09-13T23:05:37.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.645+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7f48018950 con 0x559d355679f0 2024-09-13T23:05:37.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.645+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x559d355679f0 2024-09-13T23:05:37.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.645+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f48018950 con 0x559d355679f0 2024-09-13T23:05:37.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.645+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x7f7f50031040 2024-09-13T23:05:37.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.645+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f48018950 con 0x7f7f50031040 2024-09-13T23:05:37.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.645+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x7f7f50031040 2024-09-13T23:05:37.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.645+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f48018950 con 0x7f7f50031040 2024-09-13T23:05:37.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.646+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x7f7f40085070 2024-09-13T23:05:37.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.646+0000 7f7f55498640 1 -- 172.21.15.164:0/2843117029 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f5001f070 con 0x7f7f40085070 2024-09-13T23:05:37.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.646+0000 7f7f55498640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x559d3556dad0 2024-09-13T23:05:37.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.646+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f40082030 con 0x559d3556dad0 2024-09-13T23:05:37.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.646+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x559d355679f0 2024-09-13T23:05:37.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.646+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f48018950 con 0x559d355679f0 2024-09-13T23:05:37.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.646+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x7f7f50031040 2024-09-13T23:05:37.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.646+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f48018950 con 0x7f7f50031040 2024-09-13T23:05:37.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.646+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x559d355679f0 2024-09-13T23:05:37.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.647+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f48018950 con 0x559d355679f0 2024-09-13T23:05:37.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.647+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x7f7f40085070 2024-09-13T23:05:37.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.647+0000 7f7f55498640 1 -- 172.21.15.164:0/2843117029 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7f5001f070 con 0x7f7f40085070 2024-09-13T23:05:37.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.647+0000 7f7f55498640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x559d3556dad0 2024-09-13T23:05:37.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.647+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f40082030 con 0x559d3556dad0 2024-09-13T23:05:37.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.647+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x559d3556dad0 2024-09-13T23:05:37.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.647+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f40082030 con 0x559d3556dad0 2024-09-13T23:05:37.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.647+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x7f7f50031040 2024-09-13T23:05:37.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.648+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f48018950 con 0x7f7f50031040 2024-09-13T23:05:37.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.648+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x559d3556dad0 2024-09-13T23:05:37.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.648+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f40082030 con 0x559d3556dad0 2024-09-13T23:05:37.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.648+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x559d3556dad0 2024-09-13T23:05:37.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.648+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f40082030 con 0x559d3556dad0 2024-09-13T23:05:37.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.648+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x559d355679f0 2024-09-13T23:05:37.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.648+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f48018950 con 0x559d355679f0 2024-09-13T23:05:37.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.648+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x559d355679f0 2024-09-13T23:05:37.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.649+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7f48018950 con 0x559d355679f0 2024-09-13T23:05:37.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.649+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x7f7f50031040 2024-09-13T23:05:37.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.649+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f48018950 con 0x7f7f50031040 2024-09-13T23:05:37.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.649+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x559d3556dad0 2024-09-13T23:05:37.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.649+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f40082030 con 0x559d3556dad0 2024-09-13T23:05:37.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.649+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x7f7f40085070 2024-09-13T23:05:37.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.649+0000 7f7f55498640 1 -- 172.21.15.164:0/2843117029 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f5001f070 con 0x7f7f40085070 2024-09-13T23:05:37.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.649+0000 7f7f55498640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x559d355679f0 2024-09-13T23:05:37.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.650+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7f48018950 con 0x559d355679f0 2024-09-13T23:05:37.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.650+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x7f7f50031040 2024-09-13T23:05:37.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.650+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f48018950 con 0x7f7f50031040 2024-09-13T23:05:37.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.650+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x559d3556dad0 2024-09-13T23:05:37.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.650+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f40082030 con 0x559d3556dad0 2024-09-13T23:05:37.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.650+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x7f7f50031040 2024-09-13T23:05:37.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.650+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f48018950 con 0x7f7f50031040 2024-09-13T23:05:37.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.651+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x7f7f40085070 2024-09-13T23:05:37.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.651+0000 7f7f55498640 1 -- 172.21.15.164:0/2843117029 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f5001f070 con 0x7f7f40085070 2024-09-13T23:05:37.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.651+0000 7f7f55498640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x559d3556dad0 2024-09-13T23:05:37.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.651+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f40082030 con 0x559d3556dad0 2024-09-13T23:05:37.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.651+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x7f7f50031040 2024-09-13T23:05:37.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.651+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f48018950 con 0x7f7f50031040 2024-09-13T23:05:37.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.651+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x559d355679f0 2024-09-13T23:05:37.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.651+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7f48018950 con 0x559d355679f0 2024-09-13T23:05:37.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.651+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559d35570610 con 0x7f7f40085070 2024-09-13T23:05:37.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.652+0000 7f7f55498640 1 -- 172.21.15.164:0/2843117029 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f5001f070 con 0x7f7f40085070 2024-09-13T23:05:37.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.652+0000 7f7f58f42800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:37.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.652+0000 7f7f58f42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:37.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.652+0000 7f7f58f42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:37.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.652+0000 7f7f58f42800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:37.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.652+0000 7f7f58f42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:37.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.652+0000 7f7f58f42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:37.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.652+0000 7f7f58f42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.652+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d3556c4f0 con 0x559d355679f0 2024-09-13T23:05:37.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.652+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7f48018950 con 0x559d355679f0 2024-09-13T23:05:37.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.652+0000 7f7f58f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.652+0000 7f7f58f42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.652+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d3556cd90 con 0x559d355679f0 2024-09-13T23:05:37.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.652+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7f48018950 con 0x559d355679f0 2024-09-13T23:05:37.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.652+0000 7f7f58f42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:37.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.652+0000 7f7f58f42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.652+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d3556c130 con 0x559d355679f0 2024-09-13T23:05:37.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.653+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7f48018950 con 0x559d355679f0 2024-09-13T23:05:37.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.653+0000 7f7f58f42800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:37.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.653+0000 7f7f58f42800 20 zone default found 2024-09-13T23:05:37.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.653+0000 7f7f58f42800 4 Realm: () 2024-09-13T23:05:37.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.653+0000 7f7f58f42800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:37.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.653+0000 7f7f58f42800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:37.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.653+0000 7f7f58f42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:37.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.653+0000 7f7f58f42800 20 zonegroup default 2024-09-13T23:05:37.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.653+0000 7f7f58f42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.653+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d3556cd90 con 0x7f7f50031040 2024-09-13T23:05:37.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.653+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7f48018950 con 0x7f7f50031040 2024-09-13T23:05:37.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.653+0000 7f7f58f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.653+0000 7f7f58f42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.653+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d35572470 con 0x559d3556dad0 2024-09-13T23:05:37.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.653+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7f40082030 con 0x559d3556dad0 2024-09-13T23:05:37.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.653+0000 7f7f58f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.653+0000 7f7f58f42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.653+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d35572810 con 0x559d3556dad0 2024-09-13T23:05:37.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.653+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7f40082030 con 0x559d3556dad0 2024-09-13T23:05:37.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.653+0000 7f7f58f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.653+0000 7f7f58f42800 20 started sync module instance, tier type = 2024-09-13T23:05:37.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.653+0000 7f7f58f42800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:37.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.653+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d35571910 con 0x7f7f40085070 2024-09-13T23:05:37.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.654+0000 7f7f55498640 1 -- 172.21.15.164:0/2843117029 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f50040040 con 0x7f7f40085070 2024-09-13T23:05:37.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.654+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94133693127984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d35571570 con 0x7f7f40085070 2024-09-13T23:05:37.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.654+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d35573680 con 0x559d355679f0 2024-09-13T23:05:37.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.655+0000 7f7f55498640 1 -- 172.21.15.164:0/2843117029 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94133693127984] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f50040040 con 0x7f7f40085070 2024-09-13T23:05:37.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.656+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f48018950 con 0x559d355679f0 2024-09-13T23:05:37.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.656+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94133693131696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d35573680 con 0x559d355679f0 2024-09-13T23:05:37.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.656+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d35574040 con 0x559d3556dad0 2024-09-13T23:05:37.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.657+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94133693131696] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f48018950 con 0x559d355679f0 2024-09-13T23:05:37.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.657+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f40082030 con 0x559d3556dad0 2024-09-13T23:05:37.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.657+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94133693133264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d355735f0 con 0x559d3556dad0 2024-09-13T23:05:37.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.657+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d35574f00 con 0x7f7f40085070 2024-09-13T23:05:37.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.658+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94133693133264] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f40082030 con 0x559d3556dad0 2024-09-13T23:05:37.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.658+0000 7f7f55498640 1 -- 172.21.15.164:0/2843117029 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f50040040 con 0x7f7f40085070 2024-09-13T23:05:37.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.658+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94133693139536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d35574e70 con 0x7f7f40085070 2024-09-13T23:05:37.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.658+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d35575ce0 con 0x559d355679f0 2024-09-13T23:05:37.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.659+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f48018950 con 0x559d355679f0 2024-09-13T23:05:37.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.659+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94133693142992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d35575ca0 con 0x559d355679f0 2024-09-13T23:05:37.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.659+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d35576ca0 con 0x7f7f50031040 2024-09-13T23:05:37.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.659+0000 7f7f55498640 1 -- 172.21.15.164:0/2843117029 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94133693139536] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f50040040 con 0x7f7f40085070 2024-09-13T23:05:37.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.660+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f48018950 con 0x7f7f50031040 2024-09-13T23:05:37.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.660+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94133693141792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d35576ca0 con 0x7f7f50031040 2024-09-13T23:05:37.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.660+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d355776b0 con 0x7f7f50031040 2024-09-13T23:05:37.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.660+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94133693142992] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f48018950 con 0x559d355679f0 2024-09-13T23:05:37.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.661+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94133693141792] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f48018950 con 0x7f7f50031040 2024-09-13T23:05:37.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.661+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f48018950 con 0x7f7f50031040 2024-09-13T23:05:37.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.661+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94133693147040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d35577200 con 0x7f7f50031040 2024-09-13T23:05:37.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.661+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d35577bc0 con 0x7f7f50031040 2024-09-13T23:05:37.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.662+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94133693147040] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f48018950 con 0x7f7f50031040 2024-09-13T23:05:37.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.662+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f48018950 con 0x7f7f50031040 2024-09-13T23:05:37.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.662+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94133693145248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d35577bc0 con 0x7f7f50031040 2024-09-13T23:05:37.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.662+0000 7f7f58f42800 20 add_watcher() i=0 2024-09-13T23:05:37.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.662+0000 7f7f58f42800 20 add_watcher() i=1 2024-09-13T23:05:37.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.662+0000 7f7f58f42800 20 add_watcher() i=2 2024-09-13T23:05:37.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.662+0000 7f7f58f42800 20 add_watcher() i=3 2024-09-13T23:05:37.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.662+0000 7f7f58f42800 20 add_watcher() i=4 2024-09-13T23:05:37.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.662+0000 7f7f58f42800 20 add_watcher() i=5 2024-09-13T23:05:37.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.662+0000 7f7f58f42800 20 add_watcher() i=6 2024-09-13T23:05:37.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.663+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94133693145248] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f48018950 con 0x7f7f50031040 2024-09-13T23:05:37.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.663+0000 7f7f58f42800 20 add_watcher() i=7 2024-09-13T23:05:37.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.663+0000 7f7f58f42800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:37.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.663+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d3557ae80 con 0x559d355679f0 2024-09-13T23:05:37.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.664+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7f48018950 con 0x559d355679f0 2024-09-13T23:05:37.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.664+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94133693151360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d35578150 con 0x559d355679f0 2024-09-13T23:05:37.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.665+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94133693151360] v32'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7f48018950 con 0x559d355679f0 2024-09-13T23:05:37.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.665+0000 7f7e0b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:37.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.665+0000 7f7f58f42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:37.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.665+0000 7f7f58f42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:37.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.665+0000 7f7f58f42800 5 note: GC not initialized 2024-09-13T23:05:37.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.665+0000 7f7e0a7e4640 20 reqs_thread_entry: start 2024-09-13T23:05:37.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.665+0000 7f7f58f42800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:37.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.665+0000 7f7f58f42800 20 Filter name: none 2024-09-13T23:05:37.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.665+0000 7f7e037fe640 20 reqs_thread_entry: start 2024-09-13T23:05:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.666+0000 7f7f58f42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.666+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d355ae210 con 0x7f7f40085070 2024-09-13T23:05:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.666+0000 7f7f55498640 1 -- 172.21.15.164:0/2843117029 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f7f50040040 con 0x7f7f40085070 2024-09-13T23:05:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.666+0000 7f7f58f42800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:05:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.666+0000 7f7f58f42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.666+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:63 8.15 8:aa4f46c1:root::.bucket.meta.myfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d355aeba0 con 0x559d3556dad0 2024-09-13T23:05:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.666+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(63 .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f7f40082030 con 0x559d3556dad0 2024-09-13T23:05:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.666+0000 7f7f58f42800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:05:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.666+0000 7f7f58f42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T23:05:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.666+0000 7f7f58f42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.666+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d355b0270 con 0x7f7f40085070 2024-09-13T23:05:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.667+0000 7f7f55498640 1 -- 172.21.15.164:0/2843117029 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f7f50040040 con 0x7f7f40085070 2024-09-13T23:05:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.667+0000 7f7f58f42800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:05:37.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.667+0000 7f7f58f42800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.667+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:65 8.15 8:aa4f46c1:root::.bucket.meta.myfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d355b0270 con 0x559d3556dad0 2024-09-13T23:05:37.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.667+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(65 .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f7f40082030 con 0x559d3556dad0 2024-09-13T23:05:37.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.667+0000 7f7f58f42800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:05:37.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.667+0000 7f7f58f42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T23:05:37.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.667+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:66 4.14 4:29473231:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d355b1930 con 0x559d3556dad0 2024-09-13T23:05:37.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.667+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:67 4.4 4:21c197e9:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d355b4490 con 0x7f7f50031040 2024-09-13T23:05:37.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.667+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:68 4.1c 4:3980393e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d355b6ed0 con 0x7f7f50031040 2024-09-13T23:05:37.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.667+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:69 4.3c 4:3c3df72e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d355b6ed0 con 0x559d355679f0 2024-09-13T23:05:37.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.667+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:70 4.37 4:ec9f5977:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d355bbe60 con 0x7f7f50031040 2024-09-13T23:05:37.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.667+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 4.17 4:ea5fb2d4:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d355be850 con 0x7f7f50031040 2024-09-13T23:05:37.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.667+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:72 4.30 4:0d33cc25:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d355c12a0 con 0x559d3556dad0 2024-09-13T23:05:37.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.667+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:73 4.2b 4:d7ffec3e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d355c3f10 con 0x559d355679f0 2024-09-13T23:05:37.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.667+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(66 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7f40082030 con 0x559d3556dad0 2024-09-13T23:05:37.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.667+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(67 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7f48018950 con 0x7f7f50031040 2024-09-13T23:05:37.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.667+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(68 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7f48018950 con 0x7f7f50031040 2024-09-13T23:05:37.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.667+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(71 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f7f48018950 con 0x7f7f50031040 2024-09-13T23:05:37.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.667+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(72 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.6 [call out=124b] v0'0 uv6 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f7f40082030 con 0x559d3556dad0 2024-09-13T23:05:37.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.668+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(70 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7f48018950 con 0x7f7f50031040 2024-09-13T23:05:37.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.668+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(69 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7f48018950 con 0x559d355679f0 2024-09-13T23:05:37.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.668+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(73 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7f48018950 con 0x559d355679f0 2024-09-13T23:05:37.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.668+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 4.3e 4:7f41df37:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d355b6a20 con 0x7f7f40085070 2024-09-13T23:05:37.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.668+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:75 4.5 4:a1ee3102:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d355c3a60 con 0x559d3556dad0 2024-09-13T23:05:37.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.668+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:76 4.30 4:0c251f7e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559d355b3f50 con 0x559d3556dad0 2024-09-13T23:05:37.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.668+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(76 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f7f40082030 con 0x559d3556dad0 2024-09-13T23:05:37.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.668+0000 7f7f55498640 1 -- 172.21.15.164:0/2843117029 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(74 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.8 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f7f50040040 con 0x7f7f40085070 2024-09-13T23:05:37.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.668+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(75 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7f40082030 con 0x559d3556dad0 2024-09-13T23:05:37.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.669+0000 7f7e0b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:37.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.669+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94133693151360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d355abc30 con 0x559d355679f0 2024-09-13T23:05:37.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.670+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94133693151360] v32'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7f48018950 con 0x559d355679f0 2024-09-13T23:05:37.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.670+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94133693127984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d355abc30 con 0x7f7f40085070 2024-09-13T23:05:37.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.671+0000 7f7f55498640 1 -- 172.21.15.164:0/2843117029 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94133693127984] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f50040040 con 0x7f7f40085070 2024-09-13T23:05:37.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.671+0000 7f7f58f42800 20 remove_watcher() i=0 2024-09-13T23:05:37.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.671+0000 7f7f58f42800 2 removed watcher, disabling cache 2024-09-13T23:05:37.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.671+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94133693131696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d355abc30 con 0x559d355679f0 2024-09-13T23:05:37.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.672+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94133693131696] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f48018950 con 0x559d355679f0 2024-09-13T23:05:37.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.672+0000 7f7f58f42800 20 remove_watcher() i=1 2024-09-13T23:05:37.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.672+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94133693133264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d355abc30 con 0x559d3556dad0 2024-09-13T23:05:37.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.673+0000 7f7f4ffff640 1 -- 172.21.15.164:0/2843117029 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94133693133264] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f40082030 con 0x559d3556dad0 2024-09-13T23:05:37.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.673+0000 7f7f58f42800 20 remove_watcher() i=2 2024-09-13T23:05:37.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.673+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94133693139536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d355abc30 con 0x7f7f40085070 2024-09-13T23:05:37.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.674+0000 7f7f55498640 1 -- 172.21.15.164:0/2843117029 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94133693139536] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f50040040 con 0x7f7f40085070 2024-09-13T23:05:37.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.674+0000 7f7f58f42800 20 remove_watcher() i=3 2024-09-13T23:05:37.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.674+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94133693142992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d355abc30 con 0x559d355679f0 2024-09-13T23:05:37.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.675+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94133693142992] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f48018950 con 0x559d355679f0 2024-09-13T23:05:37.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.675+0000 7f7f58f42800 20 remove_watcher() i=4 2024-09-13T23:05:37.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.675+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94133693141792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d355abc30 con 0x7f7f50031040 2024-09-13T23:05:37.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.676+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94133693141792] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f48018950 con 0x7f7f50031040 2024-09-13T23:05:37.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.676+0000 7f7f58f42800 20 remove_watcher() i=5 2024-09-13T23:05:37.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.676+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94133693147040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d355abc30 con 0x7f7f50031040 2024-09-13T23:05:37.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.677+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94133693147040] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f48018950 con 0x7f7f50031040 2024-09-13T23:05:37.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.677+0000 7f7f58f42800 20 remove_watcher() i=6 2024-09-13T23:05:37.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.677+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94133693145248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559d355abc30 con 0x7f7f50031040 2024-09-13T23:05:37.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.678+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94133693145248] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f48018950 con 0x7f7f50031040 2024-09-13T23:05:37.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.678+0000 7f7f58f42800 20 remove_watcher() i=7 2024-09-13T23:05:37.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.678+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7f50031040 msgr2=0x7f7f50032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.678+0000 7f7f58f42800 1 --2- 172.21.15.164:0/2843117029 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7f50031040 0x7f7f50032940 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.678+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559d355679f0 msgr2=0x559d35569eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.678+0000 7f7f58f42800 1 --2- 172.21.15.164:0/2843117029 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559d355679f0 0x559d35569eb0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.678+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7f40085070 msgr2=0x7f7f400527e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.678+0000 7f7f58f42800 1 --2- 172.21.15.164:0/2843117029 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7f40085070 0x7f7f400527e0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.678+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x559d3556dad0 msgr2=0x559d3556ff40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.678+0000 7f7f58f42800 1 --2- 172.21.15.164:0/2843117029 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x559d3556dad0 0x559d3556ff40 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.678+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7e20036af0 msgr2=0x7f7e20038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.678+0000 7f7f58f42800 1 --2- 172.21.15.164:0/2843117029 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7e20036af0 0x7f7e20038fb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x559d355384d0 tx=0x7f7f5001f000 comp rx=0 tx=0).stop 2024-09-13T23:05:37.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.678+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d35554a40 msgr2=0x559d3555bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.678+0000 7f7f54c97640 1 -- 172.21.15.164:0/2843117029 reap_dead start 2024-09-13T23:05:37.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.678+0000 7f7f58f42800 1 --2- 172.21.15.164:0/2843117029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d35554a40 0x559d3555bf00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7f4007cc50 tx=0x7f7f40091010 comp rx=0 tx=0).stop 2024-09-13T23:05:37.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.678+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 shutdown_connections 2024-09-13T23:05:37.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.678+0000 7f7f58f42800 1 --2- 172.21.15.164:0/2843117029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d35554a40 0x559d3555bf00 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.678+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 >> 172.21.15.164:0/2843117029 conn(0x559d35550da0 msgr2=0x559d3554ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.678+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 shutdown_connections 2024-09-13T23:05:37.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.678+0000 7f7f58f42800 1 -- 172.21.15.164:0/2843117029 wait complete. 2024-09-13T23:05:37.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.678+0000 7f7f58f42800 1 -- 172.21.15.164:0/205555312 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7e2c036b90 msgr2=0x7f7e2c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.678+0000 7f7f58f42800 1 --2- 172.21.15.164:0/205555312 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7e2c036b90 0x7f7e2c039050 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x559d35538d50 tx=0x7f7f50005840 comp rx=0 tx=0).stop 2024-09-13T23:05:37.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.678+0000 7f7f58f42800 1 -- 172.21.15.164:0/205555312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d35547ea0 msgr2=0x559d355482c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.678+0000 7f7f58f42800 1 --2- 172.21.15.164:0/205555312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d35547ea0 0x559d355482c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7f40045f50 tx=0x7f7f40002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.679+0000 7f7f58f42800 1 -- 172.21.15.164:0/205555312 shutdown_connections 2024-09-13T23:05:37.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.679+0000 7f7f58f42800 1 --2- 172.21.15.164:0/205555312 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7e2c036b90 0x7f7e2c039050 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.679+0000 7f7f58f42800 1 --2- 172.21.15.164:0/205555312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d35547ea0 0x559d355482c0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.679+0000 7f7f58f42800 1 -- 172.21.15.164:0/205555312 >> 172.21.15.164:0/205555312 conn(0x559d3553ce30 msgr2=0x559d3553f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.679+0000 7f7f58f42800 1 -- 172.21.15.164:0/205555312 shutdown_connections 2024-09-13T23:05:37.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.679+0000 7f7f58f42800 1 -- 172.21.15.164:0/205555312 wait complete. 2024-09-13T23:05:37.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.679+0000 7f7f58f42800 1 -- 172.21.15.164:0/34744330 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559d3543ddb0 msgr2=0x559d355374f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.679+0000 7f7f58f42800 1 --2- 172.21.15.164:0/34744330 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559d3543ddb0 0x559d355374f0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.679+0000 7f7f58f42800 1 -- 172.21.15.164:0/34744330 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7e3c036b90 msgr2=0x7f7e3c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.679+0000 7f7f58f42800 1 --2- 172.21.15.164:0/34744330 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7e3c036b90 0x7f7e3c039050 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7f40057000 tx=0x7f7f40052000 comp rx=0 tx=0).stop 2024-09-13T23:05:37.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.679+0000 7f7f58f42800 1 -- 172.21.15.164:0/34744330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d353ab5f0 msgr2=0x559d35530480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.679+0000 7f7f58f42800 1 --2- 172.21.15.164:0/34744330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d353ab5f0 0x559d35530480 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7f4800b7c0 tx=0x7f7f48000ed0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.679+0000 7f7f58f42800 1 -- 172.21.15.164:0/34744330 shutdown_connections 2024-09-13T23:05:37.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.679+0000 7f7f58f42800 1 --2- 172.21.15.164:0/34744330 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559d3543ddb0 0x559d355374f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.679+0000 7f7f58f42800 1 --2- 172.21.15.164:0/34744330 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7e3c036b90 0x7f7e3c039050 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.679+0000 7f7f58f42800 1 --2- 172.21.15.164:0/34744330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d353ab5f0 0x559d35530480 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.679+0000 7f7f58f42800 1 -- 172.21.15.164:0/34744330 >> 172.21.15.164:0/34744330 conn(0x559d35431de0 msgr2=0x559d35522cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.679+0000 7f7f58f42800 1 -- 172.21.15.164:0/34744330 shutdown_connections 2024-09-13T23:05:37.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.679+0000 7f7f58f42800 1 -- 172.21.15.164:0/34744330 wait complete. 2024-09-13T23:05:37.699 INFO:teuthology.orchestra.run.smithi164.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"4d3c0b48-20ce-488a-b409-36cc6d9502d0","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1","marker":"a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-13T23:05:37.158815Z","creation_time":"2024-09-13T23:05:34.302827Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-13T23:05:37.699 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '4d3c0b48-20ce-488a-b409-36cc6d9502d0', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1', 'marker': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T23:05:37.158815Z', 'creation_time': '2024-09-13T23:05:34.302827Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T23:05:37.700 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-13T23:05:37.700 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-13T23:05:37.700 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-13T23:05:37.742 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:37.742 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:37.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.742+0000 7fe805935800 1 Processor -- start 2024-09-13T23:05:37.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.742+0000 7fe805935800 1 -- start start 2024-09-13T23:05:37.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.742+0000 7fe805935800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55658b1788f0 0x55658b17ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.742+0000 7fe805935800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55658b034b30 con 0x55658b1744b0 2024-09-13T23:05:37.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.742+0000 7fe805935800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55658b016360 con 0x55658b1788f0 2024-09-13T23:05:37.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.742+0000 7fe800eed640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55658b1788f0 0x55658b17ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.742+0000 7fe8016ee640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55658b1744b0 0x55658b1748b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:41106/0 (socket says 172.21.15.164:41106) 2024-09-13T23:05:37.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.742+0000 7fe800eed640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55658b1788f0 0x55658b17ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58446/0 (socket says 172.21.15.164:58446) 2024-09-13T23:05:37.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.742+0000 7fe8016ee640 1 -- 172.21.15.164:0/3974126176 learned_addr learned my addr 172.21.15.164:0/3974126176 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:37.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.742+0000 7fe800eed640 1 -- 172.21.15.164:0/3974126176 >> v1:172.21.15.17:6789/0 conn(0x55658b1744b0 legacy=0x55658b1748b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.742+0000 7fe800eed640 1 -- 172.21.15.164:0/3974126176 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55658b03ce00 con 0x55658b1788f0 2024-09-13T23:05:37.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.744+0000 7fe800eed640 1 --2- 172.21.15.164:0/3974126176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b1788f0 0x55658b17ace0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec00a470 tx=0x7fe7ec045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1452e84accd5dd2e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.744+0000 7fe7fbfff640 1 -- 172.21.15.164:0/3974126176 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7ec053570 con 0x55658b1788f0 2024-09-13T23:05:37.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.745+0000 7fe7fbfff640 1 -- 172.21.15.164:0/3974126176 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7ec058070 con 0x55658b1788f0 2024-09-13T23:05:37.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.745+0000 7fe7fbfff640 1 -- 172.21.15.164:0/3974126176 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7ec053880 con 0x55658b1788f0 2024-09-13T23:05:37.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.745+0000 7fe805935800 1 -- 172.21.15.164:0/3974126176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b1788f0 msgr2=0x55658b17ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.745+0000 7fe805935800 1 --2- 172.21.15.164:0/3974126176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b1788f0 0x55658b17ace0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec00a470 tx=0x7fe7ec045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:37.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.745+0000 7fe805935800 1 -- 172.21.15.164:0/3974126176 shutdown_connections 2024-09-13T23:05:37.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.745+0000 7fe805935800 1 --2- 172.21.15.164:0/3974126176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b1788f0 0x55658b17ace0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.745+0000 7fe805935800 1 -- 172.21.15.164:0/3974126176 >> 172.21.15.164:0/3974126176 conn(0x55658b16fde0 msgr2=0x55658b172200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.745+0000 7fe805935800 1 -- 172.21.15.164:0/3974126176 shutdown_connections 2024-09-13T23:05:37.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.745+0000 7fe805935800 1 -- 172.21.15.164:0/3974126176 wait complete. 2024-09-13T23:05:37.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.759+0000 7fe805935800 1 Processor -- start 2024-09-13T23:05:37.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.759+0000 7fe805935800 1 -- start start 2024-09-13T23:05:37.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.759+0000 7fe805935800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b1744b0 0x55658b263740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.759+0000 7fe805935800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55658b0c1320 con 0x55658b1744b0 2024-09-13T23:05:37.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.760+0000 7fe8016ee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b1744b0 0x55658b263740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.760+0000 7fe8016ee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b1744b0 0x55658b263740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58448/0 (socket says 172.21.15.164:58448) 2024-09-13T23:05:37.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.760+0000 7fe8016ee640 1 -- 172.21.15.164:0/2620730130 learned_addr learned my addr 172.21.15.164:0/2620730130 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.760+0000 7fe8016ee640 1 -- 172.21.15.164:0/2620730130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55658b00ebc0 con 0x55658b1744b0 2024-09-13T23:05:37.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.760+0000 7fe8016ee640 1 --2- 172.21.15.164:0/2620730130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b1744b0 0x55658b263740 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc00d540 tx=0x7fe7fc00da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a2f356299f828aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.760+0000 7fe6ef606640 1 -- 172.21.15.164:0/2620730130 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7fc014070 con 0x55658b1744b0 2024-09-13T23:05:37.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.760+0000 7fe6ef606640 1 -- 172.21.15.164:0/2620730130 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7fc0063b0 con 0x55658b1744b0 2024-09-13T23:05:37.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.760+0000 7fe6ef606640 1 -- 172.21.15.164:0/2620730130 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7fc004650 con 0x55658b1744b0 2024-09-13T23:05:37.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.761+0000 7fe805935800 1 -- 172.21.15.164:0/2620730130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b1744b0 msgr2=0x55658b263740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.761+0000 7fe805935800 1 --2- 172.21.15.164:0/2620730130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b1744b0 0x55658b263740 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc00d540 tx=0x7fe7fc00da00 comp rx=0 tx=0).stop 2024-09-13T23:05:37.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.761+0000 7fe805935800 1 -- 172.21.15.164:0/2620730130 shutdown_connections 2024-09-13T23:05:37.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.761+0000 7fe805935800 1 --2- 172.21.15.164:0/2620730130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b1744b0 0x55658b263740 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.761+0000 7fe805935800 1 -- 172.21.15.164:0/2620730130 >> 172.21.15.164:0/2620730130 conn(0x55658b16fde0 msgr2=0x55658b25f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.761+0000 7fe805935800 1 -- 172.21.15.164:0/2620730130 shutdown_connections 2024-09-13T23:05:37.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.761+0000 7fe805935800 1 -- 172.21.15.164:0/2620730130 wait complete. 2024-09-13T23:05:37.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.761+0000 7fe805935800 1 Processor -- start 2024-09-13T23:05:37.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.761+0000 7fe805935800 1 -- start start 2024-09-13T23:05:37.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.762+0000 7fe805935800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b1788f0 0x55658b26e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.762+0000 7fe805935800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55658b17b520 con 0x55658b1788f0 2024-09-13T23:05:37.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.762+0000 7fe8016ee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b1788f0 0x55658b26e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.762+0000 7fe8016ee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b1788f0 0x55658b26e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58450/0 (socket says 172.21.15.164:58450) 2024-09-13T23:05:37.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.762+0000 7fe8016ee640 1 -- 172.21.15.164:0/2143329028 learned_addr learned my addr 172.21.15.164:0/2143329028 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.762+0000 7fe8016ee640 1 -- 172.21.15.164:0/2143329028 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55658b022fe0 con 0x55658b1788f0 2024-09-13T23:05:37.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.762+0000 7fe8016ee640 1 --2- 172.21.15.164:0/2143329028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b1788f0 0x55658b26e640 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc00d540 tx=0x7fe7fc001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.762+0000 7fe6ede03640 1 -- 172.21.15.164:0/2143329028 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7fc00b700 con 0x55658b1788f0 2024-09-13T23:05:37.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.762+0000 7fe6ede03640 1 -- 172.21.15.164:0/2143329028 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7fc00b8a0 con 0x55658b1788f0 2024-09-13T23:05:37.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.762+0000 7fe805935800 1 -- 172.21.15.164:0/2143329028 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55658b26eb80 con 0x55658b1788f0 2024-09-13T23:05:37.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.762+0000 7fe6ede03640 1 -- 172.21.15.164:0/2143329028 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7fc00bbc0 con 0x55658b1788f0 2024-09-13T23:05:37.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.763+0000 7fe805935800 1 -- 172.21.15.164:0/2143329028 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55658b26f0a0 con 0x55658b1788f0 2024-09-13T23:05:37.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.763+0000 7fe6ede03640 1 -- 172.21.15.164:0/2143329028 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe7fc017070 con 0x55658b1788f0 2024-09-13T23:05:37.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.763+0000 7fe6ede03640 1 --2- 172.21.15.164:0/2143329028 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe6e8036b90 0x7fe6e8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.763+0000 7fe6ede03640 1 -- 172.21.15.164:0/2143329028 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fe7fc021030 con 0x55658b1788f0 2024-09-13T23:05:37.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.764+0000 7fe800eed640 1 --2- 172.21.15.164:0/2143329028 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe6e8036b90 0x7fe6e8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.764+0000 7fe805935800 1 --2- 172.21.15.164:0/2143329028 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55658b2736a0 0x55658b275a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.764+0000 7fe805935800 1 -- 172.21.15.164:0/2143329028 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55658b275fd0 con 0x55658b2736a0 2024-09-13T23:05:37.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.764+0000 7fe801eef640 1 --2- 172.21.15.164:0/2143329028 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55658b2736a0 0x55658b275a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.764+0000 7fe800eed640 1 --2- 172.21.15.164:0/2143329028 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe6e8036b90 0x7fe6e8039050 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec057000 tx=0x7fe7ec052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.764+0000 7fe801eef640 1 --2- 172.21.15.164:0/2143329028 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55658b2736a0 0x55658b275a90 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.764+0000 7fe801eef640 1 -- 172.21.15.164:0/2143329028 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe7f40083e0 con 0x55658b2736a0 2024-09-13T23:05:37.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.764+0000 7fe805935800 1 -- 172.21.15.164:0/2143329028 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55658b272c40 con 0x55658b2736a0 2024-09-13T23:05:37.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.765+0000 7fe801eef640 1 -- 172.21.15.164:0/2143329028 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe7f40083e0 con 0x55658b2736a0 2024-09-13T23:05:37.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.765+0000 7fe805935800 1 -- 172.21.15.164:0/2143329028 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55658b277d60 con 0x55658b2736a0 2024-09-13T23:05:37.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.765+0000 7fe801eef640 1 -- 172.21.15.164:0/2143329028 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe7f40083e0 con 0x55658b2736a0 2024-09-13T23:05:37.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.765+0000 7fe805935800 1 -- 172.21.15.164:0/2143329028 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55658b276f90 con 0x55658b2736a0 2024-09-13T23:05:37.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.765+0000 7fe801eef640 1 -- 172.21.15.164:0/2143329028 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe7f40083e0 con 0x55658b2736a0 2024-09-13T23:05:37.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.765+0000 7fe805935800 1 -- 172.21.15.164:0/2143329028 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55658b277380 con 0x55658b2736a0 2024-09-13T23:05:37.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.765+0000 7fe801eef640 1 -- 172.21.15.164:0/2143329028 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe7f40083e0 con 0x55658b2736a0 2024-09-13T23:05:37.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.766+0000 7fe805935800 1 Processor -- start 2024-09-13T23:05:37.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.766+0000 7fe805935800 1 -- start start 2024-09-13T23:05:37.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.766+0000 7fe805935800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b286350 0x55658b286770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.766+0000 7fe805935800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55658b010580 con 0x55658b286350 2024-09-13T23:05:37.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.766+0000 7fe800eed640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b286350 0x55658b286770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.766+0000 7fe800eed640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b286350 0x55658b286770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58456/0 (socket says 172.21.15.164:58456) 2024-09-13T23:05:37.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.766+0000 7fe800eed640 1 -- 172.21.15.164:0/2562877605 learned_addr learned my addr 172.21.15.164:0/2562877605 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.766+0000 7fe800eed640 1 -- 172.21.15.164:0/2562877605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55658b286cb0 con 0x55658b286350 2024-09-13T23:05:37.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.767+0000 7fe800eed640 1 --2- 172.21.15.164:0/2562877605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b286350 0x55658b286770 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec045f50 tx=0x7fe7ec002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.767+0000 7fe6e6ffd640 1 -- 172.21.15.164:0/2562877605 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7ec06f070 con 0x55658b286350 2024-09-13T23:05:37.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.767+0000 7fe6e6ffd640 1 -- 172.21.15.164:0/2562877605 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7ec05f550 con 0x55658b286350 2024-09-13T23:05:37.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.767+0000 7fe805935800 1 -- 172.21.15.164:0/2562877605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55658b286ee0 con 0x55658b286350 2024-09-13T23:05:37.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.767+0000 7fe6e6ffd640 1 -- 172.21.15.164:0/2562877605 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7ec05f830 con 0x55658b286350 2024-09-13T23:05:37.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.767+0000 7fe805935800 1 -- 172.21.15.164:0/2562877605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55658b289b60 con 0x55658b286350 2024-09-13T23:05:37.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.767+0000 7fe6e6ffd640 1 -- 172.21.15.164:0/2562877605 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe7ec05f9d0 con 0x55658b286350 2024-09-13T23:05:37.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.768+0000 7fe6e6ffd640 1 --2- 172.21.15.164:0/2562877605 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe6d8036b90 0x7fe6d8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.768+0000 7fe6e6ffd640 1 -- 172.21.15.164:0/2562877605 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fe7ec092d10 con 0x55658b286350 2024-09-13T23:05:37.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.768+0000 7fe801eef640 1 --2- 172.21.15.164:0/2562877605 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe6d8036b90 0x7fe6d8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.768+0000 7fe805935800 1 Processor -- start 2024-09-13T23:05:37.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.768+0000 7fe801eef640 1 --2- 172.21.15.164:0/2562877605 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe6d8036b90 0x7fe6d8039050 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55658b276ab0 tx=0x7fe7f4000f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.768+0000 7fe805935800 1 -- start start 2024-09-13T23:05:37.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.768+0000 7fe805935800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b292ef0 0x55658b2932f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.768+0000 7fe805935800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55658b263ef0 con 0x55658b292ef0 2024-09-13T23:05:37.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.769+0000 7fe800eed640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b292ef0 0x55658b2932f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.769+0000 7fe800eed640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b292ef0 0x55658b2932f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58470/0 (socket says 172.21.15.164:58470) 2024-09-13T23:05:37.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.769+0000 7fe800eed640 1 -- 172.21.15.164:0/525625029 learned_addr learned my addr 172.21.15.164:0/525625029 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.769+0000 7fe800eed640 1 -- 172.21.15.164:0/525625029 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55658b2938c0 con 0x55658b292ef0 2024-09-13T23:05:37.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.769+0000 7fe800eed640 1 --2- 172.21.15.164:0/525625029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b292ef0 0x55658b2932f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec053da0 tx=0x7fe7ec07cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d17939f596723e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.769+0000 7fe6e4ff9640 1 -- 172.21.15.164:0/525625029 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7ec080070 con 0x55658b292ef0 2024-09-13T23:05:37.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.769+0000 7fe6e4ff9640 1 -- 172.21.15.164:0/525625029 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7ec05fcc0 con 0x55658b292ef0 2024-09-13T23:05:37.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.769+0000 7fe6e4ff9640 1 -- 172.21.15.164:0/525625029 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7ec06a3a0 con 0x55658b292ef0 2024-09-13T23:05:37.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.770+0000 7fe805935800 1 -- 172.21.15.164:0/525625029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b292ef0 msgr2=0x55658b2932f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.770+0000 7fe805935800 1 --2- 172.21.15.164:0/525625029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b292ef0 0x55658b2932f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec053da0 tx=0x7fe7ec07cea0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.770+0000 7fe805935800 1 -- 172.21.15.164:0/525625029 shutdown_connections 2024-09-13T23:05:37.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.770+0000 7fe805935800 1 --2- 172.21.15.164:0/525625029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b292ef0 0x55658b2932f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.770+0000 7fe805935800 1 -- 172.21.15.164:0/525625029 >> 172.21.15.164:0/525625029 conn(0x55658b28f250 msgr2=0x55658b28d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.770+0000 7fe805935800 1 -- 172.21.15.164:0/525625029 shutdown_connections 2024-09-13T23:05:37.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.770+0000 7fe805935800 1 -- 172.21.15.164:0/525625029 wait complete. 2024-09-13T23:05:37.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.770+0000 7fe805935800 1 Processor -- start 2024-09-13T23:05:37.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.770+0000 7fe805935800 1 -- start start 2024-09-13T23:05:37.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.770+0000 7fe805935800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b292ef0 0x55658b29a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.770+0000 7fe805935800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55658b293f30 con 0x55658b292ef0 2024-09-13T23:05:37.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.770+0000 7fe800eed640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b292ef0 0x55658b29a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.770+0000 7fe800eed640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b292ef0 0x55658b29a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58486/0 (socket says 172.21.15.164:58486) 2024-09-13T23:05:37.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.770+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 learned_addr learned my addr 172.21.15.164:0/1317034707 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.771+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55658b29a8f0 con 0x55658b292ef0 2024-09-13T23:05:37.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.771+0000 7fe800eed640 1 --2- 172.21.15.164:0/1317034707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b292ef0 0x55658b29a3b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec06bfd0 tx=0x7fe7ec091010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.771+0000 7fe6d6ffd640 1 -- 172.21.15.164:0/1317034707 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7ec06a720 con 0x55658b292ef0 2024-09-13T23:05:37.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.771+0000 7fe6d6ffd640 1 -- 172.21.15.164:0/1317034707 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7ec096070 con 0x55658b292ef0 2024-09-13T23:05:37.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.771+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55658b29ab80 con 0x55658b292ef0 2024-09-13T23:05:37.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.771+0000 7fe6d6ffd640 1 -- 172.21.15.164:0/1317034707 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7ec06aa30 con 0x55658b292ef0 2024-09-13T23:05:37.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.771+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55658b29d830 con 0x55658b292ef0 2024-09-13T23:05:37.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.772+0000 7fe6d6ffd640 1 -- 172.21.15.164:0/1317034707 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe7ec083070 con 0x55658b292ef0 2024-09-13T23:05:37.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.772+0000 7fe6d6ffd640 1 --2- 172.21.15.164:0/1317034707 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe6cc036b90 0x7fe6cc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.772+0000 7fe6d6ffd640 1 -- 172.21.15.164:0/1317034707 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fe7ec0890c0 con 0x55658b292ef0 2024-09-13T23:05:37.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.772+0000 7fe801eef640 1 --2- 172.21.15.164:0/1317034707 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe6cc036b90 0x7fe6cc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.772+0000 7fe805935800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.772+0000 7fe805935800 1 --2- 172.21.15.164:0/1317034707 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55658b2a5e30 0x55658b2a82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.772+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55658b2a8a40 con 0x55658b2a5e30 2024-09-13T23:05:37.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.773+0000 7fe8016ee640 1 --2- 172.21.15.164:0/1317034707 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55658b2a5e30 0x55658b2a82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.773+0000 7fe801eef640 1 --2- 172.21.15.164:0/1317034707 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe6cc036b90 0x7fe6cc039050 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe7f400f010 tx=0x7fe7f400c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.773+0000 7fe8016ee640 1 --2- 172.21.15.164:0/1317034707 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55658b2a5e30 0x55658b2a82f0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.773+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.773+0000 7fe805935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.773+0000 7fe805935800 20 realm 2024-09-13T23:05:37.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.773+0000 7fe805935800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.773+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55658b2a8e50 con 0x55658b2a5e30 2024-09-13T23:05:37.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.773+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.773+0000 7fe805935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.773+0000 7fe805935800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:37.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.773+0000 7fe805935800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.773+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55658b2a9720 con 0x55658b2a5e30 2024-09-13T23:05:37.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.774+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.774+0000 7fe805935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.774+0000 7fe805935800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.774+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55658b2a9ac0 con 0x55658b2a5e30 2024-09-13T23:05:37.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.774+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.774+0000 7fe805935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:37.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.774+0000 7fe805935800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.774+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55658b2a9f20 con 0x55658b2a5e30 2024-09-13T23:05:37.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.774+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.774+0000 7fe805935800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:37.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.774+0000 7fe805935800 20 searching for the correct realm 2024-09-13T23:05:37.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.774+0000 7fe805935800 1 --2- 172.21.15.164:0/1317034707 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55658b2abf70 0x55658b2ae360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.774+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2abf70 2024-09-13T23:05:37.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.774+0000 7fe800eed640 1 --2- 172.21.15.164:0/1317034707 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55658b2abf70 0x55658b2ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.774+0000 7fe800eed640 1 --2- 172.21.15.164:0/1317034707 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55658b2abf70 0x55658b2ae360 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.775+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7ec082030 con 0x55658b2abf70 2024-09-13T23:05:37.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.775+0000 7fe800eed640 1 --2- 172.21.15.164:0/1317034707 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fe7ec085070 0x7fe7ec095500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.775+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x7fe7ec085070 2024-09-13T23:05:37.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.775+0000 7fe801eef640 1 --2- 172.21.15.164:0/1317034707 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fe7ec085070 0x7fe7ec095500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.775+0000 7fe801eef640 1 --2- 172.21.15.164:0/1317034707 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fe7ec085070 0x7fe7ec095500 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.775+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7f402f040 con 0x7fe7ec085070 2024-09-13T23:05:37.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.775+0000 7fe801eef640 1 --2- 172.21.15.164:0/1317034707 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fe7f4019040 0x7fe7f4019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.775+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x7fe7f4019040 2024-09-13T23:05:37.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.776+0000 7fe8016ee640 1 --2- 172.21.15.164:0/1317034707 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fe7f4019040 0x7fe7f4019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.776+0000 7fe8016ee640 1 --2- 172.21.15.164:0/1317034707 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fe7f4019040 0x7fe7f4019930 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.776+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7fc016030 con 0x7fe7f4019040 2024-09-13T23:05:37.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.776+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2a5e30 2024-09-13T23:05:37.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.777+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.777+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2a5e30 2024-09-13T23:05:37.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.777+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.777+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x7fe7f4019040 2024-09-13T23:05:37.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.777+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7fc016030 con 0x7fe7f4019040 2024-09-13T23:05:37.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.777+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x7fe7f4019040 2024-09-13T23:05:37.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.777+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7fc016030 con 0x7fe7f4019040 2024-09-13T23:05:37.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.777+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x7fe7ec085070 2024-09-13T23:05:37.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.777+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7f402f040 con 0x7fe7ec085070 2024-09-13T23:05:37.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.777+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2abf70 2024-09-13T23:05:37.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.778+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7ec082030 con 0x55658b2abf70 2024-09-13T23:05:37.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.778+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2a5e30 2024-09-13T23:05:37.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.778+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.778+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x7fe7f4019040 2024-09-13T23:05:37.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.778+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7fc016030 con 0x7fe7f4019040 2024-09-13T23:05:37.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.778+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2a5e30 2024-09-13T23:05:37.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.778+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.778+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x7fe7ec085070 2024-09-13T23:05:37.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.779+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe7f402f040 con 0x7fe7ec085070 2024-09-13T23:05:37.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.779+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2abf70 2024-09-13T23:05:37.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.779+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7ec082030 con 0x55658b2abf70 2024-09-13T23:05:37.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.779+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2abf70 2024-09-13T23:05:37.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.779+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7ec082030 con 0x55658b2abf70 2024-09-13T23:05:37.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.779+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x7fe7f4019040 2024-09-13T23:05:37.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.779+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7fc016030 con 0x7fe7f4019040 2024-09-13T23:05:37.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.779+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2abf70 2024-09-13T23:05:37.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.780+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7ec082030 con 0x55658b2abf70 2024-09-13T23:05:37.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.780+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2abf70 2024-09-13T23:05:37.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.780+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7ec082030 con 0x55658b2abf70 2024-09-13T23:05:37.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.780+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2a5e30 2024-09-13T23:05:37.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.780+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.780+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2a5e30 2024-09-13T23:05:37.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.780+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.780+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x7fe7f4019040 2024-09-13T23:05:37.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.780+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7fc016030 con 0x7fe7f4019040 2024-09-13T23:05:37.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.780+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2abf70 2024-09-13T23:05:37.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.781+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7ec082030 con 0x55658b2abf70 2024-09-13T23:05:37.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.781+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x7fe7ec085070 2024-09-13T23:05:37.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.781+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7f402f040 con 0x7fe7ec085070 2024-09-13T23:05:37.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.781+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2a5e30 2024-09-13T23:05:37.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.781+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.781+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x7fe7f4019040 2024-09-13T23:05:37.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.781+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7fc016030 con 0x7fe7f4019040 2024-09-13T23:05:37.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.781+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2abf70 2024-09-13T23:05:37.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.782+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7ec082030 con 0x55658b2abf70 2024-09-13T23:05:37.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.782+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x7fe7f4019040 2024-09-13T23:05:37.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.782+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7fc016030 con 0x7fe7f4019040 2024-09-13T23:05:37.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.782+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x7fe7ec085070 2024-09-13T23:05:37.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.782+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7f402f040 con 0x7fe7ec085070 2024-09-13T23:05:37.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.782+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2abf70 2024-09-13T23:05:37.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.782+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7ec082030 con 0x55658b2abf70 2024-09-13T23:05:37.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.782+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x7fe7f4019040 2024-09-13T23:05:37.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.783+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7fc016030 con 0x7fe7f4019040 2024-09-13T23:05:37.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.783+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2a5e30 2024-09-13T23:05:37.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.783+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.783+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x7fe7ec085070 2024-09-13T23:05:37.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.783+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7f402f040 con 0x7fe7ec085070 2024-09-13T23:05:37.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.783+0000 7fe805935800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:37.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.783+0000 7fe805935800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:37.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.783+0000 7fe805935800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:37.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.783+0000 7fe805935800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:37.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.783+0000 7fe805935800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:37.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.783+0000 7fe805935800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:37.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.783+0000 7fe805935800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.783+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aa9f0 con 0x55658b2a5e30 2024-09-13T23:05:37.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.784+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.784+0000 7fe805935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.784+0000 7fe805935800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.784+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55658b2ab290 con 0x55658b2a5e30 2024-09-13T23:05:37.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.784+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.784+0000 7fe805935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:37.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.784+0000 7fe805935800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.784+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aa630 con 0x55658b2a5e30 2024-09-13T23:05:37.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.784+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.784+0000 7fe805935800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:37.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.784+0000 7fe805935800 20 zone default found 2024-09-13T23:05:37.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.784+0000 7fe805935800 4 Realm: () 2024-09-13T23:05:37.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.784+0000 7fe805935800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:37.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.784+0000 7fe805935800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:37.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.784+0000 7fe805935800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:37.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.784+0000 7fe805935800 20 zonegroup default 2024-09-13T23:05:37.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.784+0000 7fe805935800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.784+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aee90 con 0x7fe7f4019040 2024-09-13T23:05:37.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.785+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe7fc016030 con 0x7fe7f4019040 2024-09-13T23:05:37.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.785+0000 7fe805935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.785+0000 7fe805935800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.785+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55658b2b0d20 con 0x55658b2abf70 2024-09-13T23:05:37.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.785+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe7ec082030 con 0x55658b2abf70 2024-09-13T23:05:37.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.785+0000 7fe805935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.785+0000 7fe805935800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.785+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55658b2b10c0 con 0x55658b2abf70 2024-09-13T23:05:37.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.785+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe7ec082030 con 0x55658b2abf70 2024-09-13T23:05:37.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.785+0000 7fe805935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.785+0000 7fe805935800 20 started sync module instance, tier type = 2024-09-13T23:05:37.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.785+0000 7fe805935800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:37.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.785+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55658b2b0160 con 0x7fe7ec085070 2024-09-13T23:05:37.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.786+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7f402f040 con 0x7fe7ec085070 2024-09-13T23:05:37.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.786+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93894614910640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55658b2b0160 con 0x7fe7ec085070 2024-09-13T23:05:37.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.786+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55658b2b1a80 con 0x55658b2a5e30 2024-09-13T23:05:37.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.787+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.787+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93894614914512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55658b2b1a30 con 0x55658b2a5e30 2024-09-13T23:05:37.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.787+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55658b2b2a40 con 0x55658b2abf70 2024-09-13T23:05:37.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.787+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93894614910640] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7f402f040 con 0x7fe7ec085070 2024-09-13T23:05:37.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.788+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93894614914512] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.789+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7ec082030 con 0x55658b2abf70 2024-09-13T23:05:37.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.789+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93894614918384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55658b2b1e70 con 0x55658b2abf70 2024-09-13T23:05:37.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.789+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55658b2b32e0 con 0x7fe7ec085070 2024-09-13T23:05:37.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.790+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93894614918384] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7ec082030 con 0x55658b2abf70 2024-09-13T23:05:37.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.790+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7f402f040 con 0x7fe7ec085070 2024-09-13T23:05:37.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.790+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93894614920752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55658b2b3250 con 0x7fe7ec085070 2024-09-13T23:05:37.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.790+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55658b2b41d0 con 0x55658b2a5e30 2024-09-13T23:05:37.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.791+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93894614920752] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7f402f040 con 0x7fe7ec085070 2024-09-13T23:05:37.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.791+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.791+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93894614923008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55658b2b41d0 con 0x55658b2a5e30 2024-09-13T23:05:37.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.791+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55658b2b4bd0 con 0x7fe7f4019040 2024-09-13T23:05:37.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.792+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7fc016030 con 0x7fe7f4019040 2024-09-13T23:05:37.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.792+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93894614927072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55658b2b4b00 con 0x7fe7f4019040 2024-09-13T23:05:37.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.792+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93894614923008] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.792+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55658b2b3d40 con 0x7fe7f4019040 2024-09-13T23:05:37.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.793+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93894614927072] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7fc016030 con 0x7fe7f4019040 2024-09-13T23:05:37.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.793+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7fc016030 con 0x7fe7f4019040 2024-09-13T23:05:37.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.793+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93894614924608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55658b2b5610 con 0x7fe7f4019040 2024-09-13T23:05:37.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.793+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55658b2b5fd0 con 0x7fe7f4019040 2024-09-13T23:05:37.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.794+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93894614924608] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7fc016030 con 0x7fe7f4019040 2024-09-13T23:05:37.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.794+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7fc016030 con 0x7fe7f4019040 2024-09-13T23:05:37.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.794+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93894614929264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55658b2b5fd0 con 0x7fe7f4019040 2024-09-13T23:05:37.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.794+0000 7fe805935800 20 add_watcher() i=0 2024-09-13T23:05:37.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.794+0000 7fe805935800 20 add_watcher() i=1 2024-09-13T23:05:37.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.794+0000 7fe805935800 20 add_watcher() i=2 2024-09-13T23:05:37.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.794+0000 7fe805935800 20 add_watcher() i=3 2024-09-13T23:05:37.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.794+0000 7fe805935800 20 add_watcher() i=4 2024-09-13T23:05:37.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.794+0000 7fe805935800 20 add_watcher() i=5 2024-09-13T23:05:37.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.794+0000 7fe805935800 20 add_watcher() i=6 2024-09-13T23:05:37.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.795+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93894614929264] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7fc016030 con 0x7fe7f4019040 2024-09-13T23:05:37.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.796+0000 7fe805935800 20 add_watcher() i=7 2024-09-13T23:05:37.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.796+0000 7fe805935800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:37.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.796+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55658b2b93f0 con 0x55658b2a5e30 2024-09-13T23:05:37.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.796+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.796+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93894614932720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55658b2b68a0 con 0x55658b2a5e30 2024-09-13T23:05:37.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.797+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93894614932720] v32'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.797+0000 7fe6b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:37.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.797+0000 7fe805935800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:37.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.797+0000 7fe805935800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:37.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.797+0000 7fe805935800 5 note: GC not initialized 2024-09-13T23:05:37.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.797+0000 7fe6b67e4640 20 reqs_thread_entry: start 2024-09-13T23:05:37.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.797+0000 7fe805935800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:37.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.797+0000 7fe805935800 20 Filter name: none 2024-09-13T23:05:37.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.798+0000 7fe627fff640 20 reqs_thread_entry: start 2024-09-13T23:05:37.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.798+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2ebc50 con 0x7fe7f4019040 2024-09-13T23:05:37.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.798+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(62 [pgnls start_epoch 32 out=254b] v32'34 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fe7fc016030 con 0x7fe7f4019040 2024-09-13T23:05:37.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.798+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2ab290 con 0x7fe7f4019040 2024-09-13T23:05:37.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.799+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(63 [pgnls start_epoch 32 out=131b] v32'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fe7fc016030 con 0x7fe7f4019040 2024-09-13T23:05:37.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.799+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2ab290 con 0x55658b2abf70 2024-09-13T23:05:37.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.799+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fe7ec082030 con 0x55658b2abf70 2024-09-13T23:05:37.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.799+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2ab290 con 0x7fe7f4019040 2024-09-13T23:05:37.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.799+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(65 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fe7fc016030 con 0x7fe7f4019040 2024-09-13T23:05:37.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.799+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2ab290 con 0x55658b2a5e30 2024-09-13T23:05:37.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.799+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(66 [pgnls start_epoch 32 out=335b] v32'146 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.799+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2ab290 con 0x7fe7ec085070 2024-09-13T23:05:37.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.800+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(67 [pgnls start_epoch 32 out=213b] v32'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fe7f402f040 con 0x7fe7ec085070 2024-09-13T23:05:37.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.800+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2abf70 2024-09-13T23:05:37.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.800+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(68 [pgnls start_epoch 32 out=254b] v32'11 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fe7ec082030 con 0x55658b2abf70 2024-09-13T23:05:37.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.800+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2abf70 2024-09-13T23:05:37.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.800+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(69 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fe7ec082030 con 0x55658b2abf70 2024-09-13T23:05:37.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.800+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2abf70 2024-09-13T23:05:37.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.801+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(70 [pgnls start_epoch 32 out=213b] v32'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fe7ec082030 con 0x55658b2abf70 2024-09-13T23:05:37.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.801+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x7fe7ec085070 2024-09-13T23:05:37.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.801+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(71 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fe7f402f040 con 0x7fe7ec085070 2024-09-13T23:05:37.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.801+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x7fe7ec085070 2024-09-13T23:05:37.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.801+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(72 [pgnls start_epoch 32 out=336b] v32'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7fe7f402f040 con 0x7fe7ec085070 2024-09-13T23:05:37.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.801+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2abf70 2024-09-13T23:05:37.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.801+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(73 [pgnls start_epoch 32 out=131b] v32'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fe7ec082030 con 0x55658b2abf70 2024-09-13T23:05:37.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.801+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2abf70 2024-09-13T23:05:37.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.802+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(74 [pgnls start_epoch 32 out=254b] v32'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fe7ec082030 con 0x55658b2abf70 2024-09-13T23:05:37.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.802+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2abf70 2024-09-13T23:05:37.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.802+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(75 [pgnls start_epoch 32 out=90b] v32'17 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fe7ec082030 con 0x55658b2abf70 2024-09-13T23:05:37.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.802+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2a5e30 2024-09-13T23:05:37.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.802+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(76 [pgnls start_epoch 32 out=213b] v32'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.802+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2abf70 2024-09-13T23:05:37.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.803+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 <== osd.3 v2:172.21.15.164:6816/93809510 21 ==== osd_op_reply(77 [pgnls start_epoch 32 out=254b] v32'11 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fe7ec082030 con 0x55658b2abf70 2024-09-13T23:05:37.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.803+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2a5e30 2024-09-13T23:05:37.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.803+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(78 [pgnls start_epoch 32 out=254b] v32'15 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.803+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2abf70 2024-09-13T23:05:37.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.803+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 <== osd.3 v2:172.21.15.164:6816/93809510 22 ==== osd_op_reply(79 [pgnls start_epoch 32 out=213b] v32'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fe7ec082030 con 0x55658b2abf70 2024-09-13T23:05:37.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.803+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2abf70 2024-09-13T23:05:37.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.803+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 <== osd.3 v2:172.21.15.164:6816/93809510 23 ==== osd_op_reply(80 [pgnls start_epoch 32 out=172b] v32'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fe7ec082030 con 0x55658b2abf70 2024-09-13T23:05:37.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.803+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2a5e30 2024-09-13T23:05:37.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.804+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(81 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.804+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x7fe7ec085070 2024-09-13T23:05:37.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.804+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(82 [pgnls start_epoch 32 out=276b] v32'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7fe7f402f040 con 0x7fe7ec085070 2024-09-13T23:05:37.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.804+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x7fe7ec085070 2024-09-13T23:05:37.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.804+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(83 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fe7f402f040 con 0x7fe7ec085070 2024-09-13T23:05:37.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.804+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2a5e30 2024-09-13T23:05:37.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.805+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(84 [pgnls start_epoch 32 out=295b] v32'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.805+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x7fe7f4019040 2024-09-13T23:05:37.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.805+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(85 [pgnls start_epoch 32 out=172b] v32'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fe7fc016030 con 0x7fe7f4019040 2024-09-13T23:05:37.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.805+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x7fe7ec085070 2024-09-13T23:05:37.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.806+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(86 [pgnls start_epoch 32 out=213b] v32'43 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fe7f402f040 con 0x7fe7ec085070 2024-09-13T23:05:37.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.806+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x7fe7f4019040 2024-09-13T23:05:37.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.806+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(87 [pgnls start_epoch 32 out=172b] v32'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fe7fc016030 con 0x7fe7f4019040 2024-09-13T23:05:37.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.806+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2abf70 2024-09-13T23:05:37.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.807+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 <== osd.3 v2:172.21.15.164:6816/93809510 24 ==== osd_op_reply(88 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fe7ec082030 con 0x55658b2abf70 2024-09-13T23:05:37.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.807+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2abf70 2024-09-13T23:05:37.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.807+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 <== osd.3 v2:172.21.15.164:6816/93809510 25 ==== osd_op_reply(89 [pgnls start_epoch 32 out=90b] v32'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fe7ec082030 con 0x55658b2abf70 2024-09-13T23:05:37.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.807+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2abf70 2024-09-13T23:05:37.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.807+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 <== osd.3 v2:172.21.15.164:6816/93809510 26 ==== osd_op_reply(90 [pgnls start_epoch 32 out=90b] v32'37 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fe7ec082030 con 0x55658b2abf70 2024-09-13T23:05:37.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.807+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x55658b2a5e30 2024-09-13T23:05:37.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.807+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(91 [pgnls start_epoch 32 out=131b] v32'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.807+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x7fe7ec085070 2024-09-13T23:05:37.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.808+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== osd_op_reply(92 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fe7f402f040 con 0x7fe7ec085070 2024-09-13T23:05:37.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.808+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55658b2aea10 con 0x7fe7f4019040 2024-09-13T23:05:37.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.808+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(93 [pgnls start_epoch 32 out=213b] v32'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fe7fc016030 con 0x7fe7f4019040 2024-09-13T23:05:37.824 INFO:teuthology.orchestra.run.smithi164.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-09-13T23:05:37.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.810+0000 7fe6b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:37.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.810+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93894614932720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55658b2ab290 con 0x55658b2a5e30 2024-09-13T23:05:37.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.811+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93894614932720] v32'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.811+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93894614910640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55658b2ab290 con 0x7fe7ec085070 2024-09-13T23:05:37.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.812+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 <== osd.2 v2:172.21.15.164:6808/3795914978 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93894614910640] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7f402f040 con 0x7fe7ec085070 2024-09-13T23:05:37.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.812+0000 7fe805935800 20 remove_watcher() i=0 2024-09-13T23:05:37.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.812+0000 7fe805935800 2 removed watcher, disabling cache 2024-09-13T23:05:37.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.812+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93894614914512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55658b2ab290 con 0x55658b2a5e30 2024-09-13T23:05:37.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.813+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93894614914512] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.813+0000 7fe805935800 20 remove_watcher() i=1 2024-09-13T23:05:37.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.813+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93894614918384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55658b2ab290 con 0x55658b2abf70 2024-09-13T23:05:37.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.815+0000 7fe800eed640 1 -- 172.21.15.164:0/1317034707 <== osd.3 v2:172.21.15.164:6816/93809510 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93894614918384] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7ec082030 con 0x55658b2abf70 2024-09-13T23:05:37.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.815+0000 7fe805935800 20 remove_watcher() i=2 2024-09-13T23:05:37.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.815+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93894614920752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55658b2ea0e0 con 0x7fe7ec085070 2024-09-13T23:05:37.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.815+0000 7fe801eef640 1 -- 172.21.15.164:0/1317034707 <== osd.2 v2:172.21.15.164:6808/3795914978 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93894614920752] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7f402f040 con 0x7fe7ec085070 2024-09-13T23:05:37.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.815+0000 7fe805935800 20 remove_watcher() i=3 2024-09-13T23:05:37.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.816+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93894614923008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55658b2ea0e0 con 0x55658b2a5e30 2024-09-13T23:05:37.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.817+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93894614923008] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7fc016030 con 0x55658b2a5e30 2024-09-13T23:05:37.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.817+0000 7fe805935800 20 remove_watcher() i=4 2024-09-13T23:05:37.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.817+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93894614927072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55658b2ea0e0 con 0x7fe7f4019040 2024-09-13T23:05:37.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.818+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93894614927072] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7fc016030 con 0x7fe7f4019040 2024-09-13T23:05:37.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.818+0000 7fe805935800 20 remove_watcher() i=5 2024-09-13T23:05:37.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.818+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93894614924608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55658b2ea0e0 con 0x7fe7f4019040 2024-09-13T23:05:37.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.819+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93894614924608] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7fc016030 con 0x7fe7f4019040 2024-09-13T23:05:37.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.819+0000 7fe805935800 20 remove_watcher() i=6 2024-09-13T23:05:37.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.819+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93894614929264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55658b2ea0e0 con 0x7fe7f4019040 2024-09-13T23:05:37.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93894614929264] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7fc016030 con 0x7fe7f4019040 2024-09-13T23:05:37.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe805935800 20 remove_watcher() i=7 2024-09-13T23:05:37.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fe7f4019040 msgr2=0x7fe7f4019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe805935800 1 --2- 172.21.15.164:0/1317034707 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fe7f4019040 0x7fe7f4019930 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55658b2a5e30 msgr2=0x55658b2a82f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe805935800 1 --2- 172.21.15.164:0/1317034707 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55658b2a5e30 0x55658b2a82f0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fe7ec085070 msgr2=0x7fe7ec095500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe805935800 1 --2- 172.21.15.164:0/1317034707 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fe7ec085070 0x7fe7ec095500 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55658b2abf70 msgr2=0x55658b2ae360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe805935800 1 --2- 172.21.15.164:0/1317034707 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55658b2abf70 0x55658b2ae360 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe6cc036b90 msgr2=0x7fe6cc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe805935800 1 --2- 172.21.15.164:0/1317034707 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe6cc036b90 0x7fe6cc039050 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe7f400f010 tx=0x7fe7f400c040 comp rx=0 tx=0).stop 2024-09-13T23:05:37.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b292ef0 msgr2=0x55658b29a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe8016ee640 1 -- 172.21.15.164:0/1317034707 reap_dead start 2024-09-13T23:05:37.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe805935800 1 --2- 172.21.15.164:0/1317034707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b292ef0 0x55658b29a3b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec06bfd0 tx=0x7fe7ec091010 comp rx=0 tx=0).stop 2024-09-13T23:05:37.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 shutdown_connections 2024-09-13T23:05:37.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe805935800 1 --2- 172.21.15.164:0/1317034707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b292ef0 0x55658b29a3b0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 >> 172.21.15.164:0/1317034707 conn(0x55658b28f250 msgr2=0x55658b28d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 shutdown_connections 2024-09-13T23:05:37.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe805935800 1 -- 172.21.15.164:0/1317034707 wait complete. 2024-09-13T23:05:37.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe805935800 1 -- 172.21.15.164:0/2562877605 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe6d8036b90 msgr2=0x7fe6d8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe805935800 1 --2- 172.21.15.164:0/2562877605 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe6d8036b90 0x7fe6d8039050 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55658b276ab0 tx=0x7fe7f4000f90 comp rx=0 tx=0).stop 2024-09-13T23:05:37.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe805935800 1 -- 172.21.15.164:0/2562877605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b286350 msgr2=0x55658b286770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe805935800 1 --2- 172.21.15.164:0/2562877605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b286350 0x55658b286770 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec045f50 tx=0x7fe7ec002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe805935800 1 -- 172.21.15.164:0/2562877605 shutdown_connections 2024-09-13T23:05:37.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe805935800 1 --2- 172.21.15.164:0/2562877605 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe6d8036b90 0x7fe6d8039050 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe805935800 1 --2- 172.21.15.164:0/2562877605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b286350 0x55658b286770 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe805935800 1 -- 172.21.15.164:0/2562877605 >> 172.21.15.164:0/2562877605 conn(0x55658b27b2e0 msgr2=0x55658b27de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe805935800 1 -- 172.21.15.164:0/2562877605 shutdown_connections 2024-09-13T23:05:37.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.820+0000 7fe805935800 1 -- 172.21.15.164:0/2562877605 wait complete. 2024-09-13T23:05:37.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.821+0000 7fe805935800 1 -- 172.21.15.164:0/2143329028 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55658b2736a0 msgr2=0x55658b275a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.821+0000 7fe805935800 1 --2- 172.21.15.164:0/2143329028 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55658b2736a0 0x55658b275a90 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.821+0000 7fe805935800 1 -- 172.21.15.164:0/2143329028 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe6e8036b90 msgr2=0x7fe6e8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.821+0000 7fe805935800 1 --2- 172.21.15.164:0/2143329028 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe6e8036b90 0x7fe6e8039050 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec057000 tx=0x7fe7ec052000 comp rx=0 tx=0).stop 2024-09-13T23:05:37.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.821+0000 7fe805935800 1 -- 172.21.15.164:0/2143329028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b1788f0 msgr2=0x55658b26e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.821+0000 7fe805935800 1 --2- 172.21.15.164:0/2143329028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b1788f0 0x55658b26e640 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc00d540 tx=0x7fe7fc001250 comp rx=0 tx=0).stop 2024-09-13T23:05:37.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.821+0000 7fe805935800 1 -- 172.21.15.164:0/2143329028 shutdown_connections 2024-09-13T23:05:37.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.821+0000 7fe805935800 1 --2- 172.21.15.164:0/2143329028 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55658b2736a0 0x55658b275a90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.821+0000 7fe805935800 1 --2- 172.21.15.164:0/2143329028 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe6e8036b90 0x7fe6e8039050 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.821+0000 7fe805935800 1 --2- 172.21.15.164:0/2143329028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658b1788f0 0x55658b26e640 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.821+0000 7fe805935800 1 -- 172.21.15.164:0/2143329028 >> 172.21.15.164:0/2143329028 conn(0x55658b16fde0 msgr2=0x55658b25d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.821+0000 7fe805935800 1 -- 172.21.15.164:0/2143329028 shutdown_connections 2024-09-13T23:05:37.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.821+0000 7fe805935800 1 -- 172.21.15.164:0/2143329028 wait complete. 2024-09-13T23:05:37.836 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-13T23:05:37.836 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-13T23:05:37.837 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-13T23:05:37.837 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-13T23:05:37.921 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:37.921 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:37.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.920+0000 7f04de13e800 1 Processor -- start 2024-09-13T23:05:37.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.920+0000 7f04de13e800 1 -- start start 2024-09-13T23:05:37.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.920+0000 7f04de13e800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55decad8e990 0x55decad90d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.920+0000 7f04de13e800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55decac4ab30 con 0x55decad8a550 2024-09-13T23:05:37.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.920+0000 7f04de13e800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55decac2c360 con 0x55decad8e990 2024-09-13T23:05:37.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.921+0000 7f04d3fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55decad8e990 0x55decad90d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.921+0000 7f04d9e34640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55decad8a550 0x55decad8a950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:41116/0 (socket says 172.21.15.164:41116) 2024-09-13T23:05:37.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.921+0000 7f04d9e34640 1 -- 172.21.15.164:0/788937050 learned_addr learned my addr 172.21.15.164:0/788937050 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:37.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.921+0000 7f04d3fff640 1 -- 172.21.15.164:0/788937050 >> v1:172.21.15.17:6789/0 conn(0x55decad8a550 legacy=0x55decad8a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.921+0000 7f04d3fff640 1 -- 172.21.15.164:0/788937050 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55decac52e00 con 0x55decad8e990 2024-09-13T23:05:37.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.923+0000 7f04d3fff640 1 --2- 172.21.15.164:0/788937050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decad8e990 0x55decad90d80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f04c400a470 tx=0x7f04c4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0efe0cf05643f3b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.923+0000 7f04d9633640 1 -- 172.21.15.164:0/788937050 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04c4053570 con 0x55decad8e990 2024-09-13T23:05:37.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.923+0000 7f04d9633640 1 -- 172.21.15.164:0/788937050 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c4058070 con 0x55decad8e990 2024-09-13T23:05:37.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.923+0000 7f04d9633640 1 -- 172.21.15.164:0/788937050 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04c4053880 con 0x55decad8e990 2024-09-13T23:05:37.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.923+0000 7f04de13e800 1 -- 172.21.15.164:0/788937050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decad8e990 msgr2=0x55decad90d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.923+0000 7f04de13e800 1 --2- 172.21.15.164:0/788937050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decad8e990 0x55decad90d80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f04c400a470 tx=0x7f04c4045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:37.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.923+0000 7f04de13e800 1 -- 172.21.15.164:0/788937050 shutdown_connections 2024-09-13T23:05:37.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.923+0000 7f04de13e800 1 --2- 172.21.15.164:0/788937050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decad8e990 0x55decad90d80 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.923+0000 7f04de13e800 1 -- 172.21.15.164:0/788937050 >> 172.21.15.164:0/788937050 conn(0x55decad85de0 msgr2=0x55decad88200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.923+0000 7f04de13e800 1 -- 172.21.15.164:0/788937050 shutdown_connections 2024-09-13T23:05:37.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.923+0000 7f04de13e800 1 -- 172.21.15.164:0/788937050 wait complete. 2024-09-13T23:05:37.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.937+0000 7f04de13e800 1 Processor -- start 2024-09-13T23:05:37.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.937+0000 7f04de13e800 1 -- start start 2024-09-13T23:05:37.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.938+0000 7f04de13e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decad8a550 0x55decacff5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.938+0000 7f04de13e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55decacd7330 con 0x55decad8a550 2024-09-13T23:05:37.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.938+0000 7f04d9e34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decad8a550 0x55decacff5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.938+0000 7f04d9e34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decad8a550 0x55decacff5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58510/0 (socket says 172.21.15.164:58510) 2024-09-13T23:05:37.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.938+0000 7f04d9e34640 1 -- 172.21.15.164:0/72971182 learned_addr learned my addr 172.21.15.164:0/72971182 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.938+0000 7f04d9e34640 1 -- 172.21.15.164:0/72971182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55decac24bc0 con 0x55decad8a550 2024-09-13T23:05:37.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.938+0000 7f04d9e34640 1 --2- 172.21.15.164:0/72971182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decad8a550 0x55decacff5a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f04cc001d80 tx=0x7f04cc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5399db02658cf293 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.939+0000 7f03c7e07640 1 -- 172.21.15.164:0/72971182 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04cc013030 con 0x55decad8a550 2024-09-13T23:05:37.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.939+0000 7f03c7e07640 1 -- 172.21.15.164:0/72971182 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04cc00e470 con 0x55decad8a550 2024-09-13T23:05:37.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.939+0000 7f03c7e07640 1 -- 172.21.15.164:0/72971182 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04cc00e810 con 0x55decad8a550 2024-09-13T23:05:37.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.939+0000 7f04de13e800 1 -- 172.21.15.164:0/72971182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decad8a550 msgr2=0x55decacff5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.939+0000 7f04de13e800 1 --2- 172.21.15.164:0/72971182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decad8a550 0x55decacff5a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f04cc001d80 tx=0x7f04cc001e70 comp rx=0 tx=0).stop 2024-09-13T23:05:37.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.939+0000 7f04de13e800 1 -- 172.21.15.164:0/72971182 shutdown_connections 2024-09-13T23:05:37.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.939+0000 7f04de13e800 1 --2- 172.21.15.164:0/72971182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decad8a550 0x55decacff5a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.939+0000 7f04de13e800 1 -- 172.21.15.164:0/72971182 >> 172.21.15.164:0/72971182 conn(0x55decad85de0 msgr2=0x55decae75140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.939+0000 7f04de13e800 1 -- 172.21.15.164:0/72971182 shutdown_connections 2024-09-13T23:05:37.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.939+0000 7f04de13e800 1 -- 172.21.15.164:0/72971182 wait complete. 2024-09-13T23:05:37.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.940+0000 7f04de13e800 1 Processor -- start 2024-09-13T23:05:37.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.940+0000 7f04de13e800 1 -- start start 2024-09-13T23:05:37.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.940+0000 7f04de13e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decad8a550 0x55decae82230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.940+0000 7f04de13e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55decad915c0 con 0x55decad8a550 2024-09-13T23:05:37.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.940+0000 7f04d9e34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decad8a550 0x55decae82230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.940+0000 7f04d9e34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decad8a550 0x55decae82230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58512/0 (socket says 172.21.15.164:58512) 2024-09-13T23:05:37.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.940+0000 7f04d9e34640 1 -- 172.21.15.164:0/3619829596 learned_addr learned my addr 172.21.15.164:0/3619829596 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.940+0000 7f04d9e34640 1 -- 172.21.15.164:0/3619829596 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55decac38fe0 con 0x55decad8a550 2024-09-13T23:05:37.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.940+0000 7f04d9e34640 1 --2- 172.21.15.164:0/3619829596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decad8a550 0x55decae82230 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f04cc004000 tx=0x7f04cc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.941+0000 7f03c6604640 1 -- 172.21.15.164:0/3619829596 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04cc027070 con 0x55decad8a550 2024-09-13T23:05:37.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.941+0000 7f03c6604640 1 -- 172.21.15.164:0/3619829596 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04cc0198b0 con 0x55decad8a550 2024-09-13T23:05:37.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.941+0000 7f03c6604640 1 -- 172.21.15.164:0/3619829596 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04cc019bd0 con 0x55decad8a550 2024-09-13T23:05:37.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.941+0000 7f04de13e800 1 -- 172.21.15.164:0/3619829596 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55decae82770 con 0x55decad8a550 2024-09-13T23:05:37.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.941+0000 7f04de13e800 1 -- 172.21.15.164:0/3619829596 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55decae82c90 con 0x55decad8a550 2024-09-13T23:05:37.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.941+0000 7f03c6604640 1 -- 172.21.15.164:0/3619829596 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f04cc02a070 con 0x55decad8a550 2024-09-13T23:05:37.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.942+0000 7f03c6604640 1 --2- 172.21.15.164:0/3619829596 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f03c0036b90 0x7f03c0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.942+0000 7f03c6604640 1 -- 172.21.15.164:0/3619829596 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f04cc01f070 con 0x55decad8a550 2024-09-13T23:05:37.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.942+0000 7f04d3fff640 1 --2- 172.21.15.164:0/3619829596 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f03c0036b90 0x7f03c0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.942+0000 7f04de13e800 1 --2- 172.21.15.164:0/3619829596 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55decad8e990 0x55decae892a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.942+0000 7f04de13e800 1 -- 172.21.15.164:0/3619829596 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55decae897e0 con 0x55decad8e990 2024-09-13T23:05:37.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.942+0000 7f04da635640 1 --2- 172.21.15.164:0/3619829596 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55decad8e990 0x55decae892a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.942+0000 7f04d3fff640 1 --2- 172.21.15.164:0/3619829596 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f03c0036b90 0x7f03c0039050 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f04c4057000 tx=0x7f04c4052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.942+0000 7f04da635640 1 --2- 172.21.15.164:0/3619829596 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55decad8e990 0x55decae892a0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.943+0000 7f04da635640 1 -- 172.21.15.164:0/3619829596 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04d400a4a0 con 0x55decad8e990 2024-09-13T23:05:37.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.943+0000 7f04de13e800 1 -- 172.21.15.164:0/3619829596 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55decae86870 con 0x55decad8e990 2024-09-13T23:05:37.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.943+0000 7f04da635640 1 -- 172.21.15.164:0/3619829596 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f04d400a4a0 con 0x55decad8e990 2024-09-13T23:05:37.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.943+0000 7f04de13e800 1 -- 172.21.15.164:0/3619829596 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55decae8b620 con 0x55decad8e990 2024-09-13T23:05:37.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.943+0000 7f04da635640 1 -- 172.21.15.164:0/3619829596 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f04d400a4a0 con 0x55decad8e990 2024-09-13T23:05:37.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.943+0000 7f04de13e800 1 -- 172.21.15.164:0/3619829596 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55decae8a850 con 0x55decad8e990 2024-09-13T23:05:37.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.943+0000 7f04da635640 1 -- 172.21.15.164:0/3619829596 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f04d400a4a0 con 0x55decad8e990 2024-09-13T23:05:37.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.943+0000 7f04de13e800 1 -- 172.21.15.164:0/3619829596 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55decae8aca0 con 0x55decad8e990 2024-09-13T23:05:37.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.944+0000 7f04da635640 1 -- 172.21.15.164:0/3619829596 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f04d400a4a0 con 0x55decad8e990 2024-09-13T23:05:37.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.944+0000 7f04de13e800 1 Processor -- start 2024-09-13T23:05:37.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.944+0000 7f04de13e800 1 -- start start 2024-09-13T23:05:37.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.944+0000 7f04de13e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decae99c30 0x55decae9a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.944+0000 7f04de13e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55decac26580 con 0x55decae99c30 2024-09-13T23:05:37.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.944+0000 7f04d3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decae99c30 0x55decae9a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.944+0000 7f04d3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decae99c30 0x55decae9a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58520/0 (socket says 172.21.15.164:58520) 2024-09-13T23:05:37.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.945+0000 7f04d3fff640 1 -- 172.21.15.164:0/1429120995 learned_addr learned my addr 172.21.15.164:0/1429120995 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.945+0000 7f04d3fff640 1 -- 172.21.15.164:0/1429120995 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55decae9a590 con 0x55decae99c30 2024-09-13T23:05:37.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.945+0000 7f04d3fff640 1 --2- 172.21.15.164:0/1429120995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decae99c30 0x55decae9a050 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f04c4025bf0 tx=0x7f04c4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.945+0000 7f03bf7fe640 1 -- 172.21.15.164:0/1429120995 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04c406f070 con 0x55decae99c30 2024-09-13T23:05:37.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.945+0000 7f03bf7fe640 1 -- 172.21.15.164:0/1429120995 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c405f550 con 0x55decae99c30 2024-09-13T23:05:37.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.945+0000 7f04de13e800 1 -- 172.21.15.164:0/1429120995 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55decae9a7c0 con 0x55decae99c30 2024-09-13T23:05:37.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.945+0000 7f03bf7fe640 1 -- 172.21.15.164:0/1429120995 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04c405f830 con 0x55decae99c30 2024-09-13T23:05:37.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.945+0000 7f04de13e800 1 -- 172.21.15.164:0/1429120995 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55decae9d440 con 0x55decae99c30 2024-09-13T23:05:37.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.946+0000 7f03bf7fe640 1 -- 172.21.15.164:0/1429120995 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f04c405f9d0 con 0x55decae99c30 2024-09-13T23:05:37.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.946+0000 7f03bf7fe640 1 --2- 172.21.15.164:0/1429120995 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f03b4036b90 0x7f03b4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.946+0000 7f03bf7fe640 1 -- 172.21.15.164:0/1429120995 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f04c4092c70 con 0x55decae99c30 2024-09-13T23:05:37.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.946+0000 7f04da635640 1 --2- 172.21.15.164:0/1429120995 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f03b4036b90 0x7f03b4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.946+0000 7f04de13e800 1 Processor -- start 2024-09-13T23:05:37.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.946+0000 7f04de13e800 1 -- start start 2024-09-13T23:05:37.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.946+0000 7f04da635640 1 --2- 172.21.15.164:0/1429120995 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f03b4036b90 0x7f03b4039050 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x55decae8a370 tx=0x7f04d4005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.947+0000 7f04de13e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decaea67d0 0x55decaea6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.947+0000 7f04de13e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55decae7d760 con 0x55decaea67d0 2024-09-13T23:05:37.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.947+0000 7f04d3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decaea67d0 0x55decaea6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.947+0000 7f04d3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decaea67d0 0x55decaea6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58528/0 (socket says 172.21.15.164:58528) 2024-09-13T23:05:37.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.947+0000 7f04d3fff640 1 -- 172.21.15.164:0/3325553745 learned_addr learned my addr 172.21.15.164:0/3325553745 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.947+0000 7f04d3fff640 1 -- 172.21.15.164:0/3325553745 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55decaea71a0 con 0x55decaea67d0 2024-09-13T23:05:37.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.947+0000 7f04d3fff640 1 --2- 172.21.15.164:0/3325553745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decaea67d0 0x55decaea6bd0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f04c4045a40 tx=0x7f04c407cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c21412b45f78e96 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.947+0000 7f03bd7fa640 1 -- 172.21.15.164:0/3325553745 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04c406ba60 con 0x55decaea67d0 2024-09-13T23:05:37.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.947+0000 7f03bd7fa640 1 -- 172.21.15.164:0/3325553745 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c406b410 con 0x55decaea67d0 2024-09-13T23:05:37.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.947+0000 7f03bd7fa640 1 -- 172.21.15.164:0/3325553745 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04c405fcc0 con 0x55decaea67d0 2024-09-13T23:05:37.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.948+0000 7f04de13e800 1 -- 172.21.15.164:0/3325553745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decaea67d0 msgr2=0x55decaea6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:37.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.948+0000 7f04de13e800 1 --2- 172.21.15.164:0/3325553745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decaea67d0 0x55decaea6bd0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f04c4045a40 tx=0x7f04c407cbb0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.948+0000 7f04de13e800 1 -- 172.21.15.164:0/3325553745 shutdown_connections 2024-09-13T23:05:37.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.948+0000 7f04de13e800 1 --2- 172.21.15.164:0/3325553745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decaea67d0 0x55decaea6bd0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:37.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.948+0000 7f04de13e800 1 -- 172.21.15.164:0/3325553745 >> 172.21.15.164:0/3325553745 conn(0x55decaea2b30 msgr2=0x55decaea0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:37.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.948+0000 7f04de13e800 1 -- 172.21.15.164:0/3325553745 shutdown_connections 2024-09-13T23:05:37.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.948+0000 7f04de13e800 1 -- 172.21.15.164:0/3325553745 wait complete. 2024-09-13T23:05:37.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.948+0000 7f04de13e800 1 Processor -- start 2024-09-13T23:05:37.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.948+0000 7f04de13e800 1 -- start start 2024-09-13T23:05:37.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.948+0000 7f04de13e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decaea67d0 0x55decaeadcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.948+0000 7f04de13e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55decaea7810 con 0x55decaea67d0 2024-09-13T23:05:37.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.949+0000 7f04d3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decaea67d0 0x55decaeadcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.949+0000 7f04d3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decaea67d0 0x55decaeadcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58536/0 (socket says 172.21.15.164:58536) 2024-09-13T23:05:37.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.949+0000 7f04d3fff640 1 -- 172.21.15.164:0/4177291812 learned_addr learned my addr 172.21.15.164:0/4177291812 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:37.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.949+0000 7f04d3fff640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55decaeae210 con 0x55decaea67d0 2024-09-13T23:05:37.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.949+0000 7f04d3fff640 1 --2- 172.21.15.164:0/4177291812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decaea67d0 0x55decaeadcd0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f04c408fec0 tx=0x7f04c4090f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.949+0000 7f03ab7fe640 1 -- 172.21.15.164:0/4177291812 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04c405cca0 con 0x55decaea67d0 2024-09-13T23:05:37.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.949+0000 7f03ab7fe640 1 -- 172.21.15.164:0/4177291812 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c405ce40 con 0x55decaea67d0 2024-09-13T23:05:37.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.949+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55decaeae4a0 con 0x55decaea67d0 2024-09-13T23:05:37.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.949+0000 7f03ab7fe640 1 -- 172.21.15.164:0/4177291812 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04c4060040 con 0x55decaea67d0 2024-09-13T23:05:37.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.949+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55decaeb1150 con 0x55decaea67d0 2024-09-13T23:05:37.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.950+0000 7f03ab7fe640 1 -- 172.21.15.164:0/4177291812 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f04c407c3f0 con 0x55decaea67d0 2024-09-13T23:05:37.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.950+0000 7f03ab7fe640 1 --2- 172.21.15.164:0/4177291812 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f03a4036b40 0x7f03a4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.950+0000 7f03ab7fe640 1 -- 172.21.15.164:0/4177291812 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f04c406d0d0 con 0x55decaea67d0 2024-09-13T23:05:37.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.950+0000 7f04da635640 1 --2- 172.21.15.164:0/4177291812 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f03a4036b40 0x7f03a4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.951+0000 7f04de13e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.951+0000 7f04de13e800 1 --2- 172.21.15.164:0/4177291812 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55decaeb9770 0x55decaebbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.951+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55decaebc380 con 0x55decaeb9770 2024-09-13T23:05:37.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.951+0000 7f04da635640 1 --2- 172.21.15.164:0/4177291812 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f03a4036b40 0x7f03a4039000 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55decae867c0 tx=0x7f04d401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.951+0000 7f04d9e34640 1 --2- 172.21.15.164:0/4177291812 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55decaeb9770 0x55decaebbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.951+0000 7f04d9e34640 1 --2- 172.21.15.164:0/4177291812 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55decaeb9770 0x55decaebbc30 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.951+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:37.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.951+0000 7f04de13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.951+0000 7f04de13e800 20 realm 2024-09-13T23:05:37.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.951+0000 7f04de13e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.951+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55decaebc790 con 0x55decaeb9770 2024-09-13T23:05:37.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.952+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:37.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.952+0000 7f04de13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.952+0000 7f04de13e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:37.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.952+0000 7f04de13e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.952+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55decaebd060 con 0x55decaeb9770 2024-09-13T23:05:37.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.952+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:37.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.952+0000 7f04de13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.952+0000 7f04de13e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.952+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55decaebd400 con 0x55decaeb9770 2024-09-13T23:05:37.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.952+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:37.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.952+0000 7f04de13e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:37.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.952+0000 7f04de13e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.952+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55decaebdc50 con 0x55decaeb9770 2024-09-13T23:05:37.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.952+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:37.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.952+0000 7f04de13e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:37.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.952+0000 7f04de13e800 20 searching for the correct realm 2024-09-13T23:05:37.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.952+0000 7f04de13e800 1 --2- 172.21.15.164:0/4177291812 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55decaebf9c0 0x55decaec1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.952+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x55decaebf9c0 2024-09-13T23:05:37.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.953+0000 7f04d3fff640 1 --2- 172.21.15.164:0/4177291812 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55decaebf9c0 0x55decaec1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.953+0000 7f04d3fff640 1 --2- 172.21.15.164:0/4177291812 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55decaebf9c0 0x55decaec1db0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.953+0000 7f04d3fff640 1 -- 172.21.15.164:0/4177291812 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c4051070 con 0x55decaebf9c0 2024-09-13T23:05:37.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.953+0000 7f04d3fff640 1 --2- 172.21.15.164:0/4177291812 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f04c4092050 0x7f04c4085880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.953+0000 7f04d3fff640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x7f04c4092050 2024-09-13T23:05:37.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.953+0000 7f04da635640 1 --2- 172.21.15.164:0/4177291812 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f04c4092050 0x7f04c4085880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.953+0000 7f04da635640 1 --2- 172.21.15.164:0/4177291812 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f04c4092050 0x7f04c4085880 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.954+0000 7f04da635640 1 -- 172.21.15.164:0/4177291812 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04d401f070 con 0x7f04c4092050 2024-09-13T23:05:37.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.954+0000 7f04da635640 1 --2- 172.21.15.164:0/4177291812 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f04d4031040 0x7f04d4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:37.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.954+0000 7f04da635640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x7f04d4031040 2024-09-13T23:05:37.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.954+0000 7f04d9e34640 1 --2- 172.21.15.164:0/4177291812 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f04d4031040 0x7f04d4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:37.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.954+0000 7f04d9e34640 1 --2- 172.21.15.164:0/4177291812 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f04d4031040 0x7f04d4032940 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:37.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.955+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc029030 con 0x7f04d4031040 2024-09-13T23:05:37.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.955+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x55decaeb9770 2024-09-13T23:05:37.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.955+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:37.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.955+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x55decaeb9770 2024-09-13T23:05:37.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.955+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:37.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.955+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x7f04d4031040 2024-09-13T23:05:37.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.955+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc029030 con 0x7f04d4031040 2024-09-13T23:05:37.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.955+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x7f04d4031040 2024-09-13T23:05:37.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.955+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc029030 con 0x7f04d4031040 2024-09-13T23:05:37.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.955+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x7f04c4092050 2024-09-13T23:05:37.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.956+0000 7f04da635640 1 -- 172.21.15.164:0/4177291812 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04d401f070 con 0x7f04c4092050 2024-09-13T23:05:37.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.956+0000 7f04da635640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x55decaebf9c0 2024-09-13T23:05:37.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.956+0000 7f04d3fff640 1 -- 172.21.15.164:0/4177291812 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c4051070 con 0x55decaebf9c0 2024-09-13T23:05:37.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.956+0000 7f04d3fff640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x55decaeb9770 2024-09-13T23:05:37.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.956+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:37.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.956+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x7f04d4031040 2024-09-13T23:05:37.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.956+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc029030 con 0x7f04d4031040 2024-09-13T23:05:37.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.956+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x55decaeb9770 2024-09-13T23:05:37.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.957+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:37.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.957+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x7f04c4092050 2024-09-13T23:05:37.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.957+0000 7f04da635640 1 -- 172.21.15.164:0/4177291812 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f04d401f070 con 0x7f04c4092050 2024-09-13T23:05:37.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.957+0000 7f04da635640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x55decaebf9c0 2024-09-13T23:05:37.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.957+0000 7f04d3fff640 1 -- 172.21.15.164:0/4177291812 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c4051070 con 0x55decaebf9c0 2024-09-13T23:05:37.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.957+0000 7f04d3fff640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x55decaebf9c0 2024-09-13T23:05:37.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.957+0000 7f04d3fff640 1 -- 172.21.15.164:0/4177291812 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c4051070 con 0x55decaebf9c0 2024-09-13T23:05:37.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.957+0000 7f04d3fff640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x7f04d4031040 2024-09-13T23:05:37.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.958+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc029030 con 0x7f04d4031040 2024-09-13T23:05:37.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.958+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x55decaebf9c0 2024-09-13T23:05:37.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.958+0000 7f04d3fff640 1 -- 172.21.15.164:0/4177291812 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c4051070 con 0x55decaebf9c0 2024-09-13T23:05:37.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.958+0000 7f04d3fff640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x55decaebf9c0 2024-09-13T23:05:37.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.958+0000 7f04d3fff640 1 -- 172.21.15.164:0/4177291812 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c4051070 con 0x55decaebf9c0 2024-09-13T23:05:37.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.958+0000 7f04d3fff640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x55decaeb9770 2024-09-13T23:05:37.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.958+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:37.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.958+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x55decaeb9770 2024-09-13T23:05:37.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.959+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:37.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.959+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x7f04d4031040 2024-09-13T23:05:37.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.959+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc029030 con 0x7f04d4031040 2024-09-13T23:05:37.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.959+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x55decaebf9c0 2024-09-13T23:05:37.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.959+0000 7f04d3fff640 1 -- 172.21.15.164:0/4177291812 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c4051070 con 0x55decaebf9c0 2024-09-13T23:05:37.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.959+0000 7f04d3fff640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x7f04c4092050 2024-09-13T23:05:37.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.959+0000 7f04da635640 1 -- 172.21.15.164:0/4177291812 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04d401f070 con 0x7f04c4092050 2024-09-13T23:05:37.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.959+0000 7f04da635640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x55decaeb9770 2024-09-13T23:05:37.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.960+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:37.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.960+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x7f04d4031040 2024-09-13T23:05:37.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.960+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc029030 con 0x7f04d4031040 2024-09-13T23:05:37.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.960+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x55decaebf9c0 2024-09-13T23:05:37.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.960+0000 7f04d3fff640 1 -- 172.21.15.164:0/4177291812 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c4051070 con 0x55decaebf9c0 2024-09-13T23:05:37.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.960+0000 7f04d3fff640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x7f04d4031040 2024-09-13T23:05:37.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.961+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc029030 con 0x7f04d4031040 2024-09-13T23:05:37.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.961+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x7f04c4092050 2024-09-13T23:05:37.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.961+0000 7f04da635640 1 -- 172.21.15.164:0/4177291812 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04d401f070 con 0x7f04c4092050 2024-09-13T23:05:37.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.961+0000 7f04da635640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x55decaebf9c0 2024-09-13T23:05:37.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.961+0000 7f04d3fff640 1 -- 172.21.15.164:0/4177291812 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c4051070 con 0x55decaebf9c0 2024-09-13T23:05:37.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.961+0000 7f04d3fff640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x7f04d4031040 2024-09-13T23:05:37.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.961+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc029030 con 0x7f04d4031040 2024-09-13T23:05:37.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.961+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x55decaeb9770 2024-09-13T23:05:37.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.962+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:37.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.962+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2390 con 0x7f04c4092050 2024-09-13T23:05:37.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.962+0000 7f04da635640 1 -- 172.21.15.164:0/4177291812 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04d401f070 con 0x7f04c4092050 2024-09-13T23:05:37.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.962+0000 7f04de13e800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:37.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.962+0000 7f04de13e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:37.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.962+0000 7f04de13e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:37.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.962+0000 7f04de13e800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:37.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.962+0000 7f04de13e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:37.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.962+0000 7f04de13e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:37.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.962+0000 7f04de13e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.962+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55decaebe5d0 con 0x55decaeb9770 2024-09-13T23:05:37.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.962+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:37.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.962+0000 7f04de13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.962+0000 7f04de13e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.962+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55decaebee70 con 0x55decaeb9770 2024-09-13T23:05:37.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.962+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:37.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.962+0000 7f04de13e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:37.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.962+0000 7f04de13e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.962+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55decaebee70 con 0x55decaeb9770 2024-09-13T23:05:37.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.963+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:37.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.963+0000 7f04de13e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:37.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.963+0000 7f04de13e800 20 zone default found 2024-09-13T23:05:37.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.963+0000 7f04de13e800 4 Realm: () 2024-09-13T23:05:37.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.963+0000 7f04de13e800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:37.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.963+0000 7f04de13e800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:37.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.963+0000 7f04de13e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:37.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.963+0000 7f04de13e800 20 zonegroup default 2024-09-13T23:05:37.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.963+0000 7f04de13e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.963+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55decaec2810 con 0x7f04d4031040 2024-09-13T23:05:37.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.963+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f04cc029030 con 0x7f04d4031040 2024-09-13T23:05:37.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.963+0000 7f04de13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.963+0000 7f04de13e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.963+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55decaec41f0 con 0x55decaebf9c0 2024-09-13T23:05:37.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.963+0000 7f04d3fff640 1 -- 172.21.15.164:0/4177291812 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f04c4051070 con 0x55decaebf9c0 2024-09-13T23:05:37.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.963+0000 7f04de13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.963+0000 7f04de13e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.963+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55decaec4700 con 0x55decaebf9c0 2024-09-13T23:05:37.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.963+0000 7f04d3fff640 1 -- 172.21.15.164:0/4177291812 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f04c4051070 con 0x55decaebf9c0 2024-09-13T23:05:37.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.964+0000 7f04de13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:37.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.964+0000 7f04de13e800 20 started sync module instance, tier type = 2024-09-13T23:05:37.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.964+0000 7f04de13e800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:37.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.964+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55decaec3690 con 0x7f04c4092050 2024-09-13T23:05:37.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.965+0000 7f04da635640 1 -- 172.21.15.164:0/4177291812 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04d4040040 con 0x7f04c4092050 2024-09-13T23:05:37.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.965+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94415375579776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55decaec32f0 con 0x7f04c4092050 2024-09-13T23:05:37.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.965+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55decaec5630 con 0x55decaeb9770 2024-09-13T23:05:37.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.966+0000 7f04da635640 1 -- 172.21.15.164:0/4177291812 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94415375579776] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04d4040040 con 0x7f04c4092050 2024-09-13T23:05:37.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.966+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:37.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.966+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94415375584096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55decaec5630 con 0x55decaeb9770 2024-09-13T23:05:37.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.966+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55decaec60c0 con 0x55decaebf9c0 2024-09-13T23:05:37.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.967+0000 7f04d3fff640 1 -- 172.21.15.164:0/4177291812 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c4051070 con 0x55decaebf9c0 2024-09-13T23:05:37.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.967+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94415375588240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55decaec6960 con 0x55decaebf9c0 2024-09-13T23:05:37.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.967+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55decaec73e0 con 0x7f04c4092050 2024-09-13T23:05:37.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.967+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94415375584096] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:37.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.968+0000 7f04d3fff640 1 -- 172.21.15.164:0/4177291812 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94415375588240] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c4051070 con 0x55decaebf9c0 2024-09-13T23:05:37.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.968+0000 7f04da635640 1 -- 172.21.15.164:0/4177291812 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04d4040040 con 0x7f04c4092050 2024-09-13T23:05:37.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.968+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94415375590576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55decaec5180 con 0x7f04c4092050 2024-09-13T23:05:37.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.968+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55decaec7cb0 con 0x55decaeb9770 2024-09-13T23:05:37.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.969+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:37.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.969+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94415375595520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55decaec7c20 con 0x55decaeb9770 2024-09-13T23:05:37.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.969+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55decaec8c80 con 0x7f04d4031040 2024-09-13T23:05:37.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.969+0000 7f04da635640 1 -- 172.21.15.164:0/4177291812 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94415375590576] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04d4040040 con 0x7f04c4092050 2024-09-13T23:05:37.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.970+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94415375595520] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:37.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.970+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc029030 con 0x7f04d4031040 2024-09-13T23:05:37.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.970+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94415375599472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55decaec8050 con 0x7f04d4031040 2024-09-13T23:05:37.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.970+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55decaec9260 con 0x7f04d4031040 2024-09-13T23:05:37.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.971+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94415375599472] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc029030 con 0x7f04d4031040 2024-09-13T23:05:37.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.972+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc029030 con 0x7f04d4031040 2024-09-13T23:05:37.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.972+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94415375593168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55decaec9260 con 0x7f04d4031040 2024-09-13T23:05:37.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.972+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55decaec9b30 con 0x7f04d4031040 2024-09-13T23:05:37.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.972+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94415375593168] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc029030 con 0x7f04d4031040 2024-09-13T23:05:37.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.972+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(58 notify.7 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc029030 con 0x7f04d4031040 2024-09-13T23:05:37.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.972+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94415375601072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55decaec9d10 con 0x7f04d4031040 2024-09-13T23:05:37.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.973+0000 7f04de13e800 20 add_watcher() i=0 2024-09-13T23:05:37.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.973+0000 7f04de13e800 20 add_watcher() i=1 2024-09-13T23:05:37.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.973+0000 7f04de13e800 20 add_watcher() i=2 2024-09-13T23:05:37.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.973+0000 7f04de13e800 20 add_watcher() i=3 2024-09-13T23:05:37.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.973+0000 7f04de13e800 20 add_watcher() i=4 2024-09-13T23:05:37.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.973+0000 7f04de13e800 20 add_watcher() i=5 2024-09-13T23:05:37.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.973+0000 7f04de13e800 20 add_watcher() i=6 2024-09-13T23:05:37.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.973+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94415375601072] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc029030 con 0x7f04d4031040 2024-09-13T23:05:37.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.973+0000 7f04de13e800 20 add_watcher() i=7 2024-09-13T23:05:37.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.973+0000 7f04de13e800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:37.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.973+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55decaecd0e0 con 0x55decaeb9770 2024-09-13T23:05:37.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.974+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:37.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.974+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94415375604736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55decaeca4d0 con 0x55decaeb9770 2024-09-13T23:05:37.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.977+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94415375604736] v32'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:37.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.977+0000 7f038b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:37.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.977+0000 7f04de13e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:37.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.977+0000 7f04de13e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:37.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.977+0000 7f04de13e800 5 note: GC not initialized 2024-09-13T23:05:37.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.977+0000 7f038a7fc640 20 reqs_thread_entry: start 2024-09-13T23:05:37.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.977+0000 7f04de13e800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:37.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.977+0000 7f04de13e800 20 Filter name: none 2024-09-13T23:05:37.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.977+0000 7f02fbfff640 20 reqs_thread_entry: start 2024-09-13T23:05:37.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.977+0000 7f04de13e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:05:37.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.977+0000 7f04de13e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.977+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55decaf003b0 con 0x55decaeb9770 2024-09-13T23:05:37.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.978+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:37.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.978+0000 7f04de13e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:05:37.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.978+0000 7f04de13e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:05:37.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.978+0000 7f04de13e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:37.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.978+0000 7f04de13e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:37.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.978+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55decaf02e40 con 0x7f04c4092050 2024-09-13T23:05:37.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.978+0000 7f04da635640 1 -- 172.21.15.164:0/4177291812 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f04d4040040 con 0x7f04c4092050 2024-09-13T23:05:37.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.978+0000 7f04de13e800 20 disabling bucket name=myfoo 2024-09-13T23:05:37.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.978+0000 7f04de13e800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:05:37.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.978+0000 7f04de13e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.978+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55decaf00e20 con 0x7f04c4092050 2024-09-13T23:05:37.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.978+0000 7f04da635640 1 -- 172.21.15.164:0/4177291812 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f04d4040040 con 0x7f04c4092050 2024-09-13T23:05:37.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.978+0000 7f04de13e800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:05:37.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.978+0000 7f04de13e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-13T23:05:37.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.978+0000 7f04de13e800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:05:37.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.978+0000 7f04de13e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 : miss 2024-09-13T23:05:37.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.978+0000 7f04de13e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:37.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.978+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:65 8.15 8:aa4f46c1:root::.bucket.meta.myfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55decaf036c0 con 0x55decaebf9c0 2024-09-13T23:05:37.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.979+0000 7f04d3fff640 1 -- 172.21.15.164:0/4177291812 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(65 .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f04c4051070 con 0x55decaebf9c0 2024-09-13T23:05:37.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.979+0000 7f04de13e800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:05:37.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.979+0000 7f04de13e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 info.flags=0x17 2024-09-13T23:05:37.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.979+0000 7f04de13e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 to cache LRU end 2024-09-13T23:05:37.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.979+0000 7f04de13e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:37.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.979+0000 7f04de13e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:05:37.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.979+0000 7f04de13e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 2024-09-13T23:05:37.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.979+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:66 8.15 8:aa4f46c1:root::.bucket.meta.myfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55decaf0b2c0 con 0x55decaebf9c0 2024-09-13T23:05:37.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.980+0000 7f04d3fff640 1 -- 172.21.15.164:0/4177291812 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(66 .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v32'8 uv8 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f04c4051070 con 0x55decaebf9c0 2024-09-13T23:05:37.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.980+0000 7f04de13e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 info.flags=0x17 2024-09-13T23:05:37.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.980+0000 7f04de13e800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 to cache LRU end 2024-09-13T23:05:37.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.980+0000 7f04de13e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:05:37.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.980+0000 7f04de13e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1, ofs0, ns] 2024-09-13T23:05:37.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.980+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94415375842688 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55decaf06930 con 0x7f04d4031040 2024-09-13T23:05:37.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.981+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== watch-notify(notify (1) cookie 94415375599472 notify 137438953487 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55decae82c90 con 0x7f04d4031040 2024-09-13T23:05:37.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.981+0000 7f03bd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953487 cookie 94415375599472 notifier 4603 bl.length()=752 2024-09-13T23:05:37.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.981+0000 7f03bd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 info.flags=0x17 2024-09-13T23:05:37.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.981+0000 7f03bd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 to cache LRU end 2024-09-13T23:05:37.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.981+0000 7f03bd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:05:37.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.981+0000 7f03bd7fa640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f039c003ea0 con 0x7f04d4031040 2024-09-13T23:05:37.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.981+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(67 notify.5 [notify cookie 94415375842688 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f04cc029030 con 0x7f04d4031040 2024-09-13T23:05:37.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.981+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc029030 con 0x7f04d4031040 2024-09-13T23:05:37.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.981+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== watch-notify(notify_complete (2) cookie 94415375842688 notify 137438953487 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55decae82770 con 0x7f04d4031040 2024-09-13T23:05:37.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.981+0000 7f04de13e800 20 handle_bi_update(): bucket=:myfoo[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1]): orig_sources= new_sources= 2024-09-13T23:05:37.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.981+0000 7f04de13e800 20 handle_bi_update(): bucket=:myfoo[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1]): potential sources added=[] removed=[] 2024-09-13T23:05:37.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.981+0000 7f04de13e800 20 handle_bi_update(): bucket=:myfoo[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1]): orig_dests= new_dests= 2024-09-13T23:05:37.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.981+0000 7f04de13e800 20 handle_bi_update(): bucket=:myfoo[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1]): potential dests added=[] removed=[] 2024-09-13T23:05:38.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.981+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55decaf086b0 con 0x55decaeb9770 2024-09-13T23:05:38.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.982+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v32'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:38.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.982+0000 7f04de13e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:38.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.982+0000 7f04de13e800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:38.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.982+0000 7f04de13e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:05:38.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.982+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94415375862928 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55decaf086b0 con 0x55decaeb9770 2024-09-13T23:05:38.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.983+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== watch-notify(notify (1) cookie 94415375595520 notify 137438953488 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55decae82770 con 0x55decaeb9770 2024-09-13T23:05:38.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.983+0000 7f03bcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953488 cookie 94415375595520 notifier 4603 bl.length()=567 2024-09-13T23:05:38.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.983+0000 7f03bcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:38.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.983+0000 7f03bcff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:38.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.983+0000 7f03bcff9640 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0304003430 con 0x55decaeb9770 2024-09-13T23:05:38.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.983+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(70 notify.4 [notify cookie 94415375862928 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:38.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.983+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:38.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.983+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== watch-notify(notify_complete (2) cookie 94415375862928 notify 137438953488 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55decac38fe0 con 0x55decaeb9770 2024-09-13T23:05:38.001 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:05:31.300851Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:05:31.300826Z","tags":[],"group_ids":[]} 2024-09-13T23:05:38.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.984+0000 7f038b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:38.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.984+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94415375604736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55decaefe100 con 0x55decaeb9770 2024-09-13T23:05:38.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.985+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94415375604736] v32'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:38.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.985+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94415375579776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55decaefe100 con 0x7f04c4092050 2024-09-13T23:05:38.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.986+0000 7f04da635640 1 -- 172.21.15.164:0/4177291812 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94415375579776] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04d4040040 con 0x7f04c4092050 2024-09-13T23:05:38.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.986+0000 7f04de13e800 20 remove_watcher() i=0 2024-09-13T23:05:38.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.986+0000 7f04de13e800 2 removed watcher, disabling cache 2024-09-13T23:05:38.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.986+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94415375584096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55decaefe100 con 0x55decaeb9770 2024-09-13T23:05:38.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.987+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94415375584096] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:38.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.987+0000 7f04de13e800 20 remove_watcher() i=1 2024-09-13T23:05:38.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.987+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94415375588240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55decaefe100 con 0x55decaebf9c0 2024-09-13T23:05:38.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.988+0000 7f04d3fff640 1 -- 172.21.15.164:0/4177291812 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94415375588240] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c4051070 con 0x55decaebf9c0 2024-09-13T23:05:38.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.988+0000 7f04de13e800 20 remove_watcher() i=2 2024-09-13T23:05:38.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.988+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94415375590576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55decaec3a80 con 0x7f04c4092050 2024-09-13T23:05:38.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.989+0000 7f04da635640 1 -- 172.21.15.164:0/4177291812 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94415375590576] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04d4040040 con 0x7f04c4092050 2024-09-13T23:05:38.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.989+0000 7f04de13e800 20 remove_watcher() i=3 2024-09-13T23:05:38.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.989+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94415375595520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55decaec4b60 con 0x55decaeb9770 2024-09-13T23:05:38.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.990+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94415375595520] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc029030 con 0x55decaeb9770 2024-09-13T23:05:38.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.990+0000 7f04de13e800 20 remove_watcher() i=4 2024-09-13T23:05:38.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.990+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94415375599472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55decaec5b90 con 0x7f04d4031040 2024-09-13T23:05:38.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.991+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94415375599472] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc029030 con 0x7f04d4031040 2024-09-13T23:05:38.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.991+0000 7f04de13e800 20 remove_watcher() i=5 2024-09-13T23:05:38.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.991+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94415375593168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55decaec3a80 con 0x7f04d4031040 2024-09-13T23:05:38.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.992+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94415375593168] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc029030 con 0x7f04d4031040 2024-09-13T23:05:38.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.992+0000 7f04de13e800 20 remove_watcher() i=6 2024-09-13T23:05:38.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.992+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94415375601072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55decaec7800 con 0x7f04d4031040 2024-09-13T23:05:38.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94415375601072] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc029030 con 0x7f04d4031040 2024-09-13T23:05:38.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04de13e800 20 remove_watcher() i=7 2024-09-13T23:05:38.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f04d4031040 msgr2=0x7f04d4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:38.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04de13e800 1 --2- 172.21.15.164:0/4177291812 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f04d4031040 0x7f04d4032940 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55decaeb9770 msgr2=0x55decaebbc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:38.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04de13e800 1 --2- 172.21.15.164:0/4177291812 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55decaeb9770 0x55decaebbc30 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f04c4092050 msgr2=0x7f04c4085880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:38.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04de13e800 1 --2- 172.21.15.164:0/4177291812 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f04c4092050 0x7f04c4085880 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55decaebf9c0 msgr2=0x55decaec1db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:38.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04de13e800 1 --2- 172.21.15.164:0/4177291812 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55decaebf9c0 0x55decaec1db0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f03a4036b40 msgr2=0x7f03a4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:38.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04de13e800 1 --2- 172.21.15.164:0/4177291812 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f03a4036b40 0x7f03a4039000 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55decae867c0 tx=0x7f04d401f000 comp rx=0 tx=0).stop 2024-09-13T23:05:38.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decaea67d0 msgr2=0x55decaeadcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:38.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04d9e34640 1 -- 172.21.15.164:0/4177291812 reap_dead start 2024-09-13T23:05:38.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04de13e800 1 --2- 172.21.15.164:0/4177291812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decaea67d0 0x55decaeadcd0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f04c408fec0 tx=0x7f04c4090f30 comp rx=0 tx=0).stop 2024-09-13T23:05:38.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 shutdown_connections 2024-09-13T23:05:38.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04de13e800 1 --2- 172.21.15.164:0/4177291812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decaea67d0 0x55decaeadcd0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 >> 172.21.15.164:0/4177291812 conn(0x55decaea2b30 msgr2=0x55decaea0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:38.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 shutdown_connections 2024-09-13T23:05:38.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04de13e800 1 -- 172.21.15.164:0/4177291812 wait complete. 2024-09-13T23:05:38.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04de13e800 1 -- 172.21.15.164:0/1429120995 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f03b4036b90 msgr2=0x7f03b4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:38.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04de13e800 1 --2- 172.21.15.164:0/1429120995 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f03b4036b90 0x7f03b4039050 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x55decae8a370 tx=0x7f04d4005840 comp rx=0 tx=0).stop 2024-09-13T23:05:38.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04de13e800 1 -- 172.21.15.164:0/1429120995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decae99c30 msgr2=0x55decae9a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:38.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04de13e800 1 --2- 172.21.15.164:0/1429120995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decae99c30 0x55decae9a050 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f04c4025bf0 tx=0x7f04c4002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04de13e800 1 -- 172.21.15.164:0/1429120995 shutdown_connections 2024-09-13T23:05:38.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04de13e800 1 --2- 172.21.15.164:0/1429120995 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f03b4036b90 0x7f03b4039050 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04de13e800 1 --2- 172.21.15.164:0/1429120995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decae99c30 0x55decae9a050 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04de13e800 1 -- 172.21.15.164:0/1429120995 >> 172.21.15.164:0/1429120995 conn(0x55decae8ebc0 msgr2=0x55decae91740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:38.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04de13e800 1 -- 172.21.15.164:0/1429120995 shutdown_connections 2024-09-13T23:05:38.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.993+0000 7f04de13e800 1 -- 172.21.15.164:0/1429120995 wait complete. 2024-09-13T23:05:38.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.994+0000 7f04de13e800 1 -- 172.21.15.164:0/3619829596 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55decad8e990 msgr2=0x55decae892a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:38.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.994+0000 7f04de13e800 1 --2- 172.21.15.164:0/3619829596 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55decad8e990 0x55decae892a0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.994+0000 7f04de13e800 1 -- 172.21.15.164:0/3619829596 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f03c0036b90 msgr2=0x7f03c0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:38.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.994+0000 7f04de13e800 1 --2- 172.21.15.164:0/3619829596 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f03c0036b90 0x7f03c0039050 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f04c4057000 tx=0x7f04c4052000 comp rx=0 tx=0).stop 2024-09-13T23:05:38.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.994+0000 7f04de13e800 1 -- 172.21.15.164:0/3619829596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decad8a550 msgr2=0x55decae82230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:38.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.994+0000 7f04de13e800 1 --2- 172.21.15.164:0/3619829596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decad8a550 0x55decae82230 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f04cc004000 tx=0x7f04cc000bc0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.994+0000 7f04de13e800 1 -- 172.21.15.164:0/3619829596 shutdown_connections 2024-09-13T23:05:38.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.994+0000 7f04de13e800 1 --2- 172.21.15.164:0/3619829596 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55decad8e990 0x55decae892a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.994+0000 7f04de13e800 1 --2- 172.21.15.164:0/3619829596 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f03c0036b90 0x7f03c0039050 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.994+0000 7f04de13e800 1 --2- 172.21.15.164:0/3619829596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55decad8a550 0x55decae82230 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.994+0000 7f04de13e800 1 -- 172.21.15.164:0/3619829596 >> 172.21.15.164:0/3619829596 conn(0x55decad85de0 msgr2=0x55decae739d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:38.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.994+0000 7f04de13e800 1 -- 172.21.15.164:0/3619829596 shutdown_connections 2024-09-13T23:05:38.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:37.994+0000 7f04de13e800 1 -- 172.21.15.164:0/3619829596 wait complete. 2024-09-13T23:05:38.013 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:05:31.300851Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:05:31.300826Z', 'tags': [], 'group_ids': []} 2024-09-13T23:05:38.015 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-13T23:05:38.016 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-13T23:05:38.016 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-13T23:05:38.092 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:38.092 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:38.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.091+0000 7f46b4e0e800 1 Processor -- start 2024-09-13T23:05:38.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.091+0000 7f46b4e0e800 1 -- start start 2024-09-13T23:05:38.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.091+0000 7f46b4e0e800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x560b61b2a990 0x560b61b2cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:38.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.091+0000 7f46b4e0e800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560b619e5b30 con 0x560b61a9a610 2024-09-13T23:05:38.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.091+0000 7f46b4e0e800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x560b619c7360 con 0x560b61b2a990 2024-09-13T23:05:38.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.091+0000 7f46a7fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x560b61b2a990 0x560b61b2cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:38.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.091+0000 7f46b063b640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x560b61a9a610 0x560b61b29270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:41126/0 (socket says 172.21.15.164:41126) 2024-09-13T23:05:38.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.091+0000 7f46b063b640 1 -- 172.21.15.164:0/1015810885 learned_addr learned my addr 172.21.15.164:0/1015810885 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:38.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.092+0000 7f46a7fff640 1 -- 172.21.15.164:0/1015810885 >> v1:172.21.15.17:6789/0 conn(0x560b61a9a610 legacy=0x560b61b29270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:38.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.092+0000 7f46a7fff640 1 -- 172.21.15.164:0/1015810885 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b619ede00 con 0x560b61b2a990 2024-09-13T23:05:38.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.094+0000 7f46a7fff640 1 --2- 172.21.15.164:0/1015810885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61b2a990 0x560b61b2cd80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f469800a470 tx=0x7f4698045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c4bd0bcd9d376e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:38.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.094+0000 7f46afe3a640 1 -- 172.21.15.164:0/1015810885 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4698053570 con 0x560b61b2a990 2024-09-13T23:05:38.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.094+0000 7f46afe3a640 1 -- 172.21.15.164:0/1015810885 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4698058070 con 0x560b61b2a990 2024-09-13T23:05:38.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.094+0000 7f46afe3a640 1 -- 172.21.15.164:0/1015810885 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4698053880 con 0x560b61b2a990 2024-09-13T23:05:38.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.094+0000 7f46b4e0e800 1 -- 172.21.15.164:0/1015810885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61b2a990 msgr2=0x560b61b2cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:38.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.094+0000 7f46b4e0e800 1 --2- 172.21.15.164:0/1015810885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61b2a990 0x560b61b2cd80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f469800a470 tx=0x7f4698045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:38.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.094+0000 7f46b4e0e800 1 -- 172.21.15.164:0/1015810885 shutdown_connections 2024-09-13T23:05:38.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.094+0000 7f46b4e0e800 1 --2- 172.21.15.164:0/1015810885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61b2a990 0x560b61b2cd80 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.094+0000 7f46b4e0e800 1 -- 172.21.15.164:0/1015810885 >> 172.21.15.164:0/1015810885 conn(0x560b61b20de0 msgr2=0x560b61b23200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:38.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.094+0000 7f46b4e0e800 1 -- 172.21.15.164:0/1015810885 shutdown_connections 2024-09-13T23:05:38.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.094+0000 7f46b4e0e800 1 -- 172.21.15.164:0/1015810885 wait complete. 2024-09-13T23:05:38.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.108+0000 7f46b4e0e800 1 Processor -- start 2024-09-13T23:05:38.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.108+0000 7f46b4e0e800 1 -- start start 2024-09-13T23:05:38.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.108+0000 7f46b4e0e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61a9a610 0x560b61c15880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:38.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.108+0000 7f46b4e0e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560b61a72330 con 0x560b61a9a610 2024-09-13T23:05:38.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.109+0000 7f46b063b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61a9a610 0x560b61c15880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:38.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.109+0000 7f46b063b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61a9a610 0x560b61c15880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58550/0 (socket says 172.21.15.164:58550) 2024-09-13T23:05:38.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.109+0000 7f46b063b640 1 -- 172.21.15.164:0/1303497572 learned_addr learned my addr 172.21.15.164:0/1303497572 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:38.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.109+0000 7f46b063b640 1 -- 172.21.15.164:0/1303497572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b619bfbc0 con 0x560b61a9a610 2024-09-13T23:05:38.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.109+0000 7f46b063b640 1 --2- 172.21.15.164:0/1303497572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61a9a610 0x560b61c15880 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f46a0001e10 tx=0x7f46a000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae8bb391f154ad9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:38.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.109+0000 7f459e60c640 1 -- 172.21.15.164:0/1303497572 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46a0012020 con 0x560b61a9a610 2024-09-13T23:05:38.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.109+0000 7f459e60c640 1 -- 172.21.15.164:0/1303497572 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a000e5a0 con 0x560b61a9a610 2024-09-13T23:05:38.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.109+0000 7f459e60c640 1 -- 172.21.15.164:0/1303497572 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46a000e8e0 con 0x560b61a9a610 2024-09-13T23:05:38.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.110+0000 7f46b4e0e800 1 -- 172.21.15.164:0/1303497572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61a9a610 msgr2=0x560b61c15880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:38.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.110+0000 7f46b4e0e800 1 --2- 172.21.15.164:0/1303497572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61a9a610 0x560b61c15880 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f46a0001e10 tx=0x7f46a000b780 comp rx=0 tx=0).stop 2024-09-13T23:05:38.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.110+0000 7f46b4e0e800 1 -- 172.21.15.164:0/1303497572 shutdown_connections 2024-09-13T23:05:38.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.110+0000 7f46b4e0e800 1 --2- 172.21.15.164:0/1303497572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61a9a610 0x560b61c15880 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.110+0000 7f46b4e0e800 1 -- 172.21.15.164:0/1303497572 >> 172.21.15.164:0/1303497572 conn(0x560b61b20de0 msgr2=0x560b61c11240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:38.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.110+0000 7f46b4e0e800 1 -- 172.21.15.164:0/1303497572 shutdown_connections 2024-09-13T23:05:38.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.110+0000 7f46b4e0e800 1 -- 172.21.15.164:0/1303497572 wait complete. 2024-09-13T23:05:38.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.111+0000 7f46b4e0e800 1 Processor -- start 2024-09-13T23:05:38.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.111+0000 7f46b4e0e800 1 -- start start 2024-09-13T23:05:38.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.111+0000 7f46b4e0e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61a9a610 0x560b61c1d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:38.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.111+0000 7f46b4e0e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560b61b2d680 con 0x560b61a9a610 2024-09-13T23:05:38.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.111+0000 7f46b063b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61a9a610 0x560b61c1d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:38.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.111+0000 7f46b063b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61a9a610 0x560b61c1d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58566/0 (socket says 172.21.15.164:58566) 2024-09-13T23:05:38.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.111+0000 7f46b063b640 1 -- 172.21.15.164:0/2251925094 learned_addr learned my addr 172.21.15.164:0/2251925094 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:38.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.111+0000 7f46b063b640 1 -- 172.21.15.164:0/2251925094 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b619d3fe0 con 0x560b61a9a610 2024-09-13T23:05:38.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.112+0000 7f46b063b640 1 --2- 172.21.15.164:0/2251925094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61a9a610 0x560b61c1d280 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f46a000b7c0 tx=0x7f46a0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:38.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.112+0000 7f459ce09640 1 -- 172.21.15.164:0/2251925094 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46a0012030 con 0x560b61a9a610 2024-09-13T23:05:38.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.112+0000 7f459ce09640 1 -- 172.21.15.164:0/2251925094 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a0001470 con 0x560b61a9a610 2024-09-13T23:05:38.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.112+0000 7f46b4e0e800 1 -- 172.21.15.164:0/2251925094 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b61c1d7c0 con 0x560b61a9a610 2024-09-13T23:05:38.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.112+0000 7f459ce09640 1 -- 172.21.15.164:0/2251925094 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46a001a8d0 con 0x560b61a9a610 2024-09-13T23:05:38.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.112+0000 7f46b4e0e800 1 -- 172.21.15.164:0/2251925094 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b61c1dce0 con 0x560b61a9a610 2024-09-13T23:05:38.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.113+0000 7f459ce09640 1 -- 172.21.15.164:0/2251925094 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f46a0015020 con 0x560b61a9a610 2024-09-13T23:05:38.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.113+0000 7f459ce09640 1 --2- 172.21.15.164:0/2251925094 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4598036b90 0x7f4598039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:38.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.113+0000 7f459ce09640 1 -- 172.21.15.164:0/2251925094 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f46a0020030 con 0x560b61a9a610 2024-09-13T23:05:38.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.113+0000 7f46a7fff640 1 --2- 172.21.15.164:0/2251925094 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4598036b90 0x7f4598039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:38.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.113+0000 7f46b4e0e800 1 --2- 172.21.15.164:0/2251925094 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560b61b2a990 0x560b61c242f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:38.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.113+0000 7f46b4e0e800 1 -- 172.21.15.164:0/2251925094 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b61c24870 con 0x560b61b2a990 2024-09-13T23:05:38.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.113+0000 7f46b0e3c640 1 --2- 172.21.15.164:0/2251925094 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560b61b2a990 0x560b61c242f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:38.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.113+0000 7f46a7fff640 1 --2- 172.21.15.164:0/2251925094 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4598036b90 0x7f4598039050 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4698057000 tx=0x7f4698052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:38.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.113+0000 7f46b0e3c640 1 --2- 172.21.15.164:0/2251925094 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560b61b2a990 0x560b61c242f0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:38.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.114+0000 7f46b0e3c640 1 -- 172.21.15.164:0/2251925094 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46a800a4a0 con 0x560b61b2a990 2024-09-13T23:05:38.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.114+0000 7f46b4e0e800 1 -- 172.21.15.164:0/2251925094 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b61c218a0 con 0x560b61b2a990 2024-09-13T23:05:38.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.114+0000 7f46b0e3c640 1 -- 172.21.15.164:0/2251925094 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f46a800a4a0 con 0x560b61b2a990 2024-09-13T23:05:38.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.114+0000 7f46b4e0e800 1 -- 172.21.15.164:0/2251925094 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b61c26670 con 0x560b61b2a990 2024-09-13T23:05:38.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.114+0000 7f46b0e3c640 1 -- 172.21.15.164:0/2251925094 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f46a800a4a0 con 0x560b61b2a990 2024-09-13T23:05:38.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.114+0000 7f46b4e0e800 1 -- 172.21.15.164:0/2251925094 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b61c257b0 con 0x560b61b2a990 2024-09-13T23:05:38.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.115+0000 7f46b0e3c640 1 -- 172.21.15.164:0/2251925094 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f46a800a4a0 con 0x560b61b2a990 2024-09-13T23:05:38.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.115+0000 7f46b4e0e800 1 -- 172.21.15.164:0/2251925094 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b61c25bd0 con 0x560b61b2a990 2024-09-13T23:05:38.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.115+0000 7f46b0e3c640 1 -- 172.21.15.164:0/2251925094 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f46a800a4a0 con 0x560b61b2a990 2024-09-13T23:05:38.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.115+0000 7f46b4e0e800 1 Processor -- start 2024-09-13T23:05:38.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.115+0000 7f46b4e0e800 1 -- start start 2024-09-13T23:05:38.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.115+0000 7f46b4e0e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61b26c20 0x560b61b25270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:38.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.115+0000 7f46b4e0e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560b619c1580 con 0x560b61b26c20 2024-09-13T23:05:38.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.116+0000 7f46a7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61b26c20 0x560b61b25270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:38.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.116+0000 7f46a7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61b26c20 0x560b61b25270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58576/0 (socket says 172.21.15.164:58576) 2024-09-13T23:05:38.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.116+0000 7f46a7fff640 1 -- 172.21.15.164:0/706693657 learned_addr learned my addr 172.21.15.164:0/706693657 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:38.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.116+0000 7f46a7fff640 1 -- 172.21.15.164:0/706693657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b61b27040 con 0x560b61b26c20 2024-09-13T23:05:38.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.116+0000 7f46a7fff640 1 --2- 172.21.15.164:0/706693657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61b26c20 0x560b61b25270 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4698045f50 tx=0x7f4698002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:38.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.116+0000 7f4595ffb640 1 -- 172.21.15.164:0/706693657 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f469806f070 con 0x560b61b26c20 2024-09-13T23:05:38.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.116+0000 7f4595ffb640 1 -- 172.21.15.164:0/706693657 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f469805f550 con 0x560b61b26c20 2024-09-13T23:05:38.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.116+0000 7f46b4e0e800 1 -- 172.21.15.164:0/706693657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b61b25810 con 0x560b61b26c20 2024-09-13T23:05:38.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.116+0000 7f4595ffb640 1 -- 172.21.15.164:0/706693657 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f469805f830 con 0x560b61b26c20 2024-09-13T23:05:38.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.116+0000 7f46b4e0e800 1 -- 172.21.15.164:0/706693657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b61b25cb0 con 0x560b61b26c20 2024-09-13T23:05:38.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.117+0000 7f4595ffb640 1 -- 172.21.15.164:0/706693657 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f469805f9d0 con 0x560b61b26c20 2024-09-13T23:05:38.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.117+0000 7f4595ffb640 1 --2- 172.21.15.164:0/706693657 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4588036b90 0x7f4588039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:38.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.117+0000 7f4595ffb640 1 -- 172.21.15.164:0/706693657 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4698092d10 con 0x560b61b26c20 2024-09-13T23:05:38.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.117+0000 7f46b0e3c640 1 --2- 172.21.15.164:0/706693657 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4588036b90 0x7f4588039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:38.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.118+0000 7f46b4e0e800 1 Processor -- start 2024-09-13T23:05:38.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.118+0000 7f46b4e0e800 1 -- start start 2024-09-13T23:05:38.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.118+0000 7f46b0e3c640 1 --2- 172.21.15.164:0/706693657 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4588036b90 0x7f4588039050 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x560b61c25b50 tx=0x7f46a8005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:38.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.118+0000 7f46b4e0e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61c43a30 0x560b61c43e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:38.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.118+0000 7f46b4e0e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560b61c16030 con 0x560b61c43a30 2024-09-13T23:05:38.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.118+0000 7f46a7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61c43a30 0x560b61c43e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:38.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.118+0000 7f46a7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61c43a30 0x560b61c43e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58586/0 (socket says 172.21.15.164:58586) 2024-09-13T23:05:38.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.118+0000 7f46a7fff640 1 -- 172.21.15.164:0/4036111023 learned_addr learned my addr 172.21.15.164:0/4036111023 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:38.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.118+0000 7f46a7fff640 1 -- 172.21.15.164:0/4036111023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b61c44400 con 0x560b61c43a30 2024-09-13T23:05:38.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.118+0000 7f46a7fff640 1 --2- 172.21.15.164:0/4036111023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61c43a30 0x560b61c43e30 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4698053da0 tx=0x7f469807cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e9aa9c05dbeff5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:38.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.119+0000 7f458f7fe640 1 -- 172.21.15.164:0/4036111023 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4698080070 con 0x560b61c43a30 2024-09-13T23:05:38.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.119+0000 7f458f7fe640 1 -- 172.21.15.164:0/4036111023 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f469805fcc0 con 0x560b61c43a30 2024-09-13T23:05:38.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.119+0000 7f458f7fe640 1 -- 172.21.15.164:0/4036111023 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f469806a3a0 con 0x560b61c43a30 2024-09-13T23:05:38.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.119+0000 7f46b4e0e800 1 -- 172.21.15.164:0/4036111023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61c43a30 msgr2=0x560b61c43e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:38.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.119+0000 7f46b4e0e800 1 --2- 172.21.15.164:0/4036111023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61c43a30 0x560b61c43e30 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4698053da0 tx=0x7f469807cea0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.119+0000 7f46b4e0e800 1 -- 172.21.15.164:0/4036111023 shutdown_connections 2024-09-13T23:05:38.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.119+0000 7f46b4e0e800 1 --2- 172.21.15.164:0/4036111023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61c43a30 0x560b61c43e30 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.119+0000 7f46b4e0e800 1 -- 172.21.15.164:0/4036111023 >> 172.21.15.164:0/4036111023 conn(0x560b61c3fd90 msgr2=0x560b61c3de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:38.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.119+0000 7f46b4e0e800 1 -- 172.21.15.164:0/4036111023 shutdown_connections 2024-09-13T23:05:38.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.119+0000 7f46b4e0e800 1 -- 172.21.15.164:0/4036111023 wait complete. 2024-09-13T23:05:38.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.120+0000 7f46b4e0e800 1 Processor -- start 2024-09-13T23:05:38.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.120+0000 7f46b4e0e800 1 -- start start 2024-09-13T23:05:38.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.120+0000 7f46b4e0e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61c43a30 0x560b61c4aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:38.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.120+0000 7f46b4e0e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560b61c44a70 con 0x560b61c43a30 2024-09-13T23:05:38.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.120+0000 7f46a7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61c43a30 0x560b61c4aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:38.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.120+0000 7f46a7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61c43a30 0x560b61c4aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:58596/0 (socket says 172.21.15.164:58596) 2024-09-13T23:05:38.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.120+0000 7f46a7fff640 1 -- 172.21.15.164:0/3612119469 learned_addr learned my addr 172.21.15.164:0/3612119469 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:38.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.120+0000 7f46a7fff640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b61c4b430 con 0x560b61c43a30 2024-09-13T23:05:38.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.121+0000 7f46a7fff640 1 --2- 172.21.15.164:0/3612119469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61c43a30 0x560b61c4aef0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f469806afd0 tx=0x7f4698091010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:38.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.121+0000 7f458dffb640 1 -- 172.21.15.164:0/3612119469 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f469806a720 con 0x560b61c43a30 2024-09-13T23:05:38.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.121+0000 7f458dffb640 1 -- 172.21.15.164:0/3612119469 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4698096070 con 0x560b61c43a30 2024-09-13T23:05:38.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.121+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b61c4b6c0 con 0x560b61c43a30 2024-09-13T23:05:38.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.121+0000 7f458dffb640 1 -- 172.21.15.164:0/3612119469 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f469807c3f0 con 0x560b61c43a30 2024-09-13T23:05:38.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.121+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b61c4e370 con 0x560b61c43a30 2024-09-13T23:05:38.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.121+0000 7f458dffb640 1 -- 172.21.15.164:0/3612119469 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4698098030 con 0x560b61c43a30 2024-09-13T23:05:38.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.122+0000 7f458dffb640 1 --2- 172.21.15.164:0/3612119469 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4580036b90 0x7f4580039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:38.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.122+0000 7f458dffb640 1 -- 172.21.15.164:0/3612119469 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4698086cb0 con 0x560b61c43a30 2024-09-13T23:05:38.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.122+0000 7f46b0e3c640 1 --2- 172.21.15.164:0/3612119469 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4580036b90 0x7f4580039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:38.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.123+0000 7f46b4e0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:38.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.123+0000 7f46b0e3c640 1 --2- 172.21.15.164:0/3612119469 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4580036b90 0x7f4580039050 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x560b61c252d0 tx=0x7f46a801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:38.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.123+0000 7f46b4e0e800 1 --2- 172.21.15.164:0/3612119469 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560b61c56a80 0x560b61c58f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:38.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.123+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b61c59690 con 0x560b61c56a80 2024-09-13T23:05:38.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.123+0000 7f46b063b640 1 --2- 172.21.15.164:0/3612119469 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560b61c56a80 0x560b61c58f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:38.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.123+0000 7f46b063b640 1 --2- 172.21.15.164:0/3612119469 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560b61c56a80 0x560b61c58f40 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:38.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.124+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.124+0000 7f46b4e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:38.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.124+0000 7f46b4e0e800 20 realm 2024-09-13T23:05:38.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.124+0000 7f46b4e0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:38.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.124+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b61c59aa0 con 0x560b61c56a80 2024-09-13T23:05:38.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.124+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.124+0000 7f46b4e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:38.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.124+0000 7f46b4e0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:38.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.124+0000 7f46b4e0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:38.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.124+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5a370 con 0x560b61c56a80 2024-09-13T23:05:38.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.124+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.124+0000 7f46b4e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:38.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.124+0000 7f46b4e0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:38.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.124+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5a710 con 0x560b61c56a80 2024-09-13T23:05:38.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.124+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.124+0000 7f46b4e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:38.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.124+0000 7f46b4e0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:38.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.124+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x560b61c56a80 2024-09-13T23:05:38.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.125+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.125+0000 7f46b4e0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:38.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.125+0000 7f46b4e0e800 20 searching for the correct realm 2024-09-13T23:05:38.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.125+0000 7f46b4e0e800 1 --2- 172.21.15.164:0/3612119469 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x560b61c5ccd0 0x560b61c5f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:38.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.125+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5f6d0 con 0x560b61c5ccd0 2024-09-13T23:05:38.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.125+0000 7f46a7fff640 1 --2- 172.21.15.164:0/3612119469 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x560b61c5ccd0 0x560b61c5f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:38.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.125+0000 7f46a7fff640 1 --2- 172.21.15.164:0/3612119469 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x560b61c5ccd0 0x560b61c5f0c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:38.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.125+0000 7f46a7fff640 1 -- 172.21.15.164:0/3612119469 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46980a1070 con 0x560b61c5ccd0 2024-09-13T23:05:38.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.125+0000 7f46a7fff640 1 --2- 172.21.15.164:0/3612119469 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f4698085070 0x7f4698092690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:38.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.125+0000 7f46a7fff640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5f6d0 con 0x7f4698085070 2024-09-13T23:05:38.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.126+0000 7f46b0e3c640 1 --2- 172.21.15.164:0/3612119469 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f4698085070 0x7f4698092690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:38.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.126+0000 7f46b0e3c640 1 --2- 172.21.15.164:0/3612119469 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f4698085070 0x7f4698092690 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:38.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.126+0000 7f46b0e3c640 1 -- 172.21.15.164:0/3612119469 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a801f070 con 0x7f4698085070 2024-09-13T23:05:38.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.126+0000 7f46b0e3c640 1 --2- 172.21.15.164:0/3612119469 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f46a8031040 0x7f46a8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:38.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.126+0000 7f46b0e3c640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5f6d0 con 0x7f46a8031040 2024-09-13T23:05:38.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.126+0000 7f46b063b640 1 --2- 172.21.15.164:0/3612119469 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f46a8031040 0x7f46a8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:38.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.127+0000 7f46b063b640 1 --2- 172.21.15.164:0/3612119469 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f46a8031040 0x7f46a8032940 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:38.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.127+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a0018950 con 0x7f46a8031040 2024-09-13T23:05:38.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.127+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x560b61c56a80 2024-09-13T23:05:38.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.127+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.127+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x560b61c56a80 2024-09-13T23:05:38.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.127+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.127+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x7f46a8031040 2024-09-13T23:05:38.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.128+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a0018950 con 0x7f46a8031040 2024-09-13T23:05:38.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.128+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x7f46a8031040 2024-09-13T23:05:38.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.128+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a0018950 con 0x7f46a8031040 2024-09-13T23:05:38.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.128+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x7f4698085070 2024-09-13T23:05:38.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.128+0000 7f46b0e3c640 1 -- 172.21.15.164:0/3612119469 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a801f070 con 0x7f4698085070 2024-09-13T23:05:38.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.128+0000 7f46b0e3c640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x560b61c5ccd0 2024-09-13T23:05:38.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.128+0000 7f46a7fff640 1 -- 172.21.15.164:0/3612119469 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46980a1070 con 0x560b61c5ccd0 2024-09-13T23:05:38.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.128+0000 7f46a7fff640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x560b61c56a80 2024-09-13T23:05:38.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.128+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.129+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x7f46a8031040 2024-09-13T23:05:38.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.129+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a0018950 con 0x7f46a8031040 2024-09-13T23:05:38.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.129+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x560b61c56a80 2024-09-13T23:05:38.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.129+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.129+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x7f4698085070 2024-09-13T23:05:38.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.129+0000 7f46b0e3c640 1 -- 172.21.15.164:0/3612119469 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f46a801f070 con 0x7f4698085070 2024-09-13T23:05:38.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.129+0000 7f46b0e3c640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x560b61c5ccd0 2024-09-13T23:05:38.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.129+0000 7f46a7fff640 1 -- 172.21.15.164:0/3612119469 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46980a1070 con 0x560b61c5ccd0 2024-09-13T23:05:38.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.129+0000 7f46a7fff640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x560b61c5ccd0 2024-09-13T23:05:38.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.130+0000 7f46a7fff640 1 -- 172.21.15.164:0/3612119469 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46980a1070 con 0x560b61c5ccd0 2024-09-13T23:05:38.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.130+0000 7f46a7fff640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x7f46a8031040 2024-09-13T23:05:38.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.130+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a0018950 con 0x7f46a8031040 2024-09-13T23:05:38.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.130+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x560b61c5ccd0 2024-09-13T23:05:38.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.130+0000 7f46a7fff640 1 -- 172.21.15.164:0/3612119469 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46980a1070 con 0x560b61c5ccd0 2024-09-13T23:05:38.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.130+0000 7f46a7fff640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x560b61c5ccd0 2024-09-13T23:05:38.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.130+0000 7f46a7fff640 1 -- 172.21.15.164:0/3612119469 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46980a1070 con 0x560b61c5ccd0 2024-09-13T23:05:38.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.130+0000 7f46a7fff640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x560b61c56a80 2024-09-13T23:05:38.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.131+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.131+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x560b61c56a80 2024-09-13T23:05:38.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.131+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.131+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x7f46a8031040 2024-09-13T23:05:38.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.131+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a0018950 con 0x7f46a8031040 2024-09-13T23:05:38.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.131+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x560b61c5ccd0 2024-09-13T23:05:38.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.131+0000 7f46a7fff640 1 -- 172.21.15.164:0/3612119469 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46980a1070 con 0x560b61c5ccd0 2024-09-13T23:05:38.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.131+0000 7f46a7fff640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x7f4698085070 2024-09-13T23:05:38.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.132+0000 7f46b0e3c640 1 -- 172.21.15.164:0/3612119469 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a801f070 con 0x7f4698085070 2024-09-13T23:05:38.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.132+0000 7f46b0e3c640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x560b61c56a80 2024-09-13T23:05:38.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.132+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.132+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x7f46a8031040 2024-09-13T23:05:38.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.132+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a0018950 con 0x7f46a8031040 2024-09-13T23:05:38.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.132+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x560b61c5ccd0 2024-09-13T23:05:38.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.132+0000 7f46a7fff640 1 -- 172.21.15.164:0/3612119469 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46980a1070 con 0x560b61c5ccd0 2024-09-13T23:05:38.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.132+0000 7f46a7fff640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x7f46a8031040 2024-09-13T23:05:38.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.133+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a0018950 con 0x7f46a8031040 2024-09-13T23:05:38.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.133+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x7f4698085070 2024-09-13T23:05:38.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.133+0000 7f46b0e3c640 1 -- 172.21.15.164:0/3612119469 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a801f070 con 0x7f4698085070 2024-09-13T23:05:38.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.133+0000 7f46b0e3c640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x560b61c5ccd0 2024-09-13T23:05:38.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.133+0000 7f46a7fff640 1 -- 172.21.15.164:0/3612119469 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46980a1070 con 0x560b61c5ccd0 2024-09-13T23:05:38.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.133+0000 7f46a7fff640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x7f46a8031040 2024-09-13T23:05:38.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.133+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a0018950 con 0x7f46a8031040 2024-09-13T23:05:38.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.133+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5af60 con 0x560b61c56a80 2024-09-13T23:05:38.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.134+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.134+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f46a005f040 con 0x7f4698085070 2024-09-13T23:05:38.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.134+0000 7f46b0e3c640 1 -- 172.21.15.164:0/3612119469 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a801f070 con 0x7f4698085070 2024-09-13T23:05:38.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.134+0000 7f46b4e0e800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:38.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.134+0000 7f46b4e0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:38.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.134+0000 7f46b4e0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:38.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.134+0000 7f46b4e0e800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:38.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.134+0000 7f46b4e0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:38.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.134+0000 7f46b4e0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:38.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.134+0000 7f46b4e0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:38.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.134+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5b410 con 0x560b61c56a80 2024-09-13T23:05:38.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.134+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.134+0000 7f46b4e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:38.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.134+0000 7f46b4e0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:38.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.134+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5b800 con 0x560b61c56a80 2024-09-13T23:05:38.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.134+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.134+0000 7f46b4e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:38.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.134+0000 7f46b4e0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:38.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.134+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5b800 con 0x560b61c56a80 2024-09-13T23:05:38.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.135+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.135+0000 7f46b4e0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:38.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.135+0000 7f46b4e0e800 20 zone default found 2024-09-13T23:05:38.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.135+0000 7f46b4e0e800 4 Realm: () 2024-09-13T23:05:38.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.135+0000 7f46b4e0e800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:38.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.135+0000 7f46b4e0e800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:38.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.135+0000 7f46b4e0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:38.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.135+0000 7f46b4e0e800 20 zonegroup default 2024-09-13T23:05:38.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.135+0000 7f46b4e0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:38.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.135+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5c0d0 con 0x7f46a8031040 2024-09-13T23:05:38.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.135+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f46a0018950 con 0x7f46a8031040 2024-09-13T23:05:38.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.135+0000 7f46b4e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:38.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.135+0000 7f46b4e0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:38.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.135+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b61c5c0d0 con 0x560b61c5ccd0 2024-09-13T23:05:38.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.135+0000 7f46a7fff640 1 -- 172.21.15.164:0/3612119469 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f46980a1070 con 0x560b61c5ccd0 2024-09-13T23:05:38.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.135+0000 7f46b4e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:38.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.135+0000 7f46b4e0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:38.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.135+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b61c61530 con 0x560b61c5ccd0 2024-09-13T23:05:38.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.135+0000 7f46a7fff640 1 -- 172.21.15.164:0/3612119469 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f46980a1070 con 0x560b61c5ccd0 2024-09-13T23:05:38.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.135+0000 7f46b4e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:38.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.135+0000 7f46b4e0e800 20 started sync module instance, tier type = 2024-09-13T23:05:38.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.135+0000 7f46b4e0e800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:38.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.135+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b61c609d0 con 0x7f4698085070 2024-09-13T23:05:38.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.137+0000 7f46b0e3c640 1 -- 172.21.15.164:0/3612119469 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(44 notify.0 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a8040040 con 0x7f4698085070 2024-09-13T23:05:38.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.137+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94606884996384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b61c618d0 con 0x7f4698085070 2024-09-13T23:05:38.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.137+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b61c62180 con 0x560b61c56a80 2024-09-13T23:05:38.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.138+0000 7f46b0e3c640 1 -- 172.21.15.164:0/3612119469 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94606884996384] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a8040040 con 0x7f4698085070 2024-09-13T23:05:38.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.138+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.138+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94606884998640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b61c61d80 con 0x560b61c56a80 2024-09-13T23:05:38.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.138+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b61c62c10 con 0x560b61c5ccd0 2024-09-13T23:05:38.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.139+0000 7f46a7fff640 1 -- 172.21.15.164:0/3612119469 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46980a1070 con 0x560b61c5ccd0 2024-09-13T23:05:38.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.139+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94606885005024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b61c634b0 con 0x560b61c5ccd0 2024-09-13T23:05:38.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.139+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b61c63f50 con 0x7f4698085070 2024-09-13T23:05:38.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.139+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94606884998640] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.140+0000 7f46a7fff640 1 -- 172.21.15.164:0/3612119469 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94606885005024] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46980a1070 con 0x560b61c5ccd0 2024-09-13T23:05:38.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.140+0000 7f46b0e3c640 1 -- 172.21.15.164:0/3612119469 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(50 notify.3 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a8040040 con 0x7f4698085070 2024-09-13T23:05:38.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.140+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94606885007360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b61c618d0 con 0x7f4698085070 2024-09-13T23:05:38.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.140+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b61c64830 con 0x560b61c56a80 2024-09-13T23:05:38.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.141+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.141+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94606885012288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b61c647a0 con 0x560b61c56a80 2024-09-13T23:05:38.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.141+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b61c65790 con 0x7f46a8031040 2024-09-13T23:05:38.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.141+0000 7f46b0e3c640 1 -- 172.21.15.164:0/3612119469 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94606885007360] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a8040040 con 0x7f4698085070 2024-09-13T23:05:38.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.142+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94606885012288] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.142+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(54 notify.5 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a0018950 con 0x7f46a8031040 2024-09-13T23:05:38.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.142+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94606885016224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b61c65790 con 0x7f46a8031040 2024-09-13T23:05:38.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.142+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b61c65bb0 con 0x7f46a8031040 2024-09-13T23:05:38.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.143+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94606885016224] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a0018950 con 0x7f46a8031040 2024-09-13T23:05:38.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.143+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(56 notify.6 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a0018950 con 0x7f46a8031040 2024-09-13T23:05:38.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.143+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94606885014208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b61c65b60 con 0x7f46a8031040 2024-09-13T23:05:38.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.143+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b61c66660 con 0x7f46a8031040 2024-09-13T23:05:38.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.144+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a0018950 con 0x7f46a8031040 2024-09-13T23:05:38.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.144+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94606885014208] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a0018950 con 0x7f46a8031040 2024-09-13T23:05:38.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.144+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94606885019984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b61c66ad0 con 0x7f46a8031040 2024-09-13T23:05:38.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.144+0000 7f46b4e0e800 20 add_watcher() i=0 2024-09-13T23:05:38.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.144+0000 7f46b4e0e800 20 add_watcher() i=1 2024-09-13T23:05:38.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.144+0000 7f46b4e0e800 20 add_watcher() i=2 2024-09-13T23:05:38.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.144+0000 7f46b4e0e800 20 add_watcher() i=3 2024-09-13T23:05:38.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.144+0000 7f46b4e0e800 20 add_watcher() i=4 2024-09-13T23:05:38.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.144+0000 7f46b4e0e800 20 add_watcher() i=5 2024-09-13T23:05:38.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.144+0000 7f46b4e0e800 20 add_watcher() i=6 2024-09-13T23:05:38.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.145+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94606885019984] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a0018950 con 0x7f46a8031040 2024-09-13T23:05:38.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.145+0000 7f46b4e0e800 20 add_watcher() i=7 2024-09-13T23:05:38.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.145+0000 7f46b4e0e800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:38.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.145+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b61c66ad0 con 0x560b61c56a80 2024-09-13T23:05:38.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.146+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.146+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94606885021216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b61c66ab0 con 0x560b61c56a80 2024-09-13T23:05:38.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.147+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94606885021216] v32'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.147+0000 7f45667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:38.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.147+0000 7f46b4e0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:38.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.147+0000 7f46b4e0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:38.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.147+0000 7f46b4e0e800 5 note: GC not initialized 2024-09-13T23:05:38.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.147+0000 7f45657e2640 20 reqs_thread_entry: start 2024-09-13T23:05:38.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.148+0000 7f46b4e0e800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:38.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.148+0000 7f46b4e0e800 20 Filter name: none 2024-09-13T23:05:38.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.148+0000 7f44d6ffd640 20 reqs_thread_entry: start 2024-09-13T23:05:38.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.148+0000 7f46b4e0e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:05:38.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.148+0000 7f46b4e0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:38.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.148+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b61c9cec0 con 0x560b61c56a80 2024-09-13T23:05:38.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.148+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.148+0000 7f46b4e0e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:05:38.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.148+0000 7f46b4e0e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:05:38.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.148+0000 7f46b4e0e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:38.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.148+0000 7f46b4e0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:38.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.148+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b61c9c9a0 con 0x7f4698085070 2024-09-13T23:05:38.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.149+0000 7f46b0e3c640 1 -- 172.21.15.164:0/3612119469 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f46a8040040 con 0x7f4698085070 2024-09-13T23:05:38.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.149+0000 7f46b4e0e800 20 enabling bucket name=myfoo 2024-09-13T23:05:38.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.149+0000 7f46b4e0e800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:05:38.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.149+0000 7f46b4e0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:38.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.149+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b61c9d930 con 0x7f4698085070 2024-09-13T23:05:38.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.149+0000 7f46b0e3c640 1 -- 172.21.15.164:0/3612119469 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f46a8040040 con 0x7f4698085070 2024-09-13T23:05:38.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.149+0000 7f46b4e0e800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:05:38.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.149+0000 7f46b4e0e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-13T23:05:38.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.149+0000 7f46b4e0e800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:05:38.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.149+0000 7f46b4e0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 : miss 2024-09-13T23:05:38.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.149+0000 7f46b4e0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:38.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.149+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:65 8.15 8:aa4f46c1:root::.bucket.meta.myfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b61ca01a0 con 0x560b61c5ccd0 2024-09-13T23:05:38.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.149+0000 7f46a7fff640 1 -- 172.21.15.164:0/3612119469 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(65 .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv8 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f46980a1070 con 0x560b61c5ccd0 2024-09-13T23:05:38.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.149+0000 7f46b4e0e800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:05:38.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.149+0000 7f46b4e0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 info.flags=0x17 2024-09-13T23:05:38.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.149+0000 7f46b4e0e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 to cache LRU end 2024-09-13T23:05:38.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.149+0000 7f46b4e0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:38.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.149+0000 7f46b4e0e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:05:38.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.150+0000 7f46b4e0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 2024-09-13T23:05:38.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.150+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:66 8.15 8:aa4f46c1:root::.bucket.meta.myfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b61ca7d70 con 0x560b61c5ccd0 2024-09-13T23:05:38.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.151+0000 7f46a7fff640 1 -- 172.21.15.164:0/3612119469 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(66 .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v32'9 uv9 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f46980a1070 con 0x560b61c5ccd0 2024-09-13T23:05:38.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.151+0000 7f46b4e0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 info.flags=0x17 2024-09-13T23:05:38.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.151+0000 7f46b4e0e800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 to cache LRU end 2024-09-13T23:05:38.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.151+0000 7f46b4e0e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:05:38.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.151+0000 7f46b4e0e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1, ofs0, ns] 2024-09-13T23:05:38.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.151+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94606885259328 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b61ca2310 con 0x7f46a8031040 2024-09-13T23:05:38.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.151+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== watch-notify(notify (1) cookie 94606885016224 notify 137438953488 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7f46a0039040 con 0x7f46a8031040 2024-09-13T23:05:38.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.151+0000 7f458f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953488 cookie 94606885016224 notifier 4610 bl.length()=752 2024-09-13T23:05:38.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.151+0000 7f458f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 info.flags=0x17 2024-09-13T23:05:38.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.151+0000 7f458f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1 to cache LRU end 2024-09-13T23:05:38.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.151+0000 7f458f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:05:38.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.151+0000 7f458f7fe640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4574003ea0 con 0x7f46a8031040 2024-09-13T23:05:38.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.151+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(67 notify.5 [notify cookie 94606885259328 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f46a0018950 con 0x7f46a8031040 2024-09-13T23:05:38.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.152+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a0018950 con 0x7f46a8031040 2024-09-13T23:05:38.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.152+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== watch-notify(notify_complete (2) cookie 94606885259328 notify 137438953488 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560b61c1dce0 con 0x7f46a8031040 2024-09-13T23:05:38.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.152+0000 7f46b4e0e800 20 handle_bi_update(): bucket=:myfoo[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1]): orig_sources= new_sources= 2024-09-13T23:05:38.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.152+0000 7f46b4e0e800 20 handle_bi_update(): bucket=:myfoo[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1]): potential sources added=[] removed=[] 2024-09-13T23:05:38.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.152+0000 7f46b4e0e800 20 handle_bi_update(): bucket=:myfoo[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1]): orig_dests= new_dests= 2024-09-13T23:05:38.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.152+0000 7f46b4e0e800 20 handle_bi_update(): bucket=:myfoo[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1]): potential dests added=[] removed=[] 2024-09-13T23:05:38.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.152+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b61ca0820 con 0x560b61c56a80 2024-09-13T23:05:38.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.153+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v32'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.153+0000 7f46b4e0e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:38.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.153+0000 7f46b4e0e800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:38.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.153+0000 7f46b4e0e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:05:38.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.153+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94606885259296 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b61ca6cb0 con 0x560b61c56a80 2024-09-13T23:05:38.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.153+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== watch-notify(notify (1) cookie 94606885012288 notify 137438953489 ret 0) ==== 609+0+0 (crc 0 0 0) 0x560b61c1dce0 con 0x560b61c56a80 2024-09-13T23:05:38.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.153+0000 7f458effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953489 cookie 94606885012288 notifier 4610 bl.length()=567 2024-09-13T23:05:38.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.153+0000 7f458effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:38.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.153+0000 7f458effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:38.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.153+0000 7f458effd640 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f44e4003430 con 0x560b61c56a80 2024-09-13T23:05:38.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.153+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(70 notify.4 [notify cookie 94606885259296 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.153+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.153+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== watch-notify(notify_complete (2) cookie 94606885259296 notify 137438953489 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560b61c1d7c0 con 0x560b61c56a80 2024-09-13T23:05:38.170 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:05:31.300851Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:05:31.300826Z","tags":[],"group_ids":[]} 2024-09-13T23:05:38.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.154+0000 7f45667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:38.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.154+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94606885021216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b61c9ac10 con 0x560b61c56a80 2024-09-13T23:05:38.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.155+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94606885021216] v32'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.155+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94606884996384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b61c9ac10 con 0x7f4698085070 2024-09-13T23:05:38.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.156+0000 7f46b0e3c640 1 -- 172.21.15.164:0/3612119469 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94606884996384] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a8040040 con 0x7f4698085070 2024-09-13T23:05:38.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.156+0000 7f46b4e0e800 20 remove_watcher() i=0 2024-09-13T23:05:38.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.156+0000 7f46b4e0e800 2 removed watcher, disabling cache 2024-09-13T23:05:38.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.156+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94606884998640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b61c9ac10 con 0x560b61c56a80 2024-09-13T23:05:38.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.157+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94606884998640] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.157+0000 7f46b4e0e800 20 remove_watcher() i=1 2024-09-13T23:05:38.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.157+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94606885005024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b61c9ac10 con 0x560b61c5ccd0 2024-09-13T23:05:38.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.158+0000 7f46a7fff640 1 -- 172.21.15.164:0/3612119469 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94606885005024] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46980a1070 con 0x560b61c5ccd0 2024-09-13T23:05:38.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.158+0000 7f46b4e0e800 20 remove_watcher() i=2 2024-09-13T23:05:38.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.158+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94606885007360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b61c9ac10 con 0x7f4698085070 2024-09-13T23:05:38.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.159+0000 7f46b0e3c640 1 -- 172.21.15.164:0/3612119469 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94606885007360] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a8040040 con 0x7f4698085070 2024-09-13T23:05:38.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.159+0000 7f46b4e0e800 20 remove_watcher() i=3 2024-09-13T23:05:38.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.159+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94606885012288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b61c9ac10 con 0x560b61c56a80 2024-09-13T23:05:38.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.161+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94606885012288] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a0018950 con 0x560b61c56a80 2024-09-13T23:05:38.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.161+0000 7f46b4e0e800 20 remove_watcher() i=4 2024-09-13T23:05:38.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.161+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94606885016224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b61c9ac10 con 0x7f46a8031040 2024-09-13T23:05:38.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.162+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94606885016224] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a0018950 con 0x7f46a8031040 2024-09-13T23:05:38.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.162+0000 7f46b4e0e800 20 remove_watcher() i=5 2024-09-13T23:05:38.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.162+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94606885014208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b61c9ac10 con 0x7f46a8031040 2024-09-13T23:05:38.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.163+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94606885014208] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a0018950 con 0x7f46a8031040 2024-09-13T23:05:38.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.163+0000 7f46b4e0e800 20 remove_watcher() i=6 2024-09-13T23:05:38.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.163+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94606885019984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b61c9ac10 con 0x7f46a8031040 2024-09-13T23:05:38.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94606885019984] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a0018950 con 0x7f46a8031040 2024-09-13T23:05:38.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b4e0e800 20 remove_watcher() i=7 2024-09-13T23:05:38.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f46a8031040 msgr2=0x7f46a8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:38.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b4e0e800 1 --2- 172.21.15.164:0/3612119469 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f46a8031040 0x7f46a8032940 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560b61c56a80 msgr2=0x560b61c58f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:38.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b4e0e800 1 --2- 172.21.15.164:0/3612119469 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560b61c56a80 0x560b61c58f40 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f4698085070 msgr2=0x7f4698092690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:38.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b4e0e800 1 --2- 172.21.15.164:0/3612119469 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f4698085070 0x7f4698092690 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x560b61c5ccd0 msgr2=0x560b61c5f0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:38.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b4e0e800 1 --2- 172.21.15.164:0/3612119469 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x560b61c5ccd0 0x560b61c5f0c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4580036b90 msgr2=0x7f4580039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:38.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b4e0e800 1 --2- 172.21.15.164:0/3612119469 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4580036b90 0x7f4580039050 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x560b61c252d0 tx=0x7f46a801f000 comp rx=0 tx=0).stop 2024-09-13T23:05:38.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61c43a30 msgr2=0x560b61c4aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:38.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b063b640 1 -- 172.21.15.164:0/3612119469 reap_dead start 2024-09-13T23:05:38.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b4e0e800 1 --2- 172.21.15.164:0/3612119469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61c43a30 0x560b61c4aef0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f469806afd0 tx=0x7f4698091010 comp rx=0 tx=0).stop 2024-09-13T23:05:38.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 shutdown_connections 2024-09-13T23:05:38.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b4e0e800 1 --2- 172.21.15.164:0/3612119469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61c43a30 0x560b61c4aef0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 >> 172.21.15.164:0/3612119469 conn(0x560b61c3fd90 msgr2=0x560b61c3de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:38.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 shutdown_connections 2024-09-13T23:05:38.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b4e0e800 1 -- 172.21.15.164:0/3612119469 wait complete. 2024-09-13T23:05:38.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b4e0e800 1 -- 172.21.15.164:0/706693657 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4588036b90 msgr2=0x7f4588039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:38.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b4e0e800 1 --2- 172.21.15.164:0/706693657 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4588036b90 0x7f4588039050 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x560b61c25b50 tx=0x7f46a8005840 comp rx=0 tx=0).stop 2024-09-13T23:05:38.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b4e0e800 1 -- 172.21.15.164:0/706693657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61b26c20 msgr2=0x560b61b25270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:38.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b4e0e800 1 --2- 172.21.15.164:0/706693657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61b26c20 0x560b61b25270 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4698045f50 tx=0x7f4698002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b4e0e800 1 -- 172.21.15.164:0/706693657 shutdown_connections 2024-09-13T23:05:38.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b4e0e800 1 --2- 172.21.15.164:0/706693657 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4588036b90 0x7f4588039050 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b4e0e800 1 --2- 172.21.15.164:0/706693657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61b26c20 0x560b61b25270 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b4e0e800 1 -- 172.21.15.164:0/706693657 >> 172.21.15.164:0/706693657 conn(0x560b61c29c30 msgr2=0x560b61c2c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:38.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b4e0e800 1 -- 172.21.15.164:0/706693657 shutdown_connections 2024-09-13T23:05:38.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.164+0000 7f46b4e0e800 1 -- 172.21.15.164:0/706693657 wait complete. 2024-09-13T23:05:38.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.165+0000 7f46b4e0e800 1 -- 172.21.15.164:0/2251925094 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560b61b2a990 msgr2=0x560b61c242f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:38.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.165+0000 7f46b4e0e800 1 --2- 172.21.15.164:0/2251925094 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560b61b2a990 0x560b61c242f0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.165+0000 7f46b4e0e800 1 -- 172.21.15.164:0/2251925094 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4598036b90 msgr2=0x7f4598039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:38.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.165+0000 7f46b4e0e800 1 --2- 172.21.15.164:0/2251925094 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4598036b90 0x7f4598039050 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4698057000 tx=0x7f4698052000 comp rx=0 tx=0).stop 2024-09-13T23:05:38.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.165+0000 7f46b4e0e800 1 -- 172.21.15.164:0/2251925094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61a9a610 msgr2=0x560b61c1d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:38.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.165+0000 7f46b4e0e800 1 --2- 172.21.15.164:0/2251925094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61a9a610 0x560b61c1d280 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f46a000b7c0 tx=0x7f46a0000ed0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.165+0000 7f46b4e0e800 1 -- 172.21.15.164:0/2251925094 shutdown_connections 2024-09-13T23:05:38.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.165+0000 7f46b4e0e800 1 --2- 172.21.15.164:0/2251925094 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x560b61b2a990 0x560b61c242f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.165+0000 7f46b4e0e800 1 --2- 172.21.15.164:0/2251925094 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4598036b90 0x7f4598039050 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.165+0000 7f46b4e0e800 1 --2- 172.21.15.164:0/2251925094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b61a9a610 0x560b61c1d280 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:38.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.165+0000 7f46b4e0e800 1 -- 172.21.15.164:0/2251925094 >> 172.21.15.164:0/2251925094 conn(0x560b61b20de0 msgr2=0x560b61c0fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:38.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.165+0000 7f46b4e0e800 1 -- 172.21.15.164:0/2251925094 shutdown_connections 2024-09-13T23:05:38.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:38.165+0000 7f46b4e0e800 1 -- 172.21.15.164:0/2251925094 wait complete. 2024-09-13T23:05:38.181 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:05:31.300851Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:05:31.300826Z', 'tags': [], 'group_ids': []} 2024-09-13T23:05:38.196 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T23:05:38.430 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-13T23:05:38.438 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:05:53.439 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-13T23:05:53.439 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-13T23:05:53.440 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-13T23:05:53.491 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:53.491 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:53.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.490+0000 7f544c60e800 1 Processor -- start 2024-09-13T23:05:53.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.490+0000 7f544c60e800 1 -- start start 2024-09-13T23:05:53.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.490+0000 7f544c60e800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x557148044610 0x5571480d5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:53.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.490+0000 7f544c60e800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557147f8fb30 con 0x5571480d5bb0 2024-09-13T23:05:53.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.490+0000 7f544c60e800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x557147f71360 con 0x557148044610 2024-09-13T23:05:53.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.491+0000 7f5447cc1640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x557148044610 0x5571480d5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:53.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.491+0000 7f54474c0640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x5571480d5bb0 0x5571480d7fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:53908/0 (socket says 172.21.15.164:53908) 2024-09-13T23:05:53.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.491+0000 7f54474c0640 1 -- 172.21.15.164:0/1934502325 learned_addr learned my addr 172.21.15.164:0/1934502325 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:53.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.491+0000 7f5447cc1640 1 -- 172.21.15.164:0/1934502325 >> v1:172.21.15.17:6789/0 conn(0x5571480d5bb0 legacy=0x5571480d7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.491+0000 7f5447cc1640 1 -- 172.21.15.164:0/1934502325 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557147f97e00 con 0x557148044610 2024-09-13T23:05:53.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.491+0000 7f5446cbf640 1 -- 172.21.15.164:0/1934502325 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3592136168 0 0) 0x557147f8fb30 con 0x5571480d5bb0 2024-09-13T23:05:53.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.493+0000 7f5447cc1640 1 --2- 172.21.15.164:0/1934502325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557148044610 0x5571480d5670 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5438005fd0 tx=0x7f5438045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14dda22df20ec25a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:53.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.493+0000 7f5446cbf640 1 -- 172.21.15.164:0/1934502325 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5438058530 con 0x557148044610 2024-09-13T23:05:53.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.493+0000 7f5446cbf640 1 -- 172.21.15.164:0/1934502325 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54380586d0 con 0x557148044610 2024-09-13T23:05:53.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.493+0000 7f5446cbf640 1 -- 172.21.15.164:0/1934502325 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54380589d0 con 0x557148044610 2024-09-13T23:05:53.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.494+0000 7f544c60e800 1 -- 172.21.15.164:0/1934502325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557148044610 msgr2=0x5571480d5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.494+0000 7f544c60e800 1 --2- 172.21.15.164:0/1934502325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557148044610 0x5571480d5670 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5438005fd0 tx=0x7f5438045c30 comp rx=0 tx=0).stop 2024-09-13T23:05:53.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.494+0000 7f544c60e800 1 -- 172.21.15.164:0/1934502325 shutdown_connections 2024-09-13T23:05:53.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.494+0000 7f544c60e800 1 --2- 172.21.15.164:0/1934502325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557148044610 0x5571480d5670 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.494+0000 7f544c60e800 1 -- 172.21.15.164:0/1934502325 >> 172.21.15.164:0/1934502325 conn(0x5571480cade0 msgr2=0x5571480cd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:53.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.494+0000 7f544c60e800 1 -- 172.21.15.164:0/1934502325 shutdown_connections 2024-09-13T23:05:53.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.494+0000 7f544c60e800 1 -- 172.21.15.164:0/1934502325 wait complete. 2024-09-13T23:05:53.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.509+0000 7f544c60e800 1 Processor -- start 2024-09-13T23:05:53.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.510+0000 7f544c60e800 1 -- start start 2024-09-13T23:05:53.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.510+0000 7f544c60e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557148044610 0x5571481c1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:53.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.510+0000 7f544c60e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55714801c330 con 0x557148044610 2024-09-13T23:05:53.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.510+0000 7f5447cc1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557148044610 0x5571481c1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:53.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.510+0000 7f5447cc1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557148044610 0x5571481c1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37718/0 (socket says 172.21.15.164:37718) 2024-09-13T23:05:53.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.510+0000 7f5447cc1640 1 -- 172.21.15.164:0/27085485 learned_addr learned my addr 172.21.15.164:0/27085485 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:53.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.510+0000 7f5447cc1640 1 -- 172.21.15.164:0/27085485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557147f69bc0 con 0x557148044610 2024-09-13T23:05:53.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.511+0000 7f5447cc1640 1 --2- 172.21.15.164:0/27085485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557148044610 0x5571481c1840 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f543800a3f0 tx=0x7f5438051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5d4bbb8ebae33c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:53.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.511+0000 7f5335e0b640 1 -- 172.21.15.164:0/27085485 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5438058a30 con 0x557148044610 2024-09-13T23:05:53.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.511+0000 7f5335e0b640 1 -- 172.21.15.164:0/27085485 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5438068070 con 0x557148044610 2024-09-13T23:05:53.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.511+0000 7f5335e0b640 1 -- 172.21.15.164:0/27085485 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5438058d60 con 0x557148044610 2024-09-13T23:05:53.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.512+0000 7f544c60e800 1 -- 172.21.15.164:0/27085485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557148044610 msgr2=0x5571481c1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.512+0000 7f544c60e800 1 --2- 172.21.15.164:0/27085485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557148044610 0x5571481c1840 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f543800a3f0 tx=0x7f5438051000 comp rx=0 tx=0).stop 2024-09-13T23:05:53.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.512+0000 7f544c60e800 1 -- 172.21.15.164:0/27085485 shutdown_connections 2024-09-13T23:05:53.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.512+0000 7f544c60e800 1 --2- 172.21.15.164:0/27085485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557148044610 0x5571481c1840 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.512+0000 7f544c60e800 1 -- 172.21.15.164:0/27085485 >> 172.21.15.164:0/27085485 conn(0x5571480cade0 msgr2=0x5571481bd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:53.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.512+0000 7f544c60e800 1 -- 172.21.15.164:0/27085485 shutdown_connections 2024-09-13T23:05:53.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.512+0000 7f544c60e800 1 -- 172.21.15.164:0/27085485 wait complete. 2024-09-13T23:05:53.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.512+0000 7f544c60e800 1 Processor -- start 2024-09-13T23:05:53.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.512+0000 7f544c60e800 1 -- start start 2024-09-13T23:05:53.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.512+0000 7f544c60e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557148044610 0x5571481c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:53.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.512+0000 7f544c60e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5571480d9990 con 0x557148044610 2024-09-13T23:05:53.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.513+0000 7f5447cc1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557148044610 0x5571481c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:53.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.513+0000 7f5447cc1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557148044610 0x5571481c90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37720/0 (socket says 172.21.15.164:37720) 2024-09-13T23:05:53.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.513+0000 7f5447cc1640 1 -- 172.21.15.164:0/3956109698 learned_addr learned my addr 172.21.15.164:0/3956109698 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:53.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.513+0000 7f5447cc1640 1 -- 172.21.15.164:0/3956109698 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557147f7dfe0 con 0x557148044610 2024-09-13T23:05:53.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.513+0000 7f5447cc1640 1 --2- 172.21.15.164:0/3956109698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557148044610 0x5571481c90d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f543800a3f0 tx=0x7f5438003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:53.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.513+0000 7f532ffff640 1 -- 172.21.15.164:0/3956109698 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54380636b0 con 0x557148044610 2024-09-13T23:05:53.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.513+0000 7f532ffff640 1 -- 172.21.15.164:0/3956109698 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5438063850 con 0x557148044610 2024-09-13T23:05:53.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.513+0000 7f544c60e800 1 -- 172.21.15.164:0/3956109698 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5571481c9610 con 0x557148044610 2024-09-13T23:05:53.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.513+0000 7f532ffff640 1 -- 172.21.15.164:0/3956109698 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5438063b70 con 0x557148044610 2024-09-13T23:05:53.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.514+0000 7f544c60e800 1 -- 172.21.15.164:0/3956109698 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571481c9b30 con 0x557148044610 2024-09-13T23:05:53.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.514+0000 7f532ffff640 1 -- 172.21.15.164:0/3956109698 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5438075020 con 0x557148044610 2024-09-13T23:05:53.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.515+0000 7f532ffff640 1 --2- 172.21.15.164:0/3956109698 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5330036b90 0x7f5330039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:53.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.515+0000 7f532ffff640 1 -- 172.21.15.164:0/3956109698 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f5438090da0 con 0x557148044610 2024-09-13T23:05:53.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.515+0000 7f54474c0640 1 --2- 172.21.15.164:0/3956109698 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5330036b90 0x7f5330039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:53.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.515+0000 7f544c60e800 1 --2- 172.21.15.164:0/3956109698 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5571480d5bb0 0x5571481d0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:53.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.515+0000 7f544c60e800 1 -- 172.21.15.164:0/3956109698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571481d0680 con 0x5571480d5bb0 2024-09-13T23:05:53.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.515+0000 7f54484c2640 1 --2- 172.21.15.164:0/3956109698 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5571480d5bb0 0x5571481d0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:53.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.515+0000 7f54474c0640 1 --2- 172.21.15.164:0/3956109698 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5330036b90 0x7f5330039050 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f543c000c00 tx=0x7f543c0013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:53.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.515+0000 7f54484c2640 1 --2- 172.21.15.164:0/3956109698 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5571480d5bb0 0x5571481d0140 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:53.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.516+0000 7f54484c2640 1 -- 172.21.15.164:0/3956109698 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54400083e0 con 0x5571480d5bb0 2024-09-13T23:05:53.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.516+0000 7f544c60e800 1 -- 172.21.15.164:0/3956109698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571481cd6d0 con 0x5571480d5bb0 2024-09-13T23:05:53.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.516+0000 7f54484c2640 1 -- 172.21.15.164:0/3956109698 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f54400083e0 con 0x5571480d5bb0 2024-09-13T23:05:53.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.516+0000 7f544c60e800 1 -- 172.21.15.164:0/3956109698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571481d2440 con 0x5571480d5bb0 2024-09-13T23:05:53.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.516+0000 7f54484c2640 1 -- 172.21.15.164:0/3956109698 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f54400083e0 con 0x5571480d5bb0 2024-09-13T23:05:53.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.516+0000 7f544c60e800 1 -- 172.21.15.164:0/3956109698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571481d15b0 con 0x5571480d5bb0 2024-09-13T23:05:53.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.517+0000 7f54484c2640 1 -- 172.21.15.164:0/3956109698 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f54400083e0 con 0x5571480d5bb0 2024-09-13T23:05:53.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.517+0000 7f544c60e800 1 -- 172.21.15.164:0/3956109698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571481d19a0 con 0x5571480d5bb0 2024-09-13T23:05:53.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.517+0000 7f54484c2640 1 -- 172.21.15.164:0/3956109698 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f54400083e0 con 0x5571480d5bb0 2024-09-13T23:05:53.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.517+0000 7f544c60e800 1 Processor -- start 2024-09-13T23:05:53.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.517+0000 7f544c60e800 1 -- start start 2024-09-13T23:05:53.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.517+0000 7f544c60e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571481e0a00 0x5571481e0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:53.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.517+0000 7f544c60e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557147f6b580 con 0x5571481e0a00 2024-09-13T23:05:53.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.518+0000 7f54474c0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571481e0a00 0x5571481e0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:53.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.518+0000 7f54474c0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571481e0a00 0x5571481e0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37730/0 (socket says 172.21.15.164:37730) 2024-09-13T23:05:53.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.518+0000 7f54474c0640 1 -- 172.21.15.164:0/1421861317 learned_addr learned my addr 172.21.15.164:0/1421861317 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:53.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.518+0000 7f54474c0640 1 -- 172.21.15.164:0/1421861317 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571481e1360 con 0x5571481e0a00 2024-09-13T23:05:53.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.518+0000 7f54474c0640 1 --2- 172.21.15.164:0/1421861317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571481e0a00 0x5571481e0e20 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f543c00e610 tx=0x7f543c00ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:53.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.518+0000 7f532d7fa640 1 -- 172.21.15.164:0/1421861317 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f543c022070 con 0x5571481e0a00 2024-09-13T23:05:53.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.518+0000 7f532d7fa640 1 -- 172.21.15.164:0/1421861317 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f543c009050 con 0x5571481e0a00 2024-09-13T23:05:53.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.518+0000 7f532d7fa640 1 -- 172.21.15.164:0/1421861317 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f543c00d500 con 0x5571481e0a00 2024-09-13T23:05:53.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.518+0000 7f544c60e800 1 -- 172.21.15.164:0/1421861317 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5571481e15f0 con 0x5571481e0a00 2024-09-13T23:05:53.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.519+0000 7f544c60e800 1 -- 172.21.15.164:0/1421861317 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571481e42d0 con 0x5571481e0a00 2024-09-13T23:05:53.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.519+0000 7f532d7fa640 1 -- 172.21.15.164:0/1421861317 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f543c025070 con 0x5571481e0a00 2024-09-13T23:05:53.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.519+0000 7f532d7fa640 1 --2- 172.21.15.164:0/1421861317 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5320036b90 0x7f5320039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:53.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.520+0000 7f532d7fa640 1 -- 172.21.15.164:0/1421861317 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f543c04df20 con 0x5571481e0a00 2024-09-13T23:05:53.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.520+0000 7f54484c2640 1 --2- 172.21.15.164:0/1421861317 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5320036b90 0x7f5320039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:53.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.520+0000 7f544c60e800 1 Processor -- start 2024-09-13T23:05:53.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.520+0000 7f54484c2640 1 --2- 172.21.15.164:0/1421861317 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5320036b90 0x7f5320039050 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x5571481d10d0 tx=0x7f5440000f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:53.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.520+0000 7f544c60e800 1 -- start start 2024-09-13T23:05:53.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.520+0000 7f544c60e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571481ed720 0x5571481edb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:53.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.520+0000 7f544c60e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5571481c1f30 con 0x5571481ed720 2024-09-13T23:05:53.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.520+0000 7f54474c0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571481ed720 0x5571481edb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:53.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.521+0000 7f54474c0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571481ed720 0x5571481edb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37736/0 (socket says 172.21.15.164:37736) 2024-09-13T23:05:53.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.521+0000 7f54474c0640 1 -- 172.21.15.164:0/460333402 learned_addr learned my addr 172.21.15.164:0/460333402 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:53.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.521+0000 7f54474c0640 1 -- 172.21.15.164:0/460333402 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571481ee0f0 con 0x5571481ed720 2024-09-13T23:05:53.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.521+0000 7f54474c0640 1 --2- 172.21.15.164:0/460333402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571481ed720 0x5571481edb20 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f543c026fd0 tx=0x7f543c024eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=278c86f457ae8a65 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:53.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.521+0000 7f5326ffd640 1 -- 172.21.15.164:0/460333402 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f543c025360 con 0x5571481ed720 2024-09-13T23:05:53.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.521+0000 7f5326ffd640 1 -- 172.21.15.164:0/460333402 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f543c025500 con 0x5571481ed720 2024-09-13T23:05:53.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.521+0000 7f5326ffd640 1 -- 172.21.15.164:0/460333402 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f543c0257e0 con 0x5571481ed720 2024-09-13T23:05:53.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.522+0000 7f544c60e800 1 -- 172.21.15.164:0/460333402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571481ed720 msgr2=0x5571481edb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.522+0000 7f544c60e800 1 --2- 172.21.15.164:0/460333402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571481ed720 0x5571481edb20 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f543c026fd0 tx=0x7f543c024eb0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.522+0000 7f544c60e800 1 -- 172.21.15.164:0/460333402 shutdown_connections 2024-09-13T23:05:53.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.522+0000 7f544c60e800 1 --2- 172.21.15.164:0/460333402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571481ed720 0x5571481edb20 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.522+0000 7f544c60e800 1 -- 172.21.15.164:0/460333402 >> 172.21.15.164:0/460333402 conn(0x5571481e9a80 msgr2=0x5571481e7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:53.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.522+0000 7f544c60e800 1 -- 172.21.15.164:0/460333402 shutdown_connections 2024-09-13T23:05:53.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.522+0000 7f544c60e800 1 -- 172.21.15.164:0/460333402 wait complete. 2024-09-13T23:05:53.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.522+0000 7f544c60e800 1 Processor -- start 2024-09-13T23:05:53.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.522+0000 7f544c60e800 1 -- start start 2024-09-13T23:05:53.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.522+0000 7f544c60e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571481ed720 0x5571481f4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:53.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.522+0000 7f544c60e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5571481ee760 con 0x5571481ed720 2024-09-13T23:05:53.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.522+0000 7f54474c0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571481ed720 0x5571481f4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:53.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.522+0000 7f54474c0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571481ed720 0x5571481f4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37742/0 (socket says 172.21.15.164:37742) 2024-09-13T23:05:53.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.522+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 learned_addr learned my addr 172.21.15.164:0/447212080 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:53.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.523+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571481f5160 con 0x5571481ed720 2024-09-13T23:05:53.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.523+0000 7f54474c0640 1 --2- 172.21.15.164:0/447212080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571481ed720 0x5571481f4c20 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f543c024ef0 tx=0x7f543c04c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:53.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.523+0000 7f53257fa640 1 -- 172.21.15.164:0/447212080 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f543c03a070 con 0x5571481ed720 2024-09-13T23:05:53.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.523+0000 7f53257fa640 1 -- 172.21.15.164:0/447212080 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f543c00d6a0 con 0x5571481ed720 2024-09-13T23:05:53.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.523+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5571481f53f0 con 0x5571481ed720 2024-09-13T23:05:53.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.523+0000 7f53257fa640 1 -- 172.21.15.164:0/447212080 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f543c0248b0 con 0x5571481ed720 2024-09-13T23:05:53.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.523+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571481f80a0 con 0x5571481ed720 2024-09-13T23:05:53.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.524+0000 7f53257fa640 1 -- 172.21.15.164:0/447212080 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f543c03f2c0 con 0x5571481ed720 2024-09-13T23:05:53.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.524+0000 7f53257fa640 1 --2- 172.21.15.164:0/447212080 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5310036b40 0x7f5310039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:53.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.524+0000 7f53257fa640 1 -- 172.21.15.164:0/447212080 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f543c03d040 con 0x5571481ed720 2024-09-13T23:05:53.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.524+0000 7f54484c2640 1 --2- 172.21.15.164:0/447212080 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5310036b40 0x7f5310039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:53.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.524+0000 7f544c60e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:53.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.525+0000 7f544c60e800 1 --2- 172.21.15.164:0/447212080 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5571482006b0 0x557148202b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:53.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.525+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571482032c0 con 0x5571482006b0 2024-09-13T23:05:53.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.525+0000 7f5447cc1640 1 --2- 172.21.15.164:0/447212080 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5571482006b0 0x557148202b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:53.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.525+0000 7f54484c2640 1 --2- 172.21.15.164:0/447212080 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5310036b40 0x7f5310039000 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f544000f010 tx=0x7f544000c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:53.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.525+0000 7f5447cc1640 1 --2- 172.21.15.164:0/447212080 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5571482006b0 0x557148202b70 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:53.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.525+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.525+0000 7f544c60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:53.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.525+0000 7f544c60e800 20 realm 2024-09-13T23:05:53.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.525+0000 7f544c60e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:53.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.525+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571482036d0 con 0x5571482006b0 2024-09-13T23:05:53.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.526+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.526+0000 7f544c60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:53.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.526+0000 7f544c60e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:53.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.526+0000 7f544c60e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:53.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.526+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148203fa0 con 0x5571482006b0 2024-09-13T23:05:53.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.526+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.526+0000 7f544c60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:53.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.526+0000 7f544c60e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:53.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.526+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148204340 con 0x5571482006b0 2024-09-13T23:05:53.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.526+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.526+0000 7f544c60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:53.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.526+0000 7f544c60e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:53.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.526+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571482047a0 con 0x5571482006b0 2024-09-13T23:05:53.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.526+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.526+0000 7f544c60e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:53.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.526+0000 7f544c60e800 20 searching for the correct realm 2024-09-13T23:05:53.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.526+0000 7f544c60e800 1 --2- 172.21.15.164:0/447212080 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5571482067f0 0x557148208be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:53.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.526+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x5571482067f0 2024-09-13T23:05:53.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.527+0000 7f54474c0640 1 --2- 172.21.15.164:0/447212080 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5571482067f0 0x557148208be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:53.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.527+0000 7f54474c0640 1 --2- 172.21.15.164:0/447212080 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5571482067f0 0x557148208be0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:53.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.527+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.527+0000 7f54474c0640 1 --2- 172.21.15.164:0/447212080 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f543c027060 0x7f543c027440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:53.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.527+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x7f543c027060 2024-09-13T23:05:53.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.527+0000 7f54484c2640 1 --2- 172.21.15.164:0/447212080 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f543c027060 0x7f543c027440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:53.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.528+0000 7f54484c2640 1 --2- 172.21.15.164:0/447212080 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f543c027060 0x7f543c027440 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:53.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.528+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.528+0000 7f54484c2640 1 --2- 172.21.15.164:0/447212080 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f5440019040 0x7f5440019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:53.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.528+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x7f5440019040 2024-09-13T23:05:53.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.528+0000 7f5447cc1640 1 --2- 172.21.15.164:0/447212080 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f5440019040 0x7f5440019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:53.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.529+0000 7f5447cc1640 1 --2- 172.21.15.164:0/447212080 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f5440019040 0x7f5440019930 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:53.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.529+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.529+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x5571482006b0 2024-09-13T23:05:53.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.529+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.529+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x5571482006b0 2024-09-13T23:05:53.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.529+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.529+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x7f5440019040 2024-09-13T23:05:53.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.530+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.530+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x7f5440019040 2024-09-13T23:05:53.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.530+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.530+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x7f543c027060 2024-09-13T23:05:53.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.530+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.530+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x5571482067f0 2024-09-13T23:05:53.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.530+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.530+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x5571482006b0 2024-09-13T23:05:53.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.531+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.531+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x7f5440019040 2024-09-13T23:05:53.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.531+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.531+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x5571482006b0 2024-09-13T23:05:53.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.531+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.531+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x7f543c027060 2024-09-13T23:05:53.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.532+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.532+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x5571482067f0 2024-09-13T23:05:53.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.532+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.532+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x5571482067f0 2024-09-13T23:05:53.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.532+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.532+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x7f5440019040 2024-09-13T23:05:53.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.532+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.532+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x5571482067f0 2024-09-13T23:05:53.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.533+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.533+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x5571482067f0 2024-09-13T23:05:53.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.533+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.533+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x5571482006b0 2024-09-13T23:05:53.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.533+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.533+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x5571482006b0 2024-09-13T23:05:53.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.533+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.533+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x7f5440019040 2024-09-13T23:05:53.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.534+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.534+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x5571482067f0 2024-09-13T23:05:53.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.534+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.534+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x7f543c027060 2024-09-13T23:05:53.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.534+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.534+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x5571482006b0 2024-09-13T23:05:53.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.535+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.535+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x7f5440019040 2024-09-13T23:05:53.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.535+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.535+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x5571482067f0 2024-09-13T23:05:53.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.535+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.535+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x7f5440019040 2024-09-13T23:05:53.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.536+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.536+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x7f543c027060 2024-09-13T23:05:53.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.536+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.536+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x5571482067f0 2024-09-13T23:05:53.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.536+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.536+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x7f543c027060 2024-09-13T23:05:53.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.536+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.536+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x5571482006b0 2024-09-13T23:05:53.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.537+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.537+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557148209290 con 0x7f543c027060 2024-09-13T23:05:53.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.537+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.537+0000 7f544c60e800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:53.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.537+0000 7f544c60e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:53.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.537+0000 7f544c60e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:53.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.537+0000 7f544c60e800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:53.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.537+0000 7f544c60e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:53.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.537+0000 7f544c60e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:53.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.537+0000 7f544c60e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:53.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.537+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148205240 con 0x5571482006b0 2024-09-13T23:05:53.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.537+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.537+0000 7f544c60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:53.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.537+0000 7f544c60e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:53.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.537+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148205ae0 con 0x5571482006b0 2024-09-13T23:05:53.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.538+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.538+0000 7f544c60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:53.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.538+0000 7f544c60e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:53.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.538+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148204e80 con 0x5571482006b0 2024-09-13T23:05:53.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.538+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.538+0000 7f544c60e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:53.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.538+0000 7f544c60e800 20 zone default found 2024-09-13T23:05:53.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.538+0000 7f544c60e800 4 Realm: () 2024-09-13T23:05:53.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.538+0000 7f544c60e800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:53.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.538+0000 7f544c60e800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:53.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.538+0000 7f544c60e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:53.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.538+0000 7f544c60e800 20 zonegroup default 2024-09-13T23:05:53.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.538+0000 7f544c60e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:53.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.538+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148205ae0 con 0x7f5440019040 2024-09-13T23:05:53.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.538+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.538+0000 7f544c60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:53.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.538+0000 7f544c60e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:53.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.538+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714820b0f0 con 0x5571482067f0 2024-09-13T23:05:53.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.538+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.538+0000 7f544c60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:53.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.538+0000 7f544c60e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:53.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.539+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714820b490 con 0x5571482067f0 2024-09-13T23:05:53.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.539+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.539+0000 7f544c60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:53.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.539+0000 7f544c60e800 20 started sync module instance, tier type = 2024-09-13T23:05:53.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.539+0000 7f544c60e800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:53.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.539+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714820a590 con 0x7f543c027060 2024-09-13T23:05:53.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.540+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.540+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93945029765808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714820a590 con 0x7f543c027060 2024-09-13T23:05:53.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.540+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714820bfa0 con 0x5571482006b0 2024-09-13T23:05:53.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.541+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93945029765808] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.541+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.541+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93945029769872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714820a590 con 0x5571482006b0 2024-09-13T23:05:53.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.541+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714820ca30 con 0x5571482067f0 2024-09-13T23:05:53.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.543+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93945029769872] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.543+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.543+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93945029763296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714820a500 con 0x5571482067f0 2024-09-13T23:05:53.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.543+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714820d8f0 con 0x7f543c027060 2024-09-13T23:05:53.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.544+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93945029763296] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.544+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.544+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93945029776448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714820dd10 con 0x7f543c027060 2024-09-13T23:05:53.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.544+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714820e6d0 con 0x5571482006b0 2024-09-13T23:05:53.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.545+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.545+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93945029776448] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.545+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93945029778016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714820e6d0 con 0x5571482006b0 2024-09-13T23:05:53.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.545+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714820f140 con 0x7f5440019040 2024-09-13T23:05:53.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.546+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.546+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93945029782576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714820f100 con 0x7f5440019040 2024-09-13T23:05:53.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.546+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5571482100a0 con 0x7f5440019040 2024-09-13T23:05:53.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.546+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93945029778016] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.549+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93945029782576] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.549+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.549+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93945029786544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714820f2e0 con 0x7f5440019040 2024-09-13T23:05:53.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.549+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557148210970 con 0x7f5440019040 2024-09-13T23:05:53.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.550+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(58 notify.7 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.550+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93945029786544] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.550+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93945029788864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714820f2e0 con 0x7f5440019040 2024-09-13T23:05:53.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.550+0000 7f544c60e800 20 add_watcher() i=0 2024-09-13T23:05:53.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.550+0000 7f544c60e800 20 add_watcher() i=1 2024-09-13T23:05:53.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.550+0000 7f544c60e800 20 add_watcher() i=2 2024-09-13T23:05:53.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.550+0000 7f544c60e800 20 add_watcher() i=3 2024-09-13T23:05:53.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.550+0000 7f544c60e800 20 add_watcher() i=4 2024-09-13T23:05:53.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.550+0000 7f544c60e800 20 add_watcher() i=5 2024-09-13T23:05:53.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.550+0000 7f544c60e800 20 add_watcher() i=6 2024-09-13T23:05:53.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.551+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93945029788864] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.551+0000 7f544c60e800 20 add_watcher() i=7 2024-09-13T23:05:53.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.551+0000 7f544c60e800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:53.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.551+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714820e2b0 con 0x5571482006b0 2024-09-13T23:05:53.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.552+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.552+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93945029789920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714820e2e0 con 0x5571482006b0 2024-09-13T23:05:53.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.553+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93945029789920] v34'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.553+0000 7f52fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:53.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.553+0000 7f544c60e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:53.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.553+0000 7f544c60e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:53.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.553+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821c0d0 con 0x5571482006b0 2024-09-13T23:05:53.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.554+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.554+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821c660 con 0x7f5440019040 2024-09-13T23:05:53.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.555+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.555+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821c660 con 0x5571482067f0 2024-09-13T23:05:53.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.556+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.556+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821ceb0 con 0x5571482006b0 2024-09-13T23:05:53.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.557+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'153 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.557+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821ba50 con 0x7f543c027060 2024-09-13T23:05:53.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.558+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'44 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.558+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821ba50 con 0x5571482067f0 2024-09-13T23:05:53.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.559+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'29 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.559+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821d530 con 0x5571482006b0 2024-09-13T23:05:53.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.560+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.561+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821d530 con 0x7f5440019040 2024-09-13T23:05:53.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.562+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.562+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821d530 con 0x7f543c027060 2024-09-13T23:05:53.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.563+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.563+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821db60 con 0x5571482067f0 2024-09-13T23:05:53.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.564+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.564+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821df00 con 0x7f543c027060 2024-09-13T23:05:53.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.565+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'45 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.565+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821e470 con 0x7f5440019040 2024-09-13T23:05:53.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.566+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.566+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821e470 con 0x7f543c027060 2024-09-13T23:05:53.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.567+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.567+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821e6b0 con 0x7f5440019040 2024-09-13T23:05:53.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.568+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'35 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.568+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821e6b0 con 0x5571482006b0 2024-09-13T23:05:53.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.569+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'154 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.569+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821e6b0 con 0x5571482067f0 2024-09-13T23:05:53.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.571+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'38 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.571+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821e6b0 con 0x7f543c027060 2024-09-13T23:05:53.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.572+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'46 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.572+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821e6b0 con 0x5571482067f0 2024-09-13T23:05:53.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.573+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.573+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821e6b0 con 0x5571482006b0 2024-09-13T23:05:53.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.574+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.574+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821e6b0 con 0x5571482006b0 2024-09-13T23:05:53.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.575+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'155 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.575+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821e6b0 con 0x5571482067f0 2024-09-13T23:05:53.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.576+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'39 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.576+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821e6b0 con 0x7f543c027060 2024-09-13T23:05:53.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.577+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'28 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.577+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821e740 con 0x5571482067f0 2024-09-13T23:05:53.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.578+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.578+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821e740 con 0x5571482067f0 2024-09-13T23:05:53.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.579+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.579+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821e740 con 0x5571482067f0 2024-09-13T23:05:53.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.580+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.580+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821e7a0 con 0x5571482067f0 2024-09-13T23:05:53.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.580+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.581+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821e7a0 con 0x7f5440019040 2024-09-13T23:05:53.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.582+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.582+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821e740 con 0x5571482067f0 2024-09-13T23:05:53.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.583+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.583+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821e740 con 0x7f5440019040 2024-09-13T23:05:53.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.584+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.584+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821e7a0 con 0x5571482067f0 2024-09-13T23:05:53.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.585+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'40 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.585+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821e7a0 con 0x7f5440019040 2024-09-13T23:05:53.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.586+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'36 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.586+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714821e740 con 0x7f543c027060 2024-09-13T23:05:53.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.587+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.587+0000 7f52fcfe1640 20 reqs_thread_entry: start 2024-09-13T23:05:53.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.587+0000 7f544c60e800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:53.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.587+0000 7f544c60e800 20 Filter name: none 2024-09-13T23:05:53.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.587+0000 7f52767fc640 20 reqs_thread_entry: start 2024-09-13T23:05:53.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.587+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571482184e0 con 0x5571482006b0 2024-09-13T23:05:53.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.588+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.588+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571482184e0 con 0x5571482006b0 2024-09-13T23:05:53.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.588+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.588+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571482184e0 con 0x5571482006b0 2024-09-13T23:05:53.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.588+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.588+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571482184e0 con 0x7f5440019040 2024-09-13T23:05:53.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.589+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.589+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571482184e0 con 0x7f5440019040 2024-09-13T23:05:53.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.589+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.589+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571482184e0 con 0x7f5440019040 2024-09-13T23:05:53.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.589+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.589+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571482184e0 con 0x5571482067f0 2024-09-13T23:05:53.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.590+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.590+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571482184e0 con 0x5571482067f0 2024-09-13T23:05:53.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.590+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.590+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571482184e0 con 0x5571482067f0 2024-09-13T23:05:53.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.590+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.590+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571482184e0 con 0x5571482006b0 2024-09-13T23:05:53.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.591+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 32 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv15 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.591+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571482184e0 con 0x5571482006b0 2024-09-13T23:05:53.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.591+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 33 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv15 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.591+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571482184e0 con 0x5571482006b0 2024-09-13T23:05:53.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.591+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 34 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv15 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.591+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571482184e0 con 0x7f543c027060 2024-09-13T23:05:53.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.591+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 19 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.591+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571482184e0 con 0x7f543c027060 2024-09-13T23:05:53.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.592+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 20 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv11 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.592+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571482184e0 con 0x7f543c027060 2024-09-13T23:05:53.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.592+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 21 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.592+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571482184e0 con 0x5571482067f0 2024-09-13T23:05:53.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.592+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv10 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.592+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571482184e0 con 0x5571482067f0 2024-09-13T23:05:53.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.592+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv10 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.592+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571482184e0 con 0x5571482067f0 2024-09-13T23:05:53.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.593+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv10 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.593+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571482184e0 con 0x5571482006b0 2024-09-13T23:05:53.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.593+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 35 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.593+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571482184e0 con 0x5571482006b0 2024-09-13T23:05:53.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.593+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 36 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.593+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571482184e0 con 0x5571482006b0 2024-09-13T23:05:53.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.593+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 37 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.593+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571482184e0 con 0x7f5440019040 2024-09-13T23:05:53.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.594+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv29 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.594+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571482184e0 con 0x7f5440019040 2024-09-13T23:05:53.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.594+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 27 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv29 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.594+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5571482184e0 con 0x7f5440019040 2024-09-13T23:05:53.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.595+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 28 ==== osd_op_reply(117 gc.7 [call out=1700b] v0'0 uv29 ondisk = 0) ==== 148+0+1700 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.595+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x7f543c027060 2024-09-13T23:05:53.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.595+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 22 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.595+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148249840 con 0x7f543c027060 2024-09-13T23:05:53.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.595+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 23 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.595+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x7f543c027060 2024-09-13T23:05:53.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.595+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 24 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.595+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x5571482067f0 2024-09-13T23:05:53.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.596+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.596+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148249840 con 0x5571482067f0 2024-09-13T23:05:53.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.596+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.596+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x5571482067f0 2024-09-13T23:05:53.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.596+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.596+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x7f543c027060 2024-09-13T23:05:53.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.596+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 25 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.596+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148249840 con 0x7f543c027060 2024-09-13T23:05:53.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.597+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 26 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.597+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x7f543c027060 2024-09-13T23:05:53.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.597+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 27 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.597+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x7f5440019040 2024-09-13T23:05:53.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.597+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 29 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.597+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148249840 con 0x7f5440019040 2024-09-13T23:05:53.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.598+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 30 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.598+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x7f5440019040 2024-09-13T23:05:53.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.598+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 31 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.598+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x7f543c027060 2024-09-13T23:05:53.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.598+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 28 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.598+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148249840 con 0x7f543c027060 2024-09-13T23:05:53.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.599+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 29 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.599+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x7f543c027060 2024-09-13T23:05:53.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.599+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 30 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.599+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x7f5440019040 2024-09-13T23:05:53.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.599+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.599+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148249840 con 0x7f5440019040 2024-09-13T23:05:53.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.600+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.600+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x7f5440019040 2024-09-13T23:05:53.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.600+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.600+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x5571482006b0 2024-09-13T23:05:53.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.600+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 38 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.600+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148249840 con 0x5571482006b0 2024-09-13T23:05:53.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.600+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 39 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.600+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x5571482006b0 2024-09-13T23:05:53.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.601+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 40 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.601+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x5571482067f0 2024-09-13T23:05:53.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.601+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.601+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148249840 con 0x5571482067f0 2024-09-13T23:05:53.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.601+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.601+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x5571482067f0 2024-09-13T23:05:53.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.602+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.602+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x7f543c027060 2024-09-13T23:05:53.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.602+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 31 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.602+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148249840 con 0x7f543c027060 2024-09-13T23:05:53.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.602+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 32 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.602+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x7f543c027060 2024-09-13T23:05:53.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.602+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 33 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.602+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x5571482067f0 2024-09-13T23:05:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.603+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.603+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148249840 con 0x5571482067f0 2024-09-13T23:05:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.603+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.603+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x5571482067f0 2024-09-13T23:05:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.603+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.603+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x5571482006b0 2024-09-13T23:05:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.604+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 41 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.604+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148249840 con 0x5571482006b0 2024-09-13T23:05:53.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.604+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 42 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.604+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x5571482006b0 2024-09-13T23:05:53.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.604+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 43 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.604+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x5571482006b0 2024-09-13T23:05:53.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.604+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 44 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.604+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148249840 con 0x5571482006b0 2024-09-13T23:05:53.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.605+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 45 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.605+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x5571482006b0 2024-09-13T23:05:53.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.605+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 46 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.605+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x5571482067f0 2024-09-13T23:05:53.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.605+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.605+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148249840 con 0x5571482067f0 2024-09-13T23:05:53.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.605+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.606+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x5571482067f0 2024-09-13T23:05:53.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.606+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.606+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x7f543c027060 2024-09-13T23:05:53.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.606+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 34 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.606+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148249840 con 0x7f543c027060 2024-09-13T23:05:53.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.606+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 35 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.606+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x7f543c027060 2024-09-13T23:05:53.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.607+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 36 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.607+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x5571482067f0 2024-09-13T23:05:53.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.607+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.607+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148249840 con 0x5571482067f0 2024-09-13T23:05:53.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.607+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.607+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x5571482067f0 2024-09-13T23:05:53.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.607+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.607+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x5571482067f0 2024-09-13T23:05:53.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.608+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.608+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148249840 con 0x5571482067f0 2024-09-13T23:05:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.608+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.608+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x5571482067f0 2024-09-13T23:05:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.608+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.608+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x5571482067f0 2024-09-13T23:05:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.608+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.608+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148249840 con 0x5571482067f0 2024-09-13T23:05:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.609+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.609+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x5571482067f0 2024-09-13T23:05:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.609+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.609+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x5571482067f0 2024-09-13T23:05:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.609+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.609+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148249840 con 0x5571482067f0 2024-09-13T23:05:53.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.609+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.609+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x5571482067f0 2024-09-13T23:05:53.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.610+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.610+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x7f5440019040 2024-09-13T23:05:53.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.610+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 35 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.610+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148249840 con 0x7f5440019040 2024-09-13T23:05:53.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.611+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 36 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.611+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x7f5440019040 2024-09-13T23:05:53.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.611+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 37 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.611+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x5571482067f0 2024-09-13T23:05:53.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.611+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.611+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148249840 con 0x5571482067f0 2024-09-13T23:05:53.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.611+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.611+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x5571482067f0 2024-09-13T23:05:53.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.612+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.612+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x7f5440019040 2024-09-13T23:05:53.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.612+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 38 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.612+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148249840 con 0x7f5440019040 2024-09-13T23:05:53.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.612+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 39 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.612+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x7f5440019040 2024-09-13T23:05:53.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.613+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 40 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.613+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x5571482067f0 2024-09-13T23:05:53.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.613+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.613+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148249840 con 0x5571482067f0 2024-09-13T23:05:53.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.613+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.613+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x5571482067f0 2024-09-13T23:05:53.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.613+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.613+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x7f5440019040 2024-09-13T23:05:53.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.614+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 41 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.614+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148249840 con 0x7f5440019040 2024-09-13T23:05:53.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.614+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 42 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.614+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x7f5440019040 2024-09-13T23:05:53.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.614+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 43 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.614+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x7f543c027060 2024-09-13T23:05:53.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.615+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 37 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.615+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557148249840 con 0x7f543c027060 2024-09-13T23:05:53.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.615+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 38 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.615+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55714824a850 con 0x7f543c027060 2024-09-13T23:05:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.615+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 39 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.616+0000 7f52fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.616+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93945029789920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557148217bb0 con 0x5571482006b0 2024-09-13T23:05:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.617+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 93945029789920] v34'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.617+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93945029765808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5571482108e0 con 0x7f543c027060 2024-09-13T23:05:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.618+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 40 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 93945029765808] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.618+0000 7f544c60e800 20 remove_watcher() i=0 2024-09-13T23:05:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.618+0000 7f544c60e800 2 removed watcher, disabling cache 2024-09-13T23:05:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.618+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93945029769872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5571482108e0 con 0x5571482006b0 2024-09-13T23:05:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.619+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 93945029769872] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.620+0000 7f544c60e800 20 remove_watcher() i=1 2024-09-13T23:05:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.620+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93945029763296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714820ba90 con 0x5571482067f0 2024-09-13T23:05:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.621+0000 7f54474c0640 1 -- 172.21.15.164:0/447212080 <== osd.3 v2:172.21.15.164:6816/93809510 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 93945029763296] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f543c032070 con 0x5571482067f0 2024-09-13T23:05:53.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.621+0000 7f544c60e800 20 remove_watcher() i=2 2024-09-13T23:05:53.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.621+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93945029776448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5571482108e0 con 0x7f543c027060 2024-09-13T23:05:53.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.621+0000 7f54484c2640 1 -- 172.21.15.164:0/447212080 <== osd.2 v2:172.21.15.164:6808/3795914978 41 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 93945029776448] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f544002f040 con 0x7f543c027060 2024-09-13T23:05:53.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.621+0000 7f544c60e800 20 remove_watcher() i=3 2024-09-13T23:05:53.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.621+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93945029778016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714820a0e0 con 0x5571482006b0 2024-09-13T23:05:53.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.622+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.1 v2:172.21.15.164:6800/4060509701 49 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 93945029778016] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x5571482006b0 2024-09-13T23:05:53.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.622+0000 7f544c60e800 20 remove_watcher() i=4 2024-09-13T23:05:53.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.622+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93945029782576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714820ba90 con 0x7f5440019040 2024-09-13T23:05:53.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.624+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 44 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 93945029782576] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.624+0000 7f544c60e800 20 remove_watcher() i=5 2024-09-13T23:05:53.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.624+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93945029786544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55714820d440 con 0x7f5440019040 2024-09-13T23:05:53.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.625+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 45 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 93945029786544] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.625+0000 7f544c60e800 20 remove_watcher() i=6 2024-09-13T23:05:53.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.625+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93945029788864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5571482108e0 con 0x7f5440019040 2024-09-13T23:05:53.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.626+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 <== osd.0 v2:172.21.15.17:6800/489863589 46 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 93945029788864] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5438077bc0 con 0x7f5440019040 2024-09-13T23:05:53.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.626+0000 7f544c60e800 20 remove_watcher() i=7 2024-09-13T23:05:53.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.626+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f5440019040 msgr2=0x7f5440019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.626+0000 7f544c60e800 1 --2- 172.21.15.164:0/447212080 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f5440019040 0x7f5440019930 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.626+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5571482006b0 msgr2=0x557148202b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.626+0000 7f544c60e800 1 --2- 172.21.15.164:0/447212080 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5571482006b0 0x557148202b70 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.626+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f543c027060 msgr2=0x7f543c027440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.626+0000 7f544c60e800 1 --2- 172.21.15.164:0/447212080 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f543c027060 0x7f543c027440 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.626+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5571482067f0 msgr2=0x557148208be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.626+0000 7f544c60e800 1 --2- 172.21.15.164:0/447212080 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5571482067f0 0x557148208be0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.626+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5310036b40 msgr2=0x7f5310039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.626+0000 7f544c60e800 1 --2- 172.21.15.164:0/447212080 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5310036b40 0x7f5310039000 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f544000f010 tx=0x7f544000c040 comp rx=0 tx=0).stop 2024-09-13T23:05:53.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.626+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571481ed720 msgr2=0x5571481f4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.626+0000 7f544c60e800 1 --2- 172.21.15.164:0/447212080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571481ed720 0x5571481f4c20 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f543c024ef0 tx=0x7f543c04c140 comp rx=0 tx=0).stop 2024-09-13T23:05:53.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.626+0000 7f5447cc1640 1 -- 172.21.15.164:0/447212080 reap_dead start 2024-09-13T23:05:53.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.626+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 shutdown_connections 2024-09-13T23:05:53.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.626+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 >> 172.21.15.164:0/447212080 conn(0x5571481e9a80 msgr2=0x5571481e7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:53.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.626+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 shutdown_connections 2024-09-13T23:05:53.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.626+0000 7f544c60e800 1 -- 172.21.15.164:0/447212080 wait complete. 2024-09-13T23:05:53.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.627+0000 7f544c60e800 1 -- 172.21.15.164:0/1421861317 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5320036b90 msgr2=0x7f5320039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.627+0000 7f544c60e800 1 --2- 172.21.15.164:0/1421861317 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5320036b90 0x7f5320039050 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x5571481d10d0 tx=0x7f5440000f90 comp rx=0 tx=0).stop 2024-09-13T23:05:53.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.627+0000 7f544c60e800 1 -- 172.21.15.164:0/1421861317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571481e0a00 msgr2=0x5571481e0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.627+0000 7f544c60e800 1 --2- 172.21.15.164:0/1421861317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571481e0a00 0x5571481e0e20 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f543c00e610 tx=0x7f543c00ff90 comp rx=0 tx=0).stop 2024-09-13T23:05:53.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.627+0000 7f544c60e800 1 -- 172.21.15.164:0/1421861317 shutdown_connections 2024-09-13T23:05:53.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.627+0000 7f544c60e800 1 --2- 172.21.15.164:0/1421861317 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5320036b90 0x7f5320039050 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.627+0000 7f544c60e800 1 --2- 172.21.15.164:0/1421861317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571481e0a00 0x5571481e0e20 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.627+0000 7f544c60e800 1 -- 172.21.15.164:0/1421861317 >> 172.21.15.164:0/1421861317 conn(0x5571481d5990 msgr2=0x5571481d8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:53.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.627+0000 7f544c60e800 1 -- 172.21.15.164:0/1421861317 shutdown_connections 2024-09-13T23:05:53.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.627+0000 7f544c60e800 1 -- 172.21.15.164:0/1421861317 wait complete. 2024-09-13T23:05:53.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.627+0000 7f544c60e800 1 -- 172.21.15.164:0/3956109698 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5571480d5bb0 msgr2=0x5571481d0140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.627+0000 7f544c60e800 1 --2- 172.21.15.164:0/3956109698 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5571480d5bb0 0x5571481d0140 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.627+0000 7f544c60e800 1 -- 172.21.15.164:0/3956109698 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5330036b90 msgr2=0x7f5330039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.627+0000 7f544c60e800 1 --2- 172.21.15.164:0/3956109698 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5330036b90 0x7f5330039050 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f543c000c00 tx=0x7f543c0013b0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.627+0000 7f544c60e800 1 -- 172.21.15.164:0/3956109698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557148044610 msgr2=0x5571481c90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.627+0000 7f544c60e800 1 --2- 172.21.15.164:0/3956109698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557148044610 0x5571481c90d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f543800a3f0 tx=0x7f5438003330 comp rx=0 tx=0).stop 2024-09-13T23:05:53.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.627+0000 7f544c60e800 1 -- 172.21.15.164:0/3956109698 shutdown_connections 2024-09-13T23:05:53.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.627+0000 7f544c60e800 1 --2- 172.21.15.164:0/3956109698 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5571480d5bb0 0x5571481d0140 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.627+0000 7f544c60e800 1 --2- 172.21.15.164:0/3956109698 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5330036b90 0x7f5330039050 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.627+0000 7f544c60e800 1 --2- 172.21.15.164:0/3956109698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557148044610 0x5571481c90d0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.627+0000 7f544c60e800 1 -- 172.21.15.164:0/3956109698 >> 172.21.15.164:0/3956109698 conn(0x5571480cade0 msgr2=0x5571481bba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:53.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.627+0000 7f544c60e800 1 -- 172.21.15.164:0/3956109698 shutdown_connections 2024-09-13T23:05:53.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.627+0000 7f544c60e800 1 -- 172.21.15.164:0/3956109698 wait complete. 2024-09-13T23:05:53.661 INFO:teuthology.orchestra.run.smithi164.stdout:[{"tag":"a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.476571949781167085\u0000","time":"2024-09-13T23:05:53.435413+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_7","key":"","instance":""}]}] 2024-09-13T23:05:53.662 DEBUG:tasks.util.rgw: json result: [{'tag': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.476571949781167085\x00', 'time': '2024-09-13T23:05:53.435413+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_7', 'key': '', 'instance': ''}]}] 2024-09-13T23:05:53.662 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-13T23:05:53.662 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-13T23:05:53.662 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-13T23:05:53.704 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:53.705 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:53.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.704+0000 7f6304d24800 1 Processor -- start 2024-09-13T23:05:53.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.704+0000 7f6304d24800 1 -- start start 2024-09-13T23:05:53.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.704+0000 7f6304d24800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5580d334c540 0x5580d334c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:53.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.704+0000 7f6304d24800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5580d320cb30 con 0x5580d334ce80 2024-09-13T23:05:53.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.704+0000 7f6304d24800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x5580d31ee360 con 0x5580d334c540 2024-09-13T23:05:53.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.704+0000 7f6300ae0640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5580d334c540 0x5580d334c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:53.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.704+0000 7f6300ae0640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5580d334c540 0x5580d334c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37754/0 (socket says 172.21.15.164:37754) 2024-09-13T23:05:53.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.704+0000 7f62fbfff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x5580d334ce80 0x5580d3351a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:53922/0 (socket says 172.21.15.164:53922) 2024-09-13T23:05:53.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.704+0000 7f6300ae0640 1 -- 172.21.15.164:0/1518672200 learned_addr learned my addr 172.21.15.164:0/1518672200 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:53.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.705+0000 7f6300ae0640 1 -- 172.21.15.164:0/1518672200 >> v1:172.21.15.17:6789/0 conn(0x5580d334ce80 legacy=0x5580d3351a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.705+0000 7f6300ae0640 1 -- 172.21.15.164:0/1518672200 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580d3214e00 con 0x5580d334c540 2024-09-13T23:05:53.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.706+0000 7f6300ae0640 1 --2- 172.21.15.164:0/1518672200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d334c540 0x5580d334c940 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f62f400a520 tx=0x7f62f4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d79073df3de53f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:53.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.706+0000 7f62fb7fe640 1 -- 172.21.15.164:0/1518672200 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62f4055070 con 0x5580d334c540 2024-09-13T23:05:53.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.707+0000 7f62fb7fe640 1 -- 172.21.15.164:0/1518672200 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62f40515b0 con 0x5580d334c540 2024-09-13T23:05:53.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.707+0000 7f62fb7fe640 1 -- 172.21.15.164:0/1518672200 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62f40518d0 con 0x5580d334c540 2024-09-13T23:05:53.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.707+0000 7f6304d24800 1 -- 172.21.15.164:0/1518672200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d334c540 msgr2=0x5580d334c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.707+0000 7f6304d24800 1 --2- 172.21.15.164:0/1518672200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d334c540 0x5580d334c940 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f62f400a520 tx=0x7f62f4045ba0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.707+0000 7f6304d24800 1 -- 172.21.15.164:0/1518672200 shutdown_connections 2024-09-13T23:05:53.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.707+0000 7f6304d24800 1 --2- 172.21.15.164:0/1518672200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d334c540 0x5580d334c940 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.707+0000 7f6304d24800 1 -- 172.21.15.164:0/1518672200 >> 172.21.15.164:0/1518672200 conn(0x5580d3347dd0 msgr2=0x5580d334a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:53.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.707+0000 7f6304d24800 1 -- 172.21.15.164:0/1518672200 shutdown_connections 2024-09-13T23:05:53.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.707+0000 7f6304d24800 1 -- 172.21.15.164:0/1518672200 wait complete. 2024-09-13T23:05:53.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.721+0000 7f6304d24800 1 Processor -- start 2024-09-13T23:05:53.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.721+0000 7f6304d24800 1 -- start start 2024-09-13T23:05:53.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.721+0000 7f6304d24800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d334c540 0x5580d343b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:53.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.721+0000 7f6304d24800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5580d3299320 con 0x5580d334c540 2024-09-13T23:05:53.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.721+0000 7f6300ae0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d334c540 0x5580d343b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:53.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.721+0000 7f6300ae0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d334c540 0x5580d343b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37760/0 (socket says 172.21.15.164:37760) 2024-09-13T23:05:53.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.721+0000 7f6300ae0640 1 -- 172.21.15.164:0/3078604045 learned_addr learned my addr 172.21.15.164:0/3078604045 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:53.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.721+0000 7f6300ae0640 1 -- 172.21.15.164:0/3078604045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580d31e6bc0 con 0x5580d334c540 2024-09-13T23:05:53.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.722+0000 7f6300ae0640 1 --2- 172.21.15.164:0/3078604045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d334c540 0x5580d343b780 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f62f4025da0 tx=0x7f62f4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0ff242259521b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:53.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.722+0000 7f61eee05640 1 -- 172.21.15.164:0/3078604045 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62f4051890 con 0x5580d334c540 2024-09-13T23:05:53.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.722+0000 7f61eee05640 1 -- 172.21.15.164:0/3078604045 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62f4051ac0 con 0x5580d334c540 2024-09-13T23:05:53.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.722+0000 7f61eee05640 1 -- 172.21.15.164:0/3078604045 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62f4051da0 con 0x5580d334c540 2024-09-13T23:05:53.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.723+0000 7f6304d24800 1 -- 172.21.15.164:0/3078604045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d334c540 msgr2=0x5580d343b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.723+0000 7f6304d24800 1 --2- 172.21.15.164:0/3078604045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d334c540 0x5580d343b780 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f62f4025da0 tx=0x7f62f4051000 comp rx=0 tx=0).stop 2024-09-13T23:05:53.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.723+0000 7f6304d24800 1 -- 172.21.15.164:0/3078604045 shutdown_connections 2024-09-13T23:05:53.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.723+0000 7f6304d24800 1 --2- 172.21.15.164:0/3078604045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d334c540 0x5580d343b780 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.723+0000 7f6304d24800 1 -- 172.21.15.164:0/3078604045 >> 172.21.15.164:0/3078604045 conn(0x5580d3347dd0 msgr2=0x5580d3437140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:53.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.723+0000 7f6304d24800 1 -- 172.21.15.164:0/3078604045 shutdown_connections 2024-09-13T23:05:53.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.723+0000 7f6304d24800 1 -- 172.21.15.164:0/3078604045 wait complete. 2024-09-13T23:05:53.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.723+0000 7f6304d24800 1 Processor -- start 2024-09-13T23:05:53.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.723+0000 7f6304d24800 1 -- start start 2024-09-13T23:05:53.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.723+0000 7f6304d24800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d334c540 0x5580d32c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:53.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.723+0000 7f6304d24800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5580d3353560 con 0x5580d334c540 2024-09-13T23:05:53.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.723+0000 7f6300ae0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d334c540 0x5580d32c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:53.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.723+0000 7f6300ae0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d334c540 0x5580d32c15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37762/0 (socket says 172.21.15.164:37762) 2024-09-13T23:05:53.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.723+0000 7f6300ae0640 1 -- 172.21.15.164:0/2749079480 learned_addr learned my addr 172.21.15.164:0/2749079480 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:53.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.724+0000 7f6300ae0640 1 -- 172.21.15.164:0/2749079480 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580d31fafe0 con 0x5580d334c540 2024-09-13T23:05:53.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.724+0000 7f6300ae0640 1 --2- 172.21.15.164:0/2749079480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d334c540 0x5580d32c15d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f62f4000c00 tx=0x7f62f4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:53.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.724+0000 7f61ed602640 1 -- 172.21.15.164:0/2749079480 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62f4073070 con 0x5580d334c540 2024-09-13T23:05:53.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.724+0000 7f61ed602640 1 -- 172.21.15.164:0/2749079480 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62f405a450 con 0x5580d334c540 2024-09-13T23:05:53.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.724+0000 7f6304d24800 1 -- 172.21.15.164:0/2749079480 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580d3446d00 con 0x5580d334c540 2024-09-13T23:05:53.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.724+0000 7f61ed602640 1 -- 172.21.15.164:0/2749079480 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62f405a730 con 0x5580d334c540 2024-09-13T23:05:53.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.724+0000 7f6304d24800 1 -- 172.21.15.164:0/2749079480 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580d3447280 con 0x5580d334c540 2024-09-13T23:05:53.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.725+0000 7f61ed602640 1 -- 172.21.15.164:0/2749079480 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f62f4076070 con 0x5580d334c540 2024-09-13T23:05:53.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.725+0000 7f61ed602640 1 --2- 172.21.15.164:0/2749079480 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f61e8036b40 0x7f61e8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:53.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.725+0000 7f61ed602640 1 -- 172.21.15.164:0/2749079480 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f62f4062070 con 0x5580d334c540 2024-09-13T23:05:53.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.725+0000 7f62fbfff640 1 --2- 172.21.15.164:0/2749079480 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f61e8036b40 0x7f61e8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:53.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.725+0000 7f6304d24800 1 --2- 172.21.15.164:0/2749079480 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5580d334ce80 0x5580d344b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:53.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.725+0000 7f6304d24800 1 -- 172.21.15.164:0/2749079480 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d344b6f0 con 0x5580d334ce80 2024-09-13T23:05:53.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.725+0000 7f63012e1640 1 --2- 172.21.15.164:0/2749079480 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5580d334ce80 0x5580d344b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:53.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.726+0000 7f62fbfff640 1 --2- 172.21.15.164:0/2749079480 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f61e8036b40 0x7f61e8039000 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f62ec000f60 tx=0x7f62ec001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:53.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.726+0000 7f63012e1640 1 --2- 172.21.15.164:0/2749079480 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5580d334ce80 0x5580d344b0a0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:53.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.726+0000 7f63012e1640 1 -- 172.21.15.164:0/2749079480 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62fc00a4a0 con 0x5580d334ce80 2024-09-13T23:05:53.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.726+0000 7f6304d24800 1 -- 172.21.15.164:0/2749079480 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d3448670 con 0x5580d334ce80 2024-09-13T23:05:53.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.726+0000 7f63012e1640 1 -- 172.21.15.164:0/2749079480 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f62fc00a4a0 con 0x5580d334ce80 2024-09-13T23:05:53.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.726+0000 7f6304d24800 1 -- 172.21.15.164:0/2749079480 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d344d530 con 0x5580d334ce80 2024-09-13T23:05:53.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.727+0000 7f63012e1640 1 -- 172.21.15.164:0/2749079480 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f62fc00a4a0 con 0x5580d334ce80 2024-09-13T23:05:53.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.727+0000 7f6304d24800 1 -- 172.21.15.164:0/2749079480 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d344c670 con 0x5580d334ce80 2024-09-13T23:05:53.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.727+0000 7f63012e1640 1 -- 172.21.15.164:0/2749079480 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f62fc00a4a0 con 0x5580d334ce80 2024-09-13T23:05:53.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.727+0000 7f6304d24800 1 -- 172.21.15.164:0/2749079480 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d344cac0 con 0x5580d334ce80 2024-09-13T23:05:53.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.727+0000 7f63012e1640 1 -- 172.21.15.164:0/2749079480 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f62fc00a4a0 con 0x5580d334ce80 2024-09-13T23:05:53.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.727+0000 7f6304d24800 1 Processor -- start 2024-09-13T23:05:53.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.727+0000 7f6304d24800 1 -- start start 2024-09-13T23:05:53.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.728+0000 7f6304d24800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d345bb20 0x5580d345bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:53.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.728+0000 7f6304d24800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5580d31e8580 con 0x5580d345bb20 2024-09-13T23:05:53.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.728+0000 7f62fbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d345bb20 0x5580d345bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:53.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.728+0000 7f62fbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d345bb20 0x5580d345bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37766/0 (socket says 172.21.15.164:37766) 2024-09-13T23:05:53.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.728+0000 7f62fbfff640 1 -- 172.21.15.164:0/4283315376 learned_addr learned my addr 172.21.15.164:0/4283315376 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:53.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.728+0000 7f62fbfff640 1 -- 172.21.15.164:0/4283315376 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580d345c480 con 0x5580d345bb20 2024-09-13T23:05:53.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.728+0000 7f62fbfff640 1 --2- 172.21.15.164:0/4283315376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d345bb20 0x5580d345bf40 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f62ec001ed0 tx=0x7f62ec00ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:53.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.729+0000 7f61e67fc640 1 -- 172.21.15.164:0/4283315376 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62ec022070 con 0x5580d345bb20 2024-09-13T23:05:53.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.729+0000 7f61e67fc640 1 -- 172.21.15.164:0/4283315376 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62ec00d520 con 0x5580d345bb20 2024-09-13T23:05:53.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.729+0000 7f6304d24800 1 -- 172.21.15.164:0/4283315376 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580d345c710 con 0x5580d345bb20 2024-09-13T23:05:53.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.729+0000 7f61e67fc640 1 -- 172.21.15.164:0/4283315376 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62ec00d800 con 0x5580d345bb20 2024-09-13T23:05:53.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.729+0000 7f6304d24800 1 -- 172.21.15.164:0/4283315376 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580d345f3f0 con 0x5580d345bb20 2024-09-13T23:05:53.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.729+0000 7f61e67fc640 1 -- 172.21.15.164:0/4283315376 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f62ec025070 con 0x5580d345bb20 2024-09-13T23:05:53.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.730+0000 7f61e67fc640 1 --2- 172.21.15.164:0/4283315376 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f61d8036b40 0x7f61d8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:53.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.730+0000 7f61e67fc640 1 -- 172.21.15.164:0/4283315376 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f62ec04e150 con 0x5580d345bb20 2024-09-13T23:05:53.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.730+0000 7f63012e1640 1 --2- 172.21.15.164:0/4283315376 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f61d8036b40 0x7f61d8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:53.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.730+0000 7f6304d24800 1 Processor -- start 2024-09-13T23:05:53.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.730+0000 7f63012e1640 1 --2- 172.21.15.164:0/4283315376 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f61d8036b40 0x7f61d8039000 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x5580d344c190 tx=0x7f62fc005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:53.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.730+0000 7f6304d24800 1 -- start start 2024-09-13T23:05:53.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.730+0000 7f6304d24800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d3443f30 0x5580d3444330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:53.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.730+0000 7f6304d24800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5580d343be70 con 0x5580d3443f30 2024-09-13T23:05:53.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.730+0000 7f62fbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d3443f30 0x5580d3444330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:53.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.730+0000 7f62fbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d3443f30 0x5580d3444330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37776/0 (socket says 172.21.15.164:37776) 2024-09-13T23:05:53.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.730+0000 7f62fbfff640 1 -- 172.21.15.164:0/670682937 learned_addr learned my addr 172.21.15.164:0/670682937 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:53.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.731+0000 7f62fbfff640 1 -- 172.21.15.164:0/670682937 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580d3444900 con 0x5580d3443f30 2024-09-13T23:05:53.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.731+0000 7f62fbfff640 1 --2- 172.21.15.164:0/670682937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d3443f30 0x5580d3444330 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f62ec04c410 tx=0x7f62ec024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225ab14556ee337b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:53.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.731+0000 7f61d7fff640 1 -- 172.21.15.164:0/670682937 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62ec025990 con 0x5580d3443f30 2024-09-13T23:05:53.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.731+0000 7f61d7fff640 1 -- 172.21.15.164:0/670682937 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62ec026730 con 0x5580d3443f30 2024-09-13T23:05:53.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.731+0000 7f61d7fff640 1 -- 172.21.15.164:0/670682937 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62ec025c50 con 0x5580d3443f30 2024-09-13T23:05:53.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.731+0000 7f6304d24800 1 -- 172.21.15.164:0/670682937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d3443f30 msgr2=0x5580d3444330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.731+0000 7f6304d24800 1 --2- 172.21.15.164:0/670682937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d3443f30 0x5580d3444330 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f62ec04c410 tx=0x7f62ec024740 comp rx=0 tx=0).stop 2024-09-13T23:05:53.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.731+0000 7f6304d24800 1 -- 172.21.15.164:0/670682937 shutdown_connections 2024-09-13T23:05:53.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.731+0000 7f6304d24800 1 --2- 172.21.15.164:0/670682937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d3443f30 0x5580d3444330 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.731+0000 7f6304d24800 1 -- 172.21.15.164:0/670682937 >> 172.21.15.164:0/670682937 conn(0x5580d3464b90 msgr2=0x5580d3462c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:53.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.731+0000 7f6304d24800 1 -- 172.21.15.164:0/670682937 shutdown_connections 2024-09-13T23:05:53.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.731+0000 7f6304d24800 1 -- 172.21.15.164:0/670682937 wait complete. 2024-09-13T23:05:53.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.732+0000 7f6304d24800 1 Processor -- start 2024-09-13T23:05:53.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.732+0000 7f6304d24800 1 -- start start 2024-09-13T23:05:53.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.732+0000 7f6304d24800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d3443f30 0x5580d3471f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:53.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.732+0000 7f6304d24800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5580d3442c60 con 0x5580d3443f30 2024-09-13T23:05:53.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.732+0000 7f62fbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d3443f30 0x5580d3471f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:53.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.732+0000 7f62fbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d3443f30 0x5580d3471f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37790/0 (socket says 172.21.15.164:37790) 2024-09-13T23:05:53.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.732+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 learned_addr learned my addr 172.21.15.164:0/2414032891 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:53.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.732+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580d34724c0 con 0x5580d3443f30 2024-09-13T23:05:53.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.733+0000 7f62fbfff640 1 --2- 172.21.15.164:0/2414032891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d3443f30 0x5580d3471f80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f62ec024fd0 tx=0x7f62ec04c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:53.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.733+0000 7f61d67fc640 1 -- 172.21.15.164:0/2414032891 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62ec03a070 con 0x5580d3443f30 2024-09-13T23:05:53.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.733+0000 7f61d67fc640 1 -- 172.21.15.164:0/2414032891 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62ec030040 con 0x5580d3443f30 2024-09-13T23:05:53.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.733+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580d34724c0 con 0x5580d3443f30 2024-09-13T23:05:53.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.733+0000 7f61d67fc640 1 -- 172.21.15.164:0/2414032891 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62ec046030 con 0x5580d3443f30 2024-09-13T23:05:53.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.733+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580d34724c0 con 0x5580d3443f30 2024-09-13T23:05:53.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.733+0000 7f61d67fc640 1 -- 172.21.15.164:0/2414032891 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f62ec025360 con 0x5580d3443f30 2024-09-13T23:05:53.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.734+0000 7f61d67fc640 1 --2- 172.21.15.164:0/2414032891 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f61cc036b40 0x7f61cc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:53.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.734+0000 7f61d67fc640 1 -- 172.21.15.164:0/2414032891 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f62ec047040 con 0x5580d3443f30 2024-09-13T23:05:53.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.734+0000 7f63012e1640 1 --2- 172.21.15.164:0/2414032891 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f61cc036b40 0x7f61cc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:53.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.734+0000 7f63012e1640 1 --2- 172.21.15.164:0/2414032891 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f61cc036b40 0x7f61cc039000 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x5580d32c0fc0 tx=0x7f62fc01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:53.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.734+0000 7f6304d24800 20 rados->read ofs=0 len=0 2024-09-13T23:05:53.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.734+0000 7f6304d24800 1 --2- 172.21.15.164:0/2414032891 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5580d347d6d0 0x5580d347fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:53.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.734+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34802e0 con 0x5580d347d6d0 2024-09-13T23:05:53.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.734+0000 7f6300ae0640 1 --2- 172.21.15.164:0/2414032891 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5580d347d6d0 0x5580d347fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:53.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.735+0000 7f6300ae0640 1 --2- 172.21.15.164:0/2414032891 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5580d347d6d0 0x5580d347fb90 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:53.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.735+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.735+0000 7f6304d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:53.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.735+0000 7f6304d24800 20 realm 2024-09-13T23:05:53.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.735+0000 7f6304d24800 20 rados->read ofs=0 len=0 2024-09-13T23:05:53.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.735+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34806f0 con 0x5580d347d6d0 2024-09-13T23:05:53.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.735+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.735+0000 7f6304d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:53.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.735+0000 7f6304d24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:53.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.735+0000 7f6304d24800 20 rados->read ofs=0 len=0 2024-09-13T23:05:53.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.735+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d3480fc0 con 0x5580d347d6d0 2024-09-13T23:05:53.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.735+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.735+0000 7f6304d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:53.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.735+0000 7f6304d24800 20 rados->read ofs=0 len=0 2024-09-13T23:05:53.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.735+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d3481360 con 0x5580d347d6d0 2024-09-13T23:05:53.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.736+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.736+0000 7f6304d24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:53.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.736+0000 7f6304d24800 20 rados->read ofs=0 len=0 2024-09-13T23:05:53.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.736+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d3481bb0 con 0x5580d347d6d0 2024-09-13T23:05:53.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.736+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.736+0000 7f6304d24800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:53.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.736+0000 7f6304d24800 20 searching for the correct realm 2024-09-13T23:05:53.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.736+0000 7f6304d24800 1 --2- 172.21.15.164:0/2414032891 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5580d3483920 0x5580d3485d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:53.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.736+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x5580d3483920 2024-09-13T23:05:53.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.736+0000 7f62fbfff640 1 --2- 172.21.15.164:0/2414032891 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5580d3483920 0x5580d3485d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:53.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.736+0000 7f62fbfff640 1 --2- 172.21.15.164:0/2414032891 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5580d3483920 0x5580d3485d10 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:53.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.737+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.737+0000 7f62fbfff640 1 --2- 172.21.15.164:0/2414032891 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f62ec01ac20 0x7f62ec01c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:53.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.737+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x7f62ec01ac20 2024-09-13T23:05:53.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.737+0000 7f63012e1640 1 --2- 172.21.15.164:0/2414032891 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f62ec01ac20 0x7f62ec01c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:53.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.737+0000 7f63012e1640 1 --2- 172.21.15.164:0/2414032891 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f62ec01ac20 0x7f62ec01c420 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:53.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.737+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62fc01f070 con 0x7f62ec01ac20 2024-09-13T23:05:53.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.737+0000 7f63012e1640 1 --2- 172.21.15.164:0/2414032891 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f62fc031040 0x7f62fc032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:53.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.737+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x7f62fc031040 2024-09-13T23:05:53.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.738+0000 7f6300ae0640 1 --2- 172.21.15.164:0/2414032891 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f62fc031040 0x7f62fc032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:53.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.738+0000 7f6300ae0640 1 --2- 172.21.15.164:0/2414032891 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f62fc031040 0x7f62fc032940 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:53.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.738+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.738+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x5580d347d6d0 2024-09-13T23:05:53.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.738+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.738+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x5580d347d6d0 2024-09-13T23:05:53.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.739+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.739+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x7f62fc031040 2024-09-13T23:05:53.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.739+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.739+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x7f62fc031040 2024-09-13T23:05:53.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.739+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.739+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x7f62ec01ac20 2024-09-13T23:05:53.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.739+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62fc01f070 con 0x7f62ec01ac20 2024-09-13T23:05:53.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.739+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x5580d3483920 2024-09-13T23:05:53.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.740+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.740+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x5580d347d6d0 2024-09-13T23:05:53.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.740+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.740+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x7f62fc031040 2024-09-13T23:05:53.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.740+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.740+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x5580d347d6d0 2024-09-13T23:05:53.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.740+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.740+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x7f62ec01ac20 2024-09-13T23:05:53.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.741+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f62fc01f070 con 0x7f62ec01ac20 2024-09-13T23:05:53.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.741+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x5580d3483920 2024-09-13T23:05:53.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.741+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.741+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x5580d3483920 2024-09-13T23:05:53.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.741+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.741+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x7f62fc031040 2024-09-13T23:05:53.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.742+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.742+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x5580d3483920 2024-09-13T23:05:53.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.742+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.742+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x5580d3483920 2024-09-13T23:05:53.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.742+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.742+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x5580d347d6d0 2024-09-13T23:05:53.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.742+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.742+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x5580d347d6d0 2024-09-13T23:05:53.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.742+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.742+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x7f62fc031040 2024-09-13T23:05:53.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.743+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.743+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x5580d3483920 2024-09-13T23:05:53.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.743+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.743+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x7f62ec01ac20 2024-09-13T23:05:53.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.743+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62fc01f070 con 0x7f62ec01ac20 2024-09-13T23:05:53.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.743+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x5580d347d6d0 2024-09-13T23:05:53.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.743+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.743+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x7f62fc031040 2024-09-13T23:05:53.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.744+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.744+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x5580d3483920 2024-09-13T23:05:53.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.744+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.744+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x7f62fc031040 2024-09-13T23:05:53.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.744+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.744+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x7f62ec01ac20 2024-09-13T23:05:53.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.745+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62fc01f070 con 0x7f62ec01ac20 2024-09-13T23:05:53.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.745+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x5580d3483920 2024-09-13T23:05:53.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.745+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.745+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x7f62ec01ac20 2024-09-13T23:05:53.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.745+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62fc01f070 con 0x7f62ec01ac20 2024-09-13T23:05:53.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.745+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x5580d347d6d0 2024-09-13T23:05:53.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.745+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.745+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486340 con 0x7f62ec01ac20 2024-09-13T23:05:53.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.746+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.746+0000 7f6304d24800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:53.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.746+0000 7f6304d24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:53.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.746+0000 7f6304d24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:53.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.746+0000 7f6304d24800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:53.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.746+0000 7f6304d24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:53.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.746+0000 7f6304d24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:53.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.746+0000 7f6304d24800 20 rados->read ofs=0 len=0 2024-09-13T23:05:53.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.746+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d3482560 con 0x5580d347d6d0 2024-09-13T23:05:53.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.746+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.746+0000 7f6304d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:53.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.746+0000 7f6304d24800 20 rados->read ofs=0 len=0 2024-09-13T23:05:53.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.746+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d3482e00 con 0x5580d347d6d0 2024-09-13T23:05:53.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.746+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.746+0000 7f6304d24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:53.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.746+0000 7f6304d24800 20 rados->read ofs=0 len=0 2024-09-13T23:05:53.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.746+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34867c0 con 0x5580d347d6d0 2024-09-13T23:05:53.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.746+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.746+0000 7f6304d24800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:53.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.746+0000 7f6304d24800 20 zone default found 2024-09-13T23:05:53.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.746+0000 7f6304d24800 4 Realm: () 2024-09-13T23:05:53.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.746+0000 7f6304d24800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:53.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.746+0000 7f6304d24800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:53.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.746+0000 7f6304d24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:53.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.746+0000 7f6304d24800 20 zonegroup default 2024-09-13T23:05:53.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.746+0000 7f6304d24800 20 rados->read ofs=0 len=0 2024-09-13T23:05:53.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.746+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d3486c70 con 0x7f62fc031040 2024-09-13T23:05:53.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.747+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.747+0000 7f6304d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:53.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.747+0000 7f6304d24800 20 rados->read ofs=0 len=0 2024-09-13T23:05:53.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.747+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d3488650 con 0x5580d3483920 2024-09-13T23:05:53.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.747+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.747+0000 7f6304d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:53.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.747+0000 7f6304d24800 20 rados->read ofs=0 len=0 2024-09-13T23:05:53.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.747+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d3488af0 con 0x5580d3483920 2024-09-13T23:05:53.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.747+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.747+0000 7f6304d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:53.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.747+0000 7f6304d24800 20 started sync module instance, tier type = 2024-09-13T23:05:53.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.747+0000 7f6304d24800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:53.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.747+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d3487ae0 con 0x7f62ec01ac20 2024-09-13T23:05:53.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.748+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.748+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94011788918480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d3487740 con 0x7f62ec01ac20 2024-09-13T23:05:53.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.748+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d3489a20 con 0x5580d347d6d0 2024-09-13T23:05:53.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.749+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94011788918480] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.749+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.749+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94011788922704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d3489a20 con 0x5580d347d6d0 2024-09-13T23:05:53.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.749+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d348a420 con 0x5580d3483920 2024-09-13T23:05:53.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.751+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94011788922704] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.751+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.751+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94011788924272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d3489990 con 0x5580d3483920 2024-09-13T23:05:53.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.751+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d348b310 con 0x7f62ec01ac20 2024-09-13T23:05:53.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.752+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94011788924272] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.752+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.752+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94011788930656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d348b730 con 0x7f62ec01ac20 2024-09-13T23:05:53.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.752+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d348c0f0 con 0x5580d347d6d0 2024-09-13T23:05:53.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.753+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.753+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94011788934208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d348c510 con 0x5580d347d6d0 2024-09-13T23:05:53.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.753+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94011788930656] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.753+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d348b2c0 con 0x7f62fc031040 2024-09-13T23:05:53.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.754+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.754+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94011788937888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d348b2c0 con 0x7f62fc031040 2024-09-13T23:05:53.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.754+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d348d9d0 con 0x7f62fc031040 2024-09-13T23:05:53.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.754+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94011788934208] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.755+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94011788937888] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.755+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.755+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94011788938944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d348d4e0 con 0x7f62fc031040 2024-09-13T23:05:53.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.755+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d348e2a0 con 0x7f62fc031040 2024-09-13T23:05:53.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.756+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(58 notify.7 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.756+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94011788941984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d348e370 con 0x7f62fc031040 2024-09-13T23:05:53.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.756+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94011788938944] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.756+0000 7f6304d24800 20 add_watcher() i=0 2024-09-13T23:05:53.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.756+0000 7f6304d24800 20 add_watcher() i=1 2024-09-13T23:05:53.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.756+0000 7f6304d24800 20 add_watcher() i=2 2024-09-13T23:05:53.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.756+0000 7f6304d24800 20 add_watcher() i=3 2024-09-13T23:05:53.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.756+0000 7f6304d24800 20 add_watcher() i=4 2024-09-13T23:05:53.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.756+0000 7f6304d24800 20 add_watcher() i=5 2024-09-13T23:05:53.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.756+0000 7f6304d24800 20 add_watcher() i=6 2024-09-13T23:05:53.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.757+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94011788941984] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.757+0000 7f6304d24800 20 add_watcher() i=7 2024-09-13T23:05:53.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.757+0000 7f6304d24800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:53.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.757+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34913a0 con 0x5580d347d6d0 2024-09-13T23:05:53.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.757+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.757+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94011788943040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d348e7c0 con 0x5580d347d6d0 2024-09-13T23:05:53.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.758+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94011788943040] v34'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.758+0000 7f61b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:53.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.759+0000 7f6304d24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:53.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.759+0000 7f6304d24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:53.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.759+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d3499de0 con 0x5580d347d6d0 2024-09-13T23:05:53.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.760+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.760+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349a4b0 con 0x7f62fc031040 2024-09-13T23:05:53.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.761+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.761+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349a4b0 con 0x5580d3483920 2024-09-13T23:05:53.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.762+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.762+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349a850 con 0x5580d347d6d0 2024-09-13T23:05:53.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.763+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'158 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.763+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d3499570 con 0x7f62ec01ac20 2024-09-13T23:05:53.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.764+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'47 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.764+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d3499570 con 0x5580d3483920 2024-09-13T23:05:53.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.765+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'31 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.765+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349b2b0 con 0x5580d347d6d0 2024-09-13T23:05:53.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.766+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.766+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349b2b0 con 0x7f62fc031040 2024-09-13T23:05:53.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.767+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.767+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349b2b0 con 0x7f62ec01ac20 2024-09-13T23:05:53.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.768+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.768+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349b8e0 con 0x5580d3483920 2024-09-13T23:05:53.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.769+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.769+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349bd20 con 0x7f62ec01ac20 2024-09-13T23:05:53.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.770+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'48 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.770+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349c290 con 0x7f62fc031040 2024-09-13T23:05:53.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.771+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.771+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349c290 con 0x7f62ec01ac20 2024-09-13T23:05:53.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.772+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.772+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349c740 con 0x7f62fc031040 2024-09-13T23:05:53.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.773+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'37 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.773+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349c740 con 0x5580d347d6d0 2024-09-13T23:05:53.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.774+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'159 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.774+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349c740 con 0x5580d3483920 2024-09-13T23:05:53.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.775+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'41 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.775+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349c740 con 0x7f62ec01ac20 2024-09-13T23:05:53.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.776+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'49 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.776+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349c740 con 0x5580d3483920 2024-09-13T23:05:53.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.777+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.777+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349c740 con 0x5580d347d6d0 2024-09-13T23:05:53.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.778+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'27 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.778+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349c740 con 0x5580d347d6d0 2024-09-13T23:05:53.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.779+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'160 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.779+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349c740 con 0x5580d3483920 2024-09-13T23:05:53.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.780+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'42 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.780+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349c740 con 0x7f62ec01ac20 2024-09-13T23:05:53.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.781+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'29 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.781+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349c740 con 0x5580d3483920 2024-09-13T23:05:53.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.782+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.782+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349c740 con 0x5580d3483920 2024-09-13T23:05:53.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.783+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.783+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349c740 con 0x5580d3483920 2024-09-13T23:05:53.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.784+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.784+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349c740 con 0x5580d3483920 2024-09-13T23:05:53.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.785+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.785+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349c740 con 0x7f62fc031040 2024-09-13T23:05:53.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.787+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.787+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349c740 con 0x5580d3483920 2024-09-13T23:05:53.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.788+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.788+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349c740 con 0x7f62fc031040 2024-09-13T23:05:53.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.789+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'33 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.789+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349c740 con 0x5580d3483920 2024-09-13T23:05:53.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.790+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'43 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.790+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349c740 con 0x7f62fc031040 2024-09-13T23:05:53.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.791+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'38 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.791+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d349c740 con 0x7f62ec01ac20 2024-09-13T23:05:53.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.792+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.793+0000 7f61b67e4640 20 reqs_thread_entry: start 2024-09-13T23:05:53.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.793+0000 7f6304d24800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:53.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.793+0000 7f6304d24800 20 Filter name: none 2024-09-13T23:05:53.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.793+0000 7f61affff640 20 reqs_thread_entry: start 2024-09-13T23:05:53.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.793+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-13T23:05:53.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.793+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:94 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62fc031040 2024-09-13T23:05:53.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.794+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(94 gc.26 [call] v34'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.794+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:95 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62fc031040 2024-09-13T23:05:53.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.794+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(95 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.794+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.795+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:96 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c75b0 con 0x7f62fc031040 2024-09-13T23:05:53.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.795+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(96 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.795+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:97 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62fc031040 2024-09-13T23:05:53.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.795+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== osd_op_reply(97 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.795+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.795+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:98 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62fc031040 2024-09-13T23:05:53.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.795+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 27 ==== osd_op_reply(98 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.795+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.795+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:99 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62fc031040 2024-09-13T23:05:53.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.797+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 28 ==== osd_op_reply(99 gc.26 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.797+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-13T23:05:53.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.797+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:100 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d3483920 2024-09-13T23:05:53.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.798+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 26 ==== osd_op_reply(100 gc.27 [call] v34'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.798+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:101 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d3483920 2024-09-13T23:05:53.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.798+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 27 ==== osd_op_reply(101 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.798+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.798+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:102 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c75b0 con 0x5580d3483920 2024-09-13T23:05:53.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.798+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 28 ==== osd_op_reply(102 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.798+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:103 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d3483920 2024-09-13T23:05:53.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.798+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 29 ==== osd_op_reply(103 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.798+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.798+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:104 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d3483920 2024-09-13T23:05:53.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.799+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 30 ==== osd_op_reply(104 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.799+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.799+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:105 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d3483920 2024-09-13T23:05:53.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.799+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 31 ==== osd_op_reply(105 gc.27 [call] v34'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.800+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-13T23:05:53.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.800+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:106 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62fc031040 2024-09-13T23:05:53.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.801+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 29 ==== osd_op_reply(106 gc.28 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.801+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:107 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62fc031040 2024-09-13T23:05:53.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.801+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 30 ==== osd_op_reply(107 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.801+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.801+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:108 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c75b0 con 0x7f62fc031040 2024-09-13T23:05:53.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.801+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 31 ==== osd_op_reply(108 gc.28 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.801+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:109 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62fc031040 2024-09-13T23:05:53.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.802+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 32 ==== osd_op_reply(109 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.802+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.802+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:110 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62fc031040 2024-09-13T23:05:53.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.802+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 33 ==== osd_op_reply(110 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.802+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.802+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:111 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62fc031040 2024-09-13T23:05:53.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.803+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 34 ==== osd_op_reply(111 gc.28 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.803+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-13T23:05:53.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.803+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:112 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d3483920 2024-09-13T23:05:53.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.804+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 32 ==== osd_op_reply(112 gc.29 [call] v34'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.804+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:113 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d3483920 2024-09-13T23:05:53.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.804+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 33 ==== osd_op_reply(113 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.804+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.804+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:114 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c75b0 con 0x5580d3483920 2024-09-13T23:05:53.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.804+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 34 ==== osd_op_reply(114 gc.29 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.804+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:115 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d3483920 2024-09-13T23:05:53.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.805+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 35 ==== osd_op_reply(115 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.805+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.805+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:116 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d3483920 2024-09-13T23:05:53.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.805+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 36 ==== osd_op_reply(116 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.805+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.805+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:117 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d3483920 2024-09-13T23:05:53.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.806+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 37 ==== osd_op_reply(117 gc.29 [call] v34'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.806+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-13T23:05:53.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.806+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:118 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62fc031040 2024-09-13T23:05:53.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.807+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 35 ==== osd_op_reply(118 gc.30 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.807+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:119 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62fc031040 2024-09-13T23:05:53.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.807+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 36 ==== osd_op_reply(119 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.807+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.807+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:120 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c75b0 con 0x7f62fc031040 2024-09-13T23:05:53.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.807+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 37 ==== osd_op_reply(120 gc.30 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.807+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:121 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62fc031040 2024-09-13T23:05:53.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.808+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 38 ==== osd_op_reply(121 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.808+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.808+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:122 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62fc031040 2024-09-13T23:05:53.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.808+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 39 ==== osd_op_reply(122 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.808+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.808+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:123 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62fc031040 2024-09-13T23:05:53.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.809+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 40 ==== osd_op_reply(123 gc.30 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.809+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-13T23:05:53.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.809+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:124 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62ec01ac20 2024-09-13T23:05:53.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.810+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 19 ==== osd_op_reply(124 gc.31 [call] v34'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.810+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:125 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62ec01ac20 2024-09-13T23:05:53.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.810+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 20 ==== osd_op_reply(125 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.810+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.810+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:126 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c75b0 con 0x7f62ec01ac20 2024-09-13T23:05:53.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.810+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 21 ==== osd_op_reply(126 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.810+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:127 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62ec01ac20 2024-09-13T23:05:53.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.811+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 22 ==== osd_op_reply(127 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.811+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.811+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:128 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62ec01ac20 2024-09-13T23:05:53.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.811+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 23 ==== osd_op_reply(128 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.811+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.811+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:129 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62ec01ac20 2024-09-13T23:05:53.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.812+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 24 ==== osd_op_reply(129 gc.31 [call] v34'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.812+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-13T23:05:53.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.812+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:130 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d347d6d0 2024-09-13T23:05:53.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.813+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(130 gc.0 [call] v34'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.813+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:131 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d347d6d0 2024-09-13T23:05:53.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.813+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(131 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.813+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.813+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:132 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c75b0 con 0x5580d347d6d0 2024-09-13T23:05:53.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.814+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(132 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.814+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:133 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d347d6d0 2024-09-13T23:05:53.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.814+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 32 ==== osd_op_reply(133 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.814+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.814+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:134 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d347d6d0 2024-09-13T23:05:53.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.814+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 33 ==== osd_op_reply(134 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.814+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.814+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:135 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d347d6d0 2024-09-13T23:05:53.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.815+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 34 ==== osd_op_reply(135 gc.0 [call] v34'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.815+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-13T23:05:53.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.815+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:136 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62fc031040 2024-09-13T23:05:53.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.816+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 41 ==== osd_op_reply(136 gc.1 [call] v34'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.816+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:137 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62fc031040 2024-09-13T23:05:53.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.816+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 42 ==== osd_op_reply(137 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.816+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.816+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:138 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c75b0 con 0x7f62fc031040 2024-09-13T23:05:53.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.817+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 43 ==== osd_op_reply(138 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.817+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:139 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62fc031040 2024-09-13T23:05:53.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.817+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 44 ==== osd_op_reply(139 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.817+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.817+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:140 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62fc031040 2024-09-13T23:05:53.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.817+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 45 ==== osd_op_reply(140 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.817+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.817+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:141 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62fc031040 2024-09-13T23:05:53.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.818+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 46 ==== osd_op_reply(141 gc.1 [call] v34'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.818+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-13T23:05:53.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.818+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:142 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d3483920 2024-09-13T23:05:53.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.819+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 38 ==== osd_op_reply(142 gc.2 [call] v34'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.819+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:143 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d3483920 2024-09-13T23:05:53.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.819+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 39 ==== osd_op_reply(143 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.819+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.819+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:144 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c75b0 con 0x5580d3483920 2024-09-13T23:05:53.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.819+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 40 ==== osd_op_reply(144 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.819+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:145 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d3483920 2024-09-13T23:05:53.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.820+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 41 ==== osd_op_reply(145 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.820+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.820+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:146 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d3483920 2024-09-13T23:05:53.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.820+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 42 ==== osd_op_reply(146 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.820+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.820+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:147 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d3483920 2024-09-13T23:05:53.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.821+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 43 ==== osd_op_reply(147 gc.2 [call] v34'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.821+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-13T23:05:53.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.821+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:148 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d347d6d0 2024-09-13T23:05:53.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.822+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 35 ==== osd_op_reply(148 gc.3 [call] v34'161 uv161 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.822+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:149 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d347d6d0 2024-09-13T23:05:53.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.822+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 36 ==== osd_op_reply(149 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.822+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.822+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:150 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c75b0 con 0x5580d347d6d0 2024-09-13T23:05:53.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.822+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 37 ==== osd_op_reply(150 gc.3 [call out=24b] v0'0 uv161 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.822+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:151 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d347d6d0 2024-09-13T23:05:53.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.822+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 38 ==== osd_op_reply(151 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.822+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.822+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:152 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d347d6d0 2024-09-13T23:05:53.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.823+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 39 ==== osd_op_reply(152 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.823+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.823+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:153 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d347d6d0 2024-09-13T23:05:53.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.823+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 40 ==== osd_op_reply(153 gc.3 [call] v34'162 uv162 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.823+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-13T23:05:53.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.823+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:154 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62ec01ac20 2024-09-13T23:05:53.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.824+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 25 ==== osd_op_reply(154 gc.4 [call] v34'50 uv50 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.824+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:155 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62ec01ac20 2024-09-13T23:05:53.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.825+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 26 ==== osd_op_reply(155 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.825+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.825+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:156 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c75b0 con 0x7f62ec01ac20 2024-09-13T23:05:53.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.825+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 27 ==== osd_op_reply(156 gc.4 [call out=24b] v0'0 uv50 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.825+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:157 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62ec01ac20 2024-09-13T23:05:53.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.825+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 28 ==== osd_op_reply(157 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.825+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.825+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:158 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62ec01ac20 2024-09-13T23:05:53.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.825+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 29 ==== osd_op_reply(158 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.825+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.825+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:159 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62ec01ac20 2024-09-13T23:05:53.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.826+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 30 ==== osd_op_reply(159 gc.4 [call] v34'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.826+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-13T23:05:53.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.826+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:160 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d3483920 2024-09-13T23:05:53.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.827+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 44 ==== osd_op_reply(160 gc.5 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.827+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:161 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d3483920 2024-09-13T23:05:53.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.827+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 45 ==== osd_op_reply(161 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.828+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.828+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:162 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c75b0 con 0x5580d3483920 2024-09-13T23:05:53.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.828+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 46 ==== osd_op_reply(162 gc.5 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.828+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:163 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d3483920 2024-09-13T23:05:53.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.828+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 47 ==== osd_op_reply(163 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.828+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.828+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:164 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d3483920 2024-09-13T23:05:53.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.828+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 48 ==== osd_op_reply(164 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.828+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.828+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:165 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d3483920 2024-09-13T23:05:53.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.829+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 49 ==== osd_op_reply(165 gc.5 [call] v34'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.829+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-13T23:05:53.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.829+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:166 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d347d6d0 2024-09-13T23:05:53.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.830+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 41 ==== osd_op_reply(166 gc.6 [call] v34'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.830+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:167 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d347d6d0 2024-09-13T23:05:53.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.830+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 42 ==== osd_op_reply(167 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.830+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.830+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:168 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c75b0 con 0x5580d347d6d0 2024-09-13T23:05:53.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.831+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 43 ==== osd_op_reply(168 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.831+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:169 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d347d6d0 2024-09-13T23:05:53.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.831+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 44 ==== osd_op_reply(169 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.831+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.831+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:170 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d347d6d0 2024-09-13T23:05:53.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.831+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 45 ==== osd_op_reply(170 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.831+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.831+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:171 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x5580d347d6d0 2024-09-13T23:05:53.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.832+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 46 ==== osd_op_reply(171 gc.6 [call] v34'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.832+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-13T23:05:53.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.832+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:172 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62fc031040 2024-09-13T23:05:53.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.833+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 47 ==== osd_op_reply(172 gc.7 [call] v34'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.833+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:173 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62fc031040 2024-09-13T23:05:53.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.833+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 48 ==== osd_op_reply(173 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.833+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.833+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:174 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c75b0 con 0x7f62fc031040 2024-09-13T23:05:53.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.834+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 49 ==== osd_op_reply(174 gc.7 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.834+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:175 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62fc031040 2024-09-13T23:05:53.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.834+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 50 ==== osd_op_reply(175 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.834+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.834+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:176 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c85c0 con 0x7f62fc031040 2024-09-13T23:05:53.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.834+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 51 ==== osd_op_reply(176 gc.7 [call out=1700b] v0'0 uv36 ondisk = 0) ==== 148+0+1700 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.834+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-13T23:05:53.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.834+0000 7f6304d24800 20 garbage collection: RGWGC::process iterating over entry tag='a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.476571949781167085', time=2024-09-13T23:05:53.435413+0000, chain.objs.size()=7 2024-09-13T23:05:53.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.834+0000 7f6304d24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_1 2024-09-13T23:05:53.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.834+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:177 3.7s0 3:e10faf26:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_1:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c8c40 con 0x5580d3483920 2024-09-13T23:05:53.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.834+0000 7f6304d24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_2 2024-09-13T23:05:53.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.835+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:178 3.34s0 3:2c9bd513:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_2:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34cb870 con 0x5580d347d6d0 2024-09-13T23:05:53.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.835+0000 7f6304d24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_3 2024-09-13T23:05:53.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.835+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:179 3.20s0 3:07f414eb:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_3:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34ce360 con 0x7f62ec01ac20 2024-09-13T23:05:53.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.835+0000 7f6304d24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_4 2024-09-13T23:05:53.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.835+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:180 3.10s0 3:08252617:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_4:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34cb870 con 0x5580d347d6d0 2024-09-13T23:05:53.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.835+0000 7f6304d24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_5 2024-09-13T23:05:53.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.835+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:181 3.18s0 3:1af2ec04:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_5:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34d3410 con 0x5580d3483920 2024-09-13T23:05:53.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.835+0000 7f6304d24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_6 2024-09-13T23:05:53.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.835+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:182 3.33s0 3:cc8349c6:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_6:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34ce360 con 0x7f62fc031040 2024-09-13T23:05:53.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.835+0000 7f6304d24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_7 2024-09-13T23:05:53.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.835+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:183 3.34s0 3:2c68e44e:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_7:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34d3410 con 0x5580d347d6d0 2024-09-13T23:05:53.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.837+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 50 ==== osd_op_reply(177 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_1 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.839+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 52 ==== osd_op_reply(182 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_6 [call] v34'4 uv4 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.839+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 47 ==== osd_op_reply(180 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_4 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.839+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 48 ==== osd_op_reply(178 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_2 [call] v34'3 uv3 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.840+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 51 ==== osd_op_reply(181 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_5 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.840+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 31 ==== osd_op_reply(179 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_3 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.842+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 49 ==== osd_op_reply(183 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1__shadow_.CxC_HcR1g_rrOvQUKn8I8FauaF41ucn_7 [call] v34'4 uv4 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.842+0000 7f6304d24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-13T23:05:53.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.842+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:184 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34d3410 con 0x7f62fc031040 2024-09-13T23:05:53.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.847+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 53 ==== osd_op_reply(184 gc.7 [call] v34'37 uv37 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.847+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:185 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34d3410 con 0x7f62fc031040 2024-09-13T23:05:53.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.848+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 54 ==== osd_op_reply(185 gc.7 [call] v34'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.848+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-13T23:05:53.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.848+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:186 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34d3410 con 0x7f62ec01ac20 2024-09-13T23:05:53.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.849+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 32 ==== osd_op_reply(186 gc.8 [call] v34'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.849+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:187 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34d3410 con 0x7f62ec01ac20 2024-09-13T23:05:53.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.850+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 33 ==== osd_op_reply(187 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.850+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.850+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:188 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34d3410 con 0x7f62ec01ac20 2024-09-13T23:05:53.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.850+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 34 ==== osd_op_reply(188 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.850+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:189 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34d3410 con 0x7f62ec01ac20 2024-09-13T23:05:53.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.850+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 35 ==== osd_op_reply(189 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.850+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.850+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:190 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34d3410 con 0x7f62ec01ac20 2024-09-13T23:05:53.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.850+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 36 ==== osd_op_reply(190 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.850+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.850+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:191 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34d3410 con 0x7f62ec01ac20 2024-09-13T23:05:53.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.851+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 37 ==== osd_op_reply(191 gc.8 [call] v34'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.851+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-13T23:05:53.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.851+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:192 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34d3410 con 0x5580d3483920 2024-09-13T23:05:53.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.852+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 52 ==== osd_op_reply(192 gc.9 [call] v34'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.852+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:193 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34d3410 con 0x5580d3483920 2024-09-13T23:05:53.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.853+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 53 ==== osd_op_reply(193 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.853+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.853+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:194 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c7bd0 con 0x5580d3483920 2024-09-13T23:05:53.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.853+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 54 ==== osd_op_reply(194 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.853+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:195 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34d0cd0 con 0x5580d3483920 2024-09-13T23:05:53.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.853+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 55 ==== osd_op_reply(195 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.853+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.853+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:196 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9150 con 0x5580d3483920 2024-09-13T23:05:53.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.853+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 56 ==== osd_op_reply(196 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.853+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.853+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:197 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9150 con 0x5580d3483920 2024-09-13T23:05:53.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.854+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 57 ==== osd_op_reply(197 gc.9 [call] v34'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.854+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-13T23:05:53.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.854+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:198 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9150 con 0x7f62ec01ac20 2024-09-13T23:05:53.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.855+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 38 ==== osd_op_reply(198 gc.10 [call] v34'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.855+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:199 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9150 con 0x7f62ec01ac20 2024-09-13T23:05:53.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.855+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 39 ==== osd_op_reply(199 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.855+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.855+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:200 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62ec01ac20 2024-09-13T23:05:53.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.856+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 40 ==== osd_op_reply(200 gc.10 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.856+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:201 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62ec01ac20 2024-09-13T23:05:53.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.856+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 41 ==== osd_op_reply(201 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.856+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.856+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:202 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62ec01ac20 2024-09-13T23:05:53.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.856+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 42 ==== osd_op_reply(202 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.856+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.856+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:203 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62ec01ac20 2024-09-13T23:05:53.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.857+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 43 ==== osd_op_reply(203 gc.10 [call] v34'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.857+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-13T23:05:53.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.857+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:204 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62fc031040 2024-09-13T23:05:53.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.858+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 55 ==== osd_op_reply(204 gc.11 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.858+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:205 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62fc031040 2024-09-13T23:05:53.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.858+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 56 ==== osd_op_reply(205 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.858+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.858+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:206 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62fc031040 2024-09-13T23:05:53.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.859+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 57 ==== osd_op_reply(206 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.859+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:207 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62fc031040 2024-09-13T23:05:53.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.859+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 58 ==== osd_op_reply(207 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.859+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.859+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:208 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62fc031040 2024-09-13T23:05:53.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.859+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 59 ==== osd_op_reply(208 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.859+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.859+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:209 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62fc031040 2024-09-13T23:05:53.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.860+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 60 ==== osd_op_reply(209 gc.11 [call] v34'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.860+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-13T23:05:53.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.860+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:210 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62ec01ac20 2024-09-13T23:05:53.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.861+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 44 ==== osd_op_reply(210 gc.12 [call] v34'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.861+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:211 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62ec01ac20 2024-09-13T23:05:53.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.862+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 45 ==== osd_op_reply(211 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.862+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.862+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:212 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62ec01ac20 2024-09-13T23:05:53.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.862+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 46 ==== osd_op_reply(212 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.862+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:213 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62ec01ac20 2024-09-13T23:05:53.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.862+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 47 ==== osd_op_reply(213 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.862+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.862+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:214 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62ec01ac20 2024-09-13T23:05:53.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.862+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 48 ==== osd_op_reply(214 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.862+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.862+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:215 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62ec01ac20 2024-09-13T23:05:53.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.863+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 49 ==== osd_op_reply(215 gc.12 [call] v34'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.863+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-13T23:05:53.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.863+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:216 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62fc031040 2024-09-13T23:05:53.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.864+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 61 ==== osd_op_reply(216 gc.13 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.864+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:217 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62fc031040 2024-09-13T23:05:53.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.865+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 62 ==== osd_op_reply(217 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.865+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.865+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:218 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62fc031040 2024-09-13T23:05:53.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.865+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 63 ==== osd_op_reply(218 gc.13 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.865+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:219 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62fc031040 2024-09-13T23:05:53.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.865+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 64 ==== osd_op_reply(219 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.865+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.865+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:220 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62fc031040 2024-09-13T23:05:53.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.866+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 65 ==== osd_op_reply(220 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.866+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.866+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:221 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62fc031040 2024-09-13T23:05:53.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.867+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 66 ==== osd_op_reply(221 gc.13 [call] v34'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.867+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-13T23:05:53.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.867+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:222 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d347d6d0 2024-09-13T23:05:53.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.868+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 50 ==== osd_op_reply(222 gc.14 [call] v34'163 uv163 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.868+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:223 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d347d6d0 2024-09-13T23:05:53.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.868+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 51 ==== osd_op_reply(223 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.868+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.868+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:224 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d347d6d0 2024-09-13T23:05:53.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.868+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 52 ==== osd_op_reply(224 gc.14 [call out=24b] v0'0 uv163 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.868+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:225 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d347d6d0 2024-09-13T23:05:53.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.869+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 53 ==== osd_op_reply(225 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.869+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.869+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:226 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d347d6d0 2024-09-13T23:05:53.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.869+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 54 ==== osd_op_reply(226 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.869+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.869+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:227 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d347d6d0 2024-09-13T23:05:53.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.870+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 55 ==== osd_op_reply(227 gc.14 [call] v34'164 uv164 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.870+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-13T23:05:53.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.870+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:228 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.871+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 58 ==== osd_op_reply(228 gc.15 [call] v34'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.871+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:229 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.871+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 59 ==== osd_op_reply(229 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.871+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.871+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:230 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.871+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 60 ==== osd_op_reply(230 gc.15 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.871+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:231 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.872+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 61 ==== osd_op_reply(231 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.872+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.872+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:232 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.872+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 62 ==== osd_op_reply(232 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.872+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.872+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:233 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.873+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 63 ==== osd_op_reply(233 gc.15 [call] v34'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.873+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-13T23:05:53.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.873+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:234 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62ec01ac20 2024-09-13T23:05:53.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.874+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 50 ==== osd_op_reply(234 gc.16 [call] v34'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.874+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:235 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62ec01ac20 2024-09-13T23:05:53.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.874+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 51 ==== osd_op_reply(235 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.874+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.874+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:236 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c7bd0 con 0x7f62ec01ac20 2024-09-13T23:05:53.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.875+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 52 ==== osd_op_reply(236 gc.16 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.875+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:237 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62ec01ac20 2024-09-13T23:05:53.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.875+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 53 ==== osd_op_reply(237 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.875+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.875+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:238 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62ec01ac20 2024-09-13T23:05:53.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.875+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 54 ==== osd_op_reply(238 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.875+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.875+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:239 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62ec01ac20 2024-09-13T23:05:53.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.876+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 55 ==== osd_op_reply(239 gc.16 [call] v34'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.876+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-13T23:05:53.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.876+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:240 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.877+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 64 ==== osd_op_reply(240 gc.17 [call] v34'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.877+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:241 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.877+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 65 ==== osd_op_reply(241 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.877+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.877+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:242 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.877+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 66 ==== osd_op_reply(242 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.877+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:243 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.877+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 67 ==== osd_op_reply(243 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.877+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.877+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:244 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.878+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 68 ==== osd_op_reply(244 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.878+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.878+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:245 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.878+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 69 ==== osd_op_reply(245 gc.17 [call] v34'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.879+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-13T23:05:53.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.879+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:246 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d347d6d0 2024-09-13T23:05:53.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.880+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 56 ==== osd_op_reply(246 gc.18 [call] v34'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.880+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:247 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d347d6d0 2024-09-13T23:05:53.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.880+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 57 ==== osd_op_reply(247 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.880+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.880+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:248 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d347d6d0 2024-09-13T23:05:53.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.880+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 58 ==== osd_op_reply(248 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.880+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:249 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d347d6d0 2024-09-13T23:05:53.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.880+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 59 ==== osd_op_reply(249 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.880+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.880+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:250 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d347d6d0 2024-09-13T23:05:53.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.881+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 60 ==== osd_op_reply(250 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.881+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.881+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:251 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d347d6d0 2024-09-13T23:05:53.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.882+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 61 ==== osd_op_reply(251 gc.18 [call] v34'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.882+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-13T23:05:53.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.882+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:252 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d347d6d0 2024-09-13T23:05:53.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.883+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 62 ==== osd_op_reply(252 gc.19 [call] v34'165 uv165 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.883+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:253 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d347d6d0 2024-09-13T23:05:53.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.883+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 63 ==== osd_op_reply(253 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.883+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.883+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:254 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c7bd0 con 0x5580d347d6d0 2024-09-13T23:05:53.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.883+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 64 ==== osd_op_reply(254 gc.19 [call out=24b] v0'0 uv165 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.883+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:255 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d347d6d0 2024-09-13T23:05:53.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.883+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 65 ==== osd_op_reply(255 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.883+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.883+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:256 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d347d6d0 2024-09-13T23:05:53.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.884+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 66 ==== osd_op_reply(256 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.884+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.884+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:257 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d347d6d0 2024-09-13T23:05:53.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.885+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 67 ==== osd_op_reply(257 gc.19 [call] v34'166 uv166 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.885+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-13T23:05:53.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.885+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:258 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.886+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 70 ==== osd_op_reply(258 gc.20 [call] v34'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.886+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:259 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.886+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 71 ==== osd_op_reply(259 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.886+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.886+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:260 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.886+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 72 ==== osd_op_reply(260 gc.20 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.886+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:261 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.886+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 73 ==== osd_op_reply(261 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.886+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.886+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:262 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.887+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 74 ==== osd_op_reply(262 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.887+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.887+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:263 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.888+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 75 ==== osd_op_reply(263 gc.20 [call] v34'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.888+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-13T23:05:53.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.888+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:264 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62ec01ac20 2024-09-13T23:05:53.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.889+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 56 ==== osd_op_reply(264 gc.21 [call] v34'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.889+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:265 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62ec01ac20 2024-09-13T23:05:53.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.889+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 57 ==== osd_op_reply(265 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.889+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.889+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:266 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c7bd0 con 0x7f62ec01ac20 2024-09-13T23:05:53.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.889+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 58 ==== osd_op_reply(266 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.889+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:267 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62ec01ac20 2024-09-13T23:05:53.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.889+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 59 ==== osd_op_reply(267 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.889+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.889+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:268 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62ec01ac20 2024-09-13T23:05:53.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.890+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 60 ==== osd_op_reply(268 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.890+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.890+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:269 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x7f62ec01ac20 2024-09-13T23:05:53.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.891+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 61 ==== osd_op_reply(269 gc.21 [call] v34'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.891+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-13T23:05:53.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.891+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:270 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.892+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 76 ==== osd_op_reply(270 gc.22 [call] v34'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.892+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:271 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.892+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 77 ==== osd_op_reply(271 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.892+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.892+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:272 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.892+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 78 ==== osd_op_reply(272 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.892+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:273 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.892+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 79 ==== osd_op_reply(273 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.892+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.892+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:274 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.892+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 80 ==== osd_op_reply(274 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.893+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.893+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:275 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.893+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 81 ==== osd_op_reply(275 gc.22 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.893+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-13T23:05:53.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.893+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:276 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.894+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 82 ==== osd_op_reply(276 gc.23 [call] v34'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.894+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:277 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.895+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 83 ==== osd_op_reply(277 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.895+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.895+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:278 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.895+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 84 ==== osd_op_reply(278 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.895+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:279 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.895+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 85 ==== osd_op_reply(279 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.895+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.895+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:280 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.895+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 86 ==== osd_op_reply(280 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.895+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.895+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:281 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.896+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 87 ==== osd_op_reply(281 gc.23 [call] v34'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.896+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-13T23:05:53.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.896+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:282 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.897+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 88 ==== osd_op_reply(282 gc.24 [call] v34'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.897+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:283 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.897+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 89 ==== osd_op_reply(283 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.897+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.897+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:284 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.898+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 90 ==== osd_op_reply(284 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.898+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:285 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.898+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 91 ==== osd_op_reply(285 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.898+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.898+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:286 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.898+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 92 ==== osd_op_reply(286 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.898+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.898+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:287 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.899+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 93 ==== osd_op_reply(287 gc.24 [call] v34'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.899+0000 7f6304d24800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-13T23:05:53.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.899+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:288 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.900+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 94 ==== osd_op_reply(288 gc.25 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.900+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:289 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.900+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 95 ==== osd_op_reply(289 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.900+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.900+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:290 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.900+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 96 ==== osd_op_reply(290 gc.25 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.900+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:291 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.901+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 97 ==== osd_op_reply(291 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.901+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:05:53.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.901+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:292 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.901+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 98 ==== osd_op_reply(292 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.901+0000 7f6304d24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:05:53.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.901+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:293 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34c9100 con 0x5580d3483920 2024-09-13T23:05:53.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.902+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 99 ==== osd_op_reply(293 gc.25 [call] v34'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.903+0000 7f61b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:53.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.903+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94011788943040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d34793c0 con 0x5580d347d6d0 2024-09-13T23:05:53.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.903+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 68 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94011788943040] v34'167 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.904+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94011788918480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d348dec0 con 0x7f62ec01ac20 2024-09-13T23:05:53.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.904+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 62 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94011788918480] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.905+0000 7f6304d24800 20 remove_watcher() i=0 2024-09-13T23:05:53.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.905+0000 7f6304d24800 2 removed watcher, disabling cache 2024-09-13T23:05:53.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.905+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94011788922704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d348dec0 con 0x5580d347d6d0 2024-09-13T23:05:53.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.906+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 69 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94011788922704] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.906+0000 7f6304d24800 20 remove_watcher() i=1 2024-09-13T23:05:53.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.906+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94011788924272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d3488f50 con 0x5580d3483920 2024-09-13T23:05:53.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.907+0000 7f62fbfff640 1 -- 172.21.15.164:0/2414032891 <== osd.3 v2:172.21.15.164:6816/93809510 100 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94011788924272] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62ec032070 con 0x5580d3483920 2024-09-13T23:05:53.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.907+0000 7f6304d24800 20 remove_watcher() i=2 2024-09-13T23:05:53.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.907+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94011788930656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d348dec0 con 0x7f62ec01ac20 2024-09-13T23:05:53.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.908+0000 7f63012e1640 1 -- 172.21.15.164:0/2414032891 <== osd.2 v2:172.21.15.164:6808/3795914978 63 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94011788930656] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62fc040040 con 0x7f62ec01ac20 2024-09-13T23:05:53.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.908+0000 7f6304d24800 20 remove_watcher() i=3 2024-09-13T23:05:53.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.908+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94011788934208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d3489570 con 0x5580d347d6d0 2024-09-13T23:05:53.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.909+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.1 v2:172.21.15.164:6800/4060509701 70 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94011788934208] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x5580d347d6d0 2024-09-13T23:05:53.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.909+0000 7f6304d24800 20 remove_watcher() i=4 2024-09-13T23:05:53.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.909+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94011788937888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d348ae60 con 0x7f62fc031040 2024-09-13T23:05:53.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.910+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 67 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94011788937888] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.910+0000 7f6304d24800 20 remove_watcher() i=5 2024-09-13T23:05:53.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.910+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94011788938944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d348dec0 con 0x7f62fc031040 2024-09-13T23:05:53.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.911+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 68 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94011788938944] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.911+0000 7f6304d24800 20 remove_watcher() i=6 2024-09-13T23:05:53.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.911+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94011788941984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580d3489570 con 0x7f62fc031040 2024-09-13T23:05:53.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.912+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 <== osd.0 v2:172.21.15.17:6800/489863589 69 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94011788941984] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62f407f070 con 0x7f62fc031040 2024-09-13T23:05:53.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.912+0000 7f6304d24800 20 remove_watcher() i=7 2024-09-13T23:05:53.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.912+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f62fc031040 msgr2=0x7f62fc032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.912+0000 7f6304d24800 1 --2- 172.21.15.164:0/2414032891 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f62fc031040 0x7f62fc032940 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.912+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5580d347d6d0 msgr2=0x5580d347fb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.912+0000 7f6304d24800 1 --2- 172.21.15.164:0/2414032891 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5580d347d6d0 0x5580d347fb90 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.912+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f62ec01ac20 msgr2=0x7f62ec01c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.912+0000 7f6304d24800 1 --2- 172.21.15.164:0/2414032891 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f62ec01ac20 0x7f62ec01c420 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.912+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5580d3483920 msgr2=0x5580d3485d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.912+0000 7f6304d24800 1 --2- 172.21.15.164:0/2414032891 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5580d3483920 0x5580d3485d10 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.912+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f61cc036b40 msgr2=0x7f61cc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.912+0000 7f6304d24800 1 --2- 172.21.15.164:0/2414032891 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f61cc036b40 0x7f61cc039000 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x5580d32c0fc0 tx=0x7f62fc01f000 comp rx=0 tx=0).stop 2024-09-13T23:05:53.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.912+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d3443f30 msgr2=0x5580d3471f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.912+0000 7f6300ae0640 1 -- 172.21.15.164:0/2414032891 reap_dead start 2024-09-13T23:05:53.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.912+0000 7f6304d24800 1 --2- 172.21.15.164:0/2414032891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d3443f30 0x5580d3471f80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f62ec024fd0 tx=0x7f62ec04c370 comp rx=0 tx=0).stop 2024-09-13T23:05:53.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.912+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 shutdown_connections 2024-09-13T23:05:53.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.912+0000 7f6304d24800 1 --2- 172.21.15.164:0/2414032891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d3443f30 0x5580d3471f80 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.912+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 >> 172.21.15.164:0/2414032891 conn(0x5580d3464b90 msgr2=0x5580d3462c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:53.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.912+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 shutdown_connections 2024-09-13T23:05:53.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.912+0000 7f6304d24800 1 -- 172.21.15.164:0/2414032891 wait complete. 2024-09-13T23:05:53.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.913+0000 7f6304d24800 1 -- 172.21.15.164:0/4283315376 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f61d8036b40 msgr2=0x7f61d8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.913+0000 7f6304d24800 1 --2- 172.21.15.164:0/4283315376 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f61d8036b40 0x7f61d8039000 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x5580d344c190 tx=0x7f62fc005840 comp rx=0 tx=0).stop 2024-09-13T23:05:53.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.913+0000 7f6304d24800 1 -- 172.21.15.164:0/4283315376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d345bb20 msgr2=0x5580d345bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.913+0000 7f6304d24800 1 --2- 172.21.15.164:0/4283315376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d345bb20 0x5580d345bf40 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f62ec001ed0 tx=0x7f62ec00ea00 comp rx=0 tx=0).stop 2024-09-13T23:05:53.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.913+0000 7f6304d24800 1 -- 172.21.15.164:0/4283315376 shutdown_connections 2024-09-13T23:05:53.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.913+0000 7f6304d24800 1 --2- 172.21.15.164:0/4283315376 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f61d8036b40 0x7f61d8039000 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.913+0000 7f6304d24800 1 --2- 172.21.15.164:0/4283315376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d345bb20 0x5580d345bf40 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.913+0000 7f6304d24800 1 -- 172.21.15.164:0/4283315376 >> 172.21.15.164:0/4283315376 conn(0x5580d3450ab0 msgr2=0x5580d3453630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:53.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.913+0000 7f6304d24800 1 -- 172.21.15.164:0/4283315376 shutdown_connections 2024-09-13T23:05:53.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.913+0000 7f6304d24800 1 -- 172.21.15.164:0/4283315376 wait complete. 2024-09-13T23:05:53.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.913+0000 7f6304d24800 1 -- 172.21.15.164:0/2749079480 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5580d334ce80 msgr2=0x5580d344b0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.913+0000 7f6304d24800 1 --2- 172.21.15.164:0/2749079480 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5580d334ce80 0x5580d344b0a0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.913+0000 7f6304d24800 1 -- 172.21.15.164:0/2749079480 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f61e8036b40 msgr2=0x7f61e8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.913+0000 7f6304d24800 1 --2- 172.21.15.164:0/2749079480 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f61e8036b40 0x7f61e8039000 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f62ec000f60 tx=0x7f62ec001370 comp rx=0 tx=0).stop 2024-09-13T23:05:53.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.913+0000 7f6304d24800 1 -- 172.21.15.164:0/2749079480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d334c540 msgr2=0x5580d32c15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:53.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.913+0000 7f6304d24800 1 --2- 172.21.15.164:0/2749079480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d334c540 0x5580d32c15d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f62f4000c00 tx=0x7f62f4002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.913+0000 7f6304d24800 1 -- 172.21.15.164:0/2749079480 shutdown_connections 2024-09-13T23:05:53.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.913+0000 7f6304d24800 1 --2- 172.21.15.164:0/2749079480 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5580d334ce80 0x5580d344b0a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.913+0000 7f6304d24800 1 --2- 172.21.15.164:0/2749079480 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f61e8036b40 0x7f61e8039000 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.913+0000 7f6304d24800 1 --2- 172.21.15.164:0/2749079480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580d334c540 0x5580d32c15d0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:53.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.913+0000 7f6304d24800 1 -- 172.21.15.164:0/2749079480 >> 172.21.15.164:0/2749079480 conn(0x5580d3347dd0 msgr2=0x5580d34359b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:53.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.913+0000 7f6304d24800 1 -- 172.21.15.164:0/2749079480 shutdown_connections 2024-09-13T23:05:53.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:53.913+0000 7f6304d24800 1 -- 172.21.15.164:0/2749079480 wait complete. 2024-09-13T23:05:53.923 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-13T23:05:53.923 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-13T23:05:53.924 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-13T23:05:54.008 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:54.008 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:54.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.008+0000 7faf31f21800 1 Processor -- start 2024-09-13T23:05:54.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.008+0000 7faf31f21800 1 -- start start 2024-09-13T23:05:54.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.008+0000 7faf31f21800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55d06e210760 0x55d06e210b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.008+0000 7faf31f21800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d06e0cfb30 con 0x55d06e2110a0 2024-09-13T23:05:54.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.008+0000 7faf31f21800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55d06e0b1360 con 0x55d06e210760 2024-09-13T23:05:54.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.008+0000 7faf2dc4e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55d06e210760 0x55d06e210b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.008+0000 7faf2d44d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55d06e2110a0 0x55d06e215ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:53938/0 (socket says 172.21.15.164:53938) 2024-09-13T23:05:54.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.008+0000 7faf2d44d640 1 -- 172.21.15.164:0/2514123008 learned_addr learned my addr 172.21.15.164:0/2514123008 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:54.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.009+0000 7faf2cc4c640 1 -- 172.21.15.164:0/2514123008 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3702667390 0 0) 0x55d06e0cfb30 con 0x55d06e2110a0 2024-09-13T23:05:54.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.009+0000 7faf2cc4c640 1 -- 172.21.15.164:0/2514123008 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf1c001e10 con 0x55d06e2110a0 2024-09-13T23:05:54.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.009+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2514123008 >> v1:172.21.15.17:6789/0 conn(0x55d06e2110a0 legacy=0x55d06e215ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.009+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2514123008 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d06e0d7e00 con 0x55d06e210760 2024-09-13T23:05:54.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.011+0000 7faf2dc4e640 1 --2- 172.21.15.164:0/2514123008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e210760 0x55d06e210b60 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7faf28005fd0 tx=0x7faf28045b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55d47c1c8b21d5e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.011+0000 7faf2cc4c640 1 -- 172.21.15.164:0/2514123008 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf28055070 con 0x55d06e210760 2024-09-13T23:05:54.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.011+0000 7faf2cc4c640 1 -- 172.21.15.164:0/2514123008 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf28051540 con 0x55d06e210760 2024-09-13T23:05:54.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.011+0000 7faf2cc4c640 1 -- 172.21.15.164:0/2514123008 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf28051820 con 0x55d06e210760 2024-09-13T23:05:54.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.011+0000 7faf31f21800 1 -- 172.21.15.164:0/2514123008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e210760 msgr2=0x55d06e210b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.011+0000 7faf31f21800 1 --2- 172.21.15.164:0/2514123008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e210760 0x55d06e210b60 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7faf28005fd0 tx=0x7faf28045b30 comp rx=0 tx=0).stop 2024-09-13T23:05:54.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.011+0000 7faf31f21800 1 -- 172.21.15.164:0/2514123008 shutdown_connections 2024-09-13T23:05:54.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.011+0000 7faf31f21800 1 --2- 172.21.15.164:0/2514123008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e210760 0x55d06e210b60 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.011+0000 7faf31f21800 1 -- 172.21.15.164:0/2514123008 >> 172.21.15.164:0/2514123008 conn(0x55d06e20bff0 msgr2=0x55d06e20e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.011+0000 7faf31f21800 1 -- 172.21.15.164:0/2514123008 shutdown_connections 2024-09-13T23:05:54.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.011+0000 7faf31f21800 1 -- 172.21.15.164:0/2514123008 wait complete. 2024-09-13T23:05:54.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.025+0000 7faf31f21800 1 Processor -- start 2024-09-13T23:05:54.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.025+0000 7faf31f21800 1 -- start start 2024-09-13T23:05:54.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.025+0000 7faf31f21800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e210760 0x55d06e1866c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.025+0000 7faf31f21800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d06e15c330 con 0x55d06e210760 2024-09-13T23:05:54.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.026+0000 7faf2dc4e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e210760 0x55d06e1866c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.026+0000 7faf2dc4e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e210760 0x55d06e1866c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37800/0 (socket says 172.21.15.164:37800) 2024-09-13T23:05:54.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.026+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2499040189 learned_addr learned my addr 172.21.15.164:0/2499040189 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:54.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.026+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2499040189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d06e0a9bc0 con 0x55d06e210760 2024-09-13T23:05:54.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.026+0000 7faf2dc4e640 1 --2- 172.21.15.164:0/2499040189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e210760 0x55d06e1866c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7faf28005fd0 tx=0x7faf28051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fdd157cf7e7e187 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.026+0000 7fae1be07640 1 -- 172.21.15.164:0/2499040189 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf28055040 con 0x55d06e210760 2024-09-13T23:05:54.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.026+0000 7fae1be07640 1 -- 172.21.15.164:0/2499040189 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf28051a10 con 0x55d06e210760 2024-09-13T23:05:54.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.026+0000 7fae1be07640 1 -- 172.21.15.164:0/2499040189 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf28051cf0 con 0x55d06e210760 2024-09-13T23:05:54.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.027+0000 7faf31f21800 1 -- 172.21.15.164:0/2499040189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e210760 msgr2=0x55d06e1866c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.027+0000 7faf31f21800 1 --2- 172.21.15.164:0/2499040189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e210760 0x55d06e1866c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7faf28005fd0 tx=0x7faf28051000 comp rx=0 tx=0).stop 2024-09-13T23:05:54.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.027+0000 7faf31f21800 1 -- 172.21.15.164:0/2499040189 shutdown_connections 2024-09-13T23:05:54.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.027+0000 7faf31f21800 1 --2- 172.21.15.164:0/2499040189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e210760 0x55d06e1866c0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.027+0000 7faf31f21800 1 -- 172.21.15.164:0/2499040189 >> 172.21.15.164:0/2499040189 conn(0x55d06e20bff0 msgr2=0x55d06e2fb060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.027+0000 7faf31f21800 1 -- 172.21.15.164:0/2499040189 shutdown_connections 2024-09-13T23:05:54.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.027+0000 7faf31f21800 1 -- 172.21.15.164:0/2499040189 wait complete. 2024-09-13T23:05:54.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.027+0000 7faf31f21800 1 Processor -- start 2024-09-13T23:05:54.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.027+0000 7faf31f21800 1 -- start start 2024-09-13T23:05:54.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.028+0000 7faf31f21800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e2110a0 0x55d06e309350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.028+0000 7faf31f21800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d06e217640 con 0x55d06e2110a0 2024-09-13T23:05:54.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.028+0000 7faf2dc4e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e2110a0 0x55d06e309350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.028+0000 7faf2dc4e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e2110a0 0x55d06e309350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37814/0 (socket says 172.21.15.164:37814) 2024-09-13T23:05:54.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.028+0000 7faf2dc4e640 1 -- 172.21.15.164:0/1881245478 learned_addr learned my addr 172.21.15.164:0/1881245478 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:54.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.028+0000 7faf2dc4e640 1 -- 172.21.15.164:0/1881245478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d06e0bdfe0 con 0x55d06e2110a0 2024-09-13T23:05:54.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.028+0000 7faf2dc4e640 1 --2- 172.21.15.164:0/1881245478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e2110a0 0x55d06e309350 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7faf28005fd0 tx=0x7faf28003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.029+0000 7fae1a604640 1 -- 172.21.15.164:0/1881245478 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf28071020 con 0x55d06e2110a0 2024-09-13T23:05:54.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.029+0000 7fae1a604640 1 -- 172.21.15.164:0/1881245478 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf2805b870 con 0x55d06e2110a0 2024-09-13T23:05:54.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.029+0000 7faf31f21800 1 -- 172.21.15.164:0/1881245478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d06e309890 con 0x55d06e2110a0 2024-09-13T23:05:54.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.029+0000 7fae1a604640 1 -- 172.21.15.164:0/1881245478 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf28055040 con 0x55d06e2110a0 2024-09-13T23:05:54.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.029+0000 7faf31f21800 1 -- 172.21.15.164:0/1881245478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d06e309e10 con 0x55d06e2110a0 2024-09-13T23:05:54.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.029+0000 7fae1a604640 1 -- 172.21.15.164:0/1881245478 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7faf28074020 con 0x55d06e2110a0 2024-09-13T23:05:54.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.030+0000 7fae1a604640 1 --2- 172.21.15.164:0/1881245478 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fae14036b90 0x7fae14039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.030+0000 7fae1a604640 1 -- 172.21.15.164:0/1881245478 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7faf28061070 con 0x55d06e2110a0 2024-09-13T23:05:54.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.030+0000 7faf2d44d640 1 --2- 172.21.15.164:0/1881245478 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fae14036b90 0x7fae14039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.030+0000 7faf31f21800 1 --2- 172.21.15.164:0/1881245478 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d06e30e3b0 0x55d06e3107a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.030+0000 7faf31f21800 1 -- 172.21.15.164:0/1881245478 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e310dc0 con 0x55d06e30e3b0 2024-09-13T23:05:54.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.030+0000 7faf2e44f640 1 --2- 172.21.15.164:0/1881245478 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d06e30e3b0 0x55d06e3107a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.030+0000 7faf2d44d640 1 --2- 172.21.15.164:0/1881245478 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fae14036b90 0x7fae14039050 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7faf18000f60 tx=0x7faf180010a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.030+0000 7faf2e44f640 1 --2- 172.21.15.164:0/1881245478 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d06e30e3b0 0x55d06e3107a0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.030+0000 7faf2e44f640 1 -- 172.21.15.164:0/1881245478 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf200083e0 con 0x55d06e30e3b0 2024-09-13T23:05:54.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.031+0000 7faf31f21800 1 -- 172.21.15.164:0/1881245478 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e30d950 con 0x55d06e30e3b0 2024-09-13T23:05:54.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.031+0000 7faf2e44f640 1 -- 172.21.15.164:0/1881245478 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faf200083e0 con 0x55d06e30e3b0 2024-09-13T23:05:54.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.031+0000 7faf31f21800 1 -- 172.21.15.164:0/1881245478 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e312be0 con 0x55d06e30e3b0 2024-09-13T23:05:54.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.031+0000 7faf2e44f640 1 -- 172.21.15.164:0/1881245478 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faf200083e0 con 0x55d06e30e3b0 2024-09-13T23:05:54.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.031+0000 7faf31f21800 1 -- 172.21.15.164:0/1881245478 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e311d50 con 0x55d06e30e3b0 2024-09-13T23:05:54.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.031+0000 7faf2e44f640 1 -- 172.21.15.164:0/1881245478 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faf200083e0 con 0x55d06e30e3b0 2024-09-13T23:05:54.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.031+0000 7faf31f21800 1 -- 172.21.15.164:0/1881245478 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e312140 con 0x55d06e30e3b0 2024-09-13T23:05:54.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.032+0000 7faf2e44f640 1 -- 172.21.15.164:0/1881245478 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faf200083e0 con 0x55d06e30e3b0 2024-09-13T23:05:54.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.032+0000 7faf31f21800 1 Processor -- start 2024-09-13T23:05:54.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.032+0000 7faf31f21800 1 -- start start 2024-09-13T23:05:54.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.032+0000 7faf31f21800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e3211f0 0x55d06e321610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.032+0000 7faf31f21800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d06e0ab580 con 0x55d06e3211f0 2024-09-13T23:05:54.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.032+0000 7faf2d44d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e3211f0 0x55d06e321610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.033+0000 7faf2d44d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e3211f0 0x55d06e321610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37830/0 (socket says 172.21.15.164:37830) 2024-09-13T23:05:54.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.033+0000 7faf2d44d640 1 -- 172.21.15.164:0/4038393249 learned_addr learned my addr 172.21.15.164:0/4038393249 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:54.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.033+0000 7faf2d44d640 1 -- 172.21.15.164:0/4038393249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d06e321b50 con 0x55d06e3211f0 2024-09-13T23:05:54.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.033+0000 7faf2d44d640 1 --2- 172.21.15.164:0/4038393249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e3211f0 0x55d06e321610 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7faf1800bec0 tx=0x7faf1800d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.033+0000 7fae137fe640 1 -- 172.21.15.164:0/4038393249 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf1801b550 con 0x55d06e3211f0 2024-09-13T23:05:54.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.033+0000 7fae137fe640 1 -- 172.21.15.164:0/4038393249 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf1801b6f0 con 0x55d06e3211f0 2024-09-13T23:05:54.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.033+0000 7faf31f21800 1 -- 172.21.15.164:0/4038393249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d06e321de0 con 0x55d06e3211f0 2024-09-13T23:05:54.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.033+0000 7fae137fe640 1 -- 172.21.15.164:0/4038393249 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf1801ba10 con 0x55d06e3211f0 2024-09-13T23:05:54.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.033+0000 7faf31f21800 1 -- 172.21.15.164:0/4038393249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d06e324ac0 con 0x55d06e3211f0 2024-09-13T23:05:54.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.034+0000 7fae137fe640 1 -- 172.21.15.164:0/4038393249 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7faf18023020 con 0x55d06e3211f0 2024-09-13T23:05:54.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.034+0000 7fae137fe640 1 --2- 172.21.15.164:0/4038393249 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fae08036b90 0x7fae08039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.034+0000 7fae137fe640 1 -- 172.21.15.164:0/4038393249 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7faf18021020 con 0x55d06e3211f0 2024-09-13T23:05:54.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.034+0000 7faf2e44f640 1 --2- 172.21.15.164:0/4038393249 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fae08036b90 0x7fae08039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.034+0000 7faf31f21800 1 Processor -- start 2024-09-13T23:05:54.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.035+0000 7faf2e44f640 1 --2- 172.21.15.164:0/4038393249 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fae08036b90 0x7fae08039050 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x55d06e311870 tx=0x7faf20000f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.035+0000 7faf31f21800 1 -- start start 2024-09-13T23:05:54.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.035+0000 7faf31f21800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e32df00 0x55d06e32e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.035+0000 7faf31f21800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d06e184ca0 con 0x55d06e32df00 2024-09-13T23:05:54.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.035+0000 7faf2d44d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e32df00 0x55d06e32e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.035+0000 7faf2d44d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e32df00 0x55d06e32e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37838/0 (socket says 172.21.15.164:37838) 2024-09-13T23:05:54.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.035+0000 7faf2d44d640 1 -- 172.21.15.164:0/2133800281 learned_addr learned my addr 172.21.15.164:0/2133800281 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:54.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.035+0000 7faf2d44d640 1 -- 172.21.15.164:0/2133800281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d06e32e8d0 con 0x55d06e32df00 2024-09-13T23:05:54.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.035+0000 7faf2d44d640 1 --2- 172.21.15.164:0/2133800281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e32df00 0x55d06e32e300 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7faf1804d110 tx=0x7faf1800ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc9cc89a0008092 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.036+0000 7fae117fa640 1 -- 172.21.15.164:0/2133800281 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf180197d0 con 0x55d06e32df00 2024-09-13T23:05:54.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.036+0000 7fae117fa640 1 -- 172.21.15.164:0/2133800281 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf18046070 con 0x55d06e32df00 2024-09-13T23:05:54.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.036+0000 7fae117fa640 1 -- 172.21.15.164:0/2133800281 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf18025a60 con 0x55d06e32df00 2024-09-13T23:05:54.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.036+0000 7faf31f21800 1 -- 172.21.15.164:0/2133800281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e32df00 msgr2=0x55d06e32e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.036+0000 7faf31f21800 1 --2- 172.21.15.164:0/2133800281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e32df00 0x55d06e32e300 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7faf1804d110 tx=0x7faf1800ce40 comp rx=0 tx=0).stop 2024-09-13T23:05:54.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.036+0000 7faf31f21800 1 -- 172.21.15.164:0/2133800281 shutdown_connections 2024-09-13T23:05:54.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.036+0000 7faf31f21800 1 --2- 172.21.15.164:0/2133800281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e32df00 0x55d06e32e300 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.036+0000 7faf31f21800 1 -- 172.21.15.164:0/2133800281 >> 172.21.15.164:0/2133800281 conn(0x55d06e32a260 msgr2=0x55d06e328360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.036+0000 7faf31f21800 1 -- 172.21.15.164:0/2133800281 shutdown_connections 2024-09-13T23:05:54.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.036+0000 7faf31f21800 1 -- 172.21.15.164:0/2133800281 wait complete. 2024-09-13T23:05:54.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.036+0000 7faf31f21800 1 Processor -- start 2024-09-13T23:05:54.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.036+0000 7faf31f21800 1 -- start start 2024-09-13T23:05:54.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.037+0000 7faf31f21800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e32df00 0x55d06e3353a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.037+0000 7faf31f21800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d06e32ef40 con 0x55d06e32df00 2024-09-13T23:05:54.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.037+0000 7faf2d44d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e32df00 0x55d06e3353a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.037+0000 7faf2d44d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e32df00 0x55d06e3353a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37848/0 (socket says 172.21.15.164:37848) 2024-09-13T23:05:54.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.037+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 learned_addr learned my addr 172.21.15.164:0/2676586967 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:54.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.037+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d06e3358e0 con 0x55d06e32df00 2024-09-13T23:05:54.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.038+0000 7faf2d44d640 1 --2- 172.21.15.164:0/2676586967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e32df00 0x55d06e3353a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7faf1800cf90 tx=0x7faf1804d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.038+0000 7fadff7fe640 1 -- 172.21.15.164:0/2676586967 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf18040b80 con 0x55d06e32df00 2024-09-13T23:05:54.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.038+0000 7fadff7fe640 1 -- 172.21.15.164:0/2676586967 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf18040040 con 0x55d06e32df00 2024-09-13T23:05:54.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.038+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d06e335b70 con 0x55d06e32df00 2024-09-13T23:05:54.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.038+0000 7fadff7fe640 1 -- 172.21.15.164:0/2676586967 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf18040e50 con 0x55d06e32df00 2024-09-13T23:05:54.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.038+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d06e335b70 con 0x55d06e32df00 2024-09-13T23:05:54.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.038+0000 7fadff7fe640 1 -- 172.21.15.164:0/2676586967 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7faf1800c360 con 0x55d06e32df00 2024-09-13T23:05:54.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.039+0000 7fadff7fe640 1 --2- 172.21.15.164:0/2676586967 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fadf8036d30 0x7fadf80391f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.039+0000 7fadff7fe640 1 -- 172.21.15.164:0/2676586967 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7faf180412b0 con 0x55d06e32df00 2024-09-13T23:05:54.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.039+0000 7faf2e44f640 1 --2- 172.21.15.164:0/2676586967 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fadf8036d30 0x7fadf80391f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.039+0000 7faf31f21800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.039+0000 7faf31f21800 1 --2- 172.21.15.164:0/2676586967 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d06e340da0 0x55d06e343260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.039+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3439b0 con 0x55d06e340da0 2024-09-13T23:05:54.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.039+0000 7faf2dc4e640 1 --2- 172.21.15.164:0/2676586967 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d06e340da0 0x55d06e343260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.040+0000 7faf2dc4e640 1 --2- 172.21.15.164:0/2676586967 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d06e340da0 0x55d06e343260 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.040+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.040+0000 7faf2e44f640 1 --2- 172.21.15.164:0/2676586967 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fadf8036d30 0x7fadf80391f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7faf2000f010 tx=0x7faf2000c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.040+0000 7faf31f21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.040+0000 7faf31f21800 20 realm 2024-09-13T23:05:54.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.040+0000 7faf31f21800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.040+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e343dc0 con 0x55d06e340da0 2024-09-13T23:05:54.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.040+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.040+0000 7faf31f21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.040+0000 7faf31f21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:54.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.040+0000 7faf31f21800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.040+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e344690 con 0x55d06e340da0 2024-09-13T23:05:54.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.040+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.040+0000 7faf31f21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.040+0000 7faf31f21800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.040+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e344a30 con 0x55d06e340da0 2024-09-13T23:05:54.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.040+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.040+0000 7faf31f21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:54.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.040+0000 7faf31f21800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.041+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e344e90 con 0x55d06e340da0 2024-09-13T23:05:54.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.041+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.041+0000 7faf31f21800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:54.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.041+0000 7faf31f21800 20 searching for the correct realm 2024-09-13T23:05:54.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.041+0000 7faf31f21800 1 --2- 172.21.15.164:0/2676586967 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55d06e346e80 0x55d06e3492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.041+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x55d06e346e80 2024-09-13T23:05:54.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.041+0000 7faf2d44d640 1 --2- 172.21.15.164:0/2676586967 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55d06e346e80 0x55d06e3492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.041+0000 7faf2d44d640 1 --2- 172.21.15.164:0/2676586967 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55d06e346e80 0x55d06e3492d0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.041+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.041+0000 7faf2d44d640 1 --2- 172.21.15.164:0/2676586967 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7faf1800c650 0x7faf1804d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.041+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x7faf1800c650 2024-09-13T23:05:54.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.042+0000 7faf2e44f640 1 --2- 172.21.15.164:0/2676586967 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7faf1800c650 0x7faf1804d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.042+0000 7faf2e44f640 1 --2- 172.21.15.164:0/2676586967 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7faf1800c650 0x7faf1804d830 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.042+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.042+0000 7faf2e44f640 1 --2- 172.21.15.164:0/2676586967 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7faf20019040 0x7faf20019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.042+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x7faf20019040 2024-09-13T23:05:54.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.042+0000 7faf2dc4e640 1 --2- 172.21.15.164:0/2676586967 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7faf20019040 0x7faf20019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.043+0000 7faf2dc4e640 1 --2- 172.21.15.164:0/2676586967 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7faf20019040 0x7faf20019930 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.043+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.043+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x55d06e340da0 2024-09-13T23:05:54.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.043+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.043+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x55d06e340da0 2024-09-13T23:05:54.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.043+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.043+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x7faf20019040 2024-09-13T23:05:54.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.044+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.044+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x7faf20019040 2024-09-13T23:05:54.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.044+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.044+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x7faf1800c650 2024-09-13T23:05:54.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.044+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.044+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x55d06e346e80 2024-09-13T23:05:54.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.044+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.044+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x55d06e340da0 2024-09-13T23:05:54.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.045+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.045+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x7faf20019040 2024-09-13T23:05:54.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.045+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.045+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x55d06e340da0 2024-09-13T23:05:54.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.045+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.045+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x7faf1800c650 2024-09-13T23:05:54.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.046+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.046+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x55d06e346e80 2024-09-13T23:05:54.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.046+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.046+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x55d06e346e80 2024-09-13T23:05:54.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.046+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.046+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x7faf20019040 2024-09-13T23:05:54.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.047+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.047+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x55d06e346e80 2024-09-13T23:05:54.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.047+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.047+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x55d06e346e80 2024-09-13T23:05:54.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.047+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.047+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x55d06e340da0 2024-09-13T23:05:54.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.047+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.047+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x55d06e340da0 2024-09-13T23:05:54.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.047+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.048+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x7faf20019040 2024-09-13T23:05:54.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.048+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.048+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x55d06e346e80 2024-09-13T23:05:54.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.048+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.048+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x7faf1800c650 2024-09-13T23:05:54.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.048+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.048+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x55d06e340da0 2024-09-13T23:05:54.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.049+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.049+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x7faf20019040 2024-09-13T23:05:54.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.049+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.049+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x55d06e346e80 2024-09-13T23:05:54.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.049+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.049+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x7faf20019040 2024-09-13T23:05:54.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.050+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.050+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x7faf1800c650 2024-09-13T23:05:54.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.050+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.050+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x55d06e346e80 2024-09-13T23:05:54.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.050+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.050+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x7faf1800c650 2024-09-13T23:05:54.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.050+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.050+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x55d06e340da0 2024-09-13T23:05:54.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.051+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.051+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3499a0 con 0x7faf1800c650 2024-09-13T23:05:54.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.051+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.051+0000 7faf31f21800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:54.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.051+0000 7faf31f21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:54.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.051+0000 7faf31f21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:54.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.051+0000 7faf31f21800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:54.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.051+0000 7faf31f21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:54.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.051+0000 7faf31f21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:54.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.051+0000 7faf31f21800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.051+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3458d0 con 0x55d06e340da0 2024-09-13T23:05:54.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.051+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.051+0000 7faf31f21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.051+0000 7faf31f21800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.051+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e346170 con 0x55d06e340da0 2024-09-13T23:05:54.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.051+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.051+0000 7faf31f21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:54.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.051+0000 7faf31f21800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.051+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e345510 con 0x55d06e340da0 2024-09-13T23:05:54.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.052+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.052+0000 7faf31f21800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:54.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.052+0000 7faf31f21800 20 zone default found 2024-09-13T23:05:54.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.052+0000 7faf31f21800 4 Realm: () 2024-09-13T23:05:54.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.052+0000 7faf31f21800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:54.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.052+0000 7faf31f21800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:54.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.052+0000 7faf31f21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:54.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.052+0000 7faf31f21800 20 zonegroup default 2024-09-13T23:05:54.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.052+0000 7faf31f21800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.052+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e346170 con 0x7faf20019040 2024-09-13T23:05:54.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.052+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.052+0000 7faf31f21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.052+0000 7faf31f21800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.052+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e34b800 con 0x55d06e346e80 2024-09-13T23:05:54.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.052+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.052+0000 7faf31f21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.052+0000 7faf31f21800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.052+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e34bba0 con 0x55d06e346e80 2024-09-13T23:05:54.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.053+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.053+0000 7faf31f21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.053+0000 7faf31f21800 20 started sync module instance, tier type = 2024-09-13T23:05:54.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.053+0000 7faf31f21800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:54.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.053+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e34aca0 con 0x7faf1800c650 2024-09-13T23:05:54.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.054+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.054+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94353690505632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e34aca0 con 0x7faf1800c650 2024-09-13T23:05:54.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.054+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e34c630 con 0x55d06e340da0 2024-09-13T23:05:54.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.055+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94353690505632] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.055+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.055+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94353690509600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e34aca0 con 0x55d06e340da0 2024-09-13T23:05:54.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.055+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e34d0f0 con 0x55d06e346e80 2024-09-13T23:05:54.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.056+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94353690509600] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.056+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.056+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94353690503152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e34ac10 con 0x55d06e346e80 2024-09-13T23:05:54.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.056+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e34dfb0 con 0x7faf1800c650 2024-09-13T23:05:54.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.057+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94353690503152] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.058+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.058+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94353690516224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e34e3d0 con 0x7faf1800c650 2024-09-13T23:05:54.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.058+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e34ed90 con 0x55d06e340da0 2024-09-13T23:05:54.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.059+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.059+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94353690519776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e34ed00 con 0x55d06e340da0 2024-09-13T23:05:54.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.059+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e34fd40 con 0x7faf20019040 2024-09-13T23:05:54.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.059+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94353690516224] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.060+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94353690519776] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.060+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.060+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94353690517280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e34fd40 con 0x7faf20019040 2024-09-13T23:05:54.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.060+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3505e0 con 0x7faf20019040 2024-09-13T23:05:54.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.061+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94353690517280] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.061+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.061+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94353690523680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e34f2a0 con 0x7faf20019040 2024-09-13T23:05:54.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.061+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e350c00 con 0x7faf20019040 2024-09-13T23:05:54.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.062+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(58 notify.7 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.062+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94353690523680] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.062+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94353690527568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e351020 con 0x7faf20019040 2024-09-13T23:05:54.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.062+0000 7faf31f21800 20 add_watcher() i=0 2024-09-13T23:05:54.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.062+0000 7faf31f21800 20 add_watcher() i=1 2024-09-13T23:05:54.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.062+0000 7faf31f21800 20 add_watcher() i=2 2024-09-13T23:05:54.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.062+0000 7faf31f21800 20 add_watcher() i=3 2024-09-13T23:05:54.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.062+0000 7faf31f21800 20 add_watcher() i=4 2024-09-13T23:05:54.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.062+0000 7faf31f21800 20 add_watcher() i=5 2024-09-13T23:05:54.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.062+0000 7faf31f21800 20 add_watcher() i=6 2024-09-13T23:05:54.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.063+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94353690527568] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.063+0000 7faf31f21800 20 add_watcher() i=7 2024-09-13T23:05:54.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.063+0000 7faf31f21800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:54.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.063+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e354050 con 0x55d06e340da0 2024-09-13T23:05:54.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.063+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.063+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94353690528624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e3514e0 con 0x55d06e340da0 2024-09-13T23:05:54.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.064+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94353690528624] v34'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.064+0000 7faddf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:54.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.064+0000 7faf31f21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:54.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.064+0000 7faf31f21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:54.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.064+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35c6d0 con 0x55d06e340da0 2024-09-13T23:05:54.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.066+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.066+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35cd40 con 0x7faf20019040 2024-09-13T23:05:54.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.067+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.067+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35cd40 con 0x55d06e346e80 2024-09-13T23:05:54.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.068+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.068+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35d0e0 con 0x55d06e340da0 2024-09-13T23:05:54.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.069+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'169 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.069+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35d0e0 con 0x7faf1800c650 2024-09-13T23:05:54.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.070+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'56 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.070+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35d650 con 0x55d06e346e80 2024-09-13T23:05:54.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.071+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'37 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.071+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35da90 con 0x55d06e340da0 2024-09-13T23:05:54.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.072+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.072+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35da90 con 0x7faf20019040 2024-09-13T23:05:54.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.073+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'39 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.073+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35da90 con 0x7faf1800c650 2024-09-13T23:05:54.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.074+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.074+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35e000 con 0x55d06e346e80 2024-09-13T23:05:54.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.075+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.075+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35e000 con 0x7faf1800c650 2024-09-13T23:05:54.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.076+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'57 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.076+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35e570 con 0x7faf20019040 2024-09-13T23:05:54.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.077+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.077+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35e570 con 0x7faf1800c650 2024-09-13T23:05:54.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.078+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.078+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35e850 con 0x7faf20019040 2024-09-13T23:05:54.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.079+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'43 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.079+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35e850 con 0x55d06e340da0 2024-09-13T23:05:54.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.080+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'170 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.080+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35e850 con 0x55d06e346e80 2024-09-13T23:05:54.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.081+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'50 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.081+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35e850 con 0x7faf1800c650 2024-09-13T23:05:54.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.082+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'58 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.082+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35e8e0 con 0x55d06e346e80 2024-09-13T23:05:54.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.083+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.083+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35e8e0 con 0x55d06e340da0 2024-09-13T23:05:54.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.084+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.084+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35e8e0 con 0x55d06e340da0 2024-09-13T23:05:54.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.085+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'171 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.085+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35e8e0 con 0x55d06e346e80 2024-09-13T23:05:54.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.086+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'51 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.086+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35e8e0 con 0x7faf1800c650 2024-09-13T23:05:54.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.087+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.087+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35ece0 con 0x55d06e346e80 2024-09-13T23:05:54.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.088+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.088+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35ece0 con 0x55d06e346e80 2024-09-13T23:05:54.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.088+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.089+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35ece0 con 0x55d06e346e80 2024-09-13T23:05:54.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.090+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.090+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35ece0 con 0x55d06e346e80 2024-09-13T23:05:54.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.090+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'38 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.090+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35ece0 con 0x7faf20019040 2024-09-13T23:05:54.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.092+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.092+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35ece0 con 0x55d06e346e80 2024-09-13T23:05:54.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.093+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.093+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35ece0 con 0x7faf20019040 2024-09-13T23:05:54.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.094+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'40 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.094+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35ece0 con 0x55d06e346e80 2024-09-13T23:05:54.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.095+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'52 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.095+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35ece0 con 0x7faf20019040 2024-09-13T23:05:54.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.096+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'44 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.096+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35ece0 con 0x7faf1800c650 2024-09-13T23:05:54.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.097+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.097+0000 7fadde7fc640 20 reqs_thread_entry: start 2024-09-13T23:05:54.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.098+0000 7faf31f21800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:54.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.098+0000 7faf31f21800 20 Filter name: none 2024-09-13T23:05:54.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.098+0000 7fad4ffff640 20 reqs_thread_entry: start 2024-09-13T23:05:54.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.098+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e340da0 2024-09-13T23:05:54.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.098+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.098+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x55d06e340da0 2024-09-13T23:05:54.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.098+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.098+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e340da0 2024-09-13T23:05:54.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.099+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.099+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x7faf20019040 2024-09-13T23:05:54.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.099+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.099+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x7faf20019040 2024-09-13T23:05:54.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.100+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.100+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x7faf20019040 2024-09-13T23:05:54.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.100+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.100+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e346e80 2024-09-13T23:05:54.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.100+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.100+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x55d06e346e80 2024-09-13T23:05:54.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.100+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.100+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e346e80 2024-09-13T23:05:54.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.101+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.101+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e340da0 2024-09-13T23:05:54.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.101+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 32 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.101+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x55d06e340da0 2024-09-13T23:05:54.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.101+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 33 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv162 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.101+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e340da0 2024-09-13T23:05:54.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.101+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 34 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.101+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x7faf1800c650 2024-09-13T23:05:54.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.102+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 19 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.102+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x7faf1800c650 2024-09-13T23:05:54.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.102+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 20 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.102+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x7faf1800c650 2024-09-13T23:05:54.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.102+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 21 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.102+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e346e80 2024-09-13T23:05:54.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.102+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.102+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x55d06e346e80 2024-09-13T23:05:54.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.103+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.103+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e346e80 2024-09-13T23:05:54.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.103+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.103+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e340da0 2024-09-13T23:05:54.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.103+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 35 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.103+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x55d06e340da0 2024-09-13T23:05:54.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.103+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 36 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.103+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e340da0 2024-09-13T23:05:54.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.104+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 37 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.104+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x7faf20019040 2024-09-13T23:05:54.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.104+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.104+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x7faf20019040 2024-09-13T23:05:54.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.105+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 27 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.105+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x7faf20019040 2024-09-13T23:05:54.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.105+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 28 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.105+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x7faf1800c650 2024-09-13T23:05:54.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.105+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 22 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.105+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x7faf1800c650 2024-09-13T23:05:54.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.105+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 23 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.105+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x7faf1800c650 2024-09-13T23:05:54.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.106+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 24 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.106+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e346e80 2024-09-13T23:05:54.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.106+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.106+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x55d06e346e80 2024-09-13T23:05:54.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.106+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.106+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e346e80 2024-09-13T23:05:54.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.106+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.106+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x7faf1800c650 2024-09-13T23:05:54.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.107+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 25 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.107+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x7faf1800c650 2024-09-13T23:05:54.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.107+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 26 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.107+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x7faf1800c650 2024-09-13T23:05:54.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.107+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 27 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.107+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x7faf20019040 2024-09-13T23:05:54.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.108+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 29 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.108+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x7faf20019040 2024-09-13T23:05:54.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.108+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 30 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.108+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x7faf20019040 2024-09-13T23:05:54.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.108+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 31 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.108+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x7faf1800c650 2024-09-13T23:05:54.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.108+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 28 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.108+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x7faf1800c650 2024-09-13T23:05:54.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.109+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 29 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.109+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x7faf1800c650 2024-09-13T23:05:54.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.109+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 30 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.109+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x7faf20019040 2024-09-13T23:05:54.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.110+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.110+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x7faf20019040 2024-09-13T23:05:54.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.110+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.110+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x7faf20019040 2024-09-13T23:05:54.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.110+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.110+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e340da0 2024-09-13T23:05:54.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.111+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 38 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.111+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x55d06e340da0 2024-09-13T23:05:54.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.111+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 39 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv164 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.111+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e340da0 2024-09-13T23:05:54.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.111+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 40 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.111+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e346e80 2024-09-13T23:05:54.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.112+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.112+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x55d06e346e80 2024-09-13T23:05:54.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.112+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.112+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e346e80 2024-09-13T23:05:54.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.112+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.112+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x7faf1800c650 2024-09-13T23:05:54.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.112+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 31 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.112+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x7faf1800c650 2024-09-13T23:05:54.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.113+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 32 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.113+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x7faf1800c650 2024-09-13T23:05:54.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.113+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 33 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.113+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e346e80 2024-09-13T23:05:54.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.113+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.113+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x55d06e346e80 2024-09-13T23:05:54.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.114+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.114+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e346e80 2024-09-13T23:05:54.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.114+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.114+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e340da0 2024-09-13T23:05:54.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.114+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 41 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.114+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x55d06e340da0 2024-09-13T23:05:54.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.114+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 42 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.114+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e340da0 2024-09-13T23:05:54.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.115+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 43 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.115+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e340da0 2024-09-13T23:05:54.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.115+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 44 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.115+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x55d06e340da0 2024-09-13T23:05:54.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.115+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 45 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv166 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.115+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e340da0 2024-09-13T23:05:54.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.115+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 46 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.115+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e346e80 2024-09-13T23:05:54.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.116+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.116+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x55d06e346e80 2024-09-13T23:05:54.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.116+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.116+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e346e80 2024-09-13T23:05:54.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.116+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.116+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x7faf1800c650 2024-09-13T23:05:54.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.116+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 34 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.116+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x7faf1800c650 2024-09-13T23:05:54.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.117+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 35 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.117+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x7faf1800c650 2024-09-13T23:05:54.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.117+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 36 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.117+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e346e80 2024-09-13T23:05:54.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.117+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.117+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x55d06e346e80 2024-09-13T23:05:54.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.117+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.117+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e346e80 2024-09-13T23:05:54.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.118+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.118+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e346e80 2024-09-13T23:05:54.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.118+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.118+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x55d06e346e80 2024-09-13T23:05:54.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.118+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.118+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e346e80 2024-09-13T23:05:54.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.119+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.119+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e346e80 2024-09-13T23:05:54.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.119+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.119+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x55d06e346e80 2024-09-13T23:05:54.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.119+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.119+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e346e80 2024-09-13T23:05:54.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.119+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.119+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e346e80 2024-09-13T23:05:54.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.120+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.120+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x55d06e346e80 2024-09-13T23:05:54.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.120+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.120+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e346e80 2024-09-13T23:05:54.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.120+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.120+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x7faf20019040 2024-09-13T23:05:54.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.121+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 35 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.121+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x7faf20019040 2024-09-13T23:05:54.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.121+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 36 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.121+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x7faf20019040 2024-09-13T23:05:54.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.121+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 37 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.121+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e346e80 2024-09-13T23:05:54.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.121+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.121+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x55d06e346e80 2024-09-13T23:05:54.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.122+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.122+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e346e80 2024-09-13T23:05:54.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.122+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.122+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x7faf20019040 2024-09-13T23:05:54.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.122+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 38 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.122+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x7faf20019040 2024-09-13T23:05:54.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.123+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 39 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.123+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x7faf20019040 2024-09-13T23:05:54.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.123+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 40 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.123+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e346e80 2024-09-13T23:05:54.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.123+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.123+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x55d06e346e80 2024-09-13T23:05:54.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.124+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.124+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x55d06e346e80 2024-09-13T23:05:54.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.124+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.124+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x7faf20019040 2024-09-13T23:05:54.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.124+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 41 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.124+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x7faf20019040 2024-09-13T23:05:54.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.125+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 42 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.125+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x7faf20019040 2024-09-13T23:05:54.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.125+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 43 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.125+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x7faf1800c650 2024-09-13T23:05:54.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.125+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 37 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.125+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e389100 con 0x7faf1800c650 2024-09-13T23:05:54.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.126+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 38 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.126+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d06e38a110 con 0x7faf1800c650 2024-09-13T23:05:54.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.126+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 39 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.127+0000 7faddf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:54.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.127+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94353690528624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e35b910 con 0x55d06e340da0 2024-09-13T23:05:54.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.128+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94353690528624] v34'172 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.128+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94353690505632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e350b70 con 0x7faf1800c650 2024-09-13T23:05:54.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.129+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 40 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94353690505632] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.129+0000 7faf31f21800 20 remove_watcher() i=0 2024-09-13T23:05:54.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.129+0000 7faf31f21800 2 removed watcher, disabling cache 2024-09-13T23:05:54.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.129+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94353690509600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e34b1a0 con 0x55d06e340da0 2024-09-13T23:05:54.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.130+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94353690509600] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.130+0000 7faf31f21800 20 remove_watcher() i=1 2024-09-13T23:05:54.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.130+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94353690503152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e34b1a0 con 0x55d06e346e80 2024-09-13T23:05:54.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.131+0000 7faf2d44d640 1 -- 172.21.15.164:0/2676586967 <== osd.3 v2:172.21.15.164:6816/93809510 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94353690503152] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf18009050 con 0x55d06e346e80 2024-09-13T23:05:54.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.131+0000 7faf31f21800 20 remove_watcher() i=2 2024-09-13T23:05:54.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.131+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94353690516224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e34b1a0 con 0x7faf1800c650 2024-09-13T23:05:54.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.132+0000 7faf2e44f640 1 -- 172.21.15.164:0/2676586967 <== osd.2 v2:172.21.15.164:6808/3795914978 41 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94353690516224] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf2002f040 con 0x7faf1800c650 2024-09-13T23:05:54.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.132+0000 7faf31f21800 20 remove_watcher() i=3 2024-09-13T23:05:54.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.132+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94353690519776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e34db00 con 0x55d06e340da0 2024-09-13T23:05:54.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.133+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.1 v2:172.21.15.164:6800/4060509701 49 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94353690519776] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf28057030 con 0x55d06e340da0 2024-09-13T23:05:54.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.133+0000 7faf31f21800 20 remove_watcher() i=4 2024-09-13T23:05:54.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.133+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94353690517280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e34e8e0 con 0x7faf20019040 2024-09-13T23:05:54.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.134+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 44 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94353690517280] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.134+0000 7faf31f21800 20 remove_watcher() i=5 2024-09-13T23:05:54.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.134+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94353690523680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e34e8e0 con 0x7faf20019040 2024-09-13T23:05:54.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.135+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 45 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94353690523680] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.135+0000 7faf31f21800 20 remove_watcher() i=6 2024-09-13T23:05:54.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.135+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94353690527568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d06e34f820 con 0x7faf20019040 2024-09-13T23:05:54.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.136+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 <== osd.0 v2:172.21.15.17:6800/489863589 46 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94353690527568] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf28057030 con 0x7faf20019040 2024-09-13T23:05:54.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.136+0000 7faf31f21800 20 remove_watcher() i=7 2024-09-13T23:05:54.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.136+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7faf20019040 msgr2=0x7faf20019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.136+0000 7faf31f21800 1 --2- 172.21.15.164:0/2676586967 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7faf20019040 0x7faf20019930 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.136+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d06e340da0 msgr2=0x55d06e343260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.136+0000 7faf31f21800 1 --2- 172.21.15.164:0/2676586967 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d06e340da0 0x55d06e343260 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.136+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7faf1800c650 msgr2=0x7faf1804d830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.136+0000 7faf31f21800 1 --2- 172.21.15.164:0/2676586967 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7faf1800c650 0x7faf1804d830 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.136+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55d06e346e80 msgr2=0x55d06e3492d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.136+0000 7faf31f21800 1 --2- 172.21.15.164:0/2676586967 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55d06e346e80 0x55d06e3492d0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.136+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fadf8036d30 msgr2=0x7fadf80391f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.136+0000 7faf31f21800 1 --2- 172.21.15.164:0/2676586967 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fadf8036d30 0x7fadf80391f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7faf2000f010 tx=0x7faf2000c040 comp rx=0 tx=0).stop 2024-09-13T23:05:54.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.136+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e32df00 msgr2=0x55d06e3353a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.136+0000 7faf31f21800 1 --2- 172.21.15.164:0/2676586967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e32df00 0x55d06e3353a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7faf1800cf90 tx=0x7faf1804d070 comp rx=0 tx=0).stop 2024-09-13T23:05:54.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.136+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 reap_dead start 2024-09-13T23:05:54.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.136+0000 7faf2dc4e640 1 -- 172.21.15.164:0/2676586967 reap_dead start 2024-09-13T23:05:54.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.136+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 shutdown_connections 2024-09-13T23:05:54.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.136+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 >> 172.21.15.164:0/2676586967 conn(0x55d06e32a260 msgr2=0x55d06e328330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.136+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 shutdown_connections 2024-09-13T23:05:54.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.136+0000 7faf31f21800 1 -- 172.21.15.164:0/2676586967 wait complete. 2024-09-13T23:05:54.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.137+0000 7faf31f21800 1 -- 172.21.15.164:0/4038393249 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fae08036b90 msgr2=0x7fae08039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.137+0000 7faf31f21800 1 --2- 172.21.15.164:0/4038393249 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fae08036b90 0x7fae08039050 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x55d06e311870 tx=0x7faf20000f90 comp rx=0 tx=0).stop 2024-09-13T23:05:54.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.137+0000 7faf31f21800 1 -- 172.21.15.164:0/4038393249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e3211f0 msgr2=0x55d06e321610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.137+0000 7faf31f21800 1 --2- 172.21.15.164:0/4038393249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e3211f0 0x55d06e321610 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7faf1800bec0 tx=0x7faf1800d7a0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.137+0000 7faf31f21800 1 -- 172.21.15.164:0/4038393249 shutdown_connections 2024-09-13T23:05:54.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.137+0000 7faf31f21800 1 --2- 172.21.15.164:0/4038393249 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fae08036b90 0x7fae08039050 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.137+0000 7faf31f21800 1 --2- 172.21.15.164:0/4038393249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e3211f0 0x55d06e321610 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.137+0000 7faf31f21800 1 -- 172.21.15.164:0/4038393249 >> 172.21.15.164:0/4038393249 conn(0x55d06e316180 msgr2=0x55d06e318d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.137+0000 7faf31f21800 1 -- 172.21.15.164:0/4038393249 shutdown_connections 2024-09-13T23:05:54.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.137+0000 7faf31f21800 1 -- 172.21.15.164:0/4038393249 wait complete. 2024-09-13T23:05:54.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.137+0000 7faf31f21800 1 -- 172.21.15.164:0/1881245478 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d06e30e3b0 msgr2=0x55d06e3107a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.137+0000 7faf31f21800 1 --2- 172.21.15.164:0/1881245478 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d06e30e3b0 0x55d06e3107a0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.137+0000 7faf31f21800 1 -- 172.21.15.164:0/1881245478 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fae14036b90 msgr2=0x7fae14039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.137+0000 7faf31f21800 1 --2- 172.21.15.164:0/1881245478 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fae14036b90 0x7fae14039050 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7faf18000f60 tx=0x7faf180010a0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.137+0000 7faf31f21800 1 -- 172.21.15.164:0/1881245478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e2110a0 msgr2=0x55d06e309350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.137+0000 7faf31f21800 1 --2- 172.21.15.164:0/1881245478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e2110a0 0x55d06e309350 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7faf28005fd0 tx=0x7faf28003330 comp rx=0 tx=0).stop 2024-09-13T23:05:54.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.137+0000 7faf31f21800 1 -- 172.21.15.164:0/1881245478 shutdown_connections 2024-09-13T23:05:54.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.137+0000 7faf31f21800 1 --2- 172.21.15.164:0/1881245478 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d06e30e3b0 0x55d06e3107a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.137+0000 7faf31f21800 1 --2- 172.21.15.164:0/1881245478 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fae14036b90 0x7fae14039050 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.137+0000 7faf31f21800 1 --2- 172.21.15.164:0/1881245478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d06e2110a0 0x55d06e309350 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.137+0000 7faf31f21800 1 -- 172.21.15.164:0/1881245478 >> 172.21.15.164:0/1881245478 conn(0x55d06e20bff0 msgr2=0x55d06e2fabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.138+0000 7faf31f21800 1 -- 172.21.15.164:0/1881245478 shutdown_connections 2024-09-13T23:05:54.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.138+0000 7faf31f21800 1 -- 172.21.15.164:0/1881245478 wait complete. 2024-09-13T23:05:54.152 INFO:teuthology.orchestra.run.smithi164.stdout:[] 2024-09-13T23:05:54.152 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T23:05:54.152 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-13T23:05:54.152 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-13T23:05:54.153 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-13T23:05:54.196 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:54.197 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:54.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.196+0000 7f5d7ba0e800 1 Processor -- start 2024-09-13T23:05:54.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.196+0000 7f5d7ba0e800 1 -- start start 2024-09-13T23:05:54.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.196+0000 7f5d7ba0e800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55f9db34e4a0 0x55f9db3e26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.196+0000 7f5d7ba0e800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f9db298b30 con 0x55f9db34f5b0 2024-09-13T23:05:54.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.196+0000 7f5d7ba0e800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55f9db27a360 con 0x55f9db34e4a0 2024-09-13T23:05:54.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.196+0000 7f5d6ffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55f9db34e4a0 0x55f9db3e26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.196+0000 7f5d7711a640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55f9db34f5b0 0x55f9db34dd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:53948/0 (socket says 172.21.15.164:53948) 2024-09-13T23:05:54.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.196+0000 7f5d7711a640 1 -- 172.21.15.164:0/4164177559 learned_addr learned my addr 172.21.15.164:0/4164177559 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:54.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.197+0000 7f5d6ffff640 1 -- 172.21.15.164:0/4164177559 >> v1:172.21.15.17:6789/0 conn(0x55f9db34f5b0 legacy=0x55f9db34dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.197+0000 7f5d76919640 1 -- 172.21.15.164:0/4164177559 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 286773612 0 0) 0x55f9db298b30 con 0x55f9db34f5b0 2024-09-13T23:05:54.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.197+0000 7f5d6ffff640 1 -- 172.21.15.164:0/4164177559 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9db2a0e00 con 0x55f9db34e4a0 2024-09-13T23:05:54.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.198+0000 7f5d6ffff640 1 --2- 172.21.15.164:0/4164177559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db34e4a0 0x55f9db3e26e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5d6000a470 tx=0x7f5d60045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de9d168cbbfa3b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.199+0000 7f5d76919640 1 -- 172.21.15.164:0/4164177559 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d60053570 con 0x55f9db34e4a0 2024-09-13T23:05:54.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.199+0000 7f5d76919640 1 -- 172.21.15.164:0/4164177559 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d60058070 con 0x55f9db34e4a0 2024-09-13T23:05:54.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.199+0000 7f5d76919640 1 -- 172.21.15.164:0/4164177559 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d60053880 con 0x55f9db34e4a0 2024-09-13T23:05:54.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.199+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/4164177559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db34e4a0 msgr2=0x55f9db3e26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.199+0000 7f5d7ba0e800 1 --2- 172.21.15.164:0/4164177559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db34e4a0 0x55f9db3e26e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5d6000a470 tx=0x7f5d60045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:54.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.199+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/4164177559 shutdown_connections 2024-09-13T23:05:54.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.199+0000 7f5d7ba0e800 1 --2- 172.21.15.164:0/4164177559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db34e4a0 0x55f9db3e26e0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.199+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/4164177559 >> 172.21.15.164:0/4164177559 conn(0x55f9db3d4ff0 msgr2=0x55f9db3d7410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.199+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/4164177559 shutdown_connections 2024-09-13T23:05:54.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.199+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/4164177559 wait complete. 2024-09-13T23:05:54.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.213+0000 7f5d7ba0e800 1 Processor -- start 2024-09-13T23:05:54.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.213+0000 7f5d7ba0e800 1 -- start start 2024-09-13T23:05:54.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.214+0000 7f5d7ba0e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db34e4a0 0x55f9db4ca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.214+0000 7f5d7ba0e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f9db325330 con 0x55f9db34e4a0 2024-09-13T23:05:54.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.214+0000 7f5d7711a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db34e4a0 0x55f9db4ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.214+0000 7f5d7711a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db34e4a0 0x55f9db4ca890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37862/0 (socket says 172.21.15.164:37862) 2024-09-13T23:05:54.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.214+0000 7f5d7711a640 1 -- 172.21.15.164:0/2363691036 learned_addr learned my addr 172.21.15.164:0/2363691036 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:54.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.214+0000 7f5d7711a640 1 -- 172.21.15.164:0/2363691036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9db272bc0 con 0x55f9db34e4a0 2024-09-13T23:05:54.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.214+0000 7f5d7711a640 1 --2- 172.21.15.164:0/2363691036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db34e4a0 0x55f9db4ca890 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5d68001e10 tx=0x7f5d6800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfaa21d4768056b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.215+0000 7f5c6560a640 1 -- 172.21.15.164:0/2363691036 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d68012020 con 0x55f9db34e4a0 2024-09-13T23:05:54.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.215+0000 7f5c6560a640 1 -- 172.21.15.164:0/2363691036 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d6800e5c0 con 0x55f9db34e4a0 2024-09-13T23:05:54.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.215+0000 7f5c6560a640 1 -- 172.21.15.164:0/2363691036 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d6800e8e0 con 0x55f9db34e4a0 2024-09-13T23:05:54.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.215+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/2363691036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db34e4a0 msgr2=0x55f9db4ca890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.215+0000 7f5d7ba0e800 1 --2- 172.21.15.164:0/2363691036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db34e4a0 0x55f9db4ca890 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5d68001e10 tx=0x7f5d6800b780 comp rx=0 tx=0).stop 2024-09-13T23:05:54.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.215+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/2363691036 shutdown_connections 2024-09-13T23:05:54.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.215+0000 7f5d7ba0e800 1 --2- 172.21.15.164:0/2363691036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db34e4a0 0x55f9db4ca890 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.215+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/2363691036 >> 172.21.15.164:0/2363691036 conn(0x55f9db3d4ff0 msgr2=0x55f9db4c6250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.215+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/2363691036 shutdown_connections 2024-09-13T23:05:54.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.215+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/2363691036 wait complete. 2024-09-13T23:05:54.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.216+0000 7f5d7ba0e800 1 Processor -- start 2024-09-13T23:05:54.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.216+0000 7f5d7ba0e800 1 -- start start 2024-09-13T23:05:54.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.216+0000 7f5d7ba0e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db34e4a0 0x55f9db4d22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.216+0000 7f5d7ba0e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f9db34eb90 con 0x55f9db34e4a0 2024-09-13T23:05:54.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.216+0000 7f5d7711a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db34e4a0 0x55f9db4d22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.216+0000 7f5d7711a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db34e4a0 0x55f9db4d22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37872/0 (socket says 172.21.15.164:37872) 2024-09-13T23:05:54.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.216+0000 7f5d7711a640 1 -- 172.21.15.164:0/2467511981 learned_addr learned my addr 172.21.15.164:0/2467511981 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:54.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.216+0000 7f5d7711a640 1 -- 172.21.15.164:0/2467511981 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9db286fe0 con 0x55f9db34e4a0 2024-09-13T23:05:54.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.217+0000 7f5d7711a640 1 --2- 172.21.15.164:0/2467511981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db34e4a0 0x55f9db4d22d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5d68000fb0 tx=0x7f5d68000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.217+0000 7f5c63e07640 1 -- 172.21.15.164:0/2467511981 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d68012030 con 0x55f9db34e4a0 2024-09-13T23:05:54.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.217+0000 7f5c63e07640 1 -- 172.21.15.164:0/2467511981 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d6801a7a0 con 0x55f9db34e4a0 2024-09-13T23:05:54.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.217+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/2467511981 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9db4d2810 con 0x55f9db34e4a0 2024-09-13T23:05:54.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.217+0000 7f5c63e07640 1 -- 172.21.15.164:0/2467511981 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d6801aa80 con 0x55f9db34e4a0 2024-09-13T23:05:54.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.217+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/2467511981 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9db4d2d30 con 0x55f9db34e4a0 2024-09-13T23:05:54.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.218+0000 7f5c63e07640 1 -- 172.21.15.164:0/2467511981 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5d68015020 con 0x55f9db34e4a0 2024-09-13T23:05:54.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.218+0000 7f5c63e07640 1 --2- 172.21.15.164:0/2467511981 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5c5c036b90 0x7f5c5c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.218+0000 7f5c63e07640 1 -- 172.21.15.164:0/2467511981 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f5d68020030 con 0x55f9db34e4a0 2024-09-13T23:05:54.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.218+0000 7f5d6ffff640 1 --2- 172.21.15.164:0/2467511981 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5c5c036b90 0x7f5c5c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.218+0000 7f5d7ba0e800 1 --2- 172.21.15.164:0/2467511981 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f9db34f5b0 0x55f9db4d9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.218+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/2467511981 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9db4d9880 con 0x55f9db34f5b0 2024-09-13T23:05:54.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.218+0000 7f5d7791b640 1 --2- 172.21.15.164:0/2467511981 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f9db34f5b0 0x55f9db4d9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.218+0000 7f5d6ffff640 1 --2- 172.21.15.164:0/2467511981 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5c5c036b90 0x7f5c5c039050 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5d60057000 tx=0x7f5d60052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.218+0000 7f5d7791b640 1 --2- 172.21.15.164:0/2467511981 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f9db34f5b0 0x55f9db4d9340 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.219+0000 7f5d7791b640 1 -- 172.21.15.164:0/2467511981 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d7000a4a0 con 0x55f9db34f5b0 2024-09-13T23:05:54.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.219+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/2467511981 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9db4d6910 con 0x55f9db34f5b0 2024-09-13T23:05:54.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.219+0000 7f5d7791b640 1 -- 172.21.15.164:0/2467511981 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d7000a4a0 con 0x55f9db34f5b0 2024-09-13T23:05:54.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.219+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/2467511981 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9db4db660 con 0x55f9db34f5b0 2024-09-13T23:05:54.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.219+0000 7f5d7791b640 1 -- 172.21.15.164:0/2467511981 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5d7000a4a0 con 0x55f9db34f5b0 2024-09-13T23:05:54.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.219+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/2467511981 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9db4da890 con 0x55f9db34f5b0 2024-09-13T23:05:54.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.219+0000 7f5d7791b640 1 -- 172.21.15.164:0/2467511981 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d7000a4a0 con 0x55f9db34f5b0 2024-09-13T23:05:54.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.219+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/2467511981 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9db4dace0 con 0x55f9db34f5b0 2024-09-13T23:05:54.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.220+0000 7f5d7791b640 1 -- 172.21.15.164:0/2467511981 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5d7000a4a0 con 0x55f9db34f5b0 2024-09-13T23:05:54.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.220+0000 7f5d7ba0e800 1 Processor -- start 2024-09-13T23:05:54.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.220+0000 7f5d7ba0e800 1 -- start start 2024-09-13T23:05:54.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.220+0000 7f5d7ba0e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db4e9c50 0x55f9db4ea090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.220+0000 7f5d7ba0e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f9db274580 con 0x55f9db4e9c50 2024-09-13T23:05:54.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.220+0000 7f5d6ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db4e9c50 0x55f9db4ea090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.221+0000 7f5d6ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db4e9c50 0x55f9db4ea090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37878/0 (socket says 172.21.15.164:37878) 2024-09-13T23:05:54.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.221+0000 7f5d6ffff640 1 -- 172.21.15.164:0/1814914023 learned_addr learned my addr 172.21.15.164:0/1814914023 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:54.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.221+0000 7f5d6ffff640 1 -- 172.21.15.164:0/1814914023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9db4ea5d0 con 0x55f9db4e9c50 2024-09-13T23:05:54.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.221+0000 7f5d6ffff640 1 --2- 172.21.15.164:0/1814914023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db4e9c50 0x55f9db4ea090 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5d60025bf0 tx=0x7f5d60002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.221+0000 7f5c61602640 1 -- 172.21.15.164:0/1814914023 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d6006f070 con 0x55f9db4e9c50 2024-09-13T23:05:54.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.221+0000 7f5c61602640 1 -- 172.21.15.164:0/1814914023 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d6005f550 con 0x55f9db4e9c50 2024-09-13T23:05:54.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.221+0000 7f5c61602640 1 -- 172.21.15.164:0/1814914023 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d6005f830 con 0x55f9db4e9c50 2024-09-13T23:05:54.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.221+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/1814914023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9db4ea860 con 0x55f9db4e9c50 2024-09-13T23:05:54.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.221+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/1814914023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9db4ed490 con 0x55f9db4e9c50 2024-09-13T23:05:54.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.222+0000 7f5c61602640 1 -- 172.21.15.164:0/1814914023 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5d6005f9d0 con 0x55f9db4e9c50 2024-09-13T23:05:54.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.222+0000 7f5c61602640 1 --2- 172.21.15.164:0/1814914023 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5c50036b40 0x7f5c50039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.222+0000 7f5c61602640 1 -- 172.21.15.164:0/1814914023 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f5d60092d70 con 0x55f9db4e9c50 2024-09-13T23:05:54.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.223+0000 7f5d7791b640 1 --2- 172.21.15.164:0/1814914023 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5c50036b40 0x7f5c50039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.223+0000 7f5d7ba0e800 1 Processor -- start 2024-09-13T23:05:54.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.223+0000 7f5d7ba0e800 1 -- start start 2024-09-13T23:05:54.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.223+0000 7f5d7791b640 1 --2- 172.21.15.164:0/1814914023 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5c50036b40 0x7f5c50039000 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x55f9db4da3b0 tx=0x7f5d70005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.223+0000 7f5d7ba0e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db4f6850 0x55f9db4f6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.223+0000 7f5d7ba0e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f9db4cb040 con 0x55f9db4f6850 2024-09-13T23:05:54.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.223+0000 7f5d6ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db4f6850 0x55f9db4f6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.223+0000 7f5d6ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db4f6850 0x55f9db4f6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37886/0 (socket says 172.21.15.164:37886) 2024-09-13T23:05:54.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.223+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3326765122 learned_addr learned my addr 172.21.15.164:0/3326765122 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:54.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.224+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3326765122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9db4f7220 con 0x55f9db4f6850 2024-09-13T23:05:54.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.224+0000 7f5d6ffff640 1 --2- 172.21.15.164:0/3326765122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db4f6850 0x55f9db4f6c50 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f5d60091040 tx=0x7f5d6005c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c6d24e3d1a746d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.224+0000 7f5c5affd640 1 -- 172.21.15.164:0/3326765122 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d6008be60 con 0x55f9db4f6850 2024-09-13T23:05:54.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.224+0000 7f5c5affd640 1 -- 172.21.15.164:0/3326765122 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d60091180 con 0x55f9db4f6850 2024-09-13T23:05:54.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.224+0000 7f5c5affd640 1 -- 172.21.15.164:0/3326765122 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d6006bc60 con 0x55f9db4f6850 2024-09-13T23:05:54.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.224+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3326765122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db4f6850 msgr2=0x55f9db4f6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.224+0000 7f5d7ba0e800 1 --2- 172.21.15.164:0/3326765122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db4f6850 0x55f9db4f6c50 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f5d60091040 tx=0x7f5d6005c3a0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.224+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3326765122 shutdown_connections 2024-09-13T23:05:54.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.224+0000 7f5d7ba0e800 1 --2- 172.21.15.164:0/3326765122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db4f6850 0x55f9db4f6c50 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.224+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3326765122 >> 172.21.15.164:0/3326765122 conn(0x55f9db4f2bb0 msgr2=0x55f9db4f0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.224+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3326765122 shutdown_connections 2024-09-13T23:05:54.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.224+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3326765122 wait complete. 2024-09-13T23:05:54.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.225+0000 7f5d7ba0e800 1 Processor -- start 2024-09-13T23:05:54.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.225+0000 7f5d7ba0e800 1 -- start start 2024-09-13T23:05:54.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.225+0000 7f5d7ba0e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db4f6850 0x55f9db4fdd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.225+0000 7f5d7ba0e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f9db4f7890 con 0x55f9db4f6850 2024-09-13T23:05:54.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.225+0000 7f5d6ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db4f6850 0x55f9db4fdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.225+0000 7f5d6ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db4f6850 0x55f9db4fdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37902/0 (socket says 172.21.15.164:37902) 2024-09-13T23:05:54.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.225+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 learned_addr learned my addr 172.21.15.164:0/3311267732 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:54.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.225+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9db4fe290 con 0x55f9db4f6850 2024-09-13T23:05:54.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.226+0000 7f5d6ffff640 1 --2- 172.21.15.164:0/3311267732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db4f6850 0x55f9db4fdd50 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f5d60091040 tx=0x7f5d60090fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.226+0000 7f5c597fa640 1 -- 172.21.15.164:0/3311267732 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d60069bf0 con 0x55f9db4f6850 2024-09-13T23:05:54.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.226+0000 7f5c597fa640 1 -- 172.21.15.164:0/3311267732 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d60069d90 con 0x55f9db4f6850 2024-09-13T23:05:54.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.226+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9db4fe520 con 0x55f9db4f6850 2024-09-13T23:05:54.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.226+0000 7f5c597fa640 1 -- 172.21.15.164:0/3311267732 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d6006b560 con 0x55f9db4f6850 2024-09-13T23:05:54.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.226+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9db5011d0 con 0x55f9db4f6850 2024-09-13T23:05:54.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.226+0000 7f5c597fa640 1 -- 172.21.15.164:0/3311267732 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5d6006b700 con 0x55f9db4f6850 2024-09-13T23:05:54.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.227+0000 7f5c597fa640 1 --2- 172.21.15.164:0/3311267732 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5c40036b40 0x7f5c40039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.227+0000 7f5c597fa640 1 -- 172.21.15.164:0/3311267732 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f5d60096070 con 0x55f9db4f6850 2024-09-13T23:05:54.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.227+0000 7f5d7791b640 1 --2- 172.21.15.164:0/3311267732 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5c40036b40 0x7f5c40039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.227+0000 7f5d7791b640 1 --2- 172.21.15.164:0/3311267732 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5c40036b40 0x7f5c40039000 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55f9db4d6860 tx=0x7f5d7001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.227+0000 7f5d7ba0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.227+0000 7f5d7ba0e800 1 --2- 172.21.15.164:0/3311267732 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f9db509850 0x55f9db50bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.227+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9db50c460 con 0x55f9db509850 2024-09-13T23:05:54.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.228+0000 7f5d7711a640 1 --2- 172.21.15.164:0/3311267732 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f9db509850 0x55f9db50bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.228+0000 7f5d7711a640 1 --2- 172.21.15.164:0/3311267732 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f9db509850 0x55f9db50bd10 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.228+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.228+0000 7f5d7ba0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.228+0000 7f5d7ba0e800 20 realm 2024-09-13T23:05:54.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.228+0000 7f5d7ba0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.228+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9db50c870 con 0x55f9db509850 2024-09-13T23:05:54.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.228+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.228+0000 7f5d7ba0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.228+0000 7f5d7ba0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:54.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.228+0000 7f5d7ba0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.228+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9db50d140 con 0x55f9db509850 2024-09-13T23:05:54.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.228+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.228+0000 7f5d7ba0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.228+0000 7f5d7ba0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.228+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9db50d4e0 con 0x55f9db509850 2024-09-13T23:05:54.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.229+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.229+0000 7f5d7ba0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:54.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.229+0000 7f5d7ba0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.229+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9db50dd30 con 0x55f9db509850 2024-09-13T23:05:54.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.229+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.229+0000 7f5d7ba0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:54.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.229+0000 7f5d7ba0e800 20 searching for the correct realm 2024-09-13T23:05:54.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.229+0000 7f5d7ba0e800 1 --2- 172.21.15.164:0/3311267732 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55f9db50faa0 0x55f9db511e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.229+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x55f9db50faa0 2024-09-13T23:05:54.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.229+0000 7f5d6ffff640 1 --2- 172.21.15.164:0/3311267732 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55f9db50faa0 0x55f9db511e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.229+0000 7f5d6ffff640 1 --2- 172.21.15.164:0/3311267732 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55f9db50faa0 0x55f9db511e90 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.230+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d600a0020 con 0x55f9db50faa0 2024-09-13T23:05:54.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.230+0000 7f5d6ffff640 1 --2- 172.21.15.164:0/3311267732 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f5d6005f040 0x7f5d60052970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.230+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x7f5d6005f040 2024-09-13T23:05:54.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.230+0000 7f5d7791b640 1 --2- 172.21.15.164:0/3311267732 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f5d6005f040 0x7f5d60052970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.230+0000 7f5d7791b640 1 --2- 172.21.15.164:0/3311267732 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f5d6005f040 0x7f5d60052970 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.230+0000 7f5d7791b640 1 -- 172.21.15.164:0/3311267732 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7001f070 con 0x7f5d6005f040 2024-09-13T23:05:54.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.230+0000 7f5d7791b640 1 --2- 172.21.15.164:0/3311267732 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f5d70031040 0x7f5d70032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.230+0000 7f5d7791b640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x7f5d70031040 2024-09-13T23:05:54.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.231+0000 7f5d7711a640 1 --2- 172.21.15.164:0/3311267732 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f5d70031040 0x7f5d70032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.231+0000 7f5d7711a640 1 --2- 172.21.15.164:0/3311267732 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f5d70031040 0x7f5d70032940 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.231+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d6800dcd0 con 0x7f5d70031040 2024-09-13T23:05:54.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.231+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x55f9db509850 2024-09-13T23:05:54.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.231+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.231+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x55f9db509850 2024-09-13T23:05:54.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.232+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.232+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x7f5d70031040 2024-09-13T23:05:54.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.232+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d6800dcd0 con 0x7f5d70031040 2024-09-13T23:05:54.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.232+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x7f5d70031040 2024-09-13T23:05:54.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.232+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d6800dcd0 con 0x7f5d70031040 2024-09-13T23:05:54.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.232+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x7f5d6005f040 2024-09-13T23:05:54.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.232+0000 7f5d7791b640 1 -- 172.21.15.164:0/3311267732 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7001f070 con 0x7f5d6005f040 2024-09-13T23:05:54.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.232+0000 7f5d7791b640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x55f9db50faa0 2024-09-13T23:05:54.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.233+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d600a0020 con 0x55f9db50faa0 2024-09-13T23:05:54.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.233+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x55f9db509850 2024-09-13T23:05:54.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.233+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.233+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x7f5d70031040 2024-09-13T23:05:54.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.233+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d6800dcd0 con 0x7f5d70031040 2024-09-13T23:05:54.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.233+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x55f9db509850 2024-09-13T23:05:54.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.233+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.233+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x7f5d6005f040 2024-09-13T23:05:54.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.233+0000 7f5d7791b640 1 -- 172.21.15.164:0/3311267732 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5d7001f070 con 0x7f5d6005f040 2024-09-13T23:05:54.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.233+0000 7f5d7791b640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x55f9db50faa0 2024-09-13T23:05:54.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.234+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d600a0020 con 0x55f9db50faa0 2024-09-13T23:05:54.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.234+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x55f9db50faa0 2024-09-13T23:05:54.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.234+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d600a0020 con 0x55f9db50faa0 2024-09-13T23:05:54.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.234+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x7f5d70031040 2024-09-13T23:05:54.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.234+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d6800dcd0 con 0x7f5d70031040 2024-09-13T23:05:54.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.234+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x55f9db50faa0 2024-09-13T23:05:54.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.234+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d600a0020 con 0x55f9db50faa0 2024-09-13T23:05:54.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.234+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x55f9db50faa0 2024-09-13T23:05:54.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.235+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d600a0020 con 0x55f9db50faa0 2024-09-13T23:05:54.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.235+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x55f9db509850 2024-09-13T23:05:54.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.235+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.235+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x55f9db509850 2024-09-13T23:05:54.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.235+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.235+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x7f5d70031040 2024-09-13T23:05:54.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.235+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d6800dcd0 con 0x7f5d70031040 2024-09-13T23:05:54.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.235+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x55f9db50faa0 2024-09-13T23:05:54.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.236+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d600a0020 con 0x55f9db50faa0 2024-09-13T23:05:54.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.236+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x7f5d6005f040 2024-09-13T23:05:54.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.236+0000 7f5d7791b640 1 -- 172.21.15.164:0/3311267732 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7001f070 con 0x7f5d6005f040 2024-09-13T23:05:54.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.236+0000 7f5d7791b640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x55f9db509850 2024-09-13T23:05:54.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.236+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.236+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x7f5d70031040 2024-09-13T23:05:54.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.236+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d6800dcd0 con 0x7f5d70031040 2024-09-13T23:05:54.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.236+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x55f9db50faa0 2024-09-13T23:05:54.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.237+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d600a0020 con 0x55f9db50faa0 2024-09-13T23:05:54.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.237+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x7f5d70031040 2024-09-13T23:05:54.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.237+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d6800dcd0 con 0x7f5d70031040 2024-09-13T23:05:54.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.237+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x7f5d6005f040 2024-09-13T23:05:54.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.237+0000 7f5d7791b640 1 -- 172.21.15.164:0/3311267732 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7001f070 con 0x7f5d6005f040 2024-09-13T23:05:54.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.237+0000 7f5d7791b640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x55f9db50faa0 2024-09-13T23:05:54.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.237+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d600a0020 con 0x55f9db50faa0 2024-09-13T23:05:54.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.237+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x7f5d6005f040 2024-09-13T23:05:54.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.238+0000 7f5d7791b640 1 -- 172.21.15.164:0/3311267732 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7001f070 con 0x7f5d6005f040 2024-09-13T23:05:54.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.238+0000 7f5d7791b640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x55f9db509850 2024-09-13T23:05:54.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.238+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.238+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5124a0 con 0x7f5d6005f040 2024-09-13T23:05:54.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.238+0000 7f5d7791b640 1 -- 172.21.15.164:0/3311267732 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d70040040 con 0x7f5d6005f040 2024-09-13T23:05:54.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.238+0000 7f5d7ba0e800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:54.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.238+0000 7f5d7ba0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:54.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.238+0000 7f5d7ba0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:54.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.238+0000 7f5d7ba0e800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:54.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.238+0000 7f5d7ba0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:54.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.238+0000 7f5d7ba0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:54.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.238+0000 7f5d7ba0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.238+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9db50e6b0 con 0x55f9db509850 2024-09-13T23:05:54.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.238+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.238+0000 7f5d7ba0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.238+0000 7f5d7ba0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.238+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9db50ef50 con 0x55f9db509850 2024-09-13T23:05:54.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.239+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.239+0000 7f5d7ba0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:54.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.239+0000 7f5d7ba0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.239+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9db50ef50 con 0x55f9db509850 2024-09-13T23:05:54.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.239+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.239+0000 7f5d7ba0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:54.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.239+0000 7f5d7ba0e800 20 zone default found 2024-09-13T23:05:54.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.239+0000 7f5d7ba0e800 4 Realm: () 2024-09-13T23:05:54.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.239+0000 7f5d7ba0e800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:54.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.239+0000 7f5d7ba0e800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:54.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.239+0000 7f5d7ba0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:54.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.239+0000 7f5d7ba0e800 20 zonegroup default 2024-09-13T23:05:54.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.239+0000 7f5d7ba0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.239+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9db512920 con 0x7f5d70031040 2024-09-13T23:05:54.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.239+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x7f5d70031040 2024-09-13T23:05:54.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.239+0000 7f5d7ba0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.239+0000 7f5d7ba0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.239+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9db514360 con 0x55f9db50faa0 2024-09-13T23:05:54.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.240+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5d600a0020 con 0x55f9db50faa0 2024-09-13T23:05:54.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.240+0000 7f5d7ba0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.240+0000 7f5d7ba0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.240+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9db514850 con 0x55f9db50faa0 2024-09-13T23:05:54.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.240+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5d600a0020 con 0x55f9db50faa0 2024-09-13T23:05:54.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.240+0000 7f5d7ba0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.240+0000 7f5d7ba0e800 20 started sync module instance, tier type = 2024-09-13T23:05:54.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.240+0000 7f5d7ba0e800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:54.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.240+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5137a0 con 0x7f5d6005f040 2024-09-13T23:05:54.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.241+0000 7f5d7791b640 1 -- 172.21.15.164:0/3311267732 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d70040040 con 0x7f5d6005f040 2024-09-13T23:05:54.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.241+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94531614751632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db513400 con 0x7f5d6005f040 2024-09-13T23:05:54.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.241+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db515780 con 0x55f9db509850 2024-09-13T23:05:54.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.242+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.242+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94531614757584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db515ba0 con 0x55f9db509850 2024-09-13T23:05:54.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.242+0000 7f5d7791b640 1 -- 172.21.15.164:0/3311267732 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94531614751632] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d70040040 con 0x7f5d6005f040 2024-09-13T23:05:54.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.242+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db516680 con 0x55f9db50faa0 2024-09-13T23:05:54.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.243+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94531614757584] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.243+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d600a0020 con 0x55f9db50faa0 2024-09-13T23:05:54.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.243+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94531614756016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db515ba0 con 0x55f9db50faa0 2024-09-13T23:05:54.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.243+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db516f50 con 0x7f5d6005f040 2024-09-13T23:05:54.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.244+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94531614756016] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d600a0020 con 0x55f9db50faa0 2024-09-13T23:05:54.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.244+0000 7f5d7791b640 1 -- 172.21.15.164:0/3311267732 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d70040040 con 0x7f5d6005f040 2024-09-13T23:05:54.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.244+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94531614763680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db516ec0 con 0x7f5d6005f040 2024-09-13T23:05:54.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.244+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db517e10 con 0x55f9db509850 2024-09-13T23:05:54.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.245+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.245+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94531614767456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db517dc0 con 0x55f9db509850 2024-09-13T23:05:54.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.245+0000 7f5d7791b640 1 -- 172.21.15.164:0/3311267732 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94531614763680] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d70040040 con 0x7f5d6005f040 2024-09-13T23:05:54.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.245+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db517380 con 0x7f5d70031040 2024-09-13T23:05:54.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.246+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94531614767456] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.246+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x7f5d70031040 2024-09-13T23:05:54.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.247+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94531614769584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db517d80 con 0x7f5d70031040 2024-09-13T23:05:54.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.247+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db519230 con 0x7f5d70031040 2024-09-13T23:05:54.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.247+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94531614769584] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x7f5d70031040 2024-09-13T23:05:54.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.248+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x7f5d70031040 2024-09-13T23:05:54.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.248+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94531614771328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db519230 con 0x7f5d70031040 2024-09-13T23:05:54.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.248+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db519bf0 con 0x7f5d70031040 2024-09-13T23:05:54.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.249+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94531614771328] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x7f5d70031040 2024-09-13T23:05:54.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.249+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x7f5d70031040 2024-09-13T23:05:54.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.249+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94531614772384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db519bf0 con 0x7f5d70031040 2024-09-13T23:05:54.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.249+0000 7f5d7ba0e800 20 add_watcher() i=0 2024-09-13T23:05:54.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.249+0000 7f5d7ba0e800 20 add_watcher() i=1 2024-09-13T23:05:54.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.249+0000 7f5d7ba0e800 20 add_watcher() i=2 2024-09-13T23:05:54.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.249+0000 7f5d7ba0e800 20 add_watcher() i=3 2024-09-13T23:05:54.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.249+0000 7f5d7ba0e800 20 add_watcher() i=4 2024-09-13T23:05:54.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.249+0000 7f5d7ba0e800 20 add_watcher() i=5 2024-09-13T23:05:54.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.249+0000 7f5d7ba0e800 20 add_watcher() i=6 2024-09-13T23:05:54.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.250+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94531614772384] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x7f5d70031040 2024-09-13T23:05:54.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.250+0000 7f5d7ba0e800 20 add_watcher() i=7 2024-09-13T23:05:54.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.250+0000 7f5d7ba0e800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:54.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.250+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9db51d050 con 0x55f9db509850 2024-09-13T23:05:54.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.250+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.250+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94531614775568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db51a5a0 con 0x55f9db509850 2024-09-13T23:05:54.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.251+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94531614775568] v34'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.251+0000 7f5c2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:54.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.251+0000 7f5d7ba0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:54.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.251+0000 7f5d7ba0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:54.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.251+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db525b40 con 0x55f9db509850 2024-09-13T23:05:54.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.252+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.252+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db526190 con 0x7f5d70031040 2024-09-13T23:05:54.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.254+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x7f5d70031040 2024-09-13T23:05:54.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.254+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5265f0 con 0x55f9db50faa0 2024-09-13T23:05:54.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.255+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d600a0020 con 0x55f9db50faa0 2024-09-13T23:05:54.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.255+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db526990 con 0x55f9db509850 2024-09-13T23:05:54.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.256+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'174 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.256+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db526990 con 0x7f5d6005f040 2024-09-13T23:05:54.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.257+0000 7f5d7791b640 1 -- 172.21.15.164:0/3311267732 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'59 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d70040040 con 0x7f5d6005f040 2024-09-13T23:05:54.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.257+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db526f50 con 0x55f9db50faa0 2024-09-13T23:05:54.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.258+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'39 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d600a0020 con 0x55f9db50faa0 2024-09-13T23:05:54.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.258+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5272f0 con 0x55f9db509850 2024-09-13T23:05:54.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.259+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.259+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5272f0 con 0x7f5d70031040 2024-09-13T23:05:54.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.260+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'41 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x7f5d70031040 2024-09-13T23:05:54.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.260+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5272f0 con 0x7f5d6005f040 2024-09-13T23:05:54.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.261+0000 7f5d7791b640 1 -- 172.21.15.164:0/3311267732 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d70040040 con 0x7f5d6005f040 2024-09-13T23:05:54.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.261+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db527860 con 0x55f9db50faa0 2024-09-13T23:05:54.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.262+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d600a0020 con 0x55f9db50faa0 2024-09-13T23:05:54.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.262+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db527c40 con 0x7f5d6005f040 2024-09-13T23:05:54.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.262+0000 7f5d7791b640 1 -- 172.21.15.164:0/3311267732 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'60 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d70040040 con 0x7f5d6005f040 2024-09-13T23:05:54.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.263+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db527dd0 con 0x7f5d70031040 2024-09-13T23:05:54.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.264+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x7f5d70031040 2024-09-13T23:05:54.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.264+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db527da0 con 0x7f5d6005f040 2024-09-13T23:05:54.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.265+0000 7f5d7791b640 1 -- 172.21.15.164:0/3311267732 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d70040040 con 0x7f5d6005f040 2024-09-13T23:05:54.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.265+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db527da0 con 0x7f5d70031040 2024-09-13T23:05:54.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.266+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'45 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x7f5d70031040 2024-09-13T23:05:54.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.266+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db527e00 con 0x55f9db509850 2024-09-13T23:05:54.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.267+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'175 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.267+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db527e00 con 0x55f9db50faa0 2024-09-13T23:05:54.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.268+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'53 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d600a0020 con 0x55f9db50faa0 2024-09-13T23:05:54.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.268+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db527e90 con 0x7f5d6005f040 2024-09-13T23:05:54.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.269+0000 7f5d7791b640 1 -- 172.21.15.164:0/3311267732 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'61 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d70040040 con 0x7f5d6005f040 2024-09-13T23:05:54.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.269+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db527e90 con 0x55f9db50faa0 2024-09-13T23:05:54.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.270+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d600a0020 con 0x55f9db50faa0 2024-09-13T23:05:54.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.270+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db527e30 con 0x55f9db509850 2024-09-13T23:05:54.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.271+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.271+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db527e30 con 0x55f9db509850 2024-09-13T23:05:54.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.272+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'176 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.272+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5254d0 con 0x55f9db50faa0 2024-09-13T23:05:54.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.273+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'54 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d600a0020 con 0x55f9db50faa0 2024-09-13T23:05:54.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.273+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5254d0 con 0x7f5d6005f040 2024-09-13T23:05:54.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.274+0000 7f5d7791b640 1 -- 172.21.15.164:0/3311267732 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d70040040 con 0x7f5d6005f040 2024-09-13T23:05:54.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.274+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5254d0 con 0x55f9db50faa0 2024-09-13T23:05:54.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.275+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d600a0020 con 0x55f9db50faa0 2024-09-13T23:05:54.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.275+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5254d0 con 0x55f9db50faa0 2024-09-13T23:05:54.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.276+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 <== osd.3 v2:172.21.15.164:6816/93809510 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d600a0020 con 0x55f9db50faa0 2024-09-13T23:05:54.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.276+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5254d0 con 0x55f9db50faa0 2024-09-13T23:05:54.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.277+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 <== osd.3 v2:172.21.15.164:6816/93809510 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d600a0020 con 0x55f9db50faa0 2024-09-13T23:05:54.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.277+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5254d0 con 0x55f9db50faa0 2024-09-13T23:05:54.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.277+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 <== osd.3 v2:172.21.15.164:6816/93809510 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'40 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d600a0020 con 0x55f9db50faa0 2024-09-13T23:05:54.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.277+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5254d0 con 0x7f5d70031040 2024-09-13T23:05:54.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.279+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x7f5d70031040 2024-09-13T23:05:54.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.279+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5284f0 con 0x55f9db50faa0 2024-09-13T23:05:54.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.280+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 <== osd.3 v2:172.21.15.164:6816/93809510 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d600a0020 con 0x55f9db50faa0 2024-09-13T23:05:54.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.280+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5284f0 con 0x7f5d70031040 2024-09-13T23:05:54.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.281+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'42 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x7f5d70031040 2024-09-13T23:05:54.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.281+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5284f0 con 0x55f9db50faa0 2024-09-13T23:05:54.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.282+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 <== osd.3 v2:172.21.15.164:6816/93809510 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'55 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d600a0020 con 0x55f9db50faa0 2024-09-13T23:05:54.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.282+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5284f0 con 0x7f5d70031040 2024-09-13T23:05:54.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.283+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'46 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x7f5d70031040 2024-09-13T23:05:54.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.283+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5284f0 con 0x7f5d6005f040 2024-09-13T23:05:54.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.284+0000 7f5d7791b640 1 -- 172.21.15.164:0/3311267732 <== osd.2 v2:172.21.15.164:6808/3795914978 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d70040040 con 0x7f5d6005f040 2024-09-13T23:05:54.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.284+0000 7f5c2cfe1640 20 reqs_thread_entry: start 2024-09-13T23:05:54.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.284+0000 7f5d7ba0e800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:54.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.284+0000 7f5d7ba0e800 20 Filter name: none 2024-09-13T23:05:54.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.285+0000 7f5ba67fc640 20 reqs_thread_entry: start 2024-09-13T23:05:54.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.285+0000 7f5d7ba0e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:05:54.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.285+0000 7f5d7ba0e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.285+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9db553030 con 0x55f9db509850 2024-09-13T23:05:54.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.285+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.285+0000 7f5d7ba0e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:05:54.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.285+0000 7f5d7ba0e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:05:54.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.285+0000 7f5d7ba0e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:54.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.285+0000 7f5d7ba0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:54.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.285+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9db552be0 con 0x7f5d6005f040 2024-09-13T23:05:54.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.286+0000 7f5d7791b640 1 -- 172.21.15.164:0/3311267732 <== osd.2 v2:172.21.15.164:6808/3795914978 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f5d70040040 con 0x7f5d6005f040 2024-09-13T23:05:54.290 INFO:teuthology.orchestra.run.smithi164.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-13T23:05:54.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.286+0000 7f5c2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:54.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.286+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94531614775568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db524970 con 0x55f9db509850 2024-09-13T23:05:54.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.287+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94531614775568] v34'177 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.287+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94531614751632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db5198e0 con 0x7f5d6005f040 2024-09-13T23:05:54.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.288+0000 7f5d7791b640 1 -- 172.21.15.164:0/3311267732 <== osd.2 v2:172.21.15.164:6808/3795914978 20 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94531614751632] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d70040040 con 0x7f5d6005f040 2024-09-13T23:05:54.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.288+0000 7f5d7ba0e800 20 remove_watcher() i=0 2024-09-13T23:05:54.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.288+0000 7f5d7ba0e800 2 removed watcher, disabling cache 2024-09-13T23:05:54.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.288+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94531614757584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db513b90 con 0x55f9db509850 2024-09-13T23:05:54.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.290+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94531614757584] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.290+0000 7f5d7ba0e800 20 remove_watcher() i=1 2024-09-13T23:05:54.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.290+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94531614756016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db513b90 con 0x55f9db50faa0 2024-09-13T23:05:54.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.291+0000 7f5d6ffff640 1 -- 172.21.15.164:0/3311267732 <== osd.3 v2:172.21.15.164:6816/93809510 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94531614756016] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d600a0020 con 0x55f9db50faa0 2024-09-13T23:05:54.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.291+0000 7f5d7ba0e800 20 remove_watcher() i=2 2024-09-13T23:05:54.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.291+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94531614763680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db514cb0 con 0x7f5d6005f040 2024-09-13T23:05:54.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.292+0000 7f5d7791b640 1 -- 172.21.15.164:0/3311267732 <== osd.2 v2:172.21.15.164:6808/3795914978 21 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94531614763680] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d70040040 con 0x7f5d6005f040 2024-09-13T23:05:54.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.292+0000 7f5d7ba0e800 20 remove_watcher() i=3 2024-09-13T23:05:54.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.292+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94531614767456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db513b90 con 0x55f9db509850 2024-09-13T23:05:54.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.293+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.1 v2:172.21.15.164:6800/4060509701 32 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94531614767456] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x55f9db509850 2024-09-13T23:05:54.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.293+0000 7f5d7ba0e800 20 remove_watcher() i=4 2024-09-13T23:05:54.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.293+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94531614769584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db516aa0 con 0x7f5d70031040 2024-09-13T23:05:54.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.294+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94531614769584] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x7f5d70031040 2024-09-13T23:05:54.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.294+0000 7f5d7ba0e800 20 remove_watcher() i=5 2024-09-13T23:05:54.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.294+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94531614771328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db514cb0 con 0x7f5d70031040 2024-09-13T23:05:54.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.295+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94531614771328] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x7f5d70031040 2024-09-13T23:05:54.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.295+0000 7f5d7ba0e800 20 remove_watcher() i=6 2024-09-13T23:05:54.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.295+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94531614772384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9db517960 con 0x7f5d70031040 2024-09-13T23:05:54.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94531614772384] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d6800dcd0 con 0x7f5d70031040 2024-09-13T23:05:54.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7ba0e800 20 remove_watcher() i=7 2024-09-13T23:05:54.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f5d70031040 msgr2=0x7f5d70032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7ba0e800 1 --2- 172.21.15.164:0/3311267732 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f5d70031040 0x7f5d70032940 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f9db509850 msgr2=0x55f9db50bd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7ba0e800 1 --2- 172.21.15.164:0/3311267732 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f9db509850 0x55f9db50bd10 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f5d6005f040 msgr2=0x7f5d60052970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7ba0e800 1 --2- 172.21.15.164:0/3311267732 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f5d6005f040 0x7f5d60052970 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55f9db50faa0 msgr2=0x55f9db511e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7ba0e800 1 --2- 172.21.15.164:0/3311267732 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55f9db50faa0 0x55f9db511e90 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5c40036b40 msgr2=0x7f5c40039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7ba0e800 1 --2- 172.21.15.164:0/3311267732 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5c40036b40 0x7f5c40039000 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55f9db4d6860 tx=0x7f5d7001f000 comp rx=0 tx=0).stop 2024-09-13T23:05:54.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db4f6850 msgr2=0x55f9db4fdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7ba0e800 1 --2- 172.21.15.164:0/3311267732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db4f6850 0x55f9db4fdd50 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f5d60091040 tx=0x7f5d60090fd0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 reap_dead start 2024-09-13T23:05:54.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7711a640 1 -- 172.21.15.164:0/3311267732 reap_dead start 2024-09-13T23:05:54.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 shutdown_connections 2024-09-13T23:05:54.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 >> 172.21.15.164:0/3311267732 conn(0x55f9db4f2bb0 msgr2=0x55f9db4f0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 shutdown_connections 2024-09-13T23:05:54.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/3311267732 wait complete. 2024-09-13T23:05:54.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/1814914023 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5c50036b40 msgr2=0x7f5c50039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7ba0e800 1 --2- 172.21.15.164:0/1814914023 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5c50036b40 0x7f5c50039000 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x55f9db4da3b0 tx=0x7f5d70005840 comp rx=0 tx=0).stop 2024-09-13T23:05:54.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/1814914023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db4e9c50 msgr2=0x55f9db4ea090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7ba0e800 1 --2- 172.21.15.164:0/1814914023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db4e9c50 0x55f9db4ea090 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5d60025bf0 tx=0x7f5d60002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/1814914023 shutdown_connections 2024-09-13T23:05:54.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7ba0e800 1 --2- 172.21.15.164:0/1814914023 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5c50036b40 0x7f5c50039000 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7ba0e800 1 --2- 172.21.15.164:0/1814914023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db4e9c50 0x55f9db4ea090 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/1814914023 >> 172.21.15.164:0/1814914023 conn(0x55f9db4debe0 msgr2=0x55f9db4e1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/1814914023 shutdown_connections 2024-09-13T23:05:54.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.296+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/1814914023 wait complete. 2024-09-13T23:05:54.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.297+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/2467511981 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f9db34f5b0 msgr2=0x55f9db4d9340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.297+0000 7f5d7ba0e800 1 --2- 172.21.15.164:0/2467511981 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f9db34f5b0 0x55f9db4d9340 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.297+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/2467511981 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5c5c036b90 msgr2=0x7f5c5c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.297+0000 7f5d7ba0e800 1 --2- 172.21.15.164:0/2467511981 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5c5c036b90 0x7f5c5c039050 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5d60057000 tx=0x7f5d60052000 comp rx=0 tx=0).stop 2024-09-13T23:05:54.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.297+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/2467511981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db34e4a0 msgr2=0x55f9db4d22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.297+0000 7f5d7ba0e800 1 --2- 172.21.15.164:0/2467511981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db34e4a0 0x55f9db4d22d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5d68000fb0 tx=0x7f5d68000ed0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.297+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/2467511981 shutdown_connections 2024-09-13T23:05:54.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.297+0000 7f5d7ba0e800 1 --2- 172.21.15.164:0/2467511981 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f9db34f5b0 0x55f9db4d9340 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.297+0000 7f5d7ba0e800 1 --2- 172.21.15.164:0/2467511981 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5c5c036b90 0x7f5c5c039050 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.297+0000 7f5d7ba0e800 1 --2- 172.21.15.164:0/2467511981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9db34e4a0 0x55f9db4d22d0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.297+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/2467511981 >> 172.21.15.164:0/2467511981 conn(0x55f9db3d4ff0 msgr2=0x55f9db4c4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.297+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/2467511981 shutdown_connections 2024-09-13T23:05:54.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.297+0000 7f5d7ba0e800 1 -- 172.21.15.164:0/2467511981 wait complete. 2024-09-13T23:05:54.306 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T23:05:54.315 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-13T23:05:54.321 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:05:54.347 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:05:54.358 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:05:54.405 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-13T23:05:54.412 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:05:54.412 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T23:05:54.412 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T23:05:54.412 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-13T23:05:54.459 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:54.459 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:54.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.457+0000 7f2b93f40800 1 Processor -- start 2024-09-13T23:05:54.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.457+0000 7f2b93f40800 1 -- start start 2024-09-13T23:05:54.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.457+0000 7f2b93f40800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55bc9710a6d0 0x55bc97199160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.457+0000 7f2b93f40800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bc97055b30 con 0x55bc971996a0 2024-09-13T23:05:54.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.457+0000 7f2b93f40800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55bc97037360 con 0x55bc9710a6d0 2024-09-13T23:05:54.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.457+0000 7f2b8fcca640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55bc9710a6d0 0x55bc97199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.457+0000 7f2b874c9640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55bc971996a0 0x55bc9719bab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:53952/0 (socket says 172.21.15.164:53952) 2024-09-13T23:05:54.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.457+0000 7f2b874c9640 1 -- 172.21.15.164:0/3545017138 learned_addr learned my addr 172.21.15.164:0/3545017138 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:54.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.457+0000 7f2b8fcca640 1 -- 172.21.15.164:0/3545017138 >> v1:172.21.15.17:6789/0 conn(0x55bc971996a0 legacy=0x55bc9719bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.457+0000 7f2b8f4c9640 1 -- 172.21.15.164:0/3545017138 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2666869195 0 0) 0x55bc97055b30 con 0x55bc971996a0 2024-09-13T23:05:54.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.457+0000 7f2b8fcca640 1 -- 172.21.15.164:0/3545017138 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc9705de00 con 0x55bc9710a6d0 2024-09-13T23:05:54.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.459+0000 7f2b8fcca640 1 --2- 172.21.15.164:0/3545017138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9710a6d0 0x55bc97199160 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000a470 tx=0x7f2b80045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec7529dc4e61314 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.460+0000 7f2b8f4c9640 1 -- 172.21.15.164:0/3545017138 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b80053570 con 0x55bc9710a6d0 2024-09-13T23:05:54.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.460+0000 7f2b8f4c9640 1 -- 172.21.15.164:0/3545017138 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b80058070 con 0x55bc9710a6d0 2024-09-13T23:05:54.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.460+0000 7f2b8f4c9640 1 -- 172.21.15.164:0/3545017138 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b80053880 con 0x55bc9710a6d0 2024-09-13T23:05:54.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.460+0000 7f2b93f40800 1 -- 172.21.15.164:0/3545017138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9710a6d0 msgr2=0x55bc97199160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.460+0000 7f2b93f40800 1 --2- 172.21.15.164:0/3545017138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9710a6d0 0x55bc97199160 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000a470 tx=0x7f2b80045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:54.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.460+0000 7f2b93f40800 1 -- 172.21.15.164:0/3545017138 shutdown_connections 2024-09-13T23:05:54.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.460+0000 7f2b93f40800 1 --2- 172.21.15.164:0/3545017138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9710a6d0 0x55bc97199160 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.460+0000 7f2b93f40800 1 -- 172.21.15.164:0/3545017138 >> 172.21.15.164:0/3545017138 conn(0x55bc97190db0 msgr2=0x55bc971931d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.460+0000 7f2b93f40800 1 -- 172.21.15.164:0/3545017138 shutdown_connections 2024-09-13T23:05:54.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.460+0000 7f2b93f40800 1 -- 172.21.15.164:0/3545017138 wait complete. 2024-09-13T23:05:54.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.474+0000 7f2b93f40800 1 Processor -- start 2024-09-13T23:05:54.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.474+0000 7f2b93f40800 1 -- start start 2024-09-13T23:05:54.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.474+0000 7f2b93f40800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9710a6d0 0x55bc97196a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.474+0000 7f2b93f40800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55bc970e2360 con 0x55bc9710a6d0 2024-09-13T23:05:54.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.475+0000 7f2b8fcca640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9710a6d0 0x55bc97196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.475+0000 7f2b8fcca640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9710a6d0 0x55bc97196a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37916/0 (socket says 172.21.15.164:37916) 2024-09-13T23:05:54.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.475+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1456296075 learned_addr learned my addr 172.21.15.164:0/1456296075 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:54.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.475+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1456296075 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc9702fbc0 con 0x55bc9710a6d0 2024-09-13T23:05:54.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.475+0000 7f2b8fcca640 1 --2- 172.21.15.164:0/1456296075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9710a6d0 0x55bc97196a90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2b80045f50 tx=0x7f2b80051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca467cfd8a5939c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.475+0000 7f2a7de0b640 1 -- 172.21.15.164:0/1456296075 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b80053c20 con 0x55bc9710a6d0 2024-09-13T23:05:54.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.475+0000 7f2a7de0b640 1 -- 172.21.15.164:0/1456296075 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b80063030 con 0x55bc9710a6d0 2024-09-13T23:05:54.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.475+0000 7f2a7de0b640 1 -- 172.21.15.164:0/1456296075 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b80053440 con 0x55bc9710a6d0 2024-09-13T23:05:54.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.476+0000 7f2b93f40800 1 -- 172.21.15.164:0/1456296075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9710a6d0 msgr2=0x55bc97196a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.476+0000 7f2b93f40800 1 --2- 172.21.15.164:0/1456296075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9710a6d0 0x55bc97196a90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2b80045f50 tx=0x7f2b80051000 comp rx=0 tx=0).stop 2024-09-13T23:05:54.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.476+0000 7f2b93f40800 1 -- 172.21.15.164:0/1456296075 shutdown_connections 2024-09-13T23:05:54.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.476+0000 7f2b93f40800 1 --2- 172.21.15.164:0/1456296075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9710a6d0 0x55bc97196a90 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.476+0000 7f2b93f40800 1 -- 172.21.15.164:0/1456296075 >> 172.21.15.164:0/1456296075 conn(0x55bc97190db0 msgr2=0x55bc972810b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.476+0000 7f2b93f40800 1 -- 172.21.15.164:0/1456296075 shutdown_connections 2024-09-13T23:05:54.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.476+0000 7f2b93f40800 1 -- 172.21.15.164:0/1456296075 wait complete. 2024-09-13T23:05:54.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.476+0000 7f2b93f40800 1 Processor -- start 2024-09-13T23:05:54.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.476+0000 7f2b93f40800 1 -- start start 2024-09-13T23:05:54.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.477+0000 7f2b93f40800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9710a6d0 0x55bc9728f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.477+0000 7f2b93f40800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55bc9719d610 con 0x55bc9710a6d0 2024-09-13T23:05:54.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.477+0000 7f2b8fcca640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9710a6d0 0x55bc9728f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.477+0000 7f2b8fcca640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9710a6d0 0x55bc9728f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37930/0 (socket says 172.21.15.164:37930) 2024-09-13T23:05:54.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.477+0000 7f2b8fcca640 1 -- 172.21.15.164:0/919349218 learned_addr learned my addr 172.21.15.164:0/919349218 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:54.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.477+0000 7f2b8fcca640 1 -- 172.21.15.164:0/919349218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc97043fe0 con 0x55bc9710a6d0 2024-09-13T23:05:54.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.477+0000 7f2b8fcca640 1 --2- 172.21.15.164:0/919349218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9710a6d0 0x55bc9728f260 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2b80045f20 tx=0x7f2b80002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.478+0000 7f2a77fff640 1 -- 172.21.15.164:0/919349218 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b80053570 con 0x55bc9710a6d0 2024-09-13T23:05:54.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.478+0000 7f2a77fff640 1 -- 172.21.15.164:0/919349218 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b80053710 con 0x55bc9710a6d0 2024-09-13T23:05:54.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.478+0000 7f2b93f40800 1 -- 172.21.15.164:0/919349218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bc9728f7a0 con 0x55bc9710a6d0 2024-09-13T23:05:54.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.478+0000 7f2a77fff640 1 -- 172.21.15.164:0/919349218 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b80068420 con 0x55bc9710a6d0 2024-09-13T23:05:54.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.478+0000 7f2b93f40800 1 -- 172.21.15.164:0/919349218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc9728fc40 con 0x55bc9710a6d0 2024-09-13T23:05:54.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.478+0000 7f2a77fff640 1 -- 172.21.15.164:0/919349218 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2b800685c0 con 0x55bc9710a6d0 2024-09-13T23:05:54.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.479+0000 7f2a77fff640 1 --2- 172.21.15.164:0/919349218 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2a78036b90 0x7f2a78039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.479+0000 7f2a77fff640 1 -- 172.21.15.164:0/919349218 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2b80070070 con 0x55bc9710a6d0 2024-09-13T23:05:54.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.479+0000 7f2b874c9640 1 --2- 172.21.15.164:0/919349218 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2a78036b90 0x7f2a78039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.479+0000 7f2b93f40800 1 --2- 172.21.15.164:0/919349218 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55bc971996a0 0x55bc972962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.479+0000 7f2b93f40800 1 -- 172.21.15.164:0/919349218 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bc97296810 con 0x55bc971996a0 2024-09-13T23:05:54.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.479+0000 7f2b904cb640 1 --2- 172.21.15.164:0/919349218 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55bc971996a0 0x55bc972962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.479+0000 7f2b874c9640 1 --2- 172.21.15.164:0/919349218 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2a78036b90 0x7f2a78039050 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2b78000c00 tx=0x7f2b780013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.479+0000 7f2b904cb640 1 --2- 172.21.15.164:0/919349218 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55bc971996a0 0x55bc972962d0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.479+0000 7f2b904cb640 1 -- 172.21.15.164:0/919349218 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b8800a4a0 con 0x55bc971996a0 2024-09-13T23:05:54.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.479+0000 7f2b93f40800 1 -- 172.21.15.164:0/919349218 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bc97293840 con 0x55bc971996a0 2024-09-13T23:05:54.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.480+0000 7f2b904cb640 1 -- 172.21.15.164:0/919349218 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2b8800a4a0 con 0x55bc971996a0 2024-09-13T23:05:54.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.480+0000 7f2b93f40800 1 -- 172.21.15.164:0/919349218 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bc972985d0 con 0x55bc971996a0 2024-09-13T23:05:54.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.480+0000 7f2b904cb640 1 -- 172.21.15.164:0/919349218 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2b8800a4a0 con 0x55bc971996a0 2024-09-13T23:05:54.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.480+0000 7f2b93f40800 1 -- 172.21.15.164:0/919349218 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bc97297650 con 0x55bc971996a0 2024-09-13T23:05:54.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.480+0000 7f2b904cb640 1 -- 172.21.15.164:0/919349218 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2b8800a4a0 con 0x55bc971996a0 2024-09-13T23:05:54.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.480+0000 7f2b93f40800 1 -- 172.21.15.164:0/919349218 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bc97297a70 con 0x55bc971996a0 2024-09-13T23:05:54.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.481+0000 7f2b904cb640 1 -- 172.21.15.164:0/919349218 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2b8800a4a0 con 0x55bc971996a0 2024-09-13T23:05:54.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.481+0000 7f2b93f40800 1 Processor -- start 2024-09-13T23:05:54.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.481+0000 7f2b93f40800 1 -- start start 2024-09-13T23:05:54.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.481+0000 7f2b93f40800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc972a6b20 0x55bc972a6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.481+0000 7f2b93f40800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55bc97031580 con 0x55bc972a6b20 2024-09-13T23:05:54.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.481+0000 7f2b874c9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc972a6b20 0x55bc972a6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.481+0000 7f2b874c9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc972a6b20 0x55bc972a6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37938/0 (socket says 172.21.15.164:37938) 2024-09-13T23:05:54.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.481+0000 7f2b874c9640 1 -- 172.21.15.164:0/2836904327 learned_addr learned my addr 172.21.15.164:0/2836904327 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:54.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.482+0000 7f2b874c9640 1 -- 172.21.15.164:0/2836904327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc972a7480 con 0x55bc972a6b20 2024-09-13T23:05:54.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.482+0000 7f2b874c9640 1 --2- 172.21.15.164:0/2836904327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc972a6b20 0x55bc972a6f40 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800e610 tx=0x7f2b7800ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.482+0000 7f2a757fa640 1 -- 172.21.15.164:0/2836904327 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b78022070 con 0x55bc972a6b20 2024-09-13T23:05:54.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.482+0000 7f2a757fa640 1 -- 172.21.15.164:0/2836904327 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b78009050 con 0x55bc972a6b20 2024-09-13T23:05:54.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.482+0000 7f2b93f40800 1 -- 172.21.15.164:0/2836904327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bc972a7710 con 0x55bc972a6b20 2024-09-13T23:05:54.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.482+0000 7f2a757fa640 1 -- 172.21.15.164:0/2836904327 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b7800d500 con 0x55bc972a6b20 2024-09-13T23:05:54.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.482+0000 7f2b93f40800 1 -- 172.21.15.164:0/2836904327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc972aa3f0 con 0x55bc972a6b20 2024-09-13T23:05:54.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.483+0000 7f2a757fa640 1 -- 172.21.15.164:0/2836904327 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2b78025070 con 0x55bc972a6b20 2024-09-13T23:05:54.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.483+0000 7f2a757fa640 1 --2- 172.21.15.164:0/2836904327 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2a68036b90 0x7f2a68039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.483+0000 7f2a757fa640 1 -- 172.21.15.164:0/2836904327 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2b7804def0 con 0x55bc972a6b20 2024-09-13T23:05:54.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.483+0000 7f2b904cb640 1 --2- 172.21.15.164:0/2836904327 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2a68036b90 0x7f2a68039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.483+0000 7f2b93f40800 1 Processor -- start 2024-09-13T23:05:54.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.484+0000 7f2b904cb640 1 --2- 172.21.15.164:0/2836904327 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2a68036b90 0x7f2a68039050 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55bc972979f0 tx=0x7f2b88005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.484+0000 7f2b93f40800 1 -- start start 2024-09-13T23:05:54.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.484+0000 7f2b93f40800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc972b3840 0x55bc972b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.484+0000 7f2b93f40800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55bc97195100 con 0x55bc972b3840 2024-09-13T23:05:54.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.484+0000 7f2b874c9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc972b3840 0x55bc972b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.484+0000 7f2b874c9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc972b3840 0x55bc972b3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37940/0 (socket says 172.21.15.164:37940) 2024-09-13T23:05:54.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.484+0000 7f2b874c9640 1 -- 172.21.15.164:0/4084118165 learned_addr learned my addr 172.21.15.164:0/4084118165 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:54.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.484+0000 7f2b874c9640 1 -- 172.21.15.164:0/4084118165 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc972b4210 con 0x55bc972b3840 2024-09-13T23:05:54.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.484+0000 7f2b874c9640 1 --2- 172.21.15.164:0/4084118165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc972b3840 0x55bc972b3c40 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800ee80 tx=0x7f2b78024eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd916f62b82e434 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.484+0000 7f2a6effd640 1 -- 172.21.15.164:0/4084118165 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b78025360 con 0x55bc972b3840 2024-09-13T23:05:54.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.484+0000 7f2a6effd640 1 -- 172.21.15.164:0/4084118165 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b78025500 con 0x55bc972b3840 2024-09-13T23:05:54.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.485+0000 7f2a6effd640 1 -- 172.21.15.164:0/4084118165 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b78025820 con 0x55bc972b3840 2024-09-13T23:05:54.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.485+0000 7f2b93f40800 1 -- 172.21.15.164:0/4084118165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc972b3840 msgr2=0x55bc972b3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.485+0000 7f2b93f40800 1 --2- 172.21.15.164:0/4084118165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc972b3840 0x55bc972b3c40 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800ee80 tx=0x7f2b78024eb0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.485+0000 7f2b93f40800 1 -- 172.21.15.164:0/4084118165 shutdown_connections 2024-09-13T23:05:54.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.485+0000 7f2b93f40800 1 --2- 172.21.15.164:0/4084118165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc972b3840 0x55bc972b3c40 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.485+0000 7f2b93f40800 1 -- 172.21.15.164:0/4084118165 >> 172.21.15.164:0/4084118165 conn(0x55bc972afba0 msgr2=0x55bc972adca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.485+0000 7f2b93f40800 1 -- 172.21.15.164:0/4084118165 shutdown_connections 2024-09-13T23:05:54.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.485+0000 7f2b93f40800 1 -- 172.21.15.164:0/4084118165 wait complete. 2024-09-13T23:05:54.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.485+0000 7f2b93f40800 1 Processor -- start 2024-09-13T23:05:54.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.485+0000 7f2b93f40800 1 -- start start 2024-09-13T23:05:54.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.485+0000 7f2b93f40800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc972b3840 0x55bc972bad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.485+0000 7f2b93f40800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55bc972b4880 con 0x55bc972b3840 2024-09-13T23:05:54.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.486+0000 7f2b874c9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc972b3840 0x55bc972bad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.486+0000 7f2b874c9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc972b3840 0x55bc972bad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37950/0 (socket says 172.21.15.164:37950) 2024-09-13T23:05:54.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.486+0000 7f2b874c9640 1 -- 172.21.15.164:0/1413421396 learned_addr learned my addr 172.21.15.164:0/1413421396 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.486+0000 7f2b874c9640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc972bb240 con 0x55bc972b3840 2024-09-13T23:05:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.486+0000 7f2b874c9640 1 --2- 172.21.15.164:0/1413421396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc972b3840 0x55bc972bad00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2b7804c240 tx=0x7f2b7804c110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.486+0000 7f2a6d7fa640 1 -- 172.21.15.164:0/1413421396 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b7803a070 con 0x55bc972b3840 2024-09-13T23:05:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.486+0000 7f2a6d7fa640 1 -- 172.21.15.164:0/1413421396 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b7800d6a0 con 0x55bc972b3840 2024-09-13T23:05:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.486+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bc972bb4d0 con 0x55bc972b3840 2024-09-13T23:05:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.486+0000 7f2a6d7fa640 1 -- 172.21.15.164:0/1413421396 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b780248b0 con 0x55bc972b3840 2024-09-13T23:05:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.486+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc972bb4d0 con 0x55bc972b3840 2024-09-13T23:05:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.487+0000 7f2a6d7fa640 1 -- 172.21.15.164:0/1413421396 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2b7803f290 con 0x55bc972b3840 2024-09-13T23:05:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.487+0000 7f2a6d7fa640 1 --2- 172.21.15.164:0/1413421396 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2a58036b40 0x7f2a58039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.487+0000 7f2a6d7fa640 1 -- 172.21.15.164:0/1413421396 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2b78050020 con 0x55bc972b3840 2024-09-13T23:05:54.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.487+0000 7f2b904cb640 1 --2- 172.21.15.164:0/1413421396 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2a58036b40 0x7f2a58039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.488+0000 7f2b904cb640 1 --2- 172.21.15.164:0/1413421396 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2a58036b40 0x7f2a58039000 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55bc97297170 tx=0x7f2b8801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.488+0000 7f2b93f40800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.488+0000 7f2b93f40800 1 --2- 172.21.15.164:0/1413421396 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55bc972c6630 0x55bc972c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.488+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bc972c9240 con 0x55bc972c6630 2024-09-13T23:05:54.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.488+0000 7f2b8fcca640 1 --2- 172.21.15.164:0/1413421396 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55bc972c6630 0x55bc972c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.488+0000 7f2b8fcca640 1 --2- 172.21.15.164:0/1413421396 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55bc972c6630 0x55bc972c8af0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.488+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b80051070 con 0x55bc972c6630 2024-09-13T23:05:54.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.488+0000 7f2b93f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.488+0000 7f2b93f40800 20 realm 2024-09-13T23:05:54.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.488+0000 7f2b93f40800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.488+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bc972c9650 con 0x55bc972c6630 2024-09-13T23:05:54.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.489+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b80051070 con 0x55bc972c6630 2024-09-13T23:05:54.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.489+0000 7f2b93f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.489+0000 7f2b93f40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:54.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.489+0000 7f2b93f40800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.489+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bc972c9f20 con 0x55bc972c6630 2024-09-13T23:05:54.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.489+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b80051070 con 0x55bc972c6630 2024-09-13T23:05:54.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.489+0000 7f2b93f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.489+0000 7f2b93f40800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.489+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bc972ca2c0 con 0x55bc972c6630 2024-09-13T23:05:54.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.489+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2b80051070 con 0x55bc972c6630 2024-09-13T23:05:54.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.489+0000 7f2b93f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:54.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.489+0000 7f2b93f40800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.489+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x55bc972c6630 2024-09-13T23:05:54.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.489+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2b80051070 con 0x55bc972c6630 2024-09-13T23:05:54.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.489+0000 7f2b93f40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:54.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.489+0000 7f2b93f40800 20 searching for the correct realm 2024-09-13T23:05:54.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.489+0000 7f2b93f40800 1 --2- 172.21.15.164:0/1413421396 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55bc972cc880 0x55bc972cec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.489+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cf250 con 0x55bc972cc880 2024-09-13T23:05:54.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.490+0000 7f2b874c9640 1 --2- 172.21.15.164:0/1413421396 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55bc972cc880 0x55bc972cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.490+0000 7f2b874c9640 1 --2- 172.21.15.164:0/1413421396 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55bc972cc880 0x55bc972cec70 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.490+0000 7f2b874c9640 1 -- 172.21.15.164:0/1413421396 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b78032070 con 0x55bc972cc880 2024-09-13T23:05:54.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.490+0000 7f2b874c9640 1 --2- 172.21.15.164:0/1413421396 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f2b78027060 0x7f2b78027440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.490+0000 7f2b874c9640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cf250 con 0x7f2b78027060 2024-09-13T23:05:54.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.490+0000 7f2b904cb640 1 --2- 172.21.15.164:0/1413421396 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f2b78027060 0x7f2b78027440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.490+0000 7f2b904cb640 1 --2- 172.21.15.164:0/1413421396 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f2b78027060 0x7f2b78027440 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.491+0000 7f2b904cb640 1 -- 172.21.15.164:0/1413421396 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8801f070 con 0x7f2b78027060 2024-09-13T23:05:54.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.491+0000 7f2b904cb640 1 --2- 172.21.15.164:0/1413421396 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f2b88031040 0x7f2b88032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.491+0000 7f2b904cb640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cf250 con 0x7f2b88031040 2024-09-13T23:05:54.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.491+0000 7f2b8fcca640 1 --2- 172.21.15.164:0/1413421396 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f2b88031040 0x7f2b88032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.491+0000 7f2b8fcca640 1 --2- 172.21.15.164:0/1413421396 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f2b88031040 0x7f2b88032940 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.491+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80051070 con 0x7f2b88031040 2024-09-13T23:05:54.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.492+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x55bc972c6630 2024-09-13T23:05:54.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.492+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2b80051070 con 0x55bc972c6630 2024-09-13T23:05:54.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.492+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x55bc972c6630 2024-09-13T23:05:54.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.492+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80051070 con 0x55bc972c6630 2024-09-13T23:05:54.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.492+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x7f2b88031040 2024-09-13T23:05:54.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.492+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80051070 con 0x7f2b88031040 2024-09-13T23:05:54.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.492+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x7f2b88031040 2024-09-13T23:05:54.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.492+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80051070 con 0x7f2b88031040 2024-09-13T23:05:54.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.493+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x7f2b78027060 2024-09-13T23:05:54.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.493+0000 7f2b904cb640 1 -- 172.21.15.164:0/1413421396 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8801f070 con 0x7f2b78027060 2024-09-13T23:05:54.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.493+0000 7f2b904cb640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x55bc972cc880 2024-09-13T23:05:54.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.493+0000 7f2b874c9640 1 -- 172.21.15.164:0/1413421396 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b78032070 con 0x55bc972cc880 2024-09-13T23:05:54.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.493+0000 7f2b874c9640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x55bc972c6630 2024-09-13T23:05:54.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.493+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80051070 con 0x55bc972c6630 2024-09-13T23:05:54.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.493+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x7f2b88031040 2024-09-13T23:05:54.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.493+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80051070 con 0x7f2b88031040 2024-09-13T23:05:54.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.493+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x55bc972c6630 2024-09-13T23:05:54.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.494+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80051070 con 0x55bc972c6630 2024-09-13T23:05:54.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.494+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x7f2b78027060 2024-09-13T23:05:54.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.494+0000 7f2b904cb640 1 -- 172.21.15.164:0/1413421396 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2b8801f070 con 0x7f2b78027060 2024-09-13T23:05:54.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.494+0000 7f2b904cb640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x55bc972cc880 2024-09-13T23:05:54.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.494+0000 7f2b874c9640 1 -- 172.21.15.164:0/1413421396 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b78032070 con 0x55bc972cc880 2024-09-13T23:05:54.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.494+0000 7f2b874c9640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x55bc972cc880 2024-09-13T23:05:54.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.494+0000 7f2b874c9640 1 -- 172.21.15.164:0/1413421396 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b78032070 con 0x55bc972cc880 2024-09-13T23:05:54.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.494+0000 7f2b874c9640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x7f2b88031040 2024-09-13T23:05:54.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.495+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80051070 con 0x7f2b88031040 2024-09-13T23:05:54.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.495+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x55bc972cc880 2024-09-13T23:05:54.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.495+0000 7f2b874c9640 1 -- 172.21.15.164:0/1413421396 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b78032070 con 0x55bc972cc880 2024-09-13T23:05:54.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.495+0000 7f2b874c9640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x55bc972cc880 2024-09-13T23:05:54.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.495+0000 7f2b874c9640 1 -- 172.21.15.164:0/1413421396 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b78032070 con 0x55bc972cc880 2024-09-13T23:05:54.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.495+0000 7f2b874c9640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x55bc972c6630 2024-09-13T23:05:54.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.495+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80051070 con 0x55bc972c6630 2024-09-13T23:05:54.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.495+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x55bc972c6630 2024-09-13T23:05:54.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.495+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2b80051070 con 0x55bc972c6630 2024-09-13T23:05:54.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.495+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x7f2b88031040 2024-09-13T23:05:54.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.496+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80051070 con 0x7f2b88031040 2024-09-13T23:05:54.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.496+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x55bc972cc880 2024-09-13T23:05:54.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.496+0000 7f2b874c9640 1 -- 172.21.15.164:0/1413421396 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b78032070 con 0x55bc972cc880 2024-09-13T23:05:54.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.496+0000 7f2b874c9640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x7f2b78027060 2024-09-13T23:05:54.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.496+0000 7f2b904cb640 1 -- 172.21.15.164:0/1413421396 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8801f070 con 0x7f2b78027060 2024-09-13T23:05:54.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.496+0000 7f2b904cb640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x55bc972c6630 2024-09-13T23:05:54.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.496+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2b80051070 con 0x55bc972c6630 2024-09-13T23:05:54.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.496+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x7f2b88031040 2024-09-13T23:05:54.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.497+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80051070 con 0x7f2b88031040 2024-09-13T23:05:54.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.497+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x55bc972cc880 2024-09-13T23:05:54.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.497+0000 7f2b874c9640 1 -- 172.21.15.164:0/1413421396 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b78032070 con 0x55bc972cc880 2024-09-13T23:05:54.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.497+0000 7f2b874c9640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x7f2b88031040 2024-09-13T23:05:54.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.497+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b80051070 con 0x7f2b88031040 2024-09-13T23:05:54.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.497+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x7f2b78027060 2024-09-13T23:05:54.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.497+0000 7f2b904cb640 1 -- 172.21.15.164:0/1413421396 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8801f070 con 0x7f2b78027060 2024-09-13T23:05:54.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.498+0000 7f2b904cb640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x55bc972cc880 2024-09-13T23:05:54.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.498+0000 7f2b874c9640 1 -- 172.21.15.164:0/1413421396 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b78032070 con 0x55bc972cc880 2024-09-13T23:05:54.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.498+0000 7f2b874c9640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x7f2b78027060 2024-09-13T23:05:54.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.498+0000 7f2b904cb640 1 -- 172.21.15.164:0/1413421396 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b8801f070 con 0x7f2b78027060 2024-09-13T23:05:54.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.498+0000 7f2b904cb640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x55bc972c6630 2024-09-13T23:05:54.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.498+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2b80051070 con 0x55bc972c6630 2024-09-13T23:05:54.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.498+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cab10 con 0x7f2b78027060 2024-09-13T23:05:54.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.498+0000 7f2b904cb640 1 -- 172.21.15.164:0/1413421396 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b88040040 con 0x7f2b78027060 2024-09-13T23:05:54.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.498+0000 7f2b93f40800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:54.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.498+0000 7f2b93f40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:54.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.498+0000 7f2b93f40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:54.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.498+0000 7f2b93f40800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:54.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.498+0000 7f2b93f40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:54.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.498+0000 7f2b93f40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:54.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.498+0000 7f2b93f40800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.498+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cb360 con 0x55bc972c6630 2024-09-13T23:05:54.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.499+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b80051070 con 0x55bc972c6630 2024-09-13T23:05:54.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.499+0000 7f2b93f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.499+0000 7f2b93f40800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.499+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cb750 con 0x55bc972c6630 2024-09-13T23:05:54.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.499+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2b80051070 con 0x55bc972c6630 2024-09-13T23:05:54.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.499+0000 7f2b93f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:54.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.499+0000 7f2b93f40800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.499+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cb750 con 0x55bc972c6630 2024-09-13T23:05:54.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.499+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2b80051070 con 0x55bc972c6630 2024-09-13T23:05:54.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.499+0000 7f2b93f40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:54.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.499+0000 7f2b93f40800 20 zone default found 2024-09-13T23:05:54.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.499+0000 7f2b93f40800 4 Realm: () 2024-09-13T23:05:54.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.499+0000 7f2b93f40800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:54.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.499+0000 7f2b93f40800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:54.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.499+0000 7f2b93f40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:54.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.499+0000 7f2b93f40800 20 zonegroup default 2024-09-13T23:05:54.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.499+0000 7f2b93f40800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.499+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bc972cf6d0 con 0x7f2b88031040 2024-09-13T23:05:54.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.500+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2b80051070 con 0x7f2b88031040 2024-09-13T23:05:54.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.500+0000 7f2b93f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.500+0000 7f2b93f40800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.500+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bc972d10b0 con 0x55bc972cc880 2024-09-13T23:05:54.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.500+0000 7f2b874c9640 1 -- 172.21.15.164:0/1413421396 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2b78032070 con 0x55bc972cc880 2024-09-13T23:05:54.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.500+0000 7f2b93f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.500+0000 7f2b93f40800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.500+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bc972d1450 con 0x55bc972cc880 2024-09-13T23:05:54.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.500+0000 7f2b874c9640 1 -- 172.21.15.164:0/1413421396 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2b78032070 con 0x55bc972cc880 2024-09-13T23:05:54.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.500+0000 7f2b93f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.500+0000 7f2b93f40800 20 started sync module instance, tier type = 2024-09-13T23:05:54.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.500+0000 7f2b93f40800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:54.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.500+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bc972d0550 con 0x7f2b78027060 2024-09-13T23:05:54.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.501+0000 7f2b904cb640 1 -- 172.21.15.164:0/1413421396 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b88040040 con 0x7f2b78027060 2024-09-13T23:05:54.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.501+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94268478521504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bc972d17f0 con 0x7f2b78027060 2024-09-13T23:05:54.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.501+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bc972d21b0 con 0x55bc972c6630 2024-09-13T23:05:54.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.502+0000 7f2b904cb640 1 -- 172.21.15.164:0/1413421396 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94268478521504] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b88040040 con 0x7f2b78027060 2024-09-13T23:05:54.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.502+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80051070 con 0x55bc972c6630 2024-09-13T23:05:54.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.502+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94268478523760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bc972d21b0 con 0x55bc972c6630 2024-09-13T23:05:54.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.502+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bc972d2bf0 con 0x55bc972cc880 2024-09-13T23:05:54.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.503+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94268478523760] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80051070 con 0x55bc972c6630 2024-09-13T23:05:54.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.503+0000 7f2b874c9640 1 -- 172.21.15.164:0/1413421396 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b78032070 con 0x55bc972cc880 2024-09-13T23:05:54.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.503+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94268478528768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bc972d2120 con 0x55bc972cc880 2024-09-13T23:05:54.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.503+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bc972d3ab0 con 0x7f2b78027060 2024-09-13T23:05:54.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.504+0000 7f2b904cb640 1 -- 172.21.15.164:0/1413421396 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b88040040 con 0x7f2b78027060 2024-09-13T23:05:54.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.504+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94268478535648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bc972d42b0 con 0x7f2b78027060 2024-09-13T23:05:54.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.504+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bc972d4dd0 con 0x55bc972c6630 2024-09-13T23:05:54.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.505+0000 7f2b874c9640 1 -- 172.21.15.164:0/1413421396 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94268478528768] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b78032070 con 0x55bc972cc880 2024-09-13T23:05:54.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.506+0000 7f2b904cb640 1 -- 172.21.15.164:0/1413421396 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94268478535648] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b88040040 con 0x7f2b78027060 2024-09-13T23:05:54.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.506+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80051070 con 0x55bc972c6630 2024-09-13T23:05:54.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.506+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94268478539936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bc972d4d90 con 0x55bc972c6630 2024-09-13T23:05:54.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.506+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bc972d5670 con 0x7f2b88031040 2024-09-13T23:05:54.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.507+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94268478539936] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80051070 con 0x55bc972c6630 2024-09-13T23:05:54.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.507+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80051070 con 0x7f2b88031040 2024-09-13T23:05:54.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.507+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94268478533600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bc972d4d90 con 0x7f2b88031040 2024-09-13T23:05:54.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.507+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bc972d5ca0 con 0x7f2b88031040 2024-09-13T23:05:54.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.508+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94268478533600] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80051070 con 0x7f2b88031040 2024-09-13T23:05:54.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.508+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80051070 con 0x7f2b88031040 2024-09-13T23:05:54.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.508+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94268478543760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bc972d5c60 con 0x7f2b88031040 2024-09-13T23:05:54.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.508+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bc972d66b0 con 0x7f2b88031040 2024-09-13T23:05:54.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.509+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94268478543760] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80051070 con 0x7f2b88031040 2024-09-13T23:05:54.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.509+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80051070 con 0x7f2b88031040 2024-09-13T23:05:54.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.509+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94268478542192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bc972d66b0 con 0x7f2b88031040 2024-09-13T23:05:54.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.509+0000 7f2b93f40800 20 add_watcher() i=0 2024-09-13T23:05:54.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.509+0000 7f2b93f40800 20 add_watcher() i=1 2024-09-13T23:05:54.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.509+0000 7f2b93f40800 20 add_watcher() i=2 2024-09-13T23:05:54.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.509+0000 7f2b93f40800 20 add_watcher() i=3 2024-09-13T23:05:54.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.509+0000 7f2b93f40800 20 add_watcher() i=4 2024-09-13T23:05:54.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.509+0000 7f2b93f40800 20 add_watcher() i=5 2024-09-13T23:05:54.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.509+0000 7f2b93f40800 20 add_watcher() i=6 2024-09-13T23:05:54.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.510+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94268478542192] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80051070 con 0x7f2b88031040 2024-09-13T23:05:54.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.510+0000 7f2b93f40800 20 add_watcher() i=7 2024-09-13T23:05:54.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.510+0000 7f2b93f40800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:54.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.510+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bc972d9ad0 con 0x55bc972c6630 2024-09-13T23:05:54.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.510+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2b80051070 con 0x55bc972c6630 2024-09-13T23:05:54.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.510+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94268478546944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bc972d6fa0 con 0x55bc972c6630 2024-09-13T23:05:54.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.511+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94268478546944] v34'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2b80051070 con 0x55bc972c6630 2024-09-13T23:05:54.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.511+0000 7f2a45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:54.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.512+0000 7f2b93f40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:54.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.512+0000 7f2b93f40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:54.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.512+0000 7f2b93f40800 5 note: GC not initialized 2024-09-13T23:05:54.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.512+0000 7f2a44fe1640 20 reqs_thread_entry: start 2024-09-13T23:05:54.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.512+0000 7f2b93f40800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:54.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.512+0000 7f2b93f40800 20 Filter name: none 2024-09-13T23:05:54.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.512+0000 7f29be7fc640 20 reqs_thread_entry: start 2024-09-13T23:05:54.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.512+0000 7f2b93f40800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:05:54.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.512+0000 7f2b93f40800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.512+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bc9730d400 con 0x7f2b78027060 2024-09-13T23:05:54.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.513+0000 7f2b904cb640 1 -- 172.21.15.164:0/1413421396 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv34 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f2b88040040 con 0x7f2b78027060 2024-09-13T23:05:54.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.513+0000 7f2b93f40800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:05:54.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.513+0000 7f2b93f40800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:05:54.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.513+0000 7f2b93f40800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:05:54.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.513+0000 7f2b93f40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5 : miss 2024-09-13T23:05:54.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.513+0000 7f2b93f40800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.513+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:63 8.9 8:90242e25:root::.bucket.meta.myfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bc9730f020 con 0x7f2b78027060 2024-09-13T23:05:54.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.513+0000 7f2b904cb640 1 -- 172.21.15.164:0/1413421396 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(63 .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv33 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f2b88040040 con 0x7f2b78027060 2024-09-13T23:05:54.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.513+0000 7f2b93f40800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:05:54.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.513+0000 7f2b93f40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5 info.flags=0x17 2024-09-13T23:05:54.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.513+0000 7f2b93f40800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5 to cache LRU end 2024-09-13T23:05:54.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.513+0000 7f2b93f40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:54.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.513+0000 7f2b93f40800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:05:54.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.513+0000 7f2b93f40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5 2024-09-13T23:05:54.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.513+0000 7f2b93f40800 20 get_obj_state: octx=0x7f2b8005ff80 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55bc973116a8 s->prefetch_data=0 2024-09-13T23:05:54.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.513+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 3.7s0 3:e38cefd1:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bc973127c0 con 0x55bc972cc880 2024-09-13T23:05:54.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.514+0000 7f2b874c9640 1 -- 172.21.15.164:0/1413421396 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=848b,stat out=16b] v0'0 uv4 ondisk = 0) ==== 262+0+864 (crc 0 0 0) 0x7f2b78032070 con 0x55bc972cc880 2024-09-13T23:05:54.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.514+0000 7f2b93f40800 10 manifest: total_size = 5 2024-09-13T23:05:54.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.514+0000 7f2b93f40800 20 get_obj_state: setting s->obj_tag to _tK7yVYJiVxS1XEJ5uc92hHX6zBB-2zi 2024-09-13T23:05:54.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.514+0000 7f2a45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:54.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.514+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94268478546944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bc973121b0 con 0x55bc972c6630 2024-09-13T23:05:54.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.515+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94268478546944] v34'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2b80051070 con 0x55bc972c6630 2024-09-13T23:05:54.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.515+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94268478521504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bc973121b0 con 0x7f2b78027060 2024-09-13T23:05:54.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.516+0000 7f2b904cb640 1 -- 172.21.15.164:0/1413421396 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94268478521504] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b88040040 con 0x7f2b78027060 2024-09-13T23:05:54.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.516+0000 7f2b93f40800 20 remove_watcher() i=0 2024-09-13T23:05:54.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.516+0000 7f2b93f40800 2 removed watcher, disabling cache 2024-09-13T23:05:54.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.517+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94268478523760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bc973121b0 con 0x55bc972c6630 2024-09-13T23:05:54.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.518+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94268478523760] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80051070 con 0x55bc972c6630 2024-09-13T23:05:54.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.518+0000 7f2b93f40800 20 remove_watcher() i=1 2024-09-13T23:05:54.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.518+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94268478528768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bc973121b0 con 0x55bc972cc880 2024-09-13T23:05:54.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.519+0000 7f2b874c9640 1 -- 172.21.15.164:0/1413421396 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94268478528768] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b78032070 con 0x55bc972cc880 2024-09-13T23:05:54.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.519+0000 7f2b93f40800 20 remove_watcher() i=2 2024-09-13T23:05:54.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.519+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94268478535648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bc972d00a0 con 0x7f2b78027060 2024-09-13T23:05:54.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.520+0000 7f2b904cb640 1 -- 172.21.15.164:0/1413421396 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94268478535648] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b88040040 con 0x7f2b78027060 2024-09-13T23:05:54.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.520+0000 7f2b93f40800 20 remove_watcher() i=3 2024-09-13T23:05:54.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.520+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94268478539936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bc972d0970 con 0x55bc972c6630 2024-09-13T23:05:54.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.521+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94268478539936] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80051070 con 0x55bc972c6630 2024-09-13T23:05:54.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.521+0000 7f2b93f40800 20 remove_watcher() i=4 2024-09-13T23:05:54.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.521+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94268478533600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bc972d1d00 con 0x7f2b88031040 2024-09-13T23:05:54.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.522+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94268478533600] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80051070 con 0x7f2b88031040 2024-09-13T23:05:54.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.522+0000 7f2b93f40800 20 remove_watcher() i=5 2024-09-13T23:05:54.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.522+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94268478543760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bc972d00a0 con 0x7f2b88031040 2024-09-13T23:05:54.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.523+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94268478543760] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80051070 con 0x7f2b88031040 2024-09-13T23:05:54.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.523+0000 7f2b93f40800 20 remove_watcher() i=6 2024-09-13T23:05:54.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.523+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94268478542192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bc972d0970 con 0x7f2b88031040 2024-09-13T23:05:54.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94268478542192] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b80051070 con 0x7f2b88031040 2024-09-13T23:05:54.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b93f40800 20 remove_watcher() i=7 2024-09-13T23:05:54.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f2b88031040 msgr2=0x7f2b88032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b93f40800 1 --2- 172.21.15.164:0/1413421396 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f2b88031040 0x7f2b88032940 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55bc972c6630 msgr2=0x55bc972c8af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b93f40800 1 --2- 172.21.15.164:0/1413421396 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55bc972c6630 0x55bc972c8af0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f2b78027060 msgr2=0x7f2b78027440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b93f40800 1 --2- 172.21.15.164:0/1413421396 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f2b78027060 0x7f2b78027440 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55bc972cc880 msgr2=0x55bc972cec70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b93f40800 1 --2- 172.21.15.164:0/1413421396 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55bc972cc880 0x55bc972cec70 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2a58036b40 msgr2=0x7f2a58039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b93f40800 1 --2- 172.21.15.164:0/1413421396 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2a58036b40 0x7f2a58039000 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55bc97297170 tx=0x7f2b8801f000 comp rx=0 tx=0).stop 2024-09-13T23:05:54.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc972b3840 msgr2=0x55bc972bad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b8fcca640 1 -- 172.21.15.164:0/1413421396 reap_dead start 2024-09-13T23:05:54.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b93f40800 1 --2- 172.21.15.164:0/1413421396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc972b3840 0x55bc972bad00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2b7804c240 tx=0x7f2b7804c110 comp rx=0 tx=0).stop 2024-09-13T23:05:54.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 shutdown_connections 2024-09-13T23:05:54.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b93f40800 1 --2- 172.21.15.164:0/1413421396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc972b3840 0x55bc972bad00 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 >> 172.21.15.164:0/1413421396 conn(0x55bc972afba0 msgr2=0x55bc972adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 shutdown_connections 2024-09-13T23:05:54.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b93f40800 1 -- 172.21.15.164:0/1413421396 wait complete. 2024-09-13T23:05:54.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b93f40800 1 -- 172.21.15.164:0/2836904327 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2a68036b90 msgr2=0x7f2a68039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b93f40800 1 --2- 172.21.15.164:0/2836904327 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2a68036b90 0x7f2a68039050 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55bc972979f0 tx=0x7f2b88005840 comp rx=0 tx=0).stop 2024-09-13T23:05:54.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b93f40800 1 -- 172.21.15.164:0/2836904327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc972a6b20 msgr2=0x55bc972a6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b93f40800 1 --2- 172.21.15.164:0/2836904327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc972a6b20 0x55bc972a6f40 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800e610 tx=0x7f2b7800ff90 comp rx=0 tx=0).stop 2024-09-13T23:05:54.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b93f40800 1 -- 172.21.15.164:0/2836904327 shutdown_connections 2024-09-13T23:05:54.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b93f40800 1 --2- 172.21.15.164:0/2836904327 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2a68036b90 0x7f2a68039050 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b93f40800 1 --2- 172.21.15.164:0/2836904327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc972a6b20 0x55bc972a6f40 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b93f40800 1 -- 172.21.15.164:0/2836904327 >> 172.21.15.164:0/2836904327 conn(0x55bc9729bab0 msgr2=0x55bc9729e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b93f40800 1 -- 172.21.15.164:0/2836904327 shutdown_connections 2024-09-13T23:05:54.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.524+0000 7f2b93f40800 1 -- 172.21.15.164:0/2836904327 wait complete. 2024-09-13T23:05:54.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.525+0000 7f2b93f40800 1 -- 172.21.15.164:0/919349218 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55bc971996a0 msgr2=0x55bc972962d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.525+0000 7f2b93f40800 1 --2- 172.21.15.164:0/919349218 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55bc971996a0 0x55bc972962d0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.525+0000 7f2b93f40800 1 -- 172.21.15.164:0/919349218 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2a78036b90 msgr2=0x7f2a78039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.525+0000 7f2b93f40800 1 --2- 172.21.15.164:0/919349218 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2a78036b90 0x7f2a78039050 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2b78000c00 tx=0x7f2b780013b0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.525+0000 7f2b93f40800 1 -- 172.21.15.164:0/919349218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9710a6d0 msgr2=0x55bc9728f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.525+0000 7f2b93f40800 1 --2- 172.21.15.164:0/919349218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9710a6d0 0x55bc9728f260 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2b80045f20 tx=0x7f2b80002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.525+0000 7f2b93f40800 1 -- 172.21.15.164:0/919349218 shutdown_connections 2024-09-13T23:05:54.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.525+0000 7f2b93f40800 1 --2- 172.21.15.164:0/919349218 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55bc971996a0 0x55bc972962d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.525+0000 7f2b93f40800 1 --2- 172.21.15.164:0/919349218 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2a78036b90 0x7f2a78039050 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.525+0000 7f2b93f40800 1 --2- 172.21.15.164:0/919349218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc9710a6d0 0x55bc9728f260 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.525+0000 7f2b93f40800 1 -- 172.21.15.164:0/919349218 >> 172.21.15.164:0/919349218 conn(0x55bc97190db0 msgr2=0x55bc97280c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.525+0000 7f2b93f40800 1 -- 172.21.15.164:0/919349218 shutdown_connections 2024-09-13T23:05:54.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.525+0000 7f2b93f40800 1 -- 172.21.15.164:0/919349218 wait complete. 2024-09-13T23:05:54.548 INFO:teuthology.orchestra.run.smithi164.stdout:fooFoofooFooFULL_CONTROL 2024-09-13T23:05:54.549 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-13T23:05:54.551 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-13T23:05:54.556 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:05:54.556 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T23:05:54.556 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T23:05:54.556 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-13T23:05:54.602 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:54.602 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:54.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.601+0000 7fedbbe30800 1 Processor -- start 2024-09-13T23:05:54.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.601+0000 7fedbbe30800 1 -- start start 2024-09-13T23:05:54.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.601+0000 7fedbbe30800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55939a2d8eb0 0x55939a368160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.601+0000 7fedbbe30800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55939a224b30 con 0x55939a3686a0 2024-09-13T23:05:54.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.601+0000 7fedbbe30800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55939a206360 con 0x55939a2d8eb0 2024-09-13T23:05:54.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.602+0000 7fedb7160640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55939a2d8eb0 0x55939a368160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.602+0000 7fedae95f640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55939a3686a0 0x55939a36aab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:53964/0 (socket says 172.21.15.164:53964) 2024-09-13T23:05:54.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.602+0000 7fedae95f640 1 -- 172.21.15.164:0/1085853704 learned_addr learned my addr 172.21.15.164:0/1085853704 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:54.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.602+0000 7fedb7160640 1 -- 172.21.15.164:0/1085853704 >> v1:172.21.15.17:6789/0 conn(0x55939a3686a0 legacy=0x55939a36aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.602+0000 7fedb7160640 1 -- 172.21.15.164:0/1085853704 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55939a22ce00 con 0x55939a2d8eb0 2024-09-13T23:05:54.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.602+0000 7fedb695f640 1 -- 172.21.15.164:0/1085853704 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4271546313 0 0) 0x55939a224b30 con 0x55939a3686a0 2024-09-13T23:05:54.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.604+0000 7fedb7160640 1 --2- 172.21.15.164:0/1085853704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a2d8eb0 0x55939a368160 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7feda800a470 tx=0x7feda8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9503b333f7c7cd6d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.604+0000 7fedb695f640 1 -- 172.21.15.164:0/1085853704 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feda8053570 con 0x55939a2d8eb0 2024-09-13T23:05:54.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.604+0000 7fedb695f640 1 -- 172.21.15.164:0/1085853704 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda8058070 con 0x55939a2d8eb0 2024-09-13T23:05:54.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.604+0000 7fedb695f640 1 -- 172.21.15.164:0/1085853704 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feda8053880 con 0x55939a2d8eb0 2024-09-13T23:05:54.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.605+0000 7fedbbe30800 1 -- 172.21.15.164:0/1085853704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a2d8eb0 msgr2=0x55939a368160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.605+0000 7fedbbe30800 1 --2- 172.21.15.164:0/1085853704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a2d8eb0 0x55939a368160 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7feda800a470 tx=0x7feda8045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:54.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.605+0000 7fedbbe30800 1 -- 172.21.15.164:0/1085853704 shutdown_connections 2024-09-13T23:05:54.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.605+0000 7fedbbe30800 1 --2- 172.21.15.164:0/1085853704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a2d8eb0 0x55939a368160 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.605+0000 7fedbbe30800 1 -- 172.21.15.164:0/1085853704 >> 172.21.15.164:0/1085853704 conn(0x55939a35fdd0 msgr2=0x55939a3621f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.605+0000 7fedbbe30800 1 -- 172.21.15.164:0/1085853704 shutdown_connections 2024-09-13T23:05:54.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.605+0000 7fedbbe30800 1 -- 172.21.15.164:0/1085853704 wait complete. 2024-09-13T23:05:54.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.618+0000 7fedbbe30800 1 Processor -- start 2024-09-13T23:05:54.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.618+0000 7fedbbe30800 1 -- start start 2024-09-13T23:05:54.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.619+0000 7fedbbe30800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a2d8eb0 0x55939a365a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.619+0000 7fedbbe30800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55939a2b1360 con 0x55939a2d8eb0 2024-09-13T23:05:54.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.619+0000 7fedb7160640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a2d8eb0 0x55939a365a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.619+0000 7fedb7160640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a2d8eb0 0x55939a365a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37964/0 (socket says 172.21.15.164:37964) 2024-09-13T23:05:54.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.619+0000 7fedb7160640 1 -- 172.21.15.164:0/1193854232 learned_addr learned my addr 172.21.15.164:0/1193854232 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:54.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.619+0000 7fedb7160640 1 -- 172.21.15.164:0/1193854232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55939a1febc0 con 0x55939a2d8eb0 2024-09-13T23:05:54.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.619+0000 7fedb7160640 1 --2- 172.21.15.164:0/1193854232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a2d8eb0 0x55939a365a90 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7feda8005870 tx=0x7feda8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c76536d470cc14 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.620+0000 7feca560a640 1 -- 172.21.15.164:0/1193854232 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feda805c580 con 0x55939a2d8eb0 2024-09-13T23:05:54.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.620+0000 7feca560a640 1 -- 172.21.15.164:0/1193854232 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda8063030 con 0x55939a2d8eb0 2024-09-13T23:05:54.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.620+0000 7feca560a640 1 -- 172.21.15.164:0/1193854232 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feda805c850 con 0x55939a2d8eb0 2024-09-13T23:05:54.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.620+0000 7fedbbe30800 1 -- 172.21.15.164:0/1193854232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a2d8eb0 msgr2=0x55939a365a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.620+0000 7fedbbe30800 1 --2- 172.21.15.164:0/1193854232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a2d8eb0 0x55939a365a90 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7feda8005870 tx=0x7feda8051000 comp rx=0 tx=0).stop 2024-09-13T23:05:54.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.620+0000 7fedbbe30800 1 -- 172.21.15.164:0/1193854232 shutdown_connections 2024-09-13T23:05:54.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.620+0000 7fedbbe30800 1 --2- 172.21.15.164:0/1193854232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a2d8eb0 0x55939a365a90 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.620+0000 7fedbbe30800 1 -- 172.21.15.164:0/1193854232 >> 172.21.15.164:0/1193854232 conn(0x55939a35fdd0 msgr2=0x55939a450110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.620+0000 7fedbbe30800 1 -- 172.21.15.164:0/1193854232 shutdown_connections 2024-09-13T23:05:54.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.620+0000 7fedbbe30800 1 -- 172.21.15.164:0/1193854232 wait complete. 2024-09-13T23:05:54.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.621+0000 7fedbbe30800 1 Processor -- start 2024-09-13T23:05:54.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.621+0000 7fedbbe30800 1 -- start start 2024-09-13T23:05:54.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.621+0000 7fedbbe30800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a2d8eb0 0x55939a45e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.621+0000 7fedbbe30800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55939a36c610 con 0x55939a2d8eb0 2024-09-13T23:05:54.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.621+0000 7fedb7160640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a2d8eb0 0x55939a45e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.621+0000 7fedb7160640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a2d8eb0 0x55939a45e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37966/0 (socket says 172.21.15.164:37966) 2024-09-13T23:05:54.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.621+0000 7fedb7160640 1 -- 172.21.15.164:0/194630771 learned_addr learned my addr 172.21.15.164:0/194630771 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:54.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.621+0000 7fedb7160640 1 -- 172.21.15.164:0/194630771 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55939a212fe0 con 0x55939a2d8eb0 2024-09-13T23:05:54.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.622+0000 7fedb7160640 1 --2- 172.21.15.164:0/194630771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a2d8eb0 0x55939a45e230 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7feda8045f50 tx=0x7feda8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.622+0000 7feca3e07640 1 -- 172.21.15.164:0/194630771 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feda8078070 con 0x55939a2d8eb0 2024-09-13T23:05:54.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.622+0000 7feca3e07640 1 -- 172.21.15.164:0/194630771 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda8054a70 con 0x55939a2d8eb0 2024-09-13T23:05:54.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.622+0000 7fedbbe30800 1 -- 172.21.15.164:0/194630771 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55939a45e770 con 0x55939a2d8eb0 2024-09-13T23:05:54.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.622+0000 7feca3e07640 1 -- 172.21.15.164:0/194630771 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feda8054d50 con 0x55939a2d8eb0 2024-09-13T23:05:54.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.622+0000 7fedbbe30800 1 -- 172.21.15.164:0/194630771 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55939a45ecf0 con 0x55939a2d8eb0 2024-09-13T23:05:54.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.623+0000 7feca3e07640 1 -- 172.21.15.164:0/194630771 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7feda807b070 con 0x55939a2d8eb0 2024-09-13T23:05:54.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.623+0000 7feca3e07640 1 --2- 172.21.15.164:0/194630771 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fec9c036b90 0x7fec9c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.623+0000 7feca3e07640 1 -- 172.21.15.164:0/194630771 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7feda8070070 con 0x55939a2d8eb0 2024-09-13T23:05:54.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.623+0000 7fedae95f640 1 --2- 172.21.15.164:0/194630771 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fec9c036b90 0x7fec9c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.623+0000 7fedbbe30800 1 --2- 172.21.15.164:0/194630771 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55939a3686a0 0x55939a4652a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.623+0000 7fedbbe30800 1 -- 172.21.15.164:0/194630771 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55939a465870 con 0x55939a3686a0 2024-09-13T23:05:54.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.623+0000 7fedb7961640 1 --2- 172.21.15.164:0/194630771 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55939a3686a0 0x55939a4652a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.623+0000 7fedae95f640 1 --2- 172.21.15.164:0/194630771 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fec9c036b90 0x7fec9c039050 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7feda0000c00 tx=0x7feda00013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.623+0000 7fedb7961640 1 --2- 172.21.15.164:0/194630771 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55939a3686a0 0x55939a4652a0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.624+0000 7fedb7961640 1 -- 172.21.15.164:0/194630771 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fedb000a4a0 con 0x55939a3686a0 2024-09-13T23:05:54.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.624+0000 7fedbbe30800 1 -- 172.21.15.164:0/194630771 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55939a462850 con 0x55939a3686a0 2024-09-13T23:05:54.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.624+0000 7fedb7961640 1 -- 172.21.15.164:0/194630771 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fedb000a4a0 con 0x55939a3686a0 2024-09-13T23:05:54.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.624+0000 7fedbbe30800 1 -- 172.21.15.164:0/194630771 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55939a467650 con 0x55939a3686a0 2024-09-13T23:05:54.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.624+0000 7fedb7961640 1 -- 172.21.15.164:0/194630771 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fedb000a4a0 con 0x55939a3686a0 2024-09-13T23:05:54.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.624+0000 7fedbbe30800 1 -- 172.21.15.164:0/194630771 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55939a466880 con 0x55939a3686a0 2024-09-13T23:05:54.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.624+0000 7fedb7961640 1 -- 172.21.15.164:0/194630771 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fedb000a4a0 con 0x55939a3686a0 2024-09-13T23:05:54.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.624+0000 7fedbbe30800 1 -- 172.21.15.164:0/194630771 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55939a466cd0 con 0x55939a3686a0 2024-09-13T23:05:54.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.625+0000 7fedb7961640 1 -- 172.21.15.164:0/194630771 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fedb000a4a0 con 0x55939a3686a0 2024-09-13T23:05:54.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.625+0000 7fedbbe30800 1 Processor -- start 2024-09-13T23:05:54.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.625+0000 7fedbbe30800 1 -- start start 2024-09-13T23:05:54.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.625+0000 7fedbbe30800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a475c60 0x55939a476080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.625+0000 7fedbbe30800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55939a200580 con 0x55939a475c60 2024-09-13T23:05:54.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.626+0000 7fedae95f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a475c60 0x55939a476080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.626+0000 7fedae95f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a475c60 0x55939a476080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37974/0 (socket says 172.21.15.164:37974) 2024-09-13T23:05:54.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.626+0000 7fedae95f640 1 -- 172.21.15.164:0/1974207675 learned_addr learned my addr 172.21.15.164:0/1974207675 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:54.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.626+0000 7fedae95f640 1 -- 172.21.15.164:0/1974207675 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55939a4765c0 con 0x55939a475c60 2024-09-13T23:05:54.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.626+0000 7fedae95f640 1 --2- 172.21.15.164:0/1974207675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a475c60 0x55939a476080 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7feda000e610 tx=0x7feda000ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.626+0000 7feca1602640 1 -- 172.21.15.164:0/1974207675 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feda0022070 con 0x55939a475c60 2024-09-13T23:05:54.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.626+0000 7fedbbe30800 1 -- 172.21.15.164:0/1974207675 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55939a476850 con 0x55939a475c60 2024-09-13T23:05:54.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.626+0000 7feca1602640 1 -- 172.21.15.164:0/1974207675 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda0009050 con 0x55939a475c60 2024-09-13T23:05:54.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.626+0000 7fedbbe30800 1 -- 172.21.15.164:0/1974207675 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55939a479530 con 0x55939a475c60 2024-09-13T23:05:54.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.626+0000 7feca1602640 1 -- 172.21.15.164:0/1974207675 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feda000d500 con 0x55939a475c60 2024-09-13T23:05:54.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.627+0000 7feca1602640 1 -- 172.21.15.164:0/1974207675 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7feda000d6a0 con 0x55939a475c60 2024-09-13T23:05:54.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.627+0000 7feca1602640 1 --2- 172.21.15.164:0/1974207675 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fec90036b40 0x7fec90039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.627+0000 7feca1602640 1 -- 172.21.15.164:0/1974207675 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7feda004de90 con 0x55939a475c60 2024-09-13T23:05:54.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.627+0000 7fedb7961640 1 --2- 172.21.15.164:0/1974207675 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fec90036b40 0x7fec90039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.628+0000 7fedbbe30800 1 Processor -- start 2024-09-13T23:05:54.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.628+0000 7fedbbe30800 1 -- start start 2024-09-13T23:05:54.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.628+0000 7fedb7961640 1 --2- 172.21.15.164:0/1974207675 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fec90036b40 0x7fec90039000 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55939a4663a0 tx=0x7fedb0005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.628+0000 7fedbbe30800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a482980 0x55939a482d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.628+0000 7fedbbe30800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55939a364100 con 0x55939a482980 2024-09-13T23:05:54.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.628+0000 7fedae95f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a482980 0x55939a482d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.628+0000 7fedae95f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a482980 0x55939a482d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37986/0 (socket says 172.21.15.164:37986) 2024-09-13T23:05:54.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.628+0000 7fedae95f640 1 -- 172.21.15.164:0/1749448664 learned_addr learned my addr 172.21.15.164:0/1749448664 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:54.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.628+0000 7fedae95f640 1 -- 172.21.15.164:0/1749448664 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55939a483350 con 0x55939a482980 2024-09-13T23:05:54.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.628+0000 7fedae95f640 1 --2- 172.21.15.164:0/1749448664 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a482980 0x55939a482d80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7feda004c150 tx=0x7feda001a960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb8e4509e4b7b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.629+0000 7fec9affd640 1 -- 172.21.15.164:0/1749448664 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feda0024310 con 0x55939a482980 2024-09-13T23:05:54.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.629+0000 7fec9affd640 1 -- 172.21.15.164:0/1749448664 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda00244b0 con 0x55939a482980 2024-09-13T23:05:54.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.629+0000 7fec9affd640 1 -- 172.21.15.164:0/1749448664 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feda00451e0 con 0x55939a482980 2024-09-13T23:05:54.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.629+0000 7fedbbe30800 1 -- 172.21.15.164:0/1749448664 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a482980 msgr2=0x55939a482d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.629+0000 7fedbbe30800 1 --2- 172.21.15.164:0/1749448664 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a482980 0x55939a482d80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7feda004c150 tx=0x7feda001a960 comp rx=0 tx=0).stop 2024-09-13T23:05:54.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.629+0000 7fedbbe30800 1 -- 172.21.15.164:0/1749448664 shutdown_connections 2024-09-13T23:05:54.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.629+0000 7fedbbe30800 1 --2- 172.21.15.164:0/1749448664 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a482980 0x55939a482d80 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.629+0000 7fedbbe30800 1 -- 172.21.15.164:0/1749448664 >> 172.21.15.164:0/1749448664 conn(0x55939a47ed30 msgr2=0x55939a47ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.629+0000 7fedbbe30800 1 -- 172.21.15.164:0/1749448664 shutdown_connections 2024-09-13T23:05:54.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.629+0000 7fedbbe30800 1 -- 172.21.15.164:0/1749448664 wait complete. 2024-09-13T23:05:54.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.629+0000 7fedbbe30800 1 Processor -- start 2024-09-13T23:05:54.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.629+0000 7fedbbe30800 1 -- start start 2024-09-13T23:05:54.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.630+0000 7fedbbe30800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a482980 0x55939a489e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.630+0000 7fedbbe30800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55939a483960 con 0x55939a482980 2024-09-13T23:05:54.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.630+0000 7fedae95f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a482980 0x55939a489e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.630+0000 7fedae95f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a482980 0x55939a489e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:37992/0 (socket says 172.21.15.164:37992) 2024-09-13T23:05:54.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.630+0000 7fedae95f640 1 -- 172.21.15.164:0/1818738082 learned_addr learned my addr 172.21.15.164:0/1818738082 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:54.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.630+0000 7fedae95f640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55939a48a3d0 con 0x55939a482980 2024-09-13T23:05:54.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.630+0000 7fedae95f640 1 --2- 172.21.15.164:0/1818738082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a482980 0x55939a489e90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7feda001a9a0 tx=0x7feda004c0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.630+0000 7fec997fa640 1 -- 172.21.15.164:0/1818738082 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feda003fbc0 con 0x55939a482980 2024-09-13T23:05:54.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.630+0000 7fec997fa640 1 -- 172.21.15.164:0/1818738082 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda0044030 con 0x55939a482980 2024-09-13T23:05:54.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.630+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55939a48a660 con 0x55939a482980 2024-09-13T23:05:54.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.630+0000 7fec997fa640 1 -- 172.21.15.164:0/1818738082 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feda000d990 con 0x55939a482980 2024-09-13T23:05:54.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.630+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55939a48a660 con 0x55939a482980 2024-09-13T23:05:54.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.631+0000 7fec997fa640 1 -- 172.21.15.164:0/1818738082 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7feda0031070 con 0x55939a482980 2024-09-13T23:05:54.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.631+0000 7fec997fa640 1 --2- 172.21.15.164:0/1818738082 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fec80036b40 0x7fec80039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.631+0000 7fec997fa640 1 -- 172.21.15.164:0/1818738082 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7feda004a9f0 con 0x55939a482980 2024-09-13T23:05:54.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.631+0000 7fedb7961640 1 --2- 172.21.15.164:0/1818738082 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fec80036b40 0x7fec80039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.632+0000 7fedb7961640 1 --2- 172.21.15.164:0/1818738082 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fec80036b40 0x7fec80039000 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55939a4627c0 tx=0x7fedb001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.632+0000 7fedbbe30800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.632+0000 7fedbbe30800 1 --2- 172.21.15.164:0/1818738082 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55939a495780 0x55939a497c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.632+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55939a498390 con 0x55939a495780 2024-09-13T23:05:54.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.632+0000 7fedb7160640 1 --2- 172.21.15.164:0/1818738082 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55939a495780 0x55939a497c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.632+0000 7fedb7160640 1 --2- 172.21.15.164:0/1818738082 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55939a495780 0x55939a497c40 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.632+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feda807a030 con 0x55939a495780 2024-09-13T23:05:54.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.632+0000 7fedbbe30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.632+0000 7fedbbe30800 20 realm 2024-09-13T23:05:54.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.633+0000 7fedbbe30800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.633+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55939a4987a0 con 0x55939a495780 2024-09-13T23:05:54.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.633+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feda807a030 con 0x55939a495780 2024-09-13T23:05:54.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.633+0000 7fedbbe30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.633+0000 7fedbbe30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:54.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.633+0000 7fedbbe30800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.633+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55939a499070 con 0x55939a495780 2024-09-13T23:05:54.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.633+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feda807a030 con 0x55939a495780 2024-09-13T23:05:54.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.633+0000 7fedbbe30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.633+0000 7fedbbe30800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.633+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55939a499410 con 0x55939a495780 2024-09-13T23:05:54.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.633+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feda807a030 con 0x55939a495780 2024-09-13T23:05:54.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.633+0000 7fedbbe30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:54.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.633+0000 7fedbbe30800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.633+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55939a499c60 con 0x55939a495780 2024-09-13T23:05:54.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.634+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7feda807a030 con 0x55939a495780 2024-09-13T23:05:54.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.634+0000 7fedbbe30800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:54.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.634+0000 7fedbbe30800 20 searching for the correct realm 2024-09-13T23:05:54.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.634+0000 7fedbbe30800 1 --2- 172.21.15.164:0/1818738082 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55939a49b9d0 0x55939a49ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.634+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x55939a49b9d0 2024-09-13T23:05:54.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.634+0000 7fedae95f640 1 --2- 172.21.15.164:0/1818738082 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55939a49b9d0 0x55939a49ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.634+0000 7fedae95f640 1 --2- 172.21.15.164:0/1818738082 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55939a49b9d0 0x55939a49ddc0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.634+0000 7fedae95f640 1 -- 172.21.15.164:0/1818738082 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda000dd10 con 0x55939a49b9d0 2024-09-13T23:05:54.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.634+0000 7fedae95f640 1 --2- 172.21.15.164:0/1818738082 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7feda0034070 0x7feda002c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.634+0000 7fedae95f640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x7feda0034070 2024-09-13T23:05:54.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.634+0000 7fedb7961640 1 --2- 172.21.15.164:0/1818738082 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7feda0034070 0x7feda002c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.635+0000 7fedb7961640 1 --2- 172.21.15.164:0/1818738082 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7feda0034070 0x7feda002c8d0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.635+0000 7fedb7961640 1 -- 172.21.15.164:0/1818738082 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedb001f070 con 0x7feda0034070 2024-09-13T23:05:54.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.635+0000 7fedb7961640 1 --2- 172.21.15.164:0/1818738082 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fedb0031040 0x7fedb0032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.635+0000 7fedb7961640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x7fedb0031040 2024-09-13T23:05:54.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.635+0000 7fedb7160640 1 --2- 172.21.15.164:0/1818738082 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fedb0031040 0x7fedb0032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.635+0000 7fedb7160640 1 --2- 172.21.15.164:0/1818738082 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fedb0031040 0x7fedb0032940 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.636+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda807a030 con 0x7fedb0031040 2024-09-13T23:05:54.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.636+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x55939a495780 2024-09-13T23:05:54.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.636+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7feda807a030 con 0x55939a495780 2024-09-13T23:05:54.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.636+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x55939a495780 2024-09-13T23:05:54.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.636+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda807a030 con 0x55939a495780 2024-09-13T23:05:54.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.636+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x7fedb0031040 2024-09-13T23:05:54.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.636+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda807a030 con 0x7fedb0031040 2024-09-13T23:05:54.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.636+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x7fedb0031040 2024-09-13T23:05:54.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.637+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda807a030 con 0x7fedb0031040 2024-09-13T23:05:54.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.637+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x7feda0034070 2024-09-13T23:05:54.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.637+0000 7fedb7961640 1 -- 172.21.15.164:0/1818738082 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedb001f070 con 0x7feda0034070 2024-09-13T23:05:54.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.637+0000 7fedb7961640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x55939a49b9d0 2024-09-13T23:05:54.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.637+0000 7fedae95f640 1 -- 172.21.15.164:0/1818738082 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda000dd10 con 0x55939a49b9d0 2024-09-13T23:05:54.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.637+0000 7fedae95f640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x55939a495780 2024-09-13T23:05:54.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.637+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda807a030 con 0x55939a495780 2024-09-13T23:05:54.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.637+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x7fedb0031040 2024-09-13T23:05:54.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.638+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda807a030 con 0x7fedb0031040 2024-09-13T23:05:54.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.638+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x55939a495780 2024-09-13T23:05:54.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.638+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda807a030 con 0x55939a495780 2024-09-13T23:05:54.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.638+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x7feda0034070 2024-09-13T23:05:54.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.638+0000 7fedb7961640 1 -- 172.21.15.164:0/1818738082 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fedb001f070 con 0x7feda0034070 2024-09-13T23:05:54.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.638+0000 7fedb7961640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x55939a49b9d0 2024-09-13T23:05:54.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.638+0000 7fedae95f640 1 -- 172.21.15.164:0/1818738082 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda000dd10 con 0x55939a49b9d0 2024-09-13T23:05:54.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.638+0000 7fedae95f640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x55939a49b9d0 2024-09-13T23:05:54.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.639+0000 7fedae95f640 1 -- 172.21.15.164:0/1818738082 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda000dd10 con 0x55939a49b9d0 2024-09-13T23:05:54.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.639+0000 7fedae95f640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x7fedb0031040 2024-09-13T23:05:54.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.639+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda807a030 con 0x7fedb0031040 2024-09-13T23:05:54.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.639+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x55939a49b9d0 2024-09-13T23:05:54.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.639+0000 7fedae95f640 1 -- 172.21.15.164:0/1818738082 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda000dd10 con 0x55939a49b9d0 2024-09-13T23:05:54.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.639+0000 7fedae95f640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x55939a49b9d0 2024-09-13T23:05:54.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.639+0000 7fedae95f640 1 -- 172.21.15.164:0/1818738082 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda000dd10 con 0x55939a49b9d0 2024-09-13T23:05:54.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.639+0000 7fedae95f640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x55939a495780 2024-09-13T23:05:54.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.640+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda807a030 con 0x55939a495780 2024-09-13T23:05:54.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.640+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x55939a495780 2024-09-13T23:05:54.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.640+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7feda807a030 con 0x55939a495780 2024-09-13T23:05:54.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.640+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x7fedb0031040 2024-09-13T23:05:54.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.640+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda807a030 con 0x7fedb0031040 2024-09-13T23:05:54.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.640+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x55939a49b9d0 2024-09-13T23:05:54.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.640+0000 7fedae95f640 1 -- 172.21.15.164:0/1818738082 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda000dd10 con 0x55939a49b9d0 2024-09-13T23:05:54.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.640+0000 7fedae95f640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x7feda0034070 2024-09-13T23:05:54.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.641+0000 7fedb7961640 1 -- 172.21.15.164:0/1818738082 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedb001f070 con 0x7feda0034070 2024-09-13T23:05:54.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.641+0000 7fedb7961640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x55939a495780 2024-09-13T23:05:54.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.641+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7feda807a030 con 0x55939a495780 2024-09-13T23:05:54.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.641+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x7fedb0031040 2024-09-13T23:05:54.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.641+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda807a030 con 0x7fedb0031040 2024-09-13T23:05:54.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.641+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x55939a49b9d0 2024-09-13T23:05:54.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.641+0000 7fedae95f640 1 -- 172.21.15.164:0/1818738082 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda000dd10 con 0x55939a49b9d0 2024-09-13T23:05:54.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.641+0000 7fedae95f640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x7fedb0031040 2024-09-13T23:05:54.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.642+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda807a030 con 0x7fedb0031040 2024-09-13T23:05:54.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.642+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x7feda0034070 2024-09-13T23:05:54.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.642+0000 7fedb7961640 1 -- 172.21.15.164:0/1818738082 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedb001f070 con 0x7feda0034070 2024-09-13T23:05:54.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.642+0000 7fedb7961640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x55939a49b9d0 2024-09-13T23:05:54.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.642+0000 7fedae95f640 1 -- 172.21.15.164:0/1818738082 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda000dd10 con 0x55939a49b9d0 2024-09-13T23:05:54.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.642+0000 7fedae95f640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x7feda0034070 2024-09-13T23:05:54.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.642+0000 7fedb7961640 1 -- 172.21.15.164:0/1818738082 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedb001f070 con 0x7feda0034070 2024-09-13T23:05:54.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.642+0000 7fedb7961640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x55939a495780 2024-09-13T23:05:54.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.643+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7feda807a030 con 0x55939a495780 2024-09-13T23:05:54.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.643+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55939a49e3d0 con 0x7feda0034070 2024-09-13T23:05:54.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.643+0000 7fedb7961640 1 -- 172.21.15.164:0/1818738082 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedb0040040 con 0x7feda0034070 2024-09-13T23:05:54.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.643+0000 7fedbbe30800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:54.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.643+0000 7fedbbe30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:54.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.643+0000 7fedbbe30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:54.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.643+0000 7fedbbe30800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:54.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.643+0000 7fedbbe30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:54.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.643+0000 7fedbbe30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:54.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.643+0000 7fedbbe30800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.643+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55939a49a610 con 0x55939a495780 2024-09-13T23:05:54.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.643+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feda807a030 con 0x55939a495780 2024-09-13T23:05:54.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.643+0000 7fedbbe30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.643+0000 7fedbbe30800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.643+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55939a49aa00 con 0x55939a495780 2024-09-13T23:05:54.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.643+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feda807a030 con 0x55939a495780 2024-09-13T23:05:54.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.643+0000 7fedbbe30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:54.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.643+0000 7fedbbe30800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.643+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55939a49aa00 con 0x55939a495780 2024-09-13T23:05:54.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.644+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7feda807a030 con 0x55939a495780 2024-09-13T23:05:54.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.644+0000 7fedbbe30800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:54.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.644+0000 7fedbbe30800 20 zone default found 2024-09-13T23:05:54.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.644+0000 7fedbbe30800 4 Realm: () 2024-09-13T23:05:54.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.644+0000 7fedbbe30800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:54.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.644+0000 7fedbbe30800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:54.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.644+0000 7fedbbe30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:54.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.644+0000 7fedbbe30800 20 zonegroup default 2024-09-13T23:05:54.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.644+0000 7fedbbe30800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.644+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55939a49ae20 con 0x7fedb0031040 2024-09-13T23:05:54.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.644+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7feda807a030 con 0x7fedb0031040 2024-09-13T23:05:54.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.644+0000 7fedbbe30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.644+0000 7fedbbe30800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.644+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55939a4a0210 con 0x55939a49b9d0 2024-09-13T23:05:54.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.644+0000 7fedae95f640 1 -- 172.21.15.164:0/1818738082 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feda000dd10 con 0x55939a49b9d0 2024-09-13T23:05:54.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.644+0000 7fedbbe30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.644+0000 7fedbbe30800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.644+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55939a4a05b0 con 0x55939a49b9d0 2024-09-13T23:05:54.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.644+0000 7fedae95f640 1 -- 172.21.15.164:0/1818738082 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feda000dd10 con 0x55939a49b9d0 2024-09-13T23:05:54.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.644+0000 7fedbbe30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.644+0000 7fedbbe30800 20 started sync module instance, tier type = 2024-09-13T23:05:54.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.645+0000 7fedbbe30800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:54.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.645+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55939a49f6b0 con 0x7feda0034070 2024-09-13T23:05:54.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.646+0000 7fedb7961640 1 -- 172.21.15.164:0/1818738082 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedb0040040 con 0x7feda0034070 2024-09-13T23:05:54.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.646+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94092437090816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55939a4a0950 con 0x7feda0034070 2024-09-13T23:05:54.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.646+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55939a4a1310 con 0x55939a495780 2024-09-13T23:05:54.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.647+0000 7fedb7961640 1 -- 172.21.15.164:0/1818738082 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94092437090816] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedb0040040 con 0x7feda0034070 2024-09-13T23:05:54.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.647+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feda807a030 con 0x55939a495780 2024-09-13T23:05:54.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.647+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94092437093072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55939a4a1310 con 0x55939a495780 2024-09-13T23:05:54.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.647+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55939a4a1d10 con 0x55939a49b9d0 2024-09-13T23:05:54.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.648+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94092437093072] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feda807a030 con 0x55939a495780 2024-09-13T23:05:54.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.648+0000 7fedae95f640 1 -- 172.21.15.164:0/1818738082 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feda000dd10 con 0x55939a49b9d0 2024-09-13T23:05:54.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.648+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94092437098080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55939a4a1280 con 0x55939a49b9d0 2024-09-13T23:05:54.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.648+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55939a4a2ad0 con 0x7feda0034070 2024-09-13T23:05:54.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.649+0000 7fedae95f640 1 -- 172.21.15.164:0/1818738082 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94092437098080] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feda000dd10 con 0x55939a49b9d0 2024-09-13T23:05:54.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.649+0000 7fedb7961640 1 -- 172.21.15.164:0/1818738082 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedb0040040 con 0x7feda0034070 2024-09-13T23:05:54.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.649+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94092437102896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55939a4a2ef0 con 0x7feda0034070 2024-09-13T23:05:54.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.649+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55939a4a3930 con 0x55939a495780 2024-09-13T23:05:54.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.650+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feda807a030 con 0x55939a495780 2024-09-13T23:05:54.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.650+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94092437107712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55939a4a38f0 con 0x55939a495780 2024-09-13T23:05:54.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.650+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55939a4a48e0 con 0x7fedb0031040 2024-09-13T23:05:54.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.650+0000 7fedb7961640 1 -- 172.21.15.164:0/1818738082 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94092437102896] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedb0040040 con 0x7feda0034070 2024-09-13T23:05:54.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.651+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94092437107712] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feda807a030 con 0x55939a495780 2024-09-13T23:05:54.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.651+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feda807a030 con 0x7fedb0031040 2024-09-13T23:05:54.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.651+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94092437111792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55939a4a3ad0 con 0x7fedb0031040 2024-09-13T23:05:54.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.652+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55939a4a51b0 con 0x7fedb0031040 2024-09-13T23:05:54.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.653+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94092437111792] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feda807a030 con 0x7fedb0031040 2024-09-13T23:05:54.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.653+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feda807a030 con 0x7fedb0031040 2024-09-13T23:05:54.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.653+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94092437103952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55939a4a4900 con 0x7fedb0031040 2024-09-13T23:05:54.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.653+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55939a4a57d0 con 0x7fedb0031040 2024-09-13T23:05:54.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.654+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94092437103952] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feda807a030 con 0x7fedb0031040 2024-09-13T23:05:54.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.654+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feda807a030 con 0x7fedb0031040 2024-09-13T23:05:54.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.654+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94092437115680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55939a4a5bf0 con 0x7fedb0031040 2024-09-13T23:05:54.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.654+0000 7fedbbe30800 20 add_watcher() i=0 2024-09-13T23:05:54.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.654+0000 7fedbbe30800 20 add_watcher() i=1 2024-09-13T23:05:54.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.654+0000 7fedbbe30800 20 add_watcher() i=2 2024-09-13T23:05:54.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.654+0000 7fedbbe30800 20 add_watcher() i=3 2024-09-13T23:05:54.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.654+0000 7fedbbe30800 20 add_watcher() i=4 2024-09-13T23:05:54.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.654+0000 7fedbbe30800 20 add_watcher() i=5 2024-09-13T23:05:54.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.654+0000 7fedbbe30800 20 add_watcher() i=6 2024-09-13T23:05:54.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.655+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94092437115680] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feda807a030 con 0x7fedb0031040 2024-09-13T23:05:54.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.655+0000 7fedbbe30800 20 add_watcher() i=7 2024-09-13T23:05:54.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.655+0000 7fedbbe30800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:54.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.655+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55939a4a8f00 con 0x55939a495780 2024-09-13T23:05:54.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.655+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7feda807a030 con 0x55939a495780 2024-09-13T23:05:54.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.655+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94092437129488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55939a4a5d60 con 0x55939a495780 2024-09-13T23:05:54.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.656+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94092437129488] v34'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feda807a030 con 0x55939a495780 2024-09-13T23:05:54.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.656+0000 7fec6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:54.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.656+0000 7fedbbe30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:54.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.656+0000 7fedbbe30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:54.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.656+0000 7fedbbe30800 5 note: GC not initialized 2024-09-13T23:05:54.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.657+0000 7fec6cfe1640 20 reqs_thread_entry: start 2024-09-13T23:05:54.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.657+0000 7fedbbe30800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:54.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.657+0000 7fedbbe30800 20 Filter name: none 2024-09-13T23:05:54.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.657+0000 7febe67fc640 20 reqs_thread_entry: start 2024-09-13T23:05:54.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.657+0000 7fedbbe30800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:05:54.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.657+0000 7fedbbe30800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.657+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55939a4dc860 con 0x7feda0034070 2024-09-13T23:05:54.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.657+0000 7fedb7961640 1 -- 172.21.15.164:0/1818738082 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv34 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fedb0040040 con 0x7feda0034070 2024-09-13T23:05:54.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.657+0000 7fedbbe30800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:05:54.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.657+0000 7fedbbe30800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:05:54.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.657+0000 7fedbbe30800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:05:54.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.657+0000 7fedbbe30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5 : miss 2024-09-13T23:05:54.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.657+0000 7fedbbe30800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.657+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:63 8.9 8:90242e25:root::.bucket.meta.myfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55939a4de480 con 0x7feda0034070 2024-09-13T23:05:54.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.658+0000 7fedb7961640 1 -- 172.21.15.164:0/1818738082 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(63 .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv33 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fedb0040040 con 0x7feda0034070 2024-09-13T23:05:54.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.658+0000 7fedbbe30800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:05:54.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.658+0000 7fedbbe30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5 info.flags=0x17 2024-09-13T23:05:54.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.658+0000 7fedbbe30800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5 to cache LRU end 2024-09-13T23:05:54.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.658+0000 7fedbbe30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:54.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.658+0000 7fedbbe30800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:05:54.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.658+0000 7fedbbe30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5 2024-09-13T23:05:54.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.658+0000 7fedbbe30800 20 get_obj_state: octx=0x7feda80053b0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55939a4e0b08 s->prefetch_data=0 2024-09-13T23:05:54.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.658+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 3.7s0 3:e38cefd1:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55939a4e1c50 con 0x55939a49b9d0 2024-09-13T23:05:54.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.658+0000 7fedae95f640 1 -- 172.21.15.164:0/1818738082 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv5 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7feda000dd10 con 0x55939a49b9d0 2024-09-13T23:05:54.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.658+0000 7fedbbe30800 10 manifest: total_size = 5 2024-09-13T23:05:54.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.658+0000 7fedbbe30800 20 get_obj_state: setting s->obj_tag to _6yAVVHU0q6I0BYeOuKtJmlXSS7OP1QU 2024-09-13T23:05:54.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.659+0000 7fec6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:54.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.659+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94092437129488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55939a4e1640 con 0x55939a495780 2024-09-13T23:05:54.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.660+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94092437129488] v34'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feda807a030 con 0x55939a495780 2024-09-13T23:05:54.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.660+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94092437090816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55939a4a8910 con 0x7feda0034070 2024-09-13T23:05:54.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.661+0000 7fedb7961640 1 -- 172.21.15.164:0/1818738082 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94092437090816] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedb0040040 con 0x7feda0034070 2024-09-13T23:05:54.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.661+0000 7fedbbe30800 20 remove_watcher() i=0 2024-09-13T23:05:54.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.661+0000 7fedbbe30800 2 removed watcher, disabling cache 2024-09-13T23:05:54.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.661+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94092437093072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55939a4e1610 con 0x55939a495780 2024-09-13T23:05:54.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.662+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94092437093072] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feda807a030 con 0x55939a495780 2024-09-13T23:05:54.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.662+0000 7fedbbe30800 20 remove_watcher() i=1 2024-09-13T23:05:54.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.662+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94092437098080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55939a49f200 con 0x55939a49b9d0 2024-09-13T23:05:54.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.663+0000 7fedae95f640 1 -- 172.21.15.164:0/1818738082 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94092437098080] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feda000dd10 con 0x55939a49b9d0 2024-09-13T23:05:54.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.663+0000 7fedbbe30800 20 remove_watcher() i=2 2024-09-13T23:05:54.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.663+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94092437102896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55939a49fad0 con 0x7feda0034070 2024-09-13T23:05:54.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.664+0000 7fedb7961640 1 -- 172.21.15.164:0/1818738082 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94092437102896] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedb0040040 con 0x7feda0034070 2024-09-13T23:05:54.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.664+0000 7fedbbe30800 20 remove_watcher() i=3 2024-09-13T23:05:54.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.664+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94092437107712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55939a4a0e60 con 0x55939a495780 2024-09-13T23:05:54.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.665+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94092437107712] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feda807a030 con 0x55939a495780 2024-09-13T23:05:54.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.665+0000 7fedbbe30800 20 remove_watcher() i=4 2024-09-13T23:05:54.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.665+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94092437111792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55939a4a2130 con 0x7fedb0031040 2024-09-13T23:05:54.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.666+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94092437111792] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feda807a030 con 0x7fedb0031040 2024-09-13T23:05:54.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.666+0000 7fedbbe30800 20 remove_watcher() i=5 2024-09-13T23:05:54.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.666+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94092437103952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55939a49fad0 con 0x7fedb0031040 2024-09-13T23:05:54.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.667+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94092437103952] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feda807a030 con 0x7fedb0031040 2024-09-13T23:05:54.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.667+0000 7fedbbe30800 20 remove_watcher() i=6 2024-09-13T23:05:54.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.667+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94092437115680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55939a4a0e60 con 0x7fedb0031040 2024-09-13T23:05:54.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.668+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94092437115680] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feda807a030 con 0x7fedb0031040 2024-09-13T23:05:54.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.668+0000 7fedbbe30800 20 remove_watcher() i=7 2024-09-13T23:05:54.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.668+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fedb0031040 msgr2=0x7fedb0032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.668+0000 7fedbbe30800 1 --2- 172.21.15.164:0/1818738082 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fedb0031040 0x7fedb0032940 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.668+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55939a495780 msgr2=0x55939a497c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.668+0000 7fedbbe30800 1 --2- 172.21.15.164:0/1818738082 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55939a495780 0x55939a497c40 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.668+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7feda0034070 msgr2=0x7feda002c8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.668+0000 7fedbbe30800 1 --2- 172.21.15.164:0/1818738082 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7feda0034070 0x7feda002c8d0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.668+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55939a49b9d0 msgr2=0x55939a49ddc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.668+0000 7fedbbe30800 1 --2- 172.21.15.164:0/1818738082 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55939a49b9d0 0x55939a49ddc0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.668+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fec80036b40 msgr2=0x7fec80039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.668+0000 7fedbbe30800 1 --2- 172.21.15.164:0/1818738082 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fec80036b40 0x7fec80039000 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55939a4627c0 tx=0x7fedb001f000 comp rx=0 tx=0).stop 2024-09-13T23:05:54.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.668+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a482980 msgr2=0x55939a489e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.668+0000 7fedb7160640 1 -- 172.21.15.164:0/1818738082 reap_dead start 2024-09-13T23:05:54.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.668+0000 7fedbbe30800 1 --2- 172.21.15.164:0/1818738082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a482980 0x55939a489e90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7feda001a9a0 tx=0x7feda004c0b0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.668+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 shutdown_connections 2024-09-13T23:05:54.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.668+0000 7fedbbe30800 1 --2- 172.21.15.164:0/1818738082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a482980 0x55939a489e90 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.668+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 >> 172.21.15.164:0/1818738082 conn(0x55939a47ed30 msgr2=0x55939a4840c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.669+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 shutdown_connections 2024-09-13T23:05:54.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.669+0000 7fedbbe30800 1 -- 172.21.15.164:0/1818738082 wait complete. 2024-09-13T23:05:54.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.669+0000 7fedbbe30800 1 -- 172.21.15.164:0/1974207675 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fec90036b40 msgr2=0x7fec90039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.669+0000 7fedbbe30800 1 --2- 172.21.15.164:0/1974207675 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fec90036b40 0x7fec90039000 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55939a4663a0 tx=0x7fedb0005840 comp rx=0 tx=0).stop 2024-09-13T23:05:54.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.669+0000 7fedbbe30800 1 -- 172.21.15.164:0/1974207675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a475c60 msgr2=0x55939a476080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.669+0000 7fedbbe30800 1 --2- 172.21.15.164:0/1974207675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a475c60 0x55939a476080 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7feda000e610 tx=0x7feda000ff90 comp rx=0 tx=0).stop 2024-09-13T23:05:54.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.669+0000 7fedbbe30800 1 -- 172.21.15.164:0/1974207675 shutdown_connections 2024-09-13T23:05:54.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.669+0000 7fedbbe30800 1 --2- 172.21.15.164:0/1974207675 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fec90036b40 0x7fec90039000 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.669+0000 7fedbbe30800 1 --2- 172.21.15.164:0/1974207675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a475c60 0x55939a476080 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.669+0000 7fedbbe30800 1 -- 172.21.15.164:0/1974207675 >> 172.21.15.164:0/1974207675 conn(0x55939a46abf0 msgr2=0x55939a46d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.669+0000 7fedbbe30800 1 -- 172.21.15.164:0/1974207675 shutdown_connections 2024-09-13T23:05:54.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.669+0000 7fedbbe30800 1 -- 172.21.15.164:0/1974207675 wait complete. 2024-09-13T23:05:54.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.669+0000 7fedbbe30800 1 -- 172.21.15.164:0/194630771 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55939a3686a0 msgr2=0x55939a4652a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.669+0000 7fedbbe30800 1 --2- 172.21.15.164:0/194630771 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55939a3686a0 0x55939a4652a0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.669+0000 7fedbbe30800 1 -- 172.21.15.164:0/194630771 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fec9c036b90 msgr2=0x7fec9c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.669+0000 7fedbbe30800 1 --2- 172.21.15.164:0/194630771 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fec9c036b90 0x7fec9c039050 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7feda0000c00 tx=0x7feda00013b0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.669+0000 7fedbbe30800 1 -- 172.21.15.164:0/194630771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a2d8eb0 msgr2=0x55939a45e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.669+0000 7fedbbe30800 1 --2- 172.21.15.164:0/194630771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a2d8eb0 0x55939a45e230 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7feda8045f50 tx=0x7feda8002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.669+0000 7fedbbe30800 1 -- 172.21.15.164:0/194630771 shutdown_connections 2024-09-13T23:05:54.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.669+0000 7fedbbe30800 1 --2- 172.21.15.164:0/194630771 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55939a3686a0 0x55939a4652a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.669+0000 7fedbbe30800 1 --2- 172.21.15.164:0/194630771 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fec9c036b90 0x7fec9c039050 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.669+0000 7fedbbe30800 1 --2- 172.21.15.164:0/194630771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55939a2d8eb0 0x55939a45e230 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.669+0000 7fedbbe30800 1 -- 172.21.15.164:0/194630771 >> 172.21.15.164:0/194630771 conn(0x55939a35fdd0 msgr2=0x55939a44fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.670+0000 7fedbbe30800 1 -- 172.21.15.164:0/194630771 shutdown_connections 2024-09-13T23:05:54.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.670+0000 7fedbbe30800 1 -- 172.21.15.164:0/194630771 wait complete. 2024-09-13T23:05:54.689 INFO:teuthology.orchestra.run.smithi164.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-13T23:05:54.689 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-13T23:05:54.691 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-13T23:05:54.704 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:05:54.762 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-13T23:05:54.762 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-13T23:05:54.762 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T23:05:54.762 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-13T23:05:54.762 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-13T23:05:54.762 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-13T23:05:54.763 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-13T23:05:54.810 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:54.810 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:54.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.809+0000 7fba93096800 1 Processor -- start 2024-09-13T23:05:54.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.809+0000 7fba93096800 1 -- start start 2024-09-13T23:05:54.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.810+0000 7fba93096800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55d5f50b2880 0x55d5f50b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.810+0000 7fba93096800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d5f4f6db30 con 0x55d5f5021eb0 2024-09-13T23:05:54.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.810+0000 7fba93096800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55d5f4f4f360 con 0x55d5f50b2880 2024-09-13T23:05:54.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.810+0000 7fba88389640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55d5f50b2880 0x55d5f50b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.810+0000 7fba90b8a640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55d5f5021eb0 0x55d5f50b1160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:53980/0 (socket says 172.21.15.164:53980) 2024-09-13T23:05:54.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.810+0000 7fba90b8a640 1 -- 172.21.15.164:0/2877446134 learned_addr learned my addr 172.21.15.164:0/2877446134 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:54.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.810+0000 7fba88389640 1 -- 172.21.15.164:0/2877446134 >> v1:172.21.15.17:6789/0 conn(0x55d5f5021eb0 legacy=0x55d5f50b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.810+0000 7fba88389640 1 -- 172.21.15.164:0/2877446134 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5f4f75e00 con 0x55d5f50b2880 2024-09-13T23:05:54.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.812+0000 7fba88389640 1 --2- 172.21.15.164:0/2877446134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f50b2880 0x55d5f50b4c90 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fba7800a470 tx=0x7fba78045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfba690ecfa7dd31 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.812+0000 7fba8bfff640 1 -- 172.21.15.164:0/2877446134 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba78053570 con 0x55d5f50b2880 2024-09-13T23:05:54.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.812+0000 7fba8bfff640 1 -- 172.21.15.164:0/2877446134 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba78058070 con 0x55d5f50b2880 2024-09-13T23:05:54.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.812+0000 7fba8bfff640 1 -- 172.21.15.164:0/2877446134 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba78053880 con 0x55d5f50b2880 2024-09-13T23:05:54.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.813+0000 7fba93096800 1 -- 172.21.15.164:0/2877446134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f50b2880 msgr2=0x55d5f50b4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.813+0000 7fba93096800 1 --2- 172.21.15.164:0/2877446134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f50b2880 0x55d5f50b4c90 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fba7800a470 tx=0x7fba78045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:54.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.813+0000 7fba93096800 1 -- 172.21.15.164:0/2877446134 shutdown_connections 2024-09-13T23:05:54.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.813+0000 7fba93096800 1 --2- 172.21.15.164:0/2877446134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f50b2880 0x55d5f50b4c90 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.813+0000 7fba93096800 1 -- 172.21.15.164:0/2877446134 >> 172.21.15.164:0/2877446134 conn(0x55d5f50a8dd0 msgr2=0x55d5f50ab1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.813+0000 7fba93096800 1 -- 172.21.15.164:0/2877446134 shutdown_connections 2024-09-13T23:05:54.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.813+0000 7fba93096800 1 -- 172.21.15.164:0/2877446134 wait complete. 2024-09-13T23:05:54.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.826+0000 7fba93096800 1 Processor -- start 2024-09-13T23:05:54.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.827+0000 7fba93096800 1 -- start start 2024-09-13T23:05:54.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.827+0000 7fba93096800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f5021eb0 0x55d5f50aea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.827+0000 7fba93096800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d5f4ffa360 con 0x55d5f5021eb0 2024-09-13T23:05:54.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.827+0000 7fba90b8a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f5021eb0 0x55d5f50aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.827+0000 7fba90b8a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f5021eb0 0x55d5f50aea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:38020/0 (socket says 172.21.15.164:38020) 2024-09-13T23:05:54.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.827+0000 7fba90b8a640 1 -- 172.21.15.164:0/241933127 learned_addr learned my addr 172.21.15.164:0/241933127 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:54.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.827+0000 7fba90b8a640 1 -- 172.21.15.164:0/241933127 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5f4f47bc0 con 0x55d5f5021eb0 2024-09-13T23:05:54.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.828+0000 7fba90b8a640 1 --2- 172.21.15.164:0/241933127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f5021eb0 0x55d5f50aea90 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fba80001e10 tx=0x7fba8000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c65f66502c1dc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.828+0000 7fb97ee0d640 1 -- 172.21.15.164:0/241933127 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba80012020 con 0x55d5f5021eb0 2024-09-13T23:05:54.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.828+0000 7fb97ee0d640 1 -- 172.21.15.164:0/241933127 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba8000e5a0 con 0x55d5f5021eb0 2024-09-13T23:05:54.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.828+0000 7fb97ee0d640 1 -- 172.21.15.164:0/241933127 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba8000e8e0 con 0x55d5f5021eb0 2024-09-13T23:05:54.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.828+0000 7fba93096800 1 -- 172.21.15.164:0/241933127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f5021eb0 msgr2=0x55d5f50aea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.828+0000 7fba93096800 1 --2- 172.21.15.164:0/241933127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f5021eb0 0x55d5f50aea90 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fba80001e10 tx=0x7fba8000b780 comp rx=0 tx=0).stop 2024-09-13T23:05:54.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.828+0000 7fba93096800 1 -- 172.21.15.164:0/241933127 shutdown_connections 2024-09-13T23:05:54.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.828+0000 7fba93096800 1 --2- 172.21.15.164:0/241933127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f5021eb0 0x55d5f50aea90 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.828+0000 7fba93096800 1 -- 172.21.15.164:0/241933127 >> 172.21.15.164:0/241933127 conn(0x55d5f50a8dd0 msgr2=0x55d5f5199260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.829+0000 7fba93096800 1 -- 172.21.15.164:0/241933127 shutdown_connections 2024-09-13T23:05:54.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.829+0000 7fba93096800 1 -- 172.21.15.164:0/241933127 wait complete. 2024-09-13T23:05:54.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.829+0000 7fba93096800 1 Processor -- start 2024-09-13T23:05:54.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.829+0000 7fba93096800 1 -- start start 2024-09-13T23:05:54.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.829+0000 7fba93096800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f5021eb0 0x55d5f51a74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.829+0000 7fba93096800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d5f50b5610 con 0x55d5f5021eb0 2024-09-13T23:05:54.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.829+0000 7fba90b8a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f5021eb0 0x55d5f51a74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.829+0000 7fba90b8a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f5021eb0 0x55d5f51a74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:38032/0 (socket says 172.21.15.164:38032) 2024-09-13T23:05:54.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.829+0000 7fba90b8a640 1 -- 172.21.15.164:0/1472924647 learned_addr learned my addr 172.21.15.164:0/1472924647 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:54.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.829+0000 7fba90b8a640 1 -- 172.21.15.164:0/1472924647 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5f4f5bfe0 con 0x55d5f5021eb0 2024-09-13T23:05:54.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.830+0000 7fba90b8a640 1 --2- 172.21.15.164:0/1472924647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f5021eb0 0x55d5f51a74a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fba8000b7c0 tx=0x7fba80000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.830+0000 7fb97d60a640 1 -- 172.21.15.164:0/1472924647 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba80012030 con 0x55d5f5021eb0 2024-09-13T23:05:54.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.830+0000 7fb97d60a640 1 -- 172.21.15.164:0/1472924647 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba80001470 con 0x55d5f5021eb0 2024-09-13T23:05:54.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.830+0000 7fba93096800 1 -- 172.21.15.164:0/1472924647 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d5f51a79e0 con 0x55d5f5021eb0 2024-09-13T23:05:54.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.830+0000 7fb97d60a640 1 -- 172.21.15.164:0/1472924647 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba8001a8d0 con 0x55d5f5021eb0 2024-09-13T23:05:54.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.830+0000 7fba93096800 1 -- 172.21.15.164:0/1472924647 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5f51a7f00 con 0x55d5f5021eb0 2024-09-13T23:05:54.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.831+0000 7fb97d60a640 1 -- 172.21.15.164:0/1472924647 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fba80015020 con 0x55d5f5021eb0 2024-09-13T23:05:54.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.831+0000 7fb97d60a640 1 --2- 172.21.15.164:0/1472924647 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb978036b90 0x7fb978039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.831+0000 7fb97d60a640 1 -- 172.21.15.164:0/1472924647 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fba80020030 con 0x55d5f5021eb0 2024-09-13T23:05:54.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.831+0000 7fba88389640 1 --2- 172.21.15.164:0/1472924647 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb978036b90 0x7fb978039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.831+0000 7fba93096800 1 --2- 172.21.15.164:0/1472924647 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d5f50b2880 0x55d5f51ae510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.831+0000 7fba93096800 1 -- 172.21.15.164:0/1472924647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51aea50 con 0x55d5f50b2880 2024-09-13T23:05:54.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.831+0000 7fba9138b640 1 --2- 172.21.15.164:0/1472924647 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d5f50b2880 0x55d5f51ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.831+0000 7fba88389640 1 --2- 172.21.15.164:0/1472924647 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb978036b90 0x7fb978039050 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fba78057000 tx=0x7fba78052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.831+0000 7fba9138b640 1 --2- 172.21.15.164:0/1472924647 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d5f50b2880 0x55d5f51ae510 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.832+0000 7fba9138b640 1 -- 172.21.15.164:0/1472924647 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba8c00a4a0 con 0x55d5f50b2880 2024-09-13T23:05:54.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.832+0000 7fba93096800 1 -- 172.21.15.164:0/1472924647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51abae0 con 0x55d5f50b2880 2024-09-13T23:05:54.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.832+0000 7fba9138b640 1 -- 172.21.15.164:0/1472924647 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fba8c00a4a0 con 0x55d5f50b2880 2024-09-13T23:05:54.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.832+0000 7fba93096800 1 -- 172.21.15.164:0/1472924647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51b0890 con 0x55d5f50b2880 2024-09-13T23:05:54.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.832+0000 7fba9138b640 1 -- 172.21.15.164:0/1472924647 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fba8c00a4a0 con 0x55d5f50b2880 2024-09-13T23:05:54.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.832+0000 7fba93096800 1 -- 172.21.15.164:0/1472924647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51af9d0 con 0x55d5f50b2880 2024-09-13T23:05:54.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.833+0000 7fba9138b640 1 -- 172.21.15.164:0/1472924647 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fba8c00a4a0 con 0x55d5f50b2880 2024-09-13T23:05:54.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.833+0000 7fba93096800 1 -- 172.21.15.164:0/1472924647 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51afe10 con 0x55d5f50b2880 2024-09-13T23:05:54.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.833+0000 7fba9138b640 1 -- 172.21.15.164:0/1472924647 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fba8c00a4a0 con 0x55d5f50b2880 2024-09-13T23:05:54.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.833+0000 7fba93096800 1 Processor -- start 2024-09-13T23:05:54.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.833+0000 7fba93096800 1 -- start start 2024-09-13T23:05:54.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.833+0000 7fba93096800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f51beec0 0x55d5f51bf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.833+0000 7fba93096800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d5f4f49580 con 0x55d5f51beec0 2024-09-13T23:05:54.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.834+0000 7fba88389640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f51beec0 0x55d5f51bf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.834+0000 7fba88389640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f51beec0 0x55d5f51bf2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:38036/0 (socket says 172.21.15.164:38036) 2024-09-13T23:05:54.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.834+0000 7fba88389640 1 -- 172.21.15.164:0/1476210270 learned_addr learned my addr 172.21.15.164:0/1476210270 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:54.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.834+0000 7fba88389640 1 -- 172.21.15.164:0/1476210270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5f51bf820 con 0x55d5f51beec0 2024-09-13T23:05:54.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.834+0000 7fba88389640 1 --2- 172.21.15.164:0/1476210270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f51beec0 0x55d5f51bf2e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fba78045f50 tx=0x7fba78002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.834+0000 7fb9767fc640 1 -- 172.21.15.164:0/1476210270 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba7806f070 con 0x55d5f51beec0 2024-09-13T23:05:54.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.834+0000 7fb9767fc640 1 -- 172.21.15.164:0/1476210270 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba7805f550 con 0x55d5f51beec0 2024-09-13T23:05:54.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.834+0000 7fba93096800 1 -- 172.21.15.164:0/1476210270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d5f51bfa50 con 0x55d5f51beec0 2024-09-13T23:05:54.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.834+0000 7fb9767fc640 1 -- 172.21.15.164:0/1476210270 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba7805f830 con 0x55d5f51beec0 2024-09-13T23:05:54.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.835+0000 7fba93096800 1 -- 172.21.15.164:0/1476210270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5f51c26d0 con 0x55d5f51beec0 2024-09-13T23:05:54.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.835+0000 7fb9767fc640 1 -- 172.21.15.164:0/1476210270 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fba7805f9d0 con 0x55d5f51beec0 2024-09-13T23:05:54.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.835+0000 7fb9767fc640 1 --2- 172.21.15.164:0/1476210270 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb968036b40 0x7fb968039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.835+0000 7fb9767fc640 1 -- 172.21.15.164:0/1476210270 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fba78092e80 con 0x55d5f51beec0 2024-09-13T23:05:54.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.835+0000 7fba9138b640 1 --2- 172.21.15.164:0/1476210270 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb968036b40 0x7fb968039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.836+0000 7fba93096800 1 Processor -- start 2024-09-13T23:05:54.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.836+0000 7fba9138b640 1 --2- 172.21.15.164:0/1476210270 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb968036b40 0x7fb968039000 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55d5f51af4f0 tx=0x7fba8c005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.836+0000 7fba93096800 1 -- start start 2024-09-13T23:05:54.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.836+0000 7fba93096800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f51cbab0 0x55d5f51cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.836+0000 7fba93096800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d5f50ad160 con 0x55d5f51cbab0 2024-09-13T23:05:54.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.836+0000 7fba88389640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f51cbab0 0x55d5f51cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.836+0000 7fba88389640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f51cbab0 0x55d5f51cbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:38050/0 (socket says 172.21.15.164:38050) 2024-09-13T23:05:54.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.836+0000 7fba88389640 1 -- 172.21.15.164:0/2275688544 learned_addr learned my addr 172.21.15.164:0/2275688544 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:54.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.836+0000 7fba88389640 1 -- 172.21.15.164:0/2275688544 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5f51cc480 con 0x55d5f51cbab0 2024-09-13T23:05:54.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.837+0000 7fba88389640 1 --2- 172.21.15.164:0/2275688544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f51cbab0 0x55d5f51cbeb0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fba78053f70 tx=0x7fba7807cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c85a7e3ab8c3ca69 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.837+0000 7fb967fff640 1 -- 172.21.15.164:0/2275688544 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba7806b410 con 0x55d5f51cbab0 2024-09-13T23:05:54.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.837+0000 7fb967fff640 1 -- 172.21.15.164:0/2275688544 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba7805fcc0 con 0x55d5f51cbab0 2024-09-13T23:05:54.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.837+0000 7fb967fff640 1 -- 172.21.15.164:0/2275688544 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba7806b5b0 con 0x55d5f51cbab0 2024-09-13T23:05:54.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.837+0000 7fba93096800 1 -- 172.21.15.164:0/2275688544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f51cbab0 msgr2=0x55d5f51cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.837+0000 7fba93096800 1 --2- 172.21.15.164:0/2275688544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f51cbab0 0x55d5f51cbeb0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fba78053f70 tx=0x7fba7807cbb0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.837+0000 7fba93096800 1 -- 172.21.15.164:0/2275688544 shutdown_connections 2024-09-13T23:05:54.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.837+0000 7fba93096800 1 --2- 172.21.15.164:0/2275688544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f51cbab0 0x55d5f51cbeb0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.837+0000 7fba93096800 1 -- 172.21.15.164:0/2275688544 >> 172.21.15.164:0/2275688544 conn(0x55d5f51c7e10 msgr2=0x55d5f51c5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.837+0000 7fba93096800 1 -- 172.21.15.164:0/2275688544 shutdown_connections 2024-09-13T23:05:54.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.837+0000 7fba93096800 1 -- 172.21.15.164:0/2275688544 wait complete. 2024-09-13T23:05:54.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.837+0000 7fba93096800 1 Processor -- start 2024-09-13T23:05:54.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.838+0000 7fba93096800 1 -- start start 2024-09-13T23:05:54.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.838+0000 7fba93096800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f51cbab0 0x55d5f51d2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.838+0000 7fba93096800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d5f51ccaf0 con 0x55d5f51cbab0 2024-09-13T23:05:54.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.838+0000 7fba88389640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f51cbab0 0x55d5f51d2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.838+0000 7fba88389640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f51cbab0 0x55d5f51d2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:38066/0 (socket says 172.21.15.164:38066) 2024-09-13T23:05:54.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.838+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 learned_addr learned my addr 172.21.15.164:0/2561964117 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:54.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.838+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5f51d34b0 con 0x55d5f51cbab0 2024-09-13T23:05:54.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.838+0000 7fba88389640 1 --2- 172.21.15.164:0/2561964117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f51cbab0 0x55d5f51d2f70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fba780059a0 tx=0x7fba780910a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.839+0000 7fb9667fc640 1 -- 172.21.15.164:0/2561964117 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba7809e070 con 0x55d5f51cbab0 2024-09-13T23:05:54.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.839+0000 7fb9667fc640 1 -- 172.21.15.164:0/2561964117 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba7806b410 con 0x55d5f51cbab0 2024-09-13T23:05:54.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.839+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d5f51d3740 con 0x55d5f51cbab0 2024-09-13T23:05:54.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.839+0000 7fb9667fc640 1 -- 172.21.15.164:0/2561964117 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba7805cca0 con 0x55d5f51cbab0 2024-09-13T23:05:54.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.839+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5f51d3740 con 0x55d5f51cbab0 2024-09-13T23:05:54.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.839+0000 7fb9667fc640 1 -- 172.21.15.164:0/2561964117 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fba780a1070 con 0x55d5f51cbab0 2024-09-13T23:05:54.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.839+0000 7fb9667fc640 1 --2- 172.21.15.164:0/2561964117 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb95c036b40 0x7fb95c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.840+0000 7fb9667fc640 1 -- 172.21.15.164:0/2561964117 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fba780a4d60 con 0x55d5f51cbab0 2024-09-13T23:05:54.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.840+0000 7fba9138b640 1 --2- 172.21.15.164:0/2561964117 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb95c036b40 0x7fb95c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.840+0000 7fba9138b640 1 --2- 172.21.15.164:0/2561964117 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb95c036b40 0x7fb95c039000 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55d5f51a86c0 tx=0x7fba8c01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.840+0000 7fba93096800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.840+0000 7fba93096800 1 --2- 172.21.15.164:0/2561964117 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d5f51de8a0 0x55d5f51e0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.840+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e14b0 con 0x55d5f51de8a0 2024-09-13T23:05:54.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.840+0000 7fba90b8a640 1 --2- 172.21.15.164:0/2561964117 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d5f51de8a0 0x55d5f51e0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.840+0000 7fba90b8a640 1 --2- 172.21.15.164:0/2561964117 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d5f51de8a0 0x55d5f51e0d60 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.841+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.841+0000 7fba93096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.841+0000 7fba93096800 20 realm 2024-09-13T23:05:54.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.841+0000 7fba93096800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.841+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e18c0 con 0x55d5f51de8a0 2024-09-13T23:05:54.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.841+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.841+0000 7fba93096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.841+0000 7fba93096800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:54.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.841+0000 7fba93096800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.841+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e2190 con 0x55d5f51de8a0 2024-09-13T23:05:54.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.841+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.841+0000 7fba93096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.841+0000 7fba93096800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.841+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e2530 con 0x55d5f51de8a0 2024-09-13T23:05:54.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.841+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.841+0000 7fba93096800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:54.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.841+0000 7fba93096800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.841+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e2d80 con 0x55d5f51de8a0 2024-09-13T23:05:54.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.842+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.842+0000 7fba93096800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:54.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.842+0000 7fba93096800 20 searching for the correct realm 2024-09-13T23:05:54.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.842+0000 7fba93096800 1 --2- 172.21.15.164:0/2561964117 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55d5f51e4af0 0x55d5f51e6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.842+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x55d5f51e4af0 2024-09-13T23:05:54.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.842+0000 7fba88389640 1 --2- 172.21.15.164:0/2561964117 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55d5f51e4af0 0x55d5f51e6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.842+0000 7fba88389640 1 --2- 172.21.15.164:0/2561964117 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55d5f51e4af0 0x55d5f51e6ee0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.842+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba780a0030 con 0x55d5f51e4af0 2024-09-13T23:05:54.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.842+0000 7fba88389640 1 --2- 172.21.15.164:0/2561964117 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fba780a3060 0x7fba780914b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.842+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x7fba780a3060 2024-09-13T23:05:54.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.843+0000 7fba9138b640 1 --2- 172.21.15.164:0/2561964117 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fba780a3060 0x7fba780914b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.843+0000 7fba9138b640 1 --2- 172.21.15.164:0/2561964117 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fba780a3060 0x7fba780914b0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.843+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.843+0000 7fba9138b640 1 --2- 172.21.15.164:0/2561964117 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fba8c031040 0x7fba8c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.843+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x7fba8c031040 2024-09-13T23:05:54.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.843+0000 7fba90b8a640 1 --2- 172.21.15.164:0/2561964117 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fba8c031040 0x7fba8c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.844+0000 7fba90b8a640 1 --2- 172.21.15.164:0/2561964117 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fba8c031040 0x7fba8c032940 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.844+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba80018950 con 0x7fba8c031040 2024-09-13T23:05:54.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.844+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x55d5f51de8a0 2024-09-13T23:05:54.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.844+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.844+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x55d5f51de8a0 2024-09-13T23:05:54.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.844+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.844+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x7fba8c031040 2024-09-13T23:05:54.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.844+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba80018950 con 0x7fba8c031040 2024-09-13T23:05:54.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.844+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x7fba8c031040 2024-09-13T23:05:54.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.845+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba80018950 con 0x7fba8c031040 2024-09-13T23:05:54.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.845+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x7fba780a3060 2024-09-13T23:05:54.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.845+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.845+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x55d5f51e4af0 2024-09-13T23:05:54.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.845+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba780a0030 con 0x55d5f51e4af0 2024-09-13T23:05:54.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.845+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x55d5f51de8a0 2024-09-13T23:05:54.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.845+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.845+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x7fba8c031040 2024-09-13T23:05:54.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.846+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba80018950 con 0x7fba8c031040 2024-09-13T23:05:54.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.846+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x55d5f51de8a0 2024-09-13T23:05:54.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.846+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.846+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x7fba780a3060 2024-09-13T23:05:54.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.846+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.846+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x55d5f51e4af0 2024-09-13T23:05:54.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.846+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.846+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x55d5f51e4af0 2024-09-13T23:05:54.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.846+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.847+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x7fba8c031040 2024-09-13T23:05:54.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.847+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba80018950 con 0x7fba8c031040 2024-09-13T23:05:54.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.847+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x55d5f51e4af0 2024-09-13T23:05:54.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.847+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.847+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x55d5f51e4af0 2024-09-13T23:05:54.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.847+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.847+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x55d5f51de8a0 2024-09-13T23:05:54.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.847+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.847+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x55d5f51de8a0 2024-09-13T23:05:54.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.848+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.848+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x7fba8c031040 2024-09-13T23:05:54.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.848+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba80018950 con 0x7fba8c031040 2024-09-13T23:05:54.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.848+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x55d5f51e4af0 2024-09-13T23:05:54.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.848+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.848+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x7fba780a3060 2024-09-13T23:05:54.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.848+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.848+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x55d5f51de8a0 2024-09-13T23:05:54.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.849+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.849+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x7fba8c031040 2024-09-13T23:05:54.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.849+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba80018950 con 0x7fba8c031040 2024-09-13T23:05:54.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.849+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x55d5f51e4af0 2024-09-13T23:05:54.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.849+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.849+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x7fba8c031040 2024-09-13T23:05:54.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.849+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba80018950 con 0x7fba8c031040 2024-09-13T23:05:54.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.849+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x7fba780a3060 2024-09-13T23:05:54.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.850+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.850+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x55d5f51e4af0 2024-09-13T23:05:54.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.850+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.850+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x7fba780a3060 2024-09-13T23:05:54.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.850+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.850+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x55d5f51de8a0 2024-09-13T23:05:54.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.850+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.850+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7510 con 0x7fba780a3060 2024-09-13T23:05:54.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.851+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.851+0000 7fba93096800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:54.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.851+0000 7fba93096800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:54.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.851+0000 7fba93096800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:54.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.851+0000 7fba93096800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:54.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.851+0000 7fba93096800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:54.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.851+0000 7fba93096800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:54.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.851+0000 7fba93096800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.851+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e3700 con 0x55d5f51de8a0 2024-09-13T23:05:54.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.851+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.851+0000 7fba93096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.851+0000 7fba93096800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.851+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e3fa0 con 0x55d5f51de8a0 2024-09-13T23:05:54.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.851+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.851+0000 7fba93096800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:54.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.851+0000 7fba93096800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.851+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7990 con 0x55d5f51de8a0 2024-09-13T23:05:54.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.851+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.851+0000 7fba93096800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:54.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.851+0000 7fba93096800 20 zone default found 2024-09-13T23:05:54.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.851+0000 7fba93096800 4 Realm: () 2024-09-13T23:05:54.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.851+0000 7fba93096800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:54.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.851+0000 7fba93096800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:54.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.851+0000 7fba93096800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:54.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.851+0000 7fba93096800 20 zonegroup default 2024-09-13T23:05:54.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.851+0000 7fba93096800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.851+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e7990 con 0x7fba8c031040 2024-09-13T23:05:54.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.852+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fba80018950 con 0x7fba8c031040 2024-09-13T23:05:54.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.852+0000 7fba93096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.852+0000 7fba93096800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.852+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e97b0 con 0x55d5f51e4af0 2024-09-13T23:05:54.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.852+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.852+0000 7fba93096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.852+0000 7fba93096800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.852+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e9bd0 con 0x55d5f51e4af0 2024-09-13T23:05:54.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.852+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.852+0000 7fba93096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.852+0000 7fba93096800 20 started sync module instance, tier type = 2024-09-13T23:05:54.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.852+0000 7fba93096800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:54.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.852+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e8c50 con 0x7fba780a3060 2024-09-13T23:05:54.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.853+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.853+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94377428815936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51e88b0 con 0x7fba780a3060 2024-09-13T23:05:54.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.853+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51eaae0 con 0x55d5f51de8a0 2024-09-13T23:05:54.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.854+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94377428815936] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.855+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.855+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94377428819984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51eaae0 con 0x55d5f51de8a0 2024-09-13T23:05:54.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.855+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51eb500 con 0x55d5f51e4af0 2024-09-13T23:05:54.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.856+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94377428819984] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.856+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.856+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94377428821552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51eaa50 con 0x55d5f51e4af0 2024-09-13T23:05:54.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.856+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51ec3c0 con 0x7fba780a3060 2024-09-13T23:05:54.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.857+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94377428821552] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.857+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.857+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94377428827920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51ec7e0 con 0x7fba780a3060 2024-09-13T23:05:54.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.857+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51ed1a0 con 0x55d5f51de8a0 2024-09-13T23:05:54.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.858+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94377428827920] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.858+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.858+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94377428831952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51ec7e0 con 0x55d5f51de8a0 2024-09-13T23:05:54.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.858+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51edbf0 con 0x7fba8c031040 2024-09-13T23:05:54.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.859+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94377428831952] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.859+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80018950 con 0x7fba8c031040 2024-09-13T23:05:54.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.859+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94377428834048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51ec7e0 con 0x7fba8c031040 2024-09-13T23:05:54.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.859+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51ee600 con 0x7fba8c031040 2024-09-13T23:05:54.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.860+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(56 notify.6 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80018950 con 0x7fba8c031040 2024-09-13T23:05:54.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.860+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94377428836688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51eea20 con 0x7fba8c031040 2024-09-13T23:05:54.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.860+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51ef4e0 con 0x7fba8c031040 2024-09-13T23:05:54.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.860+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94377428834048] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80018950 con 0x7fba8c031040 2024-09-13T23:05:54.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.861+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94377428836688] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80018950 con 0x7fba8c031040 2024-09-13T23:05:54.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.861+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80018950 con 0x7fba8c031040 2024-09-13T23:05:54.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.861+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94377428840464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51ee570 con 0x7fba8c031040 2024-09-13T23:05:54.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.861+0000 7fba93096800 20 add_watcher() i=0 2024-09-13T23:05:54.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.861+0000 7fba93096800 20 add_watcher() i=1 2024-09-13T23:05:54.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.861+0000 7fba93096800 20 add_watcher() i=2 2024-09-13T23:05:54.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.861+0000 7fba93096800 20 add_watcher() i=3 2024-09-13T23:05:54.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.861+0000 7fba93096800 20 add_watcher() i=4 2024-09-13T23:05:54.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.861+0000 7fba93096800 20 add_watcher() i=5 2024-09-13T23:05:54.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.861+0000 7fba93096800 20 add_watcher() i=6 2024-09-13T23:05:54.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.862+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94377428840464] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80018950 con 0x7fba8c031040 2024-09-13T23:05:54.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.862+0000 7fba93096800 20 add_watcher() i=7 2024-09-13T23:05:54.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.862+0000 7fba93096800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:54.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.862+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51f25e0 con 0x55d5f51de8a0 2024-09-13T23:05:54.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.862+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.863+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94377428828976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51efa60 con 0x55d5f51de8a0 2024-09-13T23:05:54.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.863+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94377428828976] v34'183 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.864+0000 7fb946fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:54.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.864+0000 7fba93096800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:54.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.864+0000 7fba93096800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:54.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.864+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51faf10 con 0x55d5f51de8a0 2024-09-13T23:05:54.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.865+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.865+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fb5e0 con 0x7fba8c031040 2024-09-13T23:05:54.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.866+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba80018950 con 0x7fba8c031040 2024-09-13T23:05:54.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.866+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fb5e0 con 0x55d5f51e4af0 2024-09-13T23:05:54.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.867+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.867+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fba00 con 0x55d5f51de8a0 2024-09-13T23:05:54.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.868+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'184 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.868+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fb9e0 con 0x7fba780a3060 2024-09-13T23:05:54.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.869+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'62 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.869+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fbff0 con 0x55d5f51e4af0 2024-09-13T23:05:54.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.870+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'41 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.870+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fc470 con 0x55d5f51de8a0 2024-09-13T23:05:54.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.871+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.871+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fc580 con 0x7fba8c031040 2024-09-13T23:05:54.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.872+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'43 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba80018950 con 0x7fba8c031040 2024-09-13T23:05:54.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.872+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fc580 con 0x7fba780a3060 2024-09-13T23:05:54.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.873+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.873+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fcbd0 con 0x55d5f51e4af0 2024-09-13T23:05:54.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.874+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.874+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fcbd0 con 0x7fba780a3060 2024-09-13T23:05:54.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.875+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'63 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.875+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fd140 con 0x7fba8c031040 2024-09-13T23:05:54.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.876+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba80018950 con 0x7fba8c031040 2024-09-13T23:05:54.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.876+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fd140 con 0x7fba780a3060 2024-09-13T23:05:54.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.877+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.877+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fd560 con 0x7fba8c031040 2024-09-13T23:05:54.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.878+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'47 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba80018950 con 0x7fba8c031040 2024-09-13T23:05:54.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.878+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fd560 con 0x55d5f51de8a0 2024-09-13T23:05:54.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.879+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'185 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.879+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fd560 con 0x55d5f51e4af0 2024-09-13T23:05:54.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.880+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'56 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.880+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fd560 con 0x7fba780a3060 2024-09-13T23:05:54.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.881+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'64 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.881+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fd560 con 0x55d5f51e4af0 2024-09-13T23:05:54.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.882+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.882+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fd560 con 0x55d5f51de8a0 2024-09-13T23:05:54.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.883+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.883+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fd560 con 0x55d5f51de8a0 2024-09-13T23:05:54.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.884+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'186 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.884+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fd560 con 0x55d5f51e4af0 2024-09-13T23:05:54.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.885+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'57 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.885+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fd560 con 0x7fba780a3060 2024-09-13T23:05:54.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.886+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.886+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fd560 con 0x55d5f51e4af0 2024-09-13T23:05:54.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.887+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.888+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fd560 con 0x55d5f51e4af0 2024-09-13T23:05:54.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.888+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.888+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fd560 con 0x55d5f51e4af0 2024-09-13T23:05:54.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.889+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.889+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fd560 con 0x55d5f51e4af0 2024-09-13T23:05:54.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.890+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'42 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.890+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fd560 con 0x7fba8c031040 2024-09-13T23:05:54.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.891+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba80018950 con 0x7fba8c031040 2024-09-13T23:05:54.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.891+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fd560 con 0x55d5f51e4af0 2024-09-13T23:05:54.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.892+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.892+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fd560 con 0x7fba8c031040 2024-09-13T23:05:54.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.894+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'44 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba80018950 con 0x7fba8c031040 2024-09-13T23:05:54.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.894+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fd560 con 0x55d5f51e4af0 2024-09-13T23:05:54.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.895+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'58 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.895+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fd560 con 0x7fba8c031040 2024-09-13T23:05:54.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.896+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'48 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba80018950 con 0x7fba8c031040 2024-09-13T23:05:54.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.896+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51fd560 con 0x7fba780a3060 2024-09-13T23:05:54.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.897+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.897+0000 7fb945fe3640 20 reqs_thread_entry: start 2024-09-13T23:05:54.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.897+0000 7fba93096800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:54.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.897+0000 7fba93096800 20 Filter name: none 2024-09-13T23:05:54.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.897+0000 7fb8b77fe640 20 reqs_thread_entry: start 2024-09-13T23:05:54.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.898+0000 7fba93096800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:05:54.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.898+0000 7fba93096800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.898+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5228250 con 0x7fba780a3060 2024-09-13T23:05:54.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.898+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 19 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv34 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.898+0000 7fba93096800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:05:54.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.898+0000 7fba93096800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:05:54.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.898+0000 7fba93096800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:05:54.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.898+0000 7fba93096800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5 : miss 2024-09-13T23:05:54.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.898+0000 7fba93096800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.898+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:95 8.9 8:90242e25:root::.bucket.meta.myfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5229c30 con 0x7fba780a3060 2024-09-13T23:05:54.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.898+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 20 ==== osd_op_reply(95 .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv33 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.898+0000 7fba93096800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:05:54.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.898+0000 7fba93096800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5 info.flags=0x17 2024-09-13T23:05:54.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.898+0000 7fba93096800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5 to cache LRU end 2024-09-13T23:05:54.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.898+0000 7fba93096800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:54.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.898+0000 7fba93096800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:05:54.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.898+0000 7fba93096800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5 2024-09-13T23:05:54.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.898+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:96 4.32 4:4c32db82:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f52a7440 con 0x55d5f51de8a0 2024-09-13T23:05:54.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.899+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(96 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.899+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:97 4.c 4:31ad3e4a:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f52a7440 con 0x55d5f51de8a0 2024-09-13T23:05:54.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.899+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(97 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.899+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:98 4.c 4:3060a63f:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f52a7440 con 0x55d5f51de8a0 2024-09-13T23:05:54.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.899+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(98 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.2 [call out=425b] v0'0 uv5 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.899+0000 7fba93096800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-13T23:05:54.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.899+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:99 4.c 4:3193faaa:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f52a7440 con 0x55d5f51de8a0 2024-09-13T23:05:54.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.900+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 32 ==== osd_op_reply(99 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.900+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:100 4.12 4:4832b5f3:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f52a7440 con 0x55d5f51de8a0 2024-09-13T23:05:54.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.900+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 33 ==== osd_op_reply(100 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.900+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:101 4.23 4:c41c6848:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f52a7440 con 0x7fba8c031040 2024-09-13T23:05:54.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.901+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(101 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fba80018950 con 0x7fba8c031040 2024-09-13T23:05:54.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.901+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:102 4.1f 4:fae6ee3c:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f52a7440 con 0x55d5f51e4af0 2024-09-13T23:05:54.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.901+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 26 ==== osd_op_reply(102 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.6 [call out=425b] v0'0 uv5 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.901+0000 7fba93096800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-13T23:05:54.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.901+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:103 4.26 4:6575ed7c:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f52a7440 con 0x7fba8c031040 2024-09-13T23:05:54.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.901+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(103 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fba80018950 con 0x7fba8c031040 2024-09-13T23:05:54.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.901+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:104 4.e 4:70d406bd:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f52a7440 con 0x7fba780a3060 2024-09-13T23:05:54.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.902+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 21 ==== osd_op_reply(104 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.8 [call out=425b] v0'0 uv3 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.902+0000 7fba93096800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-13T23:05:54.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.902+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:105 4.4 4:20e1dfd2:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f52a74a0 con 0x7fba8c031040 2024-09-13T23:05:54.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.902+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(105 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fba80018950 con 0x7fba8c031040 2024-09-13T23:05:54.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.902+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:106 4.d 4:b1210977:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f52a7b70 con 0x55d5f51e4af0 2024-09-13T23:05:54.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.902+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 27 ==== osd_op_reply(106 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.10 [call out=698b] v0'0 uv11 ondisk = 0) ==== 195+0+698 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.902+0000 7fba93096800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-13T23:05:54.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.902+0000 7fba93096800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-13T23:05:54.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.902+0000 7fba93096800 20 get_obj_state: octx=0x7fba80016f90 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55d5f52a6a78 s->prefetch_data=0 2024-09-13T23:05:54.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.903+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:107 3.5s0 3:a3d5d6d5:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f52a4f70 con 0x7fba780a3060 2024-09-13T23:05:54.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.903+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 22 ==== osd_op_reply(107 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=877b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.903+0000 7fba93096800 10 manifest: total_size = 6 2024-09-13T23:05:54.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.903+0000 7fba93096800 20 get_obj_state: setting s->obj_tag to a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7249721127833853854 2024-09-13T23:05:54.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.903+0000 7fba93096800 20 get_obj_state: octx=0x7fba80016f90 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55d5f52a6a78 s->prefetch_data=0 2024-09-13T23:05:54.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.903+0000 7fba93096800 20 prepare_atomic_modification: state is not atomic. state=0x55d5f52a6a78 2024-09-13T23:05:54.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.903+0000 7fba93096800 20 bucket index object: :.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.2 2024-09-13T23:05:54.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.903+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:108 4.c 4:3060a63f:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f522f5f0 con 0x55d5f51de8a0 2024-09-13T23:05:54.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.904+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 34 ==== osd_op_reply(108 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.2 [stat,call,call] v34'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.904+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:109 3.5s0 3:a3d5d6d5:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f522f5f0 con 0x7fba780a3060 2024-09-13T23:05:54.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.906+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 23 ==== osd_op_reply(109 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5_9c8454ddf7aa50116496bac348d7550d [call] v34'3 uv3 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.906+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:110 4.c 4:3060a63f:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5230080 con 0x55d5f51de8a0 2024-09-13T23:05:54.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.906+0000 7fba93096800 20 get_obj_state: octx=0x7fba80016f90 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55d5f52309e8 s->prefetch_data=0 2024-09-13T23:05:54.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.906+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:111 3.2as0 3:55b32452:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5231360 con 0x55d5f51de8a0 2024-09-13T23:05:54.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.906+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 35 ==== osd_op_reply(111 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.906+0000 7fba93096800 10 manifest: total_size = 3 2024-09-13T23:05:54.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.906+0000 7fba93096800 20 get_obj_state: setting s->obj_tag to a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.2561529843118466166 2024-09-13T23:05:54.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.906+0000 7fba93096800 20 get_obj_state: octx=0x7fba80016f90 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55d5f52309e8 s->prefetch_data=0 2024-09-13T23:05:54.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.906+0000 7fba93096800 20 prepare_atomic_modification: state is not atomic. state=0x55d5f52309e8 2024-09-13T23:05:54.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.906+0000 7fba93096800 20 bucket index object: :.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.6 2024-09-13T23:05:54.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.906+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:112 4.1f 4:fae6ee3c:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5230080 con 0x55d5f51e4af0 2024-09-13T23:05:54.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.907+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 36 ==== osd_op_reply(110 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.2 [stat,call,call] v34'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fba80018950 con 0x55d5f51de8a0 2024-09-13T23:05:54.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.907+0000 7fb967fff640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-13T23:05:54.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.907+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 28 ==== osd_op_reply(112 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.6 [stat,call,call] v34'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.907+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:113 3.2as0 3:55b32452:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f522fbd0 con 0x55d5f51de8a0 2024-09-13T23:05:54.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.909+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 37 ==== osd_op_reply(113 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5_b1b9a972ccd8c962a473909b97007eb4 [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fba80060040 con 0x55d5f51de8a0 2024-09-13T23:05:54.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.909+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:114 4.1f 4:fae6ee3c:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5230080 con 0x55d5f51e4af0 2024-09-13T23:05:54.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.909+0000 7fba93096800 20 get_obj_state: octx=0x7fba80016f90 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55d5f52309e8 s->prefetch_data=0 2024-09-13T23:05:54.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.909+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:115 3.13s0 3:c97e3352:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5230080 con 0x55d5f51e4af0 2024-09-13T23:05:54.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.909+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 29 ==== osd_op_reply(115 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.910+0000 7fba93096800 10 manifest: total_size = 4 2024-09-13T23:05:54.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.910+0000 7fba93096800 20 get_obj_state: setting s->obj_tag to a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.1655035936984474494 2024-09-13T23:05:54.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.910+0000 7fba93096800 20 get_obj_state: octx=0x7fba80016f90 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55d5f52309e8 s->prefetch_data=0 2024-09-13T23:05:54.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.910+0000 7fba93096800 20 prepare_atomic_modification: state is not atomic. state=0x55d5f52309e8 2024-09-13T23:05:54.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.910+0000 7fba93096800 20 bucket index object: :.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.8 2024-09-13T23:05:54.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.910+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:116 4.e 4:70d406bd:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5235b00 con 0x7fba780a3060 2024-09-13T23:05:54.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.910+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 30 ==== osd_op_reply(114 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.6 [stat,call,call] v34'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.910+0000 7fb9677fe640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-13T23:05:54.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.911+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 24 ==== osd_op_reply(116 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.8 [stat,call,call] v34'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.911+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:117 3.13s0 3:c97e3352:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f522be80 con 0x55d5f51e4af0 2024-09-13T23:05:54.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.913+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 31 ==== osd_op_reply(117 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.913+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:118 4.e 4:70d406bd:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5231f20 con 0x7fba780a3060 2024-09-13T23:05:54.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.913+0000 7fba93096800 20 get_obj_state: octx=0x7fba80016f90 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55d5f52309e8 s->prefetch_data=0 2024-09-13T23:05:54.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.913+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:119 3.5s0 3:a066c06d:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5232b90 con 0x7fba780a3060 2024-09-13T23:05:54.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.913+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 25 ==== osd_op_reply(119 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.913+0000 7fba93096800 10 manifest: total_size = 5 2024-09-13T23:05:54.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.913+0000 7fba93096800 20 get_obj_state: setting s->obj_tag to a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.18149710239971937638 2024-09-13T23:05:54.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.913+0000 7fba93096800 20 get_obj_state: octx=0x7fba80016f90 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55d5f52309e8 s->prefetch_data=0 2024-09-13T23:05:54.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.913+0000 7fba93096800 20 prepare_atomic_modification: state is not atomic. state=0x55d5f52309e8 2024-09-13T23:05:54.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.913+0000 7fba93096800 20 bucket index object: :.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.10 2024-09-13T23:05:54.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.913+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:120 4.d 4:b1210977:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5231f20 con 0x55d5f51e4af0 2024-09-13T23:05:54.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.914+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 26 ==== osd_op_reply(118 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.8 [stat,call,call] v34'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.914+0000 7fb967fff640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-13T23:05:54.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.914+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 32 ==== osd_op_reply(120 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.10 [stat,call,call] v34'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.914+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:121 3.5s0 3:a066c06d:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5231e90 con 0x7fba780a3060 2024-09-13T23:05:54.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.916+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 27 ==== osd_op_reply(121 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5_24d27c169c2c881eb09a065116f2aa5c [call] v34'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.916+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:122 4.d 4:b1210977:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5232b90 con 0x55d5f51e4af0 2024-09-13T23:05:54.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.916+0000 7fba93096800 20 get_obj_state: octx=0x7fba80016f90 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55d5f52309e8 s->prefetch_data=0 2024-09-13T23:05:54.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.916+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:123 3.7s0 3:e38cefd1:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5232b90 con 0x55d5f51e4af0 2024-09-13T23:05:54.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.916+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 33 ==== osd_op_reply(123 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv5 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.916+0000 7fba93096800 10 manifest: total_size = 5 2024-09-13T23:05:54.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.916+0000 7fba93096800 20 get_obj_state: setting s->obj_tag to _6yAVVHU0q6I0BYeOuKtJmlXSS7OP1QU 2024-09-13T23:05:54.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.916+0000 7fba93096800 20 get_obj_state: octx=0x7fba80016f90 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55d5f52309e8 s->prefetch_data=0 2024-09-13T23:05:54.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.916+0000 7fba93096800 20 prepare_atomic_modification: state is not atomic. state=0x55d5f52309e8 2024-09-13T23:05:54.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.916+0000 7fba93096800 20 bucket index object: :.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.10 2024-09-13T23:05:54.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.916+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:124 4.d 4:b1210977:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5235220 con 0x55d5f51e4af0 2024-09-13T23:05:54.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.917+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 34 ==== osd_op_reply(122 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.10 [stat,call,call] v34'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.917+0000 7fb9677fe640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-13T23:05:54.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.918+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 35 ==== osd_op_reply(124 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.10 [stat,call,call] v34'14 uv14 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.918+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:125 3.7s0 3:e38cefd1:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f52326e0 con 0x55d5f51e4af0 2024-09-13T23:05:54.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.919+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 36 ==== osd_op_reply(125 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5_bb3aec0fdcdbc2974890f805c585d432 [call] v34'6 uv6 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.920+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:126 4.d 4:b1210977:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f52326e0 con 0x55d5f51e4af0 2024-09-13T23:05:54.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.920+0000 7fba93096800 20 list_objects_ordered: starting attempt 1 2024-09-13T23:05:54.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.920+0000 7fba93096800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T23:05:54.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.920+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:127 4.32 4:4c32db82:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f52326e0 con 0x55d5f51de8a0 2024-09-13T23:05:54.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.920+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:128 4.c 4:31ad3e4a:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f52326e0 con 0x55d5f51de8a0 2024-09-13T23:05:54.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.920+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:129 4.c 4:3060a63f:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f52326e0 con 0x55d5f51de8a0 2024-09-13T23:05:54.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.920+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:130 4.c 4:3193faaa:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5232e10 con 0x55d5f51de8a0 2024-09-13T23:05:54.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.920+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:131 4.12 4:4832b5f3:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f523eee0 con 0x55d5f51de8a0 2024-09-13T23:05:54.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.920+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 38 ==== osd_op_reply(127 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fba80060040 con 0x55d5f51de8a0 2024-09-13T23:05:54.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.920+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 39 ==== osd_op_reply(128 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fba80060040 con 0x55d5f51de8a0 2024-09-13T23:05:54.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.920+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:132 4.23 4:c41c6848:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5241c50 con 0x7fba8c031040 2024-09-13T23:05:54.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.920+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:133 4.1f 4:fae6ee3c:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5232e10 con 0x55d5f51e4af0 2024-09-13T23:05:54.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.921+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:134 4.26 4:6575ed7c:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5241c50 con 0x7fba8c031040 2024-09-13T23:05:54.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.921+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:135 4.e 4:70d406bd:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5241c50 con 0x7fba780a3060 2024-09-13T23:05:54.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.921+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:136 4.4 4:20e1dfd2:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5246c70 con 0x7fba8c031040 2024-09-13T23:05:54.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.921+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:137 4.d 4:b1210977:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5249a70 con 0x55d5f51e4af0 2024-09-13T23:05:54.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.921+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 40 ==== osd_op_reply(131 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fba80060040 con 0x55d5f51de8a0 2024-09-13T23:05:54.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.921+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== osd_op_reply(132 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fba80060040 con 0x7fba8c031040 2024-09-13T23:05:54.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.921+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 37 ==== osd_op_reply(133 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.6 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.921+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 27 ==== osd_op_reply(134 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fba80060040 con 0x7fba8c031040 2024-09-13T23:05:54.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.921+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 41 ==== osd_op_reply(129 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.2 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fba80060040 con 0x55d5f51de8a0 2024-09-13T23:05:54.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.921+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 28 ==== osd_op_reply(135 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.8 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.921+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 28 ==== osd_op_reply(136 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fba80060040 con 0x7fba8c031040 2024-09-13T23:05:54.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.921+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 38 ==== osd_op_reply(126 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.10 [stat,call,call] v34'15 uv15 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.921+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 42 ==== osd_op_reply(130 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fba80060040 con 0x55d5f51de8a0 2024-09-13T23:05:54.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.921+0000 7fb967fff640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-13T23:05:54.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.921+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 39 ==== osd_op_reply(137 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.10 [call out=124b] v0'0 uv15 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.921+0000 7fba93096800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T23:05:54.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.921+0000 7fba93096800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T23:05:54.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.921+0000 7fba93096800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T23:05:54.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.921+0000 7fba93096800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T23:05:54.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.921+0000 7fba93096800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5])"; uploads.size()=0; is_truncated=0 2024-09-13T23:05:54.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.922+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:138 4.32 4:4c32db82:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5241c50 con 0x55d5f51de8a0 2024-09-13T23:05:54.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.922+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:139 4.c 4:31ad3e4a:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5249a70 con 0x55d5f51de8a0 2024-09-13T23:05:54.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.922+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:140 4.c 4:3060a63f:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5249310 con 0x55d5f51de8a0 2024-09-13T23:05:54.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.922+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:141 4.c 4:3193faaa:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5235aa0 con 0x55d5f51de8a0 2024-09-13T23:05:54.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.922+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:142 4.12 4:4832b5f3:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5230cb0 con 0x55d5f51de8a0 2024-09-13T23:05:54.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.922+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:143 4.23 4:c41c6848:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5241c50 con 0x7fba8c031040 2024-09-13T23:05:54.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.922+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:144 4.1f 4:fae6ee3c:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5249a70 con 0x55d5f51e4af0 2024-09-13T23:05:54.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.922+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:145 4.26 4:6575ed7c:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5235aa0 con 0x7fba8c031040 2024-09-13T23:05:54.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.922+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:146 4.e 4:70d406bd:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5230cb0 con 0x7fba780a3060 2024-09-13T23:05:54.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.922+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:147 4.4 4:20e1dfd2:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f523c5b0 con 0x7fba8c031040 2024-09-13T23:05:54.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.922+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:148 4.d 4:b1210977:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5241c50 con 0x55d5f51e4af0 2024-09-13T23:05:54.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.922+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 29 ==== osd_op_reply(143 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fba80060040 con 0x7fba8c031040 2024-09-13T23:05:54.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.922+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 30 ==== osd_op_reply(145 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fba80060040 con 0x7fba8c031040 2024-09-13T23:05:54.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.922+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 31 ==== osd_op_reply(147 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fba80060040 con 0x7fba8c031040 2024-09-13T23:05:54.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.922+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 43 ==== osd_op_reply(138 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fba80060040 con 0x55d5f51de8a0 2024-09-13T23:05:54.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.922+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 44 ==== osd_op_reply(139 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fba80060040 con 0x55d5f51de8a0 2024-09-13T23:05:54.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.922+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 45 ==== osd_op_reply(142 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fba80060040 con 0x55d5f51de8a0 2024-09-13T23:05:54.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.922+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 40 ==== osd_op_reply(144 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.6 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.922+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 29 ==== osd_op_reply(146 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.8 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.922+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 46 ==== osd_op_reply(140 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.2 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fba80060040 con 0x55d5f51de8a0 2024-09-13T23:05:54.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.922+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 41 ==== osd_op_reply(148 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.10 [call out=124b] v0'0 uv15 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.922+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 47 ==== osd_op_reply(141 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fba80060040 con 0x55d5f51de8a0 2024-09-13T23:05:54.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.922+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5230cb0 con 0x7fba780a3060 2024-09-13T23:05:54.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.923+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 30 ==== osd_op_reply(149 foo.buckets [call] v34'38 uv38 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.923+0000 7fba93096800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-09-13T23:05:54.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.923+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5249a70 con 0x7fba780a3060 2024-09-13T23:05:54.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.924+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 31 ==== osd_op_reply(150 myfoo [call,call,delete] v34'39 uv39 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.924+0000 7fba93096800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-13T23:05:54.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.924+0000 7fba93096800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T23:05:54.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.924+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94377429211600 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5235aa0 con 0x7fba8c031040 2024-09-13T23:05:54.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.925+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 32 ==== watch-notify(notify (1) cookie 94377428836688 notify 146028888087 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55d5f51fcbd0 con 0x7fba8c031040 2024-09-13T23:05:54.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.925+0000 7fb967fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888087 cookie 94377428836688 notifier 4659 bl.length()=149 2024-09-13T23:05:54.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.925+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 33 ==== osd_op_reply(151 notify.6 [notify cookie 94377429211600 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fba80060040 con 0x7fba8c031040 2024-09-13T23:05:54.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.925+0000 7fb967fff640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb954003d60 con 0x7fba8c031040 2024-09-13T23:05:54.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.925+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 34 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80060040 con 0x7fba8c031040 2024-09-13T23:05:54.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.925+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 35 ==== watch-notify(notify_complete (2) cookie 94377429211600 notify 146028888087 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d5f51f9680 con 0x7fba8c031040 2024-09-13T23:05:54.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.925+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:153 8.9 8:90242e25:root::.bucket.meta.myfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f523ee50 con 0x7fba780a3060 2024-09-13T23:05:54.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.926+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 32 ==== osd_op_reply(153 .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5 [call,call,delete] v34'40 uv40 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.926+0000 7fba93096800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5 from cache 2024-09-13T23:05:54.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.926+0000 7fba93096800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5, ofs0, ns] 2024-09-13T23:05:54.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.926+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:154 7.3 7:c609908c:::notify.5:head [notify cookie 94377429211600 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f523ee50 con 0x7fba8c031040 2024-09-13T23:05:54.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.926+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 36 ==== watch-notify(notify (1) cookie 94377428834048 notify 146028888088 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55d5f51f9680 con 0x7fba8c031040 2024-09-13T23:05:54.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.926+0000 7fb9677fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888088 cookie 94377428834048 notifier 4659 bl.length()=206 2024-09-13T23:05:54.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.926+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 37 ==== osd_op_reply(154 notify.5 [notify cookie 94377429211600 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fba80060040 con 0x7fba8c031040 2024-09-13T23:05:54.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.926+0000 7fb9677fe640 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:155 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb8c40032c0 con 0x7fba8c031040 2024-09-13T23:05:54.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.927+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 38 ==== osd_op_reply(155 notify.5 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80060040 con 0x7fba8c031040 2024-09-13T23:05:54.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.927+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 39 ==== watch-notify(notify_complete (2) cookie 94377429211600 notify 146028888088 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d5f51a7f00 con 0x7fba8c031040 2024-09-13T23:05:54.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.927+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:156 4.32 4:4c32db82:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f523ee50 con 0x55d5f51de8a0 2024-09-13T23:05:54.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.927+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:157 4.c 4:31ad3e4a:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f52499d0 con 0x55d5f51de8a0 2024-09-13T23:05:54.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.927+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:158 4.c 4:3060a63f:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f52355f0 con 0x55d5f51de8a0 2024-09-13T23:05:54.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.927+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:159 4.c 4:3193faaa:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5230cb0 con 0x55d5f51de8a0 2024-09-13T23:05:54.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.927+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:160 4.12 4:4832b5f3:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5235a10 con 0x55d5f51de8a0 2024-09-13T23:05:54.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.927+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:161 4.23 4:c41c6848:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f523ee50 con 0x7fba8c031040 2024-09-13T23:05:54.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.927+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:162 4.1f 4:fae6ee3c:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f52499d0 con 0x55d5f51e4af0 2024-09-13T23:05:54.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.927+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:163 4.26 4:6575ed7c:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f52355f0 con 0x7fba8c031040 2024-09-13T23:05:54.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.927+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:164 4.e 4:70d406bd:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5230cb0 con 0x7fba780a3060 2024-09-13T23:05:54.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.927+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:165 4.4 4:20e1dfd2:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5235a10 con 0x7fba8c031040 2024-09-13T23:05:54.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.927+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:166 4.d 4:b1210977:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f523ee50 con 0x55d5f51e4af0 2024-09-13T23:05:54.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.928+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 42 ==== osd_op_reply(162 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.6 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.928+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 40 ==== osd_op_reply(161 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.5 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fba80060040 con 0x7fba8c031040 2024-09-13T23:05:54.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.929+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 41 ==== osd_op_reply(163 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.7 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fba80060040 con 0x7fba8c031040 2024-09-13T23:05:54.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.929+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 42 ==== osd_op_reply(165 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.9 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fba80060040 con 0x7fba8c031040 2024-09-13T23:05:54.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.929+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 48 ==== osd_op_reply(160 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.4 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fba80060040 con 0x55d5f51de8a0 2024-09-13T23:05:54.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.929+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 33 ==== osd_op_reply(164 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.8 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.929+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 43 ==== osd_op_reply(166 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.10 [delete] v34'16 uv16 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.929+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 49 ==== osd_op_reply(156 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.0 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fba80060040 con 0x55d5f51de8a0 2024-09-13T23:05:54.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.929+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 50 ==== osd_op_reply(157 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.1 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fba80060040 con 0x55d5f51de8a0 2024-09-13T23:05:54.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.929+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 51 ==== osd_op_reply(158 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.2 [delete] v34'9 uv9 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fba80060040 con 0x55d5f51de8a0 2024-09-13T23:05:54.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.932+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 52 ==== osd_op_reply(159 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5.3 [delete] v34'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fba80060040 con 0x55d5f51de8a0 2024-09-13T23:05:54.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.932+0000 7fba93096800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5 : miss 2024-09-13T23:05:54.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.932+0000 7fba93096800 20 rados->read ofs=0 len=0 2024-09-13T23:05:54.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.932+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:167 6.1 6:83054048:::pubsub..bucket.myfoo%2fa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5f5235a10 con 0x55d5f51de8a0 2024-09-13T23:05:54.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.932+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 53 ==== osd_op_reply(167 pubsub..bucket.myfoo/a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fba80060040 con 0x55d5f51de8a0 2024-09-13T23:05:54.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.932+0000 7fba93096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:54.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.932+0000 7fba93096800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5 info.flags=0x0 2024-09-13T23:05:54.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.932+0000 7fba93096800 10 adding default.rgw.log++pubsub..bucket.myfoo/a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5 to cache LRU end 2024-09-13T23:05:54.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.932+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:168 6.1 6:83054048:::pubsub..bucket.myfoo%2fa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f52499d0 con 0x55d5f51de8a0 2024-09-13T23:05:54.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.933+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 54 ==== osd_op_reply(168 pubsub..bucket.myfoo/a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5 [delete] v34'16 uv14 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fba80060040 con 0x55d5f51de8a0 2024-09-13T23:05:54.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.933+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f52355f0 con 0x7fba780a3060 2024-09-13T23:05:54.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.934+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 34 ==== osd_op_reply(169 foo.buckets [call] v34'41 uv41 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.935+0000 7fb946fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:54.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.935+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94377428828976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f52499d0 con 0x55d5f51de8a0 2024-09-13T23:05:54.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.936+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 55 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94377428828976] v34'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fba80060040 con 0x55d5f51de8a0 2024-09-13T23:05:54.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.936+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94377428815936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f52499d0 con 0x7fba780a3060 2024-09-13T23:05:54.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.937+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 35 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94377428815936] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.937+0000 7fba93096800 20 remove_watcher() i=0 2024-09-13T23:05:54.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.937+0000 7fba93096800 2 removed watcher, disabling cache 2024-09-13T23:05:54.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.937+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94377428819984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f52499d0 con 0x55d5f51de8a0 2024-09-13T23:05:54.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.938+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 56 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94377428819984] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80060040 con 0x55d5f51de8a0 2024-09-13T23:05:54.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.938+0000 7fba93096800 20 remove_watcher() i=1 2024-09-13T23:05:54.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.938+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94377428821552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51ea010 con 0x55d5f51e4af0 2024-09-13T23:05:54.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.939+0000 7fba88389640 1 -- 172.21.15.164:0/2561964117 <== osd.3 v2:172.21.15.164:6816/93809510 44 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94377428821552] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba780b2040 con 0x55d5f51e4af0 2024-09-13T23:05:54.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.939+0000 7fba93096800 20 remove_watcher() i=2 2024-09-13T23:05:54.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.939+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94377428827920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f52499d0 con 0x7fba780a3060 2024-09-13T23:05:54.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.940+0000 7fba9138b640 1 -- 172.21.15.164:0/2561964117 <== osd.2 v2:172.21.15.164:6808/3795914978 36 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94377428827920] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8c01f070 con 0x7fba780a3060 2024-09-13T23:05:54.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.940+0000 7fba93096800 20 remove_watcher() i=3 2024-09-13T23:05:54.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.940+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94377428831952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51ea630 con 0x55d5f51de8a0 2024-09-13T23:05:54.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.941+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.1 v2:172.21.15.164:6800/4060509701 57 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94377428831952] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80060040 con 0x55d5f51de8a0 2024-09-13T23:05:54.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.941+0000 7fba93096800 20 remove_watcher() i=4 2024-09-13T23:05:54.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.941+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94377428834048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51ea010 con 0x7fba8c031040 2024-09-13T23:05:54.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.942+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 43 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94377428834048] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80060040 con 0x7fba8c031040 2024-09-13T23:05:54.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.942+0000 7fba93096800 20 remove_watcher() i=5 2024-09-13T23:05:54.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.942+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94377428836688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51ea630 con 0x7fba8c031040 2024-09-13T23:05:54.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.943+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 44 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94377428836688] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80060040 con 0x7fba8c031040 2024-09-13T23:05:54.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.943+0000 7fba93096800 20 remove_watcher() i=6 2024-09-13T23:05:54.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.943+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94377428840464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5f51ed700 con 0x7fba8c031040 2024-09-13T23:05:54.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.944+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 <== osd.0 v2:172.21.15.17:6800/489863589 45 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94377428840464] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80060040 con 0x7fba8c031040 2024-09-13T23:05:54.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.944+0000 7fba93096800 20 remove_watcher() i=7 2024-09-13T23:05:54.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.944+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fba8c031040 msgr2=0x7fba8c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.944+0000 7fba93096800 1 --2- 172.21.15.164:0/2561964117 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fba8c031040 0x7fba8c032940 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.944+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d5f51de8a0 msgr2=0x55d5f51e0d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.944+0000 7fba93096800 1 --2- 172.21.15.164:0/2561964117 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d5f51de8a0 0x55d5f51e0d60 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.944+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fba780a3060 msgr2=0x7fba780914b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.944+0000 7fba93096800 1 --2- 172.21.15.164:0/2561964117 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fba780a3060 0x7fba780914b0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.944+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55d5f51e4af0 msgr2=0x55d5f51e6ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.944+0000 7fba93096800 1 --2- 172.21.15.164:0/2561964117 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55d5f51e4af0 0x55d5f51e6ee0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.944+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb95c036b40 msgr2=0x7fb95c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.944+0000 7fba93096800 1 --2- 172.21.15.164:0/2561964117 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb95c036b40 0x7fb95c039000 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55d5f51a86c0 tx=0x7fba8c01f000 comp rx=0 tx=0).stop 2024-09-13T23:05:54.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.944+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f51cbab0 msgr2=0x55d5f51d2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.944+0000 7fba90b8a640 1 -- 172.21.15.164:0/2561964117 reap_dead start 2024-09-13T23:05:54.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.944+0000 7fba93096800 1 --2- 172.21.15.164:0/2561964117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f51cbab0 0x55d5f51d2f70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fba780059a0 tx=0x7fba780910a0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.944+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 shutdown_connections 2024-09-13T23:05:54.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.944+0000 7fba93096800 1 --2- 172.21.15.164:0/2561964117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f51cbab0 0x55d5f51d2f70 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.944+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 >> 172.21.15.164:0/2561964117 conn(0x55d5f51c7e10 msgr2=0x55d5f51c5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.944+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 shutdown_connections 2024-09-13T23:05:54.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.944+0000 7fba93096800 1 -- 172.21.15.164:0/2561964117 wait complete. 2024-09-13T23:05:54.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.945+0000 7fba93096800 1 -- 172.21.15.164:0/1476210270 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb968036b40 msgr2=0x7fb968039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.945+0000 7fba93096800 1 --2- 172.21.15.164:0/1476210270 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb968036b40 0x7fb968039000 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55d5f51af4f0 tx=0x7fba8c005840 comp rx=0 tx=0).stop 2024-09-13T23:05:54.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.945+0000 7fba93096800 1 -- 172.21.15.164:0/1476210270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f51beec0 msgr2=0x55d5f51bf2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.945+0000 7fba93096800 1 --2- 172.21.15.164:0/1476210270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f51beec0 0x55d5f51bf2e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fba78045f50 tx=0x7fba78002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.945+0000 7fba93096800 1 -- 172.21.15.164:0/1476210270 shutdown_connections 2024-09-13T23:05:54.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.945+0000 7fba93096800 1 --2- 172.21.15.164:0/1476210270 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb968036b40 0x7fb968039000 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.945+0000 7fba93096800 1 --2- 172.21.15.164:0/1476210270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f51beec0 0x55d5f51bf2e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.945+0000 7fba93096800 1 -- 172.21.15.164:0/1476210270 >> 172.21.15.164:0/1476210270 conn(0x55d5f51b3e50 msgr2=0x55d5f51b69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.945+0000 7fba93096800 1 -- 172.21.15.164:0/1476210270 shutdown_connections 2024-09-13T23:05:54.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.945+0000 7fba93096800 1 -- 172.21.15.164:0/1476210270 wait complete. 2024-09-13T23:05:54.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.945+0000 7fba93096800 1 -- 172.21.15.164:0/1472924647 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d5f50b2880 msgr2=0x55d5f51ae510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.945+0000 7fba93096800 1 --2- 172.21.15.164:0/1472924647 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d5f50b2880 0x55d5f51ae510 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.945+0000 7fba93096800 1 -- 172.21.15.164:0/1472924647 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb978036b90 msgr2=0x7fb978039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.945+0000 7fba93096800 1 --2- 172.21.15.164:0/1472924647 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb978036b90 0x7fb978039050 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fba78057000 tx=0x7fba78052000 comp rx=0 tx=0).stop 2024-09-13T23:05:54.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.945+0000 7fba93096800 1 -- 172.21.15.164:0/1472924647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f5021eb0 msgr2=0x55d5f51a74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.945+0000 7fba93096800 1 --2- 172.21.15.164:0/1472924647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f5021eb0 0x55d5f51a74a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fba8000b7c0 tx=0x7fba80000ed0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.945+0000 7fba93096800 1 -- 172.21.15.164:0/1472924647 shutdown_connections 2024-09-13T23:05:54.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.945+0000 7fba93096800 1 --2- 172.21.15.164:0/1472924647 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d5f50b2880 0x55d5f51ae510 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.945+0000 7fba93096800 1 --2- 172.21.15.164:0/1472924647 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb978036b90 0x7fb978039050 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.945+0000 7fba93096800 1 --2- 172.21.15.164:0/1472924647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5f5021eb0 0x55d5f51a74a0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.945+0000 7fba93096800 1 -- 172.21.15.164:0/1472924647 >> 172.21.15.164:0/1472924647 conn(0x55d5f50a8dd0 msgr2=0x55d5f5198e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.945+0000 7fba93096800 1 -- 172.21.15.164:0/1472924647 shutdown_connections 2024-09-13T23:05:54.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:54.945+0000 7fba93096800 1 -- 172.21.15.164:0/1472924647 wait complete. 2024-09-13T23:05:54.955 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T23:05:54.955 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T23:05:54.955 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-13T23:05:55.002 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:55.002 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:55.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.001+0000 7f53df12e800 1 Processor -- start 2024-09-13T23:05:55.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.001+0000 7f53df12e800 1 -- start start 2024-09-13T23:05:55.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.002+0000 7f53df12e800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5620c1e9c650 0x5620c1f2b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.002+0000 7f53df12e800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5620c1de7b30 con 0x5620c1f2b720 2024-09-13T23:05:55.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.002+0000 7f53df12e800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x5620c1dc9360 con 0x5620c1e9c650 2024-09-13T23:05:55.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.002+0000 7f53dad6e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5620c1e9c650 0x5620c1f2b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.002+0000 7f53da56d640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x5620c1f2b720 0x5620c1f2db10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:53990/0 (socket says 172.21.15.164:53990) 2024-09-13T23:05:55.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.002+0000 7f53da56d640 1 -- 172.21.15.164:0/3453948809 learned_addr learned my addr 172.21.15.164:0/3453948809 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:55.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.002+0000 7f53d9d6c640 1 -- 172.21.15.164:0/3453948809 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1787604782 0 0) 0x5620c1de7b30 con 0x5620c1f2b720 2024-09-13T23:05:55.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.002+0000 7f53d9d6c640 1 -- 172.21.15.164:0/3453948809 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53c8001e10 con 0x5620c1f2b720 2024-09-13T23:05:55.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.002+0000 7f53dad6e640 1 -- 172.21.15.164:0/3453948809 >> v1:172.21.15.17:6789/0 conn(0x5620c1f2b720 legacy=0x5620c1f2db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.002+0000 7f53dad6e640 1 -- 172.21.15.164:0/3453948809 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620c1defe00 con 0x5620c1e9c650 2024-09-13T23:05:55.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.004+0000 7f53dad6e640 1 --2- 172.21.15.164:0/3453948809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c1e9c650 0x5620c1f2b1e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f53cc005fd0 tx=0x7f53cc045b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3631757cf96ba805 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.004+0000 7f53d9d6c640 1 -- 172.21.15.164:0/3453948809 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc055070 con 0x5620c1e9c650 2024-09-13T23:05:55.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.004+0000 7f53d9d6c640 1 -- 172.21.15.164:0/3453948809 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53cc051540 con 0x5620c1e9c650 2024-09-13T23:05:55.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.004+0000 7f53d9d6c640 1 -- 172.21.15.164:0/3453948809 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc051820 con 0x5620c1e9c650 2024-09-13T23:05:55.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.005+0000 7f53df12e800 1 -- 172.21.15.164:0/3453948809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c1e9c650 msgr2=0x5620c1f2b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.005+0000 7f53df12e800 1 --2- 172.21.15.164:0/3453948809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c1e9c650 0x5620c1f2b1e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f53cc005fd0 tx=0x7f53cc045b30 comp rx=0 tx=0).stop 2024-09-13T23:05:55.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.005+0000 7f53df12e800 1 -- 172.21.15.164:0/3453948809 shutdown_connections 2024-09-13T23:05:55.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.005+0000 7f53df12e800 1 --2- 172.21.15.164:0/3453948809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c1e9c650 0x5620c1f2b1e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.005+0000 7f53df12e800 1 -- 172.21.15.164:0/3453948809 >> 172.21.15.164:0/3453948809 conn(0x5620c1f22db0 msgr2=0x5620c1f251d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:55.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.005+0000 7f53df12e800 1 -- 172.21.15.164:0/3453948809 shutdown_connections 2024-09-13T23:05:55.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.005+0000 7f53df12e800 1 -- 172.21.15.164:0/3453948809 wait complete. 2024-09-13T23:05:55.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.019+0000 7f53df12e800 1 Processor -- start 2024-09-13T23:05:55.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.019+0000 7f53df12e800 1 -- start start 2024-09-13T23:05:55.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.019+0000 7f53df12e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c1e9c650 0x5620c1f28b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.019+0000 7f53df12e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5620c1e74360 con 0x5620c1e9c650 2024-09-13T23:05:55.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.020+0000 7f53dad6e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c1e9c650 0x5620c1f28b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.020+0000 7f53dad6e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c1e9c650 0x5620c1f28b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:38078/0 (socket says 172.21.15.164:38078) 2024-09-13T23:05:55.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.020+0000 7f53dad6e640 1 -- 172.21.15.164:0/768665450 learned_addr learned my addr 172.21.15.164:0/768665450 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:55.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.020+0000 7f53dad6e640 1 -- 172.21.15.164:0/768665450 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620c1dc1bc0 con 0x5620c1e9c650 2024-09-13T23:05:55.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.020+0000 7f53dad6e640 1 --2- 172.21.15.164:0/768665450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c1e9c650 0x5620c1f28b10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f53cc005fd0 tx=0x7f53cc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c982cf0fafc8282b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.020+0000 7f52c8e09640 1 -- 172.21.15.164:0/768665450 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc055040 con 0x5620c1e9c650 2024-09-13T23:05:55.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.020+0000 7f52c8e09640 1 -- 172.21.15.164:0/768665450 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53cc051a10 con 0x5620c1e9c650 2024-09-13T23:05:55.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.020+0000 7f52c8e09640 1 -- 172.21.15.164:0/768665450 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc051cf0 con 0x5620c1e9c650 2024-09-13T23:05:55.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.021+0000 7f53df12e800 1 -- 172.21.15.164:0/768665450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c1e9c650 msgr2=0x5620c1f28b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.021+0000 7f53df12e800 1 --2- 172.21.15.164:0/768665450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c1e9c650 0x5620c1f28b10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f53cc005fd0 tx=0x7f53cc051000 comp rx=0 tx=0).stop 2024-09-13T23:05:55.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.021+0000 7f53df12e800 1 -- 172.21.15.164:0/768665450 shutdown_connections 2024-09-13T23:05:55.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.021+0000 7f53df12e800 1 --2- 172.21.15.164:0/768665450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c1e9c650 0x5620c1f28b10 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.021+0000 7f53df12e800 1 -- 172.21.15.164:0/768665450 >> 172.21.15.164:0/768665450 conn(0x5620c1f22db0 msgr2=0x5620c2013040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:55.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.021+0000 7f53df12e800 1 -- 172.21.15.164:0/768665450 shutdown_connections 2024-09-13T23:05:55.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.021+0000 7f53df12e800 1 -- 172.21.15.164:0/768665450 wait complete. 2024-09-13T23:05:55.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.022+0000 7f53df12e800 1 Processor -- start 2024-09-13T23:05:55.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.022+0000 7f53df12e800 1 -- start start 2024-09-13T23:05:55.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.022+0000 7f53df12e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c1e9c650 0x5620c2021130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.022+0000 7f53df12e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5620c1f2f620 con 0x5620c1e9c650 2024-09-13T23:05:55.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.022+0000 7f53dad6e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c1e9c650 0x5620c2021130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.022+0000 7f53dad6e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c1e9c650 0x5620c2021130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:38084/0 (socket says 172.21.15.164:38084) 2024-09-13T23:05:55.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.022+0000 7f53dad6e640 1 -- 172.21.15.164:0/3068680467 learned_addr learned my addr 172.21.15.164:0/3068680467 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:55.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.022+0000 7f53dad6e640 1 -- 172.21.15.164:0/3068680467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620c1dd5fe0 con 0x5620c1e9c650 2024-09-13T23:05:55.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.022+0000 7f53dad6e640 1 --2- 172.21.15.164:0/3068680467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c1e9c650 0x5620c2021130 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f53cc005fd0 tx=0x7f53cc003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.023+0000 7f52c7606640 1 -- 172.21.15.164:0/3068680467 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc071020 con 0x5620c1e9c650 2024-09-13T23:05:55.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.023+0000 7f52c7606640 1 -- 172.21.15.164:0/3068680467 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53cc05a8f0 con 0x5620c1e9c650 2024-09-13T23:05:55.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.023+0000 7f53df12e800 1 -- 172.21.15.164:0/3068680467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5620c2021670 con 0x5620c1e9c650 2024-09-13T23:05:55.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.023+0000 7f52c7606640 1 -- 172.21.15.164:0/3068680467 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc055030 con 0x5620c1e9c650 2024-09-13T23:05:55.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.023+0000 7f53df12e800 1 -- 172.21.15.164:0/3068680467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620c2021bf0 con 0x5620c1e9c650 2024-09-13T23:05:55.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.023+0000 7f52c7606640 1 -- 172.21.15.164:0/3068680467 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f53cc074020 con 0x5620c1e9c650 2024-09-13T23:05:55.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.024+0000 7f52c7606640 1 --2- 172.21.15.164:0/3068680467 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f52c0036b90 0x7f52c0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.024+0000 7f52c7606640 1 -- 172.21.15.164:0/3068680467 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f53cc06a040 con 0x5620c1e9c650 2024-09-13T23:05:55.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.024+0000 7f53da56d640 1 --2- 172.21.15.164:0/3068680467 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f52c0036b90 0x7f52c0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.024+0000 7f53df12e800 1 --2- 172.21.15.164:0/3068680467 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5620c1f2b720 0x5620c20281a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.024+0000 7f53df12e800 1 -- 172.21.15.164:0/3068680467 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620c20287c0 con 0x5620c1f2b720 2024-09-13T23:05:55.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.024+0000 7f53db56f640 1 --2- 172.21.15.164:0/3068680467 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5620c1f2b720 0x5620c20281a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.024+0000 7f53da56d640 1 --2- 172.21.15.164:0/3068680467 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f52c0036b90 0x7f52c0039050 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f53c4000f60 tx=0x7f53c40010a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.024+0000 7f53db56f640 1 --2- 172.21.15.164:0/3068680467 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5620c1f2b720 0x5620c20281a0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.025+0000 7f53db56f640 1 -- 172.21.15.164:0/3068680467 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53d40083e0 con 0x5620c1f2b720 2024-09-13T23:05:55.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.025+0000 7f53df12e800 1 -- 172.21.15.164:0/3068680467 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620c2025730 con 0x5620c1f2b720 2024-09-13T23:05:55.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.025+0000 7f53db56f640 1 -- 172.21.15.164:0/3068680467 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f53d40083e0 con 0x5620c1f2b720 2024-09-13T23:05:55.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.025+0000 7f53df12e800 1 -- 172.21.15.164:0/3068680467 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620c202a5e0 con 0x5620c1f2b720 2024-09-13T23:05:55.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.025+0000 7f53db56f640 1 -- 172.21.15.164:0/3068680467 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f53d40083e0 con 0x5620c1f2b720 2024-09-13T23:05:55.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.025+0000 7f53df12e800 1 -- 172.21.15.164:0/3068680467 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620c2029750 con 0x5620c1f2b720 2024-09-13T23:05:55.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.025+0000 7f53db56f640 1 -- 172.21.15.164:0/3068680467 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f53d40083e0 con 0x5620c1f2b720 2024-09-13T23:05:55.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.025+0000 7f53df12e800 1 -- 172.21.15.164:0/3068680467 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620c2029b40 con 0x5620c1f2b720 2024-09-13T23:05:55.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.026+0000 7f53db56f640 1 -- 172.21.15.164:0/3068680467 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f53d40083e0 con 0x5620c1f2b720 2024-09-13T23:05:55.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.026+0000 7f53df12e800 1 Processor -- start 2024-09-13T23:05:55.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.026+0000 7f53df12e800 1 -- start start 2024-09-13T23:05:55.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.026+0000 7f53df12e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c2038bf0 0x5620c2039010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.026+0000 7f53df12e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5620c1dc3580 con 0x5620c2038bf0 2024-09-13T23:05:55.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.027+0000 7f53da56d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c2038bf0 0x5620c2039010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.027+0000 7f53da56d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c2038bf0 0x5620c2039010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:38086/0 (socket says 172.21.15.164:38086) 2024-09-13T23:05:55.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.027+0000 7f53da56d640 1 -- 172.21.15.164:0/3060350620 learned_addr learned my addr 172.21.15.164:0/3060350620 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:55.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.027+0000 7f53da56d640 1 -- 172.21.15.164:0/3060350620 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620c2039550 con 0x5620c2038bf0 2024-09-13T23:05:55.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.027+0000 7f53da56d640 1 --2- 172.21.15.164:0/3060350620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c2038bf0 0x5620c2039010 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f53c400bec0 tx=0x7f53c400d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.027+0000 7f52c4e01640 1 -- 172.21.15.164:0/3060350620 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53c401b550 con 0x5620c2038bf0 2024-09-13T23:05:55.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.027+0000 7f53df12e800 1 -- 172.21.15.164:0/3060350620 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5620c20397e0 con 0x5620c2038bf0 2024-09-13T23:05:55.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.028+0000 7f52c4e01640 1 -- 172.21.15.164:0/3060350620 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53c401b6f0 con 0x5620c2038bf0 2024-09-13T23:05:55.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.028+0000 7f52c4e01640 1 -- 172.21.15.164:0/3060350620 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53c401b9d0 con 0x5620c2038bf0 2024-09-13T23:05:55.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.028+0000 7f53df12e800 1 -- 172.21.15.164:0/3060350620 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620c203c4c0 con 0x5620c2038bf0 2024-09-13T23:05:55.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.028+0000 7f52c4e01640 1 -- 172.21.15.164:0/3060350620 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f53c4023020 con 0x5620c2038bf0 2024-09-13T23:05:55.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.028+0000 7f52c4e01640 1 --2- 172.21.15.164:0/3060350620 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f52b4036b40 0x7f52b4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.028+0000 7f52c4e01640 1 -- 172.21.15.164:0/3060350620 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f53c4021020 con 0x5620c2038bf0 2024-09-13T23:05:55.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.029+0000 7f53db56f640 1 --2- 172.21.15.164:0/3060350620 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f52b4036b40 0x7f52b4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.029+0000 7f53df12e800 1 Processor -- start 2024-09-13T23:05:55.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.029+0000 7f53db56f640 1 --2- 172.21.15.164:0/3060350620 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f52b4036b40 0x7f52b4039000 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x5620c2029270 tx=0x7f53d4000f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.029+0000 7f53df12e800 1 -- start start 2024-09-13T23:05:55.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.029+0000 7f53df12e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c2045960 0x5620c2045d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.029+0000 7f53df12e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5620c1f270f0 con 0x5620c2045960 2024-09-13T23:05:55.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.029+0000 7f53da56d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c2045960 0x5620c2045d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.029+0000 7f53da56d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c2045960 0x5620c2045d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:38102/0 (socket says 172.21.15.164:38102) 2024-09-13T23:05:55.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.029+0000 7f53da56d640 1 -- 172.21.15.164:0/4221163541 learned_addr learned my addr 172.21.15.164:0/4221163541 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:55.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.029+0000 7f53da56d640 1 -- 172.21.15.164:0/4221163541 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620c2046330 con 0x5620c2045960 2024-09-13T23:05:55.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.029+0000 7f53da56d640 1 --2- 172.21.15.164:0/4221163541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c2045960 0x5620c2045d60 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f53c404d110 tx=0x7f53c400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afaacb7ead834f72 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.030+0000 7f52be7fc640 1 -- 172.21.15.164:0/4221163541 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53c403f030 con 0x5620c2045960 2024-09-13T23:05:55.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.030+0000 7f52be7fc640 1 -- 172.21.15.164:0/4221163541 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53c4025930 con 0x5620c2045960 2024-09-13T23:05:55.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.030+0000 7f52be7fc640 1 -- 172.21.15.164:0/4221163541 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53c4025410 con 0x5620c2045960 2024-09-13T23:05:55.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.030+0000 7f53df12e800 1 -- 172.21.15.164:0/4221163541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c2045960 msgr2=0x5620c2045d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.030+0000 7f53df12e800 1 --2- 172.21.15.164:0/4221163541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c2045960 0x5620c2045d60 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f53c404d110 tx=0x7f53c400ced0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.030+0000 7f53df12e800 1 -- 172.21.15.164:0/4221163541 shutdown_connections 2024-09-13T23:05:55.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.030+0000 7f53df12e800 1 --2- 172.21.15.164:0/4221163541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c2045960 0x5620c2045d60 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.030+0000 7f53df12e800 1 -- 172.21.15.164:0/4221163541 >> 172.21.15.164:0/4221163541 conn(0x5620c2041cc0 msgr2=0x5620c203fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:55.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.030+0000 7f53df12e800 1 -- 172.21.15.164:0/4221163541 shutdown_connections 2024-09-13T23:05:55.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.030+0000 7f53df12e800 1 -- 172.21.15.164:0/4221163541 wait complete. 2024-09-13T23:05:55.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.030+0000 7f53df12e800 1 Processor -- start 2024-09-13T23:05:55.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.030+0000 7f53df12e800 1 -- start start 2024-09-13T23:05:55.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.031+0000 7f53df12e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c2045960 0x5620c204ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.031+0000 7f53df12e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5620c20469a0 con 0x5620c2045960 2024-09-13T23:05:55.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.031+0000 7f53da56d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c2045960 0x5620c204ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.031+0000 7f53da56d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c2045960 0x5620c204ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:38108/0 (socket says 172.21.15.164:38108) 2024-09-13T23:05:55.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.031+0000 7f53da56d640 1 -- 172.21.15.164:0/2364707026 learned_addr learned my addr 172.21.15.164:0/2364707026 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:55.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.031+0000 7f53da56d640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620c204d3a0 con 0x5620c2045960 2024-09-13T23:05:55.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.031+0000 7f53da56d640 1 --2- 172.21.15.164:0/2364707026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c2045960 0x5620c204ce60 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f53c400dcf0 tx=0x7f53c404d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.032+0000 7f52bcff9640 1 -- 172.21.15.164:0/2364707026 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53c40237d0 con 0x5620c2045960 2024-09-13T23:05:55.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.032+0000 7f52bcff9640 1 -- 172.21.15.164:0/2364707026 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53c4040e30 con 0x5620c2045960 2024-09-13T23:05:55.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.032+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5620c204d630 con 0x5620c2045960 2024-09-13T23:05:55.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.032+0000 7f52bcff9640 1 -- 172.21.15.164:0/2364707026 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53c4040270 con 0x5620c2045960 2024-09-13T23:05:55.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.032+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620c204d630 con 0x5620c2045960 2024-09-13T23:05:55.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.032+0000 7f52bcff9640 1 -- 172.21.15.164:0/2364707026 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f53c4040410 con 0x5620c2045960 2024-09-13T23:05:55.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.033+0000 7f52bcff9640 1 --2- 172.21.15.164:0/2364707026 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f52a4036ce0 0x7f52a40391a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.033+0000 7f52bcff9640 1 -- 172.21.15.164:0/2364707026 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f53c4040070 con 0x5620c2045960 2024-09-13T23:05:55.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.033+0000 7f53db56f640 1 --2- 172.21.15.164:0/2364707026 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f52a4036ce0 0x7f52a40391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.033+0000 7f53db56f640 1 --2- 172.21.15.164:0/2364707026 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f52a4036ce0 0x7f52a40391a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f53d400f010 tx=0x7f53d400c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.033+0000 7f53df12e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.033+0000 7f53df12e800 1 --2- 172.21.15.164:0/2364707026 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5620c2058750 0x5620c205ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.033+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620c205b360 con 0x5620c2058750 2024-09-13T23:05:55.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.033+0000 7f53dad6e640 1 --2- 172.21.15.164:0/2364707026 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5620c2058750 0x5620c205ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.034+0000 7f53dad6e640 1 --2- 172.21.15.164:0/2364707026 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5620c2058750 0x5620c205ac10 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.034+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.034+0000 7f53df12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:55.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.034+0000 7f53df12e800 20 realm 2024-09-13T23:05:55.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.034+0000 7f53df12e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.034+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620c205b770 con 0x5620c2058750 2024-09-13T23:05:55.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.034+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.034+0000 7f53df12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:55.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.034+0000 7f53df12e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:55.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.034+0000 7f53df12e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.034+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620c205c040 con 0x5620c2058750 2024-09-13T23:05:55.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.034+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.034+0000 7f53df12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:55.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.034+0000 7f53df12e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.034+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620c205c3e0 con 0x5620c2058750 2024-09-13T23:05:55.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.034+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.034+0000 7f53df12e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:55.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.034+0000 7f53df12e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.034+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620c205cc30 con 0x5620c2058750 2024-09-13T23:05:55.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.035+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.035+0000 7f53df12e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:55.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.035+0000 7f53df12e800 20 searching for the correct realm 2024-09-13T23:05:55.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.035+0000 7f53df12e800 1 --2- 172.21.15.164:0/2364707026 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5620c205e9a0 0x5620c2060d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.035+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x5620c205e9a0 2024-09-13T23:05:55.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.035+0000 7f53da56d640 1 --2- 172.21.15.164:0/2364707026 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5620c205e9a0 0x5620c2060d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.035+0000 7f53da56d640 1 --2- 172.21.15.164:0/2364707026 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5620c205e9a0 0x5620c2060d90 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.035+0000 7f53da56d640 1 -- 172.21.15.164:0/2364707026 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c4009050 con 0x5620c205e9a0 2024-09-13T23:05:55.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.035+0000 7f53da56d640 1 --2- 172.21.15.164:0/2364707026 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f53c4008260 0x7f53c402f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.035+0000 7f53da56d640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x7f53c4008260 2024-09-13T23:05:55.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.036+0000 7f53db56f640 1 --2- 172.21.15.164:0/2364707026 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f53c4008260 0x7f53c402f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.036+0000 7f53db56f640 1 --2- 172.21.15.164:0/2364707026 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f53c4008260 0x7f53c402f400 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.036+0000 7f53db56f640 1 -- 172.21.15.164:0/2364707026 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d402f040 con 0x7f53c4008260 2024-09-13T23:05:55.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.036+0000 7f53db56f640 1 --2- 172.21.15.164:0/2364707026 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f53d4019040 0x7f53d4019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.036+0000 7f53db56f640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x7f53d4019040 2024-09-13T23:05:55.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.036+0000 7f53dad6e640 1 --2- 172.21.15.164:0/2364707026 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f53d4019040 0x7f53d4019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.037+0000 7f53dad6e640 1 --2- 172.21.15.164:0/2364707026 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f53d4019040 0x7f53d4019930 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.037+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53cc057030 con 0x7f53d4019040 2024-09-13T23:05:55.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.037+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x5620c2058750 2024-09-13T23:05:55.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.037+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.037+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x5620c2058750 2024-09-13T23:05:55.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.037+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.037+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x7f53d4019040 2024-09-13T23:05:55.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.038+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53cc057030 con 0x7f53d4019040 2024-09-13T23:05:55.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.038+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x7f53d4019040 2024-09-13T23:05:55.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.038+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53cc057030 con 0x7f53d4019040 2024-09-13T23:05:55.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.038+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x7f53c4008260 2024-09-13T23:05:55.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.038+0000 7f53db56f640 1 -- 172.21.15.164:0/2364707026 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d402f040 con 0x7f53c4008260 2024-09-13T23:05:55.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.038+0000 7f53db56f640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x5620c205e9a0 2024-09-13T23:05:55.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.038+0000 7f53da56d640 1 -- 172.21.15.164:0/2364707026 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c4009050 con 0x5620c205e9a0 2024-09-13T23:05:55.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.038+0000 7f53da56d640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x5620c2058750 2024-09-13T23:05:55.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.039+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.039+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x7f53d4019040 2024-09-13T23:05:55.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.039+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53cc057030 con 0x7f53d4019040 2024-09-13T23:05:55.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.039+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x5620c2058750 2024-09-13T23:05:55.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.039+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.039+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x7f53c4008260 2024-09-13T23:05:55.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.039+0000 7f53db56f640 1 -- 172.21.15.164:0/2364707026 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f53d402f040 con 0x7f53c4008260 2024-09-13T23:05:55.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.039+0000 7f53db56f640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x5620c205e9a0 2024-09-13T23:05:55.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.039+0000 7f53da56d640 1 -- 172.21.15.164:0/2364707026 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c4009050 con 0x5620c205e9a0 2024-09-13T23:05:55.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.039+0000 7f53da56d640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x5620c205e9a0 2024-09-13T23:05:55.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.040+0000 7f53da56d640 1 -- 172.21.15.164:0/2364707026 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c4009050 con 0x5620c205e9a0 2024-09-13T23:05:55.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.040+0000 7f53da56d640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x7f53d4019040 2024-09-13T23:05:55.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.040+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53cc057030 con 0x7f53d4019040 2024-09-13T23:05:55.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.040+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x5620c205e9a0 2024-09-13T23:05:55.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.040+0000 7f53da56d640 1 -- 172.21.15.164:0/2364707026 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c4009050 con 0x5620c205e9a0 2024-09-13T23:05:55.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.040+0000 7f53da56d640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x5620c205e9a0 2024-09-13T23:05:55.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.040+0000 7f53da56d640 1 -- 172.21.15.164:0/2364707026 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c4068040 con 0x5620c205e9a0 2024-09-13T23:05:55.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.040+0000 7f53da56d640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x5620c2058750 2024-09-13T23:05:55.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.041+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.041+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x5620c2058750 2024-09-13T23:05:55.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.041+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.041+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x7f53d4019040 2024-09-13T23:05:55.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.041+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53cc057030 con 0x7f53d4019040 2024-09-13T23:05:55.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.041+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x5620c205e9a0 2024-09-13T23:05:55.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.041+0000 7f53da56d640 1 -- 172.21.15.164:0/2364707026 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c4068040 con 0x5620c205e9a0 2024-09-13T23:05:55.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.041+0000 7f53da56d640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x7f53c4008260 2024-09-13T23:05:55.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.042+0000 7f53db56f640 1 -- 172.21.15.164:0/2364707026 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d402f040 con 0x7f53c4008260 2024-09-13T23:05:55.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.042+0000 7f53db56f640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x5620c2058750 2024-09-13T23:05:55.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.042+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.042+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x7f53d4019040 2024-09-13T23:05:55.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.042+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53cc057030 con 0x7f53d4019040 2024-09-13T23:05:55.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.042+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x5620c205e9a0 2024-09-13T23:05:55.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.042+0000 7f53da56d640 1 -- 172.21.15.164:0/2364707026 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c4068040 con 0x5620c205e9a0 2024-09-13T23:05:55.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.042+0000 7f53da56d640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x7f53d4019040 2024-09-13T23:05:55.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.043+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53cc057030 con 0x7f53d4019040 2024-09-13T23:05:55.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.043+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x7f53c4008260 2024-09-13T23:05:55.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.043+0000 7f53db56f640 1 -- 172.21.15.164:0/2364707026 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d402f040 con 0x7f53c4008260 2024-09-13T23:05:55.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.043+0000 7f53db56f640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x5620c205e9a0 2024-09-13T23:05:55.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.043+0000 7f53da56d640 1 -- 172.21.15.164:0/2364707026 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c4068040 con 0x5620c205e9a0 2024-09-13T23:05:55.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.043+0000 7f53da56d640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x7f53c4008260 2024-09-13T23:05:55.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.043+0000 7f53db56f640 1 -- 172.21.15.164:0/2364707026 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d402f040 con 0x7f53c4008260 2024-09-13T23:05:55.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.043+0000 7f53db56f640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x5620c2058750 2024-09-13T23:05:55.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.044+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.044+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5620c2061370 con 0x7f53c4008260 2024-09-13T23:05:55.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.044+0000 7f53db56f640 1 -- 172.21.15.164:0/2364707026 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d402f040 con 0x7f53c4008260 2024-09-13T23:05:55.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.044+0000 7f53df12e800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:55.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.044+0000 7f53df12e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:55.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.044+0000 7f53df12e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:55.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.044+0000 7f53df12e800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:55.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.044+0000 7f53df12e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:55.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.044+0000 7f53df12e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:55.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.044+0000 7f53df12e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.044+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620c205d5b0 con 0x5620c2058750 2024-09-13T23:05:55.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.044+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.044+0000 7f53df12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:55.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.044+0000 7f53df12e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.044+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620c205de50 con 0x5620c2058750 2024-09-13T23:05:55.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.044+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.044+0000 7f53df12e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:55.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.044+0000 7f53df12e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.044+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620c205de50 con 0x5620c2058750 2024-09-13T23:05:55.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.045+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.045+0000 7f53df12e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:55.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.045+0000 7f53df12e800 20 zone default found 2024-09-13T23:05:55.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.045+0000 7f53df12e800 4 Realm: () 2024-09-13T23:05:55.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.045+0000 7f53df12e800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:55.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.045+0000 7f53df12e800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:55.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.045+0000 7f53df12e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:55.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.045+0000 7f53df12e800 20 zonegroup default 2024-09-13T23:05:55.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.045+0000 7f53df12e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.045+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620c20617d0 con 0x7f53d4019040 2024-09-13T23:05:55.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.045+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f53cc057030 con 0x7f53d4019040 2024-09-13T23:05:55.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.045+0000 7f53df12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:55.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.045+0000 7f53df12e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.045+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620c2063240 con 0x5620c205e9a0 2024-09-13T23:05:55.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.045+0000 7f53da56d640 1 -- 172.21.15.164:0/2364707026 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f53c4068040 con 0x5620c205e9a0 2024-09-13T23:05:55.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.045+0000 7f53df12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:55.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.045+0000 7f53df12e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.045+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620c2063b10 con 0x5620c205e9a0 2024-09-13T23:05:55.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.045+0000 7f53da56d640 1 -- 172.21.15.164:0/2364707026 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f53c4068040 con 0x5620c205e9a0 2024-09-13T23:05:55.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.045+0000 7f53df12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:55.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.045+0000 7f53df12e800 20 started sync module instance, tier type = 2024-09-13T23:05:55.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.045+0000 7f53df12e800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:55.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.046+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620c2062650 con 0x7f53c4008260 2024-09-13T23:05:55.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.047+0000 7f53db56f640 1 -- 172.21.15.164:0/2364707026 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53d402f040 con 0x7f53c4008260 2024-09-13T23:05:55.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.047+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94698694126192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620c2062650 con 0x7f53c4008260 2024-09-13T23:05:55.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.047+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620c2064360 con 0x5620c2058750 2024-09-13T23:05:55.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.047+0000 7f53db56f640 1 -- 172.21.15.164:0/2364707026 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94698694126192] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53d402f040 con 0x7f53c4008260 2024-09-13T23:05:55.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.048+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.048+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94698694124208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620c2064360 con 0x5620c2058750 2024-09-13T23:05:55.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.048+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620c2064d20 con 0x5620c205e9a0 2024-09-13T23:05:55.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.049+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94698694124208] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.049+0000 7f53da56d640 1 -- 172.21.15.164:0/2364707026 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c4068040 con 0x5620c205e9a0 2024-09-13T23:05:55.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.049+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94698694131376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620c20642d0 con 0x5620c205e9a0 2024-09-13T23:05:55.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.049+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620c2065aa0 con 0x7f53c4008260 2024-09-13T23:05:55.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.050+0000 7f53db56f640 1 -- 172.21.15.164:0/2364707026 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53d402f040 con 0x7f53c4008260 2024-09-13T23:05:55.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.050+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94698694137200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620c2066340 con 0x7f53c4008260 2024-09-13T23:05:55.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.050+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620c2066e20 con 0x5620c2058750 2024-09-13T23:05:55.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.050+0000 7f53da56d640 1 -- 172.21.15.164:0/2364707026 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94698694131376] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c4068040 con 0x5620c205e9a0 2024-09-13T23:05:55.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.051+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.051+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94698694136000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620c2066de0 con 0x5620c2058750 2024-09-13T23:05:55.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.051+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620c20678a0 con 0x7f53d4019040 2024-09-13T23:05:55.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.051+0000 7f53db56f640 1 -- 172.21.15.164:0/2364707026 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94698694137200] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53d402f040 con 0x7f53c4008260 2024-09-13T23:05:55.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.052+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94698694136000] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.053+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc057030 con 0x7f53d4019040 2024-09-13T23:05:55.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.053+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94698694139536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620c2066930 con 0x7f53d4019040 2024-09-13T23:05:55.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.053+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620c2068140 con 0x7f53d4019040 2024-09-13T23:05:55.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.054+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94698694139536] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc057030 con 0x7f53d4019040 2024-09-13T23:05:55.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.054+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc057030 con 0x7f53d4019040 2024-09-13T23:05:55.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.054+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94698694144944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620c2067f50 con 0x7f53d4019040 2024-09-13T23:05:55.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.054+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620c20687a0 con 0x7f53d4019040 2024-09-13T23:05:55.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.055+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94698694144944] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc057030 con 0x7f53d4019040 2024-09-13T23:05:55.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.055+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc057030 con 0x7f53d4019040 2024-09-13T23:05:55.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.055+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94698694147200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620c2068650 con 0x7f53d4019040 2024-09-13T23:05:55.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.055+0000 7f53df12e800 20 add_watcher() i=0 2024-09-13T23:05:55.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.055+0000 7f53df12e800 20 add_watcher() i=1 2024-09-13T23:05:55.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.055+0000 7f53df12e800 20 add_watcher() i=2 2024-09-13T23:05:55.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.055+0000 7f53df12e800 20 add_watcher() i=3 2024-09-13T23:05:55.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.055+0000 7f53df12e800 20 add_watcher() i=4 2024-09-13T23:05:55.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.055+0000 7f53df12e800 20 add_watcher() i=5 2024-09-13T23:05:55.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.055+0000 7f53df12e800 20 add_watcher() i=6 2024-09-13T23:05:55.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.056+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94698694147200] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc057030 con 0x7f53d4019040 2024-09-13T23:05:55.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.056+0000 7f53df12e800 20 add_watcher() i=7 2024-09-13T23:05:55.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.056+0000 7f53df12e800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:55.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.056+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620c206bbc0 con 0x5620c2058750 2024-09-13T23:05:55.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.056+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.056+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94698694148320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620c2069080 con 0x5620c2058750 2024-09-13T23:05:55.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.057+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94698694148320] v34'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.057+0000 7f52917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:55.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.057+0000 7f53df12e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:55.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.057+0000 7f53df12e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:55.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.057+0000 7f53df12e800 5 note: GC not initialized 2024-09-13T23:05:55.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.058+0000 7f520bfff640 20 reqs_thread_entry: start 2024-09-13T23:05:55.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.058+0000 7f53df12e800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:55.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.058+0000 7f53df12e800 20 Filter name: none 2024-09-13T23:05:55.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.058+0000 7f5209ffb640 20 reqs_thread_entry: start 2024-09-13T23:05:55.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.058+0000 7f53df12e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:05:55.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.058+0000 7f53df12e800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.058+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620c209f090 con 0x5620c2058750 2024-09-13T23:05:55.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.058+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.058+0000 7f53df12e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:05:55.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.058+0000 7f53df12e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:05:55.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.058+0000 7f53df12e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:55.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.058+0000 7f53df12e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:55.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.058+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620c20a5270 con 0x5620c2058750 2024-09-13T23:05:55.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.060+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v34'16 uv16 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.060+0000 7f53df12e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:55.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.060+0000 7f53df12e800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:55.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.060+0000 7f53df12e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:05:55.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.060+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94698694396976 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5620c20a0b10 con 0x5620c2058750 2024-09-13T23:05:55.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.060+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== watch-notify(notify (1) cookie 94698694136000 notify 146028888082 ret 0) ==== 621+0+0 (crc 0 0 0) 0x5620c2021bf0 con 0x5620c2058750 2024-09-13T23:05:55.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.060+0000 7f52be7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888082 cookie 94698694136000 notifier 4666 bl.length()=579 2024-09-13T23:05:55.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.060+0000 7f52be7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:55.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.060+0000 7f52be7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:55.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.060+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(64 notify.4 [notify cookie 94698694396976 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.060+0000 7f52be7fc640 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f52a0003ea0 con 0x5620c2058750 2024-09-13T23:05:55.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.060+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.060+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== watch-notify(notify_complete (2) cookie 94698694396976 notify 146028888082 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5620c2021670 con 0x5620c2058750 2024-09-13T23:05:55.073 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:05:31.300851Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:05:31.300826Z","tags":[],"group_ids":[]} 2024-09-13T23:05:55.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.061+0000 7f52917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:55.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.061+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94698694148320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620c209cde0 con 0x5620c2058750 2024-09-13T23:05:55.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.062+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94698694148320] v34'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.062+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94698694126192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620c209cde0 con 0x7f53c4008260 2024-09-13T23:05:55.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.063+0000 7f53db56f640 1 -- 172.21.15.164:0/2364707026 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94698694126192] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53d402f040 con 0x7f53c4008260 2024-09-13T23:05:55.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.063+0000 7f53df12e800 20 remove_watcher() i=0 2024-09-13T23:05:55.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.063+0000 7f53df12e800 2 removed watcher, disabling cache 2024-09-13T23:05:55.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.063+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94698694124208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620c209cde0 con 0x5620c2058750 2024-09-13T23:05:55.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.064+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94698694124208] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.064+0000 7f53df12e800 20 remove_watcher() i=1 2024-09-13T23:05:55.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.064+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94698694131376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620c209cde0 con 0x5620c205e9a0 2024-09-13T23:05:55.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.065+0000 7f53da56d640 1 -- 172.21.15.164:0/2364707026 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94698694131376] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c4068040 con 0x5620c205e9a0 2024-09-13T23:05:55.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.065+0000 7f53df12e800 20 remove_watcher() i=2 2024-09-13T23:05:55.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.065+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94698694137200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620c2063eb0 con 0x7f53c4008260 2024-09-13T23:05:55.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.066+0000 7f53db56f640 1 -- 172.21.15.164:0/2364707026 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94698694137200] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53d402f040 con 0x7f53c4008260 2024-09-13T23:05:55.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.067+0000 7f53df12e800 20 remove_watcher() i=3 2024-09-13T23:05:55.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.067+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94698694136000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620c2063eb0 con 0x5620c2058750 2024-09-13T23:05:55.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.067+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94698694136000] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc057030 con 0x5620c2058750 2024-09-13T23:05:55.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.068+0000 7f53df12e800 20 remove_watcher() i=4 2024-09-13T23:05:55.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.068+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94698694139536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620c20650c0 con 0x7f53d4019040 2024-09-13T23:05:55.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.069+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94698694139536] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc057030 con 0x7f53d4019040 2024-09-13T23:05:55.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.069+0000 7f53df12e800 20 remove_watcher() i=5 2024-09-13T23:05:55.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.069+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94698694144944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620c2063eb0 con 0x7f53d4019040 2024-09-13T23:05:55.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.070+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94698694144944] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc057030 con 0x7f53d4019040 2024-09-13T23:05:55.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.070+0000 7f53df12e800 20 remove_watcher() i=6 2024-09-13T23:05:55.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.070+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94698694147200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5620c2065e90 con 0x7f53d4019040 2024-09-13T23:05:55.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.071+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94698694147200] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc057030 con 0x7f53d4019040 2024-09-13T23:05:55.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.071+0000 7f53df12e800 20 remove_watcher() i=7 2024-09-13T23:05:55.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.071+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f53d4019040 msgr2=0x7f53d4019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.071+0000 7f53df12e800 1 --2- 172.21.15.164:0/2364707026 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f53d4019040 0x7f53d4019930 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.071+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5620c2058750 msgr2=0x5620c205ac10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.071+0000 7f53df12e800 1 --2- 172.21.15.164:0/2364707026 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5620c2058750 0x5620c205ac10 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.071+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f53c4008260 msgr2=0x7f53c402f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.071+0000 7f53df12e800 1 --2- 172.21.15.164:0/2364707026 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f53c4008260 0x7f53c402f400 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.071+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5620c205e9a0 msgr2=0x5620c2060d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.071+0000 7f53df12e800 1 --2- 172.21.15.164:0/2364707026 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5620c205e9a0 0x5620c2060d90 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.071+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f52a4036ce0 msgr2=0x7f52a40391a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.071+0000 7f53df12e800 1 --2- 172.21.15.164:0/2364707026 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f52a4036ce0 0x7f52a40391a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f53d400f010 tx=0x7f53d400c040 comp rx=0 tx=0).stop 2024-09-13T23:05:55.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.071+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c2045960 msgr2=0x5620c204ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.071+0000 7f53dad6e640 1 -- 172.21.15.164:0/2364707026 reap_dead start 2024-09-13T23:05:55.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.071+0000 7f53df12e800 1 --2- 172.21.15.164:0/2364707026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c2045960 0x5620c204ce60 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f53c400dcf0 tx=0x7f53c404d070 comp rx=0 tx=0).stop 2024-09-13T23:05:55.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.071+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 shutdown_connections 2024-09-13T23:05:55.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.071+0000 7f53df12e800 1 --2- 172.21.15.164:0/2364707026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c2045960 0x5620c204ce60 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.071+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 >> 172.21.15.164:0/2364707026 conn(0x5620c2041cc0 msgr2=0x5620c203fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:55.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.071+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 shutdown_connections 2024-09-13T23:05:55.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.071+0000 7f53df12e800 1 -- 172.21.15.164:0/2364707026 wait complete. 2024-09-13T23:05:55.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.071+0000 7f53df12e800 1 -- 172.21.15.164:0/3060350620 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f52b4036b40 msgr2=0x7f52b4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.071+0000 7f53df12e800 1 --2- 172.21.15.164:0/3060350620 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f52b4036b40 0x7f52b4039000 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x5620c2029270 tx=0x7f53d4000f90 comp rx=0 tx=0).stop 2024-09-13T23:05:55.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.071+0000 7f53df12e800 1 -- 172.21.15.164:0/3060350620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c2038bf0 msgr2=0x5620c2039010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.071+0000 7f53df12e800 1 --2- 172.21.15.164:0/3060350620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c2038bf0 0x5620c2039010 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f53c400bec0 tx=0x7f53c400d7a0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.071+0000 7f53df12e800 1 -- 172.21.15.164:0/3060350620 shutdown_connections 2024-09-13T23:05:55.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.071+0000 7f53df12e800 1 --2- 172.21.15.164:0/3060350620 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f52b4036b40 0x7f52b4039000 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.071+0000 7f53df12e800 1 --2- 172.21.15.164:0/3060350620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c2038bf0 0x5620c2039010 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.071+0000 7f53df12e800 1 -- 172.21.15.164:0/3060350620 >> 172.21.15.164:0/3060350620 conn(0x5620c202db80 msgr2=0x5620c2030700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:55.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.072+0000 7f53df12e800 1 -- 172.21.15.164:0/3060350620 shutdown_connections 2024-09-13T23:05:55.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.072+0000 7f53df12e800 1 -- 172.21.15.164:0/3060350620 wait complete. 2024-09-13T23:05:55.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.072+0000 7f53df12e800 1 -- 172.21.15.164:0/3068680467 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5620c1f2b720 msgr2=0x5620c20281a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.072+0000 7f53df12e800 1 --2- 172.21.15.164:0/3068680467 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5620c1f2b720 0x5620c20281a0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.072+0000 7f53df12e800 1 -- 172.21.15.164:0/3068680467 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f52c0036b90 msgr2=0x7f52c0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.072+0000 7f53df12e800 1 --2- 172.21.15.164:0/3068680467 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f52c0036b90 0x7f52c0039050 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f53c4000f60 tx=0x7f53c40010a0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.072+0000 7f53df12e800 1 -- 172.21.15.164:0/3068680467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c1e9c650 msgr2=0x5620c2021130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.072+0000 7f53df12e800 1 --2- 172.21.15.164:0/3068680467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c1e9c650 0x5620c2021130 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f53cc005fd0 tx=0x7f53cc003330 comp rx=0 tx=0).stop 2024-09-13T23:05:55.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.072+0000 7f53df12e800 1 -- 172.21.15.164:0/3068680467 shutdown_connections 2024-09-13T23:05:55.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.072+0000 7f53df12e800 1 --2- 172.21.15.164:0/3068680467 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5620c1f2b720 0x5620c20281a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.072+0000 7f53df12e800 1 --2- 172.21.15.164:0/3068680467 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f52c0036b90 0x7f52c0039050 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.072+0000 7f53df12e800 1 --2- 172.21.15.164:0/3068680467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620c1e9c650 0x5620c2021130 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.072+0000 7f53df12e800 1 -- 172.21.15.164:0/3068680467 >> 172.21.15.164:0/3068680467 conn(0x5620c1f22db0 msgr2=0x5620c2012bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:55.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.072+0000 7f53df12e800 1 -- 172.21.15.164:0/3068680467 shutdown_connections 2024-09-13T23:05:55.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.072+0000 7f53df12e800 1 -- 172.21.15.164:0/3068680467 wait complete. 2024-09-13T23:05:55.084 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:05:31.300851Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:05:31.300826Z', 'tags': [], 'group_ids': []} 2024-09-13T23:05:55.084 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T23:05:55.085 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T23:05:55.085 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-13T23:05:55.130 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:55.130 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:55.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.130+0000 7f40d00bb800 1 Processor -- start 2024-09-13T23:05:55.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.130+0000 7f40d00bb800 1 -- start start 2024-09-13T23:05:55.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.130+0000 7f40d00bb800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x562a82c6edf0 0x562a82d00620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.130+0000 7f40d00bb800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562a82bbab30 con 0x562a82d00b60 2024-09-13T23:05:55.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.130+0000 7f40d00bb800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x562a82b9c360 con 0x562a82c6edf0 2024-09-13T23:05:55.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.130+0000 7f40cdbaf640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x562a82c6edf0 0x562a82d00620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.130+0000 7f40c53ae640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x562a82d00b60 0x562a82d02f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:53992/0 (socket says 172.21.15.164:53992) 2024-09-13T23:05:55.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.130+0000 7f40c53ae640 1 -- 172.21.15.164:0/3651100908 learned_addr learned my addr 172.21.15.164:0/3651100908 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:55.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.130+0000 7f40cdbaf640 1 -- 172.21.15.164:0/3651100908 >> v1:172.21.15.17:6789/0 conn(0x562a82d00b60 legacy=0x562a82d02f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.130+0000 7f40cdbaf640 1 -- 172.21.15.164:0/3651100908 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a82bc2e00 con 0x562a82c6edf0 2024-09-13T23:05:55.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.130+0000 7f40cd3ae640 1 -- 172.21.15.164:0/3651100908 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 513247464 0 0) 0x562a82bbab30 con 0x562a82d00b60 2024-09-13T23:05:55.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.132+0000 7f40cdbaf640 1 --2- 172.21.15.164:0/3651100908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82c6edf0 0x562a82d00620 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f40c000a470 tx=0x7f40c0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336d219835bd77a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.133+0000 7f40cd3ae640 1 -- 172.21.15.164:0/3651100908 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c0053570 con 0x562a82c6edf0 2024-09-13T23:05:55.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.133+0000 7f40cd3ae640 1 -- 172.21.15.164:0/3651100908 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c0058070 con 0x562a82c6edf0 2024-09-13T23:05:55.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.133+0000 7f40cd3ae640 1 -- 172.21.15.164:0/3651100908 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c0053880 con 0x562a82c6edf0 2024-09-13T23:05:55.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.133+0000 7f40d00bb800 1 -- 172.21.15.164:0/3651100908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82c6edf0 msgr2=0x562a82d00620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.133+0000 7f40d00bb800 1 --2- 172.21.15.164:0/3651100908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82c6edf0 0x562a82d00620 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f40c000a470 tx=0x7f40c0045a20 comp rx=0 tx=0).stop 2024-09-13T23:05:55.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.133+0000 7f40d00bb800 1 -- 172.21.15.164:0/3651100908 shutdown_connections 2024-09-13T23:05:55.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.133+0000 7f40d00bb800 1 --2- 172.21.15.164:0/3651100908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82c6edf0 0x562a82d00620 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.133+0000 7f40d00bb800 1 -- 172.21.15.164:0/3651100908 >> 172.21.15.164:0/3651100908 conn(0x562a82cf5dd0 msgr2=0x562a82cf81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:55.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.133+0000 7f40d00bb800 1 -- 172.21.15.164:0/3651100908 shutdown_connections 2024-09-13T23:05:55.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.133+0000 7f40d00bb800 1 -- 172.21.15.164:0/3651100908 wait complete. 2024-09-13T23:05:55.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.147+0000 7f40d00bb800 1 Processor -- start 2024-09-13T23:05:55.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.147+0000 7f40d00bb800 1 -- start start 2024-09-13T23:05:55.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.147+0000 7f40d00bb800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82c6edf0 0x562a82dec890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.147+0000 7f40d00bb800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562a82c47360 con 0x562a82c6edf0 2024-09-13T23:05:55.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.147+0000 7f40cdbaf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82c6edf0 0x562a82dec890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.147+0000 7f40cdbaf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82c6edf0 0x562a82dec890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:38116/0 (socket says 172.21.15.164:38116) 2024-09-13T23:05:55.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.147+0000 7f40cdbaf640 1 -- 172.21.15.164:0/1383537445 learned_addr learned my addr 172.21.15.164:0/1383537445 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:55.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.148+0000 7f40cdbaf640 1 -- 172.21.15.164:0/1383537445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a82b94bc0 con 0x562a82c6edf0 2024-09-13T23:05:55.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.148+0000 7f40cdbaf640 1 --2- 172.21.15.164:0/1383537445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82c6edf0 0x562a82dec890 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f40c0005870 tx=0x7f40c0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faba9741f55a5266 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.148+0000 7f3fbbe07640 1 -- 172.21.15.164:0/1383537445 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c005c580 con 0x562a82c6edf0 2024-09-13T23:05:55.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.148+0000 7f3fbbe07640 1 -- 172.21.15.164:0/1383537445 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c0063030 con 0x562a82c6edf0 2024-09-13T23:05:55.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.148+0000 7f3fbbe07640 1 -- 172.21.15.164:0/1383537445 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c005c850 con 0x562a82c6edf0 2024-09-13T23:05:55.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.149+0000 7f40d00bb800 1 -- 172.21.15.164:0/1383537445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82c6edf0 msgr2=0x562a82dec890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.149+0000 7f40d00bb800 1 --2- 172.21.15.164:0/1383537445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82c6edf0 0x562a82dec890 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f40c0005870 tx=0x7f40c0051000 comp rx=0 tx=0).stop 2024-09-13T23:05:55.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.149+0000 7f40d00bb800 1 -- 172.21.15.164:0/1383537445 shutdown_connections 2024-09-13T23:05:55.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.149+0000 7f40d00bb800 1 --2- 172.21.15.164:0/1383537445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82c6edf0 0x562a82dec890 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.149+0000 7f40d00bb800 1 -- 172.21.15.164:0/1383537445 >> 172.21.15.164:0/1383537445 conn(0x562a82cf5dd0 msgr2=0x562a82de8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:55.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.149+0000 7f40d00bb800 1 -- 172.21.15.164:0/1383537445 shutdown_connections 2024-09-13T23:05:55.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.149+0000 7f40d00bb800 1 -- 172.21.15.164:0/1383537445 wait complete. 2024-09-13T23:05:55.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.149+0000 7f40d00bb800 1 Processor -- start 2024-09-13T23:05:55.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.149+0000 7f40d00bb800 1 -- start start 2024-09-13T23:05:55.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.149+0000 7f40d00bb800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82d00b60 0x562a82df4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.149+0000 7f40d00bb800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562a82d04910 con 0x562a82d00b60 2024-09-13T23:05:55.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.150+0000 7f40cdbaf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82d00b60 0x562a82df4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.150+0000 7f40cdbaf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82d00b60 0x562a82df4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:38120/0 (socket says 172.21.15.164:38120) 2024-09-13T23:05:55.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.150+0000 7f40cdbaf640 1 -- 172.21.15.164:0/3455045232 learned_addr learned my addr 172.21.15.164:0/3455045232 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:55.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.150+0000 7f40cdbaf640 1 -- 172.21.15.164:0/3455045232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a82ba8fe0 con 0x562a82d00b60 2024-09-13T23:05:55.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.150+0000 7f40cdbaf640 1 --2- 172.21.15.164:0/3455045232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82d00b60 0x562a82df4400 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f40c0045f50 tx=0x7f40c0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.151+0000 7f3fba604640 1 -- 172.21.15.164:0/3455045232 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c0078070 con 0x562a82d00b60 2024-09-13T23:05:55.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.151+0000 7f3fba604640 1 -- 172.21.15.164:0/3455045232 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c0054910 con 0x562a82d00b60 2024-09-13T23:05:55.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.151+0000 7f40d00bb800 1 -- 172.21.15.164:0/3455045232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a82df4940 con 0x562a82d00b60 2024-09-13T23:05:55.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.151+0000 7f3fba604640 1 -- 172.21.15.164:0/3455045232 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c0054bf0 con 0x562a82d00b60 2024-09-13T23:05:55.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.151+0000 7f40d00bb800 1 -- 172.21.15.164:0/3455045232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a82df4ec0 con 0x562a82d00b60 2024-09-13T23:05:55.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.151+0000 7f3fba604640 1 -- 172.21.15.164:0/3455045232 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f40c007b070 con 0x562a82d00b60 2024-09-13T23:05:55.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.152+0000 7f3fba604640 1 --2- 172.21.15.164:0/3455045232 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f3fb4036b90 0x7f3fb4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.152+0000 7f3fba604640 1 -- 172.21.15.164:0/3455045232 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f40c0070070 con 0x562a82d00b60 2024-09-13T23:05:55.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.152+0000 7f40c53ae640 1 --2- 172.21.15.164:0/3455045232 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f3fb4036b90 0x7f3fb4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.152+0000 7f40d00bb800 1 --2- 172.21.15.164:0/3455045232 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562a82df9460 0x562a82dfb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.152+0000 7f40d00bb800 1 -- 172.21.15.164:0/3455045232 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a82dfbdd0 con 0x562a82df9460 2024-09-13T23:05:55.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.152+0000 7f40ce3b0640 1 --2- 172.21.15.164:0/3455045232 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562a82df9460 0x562a82dfb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.152+0000 7f40c53ae640 1 --2- 172.21.15.164:0/3455045232 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f3fb4036b90 0x7f3fb4039050 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f40b8000c00 tx=0x7f40b80013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.152+0000 7f40ce3b0640 1 --2- 172.21.15.164:0/3455045232 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562a82df9460 0x562a82dfb850 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.152+0000 7f40ce3b0640 1 -- 172.21.15.164:0/3455045232 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40c800a4a0 con 0x562a82df9460 2024-09-13T23:05:55.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.153+0000 7f40d00bb800 1 -- 172.21.15.164:0/3455045232 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a82df8a20 con 0x562a82df9460 2024-09-13T23:05:55.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.153+0000 7f40ce3b0640 1 -- 172.21.15.164:0/3455045232 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f40c800a4a0 con 0x562a82df9460 2024-09-13T23:05:55.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.153+0000 7f40d00bb800 1 -- 172.21.15.164:0/3455045232 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a82dfdbf0 con 0x562a82df9460 2024-09-13T23:05:55.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.153+0000 7f40ce3b0640 1 -- 172.21.15.164:0/3455045232 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f40c800a4a0 con 0x562a82df9460 2024-09-13T23:05:55.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.153+0000 7f40d00bb800 1 -- 172.21.15.164:0/3455045232 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a82dfce20 con 0x562a82df9460 2024-09-13T23:05:55.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.153+0000 7f40ce3b0640 1 -- 172.21.15.164:0/3455045232 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f40c800a4a0 con 0x562a82df9460 2024-09-13T23:05:55.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.153+0000 7f40d00bb800 1 -- 172.21.15.164:0/3455045232 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a82dfd270 con 0x562a82df9460 2024-09-13T23:05:55.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.154+0000 7f40ce3b0640 1 -- 172.21.15.164:0/3455045232 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f40c800a4a0 con 0x562a82df9460 2024-09-13T23:05:55.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.154+0000 7f40d00bb800 1 Processor -- start 2024-09-13T23:05:55.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.154+0000 7f40d00bb800 1 -- start start 2024-09-13T23:05:55.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.154+0000 7f40d00bb800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82e0c180 0x562a82e0c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.154+0000 7f40d00bb800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562a82b96580 con 0x562a82e0c180 2024-09-13T23:05:55.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.154+0000 7f40c53ae640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82e0c180 0x562a82e0c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.154+0000 7f40c53ae640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82e0c180 0x562a82e0c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:38124/0 (socket says 172.21.15.164:38124) 2024-09-13T23:05:55.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.154+0000 7f40c53ae640 1 -- 172.21.15.164:0/3605476333 learned_addr learned my addr 172.21.15.164:0/3605476333 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:55.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.155+0000 7f40c53ae640 1 -- 172.21.15.164:0/3605476333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a82e0cae0 con 0x562a82e0c180 2024-09-13T23:05:55.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.155+0000 7f40c53ae640 1 --2- 172.21.15.164:0/3605476333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82e0c180 0x562a82e0c5a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f40b800e610 tx=0x7f40b800ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.155+0000 7f3fb37fe640 1 -- 172.21.15.164:0/3605476333 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40b8022070 con 0x562a82e0c180 2024-09-13T23:05:55.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.155+0000 7f3fb37fe640 1 -- 172.21.15.164:0/3605476333 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b8009050 con 0x562a82e0c180 2024-09-13T23:05:55.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.155+0000 7f40d00bb800 1 -- 172.21.15.164:0/3605476333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a82e0cd70 con 0x562a82e0c180 2024-09-13T23:05:55.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.155+0000 7f3fb37fe640 1 -- 172.21.15.164:0/3605476333 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40b800d500 con 0x562a82e0c180 2024-09-13T23:05:55.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.155+0000 7f40d00bb800 1 -- 172.21.15.164:0/3605476333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a82e0fa50 con 0x562a82e0c180 2024-09-13T23:05:55.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.156+0000 7f3fb37fe640 1 -- 172.21.15.164:0/3605476333 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f40b8025070 con 0x562a82e0c180 2024-09-13T23:05:55.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.156+0000 7f3fb37fe640 1 --2- 172.21.15.164:0/3605476333 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f3fa8036b90 0x7f3fa8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.156+0000 7f3fb37fe640 1 -- 172.21.15.164:0/3605476333 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f40b804df20 con 0x562a82e0c180 2024-09-13T23:05:55.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.156+0000 7f40ce3b0640 1 --2- 172.21.15.164:0/3605476333 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f3fa8036b90 0x7f3fa8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.156+0000 7f40d00bb800 1 Processor -- start 2024-09-13T23:05:55.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.156+0000 7f40ce3b0640 1 --2- 172.21.15.164:0/3605476333 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f3fa8036b90 0x7f3fa8039050 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x562a82dfc940 tx=0x7f40c8005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.156+0000 7f40d00bb800 1 -- start start 2024-09-13T23:05:55.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.157+0000 7f40d00bb800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82e18ea0 0x562a82e192a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.157+0000 7f40d00bb800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562a82decfe0 con 0x562a82e18ea0 2024-09-13T23:05:55.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.157+0000 7f40c53ae640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82e18ea0 0x562a82e192a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.157+0000 7f40c53ae640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82e18ea0 0x562a82e192a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:38126/0 (socket says 172.21.15.164:38126) 2024-09-13T23:05:55.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.157+0000 7f40c53ae640 1 -- 172.21.15.164:0/2205649255 learned_addr learned my addr 172.21.15.164:0/2205649255 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:55.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.157+0000 7f40c53ae640 1 -- 172.21.15.164:0/2205649255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a82e19870 con 0x562a82e18ea0 2024-09-13T23:05:55.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.157+0000 7f40c53ae640 1 --2- 172.21.15.164:0/2205649255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82e18ea0 0x562a82e192a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f40b8026fd0 tx=0x7f40b8024eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=302967e61c236f2f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.157+0000 7f3fb17fa640 1 -- 172.21.15.164:0/2205649255 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40b8025360 con 0x562a82e18ea0 2024-09-13T23:05:55.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.157+0000 7f3fb17fa640 1 -- 172.21.15.164:0/2205649255 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b8025500 con 0x562a82e18ea0 2024-09-13T23:05:55.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.157+0000 7f3fb17fa640 1 -- 172.21.15.164:0/2205649255 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40b80257e0 con 0x562a82e18ea0 2024-09-13T23:05:55.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.158+0000 7f40d00bb800 1 -- 172.21.15.164:0/2205649255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82e18ea0 msgr2=0x562a82e192a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.158+0000 7f40d00bb800 1 --2- 172.21.15.164:0/2205649255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82e18ea0 0x562a82e192a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f40b8026fd0 tx=0x7f40b8024eb0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.158+0000 7f40d00bb800 1 -- 172.21.15.164:0/2205649255 shutdown_connections 2024-09-13T23:05:55.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.158+0000 7f40d00bb800 1 --2- 172.21.15.164:0/2205649255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82e18ea0 0x562a82e192a0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.158+0000 7f40d00bb800 1 -- 172.21.15.164:0/2205649255 >> 172.21.15.164:0/2205649255 conn(0x562a82e15200 msgr2=0x562a82e13300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:55.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.158+0000 7f40d00bb800 1 -- 172.21.15.164:0/2205649255 shutdown_connections 2024-09-13T23:05:55.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.158+0000 7f40d00bb800 1 -- 172.21.15.164:0/2205649255 wait complete. 2024-09-13T23:05:55.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.158+0000 7f40d00bb800 1 Processor -- start 2024-09-13T23:05:55.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.158+0000 7f40d00bb800 1 -- start start 2024-09-13T23:05:55.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.158+0000 7f40d00bb800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82e18ea0 0x562a82e203a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.158+0000 7f40d00bb800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562a82e19ee0 con 0x562a82e18ea0 2024-09-13T23:05:55.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.158+0000 7f40c53ae640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82e18ea0 0x562a82e203a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.159+0000 7f40c53ae640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82e18ea0 0x562a82e203a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:38138/0 (socket says 172.21.15.164:38138) 2024-09-13T23:05:55.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.159+0000 7f40c53ae640 1 -- 172.21.15.164:0/2995815908 learned_addr learned my addr 172.21.15.164:0/2995815908 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:55.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.159+0000 7f40c53ae640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a82e208e0 con 0x562a82e18ea0 2024-09-13T23:05:55.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.159+0000 7f40c53ae640 1 --2- 172.21.15.164:0/2995815908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82e18ea0 0x562a82e203a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f40b8024ef0 tx=0x7f40b804c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.159+0000 7f3f9f7fe640 1 -- 172.21.15.164:0/2995815908 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40b803a070 con 0x562a82e18ea0 2024-09-13T23:05:55.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.159+0000 7f3f9f7fe640 1 -- 172.21.15.164:0/2995815908 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b800d6a0 con 0x562a82e18ea0 2024-09-13T23:05:55.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.159+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a82e20b70 con 0x562a82e18ea0 2024-09-13T23:05:55.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.159+0000 7f3f9f7fe640 1 -- 172.21.15.164:0/2995815908 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40b80248b0 con 0x562a82e18ea0 2024-09-13T23:05:55.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.159+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a82e23820 con 0x562a82e18ea0 2024-09-13T23:05:55.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.160+0000 7f3f9f7fe640 1 -- 172.21.15.164:0/2995815908 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f40b800d9a0 con 0x562a82e18ea0 2024-09-13T23:05:55.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.160+0000 7f3f9f7fe640 1 --2- 172.21.15.164:0/2995815908 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f3f98036b90 0x7f3f98039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.160+0000 7f3f9f7fe640 1 -- 172.21.15.164:0/2995815908 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f40b803d040 con 0x562a82e18ea0 2024-09-13T23:05:55.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.160+0000 7f40ce3b0640 1 --2- 172.21.15.164:0/2995815908 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f3f98036b90 0x7f3f98039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.161+0000 7f40ce3b0640 1 --2- 172.21.15.164:0/2995815908 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f3f98036b90 0x7f3f98039050 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x562a82df8990 tx=0x7f40c801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.161+0000 7f40d00bb800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.161+0000 7f40d00bb800 1 --2- 172.21.15.164:0/2995815908 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562a82e2be30 0x562a82e2e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.161+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a82e2ea40 con 0x562a82e2be30 2024-09-13T23:05:55.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.161+0000 7f40cdbaf640 1 --2- 172.21.15.164:0/2995815908 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562a82e2be30 0x562a82e2e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.161+0000 7f40cdbaf640 1 --2- 172.21.15.164:0/2995815908 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562a82e2be30 0x562a82e2e2f0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.161+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.161+0000 7f40d00bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:55.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.161+0000 7f40d00bb800 20 realm 2024-09-13T23:05:55.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.161+0000 7f40d00bb800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.161+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a82e2b260 con 0x562a82e2be30 2024-09-13T23:05:55.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.162+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.162+0000 7f40d00bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:55.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.162+0000 7f40d00bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:55.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.162+0000 7f40d00bb800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.162+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a82e2f4d0 con 0x562a82e2be30 2024-09-13T23:05:55.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.162+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.162+0000 7f40d00bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:55.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.162+0000 7f40d00bb800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.162+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a82e2fd70 con 0x562a82e2be30 2024-09-13T23:05:55.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.162+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.162+0000 7f40d00bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:55.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.162+0000 7f40d00bb800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.162+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a82e30110 con 0x562a82e2be30 2024-09-13T23:05:55.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.162+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.162+0000 7f40d00bb800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:55.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.162+0000 7f40d00bb800 20 searching for the correct realm 2024-09-13T23:05:55.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.162+0000 7f40d00bb800 1 --2- 172.21.15.164:0/2995815908 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x562a82e32040 0x562a82e34430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.162+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a82e34a60 con 0x562a82e32040 2024-09-13T23:05:55.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.163+0000 7f40c53ae640 1 --2- 172.21.15.164:0/2995815908 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x562a82e32040 0x562a82e34430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.163+0000 7f40c53ae640 1 --2- 172.21.15.164:0/2995815908 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x562a82e32040 0x562a82e34430 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.163+0000 7f40c53ae640 1 -- 172.21.15.164:0/2995815908 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40b8032070 con 0x562a82e32040 2024-09-13T23:05:55.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.163+0000 7f40c53ae640 1 --2- 172.21.15.164:0/2995815908 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f40b8027060 0x7f40b804c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.163+0000 7f40c53ae640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a82e34a60 con 0x7f40b8027060 2024-09-13T23:05:55.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.163+0000 7f40ce3b0640 1 --2- 172.21.15.164:0/2995815908 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f40b8027060 0x7f40b804c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.163+0000 7f40ce3b0640 1 --2- 172.21.15.164:0/2995815908 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f40b8027060 0x7f40b804c6f0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.164+0000 7f40ce3b0640 1 -- 172.21.15.164:0/2995815908 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c801f070 con 0x7f40b8027060 2024-09-13T23:05:55.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.164+0000 7f40ce3b0640 1 --2- 172.21.15.164:0/2995815908 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f40c8031040 0x7f40c8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.164+0000 7f40ce3b0640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a82e34a60 con 0x7f40c8031040 2024-09-13T23:05:55.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.164+0000 7f40cdbaf640 1 --2- 172.21.15.164:0/2995815908 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f40c8031040 0x7f40c8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.164+0000 7f40cdbaf640 1 --2- 172.21.15.164:0/2995815908 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f40c8031040 0x7f40c8032940 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.165+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c007a030 con 0x7f40c8031040 2024-09-13T23:05:55.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.165+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a82e34a60 con 0x562a82e2be30 2024-09-13T23:05:55.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.165+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.165+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a82e34a60 con 0x562a82e2be30 2024-09-13T23:05:55.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.165+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.165+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a82e34a60 con 0x7f40c8031040 2024-09-13T23:05:55.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.165+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c007a030 con 0x7f40c8031040 2024-09-13T23:05:55.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.165+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a82e34a60 con 0x7f40c8031040 2024-09-13T23:05:55.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.165+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c007a030 con 0x7f40c8031040 2024-09-13T23:05:55.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.165+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a82e34a60 con 0x7f40b8027060 2024-09-13T23:05:55.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.166+0000 7f40ce3b0640 1 -- 172.21.15.164:0/2995815908 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c801f070 con 0x7f40b8027060 2024-09-13T23:05:55.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.166+0000 7f40ce3b0640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a82e34a60 con 0x562a82e32040 2024-09-13T23:05:55.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.166+0000 7f40c53ae640 1 -- 172.21.15.164:0/2995815908 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40b8032070 con 0x562a82e32040 2024-09-13T23:05:55.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.166+0000 7f40c53ae640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a82e34a60 con 0x562a82e2be30 2024-09-13T23:05:55.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.166+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.166+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a82e34a60 con 0x7f40c8031040 2024-09-13T23:05:55.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.166+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c007a030 con 0x7f40c8031040 2024-09-13T23:05:55.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.166+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a82e34a60 con 0x562a82e2be30 2024-09-13T23:05:55.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.167+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.167+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a82e34a60 con 0x7f40b8027060 2024-09-13T23:05:55.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.167+0000 7f40ce3b0640 1 -- 172.21.15.164:0/2995815908 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f40c801f070 con 0x7f40b8027060 2024-09-13T23:05:55.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.167+0000 7f40ce3b0640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a82e34a60 con 0x562a82e32040 2024-09-13T23:05:55.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.167+0000 7f40c53ae640 1 -- 172.21.15.164:0/2995815908 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40b8032070 con 0x562a82e32040 2024-09-13T23:05:55.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.167+0000 7f40c53ae640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562a82e34a60 con 0x562a82e32040 2024-09-13T23:05:55.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.167+0000 7f40c53ae640 1 -- 172.21.15.164:0/2995815908 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40b8032070 con 0x562a82e32040 2024-09-13T23:05:55.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.167+0000 7f40c53ae640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f40b8064040 con 0x7f40c8031040 2024-09-13T23:05:55.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.168+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c007a030 con 0x7f40c8031040 2024-09-13T23:05:55.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.168+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f40b8064040 con 0x562a82e32040 2024-09-13T23:05:55.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.168+0000 7f40c53ae640 1 -- 172.21.15.164:0/2995815908 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40b8032070 con 0x562a82e32040 2024-09-13T23:05:55.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.168+0000 7f40c53ae640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f40b8064040 con 0x562a82e32040 2024-09-13T23:05:55.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.168+0000 7f40c53ae640 1 -- 172.21.15.164:0/2995815908 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40b8032070 con 0x562a82e32040 2024-09-13T23:05:55.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.168+0000 7f40c53ae640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f40b8064040 con 0x562a82e2be30 2024-09-13T23:05:55.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.168+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.168+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f40b8064040 con 0x562a82e2be30 2024-09-13T23:05:55.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.169+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.169+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f40b8064040 con 0x7f40c8031040 2024-09-13T23:05:55.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.169+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c007a030 con 0x7f40c8031040 2024-09-13T23:05:55.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.169+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f40b8064040 con 0x562a82e32040 2024-09-13T23:05:55.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.169+0000 7f40c53ae640 1 -- 172.21.15.164:0/2995815908 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40b8032070 con 0x562a82e32040 2024-09-13T23:05:55.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.169+0000 7f40c53ae640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f40b8064040 con 0x7f40b8027060 2024-09-13T23:05:55.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.169+0000 7f40ce3b0640 1 -- 172.21.15.164:0/2995815908 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c801f070 con 0x7f40b8027060 2024-09-13T23:05:55.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.169+0000 7f40ce3b0640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f40b8064040 con 0x562a82e2be30 2024-09-13T23:05:55.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.170+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.170+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f40b8064040 con 0x7f40c8031040 2024-09-13T23:05:55.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.170+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c007a030 con 0x7f40c8031040 2024-09-13T23:05:55.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.170+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f40b8064040 con 0x562a82e32040 2024-09-13T23:05:55.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.170+0000 7f40c53ae640 1 -- 172.21.15.164:0/2995815908 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40b8032070 con 0x562a82e32040 2024-09-13T23:05:55.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.170+0000 7f40c53ae640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f40b8064040 con 0x7f40c8031040 2024-09-13T23:05:55.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.170+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c007a030 con 0x7f40c8031040 2024-09-13T23:05:55.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.170+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f40b8064040 con 0x7f40b8027060 2024-09-13T23:05:55.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.171+0000 7f40ce3b0640 1 -- 172.21.15.164:0/2995815908 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c801f070 con 0x7f40b8027060 2024-09-13T23:05:55.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.171+0000 7f40ce3b0640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f40b8064040 con 0x562a82e32040 2024-09-13T23:05:55.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.171+0000 7f40c53ae640 1 -- 172.21.15.164:0/2995815908 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40b8032070 con 0x562a82e32040 2024-09-13T23:05:55.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.171+0000 7f40c53ae640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f40b8064040 con 0x7f40b8027060 2024-09-13T23:05:55.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.171+0000 7f40ce3b0640 1 -- 172.21.15.164:0/2995815908 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c801f070 con 0x7f40b8027060 2024-09-13T23:05:55.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.171+0000 7f40ce3b0640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f40b8064040 con 0x562a82e2be30 2024-09-13T23:05:55.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.171+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.171+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f40b8064040 con 0x7f40b8027060 2024-09-13T23:05:55.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.172+0000 7f40ce3b0640 1 -- 172.21.15.164:0/2995815908 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c8040040 con 0x7f40b8027060 2024-09-13T23:05:55.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.172+0000 7f40d00bb800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:55.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.172+0000 7f40d00bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:55.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.172+0000 7f40d00bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:55.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.172+0000 7f40d00bb800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:55.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.172+0000 7f40d00bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:55.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.172+0000 7f40d00bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:55.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.172+0000 7f40d00bb800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.172+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a82e30ae0 con 0x562a82e2be30 2024-09-13T23:05:55.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.172+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.172+0000 7f40d00bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:55.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.172+0000 7f40d00bb800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.172+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a82e31380 con 0x562a82e2be30 2024-09-13T23:05:55.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.172+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.172+0000 7f40d00bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:55.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.172+0000 7f40d00bb800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.172+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a82e31380 con 0x562a82e2be30 2024-09-13T23:05:55.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.172+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.172+0000 7f40d00bb800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:55.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.172+0000 7f40d00bb800 20 zone default found 2024-09-13T23:05:55.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.172+0000 7f40d00bb800 4 Realm: () 2024-09-13T23:05:55.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.172+0000 7f40d00bb800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:55.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.172+0000 7f40d00bb800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:55.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.172+0000 7f40d00bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:55.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.172+0000 7f40d00bb800 20 zonegroup default 2024-09-13T23:05:55.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.172+0000 7f40d00bb800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.172+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a82e34ec0 con 0x7f40c8031040 2024-09-13T23:05:55.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.173+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f40c007a030 con 0x7f40c8031040 2024-09-13T23:05:55.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.173+0000 7f40d00bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:55.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.173+0000 7f40d00bb800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.173+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a82e31120 con 0x562a82e32040 2024-09-13T23:05:55.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.173+0000 7f40c53ae640 1 -- 172.21.15.164:0/2995815908 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40b8032070 con 0x562a82e32040 2024-09-13T23:05:55.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.173+0000 7f40d00bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:55.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.173+0000 7f40d00bb800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.173+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a82e36e10 con 0x562a82e32040 2024-09-13T23:05:55.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.173+0000 7f40c53ae640 1 -- 172.21.15.164:0/2995815908 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40b8032070 con 0x562a82e32040 2024-09-13T23:05:55.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.173+0000 7f40d00bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:55.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.173+0000 7f40d00bb800 20 started sync module instance, tier type = 2024-09-13T23:05:55.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.173+0000 7f40d00bb800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:55.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.173+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a82e361e0 con 0x7f40b8027060 2024-09-13T23:05:55.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.174+0000 7f40ce3b0640 1 -- 172.21.15.164:0/2995815908 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c8040040 con 0x7f40b8027060 2024-09-13T23:05:55.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.174+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94740584555984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a82e37720 con 0x7f40b8027060 2024-09-13T23:05:55.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.174+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a82e37f70 con 0x562a82e2be30 2024-09-13T23:05:55.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.175+0000 7f40ce3b0640 1 -- 172.21.15.164:0/2995815908 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94740584555984] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c8040040 con 0x7f40b8027060 2024-09-13T23:05:55.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.175+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.176+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94740584559216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a82e37c60 con 0x562a82e2be30 2024-09-13T23:05:55.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.176+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a82e38780 con 0x562a82e32040 2024-09-13T23:05:55.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.176+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94740584559216] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.177+0000 7f40c53ae640 1 -- 172.21.15.164:0/2995815908 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40b8032070 con 0x562a82e32040 2024-09-13T23:05:55.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.177+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94740584563280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a82e38b70 con 0x562a82e32040 2024-09-13T23:05:55.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.177+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a82e39570 con 0x7f40b8027060 2024-09-13T23:05:55.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.178+0000 7f40c53ae640 1 -- 172.21.15.164:0/2995815908 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94740584563280] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40b8032070 con 0x562a82e32040 2024-09-13T23:05:55.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.178+0000 7f40ce3b0640 1 -- 172.21.15.164:0/2995815908 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c8040040 con 0x7f40b8027060 2024-09-13T23:05:55.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.178+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94740584560336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a82e39960 con 0x7f40b8027060 2024-09-13T23:05:55.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.178+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a82e3a380 con 0x562a82e2be30 2024-09-13T23:05:55.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.179+0000 7f40ce3b0640 1 -- 172.21.15.164:0/2995815908 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94740584560336] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c8040040 con 0x7f40b8027060 2024-09-13T23:05:55.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.179+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.179+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94740584570480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a82e3a340 con 0x562a82e2be30 2024-09-13T23:05:55.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.179+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a82e3adb0 con 0x7f40c8031040 2024-09-13T23:05:55.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.180+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c007a030 con 0x7f40c8031040 2024-09-13T23:05:55.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.180+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94740584573152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a82e3adb0 con 0x7f40c8031040 2024-09-13T23:05:55.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.180+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a82e3bd00 con 0x7f40c8031040 2024-09-13T23:05:55.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.180+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94740584570480] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.181+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94740584573152] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c007a030 con 0x7f40c8031040 2024-09-13T23:05:55.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.181+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c007a030 con 0x7f40c8031040 2024-09-13T23:05:55.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.181+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94740584577008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a82e3bd00 con 0x7f40c8031040 2024-09-13T23:05:55.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.181+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a82e3b250 con 0x7f40c8031040 2024-09-13T23:05:55.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.182+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94740584577008] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c007a030 con 0x7f40c8031040 2024-09-13T23:05:55.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.183+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c007a030 con 0x7f40c8031040 2024-09-13T23:05:55.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.183+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94740584566912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a82e3b210 con 0x7f40c8031040 2024-09-13T23:05:55.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.183+0000 7f40d00bb800 20 add_watcher() i=0 2024-09-13T23:05:55.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.183+0000 7f40d00bb800 20 add_watcher() i=1 2024-09-13T23:05:55.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.183+0000 7f40d00bb800 20 add_watcher() i=2 2024-09-13T23:05:55.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.183+0000 7f40d00bb800 20 add_watcher() i=3 2024-09-13T23:05:55.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.183+0000 7f40d00bb800 20 add_watcher() i=4 2024-09-13T23:05:55.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.183+0000 7f40d00bb800 20 add_watcher() i=5 2024-09-13T23:05:55.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.183+0000 7f40d00bb800 20 add_watcher() i=6 2024-09-13T23:05:55.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.183+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94740584566912] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c007a030 con 0x7f40c8031040 2024-09-13T23:05:55.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.183+0000 7f40d00bb800 20 add_watcher() i=7 2024-09-13T23:05:55.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.183+0000 7f40d00bb800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:55.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.183+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a82e3f630 con 0x562a82e2be30 2024-09-13T23:05:55.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.184+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.184+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94740584579312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a82e3cb50 con 0x562a82e2be30 2024-09-13T23:05:55.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.185+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94740584579312] v34'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.185+0000 7f3f7f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:55.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.185+0000 7f40d00bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:55.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.185+0000 7f40d00bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:55.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.185+0000 7f40d00bb800 5 note: GC not initialized 2024-09-13T23:05:55.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.185+0000 7f3f7e7fc640 20 reqs_thread_entry: start 2024-09-13T23:05:55.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.185+0000 7f40d00bb800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:55.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.186+0000 7f40d00bb800 20 Filter name: none 2024-09-13T23:05:55.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.186+0000 7f3eeffff640 20 reqs_thread_entry: start 2024-09-13T23:05:55.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.186+0000 7f40d00bb800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:05:55.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.186+0000 7f40d00bb800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.186+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a82e72a60 con 0x562a82e2be30 2024-09-13T23:05:55.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.186+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv16 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.186+0000 7f40d00bb800 20 rados_obj.operate() r=0 bl.length=403 2024-09-13T23:05:55.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.186+0000 7f40d00bb800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:05:55.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.186+0000 7f40d00bb800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:55.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.186+0000 7f40d00bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:55.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.186+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a82e78d00 con 0x562a82e2be30 2024-09-13T23:05:55.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.187+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v34'17 uv17 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.187+0000 7f40d00bb800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:55.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.187+0000 7f40d00bb800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:55.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.187+0000 7f40d00bb800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:05:55.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.187+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94740584826560 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562a82e744e0 con 0x562a82e2be30 2024-09-13T23:05:55.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.188+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== watch-notify(notify (1) cookie 94740584570480 notify 146028888083 ret 0) ==== 609+0+0 (crc 0 0 0) 0x562a82df4ec0 con 0x562a82e2be30 2024-09-13T23:05:55.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.188+0000 7f3fb17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888083 cookie 94740584570480 notifier 4673 bl.length()=567 2024-09-13T23:05:55.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.188+0000 7f3fb17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:05:55.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.188+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(64 notify.4 [notify cookie 94740584826560 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.188+0000 7f3fb17fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:55.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.188+0000 7f3fb17fa640 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f3f90003ea0 con 0x562a82e2be30 2024-09-13T23:05:55.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.188+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== watch-notify(notify_complete (2) cookie 94740584826560 notify 146028888083 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562a82df4940 con 0x562a82e2be30 2024-09-13T23:05:55.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.188+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.203 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:05:31.300851Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:05:31.300826Z","tags":[],"group_ids":[]} 2024-09-13T23:05:55.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.189+0000 7f3f7f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:55.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.189+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94740584579312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a82e707b0 con 0x562a82e2be30 2024-09-13T23:05:55.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.190+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94740584579312] v34'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.190+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94740584555984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a82e707b0 con 0x7f40b8027060 2024-09-13T23:05:55.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.191+0000 7f40ce3b0640 1 -- 172.21.15.164:0/2995815908 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94740584555984] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c8040040 con 0x7f40b8027060 2024-09-13T23:05:55.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.191+0000 7f40d00bb800 20 remove_watcher() i=0 2024-09-13T23:05:55.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.191+0000 7f40d00bb800 2 removed watcher, disabling cache 2024-09-13T23:05:55.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.191+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94740584559216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a82e707b0 con 0x562a82e2be30 2024-09-13T23:05:55.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.192+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94740584559216] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.192+0000 7f40d00bb800 20 remove_watcher() i=1 2024-09-13T23:05:55.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.192+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94740584563280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a82e707b0 con 0x562a82e32040 2024-09-13T23:05:55.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.193+0000 7f40c53ae640 1 -- 172.21.15.164:0/2995815908 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94740584563280] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40b8032070 con 0x562a82e32040 2024-09-13T23:05:55.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.193+0000 7f40d00bb800 20 remove_watcher() i=2 2024-09-13T23:05:55.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.193+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94740584560336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a82e38250 con 0x7f40b8027060 2024-09-13T23:05:55.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.194+0000 7f40ce3b0640 1 -- 172.21.15.164:0/2995815908 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94740584560336] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c8040040 con 0x7f40b8027060 2024-09-13T23:05:55.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.194+0000 7f40d00bb800 20 remove_watcher() i=3 2024-09-13T23:05:55.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.194+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94740584570480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a82e37720 con 0x562a82e2be30 2024-09-13T23:05:55.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.196+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94740584570480] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c007a030 con 0x562a82e2be30 2024-09-13T23:05:55.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.196+0000 7f40d00bb800 20 remove_watcher() i=4 2024-09-13T23:05:55.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.196+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94740584573152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a82e37720 con 0x7f40c8031040 2024-09-13T23:05:55.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.197+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94740584573152] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c007a030 con 0x7f40c8031040 2024-09-13T23:05:55.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.197+0000 7f40d00bb800 20 remove_watcher() i=5 2024-09-13T23:05:55.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.197+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94740584577008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a82e38250 con 0x7f40c8031040 2024-09-13T23:05:55.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.198+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94740584577008] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c007a030 con 0x7f40c8031040 2024-09-13T23:05:55.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.198+0000 7f40d00bb800 20 remove_watcher() i=6 2024-09-13T23:05:55.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.198+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94740584566912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562a82e3b7f0 con 0x7f40c8031040 2024-09-13T23:05:55.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.199+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94740584566912] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c007a030 con 0x7f40c8031040 2024-09-13T23:05:55.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.199+0000 7f40d00bb800 20 remove_watcher() i=7 2024-09-13T23:05:55.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.199+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f40c8031040 msgr2=0x7f40c8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.199+0000 7f40d00bb800 1 --2- 172.21.15.164:0/2995815908 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f40c8031040 0x7f40c8032940 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.199+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562a82e2be30 msgr2=0x562a82e2e2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.199+0000 7f40d00bb800 1 --2- 172.21.15.164:0/2995815908 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562a82e2be30 0x562a82e2e2f0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.199+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f40b8027060 msgr2=0x7f40b804c6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.199+0000 7f40d00bb800 1 --2- 172.21.15.164:0/2995815908 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f40b8027060 0x7f40b804c6f0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.199+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x562a82e32040 msgr2=0x562a82e34430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.199+0000 7f40d00bb800 1 --2- 172.21.15.164:0/2995815908 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x562a82e32040 0x562a82e34430 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.199+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f3f98036b90 msgr2=0x7f3f98039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.199+0000 7f40d00bb800 1 --2- 172.21.15.164:0/2995815908 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f3f98036b90 0x7f3f98039050 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x562a82df8990 tx=0x7f40c801f000 comp rx=0 tx=0).stop 2024-09-13T23:05:55.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.199+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82e18ea0 msgr2=0x562a82e203a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.199+0000 7f40cdbaf640 1 -- 172.21.15.164:0/2995815908 reap_dead start 2024-09-13T23:05:55.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.199+0000 7f40d00bb800 1 --2- 172.21.15.164:0/2995815908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82e18ea0 0x562a82e203a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f40b8024ef0 tx=0x7f40b804c140 comp rx=0 tx=0).stop 2024-09-13T23:05:55.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.199+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 shutdown_connections 2024-09-13T23:05:55.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.199+0000 7f40d00bb800 1 --2- 172.21.15.164:0/2995815908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82e18ea0 0x562a82e203a0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.199+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 >> 172.21.15.164:0/2995815908 conn(0x562a82e15200 msgr2=0x562a82e132d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:55.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.199+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 shutdown_connections 2024-09-13T23:05:55.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.199+0000 7f40d00bb800 1 -- 172.21.15.164:0/2995815908 wait complete. 2024-09-13T23:05:55.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.199+0000 7f40d00bb800 1 -- 172.21.15.164:0/3605476333 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f3fa8036b90 msgr2=0x7f3fa8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.199+0000 7f40d00bb800 1 --2- 172.21.15.164:0/3605476333 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f3fa8036b90 0x7f3fa8039050 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x562a82dfc940 tx=0x7f40c8005840 comp rx=0 tx=0).stop 2024-09-13T23:05:55.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.199+0000 7f40d00bb800 1 -- 172.21.15.164:0/3605476333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82e0c180 msgr2=0x562a82e0c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.199+0000 7f40d00bb800 1 --2- 172.21.15.164:0/3605476333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82e0c180 0x562a82e0c5a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f40b800e610 tx=0x7f40b800ff90 comp rx=0 tx=0).stop 2024-09-13T23:05:55.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.200+0000 7f40d00bb800 1 -- 172.21.15.164:0/3605476333 shutdown_connections 2024-09-13T23:05:55.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.200+0000 7f40d00bb800 1 --2- 172.21.15.164:0/3605476333 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f3fa8036b90 0x7f3fa8039050 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.200+0000 7f40d00bb800 1 --2- 172.21.15.164:0/3605476333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82e0c180 0x562a82e0c5a0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.200+0000 7f40d00bb800 1 -- 172.21.15.164:0/3605476333 >> 172.21.15.164:0/3605476333 conn(0x562a82e01110 msgr2=0x562a82e03c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:55.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.200+0000 7f40d00bb800 1 -- 172.21.15.164:0/3605476333 shutdown_connections 2024-09-13T23:05:55.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.200+0000 7f40d00bb800 1 -- 172.21.15.164:0/3605476333 wait complete. 2024-09-13T23:05:55.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.200+0000 7f40d00bb800 1 -- 172.21.15.164:0/3455045232 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562a82df9460 msgr2=0x562a82dfb850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.200+0000 7f40d00bb800 1 --2- 172.21.15.164:0/3455045232 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562a82df9460 0x562a82dfb850 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.200+0000 7f40d00bb800 1 -- 172.21.15.164:0/3455045232 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f3fb4036b90 msgr2=0x7f3fb4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.200+0000 7f40d00bb800 1 --2- 172.21.15.164:0/3455045232 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f3fb4036b90 0x7f3fb4039050 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f40b8000c00 tx=0x7f40b80013b0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.200+0000 7f40d00bb800 1 -- 172.21.15.164:0/3455045232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82d00b60 msgr2=0x562a82df4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.200+0000 7f40d00bb800 1 --2- 172.21.15.164:0/3455045232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82d00b60 0x562a82df4400 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f40c0045f50 tx=0x7f40c0002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.200+0000 7f40d00bb800 1 -- 172.21.15.164:0/3455045232 shutdown_connections 2024-09-13T23:05:55.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.200+0000 7f40d00bb800 1 --2- 172.21.15.164:0/3455045232 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x562a82df9460 0x562a82dfb850 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.200+0000 7f40d00bb800 1 --2- 172.21.15.164:0/3455045232 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f3fb4036b90 0x7f3fb4039050 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.200+0000 7f40d00bb800 1 --2- 172.21.15.164:0/3455045232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a82d00b60 0x562a82df4400 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.200+0000 7f40d00bb800 1 -- 172.21.15.164:0/3455045232 >> 172.21.15.164:0/3455045232 conn(0x562a82cf5dd0 msgr2=0x562a82de6b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:55.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.200+0000 7f40d00bb800 1 -- 172.21.15.164:0/3455045232 shutdown_connections 2024-09-13T23:05:55.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.200+0000 7f40d00bb800 1 -- 172.21.15.164:0/3455045232 wait complete. 2024-09-13T23:05:55.214 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:05:31.300851Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:05:31.300826Z', 'tags': [], 'group_ids': []} 2024-09-13T23:05:55.224 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:05:55.224 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-13T23:05:55.224 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-13T23:05:55.224 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-13T23:05:55.269 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:05:55.269 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:05:55.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.268+0000 7f7e403af800 1 Processor -- start 2024-09-13T23:05:55.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.268+0000 7f7e403af800 1 -- start start 2024-09-13T23:05:55.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.269+0000 7f7e403af800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5630aeebdd90 0x5630aeec0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.269+0000 7f7e403af800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5630aed76b30 con 0x5630aee2b610 2024-09-13T23:05:55.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.269+0000 7f7e403af800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x5630aed58360 con 0x5630aeebdd90 2024-09-13T23:05:55.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.269+0000 7f7e37fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5630aeebdd90 0x5630aeec0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.269+0000 7f7e3dea3640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x5630aee2b610 0x5630aeebc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:54004/0 (socket says 172.21.15.164:54004) 2024-09-13T23:05:55.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.269+0000 7f7e3dea3640 1 -- 172.21.15.164:0/1586527930 learned_addr learned my addr 172.21.15.164:0/1586527930 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:05:55.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.269+0000 7f7e3d6a2640 1 -- 172.21.15.164:0/1586527930 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2464164520 0 0) 0x5630aed76b30 con 0x5630aee2b610 2024-09-13T23:05:55.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.269+0000 7f7e3d6a2640 1 -- 172.21.15.164:0/1586527930 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e2c001e10 con 0x5630aee2b610 2024-09-13T23:05:55.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.269+0000 7f7e37fff640 1 -- 172.21.15.164:0/1586527930 >> v1:172.21.15.17:6789/0 conn(0x5630aee2b610 legacy=0x5630aeebc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.269+0000 7f7e37fff640 1 -- 172.21.15.164:0/1586527930 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630aed7ee00 con 0x5630aeebdd90 2024-09-13T23:05:55.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.271+0000 7f7e37fff640 1 --2- 172.21.15.164:0/1586527930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aeebdd90 0x5630aeec0180 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f7e2800a470 tx=0x7f7e28045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b662c46f44dd57 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.271+0000 7f7e3d6a2640 1 -- 172.21.15.164:0/1586527930 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e28059070 con 0x5630aeebdd90 2024-09-13T23:05:55.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.271+0000 7f7e3d6a2640 1 -- 172.21.15.164:0/1586527930 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e28054570 con 0x5630aeebdd90 2024-09-13T23:05:55.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.271+0000 7f7e3d6a2640 1 -- 172.21.15.164:0/1586527930 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e28054870 con 0x5630aeebdd90 2024-09-13T23:05:55.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.272+0000 7f7e403af800 1 -- 172.21.15.164:0/1586527930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aeebdd90 msgr2=0x5630aeec0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.272+0000 7f7e403af800 1 --2- 172.21.15.164:0/1586527930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aeebdd90 0x5630aeec0180 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f7e2800a470 tx=0x7f7e28045920 comp rx=0 tx=0).stop 2024-09-13T23:05:55.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.272+0000 7f7e403af800 1 -- 172.21.15.164:0/1586527930 shutdown_connections 2024-09-13T23:05:55.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.272+0000 7f7e403af800 1 --2- 172.21.15.164:0/1586527930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aeebdd90 0x5630aeec0180 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.272+0000 7f7e403af800 1 -- 172.21.15.164:0/1586527930 >> 172.21.15.164:0/1586527930 conn(0x5630aeeb1de0 msgr2=0x5630aeeb4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:55.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.272+0000 7f7e403af800 1 -- 172.21.15.164:0/1586527930 shutdown_connections 2024-09-13T23:05:55.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.272+0000 7f7e403af800 1 -- 172.21.15.164:0/1586527930 wait complete. 2024-09-13T23:05:55.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.286+0000 7f7e403af800 1 Processor -- start 2024-09-13T23:05:55.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.286+0000 7f7e403af800 1 -- start start 2024-09-13T23:05:55.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.286+0000 7f7e403af800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aee2b610 0x5630aefa88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.286+0000 7f7e403af800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5630aee03330 con 0x5630aee2b610 2024-09-13T23:05:55.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.286+0000 7f7e3dea3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aee2b610 0x5630aefa88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.286+0000 7f7e3dea3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aee2b610 0x5630aefa88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:38160/0 (socket says 172.21.15.164:38160) 2024-09-13T23:05:55.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.286+0000 7f7e3dea3640 1 -- 172.21.15.164:0/2497557630 learned_addr learned my addr 172.21.15.164:0/2497557630 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:55.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.286+0000 7f7e3dea3640 1 -- 172.21.15.164:0/2497557630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630aed50bc0 con 0x5630aee2b610 2024-09-13T23:05:55.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.286+0000 7f7e3dea3640 1 --2- 172.21.15.164:0/2497557630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aee2b610 0x5630aefa88c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7e30001e30 tx=0x7f7e3000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbb9db281ee28515 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.287+0000 7f7d2be07640 1 -- 172.21.15.164:0/2497557630 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e30012020 con 0x5630aee2b610 2024-09-13T23:05:55.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.287+0000 7f7d2be07640 1 -- 172.21.15.164:0/2497557630 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e3000e5a0 con 0x5630aee2b610 2024-09-13T23:05:55.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.287+0000 7f7d2be07640 1 -- 172.21.15.164:0/2497557630 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e3000e8e0 con 0x5630aee2b610 2024-09-13T23:05:55.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.287+0000 7f7e403af800 1 -- 172.21.15.164:0/2497557630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aee2b610 msgr2=0x5630aefa88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.287+0000 7f7e403af800 1 --2- 172.21.15.164:0/2497557630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aee2b610 0x5630aefa88c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7e30001e30 tx=0x7f7e3000b780 comp rx=0 tx=0).stop 2024-09-13T23:05:55.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.287+0000 7f7e403af800 1 -- 172.21.15.164:0/2497557630 shutdown_connections 2024-09-13T23:05:55.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.287+0000 7f7e403af800 1 --2- 172.21.15.164:0/2497557630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aee2b610 0x5630aefa88c0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.287+0000 7f7e403af800 1 -- 172.21.15.164:0/2497557630 >> 172.21.15.164:0/2497557630 conn(0x5630aeeb1de0 msgr2=0x5630aefa4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:55.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.287+0000 7f7e403af800 1 -- 172.21.15.164:0/2497557630 shutdown_connections 2024-09-13T23:05:55.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.287+0000 7f7e403af800 1 -- 172.21.15.164:0/2497557630 wait complete. 2024-09-13T23:05:55.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.288+0000 7f7e403af800 1 Processor -- start 2024-09-13T23:05:55.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.288+0000 7f7e403af800 1 -- start start 2024-09-13T23:05:55.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.288+0000 7f7e403af800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aee2b610 0x5630aefb02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.288+0000 7f7e403af800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5630aeec0990 con 0x5630aee2b610 2024-09-13T23:05:55.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.288+0000 7f7e3dea3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aee2b610 0x5630aefb02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.288+0000 7f7e3dea3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aee2b610 0x5630aefb02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:38166/0 (socket says 172.21.15.164:38166) 2024-09-13T23:05:55.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.288+0000 7f7e3dea3640 1 -- 172.21.15.164:0/2608082345 learned_addr learned my addr 172.21.15.164:0/2608082345 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:55.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.289+0000 7f7e3dea3640 1 -- 172.21.15.164:0/2608082345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630aed64fe0 con 0x5630aee2b610 2024-09-13T23:05:55.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.289+0000 7f7e3dea3640 1 --2- 172.21.15.164:0/2608082345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aee2b610 0x5630aefb02b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f7e30001e30 tx=0x7f7e30000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.289+0000 7f7d2a604640 1 -- 172.21.15.164:0/2608082345 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e30012030 con 0x5630aee2b610 2024-09-13T23:05:55.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.289+0000 7f7d2a604640 1 -- 172.21.15.164:0/2608082345 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e30001490 con 0x5630aee2b610 2024-09-13T23:05:55.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.289+0000 7f7e403af800 1 -- 172.21.15.164:0/2608082345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630aefb07f0 con 0x5630aee2b610 2024-09-13T23:05:55.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.289+0000 7f7d2a604640 1 -- 172.21.15.164:0/2608082345 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e3001a8f0 con 0x5630aee2b610 2024-09-13T23:05:55.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.289+0000 7f7e403af800 1 -- 172.21.15.164:0/2608082345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630aefb0d10 con 0x5630aee2b610 2024-09-13T23:05:55.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.290+0000 7f7d2a604640 1 -- 172.21.15.164:0/2608082345 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7e30015020 con 0x5630aee2b610 2024-09-13T23:05:55.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.290+0000 7f7d2a604640 1 --2- 172.21.15.164:0/2608082345 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7d24036b90 0x7f7d24039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.290+0000 7f7d2a604640 1 -- 172.21.15.164:0/2608082345 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f7e30020030 con 0x5630aee2b610 2024-09-13T23:05:55.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.290+0000 7f7e37fff640 1 --2- 172.21.15.164:0/2608082345 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7d24036b90 0x7f7d24039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.290+0000 7f7e403af800 1 --2- 172.21.15.164:0/2608082345 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5630aeebdd90 0x5630aefb7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.290+0000 7f7e403af800 1 -- 172.21.15.164:0/2608082345 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630aefb78a0 con 0x5630aeebdd90 2024-09-13T23:05:55.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.290+0000 7f7e3e6a4640 1 --2- 172.21.15.164:0/2608082345 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5630aeebdd90 0x5630aefb7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.291+0000 7f7e37fff640 1 --2- 172.21.15.164:0/2608082345 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7d24036b90 0x7f7d24039050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x5630aee2ad50 tx=0x7f7e28050000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.291+0000 7f7e3e6a4640 1 --2- 172.21.15.164:0/2608082345 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5630aeebdd90 0x5630aefb7320 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.291+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/2608082345 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e3800a4a0 con 0x5630aeebdd90 2024-09-13T23:05:55.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.291+0000 7f7e403af800 1 -- 172.21.15.164:0/2608082345 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630aefb4840 con 0x5630aeebdd90 2024-09-13T23:05:55.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.291+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/2608082345 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7e3800a4a0 con 0x5630aeebdd90 2024-09-13T23:05:55.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.291+0000 7f7e403af800 1 -- 172.21.15.164:0/2608082345 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630aefb92a0 con 0x5630aeebdd90 2024-09-13T23:05:55.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.292+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/2608082345 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7e3800a4a0 con 0x5630aeebdd90 2024-09-13T23:05:55.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.292+0000 7f7e403af800 1 -- 172.21.15.164:0/2608082345 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630aefb8140 con 0x5630aeebdd90 2024-09-13T23:05:55.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.292+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/2608082345 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7e3800a4a0 con 0x5630aeebdd90 2024-09-13T23:05:55.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.292+0000 7f7e403af800 1 -- 172.21.15.164:0/2608082345 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630aefb8590 con 0x5630aeebdd90 2024-09-13T23:05:55.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.292+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/2608082345 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7e3800a4a0 con 0x5630aeebdd90 2024-09-13T23:05:55.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.292+0000 7f7e403af800 1 Processor -- start 2024-09-13T23:05:55.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.292+0000 7f7e403af800 1 -- start start 2024-09-13T23:05:55.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.293+0000 7f7e403af800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aefc7bd0 0x5630aefc7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.293+0000 7f7e403af800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5630aed52580 con 0x5630aefc7bd0 2024-09-13T23:05:55.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.293+0000 7f7e37fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aefc7bd0 0x5630aefc7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.293+0000 7f7e37fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aefc7bd0 0x5630aefc7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:38168/0 (socket says 172.21.15.164:38168) 2024-09-13T23:05:55.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.293+0000 7f7e37fff640 1 -- 172.21.15.164:0/2825370268 learned_addr learned my addr 172.21.15.164:0/2825370268 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:55.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.293+0000 7f7e37fff640 1 -- 172.21.15.164:0/2825370268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630aefc8530 con 0x5630aefc7bd0 2024-09-13T23:05:55.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.293+0000 7f7e37fff640 1 --2- 172.21.15.164:0/2825370268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aefc7bd0 0x5630aefc7ff0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f7e28025af0 tx=0x7f7e28002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.293+0000 7f7d237fe640 1 -- 172.21.15.164:0/2825370268 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e28070070 con 0x5630aefc7bd0 2024-09-13T23:05:55.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.294+0000 7f7d237fe640 1 -- 172.21.15.164:0/2825370268 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e2805f470 con 0x5630aefc7bd0 2024-09-13T23:05:55.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.294+0000 7f7e403af800 1 -- 172.21.15.164:0/2825370268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630aefc8760 con 0x5630aefc7bd0 2024-09-13T23:05:55.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.294+0000 7f7d237fe640 1 -- 172.21.15.164:0/2825370268 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e28059040 con 0x5630aefc7bd0 2024-09-13T23:05:55.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.294+0000 7f7e403af800 1 -- 172.21.15.164:0/2825370268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630aefcb440 con 0x5630aefc7bd0 2024-09-13T23:05:55.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.294+0000 7f7d237fe640 1 -- 172.21.15.164:0/2825370268 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7e28073070 con 0x5630aefc7bd0 2024-09-13T23:05:55.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.294+0000 7f7d237fe640 1 --2- 172.21.15.164:0/2825370268 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7d18036b90 0x7f7d18039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.294+0000 7f7d237fe640 1 -- 172.21.15.164:0/2825370268 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f7e28068070 con 0x5630aefc7bd0 2024-09-13T23:05:55.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.295+0000 7f7e3e6a4640 1 --2- 172.21.15.164:0/2825370268 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7d18036b90 0x7f7d18039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.295+0000 7f7e403af800 1 Processor -- start 2024-09-13T23:05:55.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.295+0000 7f7e403af800 1 -- start start 2024-09-13T23:05:55.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.295+0000 7f7e3e6a4640 1 --2- 172.21.15.164:0/2825370268 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7d18036b90 0x7f7d18039050 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x5630aefb9030 tx=0x7f7e38005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.295+0000 7f7e403af800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aefd4830 0x5630aefd4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.295+0000 7f7e403af800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5630aefa9070 con 0x5630aefd4830 2024-09-13T23:05:55.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.295+0000 7f7e37fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aefd4830 0x5630aefd4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.295+0000 7f7e37fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aefd4830 0x5630aefd4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:38182/0 (socket says 172.21.15.164:38182) 2024-09-13T23:05:55.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.295+0000 7f7e37fff640 1 -- 172.21.15.164:0/3447019456 learned_addr learned my addr 172.21.15.164:0/3447019456 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:55.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.295+0000 7f7e37fff640 1 -- 172.21.15.164:0/3447019456 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630aefd5200 con 0x5630aefd4830 2024-09-13T23:05:55.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.296+0000 7f7e37fff640 1 --2- 172.21.15.164:0/3447019456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aefd4830 0x5630aefd4c30 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7e2808fae0 tx=0x7f7e2805efc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f3c20542c05023 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.296+0000 7f7d217fa640 1 -- 172.21.15.164:0/3447019456 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e28009410 con 0x5630aefd4830 2024-09-13T23:05:55.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.296+0000 7f7d217fa640 1 -- 172.21.15.164:0/3447019456 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e28073360 con 0x5630aefd4830 2024-09-13T23:05:55.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.296+0000 7f7d217fa640 1 -- 172.21.15.164:0/3447019456 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e280095b0 con 0x5630aefd4830 2024-09-13T23:05:55.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.296+0000 7f7e403af800 1 -- 172.21.15.164:0/3447019456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aefd4830 msgr2=0x5630aefd4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.296+0000 7f7e403af800 1 --2- 172.21.15.164:0/3447019456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aefd4830 0x5630aefd4c30 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7e2808fae0 tx=0x7f7e2805efc0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.296+0000 7f7e403af800 1 -- 172.21.15.164:0/3447019456 shutdown_connections 2024-09-13T23:05:55.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.296+0000 7f7e403af800 1 --2- 172.21.15.164:0/3447019456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aefd4830 0x5630aefd4c30 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.296+0000 7f7e403af800 1 -- 172.21.15.164:0/3447019456 >> 172.21.15.164:0/3447019456 conn(0x5630aefd0b90 msgr2=0x5630aefcec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:55.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.296+0000 7f7e403af800 1 -- 172.21.15.164:0/3447019456 shutdown_connections 2024-09-13T23:05:55.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.296+0000 7f7e403af800 1 -- 172.21.15.164:0/3447019456 wait complete. 2024-09-13T23:05:55.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.297+0000 7f7e403af800 1 Processor -- start 2024-09-13T23:05:55.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.297+0000 7f7e403af800 1 -- start start 2024-09-13T23:05:55.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.297+0000 7f7e403af800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aefd4830 0x5630aefdbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.297+0000 7f7e403af800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5630aefd5870 con 0x5630aefd4830 2024-09-13T23:05:55.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.297+0000 7f7e37fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aefd4830 0x5630aefdbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.297+0000 7f7e37fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aefd4830 0x5630aefdbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:38196/0 (socket says 172.21.15.164:38196) 2024-09-13T23:05:55.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.297+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 learned_addr learned my addr 172.21.15.164:0/707270154 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:05:55.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.297+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630aefdc2b0 con 0x5630aefd4830 2024-09-13T23:05:55.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.298+0000 7f7e37fff640 1 --2- 172.21.15.164:0/707270154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aefd4830 0x5630aefdbd70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f7e28005690 tx=0x7f7e2808fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.298+0000 7f7d0f7fe640 1 -- 172.21.15.164:0/707270154 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e28096070 con 0x5630aefd4830 2024-09-13T23:05:55.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.298+0000 7f7d0f7fe640 1 -- 172.21.15.164:0/707270154 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e28073510 con 0x5630aefd4830 2024-09-13T23:05:55.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.298+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630aefdc540 con 0x5630aefd4830 2024-09-13T23:05:55.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.298+0000 7f7d0f7fe640 1 -- 172.21.15.164:0/707270154 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e28074e10 con 0x5630aefd4830 2024-09-13T23:05:55.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.298+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630aefdf1f0 con 0x5630aefd4830 2024-09-13T23:05:55.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.298+0000 7f7d0f7fe640 1 -- 172.21.15.164:0/707270154 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7e28099070 con 0x5630aefd4830 2024-09-13T23:05:55.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.299+0000 7f7d0f7fe640 1 --2- 172.21.15.164:0/707270154 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7d08036af0 0x7f7d08038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.299+0000 7f7d0f7fe640 1 -- 172.21.15.164:0/707270154 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f7e2809cd60 con 0x5630aefd4830 2024-09-13T23:05:55.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.299+0000 7f7e3e6a4640 1 --2- 172.21.15.164:0/707270154 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7d08036af0 0x7f7d08038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.299+0000 7f7e3e6a4640 1 --2- 172.21.15.164:0/707270154 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7d08036af0 0x7f7d08038fb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x5630aefb14d0 tx=0x7f7e3801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.299+0000 7f7e403af800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.299+0000 7f7e403af800 1 --2- 172.21.15.164:0/707270154 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5630aefe7800 0x5630aefe9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.299+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630aefea410 con 0x5630aefe7800 2024-09-13T23:05:55.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.300+0000 7f7e3dea3640 1 --2- 172.21.15.164:0/707270154 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5630aefe7800 0x5630aefe9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.300+0000 7f7e3dea3640 1 --2- 172.21.15.164:0/707270154 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5630aefe7800 0x5630aefe9cc0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.300+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.300+0000 7f7e403af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:55.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.300+0000 7f7e403af800 20 realm 2024-09-13T23:05:55.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.300+0000 7f7e403af800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.300+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630aefea820 con 0x5630aefe7800 2024-09-13T23:05:55.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.300+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.300+0000 7f7e403af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:55.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.300+0000 7f7e403af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:05:55.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.300+0000 7f7e403af800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.300+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630aefeb0f0 con 0x5630aefe7800 2024-09-13T23:05:55.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.301+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.301+0000 7f7e403af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:55.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.301+0000 7f7e403af800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.301+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630aefeb490 con 0x5630aefe7800 2024-09-13T23:05:55.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.301+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.301+0000 7f7e403af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:55.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.301+0000 7f7e403af800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.301+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630aefebce0 con 0x5630aefe7800 2024-09-13T23:05:55.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.301+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.301+0000 7f7e403af800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:05:55.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.301+0000 7f7e403af800 20 searching for the correct realm 2024-09-13T23:05:55.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.301+0000 7f7e403af800 1 --2- 172.21.15.164:0/707270154 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5630aefeda50 0x5630aefefe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.301+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x5630aefeda50 2024-09-13T23:05:55.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.301+0000 7f7e37fff640 1 --2- 172.21.15.164:0/707270154 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5630aefeda50 0x5630aefefe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.302+0000 7f7e37fff640 1 --2- 172.21.15.164:0/707270154 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5630aefeda50 0x5630aefefe40 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.302+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e28098030 con 0x5630aefeda50 2024-09-13T23:05:55.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.302+0000 7f7e37fff640 1 --2- 172.21.15.164:0/707270154 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7e2809b060 0x7f7e28060a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.302+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x7f7e2809b060 2024-09-13T23:05:55.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.302+0000 7f7e3e6a4640 1 --2- 172.21.15.164:0/707270154 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7e2809b060 0x7f7e28060a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.302+0000 7f7e3e6a4640 1 --2- 172.21.15.164:0/707270154 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7e2809b060 0x7f7e28060a80 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.302+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/707270154 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3801f070 con 0x7f7e2809b060 2024-09-13T23:05:55.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.302+0000 7f7e3e6a4640 1 --2- 172.21.15.164:0/707270154 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7e38031040 0x7f7e38032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.302+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x7f7e38031040 2024-09-13T23:05:55.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.303+0000 7f7e3dea3640 1 --2- 172.21.15.164:0/707270154 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7e38031040 0x7f7e38032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.303+0000 7f7e3dea3640 1 --2- 172.21.15.164:0/707270154 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7e38031040 0x7f7e38032940 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.303+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3001ac70 con 0x7f7e38031040 2024-09-13T23:05:55.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.303+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x5630aefe7800 2024-09-13T23:05:55.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.304+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.304+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x5630aefe7800 2024-09-13T23:05:55.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.304+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.304+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x7f7e38031040 2024-09-13T23:05:55.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.304+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3001ac70 con 0x7f7e38031040 2024-09-13T23:05:55.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.304+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x7f7e38031040 2024-09-13T23:05:55.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.304+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3001ac70 con 0x7f7e38031040 2024-09-13T23:05:55.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.304+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x7f7e2809b060 2024-09-13T23:05:55.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.304+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/707270154 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3801f070 con 0x7f7e2809b060 2024-09-13T23:05:55.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.304+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x5630aefeda50 2024-09-13T23:05:55.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.305+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e28098030 con 0x5630aefeda50 2024-09-13T23:05:55.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.305+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x5630aefe7800 2024-09-13T23:05:55.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.305+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.305+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x7f7e38031040 2024-09-13T23:05:55.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.305+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3001ac70 con 0x7f7e38031040 2024-09-13T23:05:55.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.305+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x5630aefe7800 2024-09-13T23:05:55.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.305+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.305+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x7f7e2809b060 2024-09-13T23:05:55.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.306+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/707270154 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7e3801f070 con 0x7f7e2809b060 2024-09-13T23:05:55.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.306+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x5630aefeda50 2024-09-13T23:05:55.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.306+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e28098030 con 0x5630aefeda50 2024-09-13T23:05:55.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.306+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x5630aefeda50 2024-09-13T23:05:55.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.306+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e28098030 con 0x5630aefeda50 2024-09-13T23:05:55.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.306+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x7f7e38031040 2024-09-13T23:05:55.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.306+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3001ac70 con 0x7f7e38031040 2024-09-13T23:05:55.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.306+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x5630aefeda50 2024-09-13T23:05:55.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.307+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e28098030 con 0x5630aefeda50 2024-09-13T23:05:55.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.307+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x5630aefeda50 2024-09-13T23:05:55.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.307+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e28098030 con 0x5630aefeda50 2024-09-13T23:05:55.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.307+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x5630aefe7800 2024-09-13T23:05:55.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.307+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.307+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x5630aefe7800 2024-09-13T23:05:55.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.307+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.307+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x7f7e38031040 2024-09-13T23:05:55.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.308+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3001ac70 con 0x7f7e38031040 2024-09-13T23:05:55.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.308+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x5630aefeda50 2024-09-13T23:05:55.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.308+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e28098030 con 0x5630aefeda50 2024-09-13T23:05:55.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.308+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x7f7e2809b060 2024-09-13T23:05:55.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.308+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/707270154 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3801f070 con 0x7f7e2809b060 2024-09-13T23:05:55.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.308+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x5630aefe7800 2024-09-13T23:05:55.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.308+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.308+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x7f7e38031040 2024-09-13T23:05:55.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.309+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3001ac70 con 0x7f7e38031040 2024-09-13T23:05:55.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.309+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x5630aefeda50 2024-09-13T23:05:55.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.309+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e28098030 con 0x5630aefeda50 2024-09-13T23:05:55.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.309+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x7f7e38031040 2024-09-13T23:05:55.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.309+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3001ac70 con 0x7f7e38031040 2024-09-13T23:05:55.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.309+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x7f7e2809b060 2024-09-13T23:05:55.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.309+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/707270154 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3801f070 con 0x7f7e2809b060 2024-09-13T23:05:55.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.309+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x5630aefeda50 2024-09-13T23:05:55.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.309+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e28098030 con 0x5630aefeda50 2024-09-13T23:05:55.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.309+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x7f7e2809b060 2024-09-13T23:05:55.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.310+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/707270154 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3801f070 con 0x7f7e2809b060 2024-09-13T23:05:55.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.310+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x5630aefe7800 2024-09-13T23:05:55.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.310+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.310+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0420 con 0x7f7e2809b060 2024-09-13T23:05:55.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.310+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/707270154 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e38040040 con 0x7f7e2809b060 2024-09-13T23:05:55.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.310+0000 7f7e403af800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:05:55.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.310+0000 7f7e403af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:05:55.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.310+0000 7f7e403af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:05:55.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.310+0000 7f7e403af800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:05:55.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.310+0000 7f7e403af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:05:55.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.310+0000 7f7e403af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:05:55.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.310+0000 7f7e403af800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.310+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630aefec690 con 0x5630aefe7800 2024-09-13T23:05:55.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.310+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.310+0000 7f7e403af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:55.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.310+0000 7f7e403af800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.310+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630aefecf30 con 0x5630aefe7800 2024-09-13T23:05:55.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.311+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.311+0000 7f7e403af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:05:55.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.311+0000 7f7e403af800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.311+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff08a0 con 0x5630aefe7800 2024-09-13T23:05:55.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.311+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.311+0000 7f7e403af800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:05:55.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.311+0000 7f7e403af800 20 zone default found 2024-09-13T23:05:55.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.311+0000 7f7e403af800 4 Realm: () 2024-09-13T23:05:55.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.311+0000 7f7e403af800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:05:55.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.311+0000 7f7e403af800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:05:55.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.311+0000 7f7e403af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:05:55.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.311+0000 7f7e403af800 20 zonegroup default 2024-09-13T23:05:55.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.311+0000 7f7e403af800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.311+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff0d50 con 0x7f7e38031040 2024-09-13T23:05:55.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.312+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x7f7e38031040 2024-09-13T23:05:55.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.312+0000 7f7e403af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:55.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.312+0000 7f7e403af800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.312+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff2730 con 0x5630aefeda50 2024-09-13T23:05:55.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.312+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7e28098030 con 0x5630aefeda50 2024-09-13T23:05:55.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.312+0000 7f7e403af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:55.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.312+0000 7f7e403af800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.312+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff2b90 con 0x5630aefeda50 2024-09-13T23:05:55.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.312+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7e28098030 con 0x5630aefeda50 2024-09-13T23:05:55.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.312+0000 7f7e403af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:05:55.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.312+0000 7f7e403af800 20 started sync module instance, tier type = 2024-09-13T23:05:55.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.312+0000 7f7e403af800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:05:55.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.312+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff1bc0 con 0x7f7e2809b060 2024-09-13T23:05:55.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.313+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/707270154 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e38040040 con 0x7f7e2809b060 2024-09-13T23:05:55.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.313+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94767094374320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff1820 con 0x7f7e2809b060 2024-09-13T23:05:55.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.313+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff3ac0 con 0x5630aefe7800 2024-09-13T23:05:55.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.314+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/707270154 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94767094374320] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e38040040 con 0x7f7e2809b060 2024-09-13T23:05:55.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.314+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.314+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94767094378480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff3ac0 con 0x5630aefe7800 2024-09-13T23:05:55.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.314+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff44e0 con 0x5630aefeda50 2024-09-13T23:05:55.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.315+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94767094378480] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.316+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e28098030 con 0x5630aefeda50 2024-09-13T23:05:55.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.316+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94767094380048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff3a30 con 0x5630aefeda50 2024-09-13T23:05:55.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.316+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff53a0 con 0x7f7e2809b060 2024-09-13T23:05:55.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.317+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94767094380048] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e28098030 con 0x5630aefeda50 2024-09-13T23:05:55.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.317+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/707270154 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e38040040 con 0x7f7e2809b060 2024-09-13T23:05:55.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.317+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94767094386416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff57c0 con 0x7f7e2809b060 2024-09-13T23:05:55.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.317+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff6180 con 0x5630aefe7800 2024-09-13T23:05:55.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.318+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/707270154 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94767094386416] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e38040040 con 0x7f7e2809b060 2024-09-13T23:05:55.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.318+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.318+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94767094387952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff6180 con 0x5630aefe7800 2024-09-13T23:05:55.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.318+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff6b80 con 0x7f7e38031040 2024-09-13T23:05:55.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.319+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x7f7e38031040 2024-09-13T23:05:55.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.319+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94767094387952] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.319+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94767094392464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff6ab0 con 0x7f7e38031040 2024-09-13T23:05:55.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.319+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff5d00 con 0x7f7e38031040 2024-09-13T23:05:55.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.320+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94767094392464] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x7f7e38031040 2024-09-13T23:05:55.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.320+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x7f7e38031040 2024-09-13T23:05:55.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.320+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94767094389968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff7590 con 0x7f7e38031040 2024-09-13T23:05:55.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.320+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff7f50 con 0x7f7e38031040 2024-09-13T23:05:55.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.321+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94767094389968] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x7f7e38031040 2024-09-13T23:05:55.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.321+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x7f7e38031040 2024-09-13T23:05:55.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.321+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94767094394736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff7f50 con 0x7f7e38031040 2024-09-13T23:05:55.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.321+0000 7f7e403af800 20 add_watcher() i=0 2024-09-13T23:05:55.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.321+0000 7f7e403af800 20 add_watcher() i=1 2024-09-13T23:05:55.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.321+0000 7f7e403af800 20 add_watcher() i=2 2024-09-13T23:05:55.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.321+0000 7f7e403af800 20 add_watcher() i=3 2024-09-13T23:05:55.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.321+0000 7f7e403af800 20 add_watcher() i=4 2024-09-13T23:05:55.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.321+0000 7f7e403af800 20 add_watcher() i=5 2024-09-13T23:05:55.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.321+0000 7f7e403af800 20 add_watcher() i=6 2024-09-13T23:05:55.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.322+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94767094394736] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x7f7e38031040 2024-09-13T23:05:55.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.322+0000 7f7e403af800 20 add_watcher() i=7 2024-09-13T23:05:55.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.322+0000 7f7e403af800 2 all 8 watchers are set, enabling cache 2024-09-13T23:05:55.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.322+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630aeffb2c0 con 0x5630aefe7800 2024-09-13T23:05:55.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.323+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.323+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94767094410416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff80c0 con 0x5630aefe7800 2024-09-13T23:05:55.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.324+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94767094410416] v34'192 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.324+0000 7f7cef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:55.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.324+0000 7f7e403af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:05:55.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.324+0000 7f7e403af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:05:55.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.324+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630aeffa6c0 con 0x5630aefe7800 2024-09-13T23:05:55.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.325+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.325+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af0044e0 con 0x7f7e38031040 2024-09-13T23:05:55.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.327+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x7f7e38031040 2024-09-13T23:05:55.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.327+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af004520 con 0x5630aefeda50 2024-09-13T23:05:55.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.328+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e28098030 con 0x5630aefeda50 2024-09-13T23:05:55.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.328+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af004b70 con 0x5630aefe7800 2024-09-13T23:05:55.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.328+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'193 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.328+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af004ae0 con 0x7f7e2809b060 2024-09-13T23:05:55.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.329+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/707270154 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'65 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e38040040 con 0x7f7e2809b060 2024-09-13T23:05:55.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.329+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af005090 con 0x5630aefeda50 2024-09-13T23:05:55.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.330+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'43 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e28098030 con 0x5630aefeda50 2024-09-13T23:05:55.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.331+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af005540 con 0x5630aefe7800 2024-09-13T23:05:55.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.332+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.332+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af005540 con 0x7f7e38031040 2024-09-13T23:05:55.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.333+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'45 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x7f7e38031040 2024-09-13T23:05:55.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.333+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af005540 con 0x7f7e2809b060 2024-09-13T23:05:55.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.334+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/707270154 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e38040040 con 0x7f7e2809b060 2024-09-13T23:05:55.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.334+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af0039f0 con 0x5630aefeda50 2024-09-13T23:05:55.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.335+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e28098030 con 0x5630aefeda50 2024-09-13T23:05:55.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.335+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af0039f0 con 0x7f7e2809b060 2024-09-13T23:05:55.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.336+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/707270154 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'66 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e38040040 con 0x7f7e2809b060 2024-09-13T23:05:55.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.336+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af0039f0 con 0x7f7e38031040 2024-09-13T23:05:55.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.337+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x7f7e38031040 2024-09-13T23:05:55.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.337+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af0039f0 con 0x7f7e2809b060 2024-09-13T23:05:55.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.338+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/707270154 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e38040040 con 0x7f7e2809b060 2024-09-13T23:05:55.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.338+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af006290 con 0x7f7e38031040 2024-09-13T23:05:55.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.339+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'49 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x7f7e38031040 2024-09-13T23:05:55.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.339+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af006290 con 0x5630aefe7800 2024-09-13T23:05:55.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.340+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'194 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.340+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af006290 con 0x5630aefeda50 2024-09-13T23:05:55.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.341+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'59 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e28098030 con 0x5630aefeda50 2024-09-13T23:05:55.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.341+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af006290 con 0x7f7e2809b060 2024-09-13T23:05:55.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.342+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/707270154 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'67 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e38040040 con 0x7f7e2809b060 2024-09-13T23:05:55.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.342+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af006290 con 0x5630aefeda50 2024-09-13T23:05:55.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.343+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e28098030 con 0x5630aefeda50 2024-09-13T23:05:55.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.343+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af006290 con 0x5630aefe7800 2024-09-13T23:05:55.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.344+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.344+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af0066b0 con 0x5630aefe7800 2024-09-13T23:05:55.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.345+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'195 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.345+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af006340 con 0x5630aefeda50 2024-09-13T23:05:55.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.347+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'60 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e28098030 con 0x5630aefeda50 2024-09-13T23:05:55.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.347+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af006320 con 0x7f7e2809b060 2024-09-13T23:05:55.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.347+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/707270154 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e38040040 con 0x7f7e2809b060 2024-09-13T23:05:55.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.347+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af006320 con 0x5630aefeda50 2024-09-13T23:05:55.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.348+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e28098030 con 0x5630aefeda50 2024-09-13T23:05:55.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.348+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af006320 con 0x5630aefeda50 2024-09-13T23:05:55.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.349+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 <== osd.3 v2:172.21.15.164:6816/93809510 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e28098030 con 0x5630aefeda50 2024-09-13T23:05:55.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.349+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af006320 con 0x5630aefeda50 2024-09-13T23:05:55.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.350+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 <== osd.3 v2:172.21.15.164:6816/93809510 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e28098030 con 0x5630aefeda50 2024-09-13T23:05:55.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.350+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af006320 con 0x5630aefeda50 2024-09-13T23:05:55.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.351+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 <== osd.3 v2:172.21.15.164:6816/93809510 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'44 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e28098030 con 0x5630aefeda50 2024-09-13T23:05:55.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.351+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af006320 con 0x7f7e38031040 2024-09-13T23:05:55.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.352+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x7f7e38031040 2024-09-13T23:05:55.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.352+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af006290 con 0x5630aefeda50 2024-09-13T23:05:55.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.353+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 <== osd.3 v2:172.21.15.164:6816/93809510 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e28098030 con 0x5630aefeda50 2024-09-13T23:05:55.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.353+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af006290 con 0x7f7e38031040 2024-09-13T23:05:55.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.355+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'46 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x7f7e38031040 2024-09-13T23:05:55.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.355+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af006290 con 0x5630aefeda50 2024-09-13T23:05:55.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.356+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 <== osd.3 v2:172.21.15.164:6816/93809510 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'61 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e28098030 con 0x5630aefeda50 2024-09-13T23:05:55.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.356+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af006290 con 0x7f7e38031040 2024-09-13T23:05:55.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.357+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'50 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x7f7e38031040 2024-09-13T23:05:55.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.357+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af006290 con 0x7f7e2809b060 2024-09-13T23:05:55.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.358+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/707270154 <== osd.2 v2:172.21.15.164:6808/3795914978 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e38040040 con 0x7f7e2809b060 2024-09-13T23:05:55.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.358+0000 7f7cee7fc640 20 reqs_thread_entry: start 2024-09-13T23:05:55.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.359+0000 7f7e403af800 20 init_complete bucket index max shards: 11 2024-09-13T23:05:55.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.359+0000 7f7e403af800 20 Filter name: none 2024-09-13T23:05:55.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.359+0000 7f7c5ffff640 20 reqs_thread_entry: start 2024-09-13T23:05:55.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.359+0000 7f7e403af800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:05:55.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.359+0000 7f7e403af800 20 rados->read ofs=0 len=0 2024-09-13T23:05:55.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.359+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630af031050 con 0x5630aefe7800 2024-09-13T23:05:55.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.359+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.359+0000 7f7e403af800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:05:55.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.359+0000 7f7e403af800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:05:55.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.359+0000 7f7e403af800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:05:55.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.359+0000 7f7e403af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:05:55.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.359+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630af031040 con 0x7f7e2809b060 2024-09-13T23:05:55.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.360+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/707270154 <== osd.2 v2:172.21.15.164:6808/3795914978 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f7e38040040 con 0x7f7e2809b060 2024-09-13T23:05:55.362 INFO:teuthology.orchestra.run.smithi164.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-13T23:05:55.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.360+0000 7f7cef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:05:55.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.360+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94767094410416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630af0057f0 con 0x5630aefe7800 2024-09-13T23:05:55.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.361+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94767094410416] v34'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.361+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94767094374320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630aeffacb0 con 0x7f7e2809b060 2024-09-13T23:05:55.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.362+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/707270154 <== osd.2 v2:172.21.15.164:6808/3795914978 20 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94767094374320] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e38040040 con 0x7f7e2809b060 2024-09-13T23:05:55.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.362+0000 7f7e403af800 20 remove_watcher() i=0 2024-09-13T23:05:55.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.362+0000 7f7e403af800 2 removed watcher, disabling cache 2024-09-13T23:05:55.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.362+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94767094378480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630aeffacb0 con 0x5630aefe7800 2024-09-13T23:05:55.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.364+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94767094378480] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.364+0000 7f7e403af800 20 remove_watcher() i=1 2024-09-13T23:05:55.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.364+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94767094380048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630aeffacb0 con 0x5630aefeda50 2024-09-13T23:05:55.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.365+0000 7f7e37fff640 1 -- 172.21.15.164:0/707270154 <== osd.3 v2:172.21.15.164:6816/93809510 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94767094380048] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e28098030 con 0x5630aefeda50 2024-09-13T23:05:55.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.365+0000 7f7e403af800 20 remove_watcher() i=2 2024-09-13T23:05:55.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.365+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94767094386416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630aeffacb0 con 0x7f7e2809b060 2024-09-13T23:05:55.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.366+0000 7f7e3e6a4640 1 -- 172.21.15.164:0/707270154 <== osd.2 v2:172.21.15.164:6808/3795914978 21 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94767094386416] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e38040040 con 0x7f7e2809b060 2024-09-13T23:05:55.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.366+0000 7f7e403af800 20 remove_watcher() i=3 2024-09-13T23:05:55.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.366+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94767094387952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff4ef0 con 0x5630aefe7800 2024-09-13T23:05:55.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.367+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.1 v2:172.21.15.164:6800/4060509701 32 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94767094387952] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x5630aefe7800 2024-09-13T23:05:55.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.367+0000 7f7e403af800 20 remove_watcher() i=4 2024-09-13T23:05:55.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.367+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94767094392464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630aeffacb0 con 0x7f7e38031040 2024-09-13T23:05:55.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.368+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94767094392464] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x7f7e38031040 2024-09-13T23:05:55.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.368+0000 7f7e403af800 20 remove_watcher() i=5 2024-09-13T23:05:55.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.368+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94767094389968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff4ef0 con 0x7f7e38031040 2024-09-13T23:05:55.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.369+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94767094389968] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x7f7e38031040 2024-09-13T23:05:55.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.369+0000 7f7e403af800 20 remove_watcher() i=6 2024-09-13T23:05:55.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.369+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94767094394736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630aeff6690 con 0x7f7e38031040 2024-09-13T23:05:55.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.370+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94767094394736] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e3001ac70 con 0x7f7e38031040 2024-09-13T23:05:55.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.370+0000 7f7e403af800 20 remove_watcher() i=7 2024-09-13T23:05:55.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.370+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7e38031040 msgr2=0x7f7e38032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.370+0000 7f7e403af800 1 --2- 172.21.15.164:0/707270154 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7e38031040 0x7f7e38032940 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.370+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5630aefe7800 msgr2=0x5630aefe9cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.370+0000 7f7e403af800 1 --2- 172.21.15.164:0/707270154 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5630aefe7800 0x5630aefe9cc0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.370+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7e2809b060 msgr2=0x7f7e28060a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.370+0000 7f7e403af800 1 --2- 172.21.15.164:0/707270154 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7e2809b060 0x7f7e28060a80 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.370+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5630aefeda50 msgr2=0x5630aefefe40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.370+0000 7f7e403af800 1 --2- 172.21.15.164:0/707270154 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5630aefeda50 0x5630aefefe40 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.370+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7d08036af0 msgr2=0x7f7d08038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.370+0000 7f7e403af800 1 --2- 172.21.15.164:0/707270154 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7d08036af0 0x7f7d08038fb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x5630aefb14d0 tx=0x7f7e3801f000 comp rx=0 tx=0).stop 2024-09-13T23:05:55.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.370+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aefd4830 msgr2=0x5630aefdbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.370+0000 7f7e403af800 1 --2- 172.21.15.164:0/707270154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aefd4830 0x5630aefdbd70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f7e28005690 tx=0x7f7e2808fa40 comp rx=0 tx=0).stop 2024-09-13T23:05:55.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.370+0000 7f7e3dea3640 1 -- 172.21.15.164:0/707270154 reap_dead start 2024-09-13T23:05:55.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.370+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 shutdown_connections 2024-09-13T23:05:55.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.370+0000 7f7e403af800 1 --2- 172.21.15.164:0/707270154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aefd4830 0x5630aefdbd70 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.370+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 >> 172.21.15.164:0/707270154 conn(0x5630aefd0b90 msgr2=0x5630aefcec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:55.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.370+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 shutdown_connections 2024-09-13T23:05:55.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.370+0000 7f7e403af800 1 -- 172.21.15.164:0/707270154 wait complete. 2024-09-13T23:05:55.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.371+0000 7f7e403af800 1 -- 172.21.15.164:0/2825370268 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7d18036b90 msgr2=0x7f7d18039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.371+0000 7f7e403af800 1 --2- 172.21.15.164:0/2825370268 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7d18036b90 0x7f7d18039050 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x5630aefb9030 tx=0x7f7e38005840 comp rx=0 tx=0).stop 2024-09-13T23:05:55.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.371+0000 7f7e403af800 1 -- 172.21.15.164:0/2825370268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aefc7bd0 msgr2=0x5630aefc7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.371+0000 7f7e403af800 1 --2- 172.21.15.164:0/2825370268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aefc7bd0 0x5630aefc7ff0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f7e28025af0 tx=0x7f7e28002fb0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.371+0000 7f7e403af800 1 -- 172.21.15.164:0/2825370268 shutdown_connections 2024-09-13T23:05:55.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.371+0000 7f7e403af800 1 --2- 172.21.15.164:0/2825370268 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7d18036b90 0x7f7d18039050 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.371+0000 7f7e403af800 1 --2- 172.21.15.164:0/2825370268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aefc7bd0 0x5630aefc7ff0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.371+0000 7f7e403af800 1 -- 172.21.15.164:0/2825370268 >> 172.21.15.164:0/2825370268 conn(0x5630aefbcbb0 msgr2=0x5630aefbf6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:55.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.371+0000 7f7e403af800 1 -- 172.21.15.164:0/2825370268 shutdown_connections 2024-09-13T23:05:55.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.371+0000 7f7e403af800 1 -- 172.21.15.164:0/2825370268 wait complete. 2024-09-13T23:05:55.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.371+0000 7f7e403af800 1 -- 172.21.15.164:0/2608082345 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5630aeebdd90 msgr2=0x5630aefb7320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.371+0000 7f7e403af800 1 --2- 172.21.15.164:0/2608082345 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5630aeebdd90 0x5630aefb7320 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.371+0000 7f7e403af800 1 -- 172.21.15.164:0/2608082345 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7d24036b90 msgr2=0x7f7d24039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.371+0000 7f7e403af800 1 --2- 172.21.15.164:0/2608082345 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7d24036b90 0x7f7d24039050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x5630aee2ad50 tx=0x7f7e28050000 comp rx=0 tx=0).stop 2024-09-13T23:05:55.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.371+0000 7f7e403af800 1 -- 172.21.15.164:0/2608082345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aee2b610 msgr2=0x5630aefb02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.371+0000 7f7e403af800 1 --2- 172.21.15.164:0/2608082345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aee2b610 0x5630aefb02b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f7e30001e30 tx=0x7f7e30000ed0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.371+0000 7f7e403af800 1 -- 172.21.15.164:0/2608082345 shutdown_connections 2024-09-13T23:05:55.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.371+0000 7f7e403af800 1 --2- 172.21.15.164:0/2608082345 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5630aeebdd90 0x5630aefb7320 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.371+0000 7f7e403af800 1 --2- 172.21.15.164:0/2608082345 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7d24036b90 0x7f7d24039050 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.371+0000 7f7e403af800 1 --2- 172.21.15.164:0/2608082345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630aee2b610 0x5630aefb02b0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.371+0000 7f7e403af800 1 -- 172.21.15.164:0/2608082345 >> 172.21.15.164:0/2608082345 conn(0x5630aeeb1de0 msgr2=0x5630aefa2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:55.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.371+0000 7f7e403af800 1 -- 172.21.15.164:0/2608082345 shutdown_connections 2024-09-13T23:05:55.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:05:55.371+0000 7f7e403af800 1 -- 172.21.15.164:0/2608082345 wait complete. 2024-09-13T23:05:55.381 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T23:05:55.397 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:05:55.441 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-13T23:06:30.443 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-13T23:06:30.444 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-13T23:06:30.444 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-13T23:06:30.496 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:06:30.496 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:06:30.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.497+0000 7f1c52f42800 1 Processor -- start 2024-09-13T23:06:30.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.497+0000 7f1c52f42800 1 -- start start 2024-09-13T23:06:30.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.497+0000 7f1c52f42800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x563e2ecf65b0 0x563e2ed852d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.497+0000 7f1c52f42800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563e2ec41b30 con 0x563e2ed85810 2024-09-13T23:06:30.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.497+0000 7f1c52f42800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x563e2ec23360 con 0x563e2ecf65b0 2024-09-13T23:06:30.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.497+0000 7f1c4ec90640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x563e2ecf65b0 0x563e2ed852d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.497+0000 7f1c47fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x563e2ed85810 0x563e2ed87c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:55898/0 (socket says 172.21.15.164:55898) 2024-09-13T23:06:30.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.497+0000 7f1c4ec90640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x563e2ecf65b0 0x563e2ed852d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44428/0 (socket says 172.21.15.164:44428) 2024-09-13T23:06:30.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.497+0000 7f1c47fff640 1 -- 172.21.15.164:0/3634976016 learned_addr learned my addr 172.21.15.164:0/3634976016 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:06:30.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.498+0000 7f1c4ec90640 1 -- 172.21.15.164:0/3634976016 >> v1:172.21.15.17:6789/0 conn(0x563e2ed85810 legacy=0x563e2ed87c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.498+0000 7f1c4ec90640 1 -- 172.21.15.164:0/3634976016 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e2ec49e00 con 0x563e2ecf65b0 2024-09-13T23:06:30.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.500+0000 7f1c4ec90640 1 --2- 172.21.15.164:0/3634976016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ecf65b0 0x563e2ed852d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f1c4000a470 tx=0x7f1c40045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e027f2183c71fb00 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.500+0000 7f1c4e48f640 1 -- 172.21.15.164:0/3634976016 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c40053570 con 0x563e2ecf65b0 2024-09-13T23:06:30.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.500+0000 7f1c4e48f640 1 -- 172.21.15.164:0/3634976016 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c40058070 con 0x563e2ecf65b0 2024-09-13T23:06:30.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.500+0000 7f1c4e48f640 1 -- 172.21.15.164:0/3634976016 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c40053880 con 0x563e2ecf65b0 2024-09-13T23:06:30.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.500+0000 7f1c52f42800 1 -- 172.21.15.164:0/3634976016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ecf65b0 msgr2=0x563e2ed852d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.500+0000 7f1c52f42800 1 --2- 172.21.15.164:0/3634976016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ecf65b0 0x563e2ed852d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f1c4000a470 tx=0x7f1c40045a20 comp rx=0 tx=0).stop 2024-09-13T23:06:30.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.500+0000 7f1c52f42800 1 -- 172.21.15.164:0/3634976016 shutdown_connections 2024-09-13T23:06:30.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.500+0000 7f1c52f42800 1 --2- 172.21.15.164:0/3634976016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ecf65b0 0x563e2ed852d0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.500+0000 7f1c52f42800 1 -- 172.21.15.164:0/3634976016 >> 172.21.15.164:0/3634976016 conn(0x563e2ed7cde0 msgr2=0x563e2ed7f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:30.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.501+0000 7f1c52f42800 1 -- 172.21.15.164:0/3634976016 shutdown_connections 2024-09-13T23:06:30.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.501+0000 7f1c52f42800 1 -- 172.21.15.164:0/3634976016 wait complete. 2024-09-13T23:06:30.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.516+0000 7f1c52f42800 1 Processor -- start 2024-09-13T23:06:30.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.516+0000 7f1c52f42800 1 -- start start 2024-09-13T23:06:30.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.516+0000 7f1c52f42800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ecf65b0 0x563e2ed82c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.516+0000 7f1c52f42800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563e2ecce330 con 0x563e2ecf65b0 2024-09-13T23:06:30.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.517+0000 7f1c4ec90640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ecf65b0 0x563e2ed82c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.517+0000 7f1c4ec90640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ecf65b0 0x563e2ed82c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44434/0 (socket says 172.21.15.164:44434) 2024-09-13T23:06:30.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.517+0000 7f1c4ec90640 1 -- 172.21.15.164:0/969934618 learned_addr learned my addr 172.21.15.164:0/969934618 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:30.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.517+0000 7f1c4ec90640 1 -- 172.21.15.164:0/969934618 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e2ec1bbc0 con 0x563e2ecf65b0 2024-09-13T23:06:30.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.517+0000 7f1c4ec90640 1 --2- 172.21.15.164:0/969934618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ecf65b0 0x563e2ed82c00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1c40025c20 tx=0x7f1c40051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b280402939f71d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.518+0000 7f1b3ce09640 1 -- 172.21.15.164:0/969934618 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c4005c580 con 0x563e2ecf65b0 2024-09-13T23:06:30.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.518+0000 7f1b3ce09640 1 -- 172.21.15.164:0/969934618 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c40063030 con 0x563e2ecf65b0 2024-09-13T23:06:30.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.518+0000 7f1b3ce09640 1 -- 172.21.15.164:0/969934618 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c4005c850 con 0x563e2ecf65b0 2024-09-13T23:06:30.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.518+0000 7f1c52f42800 1 -- 172.21.15.164:0/969934618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ecf65b0 msgr2=0x563e2ed82c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.518+0000 7f1c52f42800 1 --2- 172.21.15.164:0/969934618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ecf65b0 0x563e2ed82c00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1c40025c20 tx=0x7f1c40051000 comp rx=0 tx=0).stop 2024-09-13T23:06:30.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.518+0000 7f1c52f42800 1 -- 172.21.15.164:0/969934618 shutdown_connections 2024-09-13T23:06:30.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.519+0000 7f1c52f42800 1 --2- 172.21.15.164:0/969934618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ecf65b0 0x563e2ed82c00 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.519+0000 7f1c52f42800 1 -- 172.21.15.164:0/969934618 >> 172.21.15.164:0/969934618 conn(0x563e2ed7cde0 msgr2=0x563e2ee6d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:30.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.519+0000 7f1c52f42800 1 -- 172.21.15.164:0/969934618 shutdown_connections 2024-09-13T23:06:30.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.519+0000 7f1c52f42800 1 -- 172.21.15.164:0/969934618 wait complete. 2024-09-13T23:06:30.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.519+0000 7f1c52f42800 1 Processor -- start 2024-09-13T23:06:30.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.519+0000 7f1c52f42800 1 -- start start 2024-09-13T23:06:30.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.519+0000 7f1c52f42800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ecf65b0 0x563e2ee7b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.519+0000 7f1c52f42800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563e2ed896b0 con 0x563e2ecf65b0 2024-09-13T23:06:30.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.519+0000 7f1c4ec90640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ecf65b0 0x563e2ee7b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.520+0000 7f1c4ec90640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ecf65b0 0x563e2ee7b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44438/0 (socket says 172.21.15.164:44438) 2024-09-13T23:06:30.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.520+0000 7f1c4ec90640 1 -- 172.21.15.164:0/2518820086 learned_addr learned my addr 172.21.15.164:0/2518820086 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:30.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.520+0000 7f1c4ec90640 1 -- 172.21.15.164:0/2518820086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e2ec2ffe0 con 0x563e2ecf65b0 2024-09-13T23:06:30.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.520+0000 7f1c4ec90640 1 --2- 172.21.15.164:0/2518820086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ecf65b0 0x563e2ee7b450 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x563e2ed82300 tx=0x7f1c40002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.520+0000 7f1b3b606640 1 -- 172.21.15.164:0/2518820086 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c40054ad0 con 0x563e2ecf65b0 2024-09-13T23:06:30.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.520+0000 7f1b3b606640 1 -- 172.21.15.164:0/2518820086 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c40054c70 con 0x563e2ecf65b0 2024-09-13T23:06:30.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.520+0000 7f1c52f42800 1 -- 172.21.15.164:0/2518820086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e2ee7b990 con 0x563e2ecf65b0 2024-09-13T23:06:30.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.520+0000 7f1b3b606640 1 -- 172.21.15.164:0/2518820086 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c40068420 con 0x563e2ecf65b0 2024-09-13T23:06:30.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.520+0000 7f1c52f42800 1 -- 172.21.15.164:0/2518820086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e2ee7beb0 con 0x563e2ecf65b0 2024-09-13T23:06:30.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.521+0000 7f1b3b606640 1 -- 172.21.15.164:0/2518820086 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1c400685c0 con 0x563e2ecf65b0 2024-09-13T23:06:30.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.521+0000 7f1b3b606640 1 --2- 172.21.15.164:0/2518820086 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b34036b40 0x7f1b34039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.522+0000 7f1b3b606640 1 -- 172.21.15.164:0/2518820086 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1c40070030 con 0x563e2ecf65b0 2024-09-13T23:06:30.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.522+0000 7f1c47fff640 1 --2- 172.21.15.164:0/2518820086 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b34036b40 0x7f1b34039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.522+0000 7f1c52f42800 1 --2- 172.21.15.164:0/2518820086 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563e2ed85810 0x563e2ee824c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.522+0000 7f1c52f42800 1 -- 172.21.15.164:0/2518820086 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2ee82a90 con 0x563e2ed85810 2024-09-13T23:06:30.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.522+0000 7f1c4f491640 1 --2- 172.21.15.164:0/2518820086 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563e2ed85810 0x563e2ee824c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.522+0000 7f1c47fff640 1 --2- 172.21.15.164:0/2518820086 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b34036b40 0x7f1b34039000 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1c38000f60 tx=0x7f1c380012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.522+0000 7f1c4f491640 1 --2- 172.21.15.164:0/2518820086 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563e2ed85810 0x563e2ee824c0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.522+0000 7f1c4f491640 1 -- 172.21.15.164:0/2518820086 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c4800a4a0 con 0x563e2ed85810 2024-09-13T23:06:30.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.522+0000 7f1c52f42800 1 -- 172.21.15.164:0/2518820086 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2ee7fa90 con 0x563e2ed85810 2024-09-13T23:06:30.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.523+0000 7f1c4f491640 1 -- 172.21.15.164:0/2518820086 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1c4800a4a0 con 0x563e2ed85810 2024-09-13T23:06:30.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.523+0000 7f1c52f42800 1 -- 172.21.15.164:0/2518820086 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2ee848e0 con 0x563e2ed85810 2024-09-13T23:06:30.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.523+0000 7f1c4f491640 1 -- 172.21.15.164:0/2518820086 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1c4800a4a0 con 0x563e2ed85810 2024-09-13T23:06:30.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.523+0000 7f1c52f42800 1 -- 172.21.15.164:0/2518820086 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2ee83b10 con 0x563e2ed85810 2024-09-13T23:06:30.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.523+0000 7f1c4f491640 1 -- 172.21.15.164:0/2518820086 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1c4800a4a0 con 0x563e2ed85810 2024-09-13T23:06:30.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.523+0000 7f1c52f42800 1 -- 172.21.15.164:0/2518820086 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2ee83f60 con 0x563e2ed85810 2024-09-13T23:06:30.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.524+0000 7f1c4f491640 1 -- 172.21.15.164:0/2518820086 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1c4800a4a0 con 0x563e2ed85810 2024-09-13T23:06:30.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.524+0000 7f1c52f42800 1 Processor -- start 2024-09-13T23:06:30.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.524+0000 7f1c52f42800 1 -- start start 2024-09-13T23:06:30.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.524+0000 7f1c52f42800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ee92ef0 0x563e2ee93310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.524+0000 7f1c52f42800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563e2ec1d580 con 0x563e2ee92ef0 2024-09-13T23:06:30.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.525+0000 7f1c47fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ee92ef0 0x563e2ee93310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.525+0000 7f1c47fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ee92ef0 0x563e2ee93310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44452/0 (socket says 172.21.15.164:44452) 2024-09-13T23:06:30.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.525+0000 7f1c47fff640 1 -- 172.21.15.164:0/2313480013 learned_addr learned my addr 172.21.15.164:0/2313480013 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:30.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.525+0000 7f1c47fff640 1 -- 172.21.15.164:0/2313480013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e2ee93850 con 0x563e2ee92ef0 2024-09-13T23:06:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.525+0000 7f1c47fff640 1 --2- 172.21.15.164:0/2313480013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ee92ef0 0x563e2ee93310 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1c38001ed0 tx=0x7f1c3800d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.526+0000 7f1b38e01640 1 -- 172.21.15.164:0/2313480013 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c3801b550 con 0x563e2ee92ef0 2024-09-13T23:06:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.526+0000 7f1b38e01640 1 -- 172.21.15.164:0/2313480013 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c3801b6f0 con 0x563e2ee92ef0 2024-09-13T23:06:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.526+0000 7f1c52f42800 1 -- 172.21.15.164:0/2313480013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e2ee93ae0 con 0x563e2ee92ef0 2024-09-13T23:06:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.526+0000 7f1b38e01640 1 -- 172.21.15.164:0/2313480013 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c3801b9d0 con 0x563e2ee92ef0 2024-09-13T23:06:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.526+0000 7f1c52f42800 1 -- 172.21.15.164:0/2313480013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e2ee967c0 con 0x563e2ee92ef0 2024-09-13T23:06:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.527+0000 7f1b38e01640 1 -- 172.21.15.164:0/2313480013 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1c38023020 con 0x563e2ee92ef0 2024-09-13T23:06:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.527+0000 7f1b38e01640 1 --2- 172.21.15.164:0/2313480013 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b28036b90 0x7f1b28039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.527+0000 7f1b38e01640 1 -- 172.21.15.164:0/2313480013 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1c38021020 con 0x563e2ee92ef0 2024-09-13T23:06:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.527+0000 7f1c4f491640 1 --2- 172.21.15.164:0/2313480013 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b28036b90 0x7f1b28039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.527+0000 7f1c52f42800 1 Processor -- start 2024-09-13T23:06:30.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.527+0000 7f1c4f491640 1 --2- 172.21.15.164:0/2313480013 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b28036b90 0x7f1b28039050 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x563e2ee83630 tx=0x7f1c48005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.527+0000 7f1c52f42800 1 -- start start 2024-09-13T23:06:30.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.527+0000 7f1c52f42800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ee9fc00 0x563e2eea0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.527+0000 7f1c52f42800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563e2ed81270 con 0x563e2ee9fc00 2024-09-13T23:06:30.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.528+0000 7f1c47fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ee9fc00 0x563e2eea0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.528+0000 7f1c47fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ee9fc00 0x563e2eea0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44468/0 (socket says 172.21.15.164:44468) 2024-09-13T23:06:30.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.528+0000 7f1c47fff640 1 -- 172.21.15.164:0/746934968 learned_addr learned my addr 172.21.15.164:0/746934968 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:30.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.528+0000 7f1c47fff640 1 -- 172.21.15.164:0/746934968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e2eea05d0 con 0x563e2ee9fc00 2024-09-13T23:06:30.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.528+0000 7f1c47fff640 1 --2- 172.21.15.164:0/746934968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ee9fc00 0x563e2eea0000 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f1c3804d100 tx=0x7f1c38019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ddcb58692cce20 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.529+0000 7f1b327fc640 1 -- 172.21.15.164:0/746934968 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c380258e0 con 0x563e2ee9fc00 2024-09-13T23:06:30.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.529+0000 7f1b327fc640 1 -- 172.21.15.164:0/746934968 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c38025410 con 0x563e2ee9fc00 2024-09-13T23:06:30.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.529+0000 7f1b327fc640 1 -- 172.21.15.164:0/746934968 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c38025a80 con 0x563e2ee9fc00 2024-09-13T23:06:30.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.529+0000 7f1c52f42800 1 -- 172.21.15.164:0/746934968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ee9fc00 msgr2=0x563e2eea0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.529+0000 7f1c52f42800 1 --2- 172.21.15.164:0/746934968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ee9fc00 0x563e2eea0000 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f1c3804d100 tx=0x7f1c38019ce0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.529+0000 7f1c52f42800 1 -- 172.21.15.164:0/746934968 shutdown_connections 2024-09-13T23:06:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.529+0000 7f1c52f42800 1 --2- 172.21.15.164:0/746934968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ee9fc00 0x563e2eea0000 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.529+0000 7f1c52f42800 1 -- 172.21.15.164:0/746934968 >> 172.21.15.164:0/746934968 conn(0x563e2ee9bf60 msgr2=0x563e2ee9a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.529+0000 7f1c52f42800 1 -- 172.21.15.164:0/746934968 shutdown_connections 2024-09-13T23:06:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.529+0000 7f1c52f42800 1 -- 172.21.15.164:0/746934968 wait complete. 2024-09-13T23:06:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.529+0000 7f1c52f42800 1 Processor -- start 2024-09-13T23:06:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.529+0000 7f1c52f42800 1 -- start start 2024-09-13T23:06:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.530+0000 7f1c52f42800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ee9fc00 0x563e2eea7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.530+0000 7f1c52f42800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563e2eea0c40 con 0x563e2ee9fc00 2024-09-13T23:06:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.530+0000 7f1c47fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ee9fc00 0x563e2eea7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.530+0000 7f1c47fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ee9fc00 0x563e2eea7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44484/0 (socket says 172.21.15.164:44484) 2024-09-13T23:06:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.530+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 learned_addr learned my addr 172.21.15.164:0/1236740823 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.530+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e2eea7650 con 0x563e2ee9fc00 2024-09-13T23:06:30.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.530+0000 7f1c47fff640 1 --2- 172.21.15.164:0/1236740823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ee9fc00 0x563e2eea7110 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f1c3804c020 tx=0x7f1c3804d090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.530+0000 7f1b30ff9640 1 -- 172.21.15.164:0/1236740823 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c3800cc60 con 0x563e2ee9fc00 2024-09-13T23:06:30.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.530+0000 7f1b30ff9640 1 -- 172.21.15.164:0/1236740823 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c3800ce00 con 0x563e2ee9fc00 2024-09-13T23:06:30.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.531+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e2eea78e0 con 0x563e2ee9fc00 2024-09-13T23:06:30.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.531+0000 7f1b30ff9640 1 -- 172.21.15.164:0/1236740823 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c38040990 con 0x563e2ee9fc00 2024-09-13T23:06:30.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.531+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e2eea78e0 con 0x563e2ee9fc00 2024-09-13T23:06:30.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.531+0000 7f1b30ff9640 1 -- 172.21.15.164:0/1236740823 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1c38040bf0 con 0x563e2ee9fc00 2024-09-13T23:06:30.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.532+0000 7f1b30ff9640 1 --2- 172.21.15.164:0/1236740823 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b18036af0 0x7f1b18038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.532+0000 7f1b30ff9640 1 -- 172.21.15.164:0/1236740823 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1c38035070 con 0x563e2ee9fc00 2024-09-13T23:06:30.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.532+0000 7f1c4f491640 1 --2- 172.21.15.164:0/1236740823 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b18036af0 0x7f1b18038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.532+0000 7f1c52f42800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.532+0000 7f1c52f42800 1 --2- 172.21.15.164:0/1236740823 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563e2eeb29b0 0x563e2eeb4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.532+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eeb55c0 con 0x563e2eeb29b0 2024-09-13T23:06:30.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.532+0000 7f1c4ec90640 1 --2- 172.21.15.164:0/1236740823 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563e2eeb29b0 0x563e2eeb4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.532+0000 7f1c4f491640 1 --2- 172.21.15.164:0/1236740823 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b18036af0 0x7f1b18038fb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x563e2ee7f9e0 tx=0x7f1c4801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.532+0000 7f1c4ec90640 1 --2- 172.21.15.164:0/1236740823 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563e2eeb29b0 0x563e2eeb4e70 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.533+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c40051070 con 0x563e2eeb29b0 2024-09-13T23:06:30.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.533+0000 7f1c52f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:30.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.533+0000 7f1c52f42800 20 realm 2024-09-13T23:06:30.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.533+0000 7f1c52f42800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.533+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eeb59d0 con 0x563e2eeb29b0 2024-09-13T23:06:30.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.533+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c40051070 con 0x563e2eeb29b0 2024-09-13T23:06:30.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.533+0000 7f1c52f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:30.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.533+0000 7f1c52f42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:06:30.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.533+0000 7f1c52f42800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.533+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eeb62a0 con 0x563e2eeb29b0 2024-09-13T23:06:30.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.533+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c40051070 con 0x563e2eeb29b0 2024-09-13T23:06:30.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.533+0000 7f1c52f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:30.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.533+0000 7f1c52f42800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.533+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eeb6640 con 0x563e2eeb29b0 2024-09-13T23:06:30.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.533+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1c40051070 con 0x563e2eeb29b0 2024-09-13T23:06:30.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.533+0000 7f1c52f42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:06:30.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.533+0000 7f1c52f42800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.533+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eeb6aa0 con 0x563e2eeb29b0 2024-09-13T23:06:30.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.534+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1c40051070 con 0x563e2eeb29b0 2024-09-13T23:06:30.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.534+0000 7f1c52f42800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:06:30.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.534+0000 7f1c52f42800 20 searching for the correct realm 2024-09-13T23:06:30.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.534+0000 7f1c52f42800 1 --2- 172.21.15.164:0/1236740823 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563e2eeb8af0 0x563e2eebaee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.534+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x563e2eeb8af0 2024-09-13T23:06:30.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.534+0000 7f1c47fff640 1 --2- 172.21.15.164:0/1236740823 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563e2eeb8af0 0x563e2eebaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.534+0000 7f1c47fff640 1 --2- 172.21.15.164:0/1236740823 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563e2eeb8af0 0x563e2eebaee0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.534+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c3803f020 con 0x563e2eeb8af0 2024-09-13T23:06:30.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.534+0000 7f1c47fff640 1 --2- 172.21.15.164:0/1236740823 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f1c380234d0 0x7f1c38042210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.534+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x7f1c380234d0 2024-09-13T23:06:30.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.535+0000 7f1c4f491640 1 --2- 172.21.15.164:0/1236740823 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f1c380234d0 0x7f1c38042210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.535+0000 7f1c4f491640 1 --2- 172.21.15.164:0/1236740823 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f1c380234d0 0x7f1c38042210 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.535+0000 7f1c4f491640 1 -- 172.21.15.164:0/1236740823 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c4801f070 con 0x7f1c380234d0 2024-09-13T23:06:30.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.535+0000 7f1c4f491640 1 --2- 172.21.15.164:0/1236740823 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f1c48031040 0x7f1c48032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.535+0000 7f1c4f491640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x7f1c48031040 2024-09-13T23:06:30.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.536+0000 7f1c4ec90640 1 --2- 172.21.15.164:0/1236740823 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f1c48031040 0x7f1c48032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.536+0000 7f1c4ec90640 1 --2- 172.21.15.164:0/1236740823 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f1c48031040 0x7f1c48032430 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.536+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c40089040 con 0x7f1c48031040 2024-09-13T23:06:30.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.536+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x563e2eeb29b0 2024-09-13T23:06:30.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.537+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.537+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x563e2eeb29b0 2024-09-13T23:06:30.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.537+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.537+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x7f1c48031040 2024-09-13T23:06:30.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.537+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c40089040 con 0x7f1c48031040 2024-09-13T23:06:30.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.537+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x7f1c48031040 2024-09-13T23:06:30.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.538+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c40089040 con 0x7f1c48031040 2024-09-13T23:06:30.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.538+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x7f1c380234d0 2024-09-13T23:06:30.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.538+0000 7f1c4f491640 1 -- 172.21.15.164:0/1236740823 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c4801f070 con 0x7f1c380234d0 2024-09-13T23:06:30.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.538+0000 7f1c4f491640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x563e2eeb8af0 2024-09-13T23:06:30.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.538+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c3805d040 con 0x563e2eeb8af0 2024-09-13T23:06:30.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.538+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x563e2eeb29b0 2024-09-13T23:06:30.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.538+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.538+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x7f1c48031040 2024-09-13T23:06:30.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.539+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c40089040 con 0x7f1c48031040 2024-09-13T23:06:30.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.539+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x563e2eeb29b0 2024-09-13T23:06:30.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.539+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.539+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x7f1c380234d0 2024-09-13T23:06:30.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.539+0000 7f1c4f491640 1 -- 172.21.15.164:0/1236740823 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1c4801f070 con 0x7f1c380234d0 2024-09-13T23:06:30.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.539+0000 7f1c4f491640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x563e2eeb8af0 2024-09-13T23:06:30.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.539+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c3805d040 con 0x563e2eeb8af0 2024-09-13T23:06:30.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.539+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x563e2eeb8af0 2024-09-13T23:06:30.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.540+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c3805d040 con 0x563e2eeb8af0 2024-09-13T23:06:30.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.540+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x7f1c48031040 2024-09-13T23:06:30.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.540+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c40089040 con 0x7f1c48031040 2024-09-13T23:06:30.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.540+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x563e2eeb8af0 2024-09-13T23:06:30.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.540+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c3805d040 con 0x563e2eeb8af0 2024-09-13T23:06:30.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.540+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x563e2eeb8af0 2024-09-13T23:06:30.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.540+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c3805d040 con 0x563e2eeb8af0 2024-09-13T23:06:30.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.540+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x563e2eeb29b0 2024-09-13T23:06:30.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.541+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.541+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x563e2eeb29b0 2024-09-13T23:06:30.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.541+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.541+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x7f1c48031040 2024-09-13T23:06:30.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.541+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c40089040 con 0x7f1c48031040 2024-09-13T23:06:30.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.541+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x563e2eeb8af0 2024-09-13T23:06:30.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.542+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c3805d040 con 0x563e2eeb8af0 2024-09-13T23:06:30.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.542+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x7f1c380234d0 2024-09-13T23:06:30.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.542+0000 7f1c4f491640 1 -- 172.21.15.164:0/1236740823 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c4801f070 con 0x7f1c380234d0 2024-09-13T23:06:30.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.542+0000 7f1c4f491640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x563e2eeb29b0 2024-09-13T23:06:30.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.542+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.542+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x7f1c48031040 2024-09-13T23:06:30.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.542+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c40089040 con 0x7f1c48031040 2024-09-13T23:06:30.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.542+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x563e2eeb8af0 2024-09-13T23:06:30.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.543+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c3805d040 con 0x563e2eeb8af0 2024-09-13T23:06:30.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.543+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x7f1c48031040 2024-09-13T23:06:30.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.543+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c40089040 con 0x7f1c48031040 2024-09-13T23:06:30.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.543+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x7f1c380234d0 2024-09-13T23:06:30.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.543+0000 7f1c4f491640 1 -- 172.21.15.164:0/1236740823 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c4801f070 con 0x7f1c380234d0 2024-09-13T23:06:30.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.543+0000 7f1c4f491640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x563e2eeb8af0 2024-09-13T23:06:30.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.544+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c3805d040 con 0x563e2eeb8af0 2024-09-13T23:06:30.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.544+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x7f1c380234d0 2024-09-13T23:06:30.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.544+0000 7f1c4f491640 1 -- 172.21.15.164:0/1236740823 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c4801f070 con 0x7f1c380234d0 2024-09-13T23:06:30.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.544+0000 7f1c4f491640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x563e2eeb29b0 2024-09-13T23:06:30.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.544+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.544+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebb590 con 0x7f1c380234d0 2024-09-13T23:06:30.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.544+0000 7f1c4f491640 1 -- 172.21.15.164:0/1236740823 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c48040040 con 0x7f1c380234d0 2024-09-13T23:06:30.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.544+0000 7f1c52f42800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:06:30.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.544+0000 7f1c52f42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:06:30.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.544+0000 7f1c52f42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:06:30.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.544+0000 7f1c52f42800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:06:30.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.544+0000 7f1c52f42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:06:30.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.544+0000 7f1c52f42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:06:30.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.544+0000 7f1c52f42800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.544+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eeb7540 con 0x563e2eeb29b0 2024-09-13T23:06:30.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.545+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.545+0000 7f1c52f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:30.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.545+0000 7f1c52f42800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.545+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eeb7de0 con 0x563e2eeb29b0 2024-09-13T23:06:30.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.545+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.545+0000 7f1c52f42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:06:30.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.545+0000 7f1c52f42800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.545+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eeb7180 con 0x563e2eeb29b0 2024-09-13T23:06:30.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.545+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.545+0000 7f1c52f42800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:06:30.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.545+0000 7f1c52f42800 20 zone default found 2024-09-13T23:06:30.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.545+0000 7f1c52f42800 4 Realm: () 2024-09-13T23:06:30.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.545+0000 7f1c52f42800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:06:30.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.545+0000 7f1c52f42800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:06:30.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.545+0000 7f1c52f42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:06:30.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.545+0000 7f1c52f42800 20 zonegroup default 2024-09-13T23:06:30.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.545+0000 7f1c52f42800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.545+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eeb7de0 con 0x7f1c48031040 2024-09-13T23:06:30.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.545+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x7f1c48031040 2024-09-13T23:06:30.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.545+0000 7f1c52f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:30.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.546+0000 7f1c52f42800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.546+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebd3d0 con 0x563e2eeb8af0 2024-09-13T23:06:30.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.546+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1c3805d040 con 0x563e2eeb8af0 2024-09-13T23:06:30.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.546+0000 7f1c52f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:30.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.546+0000 7f1c52f42800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.546+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebd770 con 0x563e2eeb8af0 2024-09-13T23:06:30.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.546+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1c3805d040 con 0x563e2eeb8af0 2024-09-13T23:06:30.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.546+0000 7f1c52f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:30.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.546+0000 7f1c52f42800 20 started sync module instance, tier type = 2024-09-13T23:06:30.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.546+0000 7f1c52f42800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:06:30.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.546+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebc870 con 0x7f1c380234d0 2024-09-13T23:06:30.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.547+0000 7f1c4f491640 1 -- 172.21.15.164:0/1236740823 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c48040040 con 0x7f1c380234d0 2024-09-13T23:06:30.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.547+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94825075166352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebe010 con 0x7f1c380234d0 2024-09-13T23:06:30.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.547+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebe860 con 0x563e2eeb29b0 2024-09-13T23:06:30.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.548+0000 7f1c4f491640 1 -- 172.21.15.164:0/1236740823 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94825075166352] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c48040040 con 0x7f1c380234d0 2024-09-13T23:06:30.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.549+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.549+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94825075170416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebe580 con 0x563e2eeb29b0 2024-09-13T23:06:30.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.549+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebf090 con 0x563e2eeb8af0 2024-09-13T23:06:30.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.550+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c3805d040 con 0x563e2eeb8af0 2024-09-13T23:06:30.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.550+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94825075174208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e2eebf930 con 0x563e2eeb8af0 2024-09-13T23:06:30.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.550+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e2eec03f0 con 0x7f1c380234d0 2024-09-13T23:06:30.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.551+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94825075170416] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.551+0000 7f1c4f491640 1 -- 172.21.15.164:0/1236740823 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c48040040 con 0x7f1c380234d0 2024-09-13T23:06:30.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.551+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94825075179200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e2eec07e0 con 0x7f1c380234d0 2024-09-13T23:06:30.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.551+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e2eec1240 con 0x563e2eeb29b0 2024-09-13T23:06:30.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.551+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94825075174208] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c3805d040 con 0x563e2eeb8af0 2024-09-13T23:06:30.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.552+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.552+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94825075176576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e2eec1240 con 0x563e2eeb29b0 2024-09-13T23:06:30.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.552+0000 7f1c4f491640 1 -- 172.21.15.164:0/1236740823 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94825075179200] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c48040040 con 0x7f1c380234d0 2024-09-13T23:06:30.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.552+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e2eec1ae0 con 0x7f1c48031040 2024-09-13T23:06:30.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.554+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x7f1c48031040 2024-09-13T23:06:30.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.554+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94825075176576] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.554+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94825075184192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e2eec1bb0 con 0x7f1c48031040 2024-09-13T23:06:30.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.554+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e2eec0d60 con 0x7f1c48031040 2024-09-13T23:06:30.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.555+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94825075184192] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x7f1c48031040 2024-09-13T23:06:30.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.555+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x7f1c48031040 2024-09-13T23:06:30.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.555+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94825075185248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e2eec21a0 con 0x7f1c48031040 2024-09-13T23:06:30.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.555+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e2eec2b60 con 0x7f1c48031040 2024-09-13T23:06:30.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.556+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94825075185248] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x7f1c48031040 2024-09-13T23:06:30.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.556+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x7f1c48031040 2024-09-13T23:06:30.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.556+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94825075182880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e2eec2b60 con 0x7f1c48031040 2024-09-13T23:06:30.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.556+0000 7f1c52f42800 20 add_watcher() i=0 2024-09-13T23:06:30.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.556+0000 7f1c52f42800 20 add_watcher() i=1 2024-09-13T23:06:30.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.556+0000 7f1c52f42800 20 add_watcher() i=2 2024-09-13T23:06:30.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.556+0000 7f1c52f42800 20 add_watcher() i=3 2024-09-13T23:06:30.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.556+0000 7f1c52f42800 20 add_watcher() i=4 2024-09-13T23:06:30.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.556+0000 7f1c52f42800 20 add_watcher() i=5 2024-09-13T23:06:30.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.556+0000 7f1c52f42800 20 add_watcher() i=6 2024-09-13T23:06:30.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.557+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94825075182880] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x7f1c48031040 2024-09-13T23:06:30.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.557+0000 7f1c52f42800 20 add_watcher() i=7 2024-09-13T23:06:30.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.557+0000 7f1c52f42800 2 all 8 watchers are set, enabling cache 2024-09-13T23:06:30.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.557+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eec5f60 con 0x563e2eeb29b0 2024-09-13T23:06:30.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.558+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.558+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94825075189888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e2eec3480 con 0x563e2eeb29b0 2024-09-13T23:06:30.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.559+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94825075189888] v34'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.559+0000 7f1b057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:06:30.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.559+0000 7f1c52f42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:06:30.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.559+0000 7f1c52f42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:06:30.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.559+0000 7f1c52f42800 5 note: GC not initialized 2024-09-13T23:06:30.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.559+0000 7f1a7ffff640 20 reqs_thread_entry: start 2024-09-13T23:06:30.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.559+0000 7f1c52f42800 20 init_complete bucket index max shards: 11 2024-09-13T23:06:30.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.559+0000 7f1c52f42800 20 Filter name: none 2024-09-13T23:06:30.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.559+0000 7f1a7dffb640 20 reqs_thread_entry: start 2024-09-13T23:06:30.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.560+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eef97b0 con 0x563e2eeb29b0 2024-09-13T23:06:30.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.560+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.560+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eef97b0 con 0x7f1c380234d0 2024-09-13T23:06:30.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.560+0000 7f1c4f491640 1 -- 172.21.15.164:0/1236740823 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1c48040040 con 0x7f1c380234d0 2024-09-13T23:06:30.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.560+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eef97d0 con 0x563e2eeb29b0 2024-09-13T23:06:30.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.560+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.560+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eef9790 con 0x563e2eeb8af0 2024-09-13T23:06:30.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.561+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1c3805d040 con 0x563e2eeb8af0 2024-09-13T23:06:30.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.561+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eef9ce0 con 0x563e2eeb8af0 2024-09-13T23:06:30.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.561+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1c3805d040 con 0x563e2eeb8af0 2024-09-13T23:06:30.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.561+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eef9ce0 con 0x563e2eeb8af0 2024-09-13T23:06:30.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.561+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1c3805d040 con 0x563e2eeb8af0 2024-09-13T23:06:30.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.561+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eef9ce0 con 0x563e2eeb29b0 2024-09-13T23:06:30.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.561+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.561+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eef9ce0 con 0x563e2eeb29b0 2024-09-13T23:06:30.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.561+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.561+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eef9c70 con 0x563e2eeb8af0 2024-09-13T23:06:30.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.562+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1c3805d040 con 0x563e2eeb8af0 2024-09-13T23:06:30.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.562+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eef9c70 con 0x563e2eeb8af0 2024-09-13T23:06:30.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.562+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f1c3805d040 con 0x563e2eeb8af0 2024-09-13T23:06:30.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.562+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eef9c70 con 0x7f1c48031040 2024-09-13T23:06:30.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.563+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f1c40089040 con 0x7f1c48031040 2024-09-13T23:06:30.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.563+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eefb8b0 con 0x563e2eeb29b0 2024-09-13T23:06:30.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.563+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.563+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eefb8b0 con 0x7f1c380234d0 2024-09-13T23:06:30.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.563+0000 7f1c4f491640 1 -- 172.21.15.164:0/1236740823 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c48040040 con 0x7f1c380234d0 2024-09-13T23:06:30.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.563+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eefb8b0 con 0x563e2eeb8af0 2024-09-13T23:06:30.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.563+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c3805d040 con 0x563e2eeb8af0 2024-09-13T23:06:30.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.563+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eefb8b0 con 0x7f1c48031040 2024-09-13T23:06:30.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.564+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x7f1c48031040 2024-09-13T23:06:30.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.564+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eefb8b0 con 0x7f1c48031040 2024-09-13T23:06:30.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.564+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x7f1c48031040 2024-09-13T23:06:30.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.564+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eefb8b0 con 0x563e2eeb8af0 2024-09-13T23:06:30.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.564+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c3805d040 con 0x563e2eeb8af0 2024-09-13T23:06:30.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.564+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eefb8b0 con 0x7f1c48031040 2024-09-13T23:06:30.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.565+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7f1c40089040 con 0x7f1c48031040 2024-09-13T23:06:30.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.565+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eefb8b0 con 0x563e2eeb29b0 2024-09-13T23:06:30.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.565+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.565+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eefb8b0 con 0x563e2eeb8af0 2024-09-13T23:06:30.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.565+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 <== osd.3 v2:172.21.15.164:6816/93809510 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c3805d040 con 0x563e2eeb8af0 2024-09-13T23:06:30.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.565+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eefb8b0 con 0x7f1c48031040 2024-09-13T23:06:30.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.565+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x7f1c48031040 2024-09-13T23:06:30.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.565+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eefb8b0 con 0x7f1c380234d0 2024-09-13T23:06:30.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.566+0000 7f1c4f491640 1 -- 172.21.15.164:0/1236740823 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c48040040 con 0x7f1c380234d0 2024-09-13T23:06:30.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.566+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eefb8b0 con 0x7f1c48031040 2024-09-13T23:06:30.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.566+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x7f1c48031040 2024-09-13T23:06:30.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.566+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eefb8b0 con 0x563e2eeb29b0 2024-09-13T23:06:30.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.566+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.566+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eefb8b0 con 0x563e2eeb29b0 2024-09-13T23:06:30.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.566+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.566+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eefb8b0 con 0x563e2eeb8af0 2024-09-13T23:06:30.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.567+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 <== osd.3 v2:172.21.15.164:6816/93809510 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c3805d040 con 0x563e2eeb8af0 2024-09-13T23:06:30.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.567+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eefb8b0 con 0x563e2eeb29b0 2024-09-13T23:06:30.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.567+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.567+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eefb8b0 con 0x563e2eeb29b0 2024-09-13T23:06:30.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.567+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.567+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eefb8b0 con 0x563e2eeb8af0 2024-09-13T23:06:30.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.567+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 <== osd.3 v2:172.21.15.164:6816/93809510 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c3805d040 con 0x563e2eeb8af0 2024-09-13T23:06:30.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.567+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eefb8b0 con 0x563e2eeb8af0 2024-09-13T23:06:30.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.568+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 <== osd.3 v2:172.21.15.164:6816/93809510 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c3805d040 con 0x563e2eeb8af0 2024-09-13T23:06:30.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.568+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eefb8b0 con 0x563e2eeb8af0 2024-09-13T23:06:30.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.568+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 <== osd.3 v2:172.21.15.164:6816/93809510 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c3805d040 con 0x563e2eeb8af0 2024-09-13T23:06:30.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.568+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e2eefb8f0 con 0x7f1c48031040 2024-09-13T23:06:30.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.568+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x7f1c48031040 2024-09-13T23:06:30.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.569+0000 7f1b057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:06:30.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.569+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94825075189888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e2eef6cc0 con 0x563e2eeb29b0 2024-09-13T23:06:30.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.570+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94825075189888] v34'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.570+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94825075166352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e2eef6cc0 con 0x7f1c380234d0 2024-09-13T23:06:30.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.571+0000 7f1c4f491640 1 -- 172.21.15.164:0/1236740823 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94825075166352] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c48040040 con 0x7f1c380234d0 2024-09-13T23:06:30.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.571+0000 7f1c52f42800 20 remove_watcher() i=0 2024-09-13T23:06:30.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.571+0000 7f1c52f42800 2 removed watcher, disabling cache 2024-09-13T23:06:30.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.571+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94825075170416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e2eef6cc0 con 0x563e2eeb29b0 2024-09-13T23:06:30.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.572+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94825075170416] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.573+0000 7f1c52f42800 20 remove_watcher() i=1 2024-09-13T23:06:30.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.573+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94825075174208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e2eef6cc0 con 0x563e2eeb8af0 2024-09-13T23:06:30.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.574+0000 7f1c47fff640 1 -- 172.21.15.164:0/1236740823 <== osd.3 v2:172.21.15.164:6816/93809510 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94825075174208] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c3805d040 con 0x563e2eeb8af0 2024-09-13T23:06:30.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.574+0000 7f1c52f42800 20 remove_watcher() i=2 2024-09-13T23:06:30.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.574+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94825075179200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e2eef6cc0 con 0x7f1c380234d0 2024-09-13T23:06:30.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.575+0000 7f1c4f491640 1 -- 172.21.15.164:0/1236740823 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94825075179200] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c48040040 con 0x7f1c380234d0 2024-09-13T23:06:30.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.575+0000 7f1c52f42800 20 remove_watcher() i=3 2024-09-13T23:06:30.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.575+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94825075176576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e2eef6cc0 con 0x563e2eeb29b0 2024-09-13T23:06:30.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.576+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.1 v2:172.21.15.164:6800/4060509701 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94825075176576] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x563e2eeb29b0 2024-09-13T23:06:30.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.576+0000 7f1c52f42800 20 remove_watcher() i=4 2024-09-13T23:06:30.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.576+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94825075184192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e2eef6cc0 con 0x7f1c48031040 2024-09-13T23:06:30.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.577+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94825075184192] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x7f1c48031040 2024-09-13T23:06:30.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.577+0000 7f1c52f42800 20 remove_watcher() i=5 2024-09-13T23:06:30.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.577+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94825075185248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e2eef6cc0 con 0x7f1c48031040 2024-09-13T23:06:30.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.578+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94825075185248] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x7f1c48031040 2024-09-13T23:06:30.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.578+0000 7f1c52f42800 20 remove_watcher() i=6 2024-09-13T23:06:30.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.578+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94825075182880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e2eef6cc0 con 0x7f1c48031040 2024-09-13T23:06:30.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.579+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94825075182880] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c40089040 con 0x7f1c48031040 2024-09-13T23:06:30.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.579+0000 7f1c52f42800 20 remove_watcher() i=7 2024-09-13T23:06:30.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.579+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f1c48031040 msgr2=0x7f1c48032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.579+0000 7f1c52f42800 1 --2- 172.21.15.164:0/1236740823 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f1c48031040 0x7f1c48032430 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.579+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563e2eeb29b0 msgr2=0x563e2eeb4e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.579+0000 7f1c52f42800 1 --2- 172.21.15.164:0/1236740823 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563e2eeb29b0 0x563e2eeb4e70 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.579+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f1c380234d0 msgr2=0x7f1c38042210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.579+0000 7f1c52f42800 1 --2- 172.21.15.164:0/1236740823 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f1c380234d0 0x7f1c38042210 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.579+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563e2eeb8af0 msgr2=0x563e2eebaee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.579+0000 7f1c52f42800 1 --2- 172.21.15.164:0/1236740823 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563e2eeb8af0 0x563e2eebaee0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.579+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b18036af0 msgr2=0x7f1b18038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.579+0000 7f1c52f42800 1 --2- 172.21.15.164:0/1236740823 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b18036af0 0x7f1b18038fb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x563e2ee7f9e0 tx=0x7f1c4801f000 comp rx=0 tx=0).stop 2024-09-13T23:06:30.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.579+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ee9fc00 msgr2=0x563e2eea7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.579+0000 7f1c52f42800 1 --2- 172.21.15.164:0/1236740823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ee9fc00 0x563e2eea7110 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f1c3804c020 tx=0x7f1c3804d090 comp rx=0 tx=0).stop 2024-09-13T23:06:30.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.579+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 reap_dead start 2024-09-13T23:06:30.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.579+0000 7f1c4ec90640 1 -- 172.21.15.164:0/1236740823 reap_dead start 2024-09-13T23:06:30.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.579+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 shutdown_connections 2024-09-13T23:06:30.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.579+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 >> 172.21.15.164:0/1236740823 conn(0x563e2ee9bf60 msgr2=0x563e2ee9a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:30.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.580+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 shutdown_connections 2024-09-13T23:06:30.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.580+0000 7f1c52f42800 1 -- 172.21.15.164:0/1236740823 wait complete. 2024-09-13T23:06:30.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.580+0000 7f1c52f42800 1 -- 172.21.15.164:0/2313480013 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b28036b90 msgr2=0x7f1b28039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.580+0000 7f1c52f42800 1 --2- 172.21.15.164:0/2313480013 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b28036b90 0x7f1b28039050 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x563e2ee83630 tx=0x7f1c48005840 comp rx=0 tx=0).stop 2024-09-13T23:06:30.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.580+0000 7f1c52f42800 1 -- 172.21.15.164:0/2313480013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ee92ef0 msgr2=0x563e2ee93310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.580+0000 7f1c52f42800 1 --2- 172.21.15.164:0/2313480013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ee92ef0 0x563e2ee93310 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1c38001ed0 tx=0x7f1c3800d7a0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.580+0000 7f1c52f42800 1 -- 172.21.15.164:0/2313480013 shutdown_connections 2024-09-13T23:06:30.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.580+0000 7f1c52f42800 1 --2- 172.21.15.164:0/2313480013 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b28036b90 0x7f1b28039050 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.580+0000 7f1c52f42800 1 --2- 172.21.15.164:0/2313480013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ee92ef0 0x563e2ee93310 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.580+0000 7f1c52f42800 1 -- 172.21.15.164:0/2313480013 >> 172.21.15.164:0/2313480013 conn(0x563e2ee87e80 msgr2=0x563e2ee8aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:30.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.580+0000 7f1c52f42800 1 -- 172.21.15.164:0/2313480013 shutdown_connections 2024-09-13T23:06:30.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.580+0000 7f1c52f42800 1 -- 172.21.15.164:0/2313480013 wait complete. 2024-09-13T23:06:30.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.580+0000 7f1c52f42800 1 -- 172.21.15.164:0/2518820086 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563e2ed85810 msgr2=0x563e2ee824c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.580+0000 7f1c52f42800 1 --2- 172.21.15.164:0/2518820086 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563e2ed85810 0x563e2ee824c0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.580+0000 7f1c52f42800 1 -- 172.21.15.164:0/2518820086 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b34036b40 msgr2=0x7f1b34039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.580+0000 7f1c52f42800 1 --2- 172.21.15.164:0/2518820086 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b34036b40 0x7f1b34039000 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1c38000f60 tx=0x7f1c380012b0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.580+0000 7f1c52f42800 1 -- 172.21.15.164:0/2518820086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ecf65b0 msgr2=0x563e2ee7b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.580+0000 7f1c52f42800 1 --2- 172.21.15.164:0/2518820086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ecf65b0 0x563e2ee7b450 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x563e2ed82300 tx=0x7f1c40002fb0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.580+0000 7f1c52f42800 1 -- 172.21.15.164:0/2518820086 shutdown_connections 2024-09-13T23:06:30.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.580+0000 7f1c52f42800 1 --2- 172.21.15.164:0/2518820086 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563e2ed85810 0x563e2ee824c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.580+0000 7f1c52f42800 1 --2- 172.21.15.164:0/2518820086 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b34036b40 0x7f1b34039000 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.580+0000 7f1c52f42800 1 --2- 172.21.15.164:0/2518820086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e2ecf65b0 0x563e2ee7b450 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.580+0000 7f1c52f42800 1 -- 172.21.15.164:0/2518820086 >> 172.21.15.164:0/2518820086 conn(0x563e2ed7cde0 msgr2=0x563e2ee6ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:30.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.581+0000 7f1c52f42800 1 -- 172.21.15.164:0/2518820086 shutdown_connections 2024-09-13T23:06:30.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.581+0000 7f1c52f42800 1 -- 172.21.15.164:0/2518820086 wait complete. 2024-09-13T23:06:30.595 INFO:teuthology.orchestra.run.smithi164.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-09-13T23:06:30.595 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-13T23:06:30.596 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-13T23:06:30.596 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-13T23:06:30.596 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-13T23:06:30.638 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:06:30.638 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:06:30.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.638+0000 7fc237c10800 1 Processor -- start 2024-09-13T23:06:30.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.639+0000 7fc237c10800 1 -- start start 2024-09-13T23:06:30.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.639+0000 7fc237c10800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5635446d7490 0x56354476b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.639+0000 7fc237c10800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563544621b30 con 0x5635446d85a0 2024-09-13T23:06:30.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.639+0000 7fc237c10800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x563544603360 con 0x5635446d7490 2024-09-13T23:06:30.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.639+0000 7fc232b83640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5635446d7490 0x56354476b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.639+0000 7fc233384640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x5635446d85a0 0x5635446d6d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:55908/0 (socket says 172.21.15.164:55908) 2024-09-13T23:06:30.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.639+0000 7fc232b83640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5635446d7490 0x56354476b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44492/0 (socket says 172.21.15.164:44492) 2024-09-13T23:06:30.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.639+0000 7fc233384640 1 -- 172.21.15.164:0/2400418495 learned_addr learned my addr 172.21.15.164:0/2400418495 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:06:30.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.639+0000 7fc232b83640 1 -- 172.21.15.164:0/2400418495 >> v1:172.21.15.17:6789/0 conn(0x5635446d85a0 legacy=0x5635446d6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.639+0000 7fc232b83640 1 -- 172.21.15.164:0/2400418495 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563544629e00 con 0x5635446d7490 2024-09-13T23:06:30.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.641+0000 7fc232b83640 1 --2- 172.21.15.164:0/2400418495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635446d7490 0x56354476b6d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc21c00a470 tx=0x7fc21c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e108b56684ceca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.642+0000 7fc232382640 1 -- 172.21.15.164:0/2400418495 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc21c053570 con 0x5635446d7490 2024-09-13T23:06:30.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.642+0000 7fc232382640 1 -- 172.21.15.164:0/2400418495 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc21c058070 con 0x5635446d7490 2024-09-13T23:06:30.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.642+0000 7fc232382640 1 -- 172.21.15.164:0/2400418495 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc21c053880 con 0x5635446d7490 2024-09-13T23:06:30.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.642+0000 7fc237c10800 1 -- 172.21.15.164:0/2400418495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635446d7490 msgr2=0x56354476b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.642+0000 7fc237c10800 1 --2- 172.21.15.164:0/2400418495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635446d7490 0x56354476b6d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc21c00a470 tx=0x7fc21c045a20 comp rx=0 tx=0).stop 2024-09-13T23:06:30.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.642+0000 7fc237c10800 1 -- 172.21.15.164:0/2400418495 shutdown_connections 2024-09-13T23:06:30.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.642+0000 7fc237c10800 1 --2- 172.21.15.164:0/2400418495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635446d7490 0x56354476b6d0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.642+0000 7fc237c10800 1 -- 172.21.15.164:0/2400418495 >> 172.21.15.164:0/2400418495 conn(0x56354475dfe0 msgr2=0x563544760400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:30.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.642+0000 7fc237c10800 1 -- 172.21.15.164:0/2400418495 shutdown_connections 2024-09-13T23:06:30.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.642+0000 7fc237c10800 1 -- 172.21.15.164:0/2400418495 wait complete. 2024-09-13T23:06:30.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.656+0000 7fc237c10800 1 Processor -- start 2024-09-13T23:06:30.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.656+0000 7fc237c10800 1 -- start start 2024-09-13T23:06:30.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.656+0000 7fc237c10800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635446d7490 0x563544853a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.656+0000 7fc237c10800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5635446ae320 con 0x5635446d7490 2024-09-13T23:06:30.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.657+0000 7fc233384640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635446d7490 0x563544853a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.657+0000 7fc233384640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635446d7490 0x563544853a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44498/0 (socket says 172.21.15.164:44498) 2024-09-13T23:06:30.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.657+0000 7fc233384640 1 -- 172.21.15.164:0/1683111412 learned_addr learned my addr 172.21.15.164:0/1683111412 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:30.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.657+0000 7fc233384640 1 -- 172.21.15.164:0/1683111412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635445fbbc0 con 0x5635446d7490 2024-09-13T23:06:30.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.657+0000 7fc233384640 1 --2- 172.21.15.164:0/1683111412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635446d7490 0x563544853a60 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0017a0 tx=0x7fc22c001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb6cd6f4dfccf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.657+0000 7fc12160a640 1 -- 172.21.15.164:0/1683111412 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc22c016070 con 0x5635446d7490 2024-09-13T23:06:30.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.657+0000 7fc12160a640 1 -- 172.21.15.164:0/1683111412 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc22c004520 con 0x5635446d7490 2024-09-13T23:06:30.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.657+0000 7fc12160a640 1 -- 172.21.15.164:0/1683111412 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc22c004820 con 0x5635446d7490 2024-09-13T23:06:30.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.658+0000 7fc237c10800 1 -- 172.21.15.164:0/1683111412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635446d7490 msgr2=0x563544853a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.658+0000 7fc237c10800 1 --2- 172.21.15.164:0/1683111412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635446d7490 0x563544853a60 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0017a0 tx=0x7fc22c001c60 comp rx=0 tx=0).stop 2024-09-13T23:06:30.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.658+0000 7fc237c10800 1 -- 172.21.15.164:0/1683111412 shutdown_connections 2024-09-13T23:06:30.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.658+0000 7fc237c10800 1 --2- 172.21.15.164:0/1683111412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635446d7490 0x563544853a60 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.658+0000 7fc237c10800 1 -- 172.21.15.164:0/1683111412 >> 172.21.15.164:0/1683111412 conn(0x56354475dfe0 msgr2=0x56354484f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:30.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.658+0000 7fc237c10800 1 -- 172.21.15.164:0/1683111412 shutdown_connections 2024-09-13T23:06:30.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.658+0000 7fc237c10800 1 -- 172.21.15.164:0/1683111412 wait complete. 2024-09-13T23:06:30.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.658+0000 7fc237c10800 1 Processor -- start 2024-09-13T23:06:30.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.658+0000 7fc237c10800 1 -- start start 2024-09-13T23:06:30.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.658+0000 7fc237c10800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635446d7490 0x56354485b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.658+0000 7fc237c10800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5635446d7b80 con 0x5635446d7490 2024-09-13T23:06:30.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.659+0000 7fc233384640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635446d7490 0x56354485b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.659+0000 7fc233384640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635446d7490 0x56354485b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44502/0 (socket says 172.21.15.164:44502) 2024-09-13T23:06:30.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.659+0000 7fc233384640 1 -- 172.21.15.164:0/2573424349 learned_addr learned my addr 172.21.15.164:0/2573424349 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:30.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.659+0000 7fc233384640 1 -- 172.21.15.164:0/2573424349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56354460ffe0 con 0x5635446d7490 2024-09-13T23:06:30.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.659+0000 7fc233384640 1 --2- 172.21.15.164:0/2573424349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635446d7490 0x56354485b4c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fc22c000f80 tx=0x7fc22c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.659+0000 7fc11fe07640 1 -- 172.21.15.164:0/2573424349 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc22c016040 con 0x5635446d7490 2024-09-13T23:06:30.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.659+0000 7fc11fe07640 1 -- 172.21.15.164:0/2573424349 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc22c011530 con 0x5635446d7490 2024-09-13T23:06:30.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.659+0000 7fc237c10800 1 -- 172.21.15.164:0/2573424349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56354485ba00 con 0x5635446d7490 2024-09-13T23:06:30.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.659+0000 7fc11fe07640 1 -- 172.21.15.164:0/2573424349 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc22c011890 con 0x5635446d7490 2024-09-13T23:06:30.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.659+0000 7fc237c10800 1 -- 172.21.15.164:0/2573424349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56354485bf80 con 0x5635446d7490 2024-09-13T23:06:30.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.660+0000 7fc11fe07640 1 -- 172.21.15.164:0/2573424349 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc22c01c3f0 con 0x5635446d7490 2024-09-13T23:06:30.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.660+0000 7fc11fe07640 1 --2- 172.21.15.164:0/2573424349 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc118036b40 0x7fc118039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.660+0000 7fc11fe07640 1 -- 172.21.15.164:0/2573424349 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc22c04bcc0 con 0x5635446d7490 2024-09-13T23:06:30.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.661+0000 7fc232b83640 1 --2- 172.21.15.164:0/2573424349 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc118036b40 0x7fc118039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.661+0000 7fc237c10800 1 --2- 172.21.15.164:0/2573424349 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5635446d85a0 0x563544862470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.661+0000 7fc237c10800 1 -- 172.21.15.164:0/2573424349 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563544862ae0 con 0x5635446d85a0 2024-09-13T23:06:30.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.661+0000 7fc233b85640 1 --2- 172.21.15.164:0/2573424349 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5635446d85a0 0x563544862470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.661+0000 7fc233b85640 1 --2- 172.21.15.164:0/2573424349 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5635446d85a0 0x563544862470 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.661+0000 7fc232b83640 1 --2- 172.21.15.164:0/2573424349 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc118036b40 0x7fc118039000 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc21c057000 tx=0x7fc21c052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.661+0000 7fc233b85640 1 -- 172.21.15.164:0/2573424349 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2240083e0 con 0x5635446d85a0 2024-09-13T23:06:30.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.661+0000 7fc237c10800 1 -- 172.21.15.164:0/2573424349 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56354485fac0 con 0x5635446d85a0 2024-09-13T23:06:30.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.662+0000 7fc233b85640 1 -- 172.21.15.164:0/2573424349 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc2240083e0 con 0x5635446d85a0 2024-09-13T23:06:30.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.662+0000 7fc237c10800 1 -- 172.21.15.164:0/2573424349 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563544864900 con 0x5635446d85a0 2024-09-13T23:06:30.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.662+0000 7fc233b85640 1 -- 172.21.15.164:0/2573424349 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc2240083e0 con 0x5635446d85a0 2024-09-13T23:06:30.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.662+0000 7fc237c10800 1 -- 172.21.15.164:0/2573424349 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563544863a70 con 0x5635446d85a0 2024-09-13T23:06:30.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.662+0000 7fc233b85640 1 -- 172.21.15.164:0/2573424349 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc2240083e0 con 0x5635446d85a0 2024-09-13T23:06:30.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.662+0000 7fc237c10800 1 -- 172.21.15.164:0/2573424349 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563544863e60 con 0x5635446d85a0 2024-09-13T23:06:30.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.663+0000 7fc233b85640 1 -- 172.21.15.164:0/2573424349 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc2240083e0 con 0x5635446d85a0 2024-09-13T23:06:30.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.663+0000 7fc237c10800 1 Processor -- start 2024-09-13T23:06:30.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.663+0000 7fc237c10800 1 -- start start 2024-09-13T23:06:30.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.663+0000 7fc237c10800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563544872f00 0x563544873320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.663+0000 7fc237c10800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5635445fd580 con 0x563544872f00 2024-09-13T23:06:30.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.663+0000 7fc232b83640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563544872f00 0x563544873320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.663+0000 7fc232b83640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563544872f00 0x563544873320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44508/0 (socket says 172.21.15.164:44508) 2024-09-13T23:06:30.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.663+0000 7fc232b83640 1 -- 172.21.15.164:0/2322399152 learned_addr learned my addr 172.21.15.164:0/2322399152 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:30.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.664+0000 7fc232b83640 1 -- 172.21.15.164:0/2322399152 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563544873860 con 0x563544872f00 2024-09-13T23:06:30.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.664+0000 7fc232b83640 1 --2- 172.21.15.164:0/2322399152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563544872f00 0x563544873320 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fc21c045f50 tx=0x7fc21c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.664+0000 7fc11d602640 1 -- 172.21.15.164:0/2322399152 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc21c06f070 con 0x563544872f00 2024-09-13T23:06:30.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.664+0000 7fc11d602640 1 -- 172.21.15.164:0/2322399152 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc21c05f550 con 0x563544872f00 2024-09-13T23:06:30.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.664+0000 7fc237c10800 1 -- 172.21.15.164:0/2322399152 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563544873a90 con 0x563544872f00 2024-09-13T23:06:30.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.664+0000 7fc11d602640 1 -- 172.21.15.164:0/2322399152 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc21c05f830 con 0x563544872f00 2024-09-13T23:06:30.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.664+0000 7fc237c10800 1 -- 172.21.15.164:0/2322399152 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563544876710 con 0x563544872f00 2024-09-13T23:06:30.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.665+0000 7fc11d602640 1 -- 172.21.15.164:0/2322399152 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc21c05f9d0 con 0x563544872f00 2024-09-13T23:06:30.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.665+0000 7fc11d602640 1 --2- 172.21.15.164:0/2322399152 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc10c036b90 0x7fc10c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.665+0000 7fc11d602640 1 -- 172.21.15.164:0/2322399152 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc21c092df0 con 0x563544872f00 2024-09-13T23:06:30.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.665+0000 7fc233b85640 1 --2- 172.21.15.164:0/2322399152 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc10c036b90 0x7fc10c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.666+0000 7fc237c10800 1 Processor -- start 2024-09-13T23:06:30.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.666+0000 7fc233b85640 1 --2- 172.21.15.164:0/2322399152 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc10c036b90 0x7fc10c039050 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x563544863590 tx=0x7fc224000f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.666+0000 7fc237c10800 1 -- start start 2024-09-13T23:06:30.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.666+0000 7fc237c10800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56354487faa0 0x56354487fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.666+0000 7fc237c10800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563544854210 con 0x56354487faa0 2024-09-13T23:06:30.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.666+0000 7fc232b83640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56354487faa0 0x56354487fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.666+0000 7fc232b83640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56354487faa0 0x56354487fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44518/0 (socket says 172.21.15.164:44518) 2024-09-13T23:06:30.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.666+0000 7fc232b83640 1 -- 172.21.15.164:0/2150106374 learned_addr learned my addr 172.21.15.164:0/2150106374 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:30.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.666+0000 7fc232b83640 1 -- 172.21.15.164:0/2150106374 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563544880470 con 0x56354487faa0 2024-09-13T23:06:30.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.667+0000 7fc232b83640 1 --2- 172.21.15.164:0/2150106374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56354487faa0 0x56354487fea0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc21c053da0 tx=0x7fc21c07cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c474c39989db70e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.667+0000 7fc116ffd640 1 -- 172.21.15.164:0/2150106374 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc21c080070 con 0x56354487faa0 2024-09-13T23:06:30.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.667+0000 7fc116ffd640 1 -- 172.21.15.164:0/2150106374 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc21c05fcc0 con 0x56354487faa0 2024-09-13T23:06:30.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.667+0000 7fc116ffd640 1 -- 172.21.15.164:0/2150106374 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc21c06a3a0 con 0x56354487faa0 2024-09-13T23:06:30.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.667+0000 7fc237c10800 1 -- 172.21.15.164:0/2150106374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56354487faa0 msgr2=0x56354487fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.667+0000 7fc237c10800 1 --2- 172.21.15.164:0/2150106374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56354487faa0 0x56354487fea0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc21c053da0 tx=0x7fc21c07cea0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.667+0000 7fc237c10800 1 -- 172.21.15.164:0/2150106374 shutdown_connections 2024-09-13T23:06:30.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.667+0000 7fc237c10800 1 --2- 172.21.15.164:0/2150106374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56354487faa0 0x56354487fea0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.667+0000 7fc237c10800 1 -- 172.21.15.164:0/2150106374 >> 172.21.15.164:0/2150106374 conn(0x56354487be00 msgr2=0x563544879f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:30.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.667+0000 7fc237c10800 1 -- 172.21.15.164:0/2150106374 shutdown_connections 2024-09-13T23:06:30.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.667+0000 7fc237c10800 1 -- 172.21.15.164:0/2150106374 wait complete. 2024-09-13T23:06:30.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.667+0000 7fc237c10800 1 Processor -- start 2024-09-13T23:06:30.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.668+0000 7fc237c10800 1 -- start start 2024-09-13T23:06:30.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.668+0000 7fc237c10800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56354487faa0 0x563544886f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.668+0000 7fc237c10800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563544880ae0 con 0x56354487faa0 2024-09-13T23:06:30.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.668+0000 7fc232b83640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56354487faa0 0x563544886f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.668+0000 7fc232b83640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56354487faa0 0x563544886f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44526/0 (socket says 172.21.15.164:44526) 2024-09-13T23:06:30.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.668+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 learned_addr learned my addr 172.21.15.164:0/2605002141 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:30.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.668+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563544887440 con 0x56354487faa0 2024-09-13T23:06:30.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.669+0000 7fc232b83640 1 --2- 172.21.15.164:0/2605002141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56354487faa0 0x563544886f00 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc21c06bfd0 tx=0x7fc21c091010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.669+0000 7fc1157fa640 1 -- 172.21.15.164:0/2605002141 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc21c06a720 con 0x56354487faa0 2024-09-13T23:06:30.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.669+0000 7fc1157fa640 1 -- 172.21.15.164:0/2605002141 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc21c06a8c0 con 0x56354487faa0 2024-09-13T23:06:30.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.669+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635448876d0 con 0x56354487faa0 2024-09-13T23:06:30.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.669+0000 7fc1157fa640 1 -- 172.21.15.164:0/2605002141 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc21c07c3f0 con 0x56354487faa0 2024-09-13T23:06:30.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.669+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56354488a380 con 0x56354487faa0 2024-09-13T23:06:30.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.670+0000 7fc1157fa640 1 -- 172.21.15.164:0/2605002141 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc21c0a1060 con 0x56354487faa0 2024-09-13T23:06:30.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.670+0000 7fc237c10800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.670+0000 7fc1157fa640 1 --2- 172.21.15.164:0/2605002141 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc0fc036b40 0x7fc0fc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.670+0000 7fc1157fa640 1 -- 172.21.15.164:0/2605002141 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc21c09bd40 con 0x56354487faa0 2024-09-13T23:06:30.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.670+0000 7fc233b85640 1 --2- 172.21.15.164:0/2605002141 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc0fc036b40 0x7fc0fc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.670+0000 7fc237c10800 1 --2- 172.21.15.164:0/2605002141 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563544892a60 0x563544894f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.670+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563544895650 con 0x563544892a60 2024-09-13T23:06:30.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.670+0000 7fc233384640 1 --2- 172.21.15.164:0/2605002141 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563544892a60 0x563544894f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.671+0000 7fc233b85640 1 --2- 172.21.15.164:0/2605002141 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc0fc036b40 0x7fc0fc039000 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc22400f010 tx=0x7fc22400c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.671+0000 7fc233384640 1 --2- 172.21.15.164:0/2605002141 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563544892a60 0x563544894f00 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.671+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc22c019050 con 0x563544892a60 2024-09-13T23:06:30.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.671+0000 7fc237c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:30.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.671+0000 7fc237c10800 20 realm 2024-09-13T23:06:30.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.671+0000 7fc237c10800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.671+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563544895a60 con 0x563544892a60 2024-09-13T23:06:30.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.671+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc22c019050 con 0x563544892a60 2024-09-13T23:06:30.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.671+0000 7fc237c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:30.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.671+0000 7fc237c10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:06:30.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.671+0000 7fc237c10800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.671+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563544896330 con 0x563544892a60 2024-09-13T23:06:30.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.671+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc22c019050 con 0x563544892a60 2024-09-13T23:06:30.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.671+0000 7fc237c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:30.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.671+0000 7fc237c10800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.671+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448966d0 con 0x563544892a60 2024-09-13T23:06:30.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.672+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc22c019050 con 0x563544892a60 2024-09-13T23:06:30.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.672+0000 7fc237c10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:06:30.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.672+0000 7fc237c10800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.672+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563544896b30 con 0x563544892a60 2024-09-13T23:06:30.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.672+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc22c019050 con 0x563544892a60 2024-09-13T23:06:30.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.672+0000 7fc237c10800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:06:30.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.672+0000 7fc237c10800 20 searching for the correct realm 2024-09-13T23:06:30.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.672+0000 7fc237c10800 1 --2- 172.21.15.164:0/2605002141 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563544898b30 0x56354489af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.672+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56354489b5d0 con 0x563544898b30 2024-09-13T23:06:30.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.672+0000 7fc232b83640 1 --2- 172.21.15.164:0/2605002141 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563544898b30 0x56354489af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.672+0000 7fc232b83640 1 --2- 172.21.15.164:0/2605002141 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563544898b30 0x56354489af20 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.673+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc21c082030 con 0x563544898b30 2024-09-13T23:06:30.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.673+0000 7fc232b83640 1 --2- 172.21.15.164:0/2605002141 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc21c0a3070 0x7fc21c0a3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.673+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56354489b5d0 con 0x7fc21c0a3070 2024-09-13T23:06:30.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.673+0000 7fc233b85640 1 --2- 172.21.15.164:0/2605002141 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc21c0a3070 0x7fc21c0a3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.673+0000 7fc233b85640 1 --2- 172.21.15.164:0/2605002141 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc21c0a3070 0x7fc21c0a3620 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.673+0000 7fc233b85640 1 -- 172.21.15.164:0/2605002141 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc22402f040 con 0x7fc21c0a3070 2024-09-13T23:06:30.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.673+0000 7fc233b85640 1 --2- 172.21.15.164:0/2605002141 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc224019040 0x7fc224019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.673+0000 7fc233b85640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56354489b5d0 con 0x7fc224019040 2024-09-13T23:06:30.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.673+0000 7fc233384640 1 --2- 172.21.15.164:0/2605002141 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc224019040 0x7fc224019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.674+0000 7fc233384640 1 --2- 172.21.15.164:0/2605002141 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc224019040 0x7fc224019930 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.674+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc22c019050 con 0x7fc224019040 2024-09-13T23:06:30.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.674+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56354489b5d0 con 0x563544892a60 2024-09-13T23:06:30.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.674+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc22c019050 con 0x563544892a60 2024-09-13T23:06:30.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.674+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56354489b5d0 con 0x563544892a60 2024-09-13T23:06:30.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.675+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc22c019050 con 0x563544892a60 2024-09-13T23:06:30.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.675+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56354489b5d0 con 0x7fc224019040 2024-09-13T23:06:30.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.675+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc22c019050 con 0x7fc224019040 2024-09-13T23:06:30.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.675+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56354489b5d0 con 0x7fc224019040 2024-09-13T23:06:30.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.675+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc22c019050 con 0x7fc224019040 2024-09-13T23:06:30.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.675+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56354489b5d0 con 0x7fc21c0a3070 2024-09-13T23:06:30.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.675+0000 7fc233b85640 1 -- 172.21.15.164:0/2605002141 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc22402f040 con 0x7fc21c0a3070 2024-09-13T23:06:30.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.675+0000 7fc233b85640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56354489b5d0 con 0x563544898b30 2024-09-13T23:06:30.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.676+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc21c082030 con 0x563544898b30 2024-09-13T23:06:30.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.676+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56354489b5d0 con 0x563544892a60 2024-09-13T23:06:30.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.676+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc22c019050 con 0x563544892a60 2024-09-13T23:06:30.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.676+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56354489b5d0 con 0x7fc224019040 2024-09-13T23:06:30.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.676+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc22c019050 con 0x7fc224019040 2024-09-13T23:06:30.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.676+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56354489b5d0 con 0x563544892a60 2024-09-13T23:06:30.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.676+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc22c019050 con 0x563544892a60 2024-09-13T23:06:30.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.676+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56354489b5d0 con 0x7fc21c0a3070 2024-09-13T23:06:30.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.676+0000 7fc233b85640 1 -- 172.21.15.164:0/2605002141 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc22402f040 con 0x7fc21c0a3070 2024-09-13T23:06:30.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.676+0000 7fc233b85640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56354489b5d0 con 0x563544898b30 2024-09-13T23:06:30.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.677+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc21c082030 con 0x563544898b30 2024-09-13T23:06:30.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.677+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56354489b5d0 con 0x563544898b30 2024-09-13T23:06:30.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.677+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc21c082030 con 0x563544898b30 2024-09-13T23:06:30.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.677+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56354489b5d0 con 0x7fc224019040 2024-09-13T23:06:30.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.677+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc22c019050 con 0x7fc224019040 2024-09-13T23:06:30.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.677+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56354489b5d0 con 0x563544898b30 2024-09-13T23:06:30.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.678+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc21c082030 con 0x563544898b30 2024-09-13T23:06:30.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.678+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56354489b5d0 con 0x563544898b30 2024-09-13T23:06:30.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.678+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc21c082030 con 0x563544898b30 2024-09-13T23:06:30.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.678+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56354489b5d0 con 0x563544892a60 2024-09-13T23:06:30.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.678+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc22c019050 con 0x563544892a60 2024-09-13T23:06:30.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.678+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56354489b5d0 con 0x563544892a60 2024-09-13T23:06:30.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.678+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc22c019050 con 0x563544892a60 2024-09-13T23:06:30.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.678+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56354489b5d0 con 0x7fc224019040 2024-09-13T23:06:30.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.679+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc22c019050 con 0x7fc224019040 2024-09-13T23:06:30.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.679+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56354489b5d0 con 0x563544898b30 2024-09-13T23:06:30.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.679+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc21c082030 con 0x563544898b30 2024-09-13T23:06:30.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.679+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56354489b5d0 con 0x7fc21c0a3070 2024-09-13T23:06:30.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.679+0000 7fc233b85640 1 -- 172.21.15.164:0/2605002141 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc22402f040 con 0x7fc21c0a3070 2024-09-13T23:06:30.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.679+0000 7fc233b85640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56354489b5d0 con 0x563544892a60 2024-09-13T23:06:30.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.679+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc22c019050 con 0x563544892a60 2024-09-13T23:06:30.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.679+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56354489b5d0 con 0x7fc224019040 2024-09-13T23:06:30.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.680+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc22c019050 con 0x7fc224019040 2024-09-13T23:06:30.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.680+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56354489b5d0 con 0x563544898b30 2024-09-13T23:06:30.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.680+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc21c082030 con 0x563544898b30 2024-09-13T23:06:30.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.680+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56354489b5d0 con 0x7fc224019040 2024-09-13T23:06:30.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.680+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc22c019050 con 0x7fc224019040 2024-09-13T23:06:30.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.680+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc22c036040 con 0x7fc21c0a3070 2024-09-13T23:06:30.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.680+0000 7fc233b85640 1 -- 172.21.15.164:0/2605002141 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc22402f040 con 0x7fc21c0a3070 2024-09-13T23:06:30.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.680+0000 7fc233b85640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc22c036040 con 0x563544898b30 2024-09-13T23:06:30.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.681+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc21c082030 con 0x563544898b30 2024-09-13T23:06:30.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.681+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc22c036040 con 0x7fc21c0a3070 2024-09-13T23:06:30.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.681+0000 7fc233b85640 1 -- 172.21.15.164:0/2605002141 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc22402f040 con 0x7fc21c0a3070 2024-09-13T23:06:30.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.681+0000 7fc233b85640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc22c036040 con 0x563544892a60 2024-09-13T23:06:30.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.681+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc22c019050 con 0x563544892a60 2024-09-13T23:06:30.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.681+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc22c036040 con 0x7fc21c0a3070 2024-09-13T23:06:30.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.681+0000 7fc233b85640 1 -- 172.21.15.164:0/2605002141 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc22402f040 con 0x7fc21c0a3070 2024-09-13T23:06:30.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.681+0000 7fc237c10800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:06:30.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.681+0000 7fc237c10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:06:30.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.681+0000 7fc237c10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:06:30.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.681+0000 7fc237c10800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:06:30.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.681+0000 7fc237c10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:06:30.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.681+0000 7fc237c10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:06:30.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.681+0000 7fc237c10800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.681+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563544897600 con 0x563544892a60 2024-09-13T23:06:30.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.682+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc22c019050 con 0x563544892a60 2024-09-13T23:06:30.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.682+0000 7fc237c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:30.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.682+0000 7fc237c10800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.682+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563544897ea0 con 0x563544892a60 2024-09-13T23:06:30.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.682+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc22c019050 con 0x563544892a60 2024-09-13T23:06:30.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.682+0000 7fc237c10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:06:30.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.682+0000 7fc237c10800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.682+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563544897240 con 0x563544892a60 2024-09-13T23:06:30.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.682+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc22c0511c0 con 0x563544892a60 2024-09-13T23:06:30.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.682+0000 7fc237c10800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:06:30.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.682+0000 7fc237c10800 20 zone default found 2024-09-13T23:06:30.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.682+0000 7fc237c10800 4 Realm: () 2024-09-13T23:06:30.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.682+0000 7fc237c10800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:06:30.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.682+0000 7fc237c10800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:06:30.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.682+0000 7fc237c10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:06:30.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.682+0000 7fc237c10800 20 zonegroup default 2024-09-13T23:06:30.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.682+0000 7fc237c10800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.682+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563544897ea0 con 0x7fc224019040 2024-09-13T23:06:30.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.683+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x7fc224019040 2024-09-13T23:06:30.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.683+0000 7fc237c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:30.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.683+0000 7fc237c10800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.683+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56354489d410 con 0x563544898b30 2024-09-13T23:06:30.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.683+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc21c082030 con 0x563544898b30 2024-09-13T23:06:30.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.683+0000 7fc237c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:30.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.683+0000 7fc237c10800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.683+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56354489d7b0 con 0x563544898b30 2024-09-13T23:06:30.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.683+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc21c082030 con 0x563544898b30 2024-09-13T23:06:30.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.683+0000 7fc237c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:30.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.683+0000 7fc237c10800 20 started sync module instance, tier type = 2024-09-13T23:06:30.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.683+0000 7fc237c10800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:06:30.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.683+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56354489c8b0 con 0x7fc21c0a3070 2024-09-13T23:06:30.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.684+0000 7fc233b85640 1 -- 172.21.15.164:0/2605002141 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc22402f040 con 0x7fc21c0a3070 2024-09-13T23:06:30.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.684+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94786783137232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56354489c8b0 con 0x7fc21c0a3070 2024-09-13T23:06:30.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.684+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56354489e2a0 con 0x563544892a60 2024-09-13T23:06:30.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.685+0000 7fc233b85640 1 -- 172.21.15.164:0/2605002141 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94786783137232] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc22402f040 con 0x7fc21c0a3070 2024-09-13T23:06:30.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.686+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x563544892a60 2024-09-13T23:06:30.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.686+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94786783141296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56354489c8b0 con 0x563544892a60 2024-09-13T23:06:30.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.686+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56354489ed50 con 0x563544898b30 2024-09-13T23:06:30.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.687+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc21c082030 con 0x563544898b30 2024-09-13T23:06:30.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.687+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94786783143984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56354489f5f0 con 0x563544898b30 2024-09-13T23:06:30.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.687+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635448a0070 con 0x7fc21c0a3070 2024-09-13T23:06:30.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.687+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94786783141296] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x563544892a60 2024-09-13T23:06:30.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.688+0000 7fc233b85640 1 -- 172.21.15.164:0/2605002141 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc22402f040 con 0x7fc21c0a3070 2024-09-13T23:06:30.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.688+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94786783148896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635448a0490 con 0x7fc21c0a3070 2024-09-13T23:06:30.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.688+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635448a0eb0 con 0x563544892a60 2024-09-13T23:06:30.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.689+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94786783143984] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc21c082030 con 0x563544898b30 2024-09-13T23:06:30.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.689+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x563544892a60 2024-09-13T23:06:30.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.689+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94786783152544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635448a0e70 con 0x563544892a60 2024-09-13T23:06:30.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.689+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635448a1930 con 0x7fc224019040 2024-09-13T23:06:30.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.690+0000 7fc233b85640 1 -- 172.21.15.164:0/2605002141 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94786783148896] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc22402f040 con 0x7fc21c0a3070 2024-09-13T23:06:30.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.691+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94786783152544] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x563544892a60 2024-09-13T23:06:30.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.691+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x7fc224019040 2024-09-13T23:06:30.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.691+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94786783146304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635448a1440 con 0x7fc224019040 2024-09-13T23:06:30.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.691+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635448a21d0 con 0x7fc224019040 2024-09-13T23:06:30.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.693+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94786783146304] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x7fc224019040 2024-09-13T23:06:30.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.693+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x7fc224019040 2024-09-13T23:06:30.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.693+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94786783134720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635448a1eb0 con 0x7fc224019040 2024-09-13T23:06:30.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.693+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635448a2870 con 0x7fc224019040 2024-09-13T23:06:30.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.695+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94786783134720] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x7fc224019040 2024-09-13T23:06:30.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.695+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x7fc224019040 2024-09-13T23:06:30.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.695+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94786783157216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635448a2870 con 0x7fc224019040 2024-09-13T23:06:30.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.695+0000 7fc237c10800 20 add_watcher() i=0 2024-09-13T23:06:30.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.695+0000 7fc237c10800 20 add_watcher() i=1 2024-09-13T23:06:30.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.695+0000 7fc237c10800 20 add_watcher() i=2 2024-09-13T23:06:30.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.695+0000 7fc237c10800 20 add_watcher() i=3 2024-09-13T23:06:30.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.695+0000 7fc237c10800 20 add_watcher() i=4 2024-09-13T23:06:30.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.695+0000 7fc237c10800 20 add_watcher() i=5 2024-09-13T23:06:30.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.695+0000 7fc237c10800 20 add_watcher() i=6 2024-09-13T23:06:30.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.697+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94786783157216] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x7fc224019040 2024-09-13T23:06:30.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.697+0000 7fc237c10800 20 add_watcher() i=7 2024-09-13T23:06:30.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.697+0000 7fc237c10800 2 all 8 watchers are set, enabling cache 2024-09-13T23:06:30.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.697+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448a5ba0 con 0x563544892a60 2024-09-13T23:06:30.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.697+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc22c0511c0 con 0x563544892a60 2024-09-13T23:06:30.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.697+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94786783172048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635448a29e0 con 0x563544892a60 2024-09-13T23:06:30.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.698+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94786783172048] v34'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x563544892a60 2024-09-13T23:06:30.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.699+0000 7fc0e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:06:30.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.699+0000 7fc237c10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:06:30.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.699+0000 7fc237c10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:06:30.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.699+0000 7fc237c10800 5 note: GC not initialized 2024-09-13T23:06:30.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.699+0000 7fc0e8fe1640 20 reqs_thread_entry: start 2024-09-13T23:06:30.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.699+0000 7fc237c10800 20 init_complete bucket index max shards: 11 2024-09-13T23:06:30.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.699+0000 7fc237c10800 20 Filter name: none 2024-09-13T23:06:30.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.699+0000 7fc0627fc640 20 reqs_thread_entry: start 2024-09-13T23:06:30.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.699+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448d9460 con 0x563544892a60 2024-09-13T23:06:30.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.699+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x563544892a60 2024-09-13T23:06:30.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.699+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448d9460 con 0x7fc21c0a3070 2024-09-13T23:06:30.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.700+0000 7fc233b85640 1 -- 172.21.15.164:0/2605002141 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc22402f040 con 0x7fc21c0a3070 2024-09-13T23:06:30.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.700+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448d9460 con 0x563544892a60 2024-09-13T23:06:30.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.700+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x563544892a60 2024-09-13T23:06:30.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.700+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448d9420 con 0x563544898b30 2024-09-13T23:06:30.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.700+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc21c082030 con 0x563544898b30 2024-09-13T23:06:30.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.700+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448d99a0 con 0x563544898b30 2024-09-13T23:06:30.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.700+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc21c082030 con 0x563544898b30 2024-09-13T23:06:30.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.700+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448d99a0 con 0x563544898b30 2024-09-13T23:06:30.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.700+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc21c082030 con 0x563544898b30 2024-09-13T23:06:30.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.701+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448d99a0 con 0x563544892a60 2024-09-13T23:06:30.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.701+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x563544892a60 2024-09-13T23:06:30.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.701+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448d99a0 con 0x563544892a60 2024-09-13T23:06:30.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.701+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x563544892a60 2024-09-13T23:06:30.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.701+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448d9950 con 0x563544898b30 2024-09-13T23:06:30.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.701+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc21c082030 con 0x563544898b30 2024-09-13T23:06:30.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.701+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448d9950 con 0x563544898b30 2024-09-13T23:06:30.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.701+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc21c082030 con 0x563544898b30 2024-09-13T23:06:30.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.701+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448d9950 con 0x7fc224019040 2024-09-13T23:06:30.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.702+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fc22c0511c0 con 0x7fc224019040 2024-09-13T23:06:30.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.702+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448db590 con 0x563544892a60 2024-09-13T23:06:30.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.703+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x563544892a60 2024-09-13T23:06:30.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.703+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448db590 con 0x7fc21c0a3070 2024-09-13T23:06:30.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.703+0000 7fc233b85640 1 -- 172.21.15.164:0/2605002141 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc22402f040 con 0x7fc21c0a3070 2024-09-13T23:06:30.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.703+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448db590 con 0x563544898b30 2024-09-13T23:06:30.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.703+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc21c082030 con 0x563544898b30 2024-09-13T23:06:30.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.703+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448db590 con 0x7fc224019040 2024-09-13T23:06:30.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.703+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x7fc224019040 2024-09-13T23:06:30.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.703+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448db590 con 0x7fc224019040 2024-09-13T23:06:30.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.704+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x7fc224019040 2024-09-13T23:06:30.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.704+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448db590 con 0x563544898b30 2024-09-13T23:06:30.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.704+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc21c082030 con 0x563544898b30 2024-09-13T23:06:30.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.704+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448db590 con 0x7fc224019040 2024-09-13T23:06:30.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.704+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7fc22c0511c0 con 0x7fc224019040 2024-09-13T23:06:30.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.704+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448db590 con 0x563544892a60 2024-09-13T23:06:30.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.705+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x563544892a60 2024-09-13T23:06:30.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.705+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448db590 con 0x563544898b30 2024-09-13T23:06:30.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.705+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 <== osd.3 v2:172.21.15.164:6816/93809510 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc21c082030 con 0x563544898b30 2024-09-13T23:06:30.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.705+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448db590 con 0x7fc224019040 2024-09-13T23:06:30.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.705+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x7fc224019040 2024-09-13T23:06:30.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.705+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448db590 con 0x7fc21c0a3070 2024-09-13T23:06:30.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.705+0000 7fc233b85640 1 -- 172.21.15.164:0/2605002141 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc22402f040 con 0x7fc21c0a3070 2024-09-13T23:06:30.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.705+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448db590 con 0x7fc224019040 2024-09-13T23:06:30.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.706+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x7fc224019040 2024-09-13T23:06:30.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.706+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448db590 con 0x563544892a60 2024-09-13T23:06:30.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.706+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x563544892a60 2024-09-13T23:06:30.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.706+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448db590 con 0x563544892a60 2024-09-13T23:06:30.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.706+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x563544892a60 2024-09-13T23:06:30.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.706+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448db590 con 0x563544898b30 2024-09-13T23:06:30.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.706+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 <== osd.3 v2:172.21.15.164:6816/93809510 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc21c082030 con 0x563544898b30 2024-09-13T23:06:30.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.706+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448db590 con 0x563544892a60 2024-09-13T23:06:30.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.707+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x563544892a60 2024-09-13T23:06:30.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.707+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448db590 con 0x563544892a60 2024-09-13T23:06:30.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.707+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x563544892a60 2024-09-13T23:06:30.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.707+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448db590 con 0x563544898b30 2024-09-13T23:06:30.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.707+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 <== osd.3 v2:172.21.15.164:6816/93809510 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc21c082030 con 0x563544898b30 2024-09-13T23:06:30.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.707+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448db590 con 0x563544898b30 2024-09-13T23:06:30.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.707+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 <== osd.3 v2:172.21.15.164:6816/93809510 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc21c082030 con 0x563544898b30 2024-09-13T23:06:30.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.707+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448db590 con 0x563544898b30 2024-09-13T23:06:30.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.707+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 <== osd.3 v2:172.21.15.164:6816/93809510 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc21c082030 con 0x563544898b30 2024-09-13T23:06:30.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.707+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635448db590 con 0x7fc224019040 2024-09-13T23:06:30.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.708+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x7fc224019040 2024-09-13T23:06:30.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.709+0000 7fc0e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:06:30.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.709+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94786783172048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635448d7350 con 0x563544892a60 2024-09-13T23:06:30.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.710+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94786783172048] v34'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x563544892a60 2024-09-13T23:06:30.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.710+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94786783137232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635448a55d0 con 0x7fc21c0a3070 2024-09-13T23:06:30.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.711+0000 7fc233b85640 1 -- 172.21.15.164:0/2605002141 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94786783137232] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc22402f040 con 0x7fc21c0a3070 2024-09-13T23:06:30.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.711+0000 7fc237c10800 20 remove_watcher() i=0 2024-09-13T23:06:30.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.711+0000 7fc237c10800 2 removed watcher, disabling cache 2024-09-13T23:06:30.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.711+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94786783141296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56354489cdd0 con 0x563544892a60 2024-09-13T23:06:30.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.712+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94786783141296] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x563544892a60 2024-09-13T23:06:30.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.712+0000 7fc237c10800 20 remove_watcher() i=1 2024-09-13T23:06:30.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.712+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94786783143984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56354489cdd0 con 0x563544898b30 2024-09-13T23:06:30.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.713+0000 7fc232b83640 1 -- 172.21.15.164:0/2605002141 <== osd.3 v2:172.21.15.164:6816/93809510 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94786783143984] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc21c082030 con 0x563544898b30 2024-09-13T23:06:30.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.713+0000 7fc237c10800 20 remove_watcher() i=2 2024-09-13T23:06:30.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.713+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94786783148896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635448d98e0 con 0x7fc21c0a3070 2024-09-13T23:06:30.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.714+0000 7fc233b85640 1 -- 172.21.15.164:0/2605002141 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94786783148896] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc22402f040 con 0x7fc21c0a3070 2024-09-13T23:06:30.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.714+0000 7fc237c10800 20 remove_watcher() i=3 2024-09-13T23:06:30.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.714+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94786783152544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635448d98e0 con 0x563544892a60 2024-09-13T23:06:30.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.715+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.1 v2:172.21.15.164:6800/4060509701 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94786783152544] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x563544892a60 2024-09-13T23:06:30.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.715+0000 7fc237c10800 20 remove_watcher() i=4 2024-09-13T23:06:30.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.715+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94786783146304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635448d98e0 con 0x7fc224019040 2024-09-13T23:06:30.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.717+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94786783146304] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x7fc224019040 2024-09-13T23:06:30.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.717+0000 7fc237c10800 20 remove_watcher() i=5 2024-09-13T23:06:30.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.717+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94786783134720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635448d98e0 con 0x7fc224019040 2024-09-13T23:06:30.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.718+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94786783134720] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x7fc224019040 2024-09-13T23:06:30.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.718+0000 7fc237c10800 20 remove_watcher() i=6 2024-09-13T23:06:30.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.718+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94786783157216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635448d98e0 con 0x7fc224019040 2024-09-13T23:06:30.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.719+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94786783157216] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc22c0511c0 con 0x7fc224019040 2024-09-13T23:06:30.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.719+0000 7fc237c10800 20 remove_watcher() i=7 2024-09-13T23:06:30.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.719+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc224019040 msgr2=0x7fc224019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.719+0000 7fc237c10800 1 --2- 172.21.15.164:0/2605002141 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc224019040 0x7fc224019930 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.719+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563544892a60 msgr2=0x563544894f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.719+0000 7fc237c10800 1 --2- 172.21.15.164:0/2605002141 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563544892a60 0x563544894f00 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.719+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc21c0a3070 msgr2=0x7fc21c0a3620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.719+0000 7fc237c10800 1 --2- 172.21.15.164:0/2605002141 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc21c0a3070 0x7fc21c0a3620 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.719+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563544898b30 msgr2=0x56354489af20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.719+0000 7fc237c10800 1 --2- 172.21.15.164:0/2605002141 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563544898b30 0x56354489af20 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.719+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc0fc036b40 msgr2=0x7fc0fc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.719+0000 7fc237c10800 1 --2- 172.21.15.164:0/2605002141 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc0fc036b40 0x7fc0fc039000 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc22400f010 tx=0x7fc22400c040 comp rx=0 tx=0).stop 2024-09-13T23:06:30.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.719+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56354487faa0 msgr2=0x563544886f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.719+0000 7fc237c10800 1 --2- 172.21.15.164:0/2605002141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56354487faa0 0x563544886f00 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc21c06bfd0 tx=0x7fc21c091010 comp rx=0 tx=0).stop 2024-09-13T23:06:30.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.719+0000 7fc233384640 1 -- 172.21.15.164:0/2605002141 reap_dead start 2024-09-13T23:06:30.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.719+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 shutdown_connections 2024-09-13T23:06:30.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.719+0000 7fc237c10800 1 --2- 172.21.15.164:0/2605002141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56354487faa0 0x563544886f00 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.719+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 >> 172.21.15.164:0/2605002141 conn(0x56354487be00 msgr2=0x563544879ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:30.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.720+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 shutdown_connections 2024-09-13T23:06:30.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.720+0000 7fc237c10800 1 -- 172.21.15.164:0/2605002141 wait complete. 2024-09-13T23:06:30.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.720+0000 7fc237c10800 1 -- 172.21.15.164:0/2322399152 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc10c036b90 msgr2=0x7fc10c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.720+0000 7fc237c10800 1 --2- 172.21.15.164:0/2322399152 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc10c036b90 0x7fc10c039050 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x563544863590 tx=0x7fc224000f90 comp rx=0 tx=0).stop 2024-09-13T23:06:30.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.720+0000 7fc237c10800 1 -- 172.21.15.164:0/2322399152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563544872f00 msgr2=0x563544873320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.720+0000 7fc237c10800 1 --2- 172.21.15.164:0/2322399152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563544872f00 0x563544873320 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fc21c045f50 tx=0x7fc21c002fb0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.720+0000 7fc237c10800 1 -- 172.21.15.164:0/2322399152 shutdown_connections 2024-09-13T23:06:30.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.720+0000 7fc237c10800 1 --2- 172.21.15.164:0/2322399152 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc10c036b90 0x7fc10c039050 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.720+0000 7fc237c10800 1 --2- 172.21.15.164:0/2322399152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563544872f00 0x563544873320 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.720+0000 7fc237c10800 1 -- 172.21.15.164:0/2322399152 >> 172.21.15.164:0/2322399152 conn(0x563544867ed0 msgr2=0x56354486aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:30.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.720+0000 7fc237c10800 1 -- 172.21.15.164:0/2322399152 shutdown_connections 2024-09-13T23:06:30.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.720+0000 7fc237c10800 1 -- 172.21.15.164:0/2322399152 wait complete. 2024-09-13T23:06:30.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.720+0000 7fc237c10800 1 -- 172.21.15.164:0/2573424349 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5635446d85a0 msgr2=0x563544862470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.720+0000 7fc237c10800 1 --2- 172.21.15.164:0/2573424349 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5635446d85a0 0x563544862470 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.720+0000 7fc237c10800 1 -- 172.21.15.164:0/2573424349 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc118036b40 msgr2=0x7fc118039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.720+0000 7fc237c10800 1 --2- 172.21.15.164:0/2573424349 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc118036b40 0x7fc118039000 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc21c057000 tx=0x7fc21c052000 comp rx=0 tx=0).stop 2024-09-13T23:06:30.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.720+0000 7fc237c10800 1 -- 172.21.15.164:0/2573424349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635446d7490 msgr2=0x56354485b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.720+0000 7fc237c10800 1 --2- 172.21.15.164:0/2573424349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635446d7490 0x56354485b4c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fc22c000f80 tx=0x7fc22c001250 comp rx=0 tx=0).stop 2024-09-13T23:06:30.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.720+0000 7fc237c10800 1 -- 172.21.15.164:0/2573424349 shutdown_connections 2024-09-13T23:06:30.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.720+0000 7fc237c10800 1 --2- 172.21.15.164:0/2573424349 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5635446d85a0 0x563544862470 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.720+0000 7fc237c10800 1 --2- 172.21.15.164:0/2573424349 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc118036b40 0x7fc118039000 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.720+0000 7fc237c10800 1 --2- 172.21.15.164:0/2573424349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635446d7490 0x56354485b4c0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.720+0000 7fc237c10800 1 -- 172.21.15.164:0/2573424349 >> 172.21.15.164:0/2573424349 conn(0x56354475dfe0 msgr2=0x56354484dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:30.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.720+0000 7fc237c10800 1 -- 172.21.15.164:0/2573424349 shutdown_connections 2024-09-13T23:06:30.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.720+0000 7fc237c10800 1 -- 172.21.15.164:0/2573424349 wait complete. 2024-09-13T23:06:30.730 INFO:teuthology.orchestra.run.smithi164.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-09-13T23:06:30.731 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-13T23:06:30.731 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-13T23:06:30.731 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-13T23:06:30.732 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-13T23:06:30.818 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:06:30.818 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:06:30.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.818+0000 7fc7c8139800 1 Processor -- start 2024-09-13T23:06:30.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.818+0000 7fc7c8139800 1 -- start start 2024-09-13T23:06:30.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.819+0000 7fc7c8139800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55756a766760 0x55756a766b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.819+0000 7fc7c8139800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55756a625b30 con 0x55756a7670a0 2024-09-13T23:06:30.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.819+0000 7fc7c8139800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55756a607360 con 0x55756a766760 2024-09-13T23:06:30.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.819+0000 7fc7bb5d0640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55756a7670a0 0x55756a76bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:55914/0 (socket says 172.21.15.164:55914) 2024-09-13T23:06:30.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.819+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/2629620415 learned_addr learned my addr 172.21.15.164:0/2629620415 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:06:30.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.819+0000 7fc7c35d0640 1 -- 172.21.15.164:0/2629620415 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2456501950 0 0) 0x55756a625b30 con 0x55756a7670a0 2024-09-13T23:06:30.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.819+0000 7fc7c35d0640 1 -- 172.21.15.164:0/2629620415 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7b0001e10 con 0x55756a7670a0 2024-09-13T23:06:30.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.819+0000 7fc7c35d0640 1 -- 172.21.15.164:0/2629620415 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2771525339 0 0) 0x7fc7b0001e10 con 0x55756a7670a0 2024-09-13T23:06:30.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.819+0000 7fc7c35d0640 1 -- 172.21.15.164:0/2629620415 >> v2:172.21.15.17:3300/0 conn(0x55756a766760 msgr2=0x55756a766b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T23:06:30.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.819+0000 7fc7c35d0640 1 --2- 172.21.15.164:0/2629620415 >> v2:172.21.15.17:3300/0 conn(0x55756a766760 0x55756a766b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.820+0000 7fc7c35d0640 1 -- 172.21.15.164:0/2629620415 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55756a62de00 con 0x55756a7670a0 2024-09-13T23:06:30.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.820+0000 7fc7c35d0640 1 -- 172.21.15.164:0/2629620415 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 3051827003 0 0) 0x7fc7ac0015a0 con 0x55756a7670a0 2024-09-13T23:06:30.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.820+0000 7fc7c35d0640 1 -- 172.21.15.164:0/2629620415 >> v1:172.21.15.17:6789/0 conn(0x55756a7670a0 legacy=0x55756a76bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.820+0000 7fc7c35d0640 1 --2- 172.21.15.164:0/2629620415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7b00022a0 0x7fc7b00026a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.820+0000 7fc7c35d0640 1 -- 172.21.15.164:0/2629620415 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55756a607360 con 0x7fc7b00022a0 2024-09-13T23:06:30.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.820+0000 7fc7c3dd1640 1 --2- 172.21.15.164:0/2629620415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7b00022a0 0x7fc7b00026a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.820+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/2629620415 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b0001e10 con 0x7fc7b00022a0 2024-09-13T23:06:30.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.822+0000 7fc7c3dd1640 1 --2- 172.21.15.164:0/2629620415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7b00022a0 0x7fc7b00026a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4008580 tx=0x7fc7b4045bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818c58e0c40ee2d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.822+0000 7fc7c35d0640 1 -- 172.21.15.164:0/2629620415 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b4054070 con 0x7fc7b00022a0 2024-09-13T23:06:30.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.822+0000 7fc7c35d0640 1 -- 172.21.15.164:0/2629620415 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b40080d0 con 0x7fc7b00022a0 2024-09-13T23:06:30.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.822+0000 7fc7c35d0640 1 -- 172.21.15.164:0/2629620415 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b4005d70 con 0x7fc7b00022a0 2024-09-13T23:06:30.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.823+0000 7fc7c8139800 1 -- 172.21.15.164:0/2629620415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7b00022a0 msgr2=0x7fc7b00026a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.823+0000 7fc7c8139800 1 --2- 172.21.15.164:0/2629620415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7b00022a0 0x7fc7b00026a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4008580 tx=0x7fc7b4045bd0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.823+0000 7fc7c8139800 1 -- 172.21.15.164:0/2629620415 shutdown_connections 2024-09-13T23:06:30.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.823+0000 7fc7c8139800 1 --2- 172.21.15.164:0/2629620415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7b00022a0 0x7fc7b00026a0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.823+0000 7fc7c8139800 1 --2- 172.21.15.164:0/2629620415 >> v2:172.21.15.17:3300/0 conn(0x55756a766760 0x55756a766b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.823+0000 7fc7c8139800 1 -- 172.21.15.164:0/2629620415 >> 172.21.15.164:0/2629620415 conn(0x55756a761ff0 msgr2=0x55756a764410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:30.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.823+0000 7fc7c8139800 1 -- 172.21.15.164:0/2629620415 shutdown_connections 2024-09-13T23:06:30.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.823+0000 7fc7c8139800 1 -- 172.21.15.164:0/2629620415 wait complete. 2024-09-13T23:06:30.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.837+0000 7fc7c8139800 1 Processor -- start 2024-09-13T23:06:30.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.837+0000 7fc7c8139800 1 -- start start 2024-09-13T23:06:30.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.837+0000 7fc7c8139800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a766760 0x55756a855480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.837+0000 7fc7c8139800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55756a6b2330 con 0x55756a766760 2024-09-13T23:06:30.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.838+0000 7fc7c3dd1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a766760 0x55756a855480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.838+0000 7fc7c3dd1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a766760 0x55756a855480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44546/0 (socket says 172.21.15.164:44546) 2024-09-13T23:06:30.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.838+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1368966568 learned_addr learned my addr 172.21.15.164:0/1368966568 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:30.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.838+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1368966568 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55756a5ffbc0 con 0x55756a766760 2024-09-13T23:06:30.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.838+0000 7fc7c3dd1640 1 --2- 172.21.15.164:0/1368966568 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a766760 0x55756a855480 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4046030 tx=0x7fc7b4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c465124c7d9d2c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.838+0000 7fc6b1e0b640 1 -- 172.21.15.164:0/1368966568 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b4059450 con 0x55756a766760 2024-09-13T23:06:30.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.838+0000 7fc6b1e0b640 1 -- 172.21.15.164:0/1368966568 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b4059610 con 0x55756a766760 2024-09-13T23:06:30.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.838+0000 7fc6b1e0b640 1 -- 172.21.15.164:0/1368966568 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b4059930 con 0x55756a766760 2024-09-13T23:06:30.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.839+0000 7fc7c8139800 1 -- 172.21.15.164:0/1368966568 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a766760 msgr2=0x55756a855480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.839+0000 7fc7c8139800 1 --2- 172.21.15.164:0/1368966568 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a766760 0x55756a855480 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4046030 tx=0x7fc7b4051000 comp rx=0 tx=0).stop 2024-09-13T23:06:30.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.839+0000 7fc7c8139800 1 -- 172.21.15.164:0/1368966568 shutdown_connections 2024-09-13T23:06:30.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.839+0000 7fc7c8139800 1 --2- 172.21.15.164:0/1368966568 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a766760 0x55756a855480 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.839+0000 7fc7c8139800 1 -- 172.21.15.164:0/1368966568 >> 172.21.15.164:0/1368966568 conn(0x55756a761ff0 msgr2=0x55756a850e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:30.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.839+0000 7fc7c8139800 1 -- 172.21.15.164:0/1368966568 shutdown_connections 2024-09-13T23:06:30.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.839+0000 7fc7c8139800 1 -- 172.21.15.164:0/1368966568 wait complete. 2024-09-13T23:06:30.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.839+0000 7fc7c8139800 1 Processor -- start 2024-09-13T23:06:30.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.839+0000 7fc7c8139800 1 -- start start 2024-09-13T23:06:30.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.840+0000 7fc7c8139800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a766760 0x55756a6dc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.840+0000 7fc7c8139800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55756a76d640 con 0x55756a766760 2024-09-13T23:06:30.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.840+0000 7fc7c3dd1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a766760 0x55756a6dc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.840+0000 7fc7c3dd1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a766760 0x55756a6dc6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44558/0 (socket says 172.21.15.164:44558) 2024-09-13T23:06:30.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.840+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1905722010 learned_addr learned my addr 172.21.15.164:0/1905722010 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:30.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.840+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1905722010 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55756a613fe0 con 0x55756a766760 2024-09-13T23:06:30.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.840+0000 7fc7c3dd1640 1 --2- 172.21.15.164:0/1905722010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a766760 0x55756a6dc6c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4008550 tx=0x7fc7b40030c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.841+0000 7fc6abfff640 1 -- 172.21.15.164:0/1905722010 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b406a070 con 0x55756a766760 2024-09-13T23:06:30.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.841+0000 7fc6abfff640 1 -- 172.21.15.164:0/1905722010 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b4059450 con 0x55756a766760 2024-09-13T23:06:30.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.841+0000 7fc7c8139800 1 -- 172.21.15.164:0/1905722010 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55756a6dadb0 con 0x55756a766760 2024-09-13T23:06:30.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.841+0000 7fc6abfff640 1 -- 172.21.15.164:0/1905722010 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b4066580 con 0x55756a766760 2024-09-13T23:06:30.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.841+0000 7fc7c8139800 1 -- 172.21.15.164:0/1905722010 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55756a6db330 con 0x55756a766760 2024-09-13T23:06:30.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.842+0000 7fc6abfff640 1 -- 172.21.15.164:0/1905722010 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc7b406d070 con 0x55756a766760 2024-09-13T23:06:30.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.842+0000 7fc6abfff640 1 --2- 172.21.15.164:0/1905722010 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc6ac036b40 0x7fc6ac039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.842+0000 7fc6abfff640 1 -- 172.21.15.164:0/1905722010 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc7b4060020 con 0x55756a766760 2024-09-13T23:06:30.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.842+0000 7fc7bb5d0640 1 --2- 172.21.15.164:0/1905722010 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc6ac036b40 0x7fc6ac039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.842+0000 7fc7c8139800 1 --2- 172.21.15.164:0/1905722010 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55756a7670a0 0x55756a866130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.842+0000 7fc7c8139800 1 -- 172.21.15.164:0/1905722010 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55756a866670 con 0x55756a7670a0 2024-09-13T23:06:30.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.842+0000 7fc7c45d2640 1 --2- 172.21.15.164:0/1905722010 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55756a7670a0 0x55756a866130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.842+0000 7fc7bb5d0640 1 --2- 172.21.15.164:0/1905722010 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc6ac036b40 0x7fc6ac039000 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00b2d0 tx=0x7fc7ac0013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.842+0000 7fc7c45d2640 1 --2- 172.21.15.164:0/1905722010 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55756a7670a0 0x55756a866130 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.843+0000 7fc7c45d2640 1 -- 172.21.15.164:0/1905722010 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7bc00a4a0 con 0x55756a7670a0 2024-09-13T23:06:30.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.843+0000 7fc7c8139800 1 -- 172.21.15.164:0/1905722010 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55756a866ec0 con 0x55756a7670a0 2024-09-13T23:06:30.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.843+0000 7fc7c45d2640 1 -- 172.21.15.164:0/1905722010 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc7bc00a4a0 con 0x55756a7670a0 2024-09-13T23:06:30.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.843+0000 7fc7c8139800 1 -- 172.21.15.164:0/1905722010 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55756a868270 con 0x55756a7670a0 2024-09-13T23:06:30.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.843+0000 7fc7c45d2640 1 -- 172.21.15.164:0/1905722010 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc7bc00a4a0 con 0x55756a7670a0 2024-09-13T23:06:30.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.843+0000 7fc7c8139800 1 -- 172.21.15.164:0/1905722010 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55756a867710 con 0x55756a7670a0 2024-09-13T23:06:30.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.843+0000 7fc7c45d2640 1 -- 172.21.15.164:0/1905722010 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc7bc00a4a0 con 0x55756a7670a0 2024-09-13T23:06:30.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.843+0000 7fc7c8139800 1 -- 172.21.15.164:0/1905722010 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55756a867b60 con 0x55756a7670a0 2024-09-13T23:06:30.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.844+0000 7fc7c45d2640 1 -- 172.21.15.164:0/1905722010 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc7bc00a4a0 con 0x55756a7670a0 2024-09-13T23:06:30.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.844+0000 7fc7c8139800 1 Processor -- start 2024-09-13T23:06:30.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.844+0000 7fc7c8139800 1 -- start start 2024-09-13T23:06:30.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.844+0000 7fc7c8139800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a876700 0x55756a876b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.844+0000 7fc7c8139800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55756a6dcc00 con 0x55756a876700 2024-09-13T23:06:30.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.845+0000 7fc7bb5d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a876700 0x55756a876b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.845+0000 7fc7bb5d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a876700 0x55756a876b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44566/0 (socket says 172.21.15.164:44566) 2024-09-13T23:06:30.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.845+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/4013659166 learned_addr learned my addr 172.21.15.164:0/4013659166 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:30.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.845+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/4013659166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55756a877060 con 0x55756a876700 2024-09-13T23:06:30.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.845+0000 7fc7bb5d0640 1 --2- 172.21.15.164:0/4013659166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a876700 0x55756a876b20 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00e640 tx=0x7fc7ac00ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.845+0000 7fc6a97fa640 1 -- 172.21.15.164:0/4013659166 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7ac022070 con 0x55756a876700 2024-09-13T23:06:30.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.846+0000 7fc6a97fa640 1 -- 172.21.15.164:0/4013659166 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7ac009050 con 0x55756a876700 2024-09-13T23:06:30.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.846+0000 7fc6a97fa640 1 -- 172.21.15.164:0/4013659166 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7ac00d6f0 con 0x55756a876700 2024-09-13T23:06:30.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.846+0000 7fc7c8139800 1 -- 172.21.15.164:0/4013659166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55756a8772f0 con 0x55756a876700 2024-09-13T23:06:30.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.846+0000 7fc7c8139800 1 -- 172.21.15.164:0/4013659166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55756a879fd0 con 0x55756a876700 2024-09-13T23:06:30.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.846+0000 7fc6a97fa640 1 -- 172.21.15.164:0/4013659166 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc7ac025070 con 0x55756a876700 2024-09-13T23:06:30.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.847+0000 7fc6a97fa640 1 --2- 172.21.15.164:0/4013659166 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc69c036b90 0x7fc69c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.847+0000 7fc6a97fa640 1 -- 172.21.15.164:0/4013659166 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc7ac04e0c0 con 0x55756a876700 2024-09-13T23:06:30.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.847+0000 7fc7c45d2640 1 --2- 172.21.15.164:0/4013659166 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc69c036b90 0x7fc69c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.847+0000 7fc7c8139800 1 Processor -- start 2024-09-13T23:06:30.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.847+0000 7fc7c45d2640 1 --2- 172.21.15.164:0/4013659166 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc69c036b90 0x7fc69c039050 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55756a866da0 tx=0x7fc7bc005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.847+0000 7fc7c8139800 1 -- start start 2024-09-13T23:06:30.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.847+0000 7fc7c8139800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a883360 0x55756a883760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.847+0000 7fc7c8139800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55756a601580 con 0x55756a883360 2024-09-13T23:06:30.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.847+0000 7fc7bb5d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a883360 0x55756a883760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.847+0000 7fc7bb5d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a883360 0x55756a883760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44570/0 (socket says 172.21.15.164:44570) 2024-09-13T23:06:30.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.847+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/513709210 learned_addr learned my addr 172.21.15.164:0/513709210 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:30.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.848+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/513709210 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55756a883d30 con 0x55756a883360 2024-09-13T23:06:30.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.848+0000 7fc7bb5d0640 1 --2- 172.21.15.164:0/513709210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a883360 0x55756a883760 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac04c380 tx=0x7fc7ac04c620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f08bf2d9273d6e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.848+0000 7fc6a2ffd640 1 -- 172.21.15.164:0/513709210 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7ac025a00 con 0x55756a883360 2024-09-13T23:06:30.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.848+0000 7fc6a2ffd640 1 -- 172.21.15.164:0/513709210 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7ac025ba0 con 0x55756a883360 2024-09-13T23:06:30.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.848+0000 7fc6a2ffd640 1 -- 172.21.15.164:0/513709210 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7ac025dd0 con 0x55756a883360 2024-09-13T23:06:30.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.848+0000 7fc7c8139800 1 -- 172.21.15.164:0/513709210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a883360 msgr2=0x55756a883760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.848+0000 7fc7c8139800 1 --2- 172.21.15.164:0/513709210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a883360 0x55756a883760 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac04c380 tx=0x7fc7ac04c620 comp rx=0 tx=0).stop 2024-09-13T23:06:30.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.848+0000 7fc7c8139800 1 -- 172.21.15.164:0/513709210 shutdown_connections 2024-09-13T23:06:30.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.848+0000 7fc7c8139800 1 --2- 172.21.15.164:0/513709210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a883360 0x55756a883760 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.848+0000 7fc7c8139800 1 -- 172.21.15.164:0/513709210 >> 172.21.15.164:0/513709210 conn(0x55756a87f6c0 msgr2=0x55756a87d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:30.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.848+0000 7fc7c8139800 1 -- 172.21.15.164:0/513709210 shutdown_connections 2024-09-13T23:06:30.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.848+0000 7fc7c8139800 1 -- 172.21.15.164:0/513709210 wait complete. 2024-09-13T23:06:30.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.849+0000 7fc7c8139800 1 Processor -- start 2024-09-13T23:06:30.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.849+0000 7fc7c8139800 1 -- start start 2024-09-13T23:06:30.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.849+0000 7fc7c8139800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a883360 0x55756a88a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.849+0000 7fc7c8139800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55756a884220 con 0x55756a883360 2024-09-13T23:06:30.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.849+0000 7fc7bb5d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a883360 0x55756a88a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.849+0000 7fc7bb5d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a883360 0x55756a88a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44586/0 (socket says 172.21.15.164:44586) 2024-09-13T23:06:30.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.849+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/1198578221 learned_addr learned my addr 172.21.15.164:0/1198578221 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:30.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.850+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55756a88ac10 con 0x55756a883360 2024-09-13T23:06:30.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.850+0000 7fc7bb5d0640 1 --2- 172.21.15.164:0/1198578221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a883360 0x55756a88a6d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac024fd0 tx=0x7fc7ac04c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.850+0000 7fc6a17fa640 1 -- 172.21.15.164:0/1198578221 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7ac025a00 con 0x55756a883360 2024-09-13T23:06:30.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.850+0000 7fc6a17fa640 1 -- 172.21.15.164:0/1198578221 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7ac03a070 con 0x55756a883360 2024-09-13T23:06:30.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.850+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55756a88aea0 con 0x55756a883360 2024-09-13T23:06:30.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.850+0000 7fc6a17fa640 1 -- 172.21.15.164:0/1198578221 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7ac025570 con 0x55756a883360 2024-09-13T23:06:30.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.850+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55756a88aea0 con 0x55756a883360 2024-09-13T23:06:30.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.851+0000 7fc6a17fa640 1 -- 172.21.15.164:0/1198578221 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc7ac034070 con 0x55756a883360 2024-09-13T23:06:30.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.851+0000 7fc6a17fa640 1 --2- 172.21.15.164:0/1198578221 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc68c036b40 0x7fc68c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.851+0000 7fc6a17fa640 1 -- 172.21.15.164:0/1198578221 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc7ac046070 con 0x55756a883360 2024-09-13T23:06:30.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.851+0000 7fc7c45d2640 1 --2- 172.21.15.164:0/1198578221 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc68c036b40 0x7fc68c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.851+0000 7fc7c8139800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.851+0000 7fc7c8139800 1 --2- 172.21.15.164:0/1198578221 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55756a895fa0 0x55756a898460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.851+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55756a898bb0 con 0x55756a895fa0 2024-09-13T23:06:30.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.852+0000 7fc7c3dd1640 1 --2- 172.21.15.164:0/1198578221 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55756a895fa0 0x55756a898460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.852+0000 7fc7c45d2640 1 --2- 172.21.15.164:0/1198578221 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc68c036b40 0x7fc68c039000 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x55756a6db750 tx=0x7fc7bc01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.852+0000 7fc7c3dd1640 1 --2- 172.21.15.164:0/1198578221 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55756a895fa0 0x55756a898460 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.852+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7b4076070 con 0x55756a895fa0 2024-09-13T23:06:30.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.852+0000 7fc7c8139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:30.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.852+0000 7fc7c8139800 20 realm 2024-09-13T23:06:30.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.852+0000 7fc7c8139800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.852+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55756a898fc0 con 0x55756a895fa0 2024-09-13T23:06:30.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.852+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7b4076070 con 0x55756a895fa0 2024-09-13T23:06:30.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.852+0000 7fc7c8139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:30.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.852+0000 7fc7c8139800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:06:30.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.852+0000 7fc7c8139800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.852+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55756a899890 con 0x55756a895fa0 2024-09-13T23:06:30.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.852+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7b4076070 con 0x55756a895fa0 2024-09-13T23:06:30.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.853+0000 7fc7c8139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:30.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.853+0000 7fc7c8139800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.853+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55756a899c30 con 0x55756a895fa0 2024-09-13T23:06:30.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.853+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc7b4076070 con 0x55756a895fa0 2024-09-13T23:06:30.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.853+0000 7fc7c8139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:06:30.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.853+0000 7fc7c8139800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.853+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55756a89a0d0 con 0x55756a895fa0 2024-09-13T23:06:30.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.853+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc7b4076070 con 0x55756a895fa0 2024-09-13T23:06:30.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.853+0000 7fc7c8139800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:06:30.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.853+0000 7fc7c8139800 20 searching for the correct realm 2024-09-13T23:06:30.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.853+0000 7fc7c8139800 1 --2- 172.21.15.164:0/1198578221 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55756a89c0d0 0x55756a89e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.853+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55756a89ebb0 con 0x55756a89c0d0 2024-09-13T23:06:30.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.853+0000 7fc7bb5d0640 1 --2- 172.21.15.164:0/1198578221 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55756a89c0d0 0x55756a89e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.854+0000 7fc7bb5d0640 1 --2- 172.21.15.164:0/1198578221 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55756a89c0d0 0x55756a89e4e0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.854+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/1198578221 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ac024030 con 0x55756a89c0d0 2024-09-13T23:06:30.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.854+0000 7fc7bb5d0640 1 --2- 172.21.15.164:0/1198578221 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc7ac01ac20 0x7fc7ac027660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.854+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55756a89ebb0 con 0x7fc7ac01ac20 2024-09-13T23:06:30.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.854+0000 7fc7c45d2640 1 --2- 172.21.15.164:0/1198578221 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc7ac01ac20 0x7fc7ac027660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.854+0000 7fc7c45d2640 1 --2- 172.21.15.164:0/1198578221 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc7ac01ac20 0x7fc7ac027660 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.854+0000 7fc7c45d2640 1 -- 172.21.15.164:0/1198578221 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7bc01f070 con 0x7fc7ac01ac20 2024-09-13T23:06:30.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.854+0000 7fc7c45d2640 1 --2- 172.21.15.164:0/1198578221 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc7bc031040 0x7fc7bc032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.854+0000 7fc7c45d2640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55756a89ebb0 con 0x7fc7bc031040 2024-09-13T23:06:30.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.855+0000 7fc7c3dd1640 1 --2- 172.21.15.164:0/1198578221 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc7bc031040 0x7fc7bc032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.855+0000 7fc7c3dd1640 1 --2- 172.21.15.164:0/1198578221 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc7bc031040 0x7fc7bc032940 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.855+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b4076070 con 0x7fc7bc031040 2024-09-13T23:06:30.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.855+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55756a89ebb0 con 0x55756a895fa0 2024-09-13T23:06:30.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.856+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc7b4076070 con 0x55756a895fa0 2024-09-13T23:06:30.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.856+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55756a89ebb0 con 0x55756a895fa0 2024-09-13T23:06:30.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.856+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b4076070 con 0x55756a895fa0 2024-09-13T23:06:30.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.856+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55756a89ebb0 con 0x7fc7bc031040 2024-09-13T23:06:30.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.856+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b4076070 con 0x7fc7bc031040 2024-09-13T23:06:30.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.856+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55756a89ebb0 con 0x7fc7bc031040 2024-09-13T23:06:30.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.856+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b4076070 con 0x7fc7bc031040 2024-09-13T23:06:30.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.856+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55756a89ebb0 con 0x7fc7ac01ac20 2024-09-13T23:06:30.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.857+0000 7fc7c45d2640 1 -- 172.21.15.164:0/1198578221 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7bc01f070 con 0x7fc7ac01ac20 2024-09-13T23:06:30.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.857+0000 7fc7c45d2640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55756a89ebb0 con 0x55756a89c0d0 2024-09-13T23:06:30.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.857+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/1198578221 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ac024030 con 0x55756a89c0d0 2024-09-13T23:06:30.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.857+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55756a89ebb0 con 0x55756a895fa0 2024-09-13T23:06:30.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.857+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b4076070 con 0x55756a895fa0 2024-09-13T23:06:30.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.857+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55756a89ebb0 con 0x7fc7bc031040 2024-09-13T23:06:30.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.858+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b4076070 con 0x7fc7bc031040 2024-09-13T23:06:30.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.858+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55756a89ebb0 con 0x55756a895fa0 2024-09-13T23:06:30.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.858+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b4076070 con 0x55756a895fa0 2024-09-13T23:06:30.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.858+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55756a89ebb0 con 0x7fc7ac01ac20 2024-09-13T23:06:30.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.858+0000 7fc7c45d2640 1 -- 172.21.15.164:0/1198578221 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc7bc01f070 con 0x7fc7ac01ac20 2024-09-13T23:06:30.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.858+0000 7fc7c45d2640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55756a89ebb0 con 0x55756a89c0d0 2024-09-13T23:06:30.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.858+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/1198578221 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ac024030 con 0x55756a89c0d0 2024-09-13T23:06:30.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.858+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55756a89ebb0 con 0x55756a89c0d0 2024-09-13T23:06:30.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.858+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/1198578221 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ac024030 con 0x55756a89c0d0 2024-09-13T23:06:30.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.858+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55756a89ebb0 con 0x7fc7bc031040 2024-09-13T23:06:30.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.859+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b4076070 con 0x7fc7bc031040 2024-09-13T23:06:30.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.859+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55756a89ebb0 con 0x55756a89c0d0 2024-09-13T23:06:30.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.859+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/1198578221 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ac024030 con 0x55756a89c0d0 2024-09-13T23:06:30.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.859+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55756a89ebb0 con 0x55756a89c0d0 2024-09-13T23:06:30.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.859+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/1198578221 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ac024030 con 0x55756a89c0d0 2024-09-13T23:06:30.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.859+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55756a89ebb0 con 0x55756a895fa0 2024-09-13T23:06:30.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.859+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b4076070 con 0x55756a895fa0 2024-09-13T23:06:30.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.859+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55756a89ebb0 con 0x55756a895fa0 2024-09-13T23:06:30.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.860+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc7b4076070 con 0x55756a895fa0 2024-09-13T23:06:30.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.860+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55756a89ebb0 con 0x7fc7bc031040 2024-09-13T23:06:30.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.860+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b4076070 con 0x7fc7bc031040 2024-09-13T23:06:30.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.860+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b4098040 con 0x55756a89c0d0 2024-09-13T23:06:30.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.860+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/1198578221 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ac024030 con 0x55756a89c0d0 2024-09-13T23:06:30.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.860+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b4098040 con 0x7fc7ac01ac20 2024-09-13T23:06:30.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.860+0000 7fc7c45d2640 1 -- 172.21.15.164:0/1198578221 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7bc01f070 con 0x7fc7ac01ac20 2024-09-13T23:06:30.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.861+0000 7fc7c45d2640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b4098040 con 0x55756a895fa0 2024-09-13T23:06:30.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.861+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc7b4076070 con 0x55756a895fa0 2024-09-13T23:06:30.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.861+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b4098040 con 0x7fc7bc031040 2024-09-13T23:06:30.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.861+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b4076070 con 0x7fc7bc031040 2024-09-13T23:06:30.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.861+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b4098040 con 0x55756a89c0d0 2024-09-13T23:06:30.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.861+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/1198578221 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ac024030 con 0x55756a89c0d0 2024-09-13T23:06:30.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.861+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b4098040 con 0x7fc7bc031040 2024-09-13T23:06:30.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.862+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b4076070 con 0x7fc7bc031040 2024-09-13T23:06:30.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.862+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b4098040 con 0x7fc7ac01ac20 2024-09-13T23:06:30.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.862+0000 7fc7c45d2640 1 -- 172.21.15.164:0/1198578221 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7bc01f070 con 0x7fc7ac01ac20 2024-09-13T23:06:30.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.862+0000 7fc7c45d2640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b4098040 con 0x55756a89c0d0 2024-09-13T23:06:30.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.862+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/1198578221 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ac024030 con 0x55756a89c0d0 2024-09-13T23:06:30.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.862+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b4098040 con 0x7fc7ac01ac20 2024-09-13T23:06:30.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.862+0000 7fc7c45d2640 1 -- 172.21.15.164:0/1198578221 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7bc01f070 con 0x7fc7ac01ac20 2024-09-13T23:06:30.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.862+0000 7fc7c45d2640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b4098040 con 0x55756a895fa0 2024-09-13T23:06:30.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.863+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc7b4076070 con 0x55756a895fa0 2024-09-13T23:06:30.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.863+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b4098040 con 0x7fc7ac01ac20 2024-09-13T23:06:30.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.863+0000 7fc7c45d2640 1 -- 172.21.15.164:0/1198578221 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7bc040040 con 0x7fc7ac01ac20 2024-09-13T23:06:30.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.863+0000 7fc7c8139800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:06:30.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.863+0000 7fc7c8139800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:06:30.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.863+0000 7fc7c8139800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:06:30.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.863+0000 7fc7c8139800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:06:30.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.863+0000 7fc7c8139800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:06:30.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.863+0000 7fc7c8139800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:06:30.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.863+0000 7fc7c8139800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.863+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55756a89aba0 con 0x55756a895fa0 2024-09-13T23:06:30.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.863+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7b4076070 con 0x55756a895fa0 2024-09-13T23:06:30.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.863+0000 7fc7c8139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:30.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.863+0000 7fc7c8139800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.863+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55756a89b440 con 0x55756a895fa0 2024-09-13T23:06:30.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.863+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc7b4076070 con 0x55756a895fa0 2024-09-13T23:06:30.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.863+0000 7fc7c8139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:06:30.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.863+0000 7fc7c8139800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.863+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55756a89a7e0 con 0x55756a895fa0 2024-09-13T23:06:30.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.864+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc7b4076070 con 0x55756a895fa0 2024-09-13T23:06:30.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.864+0000 7fc7c8139800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:06:30.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.864+0000 7fc7c8139800 20 zone default found 2024-09-13T23:06:30.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.864+0000 7fc7c8139800 4 Realm: () 2024-09-13T23:06:30.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.864+0000 7fc7c8139800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:06:30.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.864+0000 7fc7c8139800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:06:30.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.864+0000 7fc7c8139800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:06:30.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.864+0000 7fc7c8139800 20 zonegroup default 2024-09-13T23:06:30.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.864+0000 7fc7c8139800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.864+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55756a89b440 con 0x7fc7bc031040 2024-09-13T23:06:30.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.864+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc7b4076070 con 0x7fc7bc031040 2024-09-13T23:06:30.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.864+0000 7fc7c8139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:30.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.864+0000 7fc7c8139800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.864+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55756a8a0a10 con 0x55756a89c0d0 2024-09-13T23:06:30.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.864+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/1198578221 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7ac024030 con 0x55756a89c0d0 2024-09-13T23:06:30.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.864+0000 7fc7c8139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:30.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.864+0000 7fc7c8139800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.864+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55756a8a0db0 con 0x55756a89c0d0 2024-09-13T23:06:30.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.864+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/1198578221 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7ac024030 con 0x55756a89c0d0 2024-09-13T23:06:30.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.864+0000 7fc7c8139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:30.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.864+0000 7fc7c8139800 20 started sync module instance, tier type = 2024-09-13T23:06:30.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.865+0000 7fc7c8139800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:06:30.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.865+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55756a89feb0 con 0x7fc7ac01ac20 2024-09-13T23:06:30.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.865+0000 7fc7c45d2640 1 -- 172.21.15.164:0/1198578221 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7bc040040 con 0x7fc7ac01ac20 2024-09-13T23:06:30.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.866+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93962786964128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55756a8a16a0 con 0x7fc7ac01ac20 2024-09-13T23:06:30.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.866+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55756a8a1ef0 con 0x55756a895fa0 2024-09-13T23:06:30.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.867+0000 7fc7c45d2640 1 -- 172.21.15.164:0/1198578221 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93962786964128] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7bc040040 con 0x7fc7ac01ac20 2024-09-13T23:06:30.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.867+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b4076070 con 0x55756a895fa0 2024-09-13T23:06:30.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.867+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93962786968048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55756a8a1c20 con 0x55756a895fa0 2024-09-13T23:06:30.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.867+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55756a8a2740 con 0x55756a89c0d0 2024-09-13T23:06:30.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.868+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/1198578221 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ac024030 con 0x55756a89c0d0 2024-09-13T23:06:30.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.868+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93962786972176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55756a8a2fe0 con 0x55756a89c0d0 2024-09-13T23:06:30.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.868+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55756a8a3ad0 con 0x7fc7ac01ac20 2024-09-13T23:06:30.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.868+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93962786968048] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b4076070 con 0x55756a895fa0 2024-09-13T23:06:30.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.869+0000 7fc7c45d2640 1 -- 172.21.15.164:0/1198578221 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7bc040040 con 0x7fc7ac01ac20 2024-09-13T23:06:30.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.869+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93962786977184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55756a8a3ec0 con 0x7fc7ac01ac20 2024-09-13T23:06:30.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.869+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55756a8a48f0 con 0x55756a895fa0 2024-09-13T23:06:30.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.869+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/1198578221 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93962786972176] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ac024030 con 0x55756a89c0d0 2024-09-13T23:06:30.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.870+0000 7fc7c45d2640 1 -- 172.21.15.164:0/1198578221 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93962786977184] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7bc040040 con 0x7fc7ac01ac20 2024-09-13T23:06:30.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.871+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b4076070 con 0x55756a895fa0 2024-09-13T23:06:30.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.871+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93962786969200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55756a8a48f0 con 0x55756a895fa0 2024-09-13T23:06:30.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.871+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55756a8a51c0 con 0x7fc7bc031040 2024-09-13T23:06:30.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.872+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93962786969200] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b4076070 con 0x55756a895fa0 2024-09-13T23:06:30.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.872+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b4076070 con 0x7fc7bc031040 2024-09-13T23:06:30.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.872+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93962786980864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55756a8a4da0 con 0x7fc7bc031040 2024-09-13T23:06:30.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.872+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55756a8a5800 con 0x7fc7bc031040 2024-09-13T23:06:30.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.873+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93962786980864] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b4076070 con 0x7fc7bc031040 2024-09-13T23:06:30.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.873+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b4076070 con 0x7fc7bc031040 2024-09-13T23:06:30.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.873+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93962786984672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55756a8a59e0 con 0x7fc7bc031040 2024-09-13T23:06:30.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.873+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55756a8a6230 con 0x7fc7bc031040 2024-09-13T23:06:30.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.874+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(58 notify.7 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b4076070 con 0x7fc7bc031040 2024-09-13T23:06:30.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.874+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93962786984672] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b4076070 con 0x7fc7bc031040 2024-09-13T23:06:30.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.874+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93962786986944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55756a8a6610 con 0x7fc7bc031040 2024-09-13T23:06:30.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.874+0000 7fc7c8139800 20 add_watcher() i=0 2024-09-13T23:06:30.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.874+0000 7fc7c8139800 20 add_watcher() i=1 2024-09-13T23:06:30.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.874+0000 7fc7c8139800 20 add_watcher() i=2 2024-09-13T23:06:30.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.874+0000 7fc7c8139800 20 add_watcher() i=3 2024-09-13T23:06:30.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.874+0000 7fc7c8139800 20 add_watcher() i=4 2024-09-13T23:06:30.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.874+0000 7fc7c8139800 20 add_watcher() i=5 2024-09-13T23:06:30.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.874+0000 7fc7c8139800 20 add_watcher() i=6 2024-09-13T23:06:30.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.875+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93962786986944] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b4076070 con 0x7fc7bc031040 2024-09-13T23:06:30.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.875+0000 7fc7c8139800 20 add_watcher() i=7 2024-09-13T23:06:30.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.875+0000 7fc7c8139800 2 all 8 watchers are set, enabling cache 2024-09-13T23:06:30.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.875+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55756a8a49e0 con 0x55756a895fa0 2024-09-13T23:06:30.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.876+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc7b4076070 con 0x55756a895fa0 2024-09-13T23:06:30.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.876+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93962786982368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55756a8a61f0 con 0x55756a895fa0 2024-09-13T23:06:30.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.877+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93962786982368] v34'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc7b4076070 con 0x55756a895fa0 2024-09-13T23:06:30.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.877+0000 7fc679fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:06:30.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.877+0000 7fc7c8139800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:06:30.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.877+0000 7fc7c8139800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:06:30.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.877+0000 7fc7c8139800 5 note: GC not initialized 2024-09-13T23:06:30.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.877+0000 7fc678fe1640 20 reqs_thread_entry: start 2024-09-13T23:06:30.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.877+0000 7fc7c8139800 20 init_complete bucket index max shards: 11 2024-09-13T23:06:30.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.877+0000 7fc7c8139800 20 Filter name: none 2024-09-13T23:06:30.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.877+0000 7fc5f27fc640 20 reqs_thread_entry: start 2024-09-13T23:06:30.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.877+0000 7fc7c8139800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.877+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55756a8dc440 con 0x55756a895fa0 2024-09-13T23:06:30.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.878+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc7b4076070 con 0x55756a895fa0 2024-09-13T23:06:30.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.878+0000 7fc7c8139800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:06:30.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.878+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55756a8dd990 con 0x7fc7bc031040 2024-09-13T23:06:30.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.878+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fc7b4076070 con 0x7fc7bc031040 2024-09-13T23:06:30.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.879+0000 7fc679fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:06:30.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.879+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93962786982368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55756a8a6f30 con 0x55756a895fa0 2024-09-13T23:06:30.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.880+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93962786982368] v34'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc7b4076070 con 0x55756a895fa0 2024-09-13T23:06:30.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.880+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93962786964128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55756a8a49e0 con 0x7fc7ac01ac20 2024-09-13T23:06:30.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.881+0000 7fc7c45d2640 1 -- 172.21.15.164:0/1198578221 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93962786964128] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7bc040040 con 0x7fc7ac01ac20 2024-09-13T23:06:30.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.881+0000 7fc7c8139800 20 remove_watcher() i=0 2024-09-13T23:06:30.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.881+0000 7fc7c8139800 2 removed watcher, disabling cache 2024-09-13T23:06:30.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.881+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93962786968048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55756a8a49e0 con 0x55756a895fa0 2024-09-13T23:06:30.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.882+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93962786968048] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b4076070 con 0x55756a895fa0 2024-09-13T23:06:30.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.882+0000 7fc7c8139800 20 remove_watcher() i=1 2024-09-13T23:06:30.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.882+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93962786972176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55756a8a11f0 con 0x55756a89c0d0 2024-09-13T23:06:30.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.883+0000 7fc7bb5d0640 1 -- 172.21.15.164:0/1198578221 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93962786972176] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ac024030 con 0x55756a89c0d0 2024-09-13T23:06:30.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.883+0000 7fc7c8139800 20 remove_watcher() i=2 2024-09-13T23:06:30.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.883+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93962786977184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55756a8a49e0 con 0x7fc7ac01ac20 2024-09-13T23:06:30.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.884+0000 7fc7c45d2640 1 -- 172.21.15.164:0/1198578221 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93962786977184] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7bc040040 con 0x7fc7ac01ac20 2024-09-13T23:06:30.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.884+0000 7fc7c8139800 20 remove_watcher() i=3 2024-09-13T23:06:30.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.884+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93962786969200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55756a8a35a0 con 0x55756a895fa0 2024-09-13T23:06:30.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.885+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93962786969200] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b4076070 con 0x55756a895fa0 2024-09-13T23:06:30.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.885+0000 7fc7c8139800 20 remove_watcher() i=4 2024-09-13T23:06:30.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.885+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93962786980864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55756a8a49e0 con 0x7fc7bc031040 2024-09-13T23:06:30.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.886+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93962786980864] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b4076070 con 0x7fc7bc031040 2024-09-13T23:06:30.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.886+0000 7fc7c8139800 20 remove_watcher() i=5 2024-09-13T23:06:30.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.886+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93962786984672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55756a8a35a0 con 0x7fc7bc031040 2024-09-13T23:06:30.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.887+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93962786984672] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b4076070 con 0x7fc7bc031040 2024-09-13T23:06:30.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.887+0000 7fc7c8139800 20 remove_watcher() i=6 2024-09-13T23:06:30.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.887+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93962786986944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55756a8a35a0 con 0x7fc7bc031040 2024-09-13T23:06:30.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.888+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93962786986944] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b4076070 con 0x7fc7bc031040 2024-09-13T23:06:30.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.888+0000 7fc7c8139800 20 remove_watcher() i=7 2024-09-13T23:06:30.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.889+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc7bc031040 msgr2=0x7fc7bc032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.889+0000 7fc7c8139800 1 --2- 172.21.15.164:0/1198578221 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc7bc031040 0x7fc7bc032940 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.889+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55756a895fa0 msgr2=0x55756a898460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.889+0000 7fc7c8139800 1 --2- 172.21.15.164:0/1198578221 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55756a895fa0 0x55756a898460 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.889+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc7ac01ac20 msgr2=0x7fc7ac027660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.889+0000 7fc7c8139800 1 --2- 172.21.15.164:0/1198578221 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc7ac01ac20 0x7fc7ac027660 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.889+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55756a89c0d0 msgr2=0x55756a89e4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.889+0000 7fc7c8139800 1 --2- 172.21.15.164:0/1198578221 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55756a89c0d0 0x55756a89e4e0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.889+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc68c036b40 msgr2=0x7fc68c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.889+0000 7fc7c8139800 1 --2- 172.21.15.164:0/1198578221 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc68c036b40 0x7fc68c039000 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x55756a6db750 tx=0x7fc7bc01f000 comp rx=0 tx=0).stop 2024-09-13T23:06:30.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.889+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a883360 msgr2=0x55756a88a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.889+0000 7fc7c8139800 1 --2- 172.21.15.164:0/1198578221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a883360 0x55756a88a6d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac024fd0 tx=0x7fc7ac04c2e0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.889+0000 7fc7c3dd1640 1 -- 172.21.15.164:0/1198578221 reap_dead start 2024-09-13T23:06:30.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.889+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 shutdown_connections 2024-09-13T23:06:30.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.889+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 >> 172.21.15.164:0/1198578221 conn(0x55756a87f6c0 msgr2=0x55756a87d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:30.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.889+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 shutdown_connections 2024-09-13T23:06:30.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.889+0000 7fc7c8139800 1 -- 172.21.15.164:0/1198578221 wait complete. 2024-09-13T23:06:30.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.889+0000 7fc7c8139800 1 -- 172.21.15.164:0/4013659166 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc69c036b90 msgr2=0x7fc69c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.889+0000 7fc7c8139800 1 --2- 172.21.15.164:0/4013659166 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc69c036b90 0x7fc69c039050 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55756a866da0 tx=0x7fc7bc005840 comp rx=0 tx=0).stop 2024-09-13T23:06:30.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.889+0000 7fc7c8139800 1 -- 172.21.15.164:0/4013659166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a876700 msgr2=0x55756a876b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.889+0000 7fc7c8139800 1 --2- 172.21.15.164:0/4013659166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a876700 0x55756a876b20 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00e640 tx=0x7fc7ac00ea40 comp rx=0 tx=0).stop 2024-09-13T23:06:30.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.889+0000 7fc7c8139800 1 -- 172.21.15.164:0/4013659166 shutdown_connections 2024-09-13T23:06:30.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.889+0000 7fc7c8139800 1 --2- 172.21.15.164:0/4013659166 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc69c036b90 0x7fc69c039050 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.889+0000 7fc7c8139800 1 --2- 172.21.15.164:0/4013659166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a876700 0x55756a876b20 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.889+0000 7fc7c8139800 1 -- 172.21.15.164:0/4013659166 >> 172.21.15.164:0/4013659166 conn(0x7fc7b00022a0 msgr2=0x55756a86e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:30.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.889+0000 7fc7c8139800 1 -- 172.21.15.164:0/4013659166 shutdown_connections 2024-09-13T23:06:30.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.889+0000 7fc7c8139800 1 -- 172.21.15.164:0/4013659166 wait complete. 2024-09-13T23:06:30.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.890+0000 7fc7c8139800 1 -- 172.21.15.164:0/1905722010 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55756a7670a0 msgr2=0x55756a866130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.890+0000 7fc7c8139800 1 --2- 172.21.15.164:0/1905722010 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55756a7670a0 0x55756a866130 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.890+0000 7fc7c8139800 1 -- 172.21.15.164:0/1905722010 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc6ac036b40 msgr2=0x7fc6ac039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.890+0000 7fc7c8139800 1 --2- 172.21.15.164:0/1905722010 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc6ac036b40 0x7fc6ac039000 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00b2d0 tx=0x7fc7ac0013b0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.890+0000 7fc7c8139800 1 -- 172.21.15.164:0/1905722010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a766760 msgr2=0x55756a6dc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.890+0000 7fc7c8139800 1 --2- 172.21.15.164:0/1905722010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a766760 0x55756a6dc6c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4008550 tx=0x7fc7b40030c0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.890+0000 7fc7c8139800 1 -- 172.21.15.164:0/1905722010 shutdown_connections 2024-09-13T23:06:30.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.890+0000 7fc7c8139800 1 --2- 172.21.15.164:0/1905722010 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55756a7670a0 0x55756a866130 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.890+0000 7fc7c8139800 1 --2- 172.21.15.164:0/1905722010 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc6ac036b40 0x7fc6ac039000 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.890+0000 7fc7c8139800 1 --2- 172.21.15.164:0/1905722010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55756a766760 0x55756a6dc6c0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.890+0000 7fc7c8139800 1 -- 172.21.15.164:0/1905722010 >> 172.21.15.164:0/1905722010 conn(0x55756a761ff0 msgr2=0x55756a84f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:30.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.890+0000 7fc7c8139800 1 -- 172.21.15.164:0/1905722010 shutdown_connections 2024-09-13T23:06:30.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.890+0000 7fc7c8139800 1 -- 172.21.15.164:0/1905722010 wait complete. 2024-09-13T23:06:30.909 INFO:teuthology.orchestra.run.smithi164.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-09-13T23:06:30.909 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-13T23:06:30.910 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-13T23:06:30.910 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-13T23:06:30.910 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-13T23:06:30.956 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:06:30.956 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:06:30.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.956+0000 7f1ebba0f800 1 Processor -- start 2024-09-13T23:06:30.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.956+0000 7f1ebba0f800 1 -- start start 2024-09-13T23:06:30.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.956+0000 7f1ebba0f800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5639f611e5f0 0x5639f61af640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.956+0000 7f1ebba0f800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5639f6069b30 con 0x5639f61afb80 2024-09-13T23:06:30.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.956+0000 7f1ebba0f800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x5639f604b360 con 0x5639f611e5f0 2024-09-13T23:06:30.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.957+0000 7f1eb7067640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5639f611e5f0 0x5639f61af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.957+0000 7f1eb7067640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5639f611e5f0 0x5639f61af640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44590/0 (socket says 172.21.15.164:44590) 2024-09-13T23:06:30.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.957+0000 7f1eb7067640 1 -- 172.21.15.164:0/1566276025 learned_addr learned my addr 172.21.15.164:0/1566276025 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:30.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.957+0000 7f1eae866640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x5639f61afb80 0x5639f61b1f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:55920/0 (socket says 172.21.15.164:55920) 2024-09-13T23:06:30.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.957+0000 7f1eb7067640 1 -- 172.21.15.164:0/1566276025 >> v1:172.21.15.17:6789/0 conn(0x5639f61afb80 legacy=0x5639f61b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.957+0000 7f1eb7067640 1 -- 172.21.15.164:0/1566276025 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639f6071e00 con 0x5639f611e5f0 2024-09-13T23:06:30.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.959+0000 7f1eb7067640 1 --2- 172.21.15.164:0/1566276025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f611e5f0 0x5639f61af640 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1ea800a520 tx=0x7f1ea8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7d6090e4ab8f92 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.959+0000 7f1eb6866640 1 -- 172.21.15.164:0/1566276025 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ea8055070 con 0x5639f611e5f0 2024-09-13T23:06:30.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.959+0000 7f1eb6866640 1 -- 172.21.15.164:0/1566276025 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ea80515b0 con 0x5639f611e5f0 2024-09-13T23:06:30.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.959+0000 7f1eb6866640 1 -- 172.21.15.164:0/1566276025 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ea80518d0 con 0x5639f611e5f0 2024-09-13T23:06:30.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.959+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1566276025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f611e5f0 msgr2=0x5639f61af640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.959+0000 7f1ebba0f800 1 --2- 172.21.15.164:0/1566276025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f611e5f0 0x5639f61af640 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1ea800a520 tx=0x7f1ea8045ba0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.959+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1566276025 shutdown_connections 2024-09-13T23:06:30.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.959+0000 7f1ebba0f800 1 --2- 172.21.15.164:0/1566276025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f611e5f0 0x5639f61af640 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.959+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1566276025 >> 172.21.15.164:0/1566276025 conn(0x5639f61a4db0 msgr2=0x5639f61a71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:30.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.959+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1566276025 shutdown_connections 2024-09-13T23:06:30.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.959+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1566276025 wait complete. 2024-09-13T23:06:30.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.973+0000 7f1ebba0f800 1 Processor -- start 2024-09-13T23:06:30.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.973+0000 7f1ebba0f800 1 -- start start 2024-09-13T23:06:30.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.973+0000 7f1ebba0f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f611e5f0 0x5639f629baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.973+0000 7f1ebba0f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5639f60f6360 con 0x5639f611e5f0 2024-09-13T23:06:30.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.974+0000 7f1eb7067640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f611e5f0 0x5639f629baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.974+0000 7f1eb7067640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f611e5f0 0x5639f629baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44600/0 (socket says 172.21.15.164:44600) 2024-09-13T23:06:30.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.974+0000 7f1eb7067640 1 -- 172.21.15.164:0/2062502774 learned_addr learned my addr 172.21.15.164:0/2062502774 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:30.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.974+0000 7f1eb7067640 1 -- 172.21.15.164:0/2062502774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639f6043bc0 con 0x5639f611e5f0 2024-09-13T23:06:30.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.974+0000 7f1eb7067640 1 --2- 172.21.15.164:0/2062502774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f611e5f0 0x5639f629baa0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8025da0 tx=0x7f1ea8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af677cf228dcb510 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.975+0000 7f1da560a640 1 -- 172.21.15.164:0/2062502774 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ea8051950 con 0x5639f611e5f0 2024-09-13T23:06:30.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.975+0000 7f1da560a640 1 -- 172.21.15.164:0/2062502774 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ea8051af0 con 0x5639f611e5f0 2024-09-13T23:06:30.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.975+0000 7f1da560a640 1 -- 172.21.15.164:0/2062502774 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ea8051dd0 con 0x5639f611e5f0 2024-09-13T23:06:30.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.975+0000 7f1ebba0f800 1 -- 172.21.15.164:0/2062502774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f611e5f0 msgr2=0x5639f629baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.975+0000 7f1ebba0f800 1 --2- 172.21.15.164:0/2062502774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f611e5f0 0x5639f629baa0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8025da0 tx=0x7f1ea8051000 comp rx=0 tx=0).stop 2024-09-13T23:06:30.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.975+0000 7f1ebba0f800 1 -- 172.21.15.164:0/2062502774 shutdown_connections 2024-09-13T23:06:30.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.975+0000 7f1ebba0f800 1 --2- 172.21.15.164:0/2062502774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f611e5f0 0x5639f629baa0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.975+0000 7f1ebba0f800 1 -- 172.21.15.164:0/2062502774 >> 172.21.15.164:0/2062502774 conn(0x5639f61a4db0 msgr2=0x5639f6297460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:30.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.975+0000 7f1ebba0f800 1 -- 172.21.15.164:0/2062502774 shutdown_connections 2024-09-13T23:06:30.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.975+0000 7f1ebba0f800 1 -- 172.21.15.164:0/2062502774 wait complete. 2024-09-13T23:06:30.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.976+0000 7f1ebba0f800 1 Processor -- start 2024-09-13T23:06:30.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.976+0000 7f1ebba0f800 1 -- start start 2024-09-13T23:06:30.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.976+0000 7f1ebba0f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f611e5f0 0x5639f62a33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.976+0000 7f1ebba0f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5639f61b3930 con 0x5639f611e5f0 2024-09-13T23:06:30.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.976+0000 7f1eb7067640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f611e5f0 0x5639f62a33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.976+0000 7f1eb7067640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f611e5f0 0x5639f62a33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44608/0 (socket says 172.21.15.164:44608) 2024-09-13T23:06:30.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.976+0000 7f1eb7067640 1 -- 172.21.15.164:0/1738611006 learned_addr learned my addr 172.21.15.164:0/1738611006 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:30.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.976+0000 7f1eb7067640 1 -- 172.21.15.164:0/1738611006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639f6057fe0 con 0x5639f611e5f0 2024-09-13T23:06:30.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.977+0000 7f1eb7067640 1 --2- 172.21.15.164:0/1738611006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f611e5f0 0x5639f62a33b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8067040 tx=0x7f1ea8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.977+0000 7f1da3e07640 1 -- 172.21.15.164:0/1738611006 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ea8073070 con 0x5639f611e5f0 2024-09-13T23:06:30.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.977+0000 7f1da3e07640 1 -- 172.21.15.164:0/1738611006 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ea805a450 con 0x5639f611e5f0 2024-09-13T23:06:30.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.977+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1738611006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5639f62a38f0 con 0x5639f611e5f0 2024-09-13T23:06:30.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.977+0000 7f1da3e07640 1 -- 172.21.15.164:0/1738611006 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ea805a730 con 0x5639f611e5f0 2024-09-13T23:06:30.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.977+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1738611006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639f62a3e70 con 0x5639f611e5f0 2024-09-13T23:06:30.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.978+0000 7f1da3e07640 1 -- 172.21.15.164:0/1738611006 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1ea8076070 con 0x5639f611e5f0 2024-09-13T23:06:30.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.978+0000 7f1da3e07640 1 --2- 172.21.15.164:0/1738611006 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1d9c036b40 0x7f1d9c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.978+0000 7f1da3e07640 1 -- 172.21.15.164:0/1738611006 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1ea8062070 con 0x5639f611e5f0 2024-09-13T23:06:30.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.978+0000 7f1eae866640 1 --2- 172.21.15.164:0/1738611006 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1d9c036b40 0x7f1d9c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.978+0000 7f1ebba0f800 1 --2- 172.21.15.164:0/1738611006 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5639f61afb80 0x5639f62aa420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.978+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1738611006 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5639f62aa9a0 con 0x5639f61afb80 2024-09-13T23:06:30.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.978+0000 7f1eb7868640 1 --2- 172.21.15.164:0/1738611006 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5639f61afb80 0x5639f62aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.978+0000 7f1eae866640 1 --2- 172.21.15.164:0/1738611006 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1d9c036b40 0x7f1d9c039000 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0000f60 tx=0x7f1ea0001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.978+0000 7f1eb7868640 1 --2- 172.21.15.164:0/1738611006 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5639f61afb80 0x5639f62aa420 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.979+0000 7f1eb7868640 1 -- 172.21.15.164:0/1738611006 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1eb000a4a0 con 0x5639f61afb80 2024-09-13T23:06:30.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.979+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1738611006 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5639f62a79f0 con 0x5639f61afb80 2024-09-13T23:06:30.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.979+0000 7f1eb7868640 1 -- 172.21.15.164:0/1738611006 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1eb000a4a0 con 0x5639f61afb80 2024-09-13T23:06:30.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.979+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1738611006 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5639f62ac7c0 con 0x5639f61afb80 2024-09-13T23:06:30.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.979+0000 7f1eb7868640 1 -- 172.21.15.164:0/1738611006 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1eb000a4a0 con 0x5639f61afb80 2024-09-13T23:06:30.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.980+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1738611006 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5639f62ab900 con 0x5639f61afb80 2024-09-13T23:06:30.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.980+0000 7f1eb7868640 1 -- 172.21.15.164:0/1738611006 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1eb000a4a0 con 0x5639f61afb80 2024-09-13T23:06:30.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.980+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1738611006 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5639f62abd50 con 0x5639f61afb80 2024-09-13T23:06:30.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.980+0000 7f1eb7868640 1 -- 172.21.15.164:0/1738611006 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1eb000a4a0 con 0x5639f61afb80 2024-09-13T23:06:30.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.980+0000 7f1ebba0f800 1 Processor -- start 2024-09-13T23:06:30.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.981+0000 7f1ebba0f800 1 -- start start 2024-09-13T23:06:30.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.981+0000 7f1ebba0f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f62bad40 0x5639f62bb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.981+0000 7f1ebba0f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5639f6045580 con 0x5639f62bad40 2024-09-13T23:06:30.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.981+0000 7f1eae866640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f62bad40 0x5639f62bb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.981+0000 7f1eae866640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f62bad40 0x5639f62bb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44618/0 (socket says 172.21.15.164:44618) 2024-09-13T23:06:30.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.981+0000 7f1eae866640 1 -- 172.21.15.164:0/3301952959 learned_addr learned my addr 172.21.15.164:0/3301952959 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:30.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.981+0000 7f1eae866640 1 -- 172.21.15.164:0/3301952959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639f62bb6a0 con 0x5639f62bad40 2024-09-13T23:06:30.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.982+0000 7f1eae866640 1 --2- 172.21.15.164:0/3301952959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f62bad40 0x5639f62bb160 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0001ed0 tx=0x7f1ea000ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.982+0000 7f1da1602640 1 -- 172.21.15.164:0/3301952959 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ea0022070 con 0x5639f62bad40 2024-09-13T23:06:30.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.982+0000 7f1da1602640 1 -- 172.21.15.164:0/3301952959 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ea000d520 con 0x5639f62bad40 2024-09-13T23:06:30.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.982+0000 7f1da1602640 1 -- 172.21.15.164:0/3301952959 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ea000d800 con 0x5639f62bad40 2024-09-13T23:06:30.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.982+0000 7f1ebba0f800 1 -- 172.21.15.164:0/3301952959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5639f62bb930 con 0x5639f62bad40 2024-09-13T23:06:30.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.982+0000 7f1ebba0f800 1 -- 172.21.15.164:0/3301952959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639f62be610 con 0x5639f62bad40 2024-09-13T23:06:30.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.983+0000 7f1da1602640 1 -- 172.21.15.164:0/3301952959 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1ea0025070 con 0x5639f62bad40 2024-09-13T23:06:30.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.983+0000 7f1da1602640 1 --2- 172.21.15.164:0/3301952959 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1d90036b90 0x7f1d90039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.983+0000 7f1da1602640 1 -- 172.21.15.164:0/3301952959 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1ea004e060 con 0x5639f62bad40 2024-09-13T23:06:30.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.983+0000 7f1eb7868640 1 --2- 172.21.15.164:0/3301952959 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1d90036b90 0x7f1d90039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.983+0000 7f1ebba0f800 1 Processor -- start 2024-09-13T23:06:30.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.983+0000 7f1eb7868640 1 --2- 172.21.15.164:0/3301952959 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1d90036b90 0x7f1d90039050 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x5639f62ab420 tx=0x7f1eb0005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.983+0000 7f1ebba0f800 1 -- start start 2024-09-13T23:06:30.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.983+0000 7f1ebba0f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f62c7a00 0x5639f62c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.983+0000 7f1ebba0f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5639f629c190 con 0x5639f62c7a00 2024-09-13T23:06:30.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.984+0000 7f1eae866640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f62c7a00 0x5639f62c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.984+0000 7f1eae866640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f62c7a00 0x5639f62c7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44624/0 (socket says 172.21.15.164:44624) 2024-09-13T23:06:30.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.984+0000 7f1eae866640 1 -- 172.21.15.164:0/791032450 learned_addr learned my addr 172.21.15.164:0/791032450 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:30.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.984+0000 7f1eae866640 1 -- 172.21.15.164:0/791032450 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639f62c83d0 con 0x5639f62c7a00 2024-09-13T23:06:30.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.984+0000 7f1eae866640 1 --2- 172.21.15.164:0/791032450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f62c7a00 0x5639f62c7e00 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000eee0 tx=0x7f1ea0024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2382fa61c9fcec68 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.984+0000 7f1d9affd640 1 -- 172.21.15.164:0/791032450 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ea0045070 con 0x5639f62c7a00 2024-09-13T23:06:30.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.984+0000 7f1d9affd640 1 -- 172.21.15.164:0/791032450 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ea0026730 con 0x5639f62c7a00 2024-09-13T23:06:30.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.984+0000 7f1d9affd640 1 -- 172.21.15.164:0/791032450 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ea0025c50 con 0x5639f62c7a00 2024-09-13T23:06:30.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.985+0000 7f1ebba0f800 1 -- 172.21.15.164:0/791032450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f62c7a00 msgr2=0x5639f62c7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.985+0000 7f1ebba0f800 1 --2- 172.21.15.164:0/791032450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f62c7a00 0x5639f62c7e00 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000eee0 tx=0x7f1ea0024740 comp rx=0 tx=0).stop 2024-09-13T23:06:30.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.985+0000 7f1ebba0f800 1 -- 172.21.15.164:0/791032450 shutdown_connections 2024-09-13T23:06:30.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.985+0000 7f1ebba0f800 1 --2- 172.21.15.164:0/791032450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f62c7a00 0x5639f62c7e00 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.985+0000 7f1ebba0f800 1 -- 172.21.15.164:0/791032450 >> 172.21.15.164:0/791032450 conn(0x5639f62c3d60 msgr2=0x5639f62c1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:30.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.985+0000 7f1ebba0f800 1 -- 172.21.15.164:0/791032450 shutdown_connections 2024-09-13T23:06:30.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.985+0000 7f1ebba0f800 1 -- 172.21.15.164:0/791032450 wait complete. 2024-09-13T23:06:30.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.985+0000 7f1ebba0f800 1 Processor -- start 2024-09-13T23:06:30.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.985+0000 7f1ebba0f800 1 -- start start 2024-09-13T23:06:30.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.985+0000 7f1ebba0f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f62c7a00 0x5639f62ced00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.985+0000 7f1ebba0f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5639f62c8950 con 0x5639f62c7a00 2024-09-13T23:06:30.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.985+0000 7f1eae866640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f62c7a00 0x5639f62ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.985+0000 7f1eae866640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f62c7a00 0x5639f62ced00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44628/0 (socket says 172.21.15.164:44628) 2024-09-13T23:06:30.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.985+0000 7f1eae866640 1 -- 172.21.15.164:0/1488041443 learned_addr learned my addr 172.21.15.164:0/1488041443 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:30.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.986+0000 7f1eae866640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639f62cf240 con 0x5639f62c7a00 2024-09-13T23:06:30.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.986+0000 7f1eae866640 1 --2- 172.21.15.164:0/1488041443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f62c7a00 0x5639f62ced00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0024a00 tx=0x7f1ea004c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.986+0000 7f1d997fa640 1 -- 172.21.15.164:0/1488041443 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ea0045070 con 0x5639f62c7a00 2024-09-13T23:06:30.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.986+0000 7f1d997fa640 1 -- 172.21.15.164:0/1488041443 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ea000dbb0 con 0x5639f62c7a00 2024-09-13T23:06:30.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.986+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5639f62cf240 con 0x5639f62c7a00 2024-09-13T23:06:30.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.986+0000 7f1d997fa640 1 -- 172.21.15.164:0/1488041443 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ea001a320 con 0x5639f62c7a00 2024-09-13T23:06:30.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.986+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639f62cf240 con 0x5639f62c7a00 2024-09-13T23:06:30.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.987+0000 7f1d997fa640 1 -- 172.21.15.164:0/1488041443 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1ea0033070 con 0x5639f62c7a00 2024-09-13T23:06:30.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.987+0000 7f1d997fa640 1 --2- 172.21.15.164:0/1488041443 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1d80036b90 0x7f1d80039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.987+0000 7f1d997fa640 1 -- 172.21.15.164:0/1488041443 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1ea0037d40 con 0x5639f62c7a00 2024-09-13T23:06:30.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.987+0000 7f1eb7868640 1 --2- 172.21.15.164:0/1488041443 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1d80036b90 0x7f1d80039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.987+0000 7f1ebba0f800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.987+0000 7f1ebba0f800 1 --2- 172.21.15.164:0/1488041443 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5639f62da450 0x5639f62dc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.987+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5639f62dd060 con 0x5639f62da450 2024-09-13T23:06:30.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.988+0000 7f1eb7067640 1 --2- 172.21.15.164:0/1488041443 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5639f62da450 0x5639f62dc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.988+0000 7f1eb7868640 1 --2- 172.21.15.164:0/1488041443 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1d80036b90 0x7f1d80039050 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x5639f62a41d0 tx=0x7f1eb001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.988+0000 7f1eb7067640 1 --2- 172.21.15.164:0/1488041443 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5639f62da450 0x5639f62dc910 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.988+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ea8075030 con 0x5639f62da450 2024-09-13T23:06:30.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.988+0000 7f1ebba0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:30.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.988+0000 7f1ebba0f800 20 realm 2024-09-13T23:06:30.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.988+0000 7f1ebba0f800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.988+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5639f62dd470 con 0x5639f62da450 2024-09-13T23:06:30.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.988+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ea8075030 con 0x5639f62da450 2024-09-13T23:06:30.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.988+0000 7f1ebba0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:30.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.988+0000 7f1ebba0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:06:30.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.988+0000 7f1ebba0f800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.988+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5639f62ddd40 con 0x5639f62da450 2024-09-13T23:06:30.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.988+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ea8075030 con 0x5639f62da450 2024-09-13T23:06:30.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.988+0000 7f1ebba0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:30.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.988+0000 7f1ebba0f800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.989+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5639f62de0e0 con 0x5639f62da450 2024-09-13T23:06:30.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.989+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ea8075030 con 0x5639f62da450 2024-09-13T23:06:30.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.989+0000 7f1ebba0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:06:30.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.989+0000 7f1ebba0f800 20 rados->read ofs=0 len=0 2024-09-13T23:06:30.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.989+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5639f62de540 con 0x5639f62da450 2024-09-13T23:06:30.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.989+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1ea8075030 con 0x5639f62da450 2024-09-13T23:06:30.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.989+0000 7f1ebba0f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:06:30.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.989+0000 7f1ebba0f800 20 searching for the correct realm 2024-09-13T23:06:30.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.989+0000 7f1ebba0f800 1 --2- 172.21.15.164:0/1488041443 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5639f62e0590 0x5639f62e2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.989+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e3030 con 0x5639f62e0590 2024-09-13T23:06:30.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.989+0000 7f1eae866640 1 --2- 172.21.15.164:0/1488041443 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5639f62e0590 0x5639f62e2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.989+0000 7f1eae866640 1 --2- 172.21.15.164:0/1488041443 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5639f62e0590 0x5639f62e2980 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.990+0000 7f1eae866640 1 -- 172.21.15.164:0/1488041443 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea003c020 con 0x5639f62e0590 2024-09-13T23:06:30.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.990+0000 7f1eae866640 1 --2- 172.21.15.164:0/1488041443 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f1ea001ac20 0x7f1ea004c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.990+0000 7f1eae866640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e3030 con 0x7f1ea001ac20 2024-09-13T23:06:30.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.990+0000 7f1eb7868640 1 --2- 172.21.15.164:0/1488041443 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f1ea001ac20 0x7f1ea004c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.990+0000 7f1eb7868640 1 --2- 172.21.15.164:0/1488041443 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f1ea001ac20 0x7f1ea004c9d0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.990+0000 7f1eb7868640 1 -- 172.21.15.164:0/1488041443 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1eb001f070 con 0x7f1ea001ac20 2024-09-13T23:06:30.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.990+0000 7f1eb7868640 1 --2- 172.21.15.164:0/1488041443 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f1eb0031040 0x7f1eb0032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.990+0000 7f1eb7868640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e3030 con 0x7f1eb0031040 2024-09-13T23:06:30.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.991+0000 7f1eb7067640 1 --2- 172.21.15.164:0/1488041443 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f1eb0031040 0x7f1eb0032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.991+0000 7f1eb7067640 1 --2- 172.21.15.164:0/1488041443 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f1eb0031040 0x7f1eb0032940 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.991+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea8075030 con 0x7f1eb0031040 2024-09-13T23:06:30.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.991+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e3030 con 0x5639f62da450 2024-09-13T23:06:30.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.992+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1ea8075030 con 0x5639f62da450 2024-09-13T23:06:30.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.992+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e3030 con 0x5639f62da450 2024-09-13T23:06:30.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.992+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea8075030 con 0x5639f62da450 2024-09-13T23:06:30.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.992+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e3030 con 0x7f1eb0031040 2024-09-13T23:06:31.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.993+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea8075030 con 0x7f1eb0031040 2024-09-13T23:06:31.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.993+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e3030 con 0x7f1eb0031040 2024-09-13T23:06:31.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.994+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea8075030 con 0x7f1eb0031040 2024-09-13T23:06:31.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.994+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e3030 con 0x7f1ea001ac20 2024-09-13T23:06:31.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.994+0000 7f1eb7868640 1 -- 172.21.15.164:0/1488041443 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1eb001f070 con 0x7f1ea001ac20 2024-09-13T23:06:31.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.994+0000 7f1eb7868640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e3030 con 0x5639f62e0590 2024-09-13T23:06:31.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.994+0000 7f1eae866640 1 -- 172.21.15.164:0/1488041443 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea003c020 con 0x5639f62e0590 2024-09-13T23:06:31.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.994+0000 7f1eae866640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e3030 con 0x5639f62da450 2024-09-13T23:06:31.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.994+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea8075030 con 0x5639f62da450 2024-09-13T23:06:31.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.994+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e3030 con 0x7f1eb0031040 2024-09-13T23:06:31.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.995+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea8075030 con 0x7f1eb0031040 2024-09-13T23:06:31.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.995+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e3030 con 0x5639f62da450 2024-09-13T23:06:31.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.995+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea8075030 con 0x5639f62da450 2024-09-13T23:06:31.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.995+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e3030 con 0x7f1ea001ac20 2024-09-13T23:06:31.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.996+0000 7f1eb7868640 1 -- 172.21.15.164:0/1488041443 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1eb001f070 con 0x7f1ea001ac20 2024-09-13T23:06:31.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.996+0000 7f1eb7868640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e3030 con 0x5639f62e0590 2024-09-13T23:06:31.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.996+0000 7f1eae866640 1 -- 172.21.15.164:0/1488041443 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea003c020 con 0x5639f62e0590 2024-09-13T23:06:31.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.996+0000 7f1eae866640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e3030 con 0x5639f62e0590 2024-09-13T23:06:31.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.996+0000 7f1eae866640 1 -- 172.21.15.164:0/1488041443 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea003c020 con 0x5639f62e0590 2024-09-13T23:06:31.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.996+0000 7f1eae866640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e3030 con 0x7f1eb0031040 2024-09-13T23:06:31.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.996+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea8075030 con 0x7f1eb0031040 2024-09-13T23:06:31.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.996+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1ea80a1040 con 0x5639f62e0590 2024-09-13T23:06:31.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.996+0000 7f1eae866640 1 -- 172.21.15.164:0/1488041443 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea003c020 con 0x5639f62e0590 2024-09-13T23:06:31.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.997+0000 7f1eae866640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1ea80a1040 con 0x5639f62e0590 2024-09-13T23:06:31.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.997+0000 7f1eae866640 1 -- 172.21.15.164:0/1488041443 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea003c020 con 0x5639f62e0590 2024-09-13T23:06:31.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.997+0000 7f1eae866640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1ea80a1040 con 0x5639f62da450 2024-09-13T23:06:31.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.997+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea8075030 con 0x5639f62da450 2024-09-13T23:06:31.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.997+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1ea80a1040 con 0x5639f62da450 2024-09-13T23:06:31.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.997+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1ea8075030 con 0x5639f62da450 2024-09-13T23:06:31.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.997+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1ea80a1040 con 0x7f1eb0031040 2024-09-13T23:06:31.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.997+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea8075030 con 0x7f1eb0031040 2024-09-13T23:06:31.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.997+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1ea80a1040 con 0x5639f62e0590 2024-09-13T23:06:31.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.998+0000 7f1eae866640 1 -- 172.21.15.164:0/1488041443 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea003c020 con 0x5639f62e0590 2024-09-13T23:06:31.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.998+0000 7f1eae866640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1ea80a1040 con 0x7f1ea001ac20 2024-09-13T23:06:31.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.998+0000 7f1eb7868640 1 -- 172.21.15.164:0/1488041443 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1eb001f070 con 0x7f1ea001ac20 2024-09-13T23:06:31.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.998+0000 7f1eb7868640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1ea80a1040 con 0x5639f62da450 2024-09-13T23:06:31.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.998+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1ea8075030 con 0x5639f62da450 2024-09-13T23:06:31.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.998+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1ea80a1040 con 0x7f1eb0031040 2024-09-13T23:06:31.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.999+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea8075030 con 0x7f1eb0031040 2024-09-13T23:06:31.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.999+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1ea80a1040 con 0x5639f62e0590 2024-09-13T23:06:31.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.999+0000 7f1eae866640 1 -- 172.21.15.164:0/1488041443 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea003c020 con 0x5639f62e0590 2024-09-13T23:06:31.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.999+0000 7f1eae866640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1ea80a1040 con 0x7f1eb0031040 2024-09-13T23:06:31.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.999+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea8075030 con 0x7f1eb0031040 2024-09-13T23:06:31.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.999+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1ea80a1040 con 0x7f1ea001ac20 2024-09-13T23:06:31.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.999+0000 7f1eb7868640 1 -- 172.21.15.164:0/1488041443 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1eb001f070 con 0x7f1ea001ac20 2024-09-13T23:06:31.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:30.999+0000 7f1eb7868640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1ea80a1040 con 0x5639f62e0590 2024-09-13T23:06:31.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.000+0000 7f1eae866640 1 -- 172.21.15.164:0/1488041443 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ea003c020 con 0x5639f62e0590 2024-09-13T23:06:31.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.000+0000 7f1eae866640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1ea80a1040 con 0x7f1ea001ac20 2024-09-13T23:06:31.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.000+0000 7f1eb7868640 1 -- 172.21.15.164:0/1488041443 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1eb001f070 con 0x7f1ea001ac20 2024-09-13T23:06:31.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.000+0000 7f1eb7868640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1ea80a1040 con 0x5639f62da450 2024-09-13T23:06:31.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.000+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1ea8075030 con 0x5639f62da450 2024-09-13T23:06:31.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.000+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1ea80a1040 con 0x7f1ea001ac20 2024-09-13T23:06:31.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.000+0000 7f1eb7868640 1 -- 172.21.15.164:0/1488041443 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1eb0040040 con 0x7f1ea001ac20 2024-09-13T23:06:31.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.000+0000 7f1ebba0f800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:06:31.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.000+0000 7f1ebba0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:06:31.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.000+0000 7f1ebba0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:06:31.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.000+0000 7f1ebba0f800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:06:31.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.000+0000 7f1ebba0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:06:31.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.000+0000 7f1ebba0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:06:31.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.000+0000 7f1ebba0f800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.000+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5639f62df010 con 0x5639f62da450 2024-09-13T23:06:31.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.000+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ea8075030 con 0x5639f62da450 2024-09-13T23:06:31.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.000+0000 7f1ebba0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.000+0000 7f1ebba0f800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.000+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5639f62dec50 con 0x5639f62da450 2024-09-13T23:06:31.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.001+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ea8075030 con 0x5639f62da450 2024-09-13T23:06:31.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.001+0000 7f1ebba0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:06:31.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.001+0000 7f1ebba0f800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.001+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5639f62dec60 con 0x5639f62da450 2024-09-13T23:06:31.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.001+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1ea8075030 con 0x5639f62da450 2024-09-13T23:06:31.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.001+0000 7f1ebba0f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:06:31.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.001+0000 7f1ebba0f800 20 zone default found 2024-09-13T23:06:31.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.001+0000 7f1ebba0f800 4 Realm: () 2024-09-13T23:06:31.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.001+0000 7f1ebba0f800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:06:31.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.001+0000 7f1ebba0f800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:06:31.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.001+0000 7f1ebba0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:06:31.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.001+0000 7f1ebba0f800 20 zonegroup default 2024-09-13T23:06:31.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.001+0000 7f1ebba0f800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.001+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e3490 con 0x7f1eb0031040 2024-09-13T23:06:31.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.001+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1ea8075030 con 0x7f1eb0031040 2024-09-13T23:06:31.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.001+0000 7f1ebba0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.001+0000 7f1ebba0f800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.001+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e5320 con 0x5639f62e0590 2024-09-13T23:06:31.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.002+0000 7f1eae866640 1 -- 172.21.15.164:0/1488041443 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1ea003c020 con 0x5639f62e0590 2024-09-13T23:06:31.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.002+0000 7f1ebba0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.002+0000 7f1ebba0f800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.002+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e56c0 con 0x5639f62e0590 2024-09-13T23:06:31.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.002+0000 7f1eae866640 1 -- 172.21.15.164:0/1488041443 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1ea003c020 con 0x5639f62e0590 2024-09-13T23:06:31.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.002+0000 7f1ebba0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.002+0000 7f1ebba0f800 20 started sync module instance, tier type = 2024-09-13T23:06:31.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.002+0000 7f1ebba0f800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:06:31.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.002+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e4760 con 0x7f1ea001ac20 2024-09-13T23:06:31.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.003+0000 7f1eb7868640 1 -- 172.21.15.164:0/1488041443 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1eb0040040 con 0x7f1ea001ac20 2024-09-13T23:06:31.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.003+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94806943353680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e4f70 con 0x7f1ea001ac20 2024-09-13T23:06:31.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.003+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e6530 con 0x5639f62da450 2024-09-13T23:06:31.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.004+0000 7f1eb7868640 1 -- 172.21.15.164:0/1488041443 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94806943353680] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1eb0040040 con 0x7f1ea001ac20 2024-09-13T23:06:31.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.004+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ea8075030 con 0x5639f62da450 2024-09-13T23:06:31.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.004+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94806943359104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e6950 con 0x5639f62da450 2024-09-13T23:06:31.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.004+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e7310 con 0x5639f62e0590 2024-09-13T23:06:31.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.005+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94806943359104] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ea8075030 con 0x5639f62da450 2024-09-13T23:06:31.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.005+0000 7f1eae866640 1 -- 172.21.15.164:0/1488041443 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ea003c020 con 0x5639f62e0590 2024-09-13T23:06:31.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.005+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94806943360160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e68c0 con 0x5639f62e0590 2024-09-13T23:06:31.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.006+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e8180 con 0x7f1ea001ac20 2024-09-13T23:06:31.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.006+0000 7f1eb7868640 1 -- 172.21.15.164:0/1488041443 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1eb0040040 con 0x7f1ea001ac20 2024-09-13T23:06:31.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.006+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94806943366832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e8960 con 0x7f1ea001ac20 2024-09-13T23:06:31.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.007+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e9480 con 0x5639f62da450 2024-09-13T23:06:31.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.007+0000 7f1eae866640 1 -- 172.21.15.164:0/1488041443 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94806943360160] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ea003c020 con 0x5639f62e0590 2024-09-13T23:06:31.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.008+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ea8075030 con 0x5639f62da450 2024-09-13T23:06:31.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.008+0000 7f1eb7868640 1 -- 172.21.15.164:0/1488041443 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94806943366832] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1eb0040040 con 0x7f1ea001ac20 2024-09-13T23:06:31.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.008+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94806943371088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e9440 con 0x5639f62da450 2024-09-13T23:06:31.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.008+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e9d20 con 0x7f1eb0031040 2024-09-13T23:06:31.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.009+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94806943371088] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ea8075030 con 0x5639f62da450 2024-09-13T23:06:31.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.009+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ea8075030 con 0x7f1eb0031040 2024-09-13T23:06:31.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.009+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94806943368112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e9440 con 0x7f1eb0031040 2024-09-13T23:06:31.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.009+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5639f62ea330 con 0x7f1eb0031040 2024-09-13T23:06:31.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.010+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94806943368112] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ea8075030 con 0x7f1eb0031040 2024-09-13T23:06:31.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.010+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ea8075030 con 0x7f1eb0031040 2024-09-13T23:06:31.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.010+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94806943374880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5639f62ea2f0 con 0x7f1eb0031040 2024-09-13T23:06:31.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.010+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5639f62eacf0 con 0x7f1eb0031040 2024-09-13T23:06:31.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.011+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94806943374880] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ea8075030 con 0x7f1eb0031040 2024-09-13T23:06:31.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.011+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ea8075030 con 0x7f1eb0031040 2024-09-13T23:06:31.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.011+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94806943373312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5639f62eacb0 con 0x7f1eb0031040 2024-09-13T23:06:31.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.011+0000 7f1ebba0f800 20 add_watcher() i=0 2024-09-13T23:06:31.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.011+0000 7f1ebba0f800 20 add_watcher() i=1 2024-09-13T23:06:31.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.011+0000 7f1ebba0f800 20 add_watcher() i=2 2024-09-13T23:06:31.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.011+0000 7f1ebba0f800 20 add_watcher() i=3 2024-09-13T23:06:31.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.011+0000 7f1ebba0f800 20 add_watcher() i=4 2024-09-13T23:06:31.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.011+0000 7f1ebba0f800 20 add_watcher() i=5 2024-09-13T23:06:31.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.011+0000 7f1ebba0f800 20 add_watcher() i=6 2024-09-13T23:06:31.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.012+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94806943373312] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ea8075030 con 0x7f1eb0031040 2024-09-13T23:06:31.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.012+0000 7f1ebba0f800 20 add_watcher() i=7 2024-09-13T23:06:31.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.012+0000 7f1ebba0f800 2 all 8 watchers are set, enabling cache 2024-09-13T23:06:31.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.012+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5639f62ee170 con 0x5639f62da450 2024-09-13T23:06:31.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.013+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1ea8075030 con 0x5639f62da450 2024-09-13T23:06:31.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.013+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94806943377872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5639f62eb660 con 0x5639f62da450 2024-09-13T23:06:31.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.014+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94806943377872] v34'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1ea8075030 con 0x5639f62da450 2024-09-13T23:06:31.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.014+0000 7f1d6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:06:31.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.014+0000 7f1ebba0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:06:31.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.014+0000 7f1ebba0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:06:31.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.014+0000 7f1ebba0f800 5 note: GC not initialized 2024-09-13T23:06:31.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.014+0000 7f1d6cfe1640 20 reqs_thread_entry: start 2024-09-13T23:06:31.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.014+0000 7f1ebba0f800 20 init_complete bucket index max shards: 11 2024-09-13T23:06:31.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.014+0000 7f1ebba0f800 20 Filter name: none 2024-09-13T23:06:31.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.014+0000 7f1ce67fc640 20 reqs_thread_entry: start 2024-09-13T23:06:31.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.014+0000 7f1ebba0f800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.014+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5639f63210d0 con 0x5639f62da450 2024-09-13T23:06:31.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.015+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1ea8075030 con 0x5639f62da450 2024-09-13T23:06:31.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.015+0000 7f1ebba0f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:06:31.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.015+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5639f6322620 con 0x7f1eb0031040 2024-09-13T23:06:31.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.015+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f1ea8075030 con 0x7f1eb0031040 2024-09-13T23:06:31.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.016+0000 7f1d6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:06:31.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.016+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94806943377872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5639f62ebf30 con 0x5639f62da450 2024-09-13T23:06:31.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.017+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94806943377872] v34'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1ea8075030 con 0x5639f62da450 2024-09-13T23:06:31.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.017+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94806943353680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5639f62ea9a0 con 0x7f1ea001ac20 2024-09-13T23:06:31.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.018+0000 7f1eb7868640 1 -- 172.21.15.164:0/1488041443 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94806943353680] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1eb0040040 con 0x7f1ea001ac20 2024-09-13T23:06:31.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.018+0000 7f1ebba0f800 20 remove_watcher() i=0 2024-09-13T23:06:31.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.018+0000 7f1ebba0f800 2 removed watcher, disabling cache 2024-09-13T23:06:31.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.018+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94806943359104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e4b50 con 0x5639f62da450 2024-09-13T23:06:31.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.019+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94806943359104] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ea8075030 con 0x5639f62da450 2024-09-13T23:06:31.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.020+0000 7f1ebba0f800 20 remove_watcher() i=1 2024-09-13T23:06:31.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.020+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94806943360160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e4b50 con 0x5639f62e0590 2024-09-13T23:06:31.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.021+0000 7f1eae866640 1 -- 172.21.15.164:0/1488041443 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94806943360160] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ea003c020 con 0x5639f62e0590 2024-09-13T23:06:31.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.021+0000 7f1ebba0f800 20 remove_watcher() i=2 2024-09-13T23:06:31.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.021+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94806943366832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5639f62ea9a0 con 0x7f1ea001ac20 2024-09-13T23:06:31.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.022+0000 7f1eb7868640 1 -- 172.21.15.164:0/1488041443 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94806943366832] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1eb0040040 con 0x7f1ea001ac20 2024-09-13T23:06:31.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.022+0000 7f1ebba0f800 20 remove_watcher() i=3 2024-09-13T23:06:31.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.022+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94806943371088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5639f62ea9a0 con 0x5639f62da450 2024-09-13T23:06:31.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.023+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94806943371088] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ea8075030 con 0x5639f62da450 2024-09-13T23:06:31.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.023+0000 7f1ebba0f800 20 remove_watcher() i=4 2024-09-13T23:06:31.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.023+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94806943368112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e8f50 con 0x7f1eb0031040 2024-09-13T23:06:31.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.024+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94806943368112] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ea8075030 con 0x7f1eb0031040 2024-09-13T23:06:31.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.024+0000 7f1ebba0f800 20 remove_watcher() i=5 2024-09-13T23:06:31.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.024+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94806943374880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e8f50 con 0x7f1eb0031040 2024-09-13T23:06:31.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.025+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94806943374880] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ea8075030 con 0x7f1eb0031040 2024-09-13T23:06:31.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.025+0000 7f1ebba0f800 20 remove_watcher() i=6 2024-09-13T23:06:31.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.025+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94806943373312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5639f62e9e20 con 0x7f1eb0031040 2024-09-13T23:06:31.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.026+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94806943373312] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ea8075030 con 0x7f1eb0031040 2024-09-13T23:06:31.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.026+0000 7f1ebba0f800 20 remove_watcher() i=7 2024-09-13T23:06:31.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.026+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f1eb0031040 msgr2=0x7f1eb0032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.026+0000 7f1ebba0f800 1 --2- 172.21.15.164:0/1488041443 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f1eb0031040 0x7f1eb0032940 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.026+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5639f62da450 msgr2=0x5639f62dc910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.026+0000 7f1ebba0f800 1 --2- 172.21.15.164:0/1488041443 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5639f62da450 0x5639f62dc910 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.026+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f1ea001ac20 msgr2=0x7f1ea004c9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.026+0000 7f1ebba0f800 1 --2- 172.21.15.164:0/1488041443 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f1ea001ac20 0x7f1ea004c9d0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.026+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5639f62e0590 msgr2=0x5639f62e2980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.026+0000 7f1ebba0f800 1 --2- 172.21.15.164:0/1488041443 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5639f62e0590 0x5639f62e2980 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.026+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1d80036b90 msgr2=0x7f1d80039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.026+0000 7f1ebba0f800 1 --2- 172.21.15.164:0/1488041443 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1d80036b90 0x7f1d80039050 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x5639f62a41d0 tx=0x7f1eb001f000 comp rx=0 tx=0).stop 2024-09-13T23:06:31.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.026+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f62c7a00 msgr2=0x5639f62ced00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.026+0000 7f1ebba0f800 1 --2- 172.21.15.164:0/1488041443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f62c7a00 0x5639f62ced00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0024a00 tx=0x7f1ea004c340 comp rx=0 tx=0).stop 2024-09-13T23:06:31.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.026+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 reap_dead start 2024-09-13T23:06:31.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.026+0000 7f1eb7067640 1 -- 172.21.15.164:0/1488041443 reap_dead start 2024-09-13T23:06:31.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.027+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 shutdown_connections 2024-09-13T23:06:31.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.027+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 >> 172.21.15.164:0/1488041443 conn(0x5639f62c3d60 msgr2=0x5639f62c1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.027+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 shutdown_connections 2024-09-13T23:06:31.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.027+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1488041443 wait complete. 2024-09-13T23:06:31.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.027+0000 7f1ebba0f800 1 -- 172.21.15.164:0/3301952959 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1d90036b90 msgr2=0x7f1d90039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.027+0000 7f1ebba0f800 1 --2- 172.21.15.164:0/3301952959 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1d90036b90 0x7f1d90039050 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x5639f62ab420 tx=0x7f1eb0005840 comp rx=0 tx=0).stop 2024-09-13T23:06:31.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.027+0000 7f1ebba0f800 1 -- 172.21.15.164:0/3301952959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f62bad40 msgr2=0x5639f62bb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.027+0000 7f1ebba0f800 1 --2- 172.21.15.164:0/3301952959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f62bad40 0x5639f62bb160 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0001ed0 tx=0x7f1ea000ea00 comp rx=0 tx=0).stop 2024-09-13T23:06:31.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.027+0000 7f1ebba0f800 1 -- 172.21.15.164:0/3301952959 shutdown_connections 2024-09-13T23:06:31.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.027+0000 7f1ebba0f800 1 --2- 172.21.15.164:0/3301952959 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1d90036b90 0x7f1d90039050 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.027+0000 7f1ebba0f800 1 --2- 172.21.15.164:0/3301952959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f62bad40 0x5639f62bb160 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.027+0000 7f1ebba0f800 1 -- 172.21.15.164:0/3301952959 >> 172.21.15.164:0/3301952959 conn(0x5639f62afcd0 msgr2=0x5639f62b2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.027+0000 7f1ebba0f800 1 -- 172.21.15.164:0/3301952959 shutdown_connections 2024-09-13T23:06:31.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.027+0000 7f1ebba0f800 1 -- 172.21.15.164:0/3301952959 wait complete. 2024-09-13T23:06:31.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.027+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1738611006 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5639f61afb80 msgr2=0x5639f62aa420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.027+0000 7f1ebba0f800 1 --2- 172.21.15.164:0/1738611006 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5639f61afb80 0x5639f62aa420 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.027+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1738611006 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1d9c036b40 msgr2=0x7f1d9c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.027+0000 7f1ebba0f800 1 --2- 172.21.15.164:0/1738611006 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1d9c036b40 0x7f1d9c039000 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0000f60 tx=0x7f1ea0001370 comp rx=0 tx=0).stop 2024-09-13T23:06:31.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.027+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1738611006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f611e5f0 msgr2=0x5639f62a33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.027+0000 7f1ebba0f800 1 --2- 172.21.15.164:0/1738611006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f611e5f0 0x5639f62a33b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8067040 tx=0x7f1ea8002fb0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.027+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1738611006 shutdown_connections 2024-09-13T23:06:31.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.027+0000 7f1ebba0f800 1 --2- 172.21.15.164:0/1738611006 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5639f61afb80 0x5639f62aa420 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.027+0000 7f1ebba0f800 1 --2- 172.21.15.164:0/1738611006 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1d9c036b40 0x7f1d9c039000 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.027+0000 7f1ebba0f800 1 --2- 172.21.15.164:0/1738611006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639f611e5f0 0x5639f62a33b0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.027+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1738611006 >> 172.21.15.164:0/1738611006 conn(0x5639f61a4db0 msgr2=0x5639f6295cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.028+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1738611006 shutdown_connections 2024-09-13T23:06:31.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.028+0000 7f1ebba0f800 1 -- 172.21.15.164:0/1738611006 wait complete. 2024-09-13T23:06:31.037 INFO:teuthology.orchestra.run.smithi164.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2024-09-13T23:06:31.037 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-09-13T23:06:31.037 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-13T23:06:31.037 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-13T23:06:31.037 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-13T23:06:31.084 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:06:31.084 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:06:31.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.084+0000 7f27a9526800 1 Processor -- start 2024-09-13T23:06:31.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.084+0000 7f27a9526800 1 -- start start 2024-09-13T23:06:31.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.085+0000 7f27a9526800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55b964c41a10 0x55b964c43e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.085+0000 7f27a9526800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b964afcb30 con 0x55b964c3d710 2024-09-13T23:06:31.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.085+0000 7f27a9526800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55b964ade360 con 0x55b964c41a10 2024-09-13T23:06:31.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.085+0000 7f279ca1c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55b964c41a10 0x55b964c43e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.085+0000 7f279ca1c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55b964c41a10 0x55b964c43e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44632/0 (socket says 172.21.15.164:44632) 2024-09-13T23:06:31.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.085+0000 7f279ca1c640 1 -- 172.21.15.164:0/96453858 learned_addr learned my addr 172.21.15.164:0/96453858 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.085+0000 7f279ca1c640 1 -- 172.21.15.164:0/96453858 >> v1:172.21.15.17:6789/0 conn(0x55b964c3d710 legacy=0x55b964c3db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.085+0000 7f279ca1c640 1 -- 172.21.15.164:0/96453858 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b964b04e00 con 0x55b964c41a10 2024-09-13T23:06:31.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.087+0000 7f279ca1c640 1 --2- 172.21.15.164:0/96453858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964c41a10 0x55b964c43e00 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f279000a520 tx=0x7f2790045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3b9eecc19256d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.087+0000 7f27a4a1c640 1 -- 172.21.15.164:0/96453858 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2790055070 con 0x55b964c41a10 2024-09-13T23:06:31.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.087+0000 7f27a4a1c640 1 -- 172.21.15.164:0/96453858 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27900515b0 con 0x55b964c41a10 2024-09-13T23:06:31.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.087+0000 7f27a4a1c640 1 -- 172.21.15.164:0/96453858 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27900518d0 con 0x55b964c41a10 2024-09-13T23:06:31.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.088+0000 7f27a9526800 1 -- 172.21.15.164:0/96453858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964c41a10 msgr2=0x55b964c43e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.088+0000 7f27a9526800 1 --2- 172.21.15.164:0/96453858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964c41a10 0x55b964c43e00 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f279000a520 tx=0x7f2790045ba0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.088+0000 7f27a9526800 1 -- 172.21.15.164:0/96453858 shutdown_connections 2024-09-13T23:06:31.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.088+0000 7f27a9526800 1 --2- 172.21.15.164:0/96453858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964c41a10 0x55b964c43e00 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.088+0000 7f27a9526800 1 -- 172.21.15.164:0/96453858 >> 172.21.15.164:0/96453858 conn(0x55b964c38fe0 msgr2=0x55b964c3b400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.088+0000 7f27a9526800 1 -- 172.21.15.164:0/96453858 shutdown_connections 2024-09-13T23:06:31.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.088+0000 7f27a9526800 1 -- 172.21.15.164:0/96453858 wait complete. 2024-09-13T23:06:31.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.102+0000 7f27a9526800 1 Processor -- start 2024-09-13T23:06:31.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.102+0000 7f27a9526800 1 -- start start 2024-09-13T23:06:31.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.102+0000 7f27a9526800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964c3d710 0x55b964d2c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.102+0000 7f27a9526800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b964b89360 con 0x55b964c3d710 2024-09-13T23:06:31.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.102+0000 7f27a521d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964c3d710 0x55b964d2c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.102+0000 7f27a521d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964c3d710 0x55b964d2c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44644/0 (socket says 172.21.15.164:44644) 2024-09-13T23:06:31.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.102+0000 7f27a521d640 1 -- 172.21.15.164:0/1970127377 learned_addr learned my addr 172.21.15.164:0/1970127377 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.103+0000 7f27a521d640 1 -- 172.21.15.164:0/1970127377 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b964ad6bc0 con 0x55b964c3d710 2024-09-13T23:06:31.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.103+0000 7f27a521d640 1 --2- 172.21.15.164:0/1970127377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964c3d710 0x55b964d2c8b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f2798001d50 tx=0x7f279800b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85270dfd799b8f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.103+0000 7f2693606640 1 -- 172.21.15.164:0/1970127377 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f279800f400 con 0x55b964c3d710 2024-09-13T23:06:31.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.103+0000 7f2693606640 1 -- 172.21.15.164:0/1970127377 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f279800f5a0 con 0x55b964c3d710 2024-09-13T23:06:31.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.103+0000 7f2693606640 1 -- 172.21.15.164:0/1970127377 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f279800f7d0 con 0x55b964c3d710 2024-09-13T23:06:31.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.104+0000 7f27a9526800 1 -- 172.21.15.164:0/1970127377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964c3d710 msgr2=0x55b964d2c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.104+0000 7f27a9526800 1 --2- 172.21.15.164:0/1970127377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964c3d710 0x55b964d2c8b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f2798001d50 tx=0x7f279800b5b0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.104+0000 7f27a9526800 1 -- 172.21.15.164:0/1970127377 shutdown_connections 2024-09-13T23:06:31.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.104+0000 7f27a9526800 1 --2- 172.21.15.164:0/1970127377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964c3d710 0x55b964d2c8b0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.104+0000 7f27a9526800 1 -- 172.21.15.164:0/1970127377 >> 172.21.15.164:0/1970127377 conn(0x55b964c38fe0 msgr2=0x55b964d28270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.104+0000 7f27a9526800 1 -- 172.21.15.164:0/1970127377 shutdown_connections 2024-09-13T23:06:31.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.104+0000 7f27a9526800 1 -- 172.21.15.164:0/1970127377 wait complete. 2024-09-13T23:06:31.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.104+0000 7f27a9526800 1 Processor -- start 2024-09-13T23:06:31.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.104+0000 7f27a9526800 1 -- start start 2024-09-13T23:06:31.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.104+0000 7f27a9526800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964c3d710 0x55b964d342c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.104+0000 7f27a9526800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b964c44640 con 0x55b964c3d710 2024-09-13T23:06:31.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.105+0000 7f27a521d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964c3d710 0x55b964d342c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.105+0000 7f27a521d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964c3d710 0x55b964d342c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44660/0 (socket says 172.21.15.164:44660) 2024-09-13T23:06:31.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.105+0000 7f27a521d640 1 -- 172.21.15.164:0/4192167370 learned_addr learned my addr 172.21.15.164:0/4192167370 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.105+0000 7f27a521d640 1 -- 172.21.15.164:0/4192167370 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b964aeafe0 con 0x55b964c3d710 2024-09-13T23:06:31.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.105+0000 7f27a521d640 1 --2- 172.21.15.164:0/4192167370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964c3d710 0x55b964d342c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x55b964d2d710 tx=0x7f2798000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.105+0000 7f2691e03640 1 -- 172.21.15.164:0/4192167370 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f279801a7c0 con 0x55b964c3d710 2024-09-13T23:06:31.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.105+0000 7f2691e03640 1 -- 172.21.15.164:0/4192167370 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f279801a960 con 0x55b964c3d710 2024-09-13T23:06:31.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.105+0000 7f2691e03640 1 -- 172.21.15.164:0/4192167370 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f279801ac60 con 0x55b964c3d710 2024-09-13T23:06:31.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.105+0000 7f27a9526800 1 -- 172.21.15.164:0/4192167370 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b964d34800 con 0x55b964c3d710 2024-09-13T23:06:31.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.105+0000 7f27a9526800 1 -- 172.21.15.164:0/4192167370 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b964d34d20 con 0x55b964c3d710 2024-09-13T23:06:31.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.106+0000 7f2691e03640 1 -- 172.21.15.164:0/4192167370 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2798017070 con 0x55b964c3d710 2024-09-13T23:06:31.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.106+0000 7f2691e03640 1 --2- 172.21.15.164:0/4192167370 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f268c036b90 0x7f268c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.106+0000 7f2691e03640 1 -- 172.21.15.164:0/4192167370 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2798015020 con 0x55b964c3d710 2024-09-13T23:06:31.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.106+0000 7f279ca1c640 1 --2- 172.21.15.164:0/4192167370 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f268c036b90 0x7f268c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.107+0000 7f27a9526800 1 --2- 172.21.15.164:0/4192167370 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b964c41a10 0x55b964d3b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.107+0000 7f27a9526800 1 -- 172.21.15.164:0/4192167370 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b964d3b8b0 con 0x55b964c41a10 2024-09-13T23:06:31.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.107+0000 7f27a5a1e640 1 --2- 172.21.15.164:0/4192167370 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b964c41a10 0x55b964d3b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.107+0000 7f279ca1c640 1 --2- 172.21.15.164:0/4192167370 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f268c036b90 0x7f268c039050 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2790057000 tx=0x7f2790052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.107+0000 7f27a5a1e640 1 --2- 172.21.15.164:0/4192167370 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b964c41a10 0x55b964d3b330 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.107+0000 7f27a5a1e640 1 -- 172.21.15.164:0/4192167370 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27a000a4a0 con 0x55b964c41a10 2024-09-13T23:06:31.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.107+0000 7f27a9526800 1 -- 172.21.15.164:0/4192167370 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b964d38900 con 0x55b964c41a10 2024-09-13T23:06:31.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.108+0000 7f27a5a1e640 1 -- 172.21.15.164:0/4192167370 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f27a000a4a0 con 0x55b964c41a10 2024-09-13T23:06:31.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.108+0000 7f27a9526800 1 -- 172.21.15.164:0/4192167370 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b964d3d6b0 con 0x55b964c41a10 2024-09-13T23:06:31.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.108+0000 7f27a5a1e640 1 -- 172.21.15.164:0/4192167370 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f27a000a4a0 con 0x55b964c41a10 2024-09-13T23:06:31.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.108+0000 7f27a9526800 1 -- 172.21.15.164:0/4192167370 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b964d3c7f0 con 0x55b964c41a10 2024-09-13T23:06:31.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.108+0000 7f27a5a1e640 1 -- 172.21.15.164:0/4192167370 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f27a000a4a0 con 0x55b964c41a10 2024-09-13T23:06:31.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.108+0000 7f27a9526800 1 -- 172.21.15.164:0/4192167370 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b964d3cc40 con 0x55b964c41a10 2024-09-13T23:06:31.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.108+0000 7f27a5a1e640 1 -- 172.21.15.164:0/4192167370 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f27a000a4a0 con 0x55b964c41a10 2024-09-13T23:06:31.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.109+0000 7f27a9526800 1 Processor -- start 2024-09-13T23:06:31.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.109+0000 7f27a9526800 1 -- start start 2024-09-13T23:06:31.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.109+0000 7f27a9526800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964d4bca0 0x55b964d4c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.109+0000 7f27a9526800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b964ad8580 con 0x55b964d4bca0 2024-09-13T23:06:31.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.109+0000 7f279ca1c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964d4bca0 0x55b964d4c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.109+0000 7f279ca1c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964d4bca0 0x55b964d4c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44672/0 (socket says 172.21.15.164:44672) 2024-09-13T23:06:31.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.109+0000 7f279ca1c640 1 -- 172.21.15.164:0/1339813845 learned_addr learned my addr 172.21.15.164:0/1339813845 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.110+0000 7f279ca1c640 1 -- 172.21.15.164:0/1339813845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b964d4c600 con 0x55b964d4bca0 2024-09-13T23:06:31.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.110+0000 7f279ca1c640 1 --2- 172.21.15.164:0/1339813845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964d4bca0 0x55b964d4c0c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f2790000c00 tx=0x7f2790002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.110+0000 7f268affd640 1 -- 172.21.15.164:0/1339813845 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f279005ba50 con 0x55b964d4bca0 2024-09-13T23:06:31.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.110+0000 7f268affd640 1 -- 172.21.15.164:0/1339813845 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f279005bbf0 con 0x55b964d4bca0 2024-09-13T23:06:31.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.110+0000 7f27a9526800 1 -- 172.21.15.164:0/1339813845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b964d4c830 con 0x55b964d4bca0 2024-09-13T23:06:31.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.110+0000 7f268affd640 1 -- 172.21.15.164:0/1339813845 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2790073440 con 0x55b964d4bca0 2024-09-13T23:06:31.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.110+0000 7f27a9526800 1 -- 172.21.15.164:0/1339813845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b964d4f4b0 con 0x55b964d4bca0 2024-09-13T23:06:31.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.111+0000 7f268affd640 1 -- 172.21.15.164:0/1339813845 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2790058070 con 0x55b964d4bca0 2024-09-13T23:06:31.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.112+0000 7f268affd640 1 --2- 172.21.15.164:0/1339813845 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2680036b90 0x7f2680039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.112+0000 7f268affd640 1 -- 172.21.15.164:0/1339813845 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2790062030 con 0x55b964d4bca0 2024-09-13T23:06:31.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.112+0000 7f27a5a1e640 1 --2- 172.21.15.164:0/1339813845 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2680036b90 0x7f2680039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.112+0000 7f27a9526800 1 Processor -- start 2024-09-13T23:06:31.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.112+0000 7f27a5a1e640 1 --2- 172.21.15.164:0/1339813845 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2680036b90 0x7f2680039050 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55b964d3c310 tx=0x7f27a0005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.112+0000 7f27a9526800 1 -- start start 2024-09-13T23:06:31.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.112+0000 7f27a9526800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964d588b0 0x55b964d58cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.112+0000 7f27a9526800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b964d2d060 con 0x55b964d588b0 2024-09-13T23:06:31.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.113+0000 7f279ca1c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964d588b0 0x55b964d58cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.113+0000 7f279ca1c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964d588b0 0x55b964d58cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44686/0 (socket says 172.21.15.164:44686) 2024-09-13T23:06:31.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.113+0000 7f279ca1c640 1 -- 172.21.15.164:0/2646007831 learned_addr learned my addr 172.21.15.164:0/2646007831 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.114+0000 7f279ca1c640 1 -- 172.21.15.164:0/2646007831 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b964d59280 con 0x55b964d588b0 2024-09-13T23:06:31.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.115+0000 7f279ca1c640 1 --2- 172.21.15.164:0/2646007831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964d588b0 0x55b964d58cb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f2790091330 tx=0x7f2790066630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d139cb690de6862 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.115+0000 7f2688ff9640 1 -- 172.21.15.164:0/2646007831 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2790069420 con 0x55b964d588b0 2024-09-13T23:06:31.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.115+0000 7f2688ff9640 1 -- 172.21.15.164:0/2646007831 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27900503e0 con 0x55b964d588b0 2024-09-13T23:06:31.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.115+0000 7f2688ff9640 1 -- 172.21.15.164:0/2646007831 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27900695c0 con 0x55b964d588b0 2024-09-13T23:06:31.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.116+0000 7f27a9526800 1 -- 172.21.15.164:0/2646007831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964d588b0 msgr2=0x55b964d58cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.116+0000 7f27a9526800 1 --2- 172.21.15.164:0/2646007831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964d588b0 0x55b964d58cb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f2790091330 tx=0x7f2790066630 comp rx=0 tx=0).stop 2024-09-13T23:06:31.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.116+0000 7f27a9526800 1 -- 172.21.15.164:0/2646007831 shutdown_connections 2024-09-13T23:06:31.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.116+0000 7f27a9526800 1 --2- 172.21.15.164:0/2646007831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964d588b0 0x55b964d58cb0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.116+0000 7f27a9526800 1 -- 172.21.15.164:0/2646007831 >> 172.21.15.164:0/2646007831 conn(0x55b964d54c10 msgr2=0x55b964d52d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.116+0000 7f27a9526800 1 -- 172.21.15.164:0/2646007831 shutdown_connections 2024-09-13T23:06:31.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.116+0000 7f27a9526800 1 -- 172.21.15.164:0/2646007831 wait complete. 2024-09-13T23:06:31.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.116+0000 7f27a9526800 1 Processor -- start 2024-09-13T23:06:31.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.116+0000 7f27a9526800 1 -- start start 2024-09-13T23:06:31.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.117+0000 7f27a9526800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964d588b0 0x55b964d5fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.117+0000 7f27a9526800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b964d598f0 con 0x55b964d588b0 2024-09-13T23:06:31.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.117+0000 7f279ca1c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964d588b0 0x55b964d5fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.117+0000 7f279ca1c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964d588b0 0x55b964d5fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44702/0 (socket says 172.21.15.164:44702) 2024-09-13T23:06:31.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.117+0000 7f279ca1c640 1 -- 172.21.15.164:0/2924180142 learned_addr learned my addr 172.21.15.164:0/2924180142 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.118+0000 7f279ca1c640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b964d60330 con 0x55b964d588b0 2024-09-13T23:06:31.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.118+0000 7f279ca1c640 1 --2- 172.21.15.164:0/2924180142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964d588b0 0x55b964d5fdf0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f2790066b40 tx=0x7f2790091290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.118+0000 7f2676ffd640 1 -- 172.21.15.164:0/2924180142 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2790072de0 con 0x55b964d588b0 2024-09-13T23:06:31.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.118+0000 7f2676ffd640 1 -- 172.21.15.164:0/2924180142 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f279007c620 con 0x55b964d588b0 2024-09-13T23:06:31.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.118+0000 7f2676ffd640 1 -- 172.21.15.164:0/2924180142 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f279007c920 con 0x55b964d588b0 2024-09-13T23:06:31.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.118+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b964d605c0 con 0x55b964d588b0 2024-09-13T23:06:31.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.118+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b964d63270 con 0x55b964d588b0 2024-09-13T23:06:31.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.119+0000 7f2676ffd640 1 -- 172.21.15.164:0/2924180142 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2790083020 con 0x55b964d588b0 2024-09-13T23:06:31.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.119+0000 7f2676ffd640 1 --2- 172.21.15.164:0/2924180142 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2670036b40 0x7f2670039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.119+0000 7f2676ffd640 1 -- 172.21.15.164:0/2924180142 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f27900a4d10 con 0x55b964d588b0 2024-09-13T23:06:31.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.119+0000 7f27a5a1e640 1 --2- 172.21.15.164:0/2924180142 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2670036b40 0x7f2670039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.119+0000 7f27a9526800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.119+0000 7f27a9526800 1 --2- 172.21.15.164:0/2924180142 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b964d6b860 0x55b964d6dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.119+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b964d6e470 con 0x55b964d6b860 2024-09-13T23:06:31.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.119+0000 7f27a521d640 1 --2- 172.21.15.164:0/2924180142 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b964d6b860 0x55b964d6dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.120+0000 7f27a5a1e640 1 --2- 172.21.15.164:0/2924180142 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2670036b40 0x7f2670039000 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55b964d354e0 tx=0x7f27a001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.120+0000 7f27a521d640 1 --2- 172.21.15.164:0/2924180142 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b964d6b860 0x55b964d6dd20 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.120+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f279802e070 con 0x55b964d6b860 2024-09-13T23:06:31.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.120+0000 7f27a9526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.120+0000 7f27a9526800 20 realm 2024-09-13T23:06:31.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.120+0000 7f27a9526800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.120+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b964d6e880 con 0x55b964d6b860 2024-09-13T23:06:31.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.120+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f279802e070 con 0x55b964d6b860 2024-09-13T23:06:31.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.120+0000 7f27a9526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.120+0000 7f27a9526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:06:31.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.120+0000 7f27a9526800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.120+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b964d6f150 con 0x55b964d6b860 2024-09-13T23:06:31.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.120+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f279802e070 con 0x55b964d6b860 2024-09-13T23:06:31.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.120+0000 7f27a9526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.120+0000 7f27a9526800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.120+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b964d6f4f0 con 0x55b964d6b860 2024-09-13T23:06:31.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.121+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f279802e070 con 0x55b964d6b860 2024-09-13T23:06:31.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.121+0000 7f27a9526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:06:31.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.121+0000 7f27a9526800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.121+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b964d6eda0 con 0x55b964d6b860 2024-09-13T23:06:31.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.121+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f279802e070 con 0x55b964d6b860 2024-09-13T23:06:31.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.121+0000 7f27a9526800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:06:31.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.121+0000 7f27a9526800 20 searching for the correct realm 2024-09-13T23:06:31.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.121+0000 7f27a9526800 1 --2- 172.21.15.164:0/2924180142 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55b964d71940 0x55b964d73d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.121+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x55b964d71940 2024-09-13T23:06:31.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.121+0000 7f279ca1c640 1 --2- 172.21.15.164:0/2924180142 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55b964d71940 0x55b964d73d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.121+0000 7f279ca1c640 1 --2- 172.21.15.164:0/2924180142 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55b964d71940 0x55b964d73d30 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.122+0000 7f279ca1c640 1 -- 172.21.15.164:0/2924180142 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2790079020 con 0x55b964d71940 2024-09-13T23:06:31.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.122+0000 7f279ca1c640 1 --2- 172.21.15.164:0/2924180142 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f27900723e0 0x7f27900a64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.122+0000 7f279ca1c640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x7f27900723e0 2024-09-13T23:06:31.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.122+0000 7f27a5a1e640 1 --2- 172.21.15.164:0/2924180142 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f27900723e0 0x7f27900a64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.122+0000 7f27a5a1e640 1 --2- 172.21.15.164:0/2924180142 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f27900723e0 0x7f27900a64a0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.122+0000 7f27a5a1e640 1 -- 172.21.15.164:0/2924180142 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27a001f070 con 0x7f27900723e0 2024-09-13T23:06:31.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.122+0000 7f27a5a1e640 1 --2- 172.21.15.164:0/2924180142 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f27a0031040 0x7f27a0032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.122+0000 7f27a5a1e640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x7f27a0031040 2024-09-13T23:06:31.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.123+0000 7f27a521d640 1 --2- 172.21.15.164:0/2924180142 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f27a0031040 0x7f27a0032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.123+0000 7f27a521d640 1 --2- 172.21.15.164:0/2924180142 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f27a0031040 0x7f27a0032940 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.124+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f279802e070 con 0x7f27a0031040 2024-09-13T23:06:31.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.124+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x55b964d6b860 2024-09-13T23:06:31.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.124+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f279802e070 con 0x55b964d6b860 2024-09-13T23:06:31.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.124+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x55b964d6b860 2024-09-13T23:06:31.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.124+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f279802e070 con 0x55b964d6b860 2024-09-13T23:06:31.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.124+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x7f27a0031040 2024-09-13T23:06:31.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.124+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f279802e070 con 0x7f27a0031040 2024-09-13T23:06:31.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.124+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x7f27a0031040 2024-09-13T23:06:31.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.124+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f279802e070 con 0x7f27a0031040 2024-09-13T23:06:31.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.124+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x7f27900723e0 2024-09-13T23:06:31.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.125+0000 7f27a5a1e640 1 -- 172.21.15.164:0/2924180142 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27a001f070 con 0x7f27900723e0 2024-09-13T23:06:31.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.125+0000 7f27a5a1e640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x55b964d71940 2024-09-13T23:06:31.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.125+0000 7f279ca1c640 1 -- 172.21.15.164:0/2924180142 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2790079020 con 0x55b964d71940 2024-09-13T23:06:31.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.125+0000 7f279ca1c640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x55b964d6b860 2024-09-13T23:06:31.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.125+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f279802e070 con 0x55b964d6b860 2024-09-13T23:06:31.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.125+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x7f27a0031040 2024-09-13T23:06:31.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.125+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f279802e070 con 0x7f27a0031040 2024-09-13T23:06:31.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.125+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x55b964d6b860 2024-09-13T23:06:31.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.126+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f279802e070 con 0x55b964d6b860 2024-09-13T23:06:31.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.126+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x7f27900723e0 2024-09-13T23:06:31.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.126+0000 7f27a5a1e640 1 -- 172.21.15.164:0/2924180142 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f27a001f070 con 0x7f27900723e0 2024-09-13T23:06:31.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.126+0000 7f27a5a1e640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x55b964d71940 2024-09-13T23:06:31.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.126+0000 7f279ca1c640 1 -- 172.21.15.164:0/2924180142 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2790079020 con 0x55b964d71940 2024-09-13T23:06:31.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.126+0000 7f279ca1c640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x55b964d71940 2024-09-13T23:06:31.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.126+0000 7f279ca1c640 1 -- 172.21.15.164:0/2924180142 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2790079020 con 0x55b964d71940 2024-09-13T23:06:31.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.126+0000 7f279ca1c640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x7f27a0031040 2024-09-13T23:06:31.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.127+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f279802e070 con 0x7f27a0031040 2024-09-13T23:06:31.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.127+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x55b964d71940 2024-09-13T23:06:31.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.127+0000 7f279ca1c640 1 -- 172.21.15.164:0/2924180142 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2790079020 con 0x55b964d71940 2024-09-13T23:06:31.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.127+0000 7f279ca1c640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x55b964d71940 2024-09-13T23:06:31.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.127+0000 7f279ca1c640 1 -- 172.21.15.164:0/2924180142 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2790079020 con 0x55b964d71940 2024-09-13T23:06:31.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.127+0000 7f279ca1c640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x55b964d6b860 2024-09-13T23:06:31.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.127+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f279802e070 con 0x55b964d6b860 2024-09-13T23:06:31.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.127+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x55b964d6b860 2024-09-13T23:06:31.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.128+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f279802e070 con 0x55b964d6b860 2024-09-13T23:06:31.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.128+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x7f27a0031040 2024-09-13T23:06:31.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.128+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f279802e070 con 0x7f27a0031040 2024-09-13T23:06:31.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.128+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x55b964d71940 2024-09-13T23:06:31.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.128+0000 7f279ca1c640 1 -- 172.21.15.164:0/2924180142 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2790079020 con 0x55b964d71940 2024-09-13T23:06:31.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.128+0000 7f279ca1c640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x7f27900723e0 2024-09-13T23:06:31.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.128+0000 7f27a5a1e640 1 -- 172.21.15.164:0/2924180142 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27a001f070 con 0x7f27900723e0 2024-09-13T23:06:31.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.128+0000 7f27a5a1e640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x55b964d6b860 2024-09-13T23:06:31.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.129+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f279802e070 con 0x55b964d6b860 2024-09-13T23:06:31.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.129+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x7f27a0031040 2024-09-13T23:06:31.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.129+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f279802e070 con 0x7f27a0031040 2024-09-13T23:06:31.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.129+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x55b964d71940 2024-09-13T23:06:31.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.129+0000 7f279ca1c640 1 -- 172.21.15.164:0/2924180142 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2790079020 con 0x55b964d71940 2024-09-13T23:06:31.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.129+0000 7f279ca1c640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x7f27a0031040 2024-09-13T23:06:31.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.129+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f279802e070 con 0x7f27a0031040 2024-09-13T23:06:31.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.130+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x7f27900723e0 2024-09-13T23:06:31.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.130+0000 7f27a5a1e640 1 -- 172.21.15.164:0/2924180142 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27a001f070 con 0x7f27900723e0 2024-09-13T23:06:31.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.130+0000 7f27a5a1e640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x55b964d71940 2024-09-13T23:06:31.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.130+0000 7f279ca1c640 1 -- 172.21.15.164:0/2924180142 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2790079020 con 0x55b964d71940 2024-09-13T23:06:31.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.130+0000 7f279ca1c640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x7f27900723e0 2024-09-13T23:06:31.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.130+0000 7f27a5a1e640 1 -- 172.21.15.164:0/2924180142 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27a001f070 con 0x7f27900723e0 2024-09-13T23:06:31.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.130+0000 7f27a5a1e640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x55b964d6b860 2024-09-13T23:06:31.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.130+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f279802e070 con 0x55b964d6b860 2024-09-13T23:06:31.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.130+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74400 con 0x7f27900723e0 2024-09-13T23:06:31.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.131+0000 7f27a5a1e640 1 -- 172.21.15.164:0/2924180142 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27a0040040 con 0x7f27900723e0 2024-09-13T23:06:31.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.131+0000 7f27a9526800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:06:31.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.131+0000 7f27a9526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:06:31.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.131+0000 7f27a9526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:06:31.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.131+0000 7f27a9526800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:06:31.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.131+0000 7f27a9526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:06:31.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.131+0000 7f27a9526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:06:31.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.131+0000 7f27a9526800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.131+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b964d70410 con 0x55b964d6b860 2024-09-13T23:06:31.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.131+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f279802e070 con 0x55b964d6b860 2024-09-13T23:06:31.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.131+0000 7f27a9526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.131+0000 7f27a9526800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.131+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b964d70cb0 con 0x55b964d6b860 2024-09-13T23:06:31.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.131+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f279802e070 con 0x55b964d6b860 2024-09-13T23:06:31.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.131+0000 7f27a9526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:06:31.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.131+0000 7f27a9526800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.131+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b964d70050 con 0x55b964d6b860 2024-09-13T23:06:31.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.131+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f279802e070 con 0x55b964d6b860 2024-09-13T23:06:31.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.131+0000 7f27a9526800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:06:31.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.131+0000 7f27a9526800 20 zone default found 2024-09-13T23:06:31.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.131+0000 7f27a9526800 4 Realm: () 2024-09-13T23:06:31.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.131+0000 7f27a9526800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:06:31.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.131+0000 7f27a9526800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:06:31.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.131+0000 7f27a9526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:06:31.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.131+0000 7f27a9526800 20 zonegroup default 2024-09-13T23:06:31.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.131+0000 7f27a9526800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.131+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b964d74d30 con 0x7f27a0031040 2024-09-13T23:06:31.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.132+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f279802e070 con 0x7f27a0031040 2024-09-13T23:06:31.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.132+0000 7f27a9526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.132+0000 7f27a9526800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.132+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b964d76800 con 0x55b964d71940 2024-09-13T23:06:31.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.132+0000 7f279ca1c640 1 -- 172.21.15.164:0/2924180142 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2790079020 con 0x55b964d71940 2024-09-13T23:06:31.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.132+0000 7f27a9526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.132+0000 7f27a9526800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.132+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b964d76cc0 con 0x55b964d71940 2024-09-13T23:06:31.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.132+0000 7f279ca1c640 1 -- 172.21.15.164:0/2924180142 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2790079020 con 0x55b964d71940 2024-09-13T23:06:31.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.132+0000 7f27a9526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.132+0000 7f27a9526800 20 started sync module instance, tier type = 2024-09-13T23:06:31.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.132+0000 7f27a9526800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:06:31.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.132+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b964d76330 con 0x7f27900723e0 2024-09-13T23:06:31.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.133+0000 7f27a5a1e640 1 -- 172.21.15.164:0/2924180142 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27a0040040 con 0x7f27900723e0 2024-09-13T23:06:31.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.133+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94254749145008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b964d77120 con 0x7f27900723e0 2024-09-13T23:06:31.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.133+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b964d77b90 con 0x55b964d6b860 2024-09-13T23:06:31.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.134+0000 7f27a5a1e640 1 -- 172.21.15.164:0/2924180142 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94254749145008] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27a0040040 con 0x7f27900723e0 2024-09-13T23:06:31.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.135+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f279802e070 con 0x55b964d6b860 2024-09-13T23:06:31.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.135+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94254749152896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b964d77b50 con 0x55b964d6b860 2024-09-13T23:06:31.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.135+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b964d78630 con 0x55b964d71940 2024-09-13T23:06:31.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.136+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94254749152896] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f279802e070 con 0x55b964d6b860 2024-09-13T23:06:31.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.136+0000 7f279ca1c640 1 -- 172.21.15.164:0/2924180142 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2790079020 con 0x55b964d71940 2024-09-13T23:06:31.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.136+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94254749155616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b964d78a50 con 0x55b964d71940 2024-09-13T23:06:31.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.136+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b964d79450 con 0x7f27900723e0 2024-09-13T23:06:31.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.137+0000 7f27a5a1e640 1 -- 172.21.15.164:0/2924180142 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27a0040040 con 0x7f27900723e0 2024-09-13T23:06:31.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.137+0000 7f279ca1c640 1 -- 172.21.15.164:0/2924180142 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94254749155616] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2790079020 con 0x55b964d71940 2024-09-13T23:06:31.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.137+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94254749159264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b964d79cf0 con 0x7f27900723e0 2024-09-13T23:06:31.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.137+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b964d75ca0 con 0x55b964d6b860 2024-09-13T23:06:31.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.138+0000 7f27a5a1e640 1 -- 172.21.15.164:0/2924180142 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94254749159264] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27a0040040 con 0x7f27900723e0 2024-09-13T23:06:31.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.138+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f279802e070 con 0x55b964d6b860 2024-09-13T23:06:31.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.138+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94254749161536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b964d79c60 con 0x55b964d6b860 2024-09-13T23:06:31.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.138+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b964d7ad50 con 0x7f27a0031040 2024-09-13T23:06:31.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.140+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94254749161536] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f279802e070 con 0x55b964d6b860 2024-09-13T23:06:31.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.140+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f279802e070 con 0x7f27a0031040 2024-09-13T23:06:31.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.140+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94254749164160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b964d7ad50 con 0x7f27a0031040 2024-09-13T23:06:31.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.140+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b964d7b760 con 0x7f27a0031040 2024-09-13T23:06:31.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.141+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94254749164160] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f279802e070 con 0x7f27a0031040 2024-09-13T23:06:31.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.141+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f279802e070 con 0x7f27a0031040 2024-09-13T23:06:31.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.141+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94254749166000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b964d7b760 con 0x7f27a0031040 2024-09-13T23:06:31.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.141+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b964d7c120 con 0x7f27a0031040 2024-09-13T23:06:31.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.142+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94254749166000] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f279802e070 con 0x7f27a0031040 2024-09-13T23:06:31.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.142+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f279802e070 con 0x7f27a0031040 2024-09-13T23:06:31.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.142+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94254749168784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b964d7c120 con 0x7f27a0031040 2024-09-13T23:06:31.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.142+0000 7f27a9526800 20 add_watcher() i=0 2024-09-13T23:06:31.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.142+0000 7f27a9526800 20 add_watcher() i=1 2024-09-13T23:06:31.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.142+0000 7f27a9526800 20 add_watcher() i=2 2024-09-13T23:06:31.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.142+0000 7f27a9526800 20 add_watcher() i=3 2024-09-13T23:06:31.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.142+0000 7f27a9526800 20 add_watcher() i=4 2024-09-13T23:06:31.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.142+0000 7f27a9526800 20 add_watcher() i=5 2024-09-13T23:06:31.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.142+0000 7f27a9526800 20 add_watcher() i=6 2024-09-13T23:06:31.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.143+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94254749168784] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f279802e070 con 0x7f27a0031040 2024-09-13T23:06:31.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.143+0000 7f27a9526800 20 add_watcher() i=7 2024-09-13T23:06:31.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.143+0000 7f27a9526800 2 all 8 watchers are set, enabling cache 2024-09-13T23:06:31.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.143+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b964d7f450 con 0x55b964d6b860 2024-09-13T23:06:31.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.143+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f279802e070 con 0x55b964d6b860 2024-09-13T23:06:31.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.143+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94254749183616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b964d7c290 con 0x55b964d6b860 2024-09-13T23:06:31.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.144+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94254749183616] v34'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f279802e070 con 0x55b964d6b860 2024-09-13T23:06:31.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.144+0000 7f265b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:06:31.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.144+0000 7f27a9526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:06:31.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.144+0000 7f27a9526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:06:31.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.144+0000 7f27a9526800 5 note: GC not initialized 2024-09-13T23:06:31.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.145+0000 7f265a7e4640 20 reqs_thread_entry: start 2024-09-13T23:06:31.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.145+0000 7f27a9526800 20 init_complete bucket index max shards: 11 2024-09-13T23:06:31.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.145+0000 7f27a9526800 20 Filter name: none 2024-09-13T23:06:31.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.145+0000 7f25cbfff640 20 reqs_thread_entry: start 2024-09-13T23:06:31.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.145+0000 7f27a9526800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.145+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b964db2420 con 0x55b964d6b860 2024-09-13T23:06:31.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.145+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f279802e070 con 0x55b964d6b860 2024-09-13T23:06:31.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.145+0000 7f27a9526800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:06:31.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.145+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b964db3970 con 0x7f27a0031040 2024-09-13T23:06:31.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.146+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f279802e070 con 0x7f27a0031040 2024-09-13T23:06:31.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.147+0000 7f265b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:06:31.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.147+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94254749183616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b964d68f80 con 0x55b964d6b860 2024-09-13T23:06:31.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.148+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94254749183616] v34'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f279802e070 con 0x55b964d6b860 2024-09-13T23:06:31.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.148+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94254749145008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b964d68f80 con 0x7f27900723e0 2024-09-13T23:06:31.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.149+0000 7f27a5a1e640 1 -- 172.21.15.164:0/2924180142 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94254749145008] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27a0040040 con 0x7f27900723e0 2024-09-13T23:06:31.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.149+0000 7f27a9526800 20 remove_watcher() i=0 2024-09-13T23:06:31.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.149+0000 7f27a9526800 2 removed watcher, disabling cache 2024-09-13T23:06:31.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.149+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94254749152896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b964d757b0 con 0x55b964d6b860 2024-09-13T23:06:31.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.150+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94254749152896] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f279802e070 con 0x55b964d6b860 2024-09-13T23:06:31.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.150+0000 7f27a9526800 20 remove_watcher() i=1 2024-09-13T23:06:31.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.150+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94254749155616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b964d757b0 con 0x55b964d71940 2024-09-13T23:06:31.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.151+0000 7f279ca1c640 1 -- 172.21.15.164:0/2924180142 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94254749155616] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2790079020 con 0x55b964d71940 2024-09-13T23:06:31.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.151+0000 7f27a9526800 20 remove_watcher() i=2 2024-09-13T23:06:31.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.151+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94254749159264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b964d78120 con 0x7f27900723e0 2024-09-13T23:06:31.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.152+0000 7f27a5a1e640 1 -- 172.21.15.164:0/2924180142 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94254749159264] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27a0040040 con 0x7f27900723e0 2024-09-13T23:06:31.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.152+0000 7f27a9526800 20 remove_watcher() i=3 2024-09-13T23:06:31.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.152+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94254749161536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b964d78120 con 0x55b964d6b860 2024-09-13T23:06:31.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.153+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94254749161536] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f279802e070 con 0x55b964d6b860 2024-09-13T23:06:31.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.153+0000 7f27a9526800 20 remove_watcher() i=4 2024-09-13T23:06:31.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.153+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94254749164160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b964d79840 con 0x7f27a0031040 2024-09-13T23:06:31.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.155+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94254749164160] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f279802e070 con 0x7f27a0031040 2024-09-13T23:06:31.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.155+0000 7f27a9526800 20 remove_watcher() i=5 2024-09-13T23:06:31.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.155+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94254749166000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b964d79840 con 0x7f27a0031040 2024-09-13T23:06:31.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.156+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94254749166000] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f279802e070 con 0x7f27a0031040 2024-09-13T23:06:31.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.156+0000 7f27a9526800 20 remove_watcher() i=6 2024-09-13T23:06:31.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.156+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94254749168784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b964d79840 con 0x7f27a0031040 2024-09-13T23:06:31.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.157+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94254749168784] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f279802e070 con 0x7f27a0031040 2024-09-13T23:06:31.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.157+0000 7f27a9526800 20 remove_watcher() i=7 2024-09-13T23:06:31.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.158+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f27a0031040 msgr2=0x7f27a0032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.158+0000 7f27a9526800 1 --2- 172.21.15.164:0/2924180142 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f27a0031040 0x7f27a0032940 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.158+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b964d6b860 msgr2=0x55b964d6dd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.158+0000 7f27a9526800 1 --2- 172.21.15.164:0/2924180142 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b964d6b860 0x55b964d6dd20 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.158+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f27900723e0 msgr2=0x7f27900a64a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.158+0000 7f27a9526800 1 --2- 172.21.15.164:0/2924180142 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f27900723e0 0x7f27900a64a0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.158+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55b964d71940 msgr2=0x55b964d73d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.158+0000 7f27a9526800 1 --2- 172.21.15.164:0/2924180142 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55b964d71940 0x55b964d73d30 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.158+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2670036b40 msgr2=0x7f2670039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.158+0000 7f27a9526800 1 --2- 172.21.15.164:0/2924180142 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2670036b40 0x7f2670039000 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55b964d354e0 tx=0x7f27a001f000 comp rx=0 tx=0).stop 2024-09-13T23:06:31.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.158+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964d588b0 msgr2=0x55b964d5fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.158+0000 7f27a521d640 1 -- 172.21.15.164:0/2924180142 reap_dead start 2024-09-13T23:06:31.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.158+0000 7f27a9526800 1 --2- 172.21.15.164:0/2924180142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964d588b0 0x55b964d5fdf0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f2790066b40 tx=0x7f2790091290 comp rx=0 tx=0).stop 2024-09-13T23:06:31.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.158+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 shutdown_connections 2024-09-13T23:06:31.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.158+0000 7f27a9526800 1 --2- 172.21.15.164:0/2924180142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964d588b0 0x55b964d5fdf0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.158+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 >> 172.21.15.164:0/2924180142 conn(0x55b964d54c10 msgr2=0x55b964d52ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.158+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 shutdown_connections 2024-09-13T23:06:31.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.158+0000 7f27a9526800 1 -- 172.21.15.164:0/2924180142 wait complete. 2024-09-13T23:06:31.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.158+0000 7f27a9526800 1 -- 172.21.15.164:0/1339813845 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2680036b90 msgr2=0x7f2680039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.158+0000 7f27a9526800 1 --2- 172.21.15.164:0/1339813845 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2680036b90 0x7f2680039050 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55b964d3c310 tx=0x7f27a0005840 comp rx=0 tx=0).stop 2024-09-13T23:06:31.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.158+0000 7f27a9526800 1 -- 172.21.15.164:0/1339813845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964d4bca0 msgr2=0x55b964d4c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.158+0000 7f27a9526800 1 --2- 172.21.15.164:0/1339813845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964d4bca0 0x55b964d4c0c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f2790000c00 tx=0x7f2790002fb0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.158+0000 7f27a9526800 1 -- 172.21.15.164:0/1339813845 shutdown_connections 2024-09-13T23:06:31.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.158+0000 7f27a9526800 1 --2- 172.21.15.164:0/1339813845 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2680036b90 0x7f2680039050 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.158+0000 7f27a9526800 1 --2- 172.21.15.164:0/1339813845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964d4bca0 0x55b964d4c0c0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.158+0000 7f27a9526800 1 -- 172.21.15.164:0/1339813845 >> 172.21.15.164:0/1339813845 conn(0x55b964d40c30 msgr2=0x55b964d437b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.158+0000 7f27a9526800 1 -- 172.21.15.164:0/1339813845 shutdown_connections 2024-09-13T23:06:31.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.158+0000 7f27a9526800 1 -- 172.21.15.164:0/1339813845 wait complete. 2024-09-13T23:06:31.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.159+0000 7f27a9526800 1 -- 172.21.15.164:0/4192167370 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b964c41a10 msgr2=0x55b964d3b330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.159+0000 7f27a9526800 1 --2- 172.21.15.164:0/4192167370 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b964c41a10 0x55b964d3b330 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.159+0000 7f27a9526800 1 -- 172.21.15.164:0/4192167370 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f268c036b90 msgr2=0x7f268c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.159+0000 7f27a9526800 1 --2- 172.21.15.164:0/4192167370 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f268c036b90 0x7f268c039050 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2790057000 tx=0x7f2790052000 comp rx=0 tx=0).stop 2024-09-13T23:06:31.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.159+0000 7f27a9526800 1 -- 172.21.15.164:0/4192167370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964c3d710 msgr2=0x55b964d342c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.159+0000 7f27a9526800 1 --2- 172.21.15.164:0/4192167370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964c3d710 0x55b964d342c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x55b964d2d710 tx=0x7f2798000ed0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.159+0000 7f27a9526800 1 -- 172.21.15.164:0/4192167370 shutdown_connections 2024-09-13T23:06:31.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.159+0000 7f27a9526800 1 --2- 172.21.15.164:0/4192167370 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b964c41a10 0x55b964d3b330 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.159+0000 7f27a9526800 1 --2- 172.21.15.164:0/4192167370 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f268c036b90 0x7f268c039050 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.159+0000 7f27a9526800 1 --2- 172.21.15.164:0/4192167370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b964c3d710 0x55b964d342c0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.159+0000 7f27a9526800 1 -- 172.21.15.164:0/4192167370 >> 172.21.15.164:0/4192167370 conn(0x55b964c38fe0 msgr2=0x55b964d26b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.159+0000 7f27a9526800 1 -- 172.21.15.164:0/4192167370 shutdown_connections 2024-09-13T23:06:31.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.159+0000 7f27a9526800 1 -- 172.21.15.164:0/4192167370 wait complete. 2024-09-13T23:06:31.168 INFO:teuthology.orchestra.run.smithi164.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2024-09-13T23:06:31.168 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-09-13T23:06:31.168 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-13T23:06:31.168 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-13T23:06:31.168 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-13T23:06:31.215 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:06:31.215 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:06:31.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.215+0000 7fdf03013800 1 Processor -- start 2024-09-13T23:06:31.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.215+0000 7fdf03013800 1 -- start start 2024-09-13T23:06:31.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.215+0000 7fdf03013800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5626fd2165b0 0x5626fd214d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.215+0000 7fdf03013800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5626fd15fb30 con 0x5626fd2169b0 2024-09-13T23:06:31.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.215+0000 7fdf03013800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x5626fd141360 con 0x5626fd2165b0 2024-09-13T23:06:31.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.216+0000 7fdefe73d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5626fd2165b0 0x5626fd214d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.216+0000 7fdefe73d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5626fd2165b0 0x5626fd214d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44710/0 (socket says 172.21.15.164:44710) 2024-09-13T23:06:31.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.216+0000 7fdefe73d640 1 -- 172.21.15.164:0/3007639085 learned_addr learned my addr 172.21.15.164:0/3007639085 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.216+0000 7fdefdf3c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x5626fd2169b0 0x5626fd2153a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:55946/0 (socket says 172.21.15.164:55946) 2024-09-13T23:06:31.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.216+0000 7fdefe73d640 1 -- 172.21.15.164:0/3007639085 >> v1:172.21.15.17:6789/0 conn(0x5626fd2169b0 legacy=0x5626fd2153a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.216+0000 7fdefe73d640 1 -- 172.21.15.164:0/3007639085 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626fd167e00 con 0x5626fd2165b0 2024-09-13T23:06:31.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.218+0000 7fdefe73d640 1 --2- 172.21.15.164:0/3007639085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd2165b0 0x5626fd214d90 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fdef000a520 tx=0x7fdef0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4238c6ad32153f88 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.218+0000 7fdefd73b640 1 -- 172.21.15.164:0/3007639085 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdef0055070 con 0x5626fd2165b0 2024-09-13T23:06:31.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.218+0000 7fdefd73b640 1 -- 172.21.15.164:0/3007639085 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef00515b0 con 0x5626fd2165b0 2024-09-13T23:06:31.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.218+0000 7fdefd73b640 1 -- 172.21.15.164:0/3007639085 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdef00518d0 con 0x5626fd2165b0 2024-09-13T23:06:31.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.218+0000 7fdf03013800 1 -- 172.21.15.164:0/3007639085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd2165b0 msgr2=0x5626fd214d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.218+0000 7fdf03013800 1 --2- 172.21.15.164:0/3007639085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd2165b0 0x5626fd214d90 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fdef000a520 tx=0x7fdef0045ba0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.218+0000 7fdf03013800 1 -- 172.21.15.164:0/3007639085 shutdown_connections 2024-09-13T23:06:31.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.218+0000 7fdf03013800 1 --2- 172.21.15.164:0/3007639085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd2165b0 0x5626fd214d90 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.218+0000 7fdf03013800 1 -- 172.21.15.164:0/3007639085 >> 172.21.15.164:0/3007639085 conn(0x5626fd29bfe0 msgr2=0x5626fd29e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.218+0000 7fdf03013800 1 -- 172.21.15.164:0/3007639085 shutdown_connections 2024-09-13T23:06:31.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.218+0000 7fdf03013800 1 -- 172.21.15.164:0/3007639085 wait complete. 2024-09-13T23:06:31.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.232+0000 7fdf03013800 1 Processor -- start 2024-09-13T23:06:31.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.232+0000 7fdf03013800 1 -- start start 2024-09-13T23:06:31.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.232+0000 7fdf03013800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd2165b0 0x5626fd391ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.232+0000 7fdf03013800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5626fd1ec360 con 0x5626fd2165b0 2024-09-13T23:06:31.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.233+0000 7fdefe73d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd2165b0 0x5626fd391ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.233+0000 7fdefe73d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd2165b0 0x5626fd391ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44718/0 (socket says 172.21.15.164:44718) 2024-09-13T23:06:31.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.233+0000 7fdefe73d640 1 -- 172.21.15.164:0/621321613 learned_addr learned my addr 172.21.15.164:0/621321613 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.233+0000 7fdefe73d640 1 -- 172.21.15.164:0/621321613 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626fd139bc0 con 0x5626fd2165b0 2024-09-13T23:06:31.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.233+0000 7fdefe73d640 1 --2- 172.21.15.164:0/621321613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd2165b0 0x5626fd391ae0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fdef0025da0 tx=0x7fdef0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b026360278b1a619 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.233+0000 7fddec608640 1 -- 172.21.15.164:0/621321613 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdef0051890 con 0x5626fd2165b0 2024-09-13T23:06:31.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.233+0000 7fddec608640 1 -- 172.21.15.164:0/621321613 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef0051ac0 con 0x5626fd2165b0 2024-09-13T23:06:31.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.233+0000 7fddec608640 1 -- 172.21.15.164:0/621321613 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdef0051da0 con 0x5626fd2165b0 2024-09-13T23:06:31.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.234+0000 7fdf03013800 1 -- 172.21.15.164:0/621321613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd2165b0 msgr2=0x5626fd391ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.234+0000 7fdf03013800 1 --2- 172.21.15.164:0/621321613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd2165b0 0x5626fd391ae0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fdef0025da0 tx=0x7fdef0051000 comp rx=0 tx=0).stop 2024-09-13T23:06:31.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.234+0000 7fdf03013800 1 -- 172.21.15.164:0/621321613 shutdown_connections 2024-09-13T23:06:31.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.234+0000 7fdf03013800 1 --2- 172.21.15.164:0/621321613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd2165b0 0x5626fd391ae0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.234+0000 7fdf03013800 1 -- 172.21.15.164:0/621321613 >> 172.21.15.164:0/621321613 conn(0x5626fd29bfe0 msgr2=0x5626fd38d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.234+0000 7fdf03013800 1 -- 172.21.15.164:0/621321613 shutdown_connections 2024-09-13T23:06:31.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.234+0000 7fdf03013800 1 -- 172.21.15.164:0/621321613 wait complete. 2024-09-13T23:06:31.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.234+0000 7fdf03013800 1 Processor -- start 2024-09-13T23:06:31.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.234+0000 7fdf03013800 1 -- start start 2024-09-13T23:06:31.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.235+0000 7fdf03013800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd2165b0 0x5626fd399300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.235+0000 7fdf03013800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5626fd2a9950 con 0x5626fd2165b0 2024-09-13T23:06:31.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.235+0000 7fdefe73d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd2165b0 0x5626fd399300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.235+0000 7fdefe73d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd2165b0 0x5626fd399300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44732/0 (socket says 172.21.15.164:44732) 2024-09-13T23:06:31.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.235+0000 7fdefe73d640 1 -- 172.21.15.164:0/1620777982 learned_addr learned my addr 172.21.15.164:0/1620777982 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.235+0000 7fdefe73d640 1 -- 172.21.15.164:0/1620777982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626fd14dfe0 con 0x5626fd2165b0 2024-09-13T23:06:31.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.235+0000 7fdefe73d640 1 --2- 172.21.15.164:0/1620777982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd2165b0 0x5626fd399300 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fdef0000c00 tx=0x7fdef0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.236+0000 7fddeae05640 1 -- 172.21.15.164:0/1620777982 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdef0073070 con 0x5626fd2165b0 2024-09-13T23:06:31.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.236+0000 7fddeae05640 1 -- 172.21.15.164:0/1620777982 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef005a450 con 0x5626fd2165b0 2024-09-13T23:06:31.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.236+0000 7fdf03013800 1 -- 172.21.15.164:0/1620777982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626fd399840 con 0x5626fd2165b0 2024-09-13T23:06:31.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.236+0000 7fddeae05640 1 -- 172.21.15.164:0/1620777982 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdef005a730 con 0x5626fd2165b0 2024-09-13T23:06:31.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.236+0000 7fdf03013800 1 -- 172.21.15.164:0/1620777982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626fd399dc0 con 0x5626fd2165b0 2024-09-13T23:06:31.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.236+0000 7fddeae05640 1 -- 172.21.15.164:0/1620777982 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdef0076070 con 0x5626fd2165b0 2024-09-13T23:06:31.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.237+0000 7fddeae05640 1 --2- 172.21.15.164:0/1620777982 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdde4036b90 0x7fdde4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.237+0000 7fddeae05640 1 -- 172.21.15.164:0/1620777982 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fdef0062070 con 0x5626fd2165b0 2024-09-13T23:06:31.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.237+0000 7fdefdf3c640 1 --2- 172.21.15.164:0/1620777982 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdde4036b90 0x7fdde4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.237+0000 7fdf03013800 1 --2- 172.21.15.164:0/1620777982 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5626fd39e360 0x5626fd3a0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.237+0000 7fdf03013800 1 -- 172.21.15.164:0/1620777982 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3a0d20 con 0x5626fd39e360 2024-09-13T23:06:31.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.237+0000 7fdefef3e640 1 --2- 172.21.15.164:0/1620777982 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5626fd39e360 0x5626fd3a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.237+0000 7fdefdf3c640 1 --2- 172.21.15.164:0/1620777982 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdde4036b90 0x7fdde4039050 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdef4000f60 tx=0x7fdef4001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.237+0000 7fdefef3e640 1 --2- 172.21.15.164:0/1620777982 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5626fd39e360 0x5626fd3a0750 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.238+0000 7fdefef3e640 1 -- 172.21.15.164:0/1620777982 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdef800a4a0 con 0x5626fd39e360 2024-09-13T23:06:31.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.238+0000 7fdf03013800 1 -- 172.21.15.164:0/1620777982 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626fd39d940 con 0x5626fd39e360 2024-09-13T23:06:31.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.238+0000 7fdefef3e640 1 -- 172.21.15.164:0/1620777982 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdef800a4a0 con 0x5626fd39e360 2024-09-13T23:06:31.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.238+0000 7fdf03013800 1 -- 172.21.15.164:0/1620777982 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3a2b60 con 0x5626fd39e360 2024-09-13T23:06:31.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.238+0000 7fdefef3e640 1 -- 172.21.15.164:0/1620777982 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdef800a4a0 con 0x5626fd39e360 2024-09-13T23:06:31.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.238+0000 7fdf03013800 1 -- 172.21.15.164:0/1620777982 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3a1ca0 con 0x5626fd39e360 2024-09-13T23:06:31.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.238+0000 7fdefef3e640 1 -- 172.21.15.164:0/1620777982 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdef800a4a0 con 0x5626fd39e360 2024-09-13T23:06:31.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.238+0000 7fdf03013800 1 -- 172.21.15.164:0/1620777982 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3a20f0 con 0x5626fd39e360 2024-09-13T23:06:31.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.239+0000 7fdefef3e640 1 -- 172.21.15.164:0/1620777982 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdef800a4a0 con 0x5626fd39e360 2024-09-13T23:06:31.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.239+0000 7fdf03013800 1 Processor -- start 2024-09-13T23:06:31.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.239+0000 7fdf03013800 1 -- start start 2024-09-13T23:06:31.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.239+0000 7fdf03013800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd3b1150 0x5626fd3b1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.239+0000 7fdf03013800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5626fd13b580 con 0x5626fd3b1150 2024-09-13T23:06:31.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.240+0000 7fdefdf3c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd3b1150 0x5626fd3b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.240+0000 7fdefdf3c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd3b1150 0x5626fd3b1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44738/0 (socket says 172.21.15.164:44738) 2024-09-13T23:06:31.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.240+0000 7fdefdf3c640 1 -- 172.21.15.164:0/4260751921 learned_addr learned my addr 172.21.15.164:0/4260751921 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.241+0000 7fdefdf3c640 1 -- 172.21.15.164:0/4260751921 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626fd3b1ab0 con 0x5626fd3b1150 2024-09-13T23:06:31.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.241+0000 7fdefdf3c640 1 --2- 172.21.15.164:0/4260751921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd3b1150 0x5626fd3b1570 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fdef4001ed0 tx=0x7fdef400ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.241+0000 7fdde3fff640 1 -- 172.21.15.164:0/4260751921 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdef4022070 con 0x5626fd3b1150 2024-09-13T23:06:31.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.241+0000 7fdde3fff640 1 -- 172.21.15.164:0/4260751921 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef400d520 con 0x5626fd3b1150 2024-09-13T23:06:31.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.241+0000 7fdf03013800 1 -- 172.21.15.164:0/4260751921 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626fd3b1d40 con 0x5626fd3b1150 2024-09-13T23:06:31.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.241+0000 7fdde3fff640 1 -- 172.21.15.164:0/4260751921 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdef400d800 con 0x5626fd3b1150 2024-09-13T23:06:31.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.242+0000 7fdf03013800 1 -- 172.21.15.164:0/4260751921 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626fd3b4a20 con 0x5626fd3b1150 2024-09-13T23:06:31.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.242+0000 7fdde3fff640 1 -- 172.21.15.164:0/4260751921 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdef4025070 con 0x5626fd3b1150 2024-09-13T23:06:31.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.242+0000 7fdde3fff640 1 --2- 172.21.15.164:0/4260751921 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fddd8036b90 0x7fddd8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.242+0000 7fdde3fff640 1 -- 172.21.15.164:0/4260751921 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fdef404e120 con 0x5626fd3b1150 2024-09-13T23:06:31.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.243+0000 7fdefef3e640 1 --2- 172.21.15.164:0/4260751921 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fddd8036b90 0x7fddd8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.243+0000 7fdf03013800 1 Processor -- start 2024-09-13T23:06:31.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.243+0000 7fdf03013800 1 -- start start 2024-09-13T23:06:31.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.243+0000 7fdefef3e640 1 --2- 172.21.15.164:0/4260751921 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fddd8036b90 0x7fddd8039050 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x5626fd3a17c0 tx=0x7fdef8005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.243+0000 7fdf03013800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd3bdde0 0x5626fd3be1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.243+0000 7fdf03013800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5626fd3921d0 con 0x5626fd3bdde0 2024-09-13T23:06:31.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.243+0000 7fdefdf3c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd3bdde0 0x5626fd3be1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.243+0000 7fdefdf3c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd3bdde0 0x5626fd3be1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44740/0 (socket says 172.21.15.164:44740) 2024-09-13T23:06:31.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.243+0000 7fdefdf3c640 1 -- 172.21.15.164:0/3755204199 learned_addr learned my addr 172.21.15.164:0/3755204199 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.243+0000 7fdefdf3c640 1 -- 172.21.15.164:0/3755204199 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626fd3be7b0 con 0x5626fd3bdde0 2024-09-13T23:06:31.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.244+0000 7fdefdf3c640 1 --2- 172.21.15.164:0/3755204199 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd3bdde0 0x5626fd3be1e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fdef400eee0 tx=0x7fdef4024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd37f27b1344bd9b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.244+0000 7fdde1ffb640 1 -- 172.21.15.164:0/3755204199 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdef4026730 con 0x5626fd3bdde0 2024-09-13T23:06:31.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.244+0000 7fdde1ffb640 1 -- 172.21.15.164:0/3755204199 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef4025c50 con 0x5626fd3bdde0 2024-09-13T23:06:31.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.244+0000 7fdde1ffb640 1 -- 172.21.15.164:0/3755204199 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdef40268d0 con 0x5626fd3bdde0 2024-09-13T23:06:31.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.244+0000 7fdf03013800 1 -- 172.21.15.164:0/3755204199 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd3bdde0 msgr2=0x5626fd3be1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.244+0000 7fdf03013800 1 --2- 172.21.15.164:0/3755204199 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd3bdde0 0x5626fd3be1e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fdef400eee0 tx=0x7fdef4024740 comp rx=0 tx=0).stop 2024-09-13T23:06:31.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.244+0000 7fdf03013800 1 -- 172.21.15.164:0/3755204199 shutdown_connections 2024-09-13T23:06:31.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.244+0000 7fdf03013800 1 --2- 172.21.15.164:0/3755204199 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd3bdde0 0x5626fd3be1e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.244+0000 7fdf03013800 1 -- 172.21.15.164:0/3755204199 >> 172.21.15.164:0/3755204199 conn(0x5626fd3ba140 msgr2=0x5626fd3b8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.244+0000 7fdf03013800 1 -- 172.21.15.164:0/3755204199 shutdown_connections 2024-09-13T23:06:31.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.244+0000 7fdf03013800 1 -- 172.21.15.164:0/3755204199 wait complete. 2024-09-13T23:06:31.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.245+0000 7fdf03013800 1 Processor -- start 2024-09-13T23:06:31.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.245+0000 7fdf03013800 1 -- start start 2024-09-13T23:06:31.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.245+0000 7fdf03013800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd3bdde0 0x5626fd3c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.245+0000 7fdf03013800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5626fd3bed30 con 0x5626fd3bdde0 2024-09-13T23:06:31.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.245+0000 7fdefdf3c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd3bdde0 0x5626fd3c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.245+0000 7fdefdf3c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd3bdde0 0x5626fd3c50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44756/0 (socket says 172.21.15.164:44756) 2024-09-13T23:06:31.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.245+0000 7fdefdf3c640 1 -- 172.21.15.164:0/771927698 learned_addr learned my addr 172.21.15.164:0/771927698 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.245+0000 7fdefdf3c640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626fd3c5610 con 0x5626fd3bdde0 2024-09-13T23:06:31.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.245+0000 7fdefdf3c640 1 --2- 172.21.15.164:0/771927698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd3bdde0 0x5626fd3c50d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fdef4024a00 tx=0x7fdef404c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.246+0000 7fddcffff640 1 -- 172.21.15.164:0/771927698 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdef4025e00 con 0x5626fd3bdde0 2024-09-13T23:06:31.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.246+0000 7fddcffff640 1 -- 172.21.15.164:0/771927698 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef400dbb0 con 0x5626fd3bdde0 2024-09-13T23:06:31.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.246+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626fd3c5610 con 0x5626fd3bdde0 2024-09-13T23:06:31.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.246+0000 7fddcffff640 1 -- 172.21.15.164:0/771927698 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdef404c780 con 0x5626fd3bdde0 2024-09-13T23:06:31.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.246+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626fd3c5610 con 0x5626fd3bdde0 2024-09-13T23:06:31.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.246+0000 7fddcffff640 1 -- 172.21.15.164:0/771927698 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdef404c920 con 0x5626fd3bdde0 2024-09-13T23:06:31.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.247+0000 7fddcffff640 1 --2- 172.21.15.164:0/771927698 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fddc8036b40 0x7fddc8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.247+0000 7fddcffff640 1 -- 172.21.15.164:0/771927698 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fdef401dd40 con 0x5626fd3bdde0 2024-09-13T23:06:31.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.247+0000 7fdefef3e640 1 --2- 172.21.15.164:0/771927698 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fddc8036b40 0x7fddc8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.247+0000 7fdf03013800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.247+0000 7fdf03013800 1 --2- 172.21.15.164:0/771927698 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5626fd3d0840 0x5626fd3d2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.247+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d3450 con 0x5626fd3d0840 2024-09-13T23:06:31.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.247+0000 7fdefe73d640 1 --2- 172.21.15.164:0/771927698 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5626fd3d0840 0x5626fd3d2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.247+0000 7fdefef3e640 1 --2- 172.21.15.164:0/771927698 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fddc8036b40 0x7fddc8039000 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x5626fd39a3b0 tx=0x7fdef801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.247+0000 7fdefe73d640 1 --2- 172.21.15.164:0/771927698 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5626fd3d0840 0x5626fd3d2d00 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.248+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdef007f070 con 0x5626fd3d0840 2024-09-13T23:06:31.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.248+0000 7fdf03013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.248+0000 7fdf03013800 20 realm 2024-09-13T23:06:31.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.248+0000 7fdf03013800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.248+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d3860 con 0x5626fd3d0840 2024-09-13T23:06:31.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.248+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdef007f070 con 0x5626fd3d0840 2024-09-13T23:06:31.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.248+0000 7fdf03013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.248+0000 7fdf03013800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:06:31.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.248+0000 7fdf03013800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.248+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d4130 con 0x5626fd3d0840 2024-09-13T23:06:31.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.248+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdef007f070 con 0x5626fd3d0840 2024-09-13T23:06:31.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.248+0000 7fdf03013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.248+0000 7fdf03013800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.248+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d44d0 con 0x5626fd3d0840 2024-09-13T23:06:31.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.248+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdef007f070 con 0x5626fd3d0840 2024-09-13T23:06:31.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.248+0000 7fdf03013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:06:31.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.248+0000 7fdf03013800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.248+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d4930 con 0x5626fd3d0840 2024-09-13T23:06:31.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.249+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdef007f070 con 0x5626fd3d0840 2024-09-13T23:06:31.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.249+0000 7fdf03013800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:06:31.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.249+0000 7fdf03013800 20 searching for the correct realm 2024-09-13T23:06:31.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.249+0000 7fdf03013800 1 --2- 172.21.15.164:0/771927698 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5626fd3d6980 0x5626fd3d8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.249+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x5626fd3d6980 2024-09-13T23:06:31.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.249+0000 7fdefdf3c640 1 --2- 172.21.15.164:0/771927698 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5626fd3d6980 0x5626fd3d8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.249+0000 7fdefdf3c640 1 --2- 172.21.15.164:0/771927698 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5626fd3d6980 0x5626fd3d8d70 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.249+0000 7fdefdf3c640 1 -- 172.21.15.164:0/771927698 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef4024030 con 0x5626fd3d6980 2024-09-13T23:06:31.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.249+0000 7fdefdf3c640 1 --2- 172.21.15.164:0/771927698 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fdef401ac20 0x7fdef403d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.249+0000 7fdefdf3c640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x7fdef401ac20 2024-09-13T23:06:31.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.250+0000 7fdefef3e640 1 --2- 172.21.15.164:0/771927698 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fdef401ac20 0x7fdef403d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.250+0000 7fdefef3e640 1 --2- 172.21.15.164:0/771927698 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fdef401ac20 0x7fdef403d8a0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.250+0000 7fdefef3e640 1 -- 172.21.15.164:0/771927698 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef801f070 con 0x7fdef401ac20 2024-09-13T23:06:31.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.250+0000 7fdefef3e640 1 --2- 172.21.15.164:0/771927698 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fdef8031040 0x7fdef8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.250+0000 7fdefef3e640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x7fdef8031040 2024-09-13T23:06:31.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.251+0000 7fdefe73d640 1 --2- 172.21.15.164:0/771927698 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fdef8031040 0x7fdef8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.251+0000 7fdefe73d640 1 --2- 172.21.15.164:0/771927698 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fdef8031040 0x7fdef8032940 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.252+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef007f070 con 0x7fdef8031040 2024-09-13T23:06:31.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.252+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x5626fd3d0840 2024-09-13T23:06:31.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.252+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdef007f070 con 0x5626fd3d0840 2024-09-13T23:06:31.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.252+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x5626fd3d0840 2024-09-13T23:06:31.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.252+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef007f070 con 0x5626fd3d0840 2024-09-13T23:06:31.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.252+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x7fdef8031040 2024-09-13T23:06:31.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.253+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef007f070 con 0x7fdef8031040 2024-09-13T23:06:31.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.253+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x7fdef8031040 2024-09-13T23:06:31.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.253+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef007f070 con 0x7fdef8031040 2024-09-13T23:06:31.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.253+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x7fdef401ac20 2024-09-13T23:06:31.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.253+0000 7fdefef3e640 1 -- 172.21.15.164:0/771927698 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef801f070 con 0x7fdef401ac20 2024-09-13T23:06:31.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.253+0000 7fdefef3e640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x5626fd3d6980 2024-09-13T23:06:31.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.253+0000 7fdefdf3c640 1 -- 172.21.15.164:0/771927698 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef4024030 con 0x5626fd3d6980 2024-09-13T23:06:31.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.253+0000 7fdefdf3c640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x5626fd3d0840 2024-09-13T23:06:31.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.254+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef007f070 con 0x5626fd3d0840 2024-09-13T23:06:31.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.254+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x7fdef8031040 2024-09-13T23:06:31.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.254+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef007f070 con 0x7fdef8031040 2024-09-13T23:06:31.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.254+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x5626fd3d0840 2024-09-13T23:06:31.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.254+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef007f070 con 0x5626fd3d0840 2024-09-13T23:06:31.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.254+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x7fdef401ac20 2024-09-13T23:06:31.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.254+0000 7fdefef3e640 1 -- 172.21.15.164:0/771927698 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdef801f070 con 0x7fdef401ac20 2024-09-13T23:06:31.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.254+0000 7fdefef3e640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x5626fd3d6980 2024-09-13T23:06:31.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.255+0000 7fdefdf3c640 1 -- 172.21.15.164:0/771927698 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef4024030 con 0x5626fd3d6980 2024-09-13T23:06:31.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.255+0000 7fdefdf3c640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x5626fd3d6980 2024-09-13T23:06:31.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.255+0000 7fdefdf3c640 1 -- 172.21.15.164:0/771927698 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef4024030 con 0x5626fd3d6980 2024-09-13T23:06:31.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.255+0000 7fdefdf3c640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x7fdef8031040 2024-09-13T23:06:31.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.255+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef007f070 con 0x7fdef8031040 2024-09-13T23:06:31.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.255+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x5626fd3d6980 2024-09-13T23:06:31.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.255+0000 7fdefdf3c640 1 -- 172.21.15.164:0/771927698 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef4024030 con 0x5626fd3d6980 2024-09-13T23:06:31.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.255+0000 7fdefdf3c640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x5626fd3d6980 2024-09-13T23:06:31.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.256+0000 7fdefdf3c640 1 -- 172.21.15.164:0/771927698 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef4024030 con 0x5626fd3d6980 2024-09-13T23:06:31.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.256+0000 7fdefdf3c640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x5626fd3d0840 2024-09-13T23:06:31.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.256+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef007f070 con 0x5626fd3d0840 2024-09-13T23:06:31.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.256+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x5626fd3d0840 2024-09-13T23:06:31.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.256+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdef007f070 con 0x5626fd3d0840 2024-09-13T23:06:31.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.256+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x7fdef8031040 2024-09-13T23:06:31.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.256+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef007f070 con 0x7fdef8031040 2024-09-13T23:06:31.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.256+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x5626fd3d6980 2024-09-13T23:06:31.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.257+0000 7fdefdf3c640 1 -- 172.21.15.164:0/771927698 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef4024030 con 0x5626fd3d6980 2024-09-13T23:06:31.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.257+0000 7fdefdf3c640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x7fdef401ac20 2024-09-13T23:06:31.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.257+0000 7fdefef3e640 1 -- 172.21.15.164:0/771927698 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef801f070 con 0x7fdef401ac20 2024-09-13T23:06:31.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.257+0000 7fdefef3e640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x5626fd3d0840 2024-09-13T23:06:31.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.257+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdef007f070 con 0x5626fd3d0840 2024-09-13T23:06:31.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.257+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x7fdef8031040 2024-09-13T23:06:31.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.258+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef007f070 con 0x7fdef8031040 2024-09-13T23:06:31.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.258+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x5626fd3d6980 2024-09-13T23:06:31.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.258+0000 7fdefdf3c640 1 -- 172.21.15.164:0/771927698 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef4024030 con 0x5626fd3d6980 2024-09-13T23:06:31.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.258+0000 7fdefdf3c640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x7fdef8031040 2024-09-13T23:06:31.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.258+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef007f070 con 0x7fdef8031040 2024-09-13T23:06:31.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.258+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x7fdef401ac20 2024-09-13T23:06:31.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.258+0000 7fdefef3e640 1 -- 172.21.15.164:0/771927698 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef801f070 con 0x7fdef401ac20 2024-09-13T23:06:31.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.258+0000 7fdefef3e640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x5626fd3d6980 2024-09-13T23:06:31.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.259+0000 7fdefdf3c640 1 -- 172.21.15.164:0/771927698 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef4024030 con 0x5626fd3d6980 2024-09-13T23:06:31.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.259+0000 7fdefdf3c640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x7fdef401ac20 2024-09-13T23:06:31.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.259+0000 7fdefef3e640 1 -- 172.21.15.164:0/771927698 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef801f070 con 0x7fdef401ac20 2024-09-13T23:06:31.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.259+0000 7fdefef3e640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x5626fd3d0840 2024-09-13T23:06:31.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.259+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdef007f070 con 0x5626fd3d0840 2024-09-13T23:06:31.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.259+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9420 con 0x7fdef401ac20 2024-09-13T23:06:31.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.259+0000 7fdefef3e640 1 -- 172.21.15.164:0/771927698 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdef8040040 con 0x7fdef401ac20 2024-09-13T23:06:31.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.259+0000 7fdf03013800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:06:31.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.259+0000 7fdf03013800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:06:31.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.259+0000 7fdf03013800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:06:31.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.259+0000 7fdf03013800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:06:31.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.259+0000 7fdf03013800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:06:31.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.259+0000 7fdf03013800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:06:31.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.259+0000 7fdf03013800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.259+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d5400 con 0x5626fd3d0840 2024-09-13T23:06:31.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.260+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdef007f070 con 0x5626fd3d0840 2024-09-13T23:06:31.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.260+0000 7fdf03013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.260+0000 7fdf03013800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.260+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d5ca0 con 0x5626fd3d0840 2024-09-13T23:06:31.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.260+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdef007f070 con 0x5626fd3d0840 2024-09-13T23:06:31.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.260+0000 7fdf03013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:06:31.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.260+0000 7fdf03013800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.260+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d5040 con 0x5626fd3d0840 2024-09-13T23:06:31.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.260+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdef007f070 con 0x5626fd3d0840 2024-09-13T23:06:31.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.260+0000 7fdf03013800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:06:31.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.260+0000 7fdf03013800 20 zone default found 2024-09-13T23:06:31.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.260+0000 7fdf03013800 4 Realm: () 2024-09-13T23:06:31.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.260+0000 7fdf03013800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:06:31.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.260+0000 7fdf03013800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:06:31.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.260+0000 7fdf03013800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:06:31.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.260+0000 7fdf03013800 20 zonegroup default 2024-09-13T23:06:31.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.260+0000 7fdf03013800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.260+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3d9880 con 0x7fdef8031040 2024-09-13T23:06:31.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.260+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdef007f070 con 0x7fdef8031040 2024-09-13T23:06:31.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.260+0000 7fdf03013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.260+0000 7fdf03013800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.261+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3db710 con 0x5626fd3d6980 2024-09-13T23:06:31.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.261+0000 7fdefdf3c640 1 -- 172.21.15.164:0/771927698 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdef4024030 con 0x5626fd3d6980 2024-09-13T23:06:31.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.261+0000 7fdf03013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.261+0000 7fdf03013800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.261+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3dbab0 con 0x5626fd3d6980 2024-09-13T23:06:31.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.261+0000 7fdefdf3c640 1 -- 172.21.15.164:0/771927698 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdef4024030 con 0x5626fd3d6980 2024-09-13T23:06:31.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.261+0000 7fdf03013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.261+0000 7fdf03013800 20 started sync module instance, tier type = 2024-09-13T23:06:31.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.261+0000 7fdf03013800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:06:31.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.261+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3daba0 con 0x7fdef401ac20 2024-09-13T23:06:31.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.262+0000 7fdefef3e640 1 -- 172.21.15.164:0/771927698 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef8040040 con 0x7fdef401ac20 2024-09-13T23:06:31.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.262+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94725457424320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3da800 con 0x7fdef401ac20 2024-09-13T23:06:31.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.262+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3dc920 con 0x5626fd3d0840 2024-09-13T23:06:31.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.263+0000 7fdefef3e640 1 -- 172.21.15.164:0/771927698 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94725457424320] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef8040040 con 0x7fdef401ac20 2024-09-13T23:06:31.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.263+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef007f070 con 0x5626fd3d0840 2024-09-13T23:06:31.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.263+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94725457428048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3dc920 con 0x5626fd3d0840 2024-09-13T23:06:31.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.263+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3dd3d0 con 0x5626fd3d6980 2024-09-13T23:06:31.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.265+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94725457428048] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef007f070 con 0x5626fd3d0840 2024-09-13T23:06:31.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.265+0000 7fdefdf3c640 1 -- 172.21.15.164:0/771927698 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef4024030 con 0x5626fd3d6980 2024-09-13T23:06:31.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.265+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94725457429616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3dc890 con 0x5626fd3d6980 2024-09-13T23:06:31.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.265+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3de290 con 0x7fdef401ac20 2024-09-13T23:06:31.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.266+0000 7fdefdf3c640 1 -- 172.21.15.164:0/771927698 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94725457429616] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef4024030 con 0x5626fd3d6980 2024-09-13T23:06:31.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.266+0000 7fdefef3e640 1 -- 172.21.15.164:0/771927698 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef8040040 con 0x7fdef401ac20 2024-09-13T23:06:31.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.266+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94725457436128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3de6b0 con 0x7fdef401ac20 2024-09-13T23:06:31.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.266+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3df070 con 0x5626fd3d0840 2024-09-13T23:06:31.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.267+0000 7fdefef3e640 1 -- 172.21.15.164:0/771927698 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94725457436128] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef8040040 con 0x7fdef401ac20 2024-09-13T23:06:31.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.267+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef007f070 con 0x5626fd3d0840 2024-09-13T23:06:31.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.267+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94725457440160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3de6b0 con 0x5626fd3d0840 2024-09-13T23:06:31.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.267+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3dfac0 con 0x7fdef8031040 2024-09-13T23:06:31.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.268+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94725457440160] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef007f070 con 0x5626fd3d0840 2024-09-13T23:06:31.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.268+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef007f070 con 0x7fdef8031040 2024-09-13T23:06:31.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.268+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94725457442256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3de6b0 con 0x7fdef8031040 2024-09-13T23:06:31.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.268+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3e04d0 con 0x7fdef8031040 2024-09-13T23:06:31.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.269+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94725457442256] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef007f070 con 0x7fdef8031040 2024-09-13T23:06:31.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.269+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef007f070 con 0x7fdef8031040 2024-09-13T23:06:31.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.269+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94725457445376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3de6b0 con 0x7fdef8031040 2024-09-13T23:06:31.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.269+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3e0ee0 con 0x7fdef8031040 2024-09-13T23:06:31.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.270+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94725457445376] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef007f070 con 0x7fdef8031040 2024-09-13T23:06:31.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.270+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef007f070 con 0x7fdef8031040 2024-09-13T23:06:31.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.271+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94725457437664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3e0ee0 con 0x7fdef8031040 2024-09-13T23:06:31.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.271+0000 7fdf03013800 20 add_watcher() i=0 2024-09-13T23:06:31.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.271+0000 7fdf03013800 20 add_watcher() i=1 2024-09-13T23:06:31.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.271+0000 7fdf03013800 20 add_watcher() i=2 2024-09-13T23:06:31.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.271+0000 7fdf03013800 20 add_watcher() i=3 2024-09-13T23:06:31.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.271+0000 7fdf03013800 20 add_watcher() i=4 2024-09-13T23:06:31.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.271+0000 7fdf03013800 20 add_watcher() i=5 2024-09-13T23:06:31.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.271+0000 7fdf03013800 20 add_watcher() i=6 2024-09-13T23:06:31.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.271+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94725457437664] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef007f070 con 0x7fdef8031040 2024-09-13T23:06:31.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.272+0000 7fdf03013800 20 add_watcher() i=7 2024-09-13T23:06:31.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.272+0000 7fdf03013800 2 all 8 watchers are set, enabling cache 2024-09-13T23:06:31.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.272+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3e42e0 con 0x5626fd3d0840 2024-09-13T23:06:31.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.272+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdef007f070 con 0x5626fd3d0840 2024-09-13T23:06:31.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.272+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94725457447936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3e1830 con 0x5626fd3d0840 2024-09-13T23:06:31.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.273+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94725457447936] v34'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdef007f070 con 0x5626fd3d0840 2024-09-13T23:06:31.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.273+0000 7fddb4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:06:31.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.273+0000 7fdf03013800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:06:31.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.273+0000 7fdf03013800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:06:31.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.273+0000 7fdf03013800 5 note: GC not initialized 2024-09-13T23:06:31.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.273+0000 7fdd2f7fe640 20 reqs_thread_entry: start 2024-09-13T23:06:31.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.273+0000 7fdf03013800 20 init_complete bucket index max shards: 11 2024-09-13T23:06:31.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.273+0000 7fdf03013800 20 Filter name: none 2024-09-13T23:06:31.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.274+0000 7fdd2d7fa640 20 reqs_thread_entry: start 2024-09-13T23:06:31.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.274+0000 7fdf03013800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.274+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626fd417240 con 0x5626fd3d0840 2024-09-13T23:06:31.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.274+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fdef007f070 con 0x5626fd3d0840 2024-09-13T23:06:31.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.274+0000 7fdf03013800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:06:31.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.274+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5626fd418790 con 0x7fdef8031040 2024-09-13T23:06:31.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.274+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fdef007f070 con 0x7fdef8031040 2024-09-13T23:06:31.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.275+0000 7fddb4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:06:31.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.275+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94725457447936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626fd415dd0 con 0x5626fd3d0840 2024-09-13T23:06:31.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.276+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94725457447936] v34'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdef007f070 con 0x5626fd3d0840 2024-09-13T23:06:31.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.276+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94725457424320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3e0bd0 con 0x7fdef401ac20 2024-09-13T23:06:31.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.277+0000 7fdefef3e640 1 -- 172.21.15.164:0/771927698 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94725457424320] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef8040040 con 0x7fdef401ac20 2024-09-13T23:06:31.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.277+0000 7fdf03013800 20 remove_watcher() i=0 2024-09-13T23:06:31.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.277+0000 7fdf03013800 2 removed watcher, disabling cache 2024-09-13T23:06:31.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.277+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94725457428048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3dafc0 con 0x5626fd3d0840 2024-09-13T23:06:31.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.278+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94725457428048] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef007f070 con 0x5626fd3d0840 2024-09-13T23:06:31.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.278+0000 7fdf03013800 20 remove_watcher() i=1 2024-09-13T23:06:31.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.278+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94725457429616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3dafc0 con 0x5626fd3d6980 2024-09-13T23:06:31.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.279+0000 7fdefdf3c640 1 -- 172.21.15.164:0/771927698 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94725457429616] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef4024030 con 0x5626fd3d6980 2024-09-13T23:06:31.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.280+0000 7fdf03013800 20 remove_watcher() i=2 2024-09-13T23:06:31.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.280+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94725457436128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3dc470 con 0x7fdef401ac20 2024-09-13T23:06:31.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.281+0000 7fdefef3e640 1 -- 172.21.15.164:0/771927698 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94725457436128] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef8040040 con 0x7fdef401ac20 2024-09-13T23:06:31.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.281+0000 7fdf03013800 20 remove_watcher() i=3 2024-09-13T23:06:31.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.281+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94725457440160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3dc470 con 0x5626fd3d0840 2024-09-13T23:06:31.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.282+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94725457440160] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef007f070 con 0x5626fd3d0840 2024-09-13T23:06:31.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.282+0000 7fdf03013800 20 remove_watcher() i=4 2024-09-13T23:06:31.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.282+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94725457442256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3deda0 con 0x7fdef8031040 2024-09-13T23:06:31.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.283+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94725457442256] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef007f070 con 0x7fdef8031040 2024-09-13T23:06:31.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.283+0000 7fdf03013800 20 remove_watcher() i=5 2024-09-13T23:06:31.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.283+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94725457445376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3dc470 con 0x7fdef8031040 2024-09-13T23:06:31.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.284+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94725457445376] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef007f070 con 0x7fdef8031040 2024-09-13T23:06:31.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.284+0000 7fdf03013800 20 remove_watcher() i=6 2024-09-13T23:06:31.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.284+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94725457437664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5626fd3dc470 con 0x7fdef8031040 2024-09-13T23:06:31.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.285+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94725457437664] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdef007f070 con 0x7fdef8031040 2024-09-13T23:06:31.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.285+0000 7fdf03013800 20 remove_watcher() i=7 2024-09-13T23:06:31.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.285+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fdef8031040 msgr2=0x7fdef8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.285+0000 7fdf03013800 1 --2- 172.21.15.164:0/771927698 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fdef8031040 0x7fdef8032940 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.285+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5626fd3d0840 msgr2=0x5626fd3d2d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.285+0000 7fdf03013800 1 --2- 172.21.15.164:0/771927698 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5626fd3d0840 0x5626fd3d2d00 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.285+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fdef401ac20 msgr2=0x7fdef403d8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.285+0000 7fdf03013800 1 --2- 172.21.15.164:0/771927698 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fdef401ac20 0x7fdef403d8a0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.285+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5626fd3d6980 msgr2=0x5626fd3d8d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.285+0000 7fdf03013800 1 --2- 172.21.15.164:0/771927698 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5626fd3d6980 0x5626fd3d8d70 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.285+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fddc8036b40 msgr2=0x7fddc8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.285+0000 7fdf03013800 1 --2- 172.21.15.164:0/771927698 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fddc8036b40 0x7fddc8039000 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x5626fd39a3b0 tx=0x7fdef801f000 comp rx=0 tx=0).stop 2024-09-13T23:06:31.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.285+0000 7fdefe73d640 1 -- 172.21.15.164:0/771927698 reap_dead start 2024-09-13T23:06:31.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.285+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd3bdde0 msgr2=0x5626fd3c50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.285+0000 7fdf03013800 1 --2- 172.21.15.164:0/771927698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd3bdde0 0x5626fd3c50d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fdef4024a00 tx=0x7fdef404c340 comp rx=0 tx=0).stop 2024-09-13T23:06:31.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.285+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 shutdown_connections 2024-09-13T23:06:31.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.285+0000 7fdf03013800 1 --2- 172.21.15.164:0/771927698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd3bdde0 0x5626fd3c50d0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.285+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 >> 172.21.15.164:0/771927698 conn(0x5626fd3ba140 msgr2=0x5626fd3b8210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.285+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 shutdown_connections 2024-09-13T23:06:31.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.285+0000 7fdf03013800 1 -- 172.21.15.164:0/771927698 wait complete. 2024-09-13T23:06:31.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.286+0000 7fdf03013800 1 -- 172.21.15.164:0/4260751921 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fddd8036b90 msgr2=0x7fddd8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.286+0000 7fdf03013800 1 --2- 172.21.15.164:0/4260751921 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fddd8036b90 0x7fddd8039050 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x5626fd3a17c0 tx=0x7fdef8005840 comp rx=0 tx=0).stop 2024-09-13T23:06:31.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.286+0000 7fdf03013800 1 -- 172.21.15.164:0/4260751921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd3b1150 msgr2=0x5626fd3b1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.286+0000 7fdf03013800 1 --2- 172.21.15.164:0/4260751921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd3b1150 0x5626fd3b1570 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fdef4001ed0 tx=0x7fdef400ea00 comp rx=0 tx=0).stop 2024-09-13T23:06:31.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.286+0000 7fdf03013800 1 -- 172.21.15.164:0/4260751921 shutdown_connections 2024-09-13T23:06:31.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.286+0000 7fdf03013800 1 --2- 172.21.15.164:0/4260751921 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fddd8036b90 0x7fddd8039050 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.286+0000 7fdf03013800 1 --2- 172.21.15.164:0/4260751921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd3b1150 0x5626fd3b1570 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.286+0000 7fdf03013800 1 -- 172.21.15.164:0/4260751921 >> 172.21.15.164:0/4260751921 conn(0x5626fd3a60e0 msgr2=0x5626fd3a8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.286+0000 7fdf03013800 1 -- 172.21.15.164:0/4260751921 shutdown_connections 2024-09-13T23:06:31.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.286+0000 7fdf03013800 1 -- 172.21.15.164:0/4260751921 wait complete. 2024-09-13T23:06:31.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.286+0000 7fdf03013800 1 -- 172.21.15.164:0/1620777982 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5626fd39e360 msgr2=0x5626fd3a0750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.286+0000 7fdf03013800 1 --2- 172.21.15.164:0/1620777982 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5626fd39e360 0x5626fd3a0750 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.286+0000 7fdf03013800 1 -- 172.21.15.164:0/1620777982 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdde4036b90 msgr2=0x7fdde4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.286+0000 7fdf03013800 1 --2- 172.21.15.164:0/1620777982 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdde4036b90 0x7fdde4039050 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdef4000f60 tx=0x7fdef4001370 comp rx=0 tx=0).stop 2024-09-13T23:06:31.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.286+0000 7fdf03013800 1 -- 172.21.15.164:0/1620777982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd2165b0 msgr2=0x5626fd399300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.286+0000 7fdf03013800 1 --2- 172.21.15.164:0/1620777982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd2165b0 0x5626fd399300 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fdef0000c00 tx=0x7fdef0002fb0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.286+0000 7fdf03013800 1 -- 172.21.15.164:0/1620777982 shutdown_connections 2024-09-13T23:06:31.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.286+0000 7fdf03013800 1 --2- 172.21.15.164:0/1620777982 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5626fd39e360 0x5626fd3a0750 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.286+0000 7fdf03013800 1 --2- 172.21.15.164:0/1620777982 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdde4036b90 0x7fdde4039050 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.286+0000 7fdf03013800 1 --2- 172.21.15.164:0/1620777982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5626fd2165b0 0x5626fd399300 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.286+0000 7fdf03013800 1 -- 172.21.15.164:0/1620777982 >> 172.21.15.164:0/1620777982 conn(0x5626fd29bfe0 msgr2=0x5626fd38bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.286+0000 7fdf03013800 1 -- 172.21.15.164:0/1620777982 shutdown_connections 2024-09-13T23:06:31.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.286+0000 7fdf03013800 1 -- 172.21.15.164:0/1620777982 wait complete. 2024-09-13T23:06:31.298 INFO:teuthology.orchestra.run.smithi164.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-09-13T23:06:31.298 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-13T23:06:31.298 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-13T23:06:31.298 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-13T23:06:31.299 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-13T23:06:31.345 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:06:31.345 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:06:31.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.345+0000 7fe2aff1f800 1 Processor -- start 2024-09-13T23:06:31.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.345+0000 7fe2aff1f800 1 -- start start 2024-09-13T23:06:31.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.345+0000 7fe2aff1f800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55dddcf2f920 0x55dddcf31d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.345+0000 7fe2aff1f800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dddcdeab30 con 0x55dddce9ee10 2024-09-13T23:06:31.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.345+0000 7fe2aff1f800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55dddcdcc360 con 0x55dddcf2f920 2024-09-13T23:06:31.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.346+0000 7fe2ab394640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55dddcf2f920 0x55dddcf31d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.346+0000 7fe2abb95640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55dddce9ee10 0x55dddcf2e200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:55958/0 (socket says 172.21.15.164:55958) 2024-09-13T23:06:31.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.346+0000 7fe2abb95640 1 -- 172.21.15.164:0/646360784 learned_addr learned my addr 172.21.15.164:0/646360784 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:06:31.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.346+0000 7fe2ab394640 1 --2- 172.21.15.164:0/646360784 >> v2:172.21.15.17:3300/0 conn(0x55dddcf2f920 0x55dddcf31d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44758/0 (socket says 172.21.15.164:44758) 2024-09-13T23:06:31.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.346+0000 7fe2ab394640 1 -- 172.21.15.164:0/646360784 >> v1:172.21.15.17:6789/0 conn(0x55dddce9ee10 legacy=0x55dddcf2e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.346+0000 7fe2ab394640 1 -- 172.21.15.164:0/646360784 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dddcdf2e00 con 0x55dddcf2f920 2024-09-13T23:06:31.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.348+0000 7fe2ab394640 1 --2- 172.21.15.164:0/646360784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddcf2f920 0x55dddcf31d10 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe2a000a470 tx=0x7fe2a0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8fe8ab99aabdba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.348+0000 7fe2aab93640 1 -- 172.21.15.164:0/646360784 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2a0053570 con 0x55dddcf2f920 2024-09-13T23:06:31.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.348+0000 7fe2aab93640 1 -- 172.21.15.164:0/646360784 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a0058070 con 0x55dddcf2f920 2024-09-13T23:06:31.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.348+0000 7fe2aab93640 1 -- 172.21.15.164:0/646360784 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2a0053880 con 0x55dddcf2f920 2024-09-13T23:06:31.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.349+0000 7fe2aff1f800 1 -- 172.21.15.164:0/646360784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddcf2f920 msgr2=0x55dddcf31d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.349+0000 7fe2aff1f800 1 --2- 172.21.15.164:0/646360784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddcf2f920 0x55dddcf31d10 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe2a000a470 tx=0x7fe2a0045a20 comp rx=0 tx=0).stop 2024-09-13T23:06:31.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.349+0000 7fe2aff1f800 1 -- 172.21.15.164:0/646360784 shutdown_connections 2024-09-13T23:06:31.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.349+0000 7fe2aff1f800 1 --2- 172.21.15.164:0/646360784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddcf2f920 0x55dddcf31d10 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.349+0000 7fe2aff1f800 1 -- 172.21.15.164:0/646360784 >> 172.21.15.164:0/646360784 conn(0x55dddcf25dd0 msgr2=0x55dddcf281f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.349+0000 7fe2aff1f800 1 -- 172.21.15.164:0/646360784 shutdown_connections 2024-09-13T23:06:31.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.349+0000 7fe2aff1f800 1 -- 172.21.15.164:0/646360784 wait complete. 2024-09-13T23:06:31.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.362+0000 7fe2aff1f800 1 Processor -- start 2024-09-13T23:06:31.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.362+0000 7fe2aff1f800 1 -- start start 2024-09-13T23:06:31.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.363+0000 7fe2aff1f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddce9ee10 0x55dddcf2bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.363+0000 7fe2aff1f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55dddce77360 con 0x55dddce9ee10 2024-09-13T23:06:31.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.363+0000 7fe2abb95640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddce9ee10 0x55dddcf2bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.363+0000 7fe2abb95640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddce9ee10 0x55dddcf2bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44760/0 (socket says 172.21.15.164:44760) 2024-09-13T23:06:31.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.363+0000 7fe2abb95640 1 -- 172.21.15.164:0/4064115073 learned_addr learned my addr 172.21.15.164:0/4064115073 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.363+0000 7fe2abb95640 1 -- 172.21.15.164:0/4064115073 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dddcdc4bc0 con 0x55dddce9ee10 2024-09-13T23:06:31.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.363+0000 7fe2abb95640 1 --2- 172.21.15.164:0/4064115073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddce9ee10 0x55dddcf2bb30 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe29c001e10 tx=0x7fe29c00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d2e3695958353a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.363+0000 7fe199e0b640 1 -- 172.21.15.164:0/4064115073 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe29c012020 con 0x55dddce9ee10 2024-09-13T23:06:31.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.364+0000 7fe199e0b640 1 -- 172.21.15.164:0/4064115073 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe29c00e5a0 con 0x55dddce9ee10 2024-09-13T23:06:31.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.364+0000 7fe199e0b640 1 -- 172.21.15.164:0/4064115073 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe29c00e8e0 con 0x55dddce9ee10 2024-09-13T23:06:31.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.364+0000 7fe2aff1f800 1 -- 172.21.15.164:0/4064115073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddce9ee10 msgr2=0x55dddcf2bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.364+0000 7fe2aff1f800 1 --2- 172.21.15.164:0/4064115073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddce9ee10 0x55dddcf2bb30 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe29c001e10 tx=0x7fe29c00b780 comp rx=0 tx=0).stop 2024-09-13T23:06:31.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.364+0000 7fe2aff1f800 1 -- 172.21.15.164:0/4064115073 shutdown_connections 2024-09-13T23:06:31.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.364+0000 7fe2aff1f800 1 --2- 172.21.15.164:0/4064115073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddce9ee10 0x55dddcf2bb30 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.364+0000 7fe2aff1f800 1 -- 172.21.15.164:0/4064115073 >> 172.21.15.164:0/4064115073 conn(0x55dddcf25dd0 msgr2=0x55dddd016280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.364+0000 7fe2aff1f800 1 -- 172.21.15.164:0/4064115073 shutdown_connections 2024-09-13T23:06:31.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.364+0000 7fe2aff1f800 1 -- 172.21.15.164:0/4064115073 wait complete. 2024-09-13T23:06:31.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.365+0000 7fe2aff1f800 1 Processor -- start 2024-09-13T23:06:31.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.365+0000 7fe2aff1f800 1 -- start start 2024-09-13T23:06:31.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.365+0000 7fe2aff1f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddce9ee10 0x55dddd0244c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.365+0000 7fe2aff1f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55dddcf32610 con 0x55dddce9ee10 2024-09-13T23:06:31.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.365+0000 7fe2abb95640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddce9ee10 0x55dddd0244c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.365+0000 7fe2abb95640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddce9ee10 0x55dddd0244c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44776/0 (socket says 172.21.15.164:44776) 2024-09-13T23:06:31.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.365+0000 7fe2abb95640 1 -- 172.21.15.164:0/1444429296 learned_addr learned my addr 172.21.15.164:0/1444429296 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.365+0000 7fe2abb95640 1 -- 172.21.15.164:0/1444429296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dddcdd8fe0 con 0x55dddce9ee10 2024-09-13T23:06:31.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.365+0000 7fe2abb95640 1 --2- 172.21.15.164:0/1444429296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddce9ee10 0x55dddd0244c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe29c00b7c0 tx=0x7fe29c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.366+0000 7fe193fff640 1 -- 172.21.15.164:0/1444429296 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe29c012030 con 0x55dddce9ee10 2024-09-13T23:06:31.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.366+0000 7fe193fff640 1 -- 172.21.15.164:0/1444429296 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe29c001470 con 0x55dddce9ee10 2024-09-13T23:06:31.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.366+0000 7fe2aff1f800 1 -- 172.21.15.164:0/1444429296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dddd024a00 con 0x55dddce9ee10 2024-09-13T23:06:31.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.366+0000 7fe193fff640 1 -- 172.21.15.164:0/1444429296 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe29c01a8d0 con 0x55dddce9ee10 2024-09-13T23:06:31.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.366+0000 7fe2aff1f800 1 -- 172.21.15.164:0/1444429296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dddd024f20 con 0x55dddce9ee10 2024-09-13T23:06:31.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.366+0000 7fe193fff640 1 -- 172.21.15.164:0/1444429296 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe29c015020 con 0x55dddce9ee10 2024-09-13T23:06:31.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.367+0000 7fe193fff640 1 --2- 172.21.15.164:0/1444429296 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe194036b40 0x7fe194039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.367+0000 7fe193fff640 1 -- 172.21.15.164:0/1444429296 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe29c020030 con 0x55dddce9ee10 2024-09-13T23:06:31.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.367+0000 7fe2ab394640 1 --2- 172.21.15.164:0/1444429296 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe194036b40 0x7fe194039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.367+0000 7fe2aff1f800 1 --2- 172.21.15.164:0/1444429296 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55dddcf2f920 0x55dddd02b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.367+0000 7fe2aff1f800 1 -- 172.21.15.164:0/1444429296 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dddd02bb00 con 0x55dddcf2f920 2024-09-13T23:06:31.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.367+0000 7fe2ac396640 1 --2- 172.21.15.164:0/1444429296 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55dddcf2f920 0x55dddd02b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.367+0000 7fe2ab394640 1 --2- 172.21.15.164:0/1444429296 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe194036b40 0x7fe194039000 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0057000 tx=0x7fe2a0052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.367+0000 7fe2ac396640 1 --2- 172.21.15.164:0/1444429296 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55dddcf2f920 0x55dddd02b530 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.367+0000 7fe2ac396640 1 -- 172.21.15.164:0/1444429296 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2a400a4a0 con 0x55dddcf2f920 2024-09-13T23:06:31.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.368+0000 7fe2aff1f800 1 -- 172.21.15.164:0/1444429296 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dddd028ae0 con 0x55dddcf2f920 2024-09-13T23:06:31.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.368+0000 7fe2ac396640 1 -- 172.21.15.164:0/1444429296 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe2a400a4a0 con 0x55dddcf2f920 2024-09-13T23:06:31.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.368+0000 7fe2aff1f800 1 -- 172.21.15.164:0/1444429296 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dddd02d900 con 0x55dddcf2f920 2024-09-13T23:06:31.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.368+0000 7fe2ac396640 1 -- 172.21.15.164:0/1444429296 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe2a400a4a0 con 0x55dddcf2f920 2024-09-13T23:06:31.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.368+0000 7fe2aff1f800 1 -- 172.21.15.164:0/1444429296 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dddd02ca40 con 0x55dddcf2f920 2024-09-13T23:06:31.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.368+0000 7fe2ac396640 1 -- 172.21.15.164:0/1444429296 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe2a400a4a0 con 0x55dddcf2f920 2024-09-13T23:06:31.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.368+0000 7fe2aff1f800 1 -- 172.21.15.164:0/1444429296 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dddd02ce60 con 0x55dddcf2f920 2024-09-13T23:06:31.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.369+0000 7fe2ac396640 1 -- 172.21.15.164:0/1444429296 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe2a400a4a0 con 0x55dddcf2f920 2024-09-13T23:06:31.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.369+0000 7fe2aff1f800 1 Processor -- start 2024-09-13T23:06:31.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.369+0000 7fe2aff1f800 1 -- start start 2024-09-13T23:06:31.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.369+0000 7fe2aff1f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddd03bf30 0x55dddd03c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.369+0000 7fe2aff1f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55dddcdc6580 con 0x55dddd03bf30 2024-09-13T23:06:31.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.369+0000 7fe2ab394640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddd03bf30 0x55dddd03c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.369+0000 7fe2ab394640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddd03bf30 0x55dddd03c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44784/0 (socket says 172.21.15.164:44784) 2024-09-13T23:06:31.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.369+0000 7fe2ab394640 1 -- 172.21.15.164:0/1732342499 learned_addr learned my addr 172.21.15.164:0/1732342499 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.370+0000 7fe2ab394640 1 -- 172.21.15.164:0/1732342499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dddd03c890 con 0x55dddd03bf30 2024-09-13T23:06:31.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.370+0000 7fe2ab394640 1 --2- 172.21.15.164:0/1732342499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddd03bf30 0x55dddd03c350 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0045f50 tx=0x7fe2a0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.370+0000 7fe1917fa640 1 -- 172.21.15.164:0/1732342499 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2a006f070 con 0x55dddd03bf30 2024-09-13T23:06:31.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.370+0000 7fe1917fa640 1 -- 172.21.15.164:0/1732342499 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a005f550 con 0x55dddd03bf30 2024-09-13T23:06:31.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.370+0000 7fe2aff1f800 1 -- 172.21.15.164:0/1732342499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dddd03cac0 con 0x55dddd03bf30 2024-09-13T23:06:31.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.370+0000 7fe1917fa640 1 -- 172.21.15.164:0/1732342499 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2a005f830 con 0x55dddd03bf30 2024-09-13T23:06:31.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.370+0000 7fe2aff1f800 1 -- 172.21.15.164:0/1732342499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dddd03f740 con 0x55dddd03bf30 2024-09-13T23:06:31.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.371+0000 7fe1917fa640 1 -- 172.21.15.164:0/1732342499 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe2a005f9d0 con 0x55dddd03bf30 2024-09-13T23:06:31.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.371+0000 7fe1917fa640 1 --2- 172.21.15.164:0/1732342499 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe184036b90 0x7fe184039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.371+0000 7fe1917fa640 1 -- 172.21.15.164:0/1732342499 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe2a0092db0 con 0x55dddd03bf30 2024-09-13T23:06:31.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.371+0000 7fe2ac396640 1 --2- 172.21.15.164:0/1732342499 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe184036b90 0x7fe184039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.371+0000 7fe2aff1f800 1 Processor -- start 2024-09-13T23:06:31.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.372+0000 7fe2ac396640 1 --2- 172.21.15.164:0/1732342499 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe184036b90 0x7fe184039050 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55dddd02cde0 tx=0x7fe2a4005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.372+0000 7fe2aff1f800 1 -- start start 2024-09-13T23:06:31.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.372+0000 7fe2aff1f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddd048ad0 0x55dddd048ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.372+0000 7fe2aff1f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55dddcf2a200 con 0x55dddd048ad0 2024-09-13T23:06:31.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.372+0000 7fe2ab394640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddd048ad0 0x55dddd048ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.372+0000 7fe2ab394640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddd048ad0 0x55dddd048ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44790/0 (socket says 172.21.15.164:44790) 2024-09-13T23:06:31.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.372+0000 7fe2ab394640 1 -- 172.21.15.164:0/1283837418 learned_addr learned my addr 172.21.15.164:0/1283837418 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.372+0000 7fe2ab394640 1 -- 172.21.15.164:0/1283837418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dddd0494a0 con 0x55dddd048ad0 2024-09-13T23:06:31.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.372+0000 7fe2ab394640 1 --2- 172.21.15.164:0/1283837418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddd048ad0 0x55dddd048ed0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0053da0 tx=0x7fe2a007cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a695e054dbfdf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.372+0000 7fe18affd640 1 -- 172.21.15.164:0/1283837418 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2a0080070 con 0x55dddd048ad0 2024-09-13T23:06:31.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.372+0000 7fe18affd640 1 -- 172.21.15.164:0/1283837418 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a005fcc0 con 0x55dddd048ad0 2024-09-13T23:06:31.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.372+0000 7fe18affd640 1 -- 172.21.15.164:0/1283837418 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2a006a3a0 con 0x55dddd048ad0 2024-09-13T23:06:31.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.373+0000 7fe2aff1f800 1 -- 172.21.15.164:0/1283837418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddd048ad0 msgr2=0x55dddd048ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.373+0000 7fe2aff1f800 1 --2- 172.21.15.164:0/1283837418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddd048ad0 0x55dddd048ed0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0053da0 tx=0x7fe2a007cea0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.373+0000 7fe2aff1f800 1 -- 172.21.15.164:0/1283837418 shutdown_connections 2024-09-13T23:06:31.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.373+0000 7fe2aff1f800 1 --2- 172.21.15.164:0/1283837418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddd048ad0 0x55dddd048ed0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.373+0000 7fe2aff1f800 1 -- 172.21.15.164:0/1283837418 >> 172.21.15.164:0/1283837418 conn(0x55dddd044e30 msgr2=0x55dddd042f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.373+0000 7fe2aff1f800 1 -- 172.21.15.164:0/1283837418 shutdown_connections 2024-09-13T23:06:31.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.373+0000 7fe2aff1f800 1 -- 172.21.15.164:0/1283837418 wait complete. 2024-09-13T23:06:31.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.373+0000 7fe2aff1f800 1 Processor -- start 2024-09-13T23:06:31.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.373+0000 7fe2aff1f800 1 -- start start 2024-09-13T23:06:31.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.373+0000 7fe2aff1f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddd048ad0 0x55dddd04ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.373+0000 7fe2aff1f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55dddd049b10 con 0x55dddd048ad0 2024-09-13T23:06:31.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.374+0000 7fe2ab394640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddd048ad0 0x55dddd04ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.374+0000 7fe2ab394640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddd048ad0 0x55dddd04ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44806/0 (socket says 172.21.15.164:44806) 2024-09-13T23:06:31.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.374+0000 7fe2ab394640 1 -- 172.21.15.164:0/3403100801 learned_addr learned my addr 172.21.15.164:0/3403100801 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.374+0000 7fe2ab394640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dddd0504d0 con 0x55dddd048ad0 2024-09-13T23:06:31.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.374+0000 7fe2ab394640 1 --2- 172.21.15.164:0/3403100801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddd048ad0 0x55dddd04ff90 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe2a006bfd0 tx=0x7fe2a0091010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.374+0000 7fe1897fa640 1 -- 172.21.15.164:0/3403100801 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2a006a720 con 0x55dddd048ad0 2024-09-13T23:06:31.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.374+0000 7fe1897fa640 1 -- 172.21.15.164:0/3403100801 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a006a8c0 con 0x55dddd048ad0 2024-09-13T23:06:31.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.374+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dddd050760 con 0x55dddd048ad0 2024-09-13T23:06:31.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.375+0000 7fe1897fa640 1 -- 172.21.15.164:0/3403100801 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2a007c3f0 con 0x55dddd048ad0 2024-09-13T23:06:31.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.375+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dddd053410 con 0x55dddd048ad0 2024-09-13T23:06:31.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.376+0000 7fe2aff1f800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.376+0000 7fe1897fa640 1 -- 172.21.15.164:0/3403100801 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe2a00a1060 con 0x55dddd048ad0 2024-09-13T23:06:31.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.376+0000 7fe1897fa640 1 --2- 172.21.15.164:0/3403100801 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe174036b40 0x7fe174039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.377+0000 7fe1897fa640 1 -- 172.21.15.164:0/3403100801 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe2a009bd40 con 0x55dddd048ad0 2024-09-13T23:06:31.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.377+0000 7fe2ac396640 1 --2- 172.21.15.164:0/3403100801 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe174036b40 0x7fe174039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.377+0000 7fe2aff1f800 1 --2- 172.21.15.164:0/3403100801 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55dddd05baf0 0x55dddd05df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.377+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dddd05e6e0 con 0x55dddd05baf0 2024-09-13T23:06:31.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.377+0000 7fe2abb95640 1 --2- 172.21.15.164:0/3403100801 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55dddd05baf0 0x55dddd05df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.377+0000 7fe2ac396640 1 --2- 172.21.15.164:0/3403100801 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe174036b40 0x7fe174039000 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55dddd02c560 tx=0x7fe2a401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.377+0000 7fe2abb95640 1 --2- 172.21.15.164:0/3403100801 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55dddd05baf0 0x55dddd05df90 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.377+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe29c02dcf0 con 0x55dddd05baf0 2024-09-13T23:06:31.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.377+0000 7fe2aff1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.377+0000 7fe2aff1f800 20 realm 2024-09-13T23:06:31.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.377+0000 7fe2aff1f800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.377+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dddd05eaf0 con 0x55dddd05baf0 2024-09-13T23:06:31.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.377+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe29c02dcf0 con 0x55dddd05baf0 2024-09-13T23:06:31.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.378+0000 7fe2aff1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.378+0000 7fe2aff1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:06:31.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.378+0000 7fe2aff1f800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.378+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dddd05f3c0 con 0x55dddd05baf0 2024-09-13T23:06:31.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.378+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe29c02dcf0 con 0x55dddd05baf0 2024-09-13T23:06:31.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.378+0000 7fe2aff1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.378+0000 7fe2aff1f800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.378+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dddd05f760 con 0x55dddd05baf0 2024-09-13T23:06:31.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.378+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe29c02dcf0 con 0x55dddd05baf0 2024-09-13T23:06:31.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.378+0000 7fe2aff1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:06:31.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.378+0000 7fe2aff1f800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.378+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dddd05f010 con 0x55dddd05baf0 2024-09-13T23:06:31.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.378+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe29c02dcf0 con 0x55dddd05baf0 2024-09-13T23:06:31.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.378+0000 7fe2aff1f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:06:31.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.378+0000 7fe2aff1f800 20 searching for the correct realm 2024-09-13T23:06:31.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.378+0000 7fe2aff1f800 1 --2- 172.21.15.164:0/3403100801 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55dddd061c10 0x55dddd064000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.378+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dddd0646d0 con 0x55dddd061c10 2024-09-13T23:06:31.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.378+0000 7fe2ab394640 1 --2- 172.21.15.164:0/3403100801 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55dddd061c10 0x55dddd064000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.379+0000 7fe2ab394640 1 --2- 172.21.15.164:0/3403100801 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55dddd061c10 0x55dddd064000 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.379+0000 7fe2ab394640 1 -- 172.21.15.164:0/3403100801 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a0082030 con 0x55dddd061c10 2024-09-13T23:06:31.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.379+0000 7fe2ab394640 1 --2- 172.21.15.164:0/3403100801 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fe2a00a3070 0x7fe2a004e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.379+0000 7fe2ab394640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dddd0646d0 con 0x7fe2a00a3070 2024-09-13T23:06:31.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.379+0000 7fe2ac396640 1 --2- 172.21.15.164:0/3403100801 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fe2a00a3070 0x7fe2a004e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.379+0000 7fe2ac396640 1 --2- 172.21.15.164:0/3403100801 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fe2a00a3070 0x7fe2a004e140 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.380+0000 7fe2ac396640 1 -- 172.21.15.164:0/3403100801 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a401f070 con 0x7fe2a00a3070 2024-09-13T23:06:31.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.380+0000 7fe2ac396640 1 --2- 172.21.15.164:0/3403100801 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fe2a4031040 0x7fe2a4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.380+0000 7fe2ac396640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dddd0646d0 con 0x7fe2a4031040 2024-09-13T23:06:31.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.380+0000 7fe2abb95640 1 --2- 172.21.15.164:0/3403100801 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fe2a4031040 0x7fe2a4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.380+0000 7fe2abb95640 1 --2- 172.21.15.164:0/3403100801 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fe2a4031040 0x7fe2a4032940 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.380+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe29c02dcf0 con 0x7fe2a4031040 2024-09-13T23:06:31.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.380+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dddd0646d0 con 0x55dddd05baf0 2024-09-13T23:06:31.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.381+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe29c02dcf0 con 0x55dddd05baf0 2024-09-13T23:06:31.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.381+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dddd0646d0 con 0x55dddd05baf0 2024-09-13T23:06:31.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.381+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe29c02dcf0 con 0x55dddd05baf0 2024-09-13T23:06:31.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.381+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dddd0646d0 con 0x7fe2a4031040 2024-09-13T23:06:31.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.381+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe29c02dcf0 con 0x7fe2a4031040 2024-09-13T23:06:31.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.381+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dddd0646d0 con 0x7fe2a4031040 2024-09-13T23:06:31.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.381+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe29c02dcf0 con 0x7fe2a4031040 2024-09-13T23:06:31.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.381+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dddd0646d0 con 0x7fe2a00a3070 2024-09-13T23:06:31.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.382+0000 7fe2ac396640 1 -- 172.21.15.164:0/3403100801 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a401f070 con 0x7fe2a00a3070 2024-09-13T23:06:31.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.382+0000 7fe2ac396640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dddd0646d0 con 0x55dddd061c10 2024-09-13T23:06:31.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.382+0000 7fe2ab394640 1 -- 172.21.15.164:0/3403100801 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a0082030 con 0x55dddd061c10 2024-09-13T23:06:31.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.382+0000 7fe2ab394640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dddd0646d0 con 0x55dddd05baf0 2024-09-13T23:06:31.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.382+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe29c02dcf0 con 0x55dddd05baf0 2024-09-13T23:06:31.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.382+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dddd0646d0 con 0x7fe2a4031040 2024-09-13T23:06:31.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.383+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe29c02dcf0 con 0x7fe2a4031040 2024-09-13T23:06:31.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.383+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dddd0646d0 con 0x55dddd05baf0 2024-09-13T23:06:31.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.383+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe29c02dcf0 con 0x55dddd05baf0 2024-09-13T23:06:31.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.383+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dddd0646d0 con 0x7fe2a00a3070 2024-09-13T23:06:31.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.383+0000 7fe2ac396640 1 -- 172.21.15.164:0/3403100801 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe2a401f070 con 0x7fe2a00a3070 2024-09-13T23:06:31.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.383+0000 7fe2ac396640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dddd0646d0 con 0x55dddd061c10 2024-09-13T23:06:31.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.383+0000 7fe2ab394640 1 -- 172.21.15.164:0/3403100801 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a0082030 con 0x55dddd061c10 2024-09-13T23:06:31.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.383+0000 7fe2ab394640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dddd0646d0 con 0x55dddd061c10 2024-09-13T23:06:31.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.384+0000 7fe2ab394640 1 -- 172.21.15.164:0/3403100801 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a0082030 con 0x55dddd061c10 2024-09-13T23:06:31.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.384+0000 7fe2ab394640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe2a00b3040 con 0x7fe2a4031040 2024-09-13T23:06:31.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.384+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe29c02dcf0 con 0x7fe2a4031040 2024-09-13T23:06:31.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.384+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe2a00b3040 con 0x55dddd061c10 2024-09-13T23:06:31.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.384+0000 7fe2ab394640 1 -- 172.21.15.164:0/3403100801 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a0082030 con 0x55dddd061c10 2024-09-13T23:06:31.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.384+0000 7fe2ab394640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe2a00b3040 con 0x55dddd061c10 2024-09-13T23:06:31.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.384+0000 7fe2ab394640 1 -- 172.21.15.164:0/3403100801 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a0082030 con 0x55dddd061c10 2024-09-13T23:06:31.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.384+0000 7fe2ab394640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe2a00b3040 con 0x55dddd05baf0 2024-09-13T23:06:31.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.385+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe29c02dcf0 con 0x55dddd05baf0 2024-09-13T23:06:31.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.385+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe2a00b3040 con 0x55dddd05baf0 2024-09-13T23:06:31.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.385+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe29c02dcf0 con 0x55dddd05baf0 2024-09-13T23:06:31.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.385+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe2a00b3040 con 0x7fe2a4031040 2024-09-13T23:06:31.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.385+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe29c02dcf0 con 0x7fe2a4031040 2024-09-13T23:06:31.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.385+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe2a00b3040 con 0x55dddd061c10 2024-09-13T23:06:31.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.385+0000 7fe2ab394640 1 -- 172.21.15.164:0/3403100801 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a0082030 con 0x55dddd061c10 2024-09-13T23:06:31.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.385+0000 7fe2ab394640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe2a00b3040 con 0x7fe2a00a3070 2024-09-13T23:06:31.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.385+0000 7fe2ac396640 1 -- 172.21.15.164:0/3403100801 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a401f070 con 0x7fe2a00a3070 2024-09-13T23:06:31.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.385+0000 7fe2ac396640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe2a00b3040 con 0x55dddd05baf0 2024-09-13T23:06:31.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.386+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe29c02dcf0 con 0x55dddd05baf0 2024-09-13T23:06:31.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.386+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe2a00b3040 con 0x7fe2a4031040 2024-09-13T23:06:31.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.386+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe29c02dcf0 con 0x7fe2a4031040 2024-09-13T23:06:31.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.386+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe2a00b3040 con 0x55dddd061c10 2024-09-13T23:06:31.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.386+0000 7fe2ab394640 1 -- 172.21.15.164:0/3403100801 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a0082030 con 0x55dddd061c10 2024-09-13T23:06:31.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.386+0000 7fe2ab394640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe2a00b3040 con 0x7fe2a4031040 2024-09-13T23:06:31.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.387+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe29c02dcf0 con 0x7fe2a4031040 2024-09-13T23:06:31.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.387+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe2a00b3040 con 0x7fe2a00a3070 2024-09-13T23:06:31.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.387+0000 7fe2ac396640 1 -- 172.21.15.164:0/3403100801 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a401f070 con 0x7fe2a00a3070 2024-09-13T23:06:31.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.387+0000 7fe2ac396640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe2a00b3040 con 0x55dddd061c10 2024-09-13T23:06:31.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.387+0000 7fe2ab394640 1 -- 172.21.15.164:0/3403100801 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a0082030 con 0x55dddd061c10 2024-09-13T23:06:31.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.387+0000 7fe2ab394640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe2a00b3040 con 0x7fe2a00a3070 2024-09-13T23:06:31.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.387+0000 7fe2ac396640 1 -- 172.21.15.164:0/3403100801 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a401f070 con 0x7fe2a00a3070 2024-09-13T23:06:31.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.387+0000 7fe2ac396640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe2a00b3040 con 0x55dddd05baf0 2024-09-13T23:06:31.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.388+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe29c02dcf0 con 0x55dddd05baf0 2024-09-13T23:06:31.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.388+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe2a00b3040 con 0x7fe2a00a3070 2024-09-13T23:06:31.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.388+0000 7fe2ac396640 1 -- 172.21.15.164:0/3403100801 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a4040040 con 0x7fe2a00a3070 2024-09-13T23:06:31.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.388+0000 7fe2aff1f800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:06:31.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.388+0000 7fe2aff1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:06:31.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.388+0000 7fe2aff1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:06:31.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.388+0000 7fe2aff1f800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:06:31.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.388+0000 7fe2aff1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:06:31.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.388+0000 7fe2aff1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:06:31.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.388+0000 7fe2aff1f800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.388+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dddd0606e0 con 0x55dddd05baf0 2024-09-13T23:06:31.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.388+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe29c02dcf0 con 0x55dddd05baf0 2024-09-13T23:06:31.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.388+0000 7fe2aff1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.388+0000 7fe2aff1f800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.388+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dddd060f80 con 0x55dddd05baf0 2024-09-13T23:06:31.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.388+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe29c02dcf0 con 0x55dddd05baf0 2024-09-13T23:06:31.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.388+0000 7fe2aff1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:06:31.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.388+0000 7fe2aff1f800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.388+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dddd060320 con 0x55dddd05baf0 2024-09-13T23:06:31.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.389+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe29c02dcf0 con 0x55dddd05baf0 2024-09-13T23:06:31.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.389+0000 7fe2aff1f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:06:31.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.389+0000 7fe2aff1f800 20 zone default found 2024-09-13T23:06:31.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.389+0000 7fe2aff1f800 4 Realm: () 2024-09-13T23:06:31.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.389+0000 7fe2aff1f800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:06:31.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.389+0000 7fe2aff1f800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:06:31.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.389+0000 7fe2aff1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:06:31.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.389+0000 7fe2aff1f800 20 zonegroup default 2024-09-13T23:06:31.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.389+0000 7fe2aff1f800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.389+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dddd065000 con 0x7fe2a4031040 2024-09-13T23:06:31.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.389+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe29c02dcf0 con 0x7fe2a4031040 2024-09-13T23:06:31.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.389+0000 7fe2aff1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.389+0000 7fe2aff1f800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.389+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dddd066ad0 con 0x55dddd061c10 2024-09-13T23:06:31.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.389+0000 7fe2ab394640 1 -- 172.21.15.164:0/3403100801 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe2a0082030 con 0x55dddd061c10 2024-09-13T23:06:31.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.389+0000 7fe2aff1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.389+0000 7fe2aff1f800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.389+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dddd066fc0 con 0x55dddd061c10 2024-09-13T23:06:31.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.390+0000 7fe2ab394640 1 -- 172.21.15.164:0/3403100801 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe2a0082030 con 0x55dddd061c10 2024-09-13T23:06:31.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.390+0000 7fe2aff1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.390+0000 7fe2aff1f800 20 started sync module instance, tier type = 2024-09-13T23:06:31.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.390+0000 7fe2aff1f800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:06:31.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.390+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dddd066600 con 0x7fe2a00a3070 2024-09-13T23:06:31.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.391+0000 7fe2ac396640 1 -- 172.21.15.164:0/3403100801 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2a4040040 con 0x7fe2a00a3070 2024-09-13T23:06:31.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.391+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94411384314496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dddd067460 con 0x7fe2a00a3070 2024-09-13T23:06:31.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.391+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dddd067ef0 con 0x55dddd05baf0 2024-09-13T23:06:31.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.392+0000 7fe2ac396640 1 -- 172.21.15.164:0/3403100801 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94411384314496] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2a4040040 con 0x7fe2a00a3070 2024-09-13T23:06:31.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.392+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe29c02dcf0 con 0x55dddd05baf0 2024-09-13T23:06:31.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.392+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94411384322496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dddd067eb0 con 0x55dddd05baf0 2024-09-13T23:06:31.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.392+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dddd068960 con 0x55dddd061c10 2024-09-13T23:06:31.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.393+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94411384322496] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe29c02dcf0 con 0x55dddd05baf0 2024-09-13T23:06:31.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.393+0000 7fe2ab394640 1 -- 172.21.15.164:0/3403100801 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2a0082030 con 0x55dddd061c10 2024-09-13T23:06:31.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.393+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94411384325296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dddd068d80 con 0x55dddd061c10 2024-09-13T23:06:31.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.393+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dddd069780 con 0x7fe2a00a3070 2024-09-13T23:06:31.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.394+0000 7fe2ab394640 1 -- 172.21.15.164:0/3403100801 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94411384325296] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2a0082030 con 0x55dddd061c10 2024-09-13T23:06:31.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.394+0000 7fe2ac396640 1 -- 172.21.15.164:0/3403100801 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2a4040040 con 0x7fe2a00a3070 2024-09-13T23:06:31.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.394+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94411384315792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dddd069b70 con 0x7fe2a00a3070 2024-09-13T23:06:31.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.394+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dddd06a570 con 0x55dddd05baf0 2024-09-13T23:06:31.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.396+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe29c02dcf0 con 0x55dddd05baf0 2024-09-13T23:06:31.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.396+0000 7fe2ac396640 1 -- 172.21.15.164:0/3403100801 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94411384315792] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2a4040040 con 0x7fe2a00a3070 2024-09-13T23:06:31.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.396+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94411384328848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dddd06a530 con 0x55dddd05baf0 2024-09-13T23:06:31.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.396+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dddd06aff0 con 0x7fe2a4031040 2024-09-13T23:06:31.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.397+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe29c02dcf0 con 0x7fe2a4031040 2024-09-13T23:06:31.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.397+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94411384335104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dddd06af60 con 0x7fe2a4031040 2024-09-13T23:06:31.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.397+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dddd06bf20 con 0x7fe2a4031040 2024-09-13T23:06:31.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.397+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94411384328848] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe29c02dcf0 con 0x55dddd05baf0 2024-09-13T23:06:31.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.398+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(56 notify.6 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe29c02dcf0 con 0x7fe2a4031040 2024-09-13T23:06:31.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.398+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94411384338992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dddd06bf20 con 0x7fe2a4031040 2024-09-13T23:06:31.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.398+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dddd06c940 con 0x7fe2a4031040 2024-09-13T23:06:31.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.398+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94411384335104] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe29c02dcf0 con 0x7fe2a4031040 2024-09-13T23:06:31.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.399+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94411384338992] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe29c02dcf0 con 0x7fe2a4031040 2024-09-13T23:06:31.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.399+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe29c02dcf0 con 0x7fe2a4031040 2024-09-13T23:06:31.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.399+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94411384332416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dddd06b3e0 con 0x7fe2a4031040 2024-09-13T23:06:31.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.399+0000 7fe2aff1f800 20 add_watcher() i=0 2024-09-13T23:06:31.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.399+0000 7fe2aff1f800 20 add_watcher() i=1 2024-09-13T23:06:31.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.399+0000 7fe2aff1f800 20 add_watcher() i=2 2024-09-13T23:06:31.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.399+0000 7fe2aff1f800 20 add_watcher() i=3 2024-09-13T23:06:31.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.399+0000 7fe2aff1f800 20 add_watcher() i=4 2024-09-13T23:06:31.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.399+0000 7fe2aff1f800 20 add_watcher() i=5 2024-09-13T23:06:31.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.399+0000 7fe2aff1f800 20 add_watcher() i=6 2024-09-13T23:06:31.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.400+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94411384332416] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe29c02dcf0 con 0x7fe2a4031040 2024-09-13T23:06:31.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.400+0000 7fe2aff1f800 20 add_watcher() i=7 2024-09-13T23:06:31.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.400+0000 7fe2aff1f800 2 all 8 watchers are set, enabling cache 2024-09-13T23:06:31.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.400+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dddd06f930 con 0x55dddd05baf0 2024-09-13T23:06:31.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.400+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe29c02dcf0 con 0x55dddd05baf0 2024-09-13T23:06:31.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.400+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94411384341552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dddd06cdb0 con 0x55dddd05baf0 2024-09-13T23:06:31.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.401+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94411384341552] v34'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe29c02dcf0 con 0x55dddd05baf0 2024-09-13T23:06:31.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.402+0000 7fe161fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:06:31.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.402+0000 7fe2aff1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:06:31.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.402+0000 7fe2aff1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:06:31.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.402+0000 7fe2aff1f800 5 note: GC not initialized 2024-09-13T23:06:31.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.402+0000 7fe160fe1640 20 reqs_thread_entry: start 2024-09-13T23:06:31.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.402+0000 7fe2aff1f800 20 init_complete bucket index max shards: 11 2024-09-13T23:06:31.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.402+0000 7fe2aff1f800 20 Filter name: none 2024-09-13T23:06:31.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.402+0000 7fe0da7fc640 20 reqs_thread_entry: start 2024-09-13T23:06:31.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.402+0000 7fe2aff1f800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.402+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dddd0a2760 con 0x55dddd05baf0 2024-09-13T23:06:31.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.402+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe29c02dcf0 con 0x55dddd05baf0 2024-09-13T23:06:31.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.402+0000 7fe2aff1f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:06:31.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.403+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dddd0a3cb0 con 0x7fe2a4031040 2024-09-13T23:06:31.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.403+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fe29c02dcf0 con 0x7fe2a4031040 2024-09-13T23:06:31.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.404+0000 7fe161fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:06:31.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.404+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94411384341552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dddd0a0d60 con 0x55dddd05baf0 2024-09-13T23:06:31.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.405+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94411384341552] v34'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe29c02dcf0 con 0x55dddd05baf0 2024-09-13T23:06:31.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.405+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94411384314496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dddd06c430 con 0x7fe2a00a3070 2024-09-13T23:06:31.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.406+0000 7fe2ac396640 1 -- 172.21.15.164:0/3403100801 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94411384314496] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2a4040040 con 0x7fe2a00a3070 2024-09-13T23:06:31.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.406+0000 7fe2aff1f800 20 remove_watcher() i=0 2024-09-13T23:06:31.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.406+0000 7fe2aff1f800 2 removed watcher, disabling cache 2024-09-13T23:06:31.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.406+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94411384322496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dddd06c430 con 0x55dddd05baf0 2024-09-13T23:06:31.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.407+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94411384322496] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe29c02dcf0 con 0x55dddd05baf0 2024-09-13T23:06:31.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.407+0000 7fe2aff1f800 20 remove_watcher() i=1 2024-09-13T23:06:31.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.407+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94411384325296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dddd0679c0 con 0x55dddd061c10 2024-09-13T23:06:31.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.408+0000 7fe2ab394640 1 -- 172.21.15.164:0/3403100801 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94411384325296] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2a0082030 con 0x55dddd061c10 2024-09-13T23:06:31.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.408+0000 7fe2aff1f800 20 remove_watcher() i=2 2024-09-13T23:06:31.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.408+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94411384315792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dddd06c430 con 0x7fe2a00a3070 2024-09-13T23:06:31.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.409+0000 7fe2ac396640 1 -- 172.21.15.164:0/3403100801 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94411384315792] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2a4040040 con 0x7fe2a00a3070 2024-09-13T23:06:31.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.409+0000 7fe2aff1f800 20 remove_watcher() i=3 2024-09-13T23:06:31.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.409+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94411384328848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dddd0684b0 con 0x55dddd05baf0 2024-09-13T23:06:31.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.410+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94411384328848] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe29c02dcf0 con 0x55dddd05baf0 2024-09-13T23:06:31.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.410+0000 7fe2aff1f800 20 remove_watcher() i=4 2024-09-13T23:06:31.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.410+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94411384335104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dddd06c430 con 0x7fe2a4031040 2024-09-13T23:06:31.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.411+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94411384335104] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe29c02dcf0 con 0x7fe2a4031040 2024-09-13T23:06:31.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.411+0000 7fe2aff1f800 20 remove_watcher() i=5 2024-09-13T23:06:31.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.411+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94411384338992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dddd069290 con 0x7fe2a4031040 2024-09-13T23:06:31.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.412+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94411384338992] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe29c02dcf0 con 0x7fe2a4031040 2024-09-13T23:06:31.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.412+0000 7fe2aff1f800 20 remove_watcher() i=6 2024-09-13T23:06:31.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.412+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94411384332416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dddd0684b0 con 0x7fe2a4031040 2024-09-13T23:06:31.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.413+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94411384332416] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe29c02dcf0 con 0x7fe2a4031040 2024-09-13T23:06:31.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.413+0000 7fe2aff1f800 20 remove_watcher() i=7 2024-09-13T23:06:31.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.414+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fe2a4031040 msgr2=0x7fe2a4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.414+0000 7fe2aff1f800 1 --2- 172.21.15.164:0/3403100801 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fe2a4031040 0x7fe2a4032940 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.414+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55dddd05baf0 msgr2=0x55dddd05df90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.414+0000 7fe2aff1f800 1 --2- 172.21.15.164:0/3403100801 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55dddd05baf0 0x55dddd05df90 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.414+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fe2a00a3070 msgr2=0x7fe2a004e140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.414+0000 7fe2aff1f800 1 --2- 172.21.15.164:0/3403100801 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fe2a00a3070 0x7fe2a004e140 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.414+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55dddd061c10 msgr2=0x55dddd064000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.414+0000 7fe2aff1f800 1 --2- 172.21.15.164:0/3403100801 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55dddd061c10 0x55dddd064000 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.414+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe174036b40 msgr2=0x7fe174039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.414+0000 7fe2aff1f800 1 --2- 172.21.15.164:0/3403100801 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe174036b40 0x7fe174039000 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55dddd02c560 tx=0x7fe2a401f000 comp rx=0 tx=0).stop 2024-09-13T23:06:31.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.414+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddd048ad0 msgr2=0x55dddd04ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.414+0000 7fe2abb95640 1 -- 172.21.15.164:0/3403100801 reap_dead start 2024-09-13T23:06:31.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.414+0000 7fe2aff1f800 1 --2- 172.21.15.164:0/3403100801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddd048ad0 0x55dddd04ff90 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe2a006bfd0 tx=0x7fe2a0091010 comp rx=0 tx=0).stop 2024-09-13T23:06:31.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.414+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 shutdown_connections 2024-09-13T23:06:31.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.414+0000 7fe2aff1f800 1 --2- 172.21.15.164:0/3403100801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddd048ad0 0x55dddd04ff90 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.414+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 >> 172.21.15.164:0/3403100801 conn(0x55dddd044e30 msgr2=0x55dddd042f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.414+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 shutdown_connections 2024-09-13T23:06:31.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.414+0000 7fe2aff1f800 1 -- 172.21.15.164:0/3403100801 wait complete. 2024-09-13T23:06:31.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.414+0000 7fe2aff1f800 1 -- 172.21.15.164:0/1732342499 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe184036b90 msgr2=0x7fe184039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.414+0000 7fe2aff1f800 1 --2- 172.21.15.164:0/1732342499 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe184036b90 0x7fe184039050 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55dddd02cde0 tx=0x7fe2a4005840 comp rx=0 tx=0).stop 2024-09-13T23:06:31.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.414+0000 7fe2aff1f800 1 -- 172.21.15.164:0/1732342499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddd03bf30 msgr2=0x55dddd03c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.414+0000 7fe2aff1f800 1 --2- 172.21.15.164:0/1732342499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddd03bf30 0x55dddd03c350 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0045f50 tx=0x7fe2a0002fb0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.414+0000 7fe2aff1f800 1 -- 172.21.15.164:0/1732342499 shutdown_connections 2024-09-13T23:06:31.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.414+0000 7fe2aff1f800 1 --2- 172.21.15.164:0/1732342499 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe184036b90 0x7fe184039050 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.414+0000 7fe2aff1f800 1 --2- 172.21.15.164:0/1732342499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddd03bf30 0x55dddd03c350 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.414+0000 7fe2aff1f800 1 -- 172.21.15.164:0/1732342499 >> 172.21.15.164:0/1732342499 conn(0x55dddd030ec0 msgr2=0x55dddd033a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.414+0000 7fe2aff1f800 1 -- 172.21.15.164:0/1732342499 shutdown_connections 2024-09-13T23:06:31.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.414+0000 7fe2aff1f800 1 -- 172.21.15.164:0/1732342499 wait complete. 2024-09-13T23:06:31.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.415+0000 7fe2aff1f800 1 -- 172.21.15.164:0/1444429296 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55dddcf2f920 msgr2=0x55dddd02b530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.415+0000 7fe2aff1f800 1 --2- 172.21.15.164:0/1444429296 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55dddcf2f920 0x55dddd02b530 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.415+0000 7fe2aff1f800 1 -- 172.21.15.164:0/1444429296 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe194036b40 msgr2=0x7fe194039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.415+0000 7fe2aff1f800 1 --2- 172.21.15.164:0/1444429296 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe194036b40 0x7fe194039000 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0057000 tx=0x7fe2a0052000 comp rx=0 tx=0).stop 2024-09-13T23:06:31.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.415+0000 7fe2aff1f800 1 -- 172.21.15.164:0/1444429296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddce9ee10 msgr2=0x55dddd0244c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.415+0000 7fe2aff1f800 1 --2- 172.21.15.164:0/1444429296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddce9ee10 0x55dddd0244c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe29c00b7c0 tx=0x7fe29c000ed0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.415+0000 7fe2aff1f800 1 -- 172.21.15.164:0/1444429296 shutdown_connections 2024-09-13T23:06:31.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.415+0000 7fe2aff1f800 1 --2- 172.21.15.164:0/1444429296 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55dddcf2f920 0x55dddd02b530 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.415+0000 7fe2aff1f800 1 --2- 172.21.15.164:0/1444429296 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe194036b40 0x7fe194039000 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.415+0000 7fe2aff1f800 1 --2- 172.21.15.164:0/1444429296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dddce9ee10 0x55dddd0244c0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.415+0000 7fe2aff1f800 1 -- 172.21.15.164:0/1444429296 >> 172.21.15.164:0/1444429296 conn(0x55dddcf25dd0 msgr2=0x55dddd015e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.415+0000 7fe2aff1f800 1 -- 172.21.15.164:0/1444429296 shutdown_connections 2024-09-13T23:06:31.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.415+0000 7fe2aff1f800 1 -- 172.21.15.164:0/1444429296 wait complete. 2024-09-13T23:06:31.428 INFO:teuthology.orchestra.run.smithi164.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2024-09-13T23:06:31.428 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-09-13T23:06:31.428 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-13T23:06:31.428 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-13T23:06:31.429 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-13T23:06:31.481 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:06:31.481 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:06:31.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.481+0000 7f0000830800 1 Processor -- start 2024-09-13T23:06:31.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.481+0000 7f0000830800 1 -- start start 2024-09-13T23:06:31.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.481+0000 7f0000830800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x557443d3eed0 0x557443dce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.481+0000 7f0000830800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557443c8ab30 con 0x557443dce6c0 2024-09-13T23:06:31.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.481+0000 7f0000830800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x557443c6c360 con 0x557443d3eed0 2024-09-13T23:06:31.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.482+0000 7efffbbd6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x557443d3eed0 0x557443dce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.482+0000 7efffbbd6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x557443d3eed0 0x557443dce180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44810/0 (socket says 172.21.15.164:44810) 2024-09-13T23:06:31.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.482+0000 7efffbbd6640 1 -- 172.21.15.164:0/2657787068 learned_addr learned my addr 172.21.15.164:0/2657787068 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.482+0000 7efff3fff640 1 --1- 172.21.15.164:0/2657787068 >> v1:172.21.15.17:6789/0 conn(0x557443dce6c0 0x557443dd0ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:55960/0 (socket says 172.21.15.164:55960) 2024-09-13T23:06:31.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.482+0000 7efffbbd6640 1 -- 172.21.15.164:0/2657787068 >> v1:172.21.15.17:6789/0 conn(0x557443dce6c0 legacy=0x557443dd0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.482+0000 7efffbbd6640 1 -- 172.21.15.164:0/2657787068 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557443c92e00 con 0x557443d3eed0 2024-09-13T23:06:31.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.484+0000 7efffbbd6640 1 --2- 172.21.15.164:0/2657787068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443d3eed0 0x557443dce180 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7effec00a520 tx=0x7effec045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806e00eb6a46d435 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.484+0000 7efffb3d5640 1 -- 172.21.15.164:0/2657787068 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effec055070 con 0x557443d3eed0 2024-09-13T23:06:31.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.484+0000 7efffb3d5640 1 -- 172.21.15.164:0/2657787068 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effec0515b0 con 0x557443d3eed0 2024-09-13T23:06:31.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.484+0000 7efffb3d5640 1 -- 172.21.15.164:0/2657787068 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effec0518d0 con 0x557443d3eed0 2024-09-13T23:06:31.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.484+0000 7f0000830800 1 -- 172.21.15.164:0/2657787068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443d3eed0 msgr2=0x557443dce180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.484+0000 7f0000830800 1 --2- 172.21.15.164:0/2657787068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443d3eed0 0x557443dce180 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7effec00a520 tx=0x7effec045ba0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.484+0000 7f0000830800 1 -- 172.21.15.164:0/2657787068 shutdown_connections 2024-09-13T23:06:31.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.484+0000 7f0000830800 1 --2- 172.21.15.164:0/2657787068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443d3eed0 0x557443dce180 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.484+0000 7f0000830800 1 -- 172.21.15.164:0/2657787068 >> 172.21.15.164:0/2657787068 conn(0x557443dc5e30 msgr2=0x557443dc8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.484+0000 7f0000830800 1 -- 172.21.15.164:0/2657787068 shutdown_connections 2024-09-13T23:06:31.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.484+0000 7f0000830800 1 -- 172.21.15.164:0/2657787068 wait complete. 2024-09-13T23:06:31.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.498+0000 7f0000830800 1 Processor -- start 2024-09-13T23:06:31.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.498+0000 7f0000830800 1 -- start start 2024-09-13T23:06:31.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.499+0000 7f0000830800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443d3eed0 0x557443dcbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.499+0000 7f0000830800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557443d17370 con 0x557443d3eed0 2024-09-13T23:06:31.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.499+0000 7efffbbd6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443d3eed0 0x557443dcbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.499+0000 7efffbbd6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443d3eed0 0x557443dcbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44818/0 (socket says 172.21.15.164:44818) 2024-09-13T23:06:31.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.499+0000 7efffbbd6640 1 -- 172.21.15.164:0/3124464780 learned_addr learned my addr 172.21.15.164:0/3124464780 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.499+0000 7efffbbd6640 1 -- 172.21.15.164:0/3124464780 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557443c64bc0 con 0x557443d3eed0 2024-09-13T23:06:31.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.499+0000 7efffbbd6640 1 --2- 172.21.15.164:0/3124464780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443d3eed0 0x557443dcbab0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7effec025da0 tx=0x7effec051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa71c42c9c498f0a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.500+0000 7efee9e0b640 1 -- 172.21.15.164:0/3124464780 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effec051890 con 0x557443d3eed0 2024-09-13T23:06:31.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.500+0000 7efee9e0b640 1 -- 172.21.15.164:0/3124464780 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effec051ac0 con 0x557443d3eed0 2024-09-13T23:06:31.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.500+0000 7efee9e0b640 1 -- 172.21.15.164:0/3124464780 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effec051da0 con 0x557443d3eed0 2024-09-13T23:06:31.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.500+0000 7f0000830800 1 -- 172.21.15.164:0/3124464780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443d3eed0 msgr2=0x557443dcbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.500+0000 7f0000830800 1 --2- 172.21.15.164:0/3124464780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443d3eed0 0x557443dcbab0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7effec025da0 tx=0x7effec051000 comp rx=0 tx=0).stop 2024-09-13T23:06:31.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.500+0000 7f0000830800 1 -- 172.21.15.164:0/3124464780 shutdown_connections 2024-09-13T23:06:31.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.500+0000 7f0000830800 1 --2- 172.21.15.164:0/3124464780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443d3eed0 0x557443dcbab0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.500+0000 7f0000830800 1 -- 172.21.15.164:0/3124464780 >> 172.21.15.164:0/3124464780 conn(0x557443dc5e30 msgr2=0x557443eb6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.500+0000 7f0000830800 1 -- 172.21.15.164:0/3124464780 shutdown_connections 2024-09-13T23:06:31.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.500+0000 7f0000830800 1 -- 172.21.15.164:0/3124464780 wait complete. 2024-09-13T23:06:31.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.501+0000 7f0000830800 1 Processor -- start 2024-09-13T23:06:31.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.501+0000 7f0000830800 1 -- start start 2024-09-13T23:06:31.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.501+0000 7f0000830800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443d3eed0 0x557443ec4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.501+0000 7f0000830800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557443dd2630 con 0x557443d3eed0 2024-09-13T23:06:31.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.501+0000 7efffbbd6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443d3eed0 0x557443ec4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.501+0000 7efffbbd6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443d3eed0 0x557443ec4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44826/0 (socket says 172.21.15.164:44826) 2024-09-13T23:06:31.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.501+0000 7efffbbd6640 1 -- 172.21.15.164:0/2722414338 learned_addr learned my addr 172.21.15.164:0/2722414338 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.501+0000 7efffbbd6640 1 -- 172.21.15.164:0/2722414338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557443c78fe0 con 0x557443d3eed0 2024-09-13T23:06:31.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.502+0000 7efffbbd6640 1 --2- 172.21.15.164:0/2722414338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443d3eed0 0x557443ec4430 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7effec067040 tx=0x7effec002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.502+0000 7efee3fff640 1 -- 172.21.15.164:0/2722414338 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effec073070 con 0x557443d3eed0 2024-09-13T23:06:31.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.502+0000 7efee3fff640 1 -- 172.21.15.164:0/2722414338 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effec05a450 con 0x557443d3eed0 2024-09-13T23:06:31.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.502+0000 7f0000830800 1 -- 172.21.15.164:0/2722414338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557443ec4970 con 0x557443d3eed0 2024-09-13T23:06:31.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.502+0000 7efee3fff640 1 -- 172.21.15.164:0/2722414338 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effec05a730 con 0x557443d3eed0 2024-09-13T23:06:31.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.502+0000 7f0000830800 1 -- 172.21.15.164:0/2722414338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557443ec4ef0 con 0x557443d3eed0 2024-09-13T23:06:31.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.503+0000 7efee3fff640 1 -- 172.21.15.164:0/2722414338 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7effec076070 con 0x557443d3eed0 2024-09-13T23:06:31.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.503+0000 7efee3fff640 1 --2- 172.21.15.164:0/2722414338 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efee4036b40 0x7efee4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.503+0000 7efee3fff640 1 -- 172.21.15.164:0/2722414338 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7effec062070 con 0x557443d3eed0 2024-09-13T23:06:31.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.503+0000 7efff3fff640 1 --2- 172.21.15.164:0/2722414338 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efee4036b40 0x7efee4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.503+0000 7f0000830800 1 --2- 172.21.15.164:0/2722414338 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x557443dce6c0 0x557443ecb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.503+0000 7f0000830800 1 -- 172.21.15.164:0/2722414338 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557443ecbad0 con 0x557443dce6c0 2024-09-13T23:06:31.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.503+0000 7efffc3d7640 1 --2- 172.21.15.164:0/2722414338 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x557443dce6c0 0x557443ecb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.503+0000 7efff3fff640 1 --2- 172.21.15.164:0/2722414338 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efee4036b40 0x7efee4039000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7effe4000f60 tx=0x7effe4001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.503+0000 7efffc3d7640 1 --2- 172.21.15.164:0/2722414338 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x557443dce6c0 0x557443ecb500 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.504+0000 7efffc3d7640 1 -- 172.21.15.164:0/2722414338 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efff400a4a0 con 0x557443dce6c0 2024-09-13T23:06:31.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.504+0000 7f0000830800 1 -- 172.21.15.164:0/2722414338 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557443ec8ad0 con 0x557443dce6c0 2024-09-13T23:06:31.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.504+0000 7efffc3d7640 1 -- 172.21.15.164:0/2722414338 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efff400a4a0 con 0x557443dce6c0 2024-09-13T23:06:31.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.504+0000 7f0000830800 1 -- 172.21.15.164:0/2722414338 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557443ecd8d0 con 0x557443dce6c0 2024-09-13T23:06:31.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.504+0000 7efffc3d7640 1 -- 172.21.15.164:0/2722414338 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efff400a4a0 con 0x557443dce6c0 2024-09-13T23:06:31.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.504+0000 7f0000830800 1 -- 172.21.15.164:0/2722414338 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557443ecca10 con 0x557443dce6c0 2024-09-13T23:06:31.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.505+0000 7efffc3d7640 1 -- 172.21.15.164:0/2722414338 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efff400a4a0 con 0x557443dce6c0 2024-09-13T23:06:31.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.505+0000 7f0000830800 1 -- 172.21.15.164:0/2722414338 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557443ecce60 con 0x557443dce6c0 2024-09-13T23:06:31.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.505+0000 7efffc3d7640 1 -- 172.21.15.164:0/2722414338 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efff400a4a0 con 0x557443dce6c0 2024-09-13T23:06:31.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.505+0000 7f0000830800 1 Processor -- start 2024-09-13T23:06:31.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.505+0000 7f0000830800 1 -- start start 2024-09-13T23:06:31.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.505+0000 7f0000830800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443edbec0 0x557443edc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.505+0000 7f0000830800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557443c66580 con 0x557443edbec0 2024-09-13T23:06:31.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.506+0000 7efff3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443edbec0 0x557443edc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.506+0000 7efff3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443edbec0 0x557443edc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44840/0 (socket says 172.21.15.164:44840) 2024-09-13T23:06:31.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.506+0000 7efff3fff640 1 -- 172.21.15.164:0/1077301170 learned_addr learned my addr 172.21.15.164:0/1077301170 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.506+0000 7efff3fff640 1 -- 172.21.15.164:0/1077301170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557443edc820 con 0x557443edbec0 2024-09-13T23:06:31.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.506+0000 7efff3fff640 1 --2- 172.21.15.164:0/1077301170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443edbec0 0x557443edc2e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7effe4001ed0 tx=0x7effe400ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.506+0000 7efee17fa640 1 -- 172.21.15.164:0/1077301170 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effe4022070 con 0x557443edbec0 2024-09-13T23:06:31.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.506+0000 7efee17fa640 1 -- 172.21.15.164:0/1077301170 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effe400be90 con 0x557443edbec0 2024-09-13T23:06:31.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.506+0000 7f0000830800 1 -- 172.21.15.164:0/1077301170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557443edcab0 con 0x557443edbec0 2024-09-13T23:06:31.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.506+0000 7efee17fa640 1 -- 172.21.15.164:0/1077301170 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effe400d650 con 0x557443edbec0 2024-09-13T23:06:31.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.506+0000 7f0000830800 1 -- 172.21.15.164:0/1077301170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557443edf790 con 0x557443edbec0 2024-09-13T23:06:31.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.507+0000 7efee17fa640 1 -- 172.21.15.164:0/1077301170 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7effe4025070 con 0x557443edbec0 2024-09-13T23:06:31.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.507+0000 7efee17fa640 1 --2- 172.21.15.164:0/1077301170 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efed4036b90 0x7efed4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.507+0000 7efee17fa640 1 -- 172.21.15.164:0/1077301170 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7effe404e0d0 con 0x557443edbec0 2024-09-13T23:06:31.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.508+0000 7efffc3d7640 1 --2- 172.21.15.164:0/1077301170 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efed4036b90 0x7efed4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.508+0000 7f0000830800 1 Processor -- start 2024-09-13T23:06:31.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.508+0000 7efffc3d7640 1 --2- 172.21.15.164:0/1077301170 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efed4036b90 0x7efed4039050 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x557443ecc530 tx=0x7efff4005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.508+0000 7f0000830800 1 -- start start 2024-09-13T23:06:31.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.508+0000 7f0000830800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443ee8b80 0x557443ee8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.508+0000 7f0000830800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557443dca090 con 0x557443ee8b80 2024-09-13T23:06:31.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.508+0000 7efff3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443ee8b80 0x557443ee8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.508+0000 7efff3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443ee8b80 0x557443ee8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44850/0 (socket says 172.21.15.164:44850) 2024-09-13T23:06:31.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.508+0000 7efff3fff640 1 -- 172.21.15.164:0/3991073373 learned_addr learned my addr 172.21.15.164:0/3991073373 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.508+0000 7efff3fff640 1 -- 172.21.15.164:0/3991073373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557443ee9550 con 0x557443ee8b80 2024-09-13T23:06:31.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.509+0000 7efff3fff640 1 --2- 172.21.15.164:0/3991073373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443ee8b80 0x557443ee8f80 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7effe404c390 tx=0x7effe40243f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b912040bb7700e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.509+0000 7efedaffd640 1 -- 172.21.15.164:0/3991073373 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effe400d7f0 con 0x557443ee8b80 2024-09-13T23:06:31.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.509+0000 7efedaffd640 1 -- 172.21.15.164:0/3991073373 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effe40263b0 con 0x557443ee8b80 2024-09-13T23:06:31.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.509+0000 7efedaffd640 1 -- 172.21.15.164:0/3991073373 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effe400db20 con 0x557443ee8b80 2024-09-13T23:06:31.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.509+0000 7f0000830800 1 -- 172.21.15.164:0/3991073373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443ee8b80 msgr2=0x557443ee8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.509+0000 7f0000830800 1 --2- 172.21.15.164:0/3991073373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443ee8b80 0x557443ee8f80 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7effe404c390 tx=0x7effe40243f0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.509+0000 7f0000830800 1 -- 172.21.15.164:0/3991073373 shutdown_connections 2024-09-13T23:06:31.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.509+0000 7f0000830800 1 --2- 172.21.15.164:0/3991073373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443ee8b80 0x557443ee8f80 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.509+0000 7f0000830800 1 -- 172.21.15.164:0/3991073373 >> 172.21.15.164:0/3991073373 conn(0x557443ee4ee0 msgr2=0x557443ee2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.509+0000 7f0000830800 1 -- 172.21.15.164:0/3991073373 shutdown_connections 2024-09-13T23:06:31.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.509+0000 7f0000830800 1 -- 172.21.15.164:0/3991073373 wait complete. 2024-09-13T23:06:31.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.510+0000 7f0000830800 1 Processor -- start 2024-09-13T23:06:31.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.510+0000 7f0000830800 1 -- start start 2024-09-13T23:06:31.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.510+0000 7f0000830800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443ee8b80 0x557443ef0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.510+0000 7f0000830800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557443ee9bc0 con 0x557443ee8b80 2024-09-13T23:06:31.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.510+0000 7efff3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443ee8b80 0x557443ef0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.510+0000 7efff3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443ee8b80 0x557443ef0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44864/0 (socket says 172.21.15.164:44864) 2024-09-13T23:06:31.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.510+0000 7efff3fff640 1 -- 172.21.15.164:0/3528030147 learned_addr learned my addr 172.21.15.164:0/3528030147 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.510+0000 7efff3fff640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557443ef05c0 con 0x557443ee8b80 2024-09-13T23:06:31.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.510+0000 7efff3fff640 1 --2- 172.21.15.164:0/3528030147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443ee8b80 0x557443ef0080 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7effe404e080 tx=0x7effe404c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.511+0000 7efed97fa640 1 -- 172.21.15.164:0/3528030147 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effe4024ae0 con 0x557443ee8b80 2024-09-13T23:06:31.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.511+0000 7efed97fa640 1 -- 172.21.15.164:0/3528030147 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effe4046040 con 0x557443ee8b80 2024-09-13T23:06:31.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.511+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557443ef05c0 con 0x557443ee8b80 2024-09-13T23:06:31.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.511+0000 7efed97fa640 1 -- 172.21.15.164:0/3528030147 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effe4024db0 con 0x557443ee8b80 2024-09-13T23:06:31.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.511+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557443ef05c0 con 0x557443ee8b80 2024-09-13T23:06:31.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.511+0000 7efed97fa640 1 -- 172.21.15.164:0/3528030147 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7effe4025a40 con 0x557443ee8b80 2024-09-13T23:06:31.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.511+0000 7efed97fa640 1 --2- 172.21.15.164:0/3528030147 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efec4036b90 0x7efec4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.512+0000 7efed97fa640 1 -- 172.21.15.164:0/3528030147 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7effe4036d60 con 0x557443ee8b80 2024-09-13T23:06:31.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.512+0000 7efffc3d7640 1 --2- 172.21.15.164:0/3528030147 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efec4036b90 0x7efec4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.512+0000 7efffc3d7640 1 --2- 172.21.15.164:0/3528030147 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efec4036b90 0x7efec4039050 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x557443ec5830 tx=0x7efff401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.512+0000 7f0000830800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.512+0000 7f0000830800 1 --2- 172.21.15.164:0/3528030147 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x557443efb830 0x557443efdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.512+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557443efe440 con 0x557443efb830 2024-09-13T23:06:31.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.512+0000 7efffbbd6640 1 --2- 172.21.15.164:0/3528030147 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x557443efb830 0x557443efdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.513+0000 7efffbbd6640 1 --2- 172.21.15.164:0/3528030147 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x557443efb830 0x557443efdcf0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.513+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7effec07f070 con 0x557443efb830 2024-09-13T23:06:31.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.513+0000 7f0000830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.513+0000 7f0000830800 20 realm 2024-09-13T23:06:31.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.513+0000 7f0000830800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.513+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557443efe850 con 0x557443efb830 2024-09-13T23:06:31.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.513+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7effec07f070 con 0x557443efb830 2024-09-13T23:06:31.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.513+0000 7f0000830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.513+0000 7f0000830800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:06:31.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.513+0000 7f0000830800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.513+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557443eff120 con 0x557443efb830 2024-09-13T23:06:31.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.513+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7effec07f070 con 0x557443efb830 2024-09-13T23:06:31.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.513+0000 7f0000830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.513+0000 7f0000830800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.513+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557443eff4c0 con 0x557443efb830 2024-09-13T23:06:31.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.514+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7effec07f070 con 0x557443efb830 2024-09-13T23:06:31.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.514+0000 7f0000830800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:06:31.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.514+0000 7f0000830800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.514+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557443effd10 con 0x557443efb830 2024-09-13T23:06:31.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.514+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7effec07f070 con 0x557443efb830 2024-09-13T23:06:31.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.514+0000 7f0000830800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:06:31.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.514+0000 7f0000830800 20 searching for the correct realm 2024-09-13T23:06:31.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.514+0000 7f0000830800 1 --2- 172.21.15.164:0/3528030147 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x557443f01a80 0x557443f03e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.514+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x557443f01a80 2024-09-13T23:06:31.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.514+0000 7efff3fff640 1 --2- 172.21.15.164:0/3528030147 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x557443f01a80 0x557443f03e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.514+0000 7efff3fff640 1 --2- 172.21.15.164:0/3528030147 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x557443f01a80 0x557443f03e70 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.515+0000 7efff3fff640 1 -- 172.21.15.164:0/3528030147 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effe4059040 con 0x557443f01a80 2024-09-13T23:06:31.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.515+0000 7efff3fff640 1 --2- 172.21.15.164:0/3528030147 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7effe4050030 0x7effe4027440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.515+0000 7efff3fff640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x7effe4050030 2024-09-13T23:06:31.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.515+0000 7efffc3d7640 1 --2- 172.21.15.164:0/3528030147 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7effe4050030 0x7effe4027440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.515+0000 7efffc3d7640 1 --2- 172.21.15.164:0/3528030147 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7effe4050030 0x7effe4027440 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.515+0000 7efffc3d7640 1 -- 172.21.15.164:0/3528030147 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efff401f070 con 0x7effe4050030 2024-09-13T23:06:31.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.515+0000 7efffc3d7640 1 --2- 172.21.15.164:0/3528030147 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7efff4031040 0x7efff4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.515+0000 7efffc3d7640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x7efff4031040 2024-09-13T23:06:31.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.515+0000 7efffbbd6640 1 --2- 172.21.15.164:0/3528030147 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7efff4031040 0x7efff4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.516+0000 7efffbbd6640 1 --2- 172.21.15.164:0/3528030147 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7efff4031040 0x7efff4032940 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.516+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effec07f070 con 0x7efff4031040 2024-09-13T23:06:31.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.516+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x557443efb830 2024-09-13T23:06:31.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.516+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7effec07f070 con 0x557443efb830 2024-09-13T23:06:31.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.516+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x557443efb830 2024-09-13T23:06:31.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.517+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effec07f070 con 0x557443efb830 2024-09-13T23:06:31.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.517+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x7efff4031040 2024-09-13T23:06:31.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.517+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effec07f070 con 0x7efff4031040 2024-09-13T23:06:31.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.517+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x7efff4031040 2024-09-13T23:06:31.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.517+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effec07f070 con 0x7efff4031040 2024-09-13T23:06:31.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.517+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x7effe4050030 2024-09-13T23:06:31.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.517+0000 7efffc3d7640 1 -- 172.21.15.164:0/3528030147 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efff401f070 con 0x7effe4050030 2024-09-13T23:06:31.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.517+0000 7efffc3d7640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x557443f01a80 2024-09-13T23:06:31.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.518+0000 7efff3fff640 1 -- 172.21.15.164:0/3528030147 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effe4059040 con 0x557443f01a80 2024-09-13T23:06:31.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.518+0000 7efff3fff640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x557443efb830 2024-09-13T23:06:31.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.518+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effec07f070 con 0x557443efb830 2024-09-13T23:06:31.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.518+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x7efff4031040 2024-09-13T23:06:31.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.518+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effec07f070 con 0x7efff4031040 2024-09-13T23:06:31.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.518+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x557443efb830 2024-09-13T23:06:31.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.518+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effec07f070 con 0x557443efb830 2024-09-13T23:06:31.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.518+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x7effe4050030 2024-09-13T23:06:31.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.519+0000 7efffc3d7640 1 -- 172.21.15.164:0/3528030147 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efff401f070 con 0x7effe4050030 2024-09-13T23:06:31.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.519+0000 7efffc3d7640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x557443f01a80 2024-09-13T23:06:31.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.519+0000 7efff3fff640 1 -- 172.21.15.164:0/3528030147 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effe4059040 con 0x557443f01a80 2024-09-13T23:06:31.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.519+0000 7efff3fff640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x557443f01a80 2024-09-13T23:06:31.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.519+0000 7efff3fff640 1 -- 172.21.15.164:0/3528030147 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effe4059040 con 0x557443f01a80 2024-09-13T23:06:31.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.519+0000 7efff3fff640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x7efff4031040 2024-09-13T23:06:31.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.520+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effec07f070 con 0x7efff4031040 2024-09-13T23:06:31.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.520+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x557443f01a80 2024-09-13T23:06:31.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.520+0000 7efff3fff640 1 -- 172.21.15.164:0/3528030147 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effe4059040 con 0x557443f01a80 2024-09-13T23:06:31.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.520+0000 7efff3fff640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x557443f01a80 2024-09-13T23:06:31.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.520+0000 7efff3fff640 1 -- 172.21.15.164:0/3528030147 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effe4059040 con 0x557443f01a80 2024-09-13T23:06:31.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.520+0000 7efff3fff640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x557443efb830 2024-09-13T23:06:31.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.520+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effec07f070 con 0x557443efb830 2024-09-13T23:06:31.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.520+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x557443efb830 2024-09-13T23:06:31.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.520+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7effec07f070 con 0x557443efb830 2024-09-13T23:06:31.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.520+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x7efff4031040 2024-09-13T23:06:31.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.521+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effec07f070 con 0x7efff4031040 2024-09-13T23:06:31.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.521+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x557443f01a80 2024-09-13T23:06:31.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.522+0000 7efff3fff640 1 -- 172.21.15.164:0/3528030147 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effe4059040 con 0x557443f01a80 2024-09-13T23:06:31.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.522+0000 7efff3fff640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x7effe4050030 2024-09-13T23:06:31.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.522+0000 7efffc3d7640 1 -- 172.21.15.164:0/3528030147 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efff401f070 con 0x7effe4050030 2024-09-13T23:06:31.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.522+0000 7efffc3d7640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x557443efb830 2024-09-13T23:06:31.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.522+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7effec07f070 con 0x557443efb830 2024-09-13T23:06:31.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.522+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x7efff4031040 2024-09-13T23:06:31.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.523+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effec07f070 con 0x7efff4031040 2024-09-13T23:06:31.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.523+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x557443f01a80 2024-09-13T23:06:31.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.523+0000 7efff3fff640 1 -- 172.21.15.164:0/3528030147 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effe4059040 con 0x557443f01a80 2024-09-13T23:06:31.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.523+0000 7efff3fff640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x7efff4031040 2024-09-13T23:06:31.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.523+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effec07f070 con 0x7efff4031040 2024-09-13T23:06:31.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.523+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x7effe4050030 2024-09-13T23:06:31.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.523+0000 7efffc3d7640 1 -- 172.21.15.164:0/3528030147 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efff401f070 con 0x7effe4050030 2024-09-13T23:06:31.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.523+0000 7efffc3d7640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x557443f01a80 2024-09-13T23:06:31.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.523+0000 7efff3fff640 1 -- 172.21.15.164:0/3528030147 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effe4059040 con 0x557443f01a80 2024-09-13T23:06:31.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.523+0000 7efff3fff640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x7effe4050030 2024-09-13T23:06:31.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.524+0000 7efffc3d7640 1 -- 172.21.15.164:0/3528030147 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efff401f070 con 0x7effe4050030 2024-09-13T23:06:31.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.524+0000 7efffc3d7640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x557443efb830 2024-09-13T23:06:31.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.524+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7effec07f070 con 0x557443efb830 2024-09-13T23:06:31.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.524+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557443f044a0 con 0x7effe4050030 2024-09-13T23:06:31.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.524+0000 7efffc3d7640 1 -- 172.21.15.164:0/3528030147 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efff4040040 con 0x7effe4050030 2024-09-13T23:06:31.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.524+0000 7f0000830800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:06:31.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.524+0000 7f0000830800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:06:31.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.524+0000 7f0000830800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:06:31.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.524+0000 7f0000830800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:06:31.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.524+0000 7f0000830800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:06:31.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.524+0000 7f0000830800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:06:31.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.524+0000 7f0000830800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.524+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557443f00660 con 0x557443efb830 2024-09-13T23:06:31.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.524+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7effec07f070 con 0x557443efb830 2024-09-13T23:06:31.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.524+0000 7f0000830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.524+0000 7f0000830800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.524+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557443f00f00 con 0x557443efb830 2024-09-13T23:06:31.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.525+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7effec07f070 con 0x557443efb830 2024-09-13T23:06:31.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.525+0000 7f0000830800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:06:31.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.525+0000 7f0000830800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.525+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557443f04920 con 0x557443efb830 2024-09-13T23:06:31.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.525+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7effec07f070 con 0x557443efb830 2024-09-13T23:06:31.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.525+0000 7f0000830800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:06:31.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.525+0000 7f0000830800 20 zone default found 2024-09-13T23:06:31.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.525+0000 7f0000830800 4 Realm: () 2024-09-13T23:06:31.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.525+0000 7f0000830800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:06:31.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.525+0000 7f0000830800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:06:31.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.525+0000 7f0000830800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:06:31.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.525+0000 7f0000830800 20 zonegroup default 2024-09-13T23:06:31.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.525+0000 7f0000830800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.525+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557443f04990 con 0x7efff4031040 2024-09-13T23:06:31.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.526+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7effec07f070 con 0x7efff4031040 2024-09-13T23:06:31.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.526+0000 7f0000830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.526+0000 7f0000830800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.526+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557443f067b0 con 0x557443f01a80 2024-09-13T23:06:31.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.526+0000 7efff3fff640 1 -- 172.21.15.164:0/3528030147 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7effe4059040 con 0x557443f01a80 2024-09-13T23:06:31.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.526+0000 7f0000830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.526+0000 7f0000830800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.526+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557443f06c00 con 0x557443f01a80 2024-09-13T23:06:31.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.526+0000 7efff3fff640 1 -- 172.21.15.164:0/3528030147 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7effe4059040 con 0x557443f01a80 2024-09-13T23:06:31.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.526+0000 7f0000830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.526+0000 7f0000830800 20 started sync module instance, tier type = 2024-09-13T23:06:31.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.526+0000 7f0000830800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:06:31.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.526+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557443f05c50 con 0x7effe4050030 2024-09-13T23:06:31.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.527+0000 7efffc3d7640 1 -- 172.21.15.164:0/3528030147 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efff4040040 con 0x7effe4050030 2024-09-13T23:06:31.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.527+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93957844394048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557443f07510 con 0x7effe4050030 2024-09-13T23:06:31.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.527+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557443f07d60 con 0x557443efb830 2024-09-13T23:06:31.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.528+0000 7efffc3d7640 1 -- 172.21.15.164:0/3528030147 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93957844394048] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efff4040040 con 0x7effe4050030 2024-09-13T23:06:31.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.529+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effec07f070 con 0x557443efb830 2024-09-13T23:06:31.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.529+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93957844398176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557443f07a10 con 0x557443efb830 2024-09-13T23:06:31.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.529+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557443f08500 con 0x557443f01a80 2024-09-13T23:06:31.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.530+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93957844398176] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effec07f070 con 0x557443efb830 2024-09-13T23:06:31.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.530+0000 7efff3fff640 1 -- 172.21.15.164:0/3528030147 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effe4059040 con 0x557443f01a80 2024-09-13T23:06:31.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.530+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93957844402128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557443f088f0 con 0x557443f01a80 2024-09-13T23:06:31.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.530+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557443f092f0 con 0x7effe4050030 2024-09-13T23:06:31.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.531+0000 7efffc3d7640 1 -- 172.21.15.164:0/3528030147 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efff4040040 con 0x7effe4050030 2024-09-13T23:06:31.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.531+0000 7efff3fff640 1 -- 172.21.15.164:0/3528030147 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93957844402128] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effe4059040 con 0x557443f01a80 2024-09-13T23:06:31.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.531+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93957844399232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557443f096e0 con 0x7effe4050030 2024-09-13T23:06:31.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.531+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557443f0a130 con 0x557443efb830 2024-09-13T23:06:31.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.532+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effec07f070 con 0x557443efb830 2024-09-13T23:06:31.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.532+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93957844409376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557443f0a0f0 con 0x557443efb830 2024-09-13T23:06:31.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.532+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557443f0b0f0 con 0x7efff4031040 2024-09-13T23:06:31.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.532+0000 7efffc3d7640 1 -- 172.21.15.164:0/3528030147 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93957844399232] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efff4040040 con 0x7effe4050030 2024-09-13T23:06:31.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.533+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effec07f070 con 0x7efff4031040 2024-09-13T23:06:31.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.533+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93957844409376] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effec07f070 con 0x557443efb830 2024-09-13T23:06:31.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.533+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93957844413472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557443f0b0f0 con 0x7efff4031040 2024-09-13T23:06:31.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.533+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557443f0a4d0 con 0x7efff4031040 2024-09-13T23:06:31.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.534+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(56 notify.6 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effec07f070 con 0x7efff4031040 2024-09-13T23:06:31.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.534+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93957844411600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557443f0bb00 con 0x7efff4031040 2024-09-13T23:06:31.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.534+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557443f0c4c0 con 0x7efff4031040 2024-09-13T23:06:31.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.534+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93957844413472] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effec07f070 con 0x7efff4031040 2024-09-13T23:06:31.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.535+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(58 notify.7 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effec07f070 con 0x7efff4031040 2024-09-13T23:06:31.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.535+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93957844411600] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effec07f070 con 0x7efff4031040 2024-09-13T23:06:31.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.535+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93957844405760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557443f0c4c0 con 0x7efff4031040 2024-09-13T23:06:31.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.535+0000 7f0000830800 20 add_watcher() i=0 2024-09-13T23:06:31.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.535+0000 7f0000830800 20 add_watcher() i=1 2024-09-13T23:06:31.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.535+0000 7f0000830800 20 add_watcher() i=2 2024-09-13T23:06:31.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.535+0000 7f0000830800 20 add_watcher() i=3 2024-09-13T23:06:31.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.535+0000 7f0000830800 20 add_watcher() i=4 2024-09-13T23:06:31.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.535+0000 7f0000830800 20 add_watcher() i=5 2024-09-13T23:06:31.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.535+0000 7f0000830800 20 add_watcher() i=6 2024-09-13T23:06:31.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.536+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93957844405760] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effec07f070 con 0x7efff4031040 2024-09-13T23:06:31.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.536+0000 7f0000830800 20 add_watcher() i=7 2024-09-13T23:06:31.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.536+0000 7f0000830800 2 all 8 watchers are set, enabling cache 2024-09-13T23:06:31.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.536+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557443f0f4f0 con 0x557443efb830 2024-09-13T23:06:31.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.537+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7effec07f070 con 0x557443efb830 2024-09-13T23:06:31.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.537+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93957844418576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557443f0c920 con 0x557443efb830 2024-09-13T23:06:31.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.538+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93957844418576] v34'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7effec07f070 con 0x557443efb830 2024-09-13T23:06:31.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.538+0000 7efeb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:06:31.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.538+0000 7f0000830800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:06:31.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.538+0000 7f0000830800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:06:31.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.538+0000 7f0000830800 5 note: GC not initialized 2024-09-13T23:06:31.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.538+0000 7efeb0fe1640 20 reqs_thread_entry: start 2024-09-13T23:06:31.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.538+0000 7f0000830800 20 init_complete bucket index max shards: 11 2024-09-13T23:06:31.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.538+0000 7f0000830800 20 Filter name: none 2024-09-13T23:06:31.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.539+0000 7efe2a7fc640 20 reqs_thread_entry: start 2024-09-13T23:06:31.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.539+0000 7f0000830800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-13T23:06:31.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.539+0000 7f0000830800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.539+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557443f42890 con 0x7efff4031040 2024-09-13T23:06:31.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.539+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7effec07f070 con 0x7efff4031040 2024-09-13T23:06:31.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.539+0000 7f0000830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.539+0000 7f0000830800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-13T23:06:31.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.539+0000 7f0000830800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T23:06:31.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.539+0000 7f0000830800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-13T23:06:31.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.539+0000 7f0000830800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.539+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557443f40ed0 con 0x557443efb830 2024-09-13T23:06:31.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.539+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7effec07f070 con 0x557443efb830 2024-09-13T23:06:31.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.540+0000 7f0000830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.540+0000 7f0000830800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-13T23:06:31.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.540+0000 7f0000830800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T23:06:31.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.540+0000 7f0000830800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-13T23:06:31.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.540+0000 7f0000830800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-13T23:06:31.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.540+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557443f417a0 con 0x7efff4031040 2024-09-13T23:06:31.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.541+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v34'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7effec07f070 con 0x7efff4031040 2024-09-13T23:06:31.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.541+0000 7f0000830800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-13T23:06:31.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.541+0000 7f0000830800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T23:06:31.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.541+0000 7f0000830800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-13T23:06:31.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.541+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 93957844636400 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557443f46330 con 0x7efff4031040 2024-09-13T23:06:31.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.541+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== watch-notify(notify (1) cookie 93957844405760 notify 146028888093 ret 0) ==== 598+0+0 (crc 0 0 0) 0x557443f41b40 con 0x7efff4031040 2024-09-13T23:06:31.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.541+0000 7efedaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888093 cookie 93957844405760 notifier 4735 bl.length()=556 2024-09-13T23:06:31.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.541+0000 7efedaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-13T23:06:31.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.541+0000 7efedaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T23:06:31.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.541+0000 7efedaffd640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7efec0003ea0 con 0x7efff4031040 2024-09-13T23:06:31.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.541+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(65 notify.7 [notify cookie 93957844636400 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7effec07f070 con 0x7efff4031040 2024-09-13T23:06:31.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.541+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effec07f070 con 0x7efff4031040 2024-09-13T23:06:31.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.542+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== watch-notify(notify_complete (2) cookie 93957844636400 notify 146028888093 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557443f422e0 con 0x7efff4031040 2024-09-13T23:06:31.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.542+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557443f43e60 con 0x557443efb830 2024-09-13T23:06:31.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.543+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v34'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7effec07f070 con 0x557443efb830 2024-09-13T23:06:31.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.543+0000 7f0000830800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T23:06:31.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.543+0000 7f0000830800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T23:06:31.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.543+0000 7f0000830800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-13T23:06:31.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.543+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 93957844636272 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557443f46330 con 0x7efff4031040 2024-09-13T23:06:31.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.543+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== watch-notify(notify (1) cookie 93957844413472 notify 146028888094 ret 0) ==== 219+0+0 (crc 0 0 0) 0x557443f422e0 con 0x7efff4031040 2024-09-13T23:06:31.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.543+0000 7efeda7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888094 cookie 93957844413472 notifier 4735 bl.length()=177 2024-09-13T23:06:31.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.543+0000 7efeda7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T23:06:31.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.543+0000 7efeda7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T23:06:31.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.543+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(68 notify.5 [notify cookie 93957844636272 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7effec07f070 con 0x7efff4031040 2024-09-13T23:06:31.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.543+0000 7efeda7fc640 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7efe30003400 con 0x7efff4031040 2024-09-13T23:06:31.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.543+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effec07f070 con 0x7efff4031040 2024-09-13T23:06:31.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.543+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== watch-notify(notify_complete (2) cookie 93957844636272 notify 146028888094 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557443ec4ef0 con 0x7efff4031040 2024-09-13T23:06:31.560 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-13T23:06:31.540565Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:06:31.540550Z","tags":[],"group_ids":[]} 2024-09-13T23:06:31.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.544+0000 7efeb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:06:31.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.544+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93957844418576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557443f40570 con 0x557443efb830 2024-09-13T23:06:31.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.545+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93957844418576] v34'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7effec07f070 con 0x557443efb830 2024-09-13T23:06:31.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.545+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93957844394048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557443f40570 con 0x7effe4050030 2024-09-13T23:06:31.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.546+0000 7efffc3d7640 1 -- 172.21.15.164:0/3528030147 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93957844394048] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efff4040040 con 0x7effe4050030 2024-09-13T23:06:31.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.546+0000 7f0000830800 20 remove_watcher() i=0 2024-09-13T23:06:31.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.546+0000 7f0000830800 2 removed watcher, disabling cache 2024-09-13T23:06:31.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.546+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93957844398176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557443f40570 con 0x557443efb830 2024-09-13T23:06:31.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.547+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93957844398176] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effec07f070 con 0x557443efb830 2024-09-13T23:06:31.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.547+0000 7f0000830800 20 remove_watcher() i=1 2024-09-13T23:06:31.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.547+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93957844402128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557443f40570 con 0x557443f01a80 2024-09-13T23:06:31.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.548+0000 7efff3fff640 1 -- 172.21.15.164:0/3528030147 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93957844402128] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effe4059040 con 0x557443f01a80 2024-09-13T23:06:31.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.548+0000 7f0000830800 20 remove_watcher() i=2 2024-09-13T23:06:31.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.548+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93957844399232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557443f07060 con 0x7effe4050030 2024-09-13T23:06:31.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.549+0000 7efffc3d7640 1 -- 172.21.15.164:0/3528030147 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93957844399232] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efff4040040 con 0x7effe4050030 2024-09-13T23:06:31.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.549+0000 7f0000830800 20 remove_watcher() i=3 2024-09-13T23:06:31.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.549+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93957844409376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557443f0c010 con 0x557443efb830 2024-09-13T23:06:31.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.550+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93957844409376] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effec07f070 con 0x557443efb830 2024-09-13T23:06:31.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.550+0000 7f0000830800 20 remove_watcher() i=4 2024-09-13T23:06:31.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.550+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93957844413472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557443f0c010 con 0x7efff4031040 2024-09-13T23:06:31.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.551+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93957844413472] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effec07f070 con 0x7efff4031040 2024-09-13T23:06:31.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.551+0000 7f0000830800 20 remove_watcher() i=5 2024-09-13T23:06:31.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.552+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93957844411600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557443f0c010 con 0x7efff4031040 2024-09-13T23:06:31.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.553+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.0 v2:172.21.15.17:6800/489863589 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93957844411600] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effec07f070 con 0x7efff4031040 2024-09-13T23:06:31.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.553+0000 7f0000830800 20 remove_watcher() i=6 2024-09-13T23:06:31.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.553+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93957844405760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557443f0c010 con 0x7efff4031040 2024-09-13T23:06:31.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 <== osd.0 v2:172.21.15.17:6800/489863589 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93957844405760] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effec07f070 con 0x7efff4031040 2024-09-13T23:06:31.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7f0000830800 20 remove_watcher() i=7 2024-09-13T23:06:31.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7efff4031040 msgr2=0x7efff4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7f0000830800 1 --2- 172.21.15.164:0/3528030147 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7efff4031040 0x7efff4032940 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x557443efb830 msgr2=0x557443efdcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7f0000830800 1 --2- 172.21.15.164:0/3528030147 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x557443efb830 0x557443efdcf0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7effe4050030 msgr2=0x7effe4027440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7f0000830800 1 --2- 172.21.15.164:0/3528030147 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7effe4050030 0x7effe4027440 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x557443f01a80 msgr2=0x557443f03e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7f0000830800 1 --2- 172.21.15.164:0/3528030147 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x557443f01a80 0x557443f03e70 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efec4036b90 msgr2=0x7efec4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7f0000830800 1 --2- 172.21.15.164:0/3528030147 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efec4036b90 0x7efec4039050 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x557443ec5830 tx=0x7efff401f000 comp rx=0 tx=0).stop 2024-09-13T23:06:31.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443ee8b80 msgr2=0x557443ef0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7f0000830800 1 --2- 172.21.15.164:0/3528030147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443ee8b80 0x557443ef0080 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7effe404e080 tx=0x7effe404c2f0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 reap_dead start 2024-09-13T23:06:31.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7efffbbd6640 1 -- 172.21.15.164:0/3528030147 reap_dead start 2024-09-13T23:06:31.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 shutdown_connections 2024-09-13T23:06:31.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 >> 172.21.15.164:0/3528030147 conn(0x557443ee4ee0 msgr2=0x557443ee2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 shutdown_connections 2024-09-13T23:06:31.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7f0000830800 1 -- 172.21.15.164:0/3528030147 wait complete. 2024-09-13T23:06:31.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7f0000830800 1 -- 172.21.15.164:0/1077301170 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efed4036b90 msgr2=0x7efed4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7f0000830800 1 --2- 172.21.15.164:0/1077301170 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efed4036b90 0x7efed4039050 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x557443ecc530 tx=0x7efff4005840 comp rx=0 tx=0).stop 2024-09-13T23:06:31.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7f0000830800 1 -- 172.21.15.164:0/1077301170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443edbec0 msgr2=0x557443edc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7f0000830800 1 --2- 172.21.15.164:0/1077301170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443edbec0 0x557443edc2e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7effe4001ed0 tx=0x7effe400ea00 comp rx=0 tx=0).stop 2024-09-13T23:06:31.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7f0000830800 1 -- 172.21.15.164:0/1077301170 shutdown_connections 2024-09-13T23:06:31.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7f0000830800 1 --2- 172.21.15.164:0/1077301170 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efed4036b90 0x7efed4039050 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7f0000830800 1 --2- 172.21.15.164:0/1077301170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443edbec0 0x557443edc2e0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7f0000830800 1 -- 172.21.15.164:0/1077301170 >> 172.21.15.164:0/1077301170 conn(0x557443ed0e50 msgr2=0x557443ed39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7f0000830800 1 -- 172.21.15.164:0/1077301170 shutdown_connections 2024-09-13T23:06:31.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.554+0000 7f0000830800 1 -- 172.21.15.164:0/1077301170 wait complete. 2024-09-13T23:06:31.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.555+0000 7f0000830800 1 -- 172.21.15.164:0/2722414338 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x557443dce6c0 msgr2=0x557443ecb500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.555+0000 7f0000830800 1 --2- 172.21.15.164:0/2722414338 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x557443dce6c0 0x557443ecb500 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.555+0000 7f0000830800 1 -- 172.21.15.164:0/2722414338 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efee4036b40 msgr2=0x7efee4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.555+0000 7f0000830800 1 --2- 172.21.15.164:0/2722414338 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efee4036b40 0x7efee4039000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7effe4000f60 tx=0x7effe4001370 comp rx=0 tx=0).stop 2024-09-13T23:06:31.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.555+0000 7f0000830800 1 -- 172.21.15.164:0/2722414338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443d3eed0 msgr2=0x557443ec4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.555+0000 7f0000830800 1 --2- 172.21.15.164:0/2722414338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443d3eed0 0x557443ec4430 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7effec067040 tx=0x7effec002fb0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.555+0000 7f0000830800 1 -- 172.21.15.164:0/2722414338 shutdown_connections 2024-09-13T23:06:31.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.555+0000 7f0000830800 1 --2- 172.21.15.164:0/2722414338 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x557443dce6c0 0x557443ecb500 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.555+0000 7f0000830800 1 --2- 172.21.15.164:0/2722414338 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efee4036b40 0x7efee4039000 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.555+0000 7f0000830800 1 --2- 172.21.15.164:0/2722414338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557443d3eed0 0x557443ec4430 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.555+0000 7f0000830800 1 -- 172.21.15.164:0/2722414338 >> 172.21.15.164:0/2722414338 conn(0x557443dc5e30 msgr2=0x557443dca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.555+0000 7f0000830800 1 -- 172.21.15.164:0/2722414338 shutdown_connections 2024-09-13T23:06:31.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.555+0000 7f0000830800 1 -- 172.21.15.164:0/2722414338 wait complete. 2024-09-13T23:06:31.571 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-13T23:06:31.540565Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:06:31.540550Z', 'tags': [], 'group_ids': []} 2024-09-13T23:06:31.596 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:06:31.601 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-13T23:06:31.601 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-13T23:06:31.602 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-13T23:06:31.602 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-13T23:06:31.648 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:06:31.648 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:06:31.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.648+0000 7f67ac526800 1 Processor -- start 2024-09-13T23:06:31.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.648+0000 7f67ac526800 1 -- start start 2024-09-13T23:06:31.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.649+0000 7f67ac526800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55a41a620650 0x55a41a6af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.649+0000 7f67ac526800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a41a56bb30 con 0x55a41a6af720 2024-09-13T23:06:31.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.649+0000 7f67ac526800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55a41a54d360 con 0x55a41a620650 2024-09-13T23:06:31.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.649+0000 7f67a81e3640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55a41a620650 0x55a41a6af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.649+0000 7f67a81e3640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55a41a620650 0x55a41a6af1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44866/0 (socket says 172.21.15.164:44866) 2024-09-13T23:06:31.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.649+0000 7f67a81e3640 1 -- 172.21.15.164:0/984484864 learned_addr learned my addr 172.21.15.164:0/984484864 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.649+0000 7f67a79e2640 1 --1- 172.21.15.164:0/984484864 >> v1:172.21.15.17:6789/0 conn(0x55a41a6af720 0x55a41a6b1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:55966/0 (socket says 172.21.15.164:55966) 2024-09-13T23:06:31.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.649+0000 7f67a81e3640 1 -- 172.21.15.164:0/984484864 >> v1:172.21.15.17:6789/0 conn(0x55a41a6af720 legacy=0x55a41a6b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.649+0000 7f67a81e3640 1 -- 172.21.15.164:0/984484864 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a41a573e00 con 0x55a41a620650 2024-09-13T23:06:31.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.651+0000 7f67a81e3640 1 --2- 172.21.15.164:0/984484864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a620650 0x55a41a6af1e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f679800a520 tx=0x7f6798045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9b92deb7220670 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.651+0000 7f67a71e1640 1 -- 172.21.15.164:0/984484864 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6798055070 con 0x55a41a620650 2024-09-13T23:06:31.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.651+0000 7f67a71e1640 1 -- 172.21.15.164:0/984484864 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67980515b0 con 0x55a41a620650 2024-09-13T23:06:31.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.651+0000 7f67a71e1640 1 -- 172.21.15.164:0/984484864 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67980518d0 con 0x55a41a620650 2024-09-13T23:06:31.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.652+0000 7f67ac526800 1 -- 172.21.15.164:0/984484864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a620650 msgr2=0x55a41a6af1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.652+0000 7f67ac526800 1 --2- 172.21.15.164:0/984484864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a620650 0x55a41a6af1e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f679800a520 tx=0x7f6798045ba0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.652+0000 7f67ac526800 1 -- 172.21.15.164:0/984484864 shutdown_connections 2024-09-13T23:06:31.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.652+0000 7f67ac526800 1 --2- 172.21.15.164:0/984484864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a620650 0x55a41a6af1e0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.652+0000 7f67ac526800 1 -- 172.21.15.164:0/984484864 >> 172.21.15.164:0/984484864 conn(0x55a41a6a6db0 msgr2=0x55a41a6a91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.652+0000 7f67ac526800 1 -- 172.21.15.164:0/984484864 shutdown_connections 2024-09-13T23:06:31.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.652+0000 7f67ac526800 1 -- 172.21.15.164:0/984484864 wait complete. 2024-09-13T23:06:31.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.666+0000 7f67ac526800 1 Processor -- start 2024-09-13T23:06:31.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.666+0000 7f67ac526800 1 -- start start 2024-09-13T23:06:31.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.666+0000 7f67ac526800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a620650 0x55a41a79b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.666+0000 7f67ac526800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a41a5f8360 con 0x55a41a620650 2024-09-13T23:06:31.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.667+0000 7f67a81e3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a620650 0x55a41a79b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.667+0000 7f67a81e3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a620650 0x55a41a79b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44872/0 (socket says 172.21.15.164:44872) 2024-09-13T23:06:31.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.667+0000 7f67a81e3640 1 -- 172.21.15.164:0/1175092162 learned_addr learned my addr 172.21.15.164:0/1175092162 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.667+0000 7f67a81e3640 1 -- 172.21.15.164:0/1175092162 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a41a545bc0 con 0x55a41a620650 2024-09-13T23:06:31.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.667+0000 7f67a81e3640 1 --2- 172.21.15.164:0/1175092162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a620650 0x55a41a79b880 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6798025da0 tx=0x7f6798051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed7b7a70d5690ae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.667+0000 7f669660c640 1 -- 172.21.15.164:0/1175092162 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6798051950 con 0x55a41a620650 2024-09-13T23:06:31.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.667+0000 7f669660c640 1 -- 172.21.15.164:0/1175092162 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6798051af0 con 0x55a41a620650 2024-09-13T23:06:31.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.667+0000 7f669660c640 1 -- 172.21.15.164:0/1175092162 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6798051dd0 con 0x55a41a620650 2024-09-13T23:06:31.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.668+0000 7f67ac526800 1 -- 172.21.15.164:0/1175092162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a620650 msgr2=0x55a41a79b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.668+0000 7f67ac526800 1 --2- 172.21.15.164:0/1175092162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a620650 0x55a41a79b880 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6798025da0 tx=0x7f6798051000 comp rx=0 tx=0).stop 2024-09-13T23:06:31.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.668+0000 7f67ac526800 1 -- 172.21.15.164:0/1175092162 shutdown_connections 2024-09-13T23:06:31.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.668+0000 7f67ac526800 1 --2- 172.21.15.164:0/1175092162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a620650 0x55a41a79b880 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.668+0000 7f67ac526800 1 -- 172.21.15.164:0/1175092162 >> 172.21.15.164:0/1175092162 conn(0x55a41a6a6db0 msgr2=0x55a41a797240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.668+0000 7f67ac526800 1 -- 172.21.15.164:0/1175092162 shutdown_connections 2024-09-13T23:06:31.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.668+0000 7f67ac526800 1 -- 172.21.15.164:0/1175092162 wait complete. 2024-09-13T23:06:31.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.668+0000 7f67ac526800 1 Processor -- start 2024-09-13T23:06:31.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.669+0000 7f67ac526800 1 -- start start 2024-09-13T23:06:31.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.669+0000 7f67ac526800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a620650 0x55a41a7a3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.669+0000 7f67ac526800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a41a6b3620 con 0x55a41a620650 2024-09-13T23:06:31.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.669+0000 7f67a81e3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a620650 0x55a41a7a3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.669+0000 7f67a81e3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a620650 0x55a41a7a3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44876/0 (socket says 172.21.15.164:44876) 2024-09-13T23:06:31.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.669+0000 7f67a81e3640 1 -- 172.21.15.164:0/2931765385 learned_addr learned my addr 172.21.15.164:0/2931765385 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.669+0000 7f67a81e3640 1 -- 172.21.15.164:0/2931765385 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a41a559fe0 con 0x55a41a620650 2024-09-13T23:06:31.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.670+0000 7f67a81e3640 1 --2- 172.21.15.164:0/2931765385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a620650 0x55a41a7a3120 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6798067040 tx=0x7f6798002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.670+0000 7f6694e09640 1 -- 172.21.15.164:0/2931765385 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6798073070 con 0x55a41a620650 2024-09-13T23:06:31.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.670+0000 7f6694e09640 1 -- 172.21.15.164:0/2931765385 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f679805a450 con 0x55a41a620650 2024-09-13T23:06:31.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.670+0000 7f67ac526800 1 -- 172.21.15.164:0/2931765385 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a41a7a3660 con 0x55a41a620650 2024-09-13T23:06:31.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.670+0000 7f6694e09640 1 -- 172.21.15.164:0/2931765385 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f679805a730 con 0x55a41a620650 2024-09-13T23:06:31.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.670+0000 7f67ac526800 1 -- 172.21.15.164:0/2931765385 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a41a7a3be0 con 0x55a41a620650 2024-09-13T23:06:31.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.671+0000 7f6694e09640 1 -- 172.21.15.164:0/2931765385 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6798076070 con 0x55a41a620650 2024-09-13T23:06:31.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.671+0000 7f6694e09640 1 --2- 172.21.15.164:0/2931765385 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6690036b40 0x7f6690039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.671+0000 7f6694e09640 1 -- 172.21.15.164:0/2931765385 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6798062070 con 0x55a41a620650 2024-09-13T23:06:31.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.671+0000 7f67a79e2640 1 --2- 172.21.15.164:0/2931765385 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6690036b40 0x7f6690039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.671+0000 7f67ac526800 1 --2- 172.21.15.164:0/2931765385 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a41a6af720 0x55a41a7aa190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.671+0000 7f67ac526800 1 -- 172.21.15.164:0/2931765385 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7aa710 con 0x55a41a6af720 2024-09-13T23:06:31.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.671+0000 7f67a89e4640 1 --2- 172.21.15.164:0/2931765385 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a41a6af720 0x55a41a7aa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.671+0000 7f67a79e2640 1 --2- 172.21.15.164:0/2931765385 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6690036b40 0x7f6690039000 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6790000f60 tx=0x7f6790001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.671+0000 7f67a89e4640 1 --2- 172.21.15.164:0/2931765385 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a41a6af720 0x55a41a7aa190 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.672+0000 7f67a89e4640 1 -- 172.21.15.164:0/2931765385 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67a000a4a0 con 0x55a41a6af720 2024-09-13T23:06:31.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.672+0000 7f67ac526800 1 -- 172.21.15.164:0/2931765385 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7a7760 con 0x55a41a6af720 2024-09-13T23:06:31.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.672+0000 7f67a89e4640 1 -- 172.21.15.164:0/2931765385 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f67a000a4a0 con 0x55a41a6af720 2024-09-13T23:06:31.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.672+0000 7f67ac526800 1 -- 172.21.15.164:0/2931765385 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7ac530 con 0x55a41a6af720 2024-09-13T23:06:31.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.672+0000 7f67a89e4640 1 -- 172.21.15.164:0/2931765385 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f67a000a4a0 con 0x55a41a6af720 2024-09-13T23:06:31.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.672+0000 7f67ac526800 1 -- 172.21.15.164:0/2931765385 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7ab670 con 0x55a41a6af720 2024-09-13T23:06:31.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.672+0000 7f67a89e4640 1 -- 172.21.15.164:0/2931765385 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f67a000a4a0 con 0x55a41a6af720 2024-09-13T23:06:31.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.673+0000 7f67ac526800 1 -- 172.21.15.164:0/2931765385 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7abac0 con 0x55a41a6af720 2024-09-13T23:06:31.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.673+0000 7f67a89e4640 1 -- 172.21.15.164:0/2931765385 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f67a000a4a0 con 0x55a41a6af720 2024-09-13T23:06:31.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.673+0000 7f67ac526800 1 Processor -- start 2024-09-13T23:06:31.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.673+0000 7f67ac526800 1 -- start start 2024-09-13T23:06:31.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.673+0000 7f67ac526800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a7bab20 0x55a41a7baf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.673+0000 7f67ac526800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a41a547580 con 0x55a41a7bab20 2024-09-13T23:06:31.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.673+0000 7f67a79e2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a7bab20 0x55a41a7baf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.674+0000 7f67a79e2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a7bab20 0x55a41a7baf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44892/0 (socket says 172.21.15.164:44892) 2024-09-13T23:06:31.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.674+0000 7f67a79e2640 1 -- 172.21.15.164:0/2670364746 learned_addr learned my addr 172.21.15.164:0/2670364746 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.674+0000 7f67a79e2640 1 -- 172.21.15.164:0/2670364746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a41a7bb480 con 0x55a41a7bab20 2024-09-13T23:06:31.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.674+0000 7f67a79e2640 1 --2- 172.21.15.164:0/2670364746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a7bab20 0x55a41a7baf40 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6790001ed0 tx=0x7f679000ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.674+0000 7f668dffb640 1 -- 172.21.15.164:0/2670364746 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6790022070 con 0x55a41a7bab20 2024-09-13T23:06:31.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.674+0000 7f67ac526800 1 -- 172.21.15.164:0/2670364746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a41a7bb710 con 0x55a41a7bab20 2024-09-13T23:06:31.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.674+0000 7f668dffb640 1 -- 172.21.15.164:0/2670364746 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f679000d520 con 0x55a41a7bab20 2024-09-13T23:06:31.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.674+0000 7f668dffb640 1 -- 172.21.15.164:0/2670364746 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f679000d800 con 0x55a41a7bab20 2024-09-13T23:06:31.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.674+0000 7f67ac526800 1 -- 172.21.15.164:0/2670364746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a41a7be3f0 con 0x55a41a7bab20 2024-09-13T23:06:31.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.675+0000 7f668dffb640 1 -- 172.21.15.164:0/2670364746 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6790025070 con 0x55a41a7bab20 2024-09-13T23:06:31.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.675+0000 7f668dffb640 1 --2- 172.21.15.164:0/2670364746 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6680036b90 0x7f6680039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.675+0000 7f668dffb640 1 -- 172.21.15.164:0/2670364746 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f679004e120 con 0x55a41a7bab20 2024-09-13T23:06:31.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.675+0000 7f67a89e4640 1 --2- 172.21.15.164:0/2670364746 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6680036b90 0x7f6680039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.676+0000 7f67ac526800 1 Processor -- start 2024-09-13T23:06:31.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.676+0000 7f67a89e4640 1 --2- 172.21.15.164:0/2670364746 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6680036b90 0x7f6680039050 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55a41a7ab190 tx=0x7f67a0005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.676+0000 7f67ac526800 1 -- start start 2024-09-13T23:06:31.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.676+0000 7f67ac526800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a7c77e0 0x55a41a7c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.676+0000 7f67ac526800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a41a79bf70 con 0x55a41a7c77e0 2024-09-13T23:06:31.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.676+0000 7f67a79e2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a7c77e0 0x55a41a7c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.676+0000 7f67a79e2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a7c77e0 0x55a41a7c7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44898/0 (socket says 172.21.15.164:44898) 2024-09-13T23:06:31.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.676+0000 7f67a79e2640 1 -- 172.21.15.164:0/1505629897 learned_addr learned my addr 172.21.15.164:0/1505629897 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.676+0000 7f67a79e2640 1 -- 172.21.15.164:0/1505629897 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a41a7c81b0 con 0x55a41a7c77e0 2024-09-13T23:06:31.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.676+0000 7f67a79e2640 1 --2- 172.21.15.164:0/1505629897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a7c77e0 0x55a41a7c7be0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f679000eee0 tx=0x7f6790024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dbc132b962ed7f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.677+0000 7f66877fe640 1 -- 172.21.15.164:0/1505629897 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6790026730 con 0x55a41a7c77e0 2024-09-13T23:06:31.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.677+0000 7f66877fe640 1 -- 172.21.15.164:0/1505629897 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6790025c50 con 0x55a41a7c77e0 2024-09-13T23:06:31.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.677+0000 7f66877fe640 1 -- 172.21.15.164:0/1505629897 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67900268d0 con 0x55a41a7c77e0 2024-09-13T23:06:31.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.677+0000 7f67ac526800 1 -- 172.21.15.164:0/1505629897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a7c77e0 msgr2=0x55a41a7c7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.677+0000 7f67ac526800 1 --2- 172.21.15.164:0/1505629897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a7c77e0 0x55a41a7c7be0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f679000eee0 tx=0x7f6790024740 comp rx=0 tx=0).stop 2024-09-13T23:06:31.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.677+0000 7f67ac526800 1 -- 172.21.15.164:0/1505629897 shutdown_connections 2024-09-13T23:06:31.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.677+0000 7f67ac526800 1 --2- 172.21.15.164:0/1505629897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a7c77e0 0x55a41a7c7be0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.677+0000 7f67ac526800 1 -- 172.21.15.164:0/1505629897 >> 172.21.15.164:0/1505629897 conn(0x55a41a7c3b40 msgr2=0x55a41a7c1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.677+0000 7f67ac526800 1 -- 172.21.15.164:0/1505629897 shutdown_connections 2024-09-13T23:06:31.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.677+0000 7f67ac526800 1 -- 172.21.15.164:0/1505629897 wait complete. 2024-09-13T23:06:31.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.677+0000 7f67ac526800 1 Processor -- start 2024-09-13T23:06:31.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.677+0000 7f67ac526800 1 -- start start 2024-09-13T23:06:31.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.678+0000 7f67ac526800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a7c77e0 0x55a41a7ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.678+0000 7f67ac526800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a41a7c8730 con 0x55a41a7c77e0 2024-09-13T23:06:31.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.678+0000 7f67a79e2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a7c77e0 0x55a41a7ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.678+0000 7f67a79e2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a7c77e0 0x55a41a7ceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44914/0 (socket says 172.21.15.164:44914) 2024-09-13T23:06:31.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.678+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 learned_addr learned my addr 172.21.15.164:0/1971280578 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:31.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.678+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a41a7cf070 con 0x55a41a7c77e0 2024-09-13T23:06:31.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.678+0000 7f67a79e2640 1 --2- 172.21.15.164:0/1971280578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a7c77e0 0x55a41a7ceb30 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f679004b320 tx=0x7f679004c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.678+0000 7f6685ffb640 1 -- 172.21.15.164:0/1971280578 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6790025e00 con 0x55a41a7c77e0 2024-09-13T23:06:31.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.678+0000 7f6685ffb640 1 -- 172.21.15.164:0/1971280578 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f679000dbb0 con 0x55a41a7c77e0 2024-09-13T23:06:31.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.678+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a41a7cf070 con 0x55a41a7c77e0 2024-09-13T23:06:31.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.678+0000 7f6685ffb640 1 -- 172.21.15.164:0/1971280578 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f679004c780 con 0x55a41a7c77e0 2024-09-13T23:06:31.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.678+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a41a7cf070 con 0x55a41a7c77e0 2024-09-13T23:06:31.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.679+0000 7f6685ffb640 1 -- 172.21.15.164:0/1971280578 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f679004c920 con 0x55a41a7c77e0 2024-09-13T23:06:31.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.679+0000 7f6685ffb640 1 --2- 172.21.15.164:0/1971280578 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6678036b90 0x7f6678039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.679+0000 7f6685ffb640 1 -- 172.21.15.164:0/1971280578 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f679001dd40 con 0x55a41a7c77e0 2024-09-13T23:06:31.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.679+0000 7f67a89e4640 1 --2- 172.21.15.164:0/1971280578 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6678036b90 0x7f6678039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.680+0000 7f67a89e4640 1 --2- 172.21.15.164:0/1971280578 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6678036b90 0x7f6678039050 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55a41a7a3f40 tx=0x7f67a001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.680+0000 7f67ac526800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.680+0000 7f67ac526800 1 --2- 172.21.15.164:0/1971280578 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a41a7da2d0 0x55a41a7dc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.680+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7dcee0 con 0x55a41a7da2d0 2024-09-13T23:06:31.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.680+0000 7f67a81e3640 1 --2- 172.21.15.164:0/1971280578 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a41a7da2d0 0x55a41a7dc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.680+0000 7f67a81e3640 1 --2- 172.21.15.164:0/1971280578 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a41a7da2d0 0x55a41a7dc790 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.681+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.681+0000 7f67ac526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.681+0000 7f67ac526800 20 realm 2024-09-13T23:06:31.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.681+0000 7f67ac526800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.681+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7dd2f0 con 0x55a41a7da2d0 2024-09-13T23:06:31.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.681+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.681+0000 7f67ac526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.681+0000 7f67ac526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:06:31.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.681+0000 7f67ac526800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.681+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7ddbc0 con 0x55a41a7da2d0 2024-09-13T23:06:31.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.681+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.681+0000 7f67ac526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.681+0000 7f67ac526800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.681+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7ddf60 con 0x55a41a7da2d0 2024-09-13T23:06:31.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.681+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.681+0000 7f67ac526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:06:31.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.681+0000 7f67ac526800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.681+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7de7b0 con 0x55a41a7da2d0 2024-09-13T23:06:31.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.682+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.682+0000 7f67ac526800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:06:31.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.682+0000 7f67ac526800 20 searching for the correct realm 2024-09-13T23:06:31.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.682+0000 7f67ac526800 1 --2- 172.21.15.164:0/1971280578 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55a41a7e0520 0x55a41a7e2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.682+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e2ef0 con 0x55a41a7e0520 2024-09-13T23:06:31.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.682+0000 7f67a79e2640 1 --2- 172.21.15.164:0/1971280578 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55a41a7e0520 0x55a41a7e2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.682+0000 7f67a79e2640 1 --2- 172.21.15.164:0/1971280578 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55a41a7e0520 0x55a41a7e2910 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.682+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6790024030 con 0x55a41a7e0520 2024-09-13T23:06:31.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.682+0000 7f67a79e2640 1 --2- 172.21.15.164:0/1971280578 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f679001ac20 0x7f67900278c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.682+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e2ef0 con 0x7f679001ac20 2024-09-13T23:06:31.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.682+0000 7f67a89e4640 1 --2- 172.21.15.164:0/1971280578 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f679001ac20 0x7f67900278c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.683+0000 7f67a89e4640 1 --2- 172.21.15.164:0/1971280578 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f679001ac20 0x7f67900278c0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.683+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67a001f070 con 0x7f679001ac20 2024-09-13T23:06:31.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.683+0000 7f67a89e4640 1 --2- 172.21.15.164:0/1971280578 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f67a0031040 0x7f67a0032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:31.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.683+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e2ef0 con 0x7f67a0031040 2024-09-13T23:06:31.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.683+0000 7f67a81e3640 1 --2- 172.21.15.164:0/1971280578 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f67a0031040 0x7f67a0032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:31.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.683+0000 7f67a81e3640 1 --2- 172.21.15.164:0/1971280578 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f67a0031040 0x7f67a0032940 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:31.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.684+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6798075030 con 0x7f67a0031040 2024-09-13T23:06:31.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.684+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e2ef0 con 0x55a41a7da2d0 2024-09-13T23:06:31.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.684+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.684+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e2ef0 con 0x55a41a7da2d0 2024-09-13T23:06:31.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.684+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.684+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e2ef0 con 0x7f67a0031040 2024-09-13T23:06:31.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.684+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6798075030 con 0x7f67a0031040 2024-09-13T23:06:31.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.684+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e2ef0 con 0x7f67a0031040 2024-09-13T23:06:31.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.685+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6798075030 con 0x7f67a0031040 2024-09-13T23:06:31.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.685+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e2ef0 con 0x7f679001ac20 2024-09-13T23:06:31.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.685+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67a001f070 con 0x7f679001ac20 2024-09-13T23:06:31.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.685+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e2ef0 con 0x55a41a7e0520 2024-09-13T23:06:31.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.685+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6790024030 con 0x55a41a7e0520 2024-09-13T23:06:31.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.685+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e2ef0 con 0x55a41a7da2d0 2024-09-13T23:06:31.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.685+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.685+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e2ef0 con 0x7f67a0031040 2024-09-13T23:06:31.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.686+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6798075030 con 0x7f67a0031040 2024-09-13T23:06:31.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.686+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e2ef0 con 0x55a41a7da2d0 2024-09-13T23:06:31.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.686+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.686+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e2ef0 con 0x7f679001ac20 2024-09-13T23:06:31.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.686+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f67a001f070 con 0x7f679001ac20 2024-09-13T23:06:31.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.686+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e2ef0 con 0x55a41a7e0520 2024-09-13T23:06:31.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.686+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6790024030 con 0x55a41a7e0520 2024-09-13T23:06:31.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.686+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e2ef0 con 0x55a41a7e0520 2024-09-13T23:06:31.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.687+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6790024030 con 0x55a41a7e0520 2024-09-13T23:06:31.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.687+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e2ef0 con 0x7f67a0031040 2024-09-13T23:06:31.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.687+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6798075030 con 0x7f67a0031040 2024-09-13T23:06:31.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.687+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f67980a1040 con 0x55a41a7e0520 2024-09-13T23:06:31.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.687+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6790024030 con 0x55a41a7e0520 2024-09-13T23:06:31.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.687+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f67980a1040 con 0x55a41a7e0520 2024-09-13T23:06:31.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.688+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6790024030 con 0x55a41a7e0520 2024-09-13T23:06:31.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.688+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f67980a1040 con 0x55a41a7da2d0 2024-09-13T23:06:31.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.688+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.688+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f67980a1040 con 0x55a41a7da2d0 2024-09-13T23:06:31.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.688+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.688+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f67980a1040 con 0x7f67a0031040 2024-09-13T23:06:31.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.688+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6798075030 con 0x7f67a0031040 2024-09-13T23:06:31.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.688+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f67980a1040 con 0x55a41a7e0520 2024-09-13T23:06:31.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.688+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6790024030 con 0x55a41a7e0520 2024-09-13T23:06:31.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.688+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f67980a1040 con 0x7f679001ac20 2024-09-13T23:06:31.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.689+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67a001f070 con 0x7f679001ac20 2024-09-13T23:06:31.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.689+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f67980a1040 con 0x55a41a7da2d0 2024-09-13T23:06:31.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.689+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.689+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f67980a1040 con 0x7f67a0031040 2024-09-13T23:06:31.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.689+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6798075030 con 0x7f67a0031040 2024-09-13T23:06:31.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.689+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f67980a1040 con 0x55a41a7e0520 2024-09-13T23:06:31.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.690+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6790024030 con 0x55a41a7e0520 2024-09-13T23:06:31.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.690+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f67980a1040 con 0x7f67a0031040 2024-09-13T23:06:31.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.690+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6798075030 con 0x7f67a0031040 2024-09-13T23:06:31.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.690+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f67980a1040 con 0x7f679001ac20 2024-09-13T23:06:31.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.690+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67a001f070 con 0x7f679001ac20 2024-09-13T23:06:31.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.690+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f67980a1040 con 0x55a41a7e0520 2024-09-13T23:06:31.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.690+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6790024030 con 0x55a41a7e0520 2024-09-13T23:06:31.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.690+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f67980a1040 con 0x7f679001ac20 2024-09-13T23:06:31.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.691+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67a001f070 con 0x7f679001ac20 2024-09-13T23:06:31.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.691+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f67980a1040 con 0x55a41a7da2d0 2024-09-13T23:06:31.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.691+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.691+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f67980a1040 con 0x7f679001ac20 2024-09-13T23:06:31.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.691+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67a0040040 con 0x7f679001ac20 2024-09-13T23:06:31.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.691+0000 7f67ac526800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:06:31.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.691+0000 7f67ac526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:06:31.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.691+0000 7f67ac526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:06:31.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.691+0000 7f67ac526800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:06:31.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.691+0000 7f67ac526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:06:31.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.691+0000 7f67ac526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:06:31.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.691+0000 7f67ac526800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.691+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7df160 con 0x55a41a7da2d0 2024-09-13T23:06:31.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.691+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.691+0000 7f67ac526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.691+0000 7f67ac526800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.691+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7dfa00 con 0x55a41a7da2d0 2024-09-13T23:06:31.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.692+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.692+0000 7f67ac526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:06:31.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.692+0000 7f67ac526800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.692+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7dfa00 con 0x55a41a7da2d0 2024-09-13T23:06:31.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.692+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.692+0000 7f67ac526800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:06:31.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.692+0000 7f67ac526800 20 zone default found 2024-09-13T23:06:31.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.692+0000 7f67ac526800 4 Realm: () 2024-09-13T23:06:31.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.692+0000 7f67ac526800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:06:31.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.692+0000 7f67ac526800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:06:31.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.692+0000 7f67ac526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:06:31.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.692+0000 7f67ac526800 20 zonegroup default 2024-09-13T23:06:31.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.692+0000 7f67ac526800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.692+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e3370 con 0x7f67a0031040 2024-09-13T23:06:31.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.692+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6798075030 con 0x7f67a0031040 2024-09-13T23:06:31.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.692+0000 7f67ac526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.692+0000 7f67ac526800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.692+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7df7d0 con 0x55a41a7e0520 2024-09-13T23:06:31.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.692+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6790024030 con 0x55a41a7e0520 2024-09-13T23:06:31.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.692+0000 7f67ac526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.692+0000 7f67ac526800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.692+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e52d0 con 0x55a41a7e0520 2024-09-13T23:06:31.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.693+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6790024030 con 0x55a41a7e0520 2024-09-13T23:06:31.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.693+0000 7f67ac526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:31.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.693+0000 7f67ac526800 20 started sync module instance, tier type = 2024-09-13T23:06:31.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.693+0000 7f67ac526800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:06:31.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.693+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e4690 con 0x7f679001ac20 2024-09-13T23:06:31.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.694+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67a0040040 con 0x7f679001ac20 2024-09-13T23:06:31.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.694+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94163307481728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e5be0 con 0x7f679001ac20 2024-09-13T23:06:31.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.694+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e6430 con 0x55a41a7da2d0 2024-09-13T23:06:31.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.695+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94163307481728] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67a0040040 con 0x7f679001ac20 2024-09-13T23:06:31.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.695+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.695+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94163307484976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e60a0 con 0x55a41a7da2d0 2024-09-13T23:06:31.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.695+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e6ba0 con 0x55a41a7e0520 2024-09-13T23:06:31.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.696+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94163307484976] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.696+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6790024030 con 0x55a41a7e0520 2024-09-13T23:06:31.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.696+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94163307488912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e6fc0 con 0x55a41a7e0520 2024-09-13T23:06:31.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.696+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e7980 con 0x7f679001ac20 2024-09-13T23:06:31.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.697+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67a0040040 con 0x7f679001ac20 2024-09-13T23:06:31.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.697+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94163307493072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e8250 con 0x7f679001ac20 2024-09-13T23:06:31.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.697+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e8d50 con 0x55a41a7da2d0 2024-09-13T23:06:31.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.698+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94163307488912] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6790024030 con 0x55a41a7e0520 2024-09-13T23:06:31.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.699+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.699+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94163307497536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e8d10 con 0x55a41a7da2d0 2024-09-13T23:06:31.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.699+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e97a0 con 0x7f67a0031040 2024-09-13T23:06:31.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.699+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94163307493072] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67a0040040 con 0x7f679001ac20 2024-09-13T23:06:31.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.700+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6798075030 con 0x7f67a0031040 2024-09-13T23:06:31.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.700+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94163307497536] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.700+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94163307500208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e97a0 con 0x7f67a0031040 2024-09-13T23:06:31.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.700+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e5b50 con 0x7f67a0031040 2024-09-13T23:06:31.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.701+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94163307500208] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6798075030 con 0x7f67a0031040 2024-09-13T23:06:31.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.701+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6798075030 con 0x7f67a0031040 2024-09-13T23:06:31.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.701+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94163307486032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7e9d00 con 0x7f67a0031040 2024-09-13T23:06:31.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.701+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7ea6c0 con 0x7f67a0031040 2024-09-13T23:06:31.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.702+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(58 notify.7 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6798075030 con 0x7f67a0031040 2024-09-13T23:06:31.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.702+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94163307486032] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6798075030 con 0x7f67a0031040 2024-09-13T23:06:31.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.702+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94163307504144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7eaae0 con 0x7f67a0031040 2024-09-13T23:06:31.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.702+0000 7f67ac526800 20 add_watcher() i=0 2024-09-13T23:06:31.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.702+0000 7f67ac526800 20 add_watcher() i=1 2024-09-13T23:06:31.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.702+0000 7f67ac526800 20 add_watcher() i=2 2024-09-13T23:06:31.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.702+0000 7f67ac526800 20 add_watcher() i=3 2024-09-13T23:06:31.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.702+0000 7f67ac526800 20 add_watcher() i=4 2024-09-13T23:06:31.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.702+0000 7f67ac526800 20 add_watcher() i=5 2024-09-13T23:06:31.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.702+0000 7f67ac526800 20 add_watcher() i=6 2024-09-13T23:06:31.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.704+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94163307504144] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6798075030 con 0x7f67a0031040 2024-09-13T23:06:31.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.704+0000 7f67ac526800 20 add_watcher() i=7 2024-09-13T23:06:31.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.704+0000 7f67ac526800 2 all 8 watchers are set, enabling cache 2024-09-13T23:06:31.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.704+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7eaae0 con 0x55a41a7da2d0 2024-09-13T23:06:31.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.704+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.704+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94163307505200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a7eaac0 con 0x55a41a7da2d0 2024-09-13T23:06:31.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.705+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94163307505200] v34'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.705+0000 7f665e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:06:31.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.705+0000 7f67ac526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:06:31.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.705+0000 7f67ac526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:06:31.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.705+0000 7f67ac526800 5 note: GC not initialized 2024-09-13T23:06:31.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.706+0000 7f665d7e2640 20 reqs_thread_entry: start 2024-09-13T23:06:31.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.706+0000 7f67ac526800 20 init_complete bucket index max shards: 11 2024-09-13T23:06:31.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.706+0000 7f67ac526800 20 Filter name: none 2024-09-13T23:06:31.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.706+0000 7f65ceffd640 20 reqs_thread_entry: start 2024-09-13T23:06:31.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.706+0000 7f67ac526800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-13T23:06:31.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.706+0000 7f67ac526800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.706+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a820ea0 con 0x7f67a0031040 2024-09-13T23:06:31.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.707+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f6798075030 con 0x7f67a0031040 2024-09-13T23:06:31.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.707+0000 7f67ac526800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T23:06:31.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.707+0000 7f67ac526800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-13T23:06:31.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.707+0000 7f67ac526800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T23:06:31.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.707+0000 7f67ac526800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:06:31.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.707+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a825220 con 0x7f679001ac20 2024-09-13T23:06:31.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.708+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v34'1 uv1 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f67a0040040 con 0x7f679001ac20 2024-09-13T23:06:31.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.708+0000 7f67ac526800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T23:06:31.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.708+0000 7f67ac526800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T23:06:31.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.708+0000 7f67ac526800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-13T23:06:31.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.708+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94163307744528 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a825ed0 con 0x7f67a0031040 2024-09-13T23:06:31.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.709+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== watch-notify(notify (1) cookie 94163307500208 notify 146028888095 ret 0) ==== 424+0+0 (crc 0 0 0) 0x7f679809c040 con 0x7f67a0031040 2024-09-13T23:06:31.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.709+0000 7f66877fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888095 cookie 94163307500208 notifier 4742 bl.length()=382 2024-09-13T23:06:31.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.709+0000 7f66877fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T23:06:31.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.709+0000 7f66877fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T23:06:31.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.709+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(64 notify.5 [notify cookie 94163307744528 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6798075030 con 0x7f67a0031040 2024-09-13T23:06:31.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.709+0000 7f66877fe640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f666c003ea0 con 0x7f67a0031040 2024-09-13T23:06:31.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.710+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== watch-notify(notify_complete (2) cookie 94163307744528 notify 146028888095 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a41a7a3be0 con 0x7f67a0031040 2024-09-13T23:06:31.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.710+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6798075030 con 0x7f67a0031040 2024-09-13T23:06:31.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.710+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a824d10 con 0x55a41a7da2d0 2024-09-13T23:06:31.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.710+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.710+0000 7f67ac526800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 : miss 2024-09-13T23:06:31.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.710+0000 7f67ac526800 20 rados->read ofs=0 len=0 2024-09-13T23:06:31.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.710+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:67 8.5 8:a5861de4:root::.bucket.meta.myfoo6%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a823040 con 0x55a41a7da2d0 2024-09-13T23:06:31.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.710+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(67 .bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 333+0+662 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.710+0000 7f67ac526800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T23:06:31.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.710+0000 7f67ac526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 info.flags=0x17 2024-09-13T23:06:31.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.710+0000 7f67ac526800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 to cache LRU end 2024-09-13T23:06:31.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.710+0000 7f67ac526800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:06:31.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.710+0000 7f67ac526800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:06:31.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.710+0000 7f67ac526800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 2024-09-13T23:06:31.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.711+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 8.5 8:a5861de4:root::.bucket.meta.myfoo6%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a82d080 con 0x55a41a7da2d0 2024-09-13T23:06:31.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.712+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(68 .bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v34'5 uv5 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.712+0000 7f67ac526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 info.flags=0x17 2024-09-13T23:06:31.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.712+0000 7f67ac526800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 to cache LRU end 2024-09-13T23:06:31.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.712+0000 7f67ac526800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T23:06:31.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.712+0000 7f67ac526800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9, ofs0, ns] 2024-09-13T23:06:31.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.712+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94163307731840 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a82bd50 con 0x7f679001ac20 2024-09-13T23:06:31.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.712+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== watch-notify(notify (1) cookie 94163307481728 notify 146028888086 ret 0) ==== 790+0+0 (crc 0 0 0) 0x7f67a00437a0 con 0x7f679001ac20 2024-09-13T23:06:31.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.712+0000 7f66877fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888086 cookie 94163307481728 notifier 4742 bl.length()=748 2024-09-13T23:06:31.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.712+0000 7f66877fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 info.flags=0x17 2024-09-13T23:06:31.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.712+0000 7f66877fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 to cache LRU end 2024-09-13T23:06:31.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.712+0000 7f66877fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T23:06:31.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.712+0000 7f66877fe640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f666c003ea0 con 0x7f679001ac20 2024-09-13T23:06:31.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.712+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(69 notify.0 [notify cookie 94163307731840 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f67a0040040 con 0x7f679001ac20 2024-09-13T23:06:31.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.712+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== watch-notify(notify_complete (2) cookie 94163307731840 notify 146028888086 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f67a0024680 con 0x7f679001ac20 2024-09-13T23:06:31.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.712+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(70 notify.0 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67a0040040 con 0x7f679001ac20 2024-09-13T23:06:31.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.712+0000 7f67ac526800 20 handle_bi_update(): bucket=:myfoo6[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9]): orig_sources= new_sources= 2024-09-13T23:06:31.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.712+0000 7f67ac526800 20 handle_bi_update(): bucket=:myfoo6[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9]): potential sources added=[] removed=[] 2024-09-13T23:06:31.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.712+0000 7f67ac526800 20 handle_bi_update(): bucket=:myfoo6[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9]): orig_dests= new_dests= 2024-09-13T23:06:31.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.712+0000 7f67ac526800 20 handle_bi_update(): bucket=:myfoo6[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9]): potential dests added=[] removed=[] 2024-09-13T23:06:31.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.712+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a821b80 con 0x55a41a7da2d0 2024-09-13T23:06:31.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.713+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(71 bud.buckets [call] v34'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.713+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a821b80 con 0x55a41a7da2d0 2024-09-13T23:06:31.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.714+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(72 bud.buckets [call] v34'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.714+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a821b80 con 0x55a41a7da2d0 2024-09-13T23:06:31.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.715+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v34'19 uv19 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.715+0000 7f67ac526800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-13T23:06:31.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.715+0000 7f67ac526800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-13T23:06:31.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.715+0000 7f67ac526800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-13T23:06:31.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.715+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94163307731840 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a826300 con 0x7f679001ac20 2024-09-13T23:06:31.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.716+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== watch-notify(notify (1) cookie 94163307493072 notify 146028888087 ret 0) ==== 358+0+0 (crc 0 0 0) 0x7f67a0024920 con 0x7f679001ac20 2024-09-13T23:06:31.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.716+0000 7f6686ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888087 cookie 94163307493072 notifier 4742 bl.length()=316 2024-09-13T23:06:31.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.716+0000 7f6686ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-13T23:06:31.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.716+0000 7f6686ffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-13T23:06:31.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.716+0000 7f6686ffd640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f65dc003400 con 0x7f679001ac20 2024-09-13T23:06:31.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.716+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 18 ==== osd_op_reply(74 notify.3 [notify cookie 94163307731840 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f67a0040040 con 0x7f679001ac20 2024-09-13T23:06:31.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.716+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 19 ==== watch-notify(notify_complete (2) cookie 94163307731840 notify 146028888087 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f67a0024bc0 con 0x7f679001ac20 2024-09-13T23:06:31.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.716+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 20 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67a0040040 con 0x7f679001ac20 2024-09-13T23:06:31.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.716+0000 7f67ac526800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 : hit (requested=0x17, cached=0x17) 2024-09-13T23:06:31.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.716+0000 7f67ac526800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 2024-09-13T23:06:31.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.716+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:76 8.5 8:a5861de4:root::.bucket.meta.myfoo6%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a822a00 con 0x55a41a7da2d0 2024-09-13T23:06:31.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.717+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(76 .bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v34'6 uv6 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.717+0000 7f67ac526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 info.flags=0x17 2024-09-13T23:06:31.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.717+0000 7f67ac526800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 to cache LRU end 2024-09-13T23:06:31.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.717+0000 7f67ac526800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T23:06:31.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.717+0000 7f67ac526800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9, ofs0, ns] 2024-09-13T23:06:31.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.717+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:77 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94163307733024 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a8228f0 con 0x7f679001ac20 2024-09-13T23:06:31.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.717+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 21 ==== watch-notify(notify (1) cookie 94163307481728 notify 146028888088 ret 0) ==== 790+0+0 (crc 0 0 0) 0x7f67a0024bc0 con 0x7f679001ac20 2024-09-13T23:06:31.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.717+0000 7f66877fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888088 cookie 94163307481728 notifier 4742 bl.length()=748 2024-09-13T23:06:31.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.717+0000 7f66877fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 info.flags=0x17 2024-09-13T23:06:31.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.717+0000 7f66877fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 to cache LRU end 2024-09-13T23:06:31.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.717+0000 7f66877fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T23:06:31.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.717+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 22 ==== osd_op_reply(77 notify.0 [notify cookie 94163307733024 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f67a0040040 con 0x7f679001ac20 2024-09-13T23:06:31.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.717+0000 7f66877fe640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f666c003ea0 con 0x7f679001ac20 2024-09-13T23:06:31.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.718+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 23 ==== osd_op_reply(78 notify.0 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67a0040040 con 0x7f679001ac20 2024-09-13T23:06:31.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.718+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 24 ==== watch-notify(notify_complete (2) cookie 94163307733024 notify 146028888088 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f67a0024db0 con 0x7f679001ac20 2024-09-13T23:06:31.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.718+0000 7f67ac526800 20 handle_bi_update(): bucket=:myfoo6[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9]): orig_sources= new_sources= 2024-09-13T23:06:31.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.718+0000 7f67ac526800 20 handle_bi_update(): bucket=:myfoo6[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9]): potential sources added=[] removed=[] 2024-09-13T23:06:31.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.718+0000 7f67ac526800 20 handle_bi_update(): bucket=:myfoo6[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9]): orig_dests= new_dests= 2024-09-13T23:06:31.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.718+0000 7f67ac526800 20 handle_bi_update(): bucket=:myfoo6[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9]): potential dests added=[] removed=[] 2024-09-13T23:06:31.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.718+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:79 4.6 4:62c26400:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a8224d0 con 0x55a41a7e0520 2024-09-13T23:06:31.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.718+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(79 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6790024030 con 0x55a41a7e0520 2024-09-13T23:06:31.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.718+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:80 4.5 4:a0d4b7a9:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a822900 con 0x7f679001ac20 2024-09-13T23:06:31.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.718+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 25 ==== osd_op_reply(80 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.1 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f67a0040040 con 0x7f679001ac20 2024-09-13T23:06:31.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.718+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:81 4.32 4:4f5857b2:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a822900 con 0x55a41a7da2d0 2024-09-13T23:06:31.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.719+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(81 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.719+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:82 4.11 4:8a1b5a9e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a822900 con 0x7f67a0031040 2024-09-13T23:06:31.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.720+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(82 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6798075030 con 0x7f67a0031040 2024-09-13T23:06:31.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.720+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:83 4.35 4:ad6a2e91:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a822900 con 0x55a41a7da2d0 2024-09-13T23:06:31.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.720+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(83 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.720+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:84 4.25 4:a797616a:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a822900 con 0x7f679001ac20 2024-09-13T23:06:31.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.720+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 26 ==== osd_op_reply(84 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f67a0040040 con 0x7f679001ac20 2024-09-13T23:06:31.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.720+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:85 4.e 4:72889151:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a822900 con 0x7f679001ac20 2024-09-13T23:06:31.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.720+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 27 ==== osd_op_reply(85 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.6 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f67a0040040 con 0x7f679001ac20 2024-09-13T23:06:31.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.721+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:86 4.0 4:012594ce:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a822900 con 0x55a41a7e0520 2024-09-13T23:06:31.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.721+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(86 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6790024030 con 0x55a41a7e0520 2024-09-13T23:06:31.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.721+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:87 4.2d 4:b57db1fd:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a826300 con 0x7f67a0031040 2024-09-13T23:06:31.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.721+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(87 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6798075030 con 0x7f67a0031040 2024-09-13T23:06:31.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.721+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:88 4.5 4:a2208176:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a826300 con 0x7f679001ac20 2024-09-13T23:06:31.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.722+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 28 ==== osd_op_reply(88 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.9 [call out=377b] v0'0 uv9 ondisk = 0) ==== 194+0+377 (crc 0 0 0) 0x7f67a0040040 con 0x7f679001ac20 2024-09-13T23:06:31.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.722+0000 7f67ac526800 10 cls_bucket_list_unordered: got thirteen 2024-09-13T23:06:31.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.722+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:89 4.f 4:f030fdc2:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a826300 con 0x55a41a7da2d0 2024-09-13T23:06:31.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.722+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 32 ==== osd_op_reply(89 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f6798075030 con 0x55a41a7da2d0 2024-09-13T23:06:31.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.722+0000 7f67ac526800 20 get_obj_state: octx=0x7f6798064ba0 obj=myfoo6:thirteen state=0x55a41a82ba88 s->prefetch_data=0 2024-09-13T23:06:31.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.722+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:90 3.8s0 3:1392d58c:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a826300 con 0x55a41a7e0520 2024-09-13T23:06:31.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.722+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(90 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9_thirteen [getxattrs out=854b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+870 (crc 0 0 0) 0x7f6790024030 con 0x55a41a7e0520 2024-09-13T23:06:31.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.722+0000 7f67ac526800 10 manifest: total_size = 8 2024-09-13T23:06:31.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.722+0000 7f67ac526800 20 get_obj_state: setting s->obj_tag to a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.5309343103351010148 2024-09-13T23:06:31.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.722+0000 7f67ac526800 20 Read xattr rgw_rados: user.rgw.acl 2024-09-13T23:06:31.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.722+0000 7f67ac526800 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-13T23:06:31.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.722+0000 7f67ac526800 20 Read xattr rgw_rados: user.rgw.etag 2024-09-13T23:06:31.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.722+0000 7f67ac526800 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-13T23:06:31.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.722+0000 7f67ac526800 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-13T23:06:31.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.722+0000 7f67ac526800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-13T23:06:31.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.722+0000 7f67ac526800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-13T23:06:31.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.722+0000 7f67ac526800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-13T23:06:31.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.722+0000 7f67ac526800 20 get_obj_state: octx=0x7f6798064ba0 obj=myfoo6:thirteen state=0x55a41a82ba88 s->prefetch_data=0 2024-09-13T23:06:31.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.722+0000 7f67ac526800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 : hit (requested=0x17, cached=0x17) 2024-09-13T23:06:31.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.722+0000 7f67ac526800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 2024-09-13T23:06:31.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.722+0000 7f67ac526800 20 bucket index object: :.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.9 2024-09-13T23:06:31.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.722+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:91 4.5 4:a2208176:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a8297a0 con 0x7f679001ac20 2024-09-13T23:06:31.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.724+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 29 ==== osd_op_reply(91 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.9 [stat,call,call] v34'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f67a0040040 con 0x7f679001ac20 2024-09-13T23:06:31.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.724+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:92 3.8s0 3:1392d58c:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9_thirteen:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=76b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a8297a0 con 0x55a41a7e0520 2024-09-13T23:06:31.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.725+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(92 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9_thirteen [cmpxattr (62) op 1 mode 1,setxattr (117),setxattr (33)] v34'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7f6790024030 con 0x55a41a7e0520 2024-09-13T23:06:31.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.725+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:93 4.5 4:a2208176:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a830770 con 0x7f679001ac20 2024-09-13T23:06:31.741 INFO:teuthology.orchestra.run.smithi164.stderr:1 objects processed in :myfoo6[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9]). Next marker thirteen 2024-09-13T23:06:31.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.725+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a830770 con 0x7f679001ac20 2024-09-13T23:06:31.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.727+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 30 ==== osd_op_reply(93 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.9 [stat,call,call] v34'11 uv11 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f67a0040040 con 0x7f679001ac20 2024-09-13T23:06:31.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.727+0000 7f66877fe640 20 handle_completion(): completion ok for obj=thirteen 2024-09-13T23:06:31.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.727+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 31 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v34'2 uv2 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f67a0040040 con 0x7f679001ac20 2024-09-13T23:06:31.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.727+0000 7f67ac526800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T23:06:31.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.727+0000 7f67ac526800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T23:06:31.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.727+0000 7f67ac526800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-13T23:06:31.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.728+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94163307747952 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a82a510 con 0x7f67a0031040 2024-09-13T23:06:31.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.728+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== watch-notify(notify (1) cookie 94163307500208 notify 146028888096 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55a41a82a340 con 0x7f67a0031040 2024-09-13T23:06:31.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.728+0000 7f6686ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888096 cookie 94163307500208 notifier 4742 bl.length()=556 2024-09-13T23:06:31.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.728+0000 7f6686ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T23:06:31.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.728+0000 7f6686ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T23:06:31.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.728+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(95 notify.5 [notify cookie 94163307747952 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f67980c4020 con 0x7f67a0031040 2024-09-13T23:06:31.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.728+0000 7f6686ffd640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f65dc003460 con 0x7f67a0031040 2024-09-13T23:06:31.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.728+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67980c4020 con 0x7f67a0031040 2024-09-13T23:06:31.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.728+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== watch-notify(notify_complete (2) cookie 94163307747952 notify 146028888096 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a41a823430 con 0x7f67a0031040 2024-09-13T23:06:31.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.728+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a825a70 con 0x55a41a7da2d0 2024-09-13T23:06:31.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.730+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 33 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v34'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f67980c4020 con 0x55a41a7da2d0 2024-09-13T23:06:31.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.730+0000 7f67ac526800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T23:06:31.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.730+0000 7f67ac526800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T23:06:31.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.730+0000 7f67ac526800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-13T23:06:31.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.730+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94163307747952 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a82a510 con 0x7f67a0031040 2024-09-13T23:06:31.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.730+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 27 ==== watch-notify(notify (1) cookie 94163307500208 notify 146028888097 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55a41a823430 con 0x7f67a0031040 2024-09-13T23:06:31.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.730+0000 7f6686ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888097 cookie 94163307500208 notifier 4742 bl.length()=177 2024-09-13T23:06:31.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.730+0000 7f6686ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T23:06:31.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.730+0000 7f6686ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T23:06:31.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.730+0000 7f6686ffd640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f65dc003460 con 0x7f67a0031040 2024-09-13T23:06:31.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.730+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 28 ==== osd_op_reply(98 notify.5 [notify cookie 94163307747952 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f67980c4020 con 0x7f67a0031040 2024-09-13T23:06:31.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.730+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 29 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67980c4020 con 0x7f67a0031040 2024-09-13T23:06:31.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.730+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 30 ==== watch-notify(notify_complete (2) cookie 94163307747952 notify 146028888097 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a41a7a3be0 con 0x7f67a0031040 2024-09-13T23:06:31.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.730+0000 7f67ac526800 10 removing user index: bar 2024-09-13T23:06:31.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.730+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a825a70 con 0x7f67a0031040 2024-09-13T23:06:31.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.731+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 31 ==== osd_op_reply(100 bar [delete] v34'4 uv4 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f67980c4020 con 0x7f67a0031040 2024-09-13T23:06:31.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.731+0000 7f67ac526800 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-13T23:06:31.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.731+0000 7f67ac526800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-13T23:06:31.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.731+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94163307747952 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a41a82a510 con 0x7f67a0031040 2024-09-13T23:06:31.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.732+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 32 ==== watch-notify(notify (1) cookie 94163307504144 notify 146028888098 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55a41a7a3be0 con 0x7f67a0031040 2024-09-13T23:06:31.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.732+0000 7f66877fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888098 cookie 94163307504144 notifier 4742 bl.length()=152 2024-09-13T23:06:31.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.732+0000 7f66877fe640 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f666c003ea0 con 0x7f67a0031040 2024-09-13T23:06:31.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.732+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 33 ==== osd_op_reply(101 notify.7 [notify cookie 94163307747952 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f67980c4020 con 0x7f67a0031040 2024-09-13T23:06:31.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.732+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 34 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67980c4020 con 0x7f67a0031040 2024-09-13T23:06:31.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.732+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 35 ==== watch-notify(notify_complete (2) cookie 94163307747952 notify 146028888098 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a41a7a3660 con 0x7f67a0031040 2024-09-13T23:06:31.748 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-13T23:06:31.540565Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:06:31.540550Z","tags":[],"group_ids":[]} 2024-09-13T23:06:31.754 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.733+0000 7f665e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:06:31.754 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.733+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94163307505200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a81ec10 con 0x55a41a7da2d0 2024-09-13T23:06:31.754 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.734+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 34 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94163307505200] v34'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f67980c4020 con 0x55a41a7da2d0 2024-09-13T23:06:31.754 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.734+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94163307481728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a81ec10 con 0x7f679001ac20 2024-09-13T23:06:31.754 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.735+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 32 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94163307481728] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67a0040040 con 0x7f679001ac20 2024-09-13T23:06:31.754 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.735+0000 7f67ac526800 20 remove_watcher() i=0 2024-09-13T23:06:31.754 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.735+0000 7f67ac526800 2 removed watcher, disabling cache 2024-09-13T23:06:31.754 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.735+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94163307484976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a81ec10 con 0x55a41a7da2d0 2024-09-13T23:06:31.754 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.736+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 35 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94163307484976] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67980c4020 con 0x55a41a7da2d0 2024-09-13T23:06:31.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.736+0000 7f67ac526800 20 remove_watcher() i=1 2024-09-13T23:06:31.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.736+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94163307488912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a81ec10 con 0x55a41a7e0520 2024-09-13T23:06:31.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.737+0000 7f67a79e2640 1 -- 172.21.15.164:0/1971280578 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94163307488912] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6790024030 con 0x55a41a7e0520 2024-09-13T23:06:31.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.737+0000 7f67ac526800 20 remove_watcher() i=2 2024-09-13T23:06:31.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.737+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94163307493072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a81ec10 con 0x7f679001ac20 2024-09-13T23:06:31.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.738+0000 7f67a89e4640 1 -- 172.21.15.164:0/1971280578 <== osd.2 v2:172.21.15.164:6808/3795914978 33 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94163307493072] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67a0040040 con 0x7f679001ac20 2024-09-13T23:06:31.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.738+0000 7f67ac526800 20 remove_watcher() i=3 2024-09-13T23:06:31.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.738+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94163307497536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a81ec10 con 0x55a41a7da2d0 2024-09-13T23:06:31.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.739+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.1 v2:172.21.15.164:6800/4060509701 36 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94163307497536] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67980c4020 con 0x55a41a7da2d0 2024-09-13T23:06:31.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.739+0000 7f67ac526800 20 remove_watcher() i=4 2024-09-13T23:06:31.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.739+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94163307500208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a81ec10 con 0x7f67a0031040 2024-09-13T23:06:31.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.740+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 36 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94163307500208] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67980c4020 con 0x7f67a0031040 2024-09-13T23:06:31.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.740+0000 7f67ac526800 20 remove_watcher() i=5 2024-09-13T23:06:31.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.740+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94163307486032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a81ec10 con 0x7f67a0031040 2024-09-13T23:06:31.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.742+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 37 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94163307486032] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67980c4020 con 0x7f67a0031040 2024-09-13T23:06:31.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.742+0000 7f67ac526800 20 remove_watcher() i=6 2024-09-13T23:06:31.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.742+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94163307504144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a41a81ec10 con 0x7f67a0031040 2024-09-13T23:06:31.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 <== osd.0 v2:172.21.15.17:6800/489863589 38 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94163307504144] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67980c4020 con 0x7f67a0031040 2024-09-13T23:06:31.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67ac526800 20 remove_watcher() i=7 2024-09-13T23:06:31.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f67a0031040 msgr2=0x7f67a0032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67ac526800 1 --2- 172.21.15.164:0/1971280578 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f67a0031040 0x7f67a0032940 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a41a7da2d0 msgr2=0x55a41a7dc790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67ac526800 1 --2- 172.21.15.164:0/1971280578 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a41a7da2d0 0x55a41a7dc790 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f679001ac20 msgr2=0x7f67900278c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67ac526800 1 --2- 172.21.15.164:0/1971280578 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f679001ac20 0x7f67900278c0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55a41a7e0520 msgr2=0x55a41a7e2910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67ac526800 1 --2- 172.21.15.164:0/1971280578 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55a41a7e0520 0x55a41a7e2910 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6678036b90 msgr2=0x7f6678039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67ac526800 1 --2- 172.21.15.164:0/1971280578 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6678036b90 0x7f6678039050 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55a41a7a3f40 tx=0x7f67a001f000 comp rx=0 tx=0).stop 2024-09-13T23:06:31.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a7c77e0 msgr2=0x55a41a7ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67ac526800 1 --2- 172.21.15.164:0/1971280578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a7c77e0 0x55a41a7ceb30 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f679004b320 tx=0x7f679004c340 comp rx=0 tx=0).stop 2024-09-13T23:06:31.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 reap_dead start 2024-09-13T23:06:31.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67a81e3640 1 -- 172.21.15.164:0/1971280578 reap_dead start 2024-09-13T23:06:31.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 shutdown_connections 2024-09-13T23:06:31.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 >> 172.21.15.164:0/1971280578 conn(0x55a41a7c3b40 msgr2=0x55a41a7c1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 shutdown_connections 2024-09-13T23:06:31.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67ac526800 1 -- 172.21.15.164:0/1971280578 wait complete. 2024-09-13T23:06:31.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67ac526800 1 -- 172.21.15.164:0/2670364746 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6680036b90 msgr2=0x7f6680039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67ac526800 1 --2- 172.21.15.164:0/2670364746 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6680036b90 0x7f6680039050 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55a41a7ab190 tx=0x7f67a0005840 comp rx=0 tx=0).stop 2024-09-13T23:06:31.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67ac526800 1 -- 172.21.15.164:0/2670364746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a7bab20 msgr2=0x55a41a7baf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67ac526800 1 --2- 172.21.15.164:0/2670364746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a7bab20 0x55a41a7baf40 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6790001ed0 tx=0x7f679000ea00 comp rx=0 tx=0).stop 2024-09-13T23:06:31.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67ac526800 1 -- 172.21.15.164:0/2670364746 shutdown_connections 2024-09-13T23:06:31.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67ac526800 1 --2- 172.21.15.164:0/2670364746 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6680036b90 0x7f6680039050 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67ac526800 1 --2- 172.21.15.164:0/2670364746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a7bab20 0x55a41a7baf40 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67ac526800 1 -- 172.21.15.164:0/2670364746 >> 172.21.15.164:0/2670364746 conn(0x55a41a7afab0 msgr2=0x55a41a7b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.743+0000 7f67ac526800 1 -- 172.21.15.164:0/2670364746 shutdown_connections 2024-09-13T23:06:31.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.744+0000 7f67ac526800 1 -- 172.21.15.164:0/2670364746 wait complete. 2024-09-13T23:06:31.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.744+0000 7f67ac526800 1 -- 172.21.15.164:0/2931765385 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a41a6af720 msgr2=0x55a41a7aa190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.744+0000 7f67ac526800 1 --2- 172.21.15.164:0/2931765385 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a41a6af720 0x55a41a7aa190 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.744+0000 7f67ac526800 1 -- 172.21.15.164:0/2931765385 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6690036b40 msgr2=0x7f6690039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.744+0000 7f67ac526800 1 --2- 172.21.15.164:0/2931765385 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6690036b40 0x7f6690039000 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6790000f60 tx=0x7f6790001370 comp rx=0 tx=0).stop 2024-09-13T23:06:31.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.744+0000 7f67ac526800 1 -- 172.21.15.164:0/2931765385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a620650 msgr2=0x55a41a7a3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:31.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.744+0000 7f67ac526800 1 --2- 172.21.15.164:0/2931765385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a620650 0x55a41a7a3120 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6798067040 tx=0x7f6798002fb0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.744+0000 7f67ac526800 1 -- 172.21.15.164:0/2931765385 shutdown_connections 2024-09-13T23:06:31.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.744+0000 7f67ac526800 1 --2- 172.21.15.164:0/2931765385 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55a41a6af720 0x55a41a7aa190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.744+0000 7f67ac526800 1 --2- 172.21.15.164:0/2931765385 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6690036b40 0x7f6690039000 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.744+0000 7f67ac526800 1 --2- 172.21.15.164:0/2931765385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a41a620650 0x55a41a7a3120 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:31.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.744+0000 7f67ac526800 1 -- 172.21.15.164:0/2931765385 >> 172.21.15.164:0/2931765385 conn(0x55a41a6a6db0 msgr2=0x55a41a795ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:31.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.744+0000 7f67ac526800 1 -- 172.21.15.164:0/2931765385 shutdown_connections 2024-09-13T23:06:31.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:31.744+0000 7f67ac526800 1 -- 172.21.15.164:0/2931765385 wait complete. 2024-09-13T23:06:31.759 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-13T23:06:31.540565Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:06:31.540550Z', 'tags': [], 'group_ids': []} 2024-09-13T23:06:36.769 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:06:36.769 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-13T23:06:36.770 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-13T23:06:36.770 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-13T23:06:36.770 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-13T23:06:36.832 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:06:36.832 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:06:36.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.831+0000 7f7d52487800 1 Processor -- start 2024-09-13T23:06:36.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.831+0000 7f7d52487800 1 -- start start 2024-09-13T23:06:36.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.831+0000 7f7d52487800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55778c311590 0x55778c311990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:36.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.831+0000 7f7d52487800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55778c1d1b30 con 0x55778c311ed0 2024-09-13T23:06:36.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.831+0000 7f7d52487800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55778c1b3360 con 0x55778c311590 2024-09-13T23:06:36.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.832+0000 7f7d4ff7b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55778c311590 0x55778c311990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:36.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.832+0000 7f7d4ff7b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55778c311590 0x55778c311990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44922/0 (socket says 172.21.15.164:44922) 2024-09-13T23:06:36.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.832+0000 7f7d47fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55778c311ed0 0x55778c316a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:55980/0 (socket says 172.21.15.164:55980) 2024-09-13T23:06:36.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.832+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/3957887633 learned_addr learned my addr 172.21.15.164:0/3957887633 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:36.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.832+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/3957887633 >> v1:172.21.15.17:6789/0 conn(0x55778c311ed0 legacy=0x55778c316a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:36.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.832+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/3957887633 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55778c1d9e00 con 0x55778c311590 2024-09-13T23:06:36.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.834+0000 7f7d4ff7b640 1 --2- 172.21.15.164:0/3957887633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c311590 0x55778c311990 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7d4000a520 tx=0x7f7d40045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1eb00168efd43e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:36.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.834+0000 7f7d4f77a640 1 -- 172.21.15.164:0/3957887633 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d40055070 con 0x55778c311590 2024-09-13T23:06:36.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.834+0000 7f7d4f77a640 1 -- 172.21.15.164:0/3957887633 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d400515b0 con 0x55778c311590 2024-09-13T23:06:36.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.834+0000 7f7d4f77a640 1 -- 172.21.15.164:0/3957887633 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d400518d0 con 0x55778c311590 2024-09-13T23:06:36.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.835+0000 7f7d52487800 1 -- 172.21.15.164:0/3957887633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c311590 msgr2=0x55778c311990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:36.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.835+0000 7f7d52487800 1 --2- 172.21.15.164:0/3957887633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c311590 0x55778c311990 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7d4000a520 tx=0x7f7d40045ba0 comp rx=0 tx=0).stop 2024-09-13T23:06:36.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.835+0000 7f7d52487800 1 -- 172.21.15.164:0/3957887633 shutdown_connections 2024-09-13T23:06:36.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.835+0000 7f7d52487800 1 --2- 172.21.15.164:0/3957887633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c311590 0x55778c311990 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:36.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.835+0000 7f7d52487800 1 -- 172.21.15.164:0/3957887633 >> 172.21.15.164:0/3957887633 conn(0x55778c30ce20 msgr2=0x55778c30f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:36.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.835+0000 7f7d52487800 1 -- 172.21.15.164:0/3957887633 shutdown_connections 2024-09-13T23:06:36.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.835+0000 7f7d52487800 1 -- 172.21.15.164:0/3957887633 wait complete. 2024-09-13T23:06:36.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.850+0000 7f7d52487800 1 Processor -- start 2024-09-13T23:06:36.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.851+0000 7f7d52487800 1 -- start start 2024-09-13T23:06:36.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.851+0000 7f7d52487800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c311590 0x55778c3fd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:36.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.851+0000 7f7d52487800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55778c25e370 con 0x55778c311590 2024-09-13T23:06:36.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.851+0000 7f7d4ff7b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c311590 0x55778c3fd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:36.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.851+0000 7f7d4ff7b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c311590 0x55778c3fd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44930/0 (socket says 172.21.15.164:44930) 2024-09-13T23:06:36.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.851+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/166298045 learned_addr learned my addr 172.21.15.164:0/166298045 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:36.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.851+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/166298045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55778c1abbc0 con 0x55778c311590 2024-09-13T23:06:36.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.852+0000 7f7d4ff7b640 1 --2- 172.21.15.164:0/166298045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c311590 0x55778c3fd760 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7d40025da0 tx=0x7f7d40051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcf6f0ad7cb29a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:36.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.852+0000 7f7c3de0b640 1 -- 172.21.15.164:0/166298045 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d40051950 con 0x55778c311590 2024-09-13T23:06:36.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.852+0000 7f7c3de0b640 1 -- 172.21.15.164:0/166298045 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d40051af0 con 0x55778c311590 2024-09-13T23:06:36.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.852+0000 7f7c3de0b640 1 -- 172.21.15.164:0/166298045 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d40051dd0 con 0x55778c311590 2024-09-13T23:06:36.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.853+0000 7f7d52487800 1 -- 172.21.15.164:0/166298045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c311590 msgr2=0x55778c3fd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:36.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.853+0000 7f7d52487800 1 --2- 172.21.15.164:0/166298045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c311590 0x55778c3fd760 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7d40025da0 tx=0x7f7d40051000 comp rx=0 tx=0).stop 2024-09-13T23:06:36.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.853+0000 7f7d52487800 1 -- 172.21.15.164:0/166298045 shutdown_connections 2024-09-13T23:06:36.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.853+0000 7f7d52487800 1 --2- 172.21.15.164:0/166298045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c311590 0x55778c3fd760 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:36.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.853+0000 7f7d52487800 1 -- 172.21.15.164:0/166298045 >> 172.21.15.164:0/166298045 conn(0x55778c30ce20 msgr2=0x55778c3ffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:36.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.853+0000 7f7d52487800 1 -- 172.21.15.164:0/166298045 shutdown_connections 2024-09-13T23:06:36.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.853+0000 7f7d52487800 1 -- 172.21.15.164:0/166298045 wait complete. 2024-09-13T23:06:36.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.853+0000 7f7d52487800 1 Processor -- start 2024-09-13T23:06:36.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.853+0000 7f7d52487800 1 -- start start 2024-09-13T23:06:36.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.853+0000 7f7d52487800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c311590 0x55778c40b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:36.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.853+0000 7f7d52487800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55778c3185b0 con 0x55778c311590 2024-09-13T23:06:36.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.854+0000 7f7d4ff7b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c311590 0x55778c40b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:36.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.854+0000 7f7d4ff7b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c311590 0x55778c40b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44936/0 (socket says 172.21.15.164:44936) 2024-09-13T23:06:36.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.854+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/155008034 learned_addr learned my addr 172.21.15.164:0/155008034 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:36.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.854+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/155008034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55778c1bffe0 con 0x55778c311590 2024-09-13T23:06:36.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.854+0000 7f7d4ff7b640 1 --2- 172.21.15.164:0/155008034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c311590 0x55778c40b460 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f7d40067040 tx=0x7f7d40002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:36.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.854+0000 7f7c37fff640 1 -- 172.21.15.164:0/155008034 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d40073070 con 0x55778c311590 2024-09-13T23:06:36.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.854+0000 7f7c37fff640 1 -- 172.21.15.164:0/155008034 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d4005a450 con 0x55778c311590 2024-09-13T23:06:36.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.854+0000 7f7d52487800 1 -- 172.21.15.164:0/155008034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55778c40b9a0 con 0x55778c311590 2024-09-13T23:06:36.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.854+0000 7f7c37fff640 1 -- 172.21.15.164:0/155008034 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d4005a730 con 0x55778c311590 2024-09-13T23:06:36.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.854+0000 7f7d52487800 1 -- 172.21.15.164:0/155008034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55778c40bf20 con 0x55778c311590 2024-09-13T23:06:36.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.855+0000 7f7c37fff640 1 -- 172.21.15.164:0/155008034 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7d40076070 con 0x55778c311590 2024-09-13T23:06:36.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.855+0000 7f7c37fff640 1 --2- 172.21.15.164:0/155008034 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c38036b40 0x7f7c38039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:36.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.855+0000 7f7c37fff640 1 -- 172.21.15.164:0/155008034 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f7d40062070 con 0x55778c311590 2024-09-13T23:06:36.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.855+0000 7f7d47fff640 1 --2- 172.21.15.164:0/155008034 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c38036b40 0x7f7c38039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:36.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.856+0000 7f7d52487800 1 --2- 172.21.15.164:0/155008034 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55778c311ed0 0x55778c4124d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:36.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.856+0000 7f7d52487800 1 -- 172.21.15.164:0/155008034 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55778c412a50 con 0x55778c311ed0 2024-09-13T23:06:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.856+0000 7f7d5077c640 1 --2- 172.21.15.164:0/155008034 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55778c311ed0 0x55778c4124d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.856+0000 7f7d47fff640 1 --2- 172.21.15.164:0/155008034 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c38036b40 0x7f7c38039000 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7d38000f60 tx=0x7f7d38001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.856+0000 7f7d5077c640 1 --2- 172.21.15.164:0/155008034 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55778c311ed0 0x55778c4124d0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.856+0000 7f7d5077c640 1 -- 172.21.15.164:0/155008034 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d4800a4a0 con 0x55778c311ed0 2024-09-13T23:06:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.856+0000 7f7d52487800 1 -- 172.21.15.164:0/155008034 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55778c40faa0 con 0x55778c311ed0 2024-09-13T23:06:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.857+0000 7f7d5077c640 1 -- 172.21.15.164:0/155008034 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7d4800a4a0 con 0x55778c311ed0 2024-09-13T23:06:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.857+0000 7f7d52487800 1 -- 172.21.15.164:0/155008034 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55778c414870 con 0x55778c311ed0 2024-09-13T23:06:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.857+0000 7f7d5077c640 1 -- 172.21.15.164:0/155008034 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7d4800a4a0 con 0x55778c311ed0 2024-09-13T23:06:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.857+0000 7f7d52487800 1 -- 172.21.15.164:0/155008034 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55778c4139b0 con 0x55778c311ed0 2024-09-13T23:06:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.857+0000 7f7d5077c640 1 -- 172.21.15.164:0/155008034 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7d4800a4a0 con 0x55778c311ed0 2024-09-13T23:06:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.857+0000 7f7d52487800 1 -- 172.21.15.164:0/155008034 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55778c413e00 con 0x55778c311ed0 2024-09-13T23:06:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.857+0000 7f7d5077c640 1 -- 172.21.15.164:0/155008034 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7d4800a4a0 con 0x55778c311ed0 2024-09-13T23:06:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.858+0000 7f7d52487800 1 Processor -- start 2024-09-13T23:06:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.858+0000 7f7d52487800 1 -- start start 2024-09-13T23:06:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.858+0000 7f7d52487800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c422e60 0x55778c423280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.858+0000 7f7d52487800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55778c1ad580 con 0x55778c422e60 2024-09-13T23:06:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.858+0000 7f7d47fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c422e60 0x55778c423280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.858+0000 7f7d47fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c422e60 0x55778c423280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44942/0 (socket says 172.21.15.164:44942) 2024-09-13T23:06:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.858+0000 7f7d47fff640 1 -- 172.21.15.164:0/1396979948 learned_addr learned my addr 172.21.15.164:0/1396979948 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.859+0000 7f7d47fff640 1 -- 172.21.15.164:0/1396979948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55778c4237c0 con 0x55778c422e60 2024-09-13T23:06:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.859+0000 7f7d47fff640 1 --2- 172.21.15.164:0/1396979948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c422e60 0x55778c423280 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f7d38001ed0 tx=0x7f7d3800ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.859+0000 7f7c357fa640 1 -- 172.21.15.164:0/1396979948 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d38022070 con 0x55778c422e60 2024-09-13T23:06:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.859+0000 7f7c357fa640 1 -- 172.21.15.164:0/1396979948 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d3800d520 con 0x55778c422e60 2024-09-13T23:06:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.860+0000 7f7c357fa640 1 -- 172.21.15.164:0/1396979948 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d3800d800 con 0x55778c422e60 2024-09-13T23:06:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.860+0000 7f7d52487800 1 -- 172.21.15.164:0/1396979948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55778c423a50 con 0x55778c422e60 2024-09-13T23:06:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.860+0000 7f7d52487800 1 -- 172.21.15.164:0/1396979948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55778c426730 con 0x55778c422e60 2024-09-13T23:06:36.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.861+0000 7f7c357fa640 1 -- 172.21.15.164:0/1396979948 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7d38025070 con 0x55778c422e60 2024-09-13T23:06:36.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.861+0000 7f7c357fa640 1 --2- 172.21.15.164:0/1396979948 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c28036b90 0x7f7c28039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:36.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.861+0000 7f7c357fa640 1 -- 172.21.15.164:0/1396979948 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f7d3804e060 con 0x55778c422e60 2024-09-13T23:06:36.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.861+0000 7f7d5077c640 1 --2- 172.21.15.164:0/1396979948 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c28036b90 0x7f7c28039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:36.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.861+0000 7f7d52487800 1 Processor -- start 2024-09-13T23:06:36.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.861+0000 7f7d5077c640 1 --2- 172.21.15.164:0/1396979948 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c28036b90 0x7f7c28039050 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55778c4134d0 tx=0x7f7d48005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:36.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.861+0000 7f7d52487800 1 -- start start 2024-09-13T23:06:36.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.862+0000 7f7d52487800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c42fb20 0x55778c42ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:36.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.862+0000 7f7d52487800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55778c3fbd70 con 0x55778c42fb20 2024-09-13T23:06:36.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.862+0000 7f7d47fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c42fb20 0x55778c42ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:36.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.862+0000 7f7d47fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c42fb20 0x55778c42ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44958/0 (socket says 172.21.15.164:44958) 2024-09-13T23:06:36.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.862+0000 7f7d47fff640 1 -- 172.21.15.164:0/327464516 learned_addr learned my addr 172.21.15.164:0/327464516 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:36.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.862+0000 7f7d47fff640 1 -- 172.21.15.164:0/327464516 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55778c4304f0 con 0x55778c42fb20 2024-09-13T23:06:36.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.862+0000 7f7d47fff640 1 --2- 172.21.15.164:0/327464516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c42fb20 0x55778c42ff20 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f7d3800eee0 tx=0x7f7d38024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ae49db7c2f04b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:36.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.862+0000 7f7c2effd640 1 -- 172.21.15.164:0/327464516 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d38045070 con 0x55778c42fb20 2024-09-13T23:06:36.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.863+0000 7f7c2effd640 1 -- 172.21.15.164:0/327464516 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d38026730 con 0x55778c42fb20 2024-09-13T23:06:36.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.863+0000 7f7c2effd640 1 -- 172.21.15.164:0/327464516 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d38025c50 con 0x55778c42fb20 2024-09-13T23:06:36.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.863+0000 7f7d52487800 1 -- 172.21.15.164:0/327464516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c42fb20 msgr2=0x55778c42ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:36.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.863+0000 7f7d52487800 1 --2- 172.21.15.164:0/327464516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c42fb20 0x55778c42ff20 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f7d3800eee0 tx=0x7f7d38024740 comp rx=0 tx=0).stop 2024-09-13T23:06:36.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.863+0000 7f7d52487800 1 -- 172.21.15.164:0/327464516 shutdown_connections 2024-09-13T23:06:36.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.863+0000 7f7d52487800 1 --2- 172.21.15.164:0/327464516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c42fb20 0x55778c42ff20 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:36.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.863+0000 7f7d52487800 1 -- 172.21.15.164:0/327464516 >> 172.21.15.164:0/327464516 conn(0x55778c42be80 msgr2=0x55778c429f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:36.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.863+0000 7f7d52487800 1 -- 172.21.15.164:0/327464516 shutdown_connections 2024-09-13T23:06:36.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.863+0000 7f7d52487800 1 -- 172.21.15.164:0/327464516 wait complete. 2024-09-13T23:06:36.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.863+0000 7f7d52487800 1 Processor -- start 2024-09-13T23:06:36.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.863+0000 7f7d52487800 1 -- start start 2024-09-13T23:06:36.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.864+0000 7f7d52487800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c42fb20 0x55778c436e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:36.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.864+0000 7f7d52487800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55778c430a70 con 0x55778c42fb20 2024-09-13T23:06:36.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.864+0000 7f7d47fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c42fb20 0x55778c436e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:36.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.864+0000 7f7d47fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c42fb20 0x55778c436e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44968/0 (socket says 172.21.15.164:44968) 2024-09-13T23:06:36.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.864+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 learned_addr learned my addr 172.21.15.164:0/1162102412 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:36.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.864+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55778c4373b0 con 0x55778c42fb20 2024-09-13T23:06:36.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.864+0000 7f7d47fff640 1 --2- 172.21.15.164:0/1162102412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c42fb20 0x55778c436e70 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f7d3804b320 tx=0x7f7d3804c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:36.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.864+0000 7f7c2d7fa640 1 -- 172.21.15.164:0/1162102412 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d38045070 con 0x55778c42fb20 2024-09-13T23:06:36.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.865+0000 7f7c2d7fa640 1 -- 172.21.15.164:0/1162102412 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d3800dbb0 con 0x55778c42fb20 2024-09-13T23:06:36.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.865+0000 7f7c2d7fa640 1 -- 172.21.15.164:0/1162102412 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d3801a320 con 0x55778c42fb20 2024-09-13T23:06:36.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.865+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55778c4373b0 con 0x55778c42fb20 2024-09-13T23:06:36.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.865+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55778c4373b0 con 0x55778c42fb20 2024-09-13T23:06:36.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.865+0000 7f7c2d7fa640 1 -- 172.21.15.164:0/1162102412 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7d38033070 con 0x55778c42fb20 2024-09-13T23:06:36.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.866+0000 7f7c2d7fa640 1 --2- 172.21.15.164:0/1162102412 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c18036b40 0x7f7c18039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:36.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.866+0000 7f7c2d7fa640 1 -- 172.21.15.164:0/1162102412 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f7d38052d50 con 0x55778c42fb20 2024-09-13T23:06:36.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.866+0000 7f7d5077c640 1 --2- 172.21.15.164:0/1162102412 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c18036b40 0x7f7c18039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:36.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.866+0000 7f7d5077c640 1 --2- 172.21.15.164:0/1162102412 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c18036b40 0x7f7c18039000 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55778c40c280 tx=0x7f7d4801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:36.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.866+0000 7f7d52487800 20 rados->read ofs=0 len=0 2024-09-13T23:06:36.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.866+0000 7f7d52487800 1 --2- 172.21.15.164:0/1162102412 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55778c442620 0x55778c444ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:36.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.866+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55778c445230 con 0x55778c442620 2024-09-13T23:06:36.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.867+0000 7f7d4ff7b640 1 --2- 172.21.15.164:0/1162102412 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55778c442620 0x55778c444ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:36.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.867+0000 7f7d4ff7b640 1 --2- 172.21.15.164:0/1162102412 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55778c442620 0x55778c444ae0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:36.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.867+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d40075030 con 0x55778c442620 2024-09-13T23:06:36.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.867+0000 7f7d52487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:36.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.867+0000 7f7d52487800 20 realm 2024-09-13T23:06:36.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.867+0000 7f7d52487800 20 rados->read ofs=0 len=0 2024-09-13T23:06:36.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.867+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55778c445640 con 0x55778c442620 2024-09-13T23:06:36.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.867+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d40075030 con 0x55778c442620 2024-09-13T23:06:36.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.867+0000 7f7d52487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:36.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.867+0000 7f7d52487800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:06:36.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.867+0000 7f7d52487800 20 rados->read ofs=0 len=0 2024-09-13T23:06:36.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.867+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55778c445f10 con 0x55778c442620 2024-09-13T23:06:36.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.868+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d40075030 con 0x55778c442620 2024-09-13T23:06:36.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.868+0000 7f7d52487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:36.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.868+0000 7f7d52487800 20 rados->read ofs=0 len=0 2024-09-13T23:06:36.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.868+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55778c4462b0 con 0x55778c442620 2024-09-13T23:06:36.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.868+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7d40075030 con 0x55778c442620 2024-09-13T23:06:36.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.868+0000 7f7d52487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:06:36.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.868+0000 7f7d52487800 20 rados->read ofs=0 len=0 2024-09-13T23:06:36.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.868+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55778c446b00 con 0x55778c442620 2024-09-13T23:06:36.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.868+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7d40075030 con 0x55778c442620 2024-09-13T23:06:36.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.868+0000 7f7d52487800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:06:36.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.868+0000 7f7d52487800 20 searching for the correct realm 2024-09-13T23:06:36.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.868+0000 7f7d52487800 1 --2- 172.21.15.164:0/1162102412 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55778c448870 0x55778c44ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:36.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.868+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55778c44b240 con 0x55778c448870 2024-09-13T23:06:36.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.868+0000 7f7d47fff640 1 --2- 172.21.15.164:0/1162102412 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55778c448870 0x55778c44ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:36.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.869+0000 7f7d47fff640 1 --2- 172.21.15.164:0/1162102412 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55778c448870 0x55778c44ac60 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:36.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.869+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d3805a040 con 0x55778c448870 2024-09-13T23:06:36.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.869+0000 7f7d47fff640 1 --2- 172.21.15.164:0/1162102412 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7d3801ac20 0x7f7d3801a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:36.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.869+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55778c44b240 con 0x7f7d3801ac20 2024-09-13T23:06:36.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.869+0000 7f7d5077c640 1 --2- 172.21.15.164:0/1162102412 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7d3801ac20 0x7f7d3801a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:36.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.869+0000 7f7d5077c640 1 --2- 172.21.15.164:0/1162102412 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7d3801ac20 0x7f7d3801a6a0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:36.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.870+0000 7f7d5077c640 1 -- 172.21.15.164:0/1162102412 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d4801f070 con 0x7f7d3801ac20 2024-09-13T23:06:36.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.870+0000 7f7d5077c640 1 --2- 172.21.15.164:0/1162102412 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7d48031040 0x7f7d48032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:36.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.870+0000 7f7d5077c640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55778c44b240 con 0x7f7d48031040 2024-09-13T23:06:36.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.870+0000 7f7d4ff7b640 1 --2- 172.21.15.164:0/1162102412 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7d48031040 0x7f7d48032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:36.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.870+0000 7f7d4ff7b640 1 --2- 172.21.15.164:0/1162102412 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7d48031040 0x7f7d48032940 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:36.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.871+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d40075030 con 0x7f7d48031040 2024-09-13T23:06:36.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.871+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55778c44b240 con 0x55778c442620 2024-09-13T23:06:36.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.871+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7d40075030 con 0x55778c442620 2024-09-13T23:06:36.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.871+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55778c44b240 con 0x55778c442620 2024-09-13T23:06:36.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.871+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d40075030 con 0x55778c442620 2024-09-13T23:06:36.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.871+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55778c44b240 con 0x7f7d48031040 2024-09-13T23:06:36.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.871+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d40075030 con 0x7f7d48031040 2024-09-13T23:06:36.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.871+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55778c44b240 con 0x7f7d48031040 2024-09-13T23:06:36.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.872+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d40075030 con 0x7f7d48031040 2024-09-13T23:06:36.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.872+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55778c44b240 con 0x7f7d3801ac20 2024-09-13T23:06:36.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.872+0000 7f7d5077c640 1 -- 172.21.15.164:0/1162102412 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d4801f070 con 0x7f7d3801ac20 2024-09-13T23:06:36.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.872+0000 7f7d5077c640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55778c44b240 con 0x55778c448870 2024-09-13T23:06:36.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.872+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d3805a040 con 0x55778c448870 2024-09-13T23:06:36.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.872+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55778c44b240 con 0x55778c442620 2024-09-13T23:06:36.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.872+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d40075030 con 0x55778c442620 2024-09-13T23:06:36.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.872+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55778c44b240 con 0x7f7d48031040 2024-09-13T23:06:36.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.873+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d40075030 con 0x7f7d48031040 2024-09-13T23:06:36.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.873+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55778c44b240 con 0x55778c442620 2024-09-13T23:06:36.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.873+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d40075030 con 0x55778c442620 2024-09-13T23:06:36.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.873+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55778c44b240 con 0x7f7d3801ac20 2024-09-13T23:06:36.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.873+0000 7f7d5077c640 1 -- 172.21.15.164:0/1162102412 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7d4801f070 con 0x7f7d3801ac20 2024-09-13T23:06:36.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.873+0000 7f7d5077c640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55778c44b240 con 0x55778c448870 2024-09-13T23:06:36.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.874+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d3805a040 con 0x55778c448870 2024-09-13T23:06:36.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.874+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55778c44b240 con 0x55778c448870 2024-09-13T23:06:36.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.874+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d3805a040 con 0x55778c448870 2024-09-13T23:06:36.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.874+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55778c44b240 con 0x7f7d48031040 2024-09-13T23:06:36.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.874+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d40075030 con 0x7f7d48031040 2024-09-13T23:06:36.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.874+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7d400a1040 con 0x55778c448870 2024-09-13T23:06:36.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.874+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d3805a040 con 0x55778c448870 2024-09-13T23:06:36.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.874+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7d400a1040 con 0x55778c448870 2024-09-13T23:06:36.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.875+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d3805a040 con 0x55778c448870 2024-09-13T23:06:36.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.875+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7d400a1040 con 0x55778c442620 2024-09-13T23:06:36.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.875+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d40075030 con 0x55778c442620 2024-09-13T23:06:36.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.875+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7d400a1040 con 0x55778c442620 2024-09-13T23:06:36.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.875+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7d40075030 con 0x55778c442620 2024-09-13T23:06:36.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.875+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7d400a1040 con 0x7f7d48031040 2024-09-13T23:06:36.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.875+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d40075030 con 0x7f7d48031040 2024-09-13T23:06:36.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.875+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7d400a1040 con 0x55778c448870 2024-09-13T23:06:36.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.876+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d3805a040 con 0x55778c448870 2024-09-13T23:06:36.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.876+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7d400a1040 con 0x7f7d3801ac20 2024-09-13T23:06:36.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.876+0000 7f7d5077c640 1 -- 172.21.15.164:0/1162102412 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d4801f070 con 0x7f7d3801ac20 2024-09-13T23:06:36.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.876+0000 7f7d5077c640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7d400a1040 con 0x55778c442620 2024-09-13T23:06:36.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.876+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7d40075030 con 0x55778c442620 2024-09-13T23:06:36.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.876+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7d400a1040 con 0x7f7d48031040 2024-09-13T23:06:36.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.876+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d40075030 con 0x7f7d48031040 2024-09-13T23:06:36.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.876+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7d400a1040 con 0x55778c448870 2024-09-13T23:06:36.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.877+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d3805a040 con 0x55778c448870 2024-09-13T23:06:36.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.877+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7d400a1040 con 0x7f7d48031040 2024-09-13T23:06:36.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.877+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d40075030 con 0x7f7d48031040 2024-09-13T23:06:36.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.877+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7d400a1040 con 0x7f7d3801ac20 2024-09-13T23:06:36.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.877+0000 7f7d5077c640 1 -- 172.21.15.164:0/1162102412 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d4801f070 con 0x7f7d3801ac20 2024-09-13T23:06:36.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.877+0000 7f7d5077c640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7d400a1040 con 0x55778c448870 2024-09-13T23:06:36.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.878+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d3805a040 con 0x55778c448870 2024-09-13T23:06:36.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.878+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7d400a1040 con 0x7f7d3801ac20 2024-09-13T23:06:36.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.878+0000 7f7d5077c640 1 -- 172.21.15.164:0/1162102412 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d4801f070 con 0x7f7d3801ac20 2024-09-13T23:06:36.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.878+0000 7f7d5077c640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7d400a1040 con 0x55778c442620 2024-09-13T23:06:36.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.878+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7d40075030 con 0x55778c442620 2024-09-13T23:06:36.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.878+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7d400a1040 con 0x7f7d3801ac20 2024-09-13T23:06:36.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.878+0000 7f7d5077c640 1 -- 172.21.15.164:0/1162102412 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d48040040 con 0x7f7d3801ac20 2024-09-13T23:06:36.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.878+0000 7f7d52487800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:06:36.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.878+0000 7f7d52487800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:06:36.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.878+0000 7f7d52487800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:06:36.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.878+0000 7f7d52487800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:06:36.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.878+0000 7f7d52487800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:06:36.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.878+0000 7f7d52487800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:06:36.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.878+0000 7f7d52487800 20 rados->read ofs=0 len=0 2024-09-13T23:06:36.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.878+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55778c4474b0 con 0x55778c442620 2024-09-13T23:06:36.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.878+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d40075030 con 0x55778c442620 2024-09-13T23:06:36.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.879+0000 7f7d52487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:36.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.879+0000 7f7d52487800 20 rados->read ofs=0 len=0 2024-09-13T23:06:36.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.879+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55778c447d50 con 0x55778c442620 2024-09-13T23:06:36.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.879+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7d40075030 con 0x55778c442620 2024-09-13T23:06:36.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.879+0000 7f7d52487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:06:36.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.879+0000 7f7d52487800 20 rados->read ofs=0 len=0 2024-09-13T23:06:36.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.879+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55778c447d50 con 0x55778c442620 2024-09-13T23:06:36.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.879+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7d40075030 con 0x55778c442620 2024-09-13T23:06:36.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.879+0000 7f7d52487800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:06:36.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.879+0000 7f7d52487800 20 zone default found 2024-09-13T23:06:36.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.879+0000 7f7d52487800 4 Realm: () 2024-09-13T23:06:36.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.879+0000 7f7d52487800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:06:36.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.879+0000 7f7d52487800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:06:36.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.879+0000 7f7d52487800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:06:36.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.879+0000 7f7d52487800 20 zonegroup default 2024-09-13T23:06:36.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.879+0000 7f7d52487800 20 rados->read ofs=0 len=0 2024-09-13T23:06:36.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.879+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55778c44b6c0 con 0x7f7d48031040 2024-09-13T23:06:36.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.879+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7d40075030 con 0x7f7d48031040 2024-09-13T23:06:36.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.879+0000 7f7d52487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:36.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.879+0000 7f7d52487800 20 rados->read ofs=0 len=0 2024-09-13T23:06:36.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.879+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55778c447b20 con 0x55778c448870 2024-09-13T23:06:36.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.880+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7d3805a040 con 0x55778c448870 2024-09-13T23:06:36.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.880+0000 7f7d52487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:36.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.880+0000 7f7d52487800 20 rados->read ofs=0 len=0 2024-09-13T23:06:36.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.880+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55778c44d630 con 0x55778c448870 2024-09-13T23:06:36.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.880+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7d3805a040 con 0x55778c448870 2024-09-13T23:06:36.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.880+0000 7f7d52487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:36.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.880+0000 7f7d52487800 20 started sync module instance, tier type = 2024-09-13T23:06:36.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.880+0000 7f7d52487800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:06:36.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.880+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55778c44c9e0 con 0x7f7d3801ac20 2024-09-13T23:06:36.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.881+0000 7f7d5077c640 1 -- 172.21.15.164:0/1162102412 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d48040040 con 0x7f7d3801ac20 2024-09-13T23:06:36.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.881+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93971942788560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55778c44df40 con 0x7f7d3801ac20 2024-09-13T23:06:36.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.881+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55778c44e790 con 0x55778c442620 2024-09-13T23:06:36.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.882+0000 7f7d5077c640 1 -- 172.21.15.164:0/1162102412 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93971942788560] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d48040040 con 0x7f7d3801ac20 2024-09-13T23:06:36.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.883+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d40075030 con 0x55778c442620 2024-09-13T23:06:36.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.883+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93971942791824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55778c44e420 con 0x55778c442620 2024-09-13T23:06:36.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.883+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55778c44ef40 con 0x55778c448870 2024-09-13T23:06:36.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.884+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d3805a040 con 0x55778c448870 2024-09-13T23:06:36.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.884+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93971942791824] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d40075030 con 0x55778c442620 2024-09-13T23:06:36.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.884+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93971942795792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55778c44f7e0 con 0x55778c448870 2024-09-13T23:06:36.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.884+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55778c44deb0 con 0x7f7d3801ac20 2024-09-13T23:06:36.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.885+0000 7f7d5077c640 1 -- 172.21.15.164:0/1162102412 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d48040040 con 0x7f7d3801ac20 2024-09-13T23:06:36.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.885+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93971942795792] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d3805a040 con 0x55778c448870 2024-09-13T23:06:36.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.885+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93971942800752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55778c450640 con 0x7f7d3801ac20 2024-09-13T23:06:36.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.886+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55778c44f350 con 0x55778c442620 2024-09-13T23:06:36.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.887+0000 7f7d5077c640 1 -- 172.21.15.164:0/1162102412 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93971942800752] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d48040040 con 0x7f7d3801ac20 2024-09-13T23:06:36.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.887+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d40075030 con 0x55778c442620 2024-09-13T23:06:36.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.887+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93971942801808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55778c4505b0 con 0x55778c442620 2024-09-13T23:06:36.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.887+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55778c451650 con 0x7f7d48031040 2024-09-13T23:06:36.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.888+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d40075030 con 0x7f7d48031040 2024-09-13T23:06:36.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.888+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93971942805920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55778c451a70 con 0x7f7d48031040 2024-09-13T23:06:36.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.888+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93971942801808] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d40075030 con 0x55778c442620 2024-09-13T23:06:36.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.888+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55778c452030 con 0x7f7d48031040 2024-09-13T23:06:36.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.889+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(56 notify.6 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d40075030 con 0x7f7d48031040 2024-09-13T23:06:36.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.889+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93971942804352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55778c4524e0 con 0x7f7d48031040 2024-09-13T23:06:36.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.889+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55778c452f40 con 0x7f7d48031040 2024-09-13T23:06:36.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.889+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93971942805920] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d40075030 con 0x7f7d48031040 2024-09-13T23:06:36.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.890+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(58 notify.7 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d40075030 con 0x7f7d48031040 2024-09-13T23:06:36.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.890+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93971942804352] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d40075030 con 0x7f7d48031040 2024-09-13T23:06:36.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.891+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93971942806976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55778c452a20 con 0x7f7d48031040 2024-09-13T23:06:36.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.891+0000 7f7d52487800 20 add_watcher() i=0 2024-09-13T23:06:36.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.891+0000 7f7d52487800 20 add_watcher() i=1 2024-09-13T23:06:36.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.891+0000 7f7d52487800 20 add_watcher() i=2 2024-09-13T23:06:36.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.891+0000 7f7d52487800 20 add_watcher() i=3 2024-09-13T23:06:36.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.891+0000 7f7d52487800 20 add_watcher() i=4 2024-09-13T23:06:36.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.891+0000 7f7d52487800 20 add_watcher() i=5 2024-09-13T23:06:36.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.891+0000 7f7d52487800 20 add_watcher() i=6 2024-09-13T23:06:36.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.891+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93971942806976] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d40075030 con 0x7f7d48031040 2024-09-13T23:06:36.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.892+0000 7f7d52487800 20 add_watcher() i=7 2024-09-13T23:06:36.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.892+0000 7f7d52487800 2 all 8 watchers are set, enabling cache 2024-09-13T23:06:36.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.892+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55778c455f70 con 0x55778c442620 2024-09-13T23:06:36.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.892+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7d40075030 con 0x55778c442620 2024-09-13T23:06:36.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.892+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93971942809648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55778c4533f0 con 0x55778c442620 2024-09-13T23:06:36.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.893+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93971942809648] v34'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7d40075030 con 0x55778c442620 2024-09-13T23:06:36.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.893+0000 7f7c05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:06:36.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.893+0000 7f7d52487800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:06:36.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.893+0000 7f7d52487800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:06:36.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.893+0000 7f7d52487800 5 note: GC not initialized 2024-09-13T23:06:36.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.893+0000 7f7c04fe1640 20 reqs_thread_entry: start 2024-09-13T23:06:36.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.894+0000 7f7d52487800 20 init_complete bucket index max shards: 11 2024-09-13T23:06:36.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.894+0000 7f7d52487800 20 Filter name: none 2024-09-13T23:06:36.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.894+0000 7f7b7e7fc640 20 reqs_thread_entry: start 2024-09-13T23:06:36.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.894+0000 7f7d52487800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T23:06:36.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.894+0000 7f7d52487800 20 rados->read ofs=0 len=0 2024-09-13T23:06:36.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.894+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55778c4892d0 con 0x7f7d48031040 2024-09-13T23:06:36.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.894+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f7d40075030 con 0x7f7d48031040 2024-09-13T23:06:36.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.894+0000 7f7d52487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:36.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.894+0000 7f7d52487800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T23:06:36.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.894+0000 7f7d52487800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:06:36.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.894+0000 7f7d52487800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T23:06:36.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.894+0000 7f7d52487800 20 rados->read ofs=0 len=0 2024-09-13T23:06:36.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.894+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55778c487910 con 0x7f7d48031040 2024-09-13T23:06:36.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.894+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f7d40075030 con 0x7f7d48031040 2024-09-13T23:06:36.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.894+0000 7f7d52487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:36.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.894+0000 7f7d52487800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T23:06:36.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.894+0000 7f7d52487800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:06:36.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.894+0000 7f7d52487800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T23:06:36.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.894+0000 7f7d52487800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T23:06:36.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.895+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55778c4881e0 con 0x7f7d48031040 2024-09-13T23:06:36.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.896+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v34'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f7d40075030 con 0x7f7d48031040 2024-09-13T23:06:36.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.896+0000 7f7d52487800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T23:06:36.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.896+0000 7f7d52487800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:06:36.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.896+0000 7f7d52487800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T23:06:36.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.896+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 93971943030064 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55778c488390 con 0x7f7d48031040 2024-09-13T23:06:36.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.896+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== watch-notify(notify (1) cookie 93971942805920 notify 146028888099 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55778c488d20 con 0x7f7d48031040 2024-09-13T23:06:36.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.896+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(65 notify.5 [notify cookie 93971943030064 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7d40075030 con 0x7f7d48031040 2024-09-13T23:06:36.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.896+0000 7f7c2effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888099 cookie 93971942805920 notifier 4749 bl.length()=556 2024-09-13T23:06:36.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.896+0000 7f7c2effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T23:06:36.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.896+0000 7f7c2effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:06:36.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.896+0000 7f7c2effd640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f7c14003ea0 con 0x7f7d48031040 2024-09-13T23:06:36.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.896+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d40075030 con 0x7f7d48031040 2024-09-13T23:06:36.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.896+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== watch-notify(notify_complete (2) cookie 93971943030064 notify 146028888099 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7d4009c040 con 0x7f7d48031040 2024-09-13T23:06:36.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.896+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55778c488250 con 0x7f7d48031040 2024-09-13T23:06:36.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.898+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v34'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f7d40075030 con 0x7f7d48031040 2024-09-13T23:06:36.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.898+0000 7f7d52487800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T23:06:36.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.898+0000 7f7d52487800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:06:36.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.898+0000 7f7d52487800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T23:06:36.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.898+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93971943029904 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55778c48c9e0 con 0x55778c448870 2024-09-13T23:06:36.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.898+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== watch-notify(notify (1) cookie 93971942795792 notify 146028888070 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f7d38047040 con 0x55778c448870 2024-09-13T23:06:36.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.898+0000 7f7c2effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888070 cookie 93971942795792 notifier 4749 bl.length()=177 2024-09-13T23:06:36.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.898+0000 7f7c2effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T23:06:36.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.898+0000 7f7c2effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:06:36.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.898+0000 7f7c2effd640 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f7c14003ea0 con 0x55778c448870 2024-09-13T23:06:36.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.898+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(68 notify.2 [notify cookie 93971943029904 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7d3805a040 con 0x55778c448870 2024-09-13T23:06:36.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.898+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== watch-notify(notify_complete (2) cookie 93971943029904 notify 146028888070 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55778c426730 con 0x55778c448870 2024-09-13T23:06:36.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.898+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d3805a040 con 0x55778c448870 2024-09-13T23:06:36.914 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T23:06:36.896497Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:06:36.896482Z","tags":[],"group_ids":[]} 2024-09-13T23:06:36.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.899+0000 7f7c05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:06:36.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.899+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93971942809648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55778c486f90 con 0x55778c442620 2024-09-13T23:06:36.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.900+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93971942809648] v34'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7d40075030 con 0x55778c442620 2024-09-13T23:06:36.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.900+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93971942788560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55778c486f90 con 0x7f7d3801ac20 2024-09-13T23:06:36.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.901+0000 7f7d5077c640 1 -- 172.21.15.164:0/1162102412 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93971942788560] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d48040040 con 0x7f7d3801ac20 2024-09-13T23:06:36.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.901+0000 7f7d52487800 20 remove_watcher() i=0 2024-09-13T23:06:36.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.901+0000 7f7d52487800 2 removed watcher, disabling cache 2024-09-13T23:06:36.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.901+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93971942791824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55778c486f90 con 0x55778c442620 2024-09-13T23:06:36.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.902+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93971942791824] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d40075030 con 0x55778c442620 2024-09-13T23:06:36.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.902+0000 7f7d52487800 20 remove_watcher() i=1 2024-09-13T23:06:36.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.902+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93971942795792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55778c486f90 con 0x55778c448870 2024-09-13T23:06:36.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.903+0000 7f7d47fff640 1 -- 172.21.15.164:0/1162102412 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93971942795792] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d3805a040 con 0x55778c448870 2024-09-13T23:06:36.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.904+0000 7f7d52487800 20 remove_watcher() i=2 2024-09-13T23:06:36.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.904+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93971942800752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55778c486f90 con 0x7f7d3801ac20 2024-09-13T23:06:36.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.904+0000 7f7d5077c640 1 -- 172.21.15.164:0/1162102412 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93971942800752] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d48040040 con 0x7f7d3801ac20 2024-09-13T23:06:36.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.904+0000 7f7d52487800 20 remove_watcher() i=3 2024-09-13T23:06:36.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.904+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93971942801808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55778c486f90 con 0x55778c442620 2024-09-13T23:06:36.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.905+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93971942801808] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d40075030 con 0x55778c442620 2024-09-13T23:06:36.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.906+0000 7f7d52487800 20 remove_watcher() i=4 2024-09-13T23:06:36.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.906+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93971942805920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55778c486f90 con 0x7f7d48031040 2024-09-13T23:06:36.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.907+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93971942805920] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d40075030 con 0x7f7d48031040 2024-09-13T23:06:36.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.907+0000 7f7d52487800 20 remove_watcher() i=5 2024-09-13T23:06:36.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.907+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93971942804352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55778c486f90 con 0x7f7d48031040 2024-09-13T23:06:36.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.908+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93971942804352] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d40075030 con 0x7f7d48031040 2024-09-13T23:06:36.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.908+0000 7f7d52487800 20 remove_watcher() i=6 2024-09-13T23:06:36.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.908+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93971942806976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55778c486f90 con 0x7f7d48031040 2024-09-13T23:06:36.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.909+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93971942806976] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d40075030 con 0x7f7d48031040 2024-09-13T23:06:36.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.909+0000 7f7d52487800 20 remove_watcher() i=7 2024-09-13T23:06:36.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.910+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7d48031040 msgr2=0x7f7d48032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:36.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.910+0000 7f7d52487800 1 --2- 172.21.15.164:0/1162102412 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7d48031040 0x7f7d48032940 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:36.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.910+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55778c442620 msgr2=0x55778c444ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:36.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.910+0000 7f7d52487800 1 --2- 172.21.15.164:0/1162102412 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55778c442620 0x55778c444ae0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:36.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.910+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7d3801ac20 msgr2=0x7f7d3801a6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:36.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.910+0000 7f7d52487800 1 --2- 172.21.15.164:0/1162102412 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7d3801ac20 0x7f7d3801a6a0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:36.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.910+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55778c448870 msgr2=0x55778c44ac60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:36.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.910+0000 7f7d52487800 1 --2- 172.21.15.164:0/1162102412 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55778c448870 0x55778c44ac60 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:36.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.910+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c18036b40 msgr2=0x7f7c18039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:36.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.910+0000 7f7d52487800 1 --2- 172.21.15.164:0/1162102412 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c18036b40 0x7f7c18039000 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55778c40c280 tx=0x7f7d4801f000 comp rx=0 tx=0).stop 2024-09-13T23:06:36.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.910+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c42fb20 msgr2=0x55778c436e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:36.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.910+0000 7f7d4ff7b640 1 -- 172.21.15.164:0/1162102412 reap_dead start 2024-09-13T23:06:36.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.910+0000 7f7d52487800 1 --2- 172.21.15.164:0/1162102412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c42fb20 0x55778c436e70 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f7d3804b320 tx=0x7f7d3804c340 comp rx=0 tx=0).stop 2024-09-13T23:06:36.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.910+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 shutdown_connections 2024-09-13T23:06:36.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.910+0000 7f7d52487800 1 --2- 172.21.15.164:0/1162102412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c42fb20 0x55778c436e70 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:36.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.910+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 >> 172.21.15.164:0/1162102412 conn(0x55778c42be80 msgr2=0x55778c429f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:36.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.910+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 shutdown_connections 2024-09-13T23:06:36.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.910+0000 7f7d52487800 1 -- 172.21.15.164:0/1162102412 wait complete. 2024-09-13T23:06:36.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.910+0000 7f7d52487800 1 -- 172.21.15.164:0/1396979948 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c28036b90 msgr2=0x7f7c28039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:36.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.910+0000 7f7d52487800 1 --2- 172.21.15.164:0/1396979948 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c28036b90 0x7f7c28039050 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55778c4134d0 tx=0x7f7d48005840 comp rx=0 tx=0).stop 2024-09-13T23:06:36.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.910+0000 7f7d52487800 1 -- 172.21.15.164:0/1396979948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c422e60 msgr2=0x55778c423280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:36.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.910+0000 7f7d52487800 1 --2- 172.21.15.164:0/1396979948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c422e60 0x55778c423280 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f7d38001ed0 tx=0x7f7d3800ea00 comp rx=0 tx=0).stop 2024-09-13T23:06:36.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.910+0000 7f7d52487800 1 -- 172.21.15.164:0/1396979948 shutdown_connections 2024-09-13T23:06:36.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.910+0000 7f7d52487800 1 --2- 172.21.15.164:0/1396979948 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c28036b90 0x7f7c28039050 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:36.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.910+0000 7f7d52487800 1 --2- 172.21.15.164:0/1396979948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c422e60 0x55778c423280 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:36.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.910+0000 7f7d52487800 1 -- 172.21.15.164:0/1396979948 >> 172.21.15.164:0/1396979948 conn(0x55778c417df0 msgr2=0x55778c41a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:36.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.910+0000 7f7d52487800 1 -- 172.21.15.164:0/1396979948 shutdown_connections 2024-09-13T23:06:36.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.910+0000 7f7d52487800 1 -- 172.21.15.164:0/1396979948 wait complete. 2024-09-13T23:06:36.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.911+0000 7f7d52487800 1 -- 172.21.15.164:0/155008034 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55778c311ed0 msgr2=0x55778c4124d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:36.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.911+0000 7f7d52487800 1 --2- 172.21.15.164:0/155008034 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55778c311ed0 0x55778c4124d0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:36.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.911+0000 7f7d52487800 1 -- 172.21.15.164:0/155008034 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c38036b40 msgr2=0x7f7c38039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:36.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.911+0000 7f7d52487800 1 --2- 172.21.15.164:0/155008034 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c38036b40 0x7f7c38039000 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7d38000f60 tx=0x7f7d38001370 comp rx=0 tx=0).stop 2024-09-13T23:06:36.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.911+0000 7f7d52487800 1 -- 172.21.15.164:0/155008034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c311590 msgr2=0x55778c40b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:36.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.911+0000 7f7d52487800 1 --2- 172.21.15.164:0/155008034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c311590 0x55778c40b460 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f7d40067040 tx=0x7f7d40002fb0 comp rx=0 tx=0).stop 2024-09-13T23:06:36.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.911+0000 7f7d52487800 1 -- 172.21.15.164:0/155008034 shutdown_connections 2024-09-13T23:06:36.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.911+0000 7f7d52487800 1 --2- 172.21.15.164:0/155008034 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55778c311ed0 0x55778c4124d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:36.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.911+0000 7f7d52487800 1 --2- 172.21.15.164:0/155008034 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7c38036b40 0x7f7c38039000 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:36.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.911+0000 7f7d52487800 1 --2- 172.21.15.164:0/155008034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55778c311590 0x55778c40b460 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:36.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.911+0000 7f7d52487800 1 -- 172.21.15.164:0/155008034 >> 172.21.15.164:0/155008034 conn(0x55778c30ce20 msgr2=0x55778c3faad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:36.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.911+0000 7f7d52487800 1 -- 172.21.15.164:0/155008034 shutdown_connections 2024-09-13T23:06:36.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.911+0000 7f7d52487800 1 -- 172.21.15.164:0/155008034 wait complete. 2024-09-13T23:06:36.926 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T23:06:36.896497Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:06:36.896482Z', 'tags': [], 'group_ids': []} 2024-09-13T23:06:36.948 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:06:36.953 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-13T23:06:36.953 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-13T23:06:36.954 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-13T23:06:36.954 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-13T23:06:37.000 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:06:37.000 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:06:37.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.999+0000 7f5d0eb37800 1 Processor -- start 2024-09-13T23:06:37.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.999+0000 7f5d0eb37800 1 -- start start 2024-09-13T23:06:37.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.999+0000 7f5d0eb37800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x563d353d7710 0x563d353d7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.999+0000 7f5d0eb37800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563d35296b30 con 0x563d353d8050 2024-09-13T23:06:37.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:36.999+0000 7f5d0eb37800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x563d35278360 con 0x563d353d7710 2024-09-13T23:06:37.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.000+0000 7f5d0a82b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x563d353d7710 0x563d353d7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.000+0000 7f5d0a82b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x563d353d7710 0x563d353d7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44974/0 (socket says 172.21.15.164:44974) 2024-09-13T23:06:37.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.000+0000 7f5d0a82b640 1 -- 172.21.15.164:0/3399822627 learned_addr learned my addr 172.21.15.164:0/3399822627 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:37.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.000+0000 7f5d03fff640 1 --1- 172.21.15.164:0/3399822627 >> v1:172.21.15.17:6789/0 conn(0x563d353d8050 0x563d353dca90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:55992/0 (socket says 172.21.15.164:55992) 2024-09-13T23:06:37.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.000+0000 7f5d0a82b640 1 -- 172.21.15.164:0/3399822627 >> v1:172.21.15.17:6789/0 conn(0x563d353d8050 legacy=0x563d353dca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.000+0000 7f5d0a82b640 1 -- 172.21.15.164:0/3399822627 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d3529ee00 con 0x563d353d7710 2024-09-13T23:06:37.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.002+0000 7f5d0a82b640 1 --2- 172.21.15.164:0/3399822627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d353d7710 0x563d353d7b10 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc00a520 tx=0x7f5cfc045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63dad0c5d64854d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.002+0000 7f5d0a02a640 1 -- 172.21.15.164:0/3399822627 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cfc055070 con 0x563d353d7710 2024-09-13T23:06:37.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.002+0000 7f5d0a02a640 1 -- 172.21.15.164:0/3399822627 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cfc0515b0 con 0x563d353d7710 2024-09-13T23:06:37.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.002+0000 7f5d0a02a640 1 -- 172.21.15.164:0/3399822627 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cfc0518d0 con 0x563d353d7710 2024-09-13T23:06:37.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.002+0000 7f5d0eb37800 1 -- 172.21.15.164:0/3399822627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d353d7710 msgr2=0x563d353d7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.002+0000 7f5d0eb37800 1 --2- 172.21.15.164:0/3399822627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d353d7710 0x563d353d7b10 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc00a520 tx=0x7f5cfc045ba0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.002+0000 7f5d0eb37800 1 -- 172.21.15.164:0/3399822627 shutdown_connections 2024-09-13T23:06:37.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.002+0000 7f5d0eb37800 1 --2- 172.21.15.164:0/3399822627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d353d7710 0x563d353d7b10 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.002+0000 7f5d0eb37800 1 -- 172.21.15.164:0/3399822627 >> 172.21.15.164:0/3399822627 conn(0x563d353d2fe0 msgr2=0x563d353d5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:37.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.002+0000 7f5d0eb37800 1 -- 172.21.15.164:0/3399822627 shutdown_connections 2024-09-13T23:06:37.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.002+0000 7f5d0eb37800 1 -- 172.21.15.164:0/3399822627 wait complete. 2024-09-13T23:06:37.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.017+0000 7f5d0eb37800 1 Processor -- start 2024-09-13T23:06:37.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.017+0000 7f5d0eb37800 1 -- start start 2024-09-13T23:06:37.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.017+0000 7f5d0eb37800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d353d7710 0x563d354c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.017+0000 7f5d0eb37800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563d35323360 con 0x563d353d7710 2024-09-13T23:06:37.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.017+0000 7f5d0a82b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d353d7710 0x563d354c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.017+0000 7f5d0a82b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d353d7710 0x563d354c68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44986/0 (socket says 172.21.15.164:44986) 2024-09-13T23:06:37.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.017+0000 7f5d0a82b640 1 -- 172.21.15.164:0/314003858 learned_addr learned my addr 172.21.15.164:0/314003858 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:37.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.017+0000 7f5d0a82b640 1 -- 172.21.15.164:0/314003858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d35270bc0 con 0x563d353d7710 2024-09-13T23:06:37.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.018+0000 7f5d0a82b640 1 --2- 172.21.15.164:0/314003858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d353d7710 0x563d354c68a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc025da0 tx=0x7f5cfc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5dcadb27ecbcbd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.018+0000 7f5bf8e09640 1 -- 172.21.15.164:0/314003858 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cfc051890 con 0x563d353d7710 2024-09-13T23:06:37.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.018+0000 7f5bf8e09640 1 -- 172.21.15.164:0/314003858 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cfc051ac0 con 0x563d353d7710 2024-09-13T23:06:37.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.018+0000 7f5bf8e09640 1 -- 172.21.15.164:0/314003858 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cfc051da0 con 0x563d353d7710 2024-09-13T23:06:37.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.018+0000 7f5d0eb37800 1 -- 172.21.15.164:0/314003858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d353d7710 msgr2=0x563d354c68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.018+0000 7f5d0eb37800 1 --2- 172.21.15.164:0/314003858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d353d7710 0x563d354c68a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc025da0 tx=0x7f5cfc051000 comp rx=0 tx=0).stop 2024-09-13T23:06:37.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.019+0000 7f5d0eb37800 1 -- 172.21.15.164:0/314003858 shutdown_connections 2024-09-13T23:06:37.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.019+0000 7f5d0eb37800 1 --2- 172.21.15.164:0/314003858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d353d7710 0x563d354c68a0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.019+0000 7f5d0eb37800 1 -- 172.21.15.164:0/314003858 >> 172.21.15.164:0/314003858 conn(0x563d353d2fe0 msgr2=0x563d354c2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:37.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.019+0000 7f5d0eb37800 1 -- 172.21.15.164:0/314003858 shutdown_connections 2024-09-13T23:06:37.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.019+0000 7f5d0eb37800 1 -- 172.21.15.164:0/314003858 wait complete. 2024-09-13T23:06:37.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.019+0000 7f5d0eb37800 1 Processor -- start 2024-09-13T23:06:37.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.019+0000 7f5d0eb37800 1 -- start start 2024-09-13T23:06:37.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.019+0000 7f5d0eb37800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d353d7710 0x563d3534d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.019+0000 7f5d0eb37800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563d353de5f0 con 0x563d353d7710 2024-09-13T23:06:37.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.019+0000 7f5d0a82b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d353d7710 0x563d3534d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.019+0000 7f5d0a82b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d353d7710 0x563d3534d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44990/0 (socket says 172.21.15.164:44990) 2024-09-13T23:06:37.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.019+0000 7f5d0a82b640 1 -- 172.21.15.164:0/1682258855 learned_addr learned my addr 172.21.15.164:0/1682258855 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:37.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.020+0000 7f5d0a82b640 1 -- 172.21.15.164:0/1682258855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d35284fe0 con 0x563d353d7710 2024-09-13T23:06:37.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.020+0000 7f5d0a82b640 1 --2- 172.21.15.164:0/1682258855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d353d7710 0x563d3534d6e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc025da0 tx=0x7f5cfc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.020+0000 7f5bf7606640 1 -- 172.21.15.164:0/1682258855 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cfc073070 con 0x563d353d7710 2024-09-13T23:06:37.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.020+0000 7f5bf7606640 1 -- 172.21.15.164:0/1682258855 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cfc05a580 con 0x563d353d7710 2024-09-13T23:06:37.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.020+0000 7f5d0eb37800 1 -- 172.21.15.164:0/1682258855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d3534bdd0 con 0x563d353d7710 2024-09-13T23:06:37.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.020+0000 7f5bf7606640 1 -- 172.21.15.164:0/1682258855 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cfc05a860 con 0x563d353d7710 2024-09-13T23:06:37.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.020+0000 7f5d0eb37800 1 -- 172.21.15.164:0/1682258855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d3534c350 con 0x563d353d7710 2024-09-13T23:06:37.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.021+0000 7f5bf7606640 1 -- 172.21.15.164:0/1682258855 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5cfc076070 con 0x563d353d7710 2024-09-13T23:06:37.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.021+0000 7f5bf7606640 1 --2- 172.21.15.164:0/1682258855 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5bf0036b90 0x7f5bf0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.021+0000 7f5bf7606640 1 -- 172.21.15.164:0/1682258855 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f5cfc062070 con 0x563d353d7710 2024-09-13T23:06:37.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.021+0000 7f5d03fff640 1 --2- 172.21.15.164:0/1682258855 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5bf0036b90 0x7f5bf0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.021+0000 7f5d0eb37800 1 --2- 172.21.15.164:0/1682258855 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563d353d8050 0x563d354d75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.021+0000 7f5d0eb37800 1 -- 172.21.15.164:0/1682258855 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563d354d7ae0 con 0x563d353d8050 2024-09-13T23:06:37.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.021+0000 7f5d0b02c640 1 --2- 172.21.15.164:0/1682258855 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563d353d8050 0x563d354d75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.022+0000 7f5d03fff640 1 --2- 172.21.15.164:0/1682258855 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5bf0036b90 0x7f5bf0039050 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4000f60 tx=0x7f5cf4001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.022+0000 7f5d0b02c640 1 --2- 172.21.15.164:0/1682258855 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563d353d8050 0x563d354d75a0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.022+0000 7f5d0b02c640 1 -- 172.21.15.164:0/1682258855 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d0400a4a0 con 0x563d353d8050 2024-09-13T23:06:37.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.022+0000 7f5d0eb37800 1 -- 172.21.15.164:0/1682258855 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563d354d8360 con 0x563d353d8050 2024-09-13T23:06:37.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.022+0000 7f5d0b02c640 1 -- 172.21.15.164:0/1682258855 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d0400a4a0 con 0x563d353d8050 2024-09-13T23:06:37.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.022+0000 7f5d0eb37800 1 -- 172.21.15.164:0/1682258855 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563d354d9710 con 0x563d353d8050 2024-09-13T23:06:37.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.023+0000 7f5d0b02c640 1 -- 172.21.15.164:0/1682258855 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5d0400a4a0 con 0x563d353d8050 2024-09-13T23:06:37.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.023+0000 7f5d0eb37800 1 -- 172.21.15.164:0/1682258855 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563d354d8bb0 con 0x563d353d8050 2024-09-13T23:06:37.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.023+0000 7f5d0b02c640 1 -- 172.21.15.164:0/1682258855 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d0400a4a0 con 0x563d353d8050 2024-09-13T23:06:37.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.023+0000 7f5d0eb37800 1 -- 172.21.15.164:0/1682258855 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563d354d8fd0 con 0x563d353d8050 2024-09-13T23:06:37.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.023+0000 7f5d0b02c640 1 -- 172.21.15.164:0/1682258855 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5d0400a4a0 con 0x563d353d8050 2024-09-13T23:06:37.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.023+0000 7f5d0eb37800 1 Processor -- start 2024-09-13T23:06:37.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.024+0000 7f5d0eb37800 1 -- start start 2024-09-13T23:06:37.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.024+0000 7f5d0eb37800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d354e7fc0 0x563d354e83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.024+0000 7f5d0eb37800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563d3534dc20 con 0x563d354e7fc0 2024-09-13T23:06:37.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.024+0000 7f5d03fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d354e7fc0 0x563d354e83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.024+0000 7f5d03fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d354e7fc0 0x563d354e83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:45006/0 (socket says 172.21.15.164:45006) 2024-09-13T23:06:37.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.024+0000 7f5d03fff640 1 -- 172.21.15.164:0/3894768370 learned_addr learned my addr 172.21.15.164:0/3894768370 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:37.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.025+0000 7f5d03fff640 1 -- 172.21.15.164:0/3894768370 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d354e8920 con 0x563d354e7fc0 2024-09-13T23:06:37.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.025+0000 7f5d03fff640 1 --2- 172.21.15.164:0/3894768370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d354e7fc0 0x563d354e83e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4001ed0 tx=0x7f5cf400ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.025+0000 7f5bf4e01640 1 -- 172.21.15.164:0/3894768370 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf4022070 con 0x563d354e7fc0 2024-09-13T23:06:37.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.025+0000 7f5bf4e01640 1 -- 172.21.15.164:0/3894768370 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf400d520 con 0x563d354e7fc0 2024-09-13T23:06:37.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.025+0000 7f5d0eb37800 1 -- 172.21.15.164:0/3894768370 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d354e8bb0 con 0x563d354e7fc0 2024-09-13T23:06:37.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.025+0000 7f5bf4e01640 1 -- 172.21.15.164:0/3894768370 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf400d800 con 0x563d354e7fc0 2024-09-13T23:06:37.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.025+0000 7f5d0eb37800 1 -- 172.21.15.164:0/3894768370 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d354eb890 con 0x563d354e7fc0 2024-09-13T23:06:37.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.026+0000 7f5bf4e01640 1 -- 172.21.15.164:0/3894768370 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5cf4025070 con 0x563d354e7fc0 2024-09-13T23:06:37.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.026+0000 7f5bf4e01640 1 --2- 172.21.15.164:0/3894768370 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5be4036b90 0x7f5be4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.026+0000 7f5bf4e01640 1 -- 172.21.15.164:0/3894768370 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f5cf404e120 con 0x563d354e7fc0 2024-09-13T23:06:37.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.026+0000 7f5d0b02c640 1 --2- 172.21.15.164:0/3894768370 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5be4036b90 0x7f5be4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.026+0000 7f5d0eb37800 1 Processor -- start 2024-09-13T23:06:37.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.026+0000 7f5d0b02c640 1 --2- 172.21.15.164:0/3894768370 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5be4036b90 0x7f5be4039050 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x563d354d8f50 tx=0x7f5d04005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.026+0000 7f5d0eb37800 1 -- start start 2024-09-13T23:06:37.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.027+0000 7f5d0eb37800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d354f4c80 0x563d354f5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.027+0000 7f5d0eb37800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563d35272580 con 0x563d354f4c80 2024-09-13T23:06:37.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.027+0000 7f5d03fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d354f4c80 0x563d354f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.027+0000 7f5d03fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d354f4c80 0x563d354f5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:45020/0 (socket says 172.21.15.164:45020) 2024-09-13T23:06:37.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.027+0000 7f5d03fff640 1 -- 172.21.15.164:0/2396219533 learned_addr learned my addr 172.21.15.164:0/2396219533 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:37.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.027+0000 7f5d03fff640 1 -- 172.21.15.164:0/2396219533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d354f5650 con 0x563d354f4c80 2024-09-13T23:06:37.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.027+0000 7f5d03fff640 1 --2- 172.21.15.164:0/2396219533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d354f4c80 0x563d354f5080 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400eee0 tx=0x7f5cf4024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249d00a4ecb705e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.028+0000 7f5bee7fc640 1 -- 172.21.15.164:0/2396219533 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf4026730 con 0x563d354f4c80 2024-09-13T23:06:37.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.028+0000 7f5bee7fc640 1 -- 172.21.15.164:0/2396219533 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf4025c50 con 0x563d354f4c80 2024-09-13T23:06:37.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.028+0000 7f5bee7fc640 1 -- 172.21.15.164:0/2396219533 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf40268d0 con 0x563d354f4c80 2024-09-13T23:06:37.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.028+0000 7f5d0eb37800 1 -- 172.21.15.164:0/2396219533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d354f4c80 msgr2=0x563d354f5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.028+0000 7f5d0eb37800 1 --2- 172.21.15.164:0/2396219533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d354f4c80 0x563d354f5080 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400eee0 tx=0x7f5cf4024740 comp rx=0 tx=0).stop 2024-09-13T23:06:37.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.028+0000 7f5d0eb37800 1 -- 172.21.15.164:0/2396219533 shutdown_connections 2024-09-13T23:06:37.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.028+0000 7f5d0eb37800 1 --2- 172.21.15.164:0/2396219533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d354f4c80 0x563d354f5080 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.028+0000 7f5d0eb37800 1 -- 172.21.15.164:0/2396219533 >> 172.21.15.164:0/2396219533 conn(0x563d354f0fe0 msgr2=0x563d354ef0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:37.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.028+0000 7f5d0eb37800 1 -- 172.21.15.164:0/2396219533 shutdown_connections 2024-09-13T23:06:37.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.028+0000 7f5d0eb37800 1 -- 172.21.15.164:0/2396219533 wait complete. 2024-09-13T23:06:37.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.028+0000 7f5d0eb37800 1 Processor -- start 2024-09-13T23:06:37.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.028+0000 7f5d0eb37800 1 -- start start 2024-09-13T23:06:37.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.029+0000 7f5d0eb37800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d354f4c80 0x563d354fbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.029+0000 7f5d0eb37800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563d354f5a50 con 0x563d354f4c80 2024-09-13T23:06:37.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.029+0000 7f5d03fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d354f4c80 0x563d354fbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.029+0000 7f5d03fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d354f4c80 0x563d354fbe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:45032/0 (socket says 172.21.15.164:45032) 2024-09-13T23:06:37.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.029+0000 7f5d03fff640 1 -- 172.21.15.164:0/33674885 learned_addr learned my addr 172.21.15.164:0/33674885 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:37.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.029+0000 7f5d03fff640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d354fc380 con 0x563d354f4c80 2024-09-13T23:06:37.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.029+0000 7f5d03fff640 1 --2- 172.21.15.164:0/33674885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d354f4c80 0x563d354fbe40 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f5cf404b320 tx=0x7f5cf404c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.030+0000 7f5becff9640 1 -- 172.21.15.164:0/33674885 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf4025e00 con 0x563d354f4c80 2024-09-13T23:06:37.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.030+0000 7f5becff9640 1 -- 172.21.15.164:0/33674885 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf400dbb0 con 0x563d354f4c80 2024-09-13T23:06:37.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.030+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d354fc380 con 0x563d354f4c80 2024-09-13T23:06:37.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.030+0000 7f5becff9640 1 -- 172.21.15.164:0/33674885 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf404c780 con 0x563d354f4c80 2024-09-13T23:06:37.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.030+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d354fc380 con 0x563d354f4c80 2024-09-13T23:06:37.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.030+0000 7f5becff9640 1 -- 172.21.15.164:0/33674885 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5cf404c920 con 0x563d354f4c80 2024-09-13T23:06:37.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.031+0000 7f5becff9640 1 --2- 172.21.15.164:0/33674885 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5bd4036b40 0x7f5bd4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.031+0000 7f5becff9640 1 -- 172.21.15.164:0/33674885 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f5cf401dd40 con 0x563d354f4c80 2024-09-13T23:06:37.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.031+0000 7f5d0b02c640 1 --2- 172.21.15.164:0/33674885 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5bd4036b40 0x7f5bd4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.031+0000 7f5d0b02c640 1 --2- 172.21.15.164:0/33674885 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5bd4036b40 0x7f5bd4039000 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x563d354d8210 tx=0x7f5d0401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.031+0000 7f5d0eb37800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.031+0000 7f5d0eb37800 1 --2- 172.21.15.164:0/33674885 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563d355075e0 0x563d35509aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.031+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563d3550a1f0 con 0x563d355075e0 2024-09-13T23:06:37.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.032+0000 7f5d0a82b640 1 --2- 172.21.15.164:0/33674885 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563d355075e0 0x563d35509aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.032+0000 7f5d0a82b640 1 --2- 172.21.15.164:0/33674885 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563d355075e0 0x563d35509aa0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.032+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cfc07f070 con 0x563d355075e0 2024-09-13T23:06:37.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.032+0000 7f5d0eb37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:37.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.032+0000 7f5d0eb37800 20 realm 2024-09-13T23:06:37.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.032+0000 7f5d0eb37800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.032+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563d3550a600 con 0x563d355075e0 2024-09-13T23:06:37.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.032+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cfc07f070 con 0x563d355075e0 2024-09-13T23:06:37.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.032+0000 7f5d0eb37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:37.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.032+0000 7f5d0eb37800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:06:37.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.032+0000 7f5d0eb37800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.032+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563d3550aed0 con 0x563d355075e0 2024-09-13T23:06:37.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.033+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cfc07f070 con 0x563d355075e0 2024-09-13T23:06:37.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.033+0000 7f5d0eb37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:37.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.033+0000 7f5d0eb37800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.033+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563d3550b270 con 0x563d355075e0 2024-09-13T23:06:37.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.033+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5cfc07f070 con 0x563d355075e0 2024-09-13T23:06:37.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.033+0000 7f5d0eb37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:06:37.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.033+0000 7f5d0eb37800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.033+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563d3550bac0 con 0x563d355075e0 2024-09-13T23:06:37.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.033+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5cfc07f070 con 0x563d355075e0 2024-09-13T23:06:37.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.033+0000 7f5d0eb37800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:06:37.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.033+0000 7f5d0eb37800 20 searching for the correct realm 2024-09-13T23:06:37.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.033+0000 7f5d0eb37800 1 --2- 172.21.15.164:0/33674885 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563d3550d830 0x563d3550fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.033+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x563d3550d830 2024-09-13T23:06:37.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.033+0000 7f5d03fff640 1 --2- 172.21.15.164:0/33674885 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563d3550d830 0x563d3550fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.033+0000 7f5d03fff640 1 --2- 172.21.15.164:0/33674885 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563d3550d830 0x563d3550fc20 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.034+0000 7f5d03fff640 1 -- 172.21.15.164:0/33674885 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf4024030 con 0x563d3550d830 2024-09-13T23:06:37.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.034+0000 7f5d03fff640 1 --2- 172.21.15.164:0/33674885 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f5cf401ac20 0x7f5cf40278c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.034+0000 7f5d03fff640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x7f5cf401ac20 2024-09-13T23:06:37.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.034+0000 7f5d0b02c640 1 --2- 172.21.15.164:0/33674885 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f5cf401ac20 0x7f5cf40278c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.034+0000 7f5d0b02c640 1 --2- 172.21.15.164:0/33674885 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f5cf401ac20 0x7f5cf40278c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.034+0000 7f5d0b02c640 1 -- 172.21.15.164:0/33674885 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d0401f070 con 0x7f5cf401ac20 2024-09-13T23:06:37.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.034+0000 7f5d0b02c640 1 --2- 172.21.15.164:0/33674885 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f5d04031040 0x7f5d04032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.034+0000 7f5d0b02c640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x7f5d04031040 2024-09-13T23:06:37.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.035+0000 7f5d0a82b640 1 --2- 172.21.15.164:0/33674885 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f5d04031040 0x7f5d04032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.035+0000 7f5d0a82b640 1 --2- 172.21.15.164:0/33674885 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f5d04031040 0x7f5d04032940 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.035+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc07f070 con 0x7f5d04031040 2024-09-13T23:06:37.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.035+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x563d355075e0 2024-09-13T23:06:37.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.036+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5cfc07f070 con 0x563d355075e0 2024-09-13T23:06:37.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.036+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x563d355075e0 2024-09-13T23:06:37.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.036+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc07f070 con 0x563d355075e0 2024-09-13T23:06:37.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.036+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x7f5d04031040 2024-09-13T23:06:37.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.036+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc07f070 con 0x7f5d04031040 2024-09-13T23:06:37.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.036+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x7f5d04031040 2024-09-13T23:06:37.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.037+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc07f070 con 0x7f5d04031040 2024-09-13T23:06:37.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.037+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x7f5cf401ac20 2024-09-13T23:06:37.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.037+0000 7f5d0b02c640 1 -- 172.21.15.164:0/33674885 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d0401f070 con 0x7f5cf401ac20 2024-09-13T23:06:37.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.037+0000 7f5d0b02c640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x563d3550d830 2024-09-13T23:06:37.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.037+0000 7f5d03fff640 1 -- 172.21.15.164:0/33674885 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf4024030 con 0x563d3550d830 2024-09-13T23:06:37.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.037+0000 7f5d03fff640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x563d355075e0 2024-09-13T23:06:37.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.037+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc07f070 con 0x563d355075e0 2024-09-13T23:06:37.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.037+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x7f5d04031040 2024-09-13T23:06:37.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.038+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc07f070 con 0x7f5d04031040 2024-09-13T23:06:37.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.038+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x563d355075e0 2024-09-13T23:06:37.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.038+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc07f070 con 0x563d355075e0 2024-09-13T23:06:37.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.038+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x7f5cf401ac20 2024-09-13T23:06:37.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.038+0000 7f5d0b02c640 1 -- 172.21.15.164:0/33674885 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5d0401f070 con 0x7f5cf401ac20 2024-09-13T23:06:37.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.038+0000 7f5d0b02c640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x563d3550d830 2024-09-13T23:06:37.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.038+0000 7f5d03fff640 1 -- 172.21.15.164:0/33674885 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf4024030 con 0x563d3550d830 2024-09-13T23:06:37.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.038+0000 7f5d03fff640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x563d3550d830 2024-09-13T23:06:37.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.038+0000 7f5d03fff640 1 -- 172.21.15.164:0/33674885 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf4024030 con 0x563d3550d830 2024-09-13T23:06:37.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.038+0000 7f5d03fff640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x7f5d04031040 2024-09-13T23:06:37.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.039+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc07f070 con 0x7f5d04031040 2024-09-13T23:06:37.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.039+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x563d3550d830 2024-09-13T23:06:37.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.039+0000 7f5d03fff640 1 -- 172.21.15.164:0/33674885 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf4024030 con 0x563d3550d830 2024-09-13T23:06:37.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.039+0000 7f5d03fff640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x563d3550d830 2024-09-13T23:06:37.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.039+0000 7f5d03fff640 1 -- 172.21.15.164:0/33674885 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf4024030 con 0x563d3550d830 2024-09-13T23:06:37.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.039+0000 7f5d03fff640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x563d355075e0 2024-09-13T23:06:37.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.039+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc07f070 con 0x563d355075e0 2024-09-13T23:06:37.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.039+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x563d355075e0 2024-09-13T23:06:37.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.040+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5cfc07f070 con 0x563d355075e0 2024-09-13T23:06:37.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.040+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x7f5d04031040 2024-09-13T23:06:37.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.040+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc07f070 con 0x7f5d04031040 2024-09-13T23:06:37.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.040+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x563d3550d830 2024-09-13T23:06:37.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.040+0000 7f5d03fff640 1 -- 172.21.15.164:0/33674885 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf4024030 con 0x563d3550d830 2024-09-13T23:06:37.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.040+0000 7f5d03fff640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x7f5cf401ac20 2024-09-13T23:06:37.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.040+0000 7f5d0b02c640 1 -- 172.21.15.164:0/33674885 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d0401f070 con 0x7f5cf401ac20 2024-09-13T23:06:37.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.040+0000 7f5d0b02c640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x563d355075e0 2024-09-13T23:06:37.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.041+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5cfc07f070 con 0x563d355075e0 2024-09-13T23:06:37.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.041+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x7f5d04031040 2024-09-13T23:06:37.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.041+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc07f070 con 0x7f5d04031040 2024-09-13T23:06:37.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.041+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x563d3550d830 2024-09-13T23:06:37.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.041+0000 7f5d03fff640 1 -- 172.21.15.164:0/33674885 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf4024030 con 0x563d3550d830 2024-09-13T23:06:37.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.041+0000 7f5d03fff640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x7f5d04031040 2024-09-13T23:06:37.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.042+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc07f070 con 0x7f5d04031040 2024-09-13T23:06:37.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.042+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x7f5cf401ac20 2024-09-13T23:06:37.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.042+0000 7f5d0b02c640 1 -- 172.21.15.164:0/33674885 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d0401f070 con 0x7f5cf401ac20 2024-09-13T23:06:37.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.042+0000 7f5d0b02c640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x563d3550d830 2024-09-13T23:06:37.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.042+0000 7f5d03fff640 1 -- 172.21.15.164:0/33674885 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf4024030 con 0x563d3550d830 2024-09-13T23:06:37.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.042+0000 7f5d03fff640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x7f5cf401ac20 2024-09-13T23:06:37.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.042+0000 7f5d0b02c640 1 -- 172.21.15.164:0/33674885 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d0401f070 con 0x7f5cf401ac20 2024-09-13T23:06:37.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.042+0000 7f5d0b02c640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x563d355075e0 2024-09-13T23:06:37.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.043+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5cfc07f070 con 0x563d355075e0 2024-09-13T23:06:37.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.043+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563d35510250 con 0x7f5cf401ac20 2024-09-13T23:06:37.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.043+0000 7f5d0b02c640 1 -- 172.21.15.164:0/33674885 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d04040040 con 0x7f5cf401ac20 2024-09-13T23:06:37.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.043+0000 7f5d0eb37800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:06:37.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.043+0000 7f5d0eb37800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:06:37.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.043+0000 7f5d0eb37800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:06:37.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.043+0000 7f5d0eb37800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:06:37.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.043+0000 7f5d0eb37800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:06:37.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.043+0000 7f5d0eb37800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:06:37.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.043+0000 7f5d0eb37800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.043+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563d3550c470 con 0x563d355075e0 2024-09-13T23:06:37.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.043+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cfc07f070 con 0x563d355075e0 2024-09-13T23:06:37.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.043+0000 7f5d0eb37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:37.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.043+0000 7f5d0eb37800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.043+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563d3550cd10 con 0x563d355075e0 2024-09-13T23:06:37.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.043+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5cfc07f070 con 0x563d355075e0 2024-09-13T23:06:37.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.043+0000 7f5d0eb37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:06:37.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.043+0000 7f5d0eb37800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.043+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563d355106d0 con 0x563d355075e0 2024-09-13T23:06:37.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.044+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5cfc07f070 con 0x563d355075e0 2024-09-13T23:06:37.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.044+0000 7f5d0eb37800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:06:37.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.044+0000 7f5d0eb37800 20 zone default found 2024-09-13T23:06:37.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.044+0000 7f5d0eb37800 4 Realm: () 2024-09-13T23:06:37.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.044+0000 7f5d0eb37800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:06:37.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.044+0000 7f5d0eb37800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:06:37.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.044+0000 7f5d0eb37800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:06:37.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.044+0000 7f5d0eb37800 20 zonegroup default 2024-09-13T23:06:37.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.044+0000 7f5d0eb37800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.044+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563d35510b80 con 0x7f5d04031040 2024-09-13T23:06:37.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.044+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5cfc07f070 con 0x7f5d04031040 2024-09-13T23:06:37.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.044+0000 7f5d0eb37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:37.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.044+0000 7f5d0eb37800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.044+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563d35512560 con 0x563d3550d830 2024-09-13T23:06:37.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.044+0000 7f5d03fff640 1 -- 172.21.15.164:0/33674885 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5cf4024030 con 0x563d3550d830 2024-09-13T23:06:37.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.044+0000 7f5d0eb37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:37.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.044+0000 7f5d0eb37800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.044+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563d355129a0 con 0x563d3550d830 2024-09-13T23:06:37.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.045+0000 7f5d03fff640 1 -- 172.21.15.164:0/33674885 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5cf4024030 con 0x563d3550d830 2024-09-13T23:06:37.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.045+0000 7f5d0eb37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:37.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.045+0000 7f5d0eb37800 20 started sync module instance, tier type = 2024-09-13T23:06:37.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.045+0000 7f5d0eb37800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:06:37.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.045+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563d355119f0 con 0x7f5cf401ac20 2024-09-13T23:06:37.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.046+0000 7f5d0b02c640 1 -- 172.21.15.164:0/33674885 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d04040040 con 0x7f5cf401ac20 2024-09-13T23:06:37.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.046+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94820887502304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563d35511650 con 0x7f5cf401ac20 2024-09-13T23:06:37.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.046+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563d355138d0 con 0x563d355075e0 2024-09-13T23:06:37.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.047+0000 7f5d0b02c640 1 -- 172.21.15.164:0/33674885 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94820887502304] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d04040040 con 0x7f5cf401ac20 2024-09-13T23:06:37.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.047+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc07f070 con 0x563d355075e0 2024-09-13T23:06:37.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.047+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94820887506432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563d355138d0 con 0x563d355075e0 2024-09-13T23:06:37.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.047+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563d35514290 con 0x563d3550d830 2024-09-13T23:06:37.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.048+0000 7f5d03fff640 1 -- 172.21.15.164:0/33674885 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cf4024030 con 0x563d3550d830 2024-09-13T23:06:37.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.048+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94820887510496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563d35514ae0 con 0x563d3550d830 2024-09-13T23:06:37.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.048+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563d35515580 con 0x7f5cf401ac20 2024-09-13T23:06:37.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.048+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94820887506432] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc07f070 con 0x563d355075e0 2024-09-13T23:06:37.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.049+0000 7f5d03fff640 1 -- 172.21.15.164:0/33674885 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94820887510496] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cf4024030 con 0x563d3550d830 2024-09-13T23:06:37.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.049+0000 7f5d0b02c640 1 -- 172.21.15.164:0/33674885 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d04040040 con 0x7f5cf401ac20 2024-09-13T23:06:37.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.049+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94820887512624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563d35513420 con 0x7f5cf401ac20 2024-09-13T23:06:37.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.049+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563d35515e50 con 0x563d355075e0 2024-09-13T23:06:37.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.051+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc07f070 con 0x563d355075e0 2024-09-13T23:06:37.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.051+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94820887517600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563d35515e00 con 0x563d355075e0 2024-09-13T23:06:37.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.051+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563d35516df0 con 0x7f5d04031040 2024-09-13T23:06:37.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.051+0000 7f5d0b02c640 1 -- 172.21.15.164:0/33674885 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94820887512624] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d04040040 con 0x7f5cf401ac20 2024-09-13T23:06:37.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.052+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94820887517600] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc07f070 con 0x563d355075e0 2024-09-13T23:06:37.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.052+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc07f070 con 0x7f5d04031040 2024-09-13T23:06:37.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.052+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94820887521472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563d35516db0 con 0x7f5d04031040 2024-09-13T23:06:37.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.052+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563d35516360 con 0x7f5d04031040 2024-09-13T23:06:37.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.053+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94820887521472] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc07f070 con 0x7f5d04031040 2024-09-13T23:06:37.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.053+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc07f070 con 0x7f5d04031040 2024-09-13T23:06:37.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.053+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94820887515248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563d35516360 con 0x7f5d04031040 2024-09-13T23:06:37.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.053+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563d35517c90 con 0x7f5d04031040 2024-09-13T23:06:37.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.054+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(58 notify.7 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc07f070 con 0x7f5d04031040 2024-09-13T23:06:37.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.054+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94820887525312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563d35518140 con 0x7f5d04031040 2024-09-13T23:06:37.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.054+0000 7f5d0eb37800 20 add_watcher() i=0 2024-09-13T23:06:37.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.054+0000 7f5d0eb37800 20 add_watcher() i=1 2024-09-13T23:06:37.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.054+0000 7f5d0eb37800 20 add_watcher() i=2 2024-09-13T23:06:37.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.054+0000 7f5d0eb37800 20 add_watcher() i=3 2024-09-13T23:06:37.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.054+0000 7f5d0eb37800 20 add_watcher() i=4 2024-09-13T23:06:37.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.054+0000 7f5d0eb37800 20 add_watcher() i=5 2024-09-13T23:06:37.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.054+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94820887515248] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc07f070 con 0x7f5d04031040 2024-09-13T23:06:37.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.054+0000 7f5d0eb37800 20 add_watcher() i=6 2024-09-13T23:06:37.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.055+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94820887525312] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc07f070 con 0x7f5d04031040 2024-09-13T23:06:37.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.055+0000 7f5d0eb37800 20 add_watcher() i=7 2024-09-13T23:06:37.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.055+0000 7f5d0eb37800 2 all 8 watchers are set, enabling cache 2024-09-13T23:06:37.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.055+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563d35518140 con 0x563d355075e0 2024-09-13T23:06:37.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.056+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5cfc07f070 con 0x563d355075e0 2024-09-13T23:06:37.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.056+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94820887526544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563d355180b0 con 0x563d355075e0 2024-09-13T23:06:37.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.056+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94820887526544] v34'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5cfc07f070 con 0x563d355075e0 2024-09-13T23:06:37.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.057+0000 7f5bc17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:06:37.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.057+0000 7f5d0eb37800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:06:37.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.057+0000 7f5d0eb37800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:06:37.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.057+0000 7f5d0eb37800 5 note: GC not initialized 2024-09-13T23:06:37.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.057+0000 7f5b3bfff640 20 reqs_thread_entry: start 2024-09-13T23:06:37.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.057+0000 7f5d0eb37800 20 init_complete bucket index max shards: 11 2024-09-13T23:06:37.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.057+0000 7f5d0eb37800 20 Filter name: none 2024-09-13T23:06:37.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.057+0000 7f5b39ffb640 20 reqs_thread_entry: start 2024-09-13T23:06:37.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.057+0000 7f5d0eb37800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-13T23:06:37.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.057+0000 7f5d0eb37800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.057+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563d3554e510 con 0x7f5cf401ac20 2024-09-13T23:06:37.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.059+0000 7f5d0b02c640 1 -- 172.21.15.164:0/33674885 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f5d04040040 con 0x7f5cf401ac20 2024-09-13T23:06:37.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.059+0000 7f5d0eb37800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T23:06:37.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.059+0000 7f5d0eb37800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-13T23:06:37.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.059+0000 7f5d0eb37800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T23:06:37.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.059+0000 7f5d0eb37800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:06:37.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.059+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563d35552930 con 0x7f5d04031040 2024-09-13T23:06:37.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.060+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v34'6 uv5 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f5cfc07f070 con 0x7f5d04031040 2024-09-13T23:06:37.083 INFO:teuthology.orchestra.run.smithi164.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-13T23:06:37.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.061+0000 7f5bc17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:06:37.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.061+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94820887526544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563d3554c260 con 0x563d355075e0 2024-09-13T23:06:37.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.062+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94820887526544] v34'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5cfc07f070 con 0x563d355075e0 2024-09-13T23:06:37.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.062+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94820887502304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563d3554c260 con 0x7f5cf401ac20 2024-09-13T23:06:37.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.063+0000 7f5d0b02c640 1 -- 172.21.15.164:0/33674885 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94820887502304] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d04040040 con 0x7f5cf401ac20 2024-09-13T23:06:37.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.063+0000 7f5d0eb37800 20 remove_watcher() i=0 2024-09-13T23:06:37.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.063+0000 7f5d0eb37800 2 removed watcher, disabling cache 2024-09-13T23:06:37.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.063+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94820887506432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563d3554c260 con 0x563d355075e0 2024-09-13T23:06:37.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.065+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94820887506432] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc07f070 con 0x563d355075e0 2024-09-13T23:06:37.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.065+0000 7f5d0eb37800 20 remove_watcher() i=1 2024-09-13T23:06:37.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.065+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94820887510496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563d3554c260 con 0x563d3550d830 2024-09-13T23:06:37.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.066+0000 7f5d03fff640 1 -- 172.21.15.164:0/33674885 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94820887510496] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cf4024030 con 0x563d3550d830 2024-09-13T23:06:37.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.066+0000 7f5d0eb37800 20 remove_watcher() i=2 2024-09-13T23:06:37.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.066+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94820887512624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563d35552460 con 0x7f5cf401ac20 2024-09-13T23:06:37.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.067+0000 7f5d0b02c640 1 -- 172.21.15.164:0/33674885 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94820887512624] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d04040040 con 0x7f5cf401ac20 2024-09-13T23:06:37.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.067+0000 7f5d0eb37800 20 remove_watcher() i=3 2024-09-13T23:06:37.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.067+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94820887517600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563d35552460 con 0x563d355075e0 2024-09-13T23:06:37.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.068+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94820887517600] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc07f070 con 0x563d355075e0 2024-09-13T23:06:37.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.068+0000 7f5d0eb37800 20 remove_watcher() i=4 2024-09-13T23:06:37.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.068+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94820887521472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563d35552460 con 0x7f5d04031040 2024-09-13T23:06:37.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.069+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94820887521472] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc07f070 con 0x7f5d04031040 2024-09-13T23:06:37.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.069+0000 7f5d0eb37800 20 remove_watcher() i=5 2024-09-13T23:06:37.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.069+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94820887515248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563d35552460 con 0x7f5d04031040 2024-09-13T23:06:37.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.070+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94820887515248] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc07f070 con 0x7f5d04031040 2024-09-13T23:06:37.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.070+0000 7f5d0eb37800 20 remove_watcher() i=6 2024-09-13T23:06:37.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.070+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94820887525312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563d35552460 con 0x7f5d04031040 2024-09-13T23:06:37.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.071+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94820887525312] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc07f070 con 0x7f5d04031040 2024-09-13T23:06:37.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.071+0000 7f5d0eb37800 20 remove_watcher() i=7 2024-09-13T23:06:37.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.071+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f5d04031040 msgr2=0x7f5d04032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.071+0000 7f5d0eb37800 1 --2- 172.21.15.164:0/33674885 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f5d04031040 0x7f5d04032940 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.071+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563d355075e0 msgr2=0x563d35509aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.071+0000 7f5d0eb37800 1 --2- 172.21.15.164:0/33674885 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563d355075e0 0x563d35509aa0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.071+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f5cf401ac20 msgr2=0x7f5cf40278c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.071+0000 7f5d0eb37800 1 --2- 172.21.15.164:0/33674885 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f5cf401ac20 0x7f5cf40278c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.071+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563d3550d830 msgr2=0x563d3550fc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.071+0000 7f5d0eb37800 1 --2- 172.21.15.164:0/33674885 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563d3550d830 0x563d3550fc20 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.071+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5bd4036b40 msgr2=0x7f5bd4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.071+0000 7f5d0eb37800 1 --2- 172.21.15.164:0/33674885 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5bd4036b40 0x7f5bd4039000 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x563d354d8210 tx=0x7f5d0401f000 comp rx=0 tx=0).stop 2024-09-13T23:06:37.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.071+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d354f4c80 msgr2=0x563d354fbe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.071+0000 7f5d0a82b640 1 -- 172.21.15.164:0/33674885 reap_dead start 2024-09-13T23:06:37.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.071+0000 7f5d0eb37800 1 --2- 172.21.15.164:0/33674885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d354f4c80 0x563d354fbe40 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f5cf404b320 tx=0x7f5cf404c340 comp rx=0 tx=0).stop 2024-09-13T23:06:37.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.071+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 shutdown_connections 2024-09-13T23:06:37.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.071+0000 7f5d0eb37800 1 --2- 172.21.15.164:0/33674885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d354f4c80 0x563d354fbe40 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.071+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 >> 172.21.15.164:0/33674885 conn(0x563d354f0fe0 msgr2=0x563d354ef0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:37.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.071+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 shutdown_connections 2024-09-13T23:06:37.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.072+0000 7f5d0eb37800 1 -- 172.21.15.164:0/33674885 wait complete. 2024-09-13T23:06:37.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.072+0000 7f5d0eb37800 1 -- 172.21.15.164:0/3894768370 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5be4036b90 msgr2=0x7f5be4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.072+0000 7f5d0eb37800 1 --2- 172.21.15.164:0/3894768370 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5be4036b90 0x7f5be4039050 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x563d354d8f50 tx=0x7f5d04005840 comp rx=0 tx=0).stop 2024-09-13T23:06:37.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.072+0000 7f5d0eb37800 1 -- 172.21.15.164:0/3894768370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d354e7fc0 msgr2=0x563d354e83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.072+0000 7f5d0eb37800 1 --2- 172.21.15.164:0/3894768370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d354e7fc0 0x563d354e83e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4001ed0 tx=0x7f5cf400ea00 comp rx=0 tx=0).stop 2024-09-13T23:06:37.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.072+0000 7f5d0eb37800 1 -- 172.21.15.164:0/3894768370 shutdown_connections 2024-09-13T23:06:37.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.072+0000 7f5d0eb37800 1 --2- 172.21.15.164:0/3894768370 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5be4036b90 0x7f5be4039050 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.072+0000 7f5d0eb37800 1 --2- 172.21.15.164:0/3894768370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d354e7fc0 0x563d354e83e0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.072+0000 7f5d0eb37800 1 -- 172.21.15.164:0/3894768370 >> 172.21.15.164:0/3894768370 conn(0x563d354dcf50 msgr2=0x563d354dfad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:37.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.072+0000 7f5d0eb37800 1 -- 172.21.15.164:0/3894768370 shutdown_connections 2024-09-13T23:06:37.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.072+0000 7f5d0eb37800 1 -- 172.21.15.164:0/3894768370 wait complete. 2024-09-13T23:06:37.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.072+0000 7f5d0eb37800 1 -- 172.21.15.164:0/1682258855 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563d353d8050 msgr2=0x563d354d75a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.072+0000 7f5d0eb37800 1 --2- 172.21.15.164:0/1682258855 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563d353d8050 0x563d354d75a0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.072+0000 7f5d0eb37800 1 -- 172.21.15.164:0/1682258855 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5bf0036b90 msgr2=0x7f5bf0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.072+0000 7f5d0eb37800 1 --2- 172.21.15.164:0/1682258855 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5bf0036b90 0x7f5bf0039050 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4000f60 tx=0x7f5cf4001370 comp rx=0 tx=0).stop 2024-09-13T23:06:37.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.072+0000 7f5d0eb37800 1 -- 172.21.15.164:0/1682258855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d353d7710 msgr2=0x563d3534d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.072+0000 7f5d0eb37800 1 --2- 172.21.15.164:0/1682258855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d353d7710 0x563d3534d6e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc025da0 tx=0x7f5cfc002fb0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.072+0000 7f5d0eb37800 1 -- 172.21.15.164:0/1682258855 shutdown_connections 2024-09-13T23:06:37.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.072+0000 7f5d0eb37800 1 --2- 172.21.15.164:0/1682258855 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563d353d8050 0x563d354d75a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.072+0000 7f5d0eb37800 1 --2- 172.21.15.164:0/1682258855 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5bf0036b90 0x7f5bf0039050 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.072+0000 7f5d0eb37800 1 --2- 172.21.15.164:0/1682258855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563d353d7710 0x563d3534d6e0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.072+0000 7f5d0eb37800 1 -- 172.21.15.164:0/1682258855 >> 172.21.15.164:0/1682258855 conn(0x563d353d2fe0 msgr2=0x563d354c0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:37.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.072+0000 7f5d0eb37800 1 -- 172.21.15.164:0/1682258855 shutdown_connections 2024-09-13T23:06:37.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.072+0000 7f5d0eb37800 1 -- 172.21.15.164:0/1682258855 wait complete. 2024-09-13T23:06:37.090 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T23:06:37.095 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:06:37.095 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-13T23:06:37.100 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:06:37.100 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-13T23:06:37.100 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-13T23:06:37.101 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-13T23:06:37.101 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-13T23:06:37.147 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:06:37.147 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:06:37.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.146+0000 7fdbee011800 1 Processor -- start 2024-09-13T23:06:37.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.146+0000 7fdbee011800 1 -- start start 2024-09-13T23:06:37.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.146+0000 7fdbee011800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55fd753565b0 0x55fd75354d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.146+0000 7fdbee011800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fd7529fb30 con 0x55fd753569b0 2024-09-13T23:06:37.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.146+0000 7fdbee011800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55fd75281360 con 0x55fd753565b0 2024-09-13T23:06:37.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.147+0000 7fdbe979c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55fd753565b0 0x55fd75354d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.147+0000 7fdbe8f9b640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55fd753569b0 0x55fd753553a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:56006/0 (socket says 172.21.15.164:56006) 2024-09-13T23:06:37.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.147+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3736710975 learned_addr learned my addr 172.21.15.164:0/3736710975 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:06:37.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.147+0000 7fdbe979c640 1 -- 172.21.15.164:0/3736710975 >> v1:172.21.15.17:6789/0 conn(0x55fd753569b0 legacy=0x55fd753553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.147+0000 7fdbe979c640 1 -- 172.21.15.164:0/3736710975 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd752a7e00 con 0x55fd753565b0 2024-09-13T23:06:37.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.149+0000 7fdbe979c640 1 --2- 172.21.15.164:0/3736710975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd753565b0 0x55fd75354d90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc00a470 tx=0x7fdbdc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc8b2336f37a36e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.149+0000 7fdbe3fff640 1 -- 172.21.15.164:0/3736710975 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbdc053570 con 0x55fd753565b0 2024-09-13T23:06:37.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.149+0000 7fdbe3fff640 1 -- 172.21.15.164:0/3736710975 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbdc058070 con 0x55fd753565b0 2024-09-13T23:06:37.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.149+0000 7fdbe3fff640 1 -- 172.21.15.164:0/3736710975 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbdc053880 con 0x55fd753565b0 2024-09-13T23:06:37.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.149+0000 7fdbee011800 1 -- 172.21.15.164:0/3736710975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd753565b0 msgr2=0x55fd75354d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.149+0000 7fdbee011800 1 --2- 172.21.15.164:0/3736710975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd753565b0 0x55fd75354d90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc00a470 tx=0x7fdbdc045a20 comp rx=0 tx=0).stop 2024-09-13T23:06:37.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.150+0000 7fdbee011800 1 -- 172.21.15.164:0/3736710975 shutdown_connections 2024-09-13T23:06:37.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.150+0000 7fdbee011800 1 --2- 172.21.15.164:0/3736710975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd753565b0 0x55fd75354d90 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.150+0000 7fdbee011800 1 -- 172.21.15.164:0/3736710975 >> 172.21.15.164:0/3736710975 conn(0x55fd753dbfe0 msgr2=0x55fd753de400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:37.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.150+0000 7fdbee011800 1 -- 172.21.15.164:0/3736710975 shutdown_connections 2024-09-13T23:06:37.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.150+0000 7fdbee011800 1 -- 172.21.15.164:0/3736710975 wait complete. 2024-09-13T23:06:37.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.164+0000 7fdbee011800 1 Processor -- start 2024-09-13T23:06:37.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.164+0000 7fdbee011800 1 -- start start 2024-09-13T23:06:37.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.164+0000 7fdbee011800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd753565b0 0x55fd754d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.164+0000 7fdbee011800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fd7532c360 con 0x55fd753565b0 2024-09-13T23:06:37.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.164+0000 7fdbe979c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd753565b0 0x55fd754d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.164+0000 7fdbe979c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd753565b0 0x55fd754d1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:45042/0 (socket says 172.21.15.164:45042) 2024-09-13T23:06:37.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.164+0000 7fdbe979c640 1 -- 172.21.15.164:0/412682925 learned_addr learned my addr 172.21.15.164:0/412682925 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:37.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.164+0000 7fdbe979c640 1 -- 172.21.15.164:0/412682925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd75279bc0 con 0x55fd753565b0 2024-09-13T23:06:37.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.165+0000 7fdbe979c640 1 --2- 172.21.15.164:0/412682925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd753565b0 0x55fd754d1aa0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc025c20 tx=0x7fdbdc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fce28e8d088c948 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.165+0000 7fdad7606640 1 -- 172.21.15.164:0/412682925 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbdc05c580 con 0x55fd753565b0 2024-09-13T23:06:37.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.165+0000 7fdad7606640 1 -- 172.21.15.164:0/412682925 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbdc063030 con 0x55fd753565b0 2024-09-13T23:06:37.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.165+0000 7fdad7606640 1 -- 172.21.15.164:0/412682925 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbdc05c850 con 0x55fd753565b0 2024-09-13T23:06:37.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.165+0000 7fdbee011800 1 -- 172.21.15.164:0/412682925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd753565b0 msgr2=0x55fd754d1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.165+0000 7fdbee011800 1 --2- 172.21.15.164:0/412682925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd753565b0 0x55fd754d1aa0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc025c20 tx=0x7fdbdc051000 comp rx=0 tx=0).stop 2024-09-13T23:06:37.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.166+0000 7fdbee011800 1 -- 172.21.15.164:0/412682925 shutdown_connections 2024-09-13T23:06:37.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.166+0000 7fdbee011800 1 --2- 172.21.15.164:0/412682925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd753565b0 0x55fd754d1aa0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.166+0000 7fdbee011800 1 -- 172.21.15.164:0/412682925 >> 172.21.15.164:0/412682925 conn(0x55fd753dbfe0 msgr2=0x55fd754cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:37.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.166+0000 7fdbee011800 1 -- 172.21.15.164:0/412682925 shutdown_connections 2024-09-13T23:06:37.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.166+0000 7fdbee011800 1 -- 172.21.15.164:0/412682925 wait complete. 2024-09-13T23:06:37.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.166+0000 7fdbee011800 1 Processor -- start 2024-09-13T23:06:37.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.166+0000 7fdbee011800 1 -- start start 2024-09-13T23:06:37.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.166+0000 7fdbee011800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd753565b0 0x55fd754d93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.166+0000 7fdbee011800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fd753e9950 con 0x55fd753565b0 2024-09-13T23:06:37.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.166+0000 7fdbe979c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd753565b0 0x55fd754d93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.166+0000 7fdbe979c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd753565b0 0x55fd754d93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:45044/0 (socket says 172.21.15.164:45044) 2024-09-13T23:06:37.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.166+0000 7fdbe979c640 1 -- 172.21.15.164:0/1617932248 learned_addr learned my addr 172.21.15.164:0/1617932248 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:37.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.167+0000 7fdbe979c640 1 -- 172.21.15.164:0/1617932248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd7528dfe0 con 0x55fd753565b0 2024-09-13T23:06:37.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.167+0000 7fdbe979c640 1 --2- 172.21.15.164:0/1617932248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd753565b0 0x55fd754d93c0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x55fd754d2900 tx=0x7fdbdc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.167+0000 7fdad5e03640 1 -- 172.21.15.164:0/1617932248 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbdc054ad0 con 0x55fd753565b0 2024-09-13T23:06:37.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.167+0000 7fdad5e03640 1 -- 172.21.15.164:0/1617932248 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbdc054c70 con 0x55fd753565b0 2024-09-13T23:06:37.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.167+0000 7fdad5e03640 1 -- 172.21.15.164:0/1617932248 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbdc068420 con 0x55fd753565b0 2024-09-13T23:06:37.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.167+0000 7fdbee011800 1 -- 172.21.15.164:0/1617932248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fd754d9900 con 0x55fd753565b0 2024-09-13T23:06:37.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.167+0000 7fdbee011800 1 -- 172.21.15.164:0/1617932248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd754d9e20 con 0x55fd753565b0 2024-09-13T23:06:37.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.168+0000 7fdad5e03640 1 -- 172.21.15.164:0/1617932248 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdbdc0685c0 con 0x55fd753565b0 2024-09-13T23:06:37.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.168+0000 7fdad5e03640 1 --2- 172.21.15.164:0/1617932248 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdad0036b90 0x7fdad0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.168+0000 7fdad5e03640 1 -- 172.21.15.164:0/1617932248 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fdbdc070030 con 0x55fd753565b0 2024-09-13T23:06:37.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.168+0000 7fdbe8f9b640 1 --2- 172.21.15.164:0/1617932248 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdad0036b90 0x7fdad0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.168+0000 7fdbee011800 1 --2- 172.21.15.164:0/1617932248 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55fd754de420 0x55fd754e0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.168+0000 7fdbee011800 1 -- 172.21.15.164:0/1617932248 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd754e0d90 con 0x55fd754de420 2024-09-13T23:06:37.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.168+0000 7fdbe9f9d640 1 --2- 172.21.15.164:0/1617932248 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55fd754de420 0x55fd754e0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.169+0000 7fdbe8f9b640 1 --2- 172.21.15.164:0/1617932248 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdad0036b90 0x7fdad0039050 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4001d90 tx=0x7fdbd40012f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.169+0000 7fdbe9f9d640 1 --2- 172.21.15.164:0/1617932248 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55fd754de420 0x55fd754e0810 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.169+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/1617932248 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbe400a4a0 con 0x55fd754de420 2024-09-13T23:06:37.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.169+0000 7fdbee011800 1 -- 172.21.15.164:0/1617932248 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd754dd9e0 con 0x55fd754de420 2024-09-13T23:06:37.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.169+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/1617932248 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdbe400a4a0 con 0x55fd754de420 2024-09-13T23:06:37.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.169+0000 7fdbee011800 1 -- 172.21.15.164:0/1617932248 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd754e2be0 con 0x55fd754de420 2024-09-13T23:06:37.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.169+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/1617932248 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdbe400a4a0 con 0x55fd754de420 2024-09-13T23:06:37.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.169+0000 7fdbee011800 1 -- 172.21.15.164:0/1617932248 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd754e1e10 con 0x55fd754de420 2024-09-13T23:06:37.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.170+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/1617932248 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdbe400a4a0 con 0x55fd754de420 2024-09-13T23:06:37.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.170+0000 7fdbee011800 1 -- 172.21.15.164:0/1617932248 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd754e2260 con 0x55fd754de420 2024-09-13T23:06:37.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.170+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/1617932248 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdbe400a4a0 con 0x55fd754de420 2024-09-13T23:06:37.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.170+0000 7fdbee011800 1 Processor -- start 2024-09-13T23:06:37.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.170+0000 7fdbee011800 1 -- start start 2024-09-13T23:06:37.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.171+0000 7fdbee011800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd754f11d0 0x55fd754f15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.171+0000 7fdbee011800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fd7527b580 con 0x55fd754f11d0 2024-09-13T23:06:37.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.171+0000 7fdbe8f9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd754f11d0 0x55fd754f15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.171+0000 7fdbe8f9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd754f11d0 0x55fd754f15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:45058/0 (socket says 172.21.15.164:45058) 2024-09-13T23:06:37.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.171+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/2915531159 learned_addr learned my addr 172.21.15.164:0/2915531159 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:37.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.171+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/2915531159 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd754f1b30 con 0x55fd754f11d0 2024-09-13T23:06:37.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.171+0000 7fdbe8f9b640 1 --2- 172.21.15.164:0/2915531159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd754f11d0 0x55fd754f15f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fdbd400efd0 tx=0x7fdbd400d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.172+0000 7fdaceffd640 1 -- 172.21.15.164:0/2915531159 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbd401b550 con 0x55fd754f11d0 2024-09-13T23:06:37.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.172+0000 7fdaceffd640 1 -- 172.21.15.164:0/2915531159 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbd401b6f0 con 0x55fd754f11d0 2024-09-13T23:06:37.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.172+0000 7fdbee011800 1 -- 172.21.15.164:0/2915531159 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fd754f1dc0 con 0x55fd754f11d0 2024-09-13T23:06:37.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.172+0000 7fdaceffd640 1 -- 172.21.15.164:0/2915531159 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbd401b9f0 con 0x55fd754f11d0 2024-09-13T23:06:37.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.172+0000 7fdbee011800 1 -- 172.21.15.164:0/2915531159 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd754f4aa0 con 0x55fd754f11d0 2024-09-13T23:06:37.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.172+0000 7fdaceffd640 1 -- 172.21.15.164:0/2915531159 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdbd4023020 con 0x55fd754f11d0 2024-09-13T23:06:37.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.173+0000 7fdaceffd640 1 --2- 172.21.15.164:0/2915531159 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdac4036b90 0x7fdac4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.173+0000 7fdaceffd640 1 -- 172.21.15.164:0/2915531159 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fdbd4021020 con 0x55fd754f11d0 2024-09-13T23:06:37.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.173+0000 7fdbe9f9d640 1 --2- 172.21.15.164:0/2915531159 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdac4036b90 0x7fdac4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.173+0000 7fdbee011800 1 Processor -- start 2024-09-13T23:06:37.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.173+0000 7fdbe9f9d640 1 --2- 172.21.15.164:0/2915531159 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdac4036b90 0x7fdac4039050 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55fd754e1930 tx=0x7fdbe4005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.173+0000 7fdbee011800 1 -- start start 2024-09-13T23:06:37.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.173+0000 7fdbee011800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd754fdf40 0x55fd754fe340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.173+0000 7fdbee011800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fd754d21f0 con 0x55fd754fdf40 2024-09-13T23:06:37.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.174+0000 7fdbe8f9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd754fdf40 0x55fd754fe340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.174+0000 7fdbe8f9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd754fdf40 0x55fd754fe340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:45066/0 (socket says 172.21.15.164:45066) 2024-09-13T23:06:37.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.174+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/1500210141 learned_addr learned my addr 172.21.15.164:0/1500210141 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:37.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.174+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/1500210141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd754fe910 con 0x55fd754fdf40 2024-09-13T23:06:37.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.174+0000 7fdbe8f9b640 1 --2- 172.21.15.164:0/1500210141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd754fdf40 0x55fd754fe340 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fdbd404d320 tx=0x7fdbd404d350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8e67c84c4658d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.174+0000 7fdaccff9640 1 -- 172.21.15.164:0/1500210141 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbd4025410 con 0x55fd754fdf40 2024-09-13T23:06:37.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.174+0000 7fdaccff9640 1 -- 172.21.15.164:0/1500210141 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbd4046070 con 0x55fd754fdf40 2024-09-13T23:06:37.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.174+0000 7fdaccff9640 1 -- 172.21.15.164:0/1500210141 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbd4019320 con 0x55fd754fdf40 2024-09-13T23:06:37.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.175+0000 7fdbee011800 1 -- 172.21.15.164:0/1500210141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd754fdf40 msgr2=0x55fd754fe340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.175+0000 7fdbee011800 1 --2- 172.21.15.164:0/1500210141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd754fdf40 0x55fd754fe340 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fdbd404d320 tx=0x7fdbd404d350 comp rx=0 tx=0).stop 2024-09-13T23:06:37.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.175+0000 7fdbee011800 1 -- 172.21.15.164:0/1500210141 shutdown_connections 2024-09-13T23:06:37.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.175+0000 7fdbee011800 1 --2- 172.21.15.164:0/1500210141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd754fdf40 0x55fd754fe340 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.175+0000 7fdbee011800 1 -- 172.21.15.164:0/1500210141 >> 172.21.15.164:0/1500210141 conn(0x55fd754fa2a0 msgr2=0x55fd754f83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:37.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.175+0000 7fdbee011800 1 -- 172.21.15.164:0/1500210141 shutdown_connections 2024-09-13T23:06:37.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.175+0000 7fdbee011800 1 -- 172.21.15.164:0/1500210141 wait complete. 2024-09-13T23:06:37.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.175+0000 7fdbee011800 1 Processor -- start 2024-09-13T23:06:37.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.175+0000 7fdbee011800 1 -- start start 2024-09-13T23:06:37.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.175+0000 7fdbee011800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd754fdf40 0x55fd75505450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.175+0000 7fdbee011800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fd754fef80 con 0x55fd754fdf40 2024-09-13T23:06:37.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.175+0000 7fdbe8f9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd754fdf40 0x55fd75505450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.175+0000 7fdbe8f9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd754fdf40 0x55fd75505450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:45082/0 (socket says 172.21.15.164:45082) 2024-09-13T23:06:37.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.175+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 learned_addr learned my addr 172.21.15.164:0/3498079506 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:37.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.176+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd75505990 con 0x55fd754fdf40 2024-09-13T23:06:37.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.176+0000 7fdbe8f9b640 1 --2- 172.21.15.164:0/3498079506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd754fdf40 0x55fd75505450 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x55fd754f8f10 tx=0x7fdbd404d030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.176+0000 7fdabaffd640 1 -- 172.21.15.164:0/3498079506 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbd4024370 con 0x55fd754fdf40 2024-09-13T23:06:37.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.176+0000 7fdabaffd640 1 -- 172.21.15.164:0/3498079506 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbd4024510 con 0x55fd754fdf40 2024-09-13T23:06:37.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.176+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fd75505c20 con 0x55fd754fdf40 2024-09-13T23:06:37.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.176+0000 7fdabaffd640 1 -- 172.21.15.164:0/3498079506 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbd40246c0 con 0x55fd754fdf40 2024-09-13T23:06:37.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.176+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd75505c20 con 0x55fd754fdf40 2024-09-13T23:06:37.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.177+0000 7fdabaffd640 1 -- 172.21.15.164:0/3498079506 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdbd4040930 con 0x55fd754fdf40 2024-09-13T23:06:37.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.177+0000 7fdabaffd640 1 --2- 172.21.15.164:0/3498079506 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdab4036b90 0x7fdab4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.177+0000 7fdabaffd640 1 -- 172.21.15.164:0/3498079506 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fdbd4031070 con 0x55fd754fdf40 2024-09-13T23:06:37.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.177+0000 7fdbe9f9d640 1 --2- 172.21.15.164:0/3498079506 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdab4036b90 0x7fdab4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.178+0000 7fdbe9f9d640 1 --2- 172.21.15.164:0/3498079506 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdab4036b90 0x7fdab4039050 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55fd754dd950 tx=0x7fdbe401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.178+0000 7fdbee011800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.178+0000 7fdbee011800 1 --2- 172.21.15.164:0/3498079506 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55fd75510d70 0x55fd75513230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.178+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75513980 con 0x55fd75510d70 2024-09-13T23:06:37.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.178+0000 7fdbe979c640 1 --2- 172.21.15.164:0/3498079506 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55fd75510d70 0x55fd75513230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.178+0000 7fdbe979c640 1 --2- 172.21.15.164:0/3498079506 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55fd75510d70 0x55fd75513230 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.178+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbdc051070 con 0x55fd75510d70 2024-09-13T23:06:37.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.178+0000 7fdbee011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:37.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.178+0000 7fdbee011800 20 realm 2024-09-13T23:06:37.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.178+0000 7fdbee011800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.178+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75513d90 con 0x55fd75510d70 2024-09-13T23:06:37.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.179+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbdc051070 con 0x55fd75510d70 2024-09-13T23:06:37.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.179+0000 7fdbee011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:37.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.179+0000 7fdbee011800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:06:37.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.179+0000 7fdbee011800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.179+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75514660 con 0x55fd75510d70 2024-09-13T23:06:37.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.179+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbdc051070 con 0x55fd75510d70 2024-09-13T23:06:37.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.179+0000 7fdbee011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:37.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.179+0000 7fdbee011800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.179+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75514a00 con 0x55fd75510d70 2024-09-13T23:06:37.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.179+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdbdc051070 con 0x55fd75510d70 2024-09-13T23:06:37.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.179+0000 7fdbee011800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:06:37.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.179+0000 7fdbee011800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.179+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75515250 con 0x55fd75510d70 2024-09-13T23:06:37.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.179+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdbdc051070 con 0x55fd75510d70 2024-09-13T23:06:37.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.179+0000 7fdbee011800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:06:37.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.179+0000 7fdbee011800 20 searching for the correct realm 2024-09-13T23:06:37.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.179+0000 7fdbee011800 1 --2- 172.21.15.164:0/3498079506 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55fd75516fc0 0x55fd755193b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.179+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x55fd75516fc0 2024-09-13T23:06:37.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.180+0000 7fdbe8f9b640 1 --2- 172.21.15.164:0/3498079506 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55fd75516fc0 0x55fd755193b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.180+0000 7fdbe8f9b640 1 --2- 172.21.15.164:0/3498079506 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55fd75516fc0 0x55fd755193b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.180+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.180+0000 7fdbe8f9b640 1 --2- 172.21.15.164:0/3498079506 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fdbd404d4b0 0x7fdbd40152e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.180+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x7fdbd404d4b0 2024-09-13T23:06:37.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.180+0000 7fdbe9f9d640 1 --2- 172.21.15.164:0/3498079506 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fdbd404d4b0 0x7fdbd40152e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.181+0000 7fdbe9f9d640 1 --2- 172.21.15.164:0/3498079506 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fdbd404d4b0 0x7fdbd40152e0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.181+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbe401f070 con 0x7fdbd404d4b0 2024-09-13T23:06:37.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.181+0000 7fdbe9f9d640 1 --2- 172.21.15.164:0/3498079506 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fdbe4031040 0x7fdbe4032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.181+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x7fdbe4031040 2024-09-13T23:06:37.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.181+0000 7fdbe979c640 1 --2- 172.21.15.164:0/3498079506 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fdbe4031040 0x7fdbe4032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.181+0000 7fdbe979c640 1 --2- 172.21.15.164:0/3498079506 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fdbe4031040 0x7fdbe4032430 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.182+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbdc090d70 con 0x7fdbe4031040 2024-09-13T23:06:37.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.182+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x55fd75510d70 2024-09-13T23:06:37.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.182+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdbdc090d70 con 0x55fd75510d70 2024-09-13T23:06:37.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.182+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x55fd75510d70 2024-09-13T23:06:37.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.182+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbdc090d70 con 0x55fd75510d70 2024-09-13T23:06:37.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.182+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x7fdbe4031040 2024-09-13T23:06:37.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.182+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbdc090d70 con 0x7fdbe4031040 2024-09-13T23:06:37.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.182+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x7fdbe4031040 2024-09-13T23:06:37.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.183+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbdc090d70 con 0x7fdbe4031040 2024-09-13T23:06:37.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.183+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x7fdbd404d4b0 2024-09-13T23:06:37.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.183+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbe401f070 con 0x7fdbd404d4b0 2024-09-13T23:06:37.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.183+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x55fd75516fc0 2024-09-13T23:06:37.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.183+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.183+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x55fd75510d70 2024-09-13T23:06:37.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.183+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbdc090d70 con 0x55fd75510d70 2024-09-13T23:06:37.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.183+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x7fdbe4031040 2024-09-13T23:06:37.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.184+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbdc090d70 con 0x7fdbe4031040 2024-09-13T23:06:37.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.184+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x55fd75510d70 2024-09-13T23:06:37.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.184+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbdc090d70 con 0x55fd75510d70 2024-09-13T23:06:37.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.184+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x7fdbd404d4b0 2024-09-13T23:06:37.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.184+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdbe401f070 con 0x7fdbd404d4b0 2024-09-13T23:06:37.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.184+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x55fd75516fc0 2024-09-13T23:06:37.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.184+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.184+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x55fd75516fc0 2024-09-13T23:06:37.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.185+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.185+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x7fdbe4031040 2024-09-13T23:06:37.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.185+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbdc090d70 con 0x7fdbe4031040 2024-09-13T23:06:37.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.185+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x55fd75516fc0 2024-09-13T23:06:37.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.185+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.185+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x55fd75516fc0 2024-09-13T23:06:37.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.185+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.185+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x55fd75510d70 2024-09-13T23:06:37.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.186+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbdc090d70 con 0x55fd75510d70 2024-09-13T23:06:37.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.186+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x55fd75510d70 2024-09-13T23:06:37.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.186+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdbdc090d70 con 0x55fd75510d70 2024-09-13T23:06:37.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.186+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x7fdbe4031040 2024-09-13T23:06:37.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.186+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbdc090d70 con 0x7fdbe4031040 2024-09-13T23:06:37.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.186+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x55fd75516fc0 2024-09-13T23:06:37.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.186+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.186+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x7fdbd404d4b0 2024-09-13T23:06:37.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.187+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbe401f070 con 0x7fdbd404d4b0 2024-09-13T23:06:37.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.187+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x55fd75510d70 2024-09-13T23:06:37.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.187+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdbdc090d70 con 0x55fd75510d70 2024-09-13T23:06:37.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.187+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x7fdbe4031040 2024-09-13T23:06:37.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.187+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbdc090d70 con 0x7fdbe4031040 2024-09-13T23:06:37.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.187+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x55fd75516fc0 2024-09-13T23:06:37.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.187+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.187+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x7fdbe4031040 2024-09-13T23:06:37.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.188+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbdc090d70 con 0x7fdbe4031040 2024-09-13T23:06:37.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.188+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x7fdbd404d4b0 2024-09-13T23:06:37.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.188+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbe401f070 con 0x7fdbd404d4b0 2024-09-13T23:06:37.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.188+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x55fd75516fc0 2024-09-13T23:06:37.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.188+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.188+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x7fdbd404d4b0 2024-09-13T23:06:37.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.188+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbe401f070 con 0x7fdbd404d4b0 2024-09-13T23:06:37.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.188+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x55fd75510d70 2024-09-13T23:06:37.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.189+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdbdc090d70 con 0x55fd75510d70 2024-09-13T23:06:37.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.189+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519990 con 0x7fdbd404d4b0 2024-09-13T23:06:37.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.189+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbe4040040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.189+0000 7fdbee011800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:06:37.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.189+0000 7fdbee011800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:06:37.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.189+0000 7fdbee011800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:06:37.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.189+0000 7fdbee011800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:06:37.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.189+0000 7fdbee011800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:06:37.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.189+0000 7fdbee011800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:06:37.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.189+0000 7fdbee011800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.189+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75515bd0 con 0x55fd75510d70 2024-09-13T23:06:37.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.189+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbdc090d70 con 0x55fd75510d70 2024-09-13T23:06:37.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.189+0000 7fdbee011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:37.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.189+0000 7fdbee011800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.189+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75516470 con 0x55fd75510d70 2024-09-13T23:06:37.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.189+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdbdc090d70 con 0x55fd75510d70 2024-09-13T23:06:37.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.189+0000 7fdbee011800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:06:37.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.189+0000 7fdbee011800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.189+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75519e10 con 0x55fd75510d70 2024-09-13T23:06:37.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.190+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdbdc090d70 con 0x55fd75510d70 2024-09-13T23:06:37.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.190+0000 7fdbee011800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:06:37.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.190+0000 7fdbee011800 20 zone default found 2024-09-13T23:06:37.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.190+0000 7fdbee011800 4 Realm: () 2024-09-13T23:06:37.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.190+0000 7fdbee011800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:06:37.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.190+0000 7fdbee011800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:06:37.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.190+0000 7fdbee011800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:06:37.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.190+0000 7fdbee011800 20 zonegroup default 2024-09-13T23:06:37.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.190+0000 7fdbee011800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.190+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd755160d0 con 0x7fdbe4031040 2024-09-13T23:06:37.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.190+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdbdc090d70 con 0x7fdbe4031040 2024-09-13T23:06:37.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.190+0000 7fdbee011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:37.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.190+0000 7fdbee011800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.190+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd7551bd20 con 0x55fd75516fc0 2024-09-13T23:06:37.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.190+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.190+0000 7fdbee011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:37.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.190+0000 7fdbee011800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.190+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd7551c110 con 0x55fd75516fc0 2024-09-13T23:06:37.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.191+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.191+0000 7fdbee011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:37.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.191+0000 7fdbee011800 20 started sync module instance, tier type = 2024-09-13T23:06:37.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.191+0000 7fdbee011800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:06:37.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.191+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7551b1c0 con 0x7fdbd404d4b0 2024-09-13T23:06:37.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.192+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbe4040040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.192+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94547083376048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7551ae20 con 0x7fdbd404d4b0 2024-09-13T23:06:37.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.192+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7551d040 con 0x55fd75510d70 2024-09-13T23:06:37.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.193+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94547083376048] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbe4040040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.193+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbdc090d70 con 0x55fd75510d70 2024-09-13T23:06:37.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.193+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94547083380080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7551d040 con 0x55fd75510d70 2024-09-13T23:06:37.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.193+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7551da40 con 0x55fd75516fc0 2024-09-13T23:06:37.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.194+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.194+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94547083384144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7551e2e0 con 0x55fd75516fc0 2024-09-13T23:06:37.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.194+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7551ed50 con 0x7fdbd404d4b0 2024-09-13T23:06:37.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.195+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94547083380080] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbdc090d70 con 0x55fd75510d70 2024-09-13T23:06:37.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.195+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94547083384144] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.196+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbe4040040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.196+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94547083386416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7551cb90 con 0x7fdbd404d4b0 2024-09-13T23:06:37.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.196+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7551f760 con 0x55fd75510d70 2024-09-13T23:06:37.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.197+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbdc090d70 con 0x55fd75510d70 2024-09-13T23:06:37.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.197+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94547083391664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7551fb80 con 0x55fd75510d70 2024-09-13T23:06:37.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.197+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd755205b0 con 0x7fdbe4031040 2024-09-13T23:06:37.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.197+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94547083386416] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbe4040040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.198+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94547083391664] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbdc090d70 con 0x55fd75510d70 2024-09-13T23:06:37.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.198+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbdc090d70 con 0x7fdbe4031040 2024-09-13T23:06:37.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.198+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94547083388960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd755202a0 con 0x7fdbe4031040 2024-09-13T23:06:37.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.198+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd75520af0 con 0x7fdbe4031040 2024-09-13T23:06:37.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.199+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94547083388960] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbdc090d70 con 0x7fdbe4031040 2024-09-13T23:06:37.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.199+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbdc090d70 con 0x7fdbe4031040 2024-09-13T23:06:37.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.199+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94547083395744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd75520b70 con 0x7fdbe4031040 2024-09-13T23:06:37.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.199+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd75521400 con 0x7fdbe4031040 2024-09-13T23:06:37.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.200+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94547083395744] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbdc090d70 con 0x7fdbe4031040 2024-09-13T23:06:37.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.200+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbdc090d70 con 0x7fdbe4031040 2024-09-13T23:06:37.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.200+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94547083397280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd755212d0 con 0x7fdbe4031040 2024-09-13T23:06:37.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.200+0000 7fdbee011800 20 add_watcher() i=0 2024-09-13T23:06:37.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.200+0000 7fdbee011800 20 add_watcher() i=1 2024-09-13T23:06:37.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.200+0000 7fdbee011800 20 add_watcher() i=2 2024-09-13T23:06:37.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.200+0000 7fdbee011800 20 add_watcher() i=3 2024-09-13T23:06:37.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.200+0000 7fdbee011800 20 add_watcher() i=4 2024-09-13T23:06:37.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.200+0000 7fdbee011800 20 add_watcher() i=5 2024-09-13T23:06:37.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.200+0000 7fdbee011800 20 add_watcher() i=6 2024-09-13T23:06:37.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.201+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94547083397280] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbdc090d70 con 0x7fdbe4031040 2024-09-13T23:06:37.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.201+0000 7fdbee011800 20 add_watcher() i=7 2024-09-13T23:06:37.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.201+0000 7fdbee011800 2 all 8 watchers are set, enabling cache 2024-09-13T23:06:37.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.201+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75524840 con 0x55fd75510d70 2024-09-13T23:06:37.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.202+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdbdc090d70 con 0x55fd75510d70 2024-09-13T23:06:37.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.202+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94547083398496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd75521d00 con 0x55fd75510d70 2024-09-13T23:06:37.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.203+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94547083398496] v34'219 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdbdc090d70 con 0x55fd75510d70 2024-09-13T23:06:37.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.203+0000 7fda9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:06:37.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.203+0000 7fdbee011800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:06:37.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.203+0000 7fdbee011800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:06:37.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.203+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd75524750 con 0x55fd75510d70 2024-09-13T23:06:37.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.204+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdbdc090d70 con 0x55fd75510d70 2024-09-13T23:06:37.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.204+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552d8b0 con 0x7fdbe4031040 2024-09-13T23:06:37.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.206+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdbdc090d70 con 0x7fdbe4031040 2024-09-13T23:06:37.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.206+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552d8b0 con 0x55fd75516fc0 2024-09-13T23:06:37.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.207+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.207+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552dcf0 con 0x55fd75510d70 2024-09-13T23:06:37.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.208+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'220 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdbdc090d70 con 0x55fd75510d70 2024-09-13T23:06:37.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.208+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552dd40 con 0x7fdbd404d4b0 2024-09-13T23:06:37.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.209+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'68 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdbe4040040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.209+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552e310 con 0x55fd75516fc0 2024-09-13T23:06:37.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.210+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'45 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.210+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552e7c0 con 0x55fd75510d70 2024-09-13T23:06:37.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.211+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdbdc090d70 con 0x55fd75510d70 2024-09-13T23:06:37.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.211+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552e7c0 con 0x7fdbe4031040 2024-09-13T23:06:37.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.212+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'47 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdbdc090d70 con 0x7fdbe4031040 2024-09-13T23:06:37.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.212+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552e7c0 con 0x7fdbd404d4b0 2024-09-13T23:06:37.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.213+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdbe4040040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.213+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552d010 con 0x55fd75516fc0 2024-09-13T23:06:37.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.214+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.214+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552d010 con 0x7fdbd404d4b0 2024-09-13T23:06:37.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.216+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'69 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbe4040040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.216+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552f320 con 0x7fdbe4031040 2024-09-13T23:06:37.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.217+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbdc090d70 con 0x7fdbe4031040 2024-09-13T23:06:37.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.217+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552f320 con 0x7fdbd404d4b0 2024-09-13T23:06:37.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.218+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbe4040040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.218+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552f320 con 0x7fdbe4031040 2024-09-13T23:06:37.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.219+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'51 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbdc090d70 con 0x7fdbe4031040 2024-09-13T23:06:37.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.219+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552f320 con 0x55fd75510d70 2024-09-13T23:06:37.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.220+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'221 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbdc090d70 con 0x55fd75510d70 2024-09-13T23:06:37.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.220+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552f320 con 0x55fd75516fc0 2024-09-13T23:06:37.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.221+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'62 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.222+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552f520 con 0x7fdbd404d4b0 2024-09-13T23:06:37.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.222+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'70 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbe4040040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.222+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552f8f0 con 0x55fd75516fc0 2024-09-13T23:06:37.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.223+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.223+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552f8f0 con 0x55fd75510d70 2024-09-13T23:06:37.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.224+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbdc090d70 con 0x55fd75510d70 2024-09-13T23:06:37.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.224+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552f980 con 0x55fd75510d70 2024-09-13T23:06:37.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.225+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'222 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbdc090d70 con 0x55fd75510d70 2024-09-13T23:06:37.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.225+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552f980 con 0x55fd75516fc0 2024-09-13T23:06:37.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.227+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'63 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.227+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552f980 con 0x7fdbd404d4b0 2024-09-13T23:06:37.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.228+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbe4040040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.228+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552f980 con 0x55fd75516fc0 2024-09-13T23:06:37.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.228+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.228+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552fa00 con 0x55fd75516fc0 2024-09-13T23:06:37.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.229+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.229+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552c980 con 0x55fd75516fc0 2024-09-13T23:06:37.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.230+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.230+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552c980 con 0x55fd75516fc0 2024-09-13T23:06:37.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.231+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'46 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.231+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552c980 con 0x7fdbe4031040 2024-09-13T23:06:37.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.233+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbdc090d70 con 0x7fdbe4031040 2024-09-13T23:06:37.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.233+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552c980 con 0x55fd75516fc0 2024-09-13T23:06:37.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.233+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.233+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552c980 con 0x7fdbe4031040 2024-09-13T23:06:37.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.235+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'48 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbdc090d70 con 0x7fdbe4031040 2024-09-13T23:06:37.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.235+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552c980 con 0x55fd75516fc0 2024-09-13T23:06:37.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.236+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'64 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.236+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552c980 con 0x7fdbe4031040 2024-09-13T23:06:37.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.237+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'52 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbdc090d70 con 0x7fdbe4031040 2024-09-13T23:06:37.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.237+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7552c980 con 0x7fdbd404d4b0 2024-09-13T23:06:37.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.238+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdbe4040040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.238+0000 7fda9e7e4640 20 reqs_thread_entry: start 2024-09-13T23:06:37.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.239+0000 7fdbee011800 20 init_complete bucket index max shards: 11 2024-09-13T23:06:37.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.239+0000 7fdbee011800 20 Filter name: none 2024-09-13T23:06:37.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.239+0000 7fda0ffff640 20 reqs_thread_entry: start 2024-09-13T23:06:37.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.239+0000 7fdbee011800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-13T23:06:37.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.239+0000 7fdbee011800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.239+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd7555a800 con 0x7fdbd404d4b0 2024-09-13T23:06:37.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.239+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 19 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fdbe4040040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.239+0000 7fdbee011800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T23:06:37.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.239+0000 7fdbee011800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-13T23:06:37.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.239+0000 7fdbee011800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T23:06:37.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.239+0000 7fdbee011800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:06:37.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.239+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd7555d1d0 con 0x55fd75510d70 2024-09-13T23:06:37.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.239+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fdbdc090d70 con 0x55fd75510d70 2024-09-13T23:06:37.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.240+0000 7fdbee011800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 : miss 2024-09-13T23:06:37.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.240+0000 7fdbee011800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.240+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:96 8.5 8:a5861de4:root::.bucket.meta.myfoo6%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd7555cf00 con 0x55fd75510d70 2024-09-13T23:06:37.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.240+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(96 .bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=212b] v0'0 uv6 ondisk = 0) ==== 333+0+656 (crc 0 0 0) 0x7fdbdc090d70 con 0x55fd75510d70 2024-09-13T23:06:37.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.240+0000 7fdbee011800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T23:06:37.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.240+0000 7fdbee011800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 info.flags=0x17 2024-09-13T23:06:37.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.240+0000 7fdbee011800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 to cache LRU end 2024-09-13T23:06:37.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.240+0000 7fdbee011800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:06:37.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.240+0000 7fdbee011800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T23:06:37.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.240+0000 7fdbee011800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 2024-09-13T23:06:37.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.240+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:97 4.6 4:62c26400:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd755da3f0 con 0x55fd75516fc0 2024-09-13T23:06:37.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.240+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 26 ==== osd_op_reply(97 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.241+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:98 4.5 4:a0d4b7a9:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd755da430 con 0x7fdbd404d4b0 2024-09-13T23:06:37.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.241+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 20 ==== osd_op_reply(98 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.1 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdbe4040040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.241+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:99 4.32 4:4f5857b2:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd755da470 con 0x55fd75510d70 2024-09-13T23:06:37.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.241+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(99 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdbdc090d70 con 0x55fd75510d70 2024-09-13T23:06:37.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.241+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:100 4.11 4:8a1b5a9e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd755da470 con 0x7fdbe4031040 2024-09-13T23:06:37.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.242+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(100 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdbdc090d70 con 0x7fdbe4031040 2024-09-13T23:06:37.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.242+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:101 4.35 4:ad6a2e91:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd755da470 con 0x55fd75510d70 2024-09-13T23:06:37.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.242+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 32 ==== osd_op_reply(101 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdbdc090d70 con 0x55fd75510d70 2024-09-13T23:06:37.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.242+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:102 4.25 4:a797616a:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd755da470 con 0x7fdbd404d4b0 2024-09-13T23:06:37.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.243+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 21 ==== osd_op_reply(102 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdbe4040040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.243+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:103 4.e 4:72889151:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd755da470 con 0x7fdbd404d4b0 2024-09-13T23:06:37.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.243+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 22 ==== osd_op_reply(103 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.6 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdbe4040040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.243+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:104 4.0 4:012594ce:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd755da470 con 0x55fd75516fc0 2024-09-13T23:06:37.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.243+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 27 ==== osd_op_reply(104 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.243+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:105 4.2d 4:b57db1fd:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd755da470 con 0x7fdbe4031040 2024-09-13T23:06:37.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.244+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(105 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdbdc090d70 con 0x7fdbe4031040 2024-09-13T23:06:37.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.244+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:106 4.5 4:a2208176:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd755da410 con 0x7fdbd404d4b0 2024-09-13T23:06:37.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.244+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 23 ==== osd_op_reply(106 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.9 [call out=345b] v0'0 uv11 ondisk = 0) ==== 194+0+345 (crc 0 0 0) 0x7fdbe4040040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.244+0000 7fdbee011800 10 cls_bucket_list_unordered: got thirteen 2024-09-13T23:06:37.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.244+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:107 4.f 4:f030fdc2:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd755da410 con 0x55fd75510d70 2024-09-13T23:06:37.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.245+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 33 ==== osd_op_reply(107 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdbdc0b7060 con 0x55fd75510d70 2024-09-13T23:06:37.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.245+0000 7fdbee011800 20 get_obj_state: octx=0x55fd754fe320 obj=myfoo6:thirteen state=0x55fd755d84b8 s->prefetch_data=0 2024-09-13T23:06:37.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.245+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:108 3.8s0 3:1392d58c:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd755d92e0 con 0x55fd75516fc0 2024-09-13T23:06:37.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.245+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 28 ==== osd_op_reply(108 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9_thirteen [getxattrs out=819b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+835 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.245+0000 7fdbee011800 10 manifest: total_size = 8 2024-09-13T23:06:37.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.245+0000 7fdbee011800 20 get_obj_state: setting s->obj_tag to _clp8c76Gv9KAxdsjjtysi1iL6JjmFms 2024-09-13T23:06:37.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.245+0000 7fdbee011800 20 get_obj_state: octx=0x55fd754fe320 obj=myfoo6:thirteen state=0x55fd755d84b8 s->prefetch_data=0 2024-09-13T23:06:37.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.245+0000 7fdbee011800 20 prepare_atomic_modification: state is not atomic. state=0x55fd755d84b8 2024-09-13T23:06:37.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.245+0000 7fdbee011800 20 bucket index object: :.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.9 2024-09-13T23:06:37.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.245+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:109 4.5 4:a2208176:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd755d9ba0 con 0x7fdbd404d4b0 2024-09-13T23:06:37.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.246+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 24 ==== osd_op_reply(109 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.9 [stat,call,call] v34'12 uv12 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fdbe4040040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.246+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:110 3.8s0 3:1392d58c:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd755d9ba0 con 0x55fd75516fc0 2024-09-13T23:06:37.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.248+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 29 ==== osd_op_reply(110 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9_thirteen [call] v34'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.248+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:111 4.5 4:a2208176:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd75561a70 con 0x7fdbd404d4b0 2024-09-13T23:06:37.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.248+0000 7fdbee011800 20 list_objects_ordered: starting attempt 1 2024-09-13T23:06:37.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.248+0000 7fdbee011800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T23:06:37.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.248+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:112 4.6 4:62c26400:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75561a70 con 0x55fd75516fc0 2024-09-13T23:06:37.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.248+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:113 4.5 4:a0d4b7a9:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75565d60 con 0x7fdbd404d4b0 2024-09-13T23:06:37.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.248+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:114 4.32 4:4f5857b2:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75565d60 con 0x55fd75510d70 2024-09-13T23:06:37.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.248+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:115 4.11 4:8a1b5a9e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd7556ab90 con 0x7fdbe4031040 2024-09-13T23:06:37.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.248+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:116 4.35 4:ad6a2e91:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd7556d4d0 con 0x55fd75510d70 2024-09-13T23:06:37.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.248+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:117 4.25 4:a797616a:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd755702c0 con 0x7fdbd404d4b0 2024-09-13T23:06:37.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.248+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:118 4.e 4:72889151:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75572c90 con 0x7fdbd404d4b0 2024-09-13T23:06:37.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.249+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 34 ==== osd_op_reply(114 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdbdc0b7060 con 0x55fd75510d70 2024-09-13T23:06:37.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.249+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(115 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdbdc0b7060 con 0x7fdbe4031040 2024-09-13T23:06:37.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.249+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 30 ==== osd_op_reply(112 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.249+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 35 ==== osd_op_reply(116 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdbdc0b7060 con 0x55fd75510d70 2024-09-13T23:06:37.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.249+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 25 ==== osd_op_reply(117 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdbe404e040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.249+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:119 4.0 4:012594ce:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75572c90 con 0x55fd75516fc0 2024-09-13T23:06:37.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.249+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 26 ==== osd_op_reply(118 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.6 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdbe404e040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.249+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:120 4.2d 4:b57db1fd:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75570780 con 0x7fdbe4031040 2024-09-13T23:06:37.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.249+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 27 ==== osd_op_reply(113 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.1 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdbe404e040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.249+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:121 4.5 4:a2208176:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75572320 con 0x7fdbd404d4b0 2024-09-13T23:06:37.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.249+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:122 4.f 4:f030fdc2:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75572c90 con 0x55fd75510d70 2024-09-13T23:06:37.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.249+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== osd_op_reply(120 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdbdc0b7060 con 0x7fdbe4031040 2024-09-13T23:06:37.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.249+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 36 ==== osd_op_reply(122 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdbdc0b7060 con 0x55fd75510d70 2024-09-13T23:06:37.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.249+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 31 ==== osd_op_reply(119 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.251+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 28 ==== osd_op_reply(111 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.9 [stat,call,call] v34'13 uv13 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fdbe404e040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.251+0000 7fdaccff9640 20 handle_completion(): completion ok for obj=thirteen 2024-09-13T23:06:37.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.251+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 29 ==== osd_op_reply(121 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.9 [call out=124b] v0'0 uv13 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fdbe404e040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.251+0000 7fdbee011800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T23:06:37.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.251+0000 7fdbee011800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T23:06:37.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.251+0000 7fdbee011800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T23:06:37.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.251+0000 7fdbee011800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T23:06:37.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.251+0000 7fdbee011800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9])"; uploads.size()=0; is_truncated=0 2024-09-13T23:06:37.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.251+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:123 4.6 4:62c26400:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75570710 con 0x55fd75516fc0 2024-09-13T23:06:37.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.251+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:124 4.5 4:a0d4b7a9:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75572c20 con 0x7fdbd404d4b0 2024-09-13T23:06:37.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.251+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:125 4.32 4:4f5857b2:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd7556d4d0 con 0x55fd75510d70 2024-09-13T23:06:37.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.251+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:126 4.11 4:8a1b5a9e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75570710 con 0x7fdbe4031040 2024-09-13T23:06:37.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.251+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:127 4.35 4:ad6a2e91:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75572c20 con 0x55fd75510d70 2024-09-13T23:06:37.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.251+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:128 4.25 4:a797616a:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75572c20 con 0x7fdbd404d4b0 2024-09-13T23:06:37.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.251+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:129 4.e 4:72889151:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75570710 con 0x7fdbd404d4b0 2024-09-13T23:06:37.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.251+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:130 4.0 4:012594ce:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd7556a230 con 0x55fd75516fc0 2024-09-13T23:06:37.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.251+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:131 4.2d 4:b57db1fd:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75575150 con 0x7fdbe4031040 2024-09-13T23:06:37.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.251+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:132 4.5 4:a2208176:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75572c20 con 0x7fdbd404d4b0 2024-09-13T23:06:37.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.252+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:133 4.f 4:f030fdc2:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd7557a260 con 0x55fd75510d70 2024-09-13T23:06:37.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.252+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 37 ==== osd_op_reply(125 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdbdc0c0040 con 0x55fd75510d70 2024-09-13T23:06:37.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.252+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 38 ==== osd_op_reply(127 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdbdc0c0040 con 0x55fd75510d70 2024-09-13T23:06:37.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.252+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 30 ==== osd_op_reply(124 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.1 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdbe404e040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.252+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 32 ==== osd_op_reply(123 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdbd4055070 con 0x55fd75516fc0 2024-09-13T23:06:37.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.252+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 27 ==== osd_op_reply(131 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdbdc0c0040 con 0x7fdbe4031040 2024-09-13T23:06:37.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.252+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 33 ==== osd_op_reply(130 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdbd407b060 con 0x55fd75516fc0 2024-09-13T23:06:37.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.252+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 28 ==== osd_op_reply(126 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdbdc0c0040 con 0x7fdbe4031040 2024-09-13T23:06:37.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.252+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 31 ==== osd_op_reply(128 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdbe404e040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.252+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 32 ==== osd_op_reply(129 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.6 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdbe404e040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.252+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 39 ==== osd_op_reply(133 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdbdc0c0040 con 0x55fd75510d70 2024-09-13T23:06:37.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.252+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 33 ==== osd_op_reply(132 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.9 [call out=124b] v0'0 uv13 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fdbe404e040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.252+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd75561580 con 0x55fd75510d70 2024-09-13T23:06:37.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.253+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 40 ==== osd_op_reply(134 bud.buckets [call] v34'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdbdc0c0040 con 0x55fd75510d70 2024-09-13T23:06:37.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.253+0000 7fdbee011800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-13T23:06:37.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.253+0000 7fdbee011800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.253+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75561580 con 0x55fd75510d70 2024-09-13T23:06:37.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.253+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 41 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv19 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7fdbdc0c0040 con 0x55fd75510d70 2024-09-13T23:06:37.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.253+0000 7fdbee011800 20 rados_obj.operate() r=0 bl.length=166 2024-09-13T23:06:37.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.253+0000 7fdbee011800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-09-13T23:06:37.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.253+0000 7fdbee011800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-13T23:06:37.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.253+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd75572b70 con 0x55fd75510d70 2024-09-13T23:06:37.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.254+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 42 ==== osd_op_reply(136 myfoo6 [call,call,delete] v34'20 uv20 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fdbdc0c0040 con 0x55fd75510d70 2024-09-13T23:06:37.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.254+0000 7fdbee011800 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-13T23:06:37.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.254+0000 7fdbee011800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-13T23:06:37.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.254+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94547083721568 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75573130 con 0x7fdbd404d4b0 2024-09-13T23:06:37.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.255+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 34 ==== watch-notify(notify (1) cookie 94547083386416 notify 146028888090 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55fd7552d180 con 0x7fdbd404d4b0 2024-09-13T23:06:37.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.255+0000 7fdabbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888090 cookie 94547083386416 notifier 4763 bl.length()=150 2024-09-13T23:06:37.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.255+0000 7fdabbfff640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fda1c0032c0 con 0x7fdbd404d4b0 2024-09-13T23:06:37.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.255+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 35 ==== osd_op_reply(137 notify.3 [notify cookie 94547083721568 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdbe404e040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.255+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 36 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbe404e040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.255+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 37 ==== watch-notify(notify_complete (2) cookie 94547083721568 notify 146028888090 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fd7552d3b0 con 0x7fdbd404d4b0 2024-09-13T23:06:37.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.255+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:139 8.5 8:a5861de4:root::.bucket.meta.myfoo6%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd75573130 con 0x55fd75510d70 2024-09-13T23:06:37.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.256+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 43 ==== osd_op_reply(139 .bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 [call,call,delete] v34'7 uv7 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7fdbdc0c0040 con 0x55fd75510d70 2024-09-13T23:06:37.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.256+0000 7fdbee011800 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 from cache 2024-09-13T23:06:37.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.256+0000 7fdbee011800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9, ofs0, ns] 2024-09-13T23:06:37.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.256+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:140 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94547083644528 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75573130 con 0x7fdbd404d4b0 2024-09-13T23:06:37.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.256+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 38 ==== watch-notify(notify (1) cookie 94547083376048 notify 146028888091 ret 0) ==== 249+0+0 (crc 0 0 0) 0x55fd7552d3b0 con 0x7fdbd404d4b0 2024-09-13T23:06:37.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.256+0000 7fdaccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888091 cookie 94547083376048 notifier 4763 bl.length()=207 2024-09-13T23:06:37.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.256+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 39 ==== osd_op_reply(140 notify.0 [notify cookie 94547083644528 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdbe404e040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.256+0000 7fdaccff9640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:141 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fdaac003d60 con 0x7fdbd404d4b0 2024-09-13T23:06:37.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.257+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 40 ==== watch-notify(notify_complete (2) cookie 94547083644528 notify 146028888091 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fd7552dd90 con 0x7fdbd404d4b0 2024-09-13T23:06:37.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.257+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 41 ==== osd_op_reply(141 notify.0 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbe404e040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.257+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:142 4.6 4:62c26400:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd75561790 con 0x55fd75516fc0 2024-09-13T23:06:37.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.257+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:143 4.5 4:a0d4b7a9:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7555b360 con 0x7fdbd404d4b0 2024-09-13T23:06:37.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.257+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:144 4.32 4:4f5857b2:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7555bbf0 con 0x55fd75510d70 2024-09-13T23:06:37.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.257+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:145 4.11 4:8a1b5a9e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7555b360 con 0x7fdbe4031040 2024-09-13T23:06:37.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.257+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:146 4.35 4:ad6a2e91:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd75561790 con 0x55fd75510d70 2024-09-13T23:06:37.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.257+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:147 4.25 4:a797616a:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7555bbf0 con 0x7fdbd404d4b0 2024-09-13T23:06:37.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.257+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:148 4.e 4:72889151:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7555b360 con 0x7fdbd404d4b0 2024-09-13T23:06:37.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.257+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:149 4.0 4:012594ce:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7555bbf0 con 0x55fd75516fc0 2024-09-13T23:06:37.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.257+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:150 4.2d 4:b57db1fd:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd75573130 con 0x7fdbe4031040 2024-09-13T23:06:37.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.257+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:151 4.5 4:a2208176:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd75573af0 con 0x7fdbd404d4b0 2024-09-13T23:06:37.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.257+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:152 4.f 4:f030fdc2:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd755744b0 con 0x55fd75510d70 2024-09-13T23:06:37.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.258+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 44 ==== osd_op_reply(146 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.4 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdbdc0c0040 con 0x55fd75510d70 2024-09-13T23:06:37.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.258+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 34 ==== osd_op_reply(142 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.0 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdbd407b060 con 0x55fd75516fc0 2024-09-13T23:06:37.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.259+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 42 ==== osd_op_reply(147 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.5 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdbe404e040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.259+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 45 ==== osd_op_reply(144 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.2 [delete] v34'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdbdc0c0040 con 0x55fd75510d70 2024-09-13T23:06:37.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.259+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 29 ==== osd_op_reply(145 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.3 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdbdc0c0040 con 0x7fdbe4031040 2024-09-13T23:06:37.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.260+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 46 ==== osd_op_reply(152 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.10 [delete] v34'3 uv3 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fdbdc0c0040 con 0x55fd75510d70 2024-09-13T23:06:37.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.260+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 35 ==== osd_op_reply(149 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.7 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdbd407b060 con 0x55fd75516fc0 2024-09-13T23:06:37.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.260+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 43 ==== osd_op_reply(143 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.1 [delete] v34'14 uv14 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdbe404e040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.261+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 44 ==== osd_op_reply(151 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.9 [delete] v34'15 uv15 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdbe404e040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.261+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 45 ==== osd_op_reply(148 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.6 [delete] v34'11 uv11 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdbe404e040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.262+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 30 ==== osd_op_reply(150 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9.8 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdbdc0c0040 con 0x7fdbe4031040 2024-09-13T23:06:37.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.262+0000 7fdbee011800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 : miss 2024-09-13T23:06:37.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.262+0000 7fdbee011800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.262+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:153 6.f 6:f4785176:::pubsub..bucket.myfoo6%2fa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75561790 con 0x7fdbd404d4b0 2024-09-13T23:06:37.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.262+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 46 ==== osd_op_reply(153 pubsub..bucket.myfoo6/a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fdbe404e040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.262+0000 7fdbee011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:37.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.262+0000 7fdbee011800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 info.flags=0x0 2024-09-13T23:06:37.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.262+0000 7fdbee011800 10 adding default.rgw.log++pubsub..bucket.myfoo6/a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 to cache LRU end 2024-09-13T23:06:37.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.262+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:154 6.f 6:f4785176:::pubsub..bucket.myfoo6%2fa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd75561790 con 0x7fdbd404d4b0 2024-09-13T23:06:37.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.263+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 47 ==== osd_op_reply(154 pubsub..bucket.myfoo6/a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.9 [delete] v34'33 uv27 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fdbe404e040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.263+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd75561790 con 0x55fd75510d70 2024-09-13T23:06:37.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.264+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 47 ==== osd_op_reply(155 bud.buckets [call] v34'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdbdc0c0040 con 0x55fd75510d70 2024-09-13T23:06:37.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.264+0000 7fdbee011800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-13T23:06:37.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.264+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd75561790 con 0x55fd75510d70 2024-09-13T23:06:37.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.265+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 48 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v34'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fdbdc0c0040 con 0x55fd75510d70 2024-09-13T23:06:37.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.265+0000 7fdbee011800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-13T23:06:37.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.265+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94547083644400 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75561790 con 0x7fdbe4031040 2024-09-13T23:06:37.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.265+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 31 ==== watch-notify(notify (1) cookie 94547083388960 notify 146028888100 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55fd7555c4d0 con 0x7fdbe4031040 2024-09-13T23:06:37.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.265+0000 7fdaccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888100 cookie 94547083388960 notifier 4763 bl.length()=170 2024-09-13T23:06:37.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.265+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 32 ==== osd_op_reply(157 notify.5 [notify cookie 94547083644400 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdbdc0c0040 con 0x7fdbe4031040 2024-09-13T23:06:37.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.265+0000 7fdaccff9640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fdaac003d60 con 0x7fdbe4031040 2024-09-13T23:06:37.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.265+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 33 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbdc0c0040 con 0x7fdbe4031040 2024-09-13T23:06:37.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.265+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 34 ==== watch-notify(notify_complete (2) cookie 94547083644400 notify 146028888100 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdbdc096080 con 0x7fdbe4031040 2024-09-13T23:06:37.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.266+0000 7fdbee011800 10 removing email index: 2024-09-13T23:06:37.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.266+0000 7fdbee011800 10 removing user buckets index 2024-09-13T23:06:37.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.266+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd75561790 con 0x55fd75510d70 2024-09-13T23:06:37.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.266+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 49 ==== osd_op_reply(159 bud.buckets [delete] v34'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdbdc0c0040 con 0x55fd75510d70 2024-09-13T23:06:37.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.266+0000 7fdbee011800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-13T23:06:37.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.266+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94547083644400 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75561790 con 0x7fdbe4031040 2024-09-13T23:06:37.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.267+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 35 ==== watch-notify(notify (1) cookie 94547083395744 notify 146028888101 ret 0) ==== 202+0+0 (crc 0 0 0) 0x7fdbdc096080 con 0x7fdbe4031040 2024-09-13T23:06:37.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.267+0000 7fdabbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888101 cookie 94547083395744 notifier 4763 bl.length()=160 2024-09-13T23:06:37.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.267+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 36 ==== osd_op_reply(160 notify.6 [notify cookie 94547083644400 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdbdc0c0040 con 0x7fdbe4031040 2024-09-13T23:06:37.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.267+0000 7fdabbfff640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fda1c0032c0 con 0x7fdbe4031040 2024-09-13T23:06:37.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.267+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 37 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbdc0c0040 con 0x7fdbe4031040 2024-09-13T23:06:37.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.267+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 38 ==== watch-notify(notify_complete (2) cookie 94547083644400 notify 146028888101 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fd754d9e20 con 0x7fdbe4031040 2024-09-13T23:06:37.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.267+0000 7fdbee011800 10 removing user index: bud 2024-09-13T23:06:37.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.267+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd75561790 con 0x7fdbd404d4b0 2024-09-13T23:06:37.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.268+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 48 ==== osd_op_reply(162 bud [call,call,delete] v34'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fdbe404e040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.268+0000 7fdbee011800 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-13T23:06:37.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.268+0000 7fdbee011800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-13T23:06:37.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.268+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94547083644400 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd75573130 con 0x7fdbe4031040 2024-09-13T23:06:37.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.269+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 39 ==== watch-notify(notify (1) cookie 94547083388960 notify 146028888102 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55fd754d9e20 con 0x7fdbe4031040 2024-09-13T23:06:37.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.269+0000 7fdaccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888102 cookie 94547083388960 notifier 4763 bl.length()=152 2024-09-13T23:06:37.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.269+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 40 ==== osd_op_reply(163 notify.5 [notify cookie 94547083644400 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdbdc0c0040 con 0x7fdbe4031040 2024-09-13T23:06:37.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.269+0000 7fdaccff9640 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fdaac003d60 con 0x7fdbe4031040 2024-09-13T23:06:37.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.269+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 41 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbdc0c0040 con 0x7fdbe4031040 2024-09-13T23:06:37.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.269+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 42 ==== watch-notify(notify_complete (2) cookie 94547083644400 notify 146028888102 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fd754d9900 con 0x7fdbe4031040 2024-09-13T23:06:37.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.270+0000 7fda9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:06:37.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.270+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94547083398496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd75573130 con 0x55fd75510d70 2024-09-13T23:06:37.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.271+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 50 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94547083398496] v34'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdbdc0c0040 con 0x55fd75510d70 2024-09-13T23:06:37.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.271+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94547083376048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd75573130 con 0x7fdbd404d4b0 2024-09-13T23:06:37.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.273+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 49 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94547083376048] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbe404e040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.273+0000 7fdbee011800 20 remove_watcher() i=0 2024-09-13T23:06:37.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.273+0000 7fdbee011800 2 removed watcher, disabling cache 2024-09-13T23:06:37.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.273+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94547083380080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd75573130 con 0x55fd75510d70 2024-09-13T23:06:37.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.275+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 51 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94547083380080] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbdc0c0040 con 0x55fd75510d70 2024-09-13T23:06:37.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.275+0000 7fdbee011800 20 remove_watcher() i=1 2024-09-13T23:06:37.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.275+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94547083384144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7551c570 con 0x55fd75516fc0 2024-09-13T23:06:37.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.276+0000 7fdbe8f9b640 1 -- 172.21.15.164:0/3498079506 <== osd.3 v2:172.21.15.164:6816/93809510 36 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94547083384144] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbd407b060 con 0x55fd75516fc0 2024-09-13T23:06:37.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.276+0000 7fdbee011800 20 remove_watcher() i=2 2024-09-13T23:06:37.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.276+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94547083386416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7551c570 con 0x7fdbd404d4b0 2024-09-13T23:06:37.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.277+0000 7fdbe9f9d640 1 -- 172.21.15.164:0/3498079506 <== osd.2 v2:172.21.15.164:6808/3795914978 50 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94547083386416] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbe404e040 con 0x7fdbd404d4b0 2024-09-13T23:06:37.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.277+0000 7fdbee011800 20 remove_watcher() i=3 2024-09-13T23:06:37.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.277+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94547083391664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7551de30 con 0x55fd75510d70 2024-09-13T23:06:37.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.278+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.1 v2:172.21.15.164:6800/4060509701 52 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94547083391664] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbdc0c0040 con 0x55fd75510d70 2024-09-13T23:06:37.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.278+0000 7fdbee011800 20 remove_watcher() i=4 2024-09-13T23:06:37.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.278+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94547083388960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7551de30 con 0x7fdbe4031040 2024-09-13T23:06:37.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.279+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 43 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94547083388960] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbdc0c0040 con 0x7fdbe4031040 2024-09-13T23:06:37.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.279+0000 7fdbee011800 20 remove_watcher() i=5 2024-09-13T23:06:37.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.279+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94547083395744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7551e820 con 0x7fdbe4031040 2024-09-13T23:06:37.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.280+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 44 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94547083395744] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbdc0c0040 con 0x7fdbe4031040 2024-09-13T23:06:37.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.280+0000 7fdbee011800 20 remove_watcher() i=6 2024-09-13T23:06:37.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.280+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94547083397280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd7551de30 con 0x7fdbe4031040 2024-09-13T23:06:37.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.281+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 <== osd.0 v2:172.21.15.17:6800/489863589 45 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94547083397280] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbdc0c0040 con 0x7fdbe4031040 2024-09-13T23:06:37.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.281+0000 7fdbee011800 20 remove_watcher() i=7 2024-09-13T23:06:37.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.281+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fdbe4031040 msgr2=0x7fdbe4032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.281+0000 7fdbee011800 1 --2- 172.21.15.164:0/3498079506 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fdbe4031040 0x7fdbe4032430 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.281+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55fd75510d70 msgr2=0x55fd75513230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.281+0000 7fdbee011800 1 --2- 172.21.15.164:0/3498079506 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55fd75510d70 0x55fd75513230 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.281+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fdbd404d4b0 msgr2=0x7fdbd40152e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.281+0000 7fdbee011800 1 --2- 172.21.15.164:0/3498079506 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fdbd404d4b0 0x7fdbd40152e0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.281+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55fd75516fc0 msgr2=0x55fd755193b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.281+0000 7fdbee011800 1 --2- 172.21.15.164:0/3498079506 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55fd75516fc0 0x55fd755193b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.281+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdab4036b90 msgr2=0x7fdab4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.281+0000 7fdbee011800 1 --2- 172.21.15.164:0/3498079506 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdab4036b90 0x7fdab4039050 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55fd754dd950 tx=0x7fdbe401f000 comp rx=0 tx=0).stop 2024-09-13T23:06:37.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.281+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd754fdf40 msgr2=0x55fd75505450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.281+0000 7fdbe979c640 1 -- 172.21.15.164:0/3498079506 reap_dead start 2024-09-13T23:06:37.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.281+0000 7fdbee011800 1 --2- 172.21.15.164:0/3498079506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd754fdf40 0x55fd75505450 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x55fd754f8f10 tx=0x7fdbd404d030 comp rx=0 tx=0).stop 2024-09-13T23:06:37.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.281+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 shutdown_connections 2024-09-13T23:06:37.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.281+0000 7fdbee011800 1 --2- 172.21.15.164:0/3498079506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd754fdf40 0x55fd75505450 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.281+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 >> 172.21.15.164:0/3498079506 conn(0x55fd754fa2a0 msgr2=0x55fd754f8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:37.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.281+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 shutdown_connections 2024-09-13T23:06:37.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.281+0000 7fdbee011800 1 -- 172.21.15.164:0/3498079506 wait complete. 2024-09-13T23:06:37.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.282+0000 7fdbee011800 1 -- 172.21.15.164:0/2915531159 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdac4036b90 msgr2=0x7fdac4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.282+0000 7fdbee011800 1 --2- 172.21.15.164:0/2915531159 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdac4036b90 0x7fdac4039050 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55fd754e1930 tx=0x7fdbe4005840 comp rx=0 tx=0).stop 2024-09-13T23:06:37.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.282+0000 7fdbee011800 1 -- 172.21.15.164:0/2915531159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd754f11d0 msgr2=0x55fd754f15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.282+0000 7fdbee011800 1 --2- 172.21.15.164:0/2915531159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd754f11d0 0x55fd754f15f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fdbd400efd0 tx=0x7fdbd400d7a0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.282+0000 7fdbee011800 1 -- 172.21.15.164:0/2915531159 shutdown_connections 2024-09-13T23:06:37.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.282+0000 7fdbee011800 1 --2- 172.21.15.164:0/2915531159 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdac4036b90 0x7fdac4039050 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.282+0000 7fdbee011800 1 --2- 172.21.15.164:0/2915531159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd754f11d0 0x55fd754f15f0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.282+0000 7fdbee011800 1 -- 172.21.15.164:0/2915531159 >> 172.21.15.164:0/2915531159 conn(0x55fd754e6160 msgr2=0x55fd754e8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:37.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.282+0000 7fdbee011800 1 -- 172.21.15.164:0/2915531159 shutdown_connections 2024-09-13T23:06:37.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.282+0000 7fdbee011800 1 -- 172.21.15.164:0/2915531159 wait complete. 2024-09-13T23:06:37.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.282+0000 7fdbee011800 1 -- 172.21.15.164:0/1617932248 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55fd754de420 msgr2=0x55fd754e0810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.282+0000 7fdbee011800 1 --2- 172.21.15.164:0/1617932248 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55fd754de420 0x55fd754e0810 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.282+0000 7fdbee011800 1 -- 172.21.15.164:0/1617932248 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdad0036b90 msgr2=0x7fdad0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.282+0000 7fdbee011800 1 --2- 172.21.15.164:0/1617932248 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdad0036b90 0x7fdad0039050 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4001d90 tx=0x7fdbd40012f0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.282+0000 7fdbee011800 1 -- 172.21.15.164:0/1617932248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd753565b0 msgr2=0x55fd754d93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.282+0000 7fdbee011800 1 --2- 172.21.15.164:0/1617932248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd753565b0 0x55fd754d93c0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x55fd754d2900 tx=0x7fdbdc002fb0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.282+0000 7fdbee011800 1 -- 172.21.15.164:0/1617932248 shutdown_connections 2024-09-13T23:06:37.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.282+0000 7fdbee011800 1 --2- 172.21.15.164:0/1617932248 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55fd754de420 0x55fd754e0810 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.282+0000 7fdbee011800 1 --2- 172.21.15.164:0/1617932248 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fdad0036b90 0x7fdad0039050 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.282+0000 7fdbee011800 1 --2- 172.21.15.164:0/1617932248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fd753565b0 0x55fd754d93c0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.282+0000 7fdbee011800 1 -- 172.21.15.164:0/1617932248 >> 172.21.15.164:0/1617932248 conn(0x55fd753dbfe0 msgr2=0x55fd754cbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:37.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.282+0000 7fdbee011800 1 -- 172.21.15.164:0/1617932248 shutdown_connections 2024-09-13T23:06:37.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.282+0000 7fdbee011800 1 -- 172.21.15.164:0/1617932248 wait complete. 2024-09-13T23:06:37.292 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-13T23:06:37.292 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-13T23:06:37.293 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-13T23:06:37.337 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:06:37.338 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:06:37.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.337+0000 7fb06b413800 1 Processor -- start 2024-09-13T23:06:37.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.337+0000 7fb06b413800 1 -- start start 2024-09-13T23:06:37.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.337+0000 7fb06b413800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55d440cf3610 0x55d440d82220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.337+0000 7fb06b413800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d440c3eb30 con 0x55d440d82760 2024-09-13T23:06:37.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.337+0000 7fb06b413800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55d440c20360 con 0x55d440cf3610 2024-09-13T23:06:37.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.338+0000 7fb066b3d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55d440cf3610 0x55d440d82220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.338+0000 7fb06633c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55d440d82760 0x55d440d84b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:56014/0 (socket says 172.21.15.164:56014) 2024-09-13T23:06:37.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.338+0000 7fb066b3d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55d440cf3610 0x55d440d82220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:45096/0 (socket says 172.21.15.164:45096) 2024-09-13T23:06:37.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.338+0000 7fb06633c640 1 -- 172.21.15.164:0/3414942067 learned_addr learned my addr 172.21.15.164:0/3414942067 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:06:37.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.338+0000 7fb066b3d640 1 -- 172.21.15.164:0/3414942067 >> v1:172.21.15.17:6789/0 conn(0x55d440d82760 legacy=0x55d440d84b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.338+0000 7fb066b3d640 1 -- 172.21.15.164:0/3414942067 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d440c46e00 con 0x55d440cf3610 2024-09-13T23:06:37.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.340+0000 7fb066b3d640 1 --2- 172.21.15.164:0/3414942067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440cf3610 0x55d440d82220 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb05800a470 tx=0x7fb058045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a34e13d9a8bcbe12 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.340+0000 7fb065b3b640 1 -- 172.21.15.164:0/3414942067 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb058053570 con 0x55d440cf3610 2024-09-13T23:06:37.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.340+0000 7fb065b3b640 1 -- 172.21.15.164:0/3414942067 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb058058070 con 0x55d440cf3610 2024-09-13T23:06:37.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.340+0000 7fb065b3b640 1 -- 172.21.15.164:0/3414942067 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb058053880 con 0x55d440cf3610 2024-09-13T23:06:37.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.340+0000 7fb06b413800 1 -- 172.21.15.164:0/3414942067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440cf3610 msgr2=0x55d440d82220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.340+0000 7fb06b413800 1 --2- 172.21.15.164:0/3414942067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440cf3610 0x55d440d82220 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb05800a470 tx=0x7fb058045a20 comp rx=0 tx=0).stop 2024-09-13T23:06:37.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.340+0000 7fb06b413800 1 -- 172.21.15.164:0/3414942067 shutdown_connections 2024-09-13T23:06:37.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.340+0000 7fb06b413800 1 --2- 172.21.15.164:0/3414942067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440cf3610 0x55d440d82220 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.340+0000 7fb06b413800 1 -- 172.21.15.164:0/3414942067 >> 172.21.15.164:0/3414942067 conn(0x55d440d79db0 msgr2=0x55d440d7c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:37.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.341+0000 7fb06b413800 1 -- 172.21.15.164:0/3414942067 shutdown_connections 2024-09-13T23:06:37.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.341+0000 7fb06b413800 1 -- 172.21.15.164:0/3414942067 wait complete. 2024-09-13T23:06:37.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.354+0000 7fb06b413800 1 Processor -- start 2024-09-13T23:06:37.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.354+0000 7fb06b413800 1 -- start start 2024-09-13T23:06:37.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.355+0000 7fb06b413800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440cf3610 0x55d440e6e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.355+0000 7fb06b413800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d440ccb360 con 0x55d440cf3610 2024-09-13T23:06:37.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.355+0000 7fb066b3d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440cf3610 0x55d440e6e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.355+0000 7fb066b3d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440cf3610 0x55d440e6e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:45110/0 (socket says 172.21.15.164:45110) 2024-09-13T23:06:37.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.355+0000 7fb066b3d640 1 -- 172.21.15.164:0/3223908122 learned_addr learned my addr 172.21.15.164:0/3223908122 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:37.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.355+0000 7fb066b3d640 1 -- 172.21.15.164:0/3223908122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d440c18bc0 con 0x55d440cf3610 2024-09-13T23:06:37.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.355+0000 7fb066b3d640 1 --2- 172.21.15.164:0/3223908122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440cf3610 0x55d440e6e880 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fb058025c20 tx=0x7fb058051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd5479dd74ceffa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.356+0000 7faf54e09640 1 -- 172.21.15.164:0/3223908122 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb058053ba0 con 0x55d440cf3610 2024-09-13T23:06:37.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.356+0000 7faf54e09640 1 -- 172.21.15.164:0/3223908122 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb058063030 con 0x55d440cf3610 2024-09-13T23:06:37.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.356+0000 7faf54e09640 1 -- 172.21.15.164:0/3223908122 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb058053440 con 0x55d440cf3610 2024-09-13T23:06:37.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.357+0000 7fb06b413800 1 -- 172.21.15.164:0/3223908122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440cf3610 msgr2=0x55d440e6e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.357+0000 7fb06b413800 1 --2- 172.21.15.164:0/3223908122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440cf3610 0x55d440e6e880 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fb058025c20 tx=0x7fb058051000 comp rx=0 tx=0).stop 2024-09-13T23:06:37.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.357+0000 7fb06b413800 1 -- 172.21.15.164:0/3223908122 shutdown_connections 2024-09-13T23:06:37.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.357+0000 7fb06b413800 1 --2- 172.21.15.164:0/3223908122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440cf3610 0x55d440e6e880 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.357+0000 7fb06b413800 1 -- 172.21.15.164:0/3223908122 >> 172.21.15.164:0/3223908122 conn(0x55d440d79db0 msgr2=0x55d440e6a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:37.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.357+0000 7fb06b413800 1 -- 172.21.15.164:0/3223908122 shutdown_connections 2024-09-13T23:06:37.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.357+0000 7fb06b413800 1 -- 172.21.15.164:0/3223908122 wait complete. 2024-09-13T23:06:37.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.357+0000 7fb06b413800 1 Processor -- start 2024-09-13T23:06:37.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.357+0000 7fb06b413800 1 -- start start 2024-09-13T23:06:37.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.357+0000 7fb06b413800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440cf3610 0x55d440e76200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.357+0000 7fb06b413800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d440d86600 con 0x55d440cf3610 2024-09-13T23:06:37.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.358+0000 7fb066b3d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440cf3610 0x55d440e76200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.358+0000 7fb066b3d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440cf3610 0x55d440e76200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:45122/0 (socket says 172.21.15.164:45122) 2024-09-13T23:06:37.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.358+0000 7fb066b3d640 1 -- 172.21.15.164:0/2017208591 learned_addr learned my addr 172.21.15.164:0/2017208591 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:37.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.358+0000 7fb066b3d640 1 -- 172.21.15.164:0/2017208591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d440c2cfe0 con 0x55d440cf3610 2024-09-13T23:06:37.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.358+0000 7fb066b3d640 1 --2- 172.21.15.164:0/2017208591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440cf3610 0x55d440e76200 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x55d440e6f6e0 tx=0x7fb058002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.358+0000 7faf53606640 1 -- 172.21.15.164:0/2017208591 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb058078070 con 0x55d440cf3610 2024-09-13T23:06:37.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.358+0000 7faf53606640 1 -- 172.21.15.164:0/2017208591 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb058053570 con 0x55d440cf3610 2024-09-13T23:06:37.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.358+0000 7faf53606640 1 -- 172.21.15.164:0/2017208591 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb058053850 con 0x55d440cf3610 2024-09-13T23:06:37.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.358+0000 7fb06b413800 1 -- 172.21.15.164:0/2017208591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d440e76740 con 0x55d440cf3610 2024-09-13T23:06:37.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.358+0000 7fb06b413800 1 -- 172.21.15.164:0/2017208591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d440e76cc0 con 0x55d440cf3610 2024-09-13T23:06:37.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.359+0000 7faf53606640 1 -- 172.21.15.164:0/2017208591 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb05807b070 con 0x55d440cf3610 2024-09-13T23:06:37.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.359+0000 7faf53606640 1 --2- 172.21.15.164:0/2017208591 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faf4c036b40 0x7faf4c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.359+0000 7faf53606640 1 -- 172.21.15.164:0/2017208591 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb058070070 con 0x55d440cf3610 2024-09-13T23:06:37.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.359+0000 7fb06633c640 1 --2- 172.21.15.164:0/2017208591 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faf4c036b40 0x7faf4c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.360+0000 7fb06b413800 1 --2- 172.21.15.164:0/2017208591 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d440d82760 0x55d440e7d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.360+0000 7fb06b413800 1 -- 172.21.15.164:0/2017208591 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440e7d890 con 0x55d440d82760 2024-09-13T23:06:37.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.360+0000 7fb06733e640 1 --2- 172.21.15.164:0/2017208591 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d440d82760 0x55d440e7d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.360+0000 7fb06633c640 1 --2- 172.21.15.164:0/2017208591 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faf4c036b40 0x7faf4c039000 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb05c000f60 tx=0x7fb05c0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.360+0000 7fb06733e640 1 --2- 172.21.15.164:0/2017208591 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d440d82760 0x55d440e7d270 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.360+0000 7fb06733e640 1 -- 172.21.15.164:0/2017208591 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb06000a4a0 con 0x55d440d82760 2024-09-13T23:06:37.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.360+0000 7fb06b413800 1 -- 172.21.15.164:0/2017208591 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440e7a840 con 0x55d440d82760 2024-09-13T23:06:37.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.361+0000 7fb06733e640 1 -- 172.21.15.164:0/2017208591 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb06000a4a0 con 0x55d440d82760 2024-09-13T23:06:37.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.361+0000 7fb06b413800 1 -- 172.21.15.164:0/2017208591 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440e7f700 con 0x55d440d82760 2024-09-13T23:06:37.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.361+0000 7fb06733e640 1 -- 172.21.15.164:0/2017208591 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb06000a4a0 con 0x55d440d82760 2024-09-13T23:06:37.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.361+0000 7fb06b413800 1 -- 172.21.15.164:0/2017208591 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440e7e7e0 con 0x55d440d82760 2024-09-13T23:06:37.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.361+0000 7fb06733e640 1 -- 172.21.15.164:0/2017208591 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb06000a4a0 con 0x55d440d82760 2024-09-13T23:06:37.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.361+0000 7fb06b413800 1 -- 172.21.15.164:0/2017208591 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440e7ec30 con 0x55d440d82760 2024-09-13T23:06:37.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.361+0000 7fb06733e640 1 -- 172.21.15.164:0/2017208591 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb06000a4a0 con 0x55d440d82760 2024-09-13T23:06:37.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.362+0000 7fb06b413800 1 Processor -- start 2024-09-13T23:06:37.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.362+0000 7fb06b413800 1 -- start start 2024-09-13T23:06:37.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.362+0000 7fb06b413800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440e8dc70 0x55d440e8e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.362+0000 7fb06b413800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d440c1a580 con 0x55d440e8dc70 2024-09-13T23:06:37.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.362+0000 7fb06633c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440e8dc70 0x55d440e8e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.362+0000 7fb06633c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440e8dc70 0x55d440e8e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:45130/0 (socket says 172.21.15.164:45130) 2024-09-13T23:06:37.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.362+0000 7fb06633c640 1 -- 172.21.15.164:0/3824863339 learned_addr learned my addr 172.21.15.164:0/3824863339 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:37.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.362+0000 7fb06633c640 1 -- 172.21.15.164:0/3824863339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d440e8e5d0 con 0x55d440e8dc70 2024-09-13T23:06:37.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.363+0000 7fb06633c640 1 --2- 172.21.15.164:0/3824863339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440e8dc70 0x55d440e8e090 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb05c001ed0 tx=0x7fb05c00d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.363+0000 7faf50e01640 1 -- 172.21.15.164:0/3824863339 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb05c01b550 con 0x55d440e8dc70 2024-09-13T23:06:37.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.363+0000 7faf50e01640 1 -- 172.21.15.164:0/3824863339 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb05c01b6f0 con 0x55d440e8dc70 2024-09-13T23:06:37.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.363+0000 7fb06b413800 1 -- 172.21.15.164:0/3824863339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d440e8e860 con 0x55d440e8dc70 2024-09-13T23:06:37.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.363+0000 7faf50e01640 1 -- 172.21.15.164:0/3824863339 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb05c01b9d0 con 0x55d440e8dc70 2024-09-13T23:06:37.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.363+0000 7fb06b413800 1 -- 172.21.15.164:0/3824863339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d440e91540 con 0x55d440e8dc70 2024-09-13T23:06:37.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.364+0000 7faf50e01640 1 -- 172.21.15.164:0/3824863339 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb05c023020 con 0x55d440e8dc70 2024-09-13T23:06:37.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.364+0000 7faf50e01640 1 --2- 172.21.15.164:0/3824863339 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faf40036b30 0x7faf40038ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.364+0000 7faf50e01640 1 -- 172.21.15.164:0/3824863339 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb05c021020 con 0x55d440e8dc70 2024-09-13T23:06:37.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.364+0000 7fb06733e640 1 --2- 172.21.15.164:0/3824863339 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faf40036b30 0x7faf40038ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.364+0000 7fb06b413800 1 Processor -- start 2024-09-13T23:06:37.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.364+0000 7fb06733e640 1 --2- 172.21.15.164:0/3824863339 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faf40036b30 0x7faf40038ff0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55d440e7e300 tx=0x7fb060005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.364+0000 7fb06b413800 1 -- start start 2024-09-13T23:06:37.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.365+0000 7fb06b413800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440e9a980 0x55d440e9ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.365+0000 7fb06b413800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d440e6efd0 con 0x55d440e9a980 2024-09-13T23:06:37.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.365+0000 7fb06633c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440e9a980 0x55d440e9ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.365+0000 7fb06633c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440e9a980 0x55d440e9ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:45132/0 (socket says 172.21.15.164:45132) 2024-09-13T23:06:37.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.365+0000 7fb06633c640 1 -- 172.21.15.164:0/3328173890 learned_addr learned my addr 172.21.15.164:0/3328173890 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:37.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.365+0000 7fb06633c640 1 -- 172.21.15.164:0/3328173890 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d440e9b350 con 0x55d440e9a980 2024-09-13T23:06:37.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.365+0000 7fb06633c640 1 --2- 172.21.15.164:0/3328173890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440e9a980 0x55d440e9ad80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fb05c04d180 tx=0x7fb05c046be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbbde91db3332e90 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.365+0000 7faf4a7fc640 1 -- 172.21.15.164:0/3328173890 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb05c01be20 con 0x55d440e9a980 2024-09-13T23:06:37.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.365+0000 7faf4a7fc640 1 -- 172.21.15.164:0/3328173890 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb05c046070 con 0x55d440e9a980 2024-09-13T23:06:37.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.365+0000 7faf4a7fc640 1 -- 172.21.15.164:0/3328173890 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb05c00c360 con 0x55d440e9a980 2024-09-13T23:06:37.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.366+0000 7fb06b413800 1 -- 172.21.15.164:0/3328173890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440e9a980 msgr2=0x55d440e9ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.366+0000 7fb06b413800 1 --2- 172.21.15.164:0/3328173890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440e9a980 0x55d440e9ad80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fb05c04d180 tx=0x7fb05c046be0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.366+0000 7fb06b413800 1 -- 172.21.15.164:0/3328173890 shutdown_connections 2024-09-13T23:06:37.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.366+0000 7fb06b413800 1 --2- 172.21.15.164:0/3328173890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440e9a980 0x55d440e9ad80 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.366+0000 7fb06b413800 1 -- 172.21.15.164:0/3328173890 >> 172.21.15.164:0/3328173890 conn(0x55d440e96ce0 msgr2=0x55d440e94de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:37.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.366+0000 7fb06b413800 1 -- 172.21.15.164:0/3328173890 shutdown_connections 2024-09-13T23:06:37.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.366+0000 7fb06b413800 1 -- 172.21.15.164:0/3328173890 wait complete. 2024-09-13T23:06:37.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.366+0000 7fb06b413800 1 Processor -- start 2024-09-13T23:06:37.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.366+0000 7fb06b413800 1 -- start start 2024-09-13T23:06:37.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.366+0000 7fb06b413800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440e9a980 0x55d440ea1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.366+0000 7fb06b413800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d440e9b9c0 con 0x55d440e9a980 2024-09-13T23:06:37.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.367+0000 7fb06633c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440e9a980 0x55d440ea1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.367+0000 7fb06633c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440e9a980 0x55d440ea1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:45134/0 (socket says 172.21.15.164:45134) 2024-09-13T23:06:37.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.367+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 learned_addr learned my addr 172.21.15.164:0/4071784835 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:06:37.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.367+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d440ea23d0 con 0x55d440e9a980 2024-09-13T23:06:37.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.367+0000 7fb06633c640 1 --2- 172.21.15.164:0/4071784835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440e9a980 0x55d440ea1e90 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb05c04d180 tx=0x7fb05c04d110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.367+0000 7faf48ff9640 1 -- 172.21.15.164:0/4071784835 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb05c01be20 con 0x55d440e9a980 2024-09-13T23:06:37.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.367+0000 7faf48ff9640 1 -- 172.21.15.164:0/4071784835 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb05c00c360 con 0x55d440e9a980 2024-09-13T23:06:37.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.367+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d440ea2660 con 0x55d440e9a980 2024-09-13T23:06:37.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.367+0000 7faf48ff9640 1 -- 172.21.15.164:0/4071784835 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb05c046d10 con 0x55d440e9a980 2024-09-13T23:06:37.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.367+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d440ea2660 con 0x55d440e9a980 2024-09-13T23:06:37.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.368+0000 7faf48ff9640 1 -- 172.21.15.164:0/4071784835 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb05c025980 con 0x55d440e9a980 2024-09-13T23:06:37.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.368+0000 7faf48ff9640 1 --2- 172.21.15.164:0/4071784835 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faf30036b90 0x7faf30039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.368+0000 7faf48ff9640 1 -- 172.21.15.164:0/4071784835 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb05c039d10 con 0x55d440e9a980 2024-09-13T23:06:37.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.368+0000 7fb06733e640 1 --2- 172.21.15.164:0/4071784835 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faf30036b90 0x7faf30039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.369+0000 7fb06733e640 1 --2- 172.21.15.164:0/4071784835 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faf30036b90 0x7faf30039050 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x55d440e7a790 tx=0x7fb06001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.369+0000 7fb06b413800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.369+0000 7fb06b413800 1 --2- 172.21.15.164:0/4071784835 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d440ead730 0x55d440eafbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.369+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb0340 con 0x55d440ead730 2024-09-13T23:06:37.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.369+0000 7fb066b3d640 1 --2- 172.21.15.164:0/4071784835 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d440ead730 0x55d440eafbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.370+0000 7fb066b3d640 1 --2- 172.21.15.164:0/4071784835 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d440ead730 0x55d440eafbf0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.370+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.370+0000 7fb06b413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:37.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.370+0000 7fb06b413800 20 realm 2024-09-13T23:06:37.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.370+0000 7fb06b413800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.370+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb0750 con 0x55d440ead730 2024-09-13T23:06:37.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.370+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.370+0000 7fb06b413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:37.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.370+0000 7fb06b413800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:06:37.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.370+0000 7fb06b413800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.370+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb1020 con 0x55d440ead730 2024-09-13T23:06:37.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.370+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.370+0000 7fb06b413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:37.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.370+0000 7fb06b413800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.370+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb13c0 con 0x55d440ead730 2024-09-13T23:06:37.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.370+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.370+0000 7fb06b413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:06:37.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.370+0000 7fb06b413800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.370+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb1c10 con 0x55d440ead730 2024-09-13T23:06:37.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.371+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.371+0000 7fb06b413800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:06:37.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.371+0000 7fb06b413800 20 searching for the correct realm 2024-09-13T23:06:37.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.371+0000 7fb06b413800 1 --2- 172.21.15.164:0/4071784835 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55d440eb3980 0x55d440eb5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.371+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x55d440eb3980 2024-09-13T23:06:37.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.371+0000 7fb06633c640 1 --2- 172.21.15.164:0/4071784835 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55d440eb3980 0x55d440eb5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.371+0000 7fb06633c640 1 --2- 172.21.15.164:0/4071784835 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55d440eb3980 0x55d440eb5d70 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.371+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.371+0000 7fb06633c640 1 --2- 172.21.15.164:0/4071784835 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fb05c033be0 0x7fb05c045180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.371+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x7fb05c033be0 2024-09-13T23:06:37.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.371+0000 7fb06733e640 1 --2- 172.21.15.164:0/4071784835 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fb05c033be0 0x7fb05c045180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.372+0000 7fb06733e640 1 --2- 172.21.15.164:0/4071784835 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fb05c033be0 0x7fb05c045180 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.372+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb06001f070 con 0x7fb05c033be0 2024-09-13T23:06:37.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.372+0000 7fb06733e640 1 --2- 172.21.15.164:0/4071784835 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fb060031040 0x7fb060032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:37.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.372+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x7fb060031040 2024-09-13T23:06:37.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.372+0000 7fb066b3d640 1 --2- 172.21.15.164:0/4071784835 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fb060031040 0x7fb060032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:37.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.373+0000 7fb066b3d640 1 --2- 172.21.15.164:0/4071784835 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fb060031040 0x7fb060032430 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:37.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.373+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05807a030 con 0x7fb060031040 2024-09-13T23:06:37.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.373+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x55d440ead730 2024-09-13T23:06:37.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.373+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.373+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x55d440ead730 2024-09-13T23:06:37.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.373+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.373+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x7fb060031040 2024-09-13T23:06:37.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.374+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05807a030 con 0x7fb060031040 2024-09-13T23:06:37.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.374+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x7fb060031040 2024-09-13T23:06:37.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.374+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05807a030 con 0x7fb060031040 2024-09-13T23:06:37.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.374+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x7fb05c033be0 2024-09-13T23:06:37.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.374+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb06001f070 con 0x7fb05c033be0 2024-09-13T23:06:37.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.374+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x55d440eb3980 2024-09-13T23:06:37.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.374+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.374+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x55d440ead730 2024-09-13T23:06:37.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.375+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.375+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x7fb060031040 2024-09-13T23:06:37.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.375+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05807a030 con 0x7fb060031040 2024-09-13T23:06:37.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.375+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x55d440ead730 2024-09-13T23:06:37.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.375+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.375+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x7fb05c033be0 2024-09-13T23:06:37.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.375+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb06001f070 con 0x7fb05c033be0 2024-09-13T23:06:37.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.375+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x55d440eb3980 2024-09-13T23:06:37.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.376+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.376+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x55d440eb3980 2024-09-13T23:06:37.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.376+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.376+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x7fb060031040 2024-09-13T23:06:37.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.376+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05807a030 con 0x7fb060031040 2024-09-13T23:06:37.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.376+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x55d440eb3980 2024-09-13T23:06:37.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.377+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.377+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x55d440eb3980 2024-09-13T23:06:37.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.377+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.377+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x55d440ead730 2024-09-13T23:06:37.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.377+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.377+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x55d440ead730 2024-09-13T23:06:37.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.377+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.377+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x7fb060031040 2024-09-13T23:06:37.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.378+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05807a030 con 0x7fb060031040 2024-09-13T23:06:37.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.378+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x55d440eb3980 2024-09-13T23:06:37.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.378+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.378+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x7fb05c033be0 2024-09-13T23:06:37.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.378+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb06001f070 con 0x7fb05c033be0 2024-09-13T23:06:37.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.378+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x55d440ead730 2024-09-13T23:06:37.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.378+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.378+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x7fb060031040 2024-09-13T23:06:37.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.379+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05807a030 con 0x7fb060031040 2024-09-13T23:06:37.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.379+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x55d440eb3980 2024-09-13T23:06:37.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.379+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.379+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x7fb060031040 2024-09-13T23:06:37.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.379+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05807a030 con 0x7fb060031040 2024-09-13T23:06:37.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.379+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x7fb05c033be0 2024-09-13T23:06:37.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.379+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb06001f070 con 0x7fb05c033be0 2024-09-13T23:06:37.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.379+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x55d440eb3980 2024-09-13T23:06:37.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.380+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.380+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x7fb05c033be0 2024-09-13T23:06:37.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.380+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb06001f070 con 0x7fb05c033be0 2024-09-13T23:06:37.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.380+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x55d440ead730 2024-09-13T23:06:37.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.380+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.380+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6380 con 0x7fb05c033be0 2024-09-13T23:06:37.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.380+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb060040040 con 0x7fb05c033be0 2024-09-13T23:06:37.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.380+0000 7fb06b413800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:06:37.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.380+0000 7fb06b413800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:06:37.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.380+0000 7fb06b413800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:06:37.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.380+0000 7fb06b413800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:06:37.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.380+0000 7fb06b413800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:06:37.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.380+0000 7fb06b413800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:06:37.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.380+0000 7fb06b413800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.380+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb2590 con 0x55d440ead730 2024-09-13T23:06:37.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.381+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.381+0000 7fb06b413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:37.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.381+0000 7fb06b413800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.381+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb2e30 con 0x55d440ead730 2024-09-13T23:06:37.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.381+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.381+0000 7fb06b413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:06:37.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.381+0000 7fb06b413800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.381+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb2e30 con 0x55d440ead730 2024-09-13T23:06:37.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.381+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.381+0000 7fb06b413800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:06:37.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.381+0000 7fb06b413800 20 zone default found 2024-09-13T23:06:37.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.381+0000 7fb06b413800 4 Realm: () 2024-09-13T23:06:37.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.381+0000 7fb06b413800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:06:37.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.381+0000 7fb06b413800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:06:37.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.381+0000 7fb06b413800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:06:37.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.381+0000 7fb06b413800 20 zonegroup default 2024-09-13T23:06:37.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.381+0000 7fb06b413800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.381+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb6800 con 0x7fb060031040 2024-09-13T23:06:37.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.381+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x7fb060031040 2024-09-13T23:06:37.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.381+0000 7fb06b413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:37.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.381+0000 7fb06b413800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.381+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb8240 con 0x55d440eb3980 2024-09-13T23:06:37.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.382+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.382+0000 7fb06b413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:37.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.382+0000 7fb06b413800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.382+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb8730 con 0x55d440eb3980 2024-09-13T23:06:37.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.382+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.382+0000 7fb06b413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:37.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.382+0000 7fb06b413800 20 started sync module instance, tier type = 2024-09-13T23:06:37.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.382+0000 7fb06b413800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:06:37.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.382+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb7680 con 0x7fb05c033be0 2024-09-13T23:06:37.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.383+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb060040040 con 0x7fb05c033be0 2024-09-13T23:06:37.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.383+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94370110601840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb9040 con 0x7fb05c033be0 2024-09-13T23:06:37.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.383+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb9890 con 0x55d440ead730 2024-09-13T23:06:37.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.384+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94370110601840] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb060040040 con 0x7fb05c033be0 2024-09-13T23:06:37.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.384+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.384+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94370110606224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440eb94e0 con 0x55d440ead730 2024-09-13T23:06:37.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.384+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440eba000 con 0x55d440eb3980 2024-09-13T23:06:37.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.386+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94370110606224] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.386+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.386+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94370110610128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440eba3f0 con 0x55d440eb3980 2024-09-13T23:06:37.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.386+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ebadf0 con 0x7fb05c033be0 2024-09-13T23:06:37.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.387+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94370110610128] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.387+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb060040040 con 0x7fb05c033be0 2024-09-13T23:06:37.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.387+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94370110607280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ebb1e0 con 0x7fb05c033be0 2024-09-13T23:06:37.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.387+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ebbc40 con 0x55d440ead730 2024-09-13T23:06:37.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.388+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94370110607280] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb060040040 con 0x7fb05c033be0 2024-09-13T23:06:37.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.388+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.388+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94370110613760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ebbc40 con 0x55d440ead730 2024-09-13T23:06:37.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.388+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ebc690 con 0x7fb060031040 2024-09-13T23:06:37.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.389+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94370110613760] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.390+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x7fb060031040 2024-09-13T23:06:37.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.390+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94370110617376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ebc650 con 0x7fb060031040 2024-09-13T23:06:37.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.390+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ebd0a0 con 0x7fb060031040 2024-09-13T23:06:37.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.391+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94370110617376] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x7fb060031040 2024-09-13T23:06:37.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.391+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x7fb060031040 2024-09-13T23:06:37.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.391+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94370110620544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ebd0a0 con 0x7fb060031040 2024-09-13T23:06:37.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.391+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ebda60 con 0x7fb060031040 2024-09-13T23:06:37.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.392+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94370110620544] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x7fb060031040 2024-09-13T23:06:37.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.392+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x7fb060031040 2024-09-13T23:06:37.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.392+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94370110625680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ebd0a0 con 0x7fb060031040 2024-09-13T23:06:37.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.392+0000 7fb06b413800 20 add_watcher() i=0 2024-09-13T23:06:37.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.392+0000 7fb06b413800 20 add_watcher() i=1 2024-09-13T23:06:37.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.392+0000 7fb06b413800 20 add_watcher() i=2 2024-09-13T23:06:37.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.392+0000 7fb06b413800 20 add_watcher() i=3 2024-09-13T23:06:37.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.392+0000 7fb06b413800 20 add_watcher() i=4 2024-09-13T23:06:37.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.392+0000 7fb06b413800 20 add_watcher() i=5 2024-09-13T23:06:37.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.392+0000 7fb06b413800 20 add_watcher() i=6 2024-09-13T23:06:37.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.393+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94370110625680] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x7fb060031040 2024-09-13T23:06:37.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.393+0000 7fb06b413800 20 add_watcher() i=7 2024-09-13T23:06:37.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.393+0000 7fb06b413800 2 all 8 watchers are set, enabling cache 2024-09-13T23:06:37.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.393+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440ec0e80 con 0x55d440ead730 2024-09-13T23:06:37.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.393+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.393+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94370110623168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ebe380 con 0x55d440ead730 2024-09-13T23:06:37.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.394+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94370110623168] v34'224 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.394+0000 7faf1d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:06:37.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.395+0000 7fb06b413800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:06:37.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.395+0000 7fb06b413800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:06:37.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.395+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ec0ca0 con 0x55d440ead730 2024-09-13T23:06:37.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.396+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.396+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ec9f90 con 0x7fb060031040 2024-09-13T23:06:37.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.397+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x7fb060031040 2024-09-13T23:06:37.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.397+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ec9f90 con 0x55d440eb3980 2024-09-13T23:06:37.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.398+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.398+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440eca3b0 con 0x55d440ead730 2024-09-13T23:06:37.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.399+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'225 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.399+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440eca450 con 0x7fb05c033be0 2024-09-13T23:06:37.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.400+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'71 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb060040040 con 0x7fb05c033be0 2024-09-13T23:06:37.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.400+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ecab90 con 0x55d440eb3980 2024-09-13T23:06:37.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.401+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'47 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.401+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ecafc0 con 0x55d440ead730 2024-09-13T23:06:37.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.402+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.402+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ecafc0 con 0x7fb060031040 2024-09-13T23:06:37.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.403+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'49 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x7fb060031040 2024-09-13T23:06:37.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.403+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ecafc0 con 0x7fb05c033be0 2024-09-13T23:06:37.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.404+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb060040040 con 0x7fb05c033be0 2024-09-13T23:06:37.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.405+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ecb550 con 0x55d440eb3980 2024-09-13T23:06:37.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.405+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.405+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ecb550 con 0x7fb05c033be0 2024-09-13T23:06:37.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.406+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'72 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb060040040 con 0x7fb05c033be0 2024-09-13T23:06:37.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.406+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ecbac0 con 0x7fb060031040 2024-09-13T23:06:37.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.408+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x7fb060031040 2024-09-13T23:06:37.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.408+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ecbac0 con 0x7fb05c033be0 2024-09-13T23:06:37.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.409+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb060040040 con 0x7fb05c033be0 2024-09-13T23:06:37.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.409+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ecc070 con 0x7fb060031040 2024-09-13T23:06:37.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.410+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'53 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x7fb060031040 2024-09-13T23:06:37.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.410+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ecc070 con 0x55d440ead730 2024-09-13T23:06:37.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.411+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'226 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.411+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ecc070 con 0x55d440eb3980 2024-09-13T23:06:37.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.413+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'65 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.413+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ecc070 con 0x7fb05c033be0 2024-09-13T23:06:37.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.414+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'73 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb060040040 con 0x7fb05c033be0 2024-09-13T23:06:37.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.414+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ecc070 con 0x55d440eb3980 2024-09-13T23:06:37.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.415+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.415+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ecc070 con 0x55d440ead730 2024-09-13T23:06:37.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.416+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.416+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ecc070 con 0x55d440ead730 2024-09-13T23:06:37.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.417+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'227 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.417+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ecc070 con 0x55d440eb3980 2024-09-13T23:06:37.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.418+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'66 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.418+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ecc070 con 0x7fb05c033be0 2024-09-13T23:06:37.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.419+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb060040040 con 0x7fb05c033be0 2024-09-13T23:06:37.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.419+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ecc070 con 0x55d440eb3980 2024-09-13T23:06:37.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.420+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.420+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ecc070 con 0x55d440eb3980 2024-09-13T23:06:37.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.421+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.421+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ecc070 con 0x55d440eb3980 2024-09-13T23:06:37.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.422+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.422+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ecc070 con 0x55d440eb3980 2024-09-13T23:06:37.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.423+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'48 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.423+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ecc070 con 0x7fb060031040 2024-09-13T23:06:37.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.425+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x7fb060031040 2024-09-13T23:06:37.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.425+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ecc070 con 0x55d440eb3980 2024-09-13T23:06:37.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.426+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.426+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ecc070 con 0x7fb060031040 2024-09-13T23:06:37.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.427+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'50 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x7fb060031040 2024-09-13T23:06:37.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.427+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ecc070 con 0x55d440eb3980 2024-09-13T23:06:37.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.428+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'67 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.428+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ecc070 con 0x7fb060031040 2024-09-13T23:06:37.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.429+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'54 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb05807a030 con 0x7fb060031040 2024-09-13T23:06:37.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.429+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ecc070 con 0x7fb05c033be0 2024-09-13T23:06:37.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.430+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb060040040 con 0x7fb05c033be0 2024-09-13T23:06:37.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.431+0000 7fae97fff640 20 reqs_thread_entry: start 2024-09-13T23:06:37.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.431+0000 7fb06b413800 20 init_complete bucket index max shards: 11 2024-09-13T23:06:37.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.431+0000 7fb06b413800 20 Filter name: none 2024-09-13T23:06:37.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.431+0000 7fae95ffb640 20 reqs_thread_entry: start 2024-09-13T23:06:37.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.431+0000 7fb06b413800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T23:06:37.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.431+0000 7fb06b413800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.431+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440ef6dc0 con 0x7fb060031040 2024-09-13T23:06:37.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.432+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fb05807a030 con 0x7fb060031040 2024-09-13T23:06:37.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.432+0000 7fb06b413800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T23:06:37.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.432+0000 7fb06b413800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T23:06:37.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.432+0000 7fb06b413800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:06:37.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.432+0000 7fb06b413800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:06:37.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.432+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440ef9810 con 0x7fb060031040 2024-09-13T23:06:37.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.432+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7fb05807a030 con 0x7fb060031040 2024-09-13T23:06:37.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.432+0000 7fb06b413800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10 : miss 2024-09-13T23:06:37.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.432+0000 7fb06b413800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.432+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:96 8.11 8:8e6038fb:root::.bucket.meta.myfoo7%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440ef96f0 con 0x55d440eb3980 2024-09-13T23:06:37.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.433+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 26 ==== osd_op_reply(96 .bucket.meta.myfoo7:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10 [call out=48b,stat out=16b,read 0~382 out=382b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 334+0+664 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.433+0000 7fb06b413800 20 rados_obj.operate() r=0 bl.length=382 2024-09-13T23:06:37.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.433+0000 7fb06b413800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10 info.flags=0x17 2024-09-13T23:06:37.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.433+0000 7fb06b413800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10 to cache LRU end 2024-09-13T23:06:37.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.433+0000 7fb06b413800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:06:37.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.433+0000 7fb06b413800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:06:37.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.433+0000 7fb06b413800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10 2024-09-13T23:06:37.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.433+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:97 4.16 4:692640b6:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f76be0 con 0x55d440eb3980 2024-09-13T23:06:37.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.433+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 27 ==== osd_op_reply(97 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.433+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:98 4.30 4:0c7eac1b:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f76c80 con 0x55d440eb3980 2024-09-13T23:06:37.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.433+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 28 ==== osd_op_reply(98 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.1 [call out=85b] v0'0 uv15 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.433+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:99 4.36 4:6d387d32:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f771c0 con 0x55d440ead730 2024-09-13T23:06:37.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.434+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(99 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.434+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:100 4.e 4:70a4fb8a:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f771c0 con 0x7fb05c033be0 2024-09-13T23:06:37.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.434+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 19 ==== osd_op_reply(100 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.3 [call out=85b] v0'0 uv10 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb060040040 con 0x7fb05c033be0 2024-09-13T23:06:37.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.434+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:101 4.2f 4:f5df64d9:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f771c0 con 0x55d440ead730 2024-09-13T23:06:37.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.434+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(101 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.434+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:102 4.d 4:b3c76dc2:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f771c0 con 0x55d440eb3980 2024-09-13T23:06:37.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.435+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 29 ==== osd_op_reply(102 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.5 [call out=377b] v0'0 uv22 ondisk = 0) ==== 195+0+377 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.435+0000 7fb06b413800 10 cls_bucket_list_unordered: got fourteen 2024-09-13T23:06:37.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.435+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:103 4.15 4:a83112b0:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f771c0 con 0x55d440eb3980 2024-09-13T23:06:37.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.435+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 30 ==== osd_op_reply(103 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.435+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:104 4.3e 4:7fbd33ad:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f771c0 con 0x7fb05c033be0 2024-09-13T23:06:37.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.435+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 20 ==== osd_op_reply(104 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.7 [call out=85b] v0'0 uv12 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb060040040 con 0x7fb05c033be0 2024-09-13T23:06:37.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.435+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:105 4.32 4:4dadbe27:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f771c0 con 0x55d440ead730 2024-09-13T23:06:37.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.436+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(105 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.8 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.436+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:106 4.13 4:cb0ffa0e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f771c0 con 0x7fb05c033be0 2024-09-13T23:06:37.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.436+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 21 ==== osd_op_reply(106 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb060040040 con 0x7fb05c033be0 2024-09-13T23:06:37.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.436+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:107 4.1f 4:f9f4e056:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f771c0 con 0x55d440eb3980 2024-09-13T23:06:37.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.436+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 31 ==== osd_op_reply(107 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.10 [call out=85b] v0'0 uv9 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.436+0000 7fb06b413800 20 get_obj_state: octx=0x55d440e9ad60 obj=myfoo7:fourteen state=0x55d440f74c68 s->prefetch_data=0 2024-09-13T23:06:37.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.436+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:108 3.es0 3:724dddb1:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f75a90 con 0x7fb05c033be0 2024-09-13T23:06:37.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.437+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 22 ==== osd_op_reply(108 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10_fourteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+872 (crc 0 0 0) 0x7fb060040040 con 0x7fb05c033be0 2024-09-13T23:06:37.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.437+0000 7fb06b413800 10 manifest: total_size = 8 2024-09-13T23:06:37.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.437+0000 7fb06b413800 20 get_obj_state: setting s->obj_tag to a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7018039392225532721 2024-09-13T23:06:37.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.437+0000 7fb06b413800 20 get_obj_state: octx=0x55d440e9ad60 obj=myfoo7:fourteen state=0x55d440f74c68 s->prefetch_data=0 2024-09-13T23:06:37.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.437+0000 7fb06b413800 20 prepare_atomic_modification: state is not atomic. state=0x55d440f74c68 2024-09-13T23:06:37.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.437+0000 7fb06b413800 20 bucket index object: :.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.5 2024-09-13T23:06:37.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.437+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:109 4.d 4:b3c76dc2:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440f76320 con 0x55d440eb3980 2024-09-13T23:06:37.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.438+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 32 ==== osd_op_reply(109 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.5 [stat,call,call] v34'23 uv23 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.438+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:110 3.es0 3:724dddb1:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440f76320 con 0x7fb05c033be0 2024-09-13T23:06:37.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.439+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 23 ==== osd_op_reply(110 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10_fourteen [call] v34'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7fb060040040 con 0x7fb05c033be0 2024-09-13T23:06:37.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.439+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:111 4.d 4:b3c76dc2:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440f76260 con 0x55d440eb3980 2024-09-13T23:06:37.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.439+0000 7fb06b413800 20 list_objects_ordered: starting attempt 1 2024-09-13T23:06:37.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.439+0000 7fb06b413800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T23:06:37.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.439+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:112 4.16 4:692640b6:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f76260 con 0x55d440eb3980 2024-09-13T23:06:37.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.439+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:113 4.30 4:0c7eac1b:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f76260 con 0x55d440eb3980 2024-09-13T23:06:37.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.439+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:114 4.36 4:6d387d32:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f04600 con 0x55d440ead730 2024-09-13T23:06:37.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.440+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:115 4.e 4:70a4fb8a:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f06f60 con 0x7fb05c033be0 2024-09-13T23:06:37.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.440+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 33 ==== osd_op_reply(112 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.440+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 34 ==== osd_op_reply(113 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.1 [call out=85b] v0'0 uv15 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.440+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:116 4.2f 4:f5df64d9:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f06f60 con 0x55d440ead730 2024-09-13T23:06:37.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.440+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 24 ==== osd_op_reply(115 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.3 [call out=85b] v0'0 uv10 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb060040040 con 0x7fb05c033be0 2024-09-13T23:06:37.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.440+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 32 ==== osd_op_reply(114 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb05807a030 con 0x55d440ead730 2024-09-13T23:06:37.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.440+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:117 4.d 4:b3c76dc2:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f01d90 con 0x55d440eb3980 2024-09-13T23:06:37.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.440+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:118 4.15 4:a83112b0:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f028c0 con 0x55d440eb3980 2024-09-13T23:06:37.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.440+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:119 4.3e 4:7fbd33ad:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f083f0 con 0x7fb05c033be0 2024-09-13T23:06:37.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.440+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:120 4.32 4:4dadbe27:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f0adc0 con 0x55d440ead730 2024-09-13T23:06:37.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.440+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:121 4.13 4:cb0ffa0e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f0d7a0 con 0x7fb05c033be0 2024-09-13T23:06:37.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.440+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:122 4.1f 4:f9f4e056:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f10570 con 0x55d440eb3980 2024-09-13T23:06:37.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.441+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 35 ==== osd_op_reply(118 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.441+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 25 ==== osd_op_reply(119 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.7 [call out=85b] v0'0 uv12 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb06004a040 con 0x7fb05c033be0 2024-09-13T23:06:37.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.441+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 36 ==== osd_op_reply(122 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.10 [call out=85b] v0'0 uv9 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.441+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 26 ==== osd_op_reply(121 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb06004a040 con 0x7fb05c033be0 2024-09-13T23:06:37.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.441+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 37 ==== osd_op_reply(111 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.5 [stat,call,call] v34'24 uv24 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.441+0000 7faf4a7fc640 20 handle_completion(): completion ok for obj=fourteen 2024-09-13T23:06:37.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.441+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 33 ==== osd_op_reply(116 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb0580b2040 con 0x55d440ead730 2024-09-13T23:06:37.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.441+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 34 ==== osd_op_reply(120 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.8 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb0580b2040 con 0x55d440ead730 2024-09-13T23:06:37.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.441+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 38 ==== osd_op_reply(117 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.5 [call out=124b] v0'0 uv24 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fb05c055070 con 0x55d440eb3980 2024-09-13T23:06:37.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.441+0000 7fb06b413800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T23:06:37.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.441+0000 7fb06b413800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T23:06:37.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.441+0000 7fb06b413800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T23:06:37.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.441+0000 7fb06b413800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T23:06:37.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.441+0000 7fb06b413800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10])"; uploads.size()=0; is_truncated=0 2024-09-13T23:06:37.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.441+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:123 4.16 4:692640b6:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f76240 con 0x55d440eb3980 2024-09-13T23:06:37.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.441+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:124 4.30 4:0c7eac1b:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f0adc0 con 0x55d440eb3980 2024-09-13T23:06:37.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.441+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:125 4.36 4:6d387d32:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f083f0 con 0x55d440ead730 2024-09-13T23:06:37.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.441+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:126 4.e 4:70a4fb8a:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f01df0 con 0x7fb05c033be0 2024-09-13T23:06:37.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.441+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:127 4.2f 4:f5df64d9:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f0adc0 con 0x55d440ead730 2024-09-13T23:06:37.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.441+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:128 4.d 4:b3c76dc2:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f083f0 con 0x55d440eb3980 2024-09-13T23:06:37.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.441+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:129 4.15 4:a83112b0:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f0adc0 con 0x55d440eb3980 2024-09-13T23:06:37.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.441+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:130 4.3e 4:7fbd33ad:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f10190 con 0x7fb05c033be0 2024-09-13T23:06:37.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.442+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 35 ==== osd_op_reply(125 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb0580b2040 con 0x55d440ead730 2024-09-13T23:06:37.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.441+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:131 4.32 4:4dadbe27:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f10a90 con 0x55d440ead730 2024-09-13T23:06:37.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.442+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:132 4.13 4:cb0ffa0e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f083f0 con 0x7fb05c033be0 2024-09-13T23:06:37.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.442+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 36 ==== osd_op_reply(127 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb0580b2040 con 0x55d440ead730 2024-09-13T23:06:37.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.442+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 27 ==== osd_op_reply(126 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.3 [call out=85b] v0'0 uv10 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb06004a040 con 0x7fb05c033be0 2024-09-13T23:06:37.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.442+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 39 ==== osd_op_reply(123 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb05c074040 con 0x55d440eb3980 2024-09-13T23:06:37.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.442+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:133 4.1f 4:f9f4e056:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f0adc0 con 0x55d440eb3980 2024-09-13T23:06:37.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.442+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 40 ==== osd_op_reply(124 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.1 [call out=85b] v0'0 uv15 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb05c074040 con 0x55d440eb3980 2024-09-13T23:06:37.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.442+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 41 ==== osd_op_reply(128 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.5 [call out=124b] v0'0 uv24 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fb05c074040 con 0x55d440eb3980 2024-09-13T23:06:37.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.442+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 42 ==== osd_op_reply(129 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb05c074040 con 0x55d440eb3980 2024-09-13T23:06:37.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.442+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 28 ==== osd_op_reply(130 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.7 [call out=85b] v0'0 uv12 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb06004a040 con 0x7fb05c033be0 2024-09-13T23:06:37.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.442+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 37 ==== osd_op_reply(131 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.8 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb0580b2040 con 0x55d440ead730 2024-09-13T23:06:37.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.442+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 29 ==== osd_op_reply(132 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb06004a040 con 0x7fb05c033be0 2024-09-13T23:06:37.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.442+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 43 ==== osd_op_reply(133 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.10 [call out=85b] v0'0 uv9 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fb05c074040 con 0x55d440eb3980 2024-09-13T23:06:37.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.442+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440f083f0 con 0x7fb060031040 2024-09-13T23:06:37.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.443+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(134 fud.buckets [call] v34'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb0580b2040 con 0x7fb060031040 2024-09-13T23:06:37.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.443+0000 7fb06b413800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-13T23:06:37.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.443+0000 7fb06b413800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.443+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f083f0 con 0x7fb05c033be0 2024-09-13T23:06:37.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.444+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 30 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv46 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7fb06004a040 con 0x7fb05c033be0 2024-09-13T23:06:37.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.444+0000 7fb06b413800 20 rados_obj.operate() r=0 bl.length=168 2024-09-13T23:06:37.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.444+0000 7fb06b413800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-09-13T23:06:37.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.444+0000 7fb06b413800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-13T23:06:37.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.444+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440f083f0 con 0x7fb05c033be0 2024-09-13T23:06:37.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.445+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 31 ==== osd_op_reply(136 myfoo7 [call,call,delete] v34'47 uv47 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fb06004a040 con 0x7fb05c033be0 2024-09-13T23:06:37.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.445+0000 7fb06b413800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-13T23:06:37.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.445+0000 7fb06b413800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-13T23:06:37.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.445+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94370110931952 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f03ed0 con 0x7fb05c033be0 2024-09-13T23:06:37.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.445+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 32 ==== watch-notify(notify (1) cookie 94370110607280 notify 146028888092 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55d440ec0720 con 0x7fb05c033be0 2024-09-13T23:06:37.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.445+0000 7faf4a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888092 cookie 94370110607280 notifier 4770 bl.length()=150 2024-09-13T23:06:37.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.445+0000 7faf4a7fc640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7faf2c003d60 con 0x7fb05c033be0 2024-09-13T23:06:37.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.445+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 33 ==== osd_op_reply(137 notify.3 [notify cookie 94370110931952 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb06004a040 con 0x7fb05c033be0 2024-09-13T23:06:37.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.445+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 34 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb06004a040 con 0x7fb05c033be0 2024-09-13T23:06:37.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.446+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 35 ==== watch-notify(notify_complete (2) cookie 94370110931952 notify 146028888092 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d440ecb8f0 con 0x7fb05c033be0 2024-09-13T23:06:37.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.446+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:139 8.11 8:8e6038fb:root::.bucket.meta.myfoo7%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440f083f0 con 0x55d440eb3980 2024-09-13T23:06:37.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.447+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 44 ==== osd_op_reply(139 .bucket.meta.myfoo7:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10 [call,call,delete] v34'6 uv6 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7fb05c074040 con 0x55d440eb3980 2024-09-13T23:06:37.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.447+0000 7fb06b413800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10 from cache 2024-09-13T23:06:37.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.447+0000 7fb06b413800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10, ofs0, ns] 2024-09-13T23:06:37.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.447+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:140 7.0 7:05bf5b68:::notify.1:head [notify cookie 94370110953312 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f083f0 con 0x55d440ead730 2024-09-13T23:06:37.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.447+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 38 ==== watch-notify(notify (1) cookie 94370110606224 notify 146028888085 ret 0) ==== 250+0+0 (crc 0 0 0) 0x55d440ecafc0 con 0x55d440ead730 2024-09-13T23:06:37.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.447+0000 7faf49ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888085 cookie 94370110606224 notifier 4770 bl.length()=208 2024-09-13T23:06:37.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.447+0000 7faf49ffb640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:141 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fae9c003320 con 0x55d440ead730 2024-09-13T23:06:37.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.447+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 39 ==== osd_op_reply(140 notify.1 [notify cookie 94370110953312 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb0580b2040 con 0x55d440ead730 2024-09-13T23:06:37.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.447+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 40 ==== watch-notify(notify_complete (2) cookie 94370110953312 notify 146028888085 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d440ec0490 con 0x55d440ead730 2024-09-13T23:06:37.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.447+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 41 ==== osd_op_reply(141 notify.1 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0580b2040 con 0x55d440ead730 2024-09-13T23:06:37.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.447+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:142 4.16 4:692640b6:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440f083f0 con 0x55d440eb3980 2024-09-13T23:06:37.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.447+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:143 4.30 4:0c7eac1b:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440f03ed0 con 0x55d440eb3980 2024-09-13T23:06:37.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.447+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:144 4.36 4:6d387d32:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ef7e50 con 0x55d440ead730 2024-09-13T23:06:37.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.447+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:145 4.e 4:70a4fb8a:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440f02230 con 0x7fb05c033be0 2024-09-13T23:06:37.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.447+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:146 4.2f 4:f5df64d9:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440f02b10 con 0x55d440ead730 2024-09-13T23:06:37.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.447+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:147 4.d 4:b3c76dc2:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440f083f0 con 0x55d440eb3980 2024-09-13T23:06:37.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.447+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:148 4.15 4:a83112b0:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ef7e50 con 0x55d440eb3980 2024-09-13T23:06:37.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.447+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:149 4.3e 4:7fbd33ad:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440f02b10 con 0x7fb05c033be0 2024-09-13T23:06:37.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.448+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:150 4.32 4:4dadbe27:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440f083f0 con 0x55d440ead730 2024-09-13T23:06:37.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.448+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:151 4.13 4:cb0ffa0e:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440f02230 con 0x7fb05c033be0 2024-09-13T23:06:37.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.449+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:152 4.1f 4:f9f4e056:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440ef7e50 con 0x55d440eb3980 2024-09-13T23:06:37.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.449+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 45 ==== osd_op_reply(142 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.0 [delete] v34'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb05c074040 con 0x55d440eb3980 2024-09-13T23:06:37.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.449+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 36 ==== osd_op_reply(145 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.3 [delete] v34'12 uv12 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb06004a040 con 0x7fb05c033be0 2024-09-13T23:06:37.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.449+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 46 ==== osd_op_reply(143 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.1 [delete] v34'16 uv16 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb05c074040 con 0x55d440eb3980 2024-09-13T23:06:37.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.451+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 42 ==== osd_op_reply(146 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.4 [delete] v34'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb0580b2040 con 0x55d440ead730 2024-09-13T23:06:37.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.451+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 43 ==== osd_op_reply(150 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.8 [delete] v34'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb0580b2040 con 0x55d440ead730 2024-09-13T23:06:37.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.451+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 47 ==== osd_op_reply(152 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.10 [delete] v34'10 uv10 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fb05c074040 con 0x55d440eb3980 2024-09-13T23:06:37.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.451+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 48 ==== osd_op_reply(147 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.5 [delete] v34'25 uv25 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb05c074040 con 0x55d440eb3980 2024-09-13T23:06:37.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.451+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 49 ==== osd_op_reply(148 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.6 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb05c074040 con 0x55d440eb3980 2024-09-13T23:06:37.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.451+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 37 ==== osd_op_reply(149 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.7 [delete] v34'13 uv13 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb06004a040 con 0x7fb05c033be0 2024-09-13T23:06:37.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.451+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 38 ==== osd_op_reply(151 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.9 [delete] v34'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb06004a040 con 0x7fb05c033be0 2024-09-13T23:06:37.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.452+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 44 ==== osd_op_reply(144 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10.2 [delete] v34'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb0580b2040 con 0x55d440ead730 2024-09-13T23:06:37.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.452+0000 7fb06b413800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10 : miss 2024-09-13T23:06:37.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.452+0000 7fb06b413800 20 rados->read ofs=0 len=0 2024-09-13T23:06:37.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.452+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:153 6.2 6:40d24034:::pubsub..bucket.myfoo7%2fa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f02230 con 0x55d440eb3980 2024-09-13T23:06:37.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.452+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 50 ==== osd_op_reply(153 pubsub..bucket.myfoo7/a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7fb05c074040 con 0x55d440eb3980 2024-09-13T23:06:37.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.452+0000 7fb06b413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:06:37.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.452+0000 7fb06b413800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10 info.flags=0x0 2024-09-13T23:06:37.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.452+0000 7fb06b413800 10 adding default.rgw.log++pubsub..bucket.myfoo7/a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10 to cache LRU end 2024-09-13T23:06:37.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.452+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:154 6.2 6:40d24034:::pubsub..bucket.myfoo7%2fa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440f083f0 con 0x55d440eb3980 2024-09-13T23:06:37.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.454+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 51 ==== osd_op_reply(154 pubsub..bucket.myfoo7/a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.10 [delete] v34'11 uv10 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7fb05c074040 con 0x55d440eb3980 2024-09-13T23:06:37.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.454+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440f02230 con 0x7fb060031040 2024-09-13T23:06:37.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.455+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== osd_op_reply(155 fud.buckets [call] v34'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb0580b2040 con 0x7fb060031040 2024-09-13T23:06:37.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.455+0000 7fb06b413800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-13T23:06:37.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.455+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440f083f0 con 0x7fb060031040 2024-09-13T23:06:37.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.456+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 27 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v34'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb0580b2040 con 0x7fb060031040 2024-09-13T23:06:37.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.456+0000 7fb06b413800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T23:06:37.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.456+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94370110914256 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f02230 con 0x55d440eb3980 2024-09-13T23:06:37.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.456+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 52 ==== watch-notify(notify (1) cookie 94370110610128 notify 146028888071 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55d440ef8bd0 con 0x55d440eb3980 2024-09-13T23:06:37.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.456+0000 7faf4a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888071 cookie 94370110610128 notifier 4770 bl.length()=170 2024-09-13T23:06:37.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.456+0000 7faf4a7fc640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7faf2c003d60 con 0x55d440eb3980 2024-09-13T23:06:37.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.456+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 53 ==== osd_op_reply(157 notify.2 [notify cookie 94370110914256 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb05c074040 con 0x55d440eb3980 2024-09-13T23:06:37.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.456+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 54 ==== watch-notify(notify_complete (2) cookie 94370110914256 notify 146028888071 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d440e9b350 con 0x55d440eb3980 2024-09-13T23:06:37.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.457+0000 7fb06b413800 10 removing email index: 2024-09-13T23:06:37.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.457+0000 7fb06b413800 10 removing user buckets index 2024-09-13T23:06:37.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.457+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 55 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb05c074040 con 0x55d440eb3980 2024-09-13T23:06:37.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.457+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440f083f0 con 0x7fb060031040 2024-09-13T23:06:37.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.458+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 28 ==== osd_op_reply(159 fud.buckets [delete] v34'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb0580b2040 con 0x7fb060031040 2024-09-13T23:06:37.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.458+0000 7fb06b413800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-13T23:06:37.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.458+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94370110914256 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f02230 con 0x7fb060031040 2024-09-13T23:06:37.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.458+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 29 ==== watch-notify(notify (1) cookie 94370110620544 notify 146028888103 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55d440ec0490 con 0x7fb060031040 2024-09-13T23:06:37.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.458+0000 7faf49ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888103 cookie 94370110620544 notifier 4770 bl.length()=160 2024-09-13T23:06:37.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.458+0000 7faf49ffb640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fae9c003300 con 0x7fb060031040 2024-09-13T23:06:37.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.458+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 30 ==== osd_op_reply(160 notify.6 [notify cookie 94370110914256 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb0580b2040 con 0x7fb060031040 2024-09-13T23:06:37.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.458+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 31 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0580b2040 con 0x7fb060031040 2024-09-13T23:06:37.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.458+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 32 ==== watch-notify(notify_complete (2) cookie 94370110914256 notify 146028888103 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d440e76cc0 con 0x7fb060031040 2024-09-13T23:06:37.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.458+0000 7fb06b413800 10 removing user index: fud 2024-09-13T23:06:37.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.458+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440f083f0 con 0x7fb060031040 2024-09-13T23:06:37.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.459+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 33 ==== osd_op_reply(162 fud [call,call,delete] v34'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fb0580b2040 con 0x7fb060031040 2024-09-13T23:06:37.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.459+0000 7fb06b413800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-13T23:06:37.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.459+0000 7fb06b413800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T23:06:37.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.459+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94370110906736 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d440f083f0 con 0x7fb060031040 2024-09-13T23:06:37.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.460+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 34 ==== watch-notify(notify (1) cookie 94370110617376 notify 146028888104 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55d440e76cc0 con 0x7fb060031040 2024-09-13T23:06:37.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.460+0000 7faf4a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888104 cookie 94370110617376 notifier 4770 bl.length()=152 2024-09-13T23:06:37.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.460+0000 7faf4a7fc640 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7faf2c003d60 con 0x7fb060031040 2024-09-13T23:06:37.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.460+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 35 ==== osd_op_reply(163 notify.5 [notify cookie 94370110906736 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb0580b2040 con 0x7fb060031040 2024-09-13T23:06:37.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.460+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 36 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0580b2040 con 0x7fb060031040 2024-09-13T23:06:37.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.460+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 37 ==== watch-notify(notify_complete (2) cookie 94370110906736 notify 146028888104 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d440e76740 con 0x7fb060031040 2024-09-13T23:06:37.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.461+0000 7faf1d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:06:37.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.461+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94370110623168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440f083f0 con 0x55d440ead730 2024-09-13T23:06:37.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.462+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 45 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94370110623168] v34'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb0580b2040 con 0x55d440ead730 2024-09-13T23:06:37.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.462+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94370110601840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440f083f0 con 0x7fb05c033be0 2024-09-13T23:06:37.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.463+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 39 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94370110601840] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb06004a040 con 0x7fb05c033be0 2024-09-13T23:06:37.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.463+0000 7fb06b413800 20 remove_watcher() i=0 2024-09-13T23:06:37.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.463+0000 7fb06b413800 2 removed watcher, disabling cache 2024-09-13T23:06:37.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.463+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94370110606224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440f083f0 con 0x55d440ead730 2024-09-13T23:06:37.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.464+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 46 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94370110606224] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0580b2040 con 0x55d440ead730 2024-09-13T23:06:37.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.464+0000 7fb06b413800 20 remove_watcher() i=1 2024-09-13T23:06:37.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.464+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94370110610128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440f083f0 con 0x55d440eb3980 2024-09-13T23:06:37.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.465+0000 7fb06633c640 1 -- 172.21.15.164:0/4071784835 <== osd.3 v2:172.21.15.164:6816/93809510 56 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94370110610128] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb05c074040 con 0x55d440eb3980 2024-09-13T23:06:37.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.465+0000 7fb06b413800 20 remove_watcher() i=2 2024-09-13T23:06:37.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.465+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94370110607280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440f083f0 con 0x7fb05c033be0 2024-09-13T23:06:37.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.466+0000 7fb06733e640 1 -- 172.21.15.164:0/4071784835 <== osd.2 v2:172.21.15.164:6808/3795914978 40 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94370110607280] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb06004a040 con 0x7fb05c033be0 2024-09-13T23:06:37.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.466+0000 7fb06b413800 20 remove_watcher() i=3 2024-09-13T23:06:37.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.466+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94370110613760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440f083f0 con 0x55d440ead730 2024-09-13T23:06:37.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.468+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.1 v2:172.21.15.164:6800/4060509701 47 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94370110613760] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0580b2040 con 0x55d440ead730 2024-09-13T23:06:37.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.468+0000 7fb06b413800 20 remove_watcher() i=4 2024-09-13T23:06:37.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.468+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94370110617376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440f083f0 con 0x7fb060031040 2024-09-13T23:06:37.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.469+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 38 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94370110617376] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0580b2040 con 0x7fb060031040 2024-09-13T23:06:37.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.469+0000 7fb06b413800 20 remove_watcher() i=5 2024-09-13T23:06:37.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.469+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94370110620544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440f083f0 con 0x7fb060031040 2024-09-13T23:06:37.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.470+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 39 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94370110620544] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0580b2040 con 0x7fb060031040 2024-09-13T23:06:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.470+0000 7fb06b413800 20 remove_watcher() i=6 2024-09-13T23:06:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.470+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94370110625680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d440f083f0 con 0x7fb060031040 2024-09-13T23:06:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.471+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 <== osd.0 v2:172.21.15.17:6800/489863589 40 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94370110625680] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0580b2040 con 0x7fb060031040 2024-09-13T23:06:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.471+0000 7fb06b413800 20 remove_watcher() i=7 2024-09-13T23:06:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.471+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fb060031040 msgr2=0x7fb060032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.471+0000 7fb06b413800 1 --2- 172.21.15.164:0/4071784835 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fb060031040 0x7fb060032430 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.471+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d440ead730 msgr2=0x55d440eafbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.471+0000 7fb06b413800 1 --2- 172.21.15.164:0/4071784835 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d440ead730 0x55d440eafbf0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.471+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fb05c033be0 msgr2=0x7fb05c045180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.471+0000 7fb06b413800 1 --2- 172.21.15.164:0/4071784835 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fb05c033be0 0x7fb05c045180 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.471+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55d440eb3980 msgr2=0x55d440eb5d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.471+0000 7fb06b413800 1 --2- 172.21.15.164:0/4071784835 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55d440eb3980 0x55d440eb5d70 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.471+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faf30036b90 msgr2=0x7faf30039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.471+0000 7fb06b413800 1 --2- 172.21.15.164:0/4071784835 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faf30036b90 0x7faf30039050 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x55d440e7a790 tx=0x7fb06001f000 comp rx=0 tx=0).stop 2024-09-13T23:06:37.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.471+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440e9a980 msgr2=0x55d440ea1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.471+0000 7fb06b413800 1 --2- 172.21.15.164:0/4071784835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440e9a980 0x55d440ea1e90 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb05c04d180 tx=0x7fb05c04d110 comp rx=0 tx=0).stop 2024-09-13T23:06:37.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.471+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 reap_dead start 2024-09-13T23:06:37.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.471+0000 7fb066b3d640 1 -- 172.21.15.164:0/4071784835 reap_dead start 2024-09-13T23:06:37.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.471+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 shutdown_connections 2024-09-13T23:06:37.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.471+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 >> 172.21.15.164:0/4071784835 conn(0x55d440e96ce0 msgr2=0x55d440e94db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:37.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.471+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 shutdown_connections 2024-09-13T23:06:37.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.471+0000 7fb06b413800 1 -- 172.21.15.164:0/4071784835 wait complete. 2024-09-13T23:06:37.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.472+0000 7fb06b413800 1 -- 172.21.15.164:0/3824863339 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faf40036b30 msgr2=0x7faf40038ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.472+0000 7fb06b413800 1 --2- 172.21.15.164:0/3824863339 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faf40036b30 0x7faf40038ff0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55d440e7e300 tx=0x7fb060005840 comp rx=0 tx=0).stop 2024-09-13T23:06:37.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.472+0000 7fb06b413800 1 -- 172.21.15.164:0/3824863339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440e8dc70 msgr2=0x55d440e8e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.472+0000 7fb06b413800 1 --2- 172.21.15.164:0/3824863339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440e8dc70 0x55d440e8e090 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb05c001ed0 tx=0x7fb05c00d7a0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.472+0000 7fb06b413800 1 -- 172.21.15.164:0/3824863339 shutdown_connections 2024-09-13T23:06:37.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.472+0000 7fb06b413800 1 --2- 172.21.15.164:0/3824863339 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faf40036b30 0x7faf40038ff0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.472+0000 7fb06b413800 1 --2- 172.21.15.164:0/3824863339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440e8dc70 0x55d440e8e090 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.472+0000 7fb06b413800 1 -- 172.21.15.164:0/3824863339 >> 172.21.15.164:0/3824863339 conn(0x55d440e82c00 msgr2=0x55d440e85780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:37.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.472+0000 7fb06b413800 1 -- 172.21.15.164:0/3824863339 shutdown_connections 2024-09-13T23:06:37.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.472+0000 7fb06b413800 1 -- 172.21.15.164:0/3824863339 wait complete. 2024-09-13T23:06:37.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.472+0000 7fb06b413800 1 -- 172.21.15.164:0/2017208591 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d440d82760 msgr2=0x55d440e7d270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.472+0000 7fb06b413800 1 --2- 172.21.15.164:0/2017208591 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d440d82760 0x55d440e7d270 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.472+0000 7fb06b413800 1 -- 172.21.15.164:0/2017208591 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faf4c036b40 msgr2=0x7faf4c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.472+0000 7fb06b413800 1 --2- 172.21.15.164:0/2017208591 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faf4c036b40 0x7faf4c039000 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb05c000f60 tx=0x7fb05c0012b0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.472+0000 7fb06b413800 1 -- 172.21.15.164:0/2017208591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440cf3610 msgr2=0x55d440e76200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:37.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.472+0000 7fb06b413800 1 --2- 172.21.15.164:0/2017208591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440cf3610 0x55d440e76200 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x55d440e6f6e0 tx=0x7fb058002fb0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.472+0000 7fb06b413800 1 -- 172.21.15.164:0/2017208591 shutdown_connections 2024-09-13T23:06:37.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.472+0000 7fb06b413800 1 --2- 172.21.15.164:0/2017208591 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d440d82760 0x55d440e7d270 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.472+0000 7fb06b413800 1 --2- 172.21.15.164:0/2017208591 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faf4c036b40 0x7faf4c039000 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.472+0000 7fb06b413800 1 --2- 172.21.15.164:0/2017208591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d440cf3610 0x55d440e76200 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:37.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.472+0000 7fb06b413800 1 -- 172.21.15.164:0/2017208591 >> 172.21.15.164:0/2017208591 conn(0x55d440d79db0 msgr2=0x55d440e68ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:37.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.472+0000 7fb06b413800 1 -- 172.21.15.164:0/2017208591 shutdown_connections 2024-09-13T23:06:37.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:06:37.472+0000 7fb06b413800 1 -- 172.21.15.164:0/2017208591 wait complete. 2024-09-13T23:07:17.483 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-13T23:07:17.484 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-13T23:07:17.484 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-13T23:07:17.539 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:07:17.540 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:07:17.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.540+0000 7f6d07c36800 1 Processor -- start 2024-09-13T23:07:17.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.540+0000 7f6d07c36800 1 -- start start 2024-09-13T23:07:17.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.540+0000 7f6d07c36800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x559457dade10 0x559457e3d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.540+0000 7f6d07c36800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559457cf9b30 con 0x559457e3d700 2024-09-13T23:07:17.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.540+0000 7f6d07c36800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x559457cdb360 con 0x559457dade10 2024-09-13T23:07:17.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.540+0000 7f6d02f52640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x559457dade10 0x559457e3d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.540+0000 7f6d02f52640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x559457dade10 0x559457e3d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44388/0 (socket says 172.21.15.164:44388) 2024-09-13T23:07:17.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.540+0000 7f6d02751640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x559457e3d700 0x559457e3faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:60850/0 (socket says 172.21.15.164:60850) 2024-09-13T23:07:17.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.540+0000 7f6d02f52640 1 -- 172.21.15.164:0/1416076557 learned_addr learned my addr 172.21.15.164:0/1416076557 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:17.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.541+0000 7f6d02f52640 1 -- 172.21.15.164:0/1416076557 >> v1:172.21.15.17:6789/0 conn(0x559457e3d700 legacy=0x559457e3faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.541+0000 7f6d02f52640 1 -- 172.21.15.164:0/1416076557 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559457d01e00 con 0x559457dade10 2024-09-13T23:07:17.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.543+0000 7f6d02f52640 1 --2- 172.21.15.164:0/1416076557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457dade10 0x559457e3d1c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f6cf400a520 tx=0x7f6cf4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7222b6fec1eae02 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.543+0000 7f6d01f50640 1 -- 172.21.15.164:0/1416076557 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf4055070 con 0x559457dade10 2024-09-13T23:07:17.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.543+0000 7f6d01f50640 1 -- 172.21.15.164:0/1416076557 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf40515b0 con 0x559457dade10 2024-09-13T23:07:17.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.543+0000 7f6d01f50640 1 -- 172.21.15.164:0/1416076557 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf40518d0 con 0x559457dade10 2024-09-13T23:07:17.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.543+0000 7f6d07c36800 1 -- 172.21.15.164:0/1416076557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457dade10 msgr2=0x559457e3d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.543+0000 7f6d07c36800 1 --2- 172.21.15.164:0/1416076557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457dade10 0x559457e3d1c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f6cf400a520 tx=0x7f6cf4045ba0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.544+0000 7f6d07c36800 1 -- 172.21.15.164:0/1416076557 shutdown_connections 2024-09-13T23:07:17.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.544+0000 7f6d07c36800 1 --2- 172.21.15.164:0/1416076557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457dade10 0x559457e3d1c0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.544+0000 7f6d07c36800 1 -- 172.21.15.164:0/1416076557 >> 172.21.15.164:0/1416076557 conn(0x559457e34df0 msgr2=0x559457e37210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:17.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.544+0000 7f6d07c36800 1 -- 172.21.15.164:0/1416076557 shutdown_connections 2024-09-13T23:07:17.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.544+0000 7f6d07c36800 1 -- 172.21.15.164:0/1416076557 wait complete. 2024-09-13T23:07:17.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.559+0000 7f6d07c36800 1 Processor -- start 2024-09-13T23:07:17.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.559+0000 7f6d07c36800 1 -- start start 2024-09-13T23:07:17.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.560+0000 7f6d07c36800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457dade10 0x559457e3aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.560+0000 7f6d07c36800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559457d86330 con 0x559457dade10 2024-09-13T23:07:17.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.560+0000 7f6d02f52640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457dade10 0x559457e3aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.560+0000 7f6d02f52640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457dade10 0x559457e3aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44392/0 (socket says 172.21.15.164:44392) 2024-09-13T23:07:17.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.560+0000 7f6d02f52640 1 -- 172.21.15.164:0/1703297691 learned_addr learned my addr 172.21.15.164:0/1703297691 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:17.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.560+0000 7f6d02f52640 1 -- 172.21.15.164:0/1703297691 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559457cd3bc0 con 0x559457dade10 2024-09-13T23:07:17.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.561+0000 7f6d02f52640 1 --2- 172.21.15.164:0/1703297691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457dade10 0x559457e3aaf0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4025da0 tx=0x7f6cf4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84eebb0896e2c5a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.561+0000 7f6bf0e09640 1 -- 172.21.15.164:0/1703297691 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf4051890 con 0x559457dade10 2024-09-13T23:07:17.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.561+0000 7f6bf0e09640 1 -- 172.21.15.164:0/1703297691 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf4051ac0 con 0x559457dade10 2024-09-13T23:07:17.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.561+0000 7f6bf0e09640 1 -- 172.21.15.164:0/1703297691 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf4051da0 con 0x559457dade10 2024-09-13T23:07:17.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.561+0000 7f6d07c36800 1 -- 172.21.15.164:0/1703297691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457dade10 msgr2=0x559457e3aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.561+0000 7f6d07c36800 1 --2- 172.21.15.164:0/1703297691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457dade10 0x559457e3aaf0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4025da0 tx=0x7f6cf4051000 comp rx=0 tx=0).stop 2024-09-13T23:07:17.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.562+0000 7f6d07c36800 1 -- 172.21.15.164:0/1703297691 shutdown_connections 2024-09-13T23:07:17.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.562+0000 7f6d07c36800 1 --2- 172.21.15.164:0/1703297691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457dade10 0x559457e3aaf0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.562+0000 7f6d07c36800 1 -- 172.21.15.164:0/1703297691 >> 172.21.15.164:0/1703297691 conn(0x559457e34df0 msgr2=0x559457f25220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:17.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.562+0000 7f6d07c36800 1 -- 172.21.15.164:0/1703297691 shutdown_connections 2024-09-13T23:07:17.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.562+0000 7f6d07c36800 1 -- 172.21.15.164:0/1703297691 wait complete. 2024-09-13T23:07:17.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.562+0000 7f6d07c36800 1 Processor -- start 2024-09-13T23:07:17.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.562+0000 7f6d07c36800 1 -- start start 2024-09-13T23:07:17.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.562+0000 7f6d07c36800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457dade10 0x559457f33310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.562+0000 7f6d07c36800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559457e41600 con 0x559457dade10 2024-09-13T23:07:17.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.562+0000 7f6d02f52640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457dade10 0x559457f33310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.562+0000 7f6d02f52640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457dade10 0x559457f33310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44402/0 (socket says 172.21.15.164:44402) 2024-09-13T23:07:17.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.562+0000 7f6d02f52640 1 -- 172.21.15.164:0/2771225866 learned_addr learned my addr 172.21.15.164:0/2771225866 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:17.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.563+0000 7f6d02f52640 1 -- 172.21.15.164:0/2771225866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559457ce7fe0 con 0x559457dade10 2024-09-13T23:07:17.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.563+0000 7f6d02f52640 1 --2- 172.21.15.164:0/2771225866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457dade10 0x559457f33310 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4025da0 tx=0x7f6cf4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.563+0000 7f6bef606640 1 -- 172.21.15.164:0/2771225866 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf4073070 con 0x559457dade10 2024-09-13T23:07:17.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.563+0000 7f6bef606640 1 -- 172.21.15.164:0/2771225866 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf405a580 con 0x559457dade10 2024-09-13T23:07:17.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.563+0000 7f6d07c36800 1 -- 172.21.15.164:0/2771225866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559457f33850 con 0x559457dade10 2024-09-13T23:07:17.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.563+0000 7f6bef606640 1 -- 172.21.15.164:0/2771225866 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf405a860 con 0x559457dade10 2024-09-13T23:07:17.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.563+0000 7f6d07c36800 1 -- 172.21.15.164:0/2771225866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559457f33dd0 con 0x559457dade10 2024-09-13T23:07:17.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.564+0000 7f6bef606640 1 -- 172.21.15.164:0/2771225866 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6cf4076070 con 0x559457dade10 2024-09-13T23:07:17.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.564+0000 7f6bef606640 1 --2- 172.21.15.164:0/2771225866 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6be8036b90 0x7f6be8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.564+0000 7f6bef606640 1 -- 172.21.15.164:0/2771225866 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6cf4062070 con 0x559457dade10 2024-09-13T23:07:17.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.564+0000 7f6d02751640 1 --2- 172.21.15.164:0/2771225866 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6be8036b90 0x7f6be8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.565+0000 7f6d07c36800 1 --2- 172.21.15.164:0/2771225866 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559457e3d700 0x559457f3a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.565+0000 7f6d07c36800 1 -- 172.21.15.164:0/2771225866 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559457f3a9d0 con 0x559457e3d700 2024-09-13T23:07:17.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.565+0000 7f6d03753640 1 --2- 172.21.15.164:0/2771225866 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559457e3d700 0x559457f3a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.565+0000 7f6d02751640 1 --2- 172.21.15.164:0/2771225866 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6be8036b90 0x7f6be8039050 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8000f60 tx=0x7f6cf8001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.565+0000 7f6d03753640 1 --2- 172.21.15.164:0/2771225866 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559457e3d700 0x559457f3a380 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.565+0000 7f6d03753640 1 -- 172.21.15.164:0/2771225866 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6cfc00a4a0 con 0x559457e3d700 2024-09-13T23:07:17.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.565+0000 7f6d07c36800 1 -- 172.21.15.164:0/2771225866 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559457f37950 con 0x559457e3d700 2024-09-13T23:07:17.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.566+0000 7f6d03753640 1 -- 172.21.15.164:0/2771225866 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6cfc00a4a0 con 0x559457e3d700 2024-09-13T23:07:17.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.566+0000 7f6d07c36800 1 -- 172.21.15.164:0/2771225866 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559457f3c7f0 con 0x559457e3d700 2024-09-13T23:07:17.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.566+0000 7f6d03753640 1 -- 172.21.15.164:0/2771225866 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6cfc00a4a0 con 0x559457e3d700 2024-09-13T23:07:17.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.566+0000 7f6d07c36800 1 -- 172.21.15.164:0/2771225866 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559457f3b930 con 0x559457e3d700 2024-09-13T23:07:17.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.566+0000 7f6d03753640 1 -- 172.21.15.164:0/2771225866 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6cfc00a4a0 con 0x559457e3d700 2024-09-13T23:07:17.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.566+0000 7f6d07c36800 1 -- 172.21.15.164:0/2771225866 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559457f3bd80 con 0x559457e3d700 2024-09-13T23:07:17.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.567+0000 7f6d03753640 1 -- 172.21.15.164:0/2771225866 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6cfc00a4a0 con 0x559457e3d700 2024-09-13T23:07:17.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.567+0000 7f6d07c36800 1 Processor -- start 2024-09-13T23:07:17.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.567+0000 7f6d07c36800 1 -- start start 2024-09-13T23:07:17.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.567+0000 7f6d07c36800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457f4ade0 0x559457f4b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.567+0000 7f6d07c36800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559457cd5580 con 0x559457f4ade0 2024-09-13T23:07:17.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.567+0000 7f6d02751640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457f4ade0 0x559457f4b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.567+0000 7f6d02751640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457f4ade0 0x559457f4b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44404/0 (socket says 172.21.15.164:44404) 2024-09-13T23:07:17.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.567+0000 7f6d02751640 1 -- 172.21.15.164:0/2335010532 learned_addr learned my addr 172.21.15.164:0/2335010532 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:17.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.568+0000 7f6d02751640 1 -- 172.21.15.164:0/2335010532 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559457f4b740 con 0x559457f4ade0 2024-09-13T23:07:17.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.568+0000 7f6d02751640 1 --2- 172.21.15.164:0/2335010532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457f4ade0 0x559457f4b200 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8001ed0 tx=0x7f6cf800ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.568+0000 7f6bece01640 1 -- 172.21.15.164:0/2335010532 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf8022070 con 0x559457f4ade0 2024-09-13T23:07:17.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.568+0000 7f6bece01640 1 -- 172.21.15.164:0/2335010532 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf800d520 con 0x559457f4ade0 2024-09-13T23:07:17.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.568+0000 7f6d07c36800 1 -- 172.21.15.164:0/2335010532 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559457f4b9d0 con 0x559457f4ade0 2024-09-13T23:07:17.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.568+0000 7f6bece01640 1 -- 172.21.15.164:0/2335010532 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf800d800 con 0x559457f4ade0 2024-09-13T23:07:17.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.568+0000 7f6d07c36800 1 -- 172.21.15.164:0/2335010532 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559457f4e6b0 con 0x559457f4ade0 2024-09-13T23:07:17.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.569+0000 7f6bece01640 1 -- 172.21.15.164:0/2335010532 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6cf8025070 con 0x559457f4ade0 2024-09-13T23:07:17.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.569+0000 7f6bece01640 1 --2- 172.21.15.164:0/2335010532 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6bdc036b90 0x7f6bdc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.569+0000 7f6bece01640 1 -- 172.21.15.164:0/2335010532 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6cf804e120 con 0x559457f4ade0 2024-09-13T23:07:17.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.569+0000 7f6d03753640 1 --2- 172.21.15.164:0/2335010532 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6bdc036b90 0x7f6bdc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.570+0000 7f6d07c36800 1 Processor -- start 2024-09-13T23:07:17.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.570+0000 7f6d07c36800 1 -- start start 2024-09-13T23:07:17.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.570+0000 7f6d03753640 1 --2- 172.21.15.164:0/2335010532 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6bdc036b90 0x7f6bdc039050 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x559457f3b450 tx=0x7f6cfc005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.570+0000 7f6d07c36800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457f57a50 0x559457f57e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.570+0000 7f6d07c36800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559457e390d0 con 0x559457f57a50 2024-09-13T23:07:17.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.570+0000 7f6d02751640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457f57a50 0x559457f57e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.570+0000 7f6d02751640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457f57a50 0x559457f57e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44416/0 (socket says 172.21.15.164:44416) 2024-09-13T23:07:17.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.570+0000 7f6d02751640 1 -- 172.21.15.164:0/2349003470 learned_addr learned my addr 172.21.15.164:0/2349003470 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:17.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.570+0000 7f6d02751640 1 -- 172.21.15.164:0/2349003470 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559457f58420 con 0x559457f57a50 2024-09-13T23:07:17.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.571+0000 7f6d02751640 1 --2- 172.21.15.164:0/2349003470 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457f57a50 0x559457f57e50 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800eee0 tx=0x7f6cf8024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f271e4bbdcfc1d2b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.571+0000 7f6be67fc640 1 -- 172.21.15.164:0/2349003470 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf8026730 con 0x559457f57a50 2024-09-13T23:07:17.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.571+0000 7f6be67fc640 1 -- 172.21.15.164:0/2349003470 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf8025c50 con 0x559457f57a50 2024-09-13T23:07:17.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.571+0000 7f6be67fc640 1 -- 172.21.15.164:0/2349003470 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf80268d0 con 0x559457f57a50 2024-09-13T23:07:17.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.571+0000 7f6d07c36800 1 -- 172.21.15.164:0/2349003470 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457f57a50 msgr2=0x559457f57e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.571+0000 7f6d07c36800 1 --2- 172.21.15.164:0/2349003470 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457f57a50 0x559457f57e50 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800eee0 tx=0x7f6cf8024740 comp rx=0 tx=0).stop 2024-09-13T23:07:17.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.571+0000 7f6d07c36800 1 -- 172.21.15.164:0/2349003470 shutdown_connections 2024-09-13T23:07:17.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.571+0000 7f6d07c36800 1 --2- 172.21.15.164:0/2349003470 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457f57a50 0x559457f57e50 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.571+0000 7f6d07c36800 1 -- 172.21.15.164:0/2349003470 >> 172.21.15.164:0/2349003470 conn(0x559457f53e00 msgr2=0x559457f51f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:17.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.571+0000 7f6d07c36800 1 -- 172.21.15.164:0/2349003470 shutdown_connections 2024-09-13T23:07:17.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.571+0000 7f6d07c36800 1 -- 172.21.15.164:0/2349003470 wait complete. 2024-09-13T23:07:17.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.572+0000 7f6d07c36800 1 Processor -- start 2024-09-13T23:07:17.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.572+0000 7f6d07c36800 1 -- start start 2024-09-13T23:07:17.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.572+0000 7f6d07c36800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457f57a50 0x559457f5ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.572+0000 7f6d07c36800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559457f588b0 con 0x559457f57a50 2024-09-13T23:07:17.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.572+0000 7f6d02751640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457f57a50 0x559457f5ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.572+0000 7f6d02751640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457f57a50 0x559457f5ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44418/0 (socket says 172.21.15.164:44418) 2024-09-13T23:07:17.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.572+0000 7f6d02751640 1 -- 172.21.15.164:0/3215564314 learned_addr learned my addr 172.21.15.164:0/3215564314 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:17.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.573+0000 7f6d02751640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559457f5f390 con 0x559457f57a50 2024-09-13T23:07:17.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.573+0000 7f6d02751640 1 --2- 172.21.15.164:0/3215564314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457f57a50 0x559457f5ee50 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8024a00 tx=0x7f6cf804c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.573+0000 7f6be4ff9640 1 -- 172.21.15.164:0/3215564314 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf8025e00 con 0x559457f57a50 2024-09-13T23:07:17.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.573+0000 7f6be4ff9640 1 -- 172.21.15.164:0/3215564314 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf800dbb0 con 0x559457f57a50 2024-09-13T23:07:17.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.573+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559457f5f390 con 0x559457f57a50 2024-09-13T23:07:17.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.573+0000 7f6be4ff9640 1 -- 172.21.15.164:0/3215564314 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf804c780 con 0x559457f57a50 2024-09-13T23:07:17.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.573+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559457f5f390 con 0x559457f57a50 2024-09-13T23:07:17.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.574+0000 7f6be4ff9640 1 -- 172.21.15.164:0/3215564314 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6cf804c920 con 0x559457f57a50 2024-09-13T23:07:17.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.574+0000 7f6be4ff9640 1 --2- 172.21.15.164:0/3215564314 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6bcc036b90 0x7f6bcc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.574+0000 7f6be4ff9640 1 -- 172.21.15.164:0/3215564314 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6cf801dd40 con 0x559457f57a50 2024-09-13T23:07:17.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.574+0000 7f6d03753640 1 --2- 172.21.15.164:0/3215564314 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6bcc036b90 0x7f6bcc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.575+0000 7f6d03753640 1 --2- 172.21.15.164:0/3215564314 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6bcc036b90 0x7f6bcc039050 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x559457f343c0 tx=0x7f6cfc01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.575+0000 7f6d07c36800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.575+0000 7f6d07c36800 1 --2- 172.21.15.164:0/3215564314 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559457f6a560 0x559457f6ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.575+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559457f6d170 con 0x559457f6a560 2024-09-13T23:07:17.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.575+0000 7f6d02f52640 1 --2- 172.21.15.164:0/3215564314 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559457f6a560 0x559457f6ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.575+0000 7f6d02f52640 1 --2- 172.21.15.164:0/3215564314 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559457f6a560 0x559457f6ca20 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.576+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6cf407f070 con 0x559457f6a560 2024-09-13T23:07:17.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.576+0000 7f6d07c36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:17.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.576+0000 7f6d07c36800 20 realm 2024-09-13T23:07:17.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.576+0000 7f6d07c36800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.576+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559457f6d580 con 0x559457f6a560 2024-09-13T23:07:17.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.576+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6cf407f070 con 0x559457f6a560 2024-09-13T23:07:17.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.576+0000 7f6d07c36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:17.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.576+0000 7f6d07c36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:07:17.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.576+0000 7f6d07c36800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.576+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559457f6de50 con 0x559457f6a560 2024-09-13T23:07:17.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.576+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6cf407f070 con 0x559457f6a560 2024-09-13T23:07:17.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.576+0000 7f6d07c36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:17.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.576+0000 7f6d07c36800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.576+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559457f6e1f0 con 0x559457f6a560 2024-09-13T23:07:17.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.576+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6cf407f070 con 0x559457f6a560 2024-09-13T23:07:17.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.576+0000 7f6d07c36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:17.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.576+0000 7f6d07c36800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.576+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559457f6ea40 con 0x559457f6a560 2024-09-13T23:07:17.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.577+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6cf407f070 con 0x559457f6a560 2024-09-13T23:07:17.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.577+0000 7f6d07c36800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:07:17.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.577+0000 7f6d07c36800 20 searching for the correct realm 2024-09-13T23:07:17.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.577+0000 7f6d07c36800 1 --2- 172.21.15.164:0/3215564314 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x559457f707b0 0x559457f72ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.577+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x559457f707b0 2024-09-13T23:07:17.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.577+0000 7f6d02751640 1 --2- 172.21.15.164:0/3215564314 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x559457f707b0 0x559457f72ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.577+0000 7f6d02751640 1 --2- 172.21.15.164:0/3215564314 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x559457f707b0 0x559457f72ba0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.577+0000 7f6d02751640 1 -- 172.21.15.164:0/3215564314 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf8024030 con 0x559457f707b0 2024-09-13T23:07:17.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.577+0000 7f6d02751640 1 --2- 172.21.15.164:0/3215564314 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f6cf801ac20 0x7f6cf80278c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.577+0000 7f6d02751640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x7f6cf801ac20 2024-09-13T23:07:17.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.577+0000 7f6d03753640 1 --2- 172.21.15.164:0/3215564314 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f6cf801ac20 0x7f6cf80278c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.578+0000 7f6d03753640 1 --2- 172.21.15.164:0/3215564314 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f6cf801ac20 0x7f6cf80278c0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.578+0000 7f6d03753640 1 -- 172.21.15.164:0/3215564314 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cfc01f070 con 0x7f6cf801ac20 2024-09-13T23:07:17.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.578+0000 7f6d03753640 1 --2- 172.21.15.164:0/3215564314 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f6cfc031040 0x7f6cfc032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.578+0000 7f6d03753640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x7f6cfc031040 2024-09-13T23:07:17.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.578+0000 7f6d02f52640 1 --2- 172.21.15.164:0/3215564314 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f6cfc031040 0x7f6cfc032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.579+0000 7f6d02f52640 1 --2- 172.21.15.164:0/3215564314 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f6cfc031040 0x7f6cfc032940 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.579+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf407f070 con 0x7f6cfc031040 2024-09-13T23:07:17.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.579+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x559457f6a560 2024-09-13T23:07:17.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.579+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6cf407f070 con 0x559457f6a560 2024-09-13T23:07:17.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.579+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x559457f6a560 2024-09-13T23:07:17.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.580+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf407f070 con 0x559457f6a560 2024-09-13T23:07:17.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.580+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x7f6cfc031040 2024-09-13T23:07:17.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.580+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf407f070 con 0x7f6cfc031040 2024-09-13T23:07:17.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.580+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x7f6cfc031040 2024-09-13T23:07:17.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.580+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf407f070 con 0x7f6cfc031040 2024-09-13T23:07:17.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.580+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x7f6cf801ac20 2024-09-13T23:07:17.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.580+0000 7f6d03753640 1 -- 172.21.15.164:0/3215564314 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cfc01f070 con 0x7f6cf801ac20 2024-09-13T23:07:17.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.580+0000 7f6d03753640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x559457f707b0 2024-09-13T23:07:17.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.581+0000 7f6d02751640 1 -- 172.21.15.164:0/3215564314 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf8024030 con 0x559457f707b0 2024-09-13T23:07:17.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.581+0000 7f6d02751640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x559457f6a560 2024-09-13T23:07:17.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.581+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf407f070 con 0x559457f6a560 2024-09-13T23:07:17.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.581+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x7f6cfc031040 2024-09-13T23:07:17.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.581+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf407f070 con 0x7f6cfc031040 2024-09-13T23:07:17.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.581+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x559457f6a560 2024-09-13T23:07:17.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.581+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf407f070 con 0x559457f6a560 2024-09-13T23:07:17.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.581+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x7f6cf801ac20 2024-09-13T23:07:17.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.582+0000 7f6d03753640 1 -- 172.21.15.164:0/3215564314 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6cfc01f070 con 0x7f6cf801ac20 2024-09-13T23:07:17.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.582+0000 7f6d03753640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x559457f707b0 2024-09-13T23:07:17.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.582+0000 7f6d02751640 1 -- 172.21.15.164:0/3215564314 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf8024030 con 0x559457f707b0 2024-09-13T23:07:17.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.582+0000 7f6d02751640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x559457f707b0 2024-09-13T23:07:17.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.582+0000 7f6d02751640 1 -- 172.21.15.164:0/3215564314 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf8024030 con 0x559457f707b0 2024-09-13T23:07:17.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.582+0000 7f6d02751640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x7f6cfc031040 2024-09-13T23:07:17.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.582+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf407f070 con 0x7f6cfc031040 2024-09-13T23:07:17.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.582+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x559457f707b0 2024-09-13T23:07:17.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.583+0000 7f6d02751640 1 -- 172.21.15.164:0/3215564314 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf8024030 con 0x559457f707b0 2024-09-13T23:07:17.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.583+0000 7f6d02751640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x559457f707b0 2024-09-13T23:07:17.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.583+0000 7f6d02751640 1 -- 172.21.15.164:0/3215564314 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf8024030 con 0x559457f707b0 2024-09-13T23:07:17.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.583+0000 7f6d02751640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x559457f6a560 2024-09-13T23:07:17.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.583+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf407f070 con 0x559457f6a560 2024-09-13T23:07:17.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.583+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x559457f6a560 2024-09-13T23:07:17.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.583+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6cf407f070 con 0x559457f6a560 2024-09-13T23:07:17.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.583+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x7f6cfc031040 2024-09-13T23:07:17.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.584+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf407f070 con 0x7f6cfc031040 2024-09-13T23:07:17.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.584+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x559457f707b0 2024-09-13T23:07:17.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.584+0000 7f6d02751640 1 -- 172.21.15.164:0/3215564314 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf8024030 con 0x559457f707b0 2024-09-13T23:07:17.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.584+0000 7f6d02751640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x7f6cf801ac20 2024-09-13T23:07:17.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.584+0000 7f6d03753640 1 -- 172.21.15.164:0/3215564314 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cfc01f070 con 0x7f6cf801ac20 2024-09-13T23:07:17.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.584+0000 7f6d03753640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x559457f6a560 2024-09-13T23:07:17.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.584+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6cf407f070 con 0x559457f6a560 2024-09-13T23:07:17.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.585+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x7f6cfc031040 2024-09-13T23:07:17.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.585+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf407f070 con 0x7f6cfc031040 2024-09-13T23:07:17.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.585+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x559457f707b0 2024-09-13T23:07:17.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.585+0000 7f6d02751640 1 -- 172.21.15.164:0/3215564314 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf8024030 con 0x559457f707b0 2024-09-13T23:07:17.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.585+0000 7f6d02751640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x7f6cfc031040 2024-09-13T23:07:17.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.585+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf407f070 con 0x7f6cfc031040 2024-09-13T23:07:17.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.585+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x7f6cf801ac20 2024-09-13T23:07:17.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.586+0000 7f6d03753640 1 -- 172.21.15.164:0/3215564314 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cfc01f070 con 0x7f6cf801ac20 2024-09-13T23:07:17.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.586+0000 7f6d03753640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x559457f707b0 2024-09-13T23:07:17.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.586+0000 7f6d02751640 1 -- 172.21.15.164:0/3215564314 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf8024030 con 0x559457f707b0 2024-09-13T23:07:17.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.586+0000 7f6d02751640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x7f6cf801ac20 2024-09-13T23:07:17.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.586+0000 7f6d03753640 1 -- 172.21.15.164:0/3215564314 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cfc01f070 con 0x7f6cf801ac20 2024-09-13T23:07:17.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.586+0000 7f6d03753640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x559457f6a560 2024-09-13T23:07:17.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.586+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6cf407f070 con 0x559457f6a560 2024-09-13T23:07:17.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.586+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559457f731b0 con 0x7f6cf801ac20 2024-09-13T23:07:17.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.587+0000 7f6d03753640 1 -- 172.21.15.164:0/3215564314 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cfc040040 con 0x7f6cf801ac20 2024-09-13T23:07:17.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.587+0000 7f6d07c36800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:07:17.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.587+0000 7f6d07c36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:07:17.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.587+0000 7f6d07c36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:07:17.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.587+0000 7f6d07c36800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:07:17.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.587+0000 7f6d07c36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:07:17.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.587+0000 7f6d07c36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:07:17.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.587+0000 7f6d07c36800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.587+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559457f6f3f0 con 0x559457f6a560 2024-09-13T23:07:17.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.587+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6cf407f070 con 0x559457f6a560 2024-09-13T23:07:17.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.587+0000 7f6d07c36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:17.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.587+0000 7f6d07c36800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.587+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559457f6fc90 con 0x559457f6a560 2024-09-13T23:07:17.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.587+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6cf407f070 con 0x559457f6a560 2024-09-13T23:07:17.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.587+0000 7f6d07c36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:17.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.587+0000 7f6d07c36800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.587+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559457f73630 con 0x559457f6a560 2024-09-13T23:07:17.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.587+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6cf407f070 con 0x559457f6a560 2024-09-13T23:07:17.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.587+0000 7f6d07c36800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:07:17.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.588+0000 7f6d07c36800 20 zone default found 2024-09-13T23:07:17.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.588+0000 7f6d07c36800 4 Realm: () 2024-09-13T23:07:17.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.588+0000 7f6d07c36800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:07:17.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.588+0000 7f6d07c36800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:07:17.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.588+0000 7f6d07c36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:07:17.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.588+0000 7f6d07c36800 20 zonegroup default 2024-09-13T23:07:17.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.588+0000 7f6d07c36800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.588+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559457f73ae0 con 0x7f6cfc031040 2024-09-13T23:07:17.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.588+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6cf407f070 con 0x7f6cfc031040 2024-09-13T23:07:17.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.588+0000 7f6d07c36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:17.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.588+0000 7f6d07c36800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.588+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559457f754c0 con 0x559457f707b0 2024-09-13T23:07:17.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.588+0000 7f6d02751640 1 -- 172.21.15.164:0/3215564314 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6cf8024030 con 0x559457f707b0 2024-09-13T23:07:17.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.588+0000 7f6d07c36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:17.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.588+0000 7f6d07c36800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.588+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559457f75960 con 0x559457f707b0 2024-09-13T23:07:17.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.588+0000 7f6d02751640 1 -- 172.21.15.164:0/3215564314 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6cf8024030 con 0x559457f707b0 2024-09-13T23:07:17.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.588+0000 7f6d07c36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:17.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.588+0000 7f6d07c36800 20 started sync module instance, tier type = 2024-09-13T23:07:17.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.588+0000 7f6d07c36800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:07:17.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.588+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559457f74950 con 0x7f6cf801ac20 2024-09-13T23:07:17.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.590+0000 7f6d03753640 1 -- 172.21.15.164:0/3215564314 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cfc040040 con 0x7f6cf801ac20 2024-09-13T23:07:17.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.590+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94095619345728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559457f76270 con 0x7f6cf801ac20 2024-09-13T23:07:17.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.590+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559457f76ac0 con 0x559457f6a560 2024-09-13T23:07:17.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.591+0000 7f6d03753640 1 -- 172.21.15.164:0/3215564314 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94095619345728] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cfc040040 con 0x7f6cf801ac20 2024-09-13T23:07:17.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.591+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf407f070 con 0x559457f6a560 2024-09-13T23:07:17.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.591+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94095619349952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559457f76710 con 0x559457f6a560 2024-09-13T23:07:17.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.591+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559457f771e0 con 0x559457f707b0 2024-09-13T23:07:17.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.592+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94095619349952] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf407f070 con 0x559457f6a560 2024-09-13T23:07:17.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.592+0000 7f6d02751640 1 -- 172.21.15.164:0/3215564314 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf8024030 con 0x559457f707b0 2024-09-13T23:07:17.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.592+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94095619353808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559457f77580 con 0x559457f707b0 2024-09-13T23:07:17.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.592+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559457f77fb0 con 0x7f6cf801ac20 2024-09-13T23:07:17.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.593+0000 7f6d03753640 1 -- 172.21.15.164:0/3215564314 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cfc040040 con 0x7f6cf801ac20 2024-09-13T23:07:17.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.593+0000 7f6d02751640 1 -- 172.21.15.164:0/3215564314 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94095619353808] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf8024030 con 0x559457f707b0 2024-09-13T23:07:17.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.594+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94095619357376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559457f783d0 con 0x7f6cf801ac20 2024-09-13T23:07:17.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.594+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559457f78e30 con 0x559457f6a560 2024-09-13T23:07:17.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.595+0000 7f6d03753640 1 -- 172.21.15.164:0/3215564314 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94095619357376] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cfc040040 con 0x7f6cf801ac20 2024-09-13T23:07:17.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.595+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf407f070 con 0x559457f6a560 2024-09-13T23:07:17.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.595+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94095619351008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559457f78e30 con 0x559457f6a560 2024-09-13T23:07:17.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.595+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559457f79880 con 0x7f6cfc031040 2024-09-13T23:07:17.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.596+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf407f070 con 0x7f6cfc031040 2024-09-13T23:07:17.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.596+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94095619351008] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf407f070 con 0x559457f6a560 2024-09-13T23:07:17.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.596+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94095619363728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559457f797b0 con 0x7f6cfc031040 2024-09-13T23:07:17.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.596+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559457f7a2c0 con 0x7f6cfc031040 2024-09-13T23:07:17.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.597+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94095619363728] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf407f070 con 0x7f6cfc031040 2024-09-13T23:07:17.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.597+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf407f070 con 0x7f6cfc031040 2024-09-13T23:07:17.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.597+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94095619366048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559457f7a2c0 con 0x7f6cfc031040 2024-09-13T23:07:17.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.597+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559457f7ac80 con 0x7f6cfc031040 2024-09-13T23:07:17.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.598+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94095619366048] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf407f070 con 0x7f6cfc031040 2024-09-13T23:07:17.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.598+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf407f070 con 0x7f6cfc031040 2024-09-13T23:07:17.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.598+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94095619361040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559457f7ac80 con 0x7f6cfc031040 2024-09-13T23:07:17.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.598+0000 7f6d07c36800 20 add_watcher() i=0 2024-09-13T23:07:17.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.598+0000 7f6d07c36800 20 add_watcher() i=1 2024-09-13T23:07:17.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.598+0000 7f6d07c36800 20 add_watcher() i=2 2024-09-13T23:07:17.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.598+0000 7f6d07c36800 20 add_watcher() i=3 2024-09-13T23:07:17.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.598+0000 7f6d07c36800 20 add_watcher() i=4 2024-09-13T23:07:17.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.598+0000 7f6d07c36800 20 add_watcher() i=5 2024-09-13T23:07:17.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.598+0000 7f6d07c36800 20 add_watcher() i=6 2024-09-13T23:07:17.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.600+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94095619361040] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf407f070 con 0x7f6cfc031040 2024-09-13T23:07:17.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.600+0000 7f6d07c36800 20 add_watcher() i=7 2024-09-13T23:07:17.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.600+0000 7f6d07c36800 2 all 8 watchers are set, enabling cache 2024-09-13T23:07:17.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.600+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559457f7dfe0 con 0x559457f6a560 2024-09-13T23:07:17.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.600+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6cf407f070 con 0x559457f6a560 2024-09-13T23:07:17.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.600+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94095619381728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559457f7adf0 con 0x559457f6a560 2024-09-13T23:07:17.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.601+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94095619381728] v34'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6cf407f070 con 0x559457f6a560 2024-09-13T23:07:17.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.601+0000 7f6bb97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:17.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.601+0000 7f6d07c36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:07:17.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.601+0000 7f6d07c36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:07:17.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.601+0000 7f6d07c36800 5 note: GC not initialized 2024-09-13T23:07:17.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.602+0000 7f6b33fff640 20 reqs_thread_entry: start 2024-09-13T23:07:17.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.602+0000 7f6d07c36800 20 init_complete bucket index max shards: 11 2024-09-13T23:07:17.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.602+0000 7f6d07c36800 20 Filter name: none 2024-09-13T23:07:17.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.602+0000 7f6b31ffb640 20 reqs_thread_entry: start 2024-09-13T23:07:17.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.602+0000 7f6d07c36800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:07:17.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.602+0000 7f6d07c36800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.602+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559457fb1480 con 0x559457f6a560 2024-09-13T23:07:17.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.602+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6cf407f070 con 0x559457f6a560 2024-09-13T23:07:17.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.602+0000 7f6d07c36800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:07:17.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.602+0000 7f6d07c36800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:07:17.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.602+0000 7f6d07c36800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:07:17.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.602+0000 7f6d07c36800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:07:17.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.602+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559457fb3f10 con 0x7f6cfc031040 2024-09-13T23:07:17.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.604+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(63 usage.10 [call] v34'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf407f070 con 0x7f6cfc031040 2024-09-13T23:07:17.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.604+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559457fb3f10 con 0x7f6cfc031040 2024-09-13T23:07:17.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.605+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(64 usage.10 [call] v34'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7f6cf407f070 con 0x7f6cfc031040 2024-09-13T23:07:17.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.606+0000 7f6bb97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:17.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.606+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94095619381728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559457f7d170 con 0x559457f6a560 2024-09-13T23:07:17.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.607+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94095619381728] v34'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6cf407f070 con 0x559457f6a560 2024-09-13T23:07:17.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.607+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94095619345728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559457f7d9e0 con 0x7f6cf801ac20 2024-09-13T23:07:17.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.608+0000 7f6d03753640 1 -- 172.21.15.164:0/3215564314 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94095619345728] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cfc040040 con 0x7f6cf801ac20 2024-09-13T23:07:17.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.608+0000 7f6d07c36800 20 remove_watcher() i=0 2024-09-13T23:07:17.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.608+0000 7f6d07c36800 2 removed watcher, disabling cache 2024-09-13T23:07:17.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.608+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94095619349952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559457fb1020 con 0x559457f6a560 2024-09-13T23:07:17.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.609+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94095619349952] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf407f070 con 0x559457f6a560 2024-09-13T23:07:17.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.609+0000 7f6d07c36800 20 remove_watcher() i=1 2024-09-13T23:07:17.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.609+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94095619353808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559457fb1020 con 0x559457f707b0 2024-09-13T23:07:17.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.610+0000 7f6d02751640 1 -- 172.21.15.164:0/3215564314 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94095619353808] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf8024030 con 0x559457f707b0 2024-09-13T23:07:17.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.610+0000 7f6d07c36800 20 remove_watcher() i=2 2024-09-13T23:07:17.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.610+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94095619357376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559457f75dc0 con 0x7f6cf801ac20 2024-09-13T23:07:17.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.612+0000 7f6d03753640 1 -- 172.21.15.164:0/3215564314 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94095619357376] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cfc040040 con 0x7f6cf801ac20 2024-09-13T23:07:17.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.612+0000 7f6d07c36800 20 remove_watcher() i=3 2024-09-13T23:07:17.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.612+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94095619351008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559457f75dc0 con 0x559457f6a560 2024-09-13T23:07:17.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.613+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94095619351008] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf407f070 con 0x559457f6a560 2024-09-13T23:07:17.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.613+0000 7f6d07c36800 20 remove_watcher() i=4 2024-09-13T23:07:17.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.613+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94095619363728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559457f76270 con 0x7f6cfc031040 2024-09-13T23:07:17.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.614+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94095619363728] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf407f070 con 0x7f6cfc031040 2024-09-13T23:07:17.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.614+0000 7f6d07c36800 20 remove_watcher() i=5 2024-09-13T23:07:17.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.614+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94095619366048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559457f76270 con 0x7f6cfc031040 2024-09-13T23:07:17.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.615+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94095619366048] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf407f070 con 0x7f6cfc031040 2024-09-13T23:07:17.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.615+0000 7f6d07c36800 20 remove_watcher() i=6 2024-09-13T23:07:17.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.615+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94095619361040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559457f76270 con 0x7f6cfc031040 2024-09-13T23:07:17.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.616+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94095619361040] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf407f070 con 0x7f6cfc031040 2024-09-13T23:07:17.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.616+0000 7f6d07c36800 20 remove_watcher() i=7 2024-09-13T23:07:17.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.616+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f6cfc031040 msgr2=0x7f6cfc032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.616+0000 7f6d07c36800 1 --2- 172.21.15.164:0/3215564314 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f6cfc031040 0x7f6cfc032940 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.616+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559457f6a560 msgr2=0x559457f6ca20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.616+0000 7f6d07c36800 1 --2- 172.21.15.164:0/3215564314 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559457f6a560 0x559457f6ca20 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.616+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f6cf801ac20 msgr2=0x7f6cf80278c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.616+0000 7f6d07c36800 1 --2- 172.21.15.164:0/3215564314 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f6cf801ac20 0x7f6cf80278c0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.616+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x559457f707b0 msgr2=0x559457f72ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.616+0000 7f6d07c36800 1 --2- 172.21.15.164:0/3215564314 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x559457f707b0 0x559457f72ba0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.616+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6bcc036b90 msgr2=0x7f6bcc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.616+0000 7f6d07c36800 1 --2- 172.21.15.164:0/3215564314 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6bcc036b90 0x7f6bcc039050 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x559457f343c0 tx=0x7f6cfc01f000 comp rx=0 tx=0).stop 2024-09-13T23:07:17.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.616+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457f57a50 msgr2=0x559457f5ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.616+0000 7f6d07c36800 1 --2- 172.21.15.164:0/3215564314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457f57a50 0x559457f5ee50 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8024a00 tx=0x7f6cf804c340 comp rx=0 tx=0).stop 2024-09-13T23:07:17.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.616+0000 7f6d02f52640 1 -- 172.21.15.164:0/3215564314 reap_dead start 2024-09-13T23:07:17.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.616+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 shutdown_connections 2024-09-13T23:07:17.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.616+0000 7f6d07c36800 1 --2- 172.21.15.164:0/3215564314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457f57a50 0x559457f5ee50 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.616+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 >> 172.21.15.164:0/3215564314 conn(0x559457f53e00 msgr2=0x559457f51ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:17.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.616+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 shutdown_connections 2024-09-13T23:07:17.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.617+0000 7f6d07c36800 1 -- 172.21.15.164:0/3215564314 wait complete. 2024-09-13T23:07:17.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.617+0000 7f6d07c36800 1 -- 172.21.15.164:0/2335010532 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6bdc036b90 msgr2=0x7f6bdc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.617+0000 7f6d07c36800 1 --2- 172.21.15.164:0/2335010532 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6bdc036b90 0x7f6bdc039050 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x559457f3b450 tx=0x7f6cfc005840 comp rx=0 tx=0).stop 2024-09-13T23:07:17.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.617+0000 7f6d07c36800 1 -- 172.21.15.164:0/2335010532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457f4ade0 msgr2=0x559457f4b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.617+0000 7f6d07c36800 1 --2- 172.21.15.164:0/2335010532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457f4ade0 0x559457f4b200 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8001ed0 tx=0x7f6cf800ea00 comp rx=0 tx=0).stop 2024-09-13T23:07:17.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.617+0000 7f6d07c36800 1 -- 172.21.15.164:0/2335010532 shutdown_connections 2024-09-13T23:07:17.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.617+0000 7f6d07c36800 1 --2- 172.21.15.164:0/2335010532 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6bdc036b90 0x7f6bdc039050 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.617+0000 7f6d07c36800 1 --2- 172.21.15.164:0/2335010532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457f4ade0 0x559457f4b200 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.617+0000 7f6d07c36800 1 -- 172.21.15.164:0/2335010532 >> 172.21.15.164:0/2335010532 conn(0x559457f3fd70 msgr2=0x559457f428f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:17.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.617+0000 7f6d07c36800 1 -- 172.21.15.164:0/2335010532 shutdown_connections 2024-09-13T23:07:17.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.617+0000 7f6d07c36800 1 -- 172.21.15.164:0/2335010532 wait complete. 2024-09-13T23:07:17.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.617+0000 7f6d07c36800 1 -- 172.21.15.164:0/2771225866 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559457e3d700 msgr2=0x559457f3a380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.617+0000 7f6d07c36800 1 --2- 172.21.15.164:0/2771225866 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559457e3d700 0x559457f3a380 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.617+0000 7f6d07c36800 1 -- 172.21.15.164:0/2771225866 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6be8036b90 msgr2=0x7f6be8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.617+0000 7f6d07c36800 1 --2- 172.21.15.164:0/2771225866 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6be8036b90 0x7f6be8039050 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8000f60 tx=0x7f6cf8001370 comp rx=0 tx=0).stop 2024-09-13T23:07:17.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.617+0000 7f6d07c36800 1 -- 172.21.15.164:0/2771225866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457dade10 msgr2=0x559457f33310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.617+0000 7f6d07c36800 1 --2- 172.21.15.164:0/2771225866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457dade10 0x559457f33310 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4025da0 tx=0x7f6cf4002fb0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.617+0000 7f6d07c36800 1 -- 172.21.15.164:0/2771225866 shutdown_connections 2024-09-13T23:07:17.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.617+0000 7f6d07c36800 1 --2- 172.21.15.164:0/2771225866 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x559457e3d700 0x559457f3a380 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.617+0000 7f6d07c36800 1 --2- 172.21.15.164:0/2771225866 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6be8036b90 0x7f6be8039050 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.617+0000 7f6d07c36800 1 --2- 172.21.15.164:0/2771225866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559457dade10 0x559457f33310 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.617+0000 7f6d07c36800 1 -- 172.21.15.164:0/2771225866 >> 172.21.15.164:0/2771225866 conn(0x559457e34df0 msgr2=0x559457e39600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:17.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.617+0000 7f6d07c36800 1 -- 172.21.15.164:0/2771225866 shutdown_connections 2024-09-13T23:07:17.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.618+0000 7f6d07c36800 1 -- 172.21.15.164:0/2771225866 wait complete. 2024-09-13T23:07:17.627 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-13T23:07:17.627 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-13T23:07:17.627 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-13T23:07:17.672 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:07:17.672 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:07:17.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.672+0000 7f27b7e0e800 1 Processor -- start 2024-09-13T23:07:17.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.672+0000 7f27b7e0e800 1 -- start start 2024-09-13T23:07:17.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.672+0000 7f27b7e0e800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55f7b4a41ad0 0x55f7b4a43ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.672+0000 7f27b7e0e800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f7b48fcb30 con 0x55f7b4a3ba30 2024-09-13T23:07:17.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.672+0000 7f27b7e0e800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55f7b48de360 con 0x55f7b4a41ad0 2024-09-13T23:07:17.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.673+0000 7f27b2d0b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55f7b4a41ad0 0x55f7b4a43ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.673+0000 7f27b2d0b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55f7b4a41ad0 0x55f7b4a43ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44430/0 (socket says 172.21.15.164:44430) 2024-09-13T23:07:17.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.673+0000 7f27b350c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55f7b4a3ba30 0x55f7b4a3be30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:60864/0 (socket says 172.21.15.164:60864) 2024-09-13T23:07:17.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.673+0000 7f27b2d0b640 1 -- 172.21.15.164:0/428343745 learned_addr learned my addr 172.21.15.164:0/428343745 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:17.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.673+0000 7f27b2d0b640 1 -- 172.21.15.164:0/428343745 >> v1:172.21.15.17:6789/0 conn(0x55f7b4a3ba30 legacy=0x55f7b4a3be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.673+0000 7f27b2d0b640 1 -- 172.21.15.164:0/428343745 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7b4904e00 con 0x55f7b4a41ad0 2024-09-13T23:07:17.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.675+0000 7f27b2d0b640 1 --2- 172.21.15.164:0/428343745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4a41ad0 0x55f7b4a43ec0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f27a800a520 tx=0x7f27a8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cebc0cf67d01474d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.675+0000 7f27b250a640 1 -- 172.21.15.164:0/428343745 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27a8055070 con 0x55f7b4a41ad0 2024-09-13T23:07:17.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.675+0000 7f27b250a640 1 -- 172.21.15.164:0/428343745 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a80515b0 con 0x55f7b4a41ad0 2024-09-13T23:07:17.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.675+0000 7f27b250a640 1 -- 172.21.15.164:0/428343745 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27a80518d0 con 0x55f7b4a41ad0 2024-09-13T23:07:17.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.676+0000 7f27b7e0e800 1 -- 172.21.15.164:0/428343745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4a41ad0 msgr2=0x55f7b4a43ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.676+0000 7f27b7e0e800 1 --2- 172.21.15.164:0/428343745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4a41ad0 0x55f7b4a43ec0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f27a800a520 tx=0x7f27a8045ba0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.676+0000 7f27b7e0e800 1 -- 172.21.15.164:0/428343745 shutdown_connections 2024-09-13T23:07:17.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.676+0000 7f27b7e0e800 1 --2- 172.21.15.164:0/428343745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4a41ad0 0x55f7b4a43ec0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.676+0000 7f27b7e0e800 1 -- 172.21.15.164:0/428343745 >> 172.21.15.164:0/428343745 conn(0x55f7b4a375c0 msgr2=0x55f7b4a399e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:17.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.676+0000 7f27b7e0e800 1 -- 172.21.15.164:0/428343745 shutdown_connections 2024-09-13T23:07:17.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.676+0000 7f27b7e0e800 1 -- 172.21.15.164:0/428343745 wait complete. 2024-09-13T23:07:17.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.689+0000 7f27b7e0e800 1 Processor -- start 2024-09-13T23:07:17.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.689+0000 7f27b7e0e800 1 -- start start 2024-09-13T23:07:17.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.690+0000 7f27b7e0e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4a3ba30 0x55f7b4a3e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.690+0000 7f27b7e0e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f7b4989330 con 0x55f7b4a3ba30 2024-09-13T23:07:17.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.690+0000 7f27b350c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4a3ba30 0x55f7b4a3e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.690+0000 7f27b350c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4a3ba30 0x55f7b4a3e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44436/0 (socket says 172.21.15.164:44436) 2024-09-13T23:07:17.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.690+0000 7f27b350c640 1 -- 172.21.15.164:0/4062024454 learned_addr learned my addr 172.21.15.164:0/4062024454 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:17.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.690+0000 7f27b350c640 1 -- 172.21.15.164:0/4062024454 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7b48d6bc0 con 0x55f7b4a3ba30 2024-09-13T23:07:17.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.690+0000 7f27b350c640 1 --2- 172.21.15.164:0/4062024454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4a3ba30 0x55f7b4a3e3f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f27a4001650 tx=0x7f27a4001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e911d98584df3a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.691+0000 7f26a160a640 1 -- 172.21.15.164:0/4062024454 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27a4013420 con 0x55f7b4a3ba30 2024-09-13T23:07:17.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.691+0000 7f26a160a640 1 -- 172.21.15.164:0/4062024454 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a40135c0 con 0x55f7b4a3ba30 2024-09-13T23:07:17.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.691+0000 7f26a160a640 1 -- 172.21.15.164:0/4062024454 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27a40138c0 con 0x55f7b4a3ba30 2024-09-13T23:07:17.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.691+0000 7f27b7e0e800 1 -- 172.21.15.164:0/4062024454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4a3ba30 msgr2=0x55f7b4a3e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.691+0000 7f27b7e0e800 1 --2- 172.21.15.164:0/4062024454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4a3ba30 0x55f7b4a3e3f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f27a4001650 tx=0x7f27a4001b10 comp rx=0 tx=0).stop 2024-09-13T23:07:17.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.691+0000 7f27b7e0e800 1 -- 172.21.15.164:0/4062024454 shutdown_connections 2024-09-13T23:07:17.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.691+0000 7f27b7e0e800 1 --2- 172.21.15.164:0/4062024454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4a3ba30 0x55f7b4a3e3f0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.691+0000 7f27b7e0e800 1 -- 172.21.15.164:0/4062024454 >> 172.21.15.164:0/4062024454 conn(0x55f7b4a375c0 msgr2=0x55f7b4b28200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:17.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.691+0000 7f27b7e0e800 1 -- 172.21.15.164:0/4062024454 shutdown_connections 2024-09-13T23:07:17.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.691+0000 7f27b7e0e800 1 -- 172.21.15.164:0/4062024454 wait complete. 2024-09-13T23:07:17.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.692+0000 7f27b7e0e800 1 Processor -- start 2024-09-13T23:07:17.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.692+0000 7f27b7e0e800 1 -- start start 2024-09-13T23:07:17.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.692+0000 7f27b7e0e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4a3ba30 0x55f7b4b36460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.692+0000 7f27b7e0e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f7b4a44700 con 0x55f7b4a3ba30 2024-09-13T23:07:17.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.692+0000 7f27b350c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4a3ba30 0x55f7b4b36460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.692+0000 7f27b350c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4a3ba30 0x55f7b4b36460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44442/0 (socket says 172.21.15.164:44442) 2024-09-13T23:07:17.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.692+0000 7f27b350c640 1 -- 172.21.15.164:0/754096842 learned_addr learned my addr 172.21.15.164:0/754096842 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:17.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.692+0000 7f27b350c640 1 -- 172.21.15.164:0/754096842 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7b48eafe0 con 0x55f7b4a3ba30 2024-09-13T23:07:17.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.693+0000 7f27b350c640 1 --2- 172.21.15.164:0/754096842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4a3ba30 0x55f7b4b36460 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x55f7b4a3daf0 tx=0x7f27a4001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.693+0000 7f269fe07640 1 -- 172.21.15.164:0/754096842 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27a4022020 con 0x55f7b4a3ba30 2024-09-13T23:07:17.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.693+0000 7f269fe07640 1 -- 172.21.15.164:0/754096842 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a4006830 con 0x55f7b4a3ba30 2024-09-13T23:07:17.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.693+0000 7f269fe07640 1 -- 172.21.15.164:0/754096842 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27a4004b30 con 0x55f7b4a3ba30 2024-09-13T23:07:17.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.693+0000 7f27b7e0e800 1 -- 172.21.15.164:0/754096842 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7b4b369a0 con 0x55f7b4a3ba30 2024-09-13T23:07:17.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.693+0000 7f27b7e0e800 1 -- 172.21.15.164:0/754096842 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7b4b36ec0 con 0x55f7b4a3ba30 2024-09-13T23:07:17.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.694+0000 7f269fe07640 1 -- 172.21.15.164:0/754096842 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f27a4025020 con 0x55f7b4a3ba30 2024-09-13T23:07:17.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.694+0000 7f269fe07640 1 --2- 172.21.15.164:0/754096842 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2698036b40 0x7f2698039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.694+0000 7f269fe07640 1 -- 172.21.15.164:0/754096842 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f27a4018030 con 0x55f7b4a3ba30 2024-09-13T23:07:17.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.694+0000 7f27b2d0b640 1 --2- 172.21.15.164:0/754096842 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2698036b40 0x7f2698039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.694+0000 7f27b7e0e800 1 --2- 172.21.15.164:0/754096842 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f7b4a41ad0 0x55f7b4b3d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.694+0000 7f27b7e0e800 1 -- 172.21.15.164:0/754096842 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b3da50 con 0x55f7b4a41ad0 2024-09-13T23:07:17.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.694+0000 7f27b3d0d640 1 --2- 172.21.15.164:0/754096842 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f7b4a41ad0 0x55f7b4b3d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.694+0000 7f27b2d0b640 1 --2- 172.21.15.164:0/754096842 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2698036b40 0x7f2698039000 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f27a8057000 tx=0x7f27a8052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.695+0000 7f27b3d0d640 1 --2- 172.21.15.164:0/754096842 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f7b4a41ad0 0x55f7b4b3d4d0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.695+0000 7f27b3d0d640 1 -- 172.21.15.164:0/754096842 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27ac0083e0 con 0x55f7b4a41ad0 2024-09-13T23:07:17.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.695+0000 7f27b7e0e800 1 -- 172.21.15.164:0/754096842 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b3aa80 con 0x55f7b4a41ad0 2024-09-13T23:07:17.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.695+0000 7f27b3d0d640 1 -- 172.21.15.164:0/754096842 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f27ac0083e0 con 0x55f7b4a41ad0 2024-09-13T23:07:17.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.695+0000 7f27b7e0e800 1 -- 172.21.15.164:0/754096842 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b3f850 con 0x55f7b4a41ad0 2024-09-13T23:07:17.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.695+0000 7f27b3d0d640 1 -- 172.21.15.164:0/754096842 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f27ac0083e0 con 0x55f7b4a41ad0 2024-09-13T23:07:17.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.695+0000 7f27b7e0e800 1 -- 172.21.15.164:0/754096842 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b3ea80 con 0x55f7b4a41ad0 2024-09-13T23:07:17.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.696+0000 7f27b3d0d640 1 -- 172.21.15.164:0/754096842 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f27ac0083e0 con 0x55f7b4a41ad0 2024-09-13T23:07:17.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.696+0000 7f27b7e0e800 1 -- 172.21.15.164:0/754096842 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b3ee70 con 0x55f7b4a41ad0 2024-09-13T23:07:17.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.696+0000 7f27b3d0d640 1 -- 172.21.15.164:0/754096842 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f27ac0083e0 con 0x55f7b4a41ad0 2024-09-13T23:07:17.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.696+0000 7f27b7e0e800 1 Processor -- start 2024-09-13T23:07:17.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.696+0000 7f27b7e0e800 1 -- start start 2024-09-13T23:07:17.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.696+0000 7f27b7e0e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4b4de90 0x55f7b4b4e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.696+0000 7f27b7e0e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f7b48d8580 con 0x55f7b4b4de90 2024-09-13T23:07:17.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.697+0000 7f27b2d0b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4b4de90 0x55f7b4b4e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.697+0000 7f27b2d0b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4b4de90 0x55f7b4b4e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44458/0 (socket says 172.21.15.164:44458) 2024-09-13T23:07:17.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.697+0000 7f27b2d0b640 1 -- 172.21.15.164:0/3194683554 learned_addr learned my addr 172.21.15.164:0/3194683554 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:17.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.697+0000 7f27b2d0b640 1 -- 172.21.15.164:0/3194683554 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7b4b4e7f0 con 0x55f7b4b4de90 2024-09-13T23:07:17.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.697+0000 7f27b2d0b640 1 --2- 172.21.15.164:0/3194683554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4b4de90 0x55f7b4b4e2b0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f27a8000c00 tx=0x7f27a8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.697+0000 7f269d602640 1 -- 172.21.15.164:0/3194683554 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27a805ba50 con 0x55f7b4b4de90 2024-09-13T23:07:17.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.697+0000 7f269d602640 1 -- 172.21.15.164:0/3194683554 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a805bbf0 con 0x55f7b4b4de90 2024-09-13T23:07:17.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.697+0000 7f269d602640 1 -- 172.21.15.164:0/3194683554 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27a8073440 con 0x55f7b4b4de90 2024-09-13T23:07:17.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.697+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3194683554 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7b4b4ea20 con 0x55f7b4b4de90 2024-09-13T23:07:17.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.697+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3194683554 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7b4b516a0 con 0x55f7b4b4de90 2024-09-13T23:07:17.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.698+0000 7f269d602640 1 -- 172.21.15.164:0/3194683554 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f27a8058070 con 0x55f7b4b4de90 2024-09-13T23:07:17.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.698+0000 7f269d602640 1 --2- 172.21.15.164:0/3194683554 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f268c036b40 0x7f268c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.698+0000 7f269d602640 1 -- 172.21.15.164:0/3194683554 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f27a8062030 con 0x55f7b4b4de90 2024-09-13T23:07:17.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.698+0000 7f27b3d0d640 1 --2- 172.21.15.164:0/3194683554 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f268c036b40 0x7f268c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.699+0000 7f27b7e0e800 1 Processor -- start 2024-09-13T23:07:17.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.699+0000 7f27b3d0d640 1 --2- 172.21.15.164:0/3194683554 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f268c036b40 0x7f268c039000 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55f7b4b3e5a0 tx=0x7f27ac000f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.699+0000 7f27b7e0e800 1 -- start start 2024-09-13T23:07:17.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.699+0000 7f27b7e0e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4b5aaa0 0x55f7b4b5aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.699+0000 7f27b7e0e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f7b4a3cac0 con 0x55f7b4b5aaa0 2024-09-13T23:07:17.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.699+0000 7f27b2d0b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4b5aaa0 0x55f7b4b5aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.699+0000 7f27b2d0b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4b5aaa0 0x55f7b4b5aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44462/0 (socket says 172.21.15.164:44462) 2024-09-13T23:07:17.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.699+0000 7f27b2d0b640 1 -- 172.21.15.164:0/1808410112 learned_addr learned my addr 172.21.15.164:0/1808410112 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:17.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.699+0000 7f27b2d0b640 1 -- 172.21.15.164:0/1808410112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7b4b5b470 con 0x55f7b4b5aaa0 2024-09-13T23:07:17.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.699+0000 7f27b2d0b640 1 --2- 172.21.15.164:0/1808410112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4b5aaa0 0x55f7b4b5aea0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f27a8091340 tx=0x7f27a8066810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc3305cbc2e61b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.700+0000 7f2696ffd640 1 -- 172.21.15.164:0/1808410112 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27a80727e0 con 0x55f7b4b5aaa0 2024-09-13T23:07:17.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.700+0000 7f2696ffd640 1 -- 172.21.15.164:0/1808410112 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a8069420 con 0x55f7b4b5aaa0 2024-09-13T23:07:17.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.700+0000 7f2696ffd640 1 -- 172.21.15.164:0/1808410112 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27a80503e0 con 0x55f7b4b5aaa0 2024-09-13T23:07:17.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.700+0000 7f27b7e0e800 1 -- 172.21.15.164:0/1808410112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4b5aaa0 msgr2=0x55f7b4b5aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.700+0000 7f27b7e0e800 1 --2- 172.21.15.164:0/1808410112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4b5aaa0 0x55f7b4b5aea0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f27a8091340 tx=0x7f27a8066810 comp rx=0 tx=0).stop 2024-09-13T23:07:17.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.700+0000 7f27b7e0e800 1 -- 172.21.15.164:0/1808410112 shutdown_connections 2024-09-13T23:07:17.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.700+0000 7f27b7e0e800 1 --2- 172.21.15.164:0/1808410112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4b5aaa0 0x55f7b4b5aea0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.700+0000 7f27b7e0e800 1 -- 172.21.15.164:0/1808410112 >> 172.21.15.164:0/1808410112 conn(0x55f7b4b56e00 msgr2=0x55f7b4b54f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:17.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.700+0000 7f27b7e0e800 1 -- 172.21.15.164:0/1808410112 shutdown_connections 2024-09-13T23:07:17.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.700+0000 7f27b7e0e800 1 -- 172.21.15.164:0/1808410112 wait complete. 2024-09-13T23:07:17.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.700+0000 7f27b7e0e800 1 Processor -- start 2024-09-13T23:07:17.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.700+0000 7f27b7e0e800 1 -- start start 2024-09-13T23:07:17.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.701+0000 7f27b7e0e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4b5aaa0 0x55f7b4b61fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.701+0000 7f27b7e0e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f7b4b5bae0 con 0x55f7b4b5aaa0 2024-09-13T23:07:17.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.701+0000 7f27b2d0b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4b5aaa0 0x55f7b4b61fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.701+0000 7f27b2d0b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4b5aaa0 0x55f7b4b61fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44470/0 (socket says 172.21.15.164:44470) 2024-09-13T23:07:17.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.701+0000 7f27b2d0b640 1 -- 172.21.15.164:0/3474697092 learned_addr learned my addr 172.21.15.164:0/3474697092 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:17.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.701+0000 7f27b2d0b640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7b4b624e0 con 0x55f7b4b5aaa0 2024-09-13T23:07:17.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.701+0000 7f27b2d0b640 1 --2- 172.21.15.164:0/3474697092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4b5aaa0 0x55f7b4b61fa0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f27a8090260 tx=0x7f27a80912d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.702+0000 7f26957fa640 1 -- 172.21.15.164:0/3474697092 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27a809d020 con 0x55f7b4b5aaa0 2024-09-13T23:07:17.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.702+0000 7f26957fa640 1 -- 172.21.15.164:0/3474697092 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a8094070 con 0x55f7b4b5aaa0 2024-09-13T23:07:17.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.702+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7b4b62770 con 0x55f7b4b5aaa0 2024-09-13T23:07:17.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.702+0000 7f26957fa640 1 -- 172.21.15.164:0/3474697092 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27a8072c30 con 0x55f7b4b5aaa0 2024-09-13T23:07:17.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.702+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7b4b62770 con 0x55f7b4b5aaa0 2024-09-13T23:07:17.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.702+0000 7f26957fa640 1 -- 172.21.15.164:0/3474697092 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f27a80a0020 con 0x55f7b4b5aaa0 2024-09-13T23:07:17.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.703+0000 7f26957fa640 1 --2- 172.21.15.164:0/3474697092 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f267c036b30 0x7f267c038ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.703+0000 7f26957fa640 1 -- 172.21.15.164:0/3474697092 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f27a808a050 con 0x55f7b4b5aaa0 2024-09-13T23:07:17.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.703+0000 7f27b3d0d640 1 --2- 172.21.15.164:0/3474697092 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f267c036b30 0x7f267c038ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.703+0000 7f27b7e0e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.703+0000 7f27b7e0e800 1 --2- 172.21.15.164:0/3474697092 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f7b4b6d8d0 0x55f7b4b6fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.703+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b704e0 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.703+0000 7f27b350c640 1 --2- 172.21.15.164:0/3474697092 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f7b4b6d8d0 0x55f7b4b6fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.703+0000 7f27b3d0d640 1 --2- 172.21.15.164:0/3474697092 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f267c036b30 0x7f267c038ff0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00f010 tx=0x7f27ac00c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.703+0000 7f27b350c640 1 --2- 172.21.15.164:0/3474697092 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f7b4b6d8d0 0x55f7b4b6fd90 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.703+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27a401b070 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.703+0000 7f27b7e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:17.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.703+0000 7f27b7e0e800 20 realm 2024-09-13T23:07:17.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.703+0000 7f27b7e0e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.703+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b708f0 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.704+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27a401b070 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.704+0000 7f27b7e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:17.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.704+0000 7f27b7e0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:07:17.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.704+0000 7f27b7e0e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.704+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b711c0 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.704+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27a401b070 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.704+0000 7f27b7e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:17.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.704+0000 7f27b7e0e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.704+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b71560 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.704+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f27a401b070 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.704+0000 7f27b7e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:17.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.704+0000 7f27b7e0e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.704+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b719c0 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.704+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f27a401b070 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.704+0000 7f27b7e0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:07:17.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.704+0000 7f27b7e0e800 20 searching for the correct realm 2024-09-13T23:07:17.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.704+0000 7f27b7e0e800 1 --2- 172.21.15.164:0/3474697092 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55f7b4b73a10 0x55f7b4b75e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.704+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x55f7b4b73a10 2024-09-13T23:07:17.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.705+0000 7f27b2d0b640 1 --2- 172.21.15.164:0/3474697092 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55f7b4b73a10 0x55f7b4b75e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.705+0000 7f27b2d0b640 1 --2- 172.21.15.164:0/3474697092 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55f7b4b73a10 0x55f7b4b75e00 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.705+0000 7f27b2d0b640 1 -- 172.21.15.164:0/3474697092 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27a8079020 con 0x55f7b4b73a10 2024-09-13T23:07:17.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.705+0000 7f27b2d0b640 1 --2- 172.21.15.164:0/3474697092 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f27a80a2020 0x7f27a8067760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.705+0000 7f27b2d0b640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x7f27a80a2020 2024-09-13T23:07:17.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.705+0000 7f27b3d0d640 1 --2- 172.21.15.164:0/3474697092 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f27a80a2020 0x7f27a8067760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.705+0000 7f27b3d0d640 1 --2- 172.21.15.164:0/3474697092 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f27a80a2020 0x7f27a8067760 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.706+0000 7f27b3d0d640 1 -- 172.21.15.164:0/3474697092 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27ac02f040 con 0x7f27a80a2020 2024-09-13T23:07:17.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.706+0000 7f27b3d0d640 1 --2- 172.21.15.164:0/3474697092 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f27ac019040 0x7f27ac019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.706+0000 7f27b3d0d640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x7f27ac019040 2024-09-13T23:07:17.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.706+0000 7f27b350c640 1 --2- 172.21.15.164:0/3474697092 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f27ac019040 0x7f27ac019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.706+0000 7f27b350c640 1 --2- 172.21.15.164:0/3474697092 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f27ac019040 0x7f27ac019930 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.707+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27a401b070 con 0x7f27ac019040 2024-09-13T23:07:17.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.707+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.707+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f27a401b070 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.707+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.707+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27a401b070 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.707+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x7f27ac019040 2024-09-13T23:07:17.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.707+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27a401b070 con 0x7f27ac019040 2024-09-13T23:07:17.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.707+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x7f27ac019040 2024-09-13T23:07:17.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.707+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27a401b070 con 0x7f27ac019040 2024-09-13T23:07:17.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.707+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x7f27a80a2020 2024-09-13T23:07:17.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.708+0000 7f27b3d0d640 1 -- 172.21.15.164:0/3474697092 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27ac02f040 con 0x7f27a80a2020 2024-09-13T23:07:17.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.708+0000 7f27b3d0d640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x55f7b4b73a10 2024-09-13T23:07:17.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.708+0000 7f27b2d0b640 1 -- 172.21.15.164:0/3474697092 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27a8079020 con 0x55f7b4b73a10 2024-09-13T23:07:17.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.708+0000 7f27b2d0b640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.708+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27a401b070 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.708+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x7f27ac019040 2024-09-13T23:07:17.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.709+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27a401b070 con 0x7f27ac019040 2024-09-13T23:07:17.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.709+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.709+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27a401b070 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.709+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x7f27a80a2020 2024-09-13T23:07:17.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.709+0000 7f27b3d0d640 1 -- 172.21.15.164:0/3474697092 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f27ac02f040 con 0x7f27a80a2020 2024-09-13T23:07:17.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.709+0000 7f27b3d0d640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x55f7b4b73a10 2024-09-13T23:07:17.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.709+0000 7f27b2d0b640 1 -- 172.21.15.164:0/3474697092 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27a8079020 con 0x55f7b4b73a10 2024-09-13T23:07:17.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.709+0000 7f27b2d0b640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x55f7b4b73a10 2024-09-13T23:07:17.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.709+0000 7f27b2d0b640 1 -- 172.21.15.164:0/3474697092 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27a8079020 con 0x55f7b4b73a10 2024-09-13T23:07:17.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.709+0000 7f27b2d0b640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x7f27ac019040 2024-09-13T23:07:17.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.710+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27a401b070 con 0x7f27ac019040 2024-09-13T23:07:17.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.710+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x55f7b4b73a10 2024-09-13T23:07:17.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.710+0000 7f27b2d0b640 1 -- 172.21.15.164:0/3474697092 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27a8079020 con 0x55f7b4b73a10 2024-09-13T23:07:17.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.710+0000 7f27b2d0b640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x55f7b4b73a10 2024-09-13T23:07:17.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.710+0000 7f27b2d0b640 1 -- 172.21.15.164:0/3474697092 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27a8079020 con 0x55f7b4b73a10 2024-09-13T23:07:17.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.710+0000 7f27b2d0b640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.710+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27a401b070 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.710+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.711+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f27a401b070 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.711+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x7f27ac019040 2024-09-13T23:07:17.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.711+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27a401b070 con 0x7f27ac019040 2024-09-13T23:07:17.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.711+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x55f7b4b73a10 2024-09-13T23:07:17.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.711+0000 7f27b2d0b640 1 -- 172.21.15.164:0/3474697092 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27a8079020 con 0x55f7b4b73a10 2024-09-13T23:07:17.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.711+0000 7f27b2d0b640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x7f27a80a2020 2024-09-13T23:07:17.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.711+0000 7f27b3d0d640 1 -- 172.21.15.164:0/3474697092 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27ac02f040 con 0x7f27a80a2020 2024-09-13T23:07:17.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.712+0000 7f27b3d0d640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.712+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f27a401b070 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.712+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x7f27ac019040 2024-09-13T23:07:17.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.712+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27a401b070 con 0x7f27ac019040 2024-09-13T23:07:17.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.712+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x55f7b4b73a10 2024-09-13T23:07:17.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.712+0000 7f27b2d0b640 1 -- 172.21.15.164:0/3474697092 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27a8079020 con 0x55f7b4b73a10 2024-09-13T23:07:17.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.712+0000 7f27b2d0b640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x7f27ac019040 2024-09-13T23:07:17.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.713+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27a401b070 con 0x7f27ac019040 2024-09-13T23:07:17.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.713+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x7f27a80a2020 2024-09-13T23:07:17.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.713+0000 7f27b3d0d640 1 -- 172.21.15.164:0/3474697092 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27ac02f040 con 0x7f27a80a2020 2024-09-13T23:07:17.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.713+0000 7f27b3d0d640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x55f7b4b73a10 2024-09-13T23:07:17.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.713+0000 7f27b2d0b640 1 -- 172.21.15.164:0/3474697092 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27a8079020 con 0x55f7b4b73a10 2024-09-13T23:07:17.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.713+0000 7f27b2d0b640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x7f27a80a2020 2024-09-13T23:07:17.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.713+0000 7f27b3d0d640 1 -- 172.21.15.164:0/3474697092 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27ac02f040 con 0x7f27a80a2020 2024-09-13T23:07:17.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.713+0000 7f27b3d0d640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.713+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f27a401b070 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.714+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b764b0 con 0x7f27a80a2020 2024-09-13T23:07:17.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.714+0000 7f27b3d0d640 1 -- 172.21.15.164:0/3474697092 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27ac02f040 con 0x7f27a80a2020 2024-09-13T23:07:17.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.714+0000 7f27b7e0e800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:07:17.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.714+0000 7f27b7e0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:07:17.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.714+0000 7f27b7e0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:07:17.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.714+0000 7f27b7e0e800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:07:17.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.714+0000 7f27b7e0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:07:17.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.714+0000 7f27b7e0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:07:17.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.714+0000 7f27b7e0e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.714+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b72490 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.714+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27a401b070 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.714+0000 7f27b7e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:17.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.714+0000 7f27b7e0e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.714+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b72d30 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.714+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f27a401b070 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.714+0000 7f27b7e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:17.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.714+0000 7f27b7e0e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.714+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b720d0 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.714+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f27a401b070 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.715+0000 7f27b7e0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:07:17.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.715+0000 7f27b7e0e800 20 zone default found 2024-09-13T23:07:17.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.715+0000 7f27b7e0e800 4 Realm: () 2024-09-13T23:07:17.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.715+0000 7f27b7e0e800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:07:17.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.715+0000 7f27b7e0e800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:07:17.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.715+0000 7f27b7e0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:07:17.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.715+0000 7f27b7e0e800 20 zonegroup default 2024-09-13T23:07:17.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.715+0000 7f27b7e0e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.715+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b72d30 con 0x7f27ac019040 2024-09-13T23:07:17.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.715+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f27a401b070 con 0x7f27ac019040 2024-09-13T23:07:17.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.715+0000 7f27b7e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:17.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.715+0000 7f27b7e0e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.715+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b78310 con 0x55f7b4b73a10 2024-09-13T23:07:17.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.715+0000 7f27b2d0b640 1 -- 172.21.15.164:0/3474697092 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f27a8079020 con 0x55f7b4b73a10 2024-09-13T23:07:17.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.715+0000 7f27b7e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:17.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.715+0000 7f27b7e0e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.715+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b786b0 con 0x55f7b4b73a10 2024-09-13T23:07:17.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.715+0000 7f27b2d0b640 1 -- 172.21.15.164:0/3474697092 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f27a8079020 con 0x55f7b4b73a10 2024-09-13T23:07:17.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.715+0000 7f27b7e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:17.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.715+0000 7f27b7e0e800 20 started sync module instance, tier type = 2024-09-13T23:07:17.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.715+0000 7f27b7e0e800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:07:17.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.715+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b777b0 con 0x7f27a80a2020 2024-09-13T23:07:17.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.717+0000 7f27b3d0d640 1 -- 172.21.15.164:0/3474697092 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27ac02f040 con 0x7f27a80a2020 2024-09-13T23:07:17.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.717+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94522377206992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b777b0 con 0x7f27a80a2020 2024-09-13T23:07:17.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.717+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b791c0 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.718+0000 7f27b3d0d640 1 -- 172.21.15.164:0/3474697092 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94522377206992] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27ac02f040 con 0x7f27a80a2020 2024-09-13T23:07:17.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.718+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27a401b070 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.718+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94522377211056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b777b0 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.718+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b79c50 con 0x55f7b4b73a10 2024-09-13T23:07:17.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.719+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94522377211056] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27a401b070 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.719+0000 7f27b2d0b640 1 -- 172.21.15.164:0/3474697092 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27a8079020 con 0x55f7b4b73a10 2024-09-13T23:07:17.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.719+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94522377204480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b77720 con 0x55f7b4b73a10 2024-09-13T23:07:17.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.719+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b7ab10 con 0x7f27a80a2020 2024-09-13T23:07:17.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.720+0000 7f27b3d0d640 1 -- 172.21.15.164:0/3474697092 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27ac02f040 con 0x7f27a80a2020 2024-09-13T23:07:17.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.720+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94522377218112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b7b2d0 con 0x7f27a80a2020 2024-09-13T23:07:17.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.720+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b7bdf0 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.720+0000 7f27b2d0b640 1 -- 172.21.15.164:0/3474697092 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94522377204480] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27a8079020 con 0x55f7b4b73a10 2024-09-13T23:07:17.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.721+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27a401b070 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.721+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94522377222336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b7bdb0 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.721+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b7c840 con 0x7f27ac019040 2024-09-13T23:07:17.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.722+0000 7f27b3d0d640 1 -- 172.21.15.164:0/3474697092 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94522377218112] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27ac02f040 con 0x7f27a80a2020 2024-09-13T23:07:17.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.723+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27a401b070 con 0x7f27ac019040 2024-09-13T23:07:17.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.723+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94522377222336] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27a401b070 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.723+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94522377225040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b7c840 con 0x7f27ac019040 2024-09-13T23:07:17.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.723+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b7a040 con 0x7f27ac019040 2024-09-13T23:07:17.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.724+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94522377225040] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27a401b070 con 0x7f27ac019040 2024-09-13T23:07:17.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.724+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27a401b070 con 0x7f27ac019040 2024-09-13T23:07:17.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.724+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94522377216064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b7cda0 con 0x7f27ac019040 2024-09-13T23:07:17.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.724+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b7d760 con 0x7f27ac019040 2024-09-13T23:07:17.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.725+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94522377216064] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27a401b070 con 0x7f27ac019040 2024-09-13T23:07:17.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.725+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27a401b070 con 0x7f27ac019040 2024-09-13T23:07:17.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.725+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94522377219360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b7d760 con 0x7f27ac019040 2024-09-13T23:07:17.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.725+0000 7f27b7e0e800 20 add_watcher() i=0 2024-09-13T23:07:17.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.725+0000 7f27b7e0e800 20 add_watcher() i=1 2024-09-13T23:07:17.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.725+0000 7f27b7e0e800 20 add_watcher() i=2 2024-09-13T23:07:17.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.725+0000 7f27b7e0e800 20 add_watcher() i=3 2024-09-13T23:07:17.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.725+0000 7f27b7e0e800 20 add_watcher() i=4 2024-09-13T23:07:17.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.725+0000 7f27b7e0e800 20 add_watcher() i=5 2024-09-13T23:07:17.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.725+0000 7f27b7e0e800 20 add_watcher() i=6 2024-09-13T23:07:17.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.726+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94522377219360] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27a401b070 con 0x7f27ac019040 2024-09-13T23:07:17.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.726+0000 7f27b7e0e800 20 add_watcher() i=7 2024-09-13T23:07:17.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.726+0000 7f27b7e0e800 2 all 8 watchers are set, enabling cache 2024-09-13T23:07:17.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.726+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b80b60 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.726+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f27a401b070 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.726+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94522377229440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b7e080 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.727+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94522377229440] v34'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f27a401b070 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.728+0000 7f2669fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:17.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.728+0000 7f27b7e0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:07:17.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.728+0000 7f27b7e0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:07:17.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.728+0000 7f27b7e0e800 5 note: GC not initialized 2024-09-13T23:07:17.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.728+0000 7f2668fe1640 20 reqs_thread_entry: start 2024-09-13T23:07:17.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.728+0000 7f27b7e0e800 20 init_complete bucket index max shards: 11 2024-09-13T23:07:17.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.728+0000 7f27b7e0e800 20 Filter name: none 2024-09-13T23:07:17.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.728+0000 7f25e27fc640 20 reqs_thread_entry: start 2024-09-13T23:07:17.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.728+0000 7f27b7e0e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.728+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4bb3ac0 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.729+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f27a401b070 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.729+0000 7f27b7e0e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:07:17.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.729+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4bb5010 con 0x7f27ac019040 2024-09-13T23:07:17.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.729+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7f27a401b070 con 0x7f27ac019040 2024-09-13T23:07:17.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.730+0000 7f2669fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:17.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.730+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94522377229440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b89db0 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.731+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94522377229440] v34'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f27a401b070 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.731+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94522377206992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4bb34e0 con 0x7f27a80a2020 2024-09-13T23:07:17.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.732+0000 7f27b3d0d640 1 -- 172.21.15.164:0/3474697092 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94522377206992] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27ac02f040 con 0x7f27a80a2020 2024-09-13T23:07:17.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.732+0000 7f27b7e0e800 20 remove_watcher() i=0 2024-09-13T23:07:17.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.732+0000 7f27b7e0e800 2 removed watcher, disabling cache 2024-09-13T23:07:17.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.732+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94522377211056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b77cd0 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.733+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94522377211056] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27a401b070 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.733+0000 7f27b7e0e800 20 remove_watcher() i=1 2024-09-13T23:07:17.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.733+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94522377204480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b77cd0 con 0x55f7b4b73a10 2024-09-13T23:07:17.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.734+0000 7f27b2d0b640 1 -- 172.21.15.164:0/3474697092 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94522377204480] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27a8079020 con 0x55f7b4b73a10 2024-09-13T23:07:17.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.734+0000 7f27b7e0e800 20 remove_watcher() i=2 2024-09-13T23:07:17.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.734+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94522377218112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b77300 con 0x7f27a80a2020 2024-09-13T23:07:17.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.735+0000 7f27b3d0d640 1 -- 172.21.15.164:0/3474697092 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94522377218112] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27ac02f040 con 0x7f27a80a2020 2024-09-13T23:07:17.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.735+0000 7f27b7e0e800 20 remove_watcher() i=3 2024-09-13T23:07:17.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.735+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94522377222336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b7a840 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.736+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94522377222336] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27a401b070 con 0x55f7b4b6d8d0 2024-09-13T23:07:17.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.736+0000 7f27b7e0e800 20 remove_watcher() i=4 2024-09-13T23:07:17.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.736+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94522377225040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b77300 con 0x7f27ac019040 2024-09-13T23:07:17.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.737+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94522377225040] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27a401b070 con 0x7f27ac019040 2024-09-13T23:07:17.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.737+0000 7f27b7e0e800 20 remove_watcher() i=5 2024-09-13T23:07:17.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.737+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94522377216064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b7b8c0 con 0x7f27ac019040 2024-09-13T23:07:17.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.738+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94522377216064] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27a401b070 con 0x7f27ac019040 2024-09-13T23:07:17.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.738+0000 7f27b7e0e800 20 remove_watcher() i=6 2024-09-13T23:07:17.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.738+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94522377219360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f7b4b7a840 con 0x7f27ac019040 2024-09-13T23:07:17.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.739+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94522377219360] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27a401b070 con 0x7f27ac019040 2024-09-13T23:07:17.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.739+0000 7f27b7e0e800 20 remove_watcher() i=7 2024-09-13T23:07:17.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.739+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f27ac019040 msgr2=0x7f27ac019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.739+0000 7f27b7e0e800 1 --2- 172.21.15.164:0/3474697092 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f27ac019040 0x7f27ac019930 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.739+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f7b4b6d8d0 msgr2=0x55f7b4b6fd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.739+0000 7f27b7e0e800 1 --2- 172.21.15.164:0/3474697092 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f7b4b6d8d0 0x55f7b4b6fd90 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.739+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f27a80a2020 msgr2=0x7f27a8067760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.739+0000 7f27b7e0e800 1 --2- 172.21.15.164:0/3474697092 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f27a80a2020 0x7f27a8067760 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.739+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55f7b4b73a10 msgr2=0x55f7b4b75e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.739+0000 7f27b7e0e800 1 --2- 172.21.15.164:0/3474697092 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55f7b4b73a10 0x55f7b4b75e00 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.739+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f267c036b30 msgr2=0x7f267c038ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.739+0000 7f27b7e0e800 1 --2- 172.21.15.164:0/3474697092 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f267c036b30 0x7f267c038ff0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00f010 tx=0x7f27ac00c040 comp rx=0 tx=0).stop 2024-09-13T23:07:17.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.739+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4b5aaa0 msgr2=0x55f7b4b61fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.739+0000 7f27b350c640 1 -- 172.21.15.164:0/3474697092 reap_dead start 2024-09-13T23:07:17.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.739+0000 7f27b7e0e800 1 --2- 172.21.15.164:0/3474697092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4b5aaa0 0x55f7b4b61fa0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f27a8090260 tx=0x7f27a80912d0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.739+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 shutdown_connections 2024-09-13T23:07:17.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.739+0000 7f27b7e0e800 1 --2- 172.21.15.164:0/3474697092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4b5aaa0 0x55f7b4b61fa0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.739+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 >> 172.21.15.164:0/3474697092 conn(0x55f7b4b56e00 msgr2=0x55f7b4b54ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:17.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.739+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 shutdown_connections 2024-09-13T23:07:17.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.739+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3474697092 wait complete. 2024-09-13T23:07:17.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.740+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3194683554 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f268c036b40 msgr2=0x7f268c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.740+0000 7f27b7e0e800 1 --2- 172.21.15.164:0/3194683554 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f268c036b40 0x7f268c039000 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55f7b4b3e5a0 tx=0x7f27ac000f90 comp rx=0 tx=0).stop 2024-09-13T23:07:17.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.740+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3194683554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4b4de90 msgr2=0x55f7b4b4e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.740+0000 7f27b7e0e800 1 --2- 172.21.15.164:0/3194683554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4b4de90 0x55f7b4b4e2b0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f27a8000c00 tx=0x7f27a8002fb0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.740+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3194683554 shutdown_connections 2024-09-13T23:07:17.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.740+0000 7f27b7e0e800 1 --2- 172.21.15.164:0/3194683554 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f268c036b40 0x7f268c039000 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.740+0000 7f27b7e0e800 1 --2- 172.21.15.164:0/3194683554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4b4de90 0x55f7b4b4e2b0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.740+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3194683554 >> 172.21.15.164:0/3194683554 conn(0x55f7b4b42e20 msgr2=0x55f7b4b459a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:17.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.740+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3194683554 shutdown_connections 2024-09-13T23:07:17.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.740+0000 7f27b7e0e800 1 -- 172.21.15.164:0/3194683554 wait complete. 2024-09-13T23:07:17.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.740+0000 7f27b7e0e800 1 -- 172.21.15.164:0/754096842 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f7b4a41ad0 msgr2=0x55f7b4b3d4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.740+0000 7f27b7e0e800 1 --2- 172.21.15.164:0/754096842 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f7b4a41ad0 0x55f7b4b3d4d0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.740+0000 7f27b7e0e800 1 -- 172.21.15.164:0/754096842 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2698036b40 msgr2=0x7f2698039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.740+0000 7f27b7e0e800 1 --2- 172.21.15.164:0/754096842 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2698036b40 0x7f2698039000 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f27a8057000 tx=0x7f27a8052000 comp rx=0 tx=0).stop 2024-09-13T23:07:17.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.740+0000 7f27b7e0e800 1 -- 172.21.15.164:0/754096842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4a3ba30 msgr2=0x55f7b4b36460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.740+0000 7f27b7e0e800 1 --2- 172.21.15.164:0/754096842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4a3ba30 0x55f7b4b36460 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x55f7b4a3daf0 tx=0x7f27a4001250 comp rx=0 tx=0).stop 2024-09-13T23:07:17.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.740+0000 7f27b7e0e800 1 -- 172.21.15.164:0/754096842 shutdown_connections 2024-09-13T23:07:17.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.740+0000 7f27b7e0e800 1 --2- 172.21.15.164:0/754096842 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55f7b4a41ad0 0x55f7b4b3d4d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.740+0000 7f27b7e0e800 1 --2- 172.21.15.164:0/754096842 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f2698036b40 0x7f2698039000 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.740+0000 7f27b7e0e800 1 --2- 172.21.15.164:0/754096842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7b4a3ba30 0x55f7b4b36460 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.740+0000 7f27b7e0e800 1 -- 172.21.15.164:0/754096842 >> 172.21.15.164:0/754096842 conn(0x55f7b4a375c0 msgr2=0x55f7b4b27dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:17.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.740+0000 7f27b7e0e800 1 -- 172.21.15.164:0/754096842 shutdown_connections 2024-09-13T23:07:17.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.740+0000 7f27b7e0e800 1 -- 172.21.15.164:0/754096842 wait complete. 2024-09-13T23:07:17.751 INFO:teuthology.orchestra.run.smithi164.stdout:{"entries":[],"summary":[]} 2024-09-13T23:07:17.752 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-13T23:07:17.752 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-13T23:07:17.752 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-13T23:07:17.752 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-13T23:07:17.797 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:07:17.797 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:07:17.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.797+0000 7f88e300d800 1 Processor -- start 2024-09-13T23:07:17.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.798+0000 7f88e300d800 1 -- start start 2024-09-13T23:07:17.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.798+0000 7f88e300d800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55d3c9bd8630 0x55d3c9c69600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.798+0000 7f88e300d800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d3c9b23b30 con 0x55d3c9c69b40 2024-09-13T23:07:17.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.798+0000 7f88e300d800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55d3c9b05360 con 0x55d3c9bd8630 2024-09-13T23:07:17.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.798+0000 7f88e0b01640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55d3c9bd8630 0x55d3c9c69600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.798+0000 7f88e0b01640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55d3c9bd8630 0x55d3c9c69600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44472/0 (socket says 172.21.15.164:44472) 2024-09-13T23:07:17.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.798+0000 7f88e0b01640 1 -- 172.21.15.164:0/2286392347 learned_addr learned my addr 172.21.15.164:0/2286392347 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:17.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.798+0000 7f88d8300640 1 --1- 172.21.15.164:0/2286392347 >> v1:172.21.15.17:6789/0 conn(0x55d3c9c69b40 0x55d3c9c6bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:60876/0 (socket says 172.21.15.164:60876) 2024-09-13T23:07:17.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.798+0000 7f88e0b01640 1 -- 172.21.15.164:0/2286392347 >> v1:172.21.15.17:6789/0 conn(0x55d3c9c69b40 legacy=0x55d3c9c6bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.798+0000 7f88e0b01640 1 -- 172.21.15.164:0/2286392347 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3c9b2be00 con 0x55d3c9bd8630 2024-09-13T23:07:17.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.800+0000 7f88e0b01640 1 --2- 172.21.15.164:0/2286392347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9bd8630 0x55d3c9c69600 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f88d000a520 tx=0x7f88d0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f902e357f52f90ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.800+0000 7f88dbfff640 1 -- 172.21.15.164:0/2286392347 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88d0055070 con 0x55d3c9bd8630 2024-09-13T23:07:17.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.800+0000 7f88dbfff640 1 -- 172.21.15.164:0/2286392347 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88d00515b0 con 0x55d3c9bd8630 2024-09-13T23:07:17.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.800+0000 7f88dbfff640 1 -- 172.21.15.164:0/2286392347 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88d00518d0 con 0x55d3c9bd8630 2024-09-13T23:07:17.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.801+0000 7f88e300d800 1 -- 172.21.15.164:0/2286392347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9bd8630 msgr2=0x55d3c9c69600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.801+0000 7f88e300d800 1 --2- 172.21.15.164:0/2286392347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9bd8630 0x55d3c9c69600 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f88d000a520 tx=0x7f88d0045ba0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.801+0000 7f88e300d800 1 -- 172.21.15.164:0/2286392347 shutdown_connections 2024-09-13T23:07:17.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.801+0000 7f88e300d800 1 --2- 172.21.15.164:0/2286392347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9bd8630 0x55d3c9c69600 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.801+0000 7f88e300d800 1 -- 172.21.15.164:0/2286392347 >> 172.21.15.164:0/2286392347 conn(0x55d3c9c5edb0 msgr2=0x55d3c9c611d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:17.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.801+0000 7f88e300d800 1 -- 172.21.15.164:0/2286392347 shutdown_connections 2024-09-13T23:07:17.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.801+0000 7f88e300d800 1 -- 172.21.15.164:0/2286392347 wait complete. 2024-09-13T23:07:17.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.815+0000 7f88e300d800 1 Processor -- start 2024-09-13T23:07:17.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.815+0000 7f88e300d800 1 -- start start 2024-09-13T23:07:17.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.815+0000 7f88e300d800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9bd8630 0x55d3c9d55a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.815+0000 7f88e300d800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d3c9bb0360 con 0x55d3c9bd8630 2024-09-13T23:07:17.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.815+0000 7f88e0b01640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9bd8630 0x55d3c9d55a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.815+0000 7f88e0b01640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9bd8630 0x55d3c9d55a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44480/0 (socket says 172.21.15.164:44480) 2024-09-13T23:07:17.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.815+0000 7f88e0b01640 1 -- 172.21.15.164:0/3142069204 learned_addr learned my addr 172.21.15.164:0/3142069204 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:17.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.815+0000 7f88e0b01640 1 -- 172.21.15.164:0/3142069204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3c9afdbc0 con 0x55d3c9bd8630 2024-09-13T23:07:17.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.816+0000 7f88e0b01640 1 --2- 172.21.15.164:0/3142069204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9bd8630 0x55d3c9d55a70 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f88d0025da0 tx=0x7f88d0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8496378531d76efd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.816+0000 7f87cee0d640 1 -- 172.21.15.164:0/3142069204 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88d0051950 con 0x55d3c9bd8630 2024-09-13T23:07:17.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.816+0000 7f87cee0d640 1 -- 172.21.15.164:0/3142069204 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88d0051af0 con 0x55d3c9bd8630 2024-09-13T23:07:17.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.816+0000 7f87cee0d640 1 -- 172.21.15.164:0/3142069204 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88d0051dd0 con 0x55d3c9bd8630 2024-09-13T23:07:17.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.817+0000 7f88e300d800 1 -- 172.21.15.164:0/3142069204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9bd8630 msgr2=0x55d3c9d55a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.817+0000 7f88e300d800 1 --2- 172.21.15.164:0/3142069204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9bd8630 0x55d3c9d55a70 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f88d0025da0 tx=0x7f88d0051000 comp rx=0 tx=0).stop 2024-09-13T23:07:17.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.817+0000 7f88e300d800 1 -- 172.21.15.164:0/3142069204 shutdown_connections 2024-09-13T23:07:17.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.817+0000 7f88e300d800 1 --2- 172.21.15.164:0/3142069204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9bd8630 0x55d3c9d55a70 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.817+0000 7f88e300d800 1 -- 172.21.15.164:0/3142069204 >> 172.21.15.164:0/3142069204 conn(0x55d3c9c5edb0 msgr2=0x55d3c9d51430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:17.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.817+0000 7f88e300d800 1 -- 172.21.15.164:0/3142069204 shutdown_connections 2024-09-13T23:07:17.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.817+0000 7f88e300d800 1 -- 172.21.15.164:0/3142069204 wait complete. 2024-09-13T23:07:17.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.817+0000 7f88e300d800 1 Processor -- start 2024-09-13T23:07:17.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.817+0000 7f88e300d800 1 -- start start 2024-09-13T23:07:17.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.817+0000 7f88e300d800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9bd8630 0x55d3c9d5d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.817+0000 7f88e300d800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d3c9c6d920 con 0x55d3c9bd8630 2024-09-13T23:07:17.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.817+0000 7f88e0b01640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9bd8630 0x55d3c9d5d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.817+0000 7f88e0b01640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9bd8630 0x55d3c9d5d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44494/0 (socket says 172.21.15.164:44494) 2024-09-13T23:07:17.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.817+0000 7f88e0b01640 1 -- 172.21.15.164:0/3728677883 learned_addr learned my addr 172.21.15.164:0/3728677883 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:17.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.818+0000 7f88e0b01640 1 -- 172.21.15.164:0/3728677883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3c9b11fe0 con 0x55d3c9bd8630 2024-09-13T23:07:17.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.818+0000 7f88e0b01640 1 --2- 172.21.15.164:0/3728677883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9bd8630 0x55d3c9d5d3a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f88d0067040 tx=0x7f88d0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.818+0000 7f87cd60a640 1 -- 172.21.15.164:0/3728677883 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88d0073070 con 0x55d3c9bd8630 2024-09-13T23:07:17.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.818+0000 7f87cd60a640 1 -- 172.21.15.164:0/3728677883 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88d005a450 con 0x55d3c9bd8630 2024-09-13T23:07:17.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.818+0000 7f88e300d800 1 -- 172.21.15.164:0/3728677883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d3c9d5d8e0 con 0x55d3c9bd8630 2024-09-13T23:07:17.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.818+0000 7f87cd60a640 1 -- 172.21.15.164:0/3728677883 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88d005a730 con 0x55d3c9bd8630 2024-09-13T23:07:17.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.818+0000 7f88e300d800 1 -- 172.21.15.164:0/3728677883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3c9d5de60 con 0x55d3c9bd8630 2024-09-13T23:07:17.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.819+0000 7f87cd60a640 1 -- 172.21.15.164:0/3728677883 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f88d0076070 con 0x55d3c9bd8630 2024-09-13T23:07:17.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.819+0000 7f87cd60a640 1 --2- 172.21.15.164:0/3728677883 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f87c8036b40 0x7f87c8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.819+0000 7f87cd60a640 1 -- 172.21.15.164:0/3728677883 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f88d0062070 con 0x55d3c9bd8630 2024-09-13T23:07:17.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.819+0000 7f88d8300640 1 --2- 172.21.15.164:0/3728677883 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f87c8036b40 0x7f87c8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.819+0000 7f88e300d800 1 --2- 172.21.15.164:0/3728677883 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d3c9c69b40 0x55d3c9d64410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.819+0000 7f88e300d800 1 -- 172.21.15.164:0/3728677883 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d64990 con 0x55d3c9c69b40 2024-09-13T23:07:17.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.819+0000 7f88e1302640 1 --2- 172.21.15.164:0/3728677883 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d3c9c69b40 0x55d3c9d64410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.819+0000 7f88d8300640 1 --2- 172.21.15.164:0/3728677883 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f87c8036b40 0x7f87c8039000 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f88c8000f60 tx=0x7f88c8001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.820+0000 7f88e1302640 1 --2- 172.21.15.164:0/3728677883 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d3c9c69b40 0x55d3c9d64410 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.820+0000 7f88e1302640 1 -- 172.21.15.164:0/3728677883 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88dc00a4a0 con 0x55d3c9c69b40 2024-09-13T23:07:17.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.820+0000 7f88e300d800 1 -- 172.21.15.164:0/3728677883 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d619e0 con 0x55d3c9c69b40 2024-09-13T23:07:17.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.820+0000 7f88e1302640 1 -- 172.21.15.164:0/3728677883 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f88dc00a4a0 con 0x55d3c9c69b40 2024-09-13T23:07:17.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.820+0000 7f88e300d800 1 -- 172.21.15.164:0/3728677883 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d667b0 con 0x55d3c9c69b40 2024-09-13T23:07:17.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.820+0000 7f88e1302640 1 -- 172.21.15.164:0/3728677883 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f88dc00a4a0 con 0x55d3c9c69b40 2024-09-13T23:07:17.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.820+0000 7f88e300d800 1 -- 172.21.15.164:0/3728677883 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d658f0 con 0x55d3c9c69b40 2024-09-13T23:07:17.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.821+0000 7f88e1302640 1 -- 172.21.15.164:0/3728677883 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f88dc00a4a0 con 0x55d3c9c69b40 2024-09-13T23:07:17.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.821+0000 7f88e300d800 1 -- 172.21.15.164:0/3728677883 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d65d40 con 0x55d3c9c69b40 2024-09-13T23:07:17.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.821+0000 7f88e1302640 1 -- 172.21.15.164:0/3728677883 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f88dc00a4a0 con 0x55d3c9c69b40 2024-09-13T23:07:17.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.821+0000 7f88e300d800 1 Processor -- start 2024-09-13T23:07:17.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.821+0000 7f88e300d800 1 -- start start 2024-09-13T23:07:17.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.821+0000 7f88e300d800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9d74d30 0x55d3c9d75150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.821+0000 7f88e300d800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d3c9aff580 con 0x55d3c9d74d30 2024-09-13T23:07:17.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.822+0000 7f88d8300640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9d74d30 0x55d3c9d75150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.822+0000 7f88d8300640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9d74d30 0x55d3c9d75150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44500/0 (socket says 172.21.15.164:44500) 2024-09-13T23:07:17.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.822+0000 7f88d8300640 1 -- 172.21.15.164:0/2569238416 learned_addr learned my addr 172.21.15.164:0/2569238416 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:17.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.822+0000 7f88d8300640 1 -- 172.21.15.164:0/2569238416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3c9d75690 con 0x55d3c9d74d30 2024-09-13T23:07:17.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.822+0000 7f88d8300640 1 --2- 172.21.15.164:0/2569238416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9d74d30 0x55d3c9d75150 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f88c8001ed0 tx=0x7f88c800ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.822+0000 7f87c67fc640 1 -- 172.21.15.164:0/2569238416 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88c8022070 con 0x55d3c9d74d30 2024-09-13T23:07:17.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.822+0000 7f87c67fc640 1 -- 172.21.15.164:0/2569238416 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c800d520 con 0x55d3c9d74d30 2024-09-13T23:07:17.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.822+0000 7f88e300d800 1 -- 172.21.15.164:0/2569238416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d3c9d75920 con 0x55d3c9d74d30 2024-09-13T23:07:17.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.822+0000 7f87c67fc640 1 -- 172.21.15.164:0/2569238416 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88c800d800 con 0x55d3c9d74d30 2024-09-13T23:07:17.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.822+0000 7f88e300d800 1 -- 172.21.15.164:0/2569238416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3c9d78600 con 0x55d3c9d74d30 2024-09-13T23:07:17.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.823+0000 7f87c67fc640 1 -- 172.21.15.164:0/2569238416 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f88c8025070 con 0x55d3c9d74d30 2024-09-13T23:07:17.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.823+0000 7f87c67fc640 1 --2- 172.21.15.164:0/2569238416 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f87b8036b40 0x7f87b8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.823+0000 7f87c67fc640 1 -- 172.21.15.164:0/2569238416 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f88c804e150 con 0x55d3c9d74d30 2024-09-13T23:07:17.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.823+0000 7f88e1302640 1 --2- 172.21.15.164:0/2569238416 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f87b8036b40 0x7f87b8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.824+0000 7f88e300d800 1 Processor -- start 2024-09-13T23:07:17.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.824+0000 7f88e1302640 1 --2- 172.21.15.164:0/2569238416 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f87b8036b40 0x7f87b8039000 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x55d3c9d65410 tx=0x7f88dc005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.824+0000 7f88e300d800 1 -- start start 2024-09-13T23:07:17.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.824+0000 7f88e300d800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9d81a40 0x55d3c9d81e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.824+0000 7f88e300d800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d3c9d56160 con 0x55d3c9d81a40 2024-09-13T23:07:17.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.824+0000 7f88d8300640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9d81a40 0x55d3c9d81e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.824+0000 7f88d8300640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9d81a40 0x55d3c9d81e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44506/0 (socket says 172.21.15.164:44506) 2024-09-13T23:07:17.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.824+0000 7f88d8300640 1 -- 172.21.15.164:0/1253926191 learned_addr learned my addr 172.21.15.164:0/1253926191 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:17.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.824+0000 7f88d8300640 1 -- 172.21.15.164:0/1253926191 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3c9d82410 con 0x55d3c9d81a40 2024-09-13T23:07:17.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.824+0000 7f88d8300640 1 --2- 172.21.15.164:0/1253926191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9d81a40 0x55d3c9d81e40 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f88c804c410 tx=0x7f88c8024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd29676d5de8c3f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.825+0000 7f87b7fff640 1 -- 172.21.15.164:0/1253926191 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88c8025990 con 0x55d3c9d81a40 2024-09-13T23:07:17.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.825+0000 7f87b7fff640 1 -- 172.21.15.164:0/1253926191 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c8026730 con 0x55d3c9d81a40 2024-09-13T23:07:17.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.825+0000 7f87b7fff640 1 -- 172.21.15.164:0/1253926191 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88c8025c50 con 0x55d3c9d81a40 2024-09-13T23:07:17.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.825+0000 7f88e300d800 1 -- 172.21.15.164:0/1253926191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9d81a40 msgr2=0x55d3c9d81e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.825+0000 7f88e300d800 1 --2- 172.21.15.164:0/1253926191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9d81a40 0x55d3c9d81e40 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f88c804c410 tx=0x7f88c8024740 comp rx=0 tx=0).stop 2024-09-13T23:07:17.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.825+0000 7f88e300d800 1 -- 172.21.15.164:0/1253926191 shutdown_connections 2024-09-13T23:07:17.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.825+0000 7f88e300d800 1 --2- 172.21.15.164:0/1253926191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9d81a40 0x55d3c9d81e40 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.825+0000 7f88e300d800 1 -- 172.21.15.164:0/1253926191 >> 172.21.15.164:0/1253926191 conn(0x55d3c9d7dda0 msgr2=0x55d3c9d7bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:17.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.825+0000 7f88e300d800 1 -- 172.21.15.164:0/1253926191 shutdown_connections 2024-09-13T23:07:17.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.825+0000 7f88e300d800 1 -- 172.21.15.164:0/1253926191 wait complete. 2024-09-13T23:07:17.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.825+0000 7f88e300d800 1 Processor -- start 2024-09-13T23:07:17.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.825+0000 7f88e300d800 1 -- start start 2024-09-13T23:07:17.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.825+0000 7f88e300d800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9d81a40 0x55d3c9d88f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.825+0000 7f88e300d800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d3c9d82a80 con 0x55d3c9d81a40 2024-09-13T23:07:17.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.826+0000 7f88d8300640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9d81a40 0x55d3c9d88f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.826+0000 7f88d8300640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9d81a40 0x55d3c9d88f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44516/0 (socket says 172.21.15.164:44516) 2024-09-13T23:07:17.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.826+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 learned_addr learned my addr 172.21.15.164:0/1657556656 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:17.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.826+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3c9d89480 con 0x55d3c9d81a40 2024-09-13T23:07:17.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.826+0000 7f88d8300640 1 --2- 172.21.15.164:0/1657556656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9d81a40 0x55d3c9d88f40 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f88c8024a50 tx=0x7f88c804c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.826+0000 7f87b67fc640 1 -- 172.21.15.164:0/1657556656 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88c803a070 con 0x55d3c9d81a40 2024-09-13T23:07:17.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.826+0000 7f87b67fc640 1 -- 172.21.15.164:0/1657556656 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c8030040 con 0x55d3c9d81a40 2024-09-13T23:07:17.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.826+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d3c9d89480 con 0x55d3c9d81a40 2024-09-13T23:07:17.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.826+0000 7f87b67fc640 1 -- 172.21.15.164:0/1657556656 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88c8046030 con 0x55d3c9d81a40 2024-09-13T23:07:17.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.826+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3c9d89480 con 0x55d3c9d81a40 2024-09-13T23:07:17.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.827+0000 7f87b67fc640 1 -- 172.21.15.164:0/1657556656 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f88c8025360 con 0x55d3c9d81a40 2024-09-13T23:07:17.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.827+0000 7f87b67fc640 1 --2- 172.21.15.164:0/1657556656 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f87ac036af0 0x7f87ac038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.827+0000 7f87b67fc640 1 -- 172.21.15.164:0/1657556656 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f88c8047040 con 0x55d3c9d81a40 2024-09-13T23:07:17.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.827+0000 7f88e1302640 1 --2- 172.21.15.164:0/1657556656 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f87ac036af0 0x7f87ac038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.828+0000 7f88e1302640 1 --2- 172.21.15.164:0/1657556656 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f87ac036af0 0x7f87ac038fb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55d3c9d5e1c0 tx=0x7f88dc01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.828+0000 7f88e300d800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.828+0000 7f88e300d800 1 --2- 172.21.15.164:0/1657556656 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d3c9d946f0 0x55d3c9d96bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.828+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d97300 con 0x55d3c9d946f0 2024-09-13T23:07:17.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.828+0000 7f88e0b01640 1 --2- 172.21.15.164:0/1657556656 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d3c9d946f0 0x55d3c9d96bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.828+0000 7f88e0b01640 1 --2- 172.21.15.164:0/1657556656 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d3c9d946f0 0x55d3c9d96bb0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.829+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.829+0000 7f88e300d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:17.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.829+0000 7f88e300d800 20 realm 2024-09-13T23:07:17.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.829+0000 7f88e300d800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.829+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d97710 con 0x55d3c9d946f0 2024-09-13T23:07:17.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.829+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.829+0000 7f88e300d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:17.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.829+0000 7f88e300d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:07:17.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.829+0000 7f88e300d800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.829+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d97fe0 con 0x55d3c9d946f0 2024-09-13T23:07:17.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.829+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.829+0000 7f88e300d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:17.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.829+0000 7f88e300d800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.829+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d98380 con 0x55d3c9d946f0 2024-09-13T23:07:17.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.829+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.829+0000 7f88e300d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:17.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.829+0000 7f88e300d800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.829+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d98bd0 con 0x55d3c9d946f0 2024-09-13T23:07:17.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.830+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.830+0000 7f88e300d800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:07:17.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.830+0000 7f88e300d800 20 searching for the correct realm 2024-09-13T23:07:17.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.830+0000 7f88e300d800 1 --2- 172.21.15.164:0/1657556656 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55d3c9d9a940 0x55d3c9d9cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.830+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x55d3c9d9a940 2024-09-13T23:07:17.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.830+0000 7f88d8300640 1 --2- 172.21.15.164:0/1657556656 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55d3c9d9a940 0x55d3c9d9cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.830+0000 7f88d8300640 1 --2- 172.21.15.164:0/1657556656 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55d3c9d9a940 0x55d3c9d9cd30 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.830+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.830+0000 7f88d8300640 1 --2- 172.21.15.164:0/1657556656 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f88c801ac20 0x7f88c8013620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.830+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x7f88c801ac20 2024-09-13T23:07:17.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.830+0000 7f88e1302640 1 --2- 172.21.15.164:0/1657556656 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f88c801ac20 0x7f88c8013620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.831+0000 7f88e1302640 1 --2- 172.21.15.164:0/1657556656 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f88c801ac20 0x7f88c8013620 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.831+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88dc01f070 con 0x7f88c801ac20 2024-09-13T23:07:17.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.831+0000 7f88e1302640 1 --2- 172.21.15.164:0/1657556656 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f88dc031040 0x7f88dc032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.831+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x7f88dc031040 2024-09-13T23:07:17.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.831+0000 7f88e0b01640 1 --2- 172.21.15.164:0/1657556656 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f88dc031040 0x7f88dc032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.832+0000 7f88e0b01640 1 --2- 172.21.15.164:0/1657556656 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f88dc031040 0x7f88dc032940 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.832+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88d0075030 con 0x7f88dc031040 2024-09-13T23:07:17.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.832+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x55d3c9d946f0 2024-09-13T23:07:17.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.832+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.832+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x55d3c9d946f0 2024-09-13T23:07:17.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.832+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.832+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x7f88dc031040 2024-09-13T23:07:17.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.833+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88d0075030 con 0x7f88dc031040 2024-09-13T23:07:17.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.833+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x7f88dc031040 2024-09-13T23:07:17.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.833+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88d0075030 con 0x7f88dc031040 2024-09-13T23:07:17.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.833+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x7f88c801ac20 2024-09-13T23:07:17.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.833+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88dc01f070 con 0x7f88c801ac20 2024-09-13T23:07:17.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.833+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x55d3c9d9a940 2024-09-13T23:07:17.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.833+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.833+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x55d3c9d946f0 2024-09-13T23:07:17.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.834+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.834+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x7f88dc031040 2024-09-13T23:07:17.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.834+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88d0075030 con 0x7f88dc031040 2024-09-13T23:07:17.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.834+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x55d3c9d946f0 2024-09-13T23:07:17.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.834+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.834+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x7f88c801ac20 2024-09-13T23:07:17.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.834+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f88dc01f070 con 0x7f88c801ac20 2024-09-13T23:07:17.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.834+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x55d3c9d9a940 2024-09-13T23:07:17.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.835+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.835+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x55d3c9d9a940 2024-09-13T23:07:17.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.835+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.835+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x7f88dc031040 2024-09-13T23:07:17.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.835+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88d0075030 con 0x7f88dc031040 2024-09-13T23:07:17.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.835+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x55d3c9d9a940 2024-09-13T23:07:17.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.835+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.835+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x55d3c9d9a940 2024-09-13T23:07:17.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.835+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.836+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x55d3c9d946f0 2024-09-13T23:07:17.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.836+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.836+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x55d3c9d946f0 2024-09-13T23:07:17.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.836+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.836+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x7f88dc031040 2024-09-13T23:07:17.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.836+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88d0075030 con 0x7f88dc031040 2024-09-13T23:07:17.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.836+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x55d3c9d9a940 2024-09-13T23:07:17.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.836+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.836+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x7f88c801ac20 2024-09-13T23:07:17.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.837+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88dc01f070 con 0x7f88c801ac20 2024-09-13T23:07:17.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.837+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x55d3c9d946f0 2024-09-13T23:07:17.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.837+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.837+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x7f88dc031040 2024-09-13T23:07:17.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.837+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88d0075030 con 0x7f88dc031040 2024-09-13T23:07:17.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.837+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x55d3c9d9a940 2024-09-13T23:07:17.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.837+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.837+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x7f88dc031040 2024-09-13T23:07:17.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.838+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88d0075030 con 0x7f88dc031040 2024-09-13T23:07:17.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.838+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x7f88c801ac20 2024-09-13T23:07:17.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.838+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88dc01f070 con 0x7f88c801ac20 2024-09-13T23:07:17.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.838+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x55d3c9d9a940 2024-09-13T23:07:17.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.838+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.838+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x7f88c801ac20 2024-09-13T23:07:17.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.838+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88dc01f070 con 0x7f88c801ac20 2024-09-13T23:07:17.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.838+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x55d3c9d946f0 2024-09-13T23:07:17.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.839+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.839+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d360 con 0x7f88c801ac20 2024-09-13T23:07:17.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.839+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.839+0000 7f88e300d800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:07:17.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.839+0000 7f88e300d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:07:17.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.839+0000 7f88e300d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:07:17.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.839+0000 7f88e300d800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:07:17.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.839+0000 7f88e300d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:07:17.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.839+0000 7f88e300d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:07:17.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.839+0000 7f88e300d800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.839+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d99580 con 0x55d3c9d946f0 2024-09-13T23:07:17.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.839+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.839+0000 7f88e300d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:17.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.839+0000 7f88e300d800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.839+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d99e20 con 0x55d3c9d946f0 2024-09-13T23:07:17.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.839+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.839+0000 7f88e300d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:17.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.839+0000 7f88e300d800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.839+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9d7c0 con 0x55d3c9d946f0 2024-09-13T23:07:17.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.840+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.840+0000 7f88e300d800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:07:17.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.840+0000 7f88e300d800 20 zone default found 2024-09-13T23:07:17.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.840+0000 7f88e300d800 4 Realm: () 2024-09-13T23:07:17.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.840+0000 7f88e300d800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:07:17.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.840+0000 7f88e300d800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:07:17.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.840+0000 7f88e300d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:07:17.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.840+0000 7f88e300d800 20 zonegroup default 2024-09-13T23:07:17.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.840+0000 7f88e300d800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.840+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9dc70 con 0x7f88dc031040 2024-09-13T23:07:17.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.840+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x7f88dc031040 2024-09-13T23:07:17.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.840+0000 7f88e300d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:17.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.840+0000 7f88e300d800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.840+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9f650 con 0x55d3c9d9a940 2024-09-13T23:07:17.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.840+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.840+0000 7f88e300d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:17.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.840+0000 7f88e300d800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.840+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9faf0 con 0x55d3c9d9a940 2024-09-13T23:07:17.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.841+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.841+0000 7f88e300d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:17.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.841+0000 7f88e300d800 20 started sync module instance, tier type = 2024-09-13T23:07:17.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.841+0000 7f88e300d800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:07:17.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.841+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9eae0 con 0x7f88c801ac20 2024-09-13T23:07:17.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.842+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.842+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94368112963280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9e740 con 0x7f88c801ac20 2024-09-13T23:07:17.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.842+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9da0a20 con 0x55d3c9d946f0 2024-09-13T23:07:17.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.843+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94368112963280] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.843+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.843+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94368112967504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9da0a20 con 0x55d3c9d946f0 2024-09-13T23:07:17.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.843+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9da13e0 con 0x55d3c9d9a940 2024-09-13T23:07:17.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.844+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.844+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94368112971568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9da1c30 con 0x55d3c9d9a940 2024-09-13T23:07:17.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.844+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9da2750 con 0x7f88c801ac20 2024-09-13T23:07:17.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.844+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94368112967504] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.845+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.845+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94368112976416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9da2b40 con 0x7f88c801ac20 2024-09-13T23:07:17.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.845+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9da3560 con 0x55d3c9d946f0 2024-09-13T23:07:17.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.845+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94368112971568] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.846+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.846+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94368112980048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9da2b40 con 0x55d3c9d946f0 2024-09-13T23:07:17.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.846+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9da4000 con 0x7f88dc031040 2024-09-13T23:07:17.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.846+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94368112976416] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.847+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94368112980048] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.849+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x7f88dc031040 2024-09-13T23:07:17.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.849+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94368112973696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9da3fc0 con 0x7f88dc031040 2024-09-13T23:07:17.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.849+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9da48a0 con 0x7f88dc031040 2024-09-13T23:07:17.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.850+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94368112973696] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x7f88dc031040 2024-09-13T23:07:17.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.850+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x7f88dc031040 2024-09-13T23:07:17.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.850+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94368112982768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9da3fc0 con 0x7f88dc031040 2024-09-13T23:07:17.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.850+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9da4e50 con 0x7f88dc031040 2024-09-13T23:07:17.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.851+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(58 notify.7 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x7f88dc031040 2024-09-13T23:07:17.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.851+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94368112982768] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x7f88dc031040 2024-09-13T23:07:17.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.851+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94368112986528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9da4dc0 con 0x7f88dc031040 2024-09-13T23:07:17.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.851+0000 7f88e300d800 20 add_watcher() i=0 2024-09-13T23:07:17.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.851+0000 7f88e300d800 20 add_watcher() i=1 2024-09-13T23:07:17.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.851+0000 7f88e300d800 20 add_watcher() i=2 2024-09-13T23:07:17.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.851+0000 7f88e300d800 20 add_watcher() i=3 2024-09-13T23:07:17.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.851+0000 7f88e300d800 20 add_watcher() i=4 2024-09-13T23:07:17.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.851+0000 7f88e300d800 20 add_watcher() i=5 2024-09-13T23:07:17.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.851+0000 7f88e300d800 20 add_watcher() i=6 2024-09-13T23:07:17.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.852+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94368112986528] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x7f88dc031040 2024-09-13T23:07:17.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.852+0000 7f88e300d800 20 add_watcher() i=7 2024-09-13T23:07:17.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.852+0000 7f88e300d800 2 all 8 watchers are set, enabling cache 2024-09-13T23:07:17.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.852+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9da82b0 con 0x55d3c9d946f0 2024-09-13T23:07:17.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.853+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.853+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94368112984960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9da57a0 con 0x55d3c9d946f0 2024-09-13T23:07:17.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.854+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94368112984960] v34'233 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.854+0000 7f87977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:17.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.854+0000 7f88e300d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:07:17.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.854+0000 7f88e300d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:07:17.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.854+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9da80c0 con 0x55d3c9d946f0 2024-09-13T23:07:17.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.855+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.855+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db1420 con 0x7f88dc031040 2024-09-13T23:07:17.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.856+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x7f88dc031040 2024-09-13T23:07:17.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.856+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db1420 con 0x55d3c9d9a940 2024-09-13T23:07:17.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.857+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.857+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db18d0 con 0x55d3c9d946f0 2024-09-13T23:07:17.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.858+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'234 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.858+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db19d0 con 0x7f88c801ac20 2024-09-13T23:07:17.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.859+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'74 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.859+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db20b0 con 0x55d3c9d9a940 2024-09-13T23:07:17.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.860+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'49 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.860+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db2450 con 0x55d3c9d946f0 2024-09-13T23:07:17.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.861+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.861+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db24e0 con 0x7f88dc031040 2024-09-13T23:07:17.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.862+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'51 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x7f88dc031040 2024-09-13T23:07:17.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.862+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db24e0 con 0x7f88c801ac20 2024-09-13T23:07:17.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.863+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.863+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db2a50 con 0x55d3c9d9a940 2024-09-13T23:07:17.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.864+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.864+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db2df0 con 0x7f88c801ac20 2024-09-13T23:07:17.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.865+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'75 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.865+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db3360 con 0x7f88dc031040 2024-09-13T23:07:17.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.866+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x7f88dc031040 2024-09-13T23:07:17.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.866+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db3360 con 0x7f88c801ac20 2024-09-13T23:07:17.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.867+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.867+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db3810 con 0x7f88dc031040 2024-09-13T23:07:17.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.869+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'55 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x7f88dc031040 2024-09-13T23:07:17.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.869+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db3810 con 0x55d3c9d946f0 2024-09-13T23:07:17.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.870+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'235 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.870+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db3810 con 0x55d3c9d9a940 2024-09-13T23:07:17.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.871+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'68 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.871+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db3810 con 0x7f88c801ac20 2024-09-13T23:07:17.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.871+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'76 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.872+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db3810 con 0x55d3c9d9a940 2024-09-13T23:07:17.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.872+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.872+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db3810 con 0x55d3c9d946f0 2024-09-13T23:07:17.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.874+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.874+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db3810 con 0x55d3c9d946f0 2024-09-13T23:07:17.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.875+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'236 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.875+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db3810 con 0x55d3c9d9a940 2024-09-13T23:07:17.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.876+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'69 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.876+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db3810 con 0x7f88c801ac20 2024-09-13T23:07:17.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.877+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.877+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db3810 con 0x55d3c9d9a940 2024-09-13T23:07:17.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.878+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.878+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db3810 con 0x55d3c9d9a940 2024-09-13T23:07:17.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.879+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.879+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db3810 con 0x55d3c9d9a940 2024-09-13T23:07:17.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.879+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.879+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db3810 con 0x55d3c9d9a940 2024-09-13T23:07:17.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.880+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'50 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.880+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db3810 con 0x7f88dc031040 2024-09-13T23:07:17.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.882+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x7f88dc031040 2024-09-13T23:07:17.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.882+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db3810 con 0x55d3c9d9a940 2024-09-13T23:07:17.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.883+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.883+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db3810 con 0x7f88dc031040 2024-09-13T23:07:17.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.884+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'52 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x7f88dc031040 2024-09-13T23:07:17.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.884+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db3810 con 0x55d3c9d9a940 2024-09-13T23:07:17.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.885+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'70 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.885+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db3810 con 0x7f88dc031040 2024-09-13T23:07:17.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.886+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'56 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88d0075030 con 0x7f88dc031040 2024-09-13T23:07:17.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.887+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9db3810 con 0x7f88c801ac20 2024-09-13T23:07:17.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.887+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.888+0000 7f87967e4640 20 reqs_thread_entry: start 2024-09-13T23:07:17.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.888+0000 7f88e300d800 20 init_complete bucket index max shards: 11 2024-09-13T23:07:17.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.888+0000 7f88e300d800 20 Filter name: none 2024-09-13T23:07:17.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.888+0000 7f878f7fe640 20 reqs_thread_entry: start 2024-09-13T23:07:17.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.888+0000 7f88e300d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:07:17.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.888+0000 7f88e300d800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.888+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9dde560 con 0x55d3c9d946f0 2024-09-13T23:07:17.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.888+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.888+0000 7f88e300d800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:07:17.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.888+0000 7f88e300d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:07:17.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.888+0000 7f88e300d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:07:17.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.888+0000 7f88e300d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:07:17.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.888+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9dde500 con 0x7f88c801ac20 2024-09-13T23:07:17.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.889+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv45 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.889+0000 7f88e300d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7 : miss 2024-09-13T23:07:17.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.889+0000 7f88e300d800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.889+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:96 8.14 8:2c640e61:root::.bucket.meta.myfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9de0b10 con 0x55d3c9d9a940 2024-09-13T23:07:17.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.889+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 26 ==== osd_op_reply(96 .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.889+0000 7f88e300d800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:07:17.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.889+0000 7f88e300d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7 info.flags=0x17 2024-09-13T23:07:17.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.889+0000 7f88e300d800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7 to cache LRU end 2024-09-13T23:07:17.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.889+0000 7f88e300d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:07:17.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.889+0000 7f88e300d800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:07:17.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.889+0000 7f88e300d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7 2024-09-13T23:07:17.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.889+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:97 4.b 4:d1d2cd8a:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9e5e1f0 con 0x7f88c801ac20 2024-09-13T23:07:17.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.890+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 20 ==== osd_op_reply(97 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.890+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:98 4.7 4:e0f43aa6:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9e5e1f0 con 0x7f88dc031040 2024-09-13T23:07:17.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.890+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(98 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88d0075030 con 0x7f88dc031040 2024-09-13T23:07:17.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.890+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:99 4.3b 4:dce7140f:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9e5e1f0 con 0x55d3c9d9a940 2024-09-13T23:07:17.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.891+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 27 ==== osd_op_reply(99 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.891+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:100 4.b 4:d02743ef:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9e5e230 con 0x7f88c801ac20 2024-09-13T23:07:17.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.891+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 21 ==== osd_op_reply(100 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.3 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.891+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:101 4.d 4:b2781f61:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9e5e230 con 0x55d3c9d9a940 2024-09-13T23:07:17.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.891+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 28 ==== osd_op_reply(101 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.4 [call out=425b] v0'0 uv19 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.891+0000 7f88e300d800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-13T23:07:17.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.891+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:102 4.3e 4:7ee74406:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9e5e260 con 0x7f88c801ac20 2024-09-13T23:07:17.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.892+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 22 ==== osd_op_reply(102 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.5 [call out=85b] v0'0 uv11 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.892+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:103 4.33 4:cd3064ad:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9e5e870 con 0x7f88dc031040 2024-09-13T23:07:17.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.892+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(103 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88d0075030 con 0x7f88dc031040 2024-09-13T23:07:17.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.892+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:104 4.3a 4:5f6558e8:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9e5e870 con 0x55d3c9d9a940 2024-09-13T23:07:17.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.892+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 29 ==== osd_op_reply(104 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.893+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:105 4.5 4:a0deec66:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9e5e870 con 0x7f88c801ac20 2024-09-13T23:07:17.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.893+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 23 ==== osd_op_reply(105 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.893+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:106 4.31 4:8de3a6ba:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9e5e870 con 0x55d3c9d946f0 2024-09-13T23:07:17.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.893+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(106 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.9 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.893+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:107 4.f 4:f056c4d5:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9e5e870 con 0x55d3c9d946f0 2024-09-13T23:07:17.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.893+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(107 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f88d0075030 con 0x55d3c9d946f0 2024-09-13T23:07:17.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.893+0000 7f88e300d800 20 get_obj_state: octx=0x7f88d0064bc0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55d3c9e5c278 s->prefetch_data=0 2024-09-13T23:07:17.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.893+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:108 3.30s0 3:0df6e446:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9e5d1a0 con 0x55d3c9d9a940 2024-09-13T23:07:17.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.894+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 30 ==== osd_op_reply(108 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.894+0000 7f88e300d800 10 manifest: total_size = 6 2024-09-13T23:07:17.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.894+0000 7f88e300d800 20 get_obj_state: setting s->obj_tag to a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.4137210531603639686 2024-09-13T23:07:17.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.894+0000 7f88e300d800 20 get_obj_state: octx=0x7f88d0064bc0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55d3c9e5c278 s->prefetch_data=0 2024-09-13T23:07:17.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.894+0000 7f88e300d800 20 prepare_atomic_modification: state is not atomic. state=0x55d3c9e5c278 2024-09-13T23:07:17.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.894+0000 7f88e300d800 20 bucket index object: :.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.4 2024-09-13T23:07:17.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.894+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:109 4.d 4:b2781f61:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9e5dac0 con 0x55d3c9d9a940 2024-09-13T23:07:17.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.895+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 31 ==== osd_op_reply(109 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.4 [stat,call,call] v34'26 uv26 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.895+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:110 3.30s0 3:0df6e446:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9e5dac0 con 0x55d3c9d9a940 2024-09-13T23:07:17.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.896+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 32 ==== osd_op_reply(110 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7_15f6f8dc036519d7fe15b39338f6e5db [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.896+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:111 4.d 4:b2781f61:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9de5700 con 0x55d3c9d9a940 2024-09-13T23:07:17.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.896+0000 7f88e300d800 20 list_objects_ordered: starting attempt 1 2024-09-13T23:07:17.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.896+0000 7f88e300d800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T23:07:17.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.896+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:112 4.b 4:d1d2cd8a:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9de5700 con 0x7f88c801ac20 2024-09-13T23:07:17.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.897+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:113 4.7 4:e0f43aa6:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9de5700 con 0x7f88dc031040 2024-09-13T23:07:17.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.897+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:114 4.3b 4:dce7140f:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9de5700 con 0x55d3c9d9a940 2024-09-13T23:07:17.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.897+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:115 4.b 4:d02743ef:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9dee300 con 0x7f88c801ac20 2024-09-13T23:07:17.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.897+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:116 4.d 4:b2781f61:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9df0c10 con 0x55d3c9d9a940 2024-09-13T23:07:17.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.897+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:117 4.3e 4:7ee74406:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9df3850 con 0x7f88c801ac20 2024-09-13T23:07:17.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.897+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:118 4.33 4:cd3064ad:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9df0c10 con 0x7f88dc031040 2024-09-13T23:07:17.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.897+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 24 ==== osd_op_reply(112 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.897+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(113 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88d0075030 con 0x7f88dc031040 2024-09-13T23:07:17.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.897+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:119 4.3a 4:5f6558e8:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9de7490 con 0x55d3c9d9a940 2024-09-13T23:07:17.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.897+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:120 4.5 4:a0deec66:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9de8ff0 con 0x7f88c801ac20 2024-09-13T23:07:17.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.897+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:121 4.31 4:8de3a6ba:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9df93a0 con 0x55d3c9d946f0 2024-09-13T23:07:17.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.897+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:122 4.f 4:f056c4d5:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9dfbef0 con 0x55d3c9d946f0 2024-09-13T23:07:17.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.898+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== osd_op_reply(118 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88d00bd060 con 0x7f88dc031040 2024-09-13T23:07:17.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.898+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 33 ==== osd_op_reply(114 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.898+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 34 ==== osd_op_reply(119 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.898+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 25 ==== osd_op_reply(115 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.3 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.898+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 32 ==== osd_op_reply(121 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.9 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88d00bd060 con 0x55d3c9d946f0 2024-09-13T23:07:17.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.898+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 26 ==== osd_op_reply(117 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.5 [call out=85b] v0'0 uv11 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.898+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 33 ==== osd_op_reply(122 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f88d00bd060 con 0x55d3c9d946f0 2024-09-13T23:07:17.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.898+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 27 ==== osd_op_reply(120 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.898+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 35 ==== osd_op_reply(111 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.4 [stat,call,call] v34'27 uv27 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.898+0000 7f87b7fff640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-13T23:07:17.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.898+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 36 ==== osd_op_reply(116 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.4 [call out=124b] v0'0 uv27 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.898+0000 7f88e300d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T23:07:17.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.898+0000 7f88e300d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T23:07:17.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.898+0000 7f88e300d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T23:07:17.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.898+0000 7f88e300d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T23:07:17.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.898+0000 7f88e300d800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7])"; uploads.size()=0; is_truncated=0 2024-09-13T23:07:17.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.899+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:123 4.b 4:d1d2cd8a:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9de7630 con 0x7f88c801ac20 2024-09-13T23:07:17.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.899+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:124 4.7 4:e0f43aa6:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9de8e90 con 0x7f88dc031040 2024-09-13T23:07:17.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.899+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:125 4.3b 4:dce7140f:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9df2110 con 0x55d3c9d9a940 2024-09-13T23:07:17.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.899+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:126 4.b 4:d02743ef:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9defac0 con 0x7f88c801ac20 2024-09-13T23:07:17.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.899+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:127 4.d 4:b2781f61:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9de7630 con 0x55d3c9d9a940 2024-09-13T23:07:17.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.899+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:128 4.3e 4:7ee74406:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9deff10 con 0x7f88c801ac20 2024-09-13T23:07:17.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.899+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:129 4.33 4:cd3064ad:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9defac0 con 0x7f88dc031040 2024-09-13T23:07:17.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.899+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:130 4.3a 4:5f6558e8:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9de8e90 con 0x55d3c9d9a940 2024-09-13T23:07:17.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.899+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:131 4.5 4:a0deec66:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9de7630 con 0x7f88c801ac20 2024-09-13T23:07:17.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.899+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:132 4.31 4:8de3a6ba:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9de8e90 con 0x55d3c9d946f0 2024-09-13T23:07:17.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.899+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:133 4.f 4:f056c4d5:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9defac0 con 0x55d3c9d946f0 2024-09-13T23:07:17.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.899+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 28 ==== osd_op_reply(123 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.899+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 29 ==== osd_op_reply(128 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.5 [call out=85b] v0'0 uv11 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.899+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 37 ==== osd_op_reply(125 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.899+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 38 ==== osd_op_reply(127 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.4 [call out=124b] v0'0 uv27 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.899+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 30 ==== osd_op_reply(131 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.899+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 31 ==== osd_op_reply(126 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.3 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.899+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 34 ==== osd_op_reply(132 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.9 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88d00bd060 con 0x55d3c9d946f0 2024-09-13T23:07:17.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.899+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 35 ==== osd_op_reply(133 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f88d00bd060 con 0x55d3c9d946f0 2024-09-13T23:07:17.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.899+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 39 ==== osd_op_reply(130 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.899+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 27 ==== osd_op_reply(124 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88d00bd060 con 0x7f88dc031040 2024-09-13T23:07:17.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.899+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 28 ==== osd_op_reply(129 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88d00bd060 con 0x7f88dc031040 2024-09-13T23:07:17.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.899+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9df07c0 con 0x7f88c801ac20 2024-09-13T23:07:17.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.901+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 32 ==== osd_op_reply(134 foo.buckets [call] v34'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.901+0000 7f88e300d800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:07:17.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.901+0000 7f88e300d800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.901+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9df07c0 con 0x7f88c801ac20 2024-09-13T23:07:17.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.901+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 33 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv42 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.901+0000 7f88e300d800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:07:17.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.901+0000 7f88e300d800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:07:17.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.901+0000 7f88e300d800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:07:17.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.901+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9df0310 con 0x7f88c801ac20 2024-09-13T23:07:17.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.902+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 34 ==== osd_op_reply(136 myfoo [call,call,delete] v34'49 uv49 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.902+0000 7f88e300d800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-13T23:07:17.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.902+0000 7f88e300d800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T23:07:17.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.902+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94368113299584 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9df0310 con 0x7f88dc031040 2024-09-13T23:07:17.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.902+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 29 ==== watch-notify(notify (1) cookie 94368112982768 notify 146028888105 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55d3c9db2e40 con 0x7f88dc031040 2024-09-13T23:07:17.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.902+0000 7f87b77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888105 cookie 94368112982768 notifier 4791 bl.length()=149 2024-09-13T23:07:17.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.902+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 30 ==== osd_op_reply(137 notify.6 [notify cookie 94368113299584 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f88d00bd060 con 0x7f88dc031040 2024-09-13T23:07:17.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.902+0000 7f87b77fe640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f8708003320 con 0x7f88dc031040 2024-09-13T23:07:17.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.903+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 31 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88d00bd060 con 0x7f88dc031040 2024-09-13T23:07:17.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.903+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 32 ==== watch-notify(notify_complete (2) cookie 94368113299584 notify 146028888105 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d3c9da78b0 con 0x7f88dc031040 2024-09-13T23:07:17.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.903+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:139 8.14 8:2c640e61:root::.bucket.meta.myfoo%3aa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9df0310 con 0x55d3c9d9a940 2024-09-13T23:07:17.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.904+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 40 ==== osd_op_reply(139 .bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7 [call,call,delete] v34'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.904+0000 7f88e300d800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7 from cache 2024-09-13T23:07:17.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.904+0000 7f88e300d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7, ofs0, ns] 2024-09-13T23:07:17.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.904+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:140 7.3 7:c609908c:::notify.5:head [notify cookie 94368113295984 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9df1080 con 0x7f88dc031040 2024-09-13T23:07:17.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.904+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 33 ==== watch-notify(notify (1) cookie 94368112973696 notify 146028888106 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55d3c9da78b0 con 0x7f88dc031040 2024-09-13T23:07:17.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.904+0000 7f87b77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888106 cookie 94368112973696 notifier 4791 bl.length()=206 2024-09-13T23:07:17.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.904+0000 7f87b77fe640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:141 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f8708003320 con 0x7f88dc031040 2024-09-13T23:07:17.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.904+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 34 ==== osd_op_reply(140 notify.5 [notify cookie 94368113295984 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f88d00bd060 con 0x7f88dc031040 2024-09-13T23:07:17.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.905+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 35 ==== watch-notify(notify_complete (2) cookie 94368113295984 notify 146028888106 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d3c9d5de60 con 0x7f88dc031040 2024-09-13T23:07:17.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.905+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 36 ==== osd_op_reply(141 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88d00bd060 con 0x7f88dc031040 2024-09-13T23:07:17.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.905+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:142 4.b 4:d1d2cd8a:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9df0270 con 0x7f88c801ac20 2024-09-13T23:07:17.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.905+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:143 4.7 4:e0f43aa6:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9e5bfa0 con 0x7f88dc031040 2024-09-13T23:07:17.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.905+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:144 4.3b 4:dce7140f:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9ddefd0 con 0x55d3c9d9a940 2024-09-13T23:07:17.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.905+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:145 4.b 4:d02743ef:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9df0270 con 0x7f88c801ac20 2024-09-13T23:07:17.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.905+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:146 4.d 4:b2781f61:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9e5bfa0 con 0x55d3c9d9a940 2024-09-13T23:07:17.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.905+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:147 4.3e 4:7ee74406:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9ddefd0 con 0x7f88c801ac20 2024-09-13T23:07:17.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.905+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:148 4.33 4:cd3064ad:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9df0270 con 0x7f88dc031040 2024-09-13T23:07:17.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.905+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:149 4.3a 4:5f6558e8:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9e5bfa0 con 0x55d3c9d9a940 2024-09-13T23:07:17.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.905+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:150 4.5 4:a0deec66:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9ddefd0 con 0x7f88c801ac20 2024-09-13T23:07:17.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.905+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:151 4.31 4:8de3a6ba:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9e5bfa0 con 0x55d3c9d946f0 2024-09-13T23:07:17.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.905+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:152 4.f 4:f056c4d5:::.dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9ddefd0 con 0x55d3c9d946f0 2024-09-13T23:07:17.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.906+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 41 ==== osd_op_reply(144 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.2 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.907+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 37 ==== osd_op_reply(143 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.1 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f88d00bd060 con 0x7f88dc031040 2024-09-13T23:07:17.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.907+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 35 ==== osd_op_reply(142 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.0 [delete] v34'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.907+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 36 ==== osd_op_reply(147 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.5 [delete] v34'14 uv14 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.907+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 37 ==== osd_op_reply(150 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.8 [delete] v34'16 uv16 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.907+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 42 ==== osd_op_reply(146 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.4 [delete] v34'28 uv28 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.907+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 38 ==== osd_op_reply(148 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.6 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f88d00bd060 con 0x7f88dc031040 2024-09-13T23:07:17.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.907+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 36 ==== osd_op_reply(152 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.10 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f88d00bd060 con 0x55d3c9d946f0 2024-09-13T23:07:17.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.907+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 38 ==== osd_op_reply(145 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.3 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.907+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 43 ==== osd_op_reply(149 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.7 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.907+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 37 ==== osd_op_reply(151 .dir.a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7.9 [delete] v34'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f88d00bd060 con 0x55d3c9d946f0 2024-09-13T23:07:17.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.907+0000 7f88e300d800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7 : miss 2024-09-13T23:07:17.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.907+0000 7f88e300d800 20 rados->read ofs=0 len=0 2024-09-13T23:07:17.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.907+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:153 6.11 6:88978273:::pubsub..bucket.myfoo%2fa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9df0270 con 0x55d3c9d9a940 2024-09-13T23:07:17.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.908+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 44 ==== osd_op_reply(153 pubsub..bucket.myfoo/a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.908+0000 7f88e300d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:17.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.908+0000 7f88e300d800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7 info.flags=0x0 2024-09-13T23:07:17.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.908+0000 7f88e300d800 10 adding default.rgw.log++pubsub..bucket.myfoo/a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7 to cache LRU end 2024-09-13T23:07:17.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.908+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:154 6.11 6:88978273:::pubsub..bucket.myfoo%2fa32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9df0270 con 0x55d3c9d9a940 2024-09-13T23:07:17.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.910+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 45 ==== osd_op_reply(154 pubsub..bucket.myfoo/a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.7 [delete] v34'31 uv23 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.910+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9df0270 con 0x7f88c801ac20 2024-09-13T23:07:17.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.911+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 39 ==== osd_op_reply(155 foo.buckets [call] v34'50 uv50 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.911+0000 7f88e300d800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-13T23:07:17.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.911+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9df0270 con 0x7f88dc031040 2024-09-13T23:07:17.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.912+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 39 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v34'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f88d00bd060 con 0x7f88dc031040 2024-09-13T23:07:17.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.912+0000 7f88e300d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-13T23:07:17.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.912+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94368113295984 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9ddf980 con 0x7f88c801ac20 2024-09-13T23:07:17.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.913+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 40 ==== watch-notify(notify (1) cookie 94368112976416 notify 146028888093 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55d3c9da7b40 con 0x7f88c801ac20 2024-09-13T23:07:17.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.913+0000 7f87b7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888093 cookie 94368112976416 notifier 4791 bl.length()=170 2024-09-13T23:07:17.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.913+0000 7f87b7fff640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f87a4003d60 con 0x7f88c801ac20 2024-09-13T23:07:17.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.913+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 41 ==== osd_op_reply(157 notify.3 [notify cookie 94368113295984 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.913+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 42 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.913+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 43 ==== watch-notify(notify_complete (2) cookie 94368113295984 notify 146028888093 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d3c9db3190 con 0x7f88c801ac20 2024-09-13T23:07:17.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.913+0000 7f88e300d800 10 removing email index: foo@foo.com 2024-09-13T23:07:17.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.913+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9df0270 con 0x55d3c9d946f0 2024-09-13T23:07:17.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.914+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 38 ==== osd_op_reply(159 foo@foo.com [delete] v34'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f88d00bd060 con 0x55d3c9d946f0 2024-09-13T23:07:17.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.914+0000 7f88e300d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-13T23:07:17.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.914+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94368113295984 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9ddf980 con 0x7f88c801ac20 2024-09-13T23:07:17.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.914+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 44 ==== watch-notify(notify (1) cookie 94368112976416 notify 146028888094 ret 0) ==== 204+0+0 (crc 0 0 0) 0x55d3c9db3190 con 0x7f88c801ac20 2024-09-13T23:07:17.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.914+0000 7f87b77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888094 cookie 94368112976416 notifier 4791 bl.length()=162 2024-09-13T23:07:17.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.914+0000 7f87b77fe640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f8708003320 con 0x7f88c801ac20 2024-09-13T23:07:17.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.914+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 45 ==== osd_op_reply(160 notify.3 [notify cookie 94368113295984 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.915+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 46 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.915+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 47 ==== watch-notify(notify_complete (2) cookie 94368113295984 notify 146028888094 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d3c9db19d0 con 0x7f88c801ac20 2024-09-13T23:07:17.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.915+0000 7f88e300d800 10 removing user buckets index 2024-09-13T23:07:17.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.915+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9df0270 con 0x7f88c801ac20 2024-09-13T23:07:17.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.916+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 48 ==== osd_op_reply(162 foo.buckets [delete] v34'51 uv51 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.916+0000 7f88e300d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-13T23:07:17.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.916+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94368113295984 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9ddf980 con 0x7f88dc031040 2024-09-13T23:07:17.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.916+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 40 ==== watch-notify(notify (1) cookie 94368112973696 notify 146028888107 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55d3c9d5de60 con 0x7f88dc031040 2024-09-13T23:07:17.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.916+0000 7f87b7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888107 cookie 94368112973696 notifier 4791 bl.length()=160 2024-09-13T23:07:17.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.916+0000 7f87b7fff640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f87a4003d60 con 0x7f88dc031040 2024-09-13T23:07:17.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.916+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 41 ==== osd_op_reply(163 notify.5 [notify cookie 94368113295984 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f88d00bd060 con 0x7f88dc031040 2024-09-13T23:07:17.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.917+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 42 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88d00bd060 con 0x7f88dc031040 2024-09-13T23:07:17.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.917+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 43 ==== watch-notify(notify_complete (2) cookie 94368113295984 notify 146028888107 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d3c9d5d8e0 con 0x7f88dc031040 2024-09-13T23:07:17.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.917+0000 7f88e300d800 10 removing user index: foo 2024-09-13T23:07:17.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.917+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9df0270 con 0x55d3c9d946f0 2024-09-13T23:07:17.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.918+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 39 ==== osd_op_reply(165 foo [call,call,delete] v34'21 uv21 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f88d00bd060 con 0x55d3c9d946f0 2024-09-13T23:07:17.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.918+0000 7f88e300d800 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-13T23:07:17.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.918+0000 7f88e300d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:07:17.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.918+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94368113295984 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9ddf980 con 0x55d3c9d946f0 2024-09-13T23:07:17.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.918+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 40 ==== watch-notify(notify (1) cookie 94368112980048 notify 146028888086 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55d3c9d5d8e0 con 0x55d3c9d946f0 2024-09-13T23:07:17.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.918+0000 7f87b77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888086 cookie 94368112980048 notifier 4791 bl.length()=152 2024-09-13T23:07:17.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.918+0000 7f87b77fe640 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f87080032c0 con 0x55d3c9d946f0 2024-09-13T23:07:17.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.918+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 41 ==== osd_op_reply(166 notify.4 [notify cookie 94368113295984 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f88d00bd060 con 0x55d3c9d946f0 2024-09-13T23:07:17.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.919+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 42 ==== watch-notify(notify_complete (2) cookie 94368113295984 notify 146028888086 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d3c9b11fe0 con 0x55d3c9d946f0 2024-09-13T23:07:17.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.919+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 43 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88d00bd060 con 0x55d3c9d946f0 2024-09-13T23:07:17.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.919+0000 7f87977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:17.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.919+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94368112984960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9df0270 con 0x55d3c9d946f0 2024-09-13T23:07:17.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.920+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 44 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94368112984960] v34'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f88d00bd060 con 0x55d3c9d946f0 2024-09-13T23:07:17.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.920+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94368112963280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9df0270 con 0x7f88c801ac20 2024-09-13T23:07:17.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.921+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 49 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94368112963280] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.921+0000 7f88e300d800 20 remove_watcher() i=0 2024-09-13T23:07:17.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.922+0000 7f88e300d800 2 removed watcher, disabling cache 2024-09-13T23:07:17.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.922+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94368112967504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9d9eed0 con 0x55d3c9d946f0 2024-09-13T23:07:17.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.923+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 45 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94368112967504] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88d00bd060 con 0x55d3c9d946f0 2024-09-13T23:07:17.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.923+0000 7f88e300d800 20 remove_watcher() i=1 2024-09-13T23:07:17.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.923+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94368112971568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9df0270 con 0x55d3c9d9a940 2024-09-13T23:07:17.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.924+0000 7f88d8300640 1 -- 172.21.15.164:0/1657556656 <== osd.3 v2:172.21.15.164:6816/93809510 46 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94368112971568] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88c8032070 con 0x55d3c9d9a940 2024-09-13T23:07:17.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.924+0000 7f88e300d800 20 remove_watcher() i=2 2024-09-13T23:07:17.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.924+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94368112976416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9df0270 con 0x7f88c801ac20 2024-09-13T23:07:17.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.925+0000 7f88e1302640 1 -- 172.21.15.164:0/1657556656 <== osd.2 v2:172.21.15.164:6808/3795914978 50 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94368112976416] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88dc040040 con 0x7f88c801ac20 2024-09-13T23:07:17.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.925+0000 7f88e300d800 20 remove_watcher() i=3 2024-09-13T23:07:17.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.925+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94368112980048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9da2220 con 0x55d3c9d946f0 2024-09-13T23:07:17.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.926+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.1 v2:172.21.15.164:6800/4060509701 46 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94368112980048] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88d00bd060 con 0x55d3c9d946f0 2024-09-13T23:07:17.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.926+0000 7f88e300d800 20 remove_watcher() i=4 2024-09-13T23:07:17.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.926+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94368112973696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9df0270 con 0x7f88dc031040 2024-09-13T23:07:17.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.927+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 44 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94368112973696] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88d00bd060 con 0x7f88dc031040 2024-09-13T23:07:17.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.927+0000 7f88e300d800 20 remove_watcher() i=5 2024-09-13T23:07:17.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.927+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94368112982768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9da2220 con 0x7f88dc031040 2024-09-13T23:07:17.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.929+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 45 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94368112982768] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88d00bd060 con 0x7f88dc031040 2024-09-13T23:07:17.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.929+0000 7f88e300d800 20 remove_watcher() i=6 2024-09-13T23:07:17.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.929+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94368112986528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d3c9da1780 con 0x7f88dc031040 2024-09-13T23:07:17.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.930+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 <== osd.0 v2:172.21.15.17:6800/489863589 46 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94368112986528] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88d00bd060 con 0x7f88dc031040 2024-09-13T23:07:17.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.930+0000 7f88e300d800 20 remove_watcher() i=7 2024-09-13T23:07:17.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.930+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f88dc031040 msgr2=0x7f88dc032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.930+0000 7f88e300d800 1 --2- 172.21.15.164:0/1657556656 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f88dc031040 0x7f88dc032940 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.930+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d3c9d946f0 msgr2=0x55d3c9d96bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.930+0000 7f88e300d800 1 --2- 172.21.15.164:0/1657556656 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d3c9d946f0 0x55d3c9d96bb0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.930+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f88c801ac20 msgr2=0x7f88c8013620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.930+0000 7f88e300d800 1 --2- 172.21.15.164:0/1657556656 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f88c801ac20 0x7f88c8013620 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.930+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55d3c9d9a940 msgr2=0x55d3c9d9cd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.930+0000 7f88e300d800 1 --2- 172.21.15.164:0/1657556656 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55d3c9d9a940 0x55d3c9d9cd30 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.930+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f87ac036af0 msgr2=0x7f87ac038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.930+0000 7f88e300d800 1 --2- 172.21.15.164:0/1657556656 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f87ac036af0 0x7f87ac038fb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55d3c9d5e1c0 tx=0x7f88dc01f000 comp rx=0 tx=0).stop 2024-09-13T23:07:17.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.930+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9d81a40 msgr2=0x55d3c9d88f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.930+0000 7f88e300d800 1 --2- 172.21.15.164:0/1657556656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9d81a40 0x55d3c9d88f40 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f88c8024a50 tx=0x7f88c804c370 comp rx=0 tx=0).stop 2024-09-13T23:07:17.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.930+0000 7f88e0b01640 1 -- 172.21.15.164:0/1657556656 reap_dead start 2024-09-13T23:07:17.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.930+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 shutdown_connections 2024-09-13T23:07:17.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.930+0000 7f88e300d800 1 --2- 172.21.15.164:0/1657556656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9d81a40 0x55d3c9d88f40 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.930+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 >> 172.21.15.164:0/1657556656 conn(0x55d3c9d7dda0 msgr2=0x55d3c9d7be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:17.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.930+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 shutdown_connections 2024-09-13T23:07:17.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.930+0000 7f88e300d800 1 -- 172.21.15.164:0/1657556656 wait complete. 2024-09-13T23:07:17.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.931+0000 7f88e300d800 1 -- 172.21.15.164:0/2569238416 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f87b8036b40 msgr2=0x7f87b8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.931+0000 7f88e300d800 1 --2- 172.21.15.164:0/2569238416 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f87b8036b40 0x7f87b8039000 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x55d3c9d65410 tx=0x7f88dc005840 comp rx=0 tx=0).stop 2024-09-13T23:07:17.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.931+0000 7f88e300d800 1 -- 172.21.15.164:0/2569238416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9d74d30 msgr2=0x55d3c9d75150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.931+0000 7f88e300d800 1 --2- 172.21.15.164:0/2569238416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9d74d30 0x55d3c9d75150 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f88c8001ed0 tx=0x7f88c800ea00 comp rx=0 tx=0).stop 2024-09-13T23:07:17.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.931+0000 7f88e300d800 1 -- 172.21.15.164:0/2569238416 shutdown_connections 2024-09-13T23:07:17.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.931+0000 7f88e300d800 1 --2- 172.21.15.164:0/2569238416 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f87b8036b40 0x7f87b8039000 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.931+0000 7f88e300d800 1 --2- 172.21.15.164:0/2569238416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9d74d30 0x55d3c9d75150 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.931+0000 7f88e300d800 1 -- 172.21.15.164:0/2569238416 >> 172.21.15.164:0/2569238416 conn(0x55d3c9d69cc0 msgr2=0x55d3c9d6c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:17.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.931+0000 7f88e300d800 1 -- 172.21.15.164:0/2569238416 shutdown_connections 2024-09-13T23:07:17.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.931+0000 7f88e300d800 1 -- 172.21.15.164:0/2569238416 wait complete. 2024-09-13T23:07:17.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.931+0000 7f88e300d800 1 -- 172.21.15.164:0/3728677883 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d3c9c69b40 msgr2=0x55d3c9d64410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.931+0000 7f88e300d800 1 --2- 172.21.15.164:0/3728677883 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d3c9c69b40 0x55d3c9d64410 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.931+0000 7f88e300d800 1 -- 172.21.15.164:0/3728677883 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f87c8036b40 msgr2=0x7f87c8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.931+0000 7f88e300d800 1 --2- 172.21.15.164:0/3728677883 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f87c8036b40 0x7f87c8039000 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f88c8000f60 tx=0x7f88c8001370 comp rx=0 tx=0).stop 2024-09-13T23:07:17.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.931+0000 7f88e300d800 1 -- 172.21.15.164:0/3728677883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9bd8630 msgr2=0x55d3c9d5d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.931+0000 7f88e300d800 1 --2- 172.21.15.164:0/3728677883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9bd8630 0x55d3c9d5d3a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f88d0067040 tx=0x7f88d0002fb0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.931+0000 7f88e300d800 1 -- 172.21.15.164:0/3728677883 shutdown_connections 2024-09-13T23:07:17.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.931+0000 7f88e300d800 1 --2- 172.21.15.164:0/3728677883 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d3c9c69b40 0x55d3c9d64410 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.931+0000 7f88e300d800 1 --2- 172.21.15.164:0/3728677883 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f87c8036b40 0x7f87c8039000 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.931+0000 7f88e300d800 1 --2- 172.21.15.164:0/3728677883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d3c9bd8630 0x55d3c9d5d3a0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.931+0000 7f88e300d800 1 -- 172.21.15.164:0/3728677883 >> 172.21.15.164:0/3728677883 conn(0x55d3c9c5edb0 msgr2=0x55d3c9d4fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:17.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.931+0000 7f88e300d800 1 -- 172.21.15.164:0/3728677883 shutdown_connections 2024-09-13T23:07:17.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.931+0000 7f88e300d800 1 -- 172.21.15.164:0/3728677883 wait complete. 2024-09-13T23:07:17.940 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T23:07:17.940 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T23:07:17.941 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T23:07:17.985 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:07:17.985 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:07:17.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.985+0000 7f2428c13800 1 Processor -- start 2024-09-13T23:07:17.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.985+0000 7f2428c13800 1 -- start start 2024-09-13T23:07:17.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.985+0000 7f2428c13800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x56417547f5f0 0x564175510690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:17.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.985+0000 7f2428c13800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5641753cab30 con 0x564175510bd0 2024-09-13T23:07:17.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.985+0000 7f2428c13800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x5641753ac360 con 0x56417547f5f0 2024-09-13T23:07:17.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.986+0000 7f242433d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x56417547f5f0 0x564175510690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:17.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.986+0000 7f241bb3c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x564175510bd0 0x564175512fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:60878/0 (socket says 172.21.15.164:60878) 2024-09-13T23:07:17.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.986+0000 7f242433d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x56417547f5f0 0x564175510690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44522/0 (socket says 172.21.15.164:44522) 2024-09-13T23:07:17.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.986+0000 7f241bb3c640 1 -- 172.21.15.164:0/1801610192 learned_addr learned my addr 172.21.15.164:0/1801610192 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:07:17.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.986+0000 7f242433d640 1 -- 172.21.15.164:0/1801610192 >> v1:172.21.15.17:6789/0 conn(0x564175510bd0 legacy=0x564175512fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.986+0000 7f242433d640 1 -- 172.21.15.164:0/1801610192 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641753d2e00 con 0x56417547f5f0 2024-09-13T23:07:17.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.988+0000 7f242433d640 1 --2- 172.21.15.164:0/1801610192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56417547f5f0 0x564175510690 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f241400a470 tx=0x7f2414045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b62e36405206d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:17.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.988+0000 7f2423b3c640 1 -- 172.21.15.164:0/1801610192 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2414053570 con 0x56417547f5f0 2024-09-13T23:07:17.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.988+0000 7f2423b3c640 1 -- 172.21.15.164:0/1801610192 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2414058070 con 0x56417547f5f0 2024-09-13T23:07:17.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.988+0000 7f2423b3c640 1 -- 172.21.15.164:0/1801610192 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2414053880 con 0x56417547f5f0 2024-09-13T23:07:17.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.989+0000 7f2428c13800 1 -- 172.21.15.164:0/1801610192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56417547f5f0 msgr2=0x564175510690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:17.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.989+0000 7f2428c13800 1 --2- 172.21.15.164:0/1801610192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56417547f5f0 0x564175510690 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f241400a470 tx=0x7f2414045a20 comp rx=0 tx=0).stop 2024-09-13T23:07:17.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.989+0000 7f2428c13800 1 -- 172.21.15.164:0/1801610192 shutdown_connections 2024-09-13T23:07:17.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.989+0000 7f2428c13800 1 --2- 172.21.15.164:0/1801610192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56417547f5f0 0x564175510690 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:17.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.989+0000 7f2428c13800 1 -- 172.21.15.164:0/1801610192 >> 172.21.15.164:0/1801610192 conn(0x564175505de0 msgr2=0x564175508200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:17.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.989+0000 7f2428c13800 1 -- 172.21.15.164:0/1801610192 shutdown_connections 2024-09-13T23:07:17.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:17.989+0000 7f2428c13800 1 -- 172.21.15.164:0/1801610192 wait complete. 2024-09-13T23:07:18.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.003+0000 7f2428c13800 1 Processor -- start 2024-09-13T23:07:18.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.003+0000 7f2428c13800 1 -- start start 2024-09-13T23:07:18.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.003+0000 7f2428c13800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56417547f5f0 0x5641755fca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.003+0000 7f2428c13800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564175457330 con 0x56417547f5f0 2024-09-13T23:07:18.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.003+0000 7f242433d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56417547f5f0 0x5641755fca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.003+0000 7f242433d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56417547f5f0 0x5641755fca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44528/0 (socket says 172.21.15.164:44528) 2024-09-13T23:07:18.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.003+0000 7f242433d640 1 -- 172.21.15.164:0/2281451724 learned_addr learned my addr 172.21.15.164:0/2281451724 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.003+0000 7f242433d640 1 -- 172.21.15.164:0/2281451724 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641753a4bc0 con 0x56417547f5f0 2024-09-13T23:07:18.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.003+0000 7f242433d640 1 --2- 172.21.15.164:0/2281451724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56417547f5f0 0x5641755fca70 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f2414025c20 tx=0x7f2414051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef11f9b1cdfc0ad1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.004+0000 7f231260c640 1 -- 172.21.15.164:0/2281451724 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f241405c580 con 0x56417547f5f0 2024-09-13T23:07:18.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.004+0000 7f231260c640 1 -- 172.21.15.164:0/2281451724 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2414063030 con 0x56417547f5f0 2024-09-13T23:07:18.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.004+0000 7f231260c640 1 -- 172.21.15.164:0/2281451724 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f241405c850 con 0x56417547f5f0 2024-09-13T23:07:18.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.004+0000 7f2428c13800 1 -- 172.21.15.164:0/2281451724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56417547f5f0 msgr2=0x5641755fca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.004+0000 7f2428c13800 1 --2- 172.21.15.164:0/2281451724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56417547f5f0 0x5641755fca70 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f2414025c20 tx=0x7f2414051000 comp rx=0 tx=0).stop 2024-09-13T23:07:18.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.004+0000 7f2428c13800 1 -- 172.21.15.164:0/2281451724 shutdown_connections 2024-09-13T23:07:18.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.004+0000 7f2428c13800 1 --2- 172.21.15.164:0/2281451724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56417547f5f0 0x5641755fca70 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.004+0000 7f2428c13800 1 -- 172.21.15.164:0/2281451724 >> 172.21.15.164:0/2281451724 conn(0x564175505de0 msgr2=0x5641755f8430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.004+0000 7f2428c13800 1 -- 172.21.15.164:0/2281451724 shutdown_connections 2024-09-13T23:07:18.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.004+0000 7f2428c13800 1 -- 172.21.15.164:0/2281451724 wait complete. 2024-09-13T23:07:18.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.005+0000 7f2428c13800 1 Processor -- start 2024-09-13T23:07:18.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.005+0000 7f2428c13800 1 -- start start 2024-09-13T23:07:18.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.005+0000 7f2428c13800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56417547f5f0 0x564175604370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.005+0000 7f2428c13800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564175514980 con 0x56417547f5f0 2024-09-13T23:07:18.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.005+0000 7f242433d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56417547f5f0 0x564175604370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.005+0000 7f242433d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56417547f5f0 0x564175604370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44530/0 (socket says 172.21.15.164:44530) 2024-09-13T23:07:18.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.005+0000 7f242433d640 1 -- 172.21.15.164:0/3921239531 learned_addr learned my addr 172.21.15.164:0/3921239531 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.005+0000 7f242433d640 1 -- 172.21.15.164:0/3921239531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641753b8fe0 con 0x56417547f5f0 2024-09-13T23:07:18.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.006+0000 7f242433d640 1 --2- 172.21.15.164:0/3921239531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56417547f5f0 0x564175604370 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f241400a330 tx=0x7f2414002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.006+0000 7f2310e09640 1 -- 172.21.15.164:0/3921239531 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f241406c030 con 0x56417547f5f0 2024-09-13T23:07:18.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.006+0000 7f2310e09640 1 -- 172.21.15.164:0/3921239531 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f241405c580 con 0x56417547f5f0 2024-09-13T23:07:18.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.006+0000 7f2428c13800 1 -- 172.21.15.164:0/3921239531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641756048b0 con 0x56417547f5f0 2024-09-13T23:07:18.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.006+0000 7f2310e09640 1 -- 172.21.15.164:0/3921239531 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f241405c860 con 0x56417547f5f0 2024-09-13T23:07:18.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.006+0000 7f2428c13800 1 -- 172.21.15.164:0/3921239531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564175604e30 con 0x56417547f5f0 2024-09-13T23:07:18.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.007+0000 7f2310e09640 1 -- 172.21.15.164:0/3921239531 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2414053440 con 0x56417547f5f0 2024-09-13T23:07:18.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.007+0000 7f2310e09640 1 --2- 172.21.15.164:0/3921239531 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f230c036b40 0x7f230c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.007+0000 7f2310e09640 1 -- 172.21.15.164:0/3921239531 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2414070020 con 0x56417547f5f0 2024-09-13T23:07:18.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.007+0000 7f241bb3c640 1 --2- 172.21.15.164:0/3921239531 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f230c036b40 0x7f230c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.007+0000 7f2428c13800 1 --2- 172.21.15.164:0/3921239531 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564175510bd0 0x56417560b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.007+0000 7f2428c13800 1 -- 172.21.15.164:0/3921239531 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56417560b960 con 0x564175510bd0 2024-09-13T23:07:18.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.007+0000 7f2424b3e640 1 --2- 172.21.15.164:0/3921239531 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564175510bd0 0x56417560b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.007+0000 7f241bb3c640 1 --2- 172.21.15.164:0/3921239531 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f230c036b40 0x7f230c039000 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f240c000f60 tx=0x7f240c0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.007+0000 7f2424b3e640 1 --2- 172.21.15.164:0/3921239531 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564175510bd0 0x56417560b3e0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.008+0000 7f2424b3e640 1 -- 172.21.15.164:0/3921239531 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f241c00a4a0 con 0x564175510bd0 2024-09-13T23:07:18.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.008+0000 7f2428c13800 1 -- 172.21.15.164:0/3921239531 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5641756089b0 con 0x564175510bd0 2024-09-13T23:07:18.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.008+0000 7f2424b3e640 1 -- 172.21.15.164:0/3921239531 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f241c00a4a0 con 0x564175510bd0 2024-09-13T23:07:18.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.008+0000 7f2428c13800 1 -- 172.21.15.164:0/3921239531 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56417560d7d0 con 0x564175510bd0 2024-09-13T23:07:18.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.008+0000 7f2424b3e640 1 -- 172.21.15.164:0/3921239531 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f241c00a4a0 con 0x564175510bd0 2024-09-13T23:07:18.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.008+0000 7f2428c13800 1 -- 172.21.15.164:0/3921239531 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56417560ca00 con 0x564175510bd0 2024-09-13T23:07:18.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.009+0000 7f2424b3e640 1 -- 172.21.15.164:0/3921239531 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f241c00a4a0 con 0x564175510bd0 2024-09-13T23:07:18.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.009+0000 7f2428c13800 1 -- 172.21.15.164:0/3921239531 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56417560ce50 con 0x564175510bd0 2024-09-13T23:07:18.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.009+0000 7f2424b3e640 1 -- 172.21.15.164:0/3921239531 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f241c00a4a0 con 0x564175510bd0 2024-09-13T23:07:18.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.009+0000 7f2428c13800 1 Processor -- start 2024-09-13T23:07:18.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.009+0000 7f2428c13800 1 -- start start 2024-09-13T23:07:18.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.009+0000 7f2428c13800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56417561bdc0 0x56417561c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.009+0000 7f2428c13800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5641753a6580 con 0x56417561bdc0 2024-09-13T23:07:18.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.010+0000 7f241bb3c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56417561bdc0 0x56417561c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.010+0000 7f241bb3c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56417561bdc0 0x56417561c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44538/0 (socket says 172.21.15.164:44538) 2024-09-13T23:07:18.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.010+0000 7f241bb3c640 1 -- 172.21.15.164:0/339070739 learned_addr learned my addr 172.21.15.164:0/339070739 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.010+0000 7f241bb3c640 1 -- 172.21.15.164:0/339070739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56417561c720 con 0x56417561bdc0 2024-09-13T23:07:18.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.010+0000 7f241bb3c640 1 --2- 172.21.15.164:0/339070739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56417561bdc0 0x56417561c1e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f240c001ed0 tx=0x7f240c00d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.011+0000 7f2309ffb640 1 -- 172.21.15.164:0/339070739 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f240c01b550 con 0x56417561bdc0 2024-09-13T23:07:18.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.011+0000 7f2309ffb640 1 -- 172.21.15.164:0/339070739 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f240c01b6f0 con 0x56417561bdc0 2024-09-13T23:07:18.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.011+0000 7f2428c13800 1 -- 172.21.15.164:0/339070739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56417561c9b0 con 0x56417561bdc0 2024-09-13T23:07:18.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.011+0000 7f2309ffb640 1 -- 172.21.15.164:0/339070739 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f240c01b9d0 con 0x56417561bdc0 2024-09-13T23:07:18.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.011+0000 7f2428c13800 1 -- 172.21.15.164:0/339070739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56417561f690 con 0x56417561bdc0 2024-09-13T23:07:18.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.011+0000 7f2309ffb640 1 -- 172.21.15.164:0/339070739 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f240c023020 con 0x56417561bdc0 2024-09-13T23:07:18.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.012+0000 7f2309ffb640 1 --2- 172.21.15.164:0/339070739 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f22fc036b40 0x7f22fc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.012+0000 7f2309ffb640 1 -- 172.21.15.164:0/339070739 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f240c021020 con 0x56417561bdc0 2024-09-13T23:07:18.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.012+0000 7f2424b3e640 1 --2- 172.21.15.164:0/339070739 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f22fc036b40 0x7f22fc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.012+0000 7f2428c13800 1 Processor -- start 2024-09-13T23:07:18.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.012+0000 7f2424b3e640 1 --2- 172.21.15.164:0/339070739 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f22fc036b40 0x7f22fc039000 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x56417560c520 tx=0x7f241c005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.012+0000 7f2428c13800 1 -- start start 2024-09-13T23:07:18.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.012+0000 7f2428c13800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564175628ad0 0x564175628ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.012+0000 7f2428c13800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5641755fd1c0 con 0x564175628ad0 2024-09-13T23:07:18.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.012+0000 7f241bb3c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564175628ad0 0x564175628ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.012+0000 7f241bb3c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564175628ad0 0x564175628ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44554/0 (socket says 172.21.15.164:44554) 2024-09-13T23:07:18.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.012+0000 7f241bb3c640 1 -- 172.21.15.164:0/1026051313 learned_addr learned my addr 172.21.15.164:0/1026051313 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.013+0000 7f241bb3c640 1 -- 172.21.15.164:0/1026051313 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641756294a0 con 0x564175628ad0 2024-09-13T23:07:18.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.013+0000 7f241bb3c640 1 --2- 172.21.15.164:0/1026051313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564175628ad0 0x564175628ed0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f240c04d180 tx=0x7f240c046be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7d9f095ab598f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.013+0000 7f22fb7fe640 1 -- 172.21.15.164:0/1026051313 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f240c01be20 con 0x564175628ad0 2024-09-13T23:07:18.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.013+0000 7f22fb7fe640 1 -- 172.21.15.164:0/1026051313 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f240c046070 con 0x564175628ad0 2024-09-13T23:07:18.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.013+0000 7f22fb7fe640 1 -- 172.21.15.164:0/1026051313 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f240c00c360 con 0x564175628ad0 2024-09-13T23:07:18.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.013+0000 7f2428c13800 1 -- 172.21.15.164:0/1026051313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564175628ad0 msgr2=0x564175628ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.013+0000 7f2428c13800 1 --2- 172.21.15.164:0/1026051313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564175628ad0 0x564175628ed0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f240c04d180 tx=0x7f240c046be0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.013+0000 7f2428c13800 1 -- 172.21.15.164:0/1026051313 shutdown_connections 2024-09-13T23:07:18.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.013+0000 7f2428c13800 1 --2- 172.21.15.164:0/1026051313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564175628ad0 0x564175628ed0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.013+0000 7f2428c13800 1 -- 172.21.15.164:0/1026051313 >> 172.21.15.164:0/1026051313 conn(0x564175624e30 msgr2=0x564175622f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.014+0000 7f2428c13800 1 -- 172.21.15.164:0/1026051313 shutdown_connections 2024-09-13T23:07:18.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.014+0000 7f2428c13800 1 -- 172.21.15.164:0/1026051313 wait complete. 2024-09-13T23:07:18.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.014+0000 7f2428c13800 1 Processor -- start 2024-09-13T23:07:18.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.014+0000 7f2428c13800 1 -- start start 2024-09-13T23:07:18.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.014+0000 7f2428c13800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564175628ad0 0x56417562ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.014+0000 7f2428c13800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564175629b10 con 0x564175628ad0 2024-09-13T23:07:18.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.014+0000 7f241bb3c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564175628ad0 0x56417562ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.014+0000 7f241bb3c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564175628ad0 0x56417562ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44562/0 (socket says 172.21.15.164:44562) 2024-09-13T23:07:18.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.014+0000 7f241bb3c640 1 -- 172.21.15.164:0/3610319279 learned_addr learned my addr 172.21.15.164:0/3610319279 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.014+0000 7f241bb3c640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641756304d0 con 0x564175628ad0 2024-09-13T23:07:18.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.015+0000 7f241bb3c640 1 --2- 172.21.15.164:0/3610319279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564175628ad0 0x56417562ff90 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f240c04d180 tx=0x7f240c04d110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.015+0000 7f22f9ffb640 1 -- 172.21.15.164:0/3610319279 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f240c01be20 con 0x564175628ad0 2024-09-13T23:07:18.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.015+0000 7f22f9ffb640 1 -- 172.21.15.164:0/3610319279 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f240c00c360 con 0x564175628ad0 2024-09-13T23:07:18.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.015+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564175630760 con 0x564175628ad0 2024-09-13T23:07:18.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.015+0000 7f22f9ffb640 1 -- 172.21.15.164:0/3610319279 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f240c046d10 con 0x564175628ad0 2024-09-13T23:07:18.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.015+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564175630760 con 0x564175628ad0 2024-09-13T23:07:18.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.016+0000 7f22f9ffb640 1 -- 172.21.15.164:0/3610319279 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f240c025980 con 0x564175628ad0 2024-09-13T23:07:18.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.016+0000 7f22f9ffb640 1 --2- 172.21.15.164:0/3610319279 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f22ec036b40 0x7f22ec039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.016+0000 7f22f9ffb640 1 -- 172.21.15.164:0/3610319279 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f240c039d10 con 0x564175628ad0 2024-09-13T23:07:18.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.016+0000 7f2424b3e640 1 --2- 172.21.15.164:0/3610319279 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f22ec036b40 0x7f22ec039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.016+0000 7f2428c13800 20 rados->read ofs=0 len=0 2024-09-13T23:07:18.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.016+0000 7f2428c13800 1 --2- 172.21.15.164:0/3610319279 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x56417563b840 0x56417563dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.016+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56417563e450 con 0x56417563b840 2024-09-13T23:07:18.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.016+0000 7f2424b3e640 1 --2- 172.21.15.164:0/3610319279 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f22ec036b40 0x7f22ec039000 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x564175608900 tx=0x7f241c01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.016+0000 7f242433d640 1 --2- 172.21.15.164:0/3610319279 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x56417563b840 0x56417563dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.017+0000 7f242433d640 1 --2- 172.21.15.164:0/3610319279 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x56417563b840 0x56417563dd00 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.017+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f241407b070 con 0x56417563b840 2024-09-13T23:07:18.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.017+0000 7f2428c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:18.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.017+0000 7f2428c13800 20 realm 2024-09-13T23:07:18.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.017+0000 7f2428c13800 20 rados->read ofs=0 len=0 2024-09-13T23:07:18.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.017+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56417563e860 con 0x56417563b840 2024-09-13T23:07:18.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.017+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f241407b070 con 0x56417563b840 2024-09-13T23:07:18.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.017+0000 7f2428c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:18.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.017+0000 7f2428c13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:07:18.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.017+0000 7f2428c13800 20 rados->read ofs=0 len=0 2024-09-13T23:07:18.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.017+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56417563f130 con 0x56417563b840 2024-09-13T23:07:18.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.017+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f241407b070 con 0x56417563b840 2024-09-13T23:07:18.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.017+0000 7f2428c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:18.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.017+0000 7f2428c13800 20 rados->read ofs=0 len=0 2024-09-13T23:07:18.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.017+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56417563f4d0 con 0x56417563b840 2024-09-13T23:07:18.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.018+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f241407b070 con 0x56417563b840 2024-09-13T23:07:18.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.018+0000 7f2428c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:18.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.018+0000 7f2428c13800 20 rados->read ofs=0 len=0 2024-09-13T23:07:18.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.018+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56417563f930 con 0x56417563b840 2024-09-13T23:07:18.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.018+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f241407b070 con 0x56417563b840 2024-09-13T23:07:18.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.018+0000 7f2428c13800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:07:18.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.018+0000 7f2428c13800 20 searching for the correct realm 2024-09-13T23:07:18.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.018+0000 7f2428c13800 1 --2- 172.21.15.164:0/3610319279 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x564175641980 0x564175643d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.018+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x564175641980 2024-09-13T23:07:18.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.018+0000 7f241bb3c640 1 --2- 172.21.15.164:0/3610319279 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x564175641980 0x564175643d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.018+0000 7f241bb3c640 1 --2- 172.21.15.164:0/3610319279 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x564175641980 0x564175643d70 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.019+0000 7f241bb3c640 1 -- 172.21.15.164:0/3610319279 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f240c009050 con 0x564175641980 2024-09-13T23:07:18.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.019+0000 7f241bb3c640 1 --2- 172.21.15.164:0/3610319279 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f240c043b70 0x7f240c043070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.019+0000 7f241bb3c640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x7f240c043b70 2024-09-13T23:07:18.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.019+0000 7f2424b3e640 1 --2- 172.21.15.164:0/3610319279 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f240c043b70 0x7f240c043070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.019+0000 7f2424b3e640 1 --2- 172.21.15.164:0/3610319279 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f240c043b70 0x7f240c043070 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.019+0000 7f2424b3e640 1 -- 172.21.15.164:0/3610319279 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f241c01f070 con 0x7f240c043b70 2024-09-13T23:07:18.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.019+0000 7f2424b3e640 1 --2- 172.21.15.164:0/3610319279 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f241c031040 0x7f241c032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.019+0000 7f2424b3e640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x7f241c031040 2024-09-13T23:07:18.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.020+0000 7f242433d640 1 --2- 172.21.15.164:0/3610319279 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f241c031040 0x7f241c032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.020+0000 7f242433d640 1 --2- 172.21.15.164:0/3610319279 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f241c031040 0x7f241c032430 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.020+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f241407b070 con 0x7f241c031040 2024-09-13T23:07:18.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.020+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x56417563b840 2024-09-13T23:07:18.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.020+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f241407b070 con 0x56417563b840 2024-09-13T23:07:18.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.020+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x56417563b840 2024-09-13T23:07:18.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.021+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f241407b070 con 0x56417563b840 2024-09-13T23:07:18.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.021+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x7f241c031040 2024-09-13T23:07:18.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.021+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f241407b070 con 0x7f241c031040 2024-09-13T23:07:18.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.021+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x7f241c031040 2024-09-13T23:07:18.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.021+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f241407b070 con 0x7f241c031040 2024-09-13T23:07:18.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.021+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x7f240c043b70 2024-09-13T23:07:18.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.021+0000 7f2424b3e640 1 -- 172.21.15.164:0/3610319279 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f241c01f070 con 0x7f240c043b70 2024-09-13T23:07:18.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.021+0000 7f2424b3e640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x564175641980 2024-09-13T23:07:18.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.022+0000 7f241bb3c640 1 -- 172.21.15.164:0/3610319279 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f240c009050 con 0x564175641980 2024-09-13T23:07:18.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.022+0000 7f241bb3c640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x56417563b840 2024-09-13T23:07:18.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.022+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f241407b070 con 0x56417563b840 2024-09-13T23:07:18.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.022+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x7f241c031040 2024-09-13T23:07:18.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.022+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f241407b070 con 0x7f241c031040 2024-09-13T23:07:18.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.022+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x56417563b840 2024-09-13T23:07:18.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.022+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f241407b070 con 0x56417563b840 2024-09-13T23:07:18.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.022+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x7f240c043b70 2024-09-13T23:07:18.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.023+0000 7f2424b3e640 1 -- 172.21.15.164:0/3610319279 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f241c01f070 con 0x7f240c043b70 2024-09-13T23:07:18.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.023+0000 7f2424b3e640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x564175641980 2024-09-13T23:07:18.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.023+0000 7f241bb3c640 1 -- 172.21.15.164:0/3610319279 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f240c009050 con 0x564175641980 2024-09-13T23:07:18.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.023+0000 7f241bb3c640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x564175641980 2024-09-13T23:07:18.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.023+0000 7f241bb3c640 1 -- 172.21.15.164:0/3610319279 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f240c009050 con 0x564175641980 2024-09-13T23:07:18.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.023+0000 7f241bb3c640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x7f241c031040 2024-09-13T23:07:18.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.023+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f241407b070 con 0x7f241c031040 2024-09-13T23:07:18.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.024+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x564175641980 2024-09-13T23:07:18.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.024+0000 7f241bb3c640 1 -- 172.21.15.164:0/3610319279 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f240c009050 con 0x564175641980 2024-09-13T23:07:18.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.024+0000 7f241bb3c640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x564175641980 2024-09-13T23:07:18.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.024+0000 7f241bb3c640 1 -- 172.21.15.164:0/3610319279 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f240c009050 con 0x564175641980 2024-09-13T23:07:18.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.024+0000 7f241bb3c640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x56417563b840 2024-09-13T23:07:18.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.024+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f241407b070 con 0x56417563b840 2024-09-13T23:07:18.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.024+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x56417563b840 2024-09-13T23:07:18.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.024+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f241407b070 con 0x56417563b840 2024-09-13T23:07:18.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.024+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x7f241c031040 2024-09-13T23:07:18.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.025+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f241407b070 con 0x7f241c031040 2024-09-13T23:07:18.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.025+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x564175641980 2024-09-13T23:07:18.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.025+0000 7f241bb3c640 1 -- 172.21.15.164:0/3610319279 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f240c009050 con 0x564175641980 2024-09-13T23:07:18.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.025+0000 7f241bb3c640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x7f240c043b70 2024-09-13T23:07:18.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.025+0000 7f2424b3e640 1 -- 172.21.15.164:0/3610319279 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f241c01f070 con 0x7f240c043b70 2024-09-13T23:07:18.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.025+0000 7f2424b3e640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x56417563b840 2024-09-13T23:07:18.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.025+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f241407b070 con 0x56417563b840 2024-09-13T23:07:18.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.025+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x7f241c031040 2024-09-13T23:07:18.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.026+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f241407b070 con 0x7f241c031040 2024-09-13T23:07:18.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.026+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x564175641980 2024-09-13T23:07:18.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.026+0000 7f241bb3c640 1 -- 172.21.15.164:0/3610319279 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f240c009050 con 0x564175641980 2024-09-13T23:07:18.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.026+0000 7f241bb3c640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x7f241c031040 2024-09-13T23:07:18.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.026+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f241407b070 con 0x7f241c031040 2024-09-13T23:07:18.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.026+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x7f240c043b70 2024-09-13T23:07:18.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.027+0000 7f2424b3e640 1 -- 172.21.15.164:0/3610319279 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f241c01f070 con 0x7f240c043b70 2024-09-13T23:07:18.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.027+0000 7f2424b3e640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x564175641980 2024-09-13T23:07:18.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.027+0000 7f241bb3c640 1 -- 172.21.15.164:0/3610319279 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f240c009050 con 0x564175641980 2024-09-13T23:07:18.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.027+0000 7f241bb3c640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x7f240c043b70 2024-09-13T23:07:18.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.027+0000 7f2424b3e640 1 -- 172.21.15.164:0/3610319279 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f241c01f070 con 0x7f240c043b70 2024-09-13T23:07:18.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.027+0000 7f2424b3e640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x56417563b840 2024-09-13T23:07:18.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.027+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f241407b070 con 0x56417563b840 2024-09-13T23:07:18.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.027+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564175644420 con 0x7f240c043b70 2024-09-13T23:07:18.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.027+0000 7f2424b3e640 1 -- 172.21.15.164:0/3610319279 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f241c040040 con 0x7f240c043b70 2024-09-13T23:07:18.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.028+0000 7f2428c13800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:07:18.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.028+0000 7f2428c13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:07:18.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.028+0000 7f2428c13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:07:18.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.028+0000 7f2428c13800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:07:18.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.028+0000 7f2428c13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:07:18.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.028+0000 7f2428c13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:07:18.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.028+0000 7f2428c13800 20 rados->read ofs=0 len=0 2024-09-13T23:07:18.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.028+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5641756403d0 con 0x56417563b840 2024-09-13T23:07:18.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.028+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f241407b070 con 0x56417563b840 2024-09-13T23:07:18.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.028+0000 7f2428c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:18.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.028+0000 7f2428c13800 20 rados->read ofs=0 len=0 2024-09-13T23:07:18.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.028+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564175640010 con 0x56417563b840 2024-09-13T23:07:18.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.028+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f241407b070 con 0x56417563b840 2024-09-13T23:07:18.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.028+0000 7f2428c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:18.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.028+0000 7f2428c13800 20 rados->read ofs=0 len=0 2024-09-13T23:07:18.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.028+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564175640020 con 0x56417563b840 2024-09-13T23:07:18.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.028+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f241407b070 con 0x56417563b840 2024-09-13T23:07:18.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.028+0000 7f2428c13800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:07:18.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.028+0000 7f2428c13800 20 zone default found 2024-09-13T23:07:18.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.028+0000 7f2428c13800 4 Realm: () 2024-09-13T23:07:18.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.028+0000 7f2428c13800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:07:18.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.028+0000 7f2428c13800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:07:18.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.028+0000 7f2428c13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:07:18.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.028+0000 7f2428c13800 20 zonegroup default 2024-09-13T23:07:18.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.028+0000 7f2428c13800 20 rados->read ofs=0 len=0 2024-09-13T23:07:18.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.028+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564175644880 con 0x7f241c031040 2024-09-13T23:07:18.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.029+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f241407b070 con 0x7f241c031040 2024-09-13T23:07:18.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.029+0000 7f2428c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:18.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.029+0000 7f2428c13800 20 rados->read ofs=0 len=0 2024-09-13T23:07:18.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.029+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564175646710 con 0x564175641980 2024-09-13T23:07:18.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.029+0000 7f241bb3c640 1 -- 172.21.15.164:0/3610319279 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f240c009050 con 0x564175641980 2024-09-13T23:07:18.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.029+0000 7f2428c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:18.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.029+0000 7f2428c13800 20 rados->read ofs=0 len=0 2024-09-13T23:07:18.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.029+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564175646ab0 con 0x564175641980 2024-09-13T23:07:18.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.029+0000 7f241bb3c640 1 -- 172.21.15.164:0/3610319279 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f240c009050 con 0x564175641980 2024-09-13T23:07:18.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.029+0000 7f2428c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:18.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.029+0000 7f2428c13800 20 started sync module instance, tier type = 2024-09-13T23:07:18.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.029+0000 7f2428c13800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:07:18.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.029+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564175645b50 con 0x7f240c043b70 2024-09-13T23:07:18.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.030+0000 7f2424b3e640 1 -- 172.21.15.164:0/3610319279 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f241c040040 con 0x7f240c043b70 2024-09-13T23:07:18.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.030+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94839142375280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564175647300 con 0x7f240c043b70 2024-09-13T23:07:18.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.030+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564175647b50 con 0x56417563b840 2024-09-13T23:07:18.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.031+0000 7f2424b3e640 1 -- 172.21.15.164:0/3610319279 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94839142375280] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f241c040040 con 0x7f240c043b70 2024-09-13T23:07:18.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.032+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f241407b070 con 0x56417563b840 2024-09-13T23:07:18.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.032+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94839142379088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641756477c0 con 0x56417563b840 2024-09-13T23:07:18.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.032+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641756482e0 con 0x564175641980 2024-09-13T23:07:18.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.033+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94839142379088] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f241407b070 con 0x56417563b840 2024-09-13T23:07:18.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.033+0000 7f241bb3c640 1 -- 172.21.15.164:0/3610319279 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f240c009050 con 0x564175641980 2024-09-13T23:07:18.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.033+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94839142383024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641756486d0 con 0x564175641980 2024-09-13T23:07:18.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.033+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641756490d0 con 0x7f240c043b70 2024-09-13T23:07:18.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.034+0000 7f241bb3c640 1 -- 172.21.15.164:0/3610319279 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94839142383024] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f240c009050 con 0x564175641980 2024-09-13T23:07:18.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.034+0000 7f2424b3e640 1 -- 172.21.15.164:0/3610319279 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f241c040040 con 0x7f240c043b70 2024-09-13T23:07:18.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.034+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94839142380144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5641756494c0 con 0x7f240c043b70 2024-09-13T23:07:18.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.034+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564175649f20 con 0x56417563b840 2024-09-13T23:07:18.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.035+0000 7f2424b3e640 1 -- 172.21.15.164:0/3610319279 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94839142380144] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f241c040040 con 0x7f240c043b70 2024-09-13T23:07:18.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.035+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f241407b070 con 0x56417563b840 2024-09-13T23:07:18.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.035+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94839142386656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564175649f20 con 0x56417563b840 2024-09-13T23:07:18.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.035+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56417564a990 con 0x7f241c031040 2024-09-13T23:07:18.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.036+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f241407b070 con 0x7f241c031040 2024-09-13T23:07:18.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.036+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94839142386656] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f241407b070 con 0x56417563b840 2024-09-13T23:07:18.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.036+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94839142392960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56417564a950 con 0x7f241c031040 2024-09-13T23:07:18.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.036+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56417564b3a0 con 0x7f241c031040 2024-09-13T23:07:18.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.037+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(56 notify.6 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f241407b070 con 0x7f241c031040 2024-09-13T23:07:18.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.037+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94839142395632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56417564b7c0 con 0x7f241c031040 2024-09-13T23:07:18.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.037+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56417564c2c0 con 0x7f241c031040 2024-09-13T23:07:18.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.038+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94839142392960] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f241407b070 con 0x7f241c031040 2024-09-13T23:07:18.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.038+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94839142395632] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f241407b070 con 0x7f241c031040 2024-09-13T23:07:18.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.038+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f241407b070 con 0x7f241c031040 2024-09-13T23:07:18.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.038+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94839142399408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56417564b350 con 0x7f241c031040 2024-09-13T23:07:18.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.038+0000 7f2428c13800 20 add_watcher() i=0 2024-09-13T23:07:18.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.038+0000 7f2428c13800 20 add_watcher() i=1 2024-09-13T23:07:18.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.038+0000 7f2428c13800 20 add_watcher() i=2 2024-09-13T23:07:18.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.038+0000 7f2428c13800 20 add_watcher() i=3 2024-09-13T23:07:18.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.038+0000 7f2428c13800 20 add_watcher() i=4 2024-09-13T23:07:18.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.038+0000 7f2428c13800 20 add_watcher() i=5 2024-09-13T23:07:18.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.038+0000 7f2428c13800 20 add_watcher() i=6 2024-09-13T23:07:18.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.039+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94839142399408] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f241407b070 con 0x7f241c031040 2024-09-13T23:07:18.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.039+0000 7f2428c13800 20 add_watcher() i=7 2024-09-13T23:07:18.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.039+0000 7f2428c13800 2 all 8 watchers are set, enabling cache 2024-09-13T23:07:18.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.039+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56417564f3c0 con 0x56417563b840 2024-09-13T23:07:18.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.040+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f241407b070 con 0x56417563b840 2024-09-13T23:07:18.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.040+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94839142390272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56417564c840 con 0x56417563b840 2024-09-13T23:07:18.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.041+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94839142390272] v34'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f241407b070 con 0x56417563b840 2024-09-13T23:07:18.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.041+0000 7f22da7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:18.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.041+0000 7f2428c13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:07:18.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.041+0000 7f2428c13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:07:18.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.041+0000 7f2428c13800 5 note: GC not initialized 2024-09-13T23:07:18.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.041+0000 7f22d97e2640 20 reqs_thread_entry: start 2024-09-13T23:07:18.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.041+0000 7f2428c13800 20 init_complete bucket index max shards: 11 2024-09-13T23:07:18.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.041+0000 7f2428c13800 20 Filter name: none 2024-09-13T23:07:18.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.042+0000 7f224affd640 20 reqs_thread_entry: start 2024-09-13T23:07:18.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.042+0000 7f2428c13800 20 rados->read ofs=0 len=0 2024-09-13T23:07:18.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.042+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5641756820d0 con 0x56417563b840 2024-09-13T23:07:18.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.042+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f241407b070 con 0x56417563b840 2024-09-13T23:07:18.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.042+0000 7f2428c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:18.056 INFO:teuthology.orchestra.run.smithi164.stderr:could not fetch user info: no user info saved 2024-09-13T23:07:18.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.043+0000 7f22da7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:18.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.043+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94839142390272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564175682090 con 0x56417563b840 2024-09-13T23:07:18.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.044+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94839142390272] v34'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f241407b070 con 0x56417563b840 2024-09-13T23:07:18.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.044+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94839142375280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56417567fea0 con 0x7f240c043b70 2024-09-13T23:07:18.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.045+0000 7f2424b3e640 1 -- 172.21.15.164:0/3610319279 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94839142375280] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f241c040040 con 0x7f240c043b70 2024-09-13T23:07:18.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.045+0000 7f2428c13800 20 remove_watcher() i=0 2024-09-13T23:07:18.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.045+0000 7f2428c13800 2 removed watcher, disabling cache 2024-09-13T23:07:18.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.045+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94839142379088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56417567fea0 con 0x56417563b840 2024-09-13T23:07:18.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.046+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94839142379088] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f241407b070 con 0x56417563b840 2024-09-13T23:07:18.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.046+0000 7f2428c13800 20 remove_watcher() i=1 2024-09-13T23:07:18.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.046+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94839142383024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56417567fea0 con 0x564175641980 2024-09-13T23:07:18.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.047+0000 7f241bb3c640 1 -- 172.21.15.164:0/3610319279 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94839142383024] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f240c009050 con 0x564175641980 2024-09-13T23:07:18.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.047+0000 7f2428c13800 20 remove_watcher() i=2 2024-09-13T23:07:18.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.047+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94839142380144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564175682090 con 0x7f240c043b70 2024-09-13T23:07:18.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.048+0000 7f2424b3e640 1 -- 172.21.15.164:0/3610319279 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94839142380144] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f241c040040 con 0x7f240c043b70 2024-09-13T23:07:18.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.048+0000 7f2428c13800 20 remove_watcher() i=3 2024-09-13T23:07:18.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.048+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94839142386656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564175682090 con 0x56417563b840 2024-09-13T23:07:18.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.049+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94839142386656] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f241407b070 con 0x56417563b840 2024-09-13T23:07:18.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.049+0000 7f2428c13800 20 remove_watcher() i=4 2024-09-13T23:07:18.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.049+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94839142392960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564175682090 con 0x7f241c031040 2024-09-13T23:07:18.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.050+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94839142392960] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f241407b070 con 0x7f241c031040 2024-09-13T23:07:18.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.050+0000 7f2428c13800 20 remove_watcher() i=5 2024-09-13T23:07:18.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.050+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94839142395632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564175682090 con 0x7f241c031040 2024-09-13T23:07:18.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.051+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94839142395632] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f241407b070 con 0x7f241c031040 2024-09-13T23:07:18.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.051+0000 7f2428c13800 20 remove_watcher() i=6 2024-09-13T23:07:18.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.051+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94839142399408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564175682090 con 0x7f241c031040 2024-09-13T23:07:18.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.052+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94839142399408] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f241407b070 con 0x7f241c031040 2024-09-13T23:07:18.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.052+0000 7f2428c13800 20 remove_watcher() i=7 2024-09-13T23:07:18.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.052+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f241c031040 msgr2=0x7f241c032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.052+0000 7f2428c13800 1 --2- 172.21.15.164:0/3610319279 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f241c031040 0x7f241c032430 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.052+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x56417563b840 msgr2=0x56417563dd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.052+0000 7f2428c13800 1 --2- 172.21.15.164:0/3610319279 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x56417563b840 0x56417563dd00 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.052+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f240c043b70 msgr2=0x7f240c043070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.052+0000 7f2428c13800 1 --2- 172.21.15.164:0/3610319279 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f240c043b70 0x7f240c043070 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.052+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x564175641980 msgr2=0x564175643d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.052+0000 7f2428c13800 1 --2- 172.21.15.164:0/3610319279 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x564175641980 0x564175643d70 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.052+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f22ec036b40 msgr2=0x7f22ec039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.052+0000 7f2428c13800 1 --2- 172.21.15.164:0/3610319279 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f22ec036b40 0x7f22ec039000 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x564175608900 tx=0x7f241c01f000 comp rx=0 tx=0).stop 2024-09-13T23:07:18.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.052+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564175628ad0 msgr2=0x56417562ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.052+0000 7f2428c13800 1 --2- 172.21.15.164:0/3610319279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564175628ad0 0x56417562ff90 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f240c04d180 tx=0x7f240c04d110 comp rx=0 tx=0).stop 2024-09-13T23:07:18.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.052+0000 7f242433d640 1 -- 172.21.15.164:0/3610319279 reap_dead start 2024-09-13T23:07:18.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.053+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 shutdown_connections 2024-09-13T23:07:18.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.053+0000 7f2428c13800 1 --2- 172.21.15.164:0/3610319279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564175628ad0 0x56417562ff90 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.053+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 >> 172.21.15.164:0/3610319279 conn(0x564175624e30 msgr2=0x564175622f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.053+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 shutdown_connections 2024-09-13T23:07:18.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.053+0000 7f2428c13800 1 -- 172.21.15.164:0/3610319279 wait complete. 2024-09-13T23:07:18.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.053+0000 7f2428c13800 1 -- 172.21.15.164:0/339070739 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f22fc036b40 msgr2=0x7f22fc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.053+0000 7f2428c13800 1 --2- 172.21.15.164:0/339070739 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f22fc036b40 0x7f22fc039000 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x56417560c520 tx=0x7f241c005840 comp rx=0 tx=0).stop 2024-09-13T23:07:18.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.053+0000 7f2428c13800 1 -- 172.21.15.164:0/339070739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56417561bdc0 msgr2=0x56417561c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.053+0000 7f2428c13800 1 --2- 172.21.15.164:0/339070739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56417561bdc0 0x56417561c1e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f240c001ed0 tx=0x7f240c00d7a0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.053+0000 7f2428c13800 1 -- 172.21.15.164:0/339070739 shutdown_connections 2024-09-13T23:07:18.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.053+0000 7f2428c13800 1 --2- 172.21.15.164:0/339070739 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f22fc036b40 0x7f22fc039000 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.053+0000 7f2428c13800 1 --2- 172.21.15.164:0/339070739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56417561bdc0 0x56417561c1e0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.053+0000 7f2428c13800 1 -- 172.21.15.164:0/339070739 >> 172.21.15.164:0/339070739 conn(0x564175610d50 msgr2=0x5641756138d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.053+0000 7f2428c13800 1 -- 172.21.15.164:0/339070739 shutdown_connections 2024-09-13T23:07:18.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.053+0000 7f2428c13800 1 -- 172.21.15.164:0/339070739 wait complete. 2024-09-13T23:07:18.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.053+0000 7f2428c13800 1 -- 172.21.15.164:0/3921239531 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564175510bd0 msgr2=0x56417560b3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.053+0000 7f2428c13800 1 --2- 172.21.15.164:0/3921239531 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564175510bd0 0x56417560b3e0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.053+0000 7f2428c13800 1 -- 172.21.15.164:0/3921239531 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f230c036b40 msgr2=0x7f230c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.053+0000 7f2428c13800 1 --2- 172.21.15.164:0/3921239531 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f230c036b40 0x7f230c039000 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f240c000f60 tx=0x7f240c0012b0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.053+0000 7f2428c13800 1 -- 172.21.15.164:0/3921239531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56417547f5f0 msgr2=0x564175604370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.053+0000 7f2428c13800 1 --2- 172.21.15.164:0/3921239531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56417547f5f0 0x564175604370 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f241400a330 tx=0x7f2414002fb0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.053+0000 7f2428c13800 1 -- 172.21.15.164:0/3921239531 shutdown_connections 2024-09-13T23:07:18.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.053+0000 7f2428c13800 1 --2- 172.21.15.164:0/3921239531 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564175510bd0 0x56417560b3e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.053+0000 7f2428c13800 1 --2- 172.21.15.164:0/3921239531 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f230c036b40 0x7f230c039000 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.053+0000 7f2428c13800 1 --2- 172.21.15.164:0/3921239531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56417547f5f0 0x564175604370 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.053+0000 7f2428c13800 1 -- 172.21.15.164:0/3921239531 >> 172.21.15.164:0/3921239531 conn(0x564175505de0 msgr2=0x5641755f6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.054+0000 7f2428c13800 1 -- 172.21.15.164:0/3921239531 shutdown_connections 2024-09-13T23:07:18.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.054+0000 7f2428c13800 1 -- 172.21.15.164:0/3921239531 wait complete. 2024-09-13T23:07:18.066 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-13T23:07:18.067 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-13T23:07:18.067 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-13T23:07:18.067 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-13T23:07:18.110 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:07:18.110 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:07:18.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.110+0000 7f14fe00e800 1 Processor -- start 2024-09-13T23:07:18.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.111+0000 7f14fe00e800 1 -- start start 2024-09-13T23:07:18.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.111+0000 7f14fe00e800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55d7b9482df0 0x55d7b94851e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.111+0000 7f14fe00e800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d7b933bb30 con 0x55d7b93efee0 2024-09-13T23:07:18.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.111+0000 7f14fe00e800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55d7b931d360 con 0x55d7b9482df0 2024-09-13T23:07:18.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.111+0000 7f14f8f74640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55d7b9482df0 0x55d7b94851e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.111+0000 7f14f9775640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55d7b93efee0 0x55d7b94816d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:60882/0 (socket says 172.21.15.164:60882) 2024-09-13T23:07:18.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.111+0000 7f14f8f74640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55d7b9482df0 0x55d7b94851e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44572/0 (socket says 172.21.15.164:44572) 2024-09-13T23:07:18.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.111+0000 7f14f9775640 1 -- 172.21.15.164:0/256274649 learned_addr learned my addr 172.21.15.164:0/256274649 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:07:18.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.111+0000 7f14f8f74640 1 -- 172.21.15.164:0/256274649 >> v1:172.21.15.17:6789/0 conn(0x55d7b93efee0 legacy=0x55d7b94816d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.111+0000 7f14f8f74640 1 -- 172.21.15.164:0/256274649 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7b9343e00 con 0x55d7b9482df0 2024-09-13T23:07:18.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.113+0000 7f14f8f74640 1 --2- 172.21.15.164:0/256274649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b9482df0 0x55d7b94851e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f14f000a470 tx=0x7f14f0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91847c7adc014d5d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.113+0000 7f14ebfff640 1 -- 172.21.15.164:0/256274649 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f0053570 con 0x55d7b9482df0 2024-09-13T23:07:18.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.113+0000 7f14ebfff640 1 -- 172.21.15.164:0/256274649 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f0058070 con 0x55d7b9482df0 2024-09-13T23:07:18.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.114+0000 7f14ebfff640 1 -- 172.21.15.164:0/256274649 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f0053880 con 0x55d7b9482df0 2024-09-13T23:07:18.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.114+0000 7f14fe00e800 1 -- 172.21.15.164:0/256274649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b9482df0 msgr2=0x55d7b94851e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.114+0000 7f14fe00e800 1 --2- 172.21.15.164:0/256274649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b9482df0 0x55d7b94851e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f14f000a470 tx=0x7f14f0045a20 comp rx=0 tx=0).stop 2024-09-13T23:07:18.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.114+0000 7f14fe00e800 1 -- 172.21.15.164:0/256274649 shutdown_connections 2024-09-13T23:07:18.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.114+0000 7f14fe00e800 1 --2- 172.21.15.164:0/256274649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b9482df0 0x55d7b94851e0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.114+0000 7f14fe00e800 1 -- 172.21.15.164:0/256274649 >> 172.21.15.164:0/256274649 conn(0x55d7b9476e80 msgr2=0x55d7b94792a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.114+0000 7f14fe00e800 1 -- 172.21.15.164:0/256274649 shutdown_connections 2024-09-13T23:07:18.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.114+0000 7f14fe00e800 1 -- 172.21.15.164:0/256274649 wait complete. 2024-09-13T23:07:18.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.129+0000 7f14fe00e800 1 Processor -- start 2024-09-13T23:07:18.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.129+0000 7f14fe00e800 1 -- start start 2024-09-13T23:07:18.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.129+0000 7f14fe00e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b93efee0 0x55d7b956db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.129+0000 7f14fe00e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d7b93c8330 con 0x55d7b93efee0 2024-09-13T23:07:18.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.129+0000 7f14f9775640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b93efee0 0x55d7b956db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.129+0000 7f14f9775640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b93efee0 0x55d7b956db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44588/0 (socket says 172.21.15.164:44588) 2024-09-13T23:07:18.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.129+0000 7f14f9775640 1 -- 172.21.15.164:0/383099975 learned_addr learned my addr 172.21.15.164:0/383099975 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.130+0000 7f14f9775640 1 -- 172.21.15.164:0/383099975 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7b9315bc0 con 0x55d7b93efee0 2024-09-13T23:07:18.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.130+0000 7f14f9775640 1 --2- 172.21.15.164:0/383099975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b93efee0 0x55d7b956db10 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f14ec001d80 tx=0x7f14ec001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a893768230643a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.130+0000 7f13e7606640 1 -- 172.21.15.164:0/383099975 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14ec013030 con 0x55d7b93efee0 2024-09-13T23:07:18.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.130+0000 7f13e7606640 1 -- 172.21.15.164:0/383099975 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14ec00e470 con 0x55d7b93efee0 2024-09-13T23:07:18.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.130+0000 7f13e7606640 1 -- 172.21.15.164:0/383099975 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14ec00e810 con 0x55d7b93efee0 2024-09-13T23:07:18.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.131+0000 7f14fe00e800 1 -- 172.21.15.164:0/383099975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b93efee0 msgr2=0x55d7b956db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.131+0000 7f14fe00e800 1 --2- 172.21.15.164:0/383099975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b93efee0 0x55d7b956db10 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f14ec001d80 tx=0x7f14ec001e70 comp rx=0 tx=0).stop 2024-09-13T23:07:18.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.131+0000 7f14fe00e800 1 -- 172.21.15.164:0/383099975 shutdown_connections 2024-09-13T23:07:18.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.131+0000 7f14fe00e800 1 --2- 172.21.15.164:0/383099975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b93efee0 0x55d7b956db10 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.131+0000 7f14fe00e800 1 -- 172.21.15.164:0/383099975 >> 172.21.15.164:0/383099975 conn(0x55d7b9476e80 msgr2=0x55d7b95694d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.131+0000 7f14fe00e800 1 -- 172.21.15.164:0/383099975 shutdown_connections 2024-09-13T23:07:18.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.131+0000 7f14fe00e800 1 -- 172.21.15.164:0/383099975 wait complete. 2024-09-13T23:07:18.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.131+0000 7f14fe00e800 1 Processor -- start 2024-09-13T23:07:18.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.131+0000 7f14fe00e800 1 -- start start 2024-09-13T23:07:18.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.132+0000 7f14fe00e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b93efee0 0x55d7b9575520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.132+0000 7f14fe00e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d7b94859f0 con 0x55d7b93efee0 2024-09-13T23:07:18.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.132+0000 7f14f9775640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b93efee0 0x55d7b9575520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.132+0000 7f14f9775640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b93efee0 0x55d7b9575520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44592/0 (socket says 172.21.15.164:44592) 2024-09-13T23:07:18.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.132+0000 7f14f9775640 1 -- 172.21.15.164:0/2764195539 learned_addr learned my addr 172.21.15.164:0/2764195539 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.132+0000 7f14f9775640 1 -- 172.21.15.164:0/2764195539 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7b9329fe0 con 0x55d7b93efee0 2024-09-13T23:07:18.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.132+0000 7f14f9775640 1 --2- 172.21.15.164:0/2764195539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b93efee0 0x55d7b9575520 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f14ec004000 tx=0x7f14ec000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.132+0000 7f13e5e03640 1 -- 172.21.15.164:0/2764195539 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14ec027070 con 0x55d7b93efee0 2024-09-13T23:07:18.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.132+0000 7f13e5e03640 1 -- 172.21.15.164:0/2764195539 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14ec001400 con 0x55d7b93efee0 2024-09-13T23:07:18.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.132+0000 7f13e5e03640 1 -- 172.21.15.164:0/2764195539 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14ec019a70 con 0x55d7b93efee0 2024-09-13T23:07:18.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.132+0000 7f14fe00e800 1 -- 172.21.15.164:0/2764195539 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7b9575a60 con 0x55d7b93efee0 2024-09-13T23:07:18.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.133+0000 7f14fe00e800 1 -- 172.21.15.164:0/2764195539 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7b9575f80 con 0x55d7b93efee0 2024-09-13T23:07:18.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.133+0000 7f14fe00e800 1 Processor -- start 2024-09-13T23:07:18.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.133+0000 7f14fe00e800 1 -- start start 2024-09-13T23:07:18.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.133+0000 7f14fe00e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b95822c0 0x55d7b95826c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.133+0000 7f14fe00e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d7b9317580 con 0x55d7b95822c0 2024-09-13T23:07:18.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.133+0000 7f13e5e03640 1 -- 172.21.15.164:0/2764195539 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f14ec02a070 con 0x55d7b93efee0 2024-09-13T23:07:18.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.133+0000 7f14f9f76640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b95822c0 0x55d7b95826c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.134+0000 7f13e5e03640 1 --2- 172.21.15.164:0/2764195539 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f13e0036b90 0x7f13e0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.134+0000 7f14f9f76640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b95822c0 0x55d7b95826c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44610/0 (socket says 172.21.15.164:44610) 2024-09-13T23:07:18.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.134+0000 7f14f9f76640 1 -- 172.21.15.164:0/3413108663 learned_addr learned my addr 172.21.15.164:0/3413108663 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.134+0000 7f13e5e03640 1 -- 172.21.15.164:0/2764195539 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f14ec01f070 con 0x55d7b93efee0 2024-09-13T23:07:18.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.134+0000 7f14f9775640 1 --2- 172.21.15.164:0/2764195539 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f13e0036b90 0x7f13e0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.134+0000 7f14f9f76640 1 -- 172.21.15.164:0/3413108663 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7b9582c00 con 0x55d7b95822c0 2024-09-13T23:07:18.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.134+0000 7f14f9f76640 1 --2- 172.21.15.164:0/3413108663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b95822c0 0x55d7b95826c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f14f400a430 tx=0x7f14f400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3147a25366c65c7c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.134+0000 7f14f9775640 1 --2- 172.21.15.164:0/2764195539 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f13e0036b90 0x7f13e0039050 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f14ec019640 tx=0x7f14ec02bf50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.134+0000 7f13df7fe640 1 -- 172.21.15.164:0/3413108663 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f4015070 con 0x55d7b95822c0 2024-09-13T23:07:18.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.135+0000 7f13df7fe640 1 -- 172.21.15.164:0/3413108663 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f4001670 con 0x55d7b95822c0 2024-09-13T23:07:18.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.135+0000 7f13df7fe640 1 -- 172.21.15.164:0/3413108663 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f4001990 con 0x55d7b95822c0 2024-09-13T23:07:18.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.135+0000 7f14fe00e800 1 -- 172.21.15.164:0/3413108663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b95822c0 msgr2=0x55d7b95826c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.135+0000 7f14fe00e800 1 --2- 172.21.15.164:0/3413108663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b95822c0 0x55d7b95826c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f14f400a430 tx=0x7f14f400a8f0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.135+0000 7f14fe00e800 1 -- 172.21.15.164:0/3413108663 shutdown_connections 2024-09-13T23:07:18.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.135+0000 7f14fe00e800 1 --2- 172.21.15.164:0/3413108663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b95822c0 0x55d7b95826c0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.135+0000 7f14fe00e800 1 -- 172.21.15.164:0/3413108663 >> 172.21.15.164:0/3413108663 conn(0x55d7b9482df0 msgr2=0x55d7b957da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.135+0000 7f14fe00e800 1 -- 172.21.15.164:0/3413108663 shutdown_connections 2024-09-13T23:07:18.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.135+0000 7f14fe00e800 1 -- 172.21.15.164:0/3413108663 wait complete. 2024-09-13T23:07:18.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.135+0000 7f14fe00e800 1 Processor -- start 2024-09-13T23:07:18.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.136+0000 7f14fe00e800 1 -- start start 2024-09-13T23:07:18.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.136+0000 7f14fe00e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b95822c0 0x55d7b9589870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.136+0000 7f14fe00e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d7b95835b0 con 0x55d7b95822c0 2024-09-13T23:07:18.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.136+0000 7f14f9f76640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b95822c0 0x55d7b9589870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.136+0000 7f14f9f76640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b95822c0 0x55d7b9589870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44616/0 (socket says 172.21.15.164:44616) 2024-09-13T23:07:18.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.136+0000 7f14f9f76640 1 -- 172.21.15.164:0/1965615730 learned_addr learned my addr 172.21.15.164:0/1965615730 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.136+0000 7f14f9f76640 1 -- 172.21.15.164:0/1965615730 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7b9589db0 con 0x55d7b95822c0 2024-09-13T23:07:18.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.137+0000 7f14f9f76640 1 --2- 172.21.15.164:0/1965615730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b95822c0 0x55d7b9589870 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f14f400a930 tx=0x7f14f4003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.137+0000 7f13ddffb640 1 -- 172.21.15.164:0/1965615730 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f4020020 con 0x55d7b95822c0 2024-09-13T23:07:18.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.137+0000 7f13ddffb640 1 -- 172.21.15.164:0/1965615730 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f40108b0 con 0x55d7b95822c0 2024-09-13T23:07:18.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.137+0000 7f14fe00e800 1 -- 172.21.15.164:0/1965615730 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7b958a040 con 0x55d7b95822c0 2024-09-13T23:07:18.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.137+0000 7f13ddffb640 1 -- 172.21.15.164:0/1965615730 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f4015040 con 0x55d7b95822c0 2024-09-13T23:07:18.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.137+0000 7f14fe00e800 1 -- 172.21.15.164:0/1965615730 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7b958a420 con 0x55d7b95822c0 2024-09-13T23:07:18.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.138+0000 7f13ddffb640 1 -- 172.21.15.164:0/1965615730 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f14f4023020 con 0x55d7b95822c0 2024-09-13T23:07:18.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.138+0000 7f13ddffb640 1 --2- 172.21.15.164:0/1965615730 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f13d4036b90 0x7f13d4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.138+0000 7f13ddffb640 1 -- 172.21.15.164:0/1965615730 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f14f404c280 con 0x55d7b95822c0 2024-09-13T23:07:18.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.138+0000 7f14f8f74640 1 --2- 172.21.15.164:0/1965615730 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f13d4036b90 0x7f13d4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.138+0000 7f14fe00e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:07:18.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.138+0000 7f14fe00e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:07:18.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.138+0000 7f14f8f74640 1 --2- 172.21.15.164:0/1965615730 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f13d4036b90 0x7f13d4039050 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f14f0057000 tx=0x7f14f0052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.138+0000 7f14fe00e800 1 Processor -- start 2024-09-13T23:07:18.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.139+0000 7f14fe00e800 1 -- start start 2024-09-13T23:07:18.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.139+0000 7f14fe00e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b95a3890 0x55d7b95a3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.139+0000 7f14fe00e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d7b956e2c0 con 0x55d7b95a3890 2024-09-13T23:07:18.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.139+0000 7f14f9775640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b95a3890 0x55d7b95a3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.139+0000 7f14f9775640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b95a3890 0x55d7b95a3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44620/0 (socket says 172.21.15.164:44620) 2024-09-13T23:07:18.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.139+0000 7f14f9775640 1 -- 172.21.15.164:0/2779908466 learned_addr learned my addr 172.21.15.164:0/2779908466 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.139+0000 7f14f9775640 1 -- 172.21.15.164:0/2779908466 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7b95a4280 con 0x55d7b95a3890 2024-09-13T23:07:18.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.139+0000 7f14f9775640 1 --2- 172.21.15.164:0/2779908466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b95a3890 0x55d7b95a3cb0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f14ec0148c0 tx=0x7f14ec04aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.140+0000 7f13bdfe3640 1 -- 172.21.15.164:0/2779908466 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14ec048070 con 0x55d7b95a3890 2024-09-13T23:07:18.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.140+0000 7f13bdfe3640 1 -- 172.21.15.164:0/2779908466 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14ec04ae50 con 0x55d7b95a3890 2024-09-13T23:07:18.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.140+0000 7f13bdfe3640 1 -- 172.21.15.164:0/2779908466 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14ec014270 con 0x55d7b95a3890 2024-09-13T23:07:18.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.140+0000 7f14fe00e800 1 -- 172.21.15.164:0/2779908466 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7b95a6ed0 con 0x55d7b95a3890 2024-09-13T23:07:18.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.140+0000 7f14fe00e800 1 -- 172.21.15.164:0/2779908466 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7b95a72b0 con 0x55d7b95a3890 2024-09-13T23:07:18.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.140+0000 7f13bdfe3640 1 -- 172.21.15.164:0/2779908466 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f14ec016070 con 0x55d7b95a3890 2024-09-13T23:07:18.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.141+0000 7f13bdfe3640 1 --2- 172.21.15.164:0/2779908466 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f133c036b40 0x7f133c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.141+0000 7f13bdfe3640 1 -- 172.21.15.164:0/2779908466 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f14ec014070 con 0x55d7b95a3890 2024-09-13T23:07:18.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.141+0000 7f14f8f74640 1 --2- 172.21.15.164:0/2779908466 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f133c036b40 0x7f133c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.141+0000 7f13377fe640 20 reqs_thread_entry: start 2024-09-13T23:07:18.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.141+0000 7f14f8f74640 1 --2- 172.21.15.164:0/2779908466 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f133c036b40 0x7f133c039000 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f14f0045f20 tx=0x7f14f0005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.141+0000 7f14fe00e800 1 --2- 172.21.15.164:0/2764195539 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d7b95b12f0 0x55d7b95b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.141+0000 7f14fe00e800 1 -- 172.21.15.164:0/2764195539 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d7b95b3d90 con 0x55d7b95b12f0 2024-09-13T23:07:18.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.141+0000 7f14f9f76640 1 --2- 172.21.15.164:0/2764195539 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d7b95b12f0 0x55d7b95b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.141+0000 7f14f9f76640 1 --2- 172.21.15.164:0/2764195539 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d7b95b12f0 0x55d7b95b36e0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.142+0000 7f14f9f76640 1 -- 172.21.15.164:0/2764195539 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f14f4010d70 con 0x55d7b95b12f0 2024-09-13T23:07:18.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.142+0000 7f14fe00e800 1 -- 172.21.15.164:0/2764195539 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d7b95b5650 con 0x55d7b95b12f0 2024-09-13T23:07:18.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.142+0000 7f14f9f76640 1 -- 172.21.15.164:0/2764195539 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f14f4010d70 con 0x55d7b95b12f0 2024-09-13T23:07:18.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.143+0000 7f14fe00e800 1 -- 172.21.15.164:0/1965615730 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f13d4036b90 msgr2=0x7f13d4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.143+0000 7f14fe00e800 1 --2- 172.21.15.164:0/1965615730 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f13d4036b90 0x7f13d4039050 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f14f0057000 tx=0x7f14f0052000 comp rx=0 tx=0).stop 2024-09-13T23:07:18.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.143+0000 7f14fe00e800 1 -- 172.21.15.164:0/1965615730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b95822c0 msgr2=0x55d7b9589870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.143+0000 7f14fe00e800 1 --2- 172.21.15.164:0/1965615730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b95822c0 0x55d7b9589870 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f14f400a930 tx=0x7f14f4003370 comp rx=0 tx=0).stop 2024-09-13T23:07:18.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.143+0000 7f14fe00e800 1 -- 172.21.15.164:0/1965615730 shutdown_connections 2024-09-13T23:07:18.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.143+0000 7f14fe00e800 1 --2- 172.21.15.164:0/1965615730 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f13d4036b90 0x7f13d4039050 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.143+0000 7f14fe00e800 1 --2- 172.21.15.164:0/1965615730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b95822c0 0x55d7b9589870 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.143+0000 7f14fe00e800 1 -- 172.21.15.164:0/1965615730 >> 172.21.15.164:0/1965615730 conn(0x55d7b9482df0 msgr2=0x55d7b957d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.143+0000 7f14fe00e800 1 -- 172.21.15.164:0/1965615730 shutdown_connections 2024-09-13T23:07:18.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.143+0000 7f14fe00e800 1 -- 172.21.15.164:0/1965615730 wait complete. 2024-09-13T23:07:18.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.143+0000 7f14fe00e800 1 -- 172.21.15.164:0/2779908466 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f133c036b40 msgr2=0x7f133c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.143+0000 7f14fe00e800 1 --2- 172.21.15.164:0/2779908466 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f133c036b40 0x7f133c039000 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f14f0045f20 tx=0x7f14f0005a00 comp rx=0 tx=0).stop 2024-09-13T23:07:18.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.143+0000 7f14fe00e800 1 -- 172.21.15.164:0/2779908466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b95a3890 msgr2=0x55d7b95a3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.143+0000 7f14fe00e800 1 --2- 172.21.15.164:0/2779908466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b95a3890 0x55d7b95a3cb0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f14ec0148c0 tx=0x7f14ec04aca0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.143+0000 7f14fe00e800 1 -- 172.21.15.164:0/2779908466 shutdown_connections 2024-09-13T23:07:18.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.143+0000 7f14fe00e800 1 --2- 172.21.15.164:0/2779908466 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f133c036b40 0x7f133c039000 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.143+0000 7f14fe00e800 1 --2- 172.21.15.164:0/2779908466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b95a3890 0x55d7b95a3cb0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.143+0000 7f14fe00e800 1 -- 172.21.15.164:0/2779908466 >> 172.21.15.164:0/2779908466 conn(0x55d7b95987c0 msgr2=0x55d7b959b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.143+0000 7f14fe00e800 1 -- 172.21.15.164:0/2779908466 shutdown_connections 2024-09-13T23:07:18.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.143+0000 7f14fe00e800 1 -- 172.21.15.164:0/2779908466 wait complete. 2024-09-13T23:07:18.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.144+0000 7f14fe00e800 1 -- 172.21.15.164:0/2764195539 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d7b95b12f0 msgr2=0x55d7b95b36e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.144+0000 7f14fe00e800 1 --2- 172.21.15.164:0/2764195539 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d7b95b12f0 0x55d7b95b36e0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.144+0000 7f14fe00e800 1 -- 172.21.15.164:0/2764195539 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f13e0036b90 msgr2=0x7f13e0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.144+0000 7f14fe00e800 1 --2- 172.21.15.164:0/2764195539 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f13e0036b90 0x7f13e0039050 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f14ec019640 tx=0x7f14ec02bf50 comp rx=0 tx=0).stop 2024-09-13T23:07:18.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.144+0000 7f14fe00e800 1 -- 172.21.15.164:0/2764195539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b93efee0 msgr2=0x55d7b9575520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.144+0000 7f14fe00e800 1 --2- 172.21.15.164:0/2764195539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b93efee0 0x55d7b9575520 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f14ec004000 tx=0x7f14ec000bc0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.144+0000 7f14fe00e800 1 -- 172.21.15.164:0/2764195539 shutdown_connections 2024-09-13T23:07:18.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.144+0000 7f14fe00e800 1 --2- 172.21.15.164:0/2764195539 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d7b95b12f0 0x55d7b95b36e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.144+0000 7f14fe00e800 1 --2- 172.21.15.164:0/2764195539 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f13e0036b90 0x7f13e0039050 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.144+0000 7f14fe00e800 1 --2- 172.21.15.164:0/2764195539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d7b93efee0 0x55d7b9575520 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.144+0000 7f14fe00e800 1 -- 172.21.15.164:0/2764195539 >> 172.21.15.164:0/2764195539 conn(0x55d7b9476e80 msgr2=0x55d7b9567d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.144+0000 7f14fe00e800 1 -- 172.21.15.164:0/2764195539 shutdown_connections 2024-09-13T23:07:18.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.144+0000 7f14fe00e800 1 -- 172.21.15.164:0/2764195539 wait complete. 2024-09-13T23:07:18.153 INFO:teuthology.orchestra.run.smithi164.stdout:{"id":"a32fa7f4-f49a-4762-82e4-81303c4fe8ba","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-13T23:07:18.154 DEBUG:tasks.util.rgw: json result: {'id': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-13T23:07:18.154 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-13T23:07:18.154 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-13T23:07:18.154 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-13T23:07:18.237 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:07:18.237 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:07:18.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.237+0000 7fb18e32a800 1 Processor -- start 2024-09-13T23:07:18.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.237+0000 7fb18e32a800 1 -- start start 2024-09-13T23:07:18.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.237+0000 7fb18e32a800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5652922e3540 0x5652922e3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.238+0000 7fb18e32a800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5652921a3b30 con 0x5652922e3e80 2024-09-13T23:07:18.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.238+0000 7fb18e32a800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x565292185360 con 0x5652922e3540 2024-09-13T23:07:18.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.238+0000 7fb18a0b7640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5652922e3540 0x5652922e3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.238+0000 7fb1898b6640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x5652922e3e80 0x5652922e8a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:60886/0 (socket says 172.21.15.164:60886) 2024-09-13T23:07:18.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.238+0000 7fb1898b6640 1 -- 172.21.15.164:0/1957687970 learned_addr learned my addr 172.21.15.164:0/1957687970 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:07:18.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.238+0000 7fb18a0b7640 1 -- 172.21.15.164:0/1957687970 >> v1:172.21.15.17:6789/0 conn(0x5652922e3e80 legacy=0x5652922e8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.238+0000 7fb18a0b7640 1 -- 172.21.15.164:0/1957687970 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652921abe00 con 0x5652922e3540 2024-09-13T23:07:18.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.240+0000 7fb18a0b7640 1 --2- 172.21.15.164:0/1957687970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652922e3540 0x5652922e3940 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fb17c00a470 tx=0x7fb17c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3579e954d7a5b26 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.240+0000 7fb1890b5640 1 -- 172.21.15.164:0/1957687970 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb17c053570 con 0x5652922e3540 2024-09-13T23:07:18.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.240+0000 7fb1890b5640 1 -- 172.21.15.164:0/1957687970 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb17c058070 con 0x5652922e3540 2024-09-13T23:07:18.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.240+0000 7fb1890b5640 1 -- 172.21.15.164:0/1957687970 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb17c053880 con 0x5652922e3540 2024-09-13T23:07:18.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.241+0000 7fb18e32a800 1 -- 172.21.15.164:0/1957687970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652922e3540 msgr2=0x5652922e3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.241+0000 7fb18e32a800 1 --2- 172.21.15.164:0/1957687970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652922e3540 0x5652922e3940 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fb17c00a470 tx=0x7fb17c045a20 comp rx=0 tx=0).stop 2024-09-13T23:07:18.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.241+0000 7fb18e32a800 1 -- 172.21.15.164:0/1957687970 shutdown_connections 2024-09-13T23:07:18.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.241+0000 7fb18e32a800 1 --2- 172.21.15.164:0/1957687970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652922e3540 0x5652922e3940 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.241+0000 7fb18e32a800 1 -- 172.21.15.164:0/1957687970 >> 172.21.15.164:0/1957687970 conn(0x5652922dedd0 msgr2=0x5652922e11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.241+0000 7fb18e32a800 1 -- 172.21.15.164:0/1957687970 shutdown_connections 2024-09-13T23:07:18.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.241+0000 7fb18e32a800 1 -- 172.21.15.164:0/1957687970 wait complete. 2024-09-13T23:07:18.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.255+0000 7fb18e32a800 1 Processor -- start 2024-09-13T23:07:18.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.255+0000 7fb18e32a800 1 -- start start 2024-09-13T23:07:18.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.255+0000 7fb18e32a800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652922e3540 0x5652923cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.255+0000 7fb18e32a800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x565292230320 con 0x5652922e3540 2024-09-13T23:07:18.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.255+0000 7fb18a0b7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652922e3540 0x5652923cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.255+0000 7fb18a0b7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652922e3540 0x5652923cf6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44648/0 (socket says 172.21.15.164:44648) 2024-09-13T23:07:18.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.255+0000 7fb18a0b7640 1 -- 172.21.15.164:0/1612150408 learned_addr learned my addr 172.21.15.164:0/1612150408 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.256+0000 7fb18a0b7640 1 -- 172.21.15.164:0/1612150408 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56529217dbc0 con 0x5652922e3540 2024-09-13T23:07:18.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.256+0000 7fb18a0b7640 1 --2- 172.21.15.164:0/1612150408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652922e3540 0x5652923cf6a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb17c025c20 tx=0x7fb17c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbb8c47dd02c648 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.256+0000 7fb078608640 1 -- 172.21.15.164:0/1612150408 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb17c053ba0 con 0x5652922e3540 2024-09-13T23:07:18.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.256+0000 7fb078608640 1 -- 172.21.15.164:0/1612150408 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb17c063030 con 0x5652922e3540 2024-09-13T23:07:18.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.256+0000 7fb078608640 1 -- 172.21.15.164:0/1612150408 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb17c053440 con 0x5652922e3540 2024-09-13T23:07:18.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.257+0000 7fb18e32a800 1 -- 172.21.15.164:0/1612150408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652922e3540 msgr2=0x5652923cf6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.257+0000 7fb18e32a800 1 --2- 172.21.15.164:0/1612150408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652922e3540 0x5652923cf6a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb17c025c20 tx=0x7fb17c051000 comp rx=0 tx=0).stop 2024-09-13T23:07:18.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.257+0000 7fb18e32a800 1 -- 172.21.15.164:0/1612150408 shutdown_connections 2024-09-13T23:07:18.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.257+0000 7fb18e32a800 1 --2- 172.21.15.164:0/1612150408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652922e3540 0x5652923cf6a0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.257+0000 7fb18e32a800 1 -- 172.21.15.164:0/1612150408 >> 172.21.15.164:0/1612150408 conn(0x5652922dedd0 msgr2=0x5652923d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.257+0000 7fb18e32a800 1 -- 172.21.15.164:0/1612150408 shutdown_connections 2024-09-13T23:07:18.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.257+0000 7fb18e32a800 1 -- 172.21.15.164:0/1612150408 wait complete. 2024-09-13T23:07:18.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.257+0000 7fb18e32a800 1 Processor -- start 2024-09-13T23:07:18.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.257+0000 7fb18e32a800 1 -- start start 2024-09-13T23:07:18.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.257+0000 7fb18e32a800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652922e3540 0x5652923dd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.257+0000 7fb18e32a800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5652922ea560 con 0x5652922e3540 2024-09-13T23:07:18.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.257+0000 7fb18a0b7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652922e3540 0x5652923dd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.257+0000 7fb18a0b7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652922e3540 0x5652923dd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44662/0 (socket says 172.21.15.164:44662) 2024-09-13T23:07:18.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.258+0000 7fb18a0b7640 1 -- 172.21.15.164:0/4144777323 learned_addr learned my addr 172.21.15.164:0/4144777323 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.258+0000 7fb18a0b7640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565292191fe0 con 0x5652922e3540 2024-09-13T23:07:18.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.258+0000 7fb18a0b7640 1 --2- 172.21.15.164:0/4144777323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652922e3540 0x5652923dd3e0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x5652923ceda0 tx=0x7fb17c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.258+0000 7fb076e05640 1 -- 172.21.15.164:0/4144777323 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb17c078070 con 0x5652922e3540 2024-09-13T23:07:18.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.258+0000 7fb076e05640 1 -- 172.21.15.164:0/4144777323 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb17c053570 con 0x5652922e3540 2024-09-13T23:07:18.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.258+0000 7fb18e32a800 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5652923dd920 con 0x5652922e3540 2024-09-13T23:07:18.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.258+0000 7fb076e05640 1 -- 172.21.15.164:0/4144777323 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb17c053850 con 0x5652922e3540 2024-09-13T23:07:18.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.258+0000 7fb18e32a800 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652923ddea0 con 0x5652922e3540 2024-09-13T23:07:18.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.259+0000 7fb18e32a800 1 Processor -- start 2024-09-13T23:07:18.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.259+0000 7fb076e05640 1 -- 172.21.15.164:0/4144777323 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb17c07b070 con 0x5652922e3540 2024-09-13T23:07:18.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.259+0000 7fb18e32a800 1 -- start start 2024-09-13T23:07:18.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.259+0000 7fb18e32a800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652923ea170 0x5652923ea570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.259+0000 7fb18e32a800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56529217f580 con 0x5652923ea170 2024-09-13T23:07:18.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.259+0000 7fb076e05640 1 --2- 172.21.15.164:0/4144777323 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb070036b90 0x7fb070039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.259+0000 7fb076e05640 1 -- 172.21.15.164:0/4144777323 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb17c070070 con 0x5652922e3540 2024-09-13T23:07:18.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.259+0000 7fb18a0b7640 1 --2- 172.21.15.164:0/4144777323 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb070036b90 0x7fb070039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.259+0000 7fb18a8b8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652923ea170 0x5652923ea570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.259+0000 7fb18a8b8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652923ea170 0x5652923ea570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44668/0 (socket says 172.21.15.164:44668) 2024-09-13T23:07:18.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.259+0000 7fb18a8b8640 1 -- 172.21.15.164:0/2583157795 learned_addr learned my addr 172.21.15.164:0/2583157795 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.260+0000 7fb18a0b7640 1 --2- 172.21.15.164:0/4144777323 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb070036b90 0x7fb070039050 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb17c000c00 tx=0x7fb17c005290 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.260+0000 7fb18a8b8640 1 -- 172.21.15.164:0/2583157795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652923eaab0 con 0x5652923ea170 2024-09-13T23:07:18.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.260+0000 7fb18a8b8640 1 --2- 172.21.15.164:0/2583157795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652923ea170 0x5652923ea570 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fb18400a430 tx=0x7fb18400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bff1abd226d11a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.260+0000 7fb074e01640 1 -- 172.21.15.164:0/2583157795 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb184015070 con 0x5652923ea170 2024-09-13T23:07:18.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.260+0000 7fb074e01640 1 -- 172.21.15.164:0/2583157795 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb184001670 con 0x5652923ea170 2024-09-13T23:07:18.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.260+0000 7fb074e01640 1 -- 172.21.15.164:0/2583157795 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb184001990 con 0x5652923ea170 2024-09-13T23:07:18.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.260+0000 7fb18e32a800 1 -- 172.21.15.164:0/2583157795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652923ea170 msgr2=0x5652923ea570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.260+0000 7fb18e32a800 1 --2- 172.21.15.164:0/2583157795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652923ea170 0x5652923ea570 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fb18400a430 tx=0x7fb18400a8f0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.260+0000 7fb18e32a800 1 -- 172.21.15.164:0/2583157795 shutdown_connections 2024-09-13T23:07:18.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.260+0000 7fb18e32a800 1 --2- 172.21.15.164:0/2583157795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652923ea170 0x5652923ea570 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.260+0000 7fb18e32a800 1 -- 172.21.15.164:0/2583157795 >> 172.21.15.164:0/2583157795 conn(0x5652922e3e80 msgr2=0x5652923e58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.260+0000 7fb18e32a800 1 -- 172.21.15.164:0/2583157795 shutdown_connections 2024-09-13T23:07:18.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.261+0000 7fb18e32a800 1 -- 172.21.15.164:0/2583157795 wait complete. 2024-09-13T23:07:18.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.261+0000 7fb18e32a800 1 Processor -- start 2024-09-13T23:07:18.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.261+0000 7fb18e32a800 1 -- start start 2024-09-13T23:07:18.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.261+0000 7fb18e32a800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652923ea170 0x5652923f1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.261+0000 7fb18e32a800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5652923eb460 con 0x5652923ea170 2024-09-13T23:07:18.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.261+0000 7fb18a8b8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652923ea170 0x5652923f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.261+0000 7fb18a8b8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652923ea170 0x5652923f1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44680/0 (socket says 172.21.15.164:44680) 2024-09-13T23:07:18.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.261+0000 7fb18a8b8640 1 -- 172.21.15.164:0/2991685426 learned_addr learned my addr 172.21.15.164:0/2991685426 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.261+0000 7fb18a8b8640 1 -- 172.21.15.164:0/2991685426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652923f1b70 con 0x5652923ea170 2024-09-13T23:07:18.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.262+0000 7fb18a8b8640 1 --2- 172.21.15.164:0/2991685426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652923ea170 0x5652923f1630 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fb184013040 tx=0x7fb184003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.262+0000 7fb06effd640 1 -- 172.21.15.164:0/2991685426 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb184020020 con 0x5652923ea170 2024-09-13T23:07:18.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.262+0000 7fb06effd640 1 -- 172.21.15.164:0/2991685426 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1840108e0 con 0x5652923ea170 2024-09-13T23:07:18.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.262+0000 7fb06effd640 1 -- 172.21.15.164:0/2991685426 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb184015040 con 0x5652923ea170 2024-09-13T23:07:18.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.262+0000 7fb18e32a800 1 -- 172.21.15.164:0/2991685426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5652923f1e00 con 0x5652923ea170 2024-09-13T23:07:18.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.262+0000 7fb18e32a800 1 -- 172.21.15.164:0/2991685426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652923f4ab0 con 0x5652923ea170 2024-09-13T23:07:18.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.263+0000 7fb06effd640 1 -- 172.21.15.164:0/2991685426 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb184023020 con 0x5652923ea170 2024-09-13T23:07:18.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.263+0000 7fb06effd640 1 --2- 172.21.15.164:0/2991685426 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb064036b40 0x7fb064039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.263+0000 7fb06effd640 1 -- 172.21.15.164:0/2991685426 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb18404c490 con 0x5652923ea170 2024-09-13T23:07:18.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.263+0000 7fb1898b6640 1 --2- 172.21.15.164:0/2991685426 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb064036b40 0x7fb064039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.263+0000 7fb18e32a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:07:18.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.263+0000 7fb18e32a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:07:18.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.264+0000 7fb1898b6640 1 --2- 172.21.15.164:0/2991685426 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb064036b40 0x7fb064039000 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb174000f60 tx=0x7fb174001230 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.264+0000 7fb18e32a800 1 Processor -- start 2024-09-13T23:07:18.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.264+0000 7fb18e32a800 1 -- start start 2024-09-13T23:07:18.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.264+0000 7fb18e32a800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56529240b630 0x56529240ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.264+0000 7fb18e32a800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5652923cdda0 con 0x56529240b630 2024-09-13T23:07:18.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.264+0000 7fb18a0b7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56529240b630 0x56529240ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.264+0000 7fb18a0b7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56529240b630 0x56529240ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44682/0 (socket says 172.21.15.164:44682) 2024-09-13T23:07:18.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.264+0000 7fb18a0b7640 1 -- 172.21.15.164:0/4047653207 learned_addr learned my addr 172.21.15.164:0/4047653207 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.264+0000 7fb18a0b7640 1 -- 172.21.15.164:0/4047653207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56529240c020 con 0x56529240b630 2024-09-13T23:07:18.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.264+0000 7fb18a0b7640 1 --2- 172.21.15.164:0/4047653207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56529240b630 0x56529240ba50 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fb17c054f70 tx=0x7fb17c07a590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.265+0000 7fb04f7e6640 1 -- 172.21.15.164:0/4047653207 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb17c05ca00 con 0x56529240b630 2024-09-13T23:07:18.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.265+0000 7fb04f7e6640 1 -- 172.21.15.164:0/4047653207 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb17c094070 con 0x56529240b630 2024-09-13T23:07:18.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.265+0000 7fb04f7e6640 1 -- 172.21.15.164:0/4047653207 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb17c009b60 con 0x56529240b630 2024-09-13T23:07:18.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.265+0000 7fb18e32a800 1 -- 172.21.15.164:0/4047653207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56529240ec70 con 0x56529240b630 2024-09-13T23:07:18.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.265+0000 7fb18e32a800 1 -- 172.21.15.164:0/4047653207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56529240f050 con 0x56529240b630 2024-09-13T23:07:18.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.265+0000 7fb04f7e6640 1 -- 172.21.15.164:0/4047653207 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb17c05c450 con 0x56529240b630 2024-09-13T23:07:18.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.266+0000 7fb04f7e6640 1 --2- 172.21.15.164:0/4047653207 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fafc8036b90 0x7fafc8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.266+0000 7fb04f7e6640 1 -- 172.21.15.164:0/4047653207 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb17c09ad90 con 0x56529240b630 2024-09-13T23:07:18.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.266+0000 7fb1898b6640 1 --2- 172.21.15.164:0/4047653207 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fafc8036b90 0x7fafc8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.266+0000 7fb04d7e2640 20 reqs_thread_entry: start 2024-09-13T23:07:18.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.266+0000 7fb18e32a800 1 --2- 172.21.15.164:0/4144777323 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x565292419030 0x56529241b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.266+0000 7fb18e32a800 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56529241ba30 con 0x565292419030 2024-09-13T23:07:18.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.266+0000 7fb1898b6640 1 --2- 172.21.15.164:0/4047653207 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fafc8036b90 0x7fafc8039050 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb174001ed0 tx=0x7fb17400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.266+0000 7fb18a8b8640 1 --2- 172.21.15.164:0/4144777323 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x565292419030 0x56529241b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.266+0000 7fb18a8b8640 1 --2- 172.21.15.164:0/4144777323 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x565292419030 0x56529241b420 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.267+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb18400e070 con 0x565292419030 2024-09-13T23:07:18.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.267+0000 7fb18e32a800 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56529241c310 con 0x565292419030 2024-09-13T23:07:18.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.267+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb18400e070 con 0x565292419030 2024-09-13T23:07:18.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.267+0000 7fb18e32a800 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56529241d6c0 con 0x565292419030 2024-09-13T23:07:18.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.267+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb18400e070 con 0x565292419030 2024-09-13T23:07:18.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.267+0000 7fb18e32a800 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56529242a550 con 0x565292419030 2024-09-13T23:07:18.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.268+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb18400e070 con 0x565292419030 2024-09-13T23:07:18.274 INFO:teuthology.orchestra.run.smithi164.stderr:NOTICE: set zone's realm_id= 2024-09-13T23:07:18.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.268+0000 7fb18e32a800 1 --2- 172.21.15.164:0/4144777323 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x56529241e150 0x565292424880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.268+0000 7fb18e32a800 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x56529241e150 2024-09-13T23:07:18.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.268+0000 7fb18a0b7640 1 --2- 172.21.15.164:0/4144777323 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x56529241e150 0x565292424880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.268+0000 7fb18a0b7640 1 --2- 172.21.15.164:0/4144777323 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x56529241e150 0x565292424880 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.268+0000 7fb18a0b7640 1 -- 172.21.15.164:0/4144777323 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(5 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17c07a030 con 0x56529241e150 2024-09-13T23:07:18.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.268+0000 7fb18a0b7640 1 --2- 172.21.15.164:0/4144777323 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fb17c07d060 0x7fb17c093180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.268+0000 7fb18a0b7640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x7fb17c07d060 2024-09-13T23:07:18.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.268+0000 7fb1898b6640 1 --2- 172.21.15.164:0/4144777323 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fb17c07d060 0x7fb17c093180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.269+0000 7fb1898b6640 1 --2- 172.21.15.164:0/4144777323 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fb17c07d060 0x7fb17c093180 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.269+0000 7fb1898b6640 1 -- 172.21.15.164:0/4144777323 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb174009050 con 0x7fb17c07d060 2024-09-13T23:07:18.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.269+0000 7fb1898b6640 1 --2- 172.21.15.164:0/4144777323 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fb17401d040 0x7fb17401c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.269+0000 7fb1898b6640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x7fb17401d040 2024-09-13T23:07:18.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.269+0000 7fb18a8b8640 1 --2- 172.21.15.164:0/4144777323 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fb17401d040 0x7fb17401c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.270+0000 7fb18a8b8640 1 --2- 172.21.15.164:0/4144777323 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fb17401d040 0x7fb17401c980 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.270+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18400e070 con 0x7fb17401d040 2024-09-13T23:07:18.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.270+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x565292419030 2024-09-13T23:07:18.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.270+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(8 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb18400e070 con 0x565292419030 2024-09-13T23:07:18.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.270+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x565292419030 2024-09-13T23:07:18.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.270+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18400e070 con 0x565292419030 2024-09-13T23:07:18.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.270+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x7fb17401d040 2024-09-13T23:07:18.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.271+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18400e070 con 0x7fb17401d040 2024-09-13T23:07:18.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.271+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x7fb17401d040 2024-09-13T23:07:18.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.271+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18400e070 con 0x7fb17401d040 2024-09-13T23:07:18.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.271+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x7fb17c07d060 2024-09-13T23:07:18.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.271+0000 7fb1898b6640 1 -- 172.21.15.164:0/4144777323 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb174009050 con 0x7fb17c07d060 2024-09-13T23:07:18.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.271+0000 7fb1898b6640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x56529241e150 2024-09-13T23:07:18.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.271+0000 7fb18a0b7640 1 -- 172.21.15.164:0/4144777323 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17c0ad040 con 0x56529241e150 2024-09-13T23:07:18.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.271+0000 7fb18a0b7640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x565292419030 2024-09-13T23:07:18.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.271+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18400e070 con 0x565292419030 2024-09-13T23:07:18.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.272+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x7fb17401d040 2024-09-13T23:07:18.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.272+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18400e070 con 0x7fb17401d040 2024-09-13T23:07:18.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.272+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x565292419030 2024-09-13T23:07:18.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.272+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18400e070 con 0x565292419030 2024-09-13T23:07:18.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.272+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x7fb17c07d060 2024-09-13T23:07:18.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.272+0000 7fb1898b6640 1 -- 172.21.15.164:0/4144777323 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(17 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb17402a040 con 0x7fb17c07d060 2024-09-13T23:07:18.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.272+0000 7fb1898b6640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x56529241e150 2024-09-13T23:07:18.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.273+0000 7fb18a0b7640 1 -- 172.21.15.164:0/4144777323 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17c0ad040 con 0x56529241e150 2024-09-13T23:07:18.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.273+0000 7fb18a0b7640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x56529241e150 2024-09-13T23:07:18.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.273+0000 7fb18a0b7640 1 -- 172.21.15.164:0/4144777323 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17c0ad040 con 0x56529241e150 2024-09-13T23:07:18.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.273+0000 7fb18a0b7640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x7fb17401d040 2024-09-13T23:07:18.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.273+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18400e070 con 0x7fb17401d040 2024-09-13T23:07:18.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.273+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x56529241e150 2024-09-13T23:07:18.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.273+0000 7fb18a0b7640 1 -- 172.21.15.164:0/4144777323 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17c0ad040 con 0x56529241e150 2024-09-13T23:07:18.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.273+0000 7fb18a0b7640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x56529241e150 2024-09-13T23:07:18.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.273+0000 7fb18a0b7640 1 -- 172.21.15.164:0/4144777323 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17c0ad040 con 0x56529241e150 2024-09-13T23:07:18.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.273+0000 7fb18a0b7640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x565292419030 2024-09-13T23:07:18.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.274+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18400e070 con 0x565292419030 2024-09-13T23:07:18.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.274+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x565292419030 2024-09-13T23:07:18.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.274+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb18400e070 con 0x565292419030 2024-09-13T23:07:18.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.274+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x7fb17401d040 2024-09-13T23:07:18.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.274+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(25 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18400e070 con 0x7fb17401d040 2024-09-13T23:07:18.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.274+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x56529241e150 2024-09-13T23:07:18.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.274+0000 7fb18a0b7640 1 -- 172.21.15.164:0/4144777323 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17c0ad040 con 0x56529241e150 2024-09-13T23:07:18.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.274+0000 7fb18a0b7640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x7fb17c07d060 2024-09-13T23:07:18.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.275+0000 7fb1898b6640 1 -- 172.21.15.164:0/4144777323 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17402a040 con 0x7fb17c07d060 2024-09-13T23:07:18.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.275+0000 7fb1898b6640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x565292419030 2024-09-13T23:07:18.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.275+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb18400e070 con 0x565292419030 2024-09-13T23:07:18.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.275+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x7fb17401d040 2024-09-13T23:07:18.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.275+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18400e070 con 0x7fb17401d040 2024-09-13T23:07:18.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.275+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x56529241e150 2024-09-13T23:07:18.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.275+0000 7fb18a0b7640 1 -- 172.21.15.164:0/4144777323 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17c0ad040 con 0x56529241e150 2024-09-13T23:07:18.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.275+0000 7fb18a0b7640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x7fb17401d040 2024-09-13T23:07:18.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.276+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb18400e070 con 0x7fb17401d040 2024-09-13T23:07:18.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.276+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x7fb17c07d060 2024-09-13T23:07:18.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.276+0000 7fb1898b6640 1 -- 172.21.15.164:0/4144777323 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17402a040 con 0x7fb17c07d060 2024-09-13T23:07:18.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.276+0000 7fb1898b6640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x56529241e150 2024-09-13T23:07:18.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.276+0000 7fb18a0b7640 1 -- 172.21.15.164:0/4144777323 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17c0ad040 con 0x56529241e150 2024-09-13T23:07:18.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.276+0000 7fb18a0b7640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x7fb17c07d060 2024-09-13T23:07:18.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.276+0000 7fb1898b6640 1 -- 172.21.15.164:0/4144777323 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17402a040 con 0x7fb17c07d060 2024-09-13T23:07:18.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.276+0000 7fb1898b6640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x565292419030 2024-09-13T23:07:18.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.277+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(35 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb18400e070 con 0x565292419030 2024-09-13T23:07:18.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.277+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565292421950 con 0x7fb17c07d060 2024-09-13T23:07:18.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.277+0000 7fb1898b6640 1 -- 172.21.15.164:0/4144777323 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(36 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17402a040 con 0x7fb17c07d060 2024-09-13T23:07:18.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.277+0000 7fb18e32a800 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565292424400 con 0x565292419030 2024-09-13T23:07:18.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.277+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb18400e070 con 0x565292419030 2024-09-13T23:07:18.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.277+0000 7fb18e32a800 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565292428460 con 0x565292419030 2024-09-13T23:07:18.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.277+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb18400e070 con 0x565292419030 2024-09-13T23:07:18.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.277+0000 7fb18e32a800 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565292423c90 con 0x565292419030 2024-09-13T23:07:18.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.279+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [create,call,writefull 0~1155] v34'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7fb18400e070 con 0x565292419030 2024-09-13T23:07:18.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.279+0000 7fb18e32a800 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565292425a30 con 0x565292419030 2024-09-13T23:07:18.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.280+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v34'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7fb18400e070 con 0x565292419030 2024-09-13T23:07:18.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.280+0000 7fb18e32a800 1 -- 172.21.15.164:0/4144777323 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565292425a30 con 0x565292419030 2024-09-13T23:07:18.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.281+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v34'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7fb18400e070 con 0x565292419030 2024-09-13T23:07:18.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.281+0000 7fb18e32a800 1 -- 172.21.15.164:0/2991685426 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb064036b40 msgr2=0x7fb064039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.281+0000 7fb18e32a800 1 --2- 172.21.15.164:0/2991685426 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb064036b40 0x7fb064039000 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb174000f60 tx=0x7fb174001230 comp rx=0 tx=0).stop 2024-09-13T23:07:18.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.281+0000 7fb18e32a800 1 -- 172.21.15.164:0/2991685426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652923ea170 msgr2=0x5652923f1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.281+0000 7fb18e32a800 1 --2- 172.21.15.164:0/2991685426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652923ea170 0x5652923f1630 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fb184013040 tx=0x7fb184003370 comp rx=0 tx=0).stop 2024-09-13T23:07:18.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.281+0000 7fb18e32a800 1 -- 172.21.15.164:0/2991685426 shutdown_connections 2024-09-13T23:07:18.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.281+0000 7fb18e32a800 1 --2- 172.21.15.164:0/2991685426 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb064036b40 0x7fb064039000 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.281+0000 7fb18e32a800 1 --2- 172.21.15.164:0/2991685426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652923ea170 0x5652923f1630 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.281+0000 7fb18e32a800 1 -- 172.21.15.164:0/2991685426 >> 172.21.15.164:0/2991685426 conn(0x5652922e3e80 msgr2=0x5652923e54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.282+0000 7fb18e32a800 1 -- 172.21.15.164:0/2991685426 shutdown_connections 2024-09-13T23:07:18.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.282+0000 7fb18e32a800 1 -- 172.21.15.164:0/2991685426 wait complete. 2024-09-13T23:07:18.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.282+0000 7fb18e32a800 1 -- 172.21.15.164:0/4047653207 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fafc8036b90 msgr2=0x7fafc8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.282+0000 7fb18e32a800 1 --2- 172.21.15.164:0/4047653207 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fafc8036b90 0x7fafc8039050 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb174001ed0 tx=0x7fb17400f000 comp rx=0 tx=0).stop 2024-09-13T23:07:18.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.282+0000 7fb18e32a800 1 -- 172.21.15.164:0/4047653207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56529240b630 msgr2=0x56529240ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.282+0000 7fb18e32a800 1 --2- 172.21.15.164:0/4047653207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56529240b630 0x56529240ba50 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fb17c054f70 tx=0x7fb17c07a590 comp rx=0 tx=0).stop 2024-09-13T23:07:18.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.282+0000 7fb18e32a800 1 -- 172.21.15.164:0/4047653207 shutdown_connections 2024-09-13T23:07:18.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.282+0000 7fb18e32a800 1 --2- 172.21.15.164:0/4047653207 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fafc8036b90 0x7fafc8039050 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.282+0000 7fb18e32a800 1 --2- 172.21.15.164:0/4047653207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56529240b630 0x56529240ba50 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.282+0000 7fb18e32a800 1 -- 172.21.15.164:0/4047653207 >> 172.21.15.164:0/4047653207 conn(0x565292400510 msgr2=0x565292402e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.282+0000 7fb18e32a800 1 -- 172.21.15.164:0/4047653207 shutdown_connections 2024-09-13T23:07:18.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.282+0000 7fb18e32a800 1 -- 172.21.15.164:0/4047653207 wait complete. 2024-09-13T23:07:18.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.282+0000 7fb18e32a800 1 -- 172.21.15.164:0/4144777323 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fb17401d040 msgr2=0x7fb17401c980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.282+0000 7fb18e32a800 1 --2- 172.21.15.164:0/4144777323 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fb17401d040 0x7fb17401c980 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.282+0000 7fb18e32a800 1 -- 172.21.15.164:0/4144777323 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x565292419030 msgr2=0x56529241b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.282+0000 7fb18e32a800 1 --2- 172.21.15.164:0/4144777323 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x565292419030 0x56529241b420 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.282+0000 7fb18e32a800 1 -- 172.21.15.164:0/4144777323 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fb17c07d060 msgr2=0x7fb17c093180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.282+0000 7fb18e32a800 1 --2- 172.21.15.164:0/4144777323 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fb17c07d060 0x7fb17c093180 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.282+0000 7fb18e32a800 1 -- 172.21.15.164:0/4144777323 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x56529241e150 msgr2=0x565292424880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.282+0000 7fb18e32a800 1 --2- 172.21.15.164:0/4144777323 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x56529241e150 0x565292424880 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.282+0000 7fb18e32a800 1 -- 172.21.15.164:0/4144777323 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb070036b90 msgr2=0x7fb070039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.282+0000 7fb18e32a800 1 --2- 172.21.15.164:0/4144777323 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb070036b90 0x7fb070039050 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb17c000c00 tx=0x7fb17c005290 comp rx=0 tx=0).stop 2024-09-13T23:07:18.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.282+0000 7fb18e32a800 1 -- 172.21.15.164:0/4144777323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652922e3540 msgr2=0x5652923dd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.282+0000 7fb18e32a800 1 --2- 172.21.15.164:0/4144777323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652922e3540 0x5652923dd3e0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x5652923ceda0 tx=0x7fb17c002fb0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.282+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 reap_dead start 2024-09-13T23:07:18.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.282+0000 7fb18a8b8640 1 -- 172.21.15.164:0/4144777323 reap_dead start 2024-09-13T23:07:18.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.282+0000 7fb18e32a800 1 -- 172.21.15.164:0/4144777323 shutdown_connections 2024-09-13T23:07:18.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.282+0000 7fb18e32a800 1 -- 172.21.15.164:0/4144777323 >> 172.21.15.164:0/4144777323 conn(0x5652922dedd0 msgr2=0x5652923cc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.283+0000 7fb18e32a800 1 -- 172.21.15.164:0/4144777323 shutdown_connections 2024-09-13T23:07:18.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.283+0000 7fb18e32a800 1 -- 172.21.15.164:0/4144777323 wait complete. 2024-09-13T23:07:18.293 INFO:teuthology.orchestra.run.smithi164.stdout:{"id":"a32fa7f4-f49a-4762-82e4-81303c4fe8ba","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-13T23:07:18.294 DEBUG:tasks.util.rgw: json result: {'id': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-13T23:07:18.294 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-13T23:07:18.294 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-13T23:07:18.294 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-13T23:07:18.377 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:07:18.377 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:07:18.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.377+0000 7fab41c87800 1 Processor -- start 2024-09-13T23:07:18.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.377+0000 7fab41c87800 1 -- start start 2024-09-13T23:07:18.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.378+0000 7fab41c87800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x56504ebf3540 0x56504ebf3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.378+0000 7fab41c87800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56504eab3b30 con 0x56504ebf3e80 2024-09-13T23:07:18.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.378+0000 7fab41c87800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x56504ea95360 con 0x56504ebf3540 2024-09-13T23:07:18.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.378+0000 7fab3f77b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x56504ebf3540 0x56504ebf3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.378+0000 7fab3f77b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x56504ebf3540 0x56504ebf3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44694/0 (socket says 172.21.15.164:44694) 2024-09-13T23:07:18.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.378+0000 7fab37fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x56504ebf3e80 0x56504ebf8a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:60900/0 (socket says 172.21.15.164:60900) 2024-09-13T23:07:18.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.378+0000 7fab3f77b640 1 -- 172.21.15.164:0/4247006061 learned_addr learned my addr 172.21.15.164:0/4247006061 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.378+0000 7fab3f77b640 1 -- 172.21.15.164:0/4247006061 >> v1:172.21.15.17:6789/0 conn(0x56504ebf3e80 legacy=0x56504ebf8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.378+0000 7fab3f77b640 1 -- 172.21.15.164:0/4247006061 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56504eabbe00 con 0x56504ebf3540 2024-09-13T23:07:18.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.380+0000 7fab3f77b640 1 --2- 172.21.15.164:0/4247006061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ebf3540 0x56504ebf3940 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fab3000a6b0 tx=0x7fab30047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33eb4163e477cb76 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.380+0000 7fab3ef7a640 1 -- 172.21.15.164:0/4247006061 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab3000a200 con 0x56504ebf3540 2024-09-13T23:07:18.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.380+0000 7fab3ef7a640 1 -- 172.21.15.164:0/4247006061 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3000a3a0 con 0x56504ebf3540 2024-09-13T23:07:18.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.380+0000 7fab3ef7a640 1 -- 172.21.15.164:0/4247006061 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab30008700 con 0x56504ebf3540 2024-09-13T23:07:18.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.381+0000 7fab41c87800 1 -- 172.21.15.164:0/4247006061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ebf3540 msgr2=0x56504ebf3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.381+0000 7fab41c87800 1 --2- 172.21.15.164:0/4247006061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ebf3540 0x56504ebf3940 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fab3000a6b0 tx=0x7fab30047e30 comp rx=0 tx=0).stop 2024-09-13T23:07:18.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.381+0000 7fab41c87800 1 -- 172.21.15.164:0/4247006061 shutdown_connections 2024-09-13T23:07:18.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.381+0000 7fab41c87800 1 --2- 172.21.15.164:0/4247006061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ebf3540 0x56504ebf3940 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.381+0000 7fab41c87800 1 -- 172.21.15.164:0/4247006061 >> 172.21.15.164:0/4247006061 conn(0x56504ebeedd0 msgr2=0x56504ebf11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.381+0000 7fab41c87800 1 -- 172.21.15.164:0/4247006061 shutdown_connections 2024-09-13T23:07:18.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.381+0000 7fab41c87800 1 -- 172.21.15.164:0/4247006061 wait complete. 2024-09-13T23:07:18.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.395+0000 7fab41c87800 1 Processor -- start 2024-09-13T23:07:18.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.395+0000 7fab41c87800 1 -- start start 2024-09-13T23:07:18.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.395+0000 7fab41c87800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ebf3540 0x56504ece5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.395+0000 7fab41c87800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56504eb40320 con 0x56504ebf3540 2024-09-13T23:07:18.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.396+0000 7fab3f77b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ebf3540 0x56504ece5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.396+0000 7fab3f77b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ebf3540 0x56504ece5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44704/0 (socket says 172.21.15.164:44704) 2024-09-13T23:07:18.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.396+0000 7fab3f77b640 1 -- 172.21.15.164:0/136886311 learned_addr learned my addr 172.21.15.164:0/136886311 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.396+0000 7fab3f77b640 1 -- 172.21.15.164:0/136886311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56504ea8dbc0 con 0x56504ebf3540 2024-09-13T23:07:18.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.396+0000 7fab3f77b640 1 --2- 172.21.15.164:0/136886311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ebf3540 0x56504ece5a30 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fab30048360 tx=0x7fab30051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3037d50c826155a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.396+0000 7faa2d60a640 1 -- 172.21.15.164:0/136886311 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab30064070 con 0x56504ebf3540 2024-09-13T23:07:18.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.396+0000 7faa2d60a640 1 -- 172.21.15.164:0/136886311 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3004f4c0 con 0x56504ebf3540 2024-09-13T23:07:18.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.396+0000 7faa2d60a640 1 -- 172.21.15.164:0/136886311 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab3000a200 con 0x56504ebf3540 2024-09-13T23:07:18.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.397+0000 7fab41c87800 1 -- 172.21.15.164:0/136886311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ebf3540 msgr2=0x56504ece5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.397+0000 7fab41c87800 1 --2- 172.21.15.164:0/136886311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ebf3540 0x56504ece5a30 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fab30048360 tx=0x7fab30051000 comp rx=0 tx=0).stop 2024-09-13T23:07:18.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.397+0000 7fab41c87800 1 -- 172.21.15.164:0/136886311 shutdown_connections 2024-09-13T23:07:18.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.397+0000 7fab41c87800 1 --2- 172.21.15.164:0/136886311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ebf3540 0x56504ece5a30 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.397+0000 7fab41c87800 1 -- 172.21.15.164:0/136886311 >> 172.21.15.164:0/136886311 conn(0x56504ebeedd0 msgr2=0x56504ecdcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.397+0000 7fab41c87800 1 -- 172.21.15.164:0/136886311 shutdown_connections 2024-09-13T23:07:18.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.397+0000 7fab41c87800 1 -- 172.21.15.164:0/136886311 wait complete. 2024-09-13T23:07:18.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.397+0000 7fab41c87800 1 Processor -- start 2024-09-13T23:07:18.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.397+0000 7fab41c87800 1 -- start start 2024-09-13T23:07:18.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.397+0000 7fab41c87800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ebf3540 0x56504eced400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.397+0000 7fab41c87800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56504ebfa500 con 0x56504ebf3540 2024-09-13T23:07:18.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.398+0000 7fab3f77b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ebf3540 0x56504eced400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.398+0000 7fab3f77b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ebf3540 0x56504eced400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44712/0 (socket says 172.21.15.164:44712) 2024-09-13T23:07:18.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.398+0000 7fab3f77b640 1 -- 172.21.15.164:0/3374107636 learned_addr learned my addr 172.21.15.164:0/3374107636 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.398+0000 7fab3f77b640 1 -- 172.21.15.164:0/3374107636 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56504eaa1fe0 con 0x56504ebf3540 2024-09-13T23:07:18.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.398+0000 7fab3f77b640 1 --2- 172.21.15.164:0/3374107636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ebf3540 0x56504eced400 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fab30000c00 tx=0x7fab30002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.398+0000 7faa2be07640 1 -- 172.21.15.164:0/3374107636 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab3006c030 con 0x56504ebf3540 2024-09-13T23:07:18.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.398+0000 7faa2be07640 1 -- 172.21.15.164:0/3374107636 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3004f930 con 0x56504ebf3540 2024-09-13T23:07:18.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.398+0000 7faa2be07640 1 -- 172.21.15.164:0/3374107636 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab30064040 con 0x56504ebf3540 2024-09-13T23:07:18.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.398+0000 7fab41c87800 1 -- 172.21.15.164:0/3374107636 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56504eced940 con 0x56504ebf3540 2024-09-13T23:07:18.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.398+0000 7fab41c87800 1 -- 172.21.15.164:0/3374107636 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56504ecede00 con 0x56504ebf3540 2024-09-13T23:07:18.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.399+0000 7fab41c87800 1 Processor -- start 2024-09-13T23:07:18.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.399+0000 7fab41c87800 1 -- start start 2024-09-13T23:07:18.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.399+0000 7fab41c87800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ecfa150 0x56504ecfa550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.399+0000 7fab41c87800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56504ea8f580 con 0x56504ecfa150 2024-09-13T23:07:18.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.399+0000 7faa2be07640 1 -- 172.21.15.164:0/3374107636 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fab3006f070 con 0x56504ebf3540 2024-09-13T23:07:18.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.399+0000 7fab3ff7c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ecfa150 0x56504ecfa550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.399+0000 7fab3ff7c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ecfa150 0x56504ecfa550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44720/0 (socket says 172.21.15.164:44720) 2024-09-13T23:07:18.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.399+0000 7fab3ff7c640 1 -- 172.21.15.164:0/185589963 learned_addr learned my addr 172.21.15.164:0/185589963 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.399+0000 7faa2be07640 1 --2- 172.21.15.164:0/3374107636 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faa24036b40 0x7faa24039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.399+0000 7faa2be07640 1 -- 172.21.15.164:0/3374107636 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fab3006d070 con 0x56504ebf3540 2024-09-13T23:07:18.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.399+0000 7fab3f77b640 1 --2- 172.21.15.164:0/3374107636 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faa24036b40 0x7faa24039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.400+0000 7fab3ff7c640 1 -- 172.21.15.164:0/185589963 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56504ecfaa90 con 0x56504ecfa150 2024-09-13T23:07:18.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.400+0000 7fab3ff7c640 1 --2- 172.21.15.164:0/185589963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ecfa150 0x56504ecfa550 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fab3800a430 tx=0x7fab3800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=184b9c63b6e2bb7b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.400+0000 7fab3f77b640 1 --2- 172.21.15.164:0/3374107636 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faa24036b40 0x7faa24039000 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fab3008d670 tx=0x7fab3004fee0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.400+0000 7faa29e03640 1 -- 172.21.15.164:0/185589963 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab38015070 con 0x56504ecfa150 2024-09-13T23:07:18.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.400+0000 7faa29e03640 1 -- 172.21.15.164:0/185589963 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab38001670 con 0x56504ecfa150 2024-09-13T23:07:18.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.400+0000 7faa29e03640 1 -- 172.21.15.164:0/185589963 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab38001990 con 0x56504ecfa150 2024-09-13T23:07:18.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.400+0000 7fab41c87800 1 -- 172.21.15.164:0/185589963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ecfa150 msgr2=0x56504ecfa550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.400+0000 7fab41c87800 1 --2- 172.21.15.164:0/185589963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ecfa150 0x56504ecfa550 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fab3800a430 tx=0x7fab3800a8f0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.400+0000 7fab41c87800 1 -- 172.21.15.164:0/185589963 shutdown_connections 2024-09-13T23:07:18.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.400+0000 7fab41c87800 1 --2- 172.21.15.164:0/185589963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ecfa150 0x56504ecfa550 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.400+0000 7fab41c87800 1 -- 172.21.15.164:0/185589963 >> 172.21.15.164:0/185589963 conn(0x56504ebf3e80 msgr2=0x56504ecf58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.400+0000 7fab41c87800 1 -- 172.21.15.164:0/185589963 shutdown_connections 2024-09-13T23:07:18.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.400+0000 7fab41c87800 1 -- 172.21.15.164:0/185589963 wait complete. 2024-09-13T23:07:18.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.401+0000 7fab41c87800 1 Processor -- start 2024-09-13T23:07:18.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.401+0000 7fab41c87800 1 -- start start 2024-09-13T23:07:18.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.401+0000 7fab41c87800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ecfa150 0x56504ed01750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.401+0000 7fab41c87800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56504ecfb440 con 0x56504ecfa150 2024-09-13T23:07:18.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.401+0000 7fab3ff7c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ecfa150 0x56504ed01750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.401+0000 7fab3ff7c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ecfa150 0x56504ed01750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44726/0 (socket says 172.21.15.164:44726) 2024-09-13T23:07:18.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.401+0000 7fab3ff7c640 1 -- 172.21.15.164:0/596074145 learned_addr learned my addr 172.21.15.164:0/596074145 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.401+0000 7fab3ff7c640 1 -- 172.21.15.164:0/596074145 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56504ed01c90 con 0x56504ecfa150 2024-09-13T23:07:18.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.402+0000 7fab3ff7c640 1 --2- 172.21.15.164:0/596074145 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ecfa150 0x56504ed01750 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fab3800a930 tx=0x7fab38003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.402+0000 7faa1bfff640 1 -- 172.21.15.164:0/596074145 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab38020020 con 0x56504ecfa150 2024-09-13T23:07:18.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.402+0000 7faa1bfff640 1 -- 172.21.15.164:0/596074145 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab380108b0 con 0x56504ecfa150 2024-09-13T23:07:18.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.402+0000 7fab41c87800 1 -- 172.21.15.164:0/596074145 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56504ed01f20 con 0x56504ecfa150 2024-09-13T23:07:18.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.402+0000 7faa1bfff640 1 -- 172.21.15.164:0/596074145 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab38015040 con 0x56504ecfa150 2024-09-13T23:07:18.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.402+0000 7fab41c87800 1 -- 172.21.15.164:0/596074145 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56504ed04bd0 con 0x56504ecfa150 2024-09-13T23:07:18.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.403+0000 7faa1bfff640 1 -- 172.21.15.164:0/596074145 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fab38023020 con 0x56504ecfa150 2024-09-13T23:07:18.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.403+0000 7faa1bfff640 1 --2- 172.21.15.164:0/596074145 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faa20036b40 0x7faa20039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.403+0000 7faa1bfff640 1 -- 172.21.15.164:0/596074145 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fab3804c340 con 0x56504ecfa150 2024-09-13T23:07:18.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.403+0000 7fab41c87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:07:18.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.403+0000 7fab41c87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:07:18.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.403+0000 7fab37fff640 1 --2- 172.21.15.164:0/596074145 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faa20036b40 0x7faa20039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.404+0000 7fab41c87800 1 Processor -- start 2024-09-13T23:07:18.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.404+0000 7fab37fff640 1 --2- 172.21.15.164:0/596074145 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faa20036b40 0x7faa20039000 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fab28000f60 tx=0x7fab280012f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.404+0000 7fab41c87800 1 -- start start 2024-09-13T23:07:18.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.404+0000 7fab41c87800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ed1b770 0x56504ed1bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.404+0000 7fab41c87800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56504ece6180 con 0x56504ed1b770 2024-09-13T23:07:18.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.404+0000 7fab3f77b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ed1b770 0x56504ed1bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.404+0000 7fab3f77b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ed1b770 0x56504ed1bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44742/0 (socket says 172.21.15.164:44742) 2024-09-13T23:07:18.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.404+0000 7fab3f77b640 1 -- 172.21.15.164:0/3975469021 learned_addr learned my addr 172.21.15.164:0/3975469021 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.404+0000 7fab3f77b640 1 -- 172.21.15.164:0/3975469021 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56504ed1c160 con 0x56504ed1b770 2024-09-13T23:07:18.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.405+0000 7fab3f77b640 1 --2- 172.21.15.164:0/3975469021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ed1b770 0x56504ed1bb90 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fab3008d5e0 tx=0x7fab30056f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.405+0000 7fa99ffff640 1 -- 172.21.15.164:0/3975469021 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab30088120 con 0x56504ed1b770 2024-09-13T23:07:18.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.405+0000 7fa99ffff640 1 -- 172.21.15.164:0/3975469021 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab30081040 con 0x56504ed1b770 2024-09-13T23:07:18.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.405+0000 7fab41c87800 1 -- 172.21.15.164:0/3975469021 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56504ed1edb0 con 0x56504ed1b770 2024-09-13T23:07:18.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.405+0000 7fa99ffff640 1 -- 172.21.15.164:0/3975469021 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab30061aa0 con 0x56504ed1b770 2024-09-13T23:07:18.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.405+0000 7fab41c87800 1 -- 172.21.15.164:0/3975469021 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56504ed1f190 con 0x56504ed1b770 2024-09-13T23:07:18.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.405+0000 7fa99ffff640 1 -- 172.21.15.164:0/3975469021 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fab30067070 con 0x56504ed1b770 2024-09-13T23:07:18.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.406+0000 7fa99ffff640 1 --2- 172.21.15.164:0/3975469021 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fa978036b40 0x7fa978039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.406+0000 7fa99ffff640 1 -- 172.21.15.164:0/3975469021 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fab30090d10 con 0x56504ed1b770 2024-09-13T23:07:18.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.406+0000 7fab37fff640 1 --2- 172.21.15.164:0/3975469021 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fa978036b40 0x7fa978039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.406+0000 7fa99dffb640 20 reqs_thread_entry: start 2024-09-13T23:07:18.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.406+0000 7fab41c87800 1 --2- 172.21.15.164:0/3374107636 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x56504ed29130 0x56504ed2b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.406+0000 7fab41c87800 1 -- 172.21.15.164:0/3374107636 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56504ed2bc40 con 0x56504ed29130 2024-09-13T23:07:18.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.406+0000 7fab3ff7c640 1 --2- 172.21.15.164:0/3374107636 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x56504ed29130 0x56504ed2b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.406+0000 7fab37fff640 1 --2- 172.21.15.164:0/3975469021 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fa978036b40 0x7fa978039000 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fab28001ed0 tx=0x7fab2800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.406+0000 7fab3ff7c640 1 --2- 172.21.15.164:0/3374107636 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x56504ed29130 0x56504ed2b5c0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.407+0000 7fab3ff7c640 1 -- 172.21.15.164:0/3374107636 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab3800e070 con 0x56504ed29130 2024-09-13T23:07:18.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.407+0000 7fab41c87800 1 -- 172.21.15.164:0/3374107636 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56504ed2c520 con 0x56504ed29130 2024-09-13T23:07:18.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.407+0000 7fab3ff7c640 1 -- 172.21.15.164:0/3374107636 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab3800e070 con 0x56504ed29130 2024-09-13T23:07:18.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.407+0000 7fab41c87800 1 -- 172.21.15.164:0/3374107636 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56504ed2d8d0 con 0x56504ed29130 2024-09-13T23:07:18.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.407+0000 7fab3ff7c640 1 -- 172.21.15.164:0/3374107636 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7fab3800e070 con 0x56504ed29130 2024-09-13T23:07:18.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.408+0000 7fab41c87800 1 -- 172.21.15.164:0/596074145 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faa20036b40 msgr2=0x7faa20039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.408+0000 7fab41c87800 1 --2- 172.21.15.164:0/596074145 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faa20036b40 0x7faa20039000 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fab28000f60 tx=0x7fab280012f0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.408+0000 7fab41c87800 1 -- 172.21.15.164:0/596074145 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ecfa150 msgr2=0x56504ed01750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.408+0000 7fab41c87800 1 --2- 172.21.15.164:0/596074145 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ecfa150 0x56504ed01750 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fab3800a930 tx=0x7fab38003370 comp rx=0 tx=0).stop 2024-09-13T23:07:18.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.408+0000 7fab41c87800 1 -- 172.21.15.164:0/596074145 shutdown_connections 2024-09-13T23:07:18.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.408+0000 7fab41c87800 1 --2- 172.21.15.164:0/596074145 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faa20036b40 0x7faa20039000 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.408+0000 7fab41c87800 1 --2- 172.21.15.164:0/596074145 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ecfa150 0x56504ed01750 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.408+0000 7fab41c87800 1 -- 172.21.15.164:0/596074145 >> 172.21.15.164:0/596074145 conn(0x56504ebf3e80 msgr2=0x56504ecf54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.408+0000 7fab41c87800 1 -- 172.21.15.164:0/596074145 shutdown_connections 2024-09-13T23:07:18.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.408+0000 7fab41c87800 1 -- 172.21.15.164:0/596074145 wait complete. 2024-09-13T23:07:18.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.408+0000 7fab41c87800 1 -- 172.21.15.164:0/3975469021 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fa978036b40 msgr2=0x7fa978039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.408+0000 7fab41c87800 1 --2- 172.21.15.164:0/3975469021 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fa978036b40 0x7fa978039000 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fab28001ed0 tx=0x7fab2800f000 comp rx=0 tx=0).stop 2024-09-13T23:07:18.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.408+0000 7fab41c87800 1 -- 172.21.15.164:0/3975469021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ed1b770 msgr2=0x56504ed1bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.408+0000 7fab41c87800 1 --2- 172.21.15.164:0/3975469021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ed1b770 0x56504ed1bb90 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fab3008d5e0 tx=0x7fab30056f90 comp rx=0 tx=0).stop 2024-09-13T23:07:18.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.409+0000 7fab41c87800 1 -- 172.21.15.164:0/3975469021 shutdown_connections 2024-09-13T23:07:18.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.409+0000 7fab41c87800 1 --2- 172.21.15.164:0/3975469021 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fa978036b40 0x7fa978039000 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.409+0000 7fab41c87800 1 --2- 172.21.15.164:0/3975469021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ed1b770 0x56504ed1bb90 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.409+0000 7fab41c87800 1 -- 172.21.15.164:0/3975469021 >> 172.21.15.164:0/3975469021 conn(0x56504ed106c0 msgr2=0x56504ed12fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.409+0000 7fab41c87800 1 -- 172.21.15.164:0/3975469021 shutdown_connections 2024-09-13T23:07:18.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.409+0000 7fab41c87800 1 -- 172.21.15.164:0/3975469021 wait complete. 2024-09-13T23:07:18.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.409+0000 7fab41c87800 1 -- 172.21.15.164:0/3374107636 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x56504ed29130 msgr2=0x56504ed2b5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.409+0000 7fab41c87800 1 --2- 172.21.15.164:0/3374107636 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x56504ed29130 0x56504ed2b5c0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.409+0000 7fab41c87800 1 -- 172.21.15.164:0/3374107636 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faa24036b40 msgr2=0x7faa24039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.409+0000 7fab41c87800 1 --2- 172.21.15.164:0/3374107636 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faa24036b40 0x7faa24039000 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fab3008d670 tx=0x7fab3004fee0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.409+0000 7fab41c87800 1 -- 172.21.15.164:0/3374107636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ebf3540 msgr2=0x56504eced400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.409+0000 7fab41c87800 1 --2- 172.21.15.164:0/3374107636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ebf3540 0x56504eced400 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fab30000c00 tx=0x7fab30002fb0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.409+0000 7fab41c87800 1 -- 172.21.15.164:0/3374107636 shutdown_connections 2024-09-13T23:07:18.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.409+0000 7fab41c87800 1 --2- 172.21.15.164:0/3374107636 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x56504ed29130 0x56504ed2b5c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.409+0000 7fab41c87800 1 --2- 172.21.15.164:0/3374107636 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faa24036b40 0x7faa24039000 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.409+0000 7fab41c87800 1 --2- 172.21.15.164:0/3374107636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56504ebf3540 0x56504eced400 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.409+0000 7fab41c87800 1 -- 172.21.15.164:0/3374107636 >> 172.21.15.164:0/3374107636 conn(0x56504ebeedd0 msgr2=0x56504ecdb850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.409+0000 7fab41c87800 1 -- 172.21.15.164:0/3374107636 shutdown_connections 2024-09-13T23:07:18.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.409+0000 7fab41c87800 1 -- 172.21.15.164:0/3374107636 wait complete. 2024-09-13T23:07:18.418 INFO:teuthology.orchestra.run.smithi164.stdout:{"id":"a32fa7f4-f49a-4762-82e4-81303c4fe8ba","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-13T23:07:18.419 DEBUG:tasks.util.rgw: json result: {'id': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-13T23:07:18.419 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T23:07:18.419 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T23:07:18.419 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-13T23:07:18.506 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:07:18.506 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:07:18.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.506+0000 7f0691c98800 1 Processor -- start 2024-09-13T23:07:18.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.506+0000 7f0691c98800 1 -- start start 2024-09-13T23:07:18.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.506+0000 7f0691c98800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55e98c6485e0 0x55e98c6489e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.506+0000 7f0691c98800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e98c508b30 con 0x55e98c648f20 2024-09-13T23:07:18.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.506+0000 7f0691c98800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55e98c4ea360 con 0x55e98c6485e0 2024-09-13T23:07:18.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.506+0000 7f068f78c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55e98c6485e0 0x55e98c6489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.506+0000 7f068f78c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55e98c6485e0 0x55e98c6489e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44762/0 (socket says 172.21.15.164:44762) 2024-09-13T23:07:18.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.506+0000 7f068f78c640 1 -- 172.21.15.164:0/600865872 learned_addr learned my addr 172.21.15.164:0/600865872 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.506+0000 7f068ef8b640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55e98c648f20 0x55e98c64daa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:60916/0 (socket says 172.21.15.164:60916) 2024-09-13T23:07:18.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.507+0000 7f068f78c640 1 -- 172.21.15.164:0/600865872 >> v1:172.21.15.17:6789/0 conn(0x55e98c648f20 legacy=0x55e98c64daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.507+0000 7f068f78c640 1 -- 172.21.15.164:0/600865872 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e98c510e00 con 0x55e98c6485e0 2024-09-13T23:07:18.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.508+0000 7f068f78c640 1 --2- 172.21.15.164:0/600865872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c6485e0 0x55e98c6489e0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f068000a520 tx=0x7f0680045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e09ae43a2f98c1f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.509+0000 7f068e78a640 1 -- 172.21.15.164:0/600865872 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0680055070 con 0x55e98c6485e0 2024-09-13T23:07:18.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.509+0000 7f068e78a640 1 -- 172.21.15.164:0/600865872 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06800515b0 con 0x55e98c6485e0 2024-09-13T23:07:18.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.509+0000 7f068e78a640 1 -- 172.21.15.164:0/600865872 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06800518d0 con 0x55e98c6485e0 2024-09-13T23:07:18.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.509+0000 7f0691c98800 1 -- 172.21.15.164:0/600865872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c6485e0 msgr2=0x55e98c6489e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.509+0000 7f0691c98800 1 --2- 172.21.15.164:0/600865872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c6485e0 0x55e98c6489e0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f068000a520 tx=0x7f0680045ba0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.509+0000 7f0691c98800 1 -- 172.21.15.164:0/600865872 shutdown_connections 2024-09-13T23:07:18.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.509+0000 7f0691c98800 1 --2- 172.21.15.164:0/600865872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c6485e0 0x55e98c6489e0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.509+0000 7f0691c98800 1 -- 172.21.15.164:0/600865872 >> 172.21.15.164:0/600865872 conn(0x55e98c643e90 msgr2=0x55e98c6462b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.509+0000 7f0691c98800 1 -- 172.21.15.164:0/600865872 shutdown_connections 2024-09-13T23:07:18.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.509+0000 7f0691c98800 1 -- 172.21.15.164:0/600865872 wait complete. 2024-09-13T23:07:18.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.523+0000 7f0691c98800 1 Processor -- start 2024-09-13T23:07:18.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.523+0000 7f0691c98800 1 -- start start 2024-09-13T23:07:18.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.523+0000 7f0691c98800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c6485e0 0x55e98c5bd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.523+0000 7f0691c98800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e98c595350 con 0x55e98c6485e0 2024-09-13T23:07:18.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.524+0000 7f068f78c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c6485e0 0x55e98c5bd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.524+0000 7f068f78c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c6485e0 0x55e98c5bd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44764/0 (socket says 172.21.15.164:44764) 2024-09-13T23:07:18.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.524+0000 7f068f78c640 1 -- 172.21.15.164:0/4264237681 learned_addr learned my addr 172.21.15.164:0/4264237681 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.524+0000 7f068f78c640 1 -- 172.21.15.164:0/4264237681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e98c4e2bc0 con 0x55e98c6485e0 2024-09-13T23:07:18.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.524+0000 7f068f78c640 1 --2- 172.21.15.164:0/4264237681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c6485e0 0x55e98c5bd6b0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f0680025da0 tx=0x7f0680051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1025346e3495c402 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.524+0000 7f057d60a640 1 -- 172.21.15.164:0/4264237681 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0680051890 con 0x55e98c6485e0 2024-09-13T23:07:18.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.524+0000 7f057d60a640 1 -- 172.21.15.164:0/4264237681 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0680051ac0 con 0x55e98c6485e0 2024-09-13T23:07:18.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.524+0000 7f057d60a640 1 -- 172.21.15.164:0/4264237681 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0680051da0 con 0x55e98c6485e0 2024-09-13T23:07:18.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.525+0000 7f0691c98800 1 -- 172.21.15.164:0/4264237681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c6485e0 msgr2=0x55e98c5bd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.525+0000 7f0691c98800 1 --2- 172.21.15.164:0/4264237681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c6485e0 0x55e98c5bd6b0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f0680025da0 tx=0x7f0680051000 comp rx=0 tx=0).stop 2024-09-13T23:07:18.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.525+0000 7f0691c98800 1 -- 172.21.15.164:0/4264237681 shutdown_connections 2024-09-13T23:07:18.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.525+0000 7f0691c98800 1 --2- 172.21.15.164:0/4264237681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c6485e0 0x55e98c5bd6b0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.525+0000 7f0691c98800 1 -- 172.21.15.164:0/4264237681 >> 172.21.15.164:0/4264237681 conn(0x55e98c643e90 msgr2=0x55e98c733230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.525+0000 7f0691c98800 1 -- 172.21.15.164:0/4264237681 shutdown_connections 2024-09-13T23:07:18.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.525+0000 7f0691c98800 1 -- 172.21.15.164:0/4264237681 wait complete. 2024-09-13T23:07:18.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.525+0000 7f0691c98800 1 Processor -- start 2024-09-13T23:07:18.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.525+0000 7f0691c98800 1 -- start start 2024-09-13T23:07:18.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.526+0000 7f0691c98800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c6485e0 0x55e98c740200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.526+0000 7f0691c98800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e98c64f600 con 0x55e98c6485e0 2024-09-13T23:07:18.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.526+0000 7f068f78c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c6485e0 0x55e98c740200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.526+0000 7f068f78c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c6485e0 0x55e98c740200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44774/0 (socket says 172.21.15.164:44774) 2024-09-13T23:07:18.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.526+0000 7f068f78c640 1 -- 172.21.15.164:0/1243326605 learned_addr learned my addr 172.21.15.164:0/1243326605 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.526+0000 7f068f78c640 1 -- 172.21.15.164:0/1243326605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e98c4f6fe0 con 0x55e98c6485e0 2024-09-13T23:07:18.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.526+0000 7f068f78c640 1 --2- 172.21.15.164:0/1243326605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c6485e0 0x55e98c740200 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0680025da0 tx=0x7f0680002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.527+0000 7f057be07640 1 -- 172.21.15.164:0/1243326605 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0680073070 con 0x55e98c6485e0 2024-09-13T23:07:18.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.527+0000 7f057be07640 1 -- 172.21.15.164:0/1243326605 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f068005a580 con 0x55e98c6485e0 2024-09-13T23:07:18.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.527+0000 7f057be07640 1 -- 172.21.15.164:0/1243326605 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f068005a860 con 0x55e98c6485e0 2024-09-13T23:07:18.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.527+0000 7f0691c98800 1 -- 172.21.15.164:0/1243326605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e98c740740 con 0x55e98c6485e0 2024-09-13T23:07:18.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.527+0000 7f0691c98800 1 -- 172.21.15.164:0/1243326605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e98c740cc0 con 0x55e98c6485e0 2024-09-13T23:07:18.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.527+0000 7f0691c98800 1 Processor -- start 2024-09-13T23:07:18.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.527+0000 7f0691c98800 1 -- start start 2024-09-13T23:07:18.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.527+0000 7f0691c98800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c739120 0x55e98c737670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.527+0000 7f0691c98800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e98c4e4580 con 0x55e98c739120 2024-09-13T23:07:18.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.528+0000 7f057be07640 1 -- 172.21.15.164:0/1243326605 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0680076070 con 0x55e98c6485e0 2024-09-13T23:07:18.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.528+0000 7f068ff8d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c739120 0x55e98c737670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.528+0000 7f057be07640 1 --2- 172.21.15.164:0/1243326605 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0574036b90 0x7f0574039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.528+0000 7f068ff8d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c739120 0x55e98c737670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44780/0 (socket says 172.21.15.164:44780) 2024-09-13T23:07:18.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.528+0000 7f068ff8d640 1 -- 172.21.15.164:0/3025006861 learned_addr learned my addr 172.21.15.164:0/3025006861 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.528+0000 7f057be07640 1 -- 172.21.15.164:0/1243326605 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0680062070 con 0x55e98c6485e0 2024-09-13T23:07:18.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.528+0000 7f068f78c640 1 --2- 172.21.15.164:0/1243326605 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0574036b90 0x7f0574039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.528+0000 7f068ff8d640 1 -- 172.21.15.164:0/3025006861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e98c737bb0 con 0x55e98c739120 2024-09-13T23:07:18.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.528+0000 7f068f78c640 1 --2- 172.21.15.164:0/1243326605 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0574036b90 0x7f0574039050 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0680051fd0 tx=0x7f068006ef10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.528+0000 7f068ff8d640 1 --2- 172.21.15.164:0/3025006861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c739120 0x55e98c737670 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f068800a430 tx=0x7f068800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a13c4d187884b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.528+0000 7f0579e03640 1 -- 172.21.15.164:0/3025006861 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0688015070 con 0x55e98c739120 2024-09-13T23:07:18.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.528+0000 7f0579e03640 1 -- 172.21.15.164:0/3025006861 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0688001670 con 0x55e98c739120 2024-09-13T23:07:18.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.529+0000 7f0579e03640 1 -- 172.21.15.164:0/3025006861 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0688001990 con 0x55e98c739120 2024-09-13T23:07:18.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.529+0000 7f0691c98800 1 -- 172.21.15.164:0/3025006861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c739120 msgr2=0x55e98c737670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.529+0000 7f0691c98800 1 --2- 172.21.15.164:0/3025006861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c739120 0x55e98c737670 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f068800a430 tx=0x7f068800a8f0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.529+0000 7f0691c98800 1 -- 172.21.15.164:0/3025006861 shutdown_connections 2024-09-13T23:07:18.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.529+0000 7f0691c98800 1 --2- 172.21.15.164:0/3025006861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c739120 0x55e98c737670 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.529+0000 7f0691c98800 1 -- 172.21.15.164:0/3025006861 >> 172.21.15.164:0/3025006861 conn(0x55e98c648f20 msgr2=0x55e98c7487d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.529+0000 7f0691c98800 1 -- 172.21.15.164:0/3025006861 shutdown_connections 2024-09-13T23:07:18.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.529+0000 7f0691c98800 1 -- 172.21.15.164:0/3025006861 wait complete. 2024-09-13T23:07:18.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.529+0000 7f0691c98800 1 Processor -- start 2024-09-13T23:07:18.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.529+0000 7f0691c98800 1 -- start start 2024-09-13T23:07:18.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.529+0000 7f0691c98800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c739120 0x55e98c756810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.529+0000 7f0691c98800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e98c737ed0 con 0x55e98c739120 2024-09-13T23:07:18.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.530+0000 7f068ff8d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c739120 0x55e98c756810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.530+0000 7f068ff8d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c739120 0x55e98c756810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44782/0 (socket says 172.21.15.164:44782) 2024-09-13T23:07:18.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.530+0000 7f068ff8d640 1 -- 172.21.15.164:0/1248278841 learned_addr learned my addr 172.21.15.164:0/1248278841 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.530+0000 7f068ff8d640 1 -- 172.21.15.164:0/1248278841 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e98c756d50 con 0x55e98c739120 2024-09-13T23:07:18.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.530+0000 7f068ff8d640 1 --2- 172.21.15.164:0/1248278841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c739120 0x55e98c756810 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f0688013040 tx=0x7f0688003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.530+0000 7f056bfff640 1 -- 172.21.15.164:0/1248278841 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0688020020 con 0x55e98c739120 2024-09-13T23:07:18.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.530+0000 7f056bfff640 1 -- 172.21.15.164:0/1248278841 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06880108e0 con 0x55e98c739120 2024-09-13T23:07:18.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.530+0000 7f0691c98800 1 -- 172.21.15.164:0/1248278841 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e98c756fe0 con 0x55e98c739120 2024-09-13T23:07:18.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.530+0000 7f056bfff640 1 -- 172.21.15.164:0/1248278841 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0688015040 con 0x55e98c739120 2024-09-13T23:07:18.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.530+0000 7f0691c98800 1 -- 172.21.15.164:0/1248278841 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e98c759c90 con 0x55e98c739120 2024-09-13T23:07:18.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.531+0000 7f056bfff640 1 -- 172.21.15.164:0/1248278841 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0688023020 con 0x55e98c739120 2024-09-13T23:07:18.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.531+0000 7f056bfff640 1 --2- 172.21.15.164:0/1248278841 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0570036b40 0x7f0570039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.531+0000 7f056bfff640 1 -- 172.21.15.164:0/1248278841 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f068804c490 con 0x55e98c739120 2024-09-13T23:07:18.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.532+0000 7f068ef8b640 1 --2- 172.21.15.164:0/1248278841 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0570036b40 0x7f0570039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.532+0000 7f0691c98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:07:18.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.532+0000 7f0691c98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:07:18.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.532+0000 7f068ef8b640 1 --2- 172.21.15.164:0/1248278841 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0570036b40 0x7f0570039000 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0684000f60 tx=0x7f06840012e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.532+0000 7f0691c98800 1 Processor -- start 2024-09-13T23:07:18.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.532+0000 7f0691c98800 1 -- start start 2024-09-13T23:07:18.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.532+0000 7f0691c98800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c770800 0x55e98c770c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.532+0000 7f0691c98800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e98c73b790 con 0x55e98c770800 2024-09-13T23:07:18.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.532+0000 7f068f78c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c770800 0x55e98c770c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.532+0000 7f068f78c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c770800 0x55e98c770c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44786/0 (socket says 172.21.15.164:44786) 2024-09-13T23:07:18.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.532+0000 7f068f78c640 1 -- 172.21.15.164:0/2715650150 learned_addr learned my addr 172.21.15.164:0/2715650150 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.533+0000 7f068f78c640 1 -- 172.21.15.164:0/2715650150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e98c7711f0 con 0x55e98c770800 2024-09-13T23:07:18.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.533+0000 7f068f78c640 1 --2- 172.21.15.164:0/2715650150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c770800 0x55e98c770c20 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f068008f150 tx=0x7f068008f0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.533+0000 7f050ffff640 1 -- 172.21.15.164:0/2715650150 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06800643b0 con 0x55e98c770800 2024-09-13T23:07:18.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.533+0000 7f050ffff640 1 -- 172.21.15.164:0/2715650150 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0680064550 con 0x55e98c770800 2024-09-13T23:07:18.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.533+0000 7f050ffff640 1 -- 172.21.15.164:0/2715650150 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0680064830 con 0x55e98c770800 2024-09-13T23:07:18.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.533+0000 7f0691c98800 1 -- 172.21.15.164:0/2715650150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e98c773e40 con 0x55e98c770800 2024-09-13T23:07:18.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.533+0000 7f0691c98800 1 -- 172.21.15.164:0/2715650150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e98c774220 con 0x55e98c770800 2024-09-13T23:07:18.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.534+0000 7f050ffff640 1 -- 172.21.15.164:0/2715650150 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f068008c030 con 0x55e98c770800 2024-09-13T23:07:18.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.534+0000 7f050ffff640 1 --2- 172.21.15.164:0/2715650150 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f04c8036b40 0x7f04c8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.534+0000 7f050ffff640 1 -- 172.21.15.164:0/2715650150 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f068009ad60 con 0x55e98c770800 2024-09-13T23:07:18.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.534+0000 7f068ef8b640 1 --2- 172.21.15.164:0/2715650150 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f04c8036b40 0x7f04c8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.534+0000 7f050dffb640 20 reqs_thread_entry: start 2024-09-13T23:07:18.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.534+0000 7f068ef8b640 1 --2- 172.21.15.164:0/2715650150 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f04c8036b40 0x7f04c8039000 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x55e98c749370 tx=0x7f068400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.534+0000 7f0691c98800 1 --2- 172.21.15.164:0/1243326605 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e98c77e260 0x55e98c780700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.534+0000 7f0691c98800 1 -- 172.21.15.164:0/1243326605 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e98c780dd0 con 0x55e98c77e260 2024-09-13T23:07:18.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.535+0000 7f068ff8d640 1 --2- 172.21.15.164:0/1243326605 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e98c77e260 0x55e98c780700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.535+0000 7f068ff8d640 1 --2- 172.21.15.164:0/1243326605 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e98c77e260 0x55e98c780700 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.535+0000 7f068ff8d640 1 -- 172.21.15.164:0/1243326605 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f068800e070 con 0x55e98c77e260 2024-09-13T23:07:18.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.535+0000 7f0691c98800 1 -- 172.21.15.164:0/1243326605 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e98c7826e0 con 0x55e98c77e260 2024-09-13T23:07:18.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.535+0000 7f068ff8d640 1 -- 172.21.15.164:0/1243326605 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f068800e070 con 0x55e98c77e260 2024-09-13T23:07:18.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.535+0000 7f0691c98800 1 -- 172.21.15.164:0/1243326605 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e98c782060 con 0x55e98c77e260 2024-09-13T23:07:18.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.537+0000 7f068ff8d640 1 -- 172.21.15.164:0/1243326605 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [stat,call,call,writefull 0~993] v34'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f068800e070 con 0x55e98c77e260 2024-09-13T23:07:18.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.537+0000 7f0691c98800 1 -- 172.21.15.164:0/1248278841 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0570036b40 msgr2=0x7f0570039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.537+0000 7f0691c98800 1 --2- 172.21.15.164:0/1248278841 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0570036b40 0x7f0570039000 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0684000f60 tx=0x7f06840012e0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.537+0000 7f0691c98800 1 -- 172.21.15.164:0/1248278841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c739120 msgr2=0x55e98c756810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.537+0000 7f0691c98800 1 --2- 172.21.15.164:0/1248278841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c739120 0x55e98c756810 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f0688013040 tx=0x7f0688003370 comp rx=0 tx=0).stop 2024-09-13T23:07:18.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.537+0000 7f0691c98800 1 -- 172.21.15.164:0/1248278841 shutdown_connections 2024-09-13T23:07:18.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.537+0000 7f0691c98800 1 --2- 172.21.15.164:0/1248278841 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0570036b40 0x7f0570039000 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.537+0000 7f0691c98800 1 --2- 172.21.15.164:0/1248278841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c739120 0x55e98c756810 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.538+0000 7f0691c98800 1 -- 172.21.15.164:0/1248278841 >> 172.21.15.164:0/1248278841 conn(0x55e98c648f20 msgr2=0x55e98c74b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.538+0000 7f0691c98800 1 -- 172.21.15.164:0/1248278841 shutdown_connections 2024-09-13T23:07:18.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.538+0000 7f0691c98800 1 -- 172.21.15.164:0/1248278841 wait complete. 2024-09-13T23:07:18.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.538+0000 7f0691c98800 1 -- 172.21.15.164:0/2715650150 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f04c8036b40 msgr2=0x7f04c8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.538+0000 7f0691c98800 1 --2- 172.21.15.164:0/2715650150 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f04c8036b40 0x7f04c8039000 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x55e98c749370 tx=0x7f068400f000 comp rx=0 tx=0).stop 2024-09-13T23:07:18.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.538+0000 7f0691c98800 1 -- 172.21.15.164:0/2715650150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c770800 msgr2=0x55e98c770c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.538+0000 7f0691c98800 1 --2- 172.21.15.164:0/2715650150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c770800 0x55e98c770c20 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f068008f150 tx=0x7f068008f0e0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.538+0000 7f0691c98800 1 -- 172.21.15.164:0/2715650150 shutdown_connections 2024-09-13T23:07:18.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.538+0000 7f0691c98800 1 --2- 172.21.15.164:0/2715650150 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f04c8036b40 0x7f04c8039000 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.538+0000 7f0691c98800 1 --2- 172.21.15.164:0/2715650150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c770800 0x55e98c770c20 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.538+0000 7f0691c98800 1 -- 172.21.15.164:0/2715650150 >> 172.21.15.164:0/2715650150 conn(0x55e98c765730 msgr2=0x55e98c768020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.538+0000 7f0691c98800 1 -- 172.21.15.164:0/2715650150 shutdown_connections 2024-09-13T23:07:18.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.538+0000 7f0691c98800 1 -- 172.21.15.164:0/2715650150 wait complete. 2024-09-13T23:07:18.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.538+0000 7f0691c98800 1 -- 172.21.15.164:0/1243326605 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e98c77e260 msgr2=0x55e98c780700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.538+0000 7f0691c98800 1 --2- 172.21.15.164:0/1243326605 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e98c77e260 0x55e98c780700 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.538+0000 7f0691c98800 1 -- 172.21.15.164:0/1243326605 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0574036b90 msgr2=0x7f0574039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.538+0000 7f0691c98800 1 --2- 172.21.15.164:0/1243326605 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0574036b90 0x7f0574039050 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0680051fd0 tx=0x7f068006ef10 comp rx=0 tx=0).stop 2024-09-13T23:07:18.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.538+0000 7f0691c98800 1 -- 172.21.15.164:0/1243326605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c6485e0 msgr2=0x55e98c740200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.538+0000 7f0691c98800 1 --2- 172.21.15.164:0/1243326605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c6485e0 0x55e98c740200 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0680025da0 tx=0x7f0680002fb0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.538+0000 7f0691c98800 1 -- 172.21.15.164:0/1243326605 shutdown_connections 2024-09-13T23:07:18.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.538+0000 7f0691c98800 1 --2- 172.21.15.164:0/1243326605 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e98c77e260 0x55e98c780700 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.538+0000 7f0691c98800 1 --2- 172.21.15.164:0/1243326605 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0574036b90 0x7f0574039050 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.538+0000 7f0691c98800 1 --2- 172.21.15.164:0/1243326605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e98c6485e0 0x55e98c740200 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.538+0000 7f0691c98800 1 -- 172.21.15.164:0/1243326605 >> 172.21.15.164:0/1243326605 conn(0x55e98c643e90 msgr2=0x55e98c731ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.539+0000 7f0691c98800 1 -- 172.21.15.164:0/1243326605 shutdown_connections 2024-09-13T23:07:18.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.539+0000 7f0691c98800 1 -- 172.21.15.164:0/1243326605 wait complete. 2024-09-13T23:07:18.549 INFO:teuthology.orchestra.run.smithi164.stdout:{"id":"a32fa7f4-f49a-4762-82e4-81303c4fe8ba","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-13T23:07:18.549 DEBUG:tasks.util.rgw: json result: {'id': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-13T23:07:18.549 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-13T23:07:18.549 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-13T23:07:18.550 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-13T23:07:18.592 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:07:18.593 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:07:18.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.593+0000 7ffbcc40e800 1 Processor -- start 2024-09-13T23:07:18.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.593+0000 7ffbcc40e800 1 -- start start 2024-09-13T23:07:18.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.593+0000 7ffbcc40e800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55dccb362600 0x55dccb3f1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.593+0000 7ffbcc40e800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dccb2adb30 con 0x55dccb3f17a0 2024-09-13T23:07:18.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.593+0000 7ffbcc40e800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55dccb28f360 con 0x55dccb362600 2024-09-13T23:07:18.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.593+0000 7ffbc7c3b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55dccb362600 0x55dccb3f1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.593+0000 7ffbc743a640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55dccb3f17a0 0x55dccb3f3b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:60922/0 (socket says 172.21.15.164:60922) 2024-09-13T23:07:18.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.593+0000 7ffbc7c3b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55dccb362600 0x55dccb3f1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44796/0 (socket says 172.21.15.164:44796) 2024-09-13T23:07:18.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.593+0000 7ffbc743a640 1 -- 172.21.15.164:0/3420923471 learned_addr learned my addr 172.21.15.164:0/3420923471 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:07:18.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.593+0000 7ffbc7c3b640 1 -- 172.21.15.164:0/3420923471 >> v1:172.21.15.17:6789/0 conn(0x55dccb3f17a0 legacy=0x55dccb3f3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.593+0000 7ffbc7c3b640 1 -- 172.21.15.164:0/3420923471 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dccb2b5e00 con 0x55dccb362600 2024-09-13T23:07:18.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.595+0000 7ffbc7c3b640 1 --2- 172.21.15.164:0/3420923471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb362600 0x55dccb3f1260 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0005fd0 tx=0x7ffbc0045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a1891351d9a77 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.595+0000 7ffbc6c39640 1 -- 172.21.15.164:0/3420923471 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbc0058530 con 0x55dccb362600 2024-09-13T23:07:18.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.595+0000 7ffbc6c39640 1 -- 172.21.15.164:0/3420923471 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbc00586d0 con 0x55dccb362600 2024-09-13T23:07:18.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.595+0000 7ffbc6c39640 1 -- 172.21.15.164:0/3420923471 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbc00589d0 con 0x55dccb362600 2024-09-13T23:07:18.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.596+0000 7ffbcc40e800 1 -- 172.21.15.164:0/3420923471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb362600 msgr2=0x55dccb3f1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.596+0000 7ffbcc40e800 1 --2- 172.21.15.164:0/3420923471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb362600 0x55dccb3f1260 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0005fd0 tx=0x7ffbc0045c30 comp rx=0 tx=0).stop 2024-09-13T23:07:18.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.596+0000 7ffbcc40e800 1 -- 172.21.15.164:0/3420923471 shutdown_connections 2024-09-13T23:07:18.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.596+0000 7ffbcc40e800 1 --2- 172.21.15.164:0/3420923471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb362600 0x55dccb3f1260 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.596+0000 7ffbcc40e800 1 -- 172.21.15.164:0/3420923471 >> 172.21.15.164:0/3420923471 conn(0x55dccb3e8dd0 msgr2=0x55dccb3eb1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.596+0000 7ffbcc40e800 1 -- 172.21.15.164:0/3420923471 shutdown_connections 2024-09-13T23:07:18.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.596+0000 7ffbcc40e800 1 -- 172.21.15.164:0/3420923471 wait complete. 2024-09-13T23:07:18.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.610+0000 7ffbcc40e800 1 Processor -- start 2024-09-13T23:07:18.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.610+0000 7ffbcc40e800 1 -- start start 2024-09-13T23:07:18.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.610+0000 7ffbcc40e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb362600 0x55dccb4dd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.610+0000 7ffbcc40e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55dccb33a320 con 0x55dccb362600 2024-09-13T23:07:18.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.611+0000 7ffbc7c3b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb362600 0x55dccb4dd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.611+0000 7ffbc7c3b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb362600 0x55dccb4dd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44804/0 (socket says 172.21.15.164:44804) 2024-09-13T23:07:18.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.611+0000 7ffbc7c3b640 1 -- 172.21.15.164:0/2524209355 learned_addr learned my addr 172.21.15.164:0/2524209355 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.611+0000 7ffbc7c3b640 1 -- 172.21.15.164:0/2524209355 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dccb287bc0 con 0x55dccb362600 2024-09-13T23:07:18.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.611+0000 7ffbc7c3b640 1 --2- 172.21.15.164:0/2524209355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb362600 0x55dccb4dd8c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7ffbc000a3f0 tx=0x7ffbc0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5049ca6b77eade87 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.611+0000 7ffab5e0b640 1 -- 172.21.15.164:0/2524209355 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbc00589b0 con 0x55dccb362600 2024-09-13T23:07:18.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.611+0000 7ffab5e0b640 1 -- 172.21.15.164:0/2524209355 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbc0068070 con 0x55dccb362600 2024-09-13T23:07:18.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.611+0000 7ffab5e0b640 1 -- 172.21.15.164:0/2524209355 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbc0058c80 con 0x55dccb362600 2024-09-13T23:07:18.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.612+0000 7ffbcc40e800 1 -- 172.21.15.164:0/2524209355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb362600 msgr2=0x55dccb4dd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.612+0000 7ffbcc40e800 1 --2- 172.21.15.164:0/2524209355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb362600 0x55dccb4dd8c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7ffbc000a3f0 tx=0x7ffbc0051000 comp rx=0 tx=0).stop 2024-09-13T23:07:18.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.612+0000 7ffbcc40e800 1 -- 172.21.15.164:0/2524209355 shutdown_connections 2024-09-13T23:07:18.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.612+0000 7ffbcc40e800 1 --2- 172.21.15.164:0/2524209355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb362600 0x55dccb4dd8c0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.612+0000 7ffbcc40e800 1 -- 172.21.15.164:0/2524209355 >> 172.21.15.164:0/2524209355 conn(0x55dccb3e8dd0 msgr2=0x55dccb4d9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.612+0000 7ffbcc40e800 1 -- 172.21.15.164:0/2524209355 shutdown_connections 2024-09-13T23:07:18.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.612+0000 7ffbcc40e800 1 -- 172.21.15.164:0/2524209355 wait complete. 2024-09-13T23:07:18.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.612+0000 7ffbcc40e800 1 Processor -- start 2024-09-13T23:07:18.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.613+0000 7ffbcc40e800 1 -- start start 2024-09-13T23:07:18.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.613+0000 7ffbcc40e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb362600 0x55dccb4e5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.613+0000 7ffbcc40e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55dccb3f5670 con 0x55dccb362600 2024-09-13T23:07:18.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.613+0000 7ffbc7c3b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb362600 0x55dccb4e5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.613+0000 7ffbc7c3b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb362600 0x55dccb4e5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44808/0 (socket says 172.21.15.164:44808) 2024-09-13T23:07:18.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.613+0000 7ffbc7c3b640 1 -- 172.21.15.164:0/894295494 learned_addr learned my addr 172.21.15.164:0/894295494 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.613+0000 7ffbc7c3b640 1 -- 172.21.15.164:0/894295494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dccb29bfe0 con 0x55dccb362600 2024-09-13T23:07:18.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.613+0000 7ffbc7c3b640 1 --2- 172.21.15.164:0/894295494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb362600 0x55dccb4e5120 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0065040 tx=0x7ffbc0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.614+0000 7ffaaffff640 1 -- 172.21.15.164:0/894295494 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbc0063570 con 0x55dccb362600 2024-09-13T23:07:18.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.614+0000 7ffaaffff640 1 -- 172.21.15.164:0/894295494 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbc0063710 con 0x55dccb362600 2024-09-13T23:07:18.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.614+0000 7ffaaffff640 1 -- 172.21.15.164:0/894295494 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbc0063a10 con 0x55dccb362600 2024-09-13T23:07:18.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.614+0000 7ffbcc40e800 1 -- 172.21.15.164:0/894295494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dccb4e5660 con 0x55dccb362600 2024-09-13T23:07:18.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.614+0000 7ffbcc40e800 1 -- 172.21.15.164:0/894295494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dccb4e5b80 con 0x55dccb362600 2024-09-13T23:07:18.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.614+0000 7ffbcc40e800 1 Processor -- start 2024-09-13T23:07:18.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.614+0000 7ffbcc40e800 1 -- start start 2024-09-13T23:07:18.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.614+0000 7ffaaffff640 1 -- 172.21.15.164:0/894295494 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffbc0075020 con 0x55dccb362600 2024-09-13T23:07:18.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.615+0000 7ffbcc40e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb3eece0 0x55dccb3ed230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.615+0000 7ffbcc40e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55dccb289580 con 0x55dccb3eece0 2024-09-13T23:07:18.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.615+0000 7ffaaffff640 1 --2- 172.21.15.164:0/894295494 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffab0036b40 0x7ffab0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.615+0000 7ffbc843c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb3eece0 0x55dccb3ed230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.615+0000 7ffbc843c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb3eece0 0x55dccb3ed230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44812/0 (socket says 172.21.15.164:44812) 2024-09-13T23:07:18.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.615+0000 7ffbc843c640 1 -- 172.21.15.164:0/650605719 learned_addr learned my addr 172.21.15.164:0/650605719 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.615+0000 7ffaaffff640 1 -- 172.21.15.164:0/894295494 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ffbc0090d90 con 0x55dccb362600 2024-09-13T23:07:18.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.615+0000 7ffbc7c3b640 1 --2- 172.21.15.164:0/894295494 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffab0036b40 0x7ffab0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.615+0000 7ffbc843c640 1 -- 172.21.15.164:0/650605719 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dccb3ed770 con 0x55dccb3eece0 2024-09-13T23:07:18.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.615+0000 7ffbc7c3b640 1 --2- 172.21.15.164:0/894295494 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffab0036b40 0x7ffab0039000 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0045c50 tx=0x7ffbc0080f40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.615+0000 7ffbc843c640 1 --2- 172.21.15.164:0/650605719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb3eece0 0x55dccb3ed230 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800a400 tx=0x7ffbb800a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc2ce839ffdadb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.615+0000 7ffaadffb640 1 -- 172.21.15.164:0/650605719 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbb80087e0 con 0x55dccb3eece0 2024-09-13T23:07:18.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.615+0000 7ffaadffb640 1 -- 172.21.15.164:0/650605719 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb80089a0 con 0x55dccb3eece0 2024-09-13T23:07:18.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.615+0000 7ffaadffb640 1 -- 172.21.15.164:0/650605719 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbb8008d00 con 0x55dccb3eece0 2024-09-13T23:07:18.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.616+0000 7ffbcc40e800 1 -- 172.21.15.164:0/650605719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb3eece0 msgr2=0x55dccb3ed230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.616+0000 7ffbcc40e800 1 --2- 172.21.15.164:0/650605719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb3eece0 0x55dccb3ed230 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800a400 tx=0x7ffbb800a8c0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.616+0000 7ffbcc40e800 1 -- 172.21.15.164:0/650605719 shutdown_connections 2024-09-13T23:07:18.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.616+0000 7ffbcc40e800 1 --2- 172.21.15.164:0/650605719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb3eece0 0x55dccb3ed230 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.616+0000 7ffbcc40e800 1 -- 172.21.15.164:0/650605719 >> 172.21.15.164:0/650605719 conn(0x55dccb3f17a0 msgr2=0x55dccb4ed640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.616+0000 7ffbcc40e800 1 -- 172.21.15.164:0/650605719 shutdown_connections 2024-09-13T23:07:18.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.616+0000 7ffbcc40e800 1 -- 172.21.15.164:0/650605719 wait complete. 2024-09-13T23:07:18.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.616+0000 7ffbcc40e800 1 Processor -- start 2024-09-13T23:07:18.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.616+0000 7ffbcc40e800 1 -- start start 2024-09-13T23:07:18.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.616+0000 7ffbcc40e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb3eece0 0x55dccb4fb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.616+0000 7ffbcc40e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55dccb3eda30 con 0x55dccb3eece0 2024-09-13T23:07:18.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.617+0000 7ffbc843c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb3eece0 0x55dccb4fb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.617+0000 7ffbc843c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb3eece0 0x55dccb4fb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44824/0 (socket says 172.21.15.164:44824) 2024-09-13T23:07:18.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.617+0000 7ffbc843c640 1 -- 172.21.15.164:0/2207597073 learned_addr learned my addr 172.21.15.164:0/2207597073 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.617+0000 7ffbc843c640 1 -- 172.21.15.164:0/2207597073 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dccb4fbb60 con 0x55dccb3eece0 2024-09-13T23:07:18.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.617+0000 7ffbc843c640 1 --2- 172.21.15.164:0/2207597073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb3eece0 0x55dccb4fb620 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800c010 tx=0x7ffbb8002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.617+0000 7ffaa7fff640 1 -- 172.21.15.164:0/2207597073 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbb8022020 con 0x55dccb3eece0 2024-09-13T23:07:18.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.617+0000 7ffaa7fff640 1 -- 172.21.15.164:0/2207597073 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb8019040 con 0x55dccb3eece0 2024-09-13T23:07:18.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.617+0000 7ffbcc40e800 1 -- 172.21.15.164:0/2207597073 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dccb4fbdf0 con 0x55dccb3eece0 2024-09-13T23:07:18.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.617+0000 7ffaa7fff640 1 -- 172.21.15.164:0/2207597073 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbb8013a70 con 0x55dccb3eece0 2024-09-13T23:07:18.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.617+0000 7ffbcc40e800 1 -- 172.21.15.164:0/2207597073 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dccb4feaa0 con 0x55dccb3eece0 2024-09-13T23:07:18.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.618+0000 7ffaa7fff640 1 -- 172.21.15.164:0/2207597073 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffbb8025020 con 0x55dccb3eece0 2024-09-13T23:07:18.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.618+0000 7ffaa7fff640 1 --2- 172.21.15.164:0/2207597073 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffaa0036b40 0x7ffaa0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.618+0000 7ffaa7fff640 1 -- 172.21.15.164:0/2207597073 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ffbb804c810 con 0x55dccb3eece0 2024-09-13T23:07:18.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.618+0000 7ffbc743a640 1 --2- 172.21.15.164:0/2207597073 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffaa0036b40 0x7ffaa0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.618+0000 7ffbcc40e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:07:18.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.618+0000 7ffbcc40e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:07:18.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.619+0000 7ffbcc40e800 1 Processor -- start 2024-09-13T23:07:18.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.619+0000 7ffbcc40e800 1 -- start start 2024-09-13T23:07:18.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.619+0000 7ffbc743a640 1 --2- 172.21.15.164:0/2207597073 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffaa0036b40 0x7ffaa0039000 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0000f60 tx=0x7ffbb0001230 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.619+0000 7ffbcc40e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb515540 0x55dccb515960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.619+0000 7ffbcc40e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55dccb4ddfb0 con 0x55dccb515540 2024-09-13T23:07:18.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.619+0000 7ffbc7c3b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb515540 0x55dccb515960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.619+0000 7ffbc7c3b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb515540 0x55dccb515960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44830/0 (socket says 172.21.15.164:44830) 2024-09-13T23:07:18.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.619+0000 7ffbc7c3b640 1 -- 172.21.15.164:0/139423379 learned_addr learned my addr 172.21.15.164:0/139423379 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.620+0000 7ffbc7c3b640 1 -- 172.21.15.164:0/139423379 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dccb515f30 con 0x55dccb515540 2024-09-13T23:07:18.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.620+0000 7ffbc7c3b640 1 --2- 172.21.15.164:0/139423379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb515540 0x55dccb515960 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7ffbc000a3f0 tx=0x7ffbc006bd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.620+0000 7ffa4ffff640 1 -- 172.21.15.164:0/139423379 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbc009f070 con 0x55dccb515540 2024-09-13T23:07:18.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.620+0000 7ffa4ffff640 1 -- 172.21.15.164:0/139423379 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbc004fa90 con 0x55dccb515540 2024-09-13T23:07:18.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.620+0000 7ffbcc40e800 1 -- 172.21.15.164:0/139423379 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dccb518b80 con 0x55dccb515540 2024-09-13T23:07:18.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.620+0000 7ffa4ffff640 1 -- 172.21.15.164:0/139423379 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbc006b840 con 0x55dccb515540 2024-09-13T23:07:18.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.620+0000 7ffbcc40e800 1 -- 172.21.15.164:0/139423379 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dccb518f60 con 0x55dccb515540 2024-09-13T23:07:18.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.621+0000 7ffa4ffff640 1 -- 172.21.15.164:0/139423379 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffbc00a2070 con 0x55dccb515540 2024-09-13T23:07:18.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.621+0000 7ffa4ffff640 1 --2- 172.21.15.164:0/139423379 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffa00036b90 0x7ffa00039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.621+0000 7ffa4ffff640 1 -- 172.21.15.164:0/139423379 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ffbc00a5d60 con 0x55dccb515540 2024-09-13T23:07:18.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.621+0000 7ffbc743a640 1 --2- 172.21.15.164:0/139423379 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffa00036b90 0x7ffa00039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.621+0000 7ffa4dffb640 20 reqs_thread_entry: start 2024-09-13T23:07:18.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.621+0000 7ffbc743a640 1 --2- 172.21.15.164:0/139423379 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffa00036b90 0x7ffa00039050 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0001ed0 tx=0x7ffbb000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.621+0000 7ffbcc40e800 1 --2- 172.21.15.164:0/894295494 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55dccb522fa0 0x55dccb525390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.621+0000 7ffbcc40e800 1 -- 172.21.15.164:0/894295494 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dccb525960 con 0x55dccb522fa0 2024-09-13T23:07:18.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.621+0000 7ffbc843c640 1 --2- 172.21.15.164:0/894295494 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55dccb522fa0 0x55dccb525390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.622+0000 7ffbc843c640 1 --2- 172.21.15.164:0/894295494 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55dccb522fa0 0x55dccb525390 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.622+0000 7ffbc843c640 1 -- 172.21.15.164:0/894295494 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffbb801ecc0 con 0x55dccb522fa0 2024-09-13T23:07:18.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.622+0000 7ffbcc40e800 1 -- 172.21.15.164:0/894295494 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dccb526220 con 0x55dccb522fa0 2024-09-13T23:07:18.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.622+0000 7ffbc843c640 1 -- 172.21.15.164:0/894295494 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffbb801ecc0 con 0x55dccb522fa0 2024-09-13T23:07:18.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.622+0000 7ffbcc40e800 1 -- 172.21.15.164:0/894295494 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dccb5275d0 con 0x55dccb522fa0 2024-09-13T23:07:18.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.623+0000 7ffbc843c640 1 -- 172.21.15.164:0/894295494 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffbb801ecc0 con 0x55dccb522fa0 2024-09-13T23:07:18.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.623+0000 7ffbcc40e800 1 -- 172.21.15.164:0/2207597073 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffaa0036b40 msgr2=0x7ffaa0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.623+0000 7ffbcc40e800 1 --2- 172.21.15.164:0/2207597073 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffaa0036b40 0x7ffaa0039000 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0000f60 tx=0x7ffbb0001230 comp rx=0 tx=0).stop 2024-09-13T23:07:18.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.623+0000 7ffbcc40e800 1 -- 172.21.15.164:0/2207597073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb3eece0 msgr2=0x55dccb4fb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.623+0000 7ffbcc40e800 1 --2- 172.21.15.164:0/2207597073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb3eece0 0x55dccb4fb620 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800c010 tx=0x7ffbb8002ff0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.624+0000 7ffbcc40e800 1 -- 172.21.15.164:0/2207597073 shutdown_connections 2024-09-13T23:07:18.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.624+0000 7ffbcc40e800 1 --2- 172.21.15.164:0/2207597073 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffaa0036b40 0x7ffaa0039000 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.624+0000 7ffbcc40e800 1 --2- 172.21.15.164:0/2207597073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb3eece0 0x55dccb4fb620 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.624+0000 7ffbcc40e800 1 -- 172.21.15.164:0/2207597073 >> 172.21.15.164:0/2207597073 conn(0x55dccb3f17a0 msgr2=0x55dccb4f0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.624+0000 7ffbcc40e800 1 -- 172.21.15.164:0/2207597073 shutdown_connections 2024-09-13T23:07:18.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.624+0000 7ffbcc40e800 1 -- 172.21.15.164:0/2207597073 wait complete. 2024-09-13T23:07:18.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.624+0000 7ffbcc40e800 1 -- 172.21.15.164:0/139423379 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffa00036b90 msgr2=0x7ffa00039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.624+0000 7ffbcc40e800 1 --2- 172.21.15.164:0/139423379 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffa00036b90 0x7ffa00039050 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0001ed0 tx=0x7ffbb000f000 comp rx=0 tx=0).stop 2024-09-13T23:07:18.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.624+0000 7ffbcc40e800 1 -- 172.21.15.164:0/139423379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb515540 msgr2=0x55dccb515960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.624+0000 7ffbcc40e800 1 --2- 172.21.15.164:0/139423379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb515540 0x55dccb515960 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7ffbc000a3f0 tx=0x7ffbc006bd20 comp rx=0 tx=0).stop 2024-09-13T23:07:18.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.624+0000 7ffbcc40e800 1 -- 172.21.15.164:0/139423379 shutdown_connections 2024-09-13T23:07:18.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.624+0000 7ffbcc40e800 1 --2- 172.21.15.164:0/139423379 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffa00036b90 0x7ffa00039050 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.624+0000 7ffbcc40e800 1 --2- 172.21.15.164:0/139423379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb515540 0x55dccb515960 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.624+0000 7ffbcc40e800 1 -- 172.21.15.164:0/139423379 >> 172.21.15.164:0/139423379 conn(0x55dccb50a4e0 msgr2=0x55dccb50cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.624+0000 7ffbcc40e800 1 -- 172.21.15.164:0/139423379 shutdown_connections 2024-09-13T23:07:18.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.624+0000 7ffbcc40e800 1 -- 172.21.15.164:0/139423379 wait complete. 2024-09-13T23:07:18.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.624+0000 7ffbcc40e800 1 -- 172.21.15.164:0/894295494 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55dccb522fa0 msgr2=0x55dccb525390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.624+0000 7ffbcc40e800 1 --2- 172.21.15.164:0/894295494 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55dccb522fa0 0x55dccb525390 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.624+0000 7ffbcc40e800 1 -- 172.21.15.164:0/894295494 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffab0036b40 msgr2=0x7ffab0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.624+0000 7ffbcc40e800 1 --2- 172.21.15.164:0/894295494 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffab0036b40 0x7ffab0039000 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0045c50 tx=0x7ffbc0080f40 comp rx=0 tx=0).stop 2024-09-13T23:07:18.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.624+0000 7ffbcc40e800 1 -- 172.21.15.164:0/894295494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb362600 msgr2=0x55dccb4e5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.624+0000 7ffbcc40e800 1 --2- 172.21.15.164:0/894295494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb362600 0x55dccb4e5120 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0065040 tx=0x7ffbc0003330 comp rx=0 tx=0).stop 2024-09-13T23:07:18.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.624+0000 7ffbcc40e800 1 -- 172.21.15.164:0/894295494 shutdown_connections 2024-09-13T23:07:18.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.624+0000 7ffbcc40e800 1 --2- 172.21.15.164:0/894295494 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55dccb522fa0 0x55dccb525390 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.624+0000 7ffbcc40e800 1 --2- 172.21.15.164:0/894295494 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7ffab0036b40 0x7ffab0039000 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.624+0000 7ffbcc40e800 1 --2- 172.21.15.164:0/894295494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dccb362600 0x55dccb4e5120 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.624+0000 7ffbcc40e800 1 -- 172.21.15.164:0/894295494 >> 172.21.15.164:0/894295494 conn(0x55dccb3e8dd0 msgr2=0x55dccb4d7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.625+0000 7ffbcc40e800 1 -- 172.21.15.164:0/894295494 shutdown_connections 2024-09-13T23:07:18.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.625+0000 7ffbcc40e800 1 -- 172.21.15.164:0/894295494 wait complete. 2024-09-13T23:07:18.636 INFO:teuthology.orchestra.run.smithi164.stdout:{"id":"4d3c0b48-20ce-488a-b409-36cc6d9502d0","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"a32fa7f4-f49a-4762-82e4-81303c4fe8ba","zones":[{"id":"a32fa7f4-f49a-4762-82e4-81303c4fe8ba","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-09-13T23:07:18.636 DEBUG:tasks.util.rgw: json result: {'id': '4d3c0b48-20ce-488a-b409-36cc6d9502d0', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba', 'zones': [{'id': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-09-13T23:07:18.639 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-13T23:07:18.686 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-13T23:07:18.687 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-13T23:07:18.687 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-13T23:07:18.742 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:07:18.742 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:07:18.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.742+0000 7fcac733e800 1 Processor -- start 2024-09-13T23:07:18.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.742+0000 7fcac733e800 1 -- start start 2024-09-13T23:07:18.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.742+0000 7fcac733e800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55ef96112510 0x55ef96112910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.742+0000 7fcac733e800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ef95fd2b30 con 0x55ef96112e50 2024-09-13T23:07:18.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.742+0000 7fcac733e800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55ef95fb4360 con 0x55ef96112510 2024-09-13T23:07:18.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.743+0000 7fcac303b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55ef96112510 0x55ef96112910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.743+0000 7fcac303b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55ef96112510 0x55ef96112910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44834/0 (socket says 172.21.15.164:44834) 2024-09-13T23:07:18.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.743+0000 7fcac303b640 1 -- 172.21.15.164:0/3879330317 learned_addr learned my addr 172.21.15.164:0/3879330317 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.743+0000 7fcabbfff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55ef96112e50 0x55ef961179d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:60930/0 (socket says 172.21.15.164:60930) 2024-09-13T23:07:18.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.743+0000 7fcac303b640 1 -- 172.21.15.164:0/3879330317 >> v1:172.21.15.17:6789/0 conn(0x55ef96112e50 legacy=0x55ef961179d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.743+0000 7fcac303b640 1 -- 172.21.15.164:0/3879330317 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef95fdae00 con 0x55ef96112510 2024-09-13T23:07:18.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.745+0000 7fcac303b640 1 --2- 172.21.15.164:0/3879330317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef96112510 0x55ef96112910 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fcab400a520 tx=0x7fcab4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb278bdef604ec56 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.745+0000 7fcac283a640 1 -- 172.21.15.164:0/3879330317 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcab4055070 con 0x55ef96112510 2024-09-13T23:07:18.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.745+0000 7fcac283a640 1 -- 172.21.15.164:0/3879330317 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcab40515b0 con 0x55ef96112510 2024-09-13T23:07:18.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.745+0000 7fcac283a640 1 -- 172.21.15.164:0/3879330317 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcab40518d0 con 0x55ef96112510 2024-09-13T23:07:18.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.745+0000 7fcac733e800 1 -- 172.21.15.164:0/3879330317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef96112510 msgr2=0x55ef96112910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.745+0000 7fcac733e800 1 --2- 172.21.15.164:0/3879330317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef96112510 0x55ef96112910 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fcab400a520 tx=0x7fcab4045ba0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.745+0000 7fcac733e800 1 -- 172.21.15.164:0/3879330317 shutdown_connections 2024-09-13T23:07:18.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.745+0000 7fcac733e800 1 --2- 172.21.15.164:0/3879330317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef96112510 0x55ef96112910 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.745+0000 7fcac733e800 1 -- 172.21.15.164:0/3879330317 >> 172.21.15.164:0/3879330317 conn(0x55ef9610de00 msgr2=0x55ef96110220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.745+0000 7fcac733e800 1 -- 172.21.15.164:0/3879330317 shutdown_connections 2024-09-13T23:07:18.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.745+0000 7fcac733e800 1 -- 172.21.15.164:0/3879330317 wait complete. 2024-09-13T23:07:18.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.759+0000 7fcac733e800 1 Processor -- start 2024-09-13T23:07:18.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.759+0000 7fcac733e800 1 -- start start 2024-09-13T23:07:18.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.759+0000 7fcac733e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef96112510 0x55ef96086dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.759+0000 7fcac733e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ef9605f450 con 0x55ef96112510 2024-09-13T23:07:18.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.759+0000 7fcac303b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef96112510 0x55ef96086dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.760+0000 7fcac303b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef96112510 0x55ef96086dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44836/0 (socket says 172.21.15.164:44836) 2024-09-13T23:07:18.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.760+0000 7fcac303b640 1 -- 172.21.15.164:0/1645158969 learned_addr learned my addr 172.21.15.164:0/1645158969 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.760+0000 7fcac303b640 1 -- 172.21.15.164:0/1645158969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef95facbc0 con 0x55ef96112510 2024-09-13T23:07:18.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.760+0000 7fcac303b640 1 --2- 172.21.15.164:0/1645158969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef96112510 0x55ef96086dd0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fcab4025da0 tx=0x7fcab4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d8f9cb4c8e7329 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.760+0000 7fc9b160a640 1 -- 172.21.15.164:0/1645158969 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcab4051950 con 0x55ef96112510 2024-09-13T23:07:18.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.760+0000 7fc9b160a640 1 -- 172.21.15.164:0/1645158969 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcab4051af0 con 0x55ef96112510 2024-09-13T23:07:18.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.760+0000 7fc9b160a640 1 -- 172.21.15.164:0/1645158969 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcab4051dd0 con 0x55ef96112510 2024-09-13T23:07:18.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.761+0000 7fcac733e800 1 -- 172.21.15.164:0/1645158969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef96112510 msgr2=0x55ef96086dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.761+0000 7fcac733e800 1 --2- 172.21.15.164:0/1645158969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef96112510 0x55ef96086dd0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fcab4025da0 tx=0x7fcab4051000 comp rx=0 tx=0).stop 2024-09-13T23:07:18.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.761+0000 7fcac733e800 1 -- 172.21.15.164:0/1645158969 shutdown_connections 2024-09-13T23:07:18.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.761+0000 7fcac733e800 1 --2- 172.21.15.164:0/1645158969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef96112510 0x55ef96086dd0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.761+0000 7fcac733e800 1 -- 172.21.15.164:0/1645158969 >> 172.21.15.164:0/1645158969 conn(0x55ef9610de00 msgr2=0x55ef961fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.761+0000 7fcac733e800 1 -- 172.21.15.164:0/1645158969 shutdown_connections 2024-09-13T23:07:18.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.761+0000 7fcac733e800 1 -- 172.21.15.164:0/1645158969 wait complete. 2024-09-13T23:07:18.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.761+0000 7fcac733e800 1 Processor -- start 2024-09-13T23:07:18.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.761+0000 7fcac733e800 1 -- start start 2024-09-13T23:07:18.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.762+0000 7fcac733e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef96112510 0x55ef9620a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.762+0000 7fcac733e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ef96119530 con 0x55ef96112510 2024-09-13T23:07:18.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.762+0000 7fcac303b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef96112510 0x55ef9620a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.762+0000 7fcac303b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef96112510 0x55ef9620a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44848/0 (socket says 172.21.15.164:44848) 2024-09-13T23:07:18.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.762+0000 7fcac303b640 1 -- 172.21.15.164:0/2791002362 learned_addr learned my addr 172.21.15.164:0/2791002362 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.762+0000 7fcac303b640 1 -- 172.21.15.164:0/2791002362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef95fc0fe0 con 0x55ef96112510 2024-09-13T23:07:18.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.762+0000 7fcac303b640 1 --2- 172.21.15.164:0/2791002362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef96112510 0x55ef9620a2b0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fcab4067040 tx=0x7fcab4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.763+0000 7fc9afe07640 1 -- 172.21.15.164:0/2791002362 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcab4073070 con 0x55ef96112510 2024-09-13T23:07:18.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.763+0000 7fc9afe07640 1 -- 172.21.15.164:0/2791002362 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcab405a450 con 0x55ef96112510 2024-09-13T23:07:18.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.763+0000 7fc9afe07640 1 -- 172.21.15.164:0/2791002362 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcab405a730 con 0x55ef96112510 2024-09-13T23:07:18.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.763+0000 7fcac733e800 1 -- 172.21.15.164:0/2791002362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef9620a7f0 con 0x55ef96112510 2024-09-13T23:07:18.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.763+0000 7fcac733e800 1 -- 172.21.15.164:0/2791002362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef9620ad70 con 0x55ef96112510 2024-09-13T23:07:18.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.763+0000 7fc9afe07640 1 -- 172.21.15.164:0/2791002362 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fcab4076070 con 0x55ef96112510 2024-09-13T23:07:18.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.764+0000 7fc9afe07640 1 --2- 172.21.15.164:0/2791002362 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc9a8036b40 0x7fc9a8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.764+0000 7fc9afe07640 1 -- 172.21.15.164:0/2791002362 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fcab4062070 con 0x55ef96112510 2024-09-13T23:07:18.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.764+0000 7fcabbfff640 1 --2- 172.21.15.164:0/2791002362 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc9a8036b40 0x7fc9a8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.764+0000 7fcac733e800 1 --2- 172.21.15.164:0/2791002362 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ef96112e50 0x55ef96211320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.764+0000 7fcac733e800 1 -- 172.21.15.164:0/2791002362 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ef962118a0 con 0x55ef96112e50 2024-09-13T23:07:18.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.764+0000 7fcac383c640 1 --2- 172.21.15.164:0/2791002362 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ef96112e50 0x55ef96211320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.764+0000 7fcabbfff640 1 --2- 172.21.15.164:0/2791002362 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc9a8036b40 0x7fc9a8039000 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcaac000f60 tx=0x7fcaac001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.764+0000 7fcac383c640 1 --2- 172.21.15.164:0/2791002362 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ef96112e50 0x55ef96211320 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.765+0000 7fcac383c640 1 -- 172.21.15.164:0/2791002362 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcabc00a4a0 con 0x55ef96112e50 2024-09-13T23:07:18.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.765+0000 7fcac733e800 1 -- 172.21.15.164:0/2791002362 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ef9620e8f0 con 0x55ef96112e50 2024-09-13T23:07:18.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.765+0000 7fcac383c640 1 -- 172.21.15.164:0/2791002362 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcabc00a4a0 con 0x55ef96112e50 2024-09-13T23:07:18.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.765+0000 7fcac733e800 1 -- 172.21.15.164:0/2791002362 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ef962136c0 con 0x55ef96112e50 2024-09-13T23:07:18.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.765+0000 7fcac383c640 1 -- 172.21.15.164:0/2791002362 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcabc00a4a0 con 0x55ef96112e50 2024-09-13T23:07:18.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.765+0000 7fcac733e800 1 -- 172.21.15.164:0/2791002362 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ef962128f0 con 0x55ef96112e50 2024-09-13T23:07:18.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.765+0000 7fcac383c640 1 -- 172.21.15.164:0/2791002362 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcabc00a4a0 con 0x55ef96112e50 2024-09-13T23:07:18.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.765+0000 7fcac733e800 1 -- 172.21.15.164:0/2791002362 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ef96212d40 con 0x55ef96112e50 2024-09-13T23:07:18.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.766+0000 7fcac383c640 1 -- 172.21.15.164:0/2791002362 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcabc00a4a0 con 0x55ef96112e50 2024-09-13T23:07:18.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.766+0000 7fcac733e800 1 Processor -- start 2024-09-13T23:07:18.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.766+0000 7fcac733e800 1 -- start start 2024-09-13T23:07:18.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.766+0000 7fcac733e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef96221cd0 0x55ef962220f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.766+0000 7fcac733e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ef95fae580 con 0x55ef96221cd0 2024-09-13T23:07:18.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.767+0000 7fcabbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef96221cd0 0x55ef962220f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.767+0000 7fcabbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef96221cd0 0x55ef962220f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44868/0 (socket says 172.21.15.164:44868) 2024-09-13T23:07:18.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.767+0000 7fcabbfff640 1 -- 172.21.15.164:0/4120688049 learned_addr learned my addr 172.21.15.164:0/4120688049 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.767+0000 7fcabbfff640 1 -- 172.21.15.164:0/4120688049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef96222630 con 0x55ef96221cd0 2024-09-13T23:07:18.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.767+0000 7fcabbfff640 1 --2- 172.21.15.164:0/4120688049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef96221cd0 0x55ef962220f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fcaac001ed0 tx=0x7fcaac00ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.768+0000 7fc9ad602640 1 -- 172.21.15.164:0/4120688049 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaac022070 con 0x55ef96221cd0 2024-09-13T23:07:18.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.768+0000 7fcac733e800 1 -- 172.21.15.164:0/4120688049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef962228c0 con 0x55ef96221cd0 2024-09-13T23:07:18.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.768+0000 7fc9ad602640 1 -- 172.21.15.164:0/4120688049 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaac00d520 con 0x55ef96221cd0 2024-09-13T23:07:18.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.768+0000 7fcac733e800 1 -- 172.21.15.164:0/4120688049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef962255a0 con 0x55ef96221cd0 2024-09-13T23:07:18.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.768+0000 7fc9ad602640 1 -- 172.21.15.164:0/4120688049 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaac02c060 con 0x55ef96221cd0 2024-09-13T23:07:18.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.768+0000 7fc9ad602640 1 -- 172.21.15.164:0/4120688049 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fcaac025070 con 0x55ef96221cd0 2024-09-13T23:07:18.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.769+0000 7fc9ad602640 1 --2- 172.21.15.164:0/4120688049 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc99c036af0 0x7fc99c038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.769+0000 7fc9ad602640 1 -- 172.21.15.164:0/4120688049 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fcaac04e190 con 0x55ef96221cd0 2024-09-13T23:07:18.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.769+0000 7fcac383c640 1 --2- 172.21.15.164:0/4120688049 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc99c036af0 0x7fc99c038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.769+0000 7fcac733e800 1 Processor -- start 2024-09-13T23:07:18.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.769+0000 7fcac383c640 1 --2- 172.21.15.164:0/4120688049 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc99c036af0 0x7fc99c038fb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55ef96212410 tx=0x7fcabc005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.769+0000 7fcac733e800 1 -- start start 2024-09-13T23:07:18.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.769+0000 7fcac733e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef9622e9e0 0x55ef9622ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.769+0000 7fcac733e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ef96205870 con 0x55ef9622e9e0 2024-09-13T23:07:18.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.769+0000 7fcabbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef9622e9e0 0x55ef9622ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.769+0000 7fcabbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef9622e9e0 0x55ef9622ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44870/0 (socket says 172.21.15.164:44870) 2024-09-13T23:07:18.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.769+0000 7fcabbfff640 1 -- 172.21.15.164:0/1279445069 learned_addr learned my addr 172.21.15.164:0/1279445069 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.770+0000 7fcabbfff640 1 -- 172.21.15.164:0/1279445069 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef9622f3b0 con 0x55ef9622e9e0 2024-09-13T23:07:18.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.770+0000 7fcabbfff640 1 --2- 172.21.15.164:0/1279445069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef9622e9e0 0x55ef9622ede0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fcaac04c420 tx=0x7fcaac01b490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509ee9571f585171 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.770+0000 7fc9a6ffd640 1 -- 172.21.15.164:0/1279445069 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaac027440 con 0x55ef9622e9e0 2024-09-13T23:07:18.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.770+0000 7fc9a6ffd640 1 -- 172.21.15.164:0/1279445069 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaac00dbf0 con 0x55ef9622e9e0 2024-09-13T23:07:18.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.770+0000 7fc9a6ffd640 1 -- 172.21.15.164:0/1279445069 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaac0275e0 con 0x55ef9622e9e0 2024-09-13T23:07:18.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.771+0000 7fcac733e800 1 -- 172.21.15.164:0/1279445069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef9622e9e0 msgr2=0x55ef9622ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.771+0000 7fcac733e800 1 --2- 172.21.15.164:0/1279445069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef9622e9e0 0x55ef9622ede0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fcaac04c420 tx=0x7fcaac01b490 comp rx=0 tx=0).stop 2024-09-13T23:07:18.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.771+0000 7fcac733e800 1 -- 172.21.15.164:0/1279445069 shutdown_connections 2024-09-13T23:07:18.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.771+0000 7fcac733e800 1 --2- 172.21.15.164:0/1279445069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef9622e9e0 0x55ef9622ede0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.771+0000 7fcac733e800 1 -- 172.21.15.164:0/1279445069 >> 172.21.15.164:0/1279445069 conn(0x55ef9622ad40 msgr2=0x55ef96228e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.771+0000 7fcac733e800 1 -- 172.21.15.164:0/1279445069 shutdown_connections 2024-09-13T23:07:18.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.771+0000 7fcac733e800 1 -- 172.21.15.164:0/1279445069 wait complete. 2024-09-13T23:07:18.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.771+0000 7fcac733e800 1 Processor -- start 2024-09-13T23:07:18.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.771+0000 7fcac733e800 1 -- start start 2024-09-13T23:07:18.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.771+0000 7fcac733e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef9622e9e0 0x55ef96235e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.771+0000 7fcac733e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ef9622f930 con 0x55ef9622e9e0 2024-09-13T23:07:18.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.771+0000 7fcabbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef9622e9e0 0x55ef96235e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.771+0000 7fcabbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef9622e9e0 0x55ef96235e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44874/0 (socket says 172.21.15.164:44874) 2024-09-13T23:07:18.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.771+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 learned_addr learned my addr 172.21.15.164:0/3229986904 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:18.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.772+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef962363c0 con 0x55ef9622e9e0 2024-09-13T23:07:18.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.772+0000 7fcabbfff640 1 --2- 172.21.15.164:0/3229986904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef9622e9e0 0x55ef96235e80 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fcaac04c420 tx=0x7fcaac04c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.772+0000 7fc9a57fa640 1 -- 172.21.15.164:0/3229986904 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaac0256c0 con 0x55ef9622e9e0 2024-09-13T23:07:18.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.772+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef962363c0 con 0x55ef9622e9e0 2024-09-13T23:07:18.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.772+0000 7fc9a57fa640 1 -- 172.21.15.164:0/3229986904 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaac036070 con 0x55ef9622e9e0 2024-09-13T23:07:18.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.772+0000 7fc9a57fa640 1 -- 172.21.15.164:0/3229986904 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaac025860 con 0x55ef9622e9e0 2024-09-13T23:07:18.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.772+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef962363c0 con 0x55ef9622e9e0 2024-09-13T23:07:18.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.773+0000 7fc9a57fa640 1 -- 172.21.15.164:0/3229986904 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fcaac01ba60 con 0x55ef9622e9e0 2024-09-13T23:07:18.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.773+0000 7fc9a57fa640 1 --2- 172.21.15.164:0/3229986904 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc98c036b40 0x7fc98c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.773+0000 7fc9a57fa640 1 -- 172.21.15.164:0/3229986904 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fcaac040dc0 con 0x55ef9622e9e0 2024-09-13T23:07:18.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.773+0000 7fcac383c640 1 --2- 172.21.15.164:0/3229986904 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc98c036b40 0x7fc98c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.773+0000 7fcac383c640 1 --2- 172.21.15.164:0/3229986904 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc98c036b40 0x7fc98c039000 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x55ef9620e840 tx=0x7fcabc01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.773+0000 7fcac733e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:18.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.774+0000 7fcac733e800 1 --2- 172.21.15.164:0/3229986904 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ef96241630 0x55ef96243af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.774+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ef96244240 con 0x55ef96241630 2024-09-13T23:07:18.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.774+0000 7fcac303b640 1 --2- 172.21.15.164:0/3229986904 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ef96241630 0x55ef96243af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.774+0000 7fcac303b640 1 --2- 172.21.15.164:0/3229986904 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ef96241630 0x55ef96243af0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.774+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.774+0000 7fcac733e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:18.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.774+0000 7fcac733e800 20 realm 2024-09-13T23:07:18.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.774+0000 7fcac733e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:18.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.774+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ef96244650 con 0x55ef96241630 2024-09-13T23:07:18.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.774+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.774+0000 7fcac733e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:18.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.774+0000 7fcac733e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:07:18.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.774+0000 7fcac733e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:18.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.774+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ef96244f20 con 0x55ef96241630 2024-09-13T23:07:18.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.775+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.775+0000 7fcac733e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:18.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.775+0000 7fcac733e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:18.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.775+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ef962452c0 con 0x55ef96241630 2024-09-13T23:07:18.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.775+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.775+0000 7fcac733e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:18.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.775+0000 7fcac733e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:18.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.775+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ef96245b10 con 0x55ef96241630 2024-09-13T23:07:18.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.775+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.775+0000 7fcac733e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:07:18.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.775+0000 7fcac733e800 20 searching for the correct realm 2024-09-13T23:07:18.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.775+0000 7fcac733e800 1 --2- 172.21.15.164:0/3229986904 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55ef96247880 0x55ef96249c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.775+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624a250 con 0x55ef96247880 2024-09-13T23:07:18.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.775+0000 7fcabbfff640 1 --2- 172.21.15.164:0/3229986904 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55ef96247880 0x55ef96249c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.776+0000 7fcabbfff640 1 --2- 172.21.15.164:0/3229986904 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55ef96247880 0x55ef96249c70 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.776+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaac046070 con 0x55ef96247880 2024-09-13T23:07:18.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.776+0000 7fcabbfff640 1 --2- 172.21.15.164:0/3229986904 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fcaac027060 0x7fcaac003450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.776+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624a250 con 0x7fcaac027060 2024-09-13T23:07:18.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.776+0000 7fcac383c640 1 --2- 172.21.15.164:0/3229986904 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fcaac027060 0x7fcaac003450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.776+0000 7fcac383c640 1 --2- 172.21.15.164:0/3229986904 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fcaac027060 0x7fcaac003450 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.776+0000 7fcac383c640 1 -- 172.21.15.164:0/3229986904 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcabc01f070 con 0x7fcaac027060 2024-09-13T23:07:18.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.776+0000 7fcac383c640 1 --2- 172.21.15.164:0/3229986904 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fcabc031040 0x7fcabc032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:18.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.776+0000 7fcac383c640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624a250 con 0x7fcabc031040 2024-09-13T23:07:18.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.777+0000 7fcac303b640 1 --2- 172.21.15.164:0/3229986904 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fcabc031040 0x7fcabc032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:18.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.777+0000 7fcac303b640 1 --2- 172.21.15.164:0/3229986904 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fcabc031040 0x7fcabc032940 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:18.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.777+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcab407f070 con 0x7fcabc031040 2024-09-13T23:07:18.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.777+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624a250 con 0x55ef96241630 2024-09-13T23:07:18.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.778+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.778+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624a250 con 0x55ef96241630 2024-09-13T23:07:18.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.778+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.778+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624a250 con 0x7fcabc031040 2024-09-13T23:07:18.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.778+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcab407f070 con 0x7fcabc031040 2024-09-13T23:07:18.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.778+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624a250 con 0x7fcabc031040 2024-09-13T23:07:18.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.778+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcab407f070 con 0x7fcabc031040 2024-09-13T23:07:18.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.778+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624a250 con 0x7fcaac027060 2024-09-13T23:07:18.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.779+0000 7fcac383c640 1 -- 172.21.15.164:0/3229986904 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcabc01f070 con 0x7fcaac027060 2024-09-13T23:07:18.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.779+0000 7fcac383c640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624a250 con 0x55ef96247880 2024-09-13T23:07:18.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.779+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaac046070 con 0x55ef96247880 2024-09-13T23:07:18.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.779+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624a250 con 0x55ef96241630 2024-09-13T23:07:18.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.779+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.779+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624a250 con 0x7fcabc031040 2024-09-13T23:07:18.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.780+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcab407f070 con 0x7fcabc031040 2024-09-13T23:07:18.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.780+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624a250 con 0x55ef96241630 2024-09-13T23:07:18.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.780+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.780+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624a250 con 0x7fcaac027060 2024-09-13T23:07:18.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.780+0000 7fcac383c640 1 -- 172.21.15.164:0/3229986904 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcabc01f070 con 0x7fcaac027060 2024-09-13T23:07:18.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.780+0000 7fcac383c640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624a250 con 0x55ef96247880 2024-09-13T23:07:18.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.780+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaac046070 con 0x55ef96247880 2024-09-13T23:07:18.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.780+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624a250 con 0x55ef96247880 2024-09-13T23:07:18.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.780+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaac046070 con 0x55ef96247880 2024-09-13T23:07:18.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.780+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624a250 con 0x7fcabc031040 2024-09-13T23:07:18.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.781+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcab407f070 con 0x7fcabc031040 2024-09-13T23:07:18.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.781+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624a250 con 0x55ef96247880 2024-09-13T23:07:18.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.781+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaac046070 con 0x55ef96247880 2024-09-13T23:07:18.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.781+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624a250 con 0x55ef96247880 2024-09-13T23:07:18.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.781+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaac046070 con 0x55ef96247880 2024-09-13T23:07:18.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.781+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624a250 con 0x55ef96241630 2024-09-13T23:07:18.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.781+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.781+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624a250 con 0x55ef96241630 2024-09-13T23:07:18.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.782+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.782+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624a250 con 0x7fcabc031040 2024-09-13T23:07:18.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.782+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcab407f070 con 0x7fcabc031040 2024-09-13T23:07:18.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.782+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624a250 con 0x55ef96247880 2024-09-13T23:07:18.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.782+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaac046070 con 0x55ef96247880 2024-09-13T23:07:18.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.782+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624a250 con 0x7fcaac027060 2024-09-13T23:07:18.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.782+0000 7fcac383c640 1 -- 172.21.15.164:0/3229986904 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcabc01f070 con 0x7fcaac027060 2024-09-13T23:07:18.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.782+0000 7fcac383c640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624a250 con 0x55ef96241630 2024-09-13T23:07:18.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.783+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.783+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624a250 con 0x7fcabc031040 2024-09-13T23:07:18.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.783+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcab407f070 con 0x7fcabc031040 2024-09-13T23:07:18.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.783+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624a250 con 0x55ef96247880 2024-09-13T23:07:18.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.783+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaac046070 con 0x55ef96247880 2024-09-13T23:07:18.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.783+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624a250 con 0x7fcabc031040 2024-09-13T23:07:18.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.784+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcab407f070 con 0x7fcabc031040 2024-09-13T23:07:18.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.784+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fcab40a0040 con 0x7fcaac027060 2024-09-13T23:07:18.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.784+0000 7fcac383c640 1 -- 172.21.15.164:0/3229986904 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcabc01f070 con 0x7fcaac027060 2024-09-13T23:07:18.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.784+0000 7fcac383c640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fcab40a0040 con 0x55ef96247880 2024-09-13T23:07:18.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.784+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcaac046070 con 0x55ef96247880 2024-09-13T23:07:18.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.784+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fcab40a0040 con 0x7fcaac027060 2024-09-13T23:07:18.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.784+0000 7fcac383c640 1 -- 172.21.15.164:0/3229986904 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcabc01f070 con 0x7fcaac027060 2024-09-13T23:07:18.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.784+0000 7fcac383c640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fcab40a0040 con 0x55ef96241630 2024-09-13T23:07:18.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.784+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.784+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fcab40a0040 con 0x7fcaac027060 2024-09-13T23:07:18.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.785+0000 7fcac383c640 1 -- 172.21.15.164:0/3229986904 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcabc040040 con 0x7fcaac027060 2024-09-13T23:07:18.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.785+0000 7fcac733e800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:07:18.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.785+0000 7fcac733e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:07:18.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.785+0000 7fcac733e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:07:18.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.785+0000 7fcac733e800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:07:18.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.785+0000 7fcac733e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:07:18.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.785+0000 7fcac733e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:07:18.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.785+0000 7fcac733e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:18.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.785+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ef962464c0 con 0x55ef96241630 2024-09-13T23:07:18.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.785+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.785+0000 7fcac733e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:18.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.785+0000 7fcac733e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:18.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.785+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ef96246d60 con 0x55ef96241630 2024-09-13T23:07:18.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.785+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.785+0000 7fcac733e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:18.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.785+0000 7fcac733e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:18.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.785+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ef96246d60 con 0x55ef96241630 2024-09-13T23:07:18.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.785+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.785+0000 7fcac733e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:07:18.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.785+0000 7fcac733e800 20 zone default found 2024-09-13T23:07:18.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.785+0000 7fcac733e800 4 Realm: () 2024-09-13T23:07:18.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.785+0000 7fcac733e800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:07:18.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.785+0000 7fcac733e800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:07:18.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.785+0000 7fcac733e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:07:18.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.785+0000 7fcac733e800 20 zonegroup default 2024-09-13T23:07:18.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.785+0000 7fcac733e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:18.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.785+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624a6d0 con 0x7fcabc031040 2024-09-13T23:07:18.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.786+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcab407f070 con 0x7fcabc031040 2024-09-13T23:07:18.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.786+0000 7fcac733e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:18.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.786+0000 7fcac733e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:18.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.786+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ef96246b30 con 0x55ef96247880 2024-09-13T23:07:18.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.786+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcaac046070 con 0x55ef96247880 2024-09-13T23:07:18.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.786+0000 7fcac733e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:18.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.786+0000 7fcac733e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:18.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.786+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624c660 con 0x55ef96247880 2024-09-13T23:07:18.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.786+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcaac046070 con 0x55ef96247880 2024-09-13T23:07:18.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.786+0000 7fcac733e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:18.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.786+0000 7fcac733e800 20 started sync module instance, tier type = 2024-09-13T23:07:18.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.786+0000 7fcac733e800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:07:18.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.786+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624b9f0 con 0x7fcaac027060 2024-09-13T23:07:18.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.787+0000 7fcac383c640 1 -- 172.21.15.164:0/3229986904 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcabc040040 con 0x7fcaac027060 2024-09-13T23:07:18.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.787+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94487504535008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624cf70 con 0x7fcaac027060 2024-09-13T23:07:18.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.787+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624d7c0 con 0x55ef96241630 2024-09-13T23:07:18.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.788+0000 7fcac383c640 1 -- 172.21.15.164:0/3229986904 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94487504535008] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcabc040040 con 0x7fcaac027060 2024-09-13T23:07:18.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.789+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.789+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94487504538304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624d490 con 0x55ef96241630 2024-09-13T23:07:18.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.789+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624dfb0 con 0x55ef96247880 2024-09-13T23:07:18.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.790+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94487504538304] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.790+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaac046070 con 0x55ef96247880 2024-09-13T23:07:18.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.790+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94487504542336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624e3a0 con 0x55ef96247880 2024-09-13T23:07:18.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.790+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624edc0 con 0x7fcaac027060 2024-09-13T23:07:18.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.791+0000 7fcac383c640 1 -- 172.21.15.164:0/3229986904 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcabc040040 con 0x7fcaac027060 2024-09-13T23:07:18.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.791+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94487504545968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624f660 con 0x7fcaac027060 2024-09-13T23:07:18.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.791+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ef96250120 con 0x55ef96241630 2024-09-13T23:07:18.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.791+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94487504542336] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaac046070 con 0x55ef96247880 2024-09-13T23:07:18.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.793+0000 7fcac383c640 1 -- 172.21.15.164:0/3229986904 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94487504545968] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcabc040040 con 0x7fcaac027060 2024-09-13T23:07:18.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.793+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.793+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94487504550992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ef9624f1b0 con 0x55ef96241630 2024-09-13T23:07:18.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.793+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ef962509f0 con 0x7fcabc031040 2024-09-13T23:07:18.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.794+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94487504550992] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.794+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcab407f070 con 0x7fcabc031040 2024-09-13T23:07:18.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.794+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94487504539360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ef96250880 con 0x7fcabc031040 2024-09-13T23:07:18.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.794+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ef962510d0 con 0x7fcabc031040 2024-09-13T23:07:18.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.795+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94487504539360] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcab407f070 con 0x7fcabc031040 2024-09-13T23:07:18.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.795+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcab407f070 con 0x7fcabc031040 2024-09-13T23:07:18.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.795+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94487504553184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ef96250ed0 con 0x7fcabc031040 2024-09-13T23:07:18.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.795+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ef962519c0 con 0x7fcabc031040 2024-09-13T23:07:18.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.796+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(58 notify.7 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcab407f070 con 0x7fcabc031040 2024-09-13T23:07:18.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.796+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94487504557200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ef96251e30 con 0x7fcabc031040 2024-09-13T23:07:18.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.796+0000 7fcac733e800 20 add_watcher() i=0 2024-09-13T23:07:18.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.796+0000 7fcac733e800 20 add_watcher() i=1 2024-09-13T23:07:18.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.796+0000 7fcac733e800 20 add_watcher() i=2 2024-09-13T23:07:18.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.796+0000 7fcac733e800 20 add_watcher() i=3 2024-09-13T23:07:18.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.796+0000 7fcac733e800 20 add_watcher() i=4 2024-09-13T23:07:18.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.796+0000 7fcac733e800 20 add_watcher() i=5 2024-09-13T23:07:18.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.796+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94487504553184] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcab407f070 con 0x7fcabc031040 2024-09-13T23:07:18.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.796+0000 7fcac733e800 20 add_watcher() i=6 2024-09-13T23:07:18.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.797+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94487504557200] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcab407f070 con 0x7fcabc031040 2024-09-13T23:07:18.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.797+0000 7fcac733e800 20 add_watcher() i=7 2024-09-13T23:07:18.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.797+0000 7fcac733e800 2 all 8 watchers are set, enabling cache 2024-09-13T23:07:18.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.797+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ef96250940 con 0x55ef96241630 2024-09-13T23:07:18.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.797+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.797+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94487504554304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ef96252340 con 0x55ef96241630 2024-09-13T23:07:18.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.798+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94487504554304] v34'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.799+0000 7fc979fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:18.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.799+0000 7fcac733e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:07:18.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.799+0000 7fcac733e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:07:18.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.799+0000 7fcac733e800 5 note: GC not initialized 2024-09-13T23:07:18.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.799+0000 7fc978fe1640 20 reqs_thread_entry: start 2024-09-13T23:07:18.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.799+0000 7fcac733e800 20 init_complete bucket index max shards: 11 2024-09-13T23:07:18.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.799+0000 7fcac733e800 20 Filter name: none 2024-09-13T23:07:18.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.799+0000 7fc8f27fc640 20 reqs_thread_entry: start 2024-09-13T23:07:18.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.799+0000 7fcac733e800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T23:07:18.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.799+0000 7fcac733e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:18.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.799+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ef962882c0 con 0x7fcabc031040 2024-09-13T23:07:18.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.800+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fcab407f070 con 0x7fcabc031040 2024-09-13T23:07:18.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.800+0000 7fcac733e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:18.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.800+0000 7fcac733e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-13T23:07:18.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.800+0000 7fcac733e800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:18.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.800+0000 7fcac733e800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-13T23:07:18.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.800+0000 7fcac733e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:18.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.800+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ef96286900 con 0x55ef96241630 2024-09-13T23:07:18.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.800+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.800+0000 7fcac733e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:18.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.800+0000 7fcac733e800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-13T23:07:18.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.800+0000 7fcac733e800 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-13T23:07:18.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.800+0000 7fcac733e800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-13T23:07:18.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.800+0000 7fcac733e800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-13T23:07:18.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.800+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ef96287300 con 0x7fcabc031040 2024-09-13T23:07:18.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.801+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v34'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fcab407f070 con 0x7fcabc031040 2024-09-13T23:07:18.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.801+0000 7fcac733e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:07:18.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.801+0000 7fcac733e800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:18.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.801+0000 7fcac733e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T23:07:18.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.801+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94487504776480 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ef9628bde0 con 0x55ef96241630 2024-09-13T23:07:18.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.802+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== watch-notify(notify (1) cookie 94487504550992 notify 146028888087 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55ef962876a0 con 0x55ef96241630 2024-09-13T23:07:18.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.802+0000 7fc9a6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888087 cookie 94487504550992 notifier 4840 bl.length()=649 2024-09-13T23:07:18.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.802+0000 7fc9a6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:07:18.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.802+0000 7fc9a6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:18.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.802+0000 7fc9a6ffd640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc988003ea0 con 0x55ef96241630 2024-09-13T23:07:18.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.802+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(65 notify.4 [notify cookie 94487504776480 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.802+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.802+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== watch-notify(notify_complete (2) cookie 94487504776480 notify 146028888087 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ef96287ee0 con 0x55ef96241630 2024-09-13T23:07:18.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.802+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ef96286ca0 con 0x55ef96241630 2024-09-13T23:07:18.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.803+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v34'22 uv22 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.803+0000 7fcac733e800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-13T23:07:18.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.803+0000 7fcac733e800 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-13T23:07:18.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.803+0000 7fcac733e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-13T23:07:18.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.803+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94487504776352 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ef9628c210 con 0x55ef96247880 2024-09-13T23:07:18.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.803+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== watch-notify(notify (1) cookie 94487504542336 notify 146028888072 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55ef9622f3b0 con 0x55ef96247880 2024-09-13T23:07:18.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.803+0000 7fc9a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888072 cookie 94487504542336 notifier 4840 bl.length()=177 2024-09-13T23:07:18.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.803+0000 7fc9a67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-13T23:07:18.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.803+0000 7fc9a67fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-13T23:07:18.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.803+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(68 notify.2 [notify cookie 94487504776352 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcaac046070 con 0x55ef96247880 2024-09-13T23:07:18.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.803+0000 7fc9a67fc640 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc8f8003400 con 0x55ef96247880 2024-09-13T23:07:18.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.804+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaac046070 con 0x55ef96247880 2024-09-13T23:07:18.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.804+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== watch-notify(notify_complete (2) cookie 94487504776352 notify 146028888072 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ef962255a0 con 0x55ef96247880 2024-09-13T23:07:18.817 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T23:07:18.801026Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:07:18.801015Z","tags":[],"group_ids":[]} 2024-09-13T23:07:18.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.804+0000 7fc979fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:18.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.805+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94487504554304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ef96285f80 con 0x55ef96241630 2024-09-13T23:07:18.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.806+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94487504554304] v34'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.806+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94487504535008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ef96285f80 con 0x7fcaac027060 2024-09-13T23:07:18.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.807+0000 7fcac383c640 1 -- 172.21.15.164:0/3229986904 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94487504535008] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcabc040040 con 0x7fcaac027060 2024-09-13T23:07:18.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.807+0000 7fcac733e800 20 remove_watcher() i=0 2024-09-13T23:07:18.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.807+0000 7fcac733e800 2 removed watcher, disabling cache 2024-09-13T23:07:18.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.807+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94487504538304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ef96285f80 con 0x55ef96241630 2024-09-13T23:07:18.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.808+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94487504538304] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.808+0000 7fcac733e800 20 remove_watcher() i=1 2024-09-13T23:07:18.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.808+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94487504542336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ef96285f80 con 0x55ef96247880 2024-09-13T23:07:18.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.809+0000 7fcabbfff640 1 -- 172.21.15.164:0/3229986904 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94487504542336] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcaac046070 con 0x55ef96247880 2024-09-13T23:07:18.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.809+0000 7fcac733e800 20 remove_watcher() i=2 2024-09-13T23:07:18.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.809+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94487504545968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ef96285f80 con 0x7fcaac027060 2024-09-13T23:07:18.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.810+0000 7fcac383c640 1 -- 172.21.15.164:0/3229986904 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94487504545968] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcabc040040 con 0x7fcaac027060 2024-09-13T23:07:18.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.810+0000 7fcac733e800 20 remove_watcher() i=3 2024-09-13T23:07:18.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.810+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94487504550992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ef96285f80 con 0x55ef96241630 2024-09-13T23:07:18.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.811+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94487504550992] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcab407f070 con 0x55ef96241630 2024-09-13T23:07:18.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.811+0000 7fcac733e800 20 remove_watcher() i=4 2024-09-13T23:07:18.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.811+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94487504539360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ef96285f80 con 0x7fcabc031040 2024-09-13T23:07:18.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.813+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94487504539360] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcab407f070 con 0x7fcabc031040 2024-09-13T23:07:18.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.813+0000 7fcac733e800 20 remove_watcher() i=5 2024-09-13T23:07:18.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.813+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94487504553184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ef96285f80 con 0x7fcabc031040 2024-09-13T23:07:18.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.814+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94487504553184] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcab407f070 con 0x7fcabc031040 2024-09-13T23:07:18.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.814+0000 7fcac733e800 20 remove_watcher() i=6 2024-09-13T23:07:18.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.814+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94487504557200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ef96285f80 con 0x7fcabc031040 2024-09-13T23:07:18.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.815+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94487504557200] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcab407f070 con 0x7fcabc031040 2024-09-13T23:07:18.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.815+0000 7fcac733e800 20 remove_watcher() i=7 2024-09-13T23:07:18.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.815+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fcabc031040 msgr2=0x7fcabc032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.815+0000 7fcac733e800 1 --2- 172.21.15.164:0/3229986904 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fcabc031040 0x7fcabc032940 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.815+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ef96241630 msgr2=0x55ef96243af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.815+0000 7fcac733e800 1 --2- 172.21.15.164:0/3229986904 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ef96241630 0x55ef96243af0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.815+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fcaac027060 msgr2=0x7fcaac003450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.815+0000 7fcac733e800 1 --2- 172.21.15.164:0/3229986904 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fcaac027060 0x7fcaac003450 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.815+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55ef96247880 msgr2=0x55ef96249c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.815+0000 7fcac733e800 1 --2- 172.21.15.164:0/3229986904 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55ef96247880 0x55ef96249c70 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.816+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc98c036b40 msgr2=0x7fc98c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.816+0000 7fcac733e800 1 --2- 172.21.15.164:0/3229986904 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc98c036b40 0x7fc98c039000 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x55ef9620e840 tx=0x7fcabc01f000 comp rx=0 tx=0).stop 2024-09-13T23:07:18.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.816+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef9622e9e0 msgr2=0x55ef96235e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.816+0000 7fcac303b640 1 -- 172.21.15.164:0/3229986904 reap_dead start 2024-09-13T23:07:18.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.816+0000 7fcac733e800 1 --2- 172.21.15.164:0/3229986904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef9622e9e0 0x55ef96235e80 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fcaac04c420 tx=0x7fcaac04c3b0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.816+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 shutdown_connections 2024-09-13T23:07:18.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.816+0000 7fcac733e800 1 --2- 172.21.15.164:0/3229986904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef9622e9e0 0x55ef96235e80 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.816+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 >> 172.21.15.164:0/3229986904 conn(0x55ef9622ad40 msgr2=0x55ef96228e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.816+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 shutdown_connections 2024-09-13T23:07:18.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.816+0000 7fcac733e800 1 -- 172.21.15.164:0/3229986904 wait complete. 2024-09-13T23:07:18.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.816+0000 7fcac733e800 1 -- 172.21.15.164:0/4120688049 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc99c036af0 msgr2=0x7fc99c038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.816+0000 7fcac733e800 1 --2- 172.21.15.164:0/4120688049 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc99c036af0 0x7fc99c038fb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55ef96212410 tx=0x7fcabc005840 comp rx=0 tx=0).stop 2024-09-13T23:07:18.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.816+0000 7fcac733e800 1 -- 172.21.15.164:0/4120688049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef96221cd0 msgr2=0x55ef962220f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.816+0000 7fcac733e800 1 --2- 172.21.15.164:0/4120688049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef96221cd0 0x55ef962220f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fcaac001ed0 tx=0x7fcaac00ea00 comp rx=0 tx=0).stop 2024-09-13T23:07:18.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.816+0000 7fcac733e800 1 -- 172.21.15.164:0/4120688049 shutdown_connections 2024-09-13T23:07:18.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.816+0000 7fcac733e800 1 --2- 172.21.15.164:0/4120688049 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc99c036af0 0x7fc99c038fb0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.816+0000 7fcac733e800 1 --2- 172.21.15.164:0/4120688049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef96221cd0 0x55ef962220f0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.816+0000 7fcac733e800 1 -- 172.21.15.164:0/4120688049 >> 172.21.15.164:0/4120688049 conn(0x55ef96216c60 msgr2=0x55ef962197e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.816+0000 7fcac733e800 1 -- 172.21.15.164:0/4120688049 shutdown_connections 2024-09-13T23:07:18.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.816+0000 7fcac733e800 1 -- 172.21.15.164:0/4120688049 wait complete. 2024-09-13T23:07:18.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.816+0000 7fcac733e800 1 -- 172.21.15.164:0/2791002362 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ef96112e50 msgr2=0x55ef96211320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.816+0000 7fcac733e800 1 --2- 172.21.15.164:0/2791002362 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ef96112e50 0x55ef96211320 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.816+0000 7fcac733e800 1 -- 172.21.15.164:0/2791002362 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc9a8036b40 msgr2=0x7fc9a8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.817+0000 7fcac733e800 1 --2- 172.21.15.164:0/2791002362 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc9a8036b40 0x7fc9a8039000 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcaac000f60 tx=0x7fcaac001370 comp rx=0 tx=0).stop 2024-09-13T23:07:18.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.817+0000 7fcac733e800 1 -- 172.21.15.164:0/2791002362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef96112510 msgr2=0x55ef9620a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:18.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.817+0000 7fcac733e800 1 --2- 172.21.15.164:0/2791002362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef96112510 0x55ef9620a2b0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fcab4067040 tx=0x7fcab4002fb0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.817+0000 7fcac733e800 1 -- 172.21.15.164:0/2791002362 shutdown_connections 2024-09-13T23:07:18.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.817+0000 7fcac733e800 1 --2- 172.21.15.164:0/2791002362 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ef96112e50 0x55ef96211320 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.817+0000 7fcac733e800 1 --2- 172.21.15.164:0/2791002362 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc9a8036b40 0x7fc9a8039000 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.817+0000 7fcac733e800 1 --2- 172.21.15.164:0/2791002362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef96112510 0x55ef9620a2b0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:18.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.817+0000 7fcac733e800 1 -- 172.21.15.164:0/2791002362 >> 172.21.15.164:0/2791002362 conn(0x55ef9610de00 msgr2=0x55ef961fbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:18.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.817+0000 7fcac733e800 1 -- 172.21.15.164:0/2791002362 shutdown_connections 2024-09-13T23:07:18.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:18.817+0000 7fcac733e800 1 -- 172.21.15.164:0/2791002362 wait complete. 2024-09-13T23:07:18.828 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:07:18.801026Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:07:18.801015Z', 'tags': [], 'group_ids': []} 2024-09-13T23:07:18.828 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:07:18.801026Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:07:18.801015Z', 'tags': [], 'group_ids': []} 2024-09-13T23:07:18.829 ERROR:root:0 2024-09-13T23:07:18.830 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:07:18.847 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000bb6522b5ec01f804-0066e4c5a6-4239-default', 'HostId': '4239-default-default'} 2024-09-13T23:07:18.847 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-13T23:07:18.867 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:07:18.867 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-13T23:07:18.888 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-13T23:07:18.889 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-13T23:07:18.913 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-13T23:07:18.913 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-13T23:07:18.931 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-13T23:07:18.931 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:07:18.943 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:07:18.943 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-13T23:07:18.956 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:07:18.956 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T23:07:18.956 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T23:07:18.957 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-09-13T23:07:19.003 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:07:19.003 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:07:19.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.003+0000 7fea11632800 1 Processor -- start 2024-09-13T23:07:19.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.003+0000 7fea11632800 1 -- start start 2024-09-13T23:07:19.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.004+0000 7fea11632800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5576f350d4e0 0x5576f350d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.004+0000 7fea11632800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5576f33cdb30 con 0x5576f350de20 2024-09-13T23:07:19.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.004+0000 7fea11632800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x5576f33af360 con 0x5576f350d4e0 2024-09-13T23:07:19.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.004+0000 7fea0c873640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5576f350d4e0 0x5576f350d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.004+0000 7fea0c873640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5576f350d4e0 0x5576f350d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44886/0 (socket says 172.21.15.164:44886) 2024-09-13T23:07:19.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.004+0000 7fea0c072640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x5576f350de20 0x5576f35129a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:60938/0 (socket says 172.21.15.164:60938) 2024-09-13T23:07:19.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.004+0000 7fea0c873640 1 -- 172.21.15.164:0/2987071554 learned_addr learned my addr 172.21.15.164:0/2987071554 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.004+0000 7fea0c873640 1 -- 172.21.15.164:0/2987071554 >> v1:172.21.15.17:6789/0 conn(0x5576f350de20 legacy=0x5576f35129a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.004+0000 7fea0c873640 1 -- 172.21.15.164:0/2987071554 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576f33d5e00 con 0x5576f350d4e0 2024-09-13T23:07:19.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.006+0000 7fea0c873640 1 --2- 172.21.15.164:0/2987071554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f350d4e0 0x5576f350d8e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc00a520 tx=0x7fe9fc045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c14b8e938a0a3f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.006+0000 7fea0b871640 1 -- 172.21.15.164:0/2987071554 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9fc055070 con 0x5576f350d4e0 2024-09-13T23:07:19.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.006+0000 7fea0b871640 1 -- 172.21.15.164:0/2987071554 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9fc0515b0 con 0x5576f350d4e0 2024-09-13T23:07:19.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.006+0000 7fea0b871640 1 -- 172.21.15.164:0/2987071554 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9fc0518d0 con 0x5576f350d4e0 2024-09-13T23:07:19.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.007+0000 7fea11632800 1 -- 172.21.15.164:0/2987071554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f350d4e0 msgr2=0x5576f350d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.007+0000 7fea11632800 1 --2- 172.21.15.164:0/2987071554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f350d4e0 0x5576f350d8e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc00a520 tx=0x7fe9fc045ba0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.007+0000 7fea11632800 1 -- 172.21.15.164:0/2987071554 shutdown_connections 2024-09-13T23:07:19.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.007+0000 7fea11632800 1 --2- 172.21.15.164:0/2987071554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f350d4e0 0x5576f350d8e0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.007+0000 7fea11632800 1 -- 172.21.15.164:0/2987071554 >> 172.21.15.164:0/2987071554 conn(0x5576f3508dd0 msgr2=0x5576f350b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.007+0000 7fea11632800 1 -- 172.21.15.164:0/2987071554 shutdown_connections 2024-09-13T23:07:19.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.007+0000 7fea11632800 1 -- 172.21.15.164:0/2987071554 wait complete. 2024-09-13T23:07:19.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.021+0000 7fea11632800 1 Processor -- start 2024-09-13T23:07:19.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.021+0000 7fea11632800 1 -- start start 2024-09-13T23:07:19.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.021+0000 7fea11632800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f350d4e0 0x5576f35fc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.021+0000 7fea11632800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5576f345a360 con 0x5576f350d4e0 2024-09-13T23:07:19.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.021+0000 7fea0c873640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f350d4e0 0x5576f35fc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.021+0000 7fea0c873640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f350d4e0 0x5576f35fc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44894/0 (socket says 172.21.15.164:44894) 2024-09-13T23:07:19.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.021+0000 7fea0c873640 1 -- 172.21.15.164:0/1247410924 learned_addr learned my addr 172.21.15.164:0/1247410924 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.022+0000 7fea0c873640 1 -- 172.21.15.164:0/1247410924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576f33a7bc0 con 0x5576f350d4e0 2024-09-13T23:07:19.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.022+0000 7fea0c873640 1 --2- 172.21.15.164:0/1247410924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f350d4e0 0x5576f35fc7e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc025da0 tx=0x7fe9fc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f76522be452fc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.022+0000 7fe8fae0d640 1 -- 172.21.15.164:0/1247410924 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9fc051950 con 0x5576f350d4e0 2024-09-13T23:07:19.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.022+0000 7fe8fae0d640 1 -- 172.21.15.164:0/1247410924 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9fc051af0 con 0x5576f350d4e0 2024-09-13T23:07:19.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.022+0000 7fe8fae0d640 1 -- 172.21.15.164:0/1247410924 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9fc051dd0 con 0x5576f350d4e0 2024-09-13T23:07:19.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.023+0000 7fea11632800 1 -- 172.21.15.164:0/1247410924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f350d4e0 msgr2=0x5576f35fc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.023+0000 7fea11632800 1 --2- 172.21.15.164:0/1247410924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f350d4e0 0x5576f35fc7e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc025da0 tx=0x7fe9fc051000 comp rx=0 tx=0).stop 2024-09-13T23:07:19.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.023+0000 7fea11632800 1 -- 172.21.15.164:0/1247410924 shutdown_connections 2024-09-13T23:07:19.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.023+0000 7fea11632800 1 --2- 172.21.15.164:0/1247410924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f350d4e0 0x5576f35fc7e0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.023+0000 7fea11632800 1 -- 172.21.15.164:0/1247410924 >> 172.21.15.164:0/1247410924 conn(0x5576f3508dd0 msgr2=0x5576f35f81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.023+0000 7fea11632800 1 -- 172.21.15.164:0/1247410924 shutdown_connections 2024-09-13T23:07:19.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.023+0000 7fea11632800 1 -- 172.21.15.164:0/1247410924 wait complete. 2024-09-13T23:07:19.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.023+0000 7fea11632800 1 Processor -- start 2024-09-13T23:07:19.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.023+0000 7fea11632800 1 -- start start 2024-09-13T23:07:19.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.023+0000 7fea11632800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f350d4e0 0x5576f3605110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.023+0000 7fea11632800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5576f3514500 con 0x5576f350d4e0 2024-09-13T23:07:19.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.024+0000 7fea0c873640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f350d4e0 0x5576f3605110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.024+0000 7fea0c873640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f350d4e0 0x5576f3605110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44908/0 (socket says 172.21.15.164:44908) 2024-09-13T23:07:19.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.024+0000 7fea0c873640 1 -- 172.21.15.164:0/3398545108 learned_addr learned my addr 172.21.15.164:0/3398545108 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.024+0000 7fea0c873640 1 -- 172.21.15.164:0/3398545108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576f33bbfe0 con 0x5576f350d4e0 2024-09-13T23:07:19.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.024+0000 7fea0c873640 1 --2- 172.21.15.164:0/3398545108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f350d4e0 0x5576f3605110 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc067040 tx=0x7fe9fc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.024+0000 7fe8f960a640 1 -- 172.21.15.164:0/3398545108 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9fc073070 con 0x5576f350d4e0 2024-09-13T23:07:19.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.024+0000 7fe8f960a640 1 -- 172.21.15.164:0/3398545108 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9fc05a450 con 0x5576f350d4e0 2024-09-13T23:07:19.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.024+0000 7fea11632800 1 -- 172.21.15.164:0/3398545108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5576f3605650 con 0x5576f350d4e0 2024-09-13T23:07:19.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.024+0000 7fe8f960a640 1 -- 172.21.15.164:0/3398545108 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9fc05a730 con 0x5576f350d4e0 2024-09-13T23:07:19.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.024+0000 7fea11632800 1 -- 172.21.15.164:0/3398545108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576f3605bd0 con 0x5576f350d4e0 2024-09-13T23:07:19.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.025+0000 7fe8f960a640 1 -- 172.21.15.164:0/3398545108 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe9fc076070 con 0x5576f350d4e0 2024-09-13T23:07:19.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.025+0000 7fe8f960a640 1 --2- 172.21.15.164:0/3398545108 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe8f4036b40 0x7fe8f4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.025+0000 7fe8f960a640 1 -- 172.21.15.164:0/3398545108 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe9fc062070 con 0x5576f350d4e0 2024-09-13T23:07:19.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.025+0000 7fea0c072640 1 --2- 172.21.15.164:0/3398545108 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe8f4036b40 0x7fe8f4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.026+0000 7fea11632800 1 --2- 172.21.15.164:0/3398545108 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5576f350de20 0x5576f360c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.026+0000 7fea11632800 1 -- 172.21.15.164:0/3398545108 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5576f360c700 con 0x5576f350de20 2024-09-13T23:07:19.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.026+0000 7fea0d074640 1 --2- 172.21.15.164:0/3398545108 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5576f350de20 0x5576f360c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.026+0000 7fea0c072640 1 --2- 172.21.15.164:0/3398545108 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe8f4036b40 0x7fe8f4039000 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fea00000f60 tx=0x7fea00001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.026+0000 7fea0d074640 1 --2- 172.21.15.164:0/3398545108 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5576f350de20 0x5576f360c180 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.026+0000 7fea0d074640 1 -- 172.21.15.164:0/3398545108 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea0400a4a0 con 0x5576f350de20 2024-09-13T23:07:19.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.026+0000 7fea11632800 1 -- 172.21.15.164:0/3398545108 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5576f3609750 con 0x5576f350de20 2024-09-13T23:07:19.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.027+0000 7fea0d074640 1 -- 172.21.15.164:0/3398545108 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fea0400a4a0 con 0x5576f350de20 2024-09-13T23:07:19.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.027+0000 7fea11632800 1 -- 172.21.15.164:0/3398545108 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5576f360e520 con 0x5576f350de20 2024-09-13T23:07:19.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.027+0000 7fea0d074640 1 -- 172.21.15.164:0/3398545108 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fea0400a4a0 con 0x5576f350de20 2024-09-13T23:07:19.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.027+0000 7fea11632800 1 -- 172.21.15.164:0/3398545108 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5576f360d660 con 0x5576f350de20 2024-09-13T23:07:19.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.027+0000 7fea0d074640 1 -- 172.21.15.164:0/3398545108 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fea0400a4a0 con 0x5576f350de20 2024-09-13T23:07:19.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.027+0000 7fea11632800 1 -- 172.21.15.164:0/3398545108 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5576f360dab0 con 0x5576f350de20 2024-09-13T23:07:19.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.028+0000 7fea0d074640 1 -- 172.21.15.164:0/3398545108 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fea0400a4a0 con 0x5576f350de20 2024-09-13T23:07:19.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.028+0000 7fea11632800 1 Processor -- start 2024-09-13T23:07:19.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.028+0000 7fea11632800 1 -- start start 2024-09-13T23:07:19.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.028+0000 7fea11632800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f361cb10 0x5576f361cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.028+0000 7fea11632800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5576f33a9580 con 0x5576f361cb10 2024-09-13T23:07:19.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.029+0000 7fea0c072640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f361cb10 0x5576f361cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.029+0000 7fea0c072640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f361cb10 0x5576f361cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44924/0 (socket says 172.21.15.164:44924) 2024-09-13T23:07:19.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.029+0000 7fea0c072640 1 -- 172.21.15.164:0/1602494157 learned_addr learned my addr 172.21.15.164:0/1602494157 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.029+0000 7fea0c072640 1 -- 172.21.15.164:0/1602494157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576f361d470 con 0x5576f361cb10 2024-09-13T23:07:19.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.029+0000 7fea0c072640 1 --2- 172.21.15.164:0/1602494157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f361cb10 0x5576f361cf30 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fea00001ed0 tx=0x7fea0000ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.029+0000 7fe8f27fc640 1 -- 172.21.15.164:0/1602494157 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea00022070 con 0x5576f361cb10 2024-09-13T23:07:19.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.029+0000 7fe8f27fc640 1 -- 172.21.15.164:0/1602494157 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea0000d520 con 0x5576f361cb10 2024-09-13T23:07:19.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.029+0000 7fea11632800 1 -- 172.21.15.164:0/1602494157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5576f361d700 con 0x5576f361cb10 2024-09-13T23:07:19.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.029+0000 7fe8f27fc640 1 -- 172.21.15.164:0/1602494157 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea0000d800 con 0x5576f361cb10 2024-09-13T23:07:19.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.029+0000 7fea11632800 1 -- 172.21.15.164:0/1602494157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576f36203e0 con 0x5576f361cb10 2024-09-13T23:07:19.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.030+0000 7fe8f27fc640 1 -- 172.21.15.164:0/1602494157 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fea00025070 con 0x5576f361cb10 2024-09-13T23:07:19.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.030+0000 7fe8f27fc640 1 --2- 172.21.15.164:0/1602494157 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe8e4036b40 0x7fe8e4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.030+0000 7fe8f27fc640 1 -- 172.21.15.164:0/1602494157 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fea0004e150 con 0x5576f361cb10 2024-09-13T23:07:19.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.030+0000 7fea0d074640 1 --2- 172.21.15.164:0/1602494157 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe8e4036b40 0x7fe8e4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.031+0000 7fea11632800 1 Processor -- start 2024-09-13T23:07:19.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.031+0000 7fea11632800 1 -- start start 2024-09-13T23:07:19.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.031+0000 7fea0d074640 1 --2- 172.21.15.164:0/1602494157 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe8e4036b40 0x7fe8e4039000 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x5576f360d180 tx=0x7fea04005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.031+0000 7fea11632800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f3629820 0x5576f3629c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.031+0000 7fea11632800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5576f35fced0 con 0x5576f3629820 2024-09-13T23:07:19.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.031+0000 7fea0c072640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f3629820 0x5576f3629c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.031+0000 7fea0c072640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f3629820 0x5576f3629c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44938/0 (socket says 172.21.15.164:44938) 2024-09-13T23:07:19.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.031+0000 7fea0c072640 1 -- 172.21.15.164:0/1034149373 learned_addr learned my addr 172.21.15.164:0/1034149373 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.031+0000 7fea0c072640 1 -- 172.21.15.164:0/1034149373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576f362a1f0 con 0x5576f3629820 2024-09-13T23:07:19.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.031+0000 7fea0c072640 1 --2- 172.21.15.164:0/1034149373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f3629820 0x5576f3629c20 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fea0004c410 tx=0x7fea00024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d39fc327ed0f4b20 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.032+0000 7fe8e3fff640 1 -- 172.21.15.164:0/1034149373 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea00025990 con 0x5576f3629820 2024-09-13T23:07:19.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.032+0000 7fe8e3fff640 1 -- 172.21.15.164:0/1034149373 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea00026730 con 0x5576f3629820 2024-09-13T23:07:19.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.032+0000 7fe8e3fff640 1 -- 172.21.15.164:0/1034149373 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea00025c50 con 0x5576f3629820 2024-09-13T23:07:19.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.032+0000 7fea11632800 1 -- 172.21.15.164:0/1034149373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f3629820 msgr2=0x5576f3629c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.032+0000 7fea11632800 1 --2- 172.21.15.164:0/1034149373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f3629820 0x5576f3629c20 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fea0004c410 tx=0x7fea00024740 comp rx=0 tx=0).stop 2024-09-13T23:07:19.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.032+0000 7fea11632800 1 -- 172.21.15.164:0/1034149373 shutdown_connections 2024-09-13T23:07:19.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.032+0000 7fea11632800 1 --2- 172.21.15.164:0/1034149373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f3629820 0x5576f3629c20 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.032+0000 7fea11632800 1 -- 172.21.15.164:0/1034149373 >> 172.21.15.164:0/1034149373 conn(0x5576f3625b80 msgr2=0x5576f3623c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.032+0000 7fea11632800 1 -- 172.21.15.164:0/1034149373 shutdown_connections 2024-09-13T23:07:19.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.032+0000 7fea11632800 1 -- 172.21.15.164:0/1034149373 wait complete. 2024-09-13T23:07:19.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.032+0000 7fea11632800 1 Processor -- start 2024-09-13T23:07:19.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.032+0000 7fea11632800 1 -- start start 2024-09-13T23:07:19.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.033+0000 7fea11632800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f3629820 0x5576f3630d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.033+0000 7fea11632800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5576f362a860 con 0x5576f3629820 2024-09-13T23:07:19.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.033+0000 7fea0c072640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f3629820 0x5576f3630d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.033+0000 7fea0c072640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f3629820 0x5576f3630d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44948/0 (socket says 172.21.15.164:44948) 2024-09-13T23:07:19.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.033+0000 7fea0c072640 1 -- 172.21.15.164:0/2130238721 learned_addr learned my addr 172.21.15.164:0/2130238721 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.033+0000 7fea0c072640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576f36312a0 con 0x5576f3629820 2024-09-13T23:07:19.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.033+0000 7fea0c072640 1 --2- 172.21.15.164:0/2130238721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f3629820 0x5576f3630d60 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fea00024fd0 tx=0x7fea0004c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.033+0000 7fe8e27fc640 1 -- 172.21.15.164:0/2130238721 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea0003a070 con 0x5576f3629820 2024-09-13T23:07:19.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.033+0000 7fe8e27fc640 1 -- 172.21.15.164:0/2130238721 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea00030040 con 0x5576f3629820 2024-09-13T23:07:19.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.033+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5576f36312a0 con 0x5576f3629820 2024-09-13T23:07:19.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.033+0000 7fe8e27fc640 1 -- 172.21.15.164:0/2130238721 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea00046030 con 0x5576f3629820 2024-09-13T23:07:19.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.033+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576f36312a0 con 0x5576f3629820 2024-09-13T23:07:19.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.034+0000 7fe8e27fc640 1 -- 172.21.15.164:0/2130238721 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fea00025360 con 0x5576f3629820 2024-09-13T23:07:19.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.034+0000 7fe8e27fc640 1 --2- 172.21.15.164:0/2130238721 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe8d8036af0 0x7fe8d8038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.034+0000 7fe8e27fc640 1 -- 172.21.15.164:0/2130238721 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fea00047040 con 0x5576f3629820 2024-09-13T23:07:19.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.034+0000 7fea0d074640 1 --2- 172.21.15.164:0/2130238721 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe8d8036af0 0x7fe8d8038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.035+0000 7fea0d074640 1 --2- 172.21.15.164:0/2130238721 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe8d8036af0 0x7fe8d8038fb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x5576f3605f30 tx=0x7fea0401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.035+0000 7fea11632800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.035+0000 7fea11632800 1 --2- 172.21.15.164:0/2130238721 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5576f363c440 0x5576f363e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.035+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5576f363f050 con 0x5576f363c440 2024-09-13T23:07:19.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.035+0000 7fea0c873640 1 --2- 172.21.15.164:0/2130238721 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5576f363c440 0x5576f363e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.035+0000 7fea0c873640 1 --2- 172.21.15.164:0/2130238721 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5576f363c440 0x5576f363e900 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.036+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9fc07f070 con 0x5576f363c440 2024-09-13T23:07:19.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.036+0000 7fea11632800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.036+0000 7fea11632800 20 realm 2024-09-13T23:07:19.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.036+0000 7fea11632800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.036+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5576f363f460 con 0x5576f363c440 2024-09-13T23:07:19.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.036+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9fc07f070 con 0x5576f363c440 2024-09-13T23:07:19.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.036+0000 7fea11632800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.036+0000 7fea11632800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:07:19.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.036+0000 7fea11632800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.036+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5576f363fd30 con 0x5576f363c440 2024-09-13T23:07:19.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.036+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9fc07f070 con 0x5576f363c440 2024-09-13T23:07:19.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.036+0000 7fea11632800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.036+0000 7fea11632800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.036+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5576f36400d0 con 0x5576f363c440 2024-09-13T23:07:19.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.036+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe9fc07f070 con 0x5576f363c440 2024-09-13T23:07:19.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.036+0000 7fea11632800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:19.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.036+0000 7fea11632800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.036+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5576f3640920 con 0x5576f363c440 2024-09-13T23:07:19.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.037+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe9fc07f070 con 0x5576f363c440 2024-09-13T23:07:19.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.037+0000 7fea11632800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:07:19.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.037+0000 7fea11632800 20 searching for the correct realm 2024-09-13T23:07:19.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.037+0000 7fea11632800 1 --2- 172.21.15.164:0/2130238721 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5576f3642690 0x5576f3644a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.037+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5576f3645060 con 0x5576f3642690 2024-09-13T23:07:19.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.037+0000 7fea0c072640 1 --2- 172.21.15.164:0/2130238721 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5576f3642690 0x5576f3644a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.037+0000 7fea0c072640 1 --2- 172.21.15.164:0/2130238721 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5576f3642690 0x5576f3644a80 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.037+0000 7fea0c072640 1 -- 172.21.15.164:0/2130238721 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea00032070 con 0x5576f3642690 2024-09-13T23:07:19.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.037+0000 7fea0c072640 1 --2- 172.21.15.164:0/2130238721 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fea0001ac20 0x7fea000278a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.037+0000 7fea0c072640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5576f3645060 con 0x7fea0001ac20 2024-09-13T23:07:19.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.037+0000 7fea0d074640 1 --2- 172.21.15.164:0/2130238721 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fea0001ac20 0x7fea000278a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.038+0000 7fea0d074640 1 --2- 172.21.15.164:0/2130238721 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fea0001ac20 0x7fea000278a0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.038+0000 7fea0d074640 1 -- 172.21.15.164:0/2130238721 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea0401f070 con 0x7fea0001ac20 2024-09-13T23:07:19.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.038+0000 7fea0d074640 1 --2- 172.21.15.164:0/2130238721 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fea04031040 0x7fea04032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.038+0000 7fea0d074640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5576f3645060 con 0x7fea04031040 2024-09-13T23:07:19.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.038+0000 7fea0c873640 1 --2- 172.21.15.164:0/2130238721 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fea04031040 0x7fea04032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.039+0000 7fea0c873640 1 --2- 172.21.15.164:0/2130238721 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fea04031040 0x7fea04032940 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.039+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9fc07f070 con 0x7fea04031040 2024-09-13T23:07:19.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.039+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5576f3645060 con 0x5576f363c440 2024-09-13T23:07:19.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.039+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe9fc07f070 con 0x5576f363c440 2024-09-13T23:07:19.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.039+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5576f3645060 con 0x5576f363c440 2024-09-13T23:07:19.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.039+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9fc07f070 con 0x5576f363c440 2024-09-13T23:07:19.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.039+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5576f3645060 con 0x7fea04031040 2024-09-13T23:07:19.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.040+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9fc07f070 con 0x7fea04031040 2024-09-13T23:07:19.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.040+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5576f3645060 con 0x7fea04031040 2024-09-13T23:07:19.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.040+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9fc07f070 con 0x7fea04031040 2024-09-13T23:07:19.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.040+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5576f3645060 con 0x7fea0001ac20 2024-09-13T23:07:19.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.040+0000 7fea0d074640 1 -- 172.21.15.164:0/2130238721 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea0401f070 con 0x7fea0001ac20 2024-09-13T23:07:19.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.040+0000 7fea0d074640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5576f3645060 con 0x5576f3642690 2024-09-13T23:07:19.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.041+0000 7fea0c072640 1 -- 172.21.15.164:0/2130238721 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea00032070 con 0x5576f3642690 2024-09-13T23:07:19.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.041+0000 7fea0c072640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5576f3645060 con 0x5576f363c440 2024-09-13T23:07:19.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.041+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9fc07f070 con 0x5576f363c440 2024-09-13T23:07:19.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.041+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5576f3645060 con 0x7fea04031040 2024-09-13T23:07:19.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.041+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9fc07f070 con 0x7fea04031040 2024-09-13T23:07:19.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.041+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5576f3645060 con 0x5576f363c440 2024-09-13T23:07:19.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.041+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9fc07f070 con 0x5576f363c440 2024-09-13T23:07:19.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.041+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5576f3645060 con 0x7fea0001ac20 2024-09-13T23:07:19.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.042+0000 7fea0d074640 1 -- 172.21.15.164:0/2130238721 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fea0401f070 con 0x7fea0001ac20 2024-09-13T23:07:19.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.042+0000 7fea0d074640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5576f3645060 con 0x5576f3642690 2024-09-13T23:07:19.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.042+0000 7fea0c072640 1 -- 172.21.15.164:0/2130238721 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea00032070 con 0x5576f3642690 2024-09-13T23:07:19.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.042+0000 7fea0c072640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5576f3645060 con 0x5576f3642690 2024-09-13T23:07:19.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.042+0000 7fea0c072640 1 -- 172.21.15.164:0/2130238721 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea00032070 con 0x5576f3642690 2024-09-13T23:07:19.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.042+0000 7fea0c072640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5576f3645060 con 0x7fea04031040 2024-09-13T23:07:19.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.042+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9fc07f070 con 0x7fea04031040 2024-09-13T23:07:19.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.042+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5576f3645060 con 0x5576f3642690 2024-09-13T23:07:19.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.043+0000 7fea0c072640 1 -- 172.21.15.164:0/2130238721 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea00032070 con 0x5576f3642690 2024-09-13T23:07:19.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.043+0000 7fea0c072640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5576f3645060 con 0x5576f3642690 2024-09-13T23:07:19.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.043+0000 7fea0c072640 1 -- 172.21.15.164:0/2130238721 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea00032070 con 0x5576f3642690 2024-09-13T23:07:19.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.043+0000 7fea0c072640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5576f3645060 con 0x5576f363c440 2024-09-13T23:07:19.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.043+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9fc07f070 con 0x5576f363c440 2024-09-13T23:07:19.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.043+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5576f3645060 con 0x5576f363c440 2024-09-13T23:07:19.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.043+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe9fc07f070 con 0x5576f363c440 2024-09-13T23:07:19.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.043+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5576f3645060 con 0x7fea04031040 2024-09-13T23:07:19.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.044+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9fc07f070 con 0x7fea04031040 2024-09-13T23:07:19.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.044+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5576f3645060 con 0x5576f3642690 2024-09-13T23:07:19.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.044+0000 7fea0c072640 1 -- 172.21.15.164:0/2130238721 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea00032070 con 0x5576f3642690 2024-09-13T23:07:19.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.044+0000 7fea0c072640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5576f3645060 con 0x7fea0001ac20 2024-09-13T23:07:19.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.044+0000 7fea0d074640 1 -- 172.21.15.164:0/2130238721 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea0401f070 con 0x7fea0001ac20 2024-09-13T23:07:19.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.044+0000 7fea0d074640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5576f3645060 con 0x5576f363c440 2024-09-13T23:07:19.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.044+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe9fc07f070 con 0x5576f363c440 2024-09-13T23:07:19.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.044+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5576f3645060 con 0x7fea04031040 2024-09-13T23:07:19.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.045+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9fc07f070 con 0x7fea04031040 2024-09-13T23:07:19.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.045+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5576f3645060 con 0x5576f3642690 2024-09-13T23:07:19.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.045+0000 7fea0c072640 1 -- 172.21.15.164:0/2130238721 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea00032070 con 0x5576f3642690 2024-09-13T23:07:19.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.045+0000 7fea0c072640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5576f3645060 con 0x7fea04031040 2024-09-13T23:07:19.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.045+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9fc07f070 con 0x7fea04031040 2024-09-13T23:07:19.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.045+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe9fc0a3040 con 0x7fea0001ac20 2024-09-13T23:07:19.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.046+0000 7fea0d074640 1 -- 172.21.15.164:0/2130238721 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea0401f070 con 0x7fea0001ac20 2024-09-13T23:07:19.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.046+0000 7fea0d074640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe9fc0a3040 con 0x5576f3642690 2024-09-13T23:07:19.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.046+0000 7fea0c072640 1 -- 172.21.15.164:0/2130238721 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea00032070 con 0x5576f3642690 2024-09-13T23:07:19.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.046+0000 7fea0c072640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe9fc0a3040 con 0x7fea0001ac20 2024-09-13T23:07:19.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.046+0000 7fea0d074640 1 -- 172.21.15.164:0/2130238721 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea0401f070 con 0x7fea0001ac20 2024-09-13T23:07:19.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.046+0000 7fea0d074640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe9fc0a3040 con 0x5576f363c440 2024-09-13T23:07:19.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.046+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe9fc07f070 con 0x5576f363c440 2024-09-13T23:07:19.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.046+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe9fc0a3040 con 0x7fea0001ac20 2024-09-13T23:07:19.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.047+0000 7fea0d074640 1 -- 172.21.15.164:0/2130238721 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea04040040 con 0x7fea0001ac20 2024-09-13T23:07:19.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.047+0000 7fea11632800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:07:19.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.047+0000 7fea11632800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:07:19.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.047+0000 7fea11632800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:07:19.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.047+0000 7fea11632800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:07:19.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.047+0000 7fea11632800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:07:19.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.047+0000 7fea11632800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:07:19.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.047+0000 7fea11632800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.047+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5576f36412d0 con 0x5576f363c440 2024-09-13T23:07:19.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.047+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9fc07f070 con 0x5576f363c440 2024-09-13T23:07:19.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.047+0000 7fea11632800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.047+0000 7fea11632800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.047+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5576f3641b70 con 0x5576f363c440 2024-09-13T23:07:19.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.047+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe9fc07f070 con 0x5576f363c440 2024-09-13T23:07:19.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.047+0000 7fea11632800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:19.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.047+0000 7fea11632800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.047+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5576f3641b70 con 0x5576f363c440 2024-09-13T23:07:19.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.048+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe9fc07f070 con 0x5576f363c440 2024-09-13T23:07:19.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.048+0000 7fea11632800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:07:19.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.048+0000 7fea11632800 20 zone default found 2024-09-13T23:07:19.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.048+0000 7fea11632800 4 Realm: () 2024-09-13T23:07:19.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.048+0000 7fea11632800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:07:19.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.048+0000 7fea11632800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:07:19.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.048+0000 7fea11632800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:07:19.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.048+0000 7fea11632800 20 zonegroup default 2024-09-13T23:07:19.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.048+0000 7fea11632800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.048+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5576f36454e0 con 0x7fea04031040 2024-09-13T23:07:19.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.048+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe9fc07f070 con 0x7fea04031040 2024-09-13T23:07:19.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.048+0000 7fea11632800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.048+0000 7fea11632800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.048+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5576f3641940 con 0x5576f3642690 2024-09-13T23:07:19.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.048+0000 7fea0c072640 1 -- 172.21.15.164:0/2130238721 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fea00032070 con 0x5576f3642690 2024-09-13T23:07:19.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.048+0000 7fea11632800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.048+0000 7fea11632800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.048+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5576f3647440 con 0x5576f3642690 2024-09-13T23:07:19.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.049+0000 7fea0c072640 1 -- 172.21.15.164:0/2130238721 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fea00032070 con 0x5576f3642690 2024-09-13T23:07:19.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.049+0000 7fea11632800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.049+0000 7fea11632800 20 started sync module instance, tier type = 2024-09-13T23:07:19.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.049+0000 7fea11632800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:07:19.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.049+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576f3646800 con 0x7fea0001ac20 2024-09-13T23:07:19.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.050+0000 7fea0d074640 1 -- 172.21.15.164:0/2130238721 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea04040040 con 0x7fea0001ac20 2024-09-13T23:07:19.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.050+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93969377946608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576f3647d50 con 0x7fea0001ac20 2024-09-13T23:07:19.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.050+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576f36485a0 con 0x5576f363c440 2024-09-13T23:07:19.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.051+0000 7fea0d074640 1 -- 172.21.15.164:0/2130238721 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93969377946608] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea04040040 con 0x7fea0001ac20 2024-09-13T23:07:19.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.051+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9fc07f070 con 0x5576f363c440 2024-09-13T23:07:19.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.051+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93969377949856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576f3648250 con 0x5576f363c440 2024-09-13T23:07:19.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.051+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576f3648d70 con 0x5576f3642690 2024-09-13T23:07:19.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.052+0000 7fea0c072640 1 -- 172.21.15.164:0/2130238721 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea00032070 con 0x5576f3642690 2024-09-13T23:07:19.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.052+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93969377953856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576f3649610 con 0x5576f3642690 2024-09-13T23:07:19.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.052+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576f364a0c0 con 0x7fea0001ac20 2024-09-13T23:07:19.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.053+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93969377949856] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9fc07f070 con 0x5576f363c440 2024-09-13T23:07:19.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.053+0000 7fea0d074640 1 -- 172.21.15.164:0/2130238721 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea04040040 con 0x7fea0001ac20 2024-09-13T23:07:19.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.053+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93969377958816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576f364a4b0 con 0x7fea0001ac20 2024-09-13T23:07:19.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.053+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576f364ab10 con 0x5576f363c440 2024-09-13T23:07:19.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.053+0000 7fea0c072640 1 -- 172.21.15.164:0/2130238721 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93969377953856] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea00032070 con 0x5576f3642690 2024-09-13T23:07:19.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.055+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9fc07f070 con 0x5576f363c440 2024-09-13T23:07:19.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.055+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93969377956192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576f364af30 con 0x5576f363c440 2024-09-13T23:07:19.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.055+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576f364b930 con 0x7fea04031040 2024-09-13T23:07:19.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.055+0000 7fea0d074640 1 -- 172.21.15.164:0/2130238721 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93969377958816] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea04040040 con 0x7fea0001ac20 2024-09-13T23:07:19.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.056+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93969377956192] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9fc07f070 con 0x5576f363c440 2024-09-13T23:07:19.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.056+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9fc07f070 con 0x7fea04031040 2024-09-13T23:07:19.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.056+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93969377961504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576f364b440 con 0x7fea04031040 2024-09-13T23:07:19.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.056+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576f364c1d0 con 0x7fea04031040 2024-09-13T23:07:19.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.057+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93969377961504] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9fc07f070 con 0x7fea04031040 2024-09-13T23:07:19.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.057+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9fc07f070 con 0x7fea04031040 2024-09-13T23:07:19.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.057+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93969377950912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576f364b440 con 0x7fea04031040 2024-09-13T23:07:19.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.057+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576f364c7f0 con 0x7fea04031040 2024-09-13T23:07:19.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.058+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93969377950912] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9fc07f070 con 0x7fea04031040 2024-09-13T23:07:19.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.058+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9fc07f070 con 0x7fea04031040 2024-09-13T23:07:19.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.058+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93969377967232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576f364c7f0 con 0x7fea04031040 2024-09-13T23:07:19.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.058+0000 7fea11632800 20 add_watcher() i=0 2024-09-13T23:07:19.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.058+0000 7fea11632800 20 add_watcher() i=1 2024-09-13T23:07:19.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.058+0000 7fea11632800 20 add_watcher() i=2 2024-09-13T23:07:19.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.058+0000 7fea11632800 20 add_watcher() i=3 2024-09-13T23:07:19.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.058+0000 7fea11632800 20 add_watcher() i=4 2024-09-13T23:07:19.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.058+0000 7fea11632800 20 add_watcher() i=5 2024-09-13T23:07:19.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.058+0000 7fea11632800 20 add_watcher() i=6 2024-09-13T23:07:19.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.059+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93969377967232] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9fc07f070 con 0x7fea04031040 2024-09-13T23:07:19.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.059+0000 7fea11632800 20 add_watcher() i=7 2024-09-13T23:07:19.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.059+0000 7fea11632800 2 all 8 watchers are set, enabling cache 2024-09-13T23:07:19.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.059+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5576f364fbf0 con 0x5576f363c440 2024-09-13T23:07:19.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.060+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe9fc07f070 con 0x5576f363c440 2024-09-13T23:07:19.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.060+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93969377969424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576f364d110 con 0x5576f363c440 2024-09-13T23:07:19.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.061+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93969377969424] v34'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe9fc07f070 con 0x5576f363c440 2024-09-13T23:07:19.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.061+0000 7fe8c2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:19.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.061+0000 7fea11632800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:07:19.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.061+0000 7fea11632800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:07:19.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.061+0000 7fea11632800 5 note: GC not initialized 2024-09-13T23:07:19.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.061+0000 7fe8c1fe3640 20 reqs_thread_entry: start 2024-09-13T23:07:19.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.061+0000 7fea11632800 20 init_complete bucket index max shards: 11 2024-09-13T23:07:19.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.061+0000 7fea11632800 20 Filter name: none 2024-09-13T23:07:19.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.061+0000 7fe8337fe640 20 reqs_thread_entry: start 2024-09-13T23:07:19.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.061+0000 7fea11632800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T23:07:19.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.062+0000 7fea11632800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.062+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5576f3683050 con 0x7fea04031040 2024-09-13T23:07:19.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.062+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7fe9fc07f070 con 0x7fea04031040 2024-09-13T23:07:19.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.062+0000 7fea11632800 20 rados_obj.operate() r=0 bl.length=473 2024-09-13T23:07:19.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.062+0000 7fea11632800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T23:07:19.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.062+0000 7fea11632800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:19.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.062+0000 7fea11632800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:07:19.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.062+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576f3689a00 con 0x7fea04031040 2024-09-13T23:07:19.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.064+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe9fc0ac040 con 0x7fea04031040 2024-09-13T23:07:19.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.064+0000 7fea11632800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:07:19.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.064+0000 7fea11632800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:19.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.064+0000 7fea11632800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T23:07:19.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.064+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93969378218944 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5576f3685060 con 0x5576f363c440 2024-09-13T23:07:19.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.064+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== watch-notify(notify (1) cookie 93969377956192 notify 146028888089 ret 0) ==== 678+0+0 (crc 0 0 0) 0x5576f3605bd0 con 0x5576f363c440 2024-09-13T23:07:19.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.064+0000 7fe8e3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888089 cookie 93969377956192 notifier 4847 bl.length()=636 2024-09-13T23:07:19.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.064+0000 7fe8e3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:07:19.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.064+0000 7fe8e3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:19.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.064+0000 7fe8e3fff640 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe8d0003ea0 con 0x5576f363c440 2024-09-13T23:07:19.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.064+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(64 notify.4 [notify cookie 93969378218944 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe9fc0ac040 con 0x5576f363c440 2024-09-13T23:07:19.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.064+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9fc0ac040 con 0x5576f363c440 2024-09-13T23:07:19.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.065+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== watch-notify(notify_complete (2) cookie 93969378218944 notify 146028888089 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5576f3605650 con 0x5576f363c440 2024-09-13T23:07:19.079 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T23:07:18.801026Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:07:18.801015Z","tags":[],"group_ids":[]} 2024-09-13T23:07:19.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.065+0000 7fe8c2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:19.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.065+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93969377969424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576f3680d70 con 0x5576f363c440 2024-09-13T23:07:19.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.066+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93969377969424] v34'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe9fc0ac040 con 0x5576f363c440 2024-09-13T23:07:19.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.066+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93969377946608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576f3680d70 con 0x7fea0001ac20 2024-09-13T23:07:19.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.067+0000 7fea0d074640 1 -- 172.21.15.164:0/2130238721 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93969377946608] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea04040040 con 0x7fea0001ac20 2024-09-13T23:07:19.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.067+0000 7fea11632800 20 remove_watcher() i=0 2024-09-13T23:07:19.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.067+0000 7fea11632800 2 removed watcher, disabling cache 2024-09-13T23:07:19.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.067+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93969377949856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576f3680d70 con 0x5576f363c440 2024-09-13T23:07:19.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.069+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93969377949856] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9fc0ac040 con 0x5576f363c440 2024-09-13T23:07:19.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.069+0000 7fea11632800 20 remove_watcher() i=1 2024-09-13T23:07:19.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.069+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93969377953856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576f3680d70 con 0x5576f3642690 2024-09-13T23:07:19.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.070+0000 7fea0c072640 1 -- 172.21.15.164:0/2130238721 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93969377953856] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea00032070 con 0x5576f3642690 2024-09-13T23:07:19.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.070+0000 7fea11632800 20 remove_watcher() i=2 2024-09-13T23:07:19.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.070+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93969377958816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576f36478a0 con 0x7fea0001ac20 2024-09-13T23:07:19.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.071+0000 7fea0d074640 1 -- 172.21.15.164:0/2130238721 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93969377958816] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea04040040 con 0x7fea0001ac20 2024-09-13T23:07:19.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.071+0000 7fea11632800 20 remove_watcher() i=3 2024-09-13T23:07:19.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.071+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93969377956192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576f3649ba0 con 0x5576f363c440 2024-09-13T23:07:19.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.073+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93969377956192] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9fc0ac040 con 0x5576f363c440 2024-09-13T23:07:19.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.073+0000 7fea11632800 20 remove_watcher() i=4 2024-09-13T23:07:19.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.073+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93969377961504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576f36478a0 con 0x7fea04031040 2024-09-13T23:07:19.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.074+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93969377961504] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9fc0ac040 con 0x7fea04031040 2024-09-13T23:07:19.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.074+0000 7fea11632800 20 remove_watcher() i=5 2024-09-13T23:07:19.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.074+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93969377950912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576f3649ba0 con 0x7fea04031040 2024-09-13T23:07:19.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.075+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93969377950912] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9fc0ac040 con 0x7fea04031040 2024-09-13T23:07:19.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.075+0000 7fea11632800 20 remove_watcher() i=6 2024-09-13T23:07:19.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.075+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93969377967232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576f3647d50 con 0x7fea04031040 2024-09-13T23:07:19.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.076+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93969377967232] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9fc0ac040 con 0x7fea04031040 2024-09-13T23:07:19.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.076+0000 7fea11632800 20 remove_watcher() i=7 2024-09-13T23:07:19.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.076+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fea04031040 msgr2=0x7fea04032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.076+0000 7fea11632800 1 --2- 172.21.15.164:0/2130238721 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fea04031040 0x7fea04032940 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.076+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5576f363c440 msgr2=0x5576f363e900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.076+0000 7fea11632800 1 --2- 172.21.15.164:0/2130238721 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5576f363c440 0x5576f363e900 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.076+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fea0001ac20 msgr2=0x7fea000278a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.076+0000 7fea11632800 1 --2- 172.21.15.164:0/2130238721 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fea0001ac20 0x7fea000278a0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.076+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5576f3642690 msgr2=0x5576f3644a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.076+0000 7fea11632800 1 --2- 172.21.15.164:0/2130238721 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5576f3642690 0x5576f3644a80 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.076+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe8d8036af0 msgr2=0x7fe8d8038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.076+0000 7fea11632800 1 --2- 172.21.15.164:0/2130238721 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe8d8036af0 0x7fe8d8038fb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x5576f3605f30 tx=0x7fea0401f000 comp rx=0 tx=0).stop 2024-09-13T23:07:19.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.076+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f3629820 msgr2=0x5576f3630d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.076+0000 7fea0c873640 1 -- 172.21.15.164:0/2130238721 reap_dead start 2024-09-13T23:07:19.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.076+0000 7fea11632800 1 --2- 172.21.15.164:0/2130238721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f3629820 0x5576f3630d60 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fea00024fd0 tx=0x7fea0004c370 comp rx=0 tx=0).stop 2024-09-13T23:07:19.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.076+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 shutdown_connections 2024-09-13T23:07:19.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.076+0000 7fea11632800 1 --2- 172.21.15.164:0/2130238721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f3629820 0x5576f3630d60 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.076+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 >> 172.21.15.164:0/2130238721 conn(0x5576f3625b80 msgr2=0x5576f3623c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.076+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 shutdown_connections 2024-09-13T23:07:19.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.076+0000 7fea11632800 1 -- 172.21.15.164:0/2130238721 wait complete. 2024-09-13T23:07:19.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.077+0000 7fea11632800 1 -- 172.21.15.164:0/1602494157 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe8e4036b40 msgr2=0x7fe8e4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.077+0000 7fea11632800 1 --2- 172.21.15.164:0/1602494157 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe8e4036b40 0x7fe8e4039000 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x5576f360d180 tx=0x7fea04005840 comp rx=0 tx=0).stop 2024-09-13T23:07:19.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.077+0000 7fea11632800 1 -- 172.21.15.164:0/1602494157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f361cb10 msgr2=0x5576f361cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.077+0000 7fea11632800 1 --2- 172.21.15.164:0/1602494157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f361cb10 0x5576f361cf30 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fea00001ed0 tx=0x7fea0000ea00 comp rx=0 tx=0).stop 2024-09-13T23:07:19.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.077+0000 7fea11632800 1 -- 172.21.15.164:0/1602494157 shutdown_connections 2024-09-13T23:07:19.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.077+0000 7fea11632800 1 --2- 172.21.15.164:0/1602494157 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe8e4036b40 0x7fe8e4039000 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.077+0000 7fea11632800 1 --2- 172.21.15.164:0/1602494157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f361cb10 0x5576f361cf30 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.077+0000 7fea11632800 1 -- 172.21.15.164:0/1602494157 >> 172.21.15.164:0/1602494157 conn(0x5576f3611aa0 msgr2=0x5576f3614620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.077+0000 7fea11632800 1 -- 172.21.15.164:0/1602494157 shutdown_connections 2024-09-13T23:07:19.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.077+0000 7fea11632800 1 -- 172.21.15.164:0/1602494157 wait complete. 2024-09-13T23:07:19.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.077+0000 7fea11632800 1 -- 172.21.15.164:0/3398545108 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5576f350de20 msgr2=0x5576f360c180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.077+0000 7fea11632800 1 --2- 172.21.15.164:0/3398545108 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5576f350de20 0x5576f360c180 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.077+0000 7fea11632800 1 -- 172.21.15.164:0/3398545108 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe8f4036b40 msgr2=0x7fe8f4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.077+0000 7fea11632800 1 --2- 172.21.15.164:0/3398545108 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe8f4036b40 0x7fe8f4039000 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fea00000f60 tx=0x7fea00001370 comp rx=0 tx=0).stop 2024-09-13T23:07:19.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.077+0000 7fea11632800 1 -- 172.21.15.164:0/3398545108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f350d4e0 msgr2=0x5576f3605110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.077+0000 7fea11632800 1 --2- 172.21.15.164:0/3398545108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f350d4e0 0x5576f3605110 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc067040 tx=0x7fe9fc002fb0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.077+0000 7fea11632800 1 -- 172.21.15.164:0/3398545108 shutdown_connections 2024-09-13T23:07:19.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.077+0000 7fea11632800 1 --2- 172.21.15.164:0/3398545108 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5576f350de20 0x5576f360c180 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.077+0000 7fea11632800 1 --2- 172.21.15.164:0/3398545108 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fe8f4036b40 0x7fe8f4039000 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.077+0000 7fea11632800 1 --2- 172.21.15.164:0/3398545108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576f350d4e0 0x5576f3605110 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.077+0000 7fea11632800 1 -- 172.21.15.164:0/3398545108 >> 172.21.15.164:0/3398545108 conn(0x5576f3508dd0 msgr2=0x5576f35fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.077+0000 7fea11632800 1 -- 172.21.15.164:0/3398545108 shutdown_connections 2024-09-13T23:07:19.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.077+0000 7fea11632800 1 -- 172.21.15.164:0/3398545108 wait complete. 2024-09-13T23:07:19.090 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:07:18.801026Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:07:18.801015Z', 'tags': [], 'group_ids': []} 2024-09-13T23:07:19.091 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:07:18.801026Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:07:18.801015Z', 'tags': [], 'group_ids': []} 2024-09-13T23:07:19.091 ERROR:root:0 2024-09-13T23:07:19.091 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-13T23:07:19.091 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-13T23:07:19.091 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-09-13T23:07:19.144 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:07:19.144 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:07:19.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.144+0000 7fd105521800 1 Processor -- start 2024-09-13T23:07:19.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.144+0000 7fd105521800 1 -- start start 2024-09-13T23:07:19.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.144+0000 7fd105521800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55ee18a40930 0x55ee18a42d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.144+0000 7fd105521800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ee188fbb30 con 0x55ee189b0680 2024-09-13T23:07:19.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.144+0000 7fd105521800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55ee188dd360 con 0x55ee18a40930 2024-09-13T23:07:19.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.145+0000 7fd100a4d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55ee18a40930 0x55ee18a42d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.145+0000 7fd100a4d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55ee18a40930 0x55ee18a42d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44960/0 (socket says 172.21.15.164:44960) 2024-09-13T23:07:19.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.145+0000 7fd10124e640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55ee189b0680 0x55ee18a3f210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:60954/0 (socket says 172.21.15.164:60954) 2024-09-13T23:07:19.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.145+0000 7fd100a4d640 1 -- 172.21.15.164:0/2012250370 learned_addr learned my addr 172.21.15.164:0/2012250370 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.145+0000 7fd100a4d640 1 -- 172.21.15.164:0/2012250370 >> v1:172.21.15.17:6789/0 conn(0x55ee189b0680 legacy=0x55ee18a3f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.145+0000 7fd100a4d640 1 -- 172.21.15.164:0/2012250370 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee18903e00 con 0x55ee18a40930 2024-09-13T23:07:19.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.147+0000 7fd100a4d640 1 --2- 172.21.15.164:0/2012250370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee18a40930 0x55ee18a42d20 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd0f800a520 tx=0x7fd0f8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c285a1db1c773253 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.147+0000 7fd0f3fff640 1 -- 172.21.15.164:0/2012250370 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0f8055070 con 0x55ee18a40930 2024-09-13T23:07:19.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.147+0000 7fd0f3fff640 1 -- 172.21.15.164:0/2012250370 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f80515b0 con 0x55ee18a40930 2024-09-13T23:07:19.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.147+0000 7fd0f3fff640 1 -- 172.21.15.164:0/2012250370 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0f80518d0 con 0x55ee18a40930 2024-09-13T23:07:19.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.148+0000 7fd105521800 1 -- 172.21.15.164:0/2012250370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee18a40930 msgr2=0x55ee18a42d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.148+0000 7fd105521800 1 --2- 172.21.15.164:0/2012250370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee18a40930 0x55ee18a42d20 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd0f800a520 tx=0x7fd0f8045ba0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.148+0000 7fd105521800 1 -- 172.21.15.164:0/2012250370 shutdown_connections 2024-09-13T23:07:19.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.148+0000 7fd105521800 1 --2- 172.21.15.164:0/2012250370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee18a40930 0x55ee18a42d20 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.148+0000 7fd105521800 1 -- 172.21.15.164:0/2012250370 >> 172.21.15.164:0/2012250370 conn(0x55ee18a36de0 msgr2=0x55ee18a39200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.148+0000 7fd105521800 1 -- 172.21.15.164:0/2012250370 shutdown_connections 2024-09-13T23:07:19.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.148+0000 7fd105521800 1 -- 172.21.15.164:0/2012250370 wait complete. 2024-09-13T23:07:19.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.162+0000 7fd105521800 1 Processor -- start 2024-09-13T23:07:19.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.162+0000 7fd105521800 1 -- start start 2024-09-13T23:07:19.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.162+0000 7fd105521800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee189b0680 0x55ee18a3cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.162+0000 7fd105521800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ee18988450 con 0x55ee189b0680 2024-09-13T23:07:19.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.162+0000 7fd10124e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee189b0680 0x55ee18a3cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.162+0000 7fd10124e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee189b0680 0x55ee18a3cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44962/0 (socket says 172.21.15.164:44962) 2024-09-13T23:07:19.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.162+0000 7fd10124e640 1 -- 172.21.15.164:0/3971269105 learned_addr learned my addr 172.21.15.164:0/3971269105 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.162+0000 7fd10124e640 1 -- 172.21.15.164:0/3971269105 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee188d5bc0 con 0x55ee189b0680 2024-09-13T23:07:19.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.163+0000 7fd10124e640 1 --2- 172.21.15.164:0/3971269105 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee189b0680 0x55ee18a3cb40 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4001610 tx=0x7fd0f4001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22c35a2803c5c03 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.163+0000 7fcfef606640 1 -- 172.21.15.164:0/3971269105 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0f4013420 con 0x55ee189b0680 2024-09-13T23:07:19.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.163+0000 7fcfef606640 1 -- 172.21.15.164:0/3971269105 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f40135c0 con 0x55ee189b0680 2024-09-13T23:07:19.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.163+0000 7fcfef606640 1 -- 172.21.15.164:0/3971269105 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0f40138e0 con 0x55ee189b0680 2024-09-13T23:07:19.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.163+0000 7fd105521800 1 -- 172.21.15.164:0/3971269105 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee189b0680 msgr2=0x55ee18a3cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.163+0000 7fd105521800 1 --2- 172.21.15.164:0/3971269105 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee189b0680 0x55ee18a3cb40 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4001610 tx=0x7fd0f4001ad0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.164+0000 7fd105521800 1 -- 172.21.15.164:0/3971269105 shutdown_connections 2024-09-13T23:07:19.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.164+0000 7fd105521800 1 --2- 172.21.15.164:0/3971269105 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee189b0680 0x55ee18a3cb40 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.164+0000 7fd105521800 1 -- 172.21.15.164:0/3971269105 >> 172.21.15.164:0/3971269105 conn(0x55ee18a36de0 msgr2=0x55ee18b272b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.164+0000 7fd105521800 1 -- 172.21.15.164:0/3971269105 shutdown_connections 2024-09-13T23:07:19.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.164+0000 7fd105521800 1 -- 172.21.15.164:0/3971269105 wait complete. 2024-09-13T23:07:19.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.164+0000 7fd105521800 1 Processor -- start 2024-09-13T23:07:19.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.164+0000 7fd105521800 1 -- start start 2024-09-13T23:07:19.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.164+0000 7fd105521800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee189b0680 0x55ee18b35500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.164+0000 7fd105521800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ee18a43650 con 0x55ee189b0680 2024-09-13T23:07:19.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.164+0000 7fd10124e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee189b0680 0x55ee18b35500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.164+0000 7fd10124e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee189b0680 0x55ee18b35500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44976/0 (socket says 172.21.15.164:44976) 2024-09-13T23:07:19.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.164+0000 7fd10124e640 1 -- 172.21.15.164:0/633610112 learned_addr learned my addr 172.21.15.164:0/633610112 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.165+0000 7fd10124e640 1 -- 172.21.15.164:0/633610112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee188e9fe0 con 0x55ee189b0680 2024-09-13T23:07:19.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.165+0000 7fd10124e640 1 --2- 172.21.15.164:0/633610112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee189b0680 0x55ee18b35500 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4001b10 tx=0x7fd0f4000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.165+0000 7fcfede03640 1 -- 172.21.15.164:0/633610112 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0f4022020 con 0x55ee189b0680 2024-09-13T23:07:19.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.165+0000 7fcfede03640 1 -- 172.21.15.164:0/633610112 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f4019040 con 0x55ee189b0680 2024-09-13T23:07:19.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.165+0000 7fd105521800 1 -- 172.21.15.164:0/633610112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee18b35a40 con 0x55ee189b0680 2024-09-13T23:07:19.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.165+0000 7fcfede03640 1 -- 172.21.15.164:0/633610112 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0f4004b60 con 0x55ee189b0680 2024-09-13T23:07:19.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.165+0000 7fd105521800 1 -- 172.21.15.164:0/633610112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee18b35f60 con 0x55ee189b0680 2024-09-13T23:07:19.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.166+0000 7fcfede03640 1 -- 172.21.15.164:0/633610112 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd0f4025020 con 0x55ee189b0680 2024-09-13T23:07:19.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.166+0000 7fcfede03640 1 --2- 172.21.15.164:0/633610112 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fcfe8036b90 0x7fcfe8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.166+0000 7fcfede03640 1 -- 172.21.15.164:0/633610112 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd0f404cc00 con 0x55ee189b0680 2024-09-13T23:07:19.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.166+0000 7fd100a4d640 1 --2- 172.21.15.164:0/633610112 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fcfe8036b90 0x7fcfe8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.166+0000 7fd105521800 1 --2- 172.21.15.164:0/633610112 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ee18a40930 0x55ee18b3c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.166+0000 7fd105521800 1 -- 172.21.15.164:0/633610112 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b3caf0 con 0x55ee18a40930 2024-09-13T23:07:19.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.167+0000 7fd101a4f640 1 --2- 172.21.15.164:0/633610112 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ee18a40930 0x55ee18b3c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.167+0000 7fd100a4d640 1 --2- 172.21.15.164:0/633610112 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fcfe8036b90 0x7fcfe8039050 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8057000 tx=0x7fd0f8052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.167+0000 7fd101a4f640 1 --2- 172.21.15.164:0/633610112 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ee18a40930 0x55ee18b3c570 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.167+0000 7fd101a4f640 1 -- 172.21.15.164:0/633610112 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0fc0083e0 con 0x55ee18a40930 2024-09-13T23:07:19.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.167+0000 7fd105521800 1 -- 172.21.15.164:0/633610112 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b39b20 con 0x55ee18a40930 2024-09-13T23:07:19.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.167+0000 7fd101a4f640 1 -- 172.21.15.164:0/633610112 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd0fc0083e0 con 0x55ee18a40930 2024-09-13T23:07:19.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.167+0000 7fd105521800 1 -- 172.21.15.164:0/633610112 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b3e910 con 0x55ee18a40930 2024-09-13T23:07:19.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.168+0000 7fd101a4f640 1 -- 172.21.15.164:0/633610112 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd0fc0083e0 con 0x55ee18a40930 2024-09-13T23:07:19.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.168+0000 7fd105521800 1 -- 172.21.15.164:0/633610112 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b3db40 con 0x55ee18a40930 2024-09-13T23:07:19.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.168+0000 7fd101a4f640 1 -- 172.21.15.164:0/633610112 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd0fc0083e0 con 0x55ee18a40930 2024-09-13T23:07:19.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.168+0000 7fd105521800 1 -- 172.21.15.164:0/633610112 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b3df30 con 0x55ee18a40930 2024-09-13T23:07:19.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.168+0000 7fd101a4f640 1 -- 172.21.15.164:0/633610112 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd0fc0083e0 con 0x55ee18a40930 2024-09-13T23:07:19.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.169+0000 7fd105521800 1 Processor -- start 2024-09-13T23:07:19.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.169+0000 7fd105521800 1 -- start start 2024-09-13T23:07:19.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.169+0000 7fd105521800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee18b4cf50 0x55ee18b4d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.169+0000 7fd105521800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ee188d7580 con 0x55ee18b4cf50 2024-09-13T23:07:19.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.169+0000 7fd100a4d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee18b4cf50 0x55ee18b4d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.169+0000 7fd100a4d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee18b4cf50 0x55ee18b4d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44984/0 (socket says 172.21.15.164:44984) 2024-09-13T23:07:19.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.169+0000 7fd100a4d640 1 -- 172.21.15.164:0/1099796271 learned_addr learned my addr 172.21.15.164:0/1099796271 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.170+0000 7fd100a4d640 1 -- 172.21.15.164:0/1099796271 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee18b4d8b0 con 0x55ee18b4cf50 2024-09-13T23:07:19.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.170+0000 7fd100a4d640 1 --2- 172.21.15.164:0/1099796271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee18b4cf50 0x55ee18b4d370 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd0f80460d0 tx=0x7fd0f8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.170+0000 7fcfe6ffd640 1 -- 172.21.15.164:0/1099796271 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0f805bc00 con 0x55ee18b4cf50 2024-09-13T23:07:19.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.170+0000 7fcfe6ffd640 1 -- 172.21.15.164:0/1099796271 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f805bda0 con 0x55ee18b4cf50 2024-09-13T23:07:19.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.170+0000 7fd105521800 1 -- 172.21.15.164:0/1099796271 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee18b4dae0 con 0x55ee18b4cf50 2024-09-13T23:07:19.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.170+0000 7fcfe6ffd640 1 -- 172.21.15.164:0/1099796271 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0f8073570 con 0x55ee18b4cf50 2024-09-13T23:07:19.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.170+0000 7fd105521800 1 -- 172.21.15.164:0/1099796271 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee18b50760 con 0x55ee18b4cf50 2024-09-13T23:07:19.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.171+0000 7fcfe6ffd640 1 -- 172.21.15.164:0/1099796271 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd0f8058070 con 0x55ee18b4cf50 2024-09-13T23:07:19.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.171+0000 7fcfe6ffd640 1 --2- 172.21.15.164:0/1099796271 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fcfd8036b40 0x7fcfd8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.171+0000 7fcfe6ffd640 1 -- 172.21.15.164:0/1099796271 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd0f8062030 con 0x55ee18b4cf50 2024-09-13T23:07:19.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.171+0000 7fd101a4f640 1 --2- 172.21.15.164:0/1099796271 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fcfd8036b40 0x7fcfd8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.171+0000 7fd105521800 1 Processor -- start 2024-09-13T23:07:19.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.171+0000 7fd101a4f640 1 --2- 172.21.15.164:0/1099796271 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fcfd8036b40 0x7fcfd8039000 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55ee18b3d660 tx=0x7fd0fc000f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.171+0000 7fd105521800 1 -- start start 2024-09-13T23:07:19.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.172+0000 7fd105521800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee18b59b40 0x55ee18b59f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.172+0000 7fd105521800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ee18a3b210 con 0x55ee18b59b40 2024-09-13T23:07:19.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.172+0000 7fd100a4d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee18b59b40 0x55ee18b59f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.172+0000 7fd100a4d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee18b59b40 0x55ee18b59f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:44996/0 (socket says 172.21.15.164:44996) 2024-09-13T23:07:19.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.172+0000 7fd100a4d640 1 -- 172.21.15.164:0/2500141578 learned_addr learned my addr 172.21.15.164:0/2500141578 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.172+0000 7fd100a4d640 1 -- 172.21.15.164:0/2500141578 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee18b5a510 con 0x55ee18b59b40 2024-09-13T23:07:19.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.172+0000 7fd100a4d640 1 --2- 172.21.15.164:0/2500141578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee18b59b40 0x55ee18b59f40 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd0f80913c0 tx=0x7fd0f8071450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d74d7e6ce41fda4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.172+0000 7fcfe4ff9640 1 -- 172.21.15.164:0/2500141578 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0f8069420 con 0x55ee18b59b40 2024-09-13T23:07:19.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.172+0000 7fcfe4ff9640 1 -- 172.21.15.164:0/2500141578 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f80503e0 con 0x55ee18b59b40 2024-09-13T23:07:19.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.172+0000 7fcfe4ff9640 1 -- 172.21.15.164:0/2500141578 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0f80695c0 con 0x55ee18b59b40 2024-09-13T23:07:19.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.173+0000 7fd105521800 1 -- 172.21.15.164:0/2500141578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee18b59b40 msgr2=0x55ee18b59f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.173+0000 7fd105521800 1 --2- 172.21.15.164:0/2500141578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee18b59b40 0x55ee18b59f40 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd0f80913c0 tx=0x7fd0f8071450 comp rx=0 tx=0).stop 2024-09-13T23:07:19.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.173+0000 7fd105521800 1 -- 172.21.15.164:0/2500141578 shutdown_connections 2024-09-13T23:07:19.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.173+0000 7fd105521800 1 --2- 172.21.15.164:0/2500141578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee18b59b40 0x55ee18b59f40 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.173+0000 7fd105521800 1 -- 172.21.15.164:0/2500141578 >> 172.21.15.164:0/2500141578 conn(0x55ee18b55ea0 msgr2=0x55ee18b53fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.173+0000 7fd105521800 1 -- 172.21.15.164:0/2500141578 shutdown_connections 2024-09-13T23:07:19.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.173+0000 7fd105521800 1 -- 172.21.15.164:0/2500141578 wait complete. 2024-09-13T23:07:19.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.173+0000 7fd105521800 1 Processor -- start 2024-09-13T23:07:19.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.173+0000 7fd105521800 1 -- start start 2024-09-13T23:07:19.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.173+0000 7fd105521800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee18b59b40 0x55ee18b61040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.173+0000 7fd105521800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ee18b5ab80 con 0x55ee18b59b40 2024-09-13T23:07:19.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.174+0000 7fd100a4d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee18b59b40 0x55ee18b61040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.174+0000 7fd100a4d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee18b59b40 0x55ee18b61040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:45008/0 (socket says 172.21.15.164:45008) 2024-09-13T23:07:19.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.174+0000 7fd100a4d640 1 -- 172.21.15.164:0/668023821 learned_addr learned my addr 172.21.15.164:0/668023821 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.174+0000 7fd100a4d640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee18b61580 con 0x55ee18b59b40 2024-09-13T23:07:19.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.174+0000 7fd100a4d640 1 --2- 172.21.15.164:0/668023821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee18b59b40 0x55ee18b61040 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fd0f805b850 tx=0x7fd0f8091320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.174+0000 7fcfd6ffd640 1 -- 172.21.15.164:0/668023821 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0f809c020 con 0x55ee18b59b40 2024-09-13T23:07:19.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.174+0000 7fcfd6ffd640 1 -- 172.21.15.164:0/668023821 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f808b040 con 0x55ee18b59b40 2024-09-13T23:07:19.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.174+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee18b61810 con 0x55ee18b59b40 2024-09-13T23:07:19.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.174+0000 7fcfd6ffd640 1 -- 172.21.15.164:0/668023821 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0f80739b0 con 0x55ee18b59b40 2024-09-13T23:07:19.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.174+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee18b644c0 con 0x55ee18b59b40 2024-09-13T23:07:19.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.175+0000 7fcfd6ffd640 1 -- 172.21.15.164:0/668023821 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd0f809f020 con 0x55ee18b59b40 2024-09-13T23:07:19.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.175+0000 7fcfd6ffd640 1 --2- 172.21.15.164:0/668023821 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fcfcc036b40 0x7fcfcc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.175+0000 7fcfd6ffd640 1 -- 172.21.15.164:0/668023821 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd0f808e030 con 0x55ee18b59b40 2024-09-13T23:07:19.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.176+0000 7fd101a4f640 1 --2- 172.21.15.164:0/668023821 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fcfcc036b40 0x7fcfcc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.176+0000 7fd101a4f640 1 --2- 172.21.15.164:0/668023821 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fcfcc036b40 0x7fcfcc039000 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc00f010 tx=0x7fd0fc00c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.176+0000 7fd105521800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.176+0000 7fd105521800 1 --2- 172.21.15.164:0/668023821 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ee18b6cb90 0x55ee18b6f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.176+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b6f7a0 con 0x55ee18b6cb90 2024-09-13T23:07:19.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.176+0000 7fd10124e640 1 --2- 172.21.15.164:0/668023821 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ee18b6cb90 0x55ee18b6f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.176+0000 7fd10124e640 1 --2- 172.21.15.164:0/668023821 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ee18b6cb90 0x55ee18b6f050 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.177+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0f400f030 con 0x55ee18b6cb90 2024-09-13T23:07:19.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.177+0000 7fd105521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.177+0000 7fd105521800 20 realm 2024-09-13T23:07:19.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.177+0000 7fd105521800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.177+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b6fbb0 con 0x55ee18b6cb90 2024-09-13T23:07:19.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.177+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0f400f030 con 0x55ee18b6cb90 2024-09-13T23:07:19.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.177+0000 7fd105521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.177+0000 7fd105521800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:07:19.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.177+0000 7fd105521800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.177+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b70480 con 0x55ee18b6cb90 2024-09-13T23:07:19.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.177+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0f400f030 con 0x55ee18b6cb90 2024-09-13T23:07:19.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.177+0000 7fd105521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.177+0000 7fd105521800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.177+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b70820 con 0x55ee18b6cb90 2024-09-13T23:07:19.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.177+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd0f400f030 con 0x55ee18b6cb90 2024-09-13T23:07:19.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.177+0000 7fd105521800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:19.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.177+0000 7fd105521800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.177+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b71070 con 0x55ee18b6cb90 2024-09-13T23:07:19.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.178+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd0f400f030 con 0x55ee18b6cb90 2024-09-13T23:07:19.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.178+0000 7fd105521800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:07:19.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.178+0000 7fd105521800 20 searching for the correct realm 2024-09-13T23:07:19.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.178+0000 7fd105521800 1 --2- 172.21.15.164:0/668023821 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55ee18b72de0 0x55ee18b751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.178+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x55ee18b72de0 2024-09-13T23:07:19.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.178+0000 7fd100a4d640 1 --2- 172.21.15.164:0/668023821 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55ee18b72de0 0x55ee18b751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.178+0000 7fd100a4d640 1 --2- 172.21.15.164:0/668023821 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55ee18b72de0 0x55ee18b751d0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.178+0000 7fd100a4d640 1 -- 172.21.15.164:0/668023821 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f8082030 con 0x55ee18b72de0 2024-09-13T23:07:19.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.178+0000 7fd100a4d640 1 --2- 172.21.15.164:0/668023821 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fd0f80ac040 0x7fd0f80667f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.178+0000 7fd100a4d640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x7fd0f80ac040 2024-09-13T23:07:19.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.179+0000 7fd101a4f640 1 --2- 172.21.15.164:0/668023821 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fd0f80ac040 0x7fd0f80667f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.179+0000 7fd101a4f640 1 --2- 172.21.15.164:0/668023821 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fd0f80ac040 0x7fd0f80667f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.179+0000 7fd101a4f640 1 -- 172.21.15.164:0/668023821 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0fc02f040 con 0x7fd0f80ac040 2024-09-13T23:07:19.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.179+0000 7fd101a4f640 1 --2- 172.21.15.164:0/668023821 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fd0fc019040 0x7fd0fc019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.179+0000 7fd101a4f640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x7fd0fc019040 2024-09-13T23:07:19.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.179+0000 7fd10124e640 1 --2- 172.21.15.164:0/668023821 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fd0fc019040 0x7fd0fc019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.180+0000 7fd10124e640 1 --2- 172.21.15.164:0/668023821 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fd0fc019040 0x7fd0fc019930 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.180+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f400f030 con 0x7fd0fc019040 2024-09-13T23:07:19.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.180+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x55ee18b6cb90 2024-09-13T23:07:19.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.180+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd0f400f030 con 0x55ee18b6cb90 2024-09-13T23:07:19.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.180+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x55ee18b6cb90 2024-09-13T23:07:19.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.181+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f400f030 con 0x55ee18b6cb90 2024-09-13T23:07:19.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.181+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x7fd0fc019040 2024-09-13T23:07:19.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.181+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f400f030 con 0x7fd0fc019040 2024-09-13T23:07:19.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.181+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x7fd0fc019040 2024-09-13T23:07:19.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.181+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f400f030 con 0x7fd0fc019040 2024-09-13T23:07:19.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.181+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x7fd0f80ac040 2024-09-13T23:07:19.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.181+0000 7fd101a4f640 1 -- 172.21.15.164:0/668023821 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0fc02f040 con 0x7fd0f80ac040 2024-09-13T23:07:19.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.181+0000 7fd101a4f640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x55ee18b72de0 2024-09-13T23:07:19.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.182+0000 7fd100a4d640 1 -- 172.21.15.164:0/668023821 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f8082030 con 0x55ee18b72de0 2024-09-13T23:07:19.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.182+0000 7fd100a4d640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x55ee18b6cb90 2024-09-13T23:07:19.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.182+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f400f030 con 0x55ee18b6cb90 2024-09-13T23:07:19.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.182+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x7fd0fc019040 2024-09-13T23:07:19.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.182+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f400f030 con 0x7fd0fc019040 2024-09-13T23:07:19.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.182+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x55ee18b6cb90 2024-09-13T23:07:19.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.182+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f400f030 con 0x55ee18b6cb90 2024-09-13T23:07:19.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.182+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x7fd0f80ac040 2024-09-13T23:07:19.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.183+0000 7fd101a4f640 1 -- 172.21.15.164:0/668023821 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd0fc02f040 con 0x7fd0f80ac040 2024-09-13T23:07:19.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.183+0000 7fd101a4f640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x55ee18b72de0 2024-09-13T23:07:19.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.183+0000 7fd100a4d640 1 -- 172.21.15.164:0/668023821 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f8082030 con 0x55ee18b72de0 2024-09-13T23:07:19.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.183+0000 7fd100a4d640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x55ee18b72de0 2024-09-13T23:07:19.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.183+0000 7fd100a4d640 1 -- 172.21.15.164:0/668023821 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f8082030 con 0x55ee18b72de0 2024-09-13T23:07:19.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.183+0000 7fd100a4d640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x7fd0fc019040 2024-09-13T23:07:19.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.183+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f400f030 con 0x7fd0fc019040 2024-09-13T23:07:19.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.183+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x55ee18b72de0 2024-09-13T23:07:19.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.184+0000 7fd100a4d640 1 -- 172.21.15.164:0/668023821 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f8082030 con 0x55ee18b72de0 2024-09-13T23:07:19.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.184+0000 7fd100a4d640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x55ee18b72de0 2024-09-13T23:07:19.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.184+0000 7fd100a4d640 1 -- 172.21.15.164:0/668023821 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f8082030 con 0x55ee18b72de0 2024-09-13T23:07:19.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.184+0000 7fd100a4d640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x55ee18b6cb90 2024-09-13T23:07:19.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.184+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f400f030 con 0x55ee18b6cb90 2024-09-13T23:07:19.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.184+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x55ee18b6cb90 2024-09-13T23:07:19.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.184+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd0f400f030 con 0x55ee18b6cb90 2024-09-13T23:07:19.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.184+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x7fd0fc019040 2024-09-13T23:07:19.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.184+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f400f030 con 0x7fd0fc019040 2024-09-13T23:07:19.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.184+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x55ee18b72de0 2024-09-13T23:07:19.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.185+0000 7fd100a4d640 1 -- 172.21.15.164:0/668023821 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f8082030 con 0x55ee18b72de0 2024-09-13T23:07:19.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.185+0000 7fd100a4d640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x7fd0f80ac040 2024-09-13T23:07:19.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.185+0000 7fd101a4f640 1 -- 172.21.15.164:0/668023821 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0fc02f040 con 0x7fd0f80ac040 2024-09-13T23:07:19.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.185+0000 7fd101a4f640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x55ee18b6cb90 2024-09-13T23:07:19.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.185+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd0f400f030 con 0x55ee18b6cb90 2024-09-13T23:07:19.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.185+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x7fd0fc019040 2024-09-13T23:07:19.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.186+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f400f030 con 0x7fd0fc019040 2024-09-13T23:07:19.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.186+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x55ee18b72de0 2024-09-13T23:07:19.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.186+0000 7fd100a4d640 1 -- 172.21.15.164:0/668023821 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f8082030 con 0x55ee18b72de0 2024-09-13T23:07:19.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.186+0000 7fd100a4d640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x7fd0fc019040 2024-09-13T23:07:19.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.186+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f400f030 con 0x7fd0fc019040 2024-09-13T23:07:19.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.186+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x7fd0f80ac040 2024-09-13T23:07:19.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.186+0000 7fd101a4f640 1 -- 172.21.15.164:0/668023821 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0fc02f040 con 0x7fd0f80ac040 2024-09-13T23:07:19.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.186+0000 7fd101a4f640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x55ee18b72de0 2024-09-13T23:07:19.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.187+0000 7fd100a4d640 1 -- 172.21.15.164:0/668023821 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0f8082030 con 0x55ee18b72de0 2024-09-13T23:07:19.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.187+0000 7fd100a4d640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x7fd0f80ac040 2024-09-13T23:07:19.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.187+0000 7fd101a4f640 1 -- 172.21.15.164:0/668023821 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0fc02f040 con 0x7fd0f80ac040 2024-09-13T23:07:19.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.187+0000 7fd101a4f640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x55ee18b6cb90 2024-09-13T23:07:19.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.187+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd0f400f030 con 0x55ee18b6cb90 2024-09-13T23:07:19.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.187+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75800 con 0x7fd0f80ac040 2024-09-13T23:07:19.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.187+0000 7fd101a4f640 1 -- 172.21.15.164:0/668023821 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0fc02f040 con 0x7fd0f80ac040 2024-09-13T23:07:19.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.187+0000 7fd105521800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:07:19.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.187+0000 7fd105521800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:07:19.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.187+0000 7fd105521800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:07:19.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.187+0000 7fd105521800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:07:19.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.187+0000 7fd105521800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:07:19.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.187+0000 7fd105521800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:07:19.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.187+0000 7fd105521800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.187+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b71a20 con 0x55ee18b6cb90 2024-09-13T23:07:19.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.188+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0f400f030 con 0x55ee18b6cb90 2024-09-13T23:07:19.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.188+0000 7fd105521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.188+0000 7fd105521800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.188+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b722c0 con 0x55ee18b6cb90 2024-09-13T23:07:19.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.188+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd0f400f030 con 0x55ee18b6cb90 2024-09-13T23:07:19.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.188+0000 7fd105521800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:19.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.188+0000 7fd105521800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.188+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b722c0 con 0x55ee18b6cb90 2024-09-13T23:07:19.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.188+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd0f400f030 con 0x55ee18b6cb90 2024-09-13T23:07:19.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.188+0000 7fd105521800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:07:19.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.188+0000 7fd105521800 20 zone default found 2024-09-13T23:07:19.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.188+0000 7fd105521800 4 Realm: () 2024-09-13T23:07:19.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.188+0000 7fd105521800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:07:19.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.188+0000 7fd105521800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:07:19.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.188+0000 7fd105521800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:07:19.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.188+0000 7fd105521800 20 zonegroup default 2024-09-13T23:07:19.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.188+0000 7fd105521800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.188+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b75c80 con 0x7fd0fc019040 2024-09-13T23:07:19.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.188+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd0f400f030 con 0x7fd0fc019040 2024-09-13T23:07:19.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.188+0000 7fd105521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.188+0000 7fd105521800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.188+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b72060 con 0x55ee18b72de0 2024-09-13T23:07:19.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.189+0000 7fd100a4d640 1 -- 172.21.15.164:0/668023821 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd0f8082030 con 0x55ee18b72de0 2024-09-13T23:07:19.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.189+0000 7fd105521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.189+0000 7fd105521800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.189+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b77be0 con 0x55ee18b72de0 2024-09-13T23:07:19.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.189+0000 7fd100a4d640 1 -- 172.21.15.164:0/668023821 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd0f8082030 con 0x55ee18b72de0 2024-09-13T23:07:19.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.189+0000 7fd105521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.189+0000 7fd105521800 20 started sync module instance, tier type = 2024-09-13T23:07:19.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.189+0000 7fd105521800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:07:19.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.189+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b76fa0 con 0x7fd0f80ac040 2024-09-13T23:07:19.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.190+0000 7fd101a4f640 1 -- 172.21.15.164:0/668023821 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0fc02f040 con 0x7fd0f80ac040 2024-09-13T23:07:19.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.190+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94481105253568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b76fa0 con 0x7fd0f80ac040 2024-09-13T23:07:19.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.190+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b78660 con 0x55ee18b6cb90 2024-09-13T23:07:19.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.191+0000 7fd101a4f640 1 -- 172.21.15.164:0/668023821 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94481105253568] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0fc02f040 con 0x7fd0f80ac040 2024-09-13T23:07:19.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.192+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f400f030 con 0x55ee18b6cb90 2024-09-13T23:07:19.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.192+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94481105257360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b76fa0 con 0x55ee18b6cb90 2024-09-13T23:07:19.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.192+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b790b0 con 0x55ee18b72de0 2024-09-13T23:07:19.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.193+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94481105257360] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f400f030 con 0x55ee18b6cb90 2024-09-13T23:07:19.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.193+0000 7fd100a4d640 1 -- 172.21.15.164:0/668023821 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f8082030 con 0x55ee18b72de0 2024-09-13T23:07:19.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.193+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94481105251056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b76f10 con 0x55ee18b72de0 2024-09-13T23:07:19.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.193+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b79f70 con 0x7fd0f80ac040 2024-09-13T23:07:19.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.194+0000 7fd101a4f640 1 -- 172.21.15.164:0/668023821 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0fc02f040 con 0x7fd0f80ac040 2024-09-13T23:07:19.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.194+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94481105263808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b7a810 con 0x7fd0f80ac040 2024-09-13T23:07:19.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.194+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b7b300 con 0x55ee18b6cb90 2024-09-13T23:07:19.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.194+0000 7fd100a4d640 1 -- 172.21.15.164:0/668023821 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94481105251056] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f8082030 con 0x55ee18b72de0 2024-09-13T23:07:19.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.195+0000 7fd101a4f640 1 -- 172.21.15.164:0/668023821 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94481105263808] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0fc02f040 con 0x7fd0f80ac040 2024-09-13T23:07:19.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.195+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f400f030 con 0x55ee18b6cb90 2024-09-13T23:07:19.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.195+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94481105268176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b7a360 con 0x55ee18b6cb90 2024-09-13T23:07:19.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.195+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b7bba0 con 0x7fd0fc019040 2024-09-13T23:07:19.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.196+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f400f030 con 0x7fd0fc019040 2024-09-13T23:07:19.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.196+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94481105270272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b7bed0 con 0x7fd0fc019040 2024-09-13T23:07:19.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.196+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b7c760 con 0x7fd0fc019040 2024-09-13T23:07:19.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.196+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94481105268176] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f400f030 con 0x55ee18b6cb90 2024-09-13T23:07:19.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.197+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94481105270272] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f400f030 con 0x7fd0fc019040 2024-09-13T23:07:19.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.198+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f400f030 con 0x7fd0fc019040 2024-09-13T23:07:19.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.198+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94481105261728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b7bf10 con 0x7fd0fc019040 2024-09-13T23:07:19.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.198+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b7cdf0 con 0x7fd0fc019040 2024-09-13T23:07:19.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.199+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94481105261728] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f400f030 con 0x7fd0fc019040 2024-09-13T23:07:19.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.199+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f400f030 con 0x7fd0fc019040 2024-09-13T23:07:19.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.199+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94481105271328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b7cdf0 con 0x7fd0fc019040 2024-09-13T23:07:19.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.199+0000 7fd105521800 20 add_watcher() i=0 2024-09-13T23:07:19.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.199+0000 7fd105521800 20 add_watcher() i=1 2024-09-13T23:07:19.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.199+0000 7fd105521800 20 add_watcher() i=2 2024-09-13T23:07:19.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.199+0000 7fd105521800 20 add_watcher() i=3 2024-09-13T23:07:19.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.199+0000 7fd105521800 20 add_watcher() i=4 2024-09-13T23:07:19.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.199+0000 7fd105521800 20 add_watcher() i=5 2024-09-13T23:07:19.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.199+0000 7fd105521800 20 add_watcher() i=6 2024-09-13T23:07:19.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.200+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94481105271328] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f400f030 con 0x7fd0fc019040 2024-09-13T23:07:19.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.200+0000 7fd105521800 20 add_watcher() i=7 2024-09-13T23:07:19.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.200+0000 7fd105521800 2 all 8 watchers are set, enabling cache 2024-09-13T23:07:19.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.200+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b800a0 con 0x55ee18b6cb90 2024-09-13T23:07:19.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.200+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd0f400f030 con 0x55ee18b6cb90 2024-09-13T23:07:19.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.200+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94481105287728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b7ce40 con 0x55ee18b6cb90 2024-09-13T23:07:19.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.201+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94481105287728] v34'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd0f400f030 con 0x55ee18b6cb90 2024-09-13T23:07:19.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.201+0000 7fcfb7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:19.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.201+0000 7fd105521800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:07:19.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.201+0000 7fd105521800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:07:19.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.202+0000 7fd105521800 5 note: GC not initialized 2024-09-13T23:07:19.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.202+0000 7fcfb6fe5640 20 reqs_thread_entry: start 2024-09-13T23:07:19.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.202+0000 7fd105521800 20 init_complete bucket index max shards: 11 2024-09-13T23:07:19.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.202+0000 7fd105521800 20 Filter name: none 2024-09-13T23:07:19.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.202+0000 7fcfb4fe1640 20 reqs_thread_entry: start 2024-09-13T23:07:19.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.202+0000 7fd105521800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-13T23:07:19.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.202+0000 7fd105521800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.202+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee18bb34b0 con 0x7fd0fc019040 2024-09-13T23:07:19.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.202+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7fd0f400f030 con 0x7fd0fc019040 2024-09-13T23:07:19.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.202+0000 7fd105521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.203+0000 7fd105521800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-09-13T23:07:19.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.203+0000 7fd105521800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-13T23:07:19.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.203+0000 7fd105521800 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-09-13T23:07:19.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.203+0000 7fd105521800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.203+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee18bb1af0 con 0x55ee18b72de0 2024-09-13T23:07:19.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.203+0000 7fd100a4d640 1 -- 172.21.15.164:0/668023821 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7fd0f8082030 con 0x55ee18b72de0 2024-09-13T23:07:19.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.203+0000 7fd105521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.203+0000 7fd105521800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-09-13T23:07:19.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.203+0000 7fd105521800 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-13T23:07:19.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.203+0000 7fd105521800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-13T23:07:19.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.203+0000 7fd105521800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-13T23:07:19.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.203+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee18bb25a0 con 0x7fd0fc019040 2024-09-13T23:07:19.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.204+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v34'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7fd0f400f030 con 0x7fd0fc019040 2024-09-13T23:07:19.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.204+0000 7fd105521800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-13T23:07:19.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.204+0000 7fd105521800 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-13T23:07:19.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.204+0000 7fd105521800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-13T23:07:19.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.204+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94481105494016 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee18bb6f50 con 0x7fd0f80ac040 2024-09-13T23:07:19.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.204+0000 7fd101a4f640 1 -- 172.21.15.164:0/668023821 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== watch-notify(notify (1) cookie 94481105253568 notify 146028888097 ret 0) ==== 575+0+0 (crc 0 0 0) 0x7fd0fc010040 con 0x7fd0f80ac040 2024-09-13T23:07:19.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.204+0000 7fcfe4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888097 cookie 94481105253568 notifier 4854 bl.length()=533 2024-09-13T23:07:19.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.204+0000 7fcfe4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-13T23:07:19.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.204+0000 7fcfe4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-13T23:07:19.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.204+0000 7fd101a4f640 1 -- 172.21.15.164:0/668023821 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(65 notify.0 [notify cookie 94481105494016 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd0fc02f040 con 0x7fd0f80ac040 2024-09-13T23:07:19.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.204+0000 7fcfe4ff9640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fcfc4003ea0 con 0x7fd0f80ac040 2024-09-13T23:07:19.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.205+0000 7fd101a4f640 1 -- 172.21.15.164:0/668023821 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0fc02f040 con 0x7fd0f80ac040 2024-09-13T23:07:19.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.205+0000 7fd101a4f640 1 -- 172.21.15.164:0/668023821 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== watch-notify(notify_complete (2) cookie 94481105494016 notify 146028888097 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd0fc026c30 con 0x7fd0f80ac040 2024-09-13T23:07:19.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.205+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee18bb2000 con 0x55ee18b72de0 2024-09-13T23:07:19.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.206+0000 7fd100a4d640 1 -- 172.21.15.164:0/668023821 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v34'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fd0f8082030 con 0x55ee18b72de0 2024-09-13T23:07:19.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.206+0000 7fd105521800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-13T23:07:19.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.206+0000 7fd105521800 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-13T23:07:19.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.206+0000 7fd105521800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-13T23:07:19.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.206+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94481105504896 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ee18bb7810 con 0x55ee18b6cb90 2024-09-13T23:07:19.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.206+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== watch-notify(notify (1) cookie 94481105257360 notify 146028888090 ret 0) ==== 218+0+0 (crc 0 0 0) 0x55ee18bb3170 con 0x55ee18b6cb90 2024-09-13T23:07:19.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.206+0000 7fcfd7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888090 cookie 94481105257360 notifier 4854 bl.length()=176 2024-09-13T23:07:19.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.206+0000 7fcfd7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-13T23:07:19.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.206+0000 7fcfd7fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-13T23:07:19.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.206+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(68 notify.1 [notify cookie 94481105504896 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd0f400f030 con 0x55ee18b6cb90 2024-09-13T23:07:19.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.206+0000 7fcfd7fff640 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fcf28003400 con 0x55ee18b6cb90 2024-09-13T23:07:19.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.206+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f400f030 con 0x55ee18b6cb90 2024-09-13T23:07:19.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.207+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== watch-notify(notify_complete (2) cookie 94481105504896 notify 146028888090 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd0f4037040 con 0x55ee18b6cb90 2024-09-13T23:07:19.218 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-09-13T23:07:19.203837Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:07:19.203826Z","tags":[],"group_ids":[]} 2024-09-13T23:07:19.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.207+0000 7fcfb7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:19.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.207+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94481105287728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee18bb11d0 con 0x55ee18b6cb90 2024-09-13T23:07:19.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.208+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94481105287728] v34'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd0f400f030 con 0x55ee18b6cb90 2024-09-13T23:07:19.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.208+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94481105253568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee18bb11d0 con 0x7fd0f80ac040 2024-09-13T23:07:19.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.209+0000 7fd101a4f640 1 -- 172.21.15.164:0/668023821 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94481105253568] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0fc02f040 con 0x7fd0f80ac040 2024-09-13T23:07:19.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.209+0000 7fd105521800 20 remove_watcher() i=0 2024-09-13T23:07:19.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.209+0000 7fd105521800 2 removed watcher, disabling cache 2024-09-13T23:07:19.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.209+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94481105257360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee18bb11d0 con 0x55ee18b6cb90 2024-09-13T23:07:19.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.210+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94481105257360] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f400f030 con 0x55ee18b6cb90 2024-09-13T23:07:19.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.210+0000 7fd105521800 20 remove_watcher() i=1 2024-09-13T23:07:19.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.210+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94481105251056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee18bb11d0 con 0x55ee18b72de0 2024-09-13T23:07:19.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.212+0000 7fd100a4d640 1 -- 172.21.15.164:0/668023821 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94481105251056] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f8082030 con 0x55ee18b72de0 2024-09-13T23:07:19.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.212+0000 7fd105521800 20 remove_watcher() i=2 2024-09-13T23:07:19.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.212+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94481105263808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b78390 con 0x7fd0f80ac040 2024-09-13T23:07:19.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.213+0000 7fd101a4f640 1 -- 172.21.15.164:0/668023821 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94481105263808] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0fc02f040 con 0x7fd0f80ac040 2024-09-13T23:07:19.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.213+0000 7fd105521800 20 remove_watcher() i=3 2024-09-13T23:07:19.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.213+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94481105268176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b76af0 con 0x55ee18b6cb90 2024-09-13T23:07:19.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.214+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94481105268176] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f400f030 con 0x55ee18b6cb90 2024-09-13T23:07:19.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.214+0000 7fd105521800 20 remove_watcher() i=4 2024-09-13T23:07:19.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.214+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94481105270272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b78390 con 0x7fd0fc019040 2024-09-13T23:07:19.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.215+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94481105270272] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f400f030 con 0x7fd0fc019040 2024-09-13T23:07:19.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.215+0000 7fd105521800 20 remove_watcher() i=5 2024-09-13T23:07:19.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.215+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94481105261728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b7add0 con 0x7fd0fc019040 2024-09-13T23:07:19.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.216+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94481105261728] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f400f030 con 0x7fd0fc019040 2024-09-13T23:07:19.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.216+0000 7fd105521800 20 remove_watcher() i=6 2024-09-13T23:07:19.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.216+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94481105271328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ee18b76af0 con 0x7fd0fc019040 2024-09-13T23:07:19.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.217+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94481105271328] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0f400f030 con 0x7fd0fc019040 2024-09-13T23:07:19.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.217+0000 7fd105521800 20 remove_watcher() i=7 2024-09-13T23:07:19.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.217+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fd0fc019040 msgr2=0x7fd0fc019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.217+0000 7fd105521800 1 --2- 172.21.15.164:0/668023821 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fd0fc019040 0x7fd0fc019930 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.217+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ee18b6cb90 msgr2=0x55ee18b6f050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.217+0000 7fd105521800 1 --2- 172.21.15.164:0/668023821 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ee18b6cb90 0x55ee18b6f050 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.217+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fd0f80ac040 msgr2=0x7fd0f80667f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.217+0000 7fd105521800 1 --2- 172.21.15.164:0/668023821 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fd0f80ac040 0x7fd0f80667f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.217+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55ee18b72de0 msgr2=0x55ee18b751d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.217+0000 7fd105521800 1 --2- 172.21.15.164:0/668023821 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55ee18b72de0 0x55ee18b751d0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.218+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fcfcc036b40 msgr2=0x7fcfcc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.218+0000 7fd105521800 1 --2- 172.21.15.164:0/668023821 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fcfcc036b40 0x7fcfcc039000 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc00f010 tx=0x7fd0fc00c040 comp rx=0 tx=0).stop 2024-09-13T23:07:19.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.218+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee18b59b40 msgr2=0x55ee18b61040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.218+0000 7fd105521800 1 --2- 172.21.15.164:0/668023821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee18b59b40 0x55ee18b61040 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fd0f805b850 tx=0x7fd0f8091320 comp rx=0 tx=0).stop 2024-09-13T23:07:19.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.218+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 reap_dead start 2024-09-13T23:07:19.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.218+0000 7fd10124e640 1 -- 172.21.15.164:0/668023821 reap_dead start 2024-09-13T23:07:19.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.218+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 shutdown_connections 2024-09-13T23:07:19.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.218+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 >> 172.21.15.164:0/668023821 conn(0x55ee18b55ea0 msgr2=0x55ee18b53f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.218+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 shutdown_connections 2024-09-13T23:07:19.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.218+0000 7fd105521800 1 -- 172.21.15.164:0/668023821 wait complete. 2024-09-13T23:07:19.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.218+0000 7fd105521800 1 -- 172.21.15.164:0/1099796271 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fcfd8036b40 msgr2=0x7fcfd8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.218+0000 7fd105521800 1 --2- 172.21.15.164:0/1099796271 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fcfd8036b40 0x7fcfd8039000 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55ee18b3d660 tx=0x7fd0fc000f90 comp rx=0 tx=0).stop 2024-09-13T23:07:19.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.218+0000 7fd105521800 1 -- 172.21.15.164:0/1099796271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee18b4cf50 msgr2=0x55ee18b4d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.218+0000 7fd105521800 1 --2- 172.21.15.164:0/1099796271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee18b4cf50 0x55ee18b4d370 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd0f80460d0 tx=0x7fd0f8002fb0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.218+0000 7fd105521800 1 -- 172.21.15.164:0/1099796271 shutdown_connections 2024-09-13T23:07:19.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.218+0000 7fd105521800 1 --2- 172.21.15.164:0/1099796271 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fcfd8036b40 0x7fcfd8039000 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.218+0000 7fd105521800 1 --2- 172.21.15.164:0/1099796271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee18b4cf50 0x55ee18b4d370 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.218+0000 7fd105521800 1 -- 172.21.15.164:0/1099796271 >> 172.21.15.164:0/1099796271 conn(0x55ee18b41ee0 msgr2=0x55ee18b44a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.218+0000 7fd105521800 1 -- 172.21.15.164:0/1099796271 shutdown_connections 2024-09-13T23:07:19.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.218+0000 7fd105521800 1 -- 172.21.15.164:0/1099796271 wait complete. 2024-09-13T23:07:19.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.218+0000 7fd105521800 1 -- 172.21.15.164:0/633610112 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ee18a40930 msgr2=0x55ee18b3c570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.218+0000 7fd105521800 1 --2- 172.21.15.164:0/633610112 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ee18a40930 0x55ee18b3c570 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.219+0000 7fd105521800 1 -- 172.21.15.164:0/633610112 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fcfe8036b90 msgr2=0x7fcfe8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.219+0000 7fd105521800 1 --2- 172.21.15.164:0/633610112 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fcfe8036b90 0x7fcfe8039050 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8057000 tx=0x7fd0f8052000 comp rx=0 tx=0).stop 2024-09-13T23:07:19.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.219+0000 7fd105521800 1 -- 172.21.15.164:0/633610112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee189b0680 msgr2=0x55ee18b35500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.219+0000 7fd105521800 1 --2- 172.21.15.164:0/633610112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee189b0680 0x55ee18b35500 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4001b10 tx=0x7fd0f4000f40 comp rx=0 tx=0).stop 2024-09-13T23:07:19.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.219+0000 7fd105521800 1 -- 172.21.15.164:0/633610112 shutdown_connections 2024-09-13T23:07:19.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.219+0000 7fd105521800 1 --2- 172.21.15.164:0/633610112 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ee18a40930 0x55ee18b3c570 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.219+0000 7fd105521800 1 --2- 172.21.15.164:0/633610112 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fcfe8036b90 0x7fcfe8039050 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.219+0000 7fd105521800 1 --2- 172.21.15.164:0/633610112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ee189b0680 0x55ee18b35500 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.219+0000 7fd105521800 1 -- 172.21.15.164:0/633610112 >> 172.21.15.164:0/633610112 conn(0x55ee18a36de0 msgr2=0x55ee18b26e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.219+0000 7fd105521800 1 -- 172.21.15.164:0/633610112 shutdown_connections 2024-09-13T23:07:19.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.219+0000 7fd105521800 1 -- 172.21.15.164:0/633610112 wait complete. 2024-09-13T23:07:19.229 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-13T23:07:19.203837Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:07:19.203826Z', 'tags': [], 'group_ids': []} 2024-09-13T23:07:19.229 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-13T23:07:19.203837Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:07:19.203826Z', 'tags': [], 'group_ids': []} 2024-09-13T23:07:19.229 ERROR:root:0 2024-09-13T23:07:19.230 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:07:19.242 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:07:19.243 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-09-13T23:07:19.243 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-09-13T23:07:19.243 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-09-13T23:07:19.287 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:07:19.288 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:07:19.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.288+0000 7f0bf6524800 1 Processor -- start 2024-09-13T23:07:19.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.288+0000 7f0bf6524800 1 -- start start 2024-09-13T23:07:19.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.288+0000 7f0bf6524800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5612ef974550 0x5612ef974950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.288+0000 7f0bf6524800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5612ef834b30 con 0x5612ef974e90 2024-09-13T23:07:19.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.288+0000 7f0bf6524800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x5612ef816360 con 0x5612ef974550 2024-09-13T23:07:19.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.288+0000 7f0bf22d9640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5612ef974550 0x5612ef974950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.288+0000 7f0bf1ad8640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x5612ef974e90 0x5612ef979a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:37868/0 (socket says 172.21.15.164:37868) 2024-09-13T23:07:19.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.288+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/1178197959 learned_addr learned my addr 172.21.15.164:0/1178197959 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:07:19.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.288+0000 7f0bf22d9640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5612ef974550 0x5612ef974950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54514/0 (socket says 172.21.15.164:54514) 2024-09-13T23:07:19.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.288+0000 7f0bf22d9640 1 -- 172.21.15.164:0/1178197959 >> v1:172.21.15.17:6789/0 conn(0x5612ef974e90 legacy=0x5612ef979a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.288+0000 7f0bf22d9640 1 -- 172.21.15.164:0/1178197959 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612ef83ce00 con 0x5612ef974550 2024-09-13T23:07:19.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.290+0000 7f0bf22d9640 1 --2- 172.21.15.164:0/1178197959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612ef974550 0x5612ef974950 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f0bec005fd0 tx=0x7f0bec045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73dad8ba7a2d5e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.290+0000 7f0bf12d7640 1 -- 172.21.15.164:0/1178197959 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bec058530 con 0x5612ef974550 2024-09-13T23:07:19.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.290+0000 7f0bf12d7640 1 -- 172.21.15.164:0/1178197959 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bec0586d0 con 0x5612ef974550 2024-09-13T23:07:19.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.290+0000 7f0bf12d7640 1 -- 172.21.15.164:0/1178197959 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bec0589d0 con 0x5612ef974550 2024-09-13T23:07:19.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.291+0000 7f0bf6524800 1 -- 172.21.15.164:0/1178197959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612ef974550 msgr2=0x5612ef974950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.291+0000 7f0bf6524800 1 --2- 172.21.15.164:0/1178197959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612ef974550 0x5612ef974950 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f0bec005fd0 tx=0x7f0bec045c30 comp rx=0 tx=0).stop 2024-09-13T23:07:19.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.291+0000 7f0bf6524800 1 -- 172.21.15.164:0/1178197959 shutdown_connections 2024-09-13T23:07:19.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.291+0000 7f0bf6524800 1 --2- 172.21.15.164:0/1178197959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612ef974550 0x5612ef974950 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.291+0000 7f0bf6524800 1 -- 172.21.15.164:0/1178197959 >> 172.21.15.164:0/1178197959 conn(0x5612ef96fde0 msgr2=0x5612ef972200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.291+0000 7f0bf6524800 1 -- 172.21.15.164:0/1178197959 shutdown_connections 2024-09-13T23:07:19.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.291+0000 7f0bf6524800 1 -- 172.21.15.164:0/1178197959 wait complete. 2024-09-13T23:07:19.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.305+0000 7f0bf6524800 1 Processor -- start 2024-09-13T23:07:19.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.305+0000 7f0bf6524800 1 -- start start 2024-09-13T23:07:19.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.305+0000 7f0bf6524800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612ef974550 0x5612ef8e9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.305+0000 7f0bf6524800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5612ef8c1330 con 0x5612ef974550 2024-09-13T23:07:19.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.305+0000 7f0bf22d9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612ef974550 0x5612ef8e9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.305+0000 7f0bf22d9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612ef974550 0x5612ef8e9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54524/0 (socket says 172.21.15.164:54524) 2024-09-13T23:07:19.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.305+0000 7f0bf22d9640 1 -- 172.21.15.164:0/1806572857 learned_addr learned my addr 172.21.15.164:0/1806572857 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.306+0000 7f0bf22d9640 1 -- 172.21.15.164:0/1806572857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612ef80ebc0 con 0x5612ef974550 2024-09-13T23:07:19.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.306+0000 7f0bf22d9640 1 --2- 172.21.15.164:0/1806572857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612ef974550 0x5612ef8e9580 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00a3f0 tx=0x7f0bec051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d6ae94b967db21 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.306+0000 7f0ae0608640 1 -- 172.21.15.164:0/1806572857 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bec058a30 con 0x5612ef974550 2024-09-13T23:07:19.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.306+0000 7f0ae0608640 1 -- 172.21.15.164:0/1806572857 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bec068070 con 0x5612ef974550 2024-09-13T23:07:19.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.306+0000 7f0ae0608640 1 -- 172.21.15.164:0/1806572857 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bec058d60 con 0x5612ef974550 2024-09-13T23:07:19.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.307+0000 7f0bf6524800 1 -- 172.21.15.164:0/1806572857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612ef974550 msgr2=0x5612ef8e9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.307+0000 7f0bf6524800 1 --2- 172.21.15.164:0/1806572857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612ef974550 0x5612ef8e9580 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00a3f0 tx=0x7f0bec051000 comp rx=0 tx=0).stop 2024-09-13T23:07:19.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.307+0000 7f0bf6524800 1 -- 172.21.15.164:0/1806572857 shutdown_connections 2024-09-13T23:07:19.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.307+0000 7f0bf6524800 1 --2- 172.21.15.164:0/1806572857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612ef974550 0x5612ef8e9580 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.307+0000 7f0bf6524800 1 -- 172.21.15.164:0/1806572857 >> 172.21.15.164:0/1806572857 conn(0x5612ef96fde0 msgr2=0x5612efa5f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.307+0000 7f0bf6524800 1 -- 172.21.15.164:0/1806572857 shutdown_connections 2024-09-13T23:07:19.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.307+0000 7f0bf6524800 1 -- 172.21.15.164:0/1806572857 wait complete. 2024-09-13T23:07:19.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.307+0000 7f0bf6524800 1 Processor -- start 2024-09-13T23:07:19.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.307+0000 7f0bf6524800 1 -- start start 2024-09-13T23:07:19.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.308+0000 7f0bf6524800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612ef974550 0x5612efa6c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.308+0000 7f0bf6524800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5612ef97b570 con 0x5612ef974550 2024-09-13T23:07:19.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.308+0000 7f0bf22d9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612ef974550 0x5612efa6c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.308+0000 7f0bf22d9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612ef974550 0x5612efa6c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54532/0 (socket says 172.21.15.164:54532) 2024-09-13T23:07:19.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.308+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2893219314 learned_addr learned my addr 172.21.15.164:0/2893219314 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.308+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2893219314 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612ef822fe0 con 0x5612ef974550 2024-09-13T23:07:19.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.308+0000 7f0bf22d9640 1 --2- 172.21.15.164:0/2893219314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612ef974550 0x5612efa6c120 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f0bec046130 tx=0x7f0bec003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.308+0000 7f0adee05640 1 -- 172.21.15.164:0/2893219314 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bec0636b0 con 0x5612ef974550 2024-09-13T23:07:19.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.308+0000 7f0adee05640 1 -- 172.21.15.164:0/2893219314 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bec063850 con 0x5612ef974550 2024-09-13T23:07:19.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.308+0000 7f0adee05640 1 -- 172.21.15.164:0/2893219314 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bec063b70 con 0x5612ef974550 2024-09-13T23:07:19.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.308+0000 7f0bf6524800 1 -- 172.21.15.164:0/2893219314 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612efa6c660 con 0x5612ef974550 2024-09-13T23:07:19.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.309+0000 7f0bf6524800 1 -- 172.21.15.164:0/2893219314 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612efa6cb80 con 0x5612ef974550 2024-09-13T23:07:19.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.309+0000 7f0adee05640 1 -- 172.21.15.164:0/2893219314 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0bec075020 con 0x5612ef974550 2024-09-13T23:07:19.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.309+0000 7f0adee05640 1 --2- 172.21.15.164:0/2893219314 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0ad8036b90 0x7f0ad8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.309+0000 7f0adee05640 1 -- 172.21.15.164:0/2893219314 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0bec090dd0 con 0x5612ef974550 2024-09-13T23:07:19.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.310+0000 7f0bf1ad8640 1 --2- 172.21.15.164:0/2893219314 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0ad8036b90 0x7f0ad8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.310+0000 7f0bf6524800 1 --2- 172.21.15.164:0/2893219314 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5612ef974e90 0x5612efa73190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.310+0000 7f0bf6524800 1 -- 172.21.15.164:0/2893219314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612efa736d0 con 0x5612ef974e90 2024-09-13T23:07:19.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.310+0000 7f0bf2ada640 1 --2- 172.21.15.164:0/2893219314 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5612ef974e90 0x5612efa73190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.310+0000 7f0bf1ad8640 1 --2- 172.21.15.164:0/2893219314 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0ad8036b90 0x7f0ad8039050 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc000f60 tx=0x7f0bdc0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.310+0000 7f0bf2ada640 1 --2- 172.21.15.164:0/2893219314 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5612ef974e90 0x5612efa73190 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.310+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2893219314 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0be40083e0 con 0x5612ef974e90 2024-09-13T23:07:19.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.310+0000 7f0bf6524800 1 -- 172.21.15.164:0/2893219314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612efa70740 con 0x5612ef974e90 2024-09-13T23:07:19.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.311+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2893219314 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0be40083e0 con 0x5612ef974e90 2024-09-13T23:07:19.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.311+0000 7f0bf6524800 1 -- 172.21.15.164:0/2893219314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612efa754b0 con 0x5612ef974e90 2024-09-13T23:07:19.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.311+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2893219314 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0be40083e0 con 0x5612ef974e90 2024-09-13T23:07:19.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.311+0000 7f0bf6524800 1 -- 172.21.15.164:0/2893219314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612efa746e0 con 0x5612ef974e90 2024-09-13T23:07:19.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.311+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2893219314 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0be40083e0 con 0x5612ef974e90 2024-09-13T23:07:19.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.311+0000 7f0bf6524800 1 -- 172.21.15.164:0/2893219314 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612efa74ad0 con 0x5612ef974e90 2024-09-13T23:07:19.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.311+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2893219314 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0be40083e0 con 0x5612ef974e90 2024-09-13T23:07:19.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.312+0000 7f0bf6524800 1 Processor -- start 2024-09-13T23:07:19.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.312+0000 7f0bf6524800 1 -- start start 2024-09-13T23:07:19.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.312+0000 7f0bf6524800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612efa83af0 0x5612efa83f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.312+0000 7f0bf6524800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5612ef810580 con 0x5612efa83af0 2024-09-13T23:07:19.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.312+0000 7f0bf1ad8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612efa83af0 0x5612efa83f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.312+0000 7f0bf1ad8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612efa83af0 0x5612efa83f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54542/0 (socket says 172.21.15.164:54542) 2024-09-13T23:07:19.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.312+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/3439803189 learned_addr learned my addr 172.21.15.164:0/3439803189 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.313+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/3439803189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612efa84450 con 0x5612efa83af0 2024-09-13T23:07:19.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.313+0000 7f0bf1ad8640 1 --2- 172.21.15.164:0/3439803189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612efa83af0 0x5612efa83f10 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc001ed0 tx=0x7f0bdc00d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.313+0000 7f0ad7fff640 1 -- 172.21.15.164:0/3439803189 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bdc01b550 con 0x5612efa83af0 2024-09-13T23:07:19.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.313+0000 7f0ad7fff640 1 -- 172.21.15.164:0/3439803189 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bdc01b6f0 con 0x5612efa83af0 2024-09-13T23:07:19.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.313+0000 7f0bf6524800 1 -- 172.21.15.164:0/3439803189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612efa846e0 con 0x5612efa83af0 2024-09-13T23:07:19.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.313+0000 7f0ad7fff640 1 -- 172.21.15.164:0/3439803189 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bdc01b9d0 con 0x5612efa83af0 2024-09-13T23:07:19.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.313+0000 7f0bf6524800 1 -- 172.21.15.164:0/3439803189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612efa873c0 con 0x5612efa83af0 2024-09-13T23:07:19.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.314+0000 7f0ad7fff640 1 -- 172.21.15.164:0/3439803189 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0bdc023020 con 0x5612efa83af0 2024-09-13T23:07:19.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.314+0000 7f0ad7fff640 1 --2- 172.21.15.164:0/3439803189 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0acc036b40 0x7f0acc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.314+0000 7f0ad7fff640 1 -- 172.21.15.164:0/3439803189 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0bdc021020 con 0x5612efa83af0 2024-09-13T23:07:19.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.314+0000 7f0bf2ada640 1 --2- 172.21.15.164:0/3439803189 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0acc036b40 0x7f0acc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.314+0000 7f0bf6524800 1 Processor -- start 2024-09-13T23:07:19.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.314+0000 7f0bf6524800 1 -- start start 2024-09-13T23:07:19.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.315+0000 7f0bf2ada640 1 --2- 172.21.15.164:0/3439803189 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0acc036b40 0x7f0acc039000 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x5612efa74200 tx=0x7f0be4000f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.315+0000 7f0bf6524800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612efa63610 0x5612efa639f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.315+0000 7f0bf6524800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5612efa676d0 con 0x5612efa63610 2024-09-13T23:07:19.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.315+0000 7f0bf1ad8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612efa63610 0x5612efa639f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.315+0000 7f0bf1ad8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612efa63610 0x5612efa639f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54546/0 (socket says 172.21.15.164:54546) 2024-09-13T23:07:19.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.315+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/3388230870 learned_addr learned my addr 172.21.15.164:0/3388230870 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.315+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/3388230870 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612efa63f30 con 0x5612efa63610 2024-09-13T23:07:19.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.315+0000 7f0bf1ad8640 1 --2- 172.21.15.164:0/3388230870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612efa63610 0x5612efa639f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc04d180 tx=0x7f0bdc046be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7f354dc10fc329 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.315+0000 7f0ad5ffb640 1 -- 172.21.15.164:0/3388230870 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bdc01be20 con 0x5612efa63610 2024-09-13T23:07:19.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.315+0000 7f0ad5ffb640 1 -- 172.21.15.164:0/3388230870 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bdc046070 con 0x5612efa63610 2024-09-13T23:07:19.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.315+0000 7f0ad5ffb640 1 -- 172.21.15.164:0/3388230870 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bdc00c360 con 0x5612efa63610 2024-09-13T23:07:19.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.316+0000 7f0bf6524800 1 -- 172.21.15.164:0/3388230870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612efa63610 msgr2=0x5612efa639f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.316+0000 7f0bf6524800 1 --2- 172.21.15.164:0/3388230870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612efa63610 0x5612efa639f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc04d180 tx=0x7f0bdc046be0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.316+0000 7f0bf6524800 1 -- 172.21.15.164:0/3388230870 shutdown_connections 2024-09-13T23:07:19.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.316+0000 7f0bf6524800 1 --2- 172.21.15.164:0/3388230870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612efa63610 0x5612efa639f0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.316+0000 7f0bf6524800 1 -- 172.21.15.164:0/3388230870 >> 172.21.15.164:0/3388230870 conn(0x5612efa8cb60 msgr2=0x5612efa8ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.316+0000 7f0bf6524800 1 -- 172.21.15.164:0/3388230870 shutdown_connections 2024-09-13T23:07:19.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.316+0000 7f0bf6524800 1 -- 172.21.15.164:0/3388230870 wait complete. 2024-09-13T23:07:19.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.316+0000 7f0bf6524800 1 Processor -- start 2024-09-13T23:07:19.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.316+0000 7f0bf6524800 1 -- start start 2024-09-13T23:07:19.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.316+0000 7f0bf6524800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612efa63610 0x5612efa99ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.316+0000 7f0bf6524800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5612efa64510 con 0x5612efa63610 2024-09-13T23:07:19.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.317+0000 7f0bf1ad8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612efa63610 0x5612efa99ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.317+0000 7f0bf1ad8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612efa63610 0x5612efa99ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54562/0 (socket says 172.21.15.164:54562) 2024-09-13T23:07:19.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.317+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 learned_addr learned my addr 172.21.15.164:0/2379030902 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.317+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612efa9a430 con 0x5612efa63610 2024-09-13T23:07:19.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.317+0000 7f0bf1ad8640 1 --2- 172.21.15.164:0/2379030902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612efa63610 0x5612efa99ef0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc04d180 tx=0x7f0bdc04d110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.317+0000 7f0ac3fff640 1 -- 172.21.15.164:0/2379030902 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bdc01be20 con 0x5612efa63610 2024-09-13T23:07:19.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.317+0000 7f0ac3fff640 1 -- 172.21.15.164:0/2379030902 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bdc00c360 con 0x5612efa63610 2024-09-13T23:07:19.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.317+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612efa9a6c0 con 0x5612efa63610 2024-09-13T23:07:19.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.317+0000 7f0ac3fff640 1 -- 172.21.15.164:0/2379030902 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bdc046d10 con 0x5612efa63610 2024-09-13T23:07:19.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.317+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612efa9a6c0 con 0x5612efa63610 2024-09-13T23:07:19.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.318+0000 7f0ac3fff640 1 -- 172.21.15.164:0/2379030902 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0bdc025980 con 0x5612efa63610 2024-09-13T23:07:19.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.318+0000 7f0ac3fff640 1 --2- 172.21.15.164:0/2379030902 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0abc036b40 0x7f0abc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.318+0000 7f0ac3fff640 1 -- 172.21.15.164:0/2379030902 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0bdc039d10 con 0x5612efa63610 2024-09-13T23:07:19.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.318+0000 7f0bf2ada640 1 --2- 172.21.15.164:0/2379030902 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0abc036b40 0x7f0abc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.319+0000 7f0bf2ada640 1 --2- 172.21.15.164:0/2379030902 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0abc036b40 0x7f0abc039000 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0be400f010 tx=0x7f0be400c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.319+0000 7f0bf6524800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.319+0000 7f0bf6524800 1 --2- 172.21.15.164:0/2379030902 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5612efaa57e0 0x5612efaa7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.319+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa83f0 con 0x5612efaa57e0 2024-09-13T23:07:19.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.319+0000 7f0bf22d9640 1 --2- 172.21.15.164:0/2379030902 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5612efaa57e0 0x5612efaa7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.319+0000 7f0bf22d9640 1 --2- 172.21.15.164:0/2379030902 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5612efaa57e0 0x5612efaa7ca0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.320+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.320+0000 7f0bf6524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.320+0000 7f0bf6524800 20 realm 2024-09-13T23:07:19.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.320+0000 7f0bf6524800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.320+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa8800 con 0x5612efaa57e0 2024-09-13T23:07:19.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.320+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.320+0000 7f0bf6524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.320+0000 7f0bf6524800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:07:19.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.320+0000 7f0bf6524800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.320+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa90d0 con 0x5612efaa57e0 2024-09-13T23:07:19.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.320+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.320+0000 7f0bf6524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.320+0000 7f0bf6524800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.320+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9470 con 0x5612efaa57e0 2024-09-13T23:07:19.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.320+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.320+0000 7f0bf6524800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:19.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.320+0000 7f0bf6524800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.320+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x5612efaa57e0 2024-09-13T23:07:19.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.321+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.321+0000 7f0bf6524800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:07:19.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.321+0000 7f0bf6524800 20 searching for the correct realm 2024-09-13T23:07:19.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.321+0000 7f0bf6524800 1 --2- 172.21.15.164:0/2379030902 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5612efaaba30 0x5612efaade20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.321+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaae400 con 0x5612efaaba30 2024-09-13T23:07:19.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.321+0000 7f0bf1ad8640 1 --2- 172.21.15.164:0/2379030902 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5612efaaba30 0x5612efaade20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.321+0000 7f0bf1ad8640 1 --2- 172.21.15.164:0/2379030902 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5612efaaba30 0x5612efaade20 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.321+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bdc009050 con 0x5612efaaba30 2024-09-13T23:07:19.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.321+0000 7f0bf1ad8640 1 --2- 172.21.15.164:0/2379030902 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f0bdc043b70 0x7f0bdc043070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.321+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaae400 con 0x7f0bdc043b70 2024-09-13T23:07:19.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.321+0000 7f0bf2ada640 1 --2- 172.21.15.164:0/2379030902 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f0bdc043b70 0x7f0bdc043070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.322+0000 7f0bf2ada640 1 --2- 172.21.15.164:0/2379030902 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f0bdc043b70 0x7f0bdc043070 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.322+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be402f040 con 0x7f0bdc043b70 2024-09-13T23:07:19.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.322+0000 7f0bf2ada640 1 --2- 172.21.15.164:0/2379030902 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f0be4019040 0x7f0be4019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.322+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaae400 con 0x7f0be4019040 2024-09-13T23:07:19.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.322+0000 7f0bf22d9640 1 --2- 172.21.15.164:0/2379030902 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f0be4019040 0x7f0be4019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.323+0000 7f0bf22d9640 1 --2- 172.21.15.164:0/2379030902 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f0be4019040 0x7f0be4019930 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.323+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.323+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x5612efaa57e0 2024-09-13T23:07:19.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.323+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.323+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x5612efaa57e0 2024-09-13T23:07:19.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.323+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.323+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x7f0be4019040 2024-09-13T23:07:19.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.324+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.324+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x7f0be4019040 2024-09-13T23:07:19.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.324+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.324+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x7f0bdc043b70 2024-09-13T23:07:19.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.324+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be402f040 con 0x7f0bdc043b70 2024-09-13T23:07:19.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.324+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x5612efaaba30 2024-09-13T23:07:19.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.324+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bdc009050 con 0x5612efaaba30 2024-09-13T23:07:19.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.324+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x5612efaa57e0 2024-09-13T23:07:19.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.324+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.325+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x7f0be4019040 2024-09-13T23:07:19.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.325+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.325+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x5612efaa57e0 2024-09-13T23:07:19.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.325+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.325+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x7f0bdc043b70 2024-09-13T23:07:19.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.325+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0be402f040 con 0x7f0bdc043b70 2024-09-13T23:07:19.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.325+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x5612efaaba30 2024-09-13T23:07:19.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.326+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bdc009050 con 0x5612efaaba30 2024-09-13T23:07:19.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.326+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x5612efaaba30 2024-09-13T23:07:19.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.326+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bdc009050 con 0x5612efaaba30 2024-09-13T23:07:19.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.326+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x7f0be4019040 2024-09-13T23:07:19.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.326+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.326+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x5612efaaba30 2024-09-13T23:07:19.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.326+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bdc009050 con 0x5612efaaba30 2024-09-13T23:07:19.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.326+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x5612efaaba30 2024-09-13T23:07:19.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.327+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bdc009050 con 0x5612efaaba30 2024-09-13T23:07:19.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.327+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x5612efaa57e0 2024-09-13T23:07:19.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.327+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.327+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x5612efaa57e0 2024-09-13T23:07:19.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.327+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.327+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x7f0be4019040 2024-09-13T23:07:19.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.327+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.327+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x5612efaaba30 2024-09-13T23:07:19.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.327+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bdc009050 con 0x5612efaaba30 2024-09-13T23:07:19.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.327+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x7f0bdc043b70 2024-09-13T23:07:19.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.328+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be402f040 con 0x7f0bdc043b70 2024-09-13T23:07:19.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.328+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x5612efaa57e0 2024-09-13T23:07:19.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.328+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.328+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x7f0be4019040 2024-09-13T23:07:19.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.328+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.328+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x5612efaaba30 2024-09-13T23:07:19.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.329+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bdc009050 con 0x5612efaaba30 2024-09-13T23:07:19.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.329+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x7f0be4019040 2024-09-13T23:07:19.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.329+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.329+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x7f0bdc043b70 2024-09-13T23:07:19.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.329+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be402f040 con 0x7f0bdc043b70 2024-09-13T23:07:19.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.329+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x5612efaaba30 2024-09-13T23:07:19.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.329+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bdc009050 con 0x5612efaaba30 2024-09-13T23:07:19.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.329+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x7f0bdc043b70 2024-09-13T23:07:19.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.330+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be402f040 con 0x7f0bdc043b70 2024-09-13T23:07:19.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.330+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x5612efaa57e0 2024-09-13T23:07:19.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.330+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.330+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5612efaa9cc0 con 0x7f0bdc043b70 2024-09-13T23:07:19.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.330+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be402f040 con 0x7f0bdc043b70 2024-09-13T23:07:19.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.330+0000 7f0bf6524800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:07:19.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.330+0000 7f0bf6524800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:07:19.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.330+0000 7f0bf6524800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:07:19.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.330+0000 7f0bf6524800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:07:19.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.330+0000 7f0bf6524800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:07:19.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.330+0000 7f0bf6524800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:07:19.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.330+0000 7f0bf6524800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.330+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612efaaa510 con 0x5612efaa57e0 2024-09-13T23:07:19.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.330+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.330+0000 7f0bf6524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.330+0000 7f0bf6524800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.330+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612efaaa900 con 0x5612efaa57e0 2024-09-13T23:07:19.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.331+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.331+0000 7f0bf6524800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:19.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.331+0000 7f0bf6524800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.331+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612efaaa900 con 0x5612efaa57e0 2024-09-13T23:07:19.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.331+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.331+0000 7f0bf6524800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:07:19.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.331+0000 7f0bf6524800 20 zone default found 2024-09-13T23:07:19.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.331+0000 7f0bf6524800 4 Realm: () 2024-09-13T23:07:19.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.331+0000 7f0bf6524800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:07:19.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.331+0000 7f0bf6524800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:07:19.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.331+0000 7f0bf6524800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:07:19.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.331+0000 7f0bf6524800 20 zonegroup default 2024-09-13T23:07:19.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.331+0000 7f0bf6524800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.331+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612efaae880 con 0x7f0be4019040 2024-09-13T23:07:19.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.331+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.331+0000 7f0bf6524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.331+0000 7f0bf6524800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.331+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612efab0260 con 0x5612efaaba30 2024-09-13T23:07:19.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.331+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0bdc009050 con 0x5612efaaba30 2024-09-13T23:07:19.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.331+0000 7f0bf6524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.331+0000 7f0bf6524800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.331+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612efab0600 con 0x5612efaaba30 2024-09-13T23:07:19.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.332+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0bdc009050 con 0x5612efaaba30 2024-09-13T23:07:19.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.332+0000 7f0bf6524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.332+0000 7f0bf6524800 20 started sync module instance, tier type = 2024-09-13T23:07:19.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.332+0000 7f0bf6524800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:07:19.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.332+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efaaf700 con 0x7f0bdc043b70 2024-09-13T23:07:19.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.333+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be402f040 con 0x7f0bdc043b70 2024-09-13T23:07:19.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.333+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94639330360096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efaaf700 con 0x7f0bdc043b70 2024-09-13T23:07:19.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.333+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efab0fc0 con 0x5612efaa57e0 2024-09-13T23:07:19.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.334+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94639330360096] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be402f040 con 0x7f0bdc043b70 2024-09-13T23:07:19.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.334+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.334+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94639330358320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efab0fc0 con 0x5612efaa57e0 2024-09-13T23:07:19.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.334+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efab1980 con 0x5612efaaba30 2024-09-13T23:07:19.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.335+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94639330358320] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.335+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bdc009050 con 0x5612efaaba30 2024-09-13T23:07:19.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.335+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94639330364176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efab0f30 con 0x5612efaaba30 2024-09-13T23:07:19.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.335+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efab2870 con 0x7f0bdc043b70 2024-09-13T23:07:19.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.336+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be402f040 con 0x7f0bdc043b70 2024-09-13T23:07:19.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.336+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94639330364176] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bdc009050 con 0x5612efaaba30 2024-09-13T23:07:19.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.336+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94639330370976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efab2e70 con 0x7f0bdc043b70 2024-09-13T23:07:19.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.337+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efab36c0 con 0x5612efaa57e0 2024-09-13T23:07:19.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.339+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.339+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94639330373712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efab3ac0 con 0x5612efaa57e0 2024-09-13T23:07:19.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.339+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efab45c0 con 0x7f0be4019040 2024-09-13T23:07:19.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.340+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94639330370976] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be402f040 con 0x7f0bdc043b70 2024-09-13T23:07:19.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.345+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94639330373712] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.345+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.345+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94639330377904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efab4580 con 0x7f0be4019040 2024-09-13T23:07:19.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.345+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efab4e90 con 0x7f0be4019040 2024-09-13T23:07:19.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.346+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94639330377904] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.346+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.346+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94639330372032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efab4580 con 0x7f0be4019040 2024-09-13T23:07:19.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.346+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efab5460 con 0x7f0be4019040 2024-09-13T23:07:19.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.347+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94639330372032] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.348+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.348+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94639330380176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efab5460 con 0x7f0be4019040 2024-09-13T23:07:19.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.348+0000 7f0bf6524800 20 add_watcher() i=0 2024-09-13T23:07:19.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.348+0000 7f0bf6524800 20 add_watcher() i=1 2024-09-13T23:07:19.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.348+0000 7f0bf6524800 20 add_watcher() i=2 2024-09-13T23:07:19.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.348+0000 7f0bf6524800 20 add_watcher() i=3 2024-09-13T23:07:19.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.348+0000 7f0bf6524800 20 add_watcher() i=4 2024-09-13T23:07:19.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.348+0000 7f0bf6524800 20 add_watcher() i=5 2024-09-13T23:07:19.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.348+0000 7f0bf6524800 20 add_watcher() i=6 2024-09-13T23:07:19.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.349+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94639330380176] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.349+0000 7f0bf6524800 20 add_watcher() i=7 2024-09-13T23:07:19.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.349+0000 7f0bf6524800 2 all 8 watchers are set, enabling cache 2024-09-13T23:07:19.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.349+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612efab8860 con 0x5612efaa57e0 2024-09-13T23:07:19.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.349+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.349+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94639330382208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efab5d80 con 0x5612efaa57e0 2024-09-13T23:07:19.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.350+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94639330382208] v34'246 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.350+0000 7f0aa8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:19.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.350+0000 7f0bf6524800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:07:19.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.350+0000 7f0bf6524800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:07:19.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.350+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac1350 con 0x5612efaa57e0 2024-09-13T23:07:19.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.352+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.352+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac19a0 con 0x7f0be4019040 2024-09-13T23:07:19.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.353+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.353+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac19a0 con 0x5612efaaba30 2024-09-13T23:07:19.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.354+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0bdc009050 con 0x5612efaaba30 2024-09-13T23:07:19.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.354+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac1d40 con 0x5612efaa57e0 2024-09-13T23:07:19.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.354+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'247 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.354+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac1d40 con 0x7f0bdc043b70 2024-09-13T23:07:19.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.355+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'77 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0be402f040 con 0x7f0bdc043b70 2024-09-13T23:07:19.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.355+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac22b0 con 0x5612efaaba30 2024-09-13T23:07:19.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.356+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'51 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0bdc009050 con 0x5612efaaba30 2024-09-13T23:07:19.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.356+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac2690 con 0x5612efaa57e0 2024-09-13T23:07:19.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.358+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.358+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac2690 con 0x7f0be4019040 2024-09-13T23:07:19.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.359+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'53 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.359+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac2690 con 0x7f0bdc043b70 2024-09-13T23:07:19.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.360+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0be402f040 con 0x7f0bdc043b70 2024-09-13T23:07:19.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.360+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac2c40 con 0x5612efaaba30 2024-09-13T23:07:19.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.361+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0bdc009050 con 0x5612efaaba30 2024-09-13T23:07:19.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.361+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac2c40 con 0x7f0bdc043b70 2024-09-13T23:07:19.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.362+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'78 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0be402f040 con 0x7f0bdc043b70 2024-09-13T23:07:19.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.362+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac31d0 con 0x7f0be4019040 2024-09-13T23:07:19.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.363+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.363+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac31d0 con 0x7f0bdc043b70 2024-09-13T23:07:19.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.364+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0be402f040 con 0x7f0bdc043b70 2024-09-13T23:07:19.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.364+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac32e0 con 0x7f0be4019040 2024-09-13T23:07:19.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.365+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'57 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.365+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac32e0 con 0x5612efaa57e0 2024-09-13T23:07:19.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.366+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'248 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.367+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac32e0 con 0x5612efaaba30 2024-09-13T23:07:19.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.368+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'71 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bdc009050 con 0x5612efaaba30 2024-09-13T23:07:19.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.368+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac3370 con 0x7f0bdc043b70 2024-09-13T23:07:19.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.369+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'79 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0be402f040 con 0x7f0bdc043b70 2024-09-13T23:07:19.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.369+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac3780 con 0x5612efaaba30 2024-09-13T23:07:19.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.370+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bdc009050 con 0x5612efaaba30 2024-09-13T23:07:19.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.370+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac3780 con 0x5612efaa57e0 2024-09-13T23:07:19.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.371+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.371+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac3780 con 0x5612efaa57e0 2024-09-13T23:07:19.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.372+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'249 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.372+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac3780 con 0x5612efaaba30 2024-09-13T23:07:19.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.373+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'72 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bdc009050 con 0x5612efaaba30 2024-09-13T23:07:19.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.373+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac3780 con 0x7f0bdc043b70 2024-09-13T23:07:19.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.374+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0be402f040 con 0x7f0bdc043b70 2024-09-13T23:07:19.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.374+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac3780 con 0x5612efaaba30 2024-09-13T23:07:19.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.375+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bdc009050 con 0x5612efaaba30 2024-09-13T23:07:19.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.375+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac3780 con 0x5612efaaba30 2024-09-13T23:07:19.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.376+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 <== osd.3 v2:172.21.15.164:6816/93809510 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bdc009050 con 0x5612efaaba30 2024-09-13T23:07:19.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.376+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac3780 con 0x5612efaaba30 2024-09-13T23:07:19.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.377+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 <== osd.3 v2:172.21.15.164:6816/93809510 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bdc009050 con 0x5612efaaba30 2024-09-13T23:07:19.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.377+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac3780 con 0x5612efaaba30 2024-09-13T23:07:19.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.378+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 <== osd.3 v2:172.21.15.164:6816/93809510 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'52 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bdc009050 con 0x5612efaaba30 2024-09-13T23:07:19.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.378+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac3780 con 0x7f0be4019040 2024-09-13T23:07:19.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.379+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.379+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac3780 con 0x5612efaaba30 2024-09-13T23:07:19.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.380+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 <== osd.3 v2:172.21.15.164:6816/93809510 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bdc009050 con 0x5612efaaba30 2024-09-13T23:07:19.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.380+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac3780 con 0x7f0be4019040 2024-09-13T23:07:19.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.381+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'54 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.381+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac3780 con 0x5612efaaba30 2024-09-13T23:07:19.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.382+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 <== osd.3 v2:172.21.15.164:6816/93809510 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'73 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bdc009050 con 0x5612efaaba30 2024-09-13T23:07:19.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.382+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac3780 con 0x7f0be4019040 2024-09-13T23:07:19.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.383+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'58 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.383+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac3780 con 0x7f0bdc043b70 2024-09-13T23:07:19.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.384+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 <== osd.2 v2:172.21.15.164:6808/3795914978 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0be402f040 con 0x7f0bdc043b70 2024-09-13T23:07:19.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.384+0000 7f0a237fe640 20 reqs_thread_entry: start 2024-09-13T23:07:19.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.384+0000 7f0bf6524800 20 init_complete bucket index max shards: 11 2024-09-13T23:07:19.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.385+0000 7f0bf6524800 20 Filter name: none 2024-09-13T23:07:19.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.385+0000 7f0a217fa640 20 reqs_thread_entry: start 2024-09-13T23:07:19.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.385+0000 7f0bf6524800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-13T23:07:19.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.385+0000 7f0bf6524800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.385+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612efaee310 con 0x7f0be4019040 2024-09-13T23:07:19.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.385+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.385+0000 7f0bf6524800 20 rados_obj.operate() r=0 bl.length=349 2024-09-13T23:07:19.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.385+0000 7f0bf6524800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-09-13T23:07:19.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.385+0000 7f0bf6524800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-13T23:07:19.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.385+0000 7f0bf6524800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:07:19.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.385+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612efaf0da0 con 0x7f0be4019040 2024-09-13T23:07:19.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.385+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.386+0000 7f0bf6524800 10 removing key index: system_akey 2024-09-13T23:07:19.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.386+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efaeed80 con 0x5612efaaba30 2024-09-13T23:07:19.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.387+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 <== osd.3 v2:172.21.15.164:6816/93809510 26 ==== osd_op_reply(96 system_akey [delete] v34'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0bdc009050 con 0x5612efaaba30 2024-09-13T23:07:19.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.387+0000 7f0bf6524800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-13T23:07:19.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.387+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94639330621664 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612efaf11c0 con 0x5612efaa57e0 2024-09-13T23:07:19.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.387+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== watch-notify(notify (1) cookie 94639330358320 notify 146028888091 ret 0) ==== 203+0+0 (crc 0 0 0) 0x5612efac2c90 con 0x5612efaa57e0 2024-09-13T23:07:19.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.387+0000 7f0ad5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888091 cookie 94639330358320 notifier 4861 bl.length()=161 2024-09-13T23:07:19.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.387+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(97 notify.1 [notify cookie 94639330621664 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.387+0000 7f0ad5ffb640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f0ab8003d60 con 0x5612efaa57e0 2024-09-13T23:07:19.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.387+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.387+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 32 ==== watch-notify(notify_complete (2) cookie 94639330621664 notify 146028888091 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0bec099040 con 0x5612efaa57e0 2024-09-13T23:07:19.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.387+0000 7f0bf6524800 10 removing email index: 2024-09-13T23:07:19.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.387+0000 7f0bf6524800 10 removing user buckets index 2024-09-13T23:07:19.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.387+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efaeed30 con 0x7f0be4019040 2024-09-13T23:07:19.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.389+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(99 system_user.buckets [delete] v34'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.389+0000 7f0bf6524800 10 removing user index: system_user 2024-09-13T23:07:19.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.389+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efaf2ed0 con 0x7f0be4019040 2024-09-13T23:07:19.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.390+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== osd_op_reply(100 system_user [call,call,delete] v34'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.390+0000 7f0bf6524800 10 removing default.rgw.meta+users.uid+system_user from cache 2024-09-13T23:07:19.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.390+0000 7f0bf6524800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-13T23:07:19.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.390+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94639330634272 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5612efaf2e40 con 0x7f0bdc043b70 2024-09-13T23:07:19.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.390+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 <== osd.2 v2:172.21.15.164:6808/3795914978 19 ==== watch-notify(notify (1) cookie 94639330360096 notify 146028888098 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5612efac2f80 con 0x7f0bdc043b70 2024-09-13T23:07:19.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.390+0000 7f0ad5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888098 cookie 94639330360096 notifier 4861 bl.length()=160 2024-09-13T23:07:19.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.390+0000 7f0ad5ffb640 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f0ab8003d60 con 0x7f0bdc043b70 2024-09-13T23:07:19.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.390+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 <== osd.2 v2:172.21.15.164:6808/3795914978 20 ==== osd_op_reply(101 notify.0 [notify cookie 94639330634272 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0be402f040 con 0x7f0bdc043b70 2024-09-13T23:07:19.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.390+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 <== osd.2 v2:172.21.15.164:6808/3795914978 21 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be402f040 con 0x7f0bdc043b70 2024-09-13T23:07:19.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.390+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 <== osd.2 v2:172.21.15.164:6808/3795914978 22 ==== watch-notify(notify_complete (2) cookie 94639330634272 notify 146028888098 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5612efac1d40 con 0x7f0bdc043b70 2024-09-13T23:07:19.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.391+0000 7f0aa8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:19.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.391+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94639330382208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac0390 con 0x5612efaa57e0 2024-09-13T23:07:19.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.392+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 33 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94639330382208] v34'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.392+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94639330360096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac0390 con 0x7f0bdc043b70 2024-09-13T23:07:19.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.393+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 <== osd.2 v2:172.21.15.164:6808/3795914978 23 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94639330360096] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be402f040 con 0x7f0bdc043b70 2024-09-13T23:07:19.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.393+0000 7f0bf6524800 20 remove_watcher() i=0 2024-09-13T23:07:19.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.393+0000 7f0bf6524800 2 removed watcher, disabling cache 2024-09-13T23:07:19.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.393+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94639330358320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac0390 con 0x5612efaa57e0 2024-09-13T23:07:19.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.394+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 34 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94639330358320] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.394+0000 7f0bf6524800 20 remove_watcher() i=1 2024-09-13T23:07:19.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.394+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94639330364176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac0390 con 0x5612efaaba30 2024-09-13T23:07:19.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.395+0000 7f0bf1ad8640 1 -- 172.21.15.164:0/2379030902 <== osd.3 v2:172.21.15.164:6816/93809510 27 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94639330364176] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bdc009050 con 0x5612efaaba30 2024-09-13T23:07:19.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.395+0000 7f0bf6524800 20 remove_watcher() i=2 2024-09-13T23:07:19.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.395+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94639330370976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac0390 con 0x7f0bdc043b70 2024-09-13T23:07:19.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.396+0000 7f0bf2ada640 1 -- 172.21.15.164:0/2379030902 <== osd.2 v2:172.21.15.164:6808/3795914978 24 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94639330370976] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be402f040 con 0x7f0bdc043b70 2024-09-13T23:07:19.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.396+0000 7f0bf6524800 20 remove_watcher() i=3 2024-09-13T23:07:19.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.396+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94639330373712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac0390 con 0x5612efaa57e0 2024-09-13T23:07:19.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.397+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.1 v2:172.21.15.164:6800/4060509701 35 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94639330373712] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x5612efaa57e0 2024-09-13T23:07:19.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.397+0000 7f0bf6524800 20 remove_watcher() i=4 2024-09-13T23:07:19.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.397+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94639330377904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac0390 con 0x7f0be4019040 2024-09-13T23:07:19.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.399+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94639330377904] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.399+0000 7f0bf6524800 20 remove_watcher() i=5 2024-09-13T23:07:19.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.399+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94639330372032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac0390 con 0x7f0be4019040 2024-09-13T23:07:19.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.400+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94639330372032] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.400+0000 7f0bf6524800 20 remove_watcher() i=6 2024-09-13T23:07:19.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.400+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94639330380176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5612efac0390 con 0x7f0be4019040 2024-09-13T23:07:19.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.401+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 <== osd.0 v2:172.21.15.17:6800/489863589 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94639330380176] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec077c60 con 0x7f0be4019040 2024-09-13T23:07:19.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.401+0000 7f0bf6524800 20 remove_watcher() i=7 2024-09-13T23:07:19.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.401+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f0be4019040 msgr2=0x7f0be4019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.401+0000 7f0bf6524800 1 --2- 172.21.15.164:0/2379030902 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f0be4019040 0x7f0be4019930 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.401+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5612efaa57e0 msgr2=0x5612efaa7ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.401+0000 7f0bf6524800 1 --2- 172.21.15.164:0/2379030902 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5612efaa57e0 0x5612efaa7ca0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.401+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f0bdc043b70 msgr2=0x7f0bdc043070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.401+0000 7f0bf6524800 1 --2- 172.21.15.164:0/2379030902 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f0bdc043b70 0x7f0bdc043070 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.401+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5612efaaba30 msgr2=0x5612efaade20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.401+0000 7f0bf6524800 1 --2- 172.21.15.164:0/2379030902 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5612efaaba30 0x5612efaade20 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.401+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0abc036b40 msgr2=0x7f0abc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.401+0000 7f0bf6524800 1 --2- 172.21.15.164:0/2379030902 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0abc036b40 0x7f0abc039000 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0be400f010 tx=0x7f0be400c040 comp rx=0 tx=0).stop 2024-09-13T23:07:19.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.401+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612efa63610 msgr2=0x5612efa99ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.401+0000 7f0bf22d9640 1 -- 172.21.15.164:0/2379030902 reap_dead start 2024-09-13T23:07:19.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.401+0000 7f0bf6524800 1 --2- 172.21.15.164:0/2379030902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612efa63610 0x5612efa99ef0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc04d180 tx=0x7f0bdc04d110 comp rx=0 tx=0).stop 2024-09-13T23:07:19.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.401+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 shutdown_connections 2024-09-13T23:07:19.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.401+0000 7f0bf6524800 1 --2- 172.21.15.164:0/2379030902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612efa63610 0x5612efa99ef0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.401+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 >> 172.21.15.164:0/2379030902 conn(0x5612efa8cb60 msgr2=0x5612efa8ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.401+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 shutdown_connections 2024-09-13T23:07:19.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.401+0000 7f0bf6524800 1 -- 172.21.15.164:0/2379030902 wait complete. 2024-09-13T23:07:19.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.402+0000 7f0bf6524800 1 -- 172.21.15.164:0/3439803189 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0acc036b40 msgr2=0x7f0acc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.402+0000 7f0bf6524800 1 --2- 172.21.15.164:0/3439803189 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0acc036b40 0x7f0acc039000 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x5612efa74200 tx=0x7f0be4000f90 comp rx=0 tx=0).stop 2024-09-13T23:07:19.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.402+0000 7f0bf6524800 1 -- 172.21.15.164:0/3439803189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612efa83af0 msgr2=0x5612efa83f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.402+0000 7f0bf6524800 1 --2- 172.21.15.164:0/3439803189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612efa83af0 0x5612efa83f10 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc001ed0 tx=0x7f0bdc00d7a0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.402+0000 7f0bf6524800 1 -- 172.21.15.164:0/3439803189 shutdown_connections 2024-09-13T23:07:19.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.402+0000 7f0bf6524800 1 --2- 172.21.15.164:0/3439803189 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0acc036b40 0x7f0acc039000 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.402+0000 7f0bf6524800 1 --2- 172.21.15.164:0/3439803189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612efa83af0 0x5612efa83f10 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.402+0000 7f0bf6524800 1 -- 172.21.15.164:0/3439803189 >> 172.21.15.164:0/3439803189 conn(0x5612efa78a80 msgr2=0x5612efa7b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.402+0000 7f0bf6524800 1 -- 172.21.15.164:0/3439803189 shutdown_connections 2024-09-13T23:07:19.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.402+0000 7f0bf6524800 1 -- 172.21.15.164:0/3439803189 wait complete. 2024-09-13T23:07:19.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.402+0000 7f0bf6524800 1 -- 172.21.15.164:0/2893219314 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5612ef974e90 msgr2=0x5612efa73190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.402+0000 7f0bf6524800 1 --2- 172.21.15.164:0/2893219314 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5612ef974e90 0x5612efa73190 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.402+0000 7f0bf6524800 1 -- 172.21.15.164:0/2893219314 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0ad8036b90 msgr2=0x7f0ad8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.402+0000 7f0bf6524800 1 --2- 172.21.15.164:0/2893219314 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0ad8036b90 0x7f0ad8039050 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc000f60 tx=0x7f0bdc0012b0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.402+0000 7f0bf6524800 1 -- 172.21.15.164:0/2893219314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612ef974550 msgr2=0x5612efa6c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.402+0000 7f0bf6524800 1 --2- 172.21.15.164:0/2893219314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612ef974550 0x5612efa6c120 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f0bec046130 tx=0x7f0bec003330 comp rx=0 tx=0).stop 2024-09-13T23:07:19.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.402+0000 7f0bf6524800 1 -- 172.21.15.164:0/2893219314 shutdown_connections 2024-09-13T23:07:19.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.402+0000 7f0bf6524800 1 --2- 172.21.15.164:0/2893219314 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5612ef974e90 0x5612efa73190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.402+0000 7f0bf6524800 1 --2- 172.21.15.164:0/2893219314 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0ad8036b90 0x7f0ad8039050 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.402+0000 7f0bf6524800 1 --2- 172.21.15.164:0/2893219314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612ef974550 0x5612efa6c120 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.402+0000 7f0bf6524800 1 -- 172.21.15.164:0/2893219314 >> 172.21.15.164:0/2893219314 conn(0x5612ef96fde0 msgr2=0x5612efa5d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.402+0000 7f0bf6524800 1 -- 172.21.15.164:0/2893219314 shutdown_connections 2024-09-13T23:07:19.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.402+0000 7f0bf6524800 1 -- 172.21.15.164:0/2893219314 wait complete. 2024-09-13T23:07:19.411 ERROR:root:None 2024-09-13T23:07:19.411 ERROR:root:0 2024-09-13T23:07:19.411 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-13T23:07:19.412 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-13T23:07:19.412 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-09-13T23:07:19.505 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:07:19.505 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:07:19.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.505+0000 7f26f0c2f800 1 Processor -- start 2024-09-13T23:07:19.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.505+0000 7f26f0c2f800 1 -- start start 2024-09-13T23:07:19.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.505+0000 7f26f0c2f800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55e2a765ad90 0x55e2a765d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.505+0000 7f26f0c2f800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e2a7513b30 con 0x55e2a75c8620 2024-09-13T23:07:19.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.505+0000 7f26f0c2f800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55e2a74f5360 con 0x55e2a765ad90 2024-09-13T23:07:19.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.506+0000 7f26eb6db640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55e2a765ad90 0x55e2a765d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.506+0000 7f26ebedc640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55e2a75c8620 0x55e2a7659670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:37878/0 (socket says 172.21.15.164:37878) 2024-09-13T23:07:19.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.506+0000 7f26ebedc640 1 -- 172.21.15.164:0/2319681200 learned_addr learned my addr 172.21.15.164:0/2319681200 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:07:19.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.506+0000 7f26eb6db640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55e2a765ad90 0x55e2a765d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54570/0 (socket says 172.21.15.164:54570) 2024-09-13T23:07:19.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.506+0000 7f26eb6db640 1 -- 172.21.15.164:0/2319681200 >> v1:172.21.15.17:6789/0 conn(0x55e2a75c8620 legacy=0x55e2a7659670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.506+0000 7f26eb6db640 1 -- 172.21.15.164:0/2319681200 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2a751be00 con 0x55e2a765ad90 2024-09-13T23:07:19.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.508+0000 7f26eb6db640 1 --2- 172.21.15.164:0/2319681200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a765ad90 0x55e2a765d180 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f26e000a470 tx=0x7f26e0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2225a827279cdc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.508+0000 7f26eaeda640 1 -- 172.21.15.164:0/2319681200 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26e0053570 con 0x55e2a765ad90 2024-09-13T23:07:19.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.508+0000 7f26eaeda640 1 -- 172.21.15.164:0/2319681200 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e0058070 con 0x55e2a765ad90 2024-09-13T23:07:19.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.508+0000 7f26eaeda640 1 -- 172.21.15.164:0/2319681200 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26e0053880 con 0x55e2a765ad90 2024-09-13T23:07:19.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.508+0000 7f26f0c2f800 1 -- 172.21.15.164:0/2319681200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a765ad90 msgr2=0x55e2a765d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.508+0000 7f26f0c2f800 1 --2- 172.21.15.164:0/2319681200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a765ad90 0x55e2a765d180 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f26e000a470 tx=0x7f26e0045a20 comp rx=0 tx=0).stop 2024-09-13T23:07:19.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.508+0000 7f26f0c2f800 1 -- 172.21.15.164:0/2319681200 shutdown_connections 2024-09-13T23:07:19.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.508+0000 7f26f0c2f800 1 --2- 172.21.15.164:0/2319681200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a765ad90 0x55e2a765d180 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.508+0000 7f26f0c2f800 1 -- 172.21.15.164:0/2319681200 >> 172.21.15.164:0/2319681200 conn(0x55e2a764ede0 msgr2=0x55e2a7651200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.508+0000 7f26f0c2f800 1 -- 172.21.15.164:0/2319681200 shutdown_connections 2024-09-13T23:07:19.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.509+0000 7f26f0c2f800 1 -- 172.21.15.164:0/2319681200 wait complete. 2024-09-13T23:07:19.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.523+0000 7f26f0c2f800 1 Processor -- start 2024-09-13T23:07:19.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.523+0000 7f26f0c2f800 1 -- start start 2024-09-13T23:07:19.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.523+0000 7f26f0c2f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a75c8620 0x55e2a7745b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.523+0000 7f26f0c2f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e2a75a0450 con 0x55e2a75c8620 2024-09-13T23:07:19.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.523+0000 7f26ebedc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a75c8620 0x55e2a7745b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.523+0000 7f26ebedc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a75c8620 0x55e2a7745b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54582/0 (socket says 172.21.15.164:54582) 2024-09-13T23:07:19.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.523+0000 7f26ebedc640 1 -- 172.21.15.164:0/1308756061 learned_addr learned my addr 172.21.15.164:0/1308756061 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.523+0000 7f26ebedc640 1 -- 172.21.15.164:0/1308756061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2a74edbc0 con 0x55e2a75c8620 2024-09-13T23:07:19.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.523+0000 7f26ebedc640 1 --2- 172.21.15.164:0/1308756061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a75c8620 0x55e2a7745b10 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f26dc001e10 tx=0x7f26dc00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8c821b05321077 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.524+0000 7f25d9e0b640 1 -- 172.21.15.164:0/1308756061 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26dc012020 con 0x55e2a75c8620 2024-09-13T23:07:19.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.524+0000 7f25d9e0b640 1 -- 172.21.15.164:0/1308756061 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26dc00e5a0 con 0x55e2a75c8620 2024-09-13T23:07:19.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.524+0000 7f25d9e0b640 1 -- 172.21.15.164:0/1308756061 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26dc00e8e0 con 0x55e2a75c8620 2024-09-13T23:07:19.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.524+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1308756061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a75c8620 msgr2=0x55e2a7745b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.524+0000 7f26f0c2f800 1 --2- 172.21.15.164:0/1308756061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a75c8620 0x55e2a7745b10 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f26dc001e10 tx=0x7f26dc00b780 comp rx=0 tx=0).stop 2024-09-13T23:07:19.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.524+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1308756061 shutdown_connections 2024-09-13T23:07:19.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.524+0000 7f26f0c2f800 1 --2- 172.21.15.164:0/1308756061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a75c8620 0x55e2a7745b10 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.524+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1308756061 >> 172.21.15.164:0/1308756061 conn(0x55e2a764ede0 msgr2=0x55e2a77414d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.524+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1308756061 shutdown_connections 2024-09-13T23:07:19.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.524+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1308756061 wait complete. 2024-09-13T23:07:19.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.525+0000 7f26f0c2f800 1 Processor -- start 2024-09-13T23:07:19.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.525+0000 7f26f0c2f800 1 -- start start 2024-09-13T23:07:19.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.525+0000 7f26f0c2f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a75c8620 0x55e2a774d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.525+0000 7f26f0c2f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e2a765d960 con 0x55e2a75c8620 2024-09-13T23:07:19.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.525+0000 7f26ebedc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a75c8620 0x55e2a774d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.525+0000 7f26ebedc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a75c8620 0x55e2a774d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54590/0 (socket says 172.21.15.164:54590) 2024-09-13T23:07:19.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.525+0000 7f26ebedc640 1 -- 172.21.15.164:0/4036821710 learned_addr learned my addr 172.21.15.164:0/4036821710 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.525+0000 7f26ebedc640 1 -- 172.21.15.164:0/4036821710 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2a7501fe0 con 0x55e2a75c8620 2024-09-13T23:07:19.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.526+0000 7f26ebedc640 1 --2- 172.21.15.164:0/4036821710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a75c8620 0x55e2a774d4f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f26dc00b7c0 tx=0x7f26dc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.526+0000 7f25d3fff640 1 -- 172.21.15.164:0/4036821710 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26dc012030 con 0x55e2a75c8620 2024-09-13T23:07:19.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.526+0000 7f25d3fff640 1 -- 172.21.15.164:0/4036821710 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26dc001470 con 0x55e2a75c8620 2024-09-13T23:07:19.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.526+0000 7f26f0c2f800 1 -- 172.21.15.164:0/4036821710 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2a774da30 con 0x55e2a75c8620 2024-09-13T23:07:19.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.526+0000 7f25d3fff640 1 -- 172.21.15.164:0/4036821710 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26dc01a8d0 con 0x55e2a75c8620 2024-09-13T23:07:19.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.526+0000 7f26f0c2f800 1 -- 172.21.15.164:0/4036821710 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2a774df50 con 0x55e2a75c8620 2024-09-13T23:07:19.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.527+0000 7f25d3fff640 1 -- 172.21.15.164:0/4036821710 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f26dc015020 con 0x55e2a75c8620 2024-09-13T23:07:19.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.527+0000 7f25d3fff640 1 --2- 172.21.15.164:0/4036821710 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f25d4036b40 0x7f25d4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.527+0000 7f25d3fff640 1 -- 172.21.15.164:0/4036821710 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f26dc020030 con 0x55e2a75c8620 2024-09-13T23:07:19.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.527+0000 7f26eb6db640 1 --2- 172.21.15.164:0/4036821710 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f25d4036b40 0x7f25d4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.527+0000 7f26f0c2f800 1 --2- 172.21.15.164:0/4036821710 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e2a765ad90 0x55e2a7754560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.527+0000 7f26f0c2f800 1 -- 172.21.15.164:0/4036821710 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e2a7754af0 con 0x55e2a765ad90 2024-09-13T23:07:19.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.527+0000 7f26ec6dd640 1 --2- 172.21.15.164:0/4036821710 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e2a765ad90 0x55e2a7754560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.527+0000 7f26eb6db640 1 --2- 172.21.15.164:0/4036821710 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f25d4036b40 0x7f25d4039000 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f26e0057000 tx=0x7f26e0052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.527+0000 7f26ec6dd640 1 --2- 172.21.15.164:0/4036821710 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e2a765ad90 0x55e2a7754560 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.528+0000 7f26ec6dd640 1 -- 172.21.15.164:0/4036821710 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f26e400a4a0 con 0x55e2a765ad90 2024-09-13T23:07:19.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.528+0000 7f26f0c2f800 1 -- 172.21.15.164:0/4036821710 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e2a7751b30 con 0x55e2a765ad90 2024-09-13T23:07:19.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.528+0000 7f26ec6dd640 1 -- 172.21.15.164:0/4036821710 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f26e400a4a0 con 0x55e2a765ad90 2024-09-13T23:07:19.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.528+0000 7f26f0c2f800 1 -- 172.21.15.164:0/4036821710 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e2a7756930 con 0x55e2a765ad90 2024-09-13T23:07:19.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.528+0000 7f26ec6dd640 1 -- 172.21.15.164:0/4036821710 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f26e400a4a0 con 0x55e2a765ad90 2024-09-13T23:07:19.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.528+0000 7f26f0c2f800 1 -- 172.21.15.164:0/4036821710 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e2a7755a70 con 0x55e2a765ad90 2024-09-13T23:07:19.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.529+0000 7f26ec6dd640 1 -- 172.21.15.164:0/4036821710 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f26e400a4a0 con 0x55e2a765ad90 2024-09-13T23:07:19.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.529+0000 7f26f0c2f800 1 -- 172.21.15.164:0/4036821710 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e2a7755ec0 con 0x55e2a765ad90 2024-09-13T23:07:19.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.529+0000 7f26ec6dd640 1 -- 172.21.15.164:0/4036821710 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f26e400a4a0 con 0x55e2a765ad90 2024-09-13T23:07:19.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.529+0000 7f26f0c2f800 1 Processor -- start 2024-09-13T23:07:19.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.529+0000 7f26f0c2f800 1 -- start start 2024-09-13T23:07:19.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.529+0000 7f26f0c2f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a7764f20 0x55e2a7765340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.529+0000 7f26f0c2f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e2a74ef580 con 0x55e2a7764f20 2024-09-13T23:07:19.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.530+0000 7f26eb6db640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a7764f20 0x55e2a7765340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.530+0000 7f26eb6db640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a7764f20 0x55e2a7765340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54600/0 (socket says 172.21.15.164:54600) 2024-09-13T23:07:19.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.530+0000 7f26eb6db640 1 -- 172.21.15.164:0/1206110615 learned_addr learned my addr 172.21.15.164:0/1206110615 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.530+0000 7f26eb6db640 1 -- 172.21.15.164:0/1206110615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2a7765880 con 0x55e2a7764f20 2024-09-13T23:07:19.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.530+0000 7f26eb6db640 1 --2- 172.21.15.164:0/1206110615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a7764f20 0x55e2a7765340 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f26e0045f50 tx=0x7f26e0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.530+0000 7f25d17fa640 1 -- 172.21.15.164:0/1206110615 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26e006f070 con 0x55e2a7764f20 2024-09-13T23:07:19.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.530+0000 7f25d17fa640 1 -- 172.21.15.164:0/1206110615 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e005f550 con 0x55e2a7764f20 2024-09-13T23:07:19.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.530+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1206110615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2a7765ab0 con 0x55e2a7764f20 2024-09-13T23:07:19.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.530+0000 7f25d17fa640 1 -- 172.21.15.164:0/1206110615 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26e005f830 con 0x55e2a7764f20 2024-09-13T23:07:19.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.530+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1206110615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2a7768730 con 0x55e2a7764f20 2024-09-13T23:07:19.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.531+0000 7f25d17fa640 1 -- 172.21.15.164:0/1206110615 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f26e005f9d0 con 0x55e2a7764f20 2024-09-13T23:07:19.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.531+0000 7f25d17fa640 1 --2- 172.21.15.164:0/1206110615 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f25c4036b40 0x7f25c4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.531+0000 7f25d17fa640 1 -- 172.21.15.164:0/1206110615 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f26e0092e80 con 0x55e2a7764f20 2024-09-13T23:07:19.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.531+0000 7f26ec6dd640 1 --2- 172.21.15.164:0/1206110615 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f25c4036b40 0x7f25c4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.532+0000 7f26f0c2f800 1 Processor -- start 2024-09-13T23:07:19.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.532+0000 7f26ec6dd640 1 --2- 172.21.15.164:0/1206110615 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f25c4036b40 0x7f25c4039000 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55e2a7755590 tx=0x7f26e4005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.532+0000 7f26f0c2f800 1 -- start start 2024-09-13T23:07:19.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.532+0000 7f26f0c2f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a7771b10 0x55e2a7771f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.532+0000 7f26f0c2f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e2a77462c0 con 0x55e2a7771b10 2024-09-13T23:07:19.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.532+0000 7f26eb6db640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a7771b10 0x55e2a7771f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.532+0000 7f26eb6db640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a7771b10 0x55e2a7771f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54602/0 (socket says 172.21.15.164:54602) 2024-09-13T23:07:19.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.532+0000 7f26eb6db640 1 -- 172.21.15.164:0/2826717150 learned_addr learned my addr 172.21.15.164:0/2826717150 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.532+0000 7f26eb6db640 1 -- 172.21.15.164:0/2826717150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2a77724e0 con 0x55e2a7771b10 2024-09-13T23:07:19.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.532+0000 7f26eb6db640 1 --2- 172.21.15.164:0/2826717150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a7771b10 0x55e2a7771f10 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f26e0053f70 tx=0x7f26e007cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b796fb7b5457adb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.533+0000 7f25caffd640 1 -- 172.21.15.164:0/2826717150 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26e006b410 con 0x55e2a7771b10 2024-09-13T23:07:19.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.533+0000 7f25caffd640 1 -- 172.21.15.164:0/2826717150 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e005fcc0 con 0x55e2a7771b10 2024-09-13T23:07:19.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.533+0000 7f25caffd640 1 -- 172.21.15.164:0/2826717150 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26e006b5b0 con 0x55e2a7771b10 2024-09-13T23:07:19.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.533+0000 7f26f0c2f800 1 -- 172.21.15.164:0/2826717150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a7771b10 msgr2=0x55e2a7771f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.533+0000 7f26f0c2f800 1 --2- 172.21.15.164:0/2826717150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a7771b10 0x55e2a7771f10 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f26e0053f70 tx=0x7f26e007cbb0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.533+0000 7f26f0c2f800 1 -- 172.21.15.164:0/2826717150 shutdown_connections 2024-09-13T23:07:19.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.533+0000 7f26f0c2f800 1 --2- 172.21.15.164:0/2826717150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a7771b10 0x55e2a7771f10 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.533+0000 7f26f0c2f800 1 -- 172.21.15.164:0/2826717150 >> 172.21.15.164:0/2826717150 conn(0x55e2a776de70 msgr2=0x55e2a776bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.533+0000 7f26f0c2f800 1 -- 172.21.15.164:0/2826717150 shutdown_connections 2024-09-13T23:07:19.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.533+0000 7f26f0c2f800 1 -- 172.21.15.164:0/2826717150 wait complete. 2024-09-13T23:07:19.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.533+0000 7f26f0c2f800 1 Processor -- start 2024-09-13T23:07:19.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.533+0000 7f26f0c2f800 1 -- start start 2024-09-13T23:07:19.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.534+0000 7f26f0c2f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a7771b10 0x55e2a7778fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.534+0000 7f26f0c2f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e2a7772b50 con 0x55e2a7771b10 2024-09-13T23:07:19.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.534+0000 7f26eb6db640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a7771b10 0x55e2a7778fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.534+0000 7f26eb6db640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a7771b10 0x55e2a7778fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54618/0 (socket says 172.21.15.164:54618) 2024-09-13T23:07:19.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.534+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 learned_addr learned my addr 172.21.15.164:0/1220452603 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.534+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2a7779510 con 0x55e2a7771b10 2024-09-13T23:07:19.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.534+0000 7f26eb6db640 1 --2- 172.21.15.164:0/1220452603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a7771b10 0x55e2a7778fd0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f26e00059a0 tx=0x7f26e00910a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.534+0000 7f25c97fa640 1 -- 172.21.15.164:0/1220452603 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26e009e070 con 0x55e2a7771b10 2024-09-13T23:07:19.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.535+0000 7f25c97fa640 1 -- 172.21.15.164:0/1220452603 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e006b410 con 0x55e2a7771b10 2024-09-13T23:07:19.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.535+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2a77797a0 con 0x55e2a7771b10 2024-09-13T23:07:19.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.535+0000 7f25c97fa640 1 -- 172.21.15.164:0/1220452603 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26e005cca0 con 0x55e2a7771b10 2024-09-13T23:07:19.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.535+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2a77797a0 con 0x55e2a7771b10 2024-09-13T23:07:19.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.535+0000 7f25c97fa640 1 -- 172.21.15.164:0/1220452603 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f26e00a1070 con 0x55e2a7771b10 2024-09-13T23:07:19.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.535+0000 7f25c97fa640 1 --2- 172.21.15.164:0/1220452603 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f25b4036b90 0x7f25b4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.536+0000 7f25c97fa640 1 -- 172.21.15.164:0/1220452603 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f26e00a4d60 con 0x55e2a7771b10 2024-09-13T23:07:19.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.536+0000 7f26ec6dd640 1 --2- 172.21.15.164:0/1220452603 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f25b4036b90 0x7f25b4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.536+0000 7f26ec6dd640 1 --2- 172.21.15.164:0/1220452603 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f25b4036b90 0x7f25b4039050 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x55e2a774e710 tx=0x7f26e401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.536+0000 7f26f0c2f800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.536+0000 7f26f0c2f800 1 --2- 172.21.15.164:0/1220452603 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e2a77848b0 0x55e2a7786d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.536+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e2a77874c0 con 0x55e2a77848b0 2024-09-13T23:07:19.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.536+0000 7f26ebedc640 1 --2- 172.21.15.164:0/1220452603 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e2a77848b0 0x55e2a7786d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.537+0000 7f26ebedc640 1 --2- 172.21.15.164:0/1220452603 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e2a77848b0 0x55e2a7786d70 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.537+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f26dc018950 con 0x55e2a77848b0 2024-09-13T23:07:19.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.537+0000 7f26f0c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.537+0000 7f26f0c2f800 20 realm 2024-09-13T23:07:19.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.537+0000 7f26f0c2f800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.537+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e2a77878d0 con 0x55e2a77848b0 2024-09-13T23:07:19.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.537+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f26dc018950 con 0x55e2a77848b0 2024-09-13T23:07:19.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.537+0000 7f26f0c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.537+0000 7f26f0c2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:07:19.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.537+0000 7f26f0c2f800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.537+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e2a77881a0 con 0x55e2a77848b0 2024-09-13T23:07:19.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.537+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f26dc018950 con 0x55e2a77848b0 2024-09-13T23:07:19.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.537+0000 7f26f0c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.537+0000 7f26f0c2f800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.537+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e2a7788540 con 0x55e2a77848b0 2024-09-13T23:07:19.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.538+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f26dc018950 con 0x55e2a77848b0 2024-09-13T23:07:19.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.538+0000 7f26f0c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:19.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.538+0000 7f26f0c2f800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.538+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e2a7788d90 con 0x55e2a77848b0 2024-09-13T23:07:19.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.538+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f26dc018950 con 0x55e2a77848b0 2024-09-13T23:07:19.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.538+0000 7f26f0c2f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:07:19.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.538+0000 7f26f0c2f800 20 searching for the correct realm 2024-09-13T23:07:19.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.538+0000 7f26f0c2f800 1 --2- 172.21.15.164:0/1220452603 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55e2a778ab00 0x55e2a778cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.538+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x55e2a778ab00 2024-09-13T23:07:19.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.538+0000 7f26eb6db640 1 --2- 172.21.15.164:0/1220452603 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55e2a778ab00 0x55e2a778cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.538+0000 7f26eb6db640 1 --2- 172.21.15.164:0/1220452603 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55e2a778ab00 0x55e2a778cef0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.538+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26e00a0030 con 0x55e2a778ab00 2024-09-13T23:07:19.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.539+0000 7f26eb6db640 1 --2- 172.21.15.164:0/1220452603 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f26e00a3060 0x7f26e00914b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.539+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x7f26e00a3060 2024-09-13T23:07:19.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.539+0000 7f26ec6dd640 1 --2- 172.21.15.164:0/1220452603 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f26e00a3060 0x7f26e00914b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.539+0000 7f26ec6dd640 1 --2- 172.21.15.164:0/1220452603 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f26e00a3060 0x7f26e00914b0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.539+0000 7f26ec6dd640 1 -- 172.21.15.164:0/1220452603 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26e401f070 con 0x7f26e00a3060 2024-09-13T23:07:19.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.539+0000 7f26ec6dd640 1 --2- 172.21.15.164:0/1220452603 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f26e4031040 0x7f26e4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.539+0000 7f26ec6dd640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x7f26e4031040 2024-09-13T23:07:19.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.539+0000 7f26ebedc640 1 --2- 172.21.15.164:0/1220452603 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f26e4031040 0x7f26e4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.540+0000 7f26ebedc640 1 --2- 172.21.15.164:0/1220452603 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f26e4031040 0x7f26e4032940 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.540+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26dc018950 con 0x7f26e4031040 2024-09-13T23:07:19.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.540+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x55e2a77848b0 2024-09-13T23:07:19.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.540+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f26dc018950 con 0x55e2a77848b0 2024-09-13T23:07:19.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.540+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x55e2a77848b0 2024-09-13T23:07:19.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.541+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26dc018950 con 0x55e2a77848b0 2024-09-13T23:07:19.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.541+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x7f26e4031040 2024-09-13T23:07:19.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.541+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26dc018950 con 0x7f26e4031040 2024-09-13T23:07:19.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.541+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x7f26e4031040 2024-09-13T23:07:19.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.541+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26dc018950 con 0x7f26e4031040 2024-09-13T23:07:19.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.541+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x7f26e00a3060 2024-09-13T23:07:19.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.541+0000 7f26ec6dd640 1 -- 172.21.15.164:0/1220452603 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26e401f070 con 0x7f26e00a3060 2024-09-13T23:07:19.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.541+0000 7f26ec6dd640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x55e2a778ab00 2024-09-13T23:07:19.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.542+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26e00a0030 con 0x55e2a778ab00 2024-09-13T23:07:19.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.542+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x55e2a77848b0 2024-09-13T23:07:19.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.542+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26dc018950 con 0x55e2a77848b0 2024-09-13T23:07:19.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.542+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x7f26e4031040 2024-09-13T23:07:19.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.542+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26dc018950 con 0x7f26e4031040 2024-09-13T23:07:19.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.542+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x55e2a77848b0 2024-09-13T23:07:19.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.542+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26dc018950 con 0x55e2a77848b0 2024-09-13T23:07:19.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.542+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x7f26e00a3060 2024-09-13T23:07:19.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.542+0000 7f26ec6dd640 1 -- 172.21.15.164:0/1220452603 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f26e401f070 con 0x7f26e00a3060 2024-09-13T23:07:19.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.542+0000 7f26ec6dd640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x55e2a778ab00 2024-09-13T23:07:19.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.543+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26e00b2040 con 0x55e2a778ab00 2024-09-13T23:07:19.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.543+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x55e2a778ab00 2024-09-13T23:07:19.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.543+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26e00b2040 con 0x55e2a778ab00 2024-09-13T23:07:19.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.543+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x7f26e4031040 2024-09-13T23:07:19.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.543+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26dc018950 con 0x7f26e4031040 2024-09-13T23:07:19.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.543+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x55e2a778ab00 2024-09-13T23:07:19.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.543+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26e00b2040 con 0x55e2a778ab00 2024-09-13T23:07:19.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.543+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x55e2a778ab00 2024-09-13T23:07:19.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.544+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26e00b2040 con 0x55e2a778ab00 2024-09-13T23:07:19.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.544+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x55e2a77848b0 2024-09-13T23:07:19.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.544+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26dc018950 con 0x55e2a77848b0 2024-09-13T23:07:19.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.544+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x55e2a77848b0 2024-09-13T23:07:19.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.544+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f26dc018950 con 0x55e2a77848b0 2024-09-13T23:07:19.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.544+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x7f26e4031040 2024-09-13T23:07:19.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.544+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26dc018950 con 0x7f26e4031040 2024-09-13T23:07:19.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.544+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x55e2a778ab00 2024-09-13T23:07:19.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.545+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26e00b2040 con 0x55e2a778ab00 2024-09-13T23:07:19.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.545+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x7f26e00a3060 2024-09-13T23:07:19.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.545+0000 7f26ec6dd640 1 -- 172.21.15.164:0/1220452603 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26e401f070 con 0x7f26e00a3060 2024-09-13T23:07:19.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.545+0000 7f26ec6dd640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x55e2a77848b0 2024-09-13T23:07:19.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.545+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f26dc018950 con 0x55e2a77848b0 2024-09-13T23:07:19.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.545+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x7f26e4031040 2024-09-13T23:07:19.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.545+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26dc018950 con 0x7f26e4031040 2024-09-13T23:07:19.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.545+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x55e2a778ab00 2024-09-13T23:07:19.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.545+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26e00b2040 con 0x55e2a778ab00 2024-09-13T23:07:19.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.546+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x7f26e4031040 2024-09-13T23:07:19.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.546+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26dc018950 con 0x7f26e4031040 2024-09-13T23:07:19.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.546+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x7f26e00a3060 2024-09-13T23:07:19.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.546+0000 7f26ec6dd640 1 -- 172.21.15.164:0/1220452603 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26e401f070 con 0x7f26e00a3060 2024-09-13T23:07:19.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.546+0000 7f26ec6dd640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x55e2a778ab00 2024-09-13T23:07:19.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.546+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26e00b2040 con 0x55e2a778ab00 2024-09-13T23:07:19.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.546+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x7f26e00a3060 2024-09-13T23:07:19.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.546+0000 7f26ec6dd640 1 -- 172.21.15.164:0/1220452603 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26e401f070 con 0x7f26e00a3060 2024-09-13T23:07:19.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.546+0000 7f26ec6dd640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x55e2a77848b0 2024-09-13T23:07:19.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.547+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f26dc018950 con 0x55e2a77848b0 2024-09-13T23:07:19.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.547+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d4d0 con 0x7f26e00a3060 2024-09-13T23:07:19.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.547+0000 7f26ec6dd640 1 -- 172.21.15.164:0/1220452603 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26e4040040 con 0x7f26e00a3060 2024-09-13T23:07:19.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.547+0000 7f26f0c2f800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:07:19.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.547+0000 7f26f0c2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:07:19.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.547+0000 7f26f0c2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:07:19.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.547+0000 7f26f0c2f800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:07:19.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.547+0000 7f26f0c2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:07:19.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.547+0000 7f26f0c2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:07:19.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.547+0000 7f26f0c2f800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.547+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e2a7789740 con 0x55e2a77848b0 2024-09-13T23:07:19.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.547+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f26dc018950 con 0x55e2a77848b0 2024-09-13T23:07:19.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.547+0000 7f26f0c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.547+0000 7f26f0c2f800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.547+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e2a7789fe0 con 0x55e2a77848b0 2024-09-13T23:07:19.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.547+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f26dc018950 con 0x55e2a77848b0 2024-09-13T23:07:19.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.547+0000 7f26f0c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:19.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.547+0000 7f26f0c2f800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.547+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778d950 con 0x55e2a77848b0 2024-09-13T23:07:19.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.548+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f26dc018950 con 0x55e2a77848b0 2024-09-13T23:07:19.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.548+0000 7f26f0c2f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:07:19.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.548+0000 7f26f0c2f800 20 zone default found 2024-09-13T23:07:19.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.548+0000 7f26f0c2f800 4 Realm: () 2024-09-13T23:07:19.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.548+0000 7f26f0c2f800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:07:19.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.548+0000 7f26f0c2f800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:07:19.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.548+0000 7f26f0c2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:07:19.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.548+0000 7f26f0c2f800 20 zonegroup default 2024-09-13T23:07:19.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.548+0000 7f26f0c2f800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.548+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778de00 con 0x7f26e4031040 2024-09-13T23:07:19.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.548+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f26dc018950 con 0x7f26e4031040 2024-09-13T23:07:19.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.548+0000 7f26f0c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.548+0000 7f26f0c2f800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.548+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778f7e0 con 0x55e2a778ab00 2024-09-13T23:07:19.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.548+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f26e00b2040 con 0x55e2a778ab00 2024-09-13T23:07:19.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.548+0000 7f26f0c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.548+0000 7f26f0c2f800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.548+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778fcb0 con 0x55e2a778ab00 2024-09-13T23:07:19.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.549+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f26e00b2040 con 0x55e2a778ab00 2024-09-13T23:07:19.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.549+0000 7f26f0c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.549+0000 7f26f0c2f800 20 started sync module instance, tier type = 2024-09-13T23:07:19.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.549+0000 7f26f0c2f800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:07:19.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.549+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e2a778ec70 con 0x7f26e00a3060 2024-09-13T23:07:19.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.550+0000 7f26ec6dd640 1 -- 172.21.15.164:0/1220452603 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26e4040040 con 0x7f26e00a3060 2024-09-13T23:07:19.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.550+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94431960690784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e2a77905c0 con 0x7f26e00a3060 2024-09-13T23:07:19.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.550+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e2a7790e10 con 0x55e2a77848b0 2024-09-13T23:07:19.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.551+0000 7f26ec6dd640 1 -- 172.21.15.164:0/1220452603 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94431960690784] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26e4040040 con 0x7f26e00a3060 2024-09-13T23:07:19.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.551+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26dc018950 con 0x55e2a77848b0 2024-09-13T23:07:19.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.551+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94431960695056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e2a7790a40 con 0x55e2a77848b0 2024-09-13T23:07:19.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.551+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e2a7791550 con 0x55e2a778ab00 2024-09-13T23:07:19.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.552+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26e00b2040 con 0x55e2a778ab00 2024-09-13T23:07:19.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.552+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94431960698880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e2a7791df0 con 0x55e2a778ab00 2024-09-13T23:07:19.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.552+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e2a7792890 con 0x7f26e00a3060 2024-09-13T23:07:19.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.552+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94431960695056] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26dc018950 con 0x55e2a77848b0 2024-09-13T23:07:19.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.553+0000 7f26ec6dd640 1 -- 172.21.15.164:0/1220452603 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26e4040040 con 0x7f26e00a3060 2024-09-13T23:07:19.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.553+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94431960703872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e2a7792cb0 con 0x7f26e00a3060 2024-09-13T23:07:19.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.553+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e2a77936b0 con 0x55e2a77848b0 2024-09-13T23:07:19.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.553+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94431960698880] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26e00b2040 con 0x55e2a778ab00 2024-09-13T23:07:19.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.554+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26dc018950 con 0x55e2a77848b0 2024-09-13T23:07:19.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.554+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94431960701248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e2a7793670 con 0x55e2a77848b0 2024-09-13T23:07:19.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.554+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e2a7794130 con 0x7f26e4031040 2024-09-13T23:07:19.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.554+0000 7f26ec6dd640 1 -- 172.21.15.164:0/1220452603 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94431960703872] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26e4040040 con 0x7f26e00a3060 2024-09-13T23:07:19.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.555+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94431960701248] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26dc018950 con 0x55e2a77848b0 2024-09-13T23:07:19.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.556+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26dc018950 con 0x7f26e4031040 2024-09-13T23:07:19.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.556+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94431960696112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e2a77931c0 con 0x7f26e4031040 2024-09-13T23:07:19.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.556+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e2a77949d0 con 0x7f26e4031040 2024-09-13T23:07:19.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.557+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94431960696112] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26dc018950 con 0x7f26e4031040 2024-09-13T23:07:19.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.557+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26dc018950 con 0x7f26e4031040 2024-09-13T23:07:19.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.557+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94431960710208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e2a77931c0 con 0x7f26e4031040 2024-09-13T23:07:19.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.557+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e2a7794ff0 con 0x7f26e4031040 2024-09-13T23:07:19.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.558+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94431960710208] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26dc018950 con 0x7f26e4031040 2024-09-13T23:07:19.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.558+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26dc018950 con 0x7f26e4031040 2024-09-13T23:07:19.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.558+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94431960712352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e2a7794ff0 con 0x7f26e4031040 2024-09-13T23:07:19.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.558+0000 7f26f0c2f800 20 add_watcher() i=0 2024-09-13T23:07:19.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.558+0000 7f26f0c2f800 20 add_watcher() i=1 2024-09-13T23:07:19.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.558+0000 7f26f0c2f800 20 add_watcher() i=2 2024-09-13T23:07:19.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.558+0000 7f26f0c2f800 20 add_watcher() i=3 2024-09-13T23:07:19.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.558+0000 7f26f0c2f800 20 add_watcher() i=4 2024-09-13T23:07:19.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.558+0000 7f26f0c2f800 20 add_watcher() i=5 2024-09-13T23:07:19.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.558+0000 7f26f0c2f800 20 add_watcher() i=6 2024-09-13T23:07:19.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.559+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94431960712352] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26dc018950 con 0x7f26e4031040 2024-09-13T23:07:19.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.559+0000 7f26f0c2f800 20 add_watcher() i=7 2024-09-13T23:07:19.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.559+0000 7f26f0c2f800 2 all 8 watchers are set, enabling cache 2024-09-13T23:07:19.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.559+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e2a7798310 con 0x55e2a77848b0 2024-09-13T23:07:19.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.559+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f26dc018950 con 0x55e2a77848b0 2024-09-13T23:07:19.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.559+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94431960726864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e2a7795160 con 0x55e2a77848b0 2024-09-13T23:07:19.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.560+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94431960726864] v34'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f26dc018950 con 0x55e2a77848b0 2024-09-13T23:07:19.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.561+0000 7f25a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:19.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.561+0000 7f26f0c2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:07:19.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.561+0000 7f26f0c2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:07:19.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.561+0000 7f26f0c2f800 5 note: GC not initialized 2024-09-13T23:07:19.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.561+0000 7f25a0fe1640 20 reqs_thread_entry: start 2024-09-13T23:07:19.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.561+0000 7f26f0c2f800 20 init_complete bucket index max shards: 11 2024-09-13T23:07:19.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.561+0000 7f26f0c2f800 20 Filter name: none 2024-09-13T23:07:19.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.561+0000 7f251a7fc640 20 reqs_thread_entry: start 2024-09-13T23:07:19.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.561+0000 7f26f0c2f800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-13T23:07:19.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.561+0000 7f26f0c2f800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.561+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e2a77cb7b0 con 0x55e2a778ab00 2024-09-13T23:07:19.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.561+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7f26e00b2040 con 0x55e2a778ab00 2024-09-13T23:07:19.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.562+0000 7f26f0c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.562+0000 7f26f0c2f800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-09-13T23:07:19.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.562+0000 7f26f0c2f800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-13T23:07:19.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.562+0000 7f26f0c2f800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-09-13T23:07:19.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.562+0000 7f26f0c2f800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.562+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e2a77ca2a0 con 0x55e2a778ab00 2024-09-13T23:07:19.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.562+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7f26e00b2040 con 0x55e2a778ab00 2024-09-13T23:07:19.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.562+0000 7f26f0c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.562+0000 7f26f0c2f800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-09-13T23:07:19.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.562+0000 7f26f0c2f800 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-13T23:07:19.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.562+0000 7f26f0c2f800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-13T23:07:19.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.562+0000 7f26f0c2f800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-13T23:07:19.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.562+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e2a77ceda0 con 0x55e2a778ab00 2024-09-13T23:07:19.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.563+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v34'3 uv3 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f26e00b2040 con 0x55e2a778ab00 2024-09-13T23:07:19.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.563+0000 7f26f0c2f800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-13T23:07:19.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.563+0000 7f26f0c2f800 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-13T23:07:19.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.563+0000 7f26f0c2f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-13T23:07:19.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.563+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94431960934320 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e2a77cf4f0 con 0x55e2a778ab00 2024-09-13T23:07:19.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.563+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== watch-notify(notify (1) cookie 94431960698880 notify 146028888073 ret 0) ==== 584+0+0 (crc 0 0 0) 0x55e2a77ca060 con 0x55e2a778ab00 2024-09-13T23:07:19.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.563+0000 7f25caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888073 cookie 94431960698880 notifier 4868 bl.length()=542 2024-09-13T23:07:19.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.563+0000 7f25caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-13T23:07:19.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.563+0000 7f25caffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-13T23:07:19.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.563+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(65 notify.2 [notify cookie 94431960934320 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f26e00b2040 con 0x55e2a778ab00 2024-09-13T23:07:19.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.563+0000 7f25caffd640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f25b0003ea0 con 0x55e2a778ab00 2024-09-13T23:07:19.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.563+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26e00b2040 con 0x55e2a778ab00 2024-09-13T23:07:19.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.564+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== watch-notify(notify_complete (2) cookie 94431960934320 notify 146028888073 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f26e00bc020 con 0x55e2a778ab00 2024-09-13T23:07:19.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.564+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e2a77ca7b0 con 0x55e2a778ab00 2024-09-13T23:07:19.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.565+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 <== osd.3 v2:172.21.15.164:6816/93809510 21 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v34'11 uv11 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7f26e00be040 con 0x55e2a778ab00 2024-09-13T23:07:19.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.565+0000 7f26f0c2f800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-13T23:07:19.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.565+0000 7f26f0c2f800 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-13T23:07:19.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.565+0000 7f26f0c2f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-13T23:07:19.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.565+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94431960934320 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e2a77cf920 con 0x7f26e4031040 2024-09-13T23:07:19.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.565+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== watch-notify(notify (1) cookie 94431960696112 notify 146028888108 ret 0) ==== 217+0+0 (crc 0 0 0) 0x55e2a774df50 con 0x7f26e4031040 2024-09-13T23:07:19.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.565+0000 7f25caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888108 cookie 94431960696112 notifier 4868 bl.length()=175 2024-09-13T23:07:19.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.565+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(68 notify.5 [notify cookie 94431960934320 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f26dc018950 con 0x7f26e4031040 2024-09-13T23:07:19.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.565+0000 7f25caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-13T23:07:19.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.565+0000 7f25caffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-13T23:07:19.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.565+0000 7f25caffd640 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f25b0003ea0 con 0x7f26e4031040 2024-09-13T23:07:19.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.566+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== watch-notify(notify_complete (2) cookie 94431960934320 notify 146028888108 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e2a774da30 con 0x7f26e4031040 2024-09-13T23:07:19.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.566+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26dc018950 con 0x7f26e4031040 2024-09-13T23:07:19.578 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-09-13T23:07:19.562829Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:07:19.562816Z","tags":[],"group_ids":[]} 2024-09-13T23:07:19.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.566+0000 7f25a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:19.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.566+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94431960726864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e2a77c94f0 con 0x55e2a77848b0 2024-09-13T23:07:19.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.567+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94431960726864] v34'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f26dc018950 con 0x55e2a77848b0 2024-09-13T23:07:19.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.568+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94431960690784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e2a77c94f0 con 0x7f26e00a3060 2024-09-13T23:07:19.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.569+0000 7f26ec6dd640 1 -- 172.21.15.164:0/1220452603 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94431960690784] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26e4040040 con 0x7f26e00a3060 2024-09-13T23:07:19.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.569+0000 7f26f0c2f800 20 remove_watcher() i=0 2024-09-13T23:07:19.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.569+0000 7f26f0c2f800 2 removed watcher, disabling cache 2024-09-13T23:07:19.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.569+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94431960695056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e2a77c94f0 con 0x55e2a77848b0 2024-09-13T23:07:19.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.570+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94431960695056] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26dc018950 con 0x55e2a77848b0 2024-09-13T23:07:19.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.570+0000 7f26f0c2f800 20 remove_watcher() i=1 2024-09-13T23:07:19.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.570+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94431960698880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e2a77c94f0 con 0x55e2a778ab00 2024-09-13T23:07:19.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.571+0000 7f26eb6db640 1 -- 172.21.15.164:0/1220452603 <== osd.3 v2:172.21.15.164:6816/93809510 22 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94431960698880] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26e00be040 con 0x55e2a778ab00 2024-09-13T23:07:19.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.571+0000 7f26f0c2f800 20 remove_watcher() i=2 2024-09-13T23:07:19.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.571+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94431960703872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e2a77c94f0 con 0x7f26e00a3060 2024-09-13T23:07:19.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.572+0000 7f26ec6dd640 1 -- 172.21.15.164:0/1220452603 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94431960703872] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26e4040040 con 0x7f26e00a3060 2024-09-13T23:07:19.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.572+0000 7f26f0c2f800 20 remove_watcher() i=3 2024-09-13T23:07:19.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.572+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94431960701248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e2a77c94f0 con 0x55e2a77848b0 2024-09-13T23:07:19.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.573+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94431960701248] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26dc018950 con 0x55e2a77848b0 2024-09-13T23:07:19.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.573+0000 7f26f0c2f800 20 remove_watcher() i=4 2024-09-13T23:07:19.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.573+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94431960696112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e2a77c94f0 con 0x7f26e4031040 2024-09-13T23:07:19.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.574+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94431960696112] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26dc018950 con 0x7f26e4031040 2024-09-13T23:07:19.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.574+0000 7f26f0c2f800 20 remove_watcher() i=5 2024-09-13T23:07:19.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.574+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94431960710208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e2a77c94f0 con 0x7f26e4031040 2024-09-13T23:07:19.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.575+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94431960710208] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26dc018950 con 0x7f26e4031040 2024-09-13T23:07:19.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.575+0000 7f26f0c2f800 20 remove_watcher() i=6 2024-09-13T23:07:19.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.575+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94431960712352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e2a77c94f0 con 0x7f26e4031040 2024-09-13T23:07:19.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.576+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94431960712352] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26dc018950 con 0x7f26e4031040 2024-09-13T23:07:19.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.576+0000 7f26f0c2f800 20 remove_watcher() i=7 2024-09-13T23:07:19.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.576+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f26e4031040 msgr2=0x7f26e4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.576+0000 7f26f0c2f800 1 --2- 172.21.15.164:0/1220452603 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f26e4031040 0x7f26e4032940 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.576+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e2a77848b0 msgr2=0x55e2a7786d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.576+0000 7f26f0c2f800 1 --2- 172.21.15.164:0/1220452603 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e2a77848b0 0x55e2a7786d70 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.576+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f26e00a3060 msgr2=0x7f26e00914b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.576+0000 7f26f0c2f800 1 --2- 172.21.15.164:0/1220452603 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f26e00a3060 0x7f26e00914b0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.576+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55e2a778ab00 msgr2=0x55e2a778cef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.576+0000 7f26f0c2f800 1 --2- 172.21.15.164:0/1220452603 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55e2a778ab00 0x55e2a778cef0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.576+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f25b4036b90 msgr2=0x7f25b4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.576+0000 7f26f0c2f800 1 --2- 172.21.15.164:0/1220452603 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f25b4036b90 0x7f25b4039050 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x55e2a774e710 tx=0x7f26e401f000 comp rx=0 tx=0).stop 2024-09-13T23:07:19.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.576+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a7771b10 msgr2=0x55e2a7778fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.576+0000 7f26ebedc640 1 -- 172.21.15.164:0/1220452603 reap_dead start 2024-09-13T23:07:19.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.576+0000 7f26f0c2f800 1 --2- 172.21.15.164:0/1220452603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a7771b10 0x55e2a7778fd0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f26e00059a0 tx=0x7f26e00910a0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.576+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 shutdown_connections 2024-09-13T23:07:19.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.576+0000 7f26f0c2f800 1 --2- 172.21.15.164:0/1220452603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a7771b10 0x55e2a7778fd0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.576+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 >> 172.21.15.164:0/1220452603 conn(0x55e2a776de70 msgr2=0x55e2a776bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.576+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 shutdown_connections 2024-09-13T23:07:19.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.576+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1220452603 wait complete. 2024-09-13T23:07:19.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.577+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1206110615 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f25c4036b40 msgr2=0x7f25c4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.577+0000 7f26f0c2f800 1 --2- 172.21.15.164:0/1206110615 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f25c4036b40 0x7f25c4039000 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55e2a7755590 tx=0x7f26e4005840 comp rx=0 tx=0).stop 2024-09-13T23:07:19.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.577+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1206110615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a7764f20 msgr2=0x55e2a7765340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.577+0000 7f26f0c2f800 1 --2- 172.21.15.164:0/1206110615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a7764f20 0x55e2a7765340 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f26e0045f50 tx=0x7f26e0002fb0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.577+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1206110615 shutdown_connections 2024-09-13T23:07:19.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.577+0000 7f26f0c2f800 1 --2- 172.21.15.164:0/1206110615 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f25c4036b40 0x7f25c4039000 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.577+0000 7f26f0c2f800 1 --2- 172.21.15.164:0/1206110615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a7764f20 0x55e2a7765340 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.577+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1206110615 >> 172.21.15.164:0/1206110615 conn(0x55e2a7759eb0 msgr2=0x55e2a775ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.577+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1206110615 shutdown_connections 2024-09-13T23:07:19.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.577+0000 7f26f0c2f800 1 -- 172.21.15.164:0/1206110615 wait complete. 2024-09-13T23:07:19.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.577+0000 7f26f0c2f800 1 -- 172.21.15.164:0/4036821710 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e2a765ad90 msgr2=0x55e2a7754560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.577+0000 7f26f0c2f800 1 --2- 172.21.15.164:0/4036821710 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e2a765ad90 0x55e2a7754560 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.577+0000 7f26f0c2f800 1 -- 172.21.15.164:0/4036821710 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f25d4036b40 msgr2=0x7f25d4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.577+0000 7f26f0c2f800 1 --2- 172.21.15.164:0/4036821710 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f25d4036b40 0x7f25d4039000 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f26e0057000 tx=0x7f26e0052000 comp rx=0 tx=0).stop 2024-09-13T23:07:19.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.577+0000 7f26f0c2f800 1 -- 172.21.15.164:0/4036821710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a75c8620 msgr2=0x55e2a774d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.577+0000 7f26f0c2f800 1 --2- 172.21.15.164:0/4036821710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a75c8620 0x55e2a774d4f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f26dc00b7c0 tx=0x7f26dc000ed0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.577+0000 7f26f0c2f800 1 -- 172.21.15.164:0/4036821710 shutdown_connections 2024-09-13T23:07:19.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.577+0000 7f26f0c2f800 1 --2- 172.21.15.164:0/4036821710 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55e2a765ad90 0x55e2a7754560 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.577+0000 7f26f0c2f800 1 --2- 172.21.15.164:0/4036821710 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f25d4036b40 0x7f25d4039000 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.577+0000 7f26f0c2f800 1 --2- 172.21.15.164:0/4036821710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a75c8620 0x55e2a774d4f0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.577+0000 7f26f0c2f800 1 -- 172.21.15.164:0/4036821710 >> 172.21.15.164:0/4036821710 conn(0x55e2a764ede0 msgr2=0x55e2a773fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.577+0000 7f26f0c2f800 1 -- 172.21.15.164:0/4036821710 shutdown_connections 2024-09-13T23:07:19.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.577+0000 7f26f0c2f800 1 -- 172.21.15.164:0/4036821710 wait complete. 2024-09-13T23:07:19.589 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-13T23:07:19.562829Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:07:19.562816Z', 'tags': [], 'group_ids': []} 2024-09-13T23:07:19.589 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-13T23:07:19.562829Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:07:19.562816Z', 'tags': [], 'group_ids': []} 2024-09-13T23:07:19.589 ERROR:root:0 2024-09-13T23:07:19.590 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:07:19.602 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:07:19.603 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-09-13T23:07:19.603 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-09-13T23:07:19.603 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-09-13T23:07:19.647 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:07:19.647 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:07:19.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.647+0000 7f02c4f2e800 1 Processor -- start 2024-09-13T23:07:19.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.647+0000 7f02c4f2e800 1 -- start start 2024-09-13T23:07:19.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.647+0000 7f02c4f2e800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55c6ec13a550 0x55c6ec13a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.647+0000 7f02c4f2e800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c6ebffab30 con 0x55c6ec13ae90 2024-09-13T23:07:19.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.647+0000 7f02c4f2e800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55c6ebfdc360 con 0x55c6ec13a550 2024-09-13T23:07:19.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.648+0000 7f02c0b6e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55c6ec13a550 0x55c6ec13a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.648+0000 7f02bbfff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55c6ec13ae90 0x55c6ec13fa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:37888/0 (socket says 172.21.15.164:37888) 2024-09-13T23:07:19.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.648+0000 7f02bbfff640 1 -- 172.21.15.164:0/1403342535 learned_addr learned my addr 172.21.15.164:0/1403342535 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:07:19.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.648+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1403342535 >> v1:172.21.15.17:6789/0 conn(0x55c6ec13ae90 legacy=0x55c6ec13fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.648+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1403342535 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6ec002e00 con 0x55c6ec13a550 2024-09-13T23:07:19.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.650+0000 7f02c0b6e640 1 --2- 172.21.15.164:0/1403342535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec13a550 0x55c6ec13a950 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f02b400a470 tx=0x7f02b4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30236a9d89cc1eb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.650+0000 7f02bb7fe640 1 -- 172.21.15.164:0/1403342535 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02b4053570 con 0x55c6ec13a550 2024-09-13T23:07:19.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.650+0000 7f02bb7fe640 1 -- 172.21.15.164:0/1403342535 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b4058070 con 0x55c6ec13a550 2024-09-13T23:07:19.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.650+0000 7f02bb7fe640 1 -- 172.21.15.164:0/1403342535 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02b4053880 con 0x55c6ec13a550 2024-09-13T23:07:19.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.651+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1403342535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec13a550 msgr2=0x55c6ec13a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.651+0000 7f02c4f2e800 1 --2- 172.21.15.164:0/1403342535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec13a550 0x55c6ec13a950 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f02b400a470 tx=0x7f02b4045a20 comp rx=0 tx=0).stop 2024-09-13T23:07:19.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.651+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1403342535 shutdown_connections 2024-09-13T23:07:19.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.651+0000 7f02c4f2e800 1 --2- 172.21.15.164:0/1403342535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec13a550 0x55c6ec13a950 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.651+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1403342535 >> 172.21.15.164:0/1403342535 conn(0x55c6ec135de0 msgr2=0x55c6ec138200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.651+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1403342535 shutdown_connections 2024-09-13T23:07:19.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.651+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1403342535 wait complete. 2024-09-13T23:07:19.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.665+0000 7f02c4f2e800 1 Processor -- start 2024-09-13T23:07:19.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.665+0000 7f02c4f2e800 1 -- start start 2024-09-13T23:07:19.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.665+0000 7f02c4f2e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec13a550 0x55c6ec0af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.665+0000 7f02c4f2e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c6ec087330 con 0x55c6ec13a550 2024-09-13T23:07:19.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.665+0000 7f02c0b6e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec13a550 0x55c6ec0af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.665+0000 7f02c0b6e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec13a550 0x55c6ec0af5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54626/0 (socket says 172.21.15.164:54626) 2024-09-13T23:07:19.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.665+0000 7f02c0b6e640 1 -- 172.21.15.164:0/3238881653 learned_addr learned my addr 172.21.15.164:0/3238881653 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.665+0000 7f02c0b6e640 1 -- 172.21.15.164:0/3238881653 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6ebfd4bc0 con 0x55c6ec13a550 2024-09-13T23:07:19.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.666+0000 7f02c0b6e640 1 --2- 172.21.15.164:0/3238881653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec13a550 0x55c6ec0af5a0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f02b4025c20 tx=0x7f02b4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4b798120fe5e15a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.666+0000 7f01aee05640 1 -- 172.21.15.164:0/3238881653 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02b4053ba0 con 0x55c6ec13a550 2024-09-13T23:07:19.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.666+0000 7f01aee05640 1 -- 172.21.15.164:0/3238881653 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b4063030 con 0x55c6ec13a550 2024-09-13T23:07:19.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.666+0000 7f01aee05640 1 -- 172.21.15.164:0/3238881653 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02b4053440 con 0x55c6ec13a550 2024-09-13T23:07:19.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.667+0000 7f02c4f2e800 1 -- 172.21.15.164:0/3238881653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec13a550 msgr2=0x55c6ec0af5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.667+0000 7f02c4f2e800 1 --2- 172.21.15.164:0/3238881653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec13a550 0x55c6ec0af5a0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f02b4025c20 tx=0x7f02b4051000 comp rx=0 tx=0).stop 2024-09-13T23:07:19.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.667+0000 7f02c4f2e800 1 -- 172.21.15.164:0/3238881653 shutdown_connections 2024-09-13T23:07:19.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.667+0000 7f02c4f2e800 1 --2- 172.21.15.164:0/3238881653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec13a550 0x55c6ec0af5a0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.667+0000 7f02c4f2e800 1 -- 172.21.15.164:0/3238881653 >> 172.21.15.164:0/3238881653 conn(0x55c6ec135de0 msgr2=0x55c6ec225150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.667+0000 7f02c4f2e800 1 -- 172.21.15.164:0/3238881653 shutdown_connections 2024-09-13T23:07:19.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.667+0000 7f02c4f2e800 1 -- 172.21.15.164:0/3238881653 wait complete. 2024-09-13T23:07:19.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.667+0000 7f02c4f2e800 1 Processor -- start 2024-09-13T23:07:19.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.667+0000 7f02c4f2e800 1 -- start start 2024-09-13T23:07:19.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.667+0000 7f02c4f2e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec13a550 0x55c6ec232210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.667+0000 7f02c4f2e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c6ec141570 con 0x55c6ec13a550 2024-09-13T23:07:19.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.667+0000 7f02c0b6e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec13a550 0x55c6ec232210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.668+0000 7f02c0b6e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec13a550 0x55c6ec232210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54642/0 (socket says 172.21.15.164:54642) 2024-09-13T23:07:19.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.668+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1250397108 learned_addr learned my addr 172.21.15.164:0/1250397108 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.668+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1250397108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6ebfe8fe0 con 0x55c6ec13a550 2024-09-13T23:07:19.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.668+0000 7f02c0b6e640 1 --2- 172.21.15.164:0/1250397108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec13a550 0x55c6ec232210 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x55c6ec0aeca0 tx=0x7f02b4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.668+0000 7f01ad602640 1 -- 172.21.15.164:0/1250397108 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02b4078070 con 0x55c6ec13a550 2024-09-13T23:07:19.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.668+0000 7f01ad602640 1 -- 172.21.15.164:0/1250397108 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b4053570 con 0x55c6ec13a550 2024-09-13T23:07:19.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.668+0000 7f01ad602640 1 -- 172.21.15.164:0/1250397108 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02b4053850 con 0x55c6ec13a550 2024-09-13T23:07:19.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.668+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1250397108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c6ec232750 con 0x55c6ec13a550 2024-09-13T23:07:19.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.668+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1250397108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6ec232cd0 con 0x55c6ec13a550 2024-09-13T23:07:19.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.669+0000 7f01ad602640 1 -- 172.21.15.164:0/1250397108 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f02b407b070 con 0x55c6ec13a550 2024-09-13T23:07:19.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.669+0000 7f01ad602640 1 --2- 172.21.15.164:0/1250397108 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f01a8036b40 0x7f01a8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.669+0000 7f01ad602640 1 -- 172.21.15.164:0/1250397108 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f02b4070070 con 0x55c6ec13a550 2024-09-13T23:07:19.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.669+0000 7f02bbfff640 1 --2- 172.21.15.164:0/1250397108 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f01a8036b40 0x7f01a8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.669+0000 7f02c4f2e800 1 --2- 172.21.15.164:0/1250397108 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c6ec13ae90 0x55c6ec239280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.669+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1250397108 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2398a0 con 0x55c6ec13ae90 2024-09-13T23:07:19.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.669+0000 7f02c136f640 1 --2- 172.21.15.164:0/1250397108 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c6ec13ae90 0x55c6ec239280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.670+0000 7f02bbfff640 1 --2- 172.21.15.164:0/1250397108 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f01a8036b40 0x7f01a8039000 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f02ac000f60 tx=0x7f02ac0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.670+0000 7f02c136f640 1 --2- 172.21.15.164:0/1250397108 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c6ec13ae90 0x55c6ec239280 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.670+0000 7f02c136f640 1 -- 172.21.15.164:0/1250397108 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f02bc00a4a0 con 0x55c6ec13ae90 2024-09-13T23:07:19.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.670+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1250397108 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec236830 con 0x55c6ec13ae90 2024-09-13T23:07:19.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.670+0000 7f02c136f640 1 -- 172.21.15.164:0/1250397108 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f02bc00a4a0 con 0x55c6ec13ae90 2024-09-13T23:07:19.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.670+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1250397108 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec23b710 con 0x55c6ec13ae90 2024-09-13T23:07:19.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.671+0000 7f02c136f640 1 -- 172.21.15.164:0/1250397108 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f02bc00a4a0 con 0x55c6ec13ae90 2024-09-13T23:07:19.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.671+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1250397108 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec23a7f0 con 0x55c6ec13ae90 2024-09-13T23:07:19.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.671+0000 7f02c136f640 1 -- 172.21.15.164:0/1250397108 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f02bc00a4a0 con 0x55c6ec13ae90 2024-09-13T23:07:19.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.671+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1250397108 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec23ac40 con 0x55c6ec13ae90 2024-09-13T23:07:19.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.671+0000 7f02c136f640 1 -- 172.21.15.164:0/1250397108 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f02bc00a4a0 con 0x55c6ec13ae90 2024-09-13T23:07:19.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.672+0000 7f02c4f2e800 1 Processor -- start 2024-09-13T23:07:19.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.672+0000 7f02c4f2e800 1 -- start start 2024-09-13T23:07:19.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.672+0000 7f02c4f2e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec249c90 0x55c6ec24a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.672+0000 7f02c4f2e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c6ebfd6580 con 0x55c6ec249c90 2024-09-13T23:07:19.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.672+0000 7f02bbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec249c90 0x55c6ec24a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.672+0000 7f02bbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec249c90 0x55c6ec24a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54648/0 (socket says 172.21.15.164:54648) 2024-09-13T23:07:19.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.672+0000 7f02bbfff640 1 -- 172.21.15.164:0/1786258269 learned_addr learned my addr 172.21.15.164:0/1786258269 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.672+0000 7f02bbfff640 1 -- 172.21.15.164:0/1786258269 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6ec24a5f0 con 0x55c6ec249c90 2024-09-13T23:07:19.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.673+0000 7f02bbfff640 1 --2- 172.21.15.164:0/1786258269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec249c90 0x55c6ec24a0b0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f02ac001ed0 tx=0x7f02ac00d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.673+0000 7f01a67fc640 1 -- 172.21.15.164:0/1786258269 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02ac01b550 con 0x55c6ec249c90 2024-09-13T23:07:19.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.673+0000 7f01a67fc640 1 -- 172.21.15.164:0/1786258269 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02ac01b6f0 con 0x55c6ec249c90 2024-09-13T23:07:19.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.673+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1786258269 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c6ec24a880 con 0x55c6ec249c90 2024-09-13T23:07:19.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.673+0000 7f01a67fc640 1 -- 172.21.15.164:0/1786258269 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02ac01b9d0 con 0x55c6ec249c90 2024-09-13T23:07:19.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.673+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1786258269 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6ec24d560 con 0x55c6ec249c90 2024-09-13T23:07:19.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.674+0000 7f01a67fc640 1 -- 172.21.15.164:0/1786258269 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f02ac023020 con 0x55c6ec249c90 2024-09-13T23:07:19.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.674+0000 7f01a67fc640 1 --2- 172.21.15.164:0/1786258269 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0198036b40 0x7f0198039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.674+0000 7f01a67fc640 1 -- 172.21.15.164:0/1786258269 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f02ac021020 con 0x55c6ec249c90 2024-09-13T23:07:19.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.674+0000 7f02c136f640 1 --2- 172.21.15.164:0/1786258269 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0198036b40 0x7f0198039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.674+0000 7f02c4f2e800 1 Processor -- start 2024-09-13T23:07:19.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.674+0000 7f02c136f640 1 --2- 172.21.15.164:0/1786258269 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0198036b40 0x7f0198039000 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x55c6ec23a310 tx=0x7f02bc005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.674+0000 7f02c4f2e800 1 -- start start 2024-09-13T23:07:19.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.674+0000 7f02c4f2e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec2569a0 0x55c6ec256da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.674+0000 7f02c4f2e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c6ec22d710 con 0x55c6ec2569a0 2024-09-13T23:07:19.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.675+0000 7f02bbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec2569a0 0x55c6ec256da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.675+0000 7f02bbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec2569a0 0x55c6ec256da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54658/0 (socket says 172.21.15.164:54658) 2024-09-13T23:07:19.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.675+0000 7f02bbfff640 1 -- 172.21.15.164:0/2872593098 learned_addr learned my addr 172.21.15.164:0/2872593098 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.675+0000 7f02bbfff640 1 -- 172.21.15.164:0/2872593098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6ec257370 con 0x55c6ec2569a0 2024-09-13T23:07:19.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.675+0000 7f02bbfff640 1 --2- 172.21.15.164:0/2872593098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec2569a0 0x55c6ec256da0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f02ac04d180 tx=0x7f02ac046be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d1dedfbfb77325 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.675+0000 7f0197fff640 1 -- 172.21.15.164:0/2872593098 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02ac01be20 con 0x55c6ec2569a0 2024-09-13T23:07:19.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.675+0000 7f0197fff640 1 -- 172.21.15.164:0/2872593098 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02ac046070 con 0x55c6ec2569a0 2024-09-13T23:07:19.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.675+0000 7f0197fff640 1 -- 172.21.15.164:0/2872593098 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02ac00c360 con 0x55c6ec2569a0 2024-09-13T23:07:19.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.676+0000 7f02c4f2e800 1 -- 172.21.15.164:0/2872593098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec2569a0 msgr2=0x55c6ec256da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.676+0000 7f02c4f2e800 1 --2- 172.21.15.164:0/2872593098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec2569a0 0x55c6ec256da0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f02ac04d180 tx=0x7f02ac046be0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.676+0000 7f02c4f2e800 1 -- 172.21.15.164:0/2872593098 shutdown_connections 2024-09-13T23:07:19.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.676+0000 7f02c4f2e800 1 --2- 172.21.15.164:0/2872593098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec2569a0 0x55c6ec256da0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.676+0000 7f02c4f2e800 1 -- 172.21.15.164:0/2872593098 >> 172.21.15.164:0/2872593098 conn(0x55c6ec252d00 msgr2=0x55c6ec250e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.676+0000 7f02c4f2e800 1 -- 172.21.15.164:0/2872593098 shutdown_connections 2024-09-13T23:07:19.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.676+0000 7f02c4f2e800 1 -- 172.21.15.164:0/2872593098 wait complete. 2024-09-13T23:07:19.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.676+0000 7f02c4f2e800 1 Processor -- start 2024-09-13T23:07:19.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.676+0000 7f02c4f2e800 1 -- start start 2024-09-13T23:07:19.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.676+0000 7f02c4f2e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec2569a0 0x55c6ec25deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.676+0000 7f02c4f2e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c6ec2579e0 con 0x55c6ec2569a0 2024-09-13T23:07:19.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.676+0000 7f02bbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec2569a0 0x55c6ec25deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.676+0000 7f02bbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec2569a0 0x55c6ec25deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54666/0 (socket says 172.21.15.164:54666) 2024-09-13T23:07:19.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.676+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 learned_addr learned my addr 172.21.15.164:0/1592794005 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.677+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6ec25e3f0 con 0x55c6ec2569a0 2024-09-13T23:07:19.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.677+0000 7f02bbfff640 1 --2- 172.21.15.164:0/1592794005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec2569a0 0x55c6ec25deb0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f02ac04d180 tx=0x7f02ac04d110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.677+0000 7f01967fc640 1 -- 172.21.15.164:0/1592794005 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02ac01be20 con 0x55c6ec2569a0 2024-09-13T23:07:19.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.677+0000 7f01967fc640 1 -- 172.21.15.164:0/1592794005 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02ac00c360 con 0x55c6ec2569a0 2024-09-13T23:07:19.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.677+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c6ec25e680 con 0x55c6ec2569a0 2024-09-13T23:07:19.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.677+0000 7f01967fc640 1 -- 172.21.15.164:0/1592794005 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02ac046d10 con 0x55c6ec2569a0 2024-09-13T23:07:19.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.677+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6ec25e680 con 0x55c6ec2569a0 2024-09-13T23:07:19.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.678+0000 7f01967fc640 1 -- 172.21.15.164:0/1592794005 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f02ac025980 con 0x55c6ec2569a0 2024-09-13T23:07:19.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.678+0000 7f01967fc640 1 --2- 172.21.15.164:0/1592794005 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f018c036b40 0x7f018c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.678+0000 7f01967fc640 1 -- 172.21.15.164:0/1592794005 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f02ac00f070 con 0x55c6ec2569a0 2024-09-13T23:07:19.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.678+0000 7f02c136f640 1 --2- 172.21.15.164:0/1592794005 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f018c036b40 0x7f018c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.678+0000 7f02c136f640 1 --2- 172.21.15.164:0/1592794005 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f018c036b40 0x7f018c039000 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55c6ec2367a0 tx=0x7f02bc01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.679+0000 7f02c4f2e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.679+0000 7f02c4f2e800 1 --2- 172.21.15.164:0/1592794005 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c6ec2697a0 0x55c6ec26bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.679+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec26c3b0 con 0x55c6ec2697a0 2024-09-13T23:07:19.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.679+0000 7f02c0b6e640 1 --2- 172.21.15.164:0/1592794005 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c6ec2697a0 0x55c6ec26bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.679+0000 7f02c0b6e640 1 --2- 172.21.15.164:0/1592794005 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c6ec2697a0 0x55c6ec26bc60 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.679+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.679+0000 7f02c4f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.679+0000 7f02c4f2e800 20 realm 2024-09-13T23:07:19.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.679+0000 7f02c4f2e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.679+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec26c7c0 con 0x55c6ec2697a0 2024-09-13T23:07:19.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.680+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.680+0000 7f02c4f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.680+0000 7f02c4f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:07:19.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.680+0000 7f02c4f2e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.680+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec26d090 con 0x55c6ec2697a0 2024-09-13T23:07:19.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.680+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.680+0000 7f02c4f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.680+0000 7f02c4f2e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.680+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec26d430 con 0x55c6ec2697a0 2024-09-13T23:07:19.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.680+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.680+0000 7f02c4f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:19.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.680+0000 7f02c4f2e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.680+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec26dc80 con 0x55c6ec2697a0 2024-09-13T23:07:19.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.680+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.680+0000 7f02c4f2e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:07:19.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.680+0000 7f02c4f2e800 20 searching for the correct realm 2024-09-13T23:07:19.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.680+0000 7f02c4f2e800 1 --2- 172.21.15.164:0/1592794005 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55c6ec26f9f0 0x55c6ec271de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.680+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x55c6ec26f9f0 2024-09-13T23:07:19.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.680+0000 7f02bbfff640 1 --2- 172.21.15.164:0/1592794005 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55c6ec26f9f0 0x55c6ec271de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.681+0000 7f02bbfff640 1 --2- 172.21.15.164:0/1592794005 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55c6ec26f9f0 0x55c6ec271de0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.681+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.681+0000 7f02bbfff640 1 --2- 172.21.15.164:0/1592794005 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f02ac027580 0x7f02ac027a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.681+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x7f02ac027580 2024-09-13T23:07:19.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.681+0000 7f02c136f640 1 --2- 172.21.15.164:0/1592794005 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f02ac027580 0x7f02ac027a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.681+0000 7f02c136f640 1 --2- 172.21.15.164:0/1592794005 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f02ac027580 0x7f02ac027a00 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.682+0000 7f02c136f640 1 -- 172.21.15.164:0/1592794005 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02bc01f070 con 0x7f02ac027580 2024-09-13T23:07:19.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.682+0000 7f02c136f640 1 --2- 172.21.15.164:0/1592794005 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f02bc031040 0x7f02bc032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.682+0000 7f02c136f640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x7f02bc031040 2024-09-13T23:07:19.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.682+0000 7f02c0b6e640 1 --2- 172.21.15.164:0/1592794005 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f02bc031040 0x7f02bc032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.682+0000 7f02c0b6e640 1 --2- 172.21.15.164:0/1592794005 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f02bc031040 0x7f02bc032430 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.682+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b407a030 con 0x7f02bc031040 2024-09-13T23:07:19.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.682+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x55c6ec2697a0 2024-09-13T23:07:19.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.683+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.683+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x55c6ec2697a0 2024-09-13T23:07:19.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.683+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.683+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x7f02bc031040 2024-09-13T23:07:19.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.683+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b407a030 con 0x7f02bc031040 2024-09-13T23:07:19.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.683+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x7f02bc031040 2024-09-13T23:07:19.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.683+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b407a030 con 0x7f02bc031040 2024-09-13T23:07:19.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.683+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x7f02ac027580 2024-09-13T23:07:19.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.684+0000 7f02c136f640 1 -- 172.21.15.164:0/1592794005 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02bc01f070 con 0x7f02ac027580 2024-09-13T23:07:19.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.684+0000 7f02c136f640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x55c6ec26f9f0 2024-09-13T23:07:19.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.684+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.684+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x55c6ec2697a0 2024-09-13T23:07:19.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.684+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.684+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x7f02bc031040 2024-09-13T23:07:19.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.684+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b407a030 con 0x7f02bc031040 2024-09-13T23:07:19.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.685+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x55c6ec2697a0 2024-09-13T23:07:19.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.685+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.685+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x7f02ac027580 2024-09-13T23:07:19.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.685+0000 7f02c136f640 1 -- 172.21.15.164:0/1592794005 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f02bc01f070 con 0x7f02ac027580 2024-09-13T23:07:19.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.685+0000 7f02c136f640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x55c6ec26f9f0 2024-09-13T23:07:19.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.685+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.685+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x55c6ec26f9f0 2024-09-13T23:07:19.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.685+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.685+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x7f02bc031040 2024-09-13T23:07:19.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.686+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b407a030 con 0x7f02bc031040 2024-09-13T23:07:19.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.686+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x55c6ec26f9f0 2024-09-13T23:07:19.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.686+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.686+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x55c6ec26f9f0 2024-09-13T23:07:19.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.686+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.686+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x55c6ec2697a0 2024-09-13T23:07:19.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.686+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.686+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x55c6ec2697a0 2024-09-13T23:07:19.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.687+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.687+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x7f02bc031040 2024-09-13T23:07:19.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.687+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b407a030 con 0x7f02bc031040 2024-09-13T23:07:19.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.687+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x55c6ec26f9f0 2024-09-13T23:07:19.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.687+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.687+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x7f02ac027580 2024-09-13T23:07:19.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.688+0000 7f02c136f640 1 -- 172.21.15.164:0/1592794005 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02bc01f070 con 0x7f02ac027580 2024-09-13T23:07:19.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.688+0000 7f02c136f640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x55c6ec2697a0 2024-09-13T23:07:19.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.688+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.688+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x7f02bc031040 2024-09-13T23:07:19.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.688+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b407a030 con 0x7f02bc031040 2024-09-13T23:07:19.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.688+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x55c6ec26f9f0 2024-09-13T23:07:19.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.688+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.688+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x7f02bc031040 2024-09-13T23:07:19.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.689+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b407a030 con 0x7f02bc031040 2024-09-13T23:07:19.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.689+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x7f02ac027580 2024-09-13T23:07:19.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.689+0000 7f02c136f640 1 -- 172.21.15.164:0/1592794005 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02bc01f070 con 0x7f02ac027580 2024-09-13T23:07:19.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.689+0000 7f02c136f640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x55c6ec26f9f0 2024-09-13T23:07:19.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.689+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.689+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x7f02ac027580 2024-09-13T23:07:19.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.689+0000 7f02c136f640 1 -- 172.21.15.164:0/1592794005 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02bc01f070 con 0x7f02ac027580 2024-09-13T23:07:19.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.689+0000 7f02c136f640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x55c6ec2697a0 2024-09-13T23:07:19.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.690+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.690+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2723f0 con 0x7f02ac027580 2024-09-13T23:07:19.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.690+0000 7f02c136f640 1 -- 172.21.15.164:0/1592794005 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02bc040040 con 0x7f02ac027580 2024-09-13T23:07:19.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.690+0000 7f02c4f2e800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:07:19.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.690+0000 7f02c4f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:07:19.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.690+0000 7f02c4f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:07:19.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.690+0000 7f02c4f2e800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:07:19.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.690+0000 7f02c4f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:07:19.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.690+0000 7f02c4f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:07:19.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.690+0000 7f02c4f2e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.690+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec26e630 con 0x55c6ec2697a0 2024-09-13T23:07:19.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.690+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.690+0000 7f02c4f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.690+0000 7f02c4f2e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.690+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec26eed0 con 0x55c6ec2697a0 2024-09-13T23:07:19.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.690+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.690+0000 7f02c4f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:19.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.690+0000 7f02c4f2e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.690+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec26eed0 con 0x55c6ec2697a0 2024-09-13T23:07:19.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.691+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.691+0000 7f02c4f2e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:07:19.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.691+0000 7f02c4f2e800 20 zone default found 2024-09-13T23:07:19.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.691+0000 7f02c4f2e800 4 Realm: () 2024-09-13T23:07:19.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.691+0000 7f02c4f2e800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:07:19.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.691+0000 7f02c4f2e800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:07:19.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.691+0000 7f02c4f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:07:19.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.691+0000 7f02c4f2e800 20 zonegroup default 2024-09-13T23:07:19.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.691+0000 7f02c4f2e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.691+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec272870 con 0x7f02bc031040 2024-09-13T23:07:19.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.691+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x7f02bc031040 2024-09-13T23:07:19.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.691+0000 7f02c4f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.691+0000 7f02c4f2e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.691+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec26eca0 con 0x55c6ec26f9f0 2024-09-13T23:07:19.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.691+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.691+0000 7f02c4f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.691+0000 7f02c4f2e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.691+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2747b0 con 0x55c6ec26f9f0 2024-09-13T23:07:19.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.691+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.691+0000 7f02c4f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.691+0000 7f02c4f2e800 20 started sync module instance, tier type = 2024-09-13T23:07:19.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.691+0000 7f02c4f2e800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:07:19.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.691+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec273b90 con 0x7f02ac027580 2024-09-13T23:07:19.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.693+0000 7f02c136f640 1 -- 172.21.15.164:0/1592794005 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02bc040040 con 0x7f02ac027580 2024-09-13T23:07:19.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.693+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94312853880704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2737f0 con 0x7f02ac027580 2024-09-13T23:07:19.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.693+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2756c0 con 0x55c6ec2697a0 2024-09-13T23:07:19.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.694+0000 7f02c136f640 1 -- 172.21.15.164:0/1592794005 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94312853880704] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02bc040040 con 0x7f02ac027580 2024-09-13T23:07:19.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.694+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.694+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94312853883888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2756c0 con 0x55c6ec2697a0 2024-09-13T23:07:19.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.694+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2760c0 con 0x55c6ec26f9f0 2024-09-13T23:07:19.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.695+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.695+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94312853887952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec276960 con 0x55c6ec26f9f0 2024-09-13T23:07:19.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.695+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec277400 con 0x7f02ac027580 2024-09-13T23:07:19.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.695+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94312853883888] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.696+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94312853887952] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.696+0000 7f02c136f640 1 -- 172.21.15.164:0/1592794005 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02bc040040 con 0x7f02ac027580 2024-09-13T23:07:19.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.696+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94312853890224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec275210 con 0x7f02ac027580 2024-09-13T23:07:19.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.696+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec277ce0 con 0x55c6ec2697a0 2024-09-13T23:07:19.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.697+0000 7f02c136f640 1 -- 172.21.15.164:0/1592794005 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94312853890224] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02bc040040 con 0x7f02ac027580 2024-09-13T23:07:19.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.697+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.697+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94312853892816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec277ca0 con 0x55c6ec2697a0 2024-09-13T23:07:19.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.698+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec278730 con 0x7f02bc031040 2024-09-13T23:07:19.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.699+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94312853892816] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.699+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x7f02bc031040 2024-09-13T23:07:19.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.699+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94312853897792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec277ca0 con 0x7f02bc031040 2024-09-13T23:07:19.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.699+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec279180 con 0x7f02bc031040 2024-09-13T23:07:19.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.700+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94312853897792] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x7f02bc031040 2024-09-13T23:07:19.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.700+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x7f02bc031040 2024-09-13T23:07:19.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.700+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94312853900432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec277ca0 con 0x7f02bc031040 2024-09-13T23:07:19.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.700+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec279b90 con 0x7f02bc031040 2024-09-13T23:07:19.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.701+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94312853900432] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x7f02bc031040 2024-09-13T23:07:19.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.701+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x7f02bc031040 2024-09-13T23:07:19.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.701+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94312853895424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec279b90 con 0x7f02bc031040 2024-09-13T23:07:19.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.701+0000 7f02c4f2e800 20 add_watcher() i=0 2024-09-13T23:07:19.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.701+0000 7f02c4f2e800 20 add_watcher() i=1 2024-09-13T23:07:19.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.701+0000 7f02c4f2e800 20 add_watcher() i=2 2024-09-13T23:07:19.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.701+0000 7f02c4f2e800 20 add_watcher() i=3 2024-09-13T23:07:19.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.701+0000 7f02c4f2e800 20 add_watcher() i=4 2024-09-13T23:07:19.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.701+0000 7f02c4f2e800 20 add_watcher() i=5 2024-09-13T23:07:19.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.701+0000 7f02c4f2e800 20 add_watcher() i=6 2024-09-13T23:07:19.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.702+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94312853895424] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x7f02bc031040 2024-09-13T23:07:19.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.702+0000 7f02c4f2e800 20 add_watcher() i=7 2024-09-13T23:07:19.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.702+0000 7f02c4f2e800 2 all 8 watchers are set, enabling cache 2024-09-13T23:07:19.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.702+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec27ced0 con 0x55c6ec2697a0 2024-09-13T23:07:19.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.703+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.703+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94312853915888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec279d00 con 0x55c6ec2697a0 2024-09-13T23:07:19.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.704+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94312853915888] v34'253 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.704+0000 7f0176fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:19.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.704+0000 7f02c4f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:07:19.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.704+0000 7f02c4f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:07:19.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.704+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec27c300 con 0x55c6ec2697a0 2024-09-13T23:07:19.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.705+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.705+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec286070 con 0x7f02bc031040 2024-09-13T23:07:19.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.707+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x7f02bc031040 2024-09-13T23:07:19.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.707+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec286520 con 0x55c6ec26f9f0 2024-09-13T23:07:19.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.707+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.707+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2868c0 con 0x55c6ec2697a0 2024-09-13T23:07:19.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.708+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'254 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.708+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2868c0 con 0x7f02ac027580 2024-09-13T23:07:19.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.709+0000 7f02c136f640 1 -- 172.21.15.164:0/1592794005 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'80 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f02bc040040 con 0x7f02ac027580 2024-09-13T23:07:19.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.709+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec286d40 con 0x55c6ec26f9f0 2024-09-13T23:07:19.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.710+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'53 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.710+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2871c0 con 0x55c6ec2697a0 2024-09-13T23:07:19.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.711+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.711+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2871c0 con 0x7f02bc031040 2024-09-13T23:07:19.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.713+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'55 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x7f02bc031040 2024-09-13T23:07:19.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.713+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec287210 con 0x7f02ac027580 2024-09-13T23:07:19.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.714+0000 7f02c136f640 1 -- 172.21.15.164:0/1592794005 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f02bc040040 con 0x7f02ac027580 2024-09-13T23:07:19.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.714+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec287890 con 0x55c6ec26f9f0 2024-09-13T23:07:19.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.714+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.714+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec287890 con 0x7f02ac027580 2024-09-13T23:07:19.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.715+0000 7f02c136f640 1 -- 172.21.15.164:0/1592794005 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'81 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02bc040040 con 0x7f02ac027580 2024-09-13T23:07:19.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.715+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec287ec0 con 0x7f02bc031040 2024-09-13T23:07:19.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.716+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x7f02bc031040 2024-09-13T23:07:19.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.717+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec288340 con 0x7f02ac027580 2024-09-13T23:07:19.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.717+0000 7f02c136f640 1 -- 172.21.15.164:0/1592794005 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02bc040040 con 0x7f02ac027580 2024-09-13T23:07:19.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.717+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec288340 con 0x7f02bc031040 2024-09-13T23:07:19.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.719+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'59 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x7f02bc031040 2024-09-13T23:07:19.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.719+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec288340 con 0x55c6ec2697a0 2024-09-13T23:07:19.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.720+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'255 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.720+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec288340 con 0x55c6ec26f9f0 2024-09-13T23:07:19.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.721+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'74 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.721+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec288340 con 0x7f02ac027580 2024-09-13T23:07:19.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.722+0000 7f02c136f640 1 -- 172.21.15.164:0/1592794005 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'82 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02bc040040 con 0x7f02ac027580 2024-09-13T23:07:19.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.722+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec288340 con 0x55c6ec26f9f0 2024-09-13T23:07:19.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.723+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.723+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec288340 con 0x55c6ec2697a0 2024-09-13T23:07:19.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.724+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.724+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec288340 con 0x55c6ec2697a0 2024-09-13T23:07:19.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.725+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'256 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.725+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec288340 con 0x55c6ec26f9f0 2024-09-13T23:07:19.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.726+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'75 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.726+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec288340 con 0x7f02ac027580 2024-09-13T23:07:19.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.727+0000 7f02c136f640 1 -- 172.21.15.164:0/1592794005 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02bc040040 con 0x7f02ac027580 2024-09-13T23:07:19.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.727+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec288340 con 0x55c6ec26f9f0 2024-09-13T23:07:19.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.728+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.728+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec288340 con 0x55c6ec26f9f0 2024-09-13T23:07:19.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.729+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.729+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec288340 con 0x55c6ec26f9f0 2024-09-13T23:07:19.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.730+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.730+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec288340 con 0x55c6ec26f9f0 2024-09-13T23:07:19.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.731+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'54 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.731+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec288340 con 0x7f02bc031040 2024-09-13T23:07:19.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.732+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x7f02bc031040 2024-09-13T23:07:19.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.732+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec288340 con 0x55c6ec26f9f0 2024-09-13T23:07:19.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.733+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.733+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec288340 con 0x7f02bc031040 2024-09-13T23:07:19.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.734+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'56 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x7f02bc031040 2024-09-13T23:07:19.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.735+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec288340 con 0x55c6ec26f9f0 2024-09-13T23:07:19.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.736+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'76 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.736+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec288340 con 0x7f02bc031040 2024-09-13T23:07:19.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.737+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'60 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x7f02bc031040 2024-09-13T23:07:19.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.737+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec288340 con 0x7f02ac027580 2024-09-13T23:07:19.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.738+0000 7f02c136f640 1 -- 172.21.15.164:0/1592794005 <== osd.2 v2:172.21.15.164:6808/3795914978 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02bc040040 con 0x7f02ac027580 2024-09-13T23:07:19.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.738+0000 7f0175fe3640 20 reqs_thread_entry: start 2024-09-13T23:07:19.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.738+0000 7f02c4f2e800 20 init_complete bucket index max shards: 11 2024-09-13T23:07:19.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.738+0000 7f02c4f2e800 20 Filter name: none 2024-09-13T23:07:19.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.738+0000 7f00e77fe640 20 reqs_thread_entry: start 2024-09-13T23:07:19.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.738+0000 7f02c4f2e800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-13T23:07:19.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.738+0000 7f02c4f2e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.738+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2b30f0 con 0x55c6ec26f9f0 2024-09-13T23:07:19.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.739+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 26 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.739+0000 7f02c4f2e800 20 rados_obj.operate() r=0 bl.length=363 2024-09-13T23:07:19.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.739+0000 7f02c4f2e800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-09-13T23:07:19.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.739+0000 7f02c4f2e800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-13T23:07:19.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.739+0000 7f02c4f2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:07:19.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.739+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2b5b80 con 0x55c6ec26f9f0 2024-09-13T23:07:19.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.739+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 27 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.739+0000 7f02c4f2e800 10 removing key index: true_admin_akey 2024-09-13T23:07:19.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.739+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2b3b60 con 0x55c6ec26f9f0 2024-09-13T23:07:19.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.740+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 28 ==== osd_op_reply(96 true_admin_akey [delete] v34'12 uv12 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.740+0000 7f02c4f2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-13T23:07:19.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.740+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94312854144624 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2b60b0 con 0x7f02bc031040 2024-09-13T23:07:19.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.740+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== watch-notify(notify (1) cookie 94312853897792 notify 146028888109 ret 0) ==== 207+0+0 (crc 0 0 0) 0x55c6ec287890 con 0x7f02bc031040 2024-09-13T23:07:19.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.740+0000 7f0197fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888109 cookie 94312853897792 notifier 4875 bl.length()=165 2024-09-13T23:07:19.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.740+0000 7f0197fff640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f0184003d60 con 0x7f02bc031040 2024-09-13T23:07:19.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.740+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(97 notify.5 [notify cookie 94312854144624 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f02b407a030 con 0x7f02bc031040 2024-09-13T23:07:19.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.741+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x7f02bc031040 2024-09-13T23:07:19.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.741+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== watch-notify(notify_complete (2) cookie 94312854144624 notify 146028888109 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c6ec232cd0 con 0x7f02bc031040 2024-09-13T23:07:19.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.741+0000 7f02c4f2e800 10 removing email index: 2024-09-13T23:07:19.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.741+0000 7f02c4f2e800 10 removing user buckets index 2024-09-13T23:07:19.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.741+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2b6010 con 0x55c6ec26f9f0 2024-09-13T23:07:19.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.742+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 29 ==== osd_op_reply(99 a_user.buckets [delete] v34'7 uv6 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.742+0000 7f02c4f2e800 10 removing user index: a_user 2024-09-13T23:07:19.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.742+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2b6010 con 0x55c6ec26f9f0 2024-09-13T23:07:19.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.742+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 30 ==== osd_op_reply(100 a_user [call,call,delete] v34'4 uv4 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.742+0000 7f02c4f2e800 10 removing default.rgw.meta+users.uid+a_user from cache 2024-09-13T23:07:19.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.743+0000 7f02c4f2e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-13T23:07:19.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.743+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94312854151184 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2b4670 con 0x55c6ec26f9f0 2024-09-13T23:07:19.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.743+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 31 ==== watch-notify(notify (1) cookie 94312853887952 notify 146028888074 ret 0) ==== 197+0+0 (crc 0 0 0) 0x55c6ec287210 con 0x55c6ec26f9f0 2024-09-13T23:07:19.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.743+0000 7f01977fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888074 cookie 94312853887952 notifier 4875 bl.length()=155 2024-09-13T23:07:19.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.743+0000 7f01977fe640 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f00f40032c0 con 0x55c6ec26f9f0 2024-09-13T23:07:19.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.743+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 32 ==== osd_op_reply(101 notify.2 [notify cookie 94312854151184 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.743+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 33 ==== watch-notify(notify_complete (2) cookie 94312854151184 notify 146028888074 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c6ec257370 con 0x55c6ec26f9f0 2024-09-13T23:07:19.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.743+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 34 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.744+0000 7f0176fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:19.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.744+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94312853915888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2b6010 con 0x55c6ec2697a0 2024-09-13T23:07:19.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.745+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94312853915888] v34'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.745+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94312853880704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2b6010 con 0x7f02ac027580 2024-09-13T23:07:19.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.746+0000 7f02c136f640 1 -- 172.21.15.164:0/1592794005 <== osd.2 v2:172.21.15.164:6808/3795914978 19 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94312853880704] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02bc040040 con 0x7f02ac027580 2024-09-13T23:07:19.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.746+0000 7f02c4f2e800 20 remove_watcher() i=0 2024-09-13T23:07:19.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.746+0000 7f02c4f2e800 2 removed watcher, disabling cache 2024-09-13T23:07:19.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.746+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94312853883888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec273f80 con 0x55c6ec2697a0 2024-09-13T23:07:19.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.747+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94312853883888] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.747+0000 7f02c4f2e800 20 remove_watcher() i=1 2024-09-13T23:07:19.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.747+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94312853887952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec274bf0 con 0x55c6ec26f9f0 2024-09-13T23:07:19.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.748+0000 7f02bbfff640 1 -- 172.21.15.164:0/1592794005 <== osd.3 v2:172.21.15.164:6816/93809510 35 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94312853887952] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02ac009050 con 0x55c6ec26f9f0 2024-09-13T23:07:19.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.748+0000 7f02c4f2e800 20 remove_watcher() i=2 2024-09-13T23:07:19.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.748+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94312853890224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec273f80 con 0x7f02ac027580 2024-09-13T23:07:19.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.750+0000 7f02c136f640 1 -- 172.21.15.164:0/1592794005 <== osd.2 v2:172.21.15.164:6808/3795914978 20 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94312853890224] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02bc040040 con 0x7f02ac027580 2024-09-13T23:07:19.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.750+0000 7f02c4f2e800 20 remove_watcher() i=3 2024-09-13T23:07:19.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.750+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94312853892816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec274bf0 con 0x55c6ec2697a0 2024-09-13T23:07:19.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.751+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94312853892816] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x55c6ec2697a0 2024-09-13T23:07:19.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.751+0000 7f02c4f2e800 20 remove_watcher() i=4 2024-09-13T23:07:19.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.751+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94312853897792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec2764b0 con 0x7f02bc031040 2024-09-13T23:07:19.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.752+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94312853897792] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x7f02bc031040 2024-09-13T23:07:19.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.752+0000 7f02c4f2e800 20 remove_watcher() i=5 2024-09-13T23:07:19.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.752+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94312853900432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec273f80 con 0x7f02bc031040 2024-09-13T23:07:19.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.753+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94312853900432] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x7f02bc031040 2024-09-13T23:07:19.754 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.753+0000 7f02c4f2e800 20 remove_watcher() i=6 2024-09-13T23:07:19.754 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.753+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94312853895424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6ec276ed0 con 0x7f02bc031040 2024-09-13T23:07:19.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.754+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 <== osd.0 v2:172.21.15.17:6800/489863589 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94312853895424] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b407a030 con 0x7f02bc031040 2024-09-13T23:07:19.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.754+0000 7f02c4f2e800 20 remove_watcher() i=7 2024-09-13T23:07:19.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.754+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f02bc031040 msgr2=0x7f02bc032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.754+0000 7f02c4f2e800 1 --2- 172.21.15.164:0/1592794005 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f02bc031040 0x7f02bc032430 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.754+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c6ec2697a0 msgr2=0x55c6ec26bc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.754+0000 7f02c4f2e800 1 --2- 172.21.15.164:0/1592794005 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c6ec2697a0 0x55c6ec26bc60 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.754+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f02ac027580 msgr2=0x7f02ac027a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.754+0000 7f02c4f2e800 1 --2- 172.21.15.164:0/1592794005 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f02ac027580 0x7f02ac027a00 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.754+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55c6ec26f9f0 msgr2=0x55c6ec271de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.754+0000 7f02c4f2e800 1 --2- 172.21.15.164:0/1592794005 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55c6ec26f9f0 0x55c6ec271de0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.754+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f018c036b40 msgr2=0x7f018c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.754+0000 7f02c4f2e800 1 --2- 172.21.15.164:0/1592794005 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f018c036b40 0x7f018c039000 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55c6ec2367a0 tx=0x7f02bc01f000 comp rx=0 tx=0).stop 2024-09-13T23:07:19.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.754+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec2569a0 msgr2=0x55c6ec25deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.754+0000 7f02c4f2e800 1 --2- 172.21.15.164:0/1592794005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec2569a0 0x55c6ec25deb0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f02ac04d180 tx=0x7f02ac04d110 comp rx=0 tx=0).stop 2024-09-13T23:07:19.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.754+0000 7f02c0b6e640 1 -- 172.21.15.164:0/1592794005 reap_dead start 2024-09-13T23:07:19.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.754+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 shutdown_connections 2024-09-13T23:07:19.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.754+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 >> 172.21.15.164:0/1592794005 conn(0x55c6ec252d00 msgr2=0x55c6ec250dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.755+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 shutdown_connections 2024-09-13T23:07:19.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.755+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1592794005 wait complete. 2024-09-13T23:07:19.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.755+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1786258269 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0198036b40 msgr2=0x7f0198039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.755+0000 7f02c4f2e800 1 --2- 172.21.15.164:0/1786258269 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0198036b40 0x7f0198039000 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x55c6ec23a310 tx=0x7f02bc005840 comp rx=0 tx=0).stop 2024-09-13T23:07:19.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.755+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1786258269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec249c90 msgr2=0x55c6ec24a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.755+0000 7f02c4f2e800 1 --2- 172.21.15.164:0/1786258269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec249c90 0x55c6ec24a0b0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f02ac001ed0 tx=0x7f02ac00d7a0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.755+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1786258269 shutdown_connections 2024-09-13T23:07:19.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.755+0000 7f02c4f2e800 1 --2- 172.21.15.164:0/1786258269 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0198036b40 0x7f0198039000 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.755+0000 7f02c4f2e800 1 --2- 172.21.15.164:0/1786258269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec249c90 0x55c6ec24a0b0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.755+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1786258269 >> 172.21.15.164:0/1786258269 conn(0x55c6ec23ec20 msgr2=0x55c6ec2417a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.755+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1786258269 shutdown_connections 2024-09-13T23:07:19.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.755+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1786258269 wait complete. 2024-09-13T23:07:19.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.755+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1250397108 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c6ec13ae90 msgr2=0x55c6ec239280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.755+0000 7f02c4f2e800 1 --2- 172.21.15.164:0/1250397108 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c6ec13ae90 0x55c6ec239280 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.755+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1250397108 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f01a8036b40 msgr2=0x7f01a8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.755+0000 7f02c4f2e800 1 --2- 172.21.15.164:0/1250397108 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f01a8036b40 0x7f01a8039000 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f02ac000f60 tx=0x7f02ac0012b0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.755+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1250397108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec13a550 msgr2=0x55c6ec232210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.755+0000 7f02c4f2e800 1 --2- 172.21.15.164:0/1250397108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec13a550 0x55c6ec232210 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x55c6ec0aeca0 tx=0x7f02b4002fb0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.755+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1250397108 shutdown_connections 2024-09-13T23:07:19.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.755+0000 7f02c4f2e800 1 --2- 172.21.15.164:0/1250397108 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c6ec13ae90 0x55c6ec239280 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.755+0000 7f02c4f2e800 1 --2- 172.21.15.164:0/1250397108 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f01a8036b40 0x7f01a8039000 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.755+0000 7f02c4f2e800 1 --2- 172.21.15.164:0/1250397108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6ec13a550 0x55c6ec232210 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.755+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1250397108 >> 172.21.15.164:0/1250397108 conn(0x55c6ec135de0 msgr2=0x55c6ec2239c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.756+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1250397108 shutdown_connections 2024-09-13T23:07:19.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.756+0000 7f02c4f2e800 1 -- 172.21.15.164:0/1250397108 wait complete. 2024-09-13T23:07:19.765 ERROR:root:None 2024-09-13T23:07:19.765 ERROR:root:0 2024-09-13T23:07:19.765 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-13T23:07:19.765 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-13T23:07:19.765 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-09-13T23:07:19.812 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:07:19.812 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:07:19.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.812+0000 7f754152e800 1 Processor -- start 2024-09-13T23:07:19.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.812+0000 7f754152e800 1 -- start start 2024-09-13T23:07:19.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.812+0000 7f754152e800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x564875d354e0 0x564875d358e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.812+0000 7f754152e800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564875bf5b30 con 0x564875d35e20 2024-09-13T23:07:19.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.812+0000 7f754152e800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x564875bd7360 con 0x564875d354e0 2024-09-13T23:07:19.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.812+0000 7f753d25c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x564875d354e0 0x564875d358e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.812+0000 7f753d25c640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x564875d354e0 0x564875d358e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54678/0 (socket says 172.21.15.164:54678) 2024-09-13T23:07:19.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.812+0000 7f7534a5b640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x564875d35e20 0x564875d3a9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:37894/0 (socket says 172.21.15.164:37894) 2024-09-13T23:07:19.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.812+0000 7f753d25c640 1 -- 172.21.15.164:0/2002331319 learned_addr learned my addr 172.21.15.164:0/2002331319 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.813+0000 7f753d25c640 1 -- 172.21.15.164:0/2002331319 >> v1:172.21.15.17:6789/0 conn(0x564875d35e20 legacy=0x564875d3a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.813+0000 7f753d25c640 1 -- 172.21.15.164:0/2002331319 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564875bfde00 con 0x564875d354e0 2024-09-13T23:07:19.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.813+0000 7f753ca5b640 1 -- 172.21.15.164:0/2002331319 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3034191005 0 0) 0x564875bf5b30 con 0x564875d35e20 2024-09-13T23:07:19.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.815+0000 7f753d25c640 1 --2- 172.21.15.164:0/2002331319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875d354e0 0x564875d358e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f753000a520 tx=0x7f7530045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2c7f99de2c563 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.815+0000 7f753ca5b640 1 -- 172.21.15.164:0/2002331319 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7530055070 con 0x564875d354e0 2024-09-13T23:07:19.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.815+0000 7f753ca5b640 1 -- 172.21.15.164:0/2002331319 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75300515b0 con 0x564875d354e0 2024-09-13T23:07:19.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.815+0000 7f753ca5b640 1 -- 172.21.15.164:0/2002331319 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75300518d0 con 0x564875d354e0 2024-09-13T23:07:19.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.815+0000 7f754152e800 1 -- 172.21.15.164:0/2002331319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875d354e0 msgr2=0x564875d358e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.815+0000 7f754152e800 1 --2- 172.21.15.164:0/2002331319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875d354e0 0x564875d358e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f753000a520 tx=0x7f7530045ba0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.815+0000 7f754152e800 1 -- 172.21.15.164:0/2002331319 shutdown_connections 2024-09-13T23:07:19.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.815+0000 7f754152e800 1 --2- 172.21.15.164:0/2002331319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875d354e0 0x564875d358e0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.815+0000 7f754152e800 1 -- 172.21.15.164:0/2002331319 >> 172.21.15.164:0/2002331319 conn(0x564875d30db0 msgr2=0x564875d331d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.815+0000 7f754152e800 1 -- 172.21.15.164:0/2002331319 shutdown_connections 2024-09-13T23:07:19.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.815+0000 7f754152e800 1 -- 172.21.15.164:0/2002331319 wait complete. 2024-09-13T23:07:19.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.829+0000 7f754152e800 1 Processor -- start 2024-09-13T23:07:19.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.829+0000 7f754152e800 1 -- start start 2024-09-13T23:07:19.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.829+0000 7f754152e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875d354e0 0x564875caa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.830+0000 7f754152e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564875c82360 con 0x564875d354e0 2024-09-13T23:07:19.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.830+0000 7f753d25c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875d354e0 0x564875caa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.830+0000 7f753d25c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875d354e0 0x564875caa5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54692/0 (socket says 172.21.15.164:54692) 2024-09-13T23:07:19.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.830+0000 7f753d25c640 1 -- 172.21.15.164:0/311306977 learned_addr learned my addr 172.21.15.164:0/311306977 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.830+0000 7f753d25c640 1 -- 172.21.15.164:0/311306977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564875bcfbc0 con 0x564875d354e0 2024-09-13T23:07:19.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.830+0000 7f753d25c640 1 --2- 172.21.15.164:0/311306977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875d354e0 0x564875caa5c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7530025da0 tx=0x7f7530051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594534dd381002b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.831+0000 7f742b606640 1 -- 172.21.15.164:0/311306977 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7530051ac0 con 0x564875d354e0 2024-09-13T23:07:19.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.831+0000 7f742b606640 1 -- 172.21.15.164:0/311306977 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7530051c60 con 0x564875d354e0 2024-09-13T23:07:19.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.831+0000 7f742b606640 1 -- 172.21.15.164:0/311306977 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7530066460 con 0x564875d354e0 2024-09-13T23:07:19.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.831+0000 7f754152e800 1 -- 172.21.15.164:0/311306977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875d354e0 msgr2=0x564875caa5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.831+0000 7f754152e800 1 --2- 172.21.15.164:0/311306977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875d354e0 0x564875caa5c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7530025da0 tx=0x7f7530051000 comp rx=0 tx=0).stop 2024-09-13T23:07:19.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.831+0000 7f754152e800 1 -- 172.21.15.164:0/311306977 shutdown_connections 2024-09-13T23:07:19.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.831+0000 7f754152e800 1 --2- 172.21.15.164:0/311306977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875d354e0 0x564875caa5c0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.831+0000 7f754152e800 1 -- 172.21.15.164:0/311306977 >> 172.21.15.164:0/311306977 conn(0x564875d30db0 msgr2=0x564875e1ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.831+0000 7f754152e800 1 -- 172.21.15.164:0/311306977 shutdown_connections 2024-09-13T23:07:19.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.831+0000 7f754152e800 1 -- 172.21.15.164:0/311306977 wait complete. 2024-09-13T23:07:19.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.832+0000 7f754152e800 1 Processor -- start 2024-09-13T23:07:19.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.832+0000 7f754152e800 1 -- start start 2024-09-13T23:07:19.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.832+0000 7f754152e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875d354e0 0x564875e2d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.832+0000 7f754152e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564875d3c500 con 0x564875d354e0 2024-09-13T23:07:19.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.832+0000 7f753d25c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875d354e0 0x564875e2d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.832+0000 7f753d25c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875d354e0 0x564875e2d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54708/0 (socket says 172.21.15.164:54708) 2024-09-13T23:07:19.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.832+0000 7f753d25c640 1 -- 172.21.15.164:0/1792671273 learned_addr learned my addr 172.21.15.164:0/1792671273 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.832+0000 7f753d25c640 1 -- 172.21.15.164:0/1792671273 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564875be3fe0 con 0x564875d354e0 2024-09-13T23:07:19.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.833+0000 7f753d25c640 1 --2- 172.21.15.164:0/1792671273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875d354e0 0x564875e2d050 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f75300460a0 tx=0x7f7530003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.833+0000 7f7429e03640 1 -- 172.21.15.164:0/1792671273 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7530066650 con 0x564875d354e0 2024-09-13T23:07:19.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.833+0000 7f7429e03640 1 -- 172.21.15.164:0/1792671273 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7530066810 con 0x564875d354e0 2024-09-13T23:07:19.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.833+0000 7f754152e800 1 -- 172.21.15.164:0/1792671273 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564875e2d590 con 0x564875d354e0 2024-09-13T23:07:19.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.833+0000 7f7429e03640 1 -- 172.21.15.164:0/1792671273 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7530066b30 con 0x564875d354e0 2024-09-13T23:07:19.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.833+0000 7f754152e800 1 -- 172.21.15.164:0/1792671273 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564875e2dab0 con 0x564875d354e0 2024-09-13T23:07:19.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.834+0000 7f7429e03640 1 -- 172.21.15.164:0/1792671273 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7530079060 con 0x564875d354e0 2024-09-13T23:07:19.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.834+0000 7f7429e03640 1 --2- 172.21.15.164:0/1792671273 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7424036b40 0x7f7424039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.834+0000 7f7429e03640 1 -- 172.21.15.164:0/1792671273 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f7530062070 con 0x564875d354e0 2024-09-13T23:07:19.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.834+0000 7f7534a5b640 1 --2- 172.21.15.164:0/1792671273 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7424036b40 0x7f7424039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.834+0000 7f754152e800 1 --2- 172.21.15.164:0/1792671273 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564875d35e20 0x564875e340c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.834+0000 7f754152e800 1 -- 172.21.15.164:0/1792671273 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564875e34640 con 0x564875d35e20 2024-09-13T23:07:19.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.834+0000 7f753da5d640 1 --2- 172.21.15.164:0/1792671273 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564875d35e20 0x564875e340c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.834+0000 7f7534a5b640 1 --2- 172.21.15.164:0/1792671273 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7424036b40 0x7f7424039000 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7528000c00 tx=0x7f75280013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.834+0000 7f753da5d640 1 --2- 172.21.15.164:0/1792671273 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564875d35e20 0x564875e340c0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.835+0000 7f753da5d640 1 -- 172.21.15.164:0/1792671273 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f753800a4a0 con 0x564875d35e20 2024-09-13T23:07:19.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.835+0000 7f754152e800 1 -- 172.21.15.164:0/1792671273 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564875e31670 con 0x564875d35e20 2024-09-13T23:07:19.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.835+0000 7f753da5d640 1 -- 172.21.15.164:0/1792671273 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f753800a4a0 con 0x564875d35e20 2024-09-13T23:07:19.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.835+0000 7f754152e800 1 -- 172.21.15.164:0/1792671273 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564875e36430 con 0x564875d35e20 2024-09-13T23:07:19.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.835+0000 7f753da5d640 1 -- 172.21.15.164:0/1792671273 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f753800a4a0 con 0x564875d35e20 2024-09-13T23:07:19.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.835+0000 7f754152e800 1 -- 172.21.15.164:0/1792671273 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564875e35660 con 0x564875d35e20 2024-09-13T23:07:19.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.836+0000 7f753da5d640 1 -- 172.21.15.164:0/1792671273 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f753800a4a0 con 0x564875d35e20 2024-09-13T23:07:19.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.836+0000 7f754152e800 1 -- 172.21.15.164:0/1792671273 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564875e35a80 con 0x564875d35e20 2024-09-13T23:07:19.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.836+0000 7f753da5d640 1 -- 172.21.15.164:0/1792671273 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f753800a4a0 con 0x564875d35e20 2024-09-13T23:07:19.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.836+0000 7f754152e800 1 Processor -- start 2024-09-13T23:07:19.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.836+0000 7f754152e800 1 -- start start 2024-09-13T23:07:19.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.836+0000 7f754152e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875e25da0 0x564875e243f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.836+0000 7f754152e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564875bd1580 con 0x564875e25da0 2024-09-13T23:07:19.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.837+0000 7f7534a5b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875e25da0 0x564875e243f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.837+0000 7f7534a5b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875e25da0 0x564875e243f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54720/0 (socket says 172.21.15.164:54720) 2024-09-13T23:07:19.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.837+0000 7f7534a5b640 1 -- 172.21.15.164:0/3297908072 learned_addr learned my addr 172.21.15.164:0/3297908072 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.837+0000 7f7534a5b640 1 -- 172.21.15.164:0/3297908072 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564875e261c0 con 0x564875e25da0 2024-09-13T23:07:19.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.837+0000 7f7534a5b640 1 --2- 172.21.15.164:0/3297908072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875e25da0 0x564875e243f0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f752800e610 tx=0x7f752800ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.837+0000 7f7422ffd640 1 -- 172.21.15.164:0/3297908072 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7528022070 con 0x564875e25da0 2024-09-13T23:07:19.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.837+0000 7f7422ffd640 1 -- 172.21.15.164:0/3297908072 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7528009050 con 0x564875e25da0 2024-09-13T23:07:19.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.837+0000 7f7422ffd640 1 -- 172.21.15.164:0/3297908072 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f752800d500 con 0x564875e25da0 2024-09-13T23:07:19.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.837+0000 7f754152e800 1 -- 172.21.15.164:0/3297908072 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564875e249f0 con 0x564875e25da0 2024-09-13T23:07:19.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.837+0000 7f754152e800 1 -- 172.21.15.164:0/3297908072 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564875e24ef0 con 0x564875e25da0 2024-09-13T23:07:19.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.838+0000 7f7422ffd640 1 -- 172.21.15.164:0/3297908072 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7528025070 con 0x564875e25da0 2024-09-13T23:07:19.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.838+0000 7f7422ffd640 1 --2- 172.21.15.164:0/3297908072 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7414036b90 0x7f7414039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.838+0000 7f7422ffd640 1 -- 172.21.15.164:0/3297908072 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f752804df20 con 0x564875e25da0 2024-09-13T23:07:19.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.838+0000 7f753da5d640 1 --2- 172.21.15.164:0/3297908072 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7414036b90 0x7f7414039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.839+0000 7f754152e800 1 Processor -- start 2024-09-13T23:07:19.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.839+0000 7f753da5d640 1 --2- 172.21.15.164:0/3297908072 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7414036b90 0x7f7414039050 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x564875e35a00 tx=0x7f7538005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.839+0000 7f754152e800 1 -- start start 2024-09-13T23:07:19.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.839+0000 7f754152e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875e53990 0x564875e53d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.839+0000 7f754152e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564875e284c0 con 0x564875e53990 2024-09-13T23:07:19.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.839+0000 7f7534a5b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875e53990 0x564875e53d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.839+0000 7f7534a5b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875e53990 0x564875e53d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54734/0 (socket says 172.21.15.164:54734) 2024-09-13T23:07:19.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.839+0000 7f7534a5b640 1 -- 172.21.15.164:0/3773359880 learned_addr learned my addr 172.21.15.164:0/3773359880 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.839+0000 7f7534a5b640 1 -- 172.21.15.164:0/3773359880 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564875e54360 con 0x564875e53990 2024-09-13T23:07:19.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.839+0000 7f7534a5b640 1 --2- 172.21.15.164:0/3773359880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875e53990 0x564875e53d90 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7528026fd0 tx=0x7f7528024eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=954f28edaad6037f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.840+0000 7f7420ff9640 1 -- 172.21.15.164:0/3773359880 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7528025360 con 0x564875e53990 2024-09-13T23:07:19.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.840+0000 7f7420ff9640 1 -- 172.21.15.164:0/3773359880 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7528025500 con 0x564875e53990 2024-09-13T23:07:19.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.840+0000 7f7420ff9640 1 -- 172.21.15.164:0/3773359880 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75280257e0 con 0x564875e53990 2024-09-13T23:07:19.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.840+0000 7f754152e800 1 -- 172.21.15.164:0/3773359880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875e53990 msgr2=0x564875e53d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.840+0000 7f754152e800 1 --2- 172.21.15.164:0/3773359880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875e53990 0x564875e53d90 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7528026fd0 tx=0x7f7528024eb0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.840+0000 7f754152e800 1 -- 172.21.15.164:0/3773359880 shutdown_connections 2024-09-13T23:07:19.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.840+0000 7f754152e800 1 --2- 172.21.15.164:0/3773359880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875e53990 0x564875e53d90 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.840+0000 7f754152e800 1 -- 172.21.15.164:0/3773359880 >> 172.21.15.164:0/3773359880 conn(0x564875e4fcf0 msgr2=0x564875e4ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.840+0000 7f754152e800 1 -- 172.21.15.164:0/3773359880 shutdown_connections 2024-09-13T23:07:19.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.840+0000 7f754152e800 1 -- 172.21.15.164:0/3773359880 wait complete. 2024-09-13T23:07:19.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.840+0000 7f754152e800 1 Processor -- start 2024-09-13T23:07:19.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.840+0000 7f754152e800 1 -- start start 2024-09-13T23:07:19.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.841+0000 7f754152e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875e53990 0x564875e5ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.841+0000 7f754152e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564875e549d0 con 0x564875e53990 2024-09-13T23:07:19.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.841+0000 7f7534a5b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875e53990 0x564875e5ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.841+0000 7f7534a5b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875e53990 0x564875e5ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54736/0 (socket says 172.21.15.164:54736) 2024-09-13T23:07:19.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.841+0000 7f7534a5b640 1 -- 172.21.15.164:0/1804679416 learned_addr learned my addr 172.21.15.164:0/1804679416 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.841+0000 7f7534a5b640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564875e5b3d0 con 0x564875e53990 2024-09-13T23:07:19.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.841+0000 7f7534a5b640 1 --2- 172.21.15.164:0/1804679416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875e53990 0x564875e5ae90 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f7528024ef0 tx=0x7f752804c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.841+0000 7f7412ffd640 1 -- 172.21.15.164:0/1804679416 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f752803a070 con 0x564875e53990 2024-09-13T23:07:19.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.841+0000 7f7412ffd640 1 -- 172.21.15.164:0/1804679416 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f752800d6a0 con 0x564875e53990 2024-09-13T23:07:19.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.841+0000 7f7412ffd640 1 -- 172.21.15.164:0/1804679416 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75280248b0 con 0x564875e53990 2024-09-13T23:07:19.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.841+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564875e5b660 con 0x564875e53990 2024-09-13T23:07:19.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.841+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564875e5e310 con 0x564875e53990 2024-09-13T23:07:19.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.842+0000 7f7412ffd640 1 -- 172.21.15.164:0/1804679416 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f752800d9a0 con 0x564875e53990 2024-09-13T23:07:19.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.842+0000 7f7412ffd640 1 --2- 172.21.15.164:0/1804679416 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7408036b40 0x7f7408039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.842+0000 7f7412ffd640 1 -- 172.21.15.164:0/1804679416 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f752803d040 con 0x564875e53990 2024-09-13T23:07:19.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.842+0000 7f753da5d640 1 --2- 172.21.15.164:0/1804679416 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7408036b40 0x7f7408039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.843+0000 7f753da5d640 1 --2- 172.21.15.164:0/1804679416 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7408036b40 0x7f7408039000 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x564875e35180 tx=0x7f753801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.843+0000 7f754152e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.843+0000 7f754152e800 1 --2- 172.21.15.164:0/1804679416 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564875e66970 0x564875e68e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.843+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564875e69580 con 0x564875e66970 2024-09-13T23:07:19.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.843+0000 7f753d25c640 1 --2- 172.21.15.164:0/1804679416 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564875e66970 0x564875e68e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.843+0000 7f753d25c640 1 --2- 172.21.15.164:0/1804679416 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564875e66970 0x564875e68e30 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.844+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7530057030 con 0x564875e66970 2024-09-13T23:07:19.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.844+0000 7f754152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.844+0000 7f754152e800 20 realm 2024-09-13T23:07:19.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.844+0000 7f754152e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.844+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564875e69990 con 0x564875e66970 2024-09-13T23:07:19.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.844+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7530057030 con 0x564875e66970 2024-09-13T23:07:19.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.844+0000 7f754152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.844+0000 7f754152e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:07:19.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.844+0000 7f754152e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.844+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564875e6a260 con 0x564875e66970 2024-09-13T23:07:19.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.844+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7530057030 con 0x564875e66970 2024-09-13T23:07:19.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.844+0000 7f754152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.844+0000 7f754152e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.844+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564875e6a600 con 0x564875e66970 2024-09-13T23:07:19.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.844+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7530057030 con 0x564875e66970 2024-09-13T23:07:19.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.844+0000 7f754152e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:19.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.845+0000 7f754152e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.845+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564875e6ae50 con 0x564875e66970 2024-09-13T23:07:19.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.845+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7530057030 con 0x564875e66970 2024-09-13T23:07:19.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.845+0000 7f754152e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:07:19.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.845+0000 7f754152e800 20 searching for the correct realm 2024-09-13T23:07:19.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.845+0000 7f754152e800 1 --2- 172.21.15.164:0/1804679416 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x564875e6cbc0 0x564875e6efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.845+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564875e6f590 con 0x564875e6cbc0 2024-09-13T23:07:19.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.845+0000 7f7534a5b640 1 --2- 172.21.15.164:0/1804679416 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x564875e6cbc0 0x564875e6efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.845+0000 7f7534a5b640 1 --2- 172.21.15.164:0/1804679416 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x564875e6cbc0 0x564875e6efb0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.845+0000 7f7534a5b640 1 -- 172.21.15.164:0/1804679416 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7528032070 con 0x564875e6cbc0 2024-09-13T23:07:19.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.845+0000 7f7534a5b640 1 --2- 172.21.15.164:0/1804679416 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7528027060 0x7f7528054430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.845+0000 7f7534a5b640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564875e6f590 con 0x7f7528027060 2024-09-13T23:07:19.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.846+0000 7f753da5d640 1 --2- 172.21.15.164:0/1804679416 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7528027060 0x7f7528054430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.846+0000 7f753da5d640 1 --2- 172.21.15.164:0/1804679416 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7528027060 0x7f7528054430 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.846+0000 7f753da5d640 1 -- 172.21.15.164:0/1804679416 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f753801f070 con 0x7f7528027060 2024-09-13T23:07:19.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.846+0000 7f753da5d640 1 --2- 172.21.15.164:0/1804679416 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7538031040 0x7f7538032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.846+0000 7f753da5d640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564875e6f590 con 0x7f7538031040 2024-09-13T23:07:19.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.846+0000 7f753d25c640 1 --2- 172.21.15.164:0/1804679416 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7538031040 0x7f7538032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.847+0000 7f753d25c640 1 --2- 172.21.15.164:0/1804679416 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7538031040 0x7f7538032940 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.847+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7530057030 con 0x7f7538031040 2024-09-13T23:07:19.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.847+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564875e6f590 con 0x564875e66970 2024-09-13T23:07:19.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.847+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7530057030 con 0x564875e66970 2024-09-13T23:07:19.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.847+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564875e6f590 con 0x564875e66970 2024-09-13T23:07:19.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.848+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7530057030 con 0x564875e66970 2024-09-13T23:07:19.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.848+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564875e6f590 con 0x7f7538031040 2024-09-13T23:07:19.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.848+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7530057030 con 0x7f7538031040 2024-09-13T23:07:19.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.848+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564875e6f590 con 0x7f7538031040 2024-09-13T23:07:19.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.848+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7530057030 con 0x7f7538031040 2024-09-13T23:07:19.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.848+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564875e6f590 con 0x7f7528027060 2024-09-13T23:07:19.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.848+0000 7f753da5d640 1 -- 172.21.15.164:0/1804679416 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f753801f070 con 0x7f7528027060 2024-09-13T23:07:19.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.848+0000 7f753da5d640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564875e6f590 con 0x564875e6cbc0 2024-09-13T23:07:19.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.849+0000 7f7534a5b640 1 -- 172.21.15.164:0/1804679416 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7528032070 con 0x564875e6cbc0 2024-09-13T23:07:19.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.849+0000 7f7534a5b640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564875e6f590 con 0x564875e66970 2024-09-13T23:07:19.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.849+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7530057030 con 0x564875e66970 2024-09-13T23:07:19.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.849+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564875e6f590 con 0x7f7538031040 2024-09-13T23:07:19.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.849+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7530057030 con 0x7f7538031040 2024-09-13T23:07:19.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.849+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564875e6f590 con 0x564875e66970 2024-09-13T23:07:19.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.849+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7530057030 con 0x564875e66970 2024-09-13T23:07:19.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.849+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564875e6f590 con 0x7f7528027060 2024-09-13T23:07:19.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.850+0000 7f753da5d640 1 -- 172.21.15.164:0/1804679416 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f753801f070 con 0x7f7528027060 2024-09-13T23:07:19.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.850+0000 7f753da5d640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564875e6f590 con 0x564875e6cbc0 2024-09-13T23:07:19.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.850+0000 7f7534a5b640 1 -- 172.21.15.164:0/1804679416 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7528032070 con 0x564875e6cbc0 2024-09-13T23:07:19.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.850+0000 7f7534a5b640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564875e6f590 con 0x564875e6cbc0 2024-09-13T23:07:19.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.850+0000 7f7534a5b640 1 -- 172.21.15.164:0/1804679416 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7528032070 con 0x564875e6cbc0 2024-09-13T23:07:19.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.850+0000 7f7534a5b640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7528064040 con 0x7f7538031040 2024-09-13T23:07:19.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.851+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7530057030 con 0x7f7538031040 2024-09-13T23:07:19.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.851+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7528064040 con 0x564875e6cbc0 2024-09-13T23:07:19.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.851+0000 7f7534a5b640 1 -- 172.21.15.164:0/1804679416 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7528032070 con 0x564875e6cbc0 2024-09-13T23:07:19.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.851+0000 7f7534a5b640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7528064040 con 0x564875e6cbc0 2024-09-13T23:07:19.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.851+0000 7f7534a5b640 1 -- 172.21.15.164:0/1804679416 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7528032070 con 0x564875e6cbc0 2024-09-13T23:07:19.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.851+0000 7f7534a5b640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7528064040 con 0x564875e66970 2024-09-13T23:07:19.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.851+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7530057030 con 0x564875e66970 2024-09-13T23:07:19.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.851+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7528064040 con 0x564875e66970 2024-09-13T23:07:19.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.852+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7530057030 con 0x564875e66970 2024-09-13T23:07:19.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.852+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7528064040 con 0x7f7538031040 2024-09-13T23:07:19.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.852+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7530057030 con 0x7f7538031040 2024-09-13T23:07:19.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.852+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7528064040 con 0x564875e6cbc0 2024-09-13T23:07:19.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.852+0000 7f7534a5b640 1 -- 172.21.15.164:0/1804679416 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7528032070 con 0x564875e6cbc0 2024-09-13T23:07:19.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.852+0000 7f7534a5b640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7528064040 con 0x7f7528027060 2024-09-13T23:07:19.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.852+0000 7f753da5d640 1 -- 172.21.15.164:0/1804679416 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f753801f070 con 0x7f7528027060 2024-09-13T23:07:19.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.852+0000 7f753da5d640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7528064040 con 0x564875e66970 2024-09-13T23:07:19.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.853+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7530057030 con 0x564875e66970 2024-09-13T23:07:19.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.853+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7528064040 con 0x7f7538031040 2024-09-13T23:07:19.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.853+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7530057030 con 0x7f7538031040 2024-09-13T23:07:19.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.853+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7528064040 con 0x564875e6cbc0 2024-09-13T23:07:19.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.853+0000 7f7534a5b640 1 -- 172.21.15.164:0/1804679416 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7528032070 con 0x564875e6cbc0 2024-09-13T23:07:19.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.853+0000 7f7534a5b640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7528064040 con 0x7f7538031040 2024-09-13T23:07:19.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.854+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7530057030 con 0x7f7538031040 2024-09-13T23:07:19.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.854+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7528064040 con 0x7f7528027060 2024-09-13T23:07:19.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.854+0000 7f753da5d640 1 -- 172.21.15.164:0/1804679416 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f753801f070 con 0x7f7528027060 2024-09-13T23:07:19.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.854+0000 7f753da5d640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7528064040 con 0x564875e6cbc0 2024-09-13T23:07:19.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.854+0000 7f7534a5b640 1 -- 172.21.15.164:0/1804679416 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7528032070 con 0x564875e6cbc0 2024-09-13T23:07:19.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.854+0000 7f7534a5b640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7528064040 con 0x7f7528027060 2024-09-13T23:07:19.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.854+0000 7f753da5d640 1 -- 172.21.15.164:0/1804679416 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f753801f070 con 0x7f7528027060 2024-09-13T23:07:19.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.854+0000 7f753da5d640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7528064040 con 0x564875e66970 2024-09-13T23:07:19.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.854+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7530057030 con 0x564875e66970 2024-09-13T23:07:19.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.855+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f75300a3080 con 0x7f7528027060 2024-09-13T23:07:19.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.855+0000 7f753da5d640 1 -- 172.21.15.164:0/1804679416 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7538040040 con 0x7f7528027060 2024-09-13T23:07:19.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.855+0000 7f754152e800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:07:19.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.855+0000 7f754152e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:07:19.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.855+0000 7f754152e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:07:19.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.855+0000 7f754152e800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:07:19.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.855+0000 7f754152e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:07:19.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.855+0000 7f754152e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:07:19.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.855+0000 7f754152e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.855+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564875e6b7d0 con 0x564875e66970 2024-09-13T23:07:19.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.855+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7530057030 con 0x564875e66970 2024-09-13T23:07:19.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.855+0000 7f754152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.855+0000 7f754152e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.855+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564875e6c070 con 0x564875e66970 2024-09-13T23:07:19.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.855+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7530057030 con 0x564875e66970 2024-09-13T23:07:19.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.855+0000 7f754152e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:19.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.855+0000 7f754152e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.855+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564875e6c070 con 0x564875e66970 2024-09-13T23:07:19.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.856+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7530057030 con 0x564875e66970 2024-09-13T23:07:19.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.856+0000 7f754152e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:07:19.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.856+0000 7f754152e800 20 zone default found 2024-09-13T23:07:19.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.856+0000 7f754152e800 4 Realm: () 2024-09-13T23:07:19.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.856+0000 7f754152e800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:07:19.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.856+0000 7f754152e800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:07:19.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.856+0000 7f754152e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:07:19.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.856+0000 7f754152e800 20 zonegroup default 2024-09-13T23:07:19.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.856+0000 7f754152e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.856+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564875e6fa10 con 0x7f7538031040 2024-09-13T23:07:19.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.856+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7530057030 con 0x7f7538031040 2024-09-13T23:07:19.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.856+0000 7f754152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.856+0000 7f754152e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.856+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564875e71480 con 0x564875e6cbc0 2024-09-13T23:07:19.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.856+0000 7f7534a5b640 1 -- 172.21.15.164:0/1804679416 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7528032070 con 0x564875e6cbc0 2024-09-13T23:07:19.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.856+0000 7f754152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.856+0000 7f754152e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.856+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564875e719a0 con 0x564875e6cbc0 2024-09-13T23:07:19.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.856+0000 7f7534a5b640 1 -- 172.21.15.164:0/1804679416 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7528032070 con 0x564875e6cbc0 2024-09-13T23:07:19.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.856+0000 7f754152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.856+0000 7f754152e800 20 started sync module instance, tier type = 2024-09-13T23:07:19.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.857+0000 7f754152e800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:07:19.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.857+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564875e70890 con 0x7f7528027060 2024-09-13T23:07:19.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.858+0000 7f753da5d640 1 -- 172.21.15.164:0/1804679416 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7538040040 con 0x7f7528027060 2024-09-13T23:07:19.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.858+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94869215710336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564875e710a0 con 0x7f7528027060 2024-09-13T23:07:19.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.858+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564875e72760 con 0x564875e66970 2024-09-13T23:07:19.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.859+0000 7f753da5d640 1 -- 172.21.15.164:0/1804679416 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94869215710336] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7538040040 con 0x7f7528027060 2024-09-13T23:07:19.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.859+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7530057030 con 0x564875e66970 2024-09-13T23:07:19.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.859+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94869215715296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564875e72b80 con 0x564875e66970 2024-09-13T23:07:19.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.859+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564875e73580 con 0x564875e6cbc0 2024-09-13T23:07:19.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.860+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94869215715296] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7530057030 con 0x564875e66970 2024-09-13T23:07:19.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.860+0000 7f7534a5b640 1 -- 172.21.15.164:0/1804679416 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7528032070 con 0x564875e6cbc0 2024-09-13T23:07:19.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.860+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94869215716480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564875e739a0 con 0x564875e6cbc0 2024-09-13T23:07:19.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.860+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564875e743c0 con 0x7f7528027060 2024-09-13T23:07:19.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.861+0000 7f7534a5b640 1 -- 172.21.15.164:0/1804679416 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94869215716480] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7528032070 con 0x564875e6cbc0 2024-09-13T23:07:19.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.862+0000 7f753da5d640 1 -- 172.21.15.164:0/1804679416 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7538040040 con 0x7f7528027060 2024-09-13T23:07:19.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.862+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94869215723184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564875e747b0 con 0x7f7528027060 2024-09-13T23:07:19.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.862+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564875e75210 con 0x564875e66970 2024-09-13T23:07:19.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.863+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7530057030 con 0x564875e66970 2024-09-13T23:07:19.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.863+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94869215726832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564875e75210 con 0x564875e66970 2024-09-13T23:07:19.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.863+0000 7f753da5d640 1 -- 172.21.15.164:0/1804679416 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94869215723184] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7538040040 con 0x7f7528027060 2024-09-13T23:07:19.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.863+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564875e761b0 con 0x7f7538031040 2024-09-13T23:07:19.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.864+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7530057030 con 0x7f7538031040 2024-09-13T23:07:19.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.864+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94869215730816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564875e76170 con 0x7f7538031040 2024-09-13T23:07:19.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.864+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564875e76be0 con 0x7f7538031040 2024-09-13T23:07:19.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.864+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94869215726832] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7530057030 con 0x564875e66970 2024-09-13T23:07:19.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.865+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94869215730816] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7530057030 con 0x7f7538031040 2024-09-13T23:07:19.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.865+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7530057030 con 0x7f7538031040 2024-09-13T23:07:19.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.865+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94869215719568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564875e755d0 con 0x7f7538031040 2024-09-13T23:07:19.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.865+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564875e77090 con 0x7f7538031040 2024-09-13T23:07:19.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.866+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94869215719568] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7530057030 con 0x7f7538031040 2024-09-13T23:07:19.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.866+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7530057030 con 0x7f7538031040 2024-09-13T23:07:19.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.866+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94869215733520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564875e77090 con 0x7f7538031040 2024-09-13T23:07:19.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.866+0000 7f754152e800 20 add_watcher() i=0 2024-09-13T23:07:19.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.866+0000 7f754152e800 20 add_watcher() i=1 2024-09-13T23:07:19.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.866+0000 7f754152e800 20 add_watcher() i=2 2024-09-13T23:07:19.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.866+0000 7f754152e800 20 add_watcher() i=3 2024-09-13T23:07:19.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.866+0000 7f754152e800 20 add_watcher() i=4 2024-09-13T23:07:19.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.866+0000 7f754152e800 20 add_watcher() i=5 2024-09-13T23:07:19.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.866+0000 7f754152e800 20 add_watcher() i=6 2024-09-13T23:07:19.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.867+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94869215733520] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7530057030 con 0x7f7538031040 2024-09-13T23:07:19.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.867+0000 7f754152e800 20 add_watcher() i=7 2024-09-13T23:07:19.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.867+0000 7f754152e800 2 all 8 watchers are set, enabling cache 2024-09-13T23:07:19.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.867+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564875e7a3e0 con 0x564875e66970 2024-09-13T23:07:19.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.868+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7530057030 con 0x564875e66970 2024-09-13T23:07:19.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.868+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94869215747504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564875e77200 con 0x564875e66970 2024-09-13T23:07:19.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.869+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94869215747504] v34'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7530057030 con 0x564875e66970 2024-09-13T23:07:19.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.869+0000 7f73f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:19.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.869+0000 7f754152e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:07:19.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.869+0000 7f754152e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:07:19.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.869+0000 7f754152e800 5 note: GC not initialized 2024-09-13T23:07:19.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.869+0000 7f73f27e4640 20 reqs_thread_entry: start 2024-09-13T23:07:19.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.869+0000 7f754152e800 20 init_complete bucket index max shards: 11 2024-09-13T23:07:19.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.869+0000 7f754152e800 20 Filter name: none 2024-09-13T23:07:19.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.869+0000 7f7363fff640 20 reqs_thread_entry: start 2024-09-13T23:07:19.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.869+0000 7f754152e800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T23:07:19.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.869+0000 7f754152e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.869+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564875ead900 con 0x7f7538031040 2024-09-13T23:07:19.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.870+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f7530057030 con 0x7f7538031040 2024-09-13T23:07:19.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.870+0000 7f754152e800 20 rados_obj.operate() r=0 bl.length=460 2024-09-13T23:07:19.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.870+0000 7f754152e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T23:07:19.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.870+0000 7f754152e800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:19.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.870+0000 7f754152e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:07:19.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.870+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564875eb3f60 con 0x7f7538031040 2024-09-13T23:07:19.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.872+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f7530057030 con 0x7f7538031040 2024-09-13T23:07:19.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.872+0000 7f754152e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:07:19.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.872+0000 7f754152e800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:19.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.872+0000 7f754152e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T23:07:19.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.872+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94869215983904 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564875eaf580 con 0x564875e66970 2024-09-13T23:07:19.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.872+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== watch-notify(notify (1) cookie 94869215726832 notify 146028888092 ret 0) ==== 708+0+0 (crc 0 0 0) 0x564875e2dab0 con 0x564875e66970 2024-09-13T23:07:19.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.872+0000 7f7420ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888092 cookie 94869215726832 notifier 4882 bl.length()=666 2024-09-13T23:07:19.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.872+0000 7f7420ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:07:19.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.872+0000 7f7420ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:19.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.872+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(64 notify.4 [notify cookie 94869215983904 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7530057030 con 0x564875e66970 2024-09-13T23:07:19.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.872+0000 7f7420ff9640 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f7400003ea0 con 0x564875e66970 2024-09-13T23:07:19.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.872+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7530057030 con 0x564875e66970 2024-09-13T23:07:19.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.872+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== watch-notify(notify_complete (2) cookie 94869215983904 notify 146028888092 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564875e2d590 con 0x564875e66970 2024-09-13T23:07:19.886 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T23:07:18.801026Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:07:18.801015Z","tags":[],"group_ids":[]} 2024-09-13T23:07:19.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.873+0000 7f73f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:19.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.873+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94869215747504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564875eab620 con 0x564875e66970 2024-09-13T23:07:19.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.874+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94869215747504] v34'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7530057030 con 0x564875e66970 2024-09-13T23:07:19.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.874+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94869215710336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564875eab620 con 0x7f7528027060 2024-09-13T23:07:19.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.875+0000 7f753da5d640 1 -- 172.21.15.164:0/1804679416 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94869215710336] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7538040040 con 0x7f7528027060 2024-09-13T23:07:19.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.875+0000 7f754152e800 20 remove_watcher() i=0 2024-09-13T23:07:19.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.875+0000 7f754152e800 2 removed watcher, disabling cache 2024-09-13T23:07:19.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.875+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94869215715296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564875eab620 con 0x564875e66970 2024-09-13T23:07:19.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.876+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94869215715296] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7530057030 con 0x564875e66970 2024-09-13T23:07:19.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.876+0000 7f754152e800 20 remove_watcher() i=1 2024-09-13T23:07:19.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.876+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94869215716480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564875eab620 con 0x564875e6cbc0 2024-09-13T23:07:19.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.877+0000 7f7534a5b640 1 -- 172.21.15.164:0/1804679416 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94869215716480] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7528032070 con 0x564875e6cbc0 2024-09-13T23:07:19.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.877+0000 7f754152e800 20 remove_watcher() i=2 2024-09-13T23:07:19.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.877+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94869215723184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564875eacb80 con 0x7f7528027060 2024-09-13T23:07:19.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.878+0000 7f753da5d640 1 -- 172.21.15.164:0/1804679416 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94869215723184] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7538040040 con 0x7f7528027060 2024-09-13T23:07:19.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.878+0000 7f754152e800 20 remove_watcher() i=3 2024-09-13T23:07:19.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.878+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94869215726832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564875eacb80 con 0x564875e66970 2024-09-13T23:07:19.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.879+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94869215726832] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7530057030 con 0x564875e66970 2024-09-13T23:07:19.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.879+0000 7f754152e800 20 remove_watcher() i=4 2024-09-13T23:07:19.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.879+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94869215730816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564875eacb80 con 0x7f7538031040 2024-09-13T23:07:19.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.880+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94869215730816] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7530057030 con 0x7f7538031040 2024-09-13T23:07:19.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.880+0000 7f754152e800 20 remove_watcher() i=5 2024-09-13T23:07:19.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.880+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94869215719568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564875eacb80 con 0x7f7538031040 2024-09-13T23:07:19.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.881+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94869215719568] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7530057030 con 0x7f7538031040 2024-09-13T23:07:19.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.881+0000 7f754152e800 20 remove_watcher() i=6 2024-09-13T23:07:19.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.881+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94869215733520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564875eacb80 con 0x7f7538031040 2024-09-13T23:07:19.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.882+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94869215733520] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7530057030 con 0x7f7538031040 2024-09-13T23:07:19.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.882+0000 7f754152e800 20 remove_watcher() i=7 2024-09-13T23:07:19.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.882+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7538031040 msgr2=0x7f7538032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.882+0000 7f754152e800 1 --2- 172.21.15.164:0/1804679416 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f7538031040 0x7f7538032940 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.882+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564875e66970 msgr2=0x564875e68e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.882+0000 7f754152e800 1 --2- 172.21.15.164:0/1804679416 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564875e66970 0x564875e68e30 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.882+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7528027060 msgr2=0x7f7528054430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.882+0000 7f754152e800 1 --2- 172.21.15.164:0/1804679416 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f7528027060 0x7f7528054430 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.882+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x564875e6cbc0 msgr2=0x564875e6efb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.882+0000 7f754152e800 1 --2- 172.21.15.164:0/1804679416 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x564875e6cbc0 0x564875e6efb0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.883+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7408036b40 msgr2=0x7f7408039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.883+0000 7f754152e800 1 --2- 172.21.15.164:0/1804679416 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7408036b40 0x7f7408039000 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x564875e35180 tx=0x7f753801f000 comp rx=0 tx=0).stop 2024-09-13T23:07:19.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.883+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875e53990 msgr2=0x564875e5ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.883+0000 7f753d25c640 1 -- 172.21.15.164:0/1804679416 reap_dead start 2024-09-13T23:07:19.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.883+0000 7f754152e800 1 --2- 172.21.15.164:0/1804679416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875e53990 0x564875e5ae90 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f7528024ef0 tx=0x7f752804c140 comp rx=0 tx=0).stop 2024-09-13T23:07:19.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.883+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 shutdown_connections 2024-09-13T23:07:19.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.883+0000 7f754152e800 1 --2- 172.21.15.164:0/1804679416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875e53990 0x564875e5ae90 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.883+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 >> 172.21.15.164:0/1804679416 conn(0x564875e4fcf0 msgr2=0x564875e4ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.883+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 shutdown_connections 2024-09-13T23:07:19.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.883+0000 7f754152e800 1 -- 172.21.15.164:0/1804679416 wait complete. 2024-09-13T23:07:19.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.883+0000 7f754152e800 1 -- 172.21.15.164:0/3297908072 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7414036b90 msgr2=0x7f7414039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.883+0000 7f754152e800 1 --2- 172.21.15.164:0/3297908072 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7414036b90 0x7f7414039050 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x564875e35a00 tx=0x7f7538005840 comp rx=0 tx=0).stop 2024-09-13T23:07:19.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.883+0000 7f754152e800 1 -- 172.21.15.164:0/3297908072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875e25da0 msgr2=0x564875e243f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.883+0000 7f754152e800 1 --2- 172.21.15.164:0/3297908072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875e25da0 0x564875e243f0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f752800e610 tx=0x7f752800ff90 comp rx=0 tx=0).stop 2024-09-13T23:07:19.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.883+0000 7f754152e800 1 -- 172.21.15.164:0/3297908072 shutdown_connections 2024-09-13T23:07:19.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.883+0000 7f754152e800 1 --2- 172.21.15.164:0/3297908072 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7414036b90 0x7f7414039050 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.883+0000 7f754152e800 1 --2- 172.21.15.164:0/3297908072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875e25da0 0x564875e243f0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.883+0000 7f754152e800 1 -- 172.21.15.164:0/3297908072 >> 172.21.15.164:0/3297908072 conn(0x564875e39a00 msgr2=0x564875e3c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.883+0000 7f754152e800 1 -- 172.21.15.164:0/3297908072 shutdown_connections 2024-09-13T23:07:19.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.883+0000 7f754152e800 1 -- 172.21.15.164:0/3297908072 wait complete. 2024-09-13T23:07:19.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.883+0000 7f754152e800 1 -- 172.21.15.164:0/1792671273 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564875d35e20 msgr2=0x564875e340c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.883+0000 7f754152e800 1 --2- 172.21.15.164:0/1792671273 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564875d35e20 0x564875e340c0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.883+0000 7f754152e800 1 -- 172.21.15.164:0/1792671273 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7424036b40 msgr2=0x7f7424039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.883+0000 7f754152e800 1 --2- 172.21.15.164:0/1792671273 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7424036b40 0x7f7424039000 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7528000c00 tx=0x7f75280013b0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.883+0000 7f754152e800 1 -- 172.21.15.164:0/1792671273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875d354e0 msgr2=0x564875e2d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.884+0000 7f754152e800 1 --2- 172.21.15.164:0/1792671273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875d354e0 0x564875e2d050 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f75300460a0 tx=0x7f7530003020 comp rx=0 tx=0).stop 2024-09-13T23:07:19.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.884+0000 7f754152e800 1 -- 172.21.15.164:0/1792671273 shutdown_connections 2024-09-13T23:07:19.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.884+0000 7f754152e800 1 --2- 172.21.15.164:0/1792671273 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x564875d35e20 0x564875e340c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.884+0000 7f754152e800 1 --2- 172.21.15.164:0/1792671273 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f7424036b40 0x7f7424039000 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.884+0000 7f754152e800 1 --2- 172.21.15.164:0/1792671273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564875d354e0 0x564875e2d050 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.884+0000 7f754152e800 1 -- 172.21.15.164:0/1792671273 >> 172.21.15.164:0/1792671273 conn(0x564875d30db0 msgr2=0x564875e1e870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.884+0000 7f754152e800 1 -- 172.21.15.164:0/1792671273 shutdown_connections 2024-09-13T23:07:19.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.884+0000 7f754152e800 1 -- 172.21.15.164:0/1792671273 wait complete. 2024-09-13T23:07:19.897 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:07:18.801026Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:07:18.801015Z', 'tags': [], 'group_ids': []} 2024-09-13T23:07:19.898 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:07:18.801026Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:07:18.801015Z', 'tags': [], 'group_ids': []} 2024-09-13T23:07:19.898 ERROR:root:0 2024-09-13T23:07:19.898 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:07:19.910 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:07:19.910 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-13T23:07:19.911 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-13T23:07:19.911 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-09-13T23:07:19.957 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:07:19.957 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:07:19.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.957+0000 7f4f6760e800 1 Processor -- start 2024-09-13T23:07:19.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.957+0000 7f4f6760e800 1 -- start start 2024-09-13T23:07:19.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.958+0000 7f4f6760e800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55d5e99cd710 0x55d5e99cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.958+0000 7f4f6760e800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d5e988cb30 con 0x55d5e99ce050 2024-09-13T23:07:19.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.958+0000 7f4f6760e800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55d5e986e360 con 0x55d5e99cd710 2024-09-13T23:07:19.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.958+0000 7f4f62d75640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55d5e99cd710 0x55d5e99cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.958+0000 7f4f62574640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55d5e99ce050 0x55d5e99d2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:37900/0 (socket says 172.21.15.164:37900) 2024-09-13T23:07:19.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.958+0000 7f4f62574640 1 -- 172.21.15.164:0/3139569753 learned_addr learned my addr 172.21.15.164:0/3139569753 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:07:19.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.958+0000 7f4f62d75640 1 -- 172.21.15.164:0/3139569753 >> v1:172.21.15.17:6789/0 conn(0x55d5e99ce050 legacy=0x55d5e99d2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.958+0000 7f4f62d75640 1 -- 172.21.15.164:0/3139569753 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5e9894e00 con 0x55d5e99cd710 2024-09-13T23:07:19.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.960+0000 7f4f62d75640 1 --2- 172.21.15.164:0/3139569753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e99cd710 0x55d5e99cdb10 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400a470 tx=0x7f4f54045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06dceba908ae9c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.960+0000 7f4f61d73640 1 -- 172.21.15.164:0/3139569753 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f54053570 con 0x55d5e99cd710 2024-09-13T23:07:19.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.960+0000 7f4f61d73640 1 -- 172.21.15.164:0/3139569753 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f54058070 con 0x55d5e99cd710 2024-09-13T23:07:19.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.960+0000 7f4f61d73640 1 -- 172.21.15.164:0/3139569753 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f54053880 con 0x55d5e99cd710 2024-09-13T23:07:19.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.961+0000 7f4f6760e800 1 -- 172.21.15.164:0/3139569753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e99cd710 msgr2=0x55d5e99cdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.961+0000 7f4f6760e800 1 --2- 172.21.15.164:0/3139569753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e99cd710 0x55d5e99cdb10 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400a470 tx=0x7f4f54045a20 comp rx=0 tx=0).stop 2024-09-13T23:07:19.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.961+0000 7f4f6760e800 1 -- 172.21.15.164:0/3139569753 shutdown_connections 2024-09-13T23:07:19.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.961+0000 7f4f6760e800 1 --2- 172.21.15.164:0/3139569753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e99cd710 0x55d5e99cdb10 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.961+0000 7f4f6760e800 1 -- 172.21.15.164:0/3139569753 >> 172.21.15.164:0/3139569753 conn(0x55d5e99c8fe0 msgr2=0x55d5e99cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.961+0000 7f4f6760e800 1 -- 172.21.15.164:0/3139569753 shutdown_connections 2024-09-13T23:07:19.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.961+0000 7f4f6760e800 1 -- 172.21.15.164:0/3139569753 wait complete. 2024-09-13T23:07:19.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.975+0000 7f4f6760e800 1 Processor -- start 2024-09-13T23:07:19.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.975+0000 7f4f6760e800 1 -- start start 2024-09-13T23:07:19.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.975+0000 7f4f6760e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e99cd710 0x55d5e9abc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.975+0000 7f4f6760e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d5e9919360 con 0x55d5e99cd710 2024-09-13T23:07:19.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.975+0000 7f4f62d75640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e99cd710 0x55d5e9abc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.975+0000 7f4f62d75640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e99cd710 0x55d5e9abc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54744/0 (socket says 172.21.15.164:54744) 2024-09-13T23:07:19.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.975+0000 7f4f62d75640 1 -- 172.21.15.164:0/3226658440 learned_addr learned my addr 172.21.15.164:0/3226658440 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.975+0000 7f4f62d75640 1 -- 172.21.15.164:0/3226658440 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5e9866bc0 con 0x55d5e99cd710 2024-09-13T23:07:19.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.976+0000 7f4f62d75640 1 --2- 172.21.15.164:0/3226658440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e99cd710 0x55d5e9abc900 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f4f54025c20 tx=0x7f4f54051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217d0ff8ad536cfb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.976+0000 7f4e50e09640 1 -- 172.21.15.164:0/3226658440 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f54053ba0 con 0x55d5e99cd710 2024-09-13T23:07:19.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.976+0000 7f4e50e09640 1 -- 172.21.15.164:0/3226658440 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f54063030 con 0x55d5e99cd710 2024-09-13T23:07:19.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.976+0000 7f4e50e09640 1 -- 172.21.15.164:0/3226658440 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f54053440 con 0x55d5e99cd710 2024-09-13T23:07:19.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.977+0000 7f4f6760e800 1 -- 172.21.15.164:0/3226658440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e99cd710 msgr2=0x55d5e9abc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.977+0000 7f4f6760e800 1 --2- 172.21.15.164:0/3226658440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e99cd710 0x55d5e9abc900 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f4f54025c20 tx=0x7f4f54051000 comp rx=0 tx=0).stop 2024-09-13T23:07:19.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.977+0000 7f4f6760e800 1 -- 172.21.15.164:0/3226658440 shutdown_connections 2024-09-13T23:07:19.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.977+0000 7f4f6760e800 1 --2- 172.21.15.164:0/3226658440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e99cd710 0x55d5e9abc900 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.977+0000 7f4f6760e800 1 -- 172.21.15.164:0/3226658440 >> 172.21.15.164:0/3226658440 conn(0x55d5e99c8fe0 msgr2=0x55d5e9ab82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.977+0000 7f4f6760e800 1 -- 172.21.15.164:0/3226658440 shutdown_connections 2024-09-13T23:07:19.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.977+0000 7f4f6760e800 1 -- 172.21.15.164:0/3226658440 wait complete. 2024-09-13T23:07:19.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.977+0000 7f4f6760e800 1 Processor -- start 2024-09-13T23:07:19.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.977+0000 7f4f6760e800 1 -- start start 2024-09-13T23:07:19.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.977+0000 7f4f6760e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e99cd710 0x55d5e9ac4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.977+0000 7f4f6760e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d5e99d45f0 con 0x55d5e99cd710 2024-09-13T23:07:19.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.977+0000 7f4f62d75640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e99cd710 0x55d5e9ac4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.977+0000 7f4f62d75640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e99cd710 0x55d5e9ac4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54750/0 (socket says 172.21.15.164:54750) 2024-09-13T23:07:19.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.977+0000 7f4f62d75640 1 -- 172.21.15.164:0/4037883519 learned_addr learned my addr 172.21.15.164:0/4037883519 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.978+0000 7f4f62d75640 1 -- 172.21.15.164:0/4037883519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5e987afe0 con 0x55d5e99cd710 2024-09-13T23:07:19.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.978+0000 7f4f62d75640 1 --2- 172.21.15.164:0/4037883519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e99cd710 0x55d5e9ac4280 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x55d5e9abd760 tx=0x7f4f54002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.978+0000 7f4e4f606640 1 -- 172.21.15.164:0/4037883519 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f54078070 con 0x55d5e99cd710 2024-09-13T23:07:19.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.978+0000 7f4e4f606640 1 -- 172.21.15.164:0/4037883519 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f54053570 con 0x55d5e99cd710 2024-09-13T23:07:19.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.978+0000 7f4f6760e800 1 -- 172.21.15.164:0/4037883519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d5e9ac47c0 con 0x55d5e99cd710 2024-09-13T23:07:19.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.978+0000 7f4e4f606640 1 -- 172.21.15.164:0/4037883519 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f54053850 con 0x55d5e99cd710 2024-09-13T23:07:19.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.978+0000 7f4f6760e800 1 -- 172.21.15.164:0/4037883519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5e9ac4d40 con 0x55d5e99cd710 2024-09-13T23:07:19.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.979+0000 7f4e4f606640 1 -- 172.21.15.164:0/4037883519 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4f5407b070 con 0x55d5e99cd710 2024-09-13T23:07:19.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.979+0000 7f4e4f606640 1 --2- 172.21.15.164:0/4037883519 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4e48036b90 0x7f4e48039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.979+0000 7f4e4f606640 1 -- 172.21.15.164:0/4037883519 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f4f54070070 con 0x55d5e99cd710 2024-09-13T23:07:19.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.979+0000 7f4f62574640 1 --2- 172.21.15.164:0/4037883519 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4e48036b90 0x7f4e48039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.979+0000 7f4f6760e800 1 --2- 172.21.15.164:0/4037883519 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d5e99ce050 0x55d5e9acb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.979+0000 7f4f6760e800 1 -- 172.21.15.164:0/4037883519 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9acb8c0 con 0x55d5e99ce050 2024-09-13T23:07:19.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.979+0000 7f4f63576640 1 --2- 172.21.15.164:0/4037883519 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d5e99ce050 0x55d5e9acb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.980+0000 7f4f62574640 1 --2- 172.21.15.164:0/4037883519 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4e48036b90 0x7f4e48039050 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4f58000f60 tx=0x7f4f580012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.980+0000 7f4f63576640 1 --2- 172.21.15.164:0/4037883519 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d5e99ce050 0x55d5e9acb2f0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.980+0000 7f4f63576640 1 -- 172.21.15.164:0/4037883519 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f5c00a4a0 con 0x55d5e99ce050 2024-09-13T23:07:19.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.980+0000 7f4f6760e800 1 -- 172.21.15.164:0/4037883519 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9ac88a0 con 0x55d5e99ce050 2024-09-13T23:07:19.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.980+0000 7f4f63576640 1 -- 172.21.15.164:0/4037883519 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4f5c00a4a0 con 0x55d5e99ce050 2024-09-13T23:07:19.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.980+0000 7f4f6760e800 1 -- 172.21.15.164:0/4037883519 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9acd710 con 0x55d5e99ce050 2024-09-13T23:07:19.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.980+0000 7f4f63576640 1 -- 172.21.15.164:0/4037883519 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4f5c00a4a0 con 0x55d5e99ce050 2024-09-13T23:07:19.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.980+0000 7f4f6760e800 1 -- 172.21.15.164:0/4037883519 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9acc7f0 con 0x55d5e99ce050 2024-09-13T23:07:19.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.981+0000 7f4f63576640 1 -- 172.21.15.164:0/4037883519 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4f5c00a4a0 con 0x55d5e99ce050 2024-09-13T23:07:19.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.981+0000 7f4f6760e800 1 -- 172.21.15.164:0/4037883519 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9accc40 con 0x55d5e99ce050 2024-09-13T23:07:19.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.981+0000 7f4f63576640 1 -- 172.21.15.164:0/4037883519 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4f5c00a4a0 con 0x55d5e99ce050 2024-09-13T23:07:19.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.981+0000 7f4f6760e800 1 Processor -- start 2024-09-13T23:07:19.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.981+0000 7f4f6760e800 1 -- start start 2024-09-13T23:07:19.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.981+0000 7f4f6760e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e9adbc90 0x55d5e9adc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.981+0000 7f4f6760e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d5e9868580 con 0x55d5e9adbc90 2024-09-13T23:07:19.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.982+0000 7f4f62574640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e9adbc90 0x55d5e9adc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.982+0000 7f4f62574640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e9adbc90 0x55d5e9adc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54760/0 (socket says 172.21.15.164:54760) 2024-09-13T23:07:19.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.982+0000 7f4f62574640 1 -- 172.21.15.164:0/2251316695 learned_addr learned my addr 172.21.15.164:0/2251316695 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.982+0000 7f4f62574640 1 -- 172.21.15.164:0/2251316695 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5e9adc5f0 con 0x55d5e9adbc90 2024-09-13T23:07:19.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.982+0000 7f4f62574640 1 --2- 172.21.15.164:0/2251316695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e9adbc90 0x55d5e9adc0b0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4f58001ed0 tx=0x7f4f5800d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.983+0000 7f4e4ce01640 1 -- 172.21.15.164:0/2251316695 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f5801b550 con 0x55d5e9adbc90 2024-09-13T23:07:19.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.983+0000 7f4e4ce01640 1 -- 172.21.15.164:0/2251316695 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f5801b6f0 con 0x55d5e9adbc90 2024-09-13T23:07:19.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.983+0000 7f4e4ce01640 1 -- 172.21.15.164:0/2251316695 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f5801b9d0 con 0x55d5e9adbc90 2024-09-13T23:07:19.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.983+0000 7f4f6760e800 1 -- 172.21.15.164:0/2251316695 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d5e9adc880 con 0x55d5e9adbc90 2024-09-13T23:07:19.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.983+0000 7f4f6760e800 1 -- 172.21.15.164:0/2251316695 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5e9adf560 con 0x55d5e9adbc90 2024-09-13T23:07:19.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.983+0000 7f4e4ce01640 1 -- 172.21.15.164:0/2251316695 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4f58023020 con 0x55d5e9adbc90 2024-09-13T23:07:19.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.984+0000 7f4e4ce01640 1 --2- 172.21.15.164:0/2251316695 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4e3c036b90 0x7f4e3c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.984+0000 7f4e4ce01640 1 -- 172.21.15.164:0/2251316695 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f4f58021020 con 0x55d5e9adbc90 2024-09-13T23:07:19.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.984+0000 7f4f63576640 1 --2- 172.21.15.164:0/2251316695 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4e3c036b90 0x7f4e3c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.984+0000 7f4f6760e800 1 Processor -- start 2024-09-13T23:07:19.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.984+0000 7f4f63576640 1 --2- 172.21.15.164:0/2251316695 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4e3c036b90 0x7f4e3c039050 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55d5e9acc310 tx=0x7f4f5c005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.984+0000 7f4f6760e800 1 -- start start 2024-09-13T23:07:19.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.984+0000 7f4f6760e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e9ae89a0 0x55d5e9ae8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.984+0000 7f4f6760e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d5e9abd050 con 0x55d5e9ae89a0 2024-09-13T23:07:19.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.984+0000 7f4f62574640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e9ae89a0 0x55d5e9ae8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.984+0000 7f4f62574640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e9ae89a0 0x55d5e9ae8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54776/0 (socket says 172.21.15.164:54776) 2024-09-13T23:07:19.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.984+0000 7f4f62574640 1 -- 172.21.15.164:0/3004963340 learned_addr learned my addr 172.21.15.164:0/3004963340 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.985+0000 7f4f62574640 1 -- 172.21.15.164:0/3004963340 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5e9ae9370 con 0x55d5e9ae89a0 2024-09-13T23:07:19.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.985+0000 7f4f62574640 1 --2- 172.21.15.164:0/3004963340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e9ae89a0 0x55d5e9ae8da0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f4f5804d100 tx=0x7f4f58019ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a5cb84d113f254 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.985+0000 7f4e467fc640 1 -- 172.21.15.164:0/3004963340 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f580258e0 con 0x55d5e9ae89a0 2024-09-13T23:07:19.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.985+0000 7f4e467fc640 1 -- 172.21.15.164:0/3004963340 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f58025410 con 0x55d5e9ae89a0 2024-09-13T23:07:19.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.985+0000 7f4e467fc640 1 -- 172.21.15.164:0/3004963340 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f58025a80 con 0x55d5e9ae89a0 2024-09-13T23:07:19.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.985+0000 7f4f6760e800 1 -- 172.21.15.164:0/3004963340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e9ae89a0 msgr2=0x55d5e9ae8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:19.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.985+0000 7f4f6760e800 1 --2- 172.21.15.164:0/3004963340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e9ae89a0 0x55d5e9ae8da0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f4f5804d100 tx=0x7f4f58019ce0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.985+0000 7f4f6760e800 1 -- 172.21.15.164:0/3004963340 shutdown_connections 2024-09-13T23:07:19.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.985+0000 7f4f6760e800 1 --2- 172.21.15.164:0/3004963340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e9ae89a0 0x55d5e9ae8da0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:19.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.985+0000 7f4f6760e800 1 -- 172.21.15.164:0/3004963340 >> 172.21.15.164:0/3004963340 conn(0x55d5e9ae4d00 msgr2=0x55d5e9ae2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:19.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.985+0000 7f4f6760e800 1 -- 172.21.15.164:0/3004963340 shutdown_connections 2024-09-13T23:07:19.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.985+0000 7f4f6760e800 1 -- 172.21.15.164:0/3004963340 wait complete. 2024-09-13T23:07:19.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.986+0000 7f4f6760e800 1 Processor -- start 2024-09-13T23:07:19.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.986+0000 7f4f6760e800 1 -- start start 2024-09-13T23:07:19.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.986+0000 7f4f6760e800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e9ae89a0 0x55d5e9af2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.986+0000 7f4f6760e800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d5e9ae99e0 con 0x55d5e9ae89a0 2024-09-13T23:07:19.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.986+0000 7f4f62574640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e9ae89a0 0x55d5e9af2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.986+0000 7f4f62574640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e9ae89a0 0x55d5e9af2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54792/0 (socket says 172.21.15.164:54792) 2024-09-13T23:07:19.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.986+0000 7f4f62574640 1 -- 172.21.15.164:0/367931052 learned_addr learned my addr 172.21.15.164:0/367931052 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:19.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.987+0000 7f4f62574640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5e9af25c0 con 0x55d5e9ae89a0 2024-09-13T23:07:19.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.987+0000 7f4f62574640 1 --2- 172.21.15.164:0/367931052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e9ae89a0 0x55d5e9af2080 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f4f5804c020 tx=0x7f4f5804d090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.987+0000 7f4e44ff9640 1 -- 172.21.15.164:0/367931052 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f5800cc60 con 0x55d5e9ae89a0 2024-09-13T23:07:19.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.987+0000 7f4e44ff9640 1 -- 172.21.15.164:0/367931052 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f5800ce00 con 0x55d5e9ae89a0 2024-09-13T23:07:19.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.987+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d5e9af2850 con 0x55d5e9ae89a0 2024-09-13T23:07:19.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.987+0000 7f4e44ff9640 1 -- 172.21.15.164:0/367931052 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f58040990 con 0x55d5e9ae89a0 2024-09-13T23:07:19.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.987+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5e9af2850 con 0x55d5e9ae89a0 2024-09-13T23:07:19.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.988+0000 7f4e44ff9640 1 -- 172.21.15.164:0/367931052 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4f58040bf0 con 0x55d5e9ae89a0 2024-09-13T23:07:19.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.988+0000 7f4e44ff9640 1 --2- 172.21.15.164:0/367931052 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4e2c036af0 0x7f4e2c038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.988+0000 7f4e44ff9640 1 -- 172.21.15.164:0/367931052 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f4f58035070 con 0x55d5e9ae89a0 2024-09-13T23:07:19.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.988+0000 7f4f63576640 1 --2- 172.21.15.164:0/367931052 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4e2c036af0 0x7f4e2c038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.988+0000 7f4f63576640 1 --2- 172.21.15.164:0/367931052 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4e2c036af0 0x7f4e2c038fb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x55d5e9ac8810 tx=0x7f4f5c01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.989+0000 7f4f6760e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.989+0000 7f4f6760e800 1 --2- 172.21.15.164:0/367931052 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d5e9afd960 0x55d5e9affe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:19.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.989+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b00570 con 0x55d5e9afd960 2024-09-13T23:07:19.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.989+0000 7f4f62d75640 1 --2- 172.21.15.164:0/367931052 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d5e9afd960 0x55d5e9affe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:19.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.989+0000 7f4f62d75640 1 --2- 172.21.15.164:0/367931052 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d5e9afd960 0x55d5e9affe20 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:19.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.989+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f5407a030 con 0x55d5e9afd960 2024-09-13T23:07:19.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.989+0000 7f4f6760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.989+0000 7f4f6760e800 20 realm 2024-09-13T23:07:19.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.989+0000 7f4f6760e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.989+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b00980 con 0x55d5e9afd960 2024-09-13T23:07:19.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.989+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f5407a030 con 0x55d5e9afd960 2024-09-13T23:07:19.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.990+0000 7f4f6760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.990+0000 7f4f6760e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:07:19.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.990+0000 7f4f6760e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.990+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b01250 con 0x55d5e9afd960 2024-09-13T23:07:19.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.990+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f5407a030 con 0x55d5e9afd960 2024-09-13T23:07:19.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.990+0000 7f4f6760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:19.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.990+0000 7f4f6760e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:19.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.990+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b015f0 con 0x55d5e9afd960 2024-09-13T23:07:19.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.990+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4f5407a030 con 0x55d5e9afd960 2024-09-13T23:07:20.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.990+0000 7f4f6760e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:20.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.990+0000 7f4f6760e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.990+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b01e40 con 0x55d5e9afd960 2024-09-13T23:07:20.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.990+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4f5407a030 con 0x55d5e9afd960 2024-09-13T23:07:20.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.990+0000 7f4f6760e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:07:20.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.990+0000 7f4f6760e800 20 searching for the correct realm 2024-09-13T23:07:20.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.990+0000 7f4f6760e800 1 --2- 172.21.15.164:0/367931052 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55d5e9b03bb0 0x55d5e9b05fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.990+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x55d5e9b03bb0 2024-09-13T23:07:20.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.990+0000 7f4f62574640 1 --2- 172.21.15.164:0/367931052 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55d5e9b03bb0 0x55d5e9b05fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.991+0000 7f4f62574640 1 --2- 172.21.15.164:0/367931052 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55d5e9b03bb0 0x55d5e9b05fa0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.991+0000 7f4f62574640 1 -- 172.21.15.164:0/367931052 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5803f020 con 0x55d5e9b03bb0 2024-09-13T23:07:20.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.991+0000 7f4f62574640 1 --2- 172.21.15.164:0/367931052 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f4f580234d0 0x7f4f58042210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.991+0000 7f4f62574640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x7f4f580234d0 2024-09-13T23:07:20.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.991+0000 7f4f63576640 1 --2- 172.21.15.164:0/367931052 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f4f580234d0 0x7f4f58042210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.991+0000 7f4f63576640 1 --2- 172.21.15.164:0/367931052 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f4f580234d0 0x7f4f58042210 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.992+0000 7f4f63576640 1 -- 172.21.15.164:0/367931052 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5c01f070 con 0x7f4f580234d0 2024-09-13T23:07:20.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.992+0000 7f4f63576640 1 --2- 172.21.15.164:0/367931052 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f4f5c031040 0x7f4f5c032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.992+0000 7f4f63576640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x7f4f5c031040 2024-09-13T23:07:20.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.992+0000 7f4f62d75640 1 --2- 172.21.15.164:0/367931052 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f4f5c031040 0x7f4f5c032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.992+0000 7f4f62d75640 1 --2- 172.21.15.164:0/367931052 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f4f5c031040 0x7f4f5c032430 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.992+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5407a030 con 0x7f4f5c031040 2024-09-13T23:07:20.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.992+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x55d5e9afd960 2024-09-13T23:07:20.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.993+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4f5407a030 con 0x55d5e9afd960 2024-09-13T23:07:20.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.993+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x55d5e9afd960 2024-09-13T23:07:20.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.993+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5407a030 con 0x55d5e9afd960 2024-09-13T23:07:20.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.993+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x7f4f5c031040 2024-09-13T23:07:20.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.993+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5407a030 con 0x7f4f5c031040 2024-09-13T23:07:20.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.993+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x7f4f5c031040 2024-09-13T23:07:20.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.993+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5407a030 con 0x7f4f5c031040 2024-09-13T23:07:20.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.993+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x7f4f580234d0 2024-09-13T23:07:20.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.994+0000 7f4f63576640 1 -- 172.21.15.164:0/367931052 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5c01f070 con 0x7f4f580234d0 2024-09-13T23:07:20.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.994+0000 7f4f63576640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x55d5e9b03bb0 2024-09-13T23:07:20.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.994+0000 7f4f62574640 1 -- 172.21.15.164:0/367931052 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5805d040 con 0x55d5e9b03bb0 2024-09-13T23:07:20.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.994+0000 7f4f62574640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x55d5e9afd960 2024-09-13T23:07:20.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.994+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5407a030 con 0x55d5e9afd960 2024-09-13T23:07:20.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.994+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x7f4f5c031040 2024-09-13T23:07:20.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.994+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5407a030 con 0x7f4f5c031040 2024-09-13T23:07:20.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.994+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x55d5e9afd960 2024-09-13T23:07:20.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.995+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5407a030 con 0x55d5e9afd960 2024-09-13T23:07:20.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.995+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x7f4f580234d0 2024-09-13T23:07:20.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.995+0000 7f4f63576640 1 -- 172.21.15.164:0/367931052 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4f5c01f070 con 0x7f4f580234d0 2024-09-13T23:07:20.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.995+0000 7f4f63576640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x55d5e9b03bb0 2024-09-13T23:07:20.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.995+0000 7f4f62574640 1 -- 172.21.15.164:0/367931052 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5805d040 con 0x55d5e9b03bb0 2024-09-13T23:07:20.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.995+0000 7f4f62574640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x55d5e9b03bb0 2024-09-13T23:07:20.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.995+0000 7f4f62574640 1 -- 172.21.15.164:0/367931052 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5805d040 con 0x55d5e9b03bb0 2024-09-13T23:07:20.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.995+0000 7f4f62574640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x7f4f5c031040 2024-09-13T23:07:20.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.996+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5407a030 con 0x7f4f5c031040 2024-09-13T23:07:20.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.996+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x55d5e9b03bb0 2024-09-13T23:07:20.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.996+0000 7f4f62574640 1 -- 172.21.15.164:0/367931052 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5805d040 con 0x55d5e9b03bb0 2024-09-13T23:07:20.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.996+0000 7f4f62574640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x55d5e9b03bb0 2024-09-13T23:07:20.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.996+0000 7f4f62574640 1 -- 172.21.15.164:0/367931052 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5805d040 con 0x55d5e9b03bb0 2024-09-13T23:07:20.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.996+0000 7f4f62574640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x55d5e9afd960 2024-09-13T23:07:20.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.996+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5407a030 con 0x55d5e9afd960 2024-09-13T23:07:20.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.996+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x55d5e9afd960 2024-09-13T23:07:20.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.997+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4f5407a030 con 0x55d5e9afd960 2024-09-13T23:07:20.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.997+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x7f4f5c031040 2024-09-13T23:07:20.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.997+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5407a030 con 0x7f4f5c031040 2024-09-13T23:07:20.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.997+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x55d5e9b03bb0 2024-09-13T23:07:20.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.997+0000 7f4f62574640 1 -- 172.21.15.164:0/367931052 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5805d040 con 0x55d5e9b03bb0 2024-09-13T23:07:20.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.997+0000 7f4f62574640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x7f4f580234d0 2024-09-13T23:07:20.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.997+0000 7f4f63576640 1 -- 172.21.15.164:0/367931052 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5c01f070 con 0x7f4f580234d0 2024-09-13T23:07:20.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.997+0000 7f4f63576640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x55d5e9afd960 2024-09-13T23:07:20.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.998+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4f5407a030 con 0x55d5e9afd960 2024-09-13T23:07:20.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.998+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x7f4f5c031040 2024-09-13T23:07:20.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.998+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5407a030 con 0x7f4f5c031040 2024-09-13T23:07:20.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.998+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x55d5e9b03bb0 2024-09-13T23:07:20.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.998+0000 7f4f62574640 1 -- 172.21.15.164:0/367931052 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5805d040 con 0x55d5e9b03bb0 2024-09-13T23:07:20.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.998+0000 7f4f62574640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x7f4f5c031040 2024-09-13T23:07:20.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.998+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5407a030 con 0x7f4f5c031040 2024-09-13T23:07:20.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.998+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x7f4f580234d0 2024-09-13T23:07:20.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.999+0000 7f4f63576640 1 -- 172.21.15.164:0/367931052 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5c01f070 con 0x7f4f580234d0 2024-09-13T23:07:20.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.999+0000 7f4f63576640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x55d5e9b03bb0 2024-09-13T23:07:20.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.999+0000 7f4f62574640 1 -- 172.21.15.164:0/367931052 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5805d040 con 0x55d5e9b03bb0 2024-09-13T23:07:20.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.999+0000 7f4f62574640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x7f4f580234d0 2024-09-13T23:07:20.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.999+0000 7f4f63576640 1 -- 172.21.15.164:0/367931052 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5c01f070 con 0x7f4f580234d0 2024-09-13T23:07:20.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.999+0000 7f4f63576640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x55d5e9afd960 2024-09-13T23:07:20.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.999+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4f5407a030 con 0x55d5e9afd960 2024-09-13T23:07:20.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:19.999+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b065b0 con 0x7f4f580234d0 2024-09-13T23:07:20.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.000+0000 7f4f63576640 1 -- 172.21.15.164:0/367931052 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5c040040 con 0x7f4f580234d0 2024-09-13T23:07:20.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.000+0000 7f4f6760e800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:07:20.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.000+0000 7f4f6760e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:07:20.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.000+0000 7f4f6760e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:07:20.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.000+0000 7f4f6760e800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:07:20.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.000+0000 7f4f6760e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:07:20.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.000+0000 7f4f6760e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:07:20.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.000+0000 7f4f6760e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.000+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b027c0 con 0x55d5e9afd960 2024-09-13T23:07:20.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.000+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f5407a030 con 0x55d5e9afd960 2024-09-13T23:07:20.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.000+0000 7f4f6760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.000+0000 7f4f6760e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.000+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b03060 con 0x55d5e9afd960 2024-09-13T23:07:20.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.000+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4f5407a030 con 0x55d5e9afd960 2024-09-13T23:07:20.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.000+0000 7f4f6760e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:20.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.000+0000 7f4f6760e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.000+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b03060 con 0x55d5e9afd960 2024-09-13T23:07:20.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.000+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4f5407a030 con 0x55d5e9afd960 2024-09-13T23:07:20.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.000+0000 7f4f6760e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:07:20.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.000+0000 7f4f6760e800 20 zone default found 2024-09-13T23:07:20.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.000+0000 7f4f6760e800 4 Realm: () 2024-09-13T23:07:20.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.000+0000 7f4f6760e800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:07:20.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.000+0000 7f4f6760e800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:07:20.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.000+0000 7f4f6760e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:07:20.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.000+0000 7f4f6760e800 20 zonegroup default 2024-09-13T23:07:20.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.000+0000 7f4f6760e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.000+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b06a10 con 0x7f4f5c031040 2024-09-13T23:07:20.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.001+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4f5407a030 con 0x7f4f5c031040 2024-09-13T23:07:20.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.001+0000 7f4f6760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.001+0000 7f4f6760e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.001+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b08480 con 0x55d5e9b03bb0 2024-09-13T23:07:20.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.001+0000 7f4f62574640 1 -- 172.21.15.164:0/367931052 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4f5805d040 con 0x55d5e9b03bb0 2024-09-13T23:07:20.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.001+0000 7f4f6760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.001+0000 7f4f6760e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.001+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b089a0 con 0x55d5e9b03bb0 2024-09-13T23:07:20.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.001+0000 7f4f62574640 1 -- 172.21.15.164:0/367931052 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4f5805d040 con 0x55d5e9b03bb0 2024-09-13T23:07:20.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.001+0000 7f4f6760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.001+0000 7f4f6760e800 20 started sync module instance, tier type = 2024-09-13T23:07:20.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.001+0000 7f4f6760e800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:07:20.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.001+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b07890 con 0x7f4f580234d0 2024-09-13T23:07:20.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.002+0000 7f4f63576640 1 -- 172.21.15.164:0/367931052 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5c040040 con 0x7f4f580234d0 2024-09-13T23:07:20.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.002+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94377237052544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b080a0 con 0x7f4f580234d0 2024-09-13T23:07:20.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.003+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b097c0 con 0x55d5e9afd960 2024-09-13T23:07:20.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.003+0000 7f4f63576640 1 -- 172.21.15.164:0/367931052 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94377237052544] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5c040040 con 0x7f4f580234d0 2024-09-13T23:07:20.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.004+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5407a030 con 0x55d5e9afd960 2024-09-13T23:07:20.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.004+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94377237057024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b09be0 con 0x55d5e9afd960 2024-09-13T23:07:20.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.004+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b0a5e0 con 0x55d5e9b03bb0 2024-09-13T23:07:20.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.005+0000 7f4f62574640 1 -- 172.21.15.164:0/367931052 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5805d040 con 0x55d5e9b03bb0 2024-09-13T23:07:20.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.005+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94377237061872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b0aeb0 con 0x55d5e9b03bb0 2024-09-13T23:07:20.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.005+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b0b950 con 0x7f4f580234d0 2024-09-13T23:07:20.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.005+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94377237057024] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5407a030 con 0x55d5e9afd960 2024-09-13T23:07:20.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.006+0000 7f4f63576640 1 -- 172.21.15.164:0/367931052 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5c040040 con 0x7f4f580234d0 2024-09-13T23:07:20.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.006+0000 7f4f62574640 1 -- 172.21.15.164:0/367931052 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94377237061872] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5805d040 con 0x55d5e9b03bb0 2024-09-13T23:07:20.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.006+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94377237066784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b0bd40 con 0x7f4f580234d0 2024-09-13T23:07:20.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.006+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b0aa40 con 0x55d5e9afd960 2024-09-13T23:07:20.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.007+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5407a030 con 0x55d5e9afd960 2024-09-13T23:07:20.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.007+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94377237070464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b0aa40 con 0x55d5e9afd960 2024-09-13T23:07:20.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.007+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b0d1f0 con 0x7f4f5c031040 2024-09-13T23:07:20.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.007+0000 7f4f63576640 1 -- 172.21.15.164:0/367931052 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94377237066784] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5c040040 con 0x7f4f580234d0 2024-09-13T23:07:20.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.008+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94377237070464] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5407a030 con 0x55d5e9afd960 2024-09-13T23:07:20.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.008+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5407a030 con 0x7f4f5c031040 2024-09-13T23:07:20.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.008+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94377237071520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b0d1b0 con 0x7f4f5c031040 2024-09-13T23:07:20.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.008+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b0da90 con 0x7f4f5c031040 2024-09-13T23:07:20.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.009+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(56 notify.6 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5407a030 con 0x7f4f5c031040 2024-09-13T23:07:20.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.009+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94377237075424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b0d1b0 con 0x7f4f5c031040 2024-09-13T23:07:20.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.009+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b0e5e0 con 0x7f4f5c031040 2024-09-13T23:07:20.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.009+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94377237071520] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5407a030 con 0x7f4f5c031040 2024-09-13T23:07:20.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.010+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94377237075424] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5407a030 con 0x7f4f5c031040 2024-09-13T23:07:20.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.010+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5407a030 con 0x7f4f5c031040 2024-09-13T23:07:20.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.010+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94377237076480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b0ccc0 con 0x7f4f5c031040 2024-09-13T23:07:20.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.010+0000 7f4f6760e800 20 add_watcher() i=0 2024-09-13T23:07:20.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.010+0000 7f4f6760e800 20 add_watcher() i=1 2024-09-13T23:07:20.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.010+0000 7f4f6760e800 20 add_watcher() i=2 2024-09-13T23:07:20.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.010+0000 7f4f6760e800 20 add_watcher() i=3 2024-09-13T23:07:20.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.010+0000 7f4f6760e800 20 add_watcher() i=4 2024-09-13T23:07:20.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.010+0000 7f4f6760e800 20 add_watcher() i=5 2024-09-13T23:07:20.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.010+0000 7f4f6760e800 20 add_watcher() i=6 2024-09-13T23:07:20.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.011+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94377237076480] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5407a030 con 0x7f4f5c031040 2024-09-13T23:07:20.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.011+0000 7f4f6760e800 20 add_watcher() i=7 2024-09-13T23:07:20.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.011+0000 7f4f6760e800 2 all 8 watchers are set, enabling cache 2024-09-13T23:07:20.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.011+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b115d0 con 0x55d5e9afd960 2024-09-13T23:07:20.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.012+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4f5407a030 con 0x55d5e9afd960 2024-09-13T23:07:20.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.012+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94377237078224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b0ea50 con 0x55d5e9afd960 2024-09-13T23:07:20.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.013+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94377237078224] v34'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4f5407a030 con 0x55d5e9afd960 2024-09-13T23:07:20.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.013+0000 7f4e197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:20.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.013+0000 7f4f6760e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:07:20.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.013+0000 7f4f6760e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:07:20.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.013+0000 7f4f6760e800 5 note: GC not initialized 2024-09-13T23:07:20.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.013+0000 7f4d93fff640 20 reqs_thread_entry: start 2024-09-13T23:07:20.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.013+0000 7f4f6760e800 20 init_complete bucket index max shards: 11 2024-09-13T23:07:20.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.014+0000 7f4f6760e800 20 Filter name: none 2024-09-13T23:07:20.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.014+0000 7f4d91ffb640 20 reqs_thread_entry: start 2024-09-13T23:07:20.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.014+0000 7f4f6760e800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T23:07:20.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.014+0000 7f4f6760e800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.014+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b44a00 con 0x7f4f5c031040 2024-09-13T23:07:20.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.014+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f4f5407a030 con 0x7f4f5c031040 2024-09-13T23:07:20.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.014+0000 7f4f6760e800 20 rados_obj.operate() r=0 bl.length=490 2024-09-13T23:07:20.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.014+0000 7f4f6760e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T23:07:20.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.014+0000 7f4f6760e800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:20.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.014+0000 7f4f6760e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:07:20.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.014+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b4b170 con 0x7f4f5c031040 2024-09-13T23:07:20.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.016+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f4f5407a030 con 0x7f4f5c031040 2024-09-13T23:07:20.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.016+0000 7f4f6760e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:07:20.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.016+0000 7f4f6760e800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:20.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.016+0000 7f4f6760e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T23:07:20.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.016+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94377237326640 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b46770 con 0x55d5e9afd960 2024-09-13T23:07:20.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.016+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== watch-notify(notify (1) cookie 94377237070464 notify 146028888093 ret 0) ==== 708+0+0 (crc 0 0 0) 0x55d5e9ac4d40 con 0x55d5e9afd960 2024-09-13T23:07:20.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.016+0000 7f4e467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888093 cookie 94377237070464 notifier 4889 bl.length()=666 2024-09-13T23:07:20.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.016+0000 7f4e467fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:07:20.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.016+0000 7f4e467fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:20.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.016+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(64 notify.4 [notify cookie 94377237326640 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4f5407a030 con 0x55d5e9afd960 2024-09-13T23:07:20.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.016+0000 7f4e467fc640 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f4e28003ea0 con 0x55d5e9afd960 2024-09-13T23:07:20.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.017+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5407a030 con 0x55d5e9afd960 2024-09-13T23:07:20.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.017+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== watch-notify(notify_complete (2) cookie 94377237326640 notify 146028888093 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d5e9ac47c0 con 0x55d5e9afd960 2024-09-13T23:07:20.029 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T23:07:18.801026Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:07:18.801015Z","tags":[],"group_ids":[]} 2024-09-13T23:07:20.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.018+0000 7f4e197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:20.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.018+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94377237078224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b42720 con 0x55d5e9afd960 2024-09-13T23:07:20.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.019+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94377237078224] v34'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4f5407a030 con 0x55d5e9afd960 2024-09-13T23:07:20.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.019+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94377237052544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b42720 con 0x7f4f580234d0 2024-09-13T23:07:20.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.020+0000 7f4f63576640 1 -- 172.21.15.164:0/367931052 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94377237052544] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5c040040 con 0x7f4f580234d0 2024-09-13T23:07:20.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.020+0000 7f4f6760e800 20 remove_watcher() i=0 2024-09-13T23:07:20.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.020+0000 7f4f6760e800 2 removed watcher, disabling cache 2024-09-13T23:07:20.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.020+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94377237057024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b42720 con 0x55d5e9afd960 2024-09-13T23:07:20.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.021+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94377237057024] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5407a030 con 0x55d5e9afd960 2024-09-13T23:07:20.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.021+0000 7f4f6760e800 20 remove_watcher() i=1 2024-09-13T23:07:20.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.021+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94377237061872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b42720 con 0x55d5e9b03bb0 2024-09-13T23:07:20.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.022+0000 7f4f62574640 1 -- 172.21.15.164:0/367931052 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94377237061872] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5805d040 con 0x55d5e9b03bb0 2024-09-13T23:07:20.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.022+0000 7f4f6760e800 20 remove_watcher() i=2 2024-09-13T23:07:20.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.022+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94377237066784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b07c80 con 0x7f4f580234d0 2024-09-13T23:07:20.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.023+0000 7f4f63576640 1 -- 172.21.15.164:0/367931052 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94377237066784] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5c040040 con 0x7f4f580234d0 2024-09-13T23:07:20.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.023+0000 7f4f6760e800 20 remove_watcher() i=3 2024-09-13T23:07:20.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.023+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94377237070464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b08e00 con 0x55d5e9afd960 2024-09-13T23:07:20.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.024+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94377237070464] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5407a030 con 0x55d5e9afd960 2024-09-13T23:07:20.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.024+0000 7f4f6760e800 20 remove_watcher() i=4 2024-09-13T23:07:20.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.024+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94377237071520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b0b420 con 0x7f4f5c031040 2024-09-13T23:07:20.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.026+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94377237071520] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5407a030 con 0x7f4f5c031040 2024-09-13T23:07:20.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.026+0000 7f4f6760e800 20 remove_watcher() i=5 2024-09-13T23:07:20.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.026+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94377237075424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b07c80 con 0x7f4f5c031040 2024-09-13T23:07:20.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.027+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94377237075424] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5407a030 con 0x7f4f5c031040 2024-09-13T23:07:20.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.027+0000 7f4f6760e800 20 remove_watcher() i=6 2024-09-13T23:07:20.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.027+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94377237076480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5e9b08e00 con 0x7f4f5c031040 2024-09-13T23:07:20.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94377237076480] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5407a030 con 0x7f4f5c031040 2024-09-13T23:07:20.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f6760e800 20 remove_watcher() i=7 2024-09-13T23:07:20.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f4f5c031040 msgr2=0x7f4f5c032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f6760e800 1 --2- 172.21.15.164:0/367931052 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f4f5c031040 0x7f4f5c032430 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d5e9afd960 msgr2=0x55d5e9affe20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f6760e800 1 --2- 172.21.15.164:0/367931052 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d5e9afd960 0x55d5e9affe20 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f4f580234d0 msgr2=0x7f4f58042210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f6760e800 1 --2- 172.21.15.164:0/367931052 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f4f580234d0 0x7f4f58042210 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55d5e9b03bb0 msgr2=0x55d5e9b05fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f6760e800 1 --2- 172.21.15.164:0/367931052 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55d5e9b03bb0 0x55d5e9b05fa0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4e2c036af0 msgr2=0x7f4e2c038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f6760e800 1 --2- 172.21.15.164:0/367931052 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4e2c036af0 0x7f4e2c038fb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x55d5e9ac8810 tx=0x7f4f5c01f000 comp rx=0 tx=0).stop 2024-09-13T23:07:20.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e9ae89a0 msgr2=0x55d5e9af2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f6760e800 1 --2- 172.21.15.164:0/367931052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e9ae89a0 0x55d5e9af2080 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f4f5804c020 tx=0x7f4f5804d090 comp rx=0 tx=0).stop 2024-09-13T23:07:20.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f62d75640 1 -- 172.21.15.164:0/367931052 reap_dead start 2024-09-13T23:07:20.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 shutdown_connections 2024-09-13T23:07:20.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f6760e800 1 --2- 172.21.15.164:0/367931052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e9ae89a0 0x55d5e9af2080 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 >> 172.21.15.164:0/367931052 conn(0x55d5e9ae4d00 msgr2=0x55d5e9ae2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 shutdown_connections 2024-09-13T23:07:20.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f6760e800 1 -- 172.21.15.164:0/367931052 wait complete. 2024-09-13T23:07:20.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f6760e800 1 -- 172.21.15.164:0/2251316695 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4e3c036b90 msgr2=0x7f4e3c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f6760e800 1 --2- 172.21.15.164:0/2251316695 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4e3c036b90 0x7f4e3c039050 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55d5e9acc310 tx=0x7f4f5c005840 comp rx=0 tx=0).stop 2024-09-13T23:07:20.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f6760e800 1 -- 172.21.15.164:0/2251316695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e9adbc90 msgr2=0x55d5e9adc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f6760e800 1 --2- 172.21.15.164:0/2251316695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e9adbc90 0x55d5e9adc0b0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4f58001ed0 tx=0x7f4f5800d7a0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f6760e800 1 -- 172.21.15.164:0/2251316695 shutdown_connections 2024-09-13T23:07:20.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f6760e800 1 --2- 172.21.15.164:0/2251316695 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4e3c036b90 0x7f4e3c039050 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f6760e800 1 --2- 172.21.15.164:0/2251316695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e9adbc90 0x55d5e9adc0b0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f6760e800 1 -- 172.21.15.164:0/2251316695 >> 172.21.15.164:0/2251316695 conn(0x55d5e9ad0c20 msgr2=0x55d5e9ad37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f6760e800 1 -- 172.21.15.164:0/2251316695 shutdown_connections 2024-09-13T23:07:20.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.028+0000 7f4f6760e800 1 -- 172.21.15.164:0/2251316695 wait complete. 2024-09-13T23:07:20.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.029+0000 7f4f6760e800 1 -- 172.21.15.164:0/4037883519 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d5e99ce050 msgr2=0x55d5e9acb2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.029+0000 7f4f6760e800 1 --2- 172.21.15.164:0/4037883519 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d5e99ce050 0x55d5e9acb2f0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.029+0000 7f4f6760e800 1 -- 172.21.15.164:0/4037883519 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4e48036b90 msgr2=0x7f4e48039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.029+0000 7f4f6760e800 1 --2- 172.21.15.164:0/4037883519 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4e48036b90 0x7f4e48039050 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4f58000f60 tx=0x7f4f580012b0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.029+0000 7f4f6760e800 1 -- 172.21.15.164:0/4037883519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e99cd710 msgr2=0x55d5e9ac4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.029+0000 7f4f6760e800 1 --2- 172.21.15.164:0/4037883519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e99cd710 0x55d5e9ac4280 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x55d5e9abd760 tx=0x7f4f54002fb0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.029+0000 7f4f6760e800 1 -- 172.21.15.164:0/4037883519 shutdown_connections 2024-09-13T23:07:20.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.029+0000 7f4f6760e800 1 --2- 172.21.15.164:0/4037883519 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55d5e99ce050 0x55d5e9acb2f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.029+0000 7f4f6760e800 1 --2- 172.21.15.164:0/4037883519 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f4e48036b90 0x7f4e48039050 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.029+0000 7f4f6760e800 1 --2- 172.21.15.164:0/4037883519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5e99cd710 0x55d5e9ac4280 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.029+0000 7f4f6760e800 1 -- 172.21.15.164:0/4037883519 >> 172.21.15.164:0/4037883519 conn(0x55d5e99c8fe0 msgr2=0x55d5e9ab6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.029+0000 7f4f6760e800 1 -- 172.21.15.164:0/4037883519 shutdown_connections 2024-09-13T23:07:20.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.029+0000 7f4f6760e800 1 -- 172.21.15.164:0/4037883519 wait complete. 2024-09-13T23:07:20.040 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:07:18.801026Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:07:18.801015Z', 'tags': [], 'group_ids': []} 2024-09-13T23:07:20.040 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:07:18.801026Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:07:18.801015Z', 'tags': [], 'group_ids': []} 2024-09-13T23:07:20.040 ERROR:root:0 2024-09-13T23:07:20.040 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:07:20.053 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:07:20.053 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T23:07:20.053 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T23:07:20.054 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-13T23:07:20.100 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:07:20.100 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:07:20.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.100+0000 7f8c20232800 1 Processor -- start 2024-09-13T23:07:20.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.100+0000 7f8c20232800 1 -- start start 2024-09-13T23:07:20.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.101+0000 7f8c20232800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5576670e0d20 0x5576670e3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.101+0000 7f8c20232800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557666f99b30 con 0x55766704de10 2024-09-13T23:07:20.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.101+0000 7f8c20232800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x557666f7b360 con 0x5576670e0d20 2024-09-13T23:07:20.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.101+0000 7f8c13fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5576670e0d20 0x5576670e3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.101+0000 7f8c1b473640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55766704de10 0x5576670df600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:37910/0 (socket says 172.21.15.164:37910) 2024-09-13T23:07:20.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.101+0000 7f8c1b473640 1 -- 172.21.15.164:0/639947926 learned_addr learned my addr 172.21.15.164:0/639947926 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:07:20.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.101+0000 7f8c13fff640 1 -- 172.21.15.164:0/639947926 >> v1:172.21.15.17:6789/0 conn(0x55766704de10 legacy=0x5576670df600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.101+0000 7f8c13fff640 1 -- 172.21.15.164:0/639947926 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557666fa1e00 con 0x5576670e0d20 2024-09-13T23:07:20.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.103+0000 7f8c13fff640 1 --2- 172.21.15.164:0/639947926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576670e0d20 0x5576670e3110 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f8c0400a470 tx=0x7f8c04045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eab87c4c4108610 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.103+0000 7f8c1ac72640 1 -- 172.21.15.164:0/639947926 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c04053570 con 0x5576670e0d20 2024-09-13T23:07:20.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.103+0000 7f8c1ac72640 1 -- 172.21.15.164:0/639947926 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c04058070 con 0x5576670e0d20 2024-09-13T23:07:20.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.103+0000 7f8c1ac72640 1 -- 172.21.15.164:0/639947926 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c04053880 con 0x5576670e0d20 2024-09-13T23:07:20.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.104+0000 7f8c20232800 1 -- 172.21.15.164:0/639947926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576670e0d20 msgr2=0x5576670e3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.104+0000 7f8c20232800 1 --2- 172.21.15.164:0/639947926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576670e0d20 0x5576670e3110 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f8c0400a470 tx=0x7f8c04045a20 comp rx=0 tx=0).stop 2024-09-13T23:07:20.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.104+0000 7f8c20232800 1 -- 172.21.15.164:0/639947926 shutdown_connections 2024-09-13T23:07:20.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.104+0000 7f8c20232800 1 --2- 172.21.15.164:0/639947926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576670e0d20 0x5576670e3110 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.104+0000 7f8c20232800 1 -- 172.21.15.164:0/639947926 >> 172.21.15.164:0/639947926 conn(0x5576670d4dd0 msgr2=0x5576670d71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.104+0000 7f8c20232800 1 -- 172.21.15.164:0/639947926 shutdown_connections 2024-09-13T23:07:20.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.104+0000 7f8c20232800 1 -- 172.21.15.164:0/639947926 wait complete. 2024-09-13T23:07:20.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.118+0000 7f8c20232800 1 Processor -- start 2024-09-13T23:07:20.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.118+0000 7f8c20232800 1 -- start start 2024-09-13T23:07:20.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.118+0000 7f8c20232800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55766704de10 0x5576671cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.118+0000 7f8c20232800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557667026360 con 0x55766704de10 2024-09-13T23:07:20.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.119+0000 7f8c1b473640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55766704de10 0x5576671cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.119+0000 7f8c1b473640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55766704de10 0x5576671cbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54808/0 (socket says 172.21.15.164:54808) 2024-09-13T23:07:20.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.119+0000 7f8c1b473640 1 -- 172.21.15.164:0/2271324652 learned_addr learned my addr 172.21.15.164:0/2271324652 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.119+0000 7f8c1b473640 1 -- 172.21.15.164:0/2271324652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557666f73bc0 con 0x55766704de10 2024-09-13T23:07:20.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.120+0000 7f8c1b473640 1 --2- 172.21.15.164:0/2271324652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55766704de10 0x5576671cbb00 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c001e10 tx=0x7f8c0c00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b4de8b7c2c2008 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.120+0000 7f8b0960a640 1 -- 172.21.15.164:0/2271324652 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c0c012020 con 0x55766704de10 2024-09-13T23:07:20.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.120+0000 7f8b0960a640 1 -- 172.21.15.164:0/2271324652 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c0c00e5a0 con 0x55766704de10 2024-09-13T23:07:20.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.120+0000 7f8b0960a640 1 -- 172.21.15.164:0/2271324652 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c0c00e8e0 con 0x55766704de10 2024-09-13T23:07:20.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.121+0000 7f8c20232800 1 -- 172.21.15.164:0/2271324652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55766704de10 msgr2=0x5576671cbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.121+0000 7f8c20232800 1 --2- 172.21.15.164:0/2271324652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55766704de10 0x5576671cbb00 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c001e10 tx=0x7f8c0c00b780 comp rx=0 tx=0).stop 2024-09-13T23:07:20.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.121+0000 7f8c20232800 1 -- 172.21.15.164:0/2271324652 shutdown_connections 2024-09-13T23:07:20.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.121+0000 7f8c20232800 1 --2- 172.21.15.164:0/2271324652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55766704de10 0x5576671cbb00 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.121+0000 7f8c20232800 1 -- 172.21.15.164:0/2271324652 >> 172.21.15.164:0/2271324652 conn(0x5576670d4dd0 msgr2=0x5576671c74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.121+0000 7f8c20232800 1 -- 172.21.15.164:0/2271324652 shutdown_connections 2024-09-13T23:07:20.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.121+0000 7f8c20232800 1 -- 172.21.15.164:0/2271324652 wait complete. 2024-09-13T23:07:20.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.121+0000 7f8c20232800 1 Processor -- start 2024-09-13T23:07:20.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.121+0000 7f8c20232800 1 -- start start 2024-09-13T23:07:20.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.121+0000 7f8c20232800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55766704de10 0x5576671d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.121+0000 7f8c20232800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5576670e3920 con 0x55766704de10 2024-09-13T23:07:20.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.121+0000 7f8c1b473640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55766704de10 0x5576671d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.121+0000 7f8c1b473640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55766704de10 0x5576671d34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54818/0 (socket says 172.21.15.164:54818) 2024-09-13T23:07:20.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.121+0000 7f8c1b473640 1 -- 172.21.15.164:0/4188344287 learned_addr learned my addr 172.21.15.164:0/4188344287 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.122+0000 7f8c1b473640 1 -- 172.21.15.164:0/4188344287 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557666f87fe0 con 0x55766704de10 2024-09-13T23:07:20.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.122+0000 7f8c1b473640 1 --2- 172.21.15.164:0/4188344287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55766704de10 0x5576671d34b0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c001e10 tx=0x7f8c0c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.122+0000 7f8b07e07640 1 -- 172.21.15.164:0/4188344287 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c0c012030 con 0x55766704de10 2024-09-13T23:07:20.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.122+0000 7f8b07e07640 1 -- 172.21.15.164:0/4188344287 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c0c01a7a0 con 0x55766704de10 2024-09-13T23:07:20.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.122+0000 7f8c20232800 1 -- 172.21.15.164:0/4188344287 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5576671d39f0 con 0x55766704de10 2024-09-13T23:07:20.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.122+0000 7f8b07e07640 1 -- 172.21.15.164:0/4188344287 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c0c01aac0 con 0x55766704de10 2024-09-13T23:07:20.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.122+0000 7f8c20232800 1 -- 172.21.15.164:0/4188344287 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576671d3f10 con 0x55766704de10 2024-09-13T23:07:20.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.123+0000 7f8b07e07640 1 -- 172.21.15.164:0/4188344287 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8c0c015020 con 0x55766704de10 2024-09-13T23:07:20.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.123+0000 7f8b07e07640 1 --2- 172.21.15.164:0/4188344287 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8b00036b90 0x7f8b00039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.123+0000 7f8b07e07640 1 -- 172.21.15.164:0/4188344287 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8c0c020030 con 0x55766704de10 2024-09-13T23:07:20.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.124+0000 7f8c13fff640 1 --2- 172.21.15.164:0/4188344287 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8b00036b90 0x7f8b00039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.124+0000 7f8c20232800 1 --2- 172.21.15.164:0/4188344287 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5576670e0d20 0x5576671da520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.124+0000 7f8c20232800 1 -- 172.21.15.164:0/4188344287 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5576671daa60 con 0x5576670e0d20 2024-09-13T23:07:20.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.124+0000 7f8c1bc74640 1 --2- 172.21.15.164:0/4188344287 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5576670e0d20 0x5576671da520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.124+0000 7f8c13fff640 1 --2- 172.21.15.164:0/4188344287 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8b00036b90 0x7f8b00039050 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8c04057000 tx=0x7f8c04052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.124+0000 7f8c1bc74640 1 --2- 172.21.15.164:0/4188344287 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5576670e0d20 0x5576671da520 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.124+0000 7f8c1bc74640 1 -- 172.21.15.164:0/4188344287 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c1400a4a0 con 0x5576670e0d20 2024-09-13T23:07:20.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.124+0000 7f8c20232800 1 -- 172.21.15.164:0/4188344287 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5576671d7af0 con 0x5576670e0d20 2024-09-13T23:07:20.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.125+0000 7f8c1bc74640 1 -- 172.21.15.164:0/4188344287 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8c1400a4a0 con 0x5576670e0d20 2024-09-13T23:07:20.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.125+0000 7f8c20232800 1 -- 172.21.15.164:0/4188344287 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5576671dc880 con 0x5576670e0d20 2024-09-13T23:07:20.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.125+0000 7f8c1bc74640 1 -- 172.21.15.164:0/4188344287 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8c1400a4a0 con 0x5576670e0d20 2024-09-13T23:07:20.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.125+0000 7f8c20232800 1 -- 172.21.15.164:0/4188344287 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5576671db9c0 con 0x5576670e0d20 2024-09-13T23:07:20.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.125+0000 7f8c1bc74640 1 -- 172.21.15.164:0/4188344287 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8c1400a4a0 con 0x5576670e0d20 2024-09-13T23:07:20.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.125+0000 7f8c20232800 1 -- 172.21.15.164:0/4188344287 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5576671dbe00 con 0x5576670e0d20 2024-09-13T23:07:20.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.125+0000 7f8c1bc74640 1 -- 172.21.15.164:0/4188344287 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8c1400a4a0 con 0x5576670e0d20 2024-09-13T23:07:20.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.126+0000 7f8c20232800 1 Processor -- start 2024-09-13T23:07:20.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.126+0000 7f8c20232800 1 -- start start 2024-09-13T23:07:20.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.126+0000 7f8c20232800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576671eaea0 0x5576671eb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.126+0000 7f8c20232800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557666f75580 con 0x5576671eaea0 2024-09-13T23:07:20.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.126+0000 7f8c13fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576671eaea0 0x5576671eb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.126+0000 7f8c13fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576671eaea0 0x5576671eb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54822/0 (socket says 172.21.15.164:54822) 2024-09-13T23:07:20.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.126+0000 7f8c13fff640 1 -- 172.21.15.164:0/2953000151 learned_addr learned my addr 172.21.15.164:0/2953000151 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.126+0000 7f8c13fff640 1 -- 172.21.15.164:0/2953000151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576671eb800 con 0x5576671eaea0 2024-09-13T23:07:20.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.127+0000 7f8c13fff640 1 --2- 172.21.15.164:0/2953000151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576671eaea0 0x5576671eb2c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f8c04025bf0 tx=0x7f8c04002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.127+0000 7f8b05602640 1 -- 172.21.15.164:0/2953000151 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c04070070 con 0x5576671eaea0 2024-09-13T23:07:20.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.127+0000 7f8b05602640 1 -- 172.21.15.164:0/2953000151 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c0406c450 con 0x5576671eaea0 2024-09-13T23:07:20.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.127+0000 7f8c20232800 1 -- 172.21.15.164:0/2953000151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5576671eba30 con 0x5576671eaea0 2024-09-13T23:07:20.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.127+0000 7f8b05602640 1 -- 172.21.15.164:0/2953000151 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c0406c770 con 0x5576671eaea0 2024-09-13T23:07:20.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.127+0000 7f8c20232800 1 -- 172.21.15.164:0/2953000151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576671ee6b0 con 0x5576671eaea0 2024-09-13T23:07:20.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.128+0000 7f8b05602640 1 -- 172.21.15.164:0/2953000151 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8c04073070 con 0x5576671eaea0 2024-09-13T23:07:20.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.128+0000 7f8b05602640 1 --2- 172.21.15.164:0/2953000151 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8af4036b40 0x7f8af4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.128+0000 7f8b05602640 1 -- 172.21.15.164:0/2953000151 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8c04092c60 con 0x5576671eaea0 2024-09-13T23:07:20.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.128+0000 7f8c1bc74640 1 --2- 172.21.15.164:0/2953000151 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8af4036b40 0x7f8af4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.128+0000 7f8c20232800 1 Processor -- start 2024-09-13T23:07:20.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.128+0000 7f8c1bc74640 1 --2- 172.21.15.164:0/2953000151 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8af4036b40 0x7f8af4039000 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x5576671db4e0 tx=0x7f8c14005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.128+0000 7f8c20232800 1 -- start start 2024-09-13T23:07:20.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.128+0000 7f8c20232800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576671f7ab0 0x5576671f7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.128+0000 7f8c20232800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5576671cc2b0 con 0x5576671f7ab0 2024-09-13T23:07:20.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.128+0000 7f8c13fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576671f7ab0 0x5576671f7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.129+0000 7f8c13fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576671f7ab0 0x5576671f7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54838/0 (socket says 172.21.15.164:54838) 2024-09-13T23:07:20.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.129+0000 7f8c13fff640 1 -- 172.21.15.164:0/2995567050 learned_addr learned my addr 172.21.15.164:0/2995567050 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.129+0000 7f8c13fff640 1 -- 172.21.15.164:0/2995567050 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576671f8480 con 0x5576671f7ab0 2024-09-13T23:07:20.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.129+0000 7f8c13fff640 1 --2- 172.21.15.164:0/2995567050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576671f7ab0 0x5576671f7eb0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f8c04090ef0 tx=0x7f8c04052af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe493c847b625f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.129+0000 7f8afeffd640 1 -- 172.21.15.164:0/2995567050 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c04083030 con 0x5576671f7ab0 2024-09-13T23:07:20.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.129+0000 7f8afeffd640 1 -- 172.21.15.164:0/2995567050 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c0405f8d0 con 0x5576671f7ab0 2024-09-13T23:07:20.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.129+0000 7f8afeffd640 1 -- 172.21.15.164:0/2995567050 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c040524f0 con 0x5576671f7ab0 2024-09-13T23:07:20.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.129+0000 7f8c20232800 1 -- 172.21.15.164:0/2995567050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576671f7ab0 msgr2=0x5576671f7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.129+0000 7f8c20232800 1 --2- 172.21.15.164:0/2995567050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576671f7ab0 0x5576671f7eb0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f8c04090ef0 tx=0x7f8c04052af0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.130+0000 7f8c20232800 1 -- 172.21.15.164:0/2995567050 shutdown_connections 2024-09-13T23:07:20.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.130+0000 7f8c20232800 1 --2- 172.21.15.164:0/2995567050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576671f7ab0 0x5576671f7eb0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.130+0000 7f8c20232800 1 -- 172.21.15.164:0/2995567050 >> 172.21.15.164:0/2995567050 conn(0x5576671f3e10 msgr2=0x5576671f1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.130+0000 7f8c20232800 1 -- 172.21.15.164:0/2995567050 shutdown_connections 2024-09-13T23:07:20.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.130+0000 7f8c20232800 1 -- 172.21.15.164:0/2995567050 wait complete. 2024-09-13T23:07:20.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.130+0000 7f8c20232800 1 Processor -- start 2024-09-13T23:07:20.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.130+0000 7f8c20232800 1 -- start start 2024-09-13T23:07:20.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.130+0000 7f8c20232800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576671f7ab0 0x5576671ff010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.130+0000 7f8c20232800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5576671f8af0 con 0x5576671f7ab0 2024-09-13T23:07:20.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.130+0000 7f8c13fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576671f7ab0 0x5576671ff010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.130+0000 7f8c13fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576671f7ab0 0x5576671ff010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54840/0 (socket says 172.21.15.164:54840) 2024-09-13T23:07:20.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.130+0000 7f8c13fff640 1 -- 172.21.15.164:0/3662016351 learned_addr learned my addr 172.21.15.164:0/3662016351 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.131+0000 7f8c13fff640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576671ff550 con 0x5576671f7ab0 2024-09-13T23:07:20.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.131+0000 7f8c13fff640 1 --2- 172.21.15.164:0/3662016351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576671f7ab0 0x5576671ff010 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f8c04083000 tx=0x7f8c04090e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.131+0000 7f8afd7fa640 1 -- 172.21.15.164:0/3662016351 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c04052e10 con 0x5576671f7ab0 2024-09-13T23:07:20.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.131+0000 7f8afd7fa640 1 -- 172.21.15.164:0/3662016351 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c0406b3b0 con 0x5576671f7ab0 2024-09-13T23:07:20.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.131+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5576671ff7e0 con 0x5576671f7ab0 2024-09-13T23:07:20.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.131+0000 7f8afd7fa640 1 -- 172.21.15.164:0/3662016351 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c0406b690 con 0x5576671f7ab0 2024-09-13T23:07:20.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.131+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557667202490 con 0x5576671f7ab0 2024-09-13T23:07:20.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.132+0000 7f8afd7fa640 1 -- 172.21.15.164:0/3662016351 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8c04069050 con 0x5576671f7ab0 2024-09-13T23:07:20.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.132+0000 7f8afd7fa640 1 --2- 172.21.15.164:0/3662016351 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8ae4036b40 0x7f8ae4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.132+0000 7f8afd7fa640 1 -- 172.21.15.164:0/3662016351 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8c04098070 con 0x5576671f7ab0 2024-09-13T23:07:20.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.132+0000 7f8c1bc74640 1 --2- 172.21.15.164:0/3662016351 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8ae4036b40 0x7f8ae4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.133+0000 7f8c1bc74640 1 --2- 172.21.15.164:0/3662016351 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8ae4036b40 0x7f8ae4039000 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x5576671d42d0 tx=0x7f8c1401f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.133+0000 7f8c20232800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.133+0000 7f8c20232800 1 --2- 172.21.15.164:0/3662016351 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55766720aaf0 0x55766720cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.133+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766720d700 con 0x55766720aaf0 2024-09-13T23:07:20.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.133+0000 7f8c1b473640 1 --2- 172.21.15.164:0/3662016351 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55766720aaf0 0x55766720cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.134+0000 7f8c1b473640 1 --2- 172.21.15.164:0/3662016351 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55766720aaf0 0x55766720cfb0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.134+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c0c018950 con 0x55766720aaf0 2024-09-13T23:07:20.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.134+0000 7f8c20232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.134+0000 7f8c20232800 20 realm 2024-09-13T23:07:20.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.134+0000 7f8c20232800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.134+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766720db10 con 0x55766720aaf0 2024-09-13T23:07:20.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.134+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c0c018950 con 0x55766720aaf0 2024-09-13T23:07:20.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.134+0000 7f8c20232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.134+0000 7f8c20232800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:07:20.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.134+0000 7f8c20232800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.134+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766720e3e0 con 0x55766720aaf0 2024-09-13T23:07:20.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.135+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c0c018950 con 0x55766720aaf0 2024-09-13T23:07:20.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.135+0000 7f8c20232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.135+0000 7f8c20232800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.135+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766720e780 con 0x55766720aaf0 2024-09-13T23:07:20.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.135+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8c0c018950 con 0x55766720aaf0 2024-09-13T23:07:20.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.135+0000 7f8c20232800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:20.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.135+0000 7f8c20232800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.135+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766720efd0 con 0x55766720aaf0 2024-09-13T23:07:20.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.135+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8c0c018950 con 0x55766720aaf0 2024-09-13T23:07:20.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.135+0000 7f8c20232800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:07:20.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.135+0000 7f8c20232800 20 searching for the correct realm 2024-09-13T23:07:20.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.136+0000 7f8c20232800 1 --2- 172.21.15.164:0/3662016351 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x557667210d40 0x557667213130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.136+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x557667210d40 2024-09-13T23:07:20.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.136+0000 7f8c13fff640 1 --2- 172.21.15.164:0/3662016351 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x557667210d40 0x557667213130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.136+0000 7f8c13fff640 1 --2- 172.21.15.164:0/3662016351 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x557667210d40 0x557667213130 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.137+0000 7f8c13fff640 1 -- 172.21.15.164:0/3662016351 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c040ae040 con 0x557667210d40 2024-09-13T23:07:20.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.137+0000 7f8c13fff640 1 --2- 172.21.15.164:0/3662016351 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f8c04075070 0x7f8c0407f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.137+0000 7f8c13fff640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x7f8c04075070 2024-09-13T23:07:20.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.137+0000 7f8c1bc74640 1 --2- 172.21.15.164:0/3662016351 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f8c04075070 0x7f8c0407f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.137+0000 7f8c1bc74640 1 --2- 172.21.15.164:0/3662016351 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f8c04075070 0x7f8c0407f450 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.137+0000 7f8c1bc74640 1 -- 172.21.15.164:0/3662016351 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1401f070 con 0x7f8c04075070 2024-09-13T23:07:20.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.137+0000 7f8c1bc74640 1 --2- 172.21.15.164:0/3662016351 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f8c14031040 0x7f8c14032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.137+0000 7f8c1bc74640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x7f8c14031040 2024-09-13T23:07:20.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.137+0000 7f8c1b473640 1 --2- 172.21.15.164:0/3662016351 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f8c14031040 0x7f8c14032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.138+0000 7f8c1b473640 1 --2- 172.21.15.164:0/3662016351 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f8c14031040 0x7f8c14032940 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.138+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0c018950 con 0x7f8c14031040 2024-09-13T23:07:20.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.138+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x55766720aaf0 2024-09-13T23:07:20.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.138+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8c0c018950 con 0x55766720aaf0 2024-09-13T23:07:20.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.138+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x55766720aaf0 2024-09-13T23:07:20.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.139+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0c018950 con 0x55766720aaf0 2024-09-13T23:07:20.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.139+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x7f8c14031040 2024-09-13T23:07:20.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.139+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0c018950 con 0x7f8c14031040 2024-09-13T23:07:20.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.139+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x7f8c14031040 2024-09-13T23:07:20.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.139+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0c018950 con 0x7f8c14031040 2024-09-13T23:07:20.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.139+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x7f8c04075070 2024-09-13T23:07:20.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.139+0000 7f8c1bc74640 1 -- 172.21.15.164:0/3662016351 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1401f070 con 0x7f8c04075070 2024-09-13T23:07:20.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.139+0000 7f8c1bc74640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x557667210d40 2024-09-13T23:07:20.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.140+0000 7f8c13fff640 1 -- 172.21.15.164:0/3662016351 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c040ae040 con 0x557667210d40 2024-09-13T23:07:20.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.140+0000 7f8c13fff640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x55766720aaf0 2024-09-13T23:07:20.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.140+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0c018950 con 0x55766720aaf0 2024-09-13T23:07:20.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.140+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x7f8c14031040 2024-09-13T23:07:20.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.141+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0c018950 con 0x7f8c14031040 2024-09-13T23:07:20.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.141+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x55766720aaf0 2024-09-13T23:07:20.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.141+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0c018950 con 0x55766720aaf0 2024-09-13T23:07:20.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.141+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x7f8c04075070 2024-09-13T23:07:20.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.142+0000 7f8c1bc74640 1 -- 172.21.15.164:0/3662016351 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8c1401f070 con 0x7f8c04075070 2024-09-13T23:07:20.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.142+0000 7f8c1bc74640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x557667210d40 2024-09-13T23:07:20.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.142+0000 7f8c13fff640 1 -- 172.21.15.164:0/3662016351 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c040ae040 con 0x557667210d40 2024-09-13T23:07:20.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.142+0000 7f8c13fff640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x557667210d40 2024-09-13T23:07:20.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.142+0000 7f8c13fff640 1 -- 172.21.15.164:0/3662016351 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c040ae040 con 0x557667210d40 2024-09-13T23:07:20.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.142+0000 7f8c13fff640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x7f8c14031040 2024-09-13T23:07:20.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.143+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0c018950 con 0x7f8c14031040 2024-09-13T23:07:20.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.143+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x557667210d40 2024-09-13T23:07:20.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.143+0000 7f8c13fff640 1 -- 172.21.15.164:0/3662016351 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c040ae040 con 0x557667210d40 2024-09-13T23:07:20.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.143+0000 7f8c13fff640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x557667210d40 2024-09-13T23:07:20.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.144+0000 7f8c13fff640 1 -- 172.21.15.164:0/3662016351 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c040ae040 con 0x557667210d40 2024-09-13T23:07:20.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.144+0000 7f8c13fff640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x55766720aaf0 2024-09-13T23:07:20.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.144+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0c018950 con 0x55766720aaf0 2024-09-13T23:07:20.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.144+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x55766720aaf0 2024-09-13T23:07:20.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.144+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8c0c018950 con 0x55766720aaf0 2024-09-13T23:07:20.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.144+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x7f8c14031040 2024-09-13T23:07:20.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.145+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0c018950 con 0x7f8c14031040 2024-09-13T23:07:20.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.145+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x557667210d40 2024-09-13T23:07:20.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.145+0000 7f8c13fff640 1 -- 172.21.15.164:0/3662016351 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c040ae040 con 0x557667210d40 2024-09-13T23:07:20.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.145+0000 7f8c13fff640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x7f8c04075070 2024-09-13T23:07:20.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.146+0000 7f8c1bc74640 1 -- 172.21.15.164:0/3662016351 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1401f070 con 0x7f8c04075070 2024-09-13T23:07:20.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.146+0000 7f8c1bc74640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x55766720aaf0 2024-09-13T23:07:20.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.146+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8c0c018950 con 0x55766720aaf0 2024-09-13T23:07:20.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.146+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x7f8c14031040 2024-09-13T23:07:20.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.146+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0c018950 con 0x7f8c14031040 2024-09-13T23:07:20.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.146+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x557667210d40 2024-09-13T23:07:20.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.146+0000 7f8c13fff640 1 -- 172.21.15.164:0/3662016351 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c040ae040 con 0x557667210d40 2024-09-13T23:07:20.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.146+0000 7f8c13fff640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x7f8c14031040 2024-09-13T23:07:20.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.147+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0c018950 con 0x7f8c14031040 2024-09-13T23:07:20.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.147+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x7f8c04075070 2024-09-13T23:07:20.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.147+0000 7f8c1bc74640 1 -- 172.21.15.164:0/3662016351 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1401f070 con 0x7f8c04075070 2024-09-13T23:07:20.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.147+0000 7f8c1bc74640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x557667210d40 2024-09-13T23:07:20.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.147+0000 7f8c13fff640 1 -- 172.21.15.164:0/3662016351 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c040ae040 con 0x557667210d40 2024-09-13T23:07:20.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.147+0000 7f8c13fff640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x7f8c04075070 2024-09-13T23:07:20.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.147+0000 7f8c1bc74640 1 -- 172.21.15.164:0/3662016351 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1401f070 con 0x7f8c04075070 2024-09-13T23:07:20.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.147+0000 7f8c1bc74640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x55766720aaf0 2024-09-13T23:07:20.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.148+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8c0c018950 con 0x55766720aaf0 2024-09-13T23:07:20.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.148+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557667213740 con 0x7f8c04075070 2024-09-13T23:07:20.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.148+0000 7f8c1bc74640 1 -- 172.21.15.164:0/3662016351 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c14040040 con 0x7f8c04075070 2024-09-13T23:07:20.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.148+0000 7f8c20232800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:07:20.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.148+0000 7f8c20232800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:07:20.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.148+0000 7f8c20232800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:07:20.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.148+0000 7f8c20232800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:07:20.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.148+0000 7f8c20232800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:07:20.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.148+0000 7f8c20232800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:07:20.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.148+0000 7f8c20232800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.148+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766720f950 con 0x55766720aaf0 2024-09-13T23:07:20.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.148+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c0c018950 con 0x55766720aaf0 2024-09-13T23:07:20.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.149+0000 7f8c20232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.149+0000 7f8c20232800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.149+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5576672101f0 con 0x55766720aaf0 2024-09-13T23:07:20.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.149+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8c0c018950 con 0x55766720aaf0 2024-09-13T23:07:20.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.149+0000 7f8c20232800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:20.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.149+0000 7f8c20232800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.149+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557667213ba0 con 0x55766720aaf0 2024-09-13T23:07:20.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.149+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8c0c018950 con 0x55766720aaf0 2024-09-13T23:07:20.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.149+0000 7f8c20232800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:07:20.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.149+0000 7f8c20232800 20 zone default found 2024-09-13T23:07:20.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.149+0000 7f8c20232800 4 Realm: () 2024-09-13T23:07:20.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.149+0000 7f8c20232800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:07:20.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.149+0000 7f8c20232800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:07:20.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.149+0000 7f8c20232800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:07:20.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.149+0000 7f8c20232800 20 zonegroup default 2024-09-13T23:07:20.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.149+0000 7f8c20232800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.149+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766720fe50 con 0x7f8c14031040 2024-09-13T23:07:20.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.150+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8c0c018950 con 0x7f8c14031040 2024-09-13T23:07:20.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.150+0000 7f8c20232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.150+0000 7f8c20232800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.150+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557667215a80 con 0x557667210d40 2024-09-13T23:07:20.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.150+0000 7f8c13fff640 1 -- 172.21.15.164:0/3662016351 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8c040ae040 con 0x557667210d40 2024-09-13T23:07:20.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.150+0000 7f8c20232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.150+0000 7f8c20232800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.150+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557667215e40 con 0x557667210d40 2024-09-13T23:07:20.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.150+0000 7f8c13fff640 1 -- 172.21.15.164:0/3662016351 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8c040ae040 con 0x557667210d40 2024-09-13T23:07:20.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.150+0000 7f8c20232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.150+0000 7f8c20232800 20 started sync module instance, tier type = 2024-09-13T23:07:20.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.150+0000 7f8c20232800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:07:20.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.150+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557667214f20 con 0x7f8c04075070 2024-09-13T23:07:20.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.152+0000 7f8c1bc74640 1 -- 172.21.15.164:0/3662016351 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c14040040 con 0x7f8c04075070 2024-09-13T23:07:20.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.152+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93967024739136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557667214b80 con 0x7f8c04075070 2024-09-13T23:07:20.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.152+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557667216d70 con 0x55766720aaf0 2024-09-13T23:07:20.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.153+0000 7f8c1bc74640 1 -- 172.21.15.164:0/3662016351 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93967024739136] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c14040040 con 0x7f8c04075070 2024-09-13T23:07:20.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.153+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c018950 con 0x55766720aaf0 2024-09-13T23:07:20.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.153+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93967024743072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557667216d70 con 0x55766720aaf0 2024-09-13T23:07:20.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.153+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557667217770 con 0x557667210d40 2024-09-13T23:07:20.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.154+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93967024743072] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c018950 con 0x55766720aaf0 2024-09-13T23:07:20.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.155+0000 7f8c13fff640 1 -- 172.21.15.164:0/3662016351 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c040ae040 con 0x557667210d40 2024-09-13T23:07:20.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.155+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93967024744640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557667216ce0 con 0x557667210d40 2024-09-13T23:07:20.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.155+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557667218660 con 0x7f8c04075070 2024-09-13T23:07:20.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.156+0000 7f8c1bc74640 1 -- 172.21.15.164:0/3662016351 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c14040040 con 0x7f8c04075070 2024-09-13T23:07:20.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.156+0000 7f8c13fff640 1 -- 172.21.15.164:0/3662016351 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93967024744640] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c040ae040 con 0x557667210d40 2024-09-13T23:07:20.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.156+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93967024751504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557667218e20 con 0x7f8c04075070 2024-09-13T23:07:20.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.156+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557667219720 con 0x55766720aaf0 2024-09-13T23:07:20.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.157+0000 7f8c1bc74640 1 -- 172.21.15.164:0/3662016351 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93967024751504] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c14040040 con 0x7f8c04075070 2024-09-13T23:07:20.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.157+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c018950 con 0x55766720aaf0 2024-09-13T23:07:20.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.157+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93967024752752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557667218de0 con 0x55766720aaf0 2024-09-13T23:07:20.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.157+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557667219e00 con 0x7f8c14031040 2024-09-13T23:07:20.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.158+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93967024752752] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c018950 con 0x55766720aaf0 2024-09-13T23:07:20.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.158+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c018950 con 0x7f8c14031040 2024-09-13T23:07:20.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.158+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93967024757008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557667219e00 con 0x7f8c14031040 2024-09-13T23:07:20.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.158+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766721a800 con 0x7f8c14031040 2024-09-13T23:07:20.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.159+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93967024757008] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c018950 con 0x7f8c14031040 2024-09-13T23:07:20.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.159+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c018950 con 0x7f8c14031040 2024-09-13T23:07:20.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.159+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93967024755264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766721a7c0 con 0x7f8c14031040 2024-09-13T23:07:20.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.159+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766721a7c0 con 0x7f8c14031040 2024-09-13T23:07:20.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.160+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93967024755264] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c018950 con 0x7f8c14031040 2024-09-13T23:07:20.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.160+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c018950 con 0x7f8c14031040 2024-09-13T23:07:20.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.160+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93967024760048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766721b210 con 0x7f8c14031040 2024-09-13T23:07:20.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.161+0000 7f8c20232800 20 add_watcher() i=0 2024-09-13T23:07:20.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.161+0000 7f8c20232800 20 add_watcher() i=1 2024-09-13T23:07:20.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.161+0000 7f8c20232800 20 add_watcher() i=2 2024-09-13T23:07:20.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.161+0000 7f8c20232800 20 add_watcher() i=3 2024-09-13T23:07:20.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.161+0000 7f8c20232800 20 add_watcher() i=4 2024-09-13T23:07:20.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.161+0000 7f8c20232800 20 add_watcher() i=5 2024-09-13T23:07:20.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.161+0000 7f8c20232800 20 add_watcher() i=6 2024-09-13T23:07:20.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.161+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93967024760048] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c018950 con 0x7f8c14031040 2024-09-13T23:07:20.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.161+0000 7f8c20232800 20 add_watcher() i=7 2024-09-13T23:07:20.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.161+0000 7f8c20232800 2 all 8 watchers are set, enabling cache 2024-09-13T23:07:20.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.162+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766721e5a0 con 0x55766720aaf0 2024-09-13T23:07:20.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.162+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8c0c018950 con 0x55766720aaf0 2024-09-13T23:07:20.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.162+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93967024775024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766721b380 con 0x55766720aaf0 2024-09-13T23:07:20.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.163+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93967024775024] v34'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8c0c018950 con 0x55766720aaf0 2024-09-13T23:07:20.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.163+0000 7f8ad1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:20.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.163+0000 7f8c20232800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:07:20.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.163+0000 7f8c20232800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:07:20.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.163+0000 7f8c20232800 5 note: GC not initialized 2024-09-13T23:07:20.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.163+0000 7f8ad0fe1640 20 reqs_thread_entry: start 2024-09-13T23:07:20.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.163+0000 7f8c20232800 20 init_complete bucket index max shards: 11 2024-09-13T23:07:20.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.164+0000 7f8c20232800 20 Filter name: none 2024-09-13T23:07:20.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.164+0000 7f8a4a7fc640 20 reqs_thread_entry: start 2024-09-13T23:07:20.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.164+0000 7f8c20232800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T23:07:20.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.164+0000 7f8c20232800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.164+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5576672519f0 con 0x7f8c14031040 2024-09-13T23:07:20.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.165+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f8c0c018950 con 0x7f8c14031040 2024-09-13T23:07:20.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.165+0000 7f8c20232800 20 rados_obj.operate() r=0 bl.length=490 2024-09-13T23:07:20.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.165+0000 7f8c20232800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T23:07:20.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.165+0000 7f8c20232800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:20.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.165+0000 7f8c20232800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:07:20.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.165+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557667258160 con 0x7f8c14031040 2024-09-13T23:07:20.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.166+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v34'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8c0c018950 con 0x7f8c14031040 2024-09-13T23:07:20.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.166+0000 7f8c20232800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:07:20.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.166+0000 7f8c20232800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:20.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.166+0000 7f8c20232800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T23:07:20.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.166+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93967025011488 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557667253780 con 0x55766720aaf0 2024-09-13T23:07:20.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.166+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== watch-notify(notify (1) cookie 93967024752752 notify 146028888094 ret 0) ==== 721+0+0 (crc 0 0 0) 0x5576671d3f10 con 0x55766720aaf0 2024-09-13T23:07:20.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.166+0000 7f8afeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888094 cookie 93967024752752 notifier 4896 bl.length()=679 2024-09-13T23:07:20.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.166+0000 7f8afeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:07:20.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.166+0000 7f8afeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:20.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.166+0000 7f8afeffd640 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f8ae0003ea0 con 0x55766720aaf0 2024-09-13T23:07:20.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.166+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(64 notify.4 [notify cookie 93967025011488 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8c0c018950 con 0x55766720aaf0 2024-09-13T23:07:20.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.167+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c018950 con 0x55766720aaf0 2024-09-13T23:07:20.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.167+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== watch-notify(notify_complete (2) cookie 93967025011488 notify 146028888094 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5576671d39f0 con 0x55766720aaf0 2024-09-13T23:07:20.174 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T23:07:18.801026Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:07:18.801015Z","tags":[],"group_ids":[]} 2024-09-13T23:07:20.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.168+0000 7f8ad1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:20.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.168+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93967024775024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766724f750 con 0x55766720aaf0 2024-09-13T23:07:20.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.168+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93967024775024] v34'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8c0c018950 con 0x55766720aaf0 2024-09-13T23:07:20.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.168+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93967024739136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766724f750 con 0x7f8c04075070 2024-09-13T23:07:20.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.170+0000 7f8c1bc74640 1 -- 172.21.15.164:0/3662016351 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93967024739136] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c14040040 con 0x7f8c04075070 2024-09-13T23:07:20.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.170+0000 7f8c20232800 20 remove_watcher() i=0 2024-09-13T23:07:20.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.170+0000 7f8c20232800 2 removed watcher, disabling cache 2024-09-13T23:07:20.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.170+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93967024743072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766724f750 con 0x55766720aaf0 2024-09-13T23:07:20.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.171+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93967024743072] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c018950 con 0x55766720aaf0 2024-09-13T23:07:20.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.171+0000 7f8c20232800 20 remove_watcher() i=1 2024-09-13T23:07:20.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.171+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93967024744640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766724f750 con 0x557667210d40 2024-09-13T23:07:20.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.172+0000 7f8c13fff640 1 -- 172.21.15.164:0/3662016351 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93967024744640] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c040ae040 con 0x557667210d40 2024-09-13T23:07:20.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.172+0000 7f8c20232800 20 remove_watcher() i=2 2024-09-13T23:07:20.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.172+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93967024751504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576672168c0 con 0x7f8c04075070 2024-09-13T23:07:20.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.173+0000 7f8c1bc74640 1 -- 172.21.15.164:0/3662016351 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93967024751504] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c14040040 con 0x7f8c04075070 2024-09-13T23:07:20.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.173+0000 7f8c20232800 20 remove_watcher() i=3 2024-09-13T23:07:20.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.173+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93967024752752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557667218390 con 0x55766720aaf0 2024-09-13T23:07:20.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.174+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93967024752752] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c018950 con 0x55766720aaf0 2024-09-13T23:07:20.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.174+0000 7f8c20232800 20 remove_watcher() i=4 2024-09-13T23:07:20.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.174+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93967024757008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576672168c0 con 0x7f8c14031040 2024-09-13T23:07:20.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.175+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93967024757008] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c018950 con 0x7f8c14031040 2024-09-13T23:07:20.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.175+0000 7f8c20232800 20 remove_watcher() i=5 2024-09-13T23:07:20.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.175+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93967024755264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557667218390 con 0x7f8c14031040 2024-09-13T23:07:20.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.176+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93967024755264] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c018950 con 0x7f8c14031040 2024-09-13T23:07:20.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.176+0000 7f8c20232800 20 remove_watcher() i=6 2024-09-13T23:07:20.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.176+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93967024760048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5576672168c0 con 0x7f8c14031040 2024-09-13T23:07:20.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.177+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93967024760048] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c018950 con 0x7f8c14031040 2024-09-13T23:07:20.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.177+0000 7f8c20232800 20 remove_watcher() i=7 2024-09-13T23:07:20.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.177+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f8c14031040 msgr2=0x7f8c14032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.177+0000 7f8c20232800 1 --2- 172.21.15.164:0/3662016351 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f8c14031040 0x7f8c14032940 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.177+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55766720aaf0 msgr2=0x55766720cfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.177+0000 7f8c20232800 1 --2- 172.21.15.164:0/3662016351 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55766720aaf0 0x55766720cfb0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.177+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f8c04075070 msgr2=0x7f8c0407f450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.177+0000 7f8c20232800 1 --2- 172.21.15.164:0/3662016351 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f8c04075070 0x7f8c0407f450 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.177+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x557667210d40 msgr2=0x557667213130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.177+0000 7f8c20232800 1 --2- 172.21.15.164:0/3662016351 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x557667210d40 0x557667213130 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.177+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8ae4036b40 msgr2=0x7f8ae4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.177+0000 7f8c20232800 1 --2- 172.21.15.164:0/3662016351 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8ae4036b40 0x7f8ae4039000 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x5576671d42d0 tx=0x7f8c1401f000 comp rx=0 tx=0).stop 2024-09-13T23:07:20.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.177+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576671f7ab0 msgr2=0x5576671ff010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.177+0000 7f8c20232800 1 --2- 172.21.15.164:0/3662016351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576671f7ab0 0x5576671ff010 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f8c04083000 tx=0x7f8c04090e80 comp rx=0 tx=0).stop 2024-09-13T23:07:20.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.177+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 reap_dead start 2024-09-13T23:07:20.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.177+0000 7f8c1b473640 1 -- 172.21.15.164:0/3662016351 reap_dead start 2024-09-13T23:07:20.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.177+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 shutdown_connections 2024-09-13T23:07:20.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.177+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 >> 172.21.15.164:0/3662016351 conn(0x5576671f3e10 msgr2=0x5576671f1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.178+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 shutdown_connections 2024-09-13T23:07:20.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.178+0000 7f8c20232800 1 -- 172.21.15.164:0/3662016351 wait complete. 2024-09-13T23:07:20.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.178+0000 7f8c20232800 1 -- 172.21.15.164:0/2953000151 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8af4036b40 msgr2=0x7f8af4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.178+0000 7f8c20232800 1 --2- 172.21.15.164:0/2953000151 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8af4036b40 0x7f8af4039000 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x5576671db4e0 tx=0x7f8c14005840 comp rx=0 tx=0).stop 2024-09-13T23:07:20.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.178+0000 7f8c20232800 1 -- 172.21.15.164:0/2953000151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576671eaea0 msgr2=0x5576671eb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.178+0000 7f8c20232800 1 --2- 172.21.15.164:0/2953000151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576671eaea0 0x5576671eb2c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f8c04025bf0 tx=0x7f8c04002fb0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.178+0000 7f8c20232800 1 -- 172.21.15.164:0/2953000151 shutdown_connections 2024-09-13T23:07:20.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.178+0000 7f8c20232800 1 --2- 172.21.15.164:0/2953000151 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8af4036b40 0x7f8af4039000 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.178+0000 7f8c20232800 1 --2- 172.21.15.164:0/2953000151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576671eaea0 0x5576671eb2c0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.178+0000 7f8c20232800 1 -- 172.21.15.164:0/2953000151 >> 172.21.15.164:0/2953000151 conn(0x5576671dfe30 msgr2=0x5576671e29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.178+0000 7f8c20232800 1 -- 172.21.15.164:0/2953000151 shutdown_connections 2024-09-13T23:07:20.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.178+0000 7f8c20232800 1 -- 172.21.15.164:0/2953000151 wait complete. 2024-09-13T23:07:20.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.178+0000 7f8c20232800 1 -- 172.21.15.164:0/4188344287 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5576670e0d20 msgr2=0x5576671da520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.178+0000 7f8c20232800 1 --2- 172.21.15.164:0/4188344287 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5576670e0d20 0x5576671da520 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.178+0000 7f8c20232800 1 -- 172.21.15.164:0/4188344287 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8b00036b90 msgr2=0x7f8b00039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.178+0000 7f8c20232800 1 --2- 172.21.15.164:0/4188344287 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8b00036b90 0x7f8b00039050 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8c04057000 tx=0x7f8c04052000 comp rx=0 tx=0).stop 2024-09-13T23:07:20.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.178+0000 7f8c20232800 1 -- 172.21.15.164:0/4188344287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55766704de10 msgr2=0x5576671d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.178+0000 7f8c20232800 1 --2- 172.21.15.164:0/4188344287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55766704de10 0x5576671d34b0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c001e10 tx=0x7f8c0c000ed0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.178+0000 7f8c20232800 1 -- 172.21.15.164:0/4188344287 shutdown_connections 2024-09-13T23:07:20.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.178+0000 7f8c20232800 1 --2- 172.21.15.164:0/4188344287 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5576670e0d20 0x5576671da520 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.178+0000 7f8c20232800 1 --2- 172.21.15.164:0/4188344287 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f8b00036b90 0x7f8b00039050 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.178+0000 7f8c20232800 1 --2- 172.21.15.164:0/4188344287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55766704de10 0x5576671d34b0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.178+0000 7f8c20232800 1 -- 172.21.15.164:0/4188344287 >> 172.21.15.164:0/4188344287 conn(0x5576670d4dd0 msgr2=0x5576671c5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.178+0000 7f8c20232800 1 -- 172.21.15.164:0/4188344287 shutdown_connections 2024-09-13T23:07:20.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.178+0000 7f8c20232800 1 -- 172.21.15.164:0/4188344287 wait complete. 2024-09-13T23:07:20.187 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:07:18.801026Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:07:18.801015Z', 'tags': [], 'group_ids': []} 2024-09-13T23:07:20.188 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:07:18.801026Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:07:18.801015Z', 'tags': [], 'group_ids': []} 2024-09-13T23:07:20.188 ERROR:root:0 2024-09-13T23:07:20.188 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:07:20.200 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:07:20.201 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-13T23:07:20.201 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-13T23:07:20.201 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-09-13T23:07:20.247 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:07:20.248 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:07:20.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.248+0000 7f612f40f800 1 Processor -- start 2024-09-13T23:07:20.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.248+0000 7f612f40f800 1 -- start start 2024-09-13T23:07:20.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.248+0000 7f612f40f800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55b4fd1f0d20 0x55b4fd1f3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.248+0000 7f612f40f800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b4fd0a9b30 con 0x55b4fd15e630 2024-09-13T23:07:20.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.248+0000 7f612f40f800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55b4fd08b360 con 0x55b4fd1f0d20 2024-09-13T23:07:20.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.248+0000 7f6127fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55b4fd1f0d20 0x55b4fd1f3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.248+0000 7f612cf03640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55b4fd15e630 0x55b4fd1ef600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:37926/0 (socket says 172.21.15.164:37926) 2024-09-13T23:07:20.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.248+0000 7f612cf03640 1 -- 172.21.15.164:0/2072272632 learned_addr learned my addr 172.21.15.164:0/2072272632 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:07:20.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.248+0000 7f6127fff640 1 -- 172.21.15.164:0/2072272632 >> v1:172.21.15.17:6789/0 conn(0x55b4fd15e630 legacy=0x55b4fd1ef600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.249+0000 7f61277fe640 1 -- 172.21.15.164:0/2072272632 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2402509571 0 0) 0x55b4fd0a9b30 con 0x55b4fd15e630 2024-09-13T23:07:20.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.249+0000 7f6127fff640 1 -- 172.21.15.164:0/2072272632 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4fd0b1e00 con 0x55b4fd1f0d20 2024-09-13T23:07:20.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.250+0000 7f6127fff640 1 --2- 172.21.15.164:0/2072272632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd1f0d20 0x55b4fd1f3110 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f611800a470 tx=0x7f6118045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3772093961e4e89 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.251+0000 7f61277fe640 1 -- 172.21.15.164:0/2072272632 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6118053570 con 0x55b4fd1f0d20 2024-09-13T23:07:20.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.251+0000 7f61277fe640 1 -- 172.21.15.164:0/2072272632 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6118058070 con 0x55b4fd1f0d20 2024-09-13T23:07:20.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.251+0000 7f61277fe640 1 -- 172.21.15.164:0/2072272632 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6118053880 con 0x55b4fd1f0d20 2024-09-13T23:07:20.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.251+0000 7f612f40f800 1 -- 172.21.15.164:0/2072272632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd1f0d20 msgr2=0x55b4fd1f3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.251+0000 7f612f40f800 1 --2- 172.21.15.164:0/2072272632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd1f0d20 0x55b4fd1f3110 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f611800a470 tx=0x7f6118045a20 comp rx=0 tx=0).stop 2024-09-13T23:07:20.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.251+0000 7f612f40f800 1 -- 172.21.15.164:0/2072272632 shutdown_connections 2024-09-13T23:07:20.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.251+0000 7f612f40f800 1 --2- 172.21.15.164:0/2072272632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd1f0d20 0x55b4fd1f3110 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.251+0000 7f612f40f800 1 -- 172.21.15.164:0/2072272632 >> 172.21.15.164:0/2072272632 conn(0x55b4fd1e4db0 msgr2=0x55b4fd1e71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.251+0000 7f612f40f800 1 -- 172.21.15.164:0/2072272632 shutdown_connections 2024-09-13T23:07:20.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.251+0000 7f612f40f800 1 -- 172.21.15.164:0/2072272632 wait complete. 2024-09-13T23:07:20.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.265+0000 7f612f40f800 1 Processor -- start 2024-09-13T23:07:20.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.265+0000 7f612f40f800 1 -- start start 2024-09-13T23:07:20.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.265+0000 7f612f40f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd15e630 0x55b4fd2db8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.265+0000 7f612f40f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b4fd136360 con 0x55b4fd15e630 2024-09-13T23:07:20.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.265+0000 7f612cf03640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd15e630 0x55b4fd2db8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.265+0000 7f612cf03640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd15e630 0x55b4fd2db8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54872/0 (socket says 172.21.15.164:54872) 2024-09-13T23:07:20.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.265+0000 7f612cf03640 1 -- 172.21.15.164:0/1839842567 learned_addr learned my addr 172.21.15.164:0/1839842567 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.266+0000 7f612cf03640 1 -- 172.21.15.164:0/1839842567 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4fd083bc0 con 0x55b4fd15e630 2024-09-13T23:07:20.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.266+0000 7f612cf03640 1 --2- 172.21.15.164:0/1839842567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd15e630 0x55b4fd2db8a0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f612000b240 tx=0x7f612000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626612e1ad2c86dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.266+0000 7f601ae05640 1 -- 172.21.15.164:0/1839842567 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6120008070 con 0x55b4fd15e630 2024-09-13T23:07:20.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.266+0000 7f601ae05640 1 -- 172.21.15.164:0/1839842567 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f612000d500 con 0x55b4fd15e630 2024-09-13T23:07:20.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.266+0000 7f601ae05640 1 -- 172.21.15.164:0/1839842567 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f612000d860 con 0x55b4fd15e630 2024-09-13T23:07:20.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.267+0000 7f612f40f800 1 -- 172.21.15.164:0/1839842567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd15e630 msgr2=0x55b4fd2db8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.267+0000 7f612f40f800 1 --2- 172.21.15.164:0/1839842567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd15e630 0x55b4fd2db8a0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f612000b240 tx=0x7f612000b700 comp rx=0 tx=0).stop 2024-09-13T23:07:20.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.267+0000 7f612f40f800 1 -- 172.21.15.164:0/1839842567 shutdown_connections 2024-09-13T23:07:20.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.267+0000 7f612f40f800 1 --2- 172.21.15.164:0/1839842567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd15e630 0x55b4fd2db8a0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.267+0000 7f612f40f800 1 -- 172.21.15.164:0/1839842567 >> 172.21.15.164:0/1839842567 conn(0x55b4fd1e4db0 msgr2=0x55b4fd2d7260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.267+0000 7f612f40f800 1 -- 172.21.15.164:0/1839842567 shutdown_connections 2024-09-13T23:07:20.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.267+0000 7f612f40f800 1 -- 172.21.15.164:0/1839842567 wait complete. 2024-09-13T23:07:20.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.267+0000 7f612f40f800 1 Processor -- start 2024-09-13T23:07:20.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.267+0000 7f612f40f800 1 -- start start 2024-09-13T23:07:20.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.267+0000 7f612f40f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd15e630 0x55b4fd2e3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.267+0000 7f612f40f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b4fd1f3920 con 0x55b4fd15e630 2024-09-13T23:07:20.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.268+0000 7f612cf03640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd15e630 0x55b4fd2e3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.268+0000 7f612cf03640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd15e630 0x55b4fd2e3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54882/0 (socket says 172.21.15.164:54882) 2024-09-13T23:07:20.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.268+0000 7f612cf03640 1 -- 172.21.15.164:0/2346211958 learned_addr learned my addr 172.21.15.164:0/2346211958 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.268+0000 7f612cf03640 1 -- 172.21.15.164:0/2346211958 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4fd097fe0 con 0x55b4fd15e630 2024-09-13T23:07:20.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.268+0000 7f612cf03640 1 --2- 172.21.15.164:0/2346211958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd15e630 0x55b4fd2e3330 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f6120000f60 tx=0x7f6120000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.268+0000 7f6019602640 1 -- 172.21.15.164:0/2346211958 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6120019870 con 0x55b4fd15e630 2024-09-13T23:07:20.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.268+0000 7f6019602640 1 -- 172.21.15.164:0/2346211958 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6120019a10 con 0x55b4fd15e630 2024-09-13T23:07:20.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.268+0000 7f6019602640 1 -- 172.21.15.164:0/2346211958 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6120019d10 con 0x55b4fd15e630 2024-09-13T23:07:20.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.268+0000 7f612f40f800 1 -- 172.21.15.164:0/2346211958 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4fd2e3870 con 0x55b4fd15e630 2024-09-13T23:07:20.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.268+0000 7f612f40f800 1 -- 172.21.15.164:0/2346211958 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4fd2e3d90 con 0x55b4fd15e630 2024-09-13T23:07:20.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.269+0000 7f6019602640 1 -- 172.21.15.164:0/2346211958 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6120017040 con 0x55b4fd15e630 2024-09-13T23:07:20.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.269+0000 7f6019602640 1 --2- 172.21.15.164:0/2346211958 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6014036b40 0x7f6014039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.269+0000 7f6019602640 1 -- 172.21.15.164:0/2346211958 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6120015020 con 0x55b4fd15e630 2024-09-13T23:07:20.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.269+0000 7f6127fff640 1 --2- 172.21.15.164:0/2346211958 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6014036b40 0x7f6014039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.269+0000 7f612f40f800 1 --2- 172.21.15.164:0/2346211958 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b4fd1f0d20 0x55b4fd2ea3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.269+0000 7f612f40f800 1 -- 172.21.15.164:0/2346211958 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd2ea8e0 con 0x55b4fd1f0d20 2024-09-13T23:07:20.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.269+0000 7f612d704640 1 --2- 172.21.15.164:0/2346211958 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b4fd1f0d20 0x55b4fd2ea3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.270+0000 7f6127fff640 1 --2- 172.21.15.164:0/2346211958 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6014036b40 0x7f6014039000 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6118057000 tx=0x7f6118052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.270+0000 7f612d704640 1 --2- 172.21.15.164:0/2346211958 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b4fd1f0d20 0x55b4fd2ea3a0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.270+0000 7f612d704640 1 -- 172.21.15.164:0/2346211958 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f612800a4a0 con 0x55b4fd1f0d20 2024-09-13T23:07:20.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.270+0000 7f612f40f800 1 -- 172.21.15.164:0/2346211958 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd2e7950 con 0x55b4fd1f0d20 2024-09-13T23:07:20.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.270+0000 7f612d704640 1 -- 172.21.15.164:0/2346211958 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f612800a4a0 con 0x55b4fd1f0d20 2024-09-13T23:07:20.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.270+0000 7f612f40f800 1 -- 172.21.15.164:0/2346211958 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd2ec6c0 con 0x55b4fd1f0d20 2024-09-13T23:07:20.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.271+0000 7f612d704640 1 -- 172.21.15.164:0/2346211958 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f612800a4a0 con 0x55b4fd1f0d20 2024-09-13T23:07:20.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.271+0000 7f612f40f800 1 -- 172.21.15.164:0/2346211958 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd2eb800 con 0x55b4fd1f0d20 2024-09-13T23:07:20.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.271+0000 7f612d704640 1 -- 172.21.15.164:0/2346211958 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f612800a4a0 con 0x55b4fd1f0d20 2024-09-13T23:07:20.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.271+0000 7f612f40f800 1 -- 172.21.15.164:0/2346211958 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd2ebc20 con 0x55b4fd1f0d20 2024-09-13T23:07:20.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.271+0000 7f612d704640 1 -- 172.21.15.164:0/2346211958 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f612800a4a0 con 0x55b4fd1f0d20 2024-09-13T23:07:20.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.271+0000 7f612f40f800 1 Processor -- start 2024-09-13T23:07:20.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.272+0000 7f612f40f800 1 -- start start 2024-09-13T23:07:20.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.272+0000 7f612f40f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd2facf0 0x55b4fd2fb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.272+0000 7f612f40f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b4fd085580 con 0x55b4fd2facf0 2024-09-13T23:07:20.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.272+0000 7f6127fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd2facf0 0x55b4fd2fb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.272+0000 7f6127fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd2facf0 0x55b4fd2fb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54898/0 (socket says 172.21.15.164:54898) 2024-09-13T23:07:20.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.272+0000 7f6127fff640 1 -- 172.21.15.164:0/548784819 learned_addr learned my addr 172.21.15.164:0/548784819 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.272+0000 7f6127fff640 1 -- 172.21.15.164:0/548784819 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4fd2fb670 con 0x55b4fd2facf0 2024-09-13T23:07:20.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.273+0000 7f6127fff640 1 --2- 172.21.15.164:0/548784819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd2facf0 0x55b4fd2fb130 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f6118025bf0 tx=0x7f6118002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.273+0000 7f6012ffd640 1 -- 172.21.15.164:0/548784819 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6118072560 con 0x55b4fd2facf0 2024-09-13T23:07:20.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.273+0000 7f6012ffd640 1 -- 172.21.15.164:0/548784819 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6118072700 con 0x55b4fd2facf0 2024-09-13T23:07:20.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.273+0000 7f612f40f800 1 -- 172.21.15.164:0/548784819 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4fd2fb900 con 0x55b4fd2facf0 2024-09-13T23:07:20.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.273+0000 7f6012ffd640 1 -- 172.21.15.164:0/548784819 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61180729e0 con 0x55b4fd2facf0 2024-09-13T23:07:20.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.273+0000 7f612f40f800 1 -- 172.21.15.164:0/548784819 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4fd2fe530 con 0x55b4fd2facf0 2024-09-13T23:07:20.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.274+0000 7f6012ffd640 1 -- 172.21.15.164:0/548784819 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f611807b440 con 0x55b4fd2facf0 2024-09-13T23:07:20.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.274+0000 7f6012ffd640 1 --2- 172.21.15.164:0/548784819 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6004036b40 0x7f6004039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.274+0000 7f6012ffd640 1 -- 172.21.15.164:0/548784819 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6118092f60 con 0x55b4fd2facf0 2024-09-13T23:07:20.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.274+0000 7f612d704640 1 --2- 172.21.15.164:0/548784819 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6004036b40 0x7f6004039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.274+0000 7f612f40f800 1 Processor -- start 2024-09-13T23:07:20.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.274+0000 7f612d704640 1 --2- 172.21.15.164:0/548784819 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6004036b40 0x7f6004039000 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x55b4fd2ebba0 tx=0x7f6128005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.274+0000 7f612f40f800 1 -- start start 2024-09-13T23:07:20.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.274+0000 7f612f40f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd3078f0 0x55b4fd307cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.274+0000 7f612f40f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b4fd2dc050 con 0x55b4fd3078f0 2024-09-13T23:07:20.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.275+0000 7f6127fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd3078f0 0x55b4fd307cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.275+0000 7f6127fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd3078f0 0x55b4fd307cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54904/0 (socket says 172.21.15.164:54904) 2024-09-13T23:07:20.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.275+0000 7f6127fff640 1 -- 172.21.15.164:0/854190577 learned_addr learned my addr 172.21.15.164:0/854190577 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.275+0000 7f6127fff640 1 -- 172.21.15.164:0/854190577 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4fd3082c0 con 0x55b4fd3078f0 2024-09-13T23:07:20.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.275+0000 7f6127fff640 1 --2- 172.21.15.164:0/854190577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd3078f0 0x55b4fd307cf0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f6118071cf0 tx=0x7f6118071d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c9d59872a522a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.275+0000 7f6010ff9640 1 -- 172.21.15.164:0/854190577 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6118088070 con 0x55b4fd3078f0 2024-09-13T23:07:20.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.275+0000 7f6010ff9640 1 -- 172.21.15.164:0/854190577 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f611807bc50 con 0x55b4fd3078f0 2024-09-13T23:07:20.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.275+0000 7f6010ff9640 1 -- 172.21.15.164:0/854190577 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61180713d0 con 0x55b4fd3078f0 2024-09-13T23:07:20.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.276+0000 7f612f40f800 1 -- 172.21.15.164:0/854190577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd3078f0 msgr2=0x55b4fd307cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.276+0000 7f612f40f800 1 --2- 172.21.15.164:0/854190577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd3078f0 0x55b4fd307cf0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f6118071cf0 tx=0x7f6118071d20 comp rx=0 tx=0).stop 2024-09-13T23:07:20.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.276+0000 7f612f40f800 1 -- 172.21.15.164:0/854190577 shutdown_connections 2024-09-13T23:07:20.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.276+0000 7f612f40f800 1 --2- 172.21.15.164:0/854190577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd3078f0 0x55b4fd307cf0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.276+0000 7f612f40f800 1 -- 172.21.15.164:0/854190577 >> 172.21.15.164:0/854190577 conn(0x55b4fd303c50 msgr2=0x55b4fd301d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.276+0000 7f612f40f800 1 -- 172.21.15.164:0/854190577 shutdown_connections 2024-09-13T23:07:20.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.276+0000 7f612f40f800 1 -- 172.21.15.164:0/854190577 wait complete. 2024-09-13T23:07:20.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.276+0000 7f612f40f800 1 Processor -- start 2024-09-13T23:07:20.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.276+0000 7f612f40f800 1 -- start start 2024-09-13T23:07:20.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.276+0000 7f612f40f800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd3078f0 0x55b4fd30ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.276+0000 7f612f40f800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b4fd308930 con 0x55b4fd3078f0 2024-09-13T23:07:20.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.276+0000 7f6127fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd3078f0 0x55b4fd30ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.276+0000 7f6127fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd3078f0 0x55b4fd30ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54912/0 (socket says 172.21.15.164:54912) 2024-09-13T23:07:20.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.276+0000 7f6127fff640 1 -- 172.21.15.164:0/798906284 learned_addr learned my addr 172.21.15.164:0/798906284 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.277+0000 7f6127fff640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4fd30f340 con 0x55b4fd3078f0 2024-09-13T23:07:20.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.277+0000 7f6127fff640 1 --2- 172.21.15.164:0/798906284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd3078f0 0x55b4fd30ee00 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f6118045f50 tx=0x7f61180911c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.277+0000 7f600a7fc640 1 -- 172.21.15.164:0/798906284 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f611809c020 con 0x55b4fd3078f0 2024-09-13T23:07:20.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.277+0000 7f600a7fc640 1 -- 172.21.15.164:0/798906284 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61180713d0 con 0x55b4fd3078f0 2024-09-13T23:07:20.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.277+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4fd30f5d0 con 0x55b4fd3078f0 2024-09-13T23:07:20.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.277+0000 7f600a7fc640 1 -- 172.21.15.164:0/798906284 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6118088040 con 0x55b4fd3078f0 2024-09-13T23:07:20.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.277+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4fd312280 con 0x55b4fd3078f0 2024-09-13T23:07:20.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.278+0000 7f600a7fc640 1 -- 172.21.15.164:0/798906284 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f611809f020 con 0x55b4fd3078f0 2024-09-13T23:07:20.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.278+0000 7f600a7fc640 1 --2- 172.21.15.164:0/798906284 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5ff4036af0 0x7f5ff4038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.278+0000 7f600a7fc640 1 -- 172.21.15.164:0/798906284 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f61180a2d20 con 0x55b4fd3078f0 2024-09-13T23:07:20.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.278+0000 7f612d704640 1 --2- 172.21.15.164:0/798906284 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5ff4036af0 0x7f5ff4038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.278+0000 7f612d704640 1 --2- 172.21.15.164:0/798906284 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5ff4036af0 0x7f5ff4038fb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x55b4fd2eb320 tx=0x7f612801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.279+0000 7f612f40f800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.279+0000 7f612f40f800 1 --2- 172.21.15.164:0/798906284 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b4fd31a920 0x55b4fd31cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.279+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd31d530 con 0x55b4fd31a920 2024-09-13T23:07:20.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.279+0000 7f612cf03640 1 --2- 172.21.15.164:0/798906284 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b4fd31a920 0x55b4fd31cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.279+0000 7f612cf03640 1 --2- 172.21.15.164:0/798906284 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b4fd31a920 0x55b4fd31cde0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.279+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f612002d070 con 0x55b4fd31a920 2024-09-13T23:07:20.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.279+0000 7f612f40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.279+0000 7f612f40f800 20 realm 2024-09-13T23:07:20.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.279+0000 7f612f40f800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.279+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd31d940 con 0x55b4fd31a920 2024-09-13T23:07:20.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.279+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f612002d070 con 0x55b4fd31a920 2024-09-13T23:07:20.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.279+0000 7f612f40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.279+0000 7f612f40f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:07:20.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.279+0000 7f612f40f800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.280+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd31e210 con 0x55b4fd31a920 2024-09-13T23:07:20.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.280+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f612002d070 con 0x55b4fd31a920 2024-09-13T23:07:20.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.280+0000 7f612f40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.280+0000 7f612f40f800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.280+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd31e5b0 con 0x55b4fd31a920 2024-09-13T23:07:20.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.280+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f612002d070 con 0x55b4fd31a920 2024-09-13T23:07:20.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.280+0000 7f612f40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:20.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.280+0000 7f612f40f800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.280+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd31ee00 con 0x55b4fd31a920 2024-09-13T23:07:20.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.280+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f612002d070 con 0x55b4fd31a920 2024-09-13T23:07:20.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.280+0000 7f612f40f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:07:20.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.280+0000 7f612f40f800 20 searching for the correct realm 2024-09-13T23:07:20.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.280+0000 7f612f40f800 1 --2- 172.21.15.164:0/798906284 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55b4fd320b70 0x55b4fd322f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.280+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x55b4fd320b70 2024-09-13T23:07:20.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.280+0000 7f6127fff640 1 --2- 172.21.15.164:0/798906284 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55b4fd320b70 0x55b4fd322f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.281+0000 7f6127fff640 1 --2- 172.21.15.164:0/798906284 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55b4fd320b70 0x55b4fd322f60 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.281+0000 7f6127fff640 1 -- 172.21.15.164:0/798906284 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6118081070 con 0x55b4fd320b70 2024-09-13T23:07:20.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.281+0000 7f6127fff640 1 --2- 172.21.15.164:0/798906284 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f61180ab040 0x7f61180527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.281+0000 7f6127fff640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x7f61180ab040 2024-09-13T23:07:20.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.281+0000 7f612d704640 1 --2- 172.21.15.164:0/798906284 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f61180ab040 0x7f61180527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.281+0000 7f612d704640 1 --2- 172.21.15.164:0/798906284 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f61180ab040 0x7f61180527e0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.281+0000 7f612d704640 1 -- 172.21.15.164:0/798906284 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f612801f070 con 0x7f61180ab040 2024-09-13T23:07:20.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.281+0000 7f612d704640 1 --2- 172.21.15.164:0/798906284 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f6128031040 0x7f6128032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.281+0000 7f612d704640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x7f6128031040 2024-09-13T23:07:20.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.282+0000 7f612cf03640 1 --2- 172.21.15.164:0/798906284 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f6128031040 0x7f6128032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.282+0000 7f612cf03640 1 --2- 172.21.15.164:0/798906284 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f6128031040 0x7f6128032940 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.282+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f612002d070 con 0x7f6128031040 2024-09-13T23:07:20.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.282+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x55b4fd31a920 2024-09-13T23:07:20.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.283+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f612002d070 con 0x55b4fd31a920 2024-09-13T23:07:20.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.283+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x55b4fd31a920 2024-09-13T23:07:20.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.283+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f612002d070 con 0x55b4fd31a920 2024-09-13T23:07:20.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.283+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x7f6128031040 2024-09-13T23:07:20.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.283+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f612002d070 con 0x7f6128031040 2024-09-13T23:07:20.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.283+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x7f6128031040 2024-09-13T23:07:20.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.283+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f612002d070 con 0x7f6128031040 2024-09-13T23:07:20.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.283+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x7f61180ab040 2024-09-13T23:07:20.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.284+0000 7f612d704640 1 -- 172.21.15.164:0/798906284 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f612801f070 con 0x7f61180ab040 2024-09-13T23:07:20.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.284+0000 7f612d704640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x55b4fd320b70 2024-09-13T23:07:20.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.284+0000 7f6127fff640 1 -- 172.21.15.164:0/798906284 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6118081070 con 0x55b4fd320b70 2024-09-13T23:07:20.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.284+0000 7f6127fff640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x55b4fd31a920 2024-09-13T23:07:20.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.284+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f612002d070 con 0x55b4fd31a920 2024-09-13T23:07:20.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.284+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x7f6128031040 2024-09-13T23:07:20.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.284+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f612002d070 con 0x7f6128031040 2024-09-13T23:07:20.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.284+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x55b4fd31a920 2024-09-13T23:07:20.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.285+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f612002d070 con 0x55b4fd31a920 2024-09-13T23:07:20.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.285+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x7f61180ab040 2024-09-13T23:07:20.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.285+0000 7f612d704640 1 -- 172.21.15.164:0/798906284 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f612801f070 con 0x7f61180ab040 2024-09-13T23:07:20.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.285+0000 7f612d704640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x55b4fd320b70 2024-09-13T23:07:20.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.285+0000 7f6127fff640 1 -- 172.21.15.164:0/798906284 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6118081070 con 0x55b4fd320b70 2024-09-13T23:07:20.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.285+0000 7f6127fff640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x55b4fd320b70 2024-09-13T23:07:20.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.285+0000 7f6127fff640 1 -- 172.21.15.164:0/798906284 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6118081070 con 0x55b4fd320b70 2024-09-13T23:07:20.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.285+0000 7f6127fff640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x7f6128031040 2024-09-13T23:07:20.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.286+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f612002d070 con 0x7f6128031040 2024-09-13T23:07:20.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.286+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x55b4fd320b70 2024-09-13T23:07:20.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.286+0000 7f6127fff640 1 -- 172.21.15.164:0/798906284 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6118081070 con 0x55b4fd320b70 2024-09-13T23:07:20.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.286+0000 7f6127fff640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x55b4fd320b70 2024-09-13T23:07:20.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.286+0000 7f6127fff640 1 -- 172.21.15.164:0/798906284 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6118081070 con 0x55b4fd320b70 2024-09-13T23:07:20.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.286+0000 7f6127fff640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x55b4fd31a920 2024-09-13T23:07:20.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.286+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f612002d070 con 0x55b4fd31a920 2024-09-13T23:07:20.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.286+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x55b4fd31a920 2024-09-13T23:07:20.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.286+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f612002d070 con 0x55b4fd31a920 2024-09-13T23:07:20.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.286+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x7f6128031040 2024-09-13T23:07:20.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.287+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f612002d070 con 0x7f6128031040 2024-09-13T23:07:20.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.287+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x55b4fd320b70 2024-09-13T23:07:20.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.287+0000 7f6127fff640 1 -- 172.21.15.164:0/798906284 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6118081070 con 0x55b4fd320b70 2024-09-13T23:07:20.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.287+0000 7f6127fff640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x7f61180ab040 2024-09-13T23:07:20.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.287+0000 7f612d704640 1 -- 172.21.15.164:0/798906284 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f612801f070 con 0x7f61180ab040 2024-09-13T23:07:20.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.287+0000 7f612d704640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x55b4fd31a920 2024-09-13T23:07:20.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.287+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f612002d070 con 0x55b4fd31a920 2024-09-13T23:07:20.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.287+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x7f6128031040 2024-09-13T23:07:20.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.288+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f612002d070 con 0x7f6128031040 2024-09-13T23:07:20.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.288+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x55b4fd320b70 2024-09-13T23:07:20.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.288+0000 7f6127fff640 1 -- 172.21.15.164:0/798906284 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6118081070 con 0x55b4fd320b70 2024-09-13T23:07:20.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.288+0000 7f6127fff640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x7f6128031040 2024-09-13T23:07:20.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.288+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f612002d070 con 0x7f6128031040 2024-09-13T23:07:20.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.288+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x7f61180ab040 2024-09-13T23:07:20.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.288+0000 7f612d704640 1 -- 172.21.15.164:0/798906284 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f612801f070 con 0x7f61180ab040 2024-09-13T23:07:20.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.288+0000 7f612d704640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x55b4fd320b70 2024-09-13T23:07:20.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.289+0000 7f6127fff640 1 -- 172.21.15.164:0/798906284 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6118081070 con 0x55b4fd320b70 2024-09-13T23:07:20.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.289+0000 7f6127fff640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x7f61180ab040 2024-09-13T23:07:20.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.289+0000 7f612d704640 1 -- 172.21.15.164:0/798906284 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f612801f070 con 0x7f61180ab040 2024-09-13T23:07:20.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.289+0000 7f612d704640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x55b4fd31a920 2024-09-13T23:07:20.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.289+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f612002d070 con 0x55b4fd31a920 2024-09-13T23:07:20.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.289+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323590 con 0x7f61180ab040 2024-09-13T23:07:20.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.289+0000 7f612d704640 1 -- 172.21.15.164:0/798906284 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6128040040 con 0x7f61180ab040 2024-09-13T23:07:20.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.289+0000 7f612f40f800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:07:20.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.289+0000 7f612f40f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:07:20.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.289+0000 7f612f40f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:07:20.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.289+0000 7f612f40f800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:07:20.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.289+0000 7f612f40f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:07:20.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.289+0000 7f612f40f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:07:20.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.289+0000 7f612f40f800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.289+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd31f780 con 0x55b4fd31a920 2024-09-13T23:07:20.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.290+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f612002d070 con 0x55b4fd31a920 2024-09-13T23:07:20.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.290+0000 7f612f40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.290+0000 7f612f40f800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.290+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd320020 con 0x55b4fd31a920 2024-09-13T23:07:20.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.290+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f612002d070 con 0x55b4fd31a920 2024-09-13T23:07:20.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.290+0000 7f612f40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:20.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.290+0000 7f612f40f800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.290+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd323a10 con 0x55b4fd31a920 2024-09-13T23:07:20.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.290+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f612002d070 con 0x55b4fd31a920 2024-09-13T23:07:20.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.290+0000 7f612f40f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:07:20.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.290+0000 7f612f40f800 20 zone default found 2024-09-13T23:07:20.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.290+0000 7f612f40f800 4 Realm: () 2024-09-13T23:07:20.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.290+0000 7f612f40f800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:07:20.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.290+0000 7f612f40f800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:07:20.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.290+0000 7f612f40f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:07:20.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.290+0000 7f612f40f800 20 zonegroup default 2024-09-13T23:07:20.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.290+0000 7f612f40f800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.290+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd31fc80 con 0x7f6128031040 2024-09-13T23:07:20.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.290+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f612002d070 con 0x7f6128031040 2024-09-13T23:07:20.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.290+0000 7f612f40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.290+0000 7f612f40f800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.290+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd3258f0 con 0x55b4fd320b70 2024-09-13T23:07:20.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.291+0000 7f6127fff640 1 -- 172.21.15.164:0/798906284 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6118081070 con 0x55b4fd320b70 2024-09-13T23:07:20.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.291+0000 7f612f40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.291+0000 7f612f40f800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.291+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd325c90 con 0x55b4fd320b70 2024-09-13T23:07:20.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.291+0000 7f6127fff640 1 -- 172.21.15.164:0/798906284 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6118081070 con 0x55b4fd320b70 2024-09-13T23:07:20.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.291+0000 7f612f40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.291+0000 7f612f40f800 20 started sync module instance, tier type = 2024-09-13T23:07:20.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.291+0000 7f612f40f800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:07:20.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.291+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd324d90 con 0x7f61180ab040 2024-09-13T23:07:20.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.292+0000 7f612d704640 1 -- 172.21.15.164:0/798906284 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6128040040 con 0x7f61180ab040 2024-09-13T23:07:20.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.292+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94235830407552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd3249f0 con 0x7f61180ab040 2024-09-13T23:07:20.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.292+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd326bf0 con 0x55b4fd31a920 2024-09-13T23:07:20.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.293+0000 7f612d704640 1 -- 172.21.15.164:0/798906284 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94235830407552] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6128040040 con 0x7f61180ab040 2024-09-13T23:07:20.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.294+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f612002d070 con 0x55b4fd31a920 2024-09-13T23:07:20.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.294+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94235830411552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd326bf0 con 0x55b4fd31a920 2024-09-13T23:07:20.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.294+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd3275b0 con 0x55b4fd320b70 2024-09-13T23:07:20.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.295+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94235830411552] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f612002d070 con 0x55b4fd31a920 2024-09-13T23:07:20.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.295+0000 7f6127fff640 1 -- 172.21.15.164:0/798906284 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6118081070 con 0x55b4fd320b70 2024-09-13T23:07:20.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.295+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94235830413120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd326b60 con 0x55b4fd320b70 2024-09-13T23:07:20.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.295+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd328370 con 0x7f61180ab040 2024-09-13T23:07:20.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.296+0000 7f612d704640 1 -- 172.21.15.164:0/798906284 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6128040040 con 0x7f61180ab040 2024-09-13T23:07:20.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.296+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94235830419024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd328c10 con 0x7f61180ab040 2024-09-13T23:07:20.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.296+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd3296f0 con 0x55b4fd31a920 2024-09-13T23:07:20.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.296+0000 7f6127fff640 1 -- 172.21.15.164:0/798906284 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94235830413120] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6118081070 con 0x55b4fd320b70 2024-09-13T23:07:20.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.297+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f612002d070 con 0x55b4fd31a920 2024-09-13T23:07:20.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.297+0000 7f612d704640 1 -- 172.21.15.164:0/798906284 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94235830419024] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6128040040 con 0x7f61180ab040 2024-09-13T23:07:20.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.297+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94235830424064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd3296f0 con 0x55b4fd31a920 2024-09-13T23:07:20.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.297+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd328760 con 0x7f6128031040 2024-09-13T23:07:20.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.298+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94235830424064] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f612002d070 con 0x55b4fd31a920 2024-09-13T23:07:20.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.298+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f612002d070 con 0x7f6128031040 2024-09-13T23:07:20.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.298+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94235830417824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd3296f0 con 0x7f6128031040 2024-09-13T23:07:20.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.298+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd32a5f0 con 0x7f6128031040 2024-09-13T23:07:20.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.299+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94235830417824] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f612002d070 con 0x7f6128031040 2024-09-13T23:07:20.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.299+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f612002d070 con 0x7f6128031040 2024-09-13T23:07:20.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.299+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94235830426704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd32a520 con 0x7f6128031040 2024-09-13T23:07:20.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.299+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd32af80 con 0x7f6128031040 2024-09-13T23:07:20.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.300+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94235830426704] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f612002d070 con 0x7f6128031040 2024-09-13T23:07:20.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.300+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f612002d070 con 0x7f6128031040 2024-09-13T23:07:20.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.300+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94235830430304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd32b160 con 0x7f6128031040 2024-09-13T23:07:20.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.300+0000 7f612f40f800 20 add_watcher() i=0 2024-09-13T23:07:20.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.300+0000 7f612f40f800 20 add_watcher() i=1 2024-09-13T23:07:20.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.300+0000 7f612f40f800 20 add_watcher() i=2 2024-09-13T23:07:20.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.300+0000 7f612f40f800 20 add_watcher() i=3 2024-09-13T23:07:20.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.300+0000 7f612f40f800 20 add_watcher() i=4 2024-09-13T23:07:20.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.300+0000 7f612f40f800 20 add_watcher() i=5 2024-09-13T23:07:20.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.300+0000 7f612f40f800 20 add_watcher() i=6 2024-09-13T23:07:20.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.301+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94235830430304] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f612002d070 con 0x7f6128031040 2024-09-13T23:07:20.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.301+0000 7f612f40f800 20 add_watcher() i=7 2024-09-13T23:07:20.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.301+0000 7f612f40f800 2 all 8 watchers are set, enabling cache 2024-09-13T23:07:20.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.301+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd32e530 con 0x55b4fd31a920 2024-09-13T23:07:20.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.302+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f612002d070 con 0x55b4fd31a920 2024-09-13T23:07:20.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.302+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94235830431824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd32b920 con 0x55b4fd31a920 2024-09-13T23:07:20.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.303+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94235830431824] v34'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f612002d070 con 0x55b4fd31a920 2024-09-13T23:07:20.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.303+0000 7f5fe37de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:20.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.303+0000 7f612f40f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:07:20.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.303+0000 7f612f40f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:07:20.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.303+0000 7f612f40f800 5 note: GC not initialized 2024-09-13T23:07:20.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.303+0000 7f5fe27dc640 20 reqs_thread_entry: start 2024-09-13T23:07:20.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.303+0000 7f612f40f800 20 init_complete bucket index max shards: 11 2024-09-13T23:07:20.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.303+0000 7f612f40f800 20 Filter name: none 2024-09-13T23:07:20.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.303+0000 7f5f53fff640 20 reqs_thread_entry: start 2024-09-13T23:07:20.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.304+0000 7f612f40f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T23:07:20.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.304+0000 7f612f40f800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.304+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd3617e0 con 0x7f6128031040 2024-09-13T23:07:20.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.304+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f612002d070 con 0x7f6128031040 2024-09-13T23:07:20.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.304+0000 7f612f40f800 20 rados_obj.operate() r=0 bl.length=503 2024-09-13T23:07:20.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.304+0000 7f612f40f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T23:07:20.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.304+0000 7f612f40f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:20.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.304+0000 7f612f40f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:07:20.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.304+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd368280 con 0x7f6128031040 2024-09-13T23:07:20.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.306+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f612002d070 con 0x7f6128031040 2024-09-13T23:07:20.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.306+0000 7f612f40f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:07:20.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.306+0000 7f612f40f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:20.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.306+0000 7f612f40f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T23:07:20.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.306+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94235830680640 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd3638c0 con 0x55b4fd31a920 2024-09-13T23:07:20.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.306+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== watch-notify(notify (1) cookie 94235830424064 notify 146028888095 ret 0) ==== 678+0+0 (crc 0 0 0) 0x55b4fd2e3d90 con 0x55b4fd31a920 2024-09-13T23:07:20.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.306+0000 7f6010ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888095 cookie 94235830424064 notifier 4903 bl.length()=636 2024-09-13T23:07:20.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.306+0000 7f6010ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:07:20.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.306+0000 7f6010ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:20.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.306+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(64 notify.4 [notify cookie 94235830680640 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f612002d070 con 0x55b4fd31a920 2024-09-13T23:07:20.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.306+0000 7f6010ff9640 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f5ff8003ea0 con 0x55b4fd31a920 2024-09-13T23:07:20.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.306+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f612002d070 con 0x55b4fd31a920 2024-09-13T23:07:20.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.306+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== watch-notify(notify_complete (2) cookie 94235830680640 notify 146028888095 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b4fd2e3870 con 0x55b4fd31a920 2024-09-13T23:07:20.327 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T23:07:18.801026Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:07:18.801015Z","tags":[],"group_ids":[]} 2024-09-13T23:07:20.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.307+0000 7f5fe37de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:20.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.307+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94235830431824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd35f530 con 0x55b4fd31a920 2024-09-13T23:07:20.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.308+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94235830431824] v34'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f612002d070 con 0x55b4fd31a920 2024-09-13T23:07:20.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.308+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94235830407552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd35f530 con 0x7f61180ab040 2024-09-13T23:07:20.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.309+0000 7f612d704640 1 -- 172.21.15.164:0/798906284 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94235830407552] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6128040040 con 0x7f61180ab040 2024-09-13T23:07:20.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.309+0000 7f612f40f800 20 remove_watcher() i=0 2024-09-13T23:07:20.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.309+0000 7f612f40f800 2 removed watcher, disabling cache 2024-09-13T23:07:20.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.309+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94235830411552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd35f530 con 0x55b4fd31a920 2024-09-13T23:07:20.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.310+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94235830411552] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f612002d070 con 0x55b4fd31a920 2024-09-13T23:07:20.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.310+0000 7f612f40f800 20 remove_watcher() i=1 2024-09-13T23:07:20.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.310+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94235830413120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd35f530 con 0x55b4fd320b70 2024-09-13T23:07:20.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.311+0000 7f6127fff640 1 -- 172.21.15.164:0/798906284 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94235830413120] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6118081070 con 0x55b4fd320b70 2024-09-13T23:07:20.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.311+0000 7f612f40f800 20 remove_watcher() i=2 2024-09-13T23:07:20.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.311+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94235830419024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd325180 con 0x7f61180ab040 2024-09-13T23:07:20.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.312+0000 7f612d704640 1 -- 172.21.15.164:0/798906284 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94235830419024] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6128040040 con 0x7f61180ab040 2024-09-13T23:07:20.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.312+0000 7f612f40f800 20 remove_watcher() i=3 2024-09-13T23:07:20.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.312+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94235830424064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd326120 con 0x55b4fd31a920 2024-09-13T23:07:20.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.313+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94235830424064] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f612002d070 con 0x55b4fd31a920 2024-09-13T23:07:20.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.313+0000 7f612f40f800 20 remove_watcher() i=4 2024-09-13T23:07:20.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.313+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94235830417824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd326740 con 0x7f6128031040 2024-09-13T23:07:20.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.314+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94235830417824] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f612002d070 con 0x7f6128031040 2024-09-13T23:07:20.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.314+0000 7f612f40f800 20 remove_watcher() i=5 2024-09-13T23:07:20.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.314+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94235830426704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd325180 con 0x7f6128031040 2024-09-13T23:07:20.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.316+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94235830426704] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f612002d070 con 0x7f6128031040 2024-09-13T23:07:20.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.316+0000 7f612f40f800 20 remove_watcher() i=6 2024-09-13T23:07:20.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.316+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94235830430304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4fd326740 con 0x7f6128031040 2024-09-13T23:07:20.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94235830430304] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f612002d070 con 0x7f6128031040 2024-09-13T23:07:20.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612f40f800 20 remove_watcher() i=7 2024-09-13T23:07:20.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f6128031040 msgr2=0x7f6128032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612f40f800 1 --2- 172.21.15.164:0/798906284 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f6128031040 0x7f6128032940 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b4fd31a920 msgr2=0x55b4fd31cde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612f40f800 1 --2- 172.21.15.164:0/798906284 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b4fd31a920 0x55b4fd31cde0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f61180ab040 msgr2=0x7f61180527e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612f40f800 1 --2- 172.21.15.164:0/798906284 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f61180ab040 0x7f61180527e0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55b4fd320b70 msgr2=0x55b4fd322f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612f40f800 1 --2- 172.21.15.164:0/798906284 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55b4fd320b70 0x55b4fd322f60 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5ff4036af0 msgr2=0x7f5ff4038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612f40f800 1 --2- 172.21.15.164:0/798906284 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5ff4036af0 0x7f5ff4038fb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x55b4fd2eb320 tx=0x7f612801f000 comp rx=0 tx=0).stop 2024-09-13T23:07:20.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd3078f0 msgr2=0x55b4fd30ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612cf03640 1 -- 172.21.15.164:0/798906284 reap_dead start 2024-09-13T23:07:20.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612f40f800 1 --2- 172.21.15.164:0/798906284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd3078f0 0x55b4fd30ee00 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f6118045f50 tx=0x7f61180911c0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 shutdown_connections 2024-09-13T23:07:20.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612f40f800 1 --2- 172.21.15.164:0/798906284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd3078f0 0x55b4fd30ee00 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 >> 172.21.15.164:0/798906284 conn(0x55b4fd303c50 msgr2=0x55b4fd301d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 shutdown_connections 2024-09-13T23:07:20.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612f40f800 1 -- 172.21.15.164:0/798906284 wait complete. 2024-09-13T23:07:20.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612f40f800 1 -- 172.21.15.164:0/548784819 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6004036b40 msgr2=0x7f6004039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612f40f800 1 --2- 172.21.15.164:0/548784819 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6004036b40 0x7f6004039000 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x55b4fd2ebba0 tx=0x7f6128005840 comp rx=0 tx=0).stop 2024-09-13T23:07:20.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612f40f800 1 -- 172.21.15.164:0/548784819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd2facf0 msgr2=0x55b4fd2fb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612f40f800 1 --2- 172.21.15.164:0/548784819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd2facf0 0x55b4fd2fb130 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f6118025bf0 tx=0x7f6118002fb0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612f40f800 1 -- 172.21.15.164:0/548784819 shutdown_connections 2024-09-13T23:07:20.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612f40f800 1 --2- 172.21.15.164:0/548784819 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6004036b40 0x7f6004039000 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612f40f800 1 --2- 172.21.15.164:0/548784819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd2facf0 0x55b4fd2fb130 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612f40f800 1 -- 172.21.15.164:0/548784819 >> 172.21.15.164:0/548784819 conn(0x55b4fd2efc80 msgr2=0x55b4fd2f2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612f40f800 1 -- 172.21.15.164:0/548784819 shutdown_connections 2024-09-13T23:07:20.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.317+0000 7f612f40f800 1 -- 172.21.15.164:0/548784819 wait complete. 2024-09-13T23:07:20.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.318+0000 7f612f40f800 1 -- 172.21.15.164:0/2346211958 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b4fd1f0d20 msgr2=0x55b4fd2ea3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.318+0000 7f612f40f800 1 --2- 172.21.15.164:0/2346211958 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b4fd1f0d20 0x55b4fd2ea3a0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.318+0000 7f612f40f800 1 -- 172.21.15.164:0/2346211958 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6014036b40 msgr2=0x7f6014039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.318+0000 7f612f40f800 1 --2- 172.21.15.164:0/2346211958 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6014036b40 0x7f6014039000 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6118057000 tx=0x7f6118052000 comp rx=0 tx=0).stop 2024-09-13T23:07:20.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.318+0000 7f612f40f800 1 -- 172.21.15.164:0/2346211958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd15e630 msgr2=0x55b4fd2e3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.318+0000 7f612f40f800 1 --2- 172.21.15.164:0/2346211958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd15e630 0x55b4fd2e3330 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f6120000f60 tx=0x7f6120000ed0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.318+0000 7f612f40f800 1 -- 172.21.15.164:0/2346211958 shutdown_connections 2024-09-13T23:07:20.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.318+0000 7f612f40f800 1 --2- 172.21.15.164:0/2346211958 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55b4fd1f0d20 0x55b4fd2ea3a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.318+0000 7f612f40f800 1 --2- 172.21.15.164:0/2346211958 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f6014036b40 0x7f6014039000 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.318+0000 7f612f40f800 1 --2- 172.21.15.164:0/2346211958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4fd15e630 0x55b4fd2e3330 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.318+0000 7f612f40f800 1 -- 172.21.15.164:0/2346211958 >> 172.21.15.164:0/2346211958 conn(0x55b4fd1e4db0 msgr2=0x55b4fd2d5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.318+0000 7f612f40f800 1 -- 172.21.15.164:0/2346211958 shutdown_connections 2024-09-13T23:07:20.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.318+0000 7f612f40f800 1 -- 172.21.15.164:0/2346211958 wait complete. 2024-09-13T23:07:20.340 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:07:18.801026Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:07:18.801015Z', 'tags': [], 'group_ids': []} 2024-09-13T23:07:20.340 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:07:18.801026Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:07:18.801015Z', 'tags': [], 'group_ids': []} 2024-09-13T23:07:20.340 ERROR:root:0 2024-09-13T23:07:20.340 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-13T23:07:20.340 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-13T23:07:20.340 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-09-13T23:07:20.387 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:07:20.387 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:07:20.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.387+0000 7f0bf8210800 1 Processor -- start 2024-09-13T23:07:20.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.387+0000 7f0bf8210800 1 -- start start 2024-09-13T23:07:20.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.387+0000 7f0bf8210800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x563e34f0c900 0x563e34f0ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.387+0000 7f0bf8210800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563e34dc7b30 con 0x563e34e7c650 2024-09-13T23:07:20.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.387+0000 7f0bf8210800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x563e34da9360 con 0x563e34f0c900 2024-09-13T23:07:20.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.388+0000 7f0bf30f6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x563e34f0c900 0x563e34f0ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.388+0000 7f0bf38f7640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x563e34e7c650 0x563e34f0b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:37934/0 (socket says 172.21.15.164:37934) 2024-09-13T23:07:20.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.388+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2482938354 learned_addr learned my addr 172.21.15.164:0/2482938354 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:07:20.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.388+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2482938354 >> v1:172.21.15.17:6789/0 conn(0x563e34e7c650 legacy=0x563e34f0b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.388+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2482938354 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e34dcfe00 con 0x563e34f0c900 2024-09-13T23:07:20.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.390+0000 7f0bf30f6640 1 --2- 172.21.15.164:0/2482938354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e34f0c900 0x563e34f0ecf0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f0be800a470 tx=0x7f0be8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff72d6e99b50ca8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.390+0000 7f0bf28f5640 1 -- 172.21.15.164:0/2482938354 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be8053570 con 0x563e34f0c900 2024-09-13T23:07:20.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.390+0000 7f0bf28f5640 1 -- 172.21.15.164:0/2482938354 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be8058070 con 0x563e34f0c900 2024-09-13T23:07:20.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.390+0000 7f0bf28f5640 1 -- 172.21.15.164:0/2482938354 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be8053880 con 0x563e34f0c900 2024-09-13T23:07:20.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.390+0000 7f0bf8210800 1 -- 172.21.15.164:0/2482938354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e34f0c900 msgr2=0x563e34f0ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.390+0000 7f0bf8210800 1 --2- 172.21.15.164:0/2482938354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e34f0c900 0x563e34f0ecf0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f0be800a470 tx=0x7f0be8045a20 comp rx=0 tx=0).stop 2024-09-13T23:07:20.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.390+0000 7f0bf8210800 1 -- 172.21.15.164:0/2482938354 shutdown_connections 2024-09-13T23:07:20.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.390+0000 7f0bf8210800 1 --2- 172.21.15.164:0/2482938354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e34f0c900 0x563e34f0ecf0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.390+0000 7f0bf8210800 1 -- 172.21.15.164:0/2482938354 >> 172.21.15.164:0/2482938354 conn(0x563e34f02db0 msgr2=0x563e34f051d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.390+0000 7f0bf8210800 1 -- 172.21.15.164:0/2482938354 shutdown_connections 2024-09-13T23:07:20.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.390+0000 7f0bf8210800 1 -- 172.21.15.164:0/2482938354 wait complete. 2024-09-13T23:07:20.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.404+0000 7f0bf8210800 1 Processor -- start 2024-09-13T23:07:20.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.404+0000 7f0bf8210800 1 -- start start 2024-09-13T23:07:20.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.404+0000 7f0bf8210800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e34e7c650 0x563e34f08b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.404+0000 7f0bf8210800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563e34e54360 con 0x563e34e7c650 2024-09-13T23:07:20.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.405+0000 7f0bf38f7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e34e7c650 0x563e34f08b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.405+0000 7f0bf38f7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e34e7c650 0x563e34f08b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54930/0 (socket says 172.21.15.164:54930) 2024-09-13T23:07:20.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.405+0000 7f0bf38f7640 1 -- 172.21.15.164:0/1353979075 learned_addr learned my addr 172.21.15.164:0/1353979075 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.405+0000 7f0bf38f7640 1 -- 172.21.15.164:0/1353979075 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e34da1bc0 con 0x563e34e7c650 2024-09-13T23:07:20.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.405+0000 7f0bf38f7640 1 --2- 172.21.15.164:0/1353979075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e34e7c650 0x563e34f08b10 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f0be40017a0 tx=0x7f0be4001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3de5c684792f566 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.405+0000 7f0ae1e0b640 1 -- 172.21.15.164:0/1353979075 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be4016070 con 0x563e34e7c650 2024-09-13T23:07:20.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.405+0000 7f0ae1e0b640 1 -- 172.21.15.164:0/1353979075 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be4004520 con 0x563e34e7c650 2024-09-13T23:07:20.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.405+0000 7f0ae1e0b640 1 -- 172.21.15.164:0/1353979075 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be4004820 con 0x563e34e7c650 2024-09-13T23:07:20.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.406+0000 7f0bf8210800 1 -- 172.21.15.164:0/1353979075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e34e7c650 msgr2=0x563e34f08b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.406+0000 7f0bf8210800 1 --2- 172.21.15.164:0/1353979075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e34e7c650 0x563e34f08b10 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f0be40017a0 tx=0x7f0be4001c60 comp rx=0 tx=0).stop 2024-09-13T23:07:20.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.406+0000 7f0bf8210800 1 -- 172.21.15.164:0/1353979075 shutdown_connections 2024-09-13T23:07:20.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.406+0000 7f0bf8210800 1 --2- 172.21.15.164:0/1353979075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e34e7c650 0x563e34f08b10 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.406+0000 7f0bf8210800 1 -- 172.21.15.164:0/1353979075 >> 172.21.15.164:0/1353979075 conn(0x563e34f02db0 msgr2=0x563e34ff3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.406+0000 7f0bf8210800 1 -- 172.21.15.164:0/1353979075 shutdown_connections 2024-09-13T23:07:20.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.406+0000 7f0bf8210800 1 -- 172.21.15.164:0/1353979075 wait complete. 2024-09-13T23:07:20.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.406+0000 7f0bf8210800 1 Processor -- start 2024-09-13T23:07:20.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.407+0000 7f0bf8210800 1 -- start start 2024-09-13T23:07:20.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.407+0000 7f0bf8210800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e34e7c650 0x563e35001500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.407+0000 7f0bf8210800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563e34f0f620 con 0x563e34e7c650 2024-09-13T23:07:20.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.407+0000 7f0bf38f7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e34e7c650 0x563e35001500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.407+0000 7f0bf38f7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e34e7c650 0x563e35001500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54938/0 (socket says 172.21.15.164:54938) 2024-09-13T23:07:20.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.407+0000 7f0bf38f7640 1 -- 172.21.15.164:0/3028510645 learned_addr learned my addr 172.21.15.164:0/3028510645 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.407+0000 7f0bf38f7640 1 -- 172.21.15.164:0/3028510645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e34db5fe0 con 0x563e34e7c650 2024-09-13T23:07:20.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.407+0000 7f0bf38f7640 1 --2- 172.21.15.164:0/3028510645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e34e7c650 0x563e35001500 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f0be4000f80 tx=0x7f0be4001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.408+0000 7f0adbfff640 1 -- 172.21.15.164:0/3028510645 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be4016040 con 0x563e34e7c650 2024-09-13T23:07:20.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.408+0000 7f0adbfff640 1 -- 172.21.15.164:0/3028510645 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be4011530 con 0x563e34e7c650 2024-09-13T23:07:20.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.408+0000 7f0bf8210800 1 -- 172.21.15.164:0/3028510645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e35001a40 con 0x563e34e7c650 2024-09-13T23:07:20.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.408+0000 7f0adbfff640 1 -- 172.21.15.164:0/3028510645 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be4011890 con 0x563e34e7c650 2024-09-13T23:07:20.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.408+0000 7f0bf8210800 1 -- 172.21.15.164:0/3028510645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e35001fc0 con 0x563e34e7c650 2024-09-13T23:07:20.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.409+0000 7f0adbfff640 1 -- 172.21.15.164:0/3028510645 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0be401c3f0 con 0x563e34e7c650 2024-09-13T23:07:20.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.409+0000 7f0adbfff640 1 --2- 172.21.15.164:0/3028510645 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0adc036b90 0x7f0adc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.409+0000 7f0adbfff640 1 -- 172.21.15.164:0/3028510645 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0be404bd80 con 0x563e34e7c650 2024-09-13T23:07:20.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.409+0000 7f0bf30f6640 1 --2- 172.21.15.164:0/3028510645 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0adc036b90 0x7f0adc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.409+0000 7f0bf8210800 1 --2- 172.21.15.164:0/3028510645 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563e34f0c900 0x563e35008480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.409+0000 7f0bf8210800 1 -- 172.21.15.164:0/3028510645 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e35008af0 con 0x563e34f0c900 2024-09-13T23:07:20.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.409+0000 7f0bf40f8640 1 --2- 172.21.15.164:0/3028510645 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563e34f0c900 0x563e35008480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.409+0000 7f0bf30f6640 1 --2- 172.21.15.164:0/3028510645 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0adc036b90 0x7f0adc039050 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0be8057000 tx=0x7f0be8052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.409+0000 7f0bf40f8640 1 --2- 172.21.15.164:0/3028510645 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563e34f0c900 0x563e35008480 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.410+0000 7f0bf40f8640 1 -- 172.21.15.164:0/3028510645 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0bec0083e0 con 0x563e34f0c900 2024-09-13T23:07:20.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.410+0000 7f0bf8210800 1 -- 172.21.15.164:0/3028510645 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e35005b20 con 0x563e34f0c900 2024-09-13T23:07:20.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.410+0000 7f0bf40f8640 1 -- 172.21.15.164:0/3028510645 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0bec0083e0 con 0x563e34f0c900 2024-09-13T23:07:20.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.410+0000 7f0bf8210800 1 -- 172.21.15.164:0/3028510645 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e3500a910 con 0x563e34f0c900 2024-09-13T23:07:20.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.410+0000 7f0bf40f8640 1 -- 172.21.15.164:0/3028510645 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0bec0083e0 con 0x563e34f0c900 2024-09-13T23:07:20.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.410+0000 7f0bf8210800 1 -- 172.21.15.164:0/3028510645 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e35009b40 con 0x563e34f0c900 2024-09-13T23:07:20.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.411+0000 7f0bf40f8640 1 -- 172.21.15.164:0/3028510645 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0bec0083e0 con 0x563e34f0c900 2024-09-13T23:07:20.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.411+0000 7f0bf8210800 1 -- 172.21.15.164:0/3028510645 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e35009f30 con 0x563e34f0c900 2024-09-13T23:07:20.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.411+0000 7f0bf40f8640 1 -- 172.21.15.164:0/3028510645 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0bec0083e0 con 0x563e34f0c900 2024-09-13T23:07:20.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.411+0000 7f0bf8210800 1 Processor -- start 2024-09-13T23:07:20.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.411+0000 7f0bf8210800 1 -- start start 2024-09-13T23:07:20.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.411+0000 7f0bf8210800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e35018f50 0x563e35019370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.411+0000 7f0bf8210800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563e34da3580 con 0x563e35018f50 2024-09-13T23:07:20.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.412+0000 7f0bf30f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e35018f50 0x563e35019370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.412+0000 7f0bf30f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e35018f50 0x563e35019370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54940/0 (socket says 172.21.15.164:54940) 2024-09-13T23:07:20.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.412+0000 7f0bf30f6640 1 -- 172.21.15.164:0/3428731972 learned_addr learned my addr 172.21.15.164:0/3428731972 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.412+0000 7f0bf30f6640 1 -- 172.21.15.164:0/3428731972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e350198b0 con 0x563e35018f50 2024-09-13T23:07:20.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.412+0000 7f0bf30f6640 1 --2- 172.21.15.164:0/3428731972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e35018f50 0x563e35019370 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f0be8045f50 tx=0x7f0be8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.412+0000 7f0ad97fa640 1 -- 172.21.15.164:0/3428731972 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be806f070 con 0x563e35018f50 2024-09-13T23:07:20.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.412+0000 7f0ad97fa640 1 -- 172.21.15.164:0/3428731972 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be805f550 con 0x563e35018f50 2024-09-13T23:07:20.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.412+0000 7f0bf8210800 1 -- 172.21.15.164:0/3428731972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e35019ae0 con 0x563e35018f50 2024-09-13T23:07:20.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.412+0000 7f0ad97fa640 1 -- 172.21.15.164:0/3428731972 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be805f830 con 0x563e35018f50 2024-09-13T23:07:20.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.412+0000 7f0bf8210800 1 -- 172.21.15.164:0/3428731972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e3501c760 con 0x563e35018f50 2024-09-13T23:07:20.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.413+0000 7f0ad97fa640 1 -- 172.21.15.164:0/3428731972 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0be805f9d0 con 0x563e35018f50 2024-09-13T23:07:20.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.413+0000 7f0ad97fa640 1 --2- 172.21.15.164:0/3428731972 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0acc036b40 0x7f0acc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.413+0000 7f0ad97fa640 1 -- 172.21.15.164:0/3428731972 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0be8092e80 con 0x563e35018f50 2024-09-13T23:07:20.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.413+0000 7f0bf40f8640 1 --2- 172.21.15.164:0/3428731972 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0acc036b40 0x7f0acc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.414+0000 7f0bf8210800 1 Processor -- start 2024-09-13T23:07:20.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.414+0000 7f0bf40f8640 1 --2- 172.21.15.164:0/3428731972 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0acc036b40 0x7f0acc039000 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x563e35009660 tx=0x7f0bec000f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.414+0000 7f0bf8210800 1 -- start start 2024-09-13T23:07:20.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.414+0000 7f0bf8210800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e35025b40 0x563e35025f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.414+0000 7f0bf8210800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563e34f071e0 con 0x563e35025b40 2024-09-13T23:07:20.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.414+0000 7f0bf30f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e35025b40 0x563e35025f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.414+0000 7f0bf30f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e35025b40 0x563e35025f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54942/0 (socket says 172.21.15.164:54942) 2024-09-13T23:07:20.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.414+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2387600464 learned_addr learned my addr 172.21.15.164:0/2387600464 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.414+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2387600464 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e35026510 con 0x563e35025b40 2024-09-13T23:07:20.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.414+0000 7f0bf30f6640 1 --2- 172.21.15.164:0/2387600464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e35025b40 0x563e35025f40 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f0be8053f70 tx=0x7f0be807cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec0b531206d266b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.414+0000 7f0ad2ffd640 1 -- 172.21.15.164:0/2387600464 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be806b410 con 0x563e35025b40 2024-09-13T23:07:20.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.415+0000 7f0ad2ffd640 1 -- 172.21.15.164:0/2387600464 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be805fcc0 con 0x563e35025b40 2024-09-13T23:07:20.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.415+0000 7f0ad2ffd640 1 -- 172.21.15.164:0/2387600464 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be806b5b0 con 0x563e35025b40 2024-09-13T23:07:20.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.415+0000 7f0bf8210800 1 -- 172.21.15.164:0/2387600464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e35025b40 msgr2=0x563e35025f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.415+0000 7f0bf8210800 1 --2- 172.21.15.164:0/2387600464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e35025b40 0x563e35025f40 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f0be8053f70 tx=0x7f0be807cbb0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.415+0000 7f0bf8210800 1 -- 172.21.15.164:0/2387600464 shutdown_connections 2024-09-13T23:07:20.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.415+0000 7f0bf8210800 1 --2- 172.21.15.164:0/2387600464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e35025b40 0x563e35025f40 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.415+0000 7f0bf8210800 1 -- 172.21.15.164:0/2387600464 >> 172.21.15.164:0/2387600464 conn(0x563e35021ea0 msgr2=0x563e3501ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.415+0000 7f0bf8210800 1 -- 172.21.15.164:0/2387600464 shutdown_connections 2024-09-13T23:07:20.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.415+0000 7f0bf8210800 1 -- 172.21.15.164:0/2387600464 wait complete. 2024-09-13T23:07:20.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.415+0000 7f0bf8210800 1 Processor -- start 2024-09-13T23:07:20.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.415+0000 7f0bf8210800 1 -- start start 2024-09-13T23:07:20.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.416+0000 7f0bf8210800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e35025b40 0x563e3502d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.416+0000 7f0bf8210800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563e35026b80 con 0x563e35025b40 2024-09-13T23:07:20.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.416+0000 7f0bf30f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e35025b40 0x563e3502d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.416+0000 7f0bf30f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e35025b40 0x563e3502d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54956/0 (socket says 172.21.15.164:54956) 2024-09-13T23:07:20.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.416+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2829691130 learned_addr learned my addr 172.21.15.164:0/2829691130 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.416+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e3502d540 con 0x563e35025b40 2024-09-13T23:07:20.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.416+0000 7f0bf30f6640 1 --2- 172.21.15.164:0/2829691130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e35025b40 0x563e3502d000 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f0be80059a0 tx=0x7f0be80910a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.416+0000 7f0ad17fa640 1 -- 172.21.15.164:0/2829691130 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be809e070 con 0x563e35025b40 2024-09-13T23:07:20.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.416+0000 7f0ad17fa640 1 -- 172.21.15.164:0/2829691130 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be806b410 con 0x563e35025b40 2024-09-13T23:07:20.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.416+0000 7f0ad17fa640 1 -- 172.21.15.164:0/2829691130 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be805cca0 con 0x563e35025b40 2024-09-13T23:07:20.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.416+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e3502d7d0 con 0x563e35025b40 2024-09-13T23:07:20.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.416+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e3502d7d0 con 0x563e35025b40 2024-09-13T23:07:20.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.417+0000 7f0ad17fa640 1 -- 172.21.15.164:0/2829691130 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0be80a1070 con 0x563e35025b40 2024-09-13T23:07:20.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.417+0000 7f0ad17fa640 1 --2- 172.21.15.164:0/2829691130 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0abc036b40 0x7f0abc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.417+0000 7f0ad17fa640 1 -- 172.21.15.164:0/2829691130 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0be80a4d60 con 0x563e35025b40 2024-09-13T23:07:20.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.417+0000 7f0bf40f8640 1 --2- 172.21.15.164:0/2829691130 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0abc036b40 0x7f0abc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.418+0000 7f0bf40f8640 1 --2- 172.21.15.164:0/2829691130 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0abc036b40 0x7f0abc039000 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00f010 tx=0x7f0bec00c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.418+0000 7f0bf8210800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.418+0000 7f0bf8210800 1 --2- 172.21.15.164:0/2829691130 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563e35038940 0x563e3503ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.418+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e3503b550 con 0x563e35038940 2024-09-13T23:07:20.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.418+0000 7f0bf38f7640 1 --2- 172.21.15.164:0/2829691130 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563e35038940 0x563e3503ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.418+0000 7f0bf38f7640 1 --2- 172.21.15.164:0/2829691130 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563e35038940 0x563e3503ae00 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.419+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0be4019050 con 0x563e35038940 2024-09-13T23:07:20.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.419+0000 7f0bf8210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.419+0000 7f0bf8210800 20 realm 2024-09-13T23:07:20.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.419+0000 7f0bf8210800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.419+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e3503b960 con 0x563e35038940 2024-09-13T23:07:20.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.419+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0be4019050 con 0x563e35038940 2024-09-13T23:07:20.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.419+0000 7f0bf8210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.419+0000 7f0bf8210800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:07:20.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.419+0000 7f0bf8210800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.419+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e3503c230 con 0x563e35038940 2024-09-13T23:07:20.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.419+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0be4019050 con 0x563e35038940 2024-09-13T23:07:20.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.419+0000 7f0bf8210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.419+0000 7f0bf8210800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.419+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e3503c5d0 con 0x563e35038940 2024-09-13T23:07:20.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.419+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0be4019050 con 0x563e35038940 2024-09-13T23:07:20.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.419+0000 7f0bf8210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:20.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.419+0000 7f0bf8210800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.419+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e3503ce20 con 0x563e35038940 2024-09-13T23:07:20.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.420+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0be4019050 con 0x563e35038940 2024-09-13T23:07:20.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.420+0000 7f0bf8210800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:07:20.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.420+0000 7f0bf8210800 20 searching for the correct realm 2024-09-13T23:07:20.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.420+0000 7f0bf8210800 1 --2- 172.21.15.164:0/2829691130 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563e3503eb90 0x563e35040f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.420+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e35041510 con 0x563e3503eb90 2024-09-13T23:07:20.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.420+0000 7f0bf30f6640 1 --2- 172.21.15.164:0/2829691130 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563e3503eb90 0x563e35040f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.420+0000 7f0bf30f6640 1 --2- 172.21.15.164:0/2829691130 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563e3503eb90 0x563e35040f80 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.420+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2829691130 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be80a0030 con 0x563e3503eb90 2024-09-13T23:07:20.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.420+0000 7f0bf30f6640 1 --2- 172.21.15.164:0/2829691130 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f0be80a3060 0x7f0be80914b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.420+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e35041510 con 0x7f0be80a3060 2024-09-13T23:07:20.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.420+0000 7f0bf40f8640 1 --2- 172.21.15.164:0/2829691130 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f0be80a3060 0x7f0be80914b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.421+0000 7f0bf40f8640 1 --2- 172.21.15.164:0/2829691130 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f0be80a3060 0x7f0be80914b0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.421+0000 7f0bf40f8640 1 -- 172.21.15.164:0/2829691130 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec02f040 con 0x7f0be80a3060 2024-09-13T23:07:20.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.421+0000 7f0bf40f8640 1 --2- 172.21.15.164:0/2829691130 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f0bec019040 0x7f0bec019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.421+0000 7f0bf40f8640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e35041510 con 0x7f0bec019040 2024-09-13T23:07:20.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.421+0000 7f0bf38f7640 1 --2- 172.21.15.164:0/2829691130 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f0bec019040 0x7f0bec019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.421+0000 7f0bf38f7640 1 --2- 172.21.15.164:0/2829691130 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f0bec019040 0x7f0bec019930 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.422+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be4019050 con 0x7f0bec019040 2024-09-13T23:07:20.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.422+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e35041510 con 0x563e35038940 2024-09-13T23:07:20.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.422+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0be4019050 con 0x563e35038940 2024-09-13T23:07:20.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.422+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e35041510 con 0x563e35038940 2024-09-13T23:07:20.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.422+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be4019050 con 0x563e35038940 2024-09-13T23:07:20.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.422+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e35041510 con 0x7f0bec019040 2024-09-13T23:07:20.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.422+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be4019050 con 0x7f0bec019040 2024-09-13T23:07:20.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.422+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e35041510 con 0x7f0bec019040 2024-09-13T23:07:20.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.422+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be4019050 con 0x7f0bec019040 2024-09-13T23:07:20.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.422+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e35041510 con 0x7f0be80a3060 2024-09-13T23:07:20.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.423+0000 7f0bf40f8640 1 -- 172.21.15.164:0/2829691130 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec02f040 con 0x7f0be80a3060 2024-09-13T23:07:20.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.423+0000 7f0bf40f8640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e35041510 con 0x563e3503eb90 2024-09-13T23:07:20.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.423+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2829691130 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be80a0030 con 0x563e3503eb90 2024-09-13T23:07:20.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.423+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e35041510 con 0x563e35038940 2024-09-13T23:07:20.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.423+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be4019050 con 0x563e35038940 2024-09-13T23:07:20.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.423+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e35041510 con 0x7f0bec019040 2024-09-13T23:07:20.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.423+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be4019050 con 0x7f0bec019040 2024-09-13T23:07:20.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.423+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e35041510 con 0x563e35038940 2024-09-13T23:07:20.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.424+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be4019050 con 0x563e35038940 2024-09-13T23:07:20.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.424+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e35041510 con 0x7f0be80a3060 2024-09-13T23:07:20.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.424+0000 7f0bf40f8640 1 -- 172.21.15.164:0/2829691130 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0bec02f040 con 0x7f0be80a3060 2024-09-13T23:07:20.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.424+0000 7f0bf40f8640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e35041510 con 0x563e3503eb90 2024-09-13T23:07:20.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.424+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2829691130 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be80b2040 con 0x563e3503eb90 2024-09-13T23:07:20.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.424+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e35041510 con 0x563e3503eb90 2024-09-13T23:07:20.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.424+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2829691130 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be80b2040 con 0x563e3503eb90 2024-09-13T23:07:20.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.424+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e35041510 con 0x7f0bec019040 2024-09-13T23:07:20.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.425+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be4019050 con 0x7f0bec019040 2024-09-13T23:07:20.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.425+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e35041510 con 0x563e3503eb90 2024-09-13T23:07:20.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.425+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2829691130 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be80b2040 con 0x563e3503eb90 2024-09-13T23:07:20.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.425+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e35041510 con 0x563e3503eb90 2024-09-13T23:07:20.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.425+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2829691130 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be80b2040 con 0x563e3503eb90 2024-09-13T23:07:20.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.425+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e35041510 con 0x563e35038940 2024-09-13T23:07:20.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.425+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be4019050 con 0x563e35038940 2024-09-13T23:07:20.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.425+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e35041510 con 0x563e35038940 2024-09-13T23:07:20.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.425+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0be4019050 con 0x563e35038940 2024-09-13T23:07:20.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.425+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e35041510 con 0x7f0bec019040 2024-09-13T23:07:20.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.426+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be4019050 con 0x7f0bec019040 2024-09-13T23:07:20.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.426+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e35041510 con 0x563e3503eb90 2024-09-13T23:07:20.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.426+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2829691130 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be80b2040 con 0x563e3503eb90 2024-09-13T23:07:20.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.426+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e35041510 con 0x7f0be80a3060 2024-09-13T23:07:20.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.426+0000 7f0bf40f8640 1 -- 172.21.15.164:0/2829691130 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec02f040 con 0x7f0be80a3060 2024-09-13T23:07:20.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.426+0000 7f0bf40f8640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e35041510 con 0x563e35038940 2024-09-13T23:07:20.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.426+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0be4019050 con 0x563e35038940 2024-09-13T23:07:20.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.426+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e35041510 con 0x7f0bec019040 2024-09-13T23:07:20.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.427+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be4019050 con 0x7f0bec019040 2024-09-13T23:07:20.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.427+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e35041510 con 0x563e3503eb90 2024-09-13T23:07:20.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.427+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2829691130 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be80b2040 con 0x563e3503eb90 2024-09-13T23:07:20.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.427+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563e35041510 con 0x7f0bec019040 2024-09-13T23:07:20.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.427+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be4019050 con 0x7f0bec019040 2024-09-13T23:07:20.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.427+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0be4036040 con 0x7f0be80a3060 2024-09-13T23:07:20.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.427+0000 7f0bf40f8640 1 -- 172.21.15.164:0/2829691130 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec02f040 con 0x7f0be80a3060 2024-09-13T23:07:20.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.427+0000 7f0bf40f8640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0be4036040 con 0x563e3503eb90 2024-09-13T23:07:20.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.428+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2829691130 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be80b2040 con 0x563e3503eb90 2024-09-13T23:07:20.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.428+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0be4036040 con 0x7f0be80a3060 2024-09-13T23:07:20.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.428+0000 7f0bf40f8640 1 -- 172.21.15.164:0/2829691130 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec02f040 con 0x7f0be80a3060 2024-09-13T23:07:20.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.428+0000 7f0bf40f8640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0be4036040 con 0x563e35038940 2024-09-13T23:07:20.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.428+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0be4019050 con 0x563e35038940 2024-09-13T23:07:20.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.428+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0be4036040 con 0x7f0be80a3060 2024-09-13T23:07:20.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.428+0000 7f0bf40f8640 1 -- 172.21.15.164:0/2829691130 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bec02f040 con 0x7f0be80a3060 2024-09-13T23:07:20.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.428+0000 7f0bf8210800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:07:20.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.428+0000 7f0bf8210800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:07:20.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.428+0000 7f0bf8210800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:07:20.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.428+0000 7f0bf8210800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:07:20.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.428+0000 7f0bf8210800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:07:20.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.428+0000 7f0bf8210800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:07:20.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.428+0000 7f0bf8210800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.428+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e3503d7a0 con 0x563e35038940 2024-09-13T23:07:20.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.429+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0be4019050 con 0x563e35038940 2024-09-13T23:07:20.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.429+0000 7f0bf8210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.429+0000 7f0bf8210800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.429+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e3503e040 con 0x563e35038940 2024-09-13T23:07:20.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.429+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0be4019050 con 0x563e35038940 2024-09-13T23:07:20.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.429+0000 7f0bf8210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:20.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.429+0000 7f0bf8210800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.429+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e3503e040 con 0x563e35038940 2024-09-13T23:07:20.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.429+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0be4019050 con 0x563e35038940 2024-09-13T23:07:20.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.429+0000 7f0bf8210800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:07:20.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.429+0000 7f0bf8210800 20 zone default found 2024-09-13T23:07:20.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.429+0000 7f0bf8210800 4 Realm: () 2024-09-13T23:07:20.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.429+0000 7f0bf8210800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:07:20.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.429+0000 7f0bf8210800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:07:20.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.429+0000 7f0bf8210800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:07:20.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.429+0000 7f0bf8210800 20 zonegroup default 2024-09-13T23:07:20.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.429+0000 7f0bf8210800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.429+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e35041990 con 0x7f0bec019040 2024-09-13T23:07:20.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.429+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0be4019050 con 0x7f0bec019040 2024-09-13T23:07:20.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.429+0000 7f0bf8210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.429+0000 7f0bf8210800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.429+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e35043400 con 0x563e3503eb90 2024-09-13T23:07:20.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.430+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2829691130 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0be80b2040 con 0x563e3503eb90 2024-09-13T23:07:20.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.430+0000 7f0bf8210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.430+0000 7f0bf8210800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.430+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e350438f0 con 0x563e3503eb90 2024-09-13T23:07:20.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.430+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2829691130 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0be80b2040 con 0x563e3503eb90 2024-09-13T23:07:20.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.430+0000 7f0bf8210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.430+0000 7f0bf8210800 20 started sync module instance, tier type = 2024-09-13T23:07:20.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.430+0000 7f0bf8210800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:07:20.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.430+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e35042810 con 0x7f0be80a3060 2024-09-13T23:07:20.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.431+0000 7f0bf40f8640 1 -- 172.21.15.164:0/2829691130 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec02f040 con 0x7f0be80a3060 2024-09-13T23:07:20.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.431+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94825177427216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e35042810 con 0x7f0be80a3060 2024-09-13T23:07:20.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.431+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e350443b0 con 0x563e35038940 2024-09-13T23:07:20.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.432+0000 7f0bf40f8640 1 -- 172.21.15.164:0/2829691130 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94825177427216] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec02f040 con 0x7f0be80a3060 2024-09-13T23:07:20.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.433+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be4019050 con 0x563e35038940 2024-09-13T23:07:20.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.433+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94825177431744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e35042810 con 0x563e35038940 2024-09-13T23:07:20.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.433+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e35044e50 con 0x563e3503eb90 2024-09-13T23:07:20.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.434+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94825177431744] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be4019050 con 0x563e35038940 2024-09-13T23:07:20.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.434+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2829691130 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be80b2040 con 0x563e3503eb90 2024-09-13T23:07:20.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.434+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94825177434432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e350451f0 con 0x563e3503eb90 2024-09-13T23:07:20.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.434+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e35045c20 con 0x7f0be80a3060 2024-09-13T23:07:20.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.435+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2829691130 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94825177434432] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be80b2040 con 0x563e3503eb90 2024-09-13T23:07:20.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.435+0000 7f0bf40f8640 1 -- 172.21.15.164:0/2829691130 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec02f040 con 0x7f0be80a3060 2024-09-13T23:07:20.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.435+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94825177424736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e35046040 con 0x7f0be80a3060 2024-09-13T23:07:20.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.435+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e35046a60 con 0x563e35038940 2024-09-13T23:07:20.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.436+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be4019050 con 0x563e35038940 2024-09-13T23:07:20.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.436+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94825177441616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e35046a20 con 0x563e35038940 2024-09-13T23:07:20.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.436+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e35047a20 con 0x7f0bec019040 2024-09-13T23:07:20.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.436+0000 7f0bf40f8640 1 -- 172.21.15.164:0/2829691130 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94825177424736] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec02f040 con 0x7f0be80a3060 2024-09-13T23:07:20.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.437+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94825177441616] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be4019050 con 0x563e35038940 2024-09-13T23:07:20.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.437+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be4019050 con 0x7f0bec019040 2024-09-13T23:07:20.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.437+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94825177438000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e35046c00 con 0x7f0bec019040 2024-09-13T23:07:20.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.437+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e350482c0 con 0x7f0bec019040 2024-09-13T23:07:20.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.438+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94825177438000] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be4019050 con 0x7f0bec019040 2024-09-13T23:07:20.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.438+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be4019050 con 0x7f0bec019040 2024-09-13T23:07:20.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.438+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94825177445664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e35047f10 con 0x7f0bec019040 2024-09-13T23:07:20.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.438+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e350488d0 con 0x7f0bec019040 2024-09-13T23:07:20.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.439+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(58 notify.7 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be4019050 con 0x7f0bec019040 2024-09-13T23:07:20.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.439+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94825177445664] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be4019050 con 0x7f0bec019040 2024-09-13T23:07:20.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.439+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94825177449504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e35048840 con 0x7f0bec019040 2024-09-13T23:07:20.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.439+0000 7f0bf8210800 20 add_watcher() i=0 2024-09-13T23:07:20.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.439+0000 7f0bf8210800 20 add_watcher() i=1 2024-09-13T23:07:20.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.439+0000 7f0bf8210800 20 add_watcher() i=2 2024-09-13T23:07:20.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.439+0000 7f0bf8210800 20 add_watcher() i=3 2024-09-13T23:07:20.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.439+0000 7f0bf8210800 20 add_watcher() i=4 2024-09-13T23:07:20.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.439+0000 7f0bf8210800 20 add_watcher() i=5 2024-09-13T23:07:20.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.439+0000 7f0bf8210800 20 add_watcher() i=6 2024-09-13T23:07:20.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.440+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94825177449504] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be4019050 con 0x7f0bec019040 2024-09-13T23:07:20.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.440+0000 7f0bf8210800 20 add_watcher() i=7 2024-09-13T23:07:20.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.440+0000 7f0bf8210800 2 all 8 watchers are set, enabling cache 2024-09-13T23:07:20.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.440+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e35047b50 con 0x563e35038940 2024-09-13T23:07:20.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.441+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0be4019050 con 0x563e35038940 2024-09-13T23:07:20.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.441+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94825177451632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e35049540 con 0x563e35038940 2024-09-13T23:07:20.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.442+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94825177451632] v34'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0be4019050 con 0x563e35038940 2024-09-13T23:07:20.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.442+0000 7f0aa9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:20.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.442+0000 7f0bf8210800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:07:20.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.442+0000 7f0bf8210800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:07:20.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.442+0000 7f0bf8210800 5 note: GC not initialized 2024-09-13T23:07:20.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.442+0000 7f0aa8fe1640 20 reqs_thread_entry: start 2024-09-13T23:07:20.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.442+0000 7f0bf8210800 20 init_complete bucket index max shards: 11 2024-09-13T23:07:20.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.442+0000 7f0bf8210800 20 Filter name: none 2024-09-13T23:07:20.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.443+0000 7f0a227fc640 20 reqs_thread_entry: start 2024-09-13T23:07:20.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.443+0000 7f0bf8210800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T23:07:20.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.443+0000 7f0bf8210800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.443+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e3507f1c0 con 0x7f0bec019040 2024-09-13T23:07:20.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.443+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f0be4019050 con 0x7f0bec019040 2024-09-13T23:07:20.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.443+0000 7f0bf8210800 20 rados_obj.operate() r=0 bl.length=460 2024-09-13T23:07:20.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.443+0000 7f0bf8210800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T23:07:20.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.443+0000 7f0bf8210800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:20.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.443+0000 7f0bf8210800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:07:20.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.443+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e350858c0 con 0x7f0bec019040 2024-09-13T23:07:20.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.445+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0be4019050 con 0x7f0bec019040 2024-09-13T23:07:20.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.445+0000 7f0bf8210800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:07:20.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.445+0000 7f0bf8210800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:20.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.445+0000 7f0bf8210800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T23:07:20.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.445+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94825177698944 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563e35080ee0 con 0x563e35038940 2024-09-13T23:07:20.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.445+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== watch-notify(notify (1) cookie 94825177441616 notify 146028888096 ret 0) ==== 708+0+0 (crc 0 0 0) 0x563e35001fc0 con 0x563e35038940 2024-09-13T23:07:20.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.445+0000 7f0ad2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888096 cookie 94825177441616 notifier 4910 bl.length()=666 2024-09-13T23:07:20.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.445+0000 7f0ad2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:07:20.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.445+0000 7f0ad2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:20.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.445+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(64 notify.4 [notify cookie 94825177698944 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0be4019050 con 0x563e35038940 2024-09-13T23:07:20.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.445+0000 7f0ad2ffd640 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f0ab8003ea0 con 0x563e35038940 2024-09-13T23:07:20.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.445+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be4019050 con 0x563e35038940 2024-09-13T23:07:20.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.445+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== watch-notify(notify_complete (2) cookie 94825177698944 notify 146028888096 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563e35001a40 con 0x563e35038940 2024-09-13T23:07:20.460 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T23:07:18.801026Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:07:18.801015Z","tags":[],"group_ids":[]} 2024-09-13T23:07:20.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.446+0000 7f0aa9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:20.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.446+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94825177451632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e3507cf00 con 0x563e35038940 2024-09-13T23:07:20.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.447+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94825177451632] v34'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0be4019050 con 0x563e35038940 2024-09-13T23:07:20.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.447+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94825177427216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e3507cf00 con 0x7f0be80a3060 2024-09-13T23:07:20.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.448+0000 7f0bf40f8640 1 -- 172.21.15.164:0/2829691130 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94825177427216] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec02f040 con 0x7f0be80a3060 2024-09-13T23:07:20.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.448+0000 7f0bf8210800 20 remove_watcher() i=0 2024-09-13T23:07:20.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.448+0000 7f0bf8210800 2 removed watcher, disabling cache 2024-09-13T23:07:20.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.448+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94825177431744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e3507cf00 con 0x563e35038940 2024-09-13T23:07:20.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.449+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94825177431744] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be4019050 con 0x563e35038940 2024-09-13T23:07:20.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.449+0000 7f0bf8210800 20 remove_watcher() i=1 2024-09-13T23:07:20.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.449+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94825177434432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e3507cf00 con 0x563e3503eb90 2024-09-13T23:07:20.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.450+0000 7f0bf30f6640 1 -- 172.21.15.164:0/2829691130 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94825177434432] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be80b2040 con 0x563e3503eb90 2024-09-13T23:07:20.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.450+0000 7f0bf8210800 20 remove_watcher() i=2 2024-09-13T23:07:20.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.450+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94825177424736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e35043ec0 con 0x7f0be80a3060 2024-09-13T23:07:20.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.451+0000 7f0bf40f8640 1 -- 172.21.15.164:0/2829691130 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94825177424736] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bec02f040 con 0x7f0be80a3060 2024-09-13T23:07:20.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.451+0000 7f0bf8210800 20 remove_watcher() i=3 2024-09-13T23:07:20.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.451+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94825177441616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e35044940 con 0x563e35038940 2024-09-13T23:07:20.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.452+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94825177441616] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be4019050 con 0x563e35038940 2024-09-13T23:07:20.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.452+0000 7f0bf8210800 20 remove_watcher() i=4 2024-09-13T23:07:20.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.452+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94825177438000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e35042360 con 0x7f0bec019040 2024-09-13T23:07:20.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.453+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94825177438000] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be4019050 con 0x7f0bec019040 2024-09-13T23:07:20.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.453+0000 7f0bf8210800 20 remove_watcher() i=5 2024-09-13T23:07:20.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.453+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94825177445664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e35043ec0 con 0x7f0bec019040 2024-09-13T23:07:20.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.454+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94825177445664] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be4019050 con 0x7f0bec019040 2024-09-13T23:07:20.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.454+0000 7f0bf8210800 20 remove_watcher() i=6 2024-09-13T23:07:20.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.454+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94825177449504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563e35044940 con 0x7f0bec019040 2024-09-13T23:07:20.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.455+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94825177449504] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be4019050 con 0x7f0bec019040 2024-09-13T23:07:20.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.455+0000 7f0bf8210800 20 remove_watcher() i=7 2024-09-13T23:07:20.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.455+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f0bec019040 msgr2=0x7f0bec019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.456+0000 7f0bf8210800 1 --2- 172.21.15.164:0/2829691130 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f0bec019040 0x7f0bec019930 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.456+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563e35038940 msgr2=0x563e3503ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.456+0000 7f0bf8210800 1 --2- 172.21.15.164:0/2829691130 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563e35038940 0x563e3503ae00 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.456+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f0be80a3060 msgr2=0x7f0be80914b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.456+0000 7f0bf8210800 1 --2- 172.21.15.164:0/2829691130 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f0be80a3060 0x7f0be80914b0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.456+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563e3503eb90 msgr2=0x563e35040f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.456+0000 7f0bf8210800 1 --2- 172.21.15.164:0/2829691130 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x563e3503eb90 0x563e35040f80 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.456+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0abc036b40 msgr2=0x7f0abc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.456+0000 7f0bf8210800 1 --2- 172.21.15.164:0/2829691130 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0abc036b40 0x7f0abc039000 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00f010 tx=0x7f0bec00c040 comp rx=0 tx=0).stop 2024-09-13T23:07:20.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.456+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e35025b40 msgr2=0x563e3502d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.456+0000 7f0bf38f7640 1 -- 172.21.15.164:0/2829691130 reap_dead start 2024-09-13T23:07:20.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.456+0000 7f0bf8210800 1 --2- 172.21.15.164:0/2829691130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e35025b40 0x563e3502d000 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f0be80059a0 tx=0x7f0be80910a0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.456+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 shutdown_connections 2024-09-13T23:07:20.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.456+0000 7f0bf8210800 1 --2- 172.21.15.164:0/2829691130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e35025b40 0x563e3502d000 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.456+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 >> 172.21.15.164:0/2829691130 conn(0x563e35021ea0 msgr2=0x563e3501ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.456+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 shutdown_connections 2024-09-13T23:07:20.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.456+0000 7f0bf8210800 1 -- 172.21.15.164:0/2829691130 wait complete. 2024-09-13T23:07:20.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.456+0000 7f0bf8210800 1 -- 172.21.15.164:0/3428731972 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0acc036b40 msgr2=0x7f0acc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.456+0000 7f0bf8210800 1 --2- 172.21.15.164:0/3428731972 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0acc036b40 0x7f0acc039000 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x563e35009660 tx=0x7f0bec000f90 comp rx=0 tx=0).stop 2024-09-13T23:07:20.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.456+0000 7f0bf8210800 1 -- 172.21.15.164:0/3428731972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e35018f50 msgr2=0x563e35019370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.456+0000 7f0bf8210800 1 --2- 172.21.15.164:0/3428731972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e35018f50 0x563e35019370 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f0be8045f50 tx=0x7f0be8002fb0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.456+0000 7f0bf8210800 1 -- 172.21.15.164:0/3428731972 shutdown_connections 2024-09-13T23:07:20.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.456+0000 7f0bf8210800 1 --2- 172.21.15.164:0/3428731972 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0acc036b40 0x7f0acc039000 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.456+0000 7f0bf8210800 1 --2- 172.21.15.164:0/3428731972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e35018f50 0x563e35019370 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.456+0000 7f0bf8210800 1 -- 172.21.15.164:0/3428731972 >> 172.21.15.164:0/3428731972 conn(0x563e3500dee0 msgr2=0x563e35010a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.456+0000 7f0bf8210800 1 -- 172.21.15.164:0/3428731972 shutdown_connections 2024-09-13T23:07:20.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.456+0000 7f0bf8210800 1 -- 172.21.15.164:0/3428731972 wait complete. 2024-09-13T23:07:20.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.457+0000 7f0bf8210800 1 -- 172.21.15.164:0/3028510645 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563e34f0c900 msgr2=0x563e35008480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.457+0000 7f0bf8210800 1 --2- 172.21.15.164:0/3028510645 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563e34f0c900 0x563e35008480 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.457+0000 7f0bf8210800 1 -- 172.21.15.164:0/3028510645 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0adc036b90 msgr2=0x7f0adc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.457+0000 7f0bf8210800 1 --2- 172.21.15.164:0/3028510645 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0adc036b90 0x7f0adc039050 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0be8057000 tx=0x7f0be8052000 comp rx=0 tx=0).stop 2024-09-13T23:07:20.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.457+0000 7f0bf8210800 1 -- 172.21.15.164:0/3028510645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e34e7c650 msgr2=0x563e35001500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.457+0000 7f0bf8210800 1 --2- 172.21.15.164:0/3028510645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e34e7c650 0x563e35001500 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f0be4000f80 tx=0x7f0be4001250 comp rx=0 tx=0).stop 2024-09-13T23:07:20.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.457+0000 7f0bf8210800 1 -- 172.21.15.164:0/3028510645 shutdown_connections 2024-09-13T23:07:20.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.457+0000 7f0bf8210800 1 --2- 172.21.15.164:0/3028510645 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x563e34f0c900 0x563e35008480 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.457+0000 7f0bf8210800 1 --2- 172.21.15.164:0/3028510645 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f0adc036b90 0x7f0adc039050 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.457+0000 7f0bf8210800 1 --2- 172.21.15.164:0/3028510645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e34e7c650 0x563e35001500 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.457+0000 7f0bf8210800 1 -- 172.21.15.164:0/3028510645 >> 172.21.15.164:0/3028510645 conn(0x563e34f02db0 msgr2=0x563e34ff2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.457+0000 7f0bf8210800 1 -- 172.21.15.164:0/3028510645 shutdown_connections 2024-09-13T23:07:20.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.457+0000 7f0bf8210800 1 -- 172.21.15.164:0/3028510645 wait complete. 2024-09-13T23:07:20.472 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:07:18.801026Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:07:18.801015Z', 'tags': [], 'group_ids': []} 2024-09-13T23:07:20.472 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:07:18.801026Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:07:18.801015Z', 'tags': [], 'group_ids': []} 2024-09-13T23:07:20.472 ERROR:root:0 2024-09-13T23:07:20.472 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:07:20.487 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx00000eac9f91838dd0be7-0066e4c5a8-4239-default', 'HostId': '4239-default-default'} 2024-09-13T23:07:20.488 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-13T23:07:20.488 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-13T23:07:20.488 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-09-13T23:07:20.535 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:07:20.535 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:07:20.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.535+0000 7f1c2ad26800 1 Processor -- start 2024-09-13T23:07:20.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.535+0000 7f1c2ad26800 1 -- start start 2024-09-13T23:07:20.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.535+0000 7f1c2ad26800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55ada20ef650 0x55ada217e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.535+0000 7f1c2ad26800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ada203ab30 con 0x55ada217e720 2024-09-13T23:07:20.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.535+0000 7f1c2ad26800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55ada201c360 con 0x55ada20ef650 2024-09-13T23:07:20.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.536+0000 7f1c26913640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55ada20ef650 0x55ada217e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.536+0000 7f1c26112640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55ada217e720 0x55ada2180b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:37950/0 (socket says 172.21.15.164:37950) 2024-09-13T23:07:20.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.536+0000 7f1c26913640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55ada20ef650 0x55ada217e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54968/0 (socket says 172.21.15.164:54968) 2024-09-13T23:07:20.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.536+0000 7f1c26112640 1 -- 172.21.15.164:0/3265133790 learned_addr learned my addr 172.21.15.164:0/3265133790 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:07:20.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.536+0000 7f1c26913640 1 -- 172.21.15.164:0/3265133790 >> v1:172.21.15.17:6789/0 conn(0x55ada217e720 legacy=0x55ada2180b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.536+0000 7f1c26913640 1 -- 172.21.15.164:0/3265133790 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ada2042e00 con 0x55ada20ef650 2024-09-13T23:07:20.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.538+0000 7f1c26913640 1 --2- 172.21.15.164:0/3265133790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada20ef650 0x55ada217e1e0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f1c18005fd0 tx=0x7f1c18045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87f5a8020230726 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.538+0000 7f1c25911640 1 -- 172.21.15.164:0/3265133790 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c18058530 con 0x55ada20ef650 2024-09-13T23:07:20.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.538+0000 7f1c25911640 1 -- 172.21.15.164:0/3265133790 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c180586d0 con 0x55ada20ef650 2024-09-13T23:07:20.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.538+0000 7f1c25911640 1 -- 172.21.15.164:0/3265133790 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c180589d0 con 0x55ada20ef650 2024-09-13T23:07:20.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.539+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3265133790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada20ef650 msgr2=0x55ada217e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.539+0000 7f1c2ad26800 1 --2- 172.21.15.164:0/3265133790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada20ef650 0x55ada217e1e0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f1c18005fd0 tx=0x7f1c18045c30 comp rx=0 tx=0).stop 2024-09-13T23:07:20.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.539+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3265133790 shutdown_connections 2024-09-13T23:07:20.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.539+0000 7f1c2ad26800 1 --2- 172.21.15.164:0/3265133790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada20ef650 0x55ada217e1e0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.539+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3265133790 >> 172.21.15.164:0/3265133790 conn(0x55ada2175db0 msgr2=0x55ada21781d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.539+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3265133790 shutdown_connections 2024-09-13T23:07:20.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.539+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3265133790 wait complete. 2024-09-13T23:07:20.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.552+0000 7f1c2ad26800 1 Processor -- start 2024-09-13T23:07:20.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.553+0000 7f1c2ad26800 1 -- start start 2024-09-13T23:07:20.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.553+0000 7f1c2ad26800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada20ef650 0x55ada226a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.553+0000 7f1c2ad26800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ada20c7360 con 0x55ada20ef650 2024-09-13T23:07:20.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.553+0000 7f1c26913640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada20ef650 0x55ada226a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.553+0000 7f1c26913640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada20ef650 0x55ada226a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54972/0 (socket says 172.21.15.164:54972) 2024-09-13T23:07:20.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.553+0000 7f1c26913640 1 -- 172.21.15.164:0/4014093686 learned_addr learned my addr 172.21.15.164:0/4014093686 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.553+0000 7f1c26913640 1 -- 172.21.15.164:0/4014093686 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ada2014bc0 con 0x55ada20ef650 2024-09-13T23:07:20.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.553+0000 7f1c26913640 1 --2- 172.21.15.164:0/4014093686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada20ef650 0x55ada226a920 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f1c1800a3f0 tx=0x7f1c18051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed989258c1015cee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.554+0000 7f1b14e09640 1 -- 172.21.15.164:0/4014093686 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c180589b0 con 0x55ada20ef650 2024-09-13T23:07:20.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.554+0000 7f1b14e09640 1 -- 172.21.15.164:0/4014093686 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c18068070 con 0x55ada20ef650 2024-09-13T23:07:20.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.554+0000 7f1b14e09640 1 -- 172.21.15.164:0/4014093686 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c18058c80 con 0x55ada20ef650 2024-09-13T23:07:20.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.554+0000 7f1c2ad26800 1 -- 172.21.15.164:0/4014093686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada20ef650 msgr2=0x55ada226a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.554+0000 7f1c2ad26800 1 --2- 172.21.15.164:0/4014093686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada20ef650 0x55ada226a920 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f1c1800a3f0 tx=0x7f1c18051000 comp rx=0 tx=0).stop 2024-09-13T23:07:20.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.554+0000 7f1c2ad26800 1 -- 172.21.15.164:0/4014093686 shutdown_connections 2024-09-13T23:07:20.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.554+0000 7f1c2ad26800 1 --2- 172.21.15.164:0/4014093686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada20ef650 0x55ada226a920 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.554+0000 7f1c2ad26800 1 -- 172.21.15.164:0/4014093686 >> 172.21.15.164:0/4014093686 conn(0x55ada2175db0 msgr2=0x55ada22662e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.554+0000 7f1c2ad26800 1 -- 172.21.15.164:0/4014093686 shutdown_connections 2024-09-13T23:07:20.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.554+0000 7f1c2ad26800 1 -- 172.21.15.164:0/4014093686 wait complete. 2024-09-13T23:07:20.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.555+0000 7f1c2ad26800 1 Processor -- start 2024-09-13T23:07:20.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.555+0000 7f1c2ad26800 1 -- start start 2024-09-13T23:07:20.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.555+0000 7f1c2ad26800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada20ef650 0x55ada2272240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.555+0000 7f1c2ad26800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ada2182620 con 0x55ada20ef650 2024-09-13T23:07:20.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.555+0000 7f1c26913640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada20ef650 0x55ada2272240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.555+0000 7f1c26913640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada20ef650 0x55ada2272240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54976/0 (socket says 172.21.15.164:54976) 2024-09-13T23:07:20.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.555+0000 7f1c26913640 1 -- 172.21.15.164:0/1282044969 learned_addr learned my addr 172.21.15.164:0/1282044969 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.555+0000 7f1c26913640 1 -- 172.21.15.164:0/1282044969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ada2028fe0 con 0x55ada20ef650 2024-09-13T23:07:20.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.555+0000 7f1c26913640 1 --2- 172.21.15.164:0/1282044969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada20ef650 0x55ada2272240 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f1c18065040 tx=0x7f1c18003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.556+0000 7f1b13606640 1 -- 172.21.15.164:0/1282044969 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c18063650 con 0x55ada20ef650 2024-09-13T23:07:20.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.556+0000 7f1b13606640 1 -- 172.21.15.164:0/1282044969 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c180637f0 con 0x55ada20ef650 2024-09-13T23:07:20.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.556+0000 7f1c2ad26800 1 -- 172.21.15.164:0/1282044969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ada2272780 con 0x55ada20ef650 2024-09-13T23:07:20.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.556+0000 7f1b13606640 1 -- 172.21.15.164:0/1282044969 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c18063af0 con 0x55ada20ef650 2024-09-13T23:07:20.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.556+0000 7f1c2ad26800 1 -- 172.21.15.164:0/1282044969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ada2272ca0 con 0x55ada20ef650 2024-09-13T23:07:20.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.556+0000 7f1b13606640 1 -- 172.21.15.164:0/1282044969 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1c18074020 con 0x55ada20ef650 2024-09-13T23:07:20.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.557+0000 7f1b13606640 1 --2- 172.21.15.164:0/1282044969 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b0c036b40 0x7f1b0c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.557+0000 7f1b13606640 1 -- 172.21.15.164:0/1282044969 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1c18090a90 con 0x55ada20ef650 2024-09-13T23:07:20.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.557+0000 7f1c26112640 1 --2- 172.21.15.164:0/1282044969 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b0c036b40 0x7f1b0c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.557+0000 7f1c2ad26800 1 --2- 172.21.15.164:0/1282044969 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ada217e720 0x55ada22792b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.557+0000 7f1c2ad26800 1 -- 172.21.15.164:0/1282044969 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ada22797f0 con 0x55ada217e720 2024-09-13T23:07:20.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.557+0000 7f1c27114640 1 --2- 172.21.15.164:0/1282044969 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ada217e720 0x55ada22792b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.557+0000 7f1c26112640 1 --2- 172.21.15.164:0/1282044969 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b0c036b40 0x7f1b0c039000 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c000f60 tx=0x7f1c1c0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.557+0000 7f1c27114640 1 --2- 172.21.15.164:0/1282044969 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ada217e720 0x55ada22792b0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.558+0000 7f1c27114640 1 -- 172.21.15.164:0/1282044969 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c200083e0 con 0x55ada217e720 2024-09-13T23:07:20.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.558+0000 7f1c2ad26800 1 -- 172.21.15.164:0/1282044969 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ada2276860 con 0x55ada217e720 2024-09-13T23:07:20.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.558+0000 7f1c27114640 1 -- 172.21.15.164:0/1282044969 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1c200083e0 con 0x55ada217e720 2024-09-13T23:07:20.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.558+0000 7f1c2ad26800 1 -- 172.21.15.164:0/1282044969 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ada227b5f0 con 0x55ada217e720 2024-09-13T23:07:20.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.558+0000 7f1c27114640 1 -- 172.21.15.164:0/1282044969 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1c200083e0 con 0x55ada217e720 2024-09-13T23:07:20.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.558+0000 7f1c2ad26800 1 -- 172.21.15.164:0/1282044969 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ada227a820 con 0x55ada217e720 2024-09-13T23:07:20.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.558+0000 7f1c27114640 1 -- 172.21.15.164:0/1282044969 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1c200083e0 con 0x55ada217e720 2024-09-13T23:07:20.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.558+0000 7f1c2ad26800 1 -- 172.21.15.164:0/1282044969 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ada227ac10 con 0x55ada217e720 2024-09-13T23:07:20.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.559+0000 7f1c27114640 1 -- 172.21.15.164:0/1282044969 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1c200083e0 con 0x55ada217e720 2024-09-13T23:07:20.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.559+0000 7f1c2ad26800 1 Processor -- start 2024-09-13T23:07:20.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.559+0000 7f1c2ad26800 1 -- start start 2024-09-13T23:07:20.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.559+0000 7f1c2ad26800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada2289c30 0x55ada228a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.559+0000 7f1c2ad26800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ada2016580 con 0x55ada2289c30 2024-09-13T23:07:20.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.560+0000 7f1c26112640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada2289c30 0x55ada228a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.560+0000 7f1c26112640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada2289c30 0x55ada228a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54986/0 (socket says 172.21.15.164:54986) 2024-09-13T23:07:20.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.560+0000 7f1c26112640 1 -- 172.21.15.164:0/100710977 learned_addr learned my addr 172.21.15.164:0/100710977 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.560+0000 7f1c26112640 1 -- 172.21.15.164:0/100710977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ada228a590 con 0x55ada2289c30 2024-09-13T23:07:20.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.560+0000 7f1c26112640 1 --2- 172.21.15.164:0/100710977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada2289c30 0x55ada228a050 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c001ed0 tx=0x7f1c1c00d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.560+0000 7f1b10e01640 1 -- 172.21.15.164:0/100710977 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c1c01b550 con 0x55ada2289c30 2024-09-13T23:07:20.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.560+0000 7f1b10e01640 1 -- 172.21.15.164:0/100710977 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c1c01b6f0 con 0x55ada2289c30 2024-09-13T23:07:20.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.560+0000 7f1c2ad26800 1 -- 172.21.15.164:0/100710977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ada228a820 con 0x55ada2289c30 2024-09-13T23:07:20.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.560+0000 7f1b10e01640 1 -- 172.21.15.164:0/100710977 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c1c01b9d0 con 0x55ada2289c30 2024-09-13T23:07:20.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.560+0000 7f1c2ad26800 1 -- 172.21.15.164:0/100710977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ada228d500 con 0x55ada2289c30 2024-09-13T23:07:20.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.561+0000 7f1b10e01640 1 -- 172.21.15.164:0/100710977 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1c1c023020 con 0x55ada2289c30 2024-09-13T23:07:20.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.561+0000 7f1b10e01640 1 --2- 172.21.15.164:0/100710977 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b00036b40 0x7f1b00039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.561+0000 7f1b10e01640 1 -- 172.21.15.164:0/100710977 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1c1c021020 con 0x55ada2289c30 2024-09-13T23:07:20.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.561+0000 7f1c27114640 1 --2- 172.21.15.164:0/100710977 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b00036b40 0x7f1b00039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.562+0000 7f1c2ad26800 1 Processor -- start 2024-09-13T23:07:20.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.562+0000 7f1c27114640 1 --2- 172.21.15.164:0/100710977 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b00036b40 0x7f1b00039000 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55ada227a340 tx=0x7f1c20000f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.562+0000 7f1c2ad26800 1 -- start start 2024-09-13T23:07:20.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.562+0000 7f1c2ad26800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada2296940 0x55ada2296d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.562+0000 7f1c2ad26800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ada226b010 con 0x55ada2296940 2024-09-13T23:07:20.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.562+0000 7f1c26112640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada2296940 0x55ada2296d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.562+0000 7f1c26112640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada2296940 0x55ada2296d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54990/0 (socket says 172.21.15.164:54990) 2024-09-13T23:07:20.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.562+0000 7f1c26112640 1 -- 172.21.15.164:0/862842606 learned_addr learned my addr 172.21.15.164:0/862842606 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.562+0000 7f1c26112640 1 -- 172.21.15.164:0/862842606 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ada2297310 con 0x55ada2296940 2024-09-13T23:07:20.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.562+0000 7f1c26112640 1 --2- 172.21.15.164:0/862842606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada2296940 0x55ada2296d40 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c04d180 tx=0x7f1c1c046be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87e4ae1b4d6b9e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.562+0000 7f1b0a7fc640 1 -- 172.21.15.164:0/862842606 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c1c01be20 con 0x55ada2296940 2024-09-13T23:07:20.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.563+0000 7f1b0a7fc640 1 -- 172.21.15.164:0/862842606 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c1c046070 con 0x55ada2296940 2024-09-13T23:07:20.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.563+0000 7f1b0a7fc640 1 -- 172.21.15.164:0/862842606 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c1c00c360 con 0x55ada2296940 2024-09-13T23:07:20.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.563+0000 7f1c2ad26800 1 -- 172.21.15.164:0/862842606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada2296940 msgr2=0x55ada2296d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.563+0000 7f1c2ad26800 1 --2- 172.21.15.164:0/862842606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada2296940 0x55ada2296d40 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c04d180 tx=0x7f1c1c046be0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.563+0000 7f1c2ad26800 1 -- 172.21.15.164:0/862842606 shutdown_connections 2024-09-13T23:07:20.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.563+0000 7f1c2ad26800 1 --2- 172.21.15.164:0/862842606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada2296940 0x55ada2296d40 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.563+0000 7f1c2ad26800 1 -- 172.21.15.164:0/862842606 >> 172.21.15.164:0/862842606 conn(0x55ada2292ca0 msgr2=0x55ada2290da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.563+0000 7f1c2ad26800 1 -- 172.21.15.164:0/862842606 shutdown_connections 2024-09-13T23:07:20.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.563+0000 7f1c2ad26800 1 -- 172.21.15.164:0/862842606 wait complete. 2024-09-13T23:07:20.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.563+0000 7f1c2ad26800 1 Processor -- start 2024-09-13T23:07:20.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.563+0000 7f1c2ad26800 1 -- start start 2024-09-13T23:07:20.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.563+0000 7f1c2ad26800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada2296940 0x55ada229de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.563+0000 7f1c2ad26800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ada2297980 con 0x55ada2296940 2024-09-13T23:07:20.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.564+0000 7f1c26112640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada2296940 0x55ada229de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.564+0000 7f1c26112640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada2296940 0x55ada229de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:54996/0 (socket says 172.21.15.164:54996) 2024-09-13T23:07:20.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.564+0000 7f1c26112640 1 -- 172.21.15.164:0/3718921140 learned_addr learned my addr 172.21.15.164:0/3718921140 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.564+0000 7f1c26112640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ada229e390 con 0x55ada2296940 2024-09-13T23:07:20.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.564+0000 7f1c26112640 1 --2- 172.21.15.164:0/3718921140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada2296940 0x55ada229de50 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c048010 tx=0x7f1c1c04d110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.564+0000 7f1b08ff9640 1 -- 172.21.15.164:0/3718921140 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c1c01be20 con 0x55ada2296940 2024-09-13T23:07:20.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.564+0000 7f1b08ff9640 1 -- 172.21.15.164:0/3718921140 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c1c00c360 con 0x55ada2296940 2024-09-13T23:07:20.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.564+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ada229e620 con 0x55ada2296940 2024-09-13T23:07:20.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.564+0000 7f1b08ff9640 1 -- 172.21.15.164:0/3718921140 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c1c046d10 con 0x55ada2296940 2024-09-13T23:07:20.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.564+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ada229e620 con 0x55ada2296940 2024-09-13T23:07:20.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.565+0000 7f1b08ff9640 1 -- 172.21.15.164:0/3718921140 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1c1c025980 con 0x55ada2296940 2024-09-13T23:07:20.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.565+0000 7f1b08ff9640 1 --2- 172.21.15.164:0/3718921140 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1af0036b40 0x7f1af0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.565+0000 7f1b08ff9640 1 -- 172.21.15.164:0/3718921140 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1c1c030050 con 0x55ada2296940 2024-09-13T23:07:20.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.566+0000 7f1c27114640 1 --2- 172.21.15.164:0/3718921140 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1af0036b40 0x7f1af0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.566+0000 7f1c27114640 1 --2- 172.21.15.164:0/3718921140 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1af0036b40 0x7f1af0039000 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1c2000f010 tx=0x7f1c2000c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.566+0000 7f1c2ad26800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.566+0000 7f1c2ad26800 1 --2- 172.21.15.164:0/3718921140 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ada22a97a0 0x55ada22abc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.566+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ada22ac3b0 con 0x55ada22a97a0 2024-09-13T23:07:20.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.566+0000 7f1c26913640 1 --2- 172.21.15.164:0/3718921140 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ada22a97a0 0x55ada22abc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.566+0000 7f1c26913640 1 --2- 172.21.15.164:0/3718921140 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ada22a97a0 0x55ada22abc60 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.567+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c1806c3f0 con 0x55ada22a97a0 2024-09-13T23:07:20.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.567+0000 7f1c2ad26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.567+0000 7f1c2ad26800 20 realm 2024-09-13T23:07:20.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.567+0000 7f1c2ad26800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.567+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ada22ac7c0 con 0x55ada22a97a0 2024-09-13T23:07:20.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.567+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c1806c3f0 con 0x55ada22a97a0 2024-09-13T23:07:20.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.567+0000 7f1c2ad26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.567+0000 7f1c2ad26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:07:20.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.567+0000 7f1c2ad26800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.567+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ada22ad090 con 0x55ada22a97a0 2024-09-13T23:07:20.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.567+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c1806c3f0 con 0x55ada22a97a0 2024-09-13T23:07:20.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.567+0000 7f1c2ad26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.567+0000 7f1c2ad26800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.567+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ada22ad430 con 0x55ada22a97a0 2024-09-13T23:07:20.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.567+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1c1806c3f0 con 0x55ada22a97a0 2024-09-13T23:07:20.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.567+0000 7f1c2ad26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:20.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.567+0000 7f1c2ad26800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.567+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ada22adc80 con 0x55ada22a97a0 2024-09-13T23:07:20.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.568+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1c1806c3f0 con 0x55ada22a97a0 2024-09-13T23:07:20.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.568+0000 7f1c2ad26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:07:20.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.568+0000 7f1c2ad26800 20 searching for the correct realm 2024-09-13T23:07:20.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.568+0000 7f1c2ad26800 1 --2- 172.21.15.164:0/3718921140 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55ada22af9f0 0x55ada22b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.568+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x55ada22af9f0 2024-09-13T23:07:20.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.568+0000 7f1c26112640 1 --2- 172.21.15.164:0/3718921140 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55ada22af9f0 0x55ada22b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.568+0000 7f1c26112640 1 --2- 172.21.15.164:0/3718921140 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55ada22af9f0 0x55ada22b1de0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.568+0000 7f1c26112640 1 -- 172.21.15.164:0/3718921140 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1c009050 con 0x55ada22af9f0 2024-09-13T23:07:20.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.568+0000 7f1c26112640 1 --2- 172.21.15.164:0/3718921140 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f1c1c023c20 0x7f1c1c00c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.568+0000 7f1c26112640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x7f1c1c023c20 2024-09-13T23:07:20.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.568+0000 7f1c27114640 1 --2- 172.21.15.164:0/3718921140 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f1c1c023c20 0x7f1c1c00c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.569+0000 7f1c27114640 1 --2- 172.21.15.164:0/3718921140 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f1c1c023c20 0x7f1c1c00c580 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.569+0000 7f1c27114640 1 -- 172.21.15.164:0/3718921140 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c2002f040 con 0x7f1c1c023c20 2024-09-13T23:07:20.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.569+0000 7f1c27114640 1 --2- 172.21.15.164:0/3718921140 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f1c20019040 0x7f1c20019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.569+0000 7f1c27114640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x7f1c20019040 2024-09-13T23:07:20.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.569+0000 7f1c26913640 1 --2- 172.21.15.164:0/3718921140 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f1c20019040 0x7f1c20019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.570+0000 7f1c26913640 1 --2- 172.21.15.164:0/3718921140 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f1c20019040 0x7f1c20019930 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.570+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1806c3f0 con 0x7f1c20019040 2024-09-13T23:07:20.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.570+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x55ada22a97a0 2024-09-13T23:07:20.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.570+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1c1806c3f0 con 0x55ada22a97a0 2024-09-13T23:07:20.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.570+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x55ada22a97a0 2024-09-13T23:07:20.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.570+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1806c3f0 con 0x55ada22a97a0 2024-09-13T23:07:20.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.570+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x7f1c20019040 2024-09-13T23:07:20.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.571+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1806c3f0 con 0x7f1c20019040 2024-09-13T23:07:20.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.571+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x7f1c20019040 2024-09-13T23:07:20.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.571+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1806c3f0 con 0x7f1c20019040 2024-09-13T23:07:20.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.571+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x7f1c1c023c20 2024-09-13T23:07:20.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.571+0000 7f1c27114640 1 -- 172.21.15.164:0/3718921140 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c2002f040 con 0x7f1c1c023c20 2024-09-13T23:07:20.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.571+0000 7f1c27114640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x55ada22af9f0 2024-09-13T23:07:20.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.571+0000 7f1c26112640 1 -- 172.21.15.164:0/3718921140 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1c009050 con 0x55ada22af9f0 2024-09-13T23:07:20.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.571+0000 7f1c26112640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x55ada22a97a0 2024-09-13T23:07:20.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.572+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1806c3f0 con 0x55ada22a97a0 2024-09-13T23:07:20.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.572+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x7f1c20019040 2024-09-13T23:07:20.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.572+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1806c3f0 con 0x7f1c20019040 2024-09-13T23:07:20.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.572+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x55ada22a97a0 2024-09-13T23:07:20.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.572+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1806c3f0 con 0x55ada22a97a0 2024-09-13T23:07:20.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.572+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x7f1c1c023c20 2024-09-13T23:07:20.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.572+0000 7f1c27114640 1 -- 172.21.15.164:0/3718921140 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1c2002f040 con 0x7f1c1c023c20 2024-09-13T23:07:20.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.572+0000 7f1c27114640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x55ada22af9f0 2024-09-13T23:07:20.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.573+0000 7f1c26112640 1 -- 172.21.15.164:0/3718921140 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1c009050 con 0x55ada22af9f0 2024-09-13T23:07:20.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.573+0000 7f1c26112640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x55ada22af9f0 2024-09-13T23:07:20.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.573+0000 7f1c26112640 1 -- 172.21.15.164:0/3718921140 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1c009050 con 0x55ada22af9f0 2024-09-13T23:07:20.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.573+0000 7f1c26112640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x7f1c20019040 2024-09-13T23:07:20.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.573+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1806c3f0 con 0x7f1c20019040 2024-09-13T23:07:20.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.573+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x55ada22af9f0 2024-09-13T23:07:20.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.573+0000 7f1c26112640 1 -- 172.21.15.164:0/3718921140 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1c009050 con 0x55ada22af9f0 2024-09-13T23:07:20.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.573+0000 7f1c26112640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x55ada22af9f0 2024-09-13T23:07:20.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.573+0000 7f1c26112640 1 -- 172.21.15.164:0/3718921140 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1c009050 con 0x55ada22af9f0 2024-09-13T23:07:20.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.573+0000 7f1c26112640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x55ada22a97a0 2024-09-13T23:07:20.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.574+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1806c3f0 con 0x55ada22a97a0 2024-09-13T23:07:20.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.574+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x55ada22a97a0 2024-09-13T23:07:20.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.574+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1c1806c3f0 con 0x55ada22a97a0 2024-09-13T23:07:20.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.574+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x7f1c20019040 2024-09-13T23:07:20.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.574+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1806c3f0 con 0x7f1c20019040 2024-09-13T23:07:20.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.574+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x55ada22af9f0 2024-09-13T23:07:20.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.574+0000 7f1c26112640 1 -- 172.21.15.164:0/3718921140 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1c009050 con 0x55ada22af9f0 2024-09-13T23:07:20.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.574+0000 7f1c26112640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x7f1c1c023c20 2024-09-13T23:07:20.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.575+0000 7f1c27114640 1 -- 172.21.15.164:0/3718921140 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c2002f040 con 0x7f1c1c023c20 2024-09-13T23:07:20.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.575+0000 7f1c27114640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x55ada22a97a0 2024-09-13T23:07:20.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.575+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1c1806c3f0 con 0x55ada22a97a0 2024-09-13T23:07:20.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.575+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x7f1c20019040 2024-09-13T23:07:20.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.575+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1806c3f0 con 0x7f1c20019040 2024-09-13T23:07:20.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.575+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x55ada22af9f0 2024-09-13T23:07:20.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.575+0000 7f1c26112640 1 -- 172.21.15.164:0/3718921140 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1c009050 con 0x55ada22af9f0 2024-09-13T23:07:20.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.575+0000 7f1c26112640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x7f1c20019040 2024-09-13T23:07:20.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.576+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1806c3f0 con 0x7f1c20019040 2024-09-13T23:07:20.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.576+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x7f1c1c023c20 2024-09-13T23:07:20.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.576+0000 7f1c27114640 1 -- 172.21.15.164:0/3718921140 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c2002f040 con 0x7f1c1c023c20 2024-09-13T23:07:20.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.576+0000 7f1c27114640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x55ada22af9f0 2024-09-13T23:07:20.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.576+0000 7f1c26112640 1 -- 172.21.15.164:0/3718921140 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1c009050 con 0x55ada22af9f0 2024-09-13T23:07:20.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.576+0000 7f1c26112640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x7f1c1c023c20 2024-09-13T23:07:20.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.576+0000 7f1c27114640 1 -- 172.21.15.164:0/3718921140 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c2002f040 con 0x7f1c1c023c20 2024-09-13T23:07:20.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.576+0000 7f1c27114640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x55ada22a97a0 2024-09-13T23:07:20.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.577+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1c1806c3f0 con 0x55ada22a97a0 2024-09-13T23:07:20.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.577+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b2410 con 0x7f1c1c023c20 2024-09-13T23:07:20.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.577+0000 7f1c27114640 1 -- 172.21.15.164:0/3718921140 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c2002f040 con 0x7f1c1c023c20 2024-09-13T23:07:20.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.577+0000 7f1c2ad26800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:07:20.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.577+0000 7f1c2ad26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:07:20.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.577+0000 7f1c2ad26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:07:20.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.577+0000 7f1c2ad26800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:07:20.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.577+0000 7f1c2ad26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:07:20.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.577+0000 7f1c2ad26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:07:20.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.577+0000 7f1c2ad26800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.577+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ada22ae630 con 0x55ada22a97a0 2024-09-13T23:07:20.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.577+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c1806c3f0 con 0x55ada22a97a0 2024-09-13T23:07:20.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.577+0000 7f1c2ad26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.577+0000 7f1c2ad26800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.577+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ada22aea20 con 0x55ada22a97a0 2024-09-13T23:07:20.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.577+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1c1806c3f0 con 0x55ada22a97a0 2024-09-13T23:07:20.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.577+0000 7f1c2ad26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:20.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.577+0000 7f1c2ad26800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.577+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ada22aea20 con 0x55ada22a97a0 2024-09-13T23:07:20.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.578+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1c1806c3f0 con 0x55ada22a97a0 2024-09-13T23:07:20.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.578+0000 7f1c2ad26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:07:20.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.578+0000 7f1c2ad26800 20 zone default found 2024-09-13T23:07:20.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.578+0000 7f1c2ad26800 4 Realm: () 2024-09-13T23:07:20.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.578+0000 7f1c2ad26800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:07:20.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.578+0000 7f1c2ad26800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:07:20.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.578+0000 7f1c2ad26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:07:20.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.578+0000 7f1c2ad26800 20 zonegroup default 2024-09-13T23:07:20.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.578+0000 7f1c2ad26800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.578+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ada22aee40 con 0x7f1c20019040 2024-09-13T23:07:20.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.578+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1c1806c3f0 con 0x7f1c20019040 2024-09-13T23:07:20.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.578+0000 7f1c2ad26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.578+0000 7f1c2ad26800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.578+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ada22aee70 con 0x55ada22af9f0 2024-09-13T23:07:20.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.578+0000 7f1c26112640 1 -- 172.21.15.164:0/3718921140 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1c1c009050 con 0x55ada22af9f0 2024-09-13T23:07:20.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.578+0000 7f1c2ad26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.578+0000 7f1c2ad26800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.578+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b4370 con 0x55ada22af9f0 2024-09-13T23:07:20.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.578+0000 7f1c26112640 1 -- 172.21.15.164:0/3718921140 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1c1c009050 con 0x55ada22af9f0 2024-09-13T23:07:20.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.578+0000 7f1c2ad26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.578+0000 7f1c2ad26800 20 started sync module instance, tier type = 2024-09-13T23:07:20.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.578+0000 7f1c2ad26800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:07:20.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.579+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b3710 con 0x7f1c1c023c20 2024-09-13T23:07:20.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.580+0000 7f1c27114640 1 -- 172.21.15.164:0/3718921140 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c2002f040 con 0x7f1c1c023c20 2024-09-13T23:07:20.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.580+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94204238445632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b3710 con 0x7f1c1c023c20 2024-09-13T23:07:20.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.580+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b4ed0 con 0x55ada22a97a0 2024-09-13T23:07:20.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.581+0000 7f1c27114640 1 -- 172.21.15.164:0/3718921140 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94204238445632] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c2002f040 con 0x7f1c1c023c20 2024-09-13T23:07:20.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.581+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c1806c3f0 con 0x55ada22a97a0 2024-09-13T23:07:20.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.581+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94204238449056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b3710 con 0x55ada22a97a0 2024-09-13T23:07:20.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.581+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b5980 con 0x55ada22af9f0 2024-09-13T23:07:20.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.582+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94204238449056] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c1806c3f0 con 0x55ada22a97a0 2024-09-13T23:07:20.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.582+0000 7f1c26112640 1 -- 172.21.15.164:0/3718921140 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c1c009050 con 0x55ada22af9f0 2024-09-13T23:07:20.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.582+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94204238443104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b3680 con 0x55ada22af9f0 2024-09-13T23:07:20.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.582+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b6840 con 0x7f1c1c023c20 2024-09-13T23:07:20.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.583+0000 7f1c26112640 1 -- 172.21.15.164:0/3718921140 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94204238443104] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c1c009050 con 0x55ada22af9f0 2024-09-13T23:07:20.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.583+0000 7f1c27114640 1 -- 172.21.15.164:0/3718921140 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c2002f040 con 0x7f1c1c023c20 2024-09-13T23:07:20.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.583+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94204238455696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b67b0 con 0x7f1c1c023c20 2024-09-13T23:07:20.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.583+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b7700 con 0x55ada22a97a0 2024-09-13T23:07:20.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.584+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c1806c3f0 con 0x55ada22a97a0 2024-09-13T23:07:20.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.584+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94204238459472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b7670 con 0x55ada22a97a0 2024-09-13T23:07:20.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.584+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b8670 con 0x7f1c20019040 2024-09-13T23:07:20.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.584+0000 7f1c27114640 1 -- 172.21.15.164:0/3718921140 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94204238455696] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c2002f040 con 0x7f1c1c023c20 2024-09-13T23:07:20.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.585+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c1806c3f0 con 0x7f1c20019040 2024-09-13T23:07:20.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.585+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94204238457904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b8670 con 0x7f1c20019040 2024-09-13T23:07:20.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.585+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b90b0 con 0x7f1c20019040 2024-09-13T23:07:20.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.586+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94204238459472] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c1806c3f0 con 0x55ada22a97a0 2024-09-13T23:07:20.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.586+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94204238457904] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c1806c3f0 con 0x7f1c20019040 2024-09-13T23:07:20.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.587+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c1806c3f0 con 0x7f1c20019040 2024-09-13T23:07:20.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.587+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94204238463424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b8c00 con 0x7f1c20019040 2024-09-13T23:07:20.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.587+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b95c0 con 0x7f1c20019040 2024-09-13T23:07:20.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.588+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94204238463424] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c1806c3f0 con 0x7f1c20019040 2024-09-13T23:07:20.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.588+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c1806c3f0 con 0x7f1c20019040 2024-09-13T23:07:20.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.588+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94204238464480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b95c0 con 0x7f1c20019040 2024-09-13T23:07:20.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.588+0000 7f1c2ad26800 20 add_watcher() i=0 2024-09-13T23:07:20.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.588+0000 7f1c2ad26800 20 add_watcher() i=1 2024-09-13T23:07:20.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.588+0000 7f1c2ad26800 20 add_watcher() i=2 2024-09-13T23:07:20.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.588+0000 7f1c2ad26800 20 add_watcher() i=3 2024-09-13T23:07:20.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.588+0000 7f1c2ad26800 20 add_watcher() i=4 2024-09-13T23:07:20.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.588+0000 7f1c2ad26800 20 add_watcher() i=5 2024-09-13T23:07:20.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.588+0000 7f1c2ad26800 20 add_watcher() i=6 2024-09-13T23:07:20.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.589+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94204238464480] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c1806c3f0 con 0x7f1c20019040 2024-09-13T23:07:20.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.589+0000 7f1c2ad26800 20 add_watcher() i=7 2024-09-13T23:07:20.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.589+0000 7f1c2ad26800 2 all 8 watchers are set, enabling cache 2024-09-13T23:07:20.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.589+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ada22bc8b0 con 0x55ada22a97a0 2024-09-13T23:07:20.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.589+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1c1806c3f0 con 0x55ada22a97a0 2024-09-13T23:07:20.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.589+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94204238467712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b9b50 con 0x55ada22a97a0 2024-09-13T23:07:20.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.590+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94204238467712] v34'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1c1806c3f0 con 0x55ada22a97a0 2024-09-13T23:07:20.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.590+0000 7f1add7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:20.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.590+0000 7f1c2ad26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:07:20.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.590+0000 7f1c2ad26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:07:20.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.590+0000 7f1c2ad26800 5 note: GC not initialized 2024-09-13T23:07:20.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.590+0000 7f1a57fff640 20 reqs_thread_entry: start 2024-09-13T23:07:20.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.590+0000 7f1c2ad26800 20 init_complete bucket index max shards: 11 2024-09-13T23:07:20.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.591+0000 7f1c2ad26800 20 Filter name: none 2024-09-13T23:07:20.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.591+0000 7f1a55ffb640 20 reqs_thread_entry: start 2024-09-13T23:07:20.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.591+0000 7f1c2ad26800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T23:07:20.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.591+0000 7f1c2ad26800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.591+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ada22efd60 con 0x7f1c20019040 2024-09-13T23:07:20.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.591+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f1c1806c3f0 con 0x7f1c20019040 2024-09-13T23:07:20.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.591+0000 7f1c2ad26800 20 rados_obj.operate() r=0 bl.length=490 2024-09-13T23:07:20.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.591+0000 7f1c2ad26800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T23:07:20.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.591+0000 7f1c2ad26800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:20.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.591+0000 7f1c2ad26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:07:20.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.591+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ada22f6530 con 0x7f1c20019040 2024-09-13T23:07:20.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.593+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1c1806c3f0 con 0x7f1c20019040 2024-09-13T23:07:20.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.593+0000 7f1c2ad26800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:07:20.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.593+0000 7f1c2ad26800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:20.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.593+0000 7f1c2ad26800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T23:07:20.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.593+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94204238716656 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ada22f1b70 con 0x55ada22a97a0 2024-09-13T23:07:20.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.593+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== watch-notify(notify (1) cookie 94204238459472 notify 146028888097 ret 0) ==== 678+0+0 (crc 0 0 0) 0x55ada2272ca0 con 0x55ada22a97a0 2024-09-13T23:07:20.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.593+0000 7f1b0a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888097 cookie 94204238459472 notifier 4917 bl.length()=636 2024-09-13T23:07:20.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.593+0000 7f1b0a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:07:20.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.593+0000 7f1b0a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:20.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.593+0000 7f1b0a7fc640 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1aec003ea0 con 0x55ada22a97a0 2024-09-13T23:07:20.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.593+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(64 notify.4 [notify cookie 94204238716656 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1c1806c3f0 con 0x55ada22a97a0 2024-09-13T23:07:20.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.593+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c1806c3f0 con 0x55ada22a97a0 2024-09-13T23:07:20.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.593+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== watch-notify(notify_complete (2) cookie 94204238716656 notify 146028888097 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ada2272780 con 0x55ada22a97a0 2024-09-13T23:07:20.606 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T23:07:18.801026Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:07:18.801015Z","tags":[],"group_ids":[]} 2024-09-13T23:07:20.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.594+0000 7f1add7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:20.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.594+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94204238467712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ada22edaa0 con 0x55ada22a97a0 2024-09-13T23:07:20.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.595+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94204238467712] v34'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1c1806c3f0 con 0x55ada22a97a0 2024-09-13T23:07:20.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.595+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94204238445632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ada22edaa0 con 0x7f1c1c023c20 2024-09-13T23:07:20.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.596+0000 7f1c27114640 1 -- 172.21.15.164:0/3718921140 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94204238445632] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c2002f040 con 0x7f1c1c023c20 2024-09-13T23:07:20.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.596+0000 7f1c2ad26800 20 remove_watcher() i=0 2024-09-13T23:07:20.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.596+0000 7f1c2ad26800 2 removed watcher, disabling cache 2024-09-13T23:07:20.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.596+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94204238449056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ada22edaa0 con 0x55ada22a97a0 2024-09-13T23:07:20.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.597+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94204238449056] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c1806c3f0 con 0x55ada22a97a0 2024-09-13T23:07:20.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.597+0000 7f1c2ad26800 20 remove_watcher() i=1 2024-09-13T23:07:20.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.597+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94204238443104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ada22edaa0 con 0x55ada22af9f0 2024-09-13T23:07:20.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.598+0000 7f1c26112640 1 -- 172.21.15.164:0/3718921140 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94204238443104] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c1c009050 con 0x55ada22af9f0 2024-09-13T23:07:20.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.598+0000 7f1c2ad26800 20 remove_watcher() i=2 2024-09-13T23:07:20.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.598+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94204238455696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b3260 con 0x7f1c1c023c20 2024-09-13T23:07:20.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.599+0000 7f1c27114640 1 -- 172.21.15.164:0/3718921140 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94204238455696] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c2002f040 con 0x7f1c1c023c20 2024-09-13T23:07:20.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.599+0000 7f1c2ad26800 20 remove_watcher() i=3 2024-09-13T23:07:20.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.599+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94204238459472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b6390 con 0x55ada22a97a0 2024-09-13T23:07:20.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.600+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94204238459472] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c1806c3f0 con 0x55ada22a97a0 2024-09-13T23:07:20.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.600+0000 7f1c2ad26800 20 remove_watcher() i=4 2024-09-13T23:07:20.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.600+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94204238457904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b3260 con 0x7f1c20019040 2024-09-13T23:07:20.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.601+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94204238457904] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c1806c3f0 con 0x7f1c20019040 2024-09-13T23:07:20.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.601+0000 7f1c2ad26800 20 remove_watcher() i=5 2024-09-13T23:07:20.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.601+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94204238463424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b7250 con 0x7f1c20019040 2024-09-13T23:07:20.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.603+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94204238463424] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c1806c3f0 con 0x7f1c20019040 2024-09-13T23:07:20.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.603+0000 7f1c2ad26800 20 remove_watcher() i=6 2024-09-13T23:07:20.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.603+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94204238464480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ada22b6390 con 0x7f1c20019040 2024-09-13T23:07:20.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.604+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94204238464480] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c1806c3f0 con 0x7f1c20019040 2024-09-13T23:07:20.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.604+0000 7f1c2ad26800 20 remove_watcher() i=7 2024-09-13T23:07:20.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.604+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f1c20019040 msgr2=0x7f1c20019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.604+0000 7f1c2ad26800 1 --2- 172.21.15.164:0/3718921140 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f1c20019040 0x7f1c20019930 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.604+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ada22a97a0 msgr2=0x55ada22abc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.604+0000 7f1c2ad26800 1 --2- 172.21.15.164:0/3718921140 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ada22a97a0 0x55ada22abc60 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.604+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f1c1c023c20 msgr2=0x7f1c1c00c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.604+0000 7f1c2ad26800 1 --2- 172.21.15.164:0/3718921140 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f1c1c023c20 0x7f1c1c00c580 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.604+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55ada22af9f0 msgr2=0x55ada22b1de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.604+0000 7f1c2ad26800 1 --2- 172.21.15.164:0/3718921140 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55ada22af9f0 0x55ada22b1de0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.604+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1af0036b40 msgr2=0x7f1af0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.604+0000 7f1c2ad26800 1 --2- 172.21.15.164:0/3718921140 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1af0036b40 0x7f1af0039000 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1c2000f010 tx=0x7f1c2000c040 comp rx=0 tx=0).stop 2024-09-13T23:07:20.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.604+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada2296940 msgr2=0x55ada229de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.604+0000 7f1c2ad26800 1 --2- 172.21.15.164:0/3718921140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada2296940 0x55ada229de50 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c048010 tx=0x7f1c1c04d110 comp rx=0 tx=0).stop 2024-09-13T23:07:20.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.604+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 reap_dead start 2024-09-13T23:07:20.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.604+0000 7f1c26913640 1 -- 172.21.15.164:0/3718921140 reap_dead start 2024-09-13T23:07:20.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.604+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 shutdown_connections 2024-09-13T23:07:20.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.604+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 >> 172.21.15.164:0/3718921140 conn(0x55ada2292ca0 msgr2=0x55ada2290d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.604+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 shutdown_connections 2024-09-13T23:07:20.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.604+0000 7f1c2ad26800 1 -- 172.21.15.164:0/3718921140 wait complete. 2024-09-13T23:07:20.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.604+0000 7f1c2ad26800 1 -- 172.21.15.164:0/100710977 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b00036b40 msgr2=0x7f1b00039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.604+0000 7f1c2ad26800 1 --2- 172.21.15.164:0/100710977 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b00036b40 0x7f1b00039000 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55ada227a340 tx=0x7f1c20000f90 comp rx=0 tx=0).stop 2024-09-13T23:07:20.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.604+0000 7f1c2ad26800 1 -- 172.21.15.164:0/100710977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada2289c30 msgr2=0x55ada228a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.604+0000 7f1c2ad26800 1 --2- 172.21.15.164:0/100710977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada2289c30 0x55ada228a050 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c001ed0 tx=0x7f1c1c00d7a0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.605+0000 7f1c2ad26800 1 -- 172.21.15.164:0/100710977 shutdown_connections 2024-09-13T23:07:20.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.605+0000 7f1c2ad26800 1 --2- 172.21.15.164:0/100710977 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b00036b40 0x7f1b00039000 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.605+0000 7f1c2ad26800 1 --2- 172.21.15.164:0/100710977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada2289c30 0x55ada228a050 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.605+0000 7f1c2ad26800 1 -- 172.21.15.164:0/100710977 >> 172.21.15.164:0/100710977 conn(0x55ada227ebc0 msgr2=0x55ada2281740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.605+0000 7f1c2ad26800 1 -- 172.21.15.164:0/100710977 shutdown_connections 2024-09-13T23:07:20.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.605+0000 7f1c2ad26800 1 -- 172.21.15.164:0/100710977 wait complete. 2024-09-13T23:07:20.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.605+0000 7f1c2ad26800 1 -- 172.21.15.164:0/1282044969 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ada217e720 msgr2=0x55ada22792b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.605+0000 7f1c2ad26800 1 --2- 172.21.15.164:0/1282044969 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ada217e720 0x55ada22792b0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.605+0000 7f1c2ad26800 1 -- 172.21.15.164:0/1282044969 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b0c036b40 msgr2=0x7f1b0c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.605+0000 7f1c2ad26800 1 --2- 172.21.15.164:0/1282044969 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b0c036b40 0x7f1b0c039000 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c000f60 tx=0x7f1c1c0012b0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.605+0000 7f1c2ad26800 1 -- 172.21.15.164:0/1282044969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada20ef650 msgr2=0x55ada2272240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.605+0000 7f1c2ad26800 1 --2- 172.21.15.164:0/1282044969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada20ef650 0x55ada2272240 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f1c18065040 tx=0x7f1c18003330 comp rx=0 tx=0).stop 2024-09-13T23:07:20.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.605+0000 7f1c2ad26800 1 -- 172.21.15.164:0/1282044969 shutdown_connections 2024-09-13T23:07:20.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.605+0000 7f1c2ad26800 1 --2- 172.21.15.164:0/1282044969 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55ada217e720 0x55ada22792b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.605+0000 7f1c2ad26800 1 --2- 172.21.15.164:0/1282044969 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1b0c036b40 0x7f1b0c039000 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.605+0000 7f1c2ad26800 1 --2- 172.21.15.164:0/1282044969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ada20ef650 0x55ada2272240 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.605+0000 7f1c2ad26800 1 -- 172.21.15.164:0/1282044969 >> 172.21.15.164:0/1282044969 conn(0x55ada2175db0 msgr2=0x55ada2264b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.605+0000 7f1c2ad26800 1 -- 172.21.15.164:0/1282044969 shutdown_connections 2024-09-13T23:07:20.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.605+0000 7f1c2ad26800 1 -- 172.21.15.164:0/1282044969 wait complete. 2024-09-13T23:07:20.617 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:07:18.801026Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:07:18.801015Z', 'tags': [], 'group_ids': []} 2024-09-13T23:07:20.617 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:07:18.801026Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:07:18.801015Z', 'tags': [], 'group_ids': []} 2024-09-13T23:07:20.617 ERROR:root:0 2024-09-13T23:07:20.618 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T23:07:20.618 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T23:07:20.618 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-13T23:07:20.664 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:07:20.665 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:07:20.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.665+0000 7f93c0f26800 1 Processor -- start 2024-09-13T23:07:20.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.665+0000 7f93c0f26800 1 -- start start 2024-09-13T23:07:20.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.665+0000 7f93c0f26800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5603ddc30880 0x5603ddc32c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.665+0000 7f93c0f26800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5603ddaebb30 con 0x5603ddba06d0 2024-09-13T23:07:20.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.665+0000 7f93c0f26800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x5603ddacd360 con 0x5603ddc30880 2024-09-13T23:07:20.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.665+0000 7f93b4312640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5603ddc30880 0x5603ddc32c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.665+0000 7f93bcb13640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x5603ddba06d0 0x5603ddc2f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:37962/0 (socket says 172.21.15.164:37962) 2024-09-13T23:07:20.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.665+0000 7f93bcb13640 1 -- 172.21.15.164:0/1000389674 learned_addr learned my addr 172.21.15.164:0/1000389674 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:07:20.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.665+0000 7f93b4312640 1 -- 172.21.15.164:0/1000389674 >> v1:172.21.15.17:6789/0 conn(0x5603ddba06d0 legacy=0x5603ddc2f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.665+0000 7f93b7fff640 1 -- 172.21.15.164:0/1000389674 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4221587450 0 0) 0x5603ddaebb30 con 0x5603ddba06d0 2024-09-13T23:07:20.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.665+0000 7f93b4312640 1 -- 172.21.15.164:0/1000389674 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603ddaf3e00 con 0x5603ddc30880 2024-09-13T23:07:20.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.667+0000 7f93b4312640 1 --2- 172.21.15.164:0/1000389674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddc30880 0x5603ddc32c90 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f93a400a470 tx=0x7f93a4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597b92d299db8abb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.667+0000 7f93b7fff640 1 -- 172.21.15.164:0/1000389674 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93a4053570 con 0x5603ddc30880 2024-09-13T23:07:20.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.667+0000 7f93b7fff640 1 -- 172.21.15.164:0/1000389674 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93a4058070 con 0x5603ddc30880 2024-09-13T23:07:20.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.667+0000 7f93b7fff640 1 -- 172.21.15.164:0/1000389674 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93a4053880 con 0x5603ddc30880 2024-09-13T23:07:20.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.668+0000 7f93c0f26800 1 -- 172.21.15.164:0/1000389674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddc30880 msgr2=0x5603ddc32c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.668+0000 7f93c0f26800 1 --2- 172.21.15.164:0/1000389674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddc30880 0x5603ddc32c90 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f93a400a470 tx=0x7f93a4045a20 comp rx=0 tx=0).stop 2024-09-13T23:07:20.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.668+0000 7f93c0f26800 1 -- 172.21.15.164:0/1000389674 shutdown_connections 2024-09-13T23:07:20.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.668+0000 7f93c0f26800 1 --2- 172.21.15.164:0/1000389674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddc30880 0x5603ddc32c90 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.668+0000 7f93c0f26800 1 -- 172.21.15.164:0/1000389674 >> 172.21.15.164:0/1000389674 conn(0x5603ddc26db0 msgr2=0x5603ddc291d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.668+0000 7f93c0f26800 1 -- 172.21.15.164:0/1000389674 shutdown_connections 2024-09-13T23:07:20.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.668+0000 7f93c0f26800 1 -- 172.21.15.164:0/1000389674 wait complete. 2024-09-13T23:07:20.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.682+0000 7f93c0f26800 1 Processor -- start 2024-09-13T23:07:20.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.682+0000 7f93c0f26800 1 -- start start 2024-09-13T23:07:20.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.682+0000 7f93c0f26800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddba06d0 0x5603ddc2ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.682+0000 7f93c0f26800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5603ddb78360 con 0x5603ddba06d0 2024-09-13T23:07:20.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.682+0000 7f93bcb13640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddba06d0 0x5603ddc2ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.682+0000 7f93bcb13640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddba06d0 0x5603ddc2ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55010/0 (socket says 172.21.15.164:55010) 2024-09-13T23:07:20.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.682+0000 7f93bcb13640 1 -- 172.21.15.164:0/355038425 learned_addr learned my addr 172.21.15.164:0/355038425 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.683+0000 7f93bcb13640 1 -- 172.21.15.164:0/355038425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603ddac5bc0 con 0x5603ddba06d0 2024-09-13T23:07:20.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.683+0000 7f93bcb13640 1 --2- 172.21.15.164:0/355038425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddba06d0 0x5603ddc2ca90 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00b240 tx=0x7f93ac00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2015eac07e07e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.683+0000 7f92aae0d640 1 -- 172.21.15.164:0/355038425 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93ac008070 con 0x5603ddba06d0 2024-09-13T23:07:20.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.683+0000 7f92aae0d640 1 -- 172.21.15.164:0/355038425 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93ac00d500 con 0x5603ddba06d0 2024-09-13T23:07:20.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.683+0000 7f92aae0d640 1 -- 172.21.15.164:0/355038425 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93ac00d860 con 0x5603ddba06d0 2024-09-13T23:07:20.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.684+0000 7f93c0f26800 1 -- 172.21.15.164:0/355038425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddba06d0 msgr2=0x5603ddc2ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.684+0000 7f93c0f26800 1 --2- 172.21.15.164:0/355038425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddba06d0 0x5603ddc2ca90 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00b240 tx=0x7f93ac00b700 comp rx=0 tx=0).stop 2024-09-13T23:07:20.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.684+0000 7f93c0f26800 1 -- 172.21.15.164:0/355038425 shutdown_connections 2024-09-13T23:07:20.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.684+0000 7f93c0f26800 1 --2- 172.21.15.164:0/355038425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddba06d0 0x5603ddc2ca90 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.684+0000 7f93c0f26800 1 -- 172.21.15.164:0/355038425 >> 172.21.15.164:0/355038425 conn(0x5603ddc26db0 msgr2=0x5603ddd17050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.684+0000 7f93c0f26800 1 -- 172.21.15.164:0/355038425 shutdown_connections 2024-09-13T23:07:20.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.684+0000 7f93c0f26800 1 -- 172.21.15.164:0/355038425 wait complete. 2024-09-13T23:07:20.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.684+0000 7f93c0f26800 1 Processor -- start 2024-09-13T23:07:20.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.684+0000 7f93c0f26800 1 -- start start 2024-09-13T23:07:20.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.684+0000 7f93c0f26800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddba06d0 0x5603ddd25300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.684+0000 7f93c0f26800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5603ddc33610 con 0x5603ddba06d0 2024-09-13T23:07:20.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.684+0000 7f93bcb13640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddba06d0 0x5603ddd25300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.685+0000 7f93bcb13640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddba06d0 0x5603ddd25300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55018/0 (socket says 172.21.15.164:55018) 2024-09-13T23:07:20.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.685+0000 7f93bcb13640 1 -- 172.21.15.164:0/2008471941 learned_addr learned my addr 172.21.15.164:0/2008471941 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.685+0000 7f93bcb13640 1 -- 172.21.15.164:0/2008471941 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603ddad9fe0 con 0x5603ddba06d0 2024-09-13T23:07:20.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.685+0000 7f93bcb13640 1 --2- 172.21.15.164:0/2008471941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddba06d0 0x5603ddd25300 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x5603ddc2c190 tx=0x7f93ac000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.685+0000 7f92a960a640 1 -- 172.21.15.164:0/2008471941 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93ac019870 con 0x5603ddba06d0 2024-09-13T23:07:20.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.685+0000 7f92a960a640 1 -- 172.21.15.164:0/2008471941 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93ac019a10 con 0x5603ddba06d0 2024-09-13T23:07:20.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.685+0000 7f93c0f26800 1 -- 172.21.15.164:0/2008471941 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5603ddd25840 con 0x5603ddba06d0 2024-09-13T23:07:20.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.685+0000 7f92a960a640 1 -- 172.21.15.164:0/2008471941 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93ac019d30 con 0x5603ddba06d0 2024-09-13T23:07:20.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.685+0000 7f93c0f26800 1 -- 172.21.15.164:0/2008471941 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603ddd25d60 con 0x5603ddba06d0 2024-09-13T23:07:20.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.686+0000 7f92a960a640 1 -- 172.21.15.164:0/2008471941 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f93ac017040 con 0x5603ddba06d0 2024-09-13T23:07:20.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.686+0000 7f92a960a640 1 --2- 172.21.15.164:0/2008471941 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f92a4036b90 0x7f92a4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.686+0000 7f92a960a640 1 -- 172.21.15.164:0/2008471941 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f93ac015020 con 0x5603ddba06d0 2024-09-13T23:07:20.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.686+0000 7f93b4312640 1 --2- 172.21.15.164:0/2008471941 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f92a4036b90 0x7f92a4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.686+0000 7f93c0f26800 1 --2- 172.21.15.164:0/2008471941 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5603ddc30880 0x5603ddd2c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.686+0000 7f93c0f26800 1 -- 172.21.15.164:0/2008471941 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd2c8f0 con 0x5603ddc30880 2024-09-13T23:07:20.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.686+0000 7f93bd314640 1 --2- 172.21.15.164:0/2008471941 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5603ddc30880 0x5603ddd2c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.687+0000 7f93b4312640 1 --2- 172.21.15.164:0/2008471941 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f92a4036b90 0x7f92a4039050 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f93a4057000 tx=0x7f93a4052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.687+0000 7f93bd314640 1 --2- 172.21.15.164:0/2008471941 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5603ddc30880 0x5603ddd2c370 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.687+0000 7f93bd314640 1 -- 172.21.15.164:0/2008471941 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f93b800a4a0 con 0x5603ddc30880 2024-09-13T23:07:20.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.687+0000 7f93c0f26800 1 -- 172.21.15.164:0/2008471941 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd29940 con 0x5603ddc30880 2024-09-13T23:07:20.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.687+0000 7f93bd314640 1 -- 172.21.15.164:0/2008471941 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f93b800a4a0 con 0x5603ddc30880 2024-09-13T23:07:20.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.687+0000 7f93c0f26800 1 -- 172.21.15.164:0/2008471941 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd2e710 con 0x5603ddc30880 2024-09-13T23:07:20.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.688+0000 7f93bd314640 1 -- 172.21.15.164:0/2008471941 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f93b800a4a0 con 0x5603ddc30880 2024-09-13T23:07:20.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.688+0000 7f93c0f26800 1 -- 172.21.15.164:0/2008471941 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd2d850 con 0x5603ddc30880 2024-09-13T23:07:20.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.688+0000 7f93bd314640 1 -- 172.21.15.164:0/2008471941 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f93b800a4a0 con 0x5603ddc30880 2024-09-13T23:07:20.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.688+0000 7f93c0f26800 1 -- 172.21.15.164:0/2008471941 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd2dca0 con 0x5603ddc30880 2024-09-13T23:07:20.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.688+0000 7f93bd314640 1 -- 172.21.15.164:0/2008471941 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f93b800a4a0 con 0x5603ddc30880 2024-09-13T23:07:20.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.688+0000 7f93c0f26800 1 Processor -- start 2024-09-13T23:07:20.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.689+0000 7f93c0f26800 1 -- start start 2024-09-13T23:07:20.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.689+0000 7f93c0f26800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddd3cd00 0x5603ddd3d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.689+0000 7f93c0f26800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5603ddac7580 con 0x5603ddd3cd00 2024-09-13T23:07:20.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.689+0000 7f93b4312640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddd3cd00 0x5603ddd3d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.689+0000 7f93b4312640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddd3cd00 0x5603ddd3d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55032/0 (socket says 172.21.15.164:55032) 2024-09-13T23:07:20.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.689+0000 7f93b4312640 1 -- 172.21.15.164:0/1262243915 learned_addr learned my addr 172.21.15.164:0/1262243915 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.689+0000 7f93b4312640 1 -- 172.21.15.164:0/1262243915 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603ddd3d660 con 0x5603ddd3cd00 2024-09-13T23:07:20.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.689+0000 7f93b4312640 1 --2- 172.21.15.164:0/1262243915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddd3cd00 0x5603ddd3d120 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f93a4025bf0 tx=0x7f93a4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.690+0000 7f92a27fc640 1 -- 172.21.15.164:0/1262243915 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93a4072560 con 0x5603ddd3cd00 2024-09-13T23:07:20.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.690+0000 7f92a27fc640 1 -- 172.21.15.164:0/1262243915 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93a4072700 con 0x5603ddd3cd00 2024-09-13T23:07:20.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.690+0000 7f93c0f26800 1 -- 172.21.15.164:0/1262243915 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5603ddd3d890 con 0x5603ddd3cd00 2024-09-13T23:07:20.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.690+0000 7f92a27fc640 1 -- 172.21.15.164:0/1262243915 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93a40729e0 con 0x5603ddd3cd00 2024-09-13T23:07:20.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.690+0000 7f93c0f26800 1 -- 172.21.15.164:0/1262243915 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603ddd40510 con 0x5603ddd3cd00 2024-09-13T23:07:20.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.690+0000 7f92a27fc640 1 -- 172.21.15.164:0/1262243915 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f93a407b440 con 0x5603ddd3cd00 2024-09-13T23:07:20.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.691+0000 7f92a27fc640 1 --2- 172.21.15.164:0/1262243915 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9294036b40 0x7f9294039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.691+0000 7f92a27fc640 1 -- 172.21.15.164:0/1262243915 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f93a4092fa0 con 0x5603ddd3cd00 2024-09-13T23:07:20.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.691+0000 7f93bd314640 1 --2- 172.21.15.164:0/1262243915 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9294036b40 0x7f9294039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.691+0000 7f93c0f26800 1 Processor -- start 2024-09-13T23:07:20.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.691+0000 7f93bd314640 1 --2- 172.21.15.164:0/1262243915 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9294036b40 0x7f9294039000 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x5603ddd2d370 tx=0x7f93b8005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.691+0000 7f93c0f26800 1 -- start start 2024-09-13T23:07:20.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.691+0000 7f93c0f26800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddd498f0 0x5603ddd49cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.691+0000 7f93c0f26800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5603ddc2b160 con 0x5603ddd498f0 2024-09-13T23:07:20.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.691+0000 7f93b4312640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddd498f0 0x5603ddd49cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.691+0000 7f93b4312640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddd498f0 0x5603ddd49cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55036/0 (socket says 172.21.15.164:55036) 2024-09-13T23:07:20.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.691+0000 7f93b4312640 1 -- 172.21.15.164:0/3277579563 learned_addr learned my addr 172.21.15.164:0/3277579563 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.692+0000 7f93b4312640 1 -- 172.21.15.164:0/3277579563 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603ddd4a2c0 con 0x5603ddd498f0 2024-09-13T23:07:20.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.692+0000 7f93b4312640 1 --2- 172.21.15.164:0/3277579563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddd498f0 0x5603ddd49cf0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f93a4071cf0 tx=0x7f93a4071d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5acaf9649c4c29ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.692+0000 7f9293fff640 1 -- 172.21.15.164:0/3277579563 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93a4088070 con 0x5603ddd498f0 2024-09-13T23:07:20.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.692+0000 7f9293fff640 1 -- 172.21.15.164:0/3277579563 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93a407bc50 con 0x5603ddd498f0 2024-09-13T23:07:20.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.692+0000 7f9293fff640 1 -- 172.21.15.164:0/3277579563 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93a40713d0 con 0x5603ddd498f0 2024-09-13T23:07:20.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.692+0000 7f93c0f26800 1 -- 172.21.15.164:0/3277579563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddd498f0 msgr2=0x5603ddd49cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.692+0000 7f93c0f26800 1 --2- 172.21.15.164:0/3277579563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddd498f0 0x5603ddd49cf0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f93a4071cf0 tx=0x7f93a4071d20 comp rx=0 tx=0).stop 2024-09-13T23:07:20.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.692+0000 7f93c0f26800 1 -- 172.21.15.164:0/3277579563 shutdown_connections 2024-09-13T23:07:20.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.692+0000 7f93c0f26800 1 --2- 172.21.15.164:0/3277579563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddd498f0 0x5603ddd49cf0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.692+0000 7f93c0f26800 1 -- 172.21.15.164:0/3277579563 >> 172.21.15.164:0/3277579563 conn(0x5603ddd45c50 msgr2=0x5603ddd43d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.692+0000 7f93c0f26800 1 -- 172.21.15.164:0/3277579563 shutdown_connections 2024-09-13T23:07:20.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.692+0000 7f93c0f26800 1 -- 172.21.15.164:0/3277579563 wait complete. 2024-09-13T23:07:20.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.693+0000 7f93c0f26800 1 Processor -- start 2024-09-13T23:07:20.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.693+0000 7f93c0f26800 1 -- start start 2024-09-13T23:07:20.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.693+0000 7f93c0f26800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddd498f0 0x5603ddd50e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.693+0000 7f93c0f26800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5603ddd4a930 con 0x5603ddd498f0 2024-09-13T23:07:20.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.693+0000 7f93b4312640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddd498f0 0x5603ddd50e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.693+0000 7f93b4312640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddd498f0 0x5603ddd50e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55044/0 (socket says 172.21.15.164:55044) 2024-09-13T23:07:20.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.693+0000 7f93b4312640 1 -- 172.21.15.164:0/829769160 learned_addr learned my addr 172.21.15.164:0/829769160 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.693+0000 7f93b4312640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603ddd51340 con 0x5603ddd498f0 2024-09-13T23:07:20.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.693+0000 7f93b4312640 1 --2- 172.21.15.164:0/829769160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddd498f0 0x5603ddd50e00 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x5603ddd448c0 tx=0x7f93a40911c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.694+0000 7f92927fc640 1 -- 172.21.15.164:0/829769160 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93a409c020 con 0x5603ddd498f0 2024-09-13T23:07:20.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.694+0000 7f92927fc640 1 -- 172.21.15.164:0/829769160 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93a40713d0 con 0x5603ddd498f0 2024-09-13T23:07:20.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.694+0000 7f92927fc640 1 -- 172.21.15.164:0/829769160 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93a4088040 con 0x5603ddd498f0 2024-09-13T23:07:20.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.694+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5603ddd515d0 con 0x5603ddd498f0 2024-09-13T23:07:20.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.694+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603ddd54280 con 0x5603ddd498f0 2024-09-13T23:07:20.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.694+0000 7f92927fc640 1 -- 172.21.15.164:0/829769160 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f93a409f020 con 0x5603ddd498f0 2024-09-13T23:07:20.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.695+0000 7f92927fc640 1 --2- 172.21.15.164:0/829769160 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9288036b40 0x7f9288039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.695+0000 7f92927fc640 1 -- 172.21.15.164:0/829769160 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f93a40a2d20 con 0x5603ddd498f0 2024-09-13T23:07:20.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.695+0000 7f93bd314640 1 --2- 172.21.15.164:0/829769160 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9288036b40 0x7f9288039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.695+0000 7f93bd314640 1 --2- 172.21.15.164:0/829769160 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9288036b40 0x7f9288039000 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x5603ddd26120 tx=0x7f93b801f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.695+0000 7f93c0f26800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.695+0000 7f93c0f26800 1 --2- 172.21.15.164:0/829769160 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5603ddd5c950 0x5603ddd5ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.695+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd5f560 con 0x5603ddd5c950 2024-09-13T23:07:20.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.695+0000 7f93bcb13640 1 --2- 172.21.15.164:0/829769160 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5603ddd5c950 0x5603ddd5ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.696+0000 7f93bcb13640 1 --2- 172.21.15.164:0/829769160 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5603ddd5c950 0x5603ddd5ee10 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.696+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f93ac02d070 con 0x5603ddd5c950 2024-09-13T23:07:20.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.696+0000 7f93c0f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.696+0000 7f93c0f26800 20 realm 2024-09-13T23:07:20.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.696+0000 7f93c0f26800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.696+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd5f970 con 0x5603ddd5c950 2024-09-13T23:07:20.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.696+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f93ac02d070 con 0x5603ddd5c950 2024-09-13T23:07:20.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.696+0000 7f93c0f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.696+0000 7f93c0f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:07:20.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.696+0000 7f93c0f26800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.696+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd60240 con 0x5603ddd5c950 2024-09-13T23:07:20.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.696+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f93ac02d070 con 0x5603ddd5c950 2024-09-13T23:07:20.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.696+0000 7f93c0f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.696+0000 7f93c0f26800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.696+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd605e0 con 0x5603ddd5c950 2024-09-13T23:07:20.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.697+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f93ac02d070 con 0x5603ddd5c950 2024-09-13T23:07:20.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.697+0000 7f93c0f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:20.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.697+0000 7f93c0f26800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.697+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd60e30 con 0x5603ddd5c950 2024-09-13T23:07:20.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.697+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f93ac02d070 con 0x5603ddd5c950 2024-09-13T23:07:20.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.697+0000 7f93c0f26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:07:20.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.697+0000 7f93c0f26800 20 searching for the correct realm 2024-09-13T23:07:20.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.697+0000 7f93c0f26800 1 --2- 172.21.15.164:0/829769160 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5603ddd62ba0 0x5603ddd64f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.697+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x5603ddd62ba0 2024-09-13T23:07:20.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.697+0000 7f93b4312640 1 --2- 172.21.15.164:0/829769160 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5603ddd62ba0 0x5603ddd64f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.697+0000 7f93b4312640 1 --2- 172.21.15.164:0/829769160 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5603ddd62ba0 0x5603ddd64f90 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.698+0000 7f93b4312640 1 -- 172.21.15.164:0/829769160 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93a4081070 con 0x5603ddd62ba0 2024-09-13T23:07:20.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.698+0000 7f93b4312640 1 --2- 172.21.15.164:0/829769160 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f93a40ab040 0x7f93a407ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.698+0000 7f93b4312640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x7f93a40ab040 2024-09-13T23:07:20.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.698+0000 7f93bd314640 1 --2- 172.21.15.164:0/829769160 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f93a40ab040 0x7f93a407ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.698+0000 7f93bd314640 1 --2- 172.21.15.164:0/829769160 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f93a40ab040 0x7f93a407ea40 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.698+0000 7f93bd314640 1 -- 172.21.15.164:0/829769160 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93b801f070 con 0x7f93a40ab040 2024-09-13T23:07:20.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.698+0000 7f93bd314640 1 --2- 172.21.15.164:0/829769160 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f93b8031040 0x7f93b8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.698+0000 7f93bd314640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x7f93b8031040 2024-09-13T23:07:20.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.698+0000 7f93bcb13640 1 --2- 172.21.15.164:0/829769160 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f93b8031040 0x7f93b8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.699+0000 7f93bcb13640 1 --2- 172.21.15.164:0/829769160 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f93b8031040 0x7f93b8032940 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.699+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93ac02d070 con 0x7f93b8031040 2024-09-13T23:07:20.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.699+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x5603ddd5c950 2024-09-13T23:07:20.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.699+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f93ac02d070 con 0x5603ddd5c950 2024-09-13T23:07:20.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.699+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x5603ddd5c950 2024-09-13T23:07:20.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.700+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93ac02d070 con 0x5603ddd5c950 2024-09-13T23:07:20.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.700+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x7f93b8031040 2024-09-13T23:07:20.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.700+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93ac02d070 con 0x7f93b8031040 2024-09-13T23:07:20.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.700+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x7f93b8031040 2024-09-13T23:07:20.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.700+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93ac02d070 con 0x7f93b8031040 2024-09-13T23:07:20.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.700+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x7f93a40ab040 2024-09-13T23:07:20.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.700+0000 7f93bd314640 1 -- 172.21.15.164:0/829769160 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93b801f070 con 0x7f93a40ab040 2024-09-13T23:07:20.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.700+0000 7f93bd314640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x5603ddd62ba0 2024-09-13T23:07:20.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.700+0000 7f93b4312640 1 -- 172.21.15.164:0/829769160 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93a4081070 con 0x5603ddd62ba0 2024-09-13T23:07:20.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.701+0000 7f93b4312640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x5603ddd5c950 2024-09-13T23:07:20.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.701+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93ac02d070 con 0x5603ddd5c950 2024-09-13T23:07:20.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.701+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x7f93b8031040 2024-09-13T23:07:20.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.701+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93ac02d070 con 0x7f93b8031040 2024-09-13T23:07:20.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.701+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x5603ddd5c950 2024-09-13T23:07:20.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.701+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93ac02d070 con 0x5603ddd5c950 2024-09-13T23:07:20.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.701+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x7f93a40ab040 2024-09-13T23:07:20.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.701+0000 7f93bd314640 1 -- 172.21.15.164:0/829769160 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f93b801f070 con 0x7f93a40ab040 2024-09-13T23:07:20.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.701+0000 7f93bd314640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x5603ddd62ba0 2024-09-13T23:07:20.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.702+0000 7f93b4312640 1 -- 172.21.15.164:0/829769160 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93a4081070 con 0x5603ddd62ba0 2024-09-13T23:07:20.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.702+0000 7f93b4312640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x5603ddd62ba0 2024-09-13T23:07:20.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.702+0000 7f93b4312640 1 -- 172.21.15.164:0/829769160 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93a4081070 con 0x5603ddd62ba0 2024-09-13T23:07:20.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.702+0000 7f93b4312640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x7f93b8031040 2024-09-13T23:07:20.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.702+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93ac02d070 con 0x7f93b8031040 2024-09-13T23:07:20.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.702+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x5603ddd62ba0 2024-09-13T23:07:20.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.702+0000 7f93b4312640 1 -- 172.21.15.164:0/829769160 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93a4081070 con 0x5603ddd62ba0 2024-09-13T23:07:20.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.702+0000 7f93b4312640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x5603ddd62ba0 2024-09-13T23:07:20.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.702+0000 7f93b4312640 1 -- 172.21.15.164:0/829769160 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93a4081070 con 0x5603ddd62ba0 2024-09-13T23:07:20.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.702+0000 7f93b4312640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x5603ddd5c950 2024-09-13T23:07:20.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.703+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93ac02d070 con 0x5603ddd5c950 2024-09-13T23:07:20.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.703+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x5603ddd5c950 2024-09-13T23:07:20.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.703+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f93ac02d070 con 0x5603ddd5c950 2024-09-13T23:07:20.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.703+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x7f93b8031040 2024-09-13T23:07:20.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.703+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93ac02d070 con 0x7f93b8031040 2024-09-13T23:07:20.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.703+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x5603ddd62ba0 2024-09-13T23:07:20.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.703+0000 7f93b4312640 1 -- 172.21.15.164:0/829769160 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93a4081070 con 0x5603ddd62ba0 2024-09-13T23:07:20.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.703+0000 7f93b4312640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x7f93a40ab040 2024-09-13T23:07:20.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.704+0000 7f93bd314640 1 -- 172.21.15.164:0/829769160 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93b801f070 con 0x7f93a40ab040 2024-09-13T23:07:20.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.704+0000 7f93bd314640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x5603ddd5c950 2024-09-13T23:07:20.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.704+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f93ac02d070 con 0x5603ddd5c950 2024-09-13T23:07:20.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.704+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x7f93b8031040 2024-09-13T23:07:20.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.704+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93ac02d070 con 0x7f93b8031040 2024-09-13T23:07:20.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.704+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x5603ddd62ba0 2024-09-13T23:07:20.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.704+0000 7f93b4312640 1 -- 172.21.15.164:0/829769160 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93a4081070 con 0x5603ddd62ba0 2024-09-13T23:07:20.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.704+0000 7f93b4312640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x7f93b8031040 2024-09-13T23:07:20.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.705+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93ac02d070 con 0x7f93b8031040 2024-09-13T23:07:20.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.705+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x7f93a40ab040 2024-09-13T23:07:20.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.705+0000 7f93bd314640 1 -- 172.21.15.164:0/829769160 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93b801f070 con 0x7f93a40ab040 2024-09-13T23:07:20.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.705+0000 7f93bd314640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x5603ddd62ba0 2024-09-13T23:07:20.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.705+0000 7f93b4312640 1 -- 172.21.15.164:0/829769160 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93a4081070 con 0x5603ddd62ba0 2024-09-13T23:07:20.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.705+0000 7f93b4312640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x7f93a40ab040 2024-09-13T23:07:20.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.705+0000 7f93bd314640 1 -- 172.21.15.164:0/829769160 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93b801f070 con 0x7f93a40ab040 2024-09-13T23:07:20.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.705+0000 7f93bd314640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x5603ddd5c950 2024-09-13T23:07:20.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.705+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f93ac02d070 con 0x5603ddd5c950 2024-09-13T23:07:20.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.706+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65570 con 0x7f93a40ab040 2024-09-13T23:07:20.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.706+0000 7f93bd314640 1 -- 172.21.15.164:0/829769160 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93b8040040 con 0x7f93a40ab040 2024-09-13T23:07:20.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.706+0000 7f93c0f26800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:07:20.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.706+0000 7f93c0f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:07:20.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.706+0000 7f93c0f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:07:20.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.706+0000 7f93c0f26800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:07:20.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.706+0000 7f93c0f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:07:20.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.706+0000 7f93c0f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:07:20.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.706+0000 7f93c0f26800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.706+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd617e0 con 0x5603ddd5c950 2024-09-13T23:07:20.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.706+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f93ac02d070 con 0x5603ddd5c950 2024-09-13T23:07:20.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.706+0000 7f93c0f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.706+0000 7f93c0f26800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.706+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd62080 con 0x5603ddd5c950 2024-09-13T23:07:20.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.706+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f93ac02d070 con 0x5603ddd5c950 2024-09-13T23:07:20.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.706+0000 7f93c0f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:20.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.706+0000 7f93c0f26800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.706+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd659f0 con 0x5603ddd5c950 2024-09-13T23:07:20.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.706+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f93ac02d070 con 0x5603ddd5c950 2024-09-13T23:07:20.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.706+0000 7f93c0f26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:07:20.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.707+0000 7f93c0f26800 20 zone default found 2024-09-13T23:07:20.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.707+0000 7f93c0f26800 4 Realm: () 2024-09-13T23:07:20.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.707+0000 7f93c0f26800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:07:20.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.707+0000 7f93c0f26800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:07:20.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.707+0000 7f93c0f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:07:20.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.707+0000 7f93c0f26800 20 zonegroup default 2024-09-13T23:07:20.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.707+0000 7f93c0f26800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.707+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd65ea0 con 0x7f93b8031040 2024-09-13T23:07:20.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.707+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f93ac02d070 con 0x7f93b8031040 2024-09-13T23:07:20.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.707+0000 7f93c0f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.707+0000 7f93c0f26800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.707+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd67880 con 0x5603ddd62ba0 2024-09-13T23:07:20.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.707+0000 7f93b4312640 1 -- 172.21.15.164:0/829769160 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f93a4081070 con 0x5603ddd62ba0 2024-09-13T23:07:20.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.707+0000 7f93c0f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.707+0000 7f93c0f26800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.707+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd67d70 con 0x5603ddd62ba0 2024-09-13T23:07:20.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.707+0000 7f93b4312640 1 -- 172.21.15.164:0/829769160 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f93a4081070 con 0x5603ddd62ba0 2024-09-13T23:07:20.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.707+0000 7f93c0f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.707+0000 7f93c0f26800 20 started sync module instance, tier type = 2024-09-13T23:07:20.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.707+0000 7f93c0f26800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:07:20.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.707+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd66d10 con 0x7f93a40ab040 2024-09-13T23:07:20.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.708+0000 7f93bd314640 1 -- 172.21.15.164:0/829769160 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93b8040040 con 0x7f93a40ab040 2024-09-13T23:07:20.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.708+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94574606708992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd68680 con 0x7f93a40ab040 2024-09-13T23:07:20.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.708+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd68ed0 con 0x5603ddd5c950 2024-09-13T23:07:20.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.709+0000 7f93bd314640 1 -- 172.21.15.164:0/829769160 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94574606708992] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93b8040040 con 0x7f93a40ab040 2024-09-13T23:07:20.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.710+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93ac02d070 con 0x5603ddd5c950 2024-09-13T23:07:20.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.710+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94574606713296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd68b80 con 0x5603ddd5c950 2024-09-13T23:07:20.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.710+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd69680 con 0x5603ddd62ba0 2024-09-13T23:07:20.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.711+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94574606713296] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93ac02d070 con 0x5603ddd5c950 2024-09-13T23:07:20.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.711+0000 7f93b4312640 1 -- 172.21.15.164:0/829769160 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93a4081070 con 0x5603ddd62ba0 2024-09-13T23:07:20.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.711+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94574606717296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd69aa0 con 0x5603ddd62ba0 2024-09-13T23:07:20.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.711+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd6a4a0 con 0x7f93a40ab040 2024-09-13T23:07:20.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.712+0000 7f93b4312640 1 -- 172.21.15.164:0/829769160 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94574606717296] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93a4081070 con 0x5603ddd62ba0 2024-09-13T23:07:20.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.712+0000 7f93bd314640 1 -- 172.21.15.164:0/829769160 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93b8040040 con 0x7f93a40ab040 2024-09-13T23:07:20.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.712+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94574606714352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd6a890 con 0x7f93a40ab040 2024-09-13T23:07:20.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.712+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd6b2d0 con 0x5603ddd5c950 2024-09-13T23:07:20.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.713+0000 7f93bd314640 1 -- 172.21.15.164:0/829769160 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94574606714352] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93b8040040 con 0x7f93a40ab040 2024-09-13T23:07:20.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.713+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93ac02d070 con 0x5603ddd5c950 2024-09-13T23:07:20.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.713+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94574606720944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd6b2d0 con 0x5603ddd5c950 2024-09-13T23:07:20.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.713+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd6bd10 con 0x7f93b8031040 2024-09-13T23:07:20.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.714+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93ac02d070 con 0x7f93b8031040 2024-09-13T23:07:20.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.714+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94574606720944] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93ac02d070 con 0x5603ddd5c950 2024-09-13T23:07:20.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.714+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94574606727264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd6bc80 con 0x7f93b8031040 2024-09-13T23:07:20.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.714+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd6add0 con 0x7f93b8031040 2024-09-13T23:07:20.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.715+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94574606727264] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93ac02d070 con 0x7f93b8031040 2024-09-13T23:07:20.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.716+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93ac02d070 con 0x7f93b8031040 2024-09-13T23:07:20.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.716+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94574606729520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd6c750 con 0x7f93b8031040 2024-09-13T23:07:20.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.716+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd6d110 con 0x7f93b8031040 2024-09-13T23:07:20.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.717+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94574606729520] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93ac02d070 con 0x7f93b8031040 2024-09-13T23:07:20.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.717+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93ac02d070 con 0x7f93b8031040 2024-09-13T23:07:20.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.717+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94574606724560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd6d110 con 0x7f93b8031040 2024-09-13T23:07:20.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.717+0000 7f93c0f26800 20 add_watcher() i=0 2024-09-13T23:07:20.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.717+0000 7f93c0f26800 20 add_watcher() i=1 2024-09-13T23:07:20.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.717+0000 7f93c0f26800 20 add_watcher() i=2 2024-09-13T23:07:20.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.717+0000 7f93c0f26800 20 add_watcher() i=3 2024-09-13T23:07:20.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.717+0000 7f93c0f26800 20 add_watcher() i=4 2024-09-13T23:07:20.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.717+0000 7f93c0f26800 20 add_watcher() i=5 2024-09-13T23:07:20.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.717+0000 7f93c0f26800 20 add_watcher() i=6 2024-09-13T23:07:20.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.718+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94574606724560] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93ac02d070 con 0x7f93b8031040 2024-09-13T23:07:20.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.718+0000 7f93c0f26800 20 add_watcher() i=7 2024-09-13T23:07:20.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.718+0000 7f93c0f26800 2 all 8 watchers are set, enabling cache 2024-09-13T23:07:20.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.718+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd70510 con 0x5603ddd5c950 2024-09-13T23:07:20.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.718+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f93ac02d070 con 0x5603ddd5c950 2024-09-13T23:07:20.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.718+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94574606732848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603ddd6da30 con 0x5603ddd5c950 2024-09-13T23:07:20.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.719+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94574606732848] v34'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f93ac02d070 con 0x5603ddd5c950 2024-09-13T23:07:20.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.719+0000 7f9272fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:20.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.719+0000 7f93c0f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:07:20.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.719+0000 7f93c0f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:07:20.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.719+0000 7f93c0f26800 5 note: GC not initialized 2024-09-13T23:07:20.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.719+0000 7f9271fe3640 20 reqs_thread_entry: start 2024-09-13T23:07:20.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.720+0000 7f93c0f26800 20 init_complete bucket index max shards: 11 2024-09-13T23:07:20.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.720+0000 7f93c0f26800 20 Filter name: none 2024-09-13T23:07:20.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.720+0000 7f91e37fe640 20 reqs_thread_entry: start 2024-09-13T23:07:20.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.720+0000 7f93c0f26800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T23:07:20.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.720+0000 7f93c0f26800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.720+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603ddda3950 con 0x7f93b8031040 2024-09-13T23:07:20.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.720+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f93ac02d070 con 0x7f93b8031040 2024-09-13T23:07:20.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.720+0000 7f93c0f26800 20 rados_obj.operate() r=0 bl.length=460 2024-09-13T23:07:20.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.720+0000 7f93c0f26800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T23:07:20.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.720+0000 7f93c0f26800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:20.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.720+0000 7f93c0f26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:07:20.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.720+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603dddaa000 con 0x7f93b8031040 2024-09-13T23:07:20.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.722+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v34'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f93ac02d070 con 0x7f93b8031040 2024-09-13T23:07:20.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.722+0000 7f93c0f26800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:07:20.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.722+0000 7f93c0f26800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:20.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.722+0000 7f93c0f26800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T23:07:20.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.722+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94574606981568 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5603ddda5640 con 0x5603ddd5c950 2024-09-13T23:07:20.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.722+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== watch-notify(notify (1) cookie 94574606720944 notify 146028888098 ret 0) ==== 691+0+0 (crc 0 0 0) 0x5603ddd25d60 con 0x5603ddd5c950 2024-09-13T23:07:20.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.722+0000 7f9293fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888098 cookie 94574606720944 notifier 4924 bl.length()=649 2024-09-13T23:07:20.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.722+0000 7f9293fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:07:20.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.722+0000 7f9293fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:20.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.722+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(64 notify.4 [notify cookie 94574606981568 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f93ac02d070 con 0x5603ddd5c950 2024-09-13T23:07:20.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.722+0000 7f9293fff640 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f9280003ea0 con 0x5603ddd5c950 2024-09-13T23:07:20.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.722+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93ac02d070 con 0x5603ddd5c950 2024-09-13T23:07:20.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.722+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== watch-notify(notify_complete (2) cookie 94574606981568 notify 146028888098 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5603ddd25840 con 0x5603ddd5c950 2024-09-13T23:07:20.735 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T23:07:18.801026Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:07:18.801015Z","tags":[],"group_ids":[]} 2024-09-13T23:07:20.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.723+0000 7f9272fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:20.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.723+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94574606732848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603ddda5e00 con 0x5603ddd5c950 2024-09-13T23:07:20.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.724+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94574606732848] v34'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f93ac02d070 con 0x5603ddd5c950 2024-09-13T23:07:20.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.724+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94574606708992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603ddda5e00 con 0x7f93a40ab040 2024-09-13T23:07:20.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.725+0000 7f93bd314640 1 -- 172.21.15.164:0/829769160 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94574606708992] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93b8040040 con 0x7f93a40ab040 2024-09-13T23:07:20.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.725+0000 7f93c0f26800 20 remove_watcher() i=0 2024-09-13T23:07:20.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.725+0000 7f93c0f26800 2 removed watcher, disabling cache 2024-09-13T23:07:20.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.725+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94574606713296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603ddda5e00 con 0x5603ddd5c950 2024-09-13T23:07:20.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.726+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94574606713296] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93ac02d070 con 0x5603ddd5c950 2024-09-13T23:07:20.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.726+0000 7f93c0f26800 20 remove_watcher() i=1 2024-09-13T23:07:20.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.726+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94574606717296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603ddda5e00 con 0x5603ddd62ba0 2024-09-13T23:07:20.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.727+0000 7f93b4312640 1 -- 172.21.15.164:0/829769160 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94574606717296] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93a4081070 con 0x5603ddd62ba0 2024-09-13T23:07:20.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.728+0000 7f93c0f26800 20 remove_watcher() i=2 2024-09-13T23:07:20.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.728+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94574606714352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603ddda1690 con 0x7f93a40ab040 2024-09-13T23:07:20.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.728+0000 7f93bd314640 1 -- 172.21.15.164:0/829769160 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94574606714352] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93b8040040 con 0x7f93a40ab040 2024-09-13T23:07:20.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.728+0000 7f93c0f26800 20 remove_watcher() i=3 2024-09-13T23:07:20.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.728+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94574606720944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603ddda1690 con 0x5603ddd5c950 2024-09-13T23:07:20.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.730+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94574606720944] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93ac02d070 con 0x5603ddd5c950 2024-09-13T23:07:20.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.730+0000 7f93c0f26800 20 remove_watcher() i=4 2024-09-13T23:07:20.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.730+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94574606727264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603ddda1690 con 0x7f93b8031040 2024-09-13T23:07:20.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.731+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94574606727264] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93ac02d070 con 0x7f93b8031040 2024-09-13T23:07:20.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.731+0000 7f93c0f26800 20 remove_watcher() i=5 2024-09-13T23:07:20.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.731+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94574606729520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603ddda1690 con 0x7f93b8031040 2024-09-13T23:07:20.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.732+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94574606729520] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93ac02d070 con 0x7f93b8031040 2024-09-13T23:07:20.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.732+0000 7f93c0f26800 20 remove_watcher() i=6 2024-09-13T23:07:20.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.732+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94574606724560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5603ddda1690 con 0x7f93b8031040 2024-09-13T23:07:20.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.733+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94574606724560] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93ac02d070 con 0x7f93b8031040 2024-09-13T23:07:20.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.733+0000 7f93c0f26800 20 remove_watcher() i=7 2024-09-13T23:07:20.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.733+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f93b8031040 msgr2=0x7f93b8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.733+0000 7f93c0f26800 1 --2- 172.21.15.164:0/829769160 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f93b8031040 0x7f93b8032940 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.733+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5603ddd5c950 msgr2=0x5603ddd5ee10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.733+0000 7f93c0f26800 1 --2- 172.21.15.164:0/829769160 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5603ddd5c950 0x5603ddd5ee10 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.733+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f93a40ab040 msgr2=0x7f93a407ea40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.733+0000 7f93c0f26800 1 --2- 172.21.15.164:0/829769160 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f93a40ab040 0x7f93a407ea40 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.733+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5603ddd62ba0 msgr2=0x5603ddd64f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.733+0000 7f93c0f26800 1 --2- 172.21.15.164:0/829769160 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5603ddd62ba0 0x5603ddd64f90 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.733+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9288036b40 msgr2=0x7f9288039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.733+0000 7f93c0f26800 1 --2- 172.21.15.164:0/829769160 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9288036b40 0x7f9288039000 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x5603ddd26120 tx=0x7f93b801f000 comp rx=0 tx=0).stop 2024-09-13T23:07:20.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.733+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddd498f0 msgr2=0x5603ddd50e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.733+0000 7f93c0f26800 1 --2- 172.21.15.164:0/829769160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddd498f0 0x5603ddd50e00 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x5603ddd448c0 tx=0x7f93a40911c0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.733+0000 7f93bcb13640 1 -- 172.21.15.164:0/829769160 reap_dead start 2024-09-13T23:07:20.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.733+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 shutdown_connections 2024-09-13T23:07:20.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.733+0000 7f93c0f26800 1 --2- 172.21.15.164:0/829769160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddd498f0 0x5603ddd50e00 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.733+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 >> 172.21.15.164:0/829769160 conn(0x5603ddd45c50 msgr2=0x5603ddd43d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.733+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 shutdown_connections 2024-09-13T23:07:20.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.733+0000 7f93c0f26800 1 -- 172.21.15.164:0/829769160 wait complete. 2024-09-13T23:07:20.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.733+0000 7f93c0f26800 1 -- 172.21.15.164:0/1262243915 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9294036b40 msgr2=0x7f9294039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.733+0000 7f93c0f26800 1 --2- 172.21.15.164:0/1262243915 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9294036b40 0x7f9294039000 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x5603ddd2d370 tx=0x7f93b8005840 comp rx=0 tx=0).stop 2024-09-13T23:07:20.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.733+0000 7f93c0f26800 1 -- 172.21.15.164:0/1262243915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddd3cd00 msgr2=0x5603ddd3d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.733+0000 7f93c0f26800 1 --2- 172.21.15.164:0/1262243915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddd3cd00 0x5603ddd3d120 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f93a4025bf0 tx=0x7f93a4002fb0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.734+0000 7f93c0f26800 1 -- 172.21.15.164:0/1262243915 shutdown_connections 2024-09-13T23:07:20.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.734+0000 7f93c0f26800 1 --2- 172.21.15.164:0/1262243915 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9294036b40 0x7f9294039000 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.734+0000 7f93c0f26800 1 --2- 172.21.15.164:0/1262243915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddd3cd00 0x5603ddd3d120 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.734+0000 7f93c0f26800 1 -- 172.21.15.164:0/1262243915 >> 172.21.15.164:0/1262243915 conn(0x5603ddd31c90 msgr2=0x5603ddd34810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.734+0000 7f93c0f26800 1 -- 172.21.15.164:0/1262243915 shutdown_connections 2024-09-13T23:07:20.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.734+0000 7f93c0f26800 1 -- 172.21.15.164:0/1262243915 wait complete. 2024-09-13T23:07:20.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.734+0000 7f93c0f26800 1 -- 172.21.15.164:0/2008471941 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5603ddc30880 msgr2=0x5603ddd2c370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.734+0000 7f93c0f26800 1 --2- 172.21.15.164:0/2008471941 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5603ddc30880 0x5603ddd2c370 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.734+0000 7f93c0f26800 1 -- 172.21.15.164:0/2008471941 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f92a4036b90 msgr2=0x7f92a4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.734+0000 7f93c0f26800 1 --2- 172.21.15.164:0/2008471941 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f92a4036b90 0x7f92a4039050 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f93a4057000 tx=0x7f93a4052000 comp rx=0 tx=0).stop 2024-09-13T23:07:20.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.734+0000 7f93c0f26800 1 -- 172.21.15.164:0/2008471941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddba06d0 msgr2=0x5603ddd25300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.734+0000 7f93c0f26800 1 --2- 172.21.15.164:0/2008471941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddba06d0 0x5603ddd25300 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x5603ddc2c190 tx=0x7f93ac000ed0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.734+0000 7f93c0f26800 1 -- 172.21.15.164:0/2008471941 shutdown_connections 2024-09-13T23:07:20.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.734+0000 7f93c0f26800 1 --2- 172.21.15.164:0/2008471941 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5603ddc30880 0x5603ddd2c370 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.734+0000 7f93c0f26800 1 --2- 172.21.15.164:0/2008471941 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f92a4036b90 0x7f92a4039050 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.734+0000 7f93c0f26800 1 --2- 172.21.15.164:0/2008471941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603ddba06d0 0x5603ddd25300 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.734+0000 7f93c0f26800 1 -- 172.21.15.164:0/2008471941 >> 172.21.15.164:0/2008471941 conn(0x5603ddc26db0 msgr2=0x5603ddd16c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.734+0000 7f93c0f26800 1 -- 172.21.15.164:0/2008471941 shutdown_connections 2024-09-13T23:07:20.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.734+0000 7f93c0f26800 1 -- 172.21.15.164:0/2008471941 wait complete. 2024-09-13T23:07:20.747 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:07:18.801026Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:07:18.801015Z', 'tags': [], 'group_ids': []} 2024-09-13T23:07:20.747 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:07:18.801026Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:07:18.801015Z', 'tags': [], 'group_ids': []} 2024-09-13T23:07:20.748 ERROR:root:0 2024-09-13T23:07:20.748 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T23:07:20.748 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T23:07:20.748 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-13T23:07:20.795 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:07:20.795 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:07:20.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.795+0000 7f2028b0c800 1 Processor -- start 2024-09-13T23:07:20.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.795+0000 7f2028b0c800 1 -- start start 2024-09-13T23:07:20.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.795+0000 7f2028b0c800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5609003b3d20 0x5609003b6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.795+0000 7f2028b0c800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56090026cb30 con 0x560900321630 2024-09-13T23:07:20.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.795+0000 7f2028b0c800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x56090024e360 con 0x5609003b3d20 2024-09-13T23:07:20.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.796+0000 7f2025dff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x5609003b3d20 0x5609003b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.796+0000 7f2026600640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x560900321630 0x5609003b2600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:37972/0 (socket says 172.21.15.164:37972) 2024-09-13T23:07:20.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.796+0000 7f2026600640 1 -- 172.21.15.164:0/2533663951 learned_addr learned my addr 172.21.15.164:0/2533663951 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:07:20.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.796+0000 7f2025dff640 1 -- 172.21.15.164:0/2533663951 >> v1:172.21.15.17:6789/0 conn(0x560900321630 legacy=0x5609003b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.796+0000 7f20255fe640 1 -- 172.21.15.164:0/2533663951 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1827925765 0 0) 0x56090026cb30 con 0x560900321630 2024-09-13T23:07:20.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.796+0000 7f2025dff640 1 -- 172.21.15.164:0/2533663951 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560900274e00 con 0x5609003b3d20 2024-09-13T23:07:20.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.798+0000 7f2025dff640 1 --2- 172.21.15.164:0/2533663951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609003b3d20 0x5609003b6110 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f201c00a470 tx=0x7f201c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c1a4d5f955eb62 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.798+0000 7f20255fe640 1 -- 172.21.15.164:0/2533663951 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f201c053570 con 0x5609003b3d20 2024-09-13T23:07:20.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.798+0000 7f20255fe640 1 -- 172.21.15.164:0/2533663951 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f201c058070 con 0x5609003b3d20 2024-09-13T23:07:20.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.798+0000 7f20255fe640 1 -- 172.21.15.164:0/2533663951 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f201c053880 con 0x5609003b3d20 2024-09-13T23:07:20.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.798+0000 7f2028b0c800 1 -- 172.21.15.164:0/2533663951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609003b3d20 msgr2=0x5609003b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.798+0000 7f2028b0c800 1 --2- 172.21.15.164:0/2533663951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609003b3d20 0x5609003b6110 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f201c00a470 tx=0x7f201c045a20 comp rx=0 tx=0).stop 2024-09-13T23:07:20.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.798+0000 7f2028b0c800 1 -- 172.21.15.164:0/2533663951 shutdown_connections 2024-09-13T23:07:20.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.798+0000 7f2028b0c800 1 --2- 172.21.15.164:0/2533663951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609003b3d20 0x5609003b6110 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.798+0000 7f2028b0c800 1 -- 172.21.15.164:0/2533663951 >> 172.21.15.164:0/2533663951 conn(0x5609003a7db0 msgr2=0x5609003aa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.798+0000 7f2028b0c800 1 -- 172.21.15.164:0/2533663951 shutdown_connections 2024-09-13T23:07:20.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.798+0000 7f2028b0c800 1 -- 172.21.15.164:0/2533663951 wait complete. 2024-09-13T23:07:20.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.812+0000 7f2028b0c800 1 Processor -- start 2024-09-13T23:07:20.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.812+0000 7f2028b0c800 1 -- start start 2024-09-13T23:07:20.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.812+0000 7f2028b0c800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560900321630 0x56090049e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.812+0000 7f2028b0c800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5609002f9360 con 0x560900321630 2024-09-13T23:07:20.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.813+0000 7f2026600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560900321630 0x56090049e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.813+0000 7f2026600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560900321630 0x56090049e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55066/0 (socket says 172.21.15.164:55066) 2024-09-13T23:07:20.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.813+0000 7f2026600640 1 -- 172.21.15.164:0/3688598099 learned_addr learned my addr 172.21.15.164:0/3688598099 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.813+0000 7f2026600640 1 -- 172.21.15.164:0/3688598099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560900246bc0 con 0x560900321630 2024-09-13T23:07:20.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.813+0000 7f2026600640 1 --2- 172.21.15.164:0/3688598099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560900321630 0x56090049e880 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f2018001660 tx=0x7f2018001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e800810353e873 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.813+0000 7f1f14608640 1 -- 172.21.15.164:0/3688598099 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2018003450 con 0x560900321630 2024-09-13T23:07:20.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.813+0000 7f1f14608640 1 -- 172.21.15.164:0/3688598099 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2018003610 con 0x560900321630 2024-09-13T23:07:20.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.813+0000 7f1f14608640 1 -- 172.21.15.164:0/3688598099 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20180039b0 con 0x560900321630 2024-09-13T23:07:20.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.814+0000 7f2028b0c800 1 -- 172.21.15.164:0/3688598099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560900321630 msgr2=0x56090049e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.814+0000 7f2028b0c800 1 --2- 172.21.15.164:0/3688598099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560900321630 0x56090049e880 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f2018001660 tx=0x7f2018001b20 comp rx=0 tx=0).stop 2024-09-13T23:07:20.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.814+0000 7f2028b0c800 1 -- 172.21.15.164:0/3688598099 shutdown_connections 2024-09-13T23:07:20.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.814+0000 7f2028b0c800 1 --2- 172.21.15.164:0/3688598099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560900321630 0x56090049e880 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.814+0000 7f2028b0c800 1 -- 172.21.15.164:0/3688598099 >> 172.21.15.164:0/3688598099 conn(0x5609003a7db0 msgr2=0x56090049a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.814+0000 7f2028b0c800 1 -- 172.21.15.164:0/3688598099 shutdown_connections 2024-09-13T23:07:20.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.814+0000 7f2028b0c800 1 -- 172.21.15.164:0/3688598099 wait complete. 2024-09-13T23:07:20.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.814+0000 7f2028b0c800 1 Processor -- start 2024-09-13T23:07:20.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.815+0000 7f2028b0c800 1 -- start start 2024-09-13T23:07:20.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.815+0000 7f2028b0c800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560900321630 0x5609004a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.815+0000 7f2028b0c800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5609003b6920 con 0x560900321630 2024-09-13T23:07:20.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.815+0000 7f2026600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560900321630 0x5609004a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.815+0000 7f2026600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560900321630 0x5609004a62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55076/0 (socket says 172.21.15.164:55076) 2024-09-13T23:07:20.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.815+0000 7f2026600640 1 -- 172.21.15.164:0/3717774221 learned_addr learned my addr 172.21.15.164:0/3717774221 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.815+0000 7f2026600640 1 -- 172.21.15.164:0/3717774221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56090025afe0 con 0x560900321630 2024-09-13T23:07:20.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.815+0000 7f2026600640 1 --2- 172.21.15.164:0/3717774221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560900321630 0x5609004a62a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x56090049f6e0 tx=0x7f2018001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.816+0000 7f1f12e05640 1 -- 172.21.15.164:0/3717774221 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2018025070 con 0x560900321630 2024-09-13T23:07:20.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.816+0000 7f1f12e05640 1 -- 172.21.15.164:0/3717774221 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2018019040 con 0x560900321630 2024-09-13T23:07:20.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.816+0000 7f1f12e05640 1 -- 172.21.15.164:0/3717774221 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2018013970 con 0x560900321630 2024-09-13T23:07:20.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.816+0000 7f2028b0c800 1 -- 172.21.15.164:0/3717774221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609004a67e0 con 0x560900321630 2024-09-13T23:07:20.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.816+0000 7f2028b0c800 1 -- 172.21.15.164:0/3717774221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609004a6d60 con 0x560900321630 2024-09-13T23:07:20.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.816+0000 7f1f12e05640 1 -- 172.21.15.164:0/3717774221 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2018010070 con 0x560900321630 2024-09-13T23:07:20.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.817+0000 7f1f12e05640 1 --2- 172.21.15.164:0/3717774221 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f0c036b40 0x7f1f0c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.817+0000 7f1f12e05640 1 -- 172.21.15.164:0/3717774221 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f201804c1f0 con 0x560900321630 2024-09-13T23:07:20.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.817+0000 7f2025dff640 1 --2- 172.21.15.164:0/3717774221 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f0c036b40 0x7f1f0c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.817+0000 7f2028b0c800 1 --2- 172.21.15.164:0/3717774221 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5609003b3d20 0x5609004ad310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.817+0000 7f2028b0c800 1 -- 172.21.15.164:0/3717774221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5609004ad910 con 0x5609003b3d20 2024-09-13T23:07:20.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.817+0000 7f2026e01640 1 --2- 172.21.15.164:0/3717774221 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5609003b3d20 0x5609004ad310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.817+0000 7f2025dff640 1 --2- 172.21.15.164:0/3717774221 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f0c036b40 0x7f1f0c039000 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f201c057000 tx=0x7f201c052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.817+0000 7f2026e01640 1 --2- 172.21.15.164:0/3717774221 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5609003b3d20 0x5609004ad310 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.818+0000 7f2026e01640 1 -- 172.21.15.164:0/3717774221 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20200083e0 con 0x5609003b3d20 2024-09-13T23:07:20.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.818+0000 7f2028b0c800 1 -- 172.21.15.164:0/3717774221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5609004aa8c0 con 0x5609003b3d20 2024-09-13T23:07:20.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.818+0000 7f2026e01640 1 -- 172.21.15.164:0/3717774221 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f20200083e0 con 0x5609003b3d20 2024-09-13T23:07:20.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.818+0000 7f2028b0c800 1 -- 172.21.15.164:0/3717774221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5609004af710 con 0x5609003b3d20 2024-09-13T23:07:20.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.818+0000 7f2026e01640 1 -- 172.21.15.164:0/3717774221 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f20200083e0 con 0x5609003b3d20 2024-09-13T23:07:20.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.818+0000 7f2028b0c800 1 -- 172.21.15.164:0/3717774221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5609004ae940 con 0x5609003b3d20 2024-09-13T23:07:20.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.818+0000 7f2026e01640 1 -- 172.21.15.164:0/3717774221 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f20200083e0 con 0x5609003b3d20 2024-09-13T23:07:20.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.818+0000 7f2028b0c800 1 -- 172.21.15.164:0/3717774221 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5609004aed30 con 0x5609003b3d20 2024-09-13T23:07:20.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.819+0000 7f2026e01640 1 -- 172.21.15.164:0/3717774221 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f20200083e0 con 0x5609003b3d20 2024-09-13T23:07:20.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.819+0000 7f2028b0c800 1 Processor -- start 2024-09-13T23:07:20.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.819+0000 7f2028b0c800 1 -- start start 2024-09-13T23:07:20.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.819+0000 7f2028b0c800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609004bdd50 0x5609004be170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.819+0000 7f2028b0c800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560900248580 con 0x5609004bdd50 2024-09-13T23:07:20.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.820+0000 7f2025dff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609004bdd50 0x5609004be170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.820+0000 7f2025dff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609004bdd50 0x5609004be170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55082/0 (socket says 172.21.15.164:55082) 2024-09-13T23:07:20.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.820+0000 7f2025dff640 1 -- 172.21.15.164:0/3545801805 learned_addr learned my addr 172.21.15.164:0/3545801805 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.820+0000 7f2025dff640 1 -- 172.21.15.164:0/3545801805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609004be6b0 con 0x5609004bdd50 2024-09-13T23:07:20.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.820+0000 7f2025dff640 1 --2- 172.21.15.164:0/3545801805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609004bdd50 0x5609004be170 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f201c025bf0 tx=0x7f201c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.820+0000 7f1f0bfff640 1 -- 172.21.15.164:0/3545801805 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f201c072560 con 0x5609004bdd50 2024-09-13T23:07:20.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.820+0000 7f1f0bfff640 1 -- 172.21.15.164:0/3545801805 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f201c072700 con 0x5609004bdd50 2024-09-13T23:07:20.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.820+0000 7f2028b0c800 1 -- 172.21.15.164:0/3545801805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609004be8e0 con 0x5609004bdd50 2024-09-13T23:07:20.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.820+0000 7f1f0bfff640 1 -- 172.21.15.164:0/3545801805 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f201c0729e0 con 0x5609004bdd50 2024-09-13T23:07:20.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.820+0000 7f2028b0c800 1 -- 172.21.15.164:0/3545801805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609004c1560 con 0x5609004bdd50 2024-09-13T23:07:20.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.821+0000 7f1f0bfff640 1 -- 172.21.15.164:0/3545801805 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f201c07b440 con 0x5609004bdd50 2024-09-13T23:07:20.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.821+0000 7f1f0bfff640 1 --2- 172.21.15.164:0/3545801805 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f00036b90 0x7f1f00039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.821+0000 7f1f0bfff640 1 -- 172.21.15.164:0/3545801805 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f201c092f40 con 0x5609004bdd50 2024-09-13T23:07:20.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.821+0000 7f2026e01640 1 --2- 172.21.15.164:0/3545801805 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f00036b90 0x7f1f00039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.821+0000 7f2028b0c800 1 Processor -- start 2024-09-13T23:07:20.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.822+0000 7f2026e01640 1 --2- 172.21.15.164:0/3545801805 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f00036b90 0x7f1f00039050 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x5609004ae460 tx=0x7f2020000f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.822+0000 7f2028b0c800 1 -- start start 2024-09-13T23:07:20.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.822+0000 7f2028b0c800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609004ca940 0x5609004cad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.822+0000 7f2028b0c800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56090049efd0 con 0x5609004ca940 2024-09-13T23:07:20.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.822+0000 7f2025dff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609004ca940 0x5609004cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.822+0000 7f2025dff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609004ca940 0x5609004cad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55090/0 (socket says 172.21.15.164:55090) 2024-09-13T23:07:20.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.822+0000 7f2025dff640 1 -- 172.21.15.164:0/1660269971 learned_addr learned my addr 172.21.15.164:0/1660269971 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.822+0000 7f2025dff640 1 -- 172.21.15.164:0/1660269971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609004cb310 con 0x5609004ca940 2024-09-13T23:07:20.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.822+0000 7f2025dff640 1 --2- 172.21.15.164:0/1660269971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609004ca940 0x5609004cad40 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f201c0911d0 tx=0x7f201c071e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc2d3b9ecab1a99 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.823+0000 7f1f09ffb640 1 -- 172.21.15.164:0/1660269971 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f201c07bc50 con 0x5609004ca940 2024-09-13T23:07:20.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.823+0000 7f1f09ffb640 1 -- 172.21.15.164:0/1660269971 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f201c0713d0 con 0x5609004ca940 2024-09-13T23:07:20.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.823+0000 7f1f09ffb640 1 -- 172.21.15.164:0/1660269971 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f201c07bdf0 con 0x5609004ca940 2024-09-13T23:07:20.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.823+0000 7f2028b0c800 1 -- 172.21.15.164:0/1660269971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609004ca940 msgr2=0x5609004cad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.823+0000 7f2028b0c800 1 --2- 172.21.15.164:0/1660269971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609004ca940 0x5609004cad40 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f201c0911d0 tx=0x7f201c071e60 comp rx=0 tx=0).stop 2024-09-13T23:07:20.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.823+0000 7f2028b0c800 1 -- 172.21.15.164:0/1660269971 shutdown_connections 2024-09-13T23:07:20.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.823+0000 7f2028b0c800 1 --2- 172.21.15.164:0/1660269971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609004ca940 0x5609004cad40 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.823+0000 7f2028b0c800 1 -- 172.21.15.164:0/1660269971 >> 172.21.15.164:0/1660269971 conn(0x5609004c6ca0 msgr2=0x5609004c4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.823+0000 7f2028b0c800 1 -- 172.21.15.164:0/1660269971 shutdown_connections 2024-09-13T23:07:20.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.823+0000 7f2028b0c800 1 -- 172.21.15.164:0/1660269971 wait complete. 2024-09-13T23:07:20.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.823+0000 7f2028b0c800 1 Processor -- start 2024-09-13T23:07:20.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.823+0000 7f2028b0c800 1 -- start start 2024-09-13T23:07:20.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.824+0000 7f2028b0c800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609004ca940 0x5609004d1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.824+0000 7f2028b0c800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5609004cb980 con 0x5609004ca940 2024-09-13T23:07:20.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.824+0000 7f2025dff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609004ca940 0x5609004d1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.824+0000 7f2025dff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609004ca940 0x5609004d1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:55094/0 (socket says 172.21.15.164:55094) 2024-09-13T23:07:20.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.824+0000 7f2025dff640 1 -- 172.21.15.164:0/3843392206 learned_addr learned my addr 172.21.15.164:0/3843392206 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:07:20.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.824+0000 7f2025dff640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609004d2390 con 0x5609004ca940 2024-09-13T23:07:20.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.824+0000 7f2025dff640 1 --2- 172.21.15.164:0/3843392206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609004ca940 0x5609004d1e50 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x5609004c5910 tx=0x7f201c091160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.824+0000 7f1ef7fff640 1 -- 172.21.15.164:0/3843392206 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f201c09d070 con 0x5609004ca940 2024-09-13T23:07:20.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.824+0000 7f1ef7fff640 1 -- 172.21.15.164:0/3843392206 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f201c094030 con 0x5609004ca940 2024-09-13T23:07:20.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.824+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609004d2620 con 0x5609004ca940 2024-09-13T23:07:20.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.824+0000 7f1ef7fff640 1 -- 172.21.15.164:0/3843392206 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f201c07bd80 con 0x5609004ca940 2024-09-13T23:07:20.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.825+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609004d52d0 con 0x5609004ca940 2024-09-13T23:07:20.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.825+0000 7f1ef7fff640 1 -- 172.21.15.164:0/3843392206 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f201c0a0070 con 0x5609004ca940 2024-09-13T23:07:20.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.825+0000 7f1ef7fff640 1 --2- 172.21.15.164:0/3843392206 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1ef0036af0 0x7f1ef0038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.825+0000 7f1ef7fff640 1 -- 172.21.15.164:0/3843392206 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f201c0a3d60 con 0x5609004ca940 2024-09-13T23:07:20.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.826+0000 7f2026e01640 1 --2- 172.21.15.164:0/3843392206 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1ef0036af0 0x7f1ef0038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.826+0000 7f2026e01640 1 --2- 172.21.15.164:0/3843392206 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1ef0036af0 0x7f1ef0038fb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f202000f010 tx=0x7f202000c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.826+0000 7f2028b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.826+0000 7f2028b0c800 1 --2- 172.21.15.164:0/3843392206 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5609004dd940 0x5609004dfe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.826+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5609004e0550 con 0x5609004dd940 2024-09-13T23:07:20.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.826+0000 7f2026600640 1 --2- 172.21.15.164:0/3843392206 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5609004dd940 0x5609004dfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.826+0000 7f2026600640 1 --2- 172.21.15.164:0/3843392206 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5609004dd940 0x5609004dfe00 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.827+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f201800f030 con 0x5609004dd940 2024-09-13T23:07:20.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.827+0000 7f2028b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.827+0000 7f2028b0c800 20 realm 2024-09-13T23:07:20.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.827+0000 7f2028b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.827+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5609004e0960 con 0x5609004dd940 2024-09-13T23:07:20.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.827+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f201800f030 con 0x5609004dd940 2024-09-13T23:07:20.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.827+0000 7f2028b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.827+0000 7f2028b0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:07:20.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.827+0000 7f2028b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.827+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5609004e1230 con 0x5609004dd940 2024-09-13T23:07:20.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.827+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f201800f030 con 0x5609004dd940 2024-09-13T23:07:20.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.827+0000 7f2028b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.827+0000 7f2028b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.827+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5609004e15d0 con 0x5609004dd940 2024-09-13T23:07:20.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.827+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f201800f030 con 0x5609004dd940 2024-09-13T23:07:20.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.827+0000 7f2028b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:20.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.827+0000 7f2028b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.827+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5609004e1e20 con 0x5609004dd940 2024-09-13T23:07:20.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.828+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f201800f030 con 0x5609004dd940 2024-09-13T23:07:20.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.828+0000 7f2028b0c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:07:20.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.828+0000 7f2028b0c800 20 searching for the correct realm 2024-09-13T23:07:20.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.828+0000 7f2028b0c800 1 --2- 172.21.15.164:0/3843392206 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5609004e3b90 0x5609004e5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.828+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x5609004e3b90 2024-09-13T23:07:20.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.828+0000 7f2025dff640 1 --2- 172.21.15.164:0/3843392206 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5609004e3b90 0x5609004e5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.828+0000 7f2025dff640 1 --2- 172.21.15.164:0/3843392206 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5609004e3b90 0x5609004e5f80 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.828+0000 7f2025dff640 1 -- 172.21.15.164:0/3843392206 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201c09f030 con 0x5609004e3b90 2024-09-13T23:07:20.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.828+0000 7f2025dff640 1 --2- 172.21.15.164:0/3843392206 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f201c0a2060 0x7f201c091570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.828+0000 7f2025dff640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x7f201c0a2060 2024-09-13T23:07:20.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.829+0000 7f2026e01640 1 --2- 172.21.15.164:0/3843392206 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f201c0a2060 0x7f201c091570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.829+0000 7f2026e01640 1 --2- 172.21.15.164:0/3843392206 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f201c0a2060 0x7f201c091570 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.829+0000 7f2026e01640 1 -- 172.21.15.164:0/3843392206 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f202002f040 con 0x7f201c0a2060 2024-09-13T23:07:20.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.829+0000 7f2026e01640 1 --2- 172.21.15.164:0/3843392206 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f2020019040 0x7f2020019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:20.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.829+0000 7f2026e01640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x7f2020019040 2024-09-13T23:07:20.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.829+0000 7f2026600640 1 --2- 172.21.15.164:0/3843392206 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f2020019040 0x7f2020019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:20.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.830+0000 7f2026600640 1 --2- 172.21.15.164:0/3843392206 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f2020019040 0x7f2020019930 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:20.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.830+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201800f030 con 0x7f2020019040 2024-09-13T23:07:20.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.830+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x5609004dd940 2024-09-13T23:07:20.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.830+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f201800f030 con 0x5609004dd940 2024-09-13T23:07:20.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.830+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x5609004dd940 2024-09-13T23:07:20.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.830+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201800f030 con 0x5609004dd940 2024-09-13T23:07:20.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.830+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x7f2020019040 2024-09-13T23:07:20.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.831+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201800f030 con 0x7f2020019040 2024-09-13T23:07:20.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.831+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x7f2020019040 2024-09-13T23:07:20.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.831+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201800f030 con 0x7f2020019040 2024-09-13T23:07:20.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.831+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x7f201c0a2060 2024-09-13T23:07:20.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.831+0000 7f2026e01640 1 -- 172.21.15.164:0/3843392206 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f202002f040 con 0x7f201c0a2060 2024-09-13T23:07:20.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.831+0000 7f2026e01640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x5609004e3b90 2024-09-13T23:07:20.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.831+0000 7f2025dff640 1 -- 172.21.15.164:0/3843392206 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201c09f030 con 0x5609004e3b90 2024-09-13T23:07:20.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.831+0000 7f2025dff640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x5609004dd940 2024-09-13T23:07:20.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.831+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201800f030 con 0x5609004dd940 2024-09-13T23:07:20.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.831+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x7f2020019040 2024-09-13T23:07:20.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.832+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201800f030 con 0x7f2020019040 2024-09-13T23:07:20.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.832+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x5609004dd940 2024-09-13T23:07:20.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.832+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201800f030 con 0x5609004dd940 2024-09-13T23:07:20.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.832+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x7f201c0a2060 2024-09-13T23:07:20.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.832+0000 7f2026e01640 1 -- 172.21.15.164:0/3843392206 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f202002f040 con 0x7f201c0a2060 2024-09-13T23:07:20.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.832+0000 7f2026e01640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x5609004e3b90 2024-09-13T23:07:20.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.832+0000 7f2025dff640 1 -- 172.21.15.164:0/3843392206 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201c09f030 con 0x5609004e3b90 2024-09-13T23:07:20.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.832+0000 7f2025dff640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x5609004e3b90 2024-09-13T23:07:20.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.833+0000 7f2025dff640 1 -- 172.21.15.164:0/3843392206 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201c09f030 con 0x5609004e3b90 2024-09-13T23:07:20.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.833+0000 7f2025dff640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x7f2020019040 2024-09-13T23:07:20.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.833+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201800f030 con 0x7f2020019040 2024-09-13T23:07:20.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.833+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x5609004e3b90 2024-09-13T23:07:20.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.833+0000 7f2025dff640 1 -- 172.21.15.164:0/3843392206 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201c09f030 con 0x5609004e3b90 2024-09-13T23:07:20.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.833+0000 7f2025dff640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x5609004e3b90 2024-09-13T23:07:20.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.833+0000 7f2025dff640 1 -- 172.21.15.164:0/3843392206 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201c09f030 con 0x5609004e3b90 2024-09-13T23:07:20.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.833+0000 7f2025dff640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x5609004dd940 2024-09-13T23:07:20.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.834+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201800f030 con 0x5609004dd940 2024-09-13T23:07:20.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.834+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x5609004dd940 2024-09-13T23:07:20.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.834+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f201800f030 con 0x5609004dd940 2024-09-13T23:07:20.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.834+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x7f2020019040 2024-09-13T23:07:20.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.834+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201800f030 con 0x7f2020019040 2024-09-13T23:07:20.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.834+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x5609004e3b90 2024-09-13T23:07:20.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.834+0000 7f2025dff640 1 -- 172.21.15.164:0/3843392206 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201c09f030 con 0x5609004e3b90 2024-09-13T23:07:20.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.834+0000 7f2025dff640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x7f201c0a2060 2024-09-13T23:07:20.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.835+0000 7f2026e01640 1 -- 172.21.15.164:0/3843392206 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f202002f040 con 0x7f201c0a2060 2024-09-13T23:07:20.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.835+0000 7f2026e01640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x5609004dd940 2024-09-13T23:07:20.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.835+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f201800f030 con 0x5609004dd940 2024-09-13T23:07:20.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.835+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x7f2020019040 2024-09-13T23:07:20.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.835+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201800f030 con 0x7f2020019040 2024-09-13T23:07:20.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.835+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x5609004e3b90 2024-09-13T23:07:20.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.835+0000 7f2025dff640 1 -- 172.21.15.164:0/3843392206 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201c09f030 con 0x5609004e3b90 2024-09-13T23:07:20.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.835+0000 7f2025dff640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x7f2020019040 2024-09-13T23:07:20.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.836+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201800f030 con 0x7f2020019040 2024-09-13T23:07:20.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.836+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x7f201c0a2060 2024-09-13T23:07:20.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.836+0000 7f2026e01640 1 -- 172.21.15.164:0/3843392206 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f202002f040 con 0x7f201c0a2060 2024-09-13T23:07:20.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.836+0000 7f2026e01640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x5609004e3b90 2024-09-13T23:07:20.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.836+0000 7f2025dff640 1 -- 172.21.15.164:0/3843392206 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201c09f030 con 0x5609004e3b90 2024-09-13T23:07:20.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.836+0000 7f2025dff640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x7f201c0a2060 2024-09-13T23:07:20.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.836+0000 7f2026e01640 1 -- 172.21.15.164:0/3843392206 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f202002f040 con 0x7f201c0a2060 2024-09-13T23:07:20.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.836+0000 7f2026e01640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x5609004dd940 2024-09-13T23:07:20.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.836+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f201800f030 con 0x5609004dd940 2024-09-13T23:07:20.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.836+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5609004e6590 con 0x7f201c0a2060 2024-09-13T23:07:20.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.837+0000 7f2026e01640 1 -- 172.21.15.164:0/3843392206 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f202002f040 con 0x7f201c0a2060 2024-09-13T23:07:20.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.837+0000 7f2028b0c800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:07:20.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.837+0000 7f2028b0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:07:20.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.837+0000 7f2028b0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:07:20.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.837+0000 7f2028b0c800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:07:20.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.837+0000 7f2028b0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:07:20.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.837+0000 7f2028b0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:07:20.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.837+0000 7f2028b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.837+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5609004e2770 con 0x5609004dd940 2024-09-13T23:07:20.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.837+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f201800f030 con 0x5609004dd940 2024-09-13T23:07:20.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.837+0000 7f2028b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.837+0000 7f2028b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.837+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5609004e3010 con 0x5609004dd940 2024-09-13T23:07:20.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.837+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f201800f030 con 0x5609004dd940 2024-09-13T23:07:20.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.837+0000 7f2028b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:07:20.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.837+0000 7f2028b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.837+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5609004e3010 con 0x5609004dd940 2024-09-13T23:07:20.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.838+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f201800f030 con 0x5609004dd940 2024-09-13T23:07:20.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.838+0000 7f2028b0c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:07:20.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.838+0000 7f2028b0c800 20 zone default found 2024-09-13T23:07:20.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.838+0000 7f2028b0c800 4 Realm: () 2024-09-13T23:07:20.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.838+0000 7f2028b0c800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:07:20.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.838+0000 7f2028b0c800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:07:20.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.838+0000 7f2028b0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:07:20.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.838+0000 7f2028b0c800 20 zonegroup default 2024-09-13T23:07:20.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.838+0000 7f2028b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.838+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5609004e69f0 con 0x7f2020019040 2024-09-13T23:07:20.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.838+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f201800f030 con 0x7f2020019040 2024-09-13T23:07:20.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.838+0000 7f2028b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.838+0000 7f2028b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.838+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5609004e8460 con 0x5609004e3b90 2024-09-13T23:07:20.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.838+0000 7f2025dff640 1 -- 172.21.15.164:0/3843392206 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f201c09f030 con 0x5609004e3b90 2024-09-13T23:07:20.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.838+0000 7f2028b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.838+0000 7f2028b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.838+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5609004e8960 con 0x5609004e3b90 2024-09-13T23:07:20.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.838+0000 7f2025dff640 1 -- 172.21.15.164:0/3843392206 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f201c09f030 con 0x5609004e3b90 2024-09-13T23:07:20.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.839+0000 7f2028b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:07:20.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.839+0000 7f2028b0c800 20 started sync module instance, tier type = 2024-09-13T23:07:20.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.839+0000 7f2028b0c800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:07:20.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.839+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5609004e7870 con 0x7f201c0a2060 2024-09-13T23:07:20.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.840+0000 7f2026e01640 1 -- 172.21.15.164:0/3843392206 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f202002f040 con 0x7f201c0a2060 2024-09-13T23:07:20.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.840+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94596659838352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5609004e7870 con 0x7f201c0a2060 2024-09-13T23:07:20.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.840+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5609004e93e0 con 0x5609004dd940 2024-09-13T23:07:20.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.841+0000 7f2026e01640 1 -- 172.21.15.164:0/3843392206 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94596659838352] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f202002f040 con 0x7f201c0a2060 2024-09-13T23:07:20.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.841+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201800f030 con 0x5609004dd940 2024-09-13T23:07:20.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.841+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94596659843344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5609004e7870 con 0x5609004dd940 2024-09-13T23:07:20.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.841+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5609004e9e50 con 0x5609004e3b90 2024-09-13T23:07:20.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.842+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94596659843344] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201800f030 con 0x5609004dd940 2024-09-13T23:07:20.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.842+0000 7f2025dff640 1 -- 172.21.15.164:0/3843392206 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201c09f030 con 0x5609004e3b90 2024-09-13T23:07:20.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.842+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94596659835840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5609004e77e0 con 0x5609004e3b90 2024-09-13T23:07:20.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.842+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5609004ead10 con 0x7f201c0a2060 2024-09-13T23:07:20.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.843+0000 7f2025dff640 1 -- 172.21.15.164:0/3843392206 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94596659835840] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201c09f030 con 0x5609004e3b90 2024-09-13T23:07:20.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.843+0000 7f2026e01640 1 -- 172.21.15.164:0/3843392206 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f202002f040 con 0x7f201c0a2060 2024-09-13T23:07:20.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.843+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94596659849312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5609004eac80 con 0x7f201c0a2060 2024-09-13T23:07:20.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.843+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5609004ebbd0 con 0x5609004dd940 2024-09-13T23:07:20.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.844+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201800f030 con 0x5609004dd940 2024-09-13T23:07:20.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.844+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94596659853088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5609004ebb40 con 0x5609004dd940 2024-09-13T23:07:20.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.844+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5609004ecac0 con 0x7f2020019040 2024-09-13T23:07:20.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.845+0000 7f2026e01640 1 -- 172.21.15.164:0/3843392206 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94596659849312] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f202002f040 con 0x7f201c0a2060 2024-09-13T23:07:20.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.846+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94596659853088] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201800f030 con 0x5609004dd940 2024-09-13T23:07:20.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.846+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201800f030 con 0x7f2020019040 2024-09-13T23:07:20.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.846+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94596659851520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5609004ec610 con 0x7f2020019040 2024-09-13T23:07:20.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.846+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5609004ed390 con 0x7f2020019040 2024-09-13T23:07:20.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.847+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94596659851520] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201800f030 con 0x7f2020019040 2024-09-13T23:07:20.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.847+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201800f030 con 0x7f2020019040 2024-09-13T23:07:20.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.847+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94596659855152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5609004ec610 con 0x7f2020019040 2024-09-13T23:07:20.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.847+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5609004ed9b0 con 0x7f2020019040 2024-09-13T23:07:20.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.848+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94596659855152] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201800f030 con 0x7f2020019040 2024-09-13T23:07:20.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.848+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(58 notify.7 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201800f030 con 0x7f2020019040 2024-09-13T23:07:20.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.848+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94596659859168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5609004ed9b0 con 0x7f2020019040 2024-09-13T23:07:20.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.848+0000 7f2028b0c800 20 add_watcher() i=0 2024-09-13T23:07:20.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.848+0000 7f2028b0c800 20 add_watcher() i=1 2024-09-13T23:07:20.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.848+0000 7f2028b0c800 20 add_watcher() i=2 2024-09-13T23:07:20.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.848+0000 7f2028b0c800 20 add_watcher() i=3 2024-09-13T23:07:20.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.848+0000 7f2028b0c800 20 add_watcher() i=4 2024-09-13T23:07:20.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.848+0000 7f2028b0c800 20 add_watcher() i=5 2024-09-13T23:07:20.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.848+0000 7f2028b0c800 20 add_watcher() i=6 2024-09-13T23:07:20.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.849+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94596659859168] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201800f030 con 0x7f2020019040 2024-09-13T23:07:20.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.849+0000 7f2028b0c800 20 add_watcher() i=7 2024-09-13T23:07:20.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.849+0000 7f2028b0c800 2 all 8 watchers are set, enabling cache 2024-09-13T23:07:20.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.849+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5609004f0cb0 con 0x5609004dd940 2024-09-13T23:07:20.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.850+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f201800f030 con 0x5609004dd940 2024-09-13T23:07:20.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.850+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94596659861104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5609004edf40 con 0x5609004dd940 2024-09-13T23:07:20.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.851+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94596659861104] v34'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f201800f030 con 0x5609004dd940 2024-09-13T23:07:20.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.851+0000 7f1edcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:20.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.851+0000 7f2028b0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:07:20.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.851+0000 7f2028b0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:07:20.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.851+0000 7f2028b0c800 5 note: GC not initialized 2024-09-13T23:07:20.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.851+0000 7f1e577fe640 20 reqs_thread_entry: start 2024-09-13T23:07:20.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.851+0000 7f2028b0c800 20 init_complete bucket index max shards: 11 2024-09-13T23:07:20.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.851+0000 7f2028b0c800 20 Filter name: none 2024-09-13T23:07:20.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.851+0000 7f1e557fa640 20 reqs_thread_entry: start 2024-09-13T23:07:20.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.851+0000 7f2028b0c800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T23:07:20.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.851+0000 7f2028b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:07:20.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.852+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560900524180 con 0x7f2020019040 2024-09-13T23:07:20.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.852+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f201800f030 con 0x7f2020019040 2024-09-13T23:07:20.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.852+0000 7f2028b0c800 20 rados_obj.operate() r=0 bl.length=473 2024-09-13T23:07:20.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.852+0000 7f2028b0c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T23:07:20.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.852+0000 7f2028b0c800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:20.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.852+0000 7f2028b0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:07:20.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.852+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56090052ab30 con 0x7f2020019040 2024-09-13T23:07:20.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.853+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v34'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f201800f030 con 0x7f2020019040 2024-09-13T23:07:20.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.853+0000 7f2028b0c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:07:20.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.853+0000 7f2028b0c800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:20.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.853+0000 7f2028b0c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T23:07:20.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.853+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94596660110576 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560900526190 con 0x5609004dd940 2024-09-13T23:07:20.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.854+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== watch-notify(notify (1) cookie 94596659853088 notify 146028888099 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f201803e040 con 0x5609004dd940 2024-09-13T23:07:20.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.854+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(64 notify.4 [notify cookie 94596660110576 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f201800f030 con 0x5609004dd940 2024-09-13T23:07:20.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.854+0000 7f1f09ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888099 cookie 94596659853088 notifier 4931 bl.length()=649 2024-09-13T23:07:20.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.854+0000 7f1f09ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:07:20.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.854+0000 7f1f09ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:07:20.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.854+0000 7f1f09ffb640 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1eec003ea0 con 0x5609004dd940 2024-09-13T23:07:20.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.854+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== watch-notify(notify_complete (2) cookie 94596660110576 notify 146028888099 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5609004a6d60 con 0x5609004dd940 2024-09-13T23:07:20.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.854+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201800f030 con 0x5609004dd940 2024-09-13T23:07:20.866 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T23:07:18.801026Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:07:18.801015Z","tags":[],"group_ids":[]} 2024-09-13T23:07:20.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.855+0000 7f1edcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:07:20.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.855+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94596659861104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560900526950 con 0x5609004dd940 2024-09-13T23:07:20.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.856+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94596659861104] v34'273 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f201800f030 con 0x5609004dd940 2024-09-13T23:07:20.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.856+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94596659838352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560900526950 con 0x7f201c0a2060 2024-09-13T23:07:20.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.857+0000 7f2026e01640 1 -- 172.21.15.164:0/3843392206 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94596659838352] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f202002f040 con 0x7f201c0a2060 2024-09-13T23:07:20.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.857+0000 7f2028b0c800 20 remove_watcher() i=0 2024-09-13T23:07:20.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.857+0000 7f2028b0c800 2 removed watcher, disabling cache 2024-09-13T23:07:20.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.857+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94596659843344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560900526950 con 0x5609004dd940 2024-09-13T23:07:20.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.858+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94596659843344] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201800f030 con 0x5609004dd940 2024-09-13T23:07:20.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.858+0000 7f2028b0c800 20 remove_watcher() i=1 2024-09-13T23:07:20.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.858+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94596659835840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560900526950 con 0x5609004e3b90 2024-09-13T23:07:20.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.859+0000 7f2025dff640 1 -- 172.21.15.164:0/3843392206 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94596659835840] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201c09f030 con 0x5609004e3b90 2024-09-13T23:07:20.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.859+0000 7f2028b0c800 20 remove_watcher() i=2 2024-09-13T23:07:20.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.859+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94596659849312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560900521ea0 con 0x7f201c0a2060 2024-09-13T23:07:20.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.860+0000 7f2026e01640 1 -- 172.21.15.164:0/3843392206 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94596659849312] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f202002f040 con 0x7f201c0a2060 2024-09-13T23:07:20.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.860+0000 7f2028b0c800 20 remove_watcher() i=3 2024-09-13T23:07:20.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.860+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94596659853088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560900521ea0 con 0x5609004dd940 2024-09-13T23:07:20.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.861+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94596659853088] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201800f030 con 0x5609004dd940 2024-09-13T23:07:20.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.861+0000 7f2028b0c800 20 remove_watcher() i=4 2024-09-13T23:07:20.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.861+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94596659851520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560900521ea0 con 0x7f2020019040 2024-09-13T23:07:20.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.862+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94596659851520] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201800f030 con 0x7f2020019040 2024-09-13T23:07:20.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.862+0000 7f2028b0c800 20 remove_watcher() i=5 2024-09-13T23:07:20.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.862+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94596659855152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560900521ea0 con 0x7f2020019040 2024-09-13T23:07:20.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.863+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94596659855152] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201800f030 con 0x7f2020019040 2024-09-13T23:07:20.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.863+0000 7f2028b0c800 20 remove_watcher() i=6 2024-09-13T23:07:20.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.863+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94596659859168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560900521ea0 con 0x7f2020019040 2024-09-13T23:07:20.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.864+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94596659859168] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201800f030 con 0x7f2020019040 2024-09-13T23:07:20.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.864+0000 7f2028b0c800 20 remove_watcher() i=7 2024-09-13T23:07:20.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.864+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f2020019040 msgr2=0x7f2020019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.864+0000 7f2028b0c800 1 --2- 172.21.15.164:0/3843392206 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f2020019040 0x7f2020019930 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.864+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5609004dd940 msgr2=0x5609004dfe00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.864+0000 7f2028b0c800 1 --2- 172.21.15.164:0/3843392206 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5609004dd940 0x5609004dfe00 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.864+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f201c0a2060 msgr2=0x7f201c091570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.864+0000 7f2028b0c800 1 --2- 172.21.15.164:0/3843392206 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f201c0a2060 0x7f201c091570 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.864+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5609004e3b90 msgr2=0x5609004e5f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.864+0000 7f2028b0c800 1 --2- 172.21.15.164:0/3843392206 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x5609004e3b90 0x5609004e5f80 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.864+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1ef0036af0 msgr2=0x7f1ef0038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.864+0000 7f2028b0c800 1 --2- 172.21.15.164:0/3843392206 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1ef0036af0 0x7f1ef0038fb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f202000f010 tx=0x7f202000c040 comp rx=0 tx=0).stop 2024-09-13T23:07:20.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.864+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609004ca940 msgr2=0x5609004d1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.864+0000 7f2028b0c800 1 --2- 172.21.15.164:0/3843392206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609004ca940 0x5609004d1e50 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x5609004c5910 tx=0x7f201c091160 comp rx=0 tx=0).stop 2024-09-13T23:07:20.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.864+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 reap_dead start 2024-09-13T23:07:20.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.864+0000 7f2026600640 1 -- 172.21.15.164:0/3843392206 reap_dead start 2024-09-13T23:07:20.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.865+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 shutdown_connections 2024-09-13T23:07:20.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.865+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 >> 172.21.15.164:0/3843392206 conn(0x5609004c6ca0 msgr2=0x5609004c4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.865+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 shutdown_connections 2024-09-13T23:07:20.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.865+0000 7f2028b0c800 1 -- 172.21.15.164:0/3843392206 wait complete. 2024-09-13T23:07:20.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.865+0000 7f2028b0c800 1 -- 172.21.15.164:0/3545801805 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f00036b90 msgr2=0x7f1f00039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.865+0000 7f2028b0c800 1 --2- 172.21.15.164:0/3545801805 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f00036b90 0x7f1f00039050 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x5609004ae460 tx=0x7f2020000f90 comp rx=0 tx=0).stop 2024-09-13T23:07:20.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.865+0000 7f2028b0c800 1 -- 172.21.15.164:0/3545801805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609004bdd50 msgr2=0x5609004be170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.865+0000 7f2028b0c800 1 --2- 172.21.15.164:0/3545801805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609004bdd50 0x5609004be170 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f201c025bf0 tx=0x7f201c002fb0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.865+0000 7f2028b0c800 1 -- 172.21.15.164:0/3545801805 shutdown_connections 2024-09-13T23:07:20.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.865+0000 7f2028b0c800 1 --2- 172.21.15.164:0/3545801805 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f00036b90 0x7f1f00039050 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.865+0000 7f2028b0c800 1 --2- 172.21.15.164:0/3545801805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609004bdd50 0x5609004be170 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.865+0000 7f2028b0c800 1 -- 172.21.15.164:0/3545801805 >> 172.21.15.164:0/3545801805 conn(0x5609004b2ce0 msgr2=0x5609004b5860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.865+0000 7f2028b0c800 1 -- 172.21.15.164:0/3545801805 shutdown_connections 2024-09-13T23:07:20.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.865+0000 7f2028b0c800 1 -- 172.21.15.164:0/3545801805 wait complete. 2024-09-13T23:07:20.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.865+0000 7f2028b0c800 1 -- 172.21.15.164:0/3717774221 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5609003b3d20 msgr2=0x5609004ad310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.865+0000 7f2028b0c800 1 --2- 172.21.15.164:0/3717774221 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5609003b3d20 0x5609004ad310 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.865+0000 7f2028b0c800 1 -- 172.21.15.164:0/3717774221 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f0c036b40 msgr2=0x7f1f0c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.865+0000 7f2028b0c800 1 --2- 172.21.15.164:0/3717774221 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f0c036b40 0x7f1f0c039000 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f201c057000 tx=0x7f201c052000 comp rx=0 tx=0).stop 2024-09-13T23:07:20.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.865+0000 7f2028b0c800 1 -- 172.21.15.164:0/3717774221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560900321630 msgr2=0x5609004a62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:20.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.865+0000 7f2028b0c800 1 --2- 172.21.15.164:0/3717774221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560900321630 0x5609004a62a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x56090049f6e0 tx=0x7f2018001250 comp rx=0 tx=0).stop 2024-09-13T23:07:20.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.865+0000 7f2028b0c800 1 -- 172.21.15.164:0/3717774221 shutdown_connections 2024-09-13T23:07:20.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.865+0000 7f2028b0c800 1 --2- 172.21.15.164:0/3717774221 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x5609003b3d20 0x5609004ad310 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.865+0000 7f2028b0c800 1 --2- 172.21.15.164:0/3717774221 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1f0c036b40 0x7f1f0c039000 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.865+0000 7f2028b0c800 1 --2- 172.21.15.164:0/3717774221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560900321630 0x5609004a62a0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:20.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.865+0000 7f2028b0c800 1 -- 172.21.15.164:0/3717774221 >> 172.21.15.164:0/3717774221 conn(0x5609003a7db0 msgr2=0x560900498b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:20.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.866+0000 7f2028b0c800 1 -- 172.21.15.164:0/3717774221 shutdown_connections 2024-09-13T23:07:20.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:07:20.866+0000 7f2028b0c800 1 -- 172.21.15.164:0/3717774221 wait complete. 2024-09-13T23:07:20.877 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:07:18.801026Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:07:18.801015Z', 'tags': [], 'group_ids': []} 2024-09-13T23:07:20.877 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:07:18.801026Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:07:18.801015Z', 'tags': [], 'group_ids': []} 2024-09-13T23:07:20.877 ERROR:root:0 2024-09-13T23:07:20.877 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-13T23:07:20.892 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:07:20.893 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:07:20.904 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:07:20.905 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-13T23:07:20.919 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:07:20.919 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:07:20.931 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:07:20.932 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-13T23:07:20.948 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-09-13T23:07:20.948 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:07:20.960 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:07:20.961 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-13T23:07:20.976 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:07:20.976 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:07:20.988 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:07:20.988 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-13T23:07:21.004 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-13T23:07:21.004 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:07:21.017 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:07:21.018 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-13T23:07:21.034 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-13T23:07:21.034 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:07:21.047 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:07:21.047 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-13T23:07:21.062 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:07:21.063 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:07:21.074 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:07:21.075 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-13T23:07:21.087 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:07:21.087 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:07:21.100 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:07:21.100 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-13T23:07:21.115 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:07:21.115 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:07:21.127 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:07:21.127 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-13T23:07:21.140 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-13T23:07:21.140 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-13T23:07:21.152 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-13T23:07:21.174 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-13T23:07:21.187 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-13T23:07:21.187 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-13T23:07:21.200 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '4d3c0b48-20ce-488a-b409-36cc6d9502d0', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11', 'marker': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T23:07:21.169175Z', 'creation_time': '2024-09-13T23:07:21.165072Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T23:07:21.201 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-13T23:07:21.214 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '4d3c0b48-20ce-488a-b409-36cc6d9502d0', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11', 'marker': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T23:07:21.169175Z', 'creation_time': '2024-09-13T23:07:21.165072Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-13T23:07:21.219 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-13T23:07:21.232 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '4d3c0b48-20ce-488a-b409-36cc6d9502d0', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11', 'marker': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T23:07:21.169175Z', 'creation_time': '2024-09-13T23:07:21.165072Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T23:07:21.232 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-13T23:07:21.245 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx000003a8f6709cf2ea641-0066e4c5a9-4239-default', 'HostId': '4239-default-default'} 2024-09-13T23:07:21.250 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-13T23:07:21.265 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:07:21.265 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-13T23:07:21.281 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:07:21.293 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11'} 2024-09-13T23:07:21.314 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:07:21.361 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11'} 2024-09-13T23:07:21.381 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:07:21.381 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-13T23:07:21.399 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:07:21.414 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-13T23:07:21.429 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:07:21.430 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-13T23:07:21.445 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '4d3c0b48-20ce-488a-b409-36cc6d9502d0', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11', 'marker': 'a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T23:07:21.376273Z', 'creation_time': '2024-09-13T23:07:21.165072Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T23:08:21.488 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-13T23:08:21.517 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'anonymous', 'categories': []}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'bar', 'categories': []}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'bud', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'fud', 'categories': []}, {'bucket': 'myfoo7', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'fud', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}]} 2024-09-13T23:08:21.518 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-13T23:08:21.541 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}]}, {'bucket': 'myfoo7', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4}}]} 2024-09-13T23:08:21.541 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-13T23:08:21.554 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}]} 2024-09-13T23:08:21.555 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-13T23:08:21.567 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}}]} 2024-09-13T23:08:21.568 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-13T23:08:21.581 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}}]} 2024-09-13T23:08:21.581 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-13T23:08:21.595 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}]} 2024-09-13T23:08:21.595 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-13T23:08:21.609 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'useless-bucket', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}]} 2024-09-13T23:08:21.609 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-13T23:08:21.625 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:08:21.625 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-13T23:08:21.638 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-13T23:08:21.638 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-13T23:08:21.656 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:08:21.668 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-13T23:08:21.686 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:08:21.944 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-13T23:08:21.956 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000e3062833c65db463-0066e4c5e5-4239-default', 'HostId': '4239-default-default'} 2024-09-13T23:08:22.066 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-13T23:08:22.079 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-13T23:08:22.085 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-13T23:08:22.097 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-13T23:08:22.209 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-13T23:08:22.262 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:08:22.263 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-13T23:08:22.277 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-13T23:08:22.277 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-13T23:08:22.291 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-13T23:08:22.304 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-13T23:08:22.317 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx0000034012cd8a24a78b8-0066e4c5e6-4239-default', 'HostId': '4239-default-default'} 2024-09-13T23:08:22.336 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-13T23:08:22.381 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:08:22.381 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:08:22.393 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx0000071d43395fdbe685c-0066e4c5e6-4239-default', 'HostId': '4239-default-default'} 2024-09-13T23:08:22.394 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-13T23:08:22.405 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': 'cf23c940-4ed5-4d79-b536-21dd117d26cb'}]}} 2024-09-13T23:08:22.405 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-13T23:08:22.424 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:08:22.424 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-13T23:08:22.436 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-13T23:08:22.437 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-13T23:08:22.452 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000064ae3f68c4d27d38-0066e4c5e6-4239-default', 'HostId': '4239-default-default'} 2024-09-13T23:08:22.453 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-13T23:08:22.464 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000d19df61fec9eecc0-0066e4c5e6-4239-default', 'HostId': '4239-default-default'} 2024-09-13T23:08:22.474 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-13T23:08:22.485 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-13T23:08:22.486 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-13T23:08:22.498 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000e52e08a3cdbde6f9-0066e4c5e6-4239-default', 'HostId': '4239-default-default'} 2024-09-13T23:08:22.498 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-13T23:08:22.510 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000008ad2aeb2704e3109-0066e4c5e6-4239-default', 'HostId': '4239-default-default'} 2024-09-13T23:08:22.511 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-13T23:08:22.522 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-13T23:08:22.523 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-13T23:08:22.534 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000bea6d22ef9c99f55-0066e4c5e6-4239-default', 'HostId': '4239-default-default'} 2024-09-13T23:08:22.534 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-13T23:08:22.546 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000cbcc63ff0043c63e-0066e4c5e6-4239-default', 'HostId': '4239-default-default'} 2024-09-13T23:08:22.546 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-13T23:08:22.558 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000b19fc9351c290bb4-0066e4c5e6-4239-default', 'HostId': '4239-default-default'} 2024-09-13T23:08:22.558 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-13T23:08:22.569 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000d303eeba824fda58-0066e4c5e6-4239-default', 'HostId': '4239-default-default'} 2024-09-13T23:08:22.570 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-13T23:08:22.586 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:08:22.586 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-13T23:08:22.598 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-13T23:08:22.598 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-13T23:08:22.612 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:08:22.613 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-13T23:08:22.624 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-13T23:08:22.625 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-13T23:08:22.638 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:08:22.645 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-13T23:08:22.656 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-13T23:08:22.657 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T23:08:22.658 INFO:tasks.rgw.client.0.smithi164.stdout:2024-09-13T23:08:22.657+0000 7f4367f42640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 35907) UID: 0 2024-09-13T23:08:22.658 INFO:tasks.rgw.client.0.smithi164.stdout:2024-09-13T23:08:22.657+0000 7f436b793880 -1 shutting down 2024-09-13T23:08:28.758 INFO:tasks.rgw.client.0:Stopped 2024-09-13T23:08:28.759 DEBUG:teuthology.orchestra.run.smithi164:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-13T23:08:28.779 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f /etc/ceph/vault-root-token 2024-09-13T23:08:28.848 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-13T23:08:28.916 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-13T23:08:28.916 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-13T23:08:28.916 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-13T23:08:29.002 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:08:29.003 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:08:29.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.003+0000 7fc8b54bb800 1 Processor -- start 2024-09-13T23:08:29.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.003+0000 7fc8b54bb800 1 -- start start 2024-09-13T23:08:29.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.003+0000 7fc8b54bb800 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55c6e3793e90 0x55c6e3823140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:29.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.003+0000 7fc8b54bb800 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c6e36dfb30 con 0x55c6e3823680 2024-09-13T23:08:29.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.003+0000 7fc8b54bb800 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x55c6e36c1360 con 0x55c6e3793e90 2024-09-13T23:08:29.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.004+0000 7fc8b2faf640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x55c6e3793e90 0x55c6e3823140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:29.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.004+0000 7fc8abfff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x55c6e3823680 0x55c6e3825a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.164:39150/0 (socket says 172.21.15.164:39150) 2024-09-13T23:08:29.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.004+0000 7fc8abfff640 1 -- 172.21.15.164:0/3499360472 learned_addr learned my addr 172.21.15.164:0/3499360472 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-13T23:08:29.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.004+0000 7fc8b2faf640 1 -- 172.21.15.164:0/3499360472 >> v1:172.21.15.17:6789/0 conn(0x55c6e3823680 legacy=0x55c6e3825a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:29.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.004+0000 7fc8b2faf640 1 -- 172.21.15.164:0/3499360472 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6e36e7e00 con 0x55c6e3793e90 2024-09-13T23:08:29.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.006+0000 7fc8b2faf640 1 --2- 172.21.15.164:0/3499360472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e3793e90 0x55c6e3823140 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400a470 tx=0x7fc8a4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdafb4e6be605621 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:29.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.006+0000 7fc8b27ae640 1 -- 172.21.15.164:0/3499360472 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8a4053570 con 0x55c6e3793e90 2024-09-13T23:08:29.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.006+0000 7fc8b27ae640 1 -- 172.21.15.164:0/3499360472 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a4058070 con 0x55c6e3793e90 2024-09-13T23:08:29.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.006+0000 7fc8b27ae640 1 -- 172.21.15.164:0/3499360472 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8a4053880 con 0x55c6e3793e90 2024-09-13T23:08:29.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.007+0000 7fc8b54bb800 1 -- 172.21.15.164:0/3499360472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e3793e90 msgr2=0x55c6e3823140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:29.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.007+0000 7fc8b54bb800 1 --2- 172.21.15.164:0/3499360472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e3793e90 0x55c6e3823140 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400a470 tx=0x7fc8a4045a20 comp rx=0 tx=0).stop 2024-09-13T23:08:29.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.007+0000 7fc8b54bb800 1 -- 172.21.15.164:0/3499360472 shutdown_connections 2024-09-13T23:08:29.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.007+0000 7fc8b54bb800 1 --2- 172.21.15.164:0/3499360472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e3793e90 0x55c6e3823140 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:29.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.007+0000 7fc8b54bb800 1 -- 172.21.15.164:0/3499360472 >> 172.21.15.164:0/3499360472 conn(0x55c6e381adf0 msgr2=0x55c6e381d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:29.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.007+0000 7fc8b54bb800 1 -- 172.21.15.164:0/3499360472 shutdown_connections 2024-09-13T23:08:29.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.007+0000 7fc8b54bb800 1 -- 172.21.15.164:0/3499360472 wait complete. 2024-09-13T23:08:29.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.022+0000 7fc8b54bb800 1 Processor -- start 2024-09-13T23:08:29.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.022+0000 7fc8b54bb800 1 -- start start 2024-09-13T23:08:29.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.022+0000 7fc8b54bb800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e3793e90 0x55c6e390f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:29.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.022+0000 7fc8b54bb800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c6e376c330 con 0x55c6e3793e90 2024-09-13T23:08:29.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.023+0000 7fc8b2faf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e3793e90 0x55c6e390f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:29.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.023+0000 7fc8b2faf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e3793e90 0x55c6e390f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:59464/0 (socket says 172.21.15.164:59464) 2024-09-13T23:08:29.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.023+0000 7fc8b2faf640 1 -- 172.21.15.164:0/3983280845 learned_addr learned my addr 172.21.15.164:0/3983280845 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:08:29.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.023+0000 7fc8b2faf640 1 -- 172.21.15.164:0/3983280845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6e36b9bc0 con 0x55c6e3793e90 2024-09-13T23:08:29.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.023+0000 7fc8b2faf640 1 --2- 172.21.15.164:0/3983280845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e3793e90 0x55c6e390f880 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4025c20 tx=0x7fc8a4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e46dc329329c214c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:29.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.023+0000 7fc7a0e09640 1 -- 172.21.15.164:0/3983280845 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8a405c580 con 0x55c6e3793e90 2024-09-13T23:08:29.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.023+0000 7fc7a0e09640 1 -- 172.21.15.164:0/3983280845 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a4063030 con 0x55c6e3793e90 2024-09-13T23:08:29.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.023+0000 7fc7a0e09640 1 -- 172.21.15.164:0/3983280845 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8a405c850 con 0x55c6e3793e90 2024-09-13T23:08:29.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.024+0000 7fc8b54bb800 1 -- 172.21.15.164:0/3983280845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e3793e90 msgr2=0x55c6e390f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:29.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.024+0000 7fc8b54bb800 1 --2- 172.21.15.164:0/3983280845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e3793e90 0x55c6e390f880 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4025c20 tx=0x7fc8a4051000 comp rx=0 tx=0).stop 2024-09-13T23:08:29.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.024+0000 7fc8b54bb800 1 -- 172.21.15.164:0/3983280845 shutdown_connections 2024-09-13T23:08:29.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.024+0000 7fc8b54bb800 1 --2- 172.21.15.164:0/3983280845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e3793e90 0x55c6e390f880 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:29.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.024+0000 7fc8b54bb800 1 -- 172.21.15.164:0/3983280845 >> 172.21.15.164:0/3983280845 conn(0x55c6e381adf0 msgr2=0x55c6e390b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:29.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.024+0000 7fc8b54bb800 1 -- 172.21.15.164:0/3983280845 shutdown_connections 2024-09-13T23:08:29.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.024+0000 7fc8b54bb800 1 -- 172.21.15.164:0/3983280845 wait complete. 2024-09-13T23:08:29.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.025+0000 7fc8b54bb800 1 Processor -- start 2024-09-13T23:08:29.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.025+0000 7fc8b54bb800 1 -- start start 2024-09-13T23:08:29.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.025+0000 7fc8b54bb800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e3793e90 0x55c6e39171e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:29.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.025+0000 7fc8b54bb800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c6e38275f0 con 0x55c6e3793e90 2024-09-13T23:08:29.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.025+0000 7fc8b2faf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e3793e90 0x55c6e39171e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:29.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.025+0000 7fc8b2faf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e3793e90 0x55c6e39171e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:59478/0 (socket says 172.21.15.164:59478) 2024-09-13T23:08:29.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.025+0000 7fc8b2faf640 1 -- 172.21.15.164:0/2126635785 learned_addr learned my addr 172.21.15.164:0/2126635785 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:08:29.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.025+0000 7fc8b2faf640 1 -- 172.21.15.164:0/2126635785 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6e36cdfe0 con 0x55c6e3793e90 2024-09-13T23:08:29.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.025+0000 7fc8b2faf640 1 --2- 172.21.15.164:0/2126635785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e3793e90 0x55c6e39171e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x55c6e39106e0 tx=0x7fc8a4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:29.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.026+0000 7fc79f606640 1 -- 172.21.15.164:0/2126635785 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8a4054af0 con 0x55c6e3793e90 2024-09-13T23:08:29.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.026+0000 7fc79f606640 1 -- 172.21.15.164:0/2126635785 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a4054c90 con 0x55c6e3793e90 2024-09-13T23:08:29.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.026+0000 7fc79f606640 1 -- 172.21.15.164:0/2126635785 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8a4068420 con 0x55c6e3793e90 2024-09-13T23:08:29.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.026+0000 7fc8b54bb800 1 -- 172.21.15.164:0/2126635785 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c6e3917720 con 0x55c6e3793e90 2024-09-13T23:08:29.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.026+0000 7fc8b54bb800 1 -- 172.21.15.164:0/2126635785 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6e3917c40 con 0x55c6e3793e90 2024-09-13T23:08:29.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.027+0000 7fc79f606640 1 -- 172.21.15.164:0/2126635785 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc8a40685c0 con 0x55c6e3793e90 2024-09-13T23:08:29.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.027+0000 7fc79f606640 1 --2- 172.21.15.164:0/2126635785 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc798036b40 0x7fc798039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:29.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.027+0000 7fc79f606640 1 -- 172.21.15.164:0/2126635785 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc8a4070030 con 0x55c6e3793e90 2024-09-13T23:08:29.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.027+0000 7fc8abfff640 1 --2- 172.21.15.164:0/2126635785 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc798036b40 0x7fc798039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:29.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.027+0000 7fc8b54bb800 1 --2- 172.21.15.164:0/2126635785 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c6e3823680 0x55c6e391e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:29.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.027+0000 7fc8b54bb800 1 -- 172.21.15.164:0/2126635785 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e391e820 con 0x55c6e3823680 2024-09-13T23:08:29.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.027+0000 7fc8b37b0640 1 --2- 172.21.15.164:0/2126635785 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c6e3823680 0x55c6e391e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:29.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.027+0000 7fc8abfff640 1 --2- 172.21.15.164:0/2126635785 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc798036b40 0x7fc798039000 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc89c000f60 tx=0x7fc89c0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:29.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.027+0000 7fc8b37b0640 1 --2- 172.21.15.164:0/2126635785 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c6e3823680 0x55c6e391e250 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:29.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.028+0000 7fc8b37b0640 1 -- 172.21.15.164:0/2126635785 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8ac00a4a0 con 0x55c6e3823680 2024-09-13T23:08:29.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.028+0000 7fc8b54bb800 1 -- 172.21.15.164:0/2126635785 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e391b820 con 0x55c6e3823680 2024-09-13T23:08:29.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.028+0000 7fc8b37b0640 1 -- 172.21.15.164:0/2126635785 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc8ac00a4a0 con 0x55c6e3823680 2024-09-13T23:08:29.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.028+0000 7fc8b54bb800 1 -- 172.21.15.164:0/2126635785 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3920670 con 0x55c6e3823680 2024-09-13T23:08:29.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.028+0000 7fc8b37b0640 1 -- 172.21.15.164:0/2126635785 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc8ac00a4a0 con 0x55c6e3823680 2024-09-13T23:08:29.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.028+0000 7fc8b54bb800 1 -- 172.21.15.164:0/2126635785 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e391f8a0 con 0x55c6e3823680 2024-09-13T23:08:29.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.029+0000 7fc8b37b0640 1 -- 172.21.15.164:0/2126635785 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc8ac00a4a0 con 0x55c6e3823680 2024-09-13T23:08:29.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.029+0000 7fc8b54bb800 1 -- 172.21.15.164:0/2126635785 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e391fcf0 con 0x55c6e3823680 2024-09-13T23:08:29.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.029+0000 7fc8b37b0640 1 -- 172.21.15.164:0/2126635785 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc8ac00a4a0 con 0x55c6e3823680 2024-09-13T23:08:29.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.029+0000 7fc8b54bb800 1 Processor -- start 2024-09-13T23:08:29.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.029+0000 7fc8b54bb800 1 -- start start 2024-09-13T23:08:29.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.029+0000 7fc8b54bb800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e392ec80 0x55c6e392f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:29.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.029+0000 7fc8b54bb800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c6e36bb580 con 0x55c6e392ec80 2024-09-13T23:08:29.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.030+0000 7fc8abfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e392ec80 0x55c6e392f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:29.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.030+0000 7fc8abfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e392ec80 0x55c6e392f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:59486/0 (socket says 172.21.15.164:59486) 2024-09-13T23:08:29.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.030+0000 7fc8abfff640 1 -- 172.21.15.164:0/1721770478 learned_addr learned my addr 172.21.15.164:0/1721770478 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:08:29.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.030+0000 7fc8abfff640 1 -- 172.21.15.164:0/1721770478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6e392f5e0 con 0x55c6e392ec80 2024-09-13T23:08:29.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.030+0000 7fc8abfff640 1 --2- 172.21.15.164:0/1721770478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e392ec80 0x55c6e392f0a0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fc89c001ed0 tx=0x7fc89c00d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:29.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.031+0000 7fc79ce01640 1 -- 172.21.15.164:0/1721770478 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c01b550 con 0x55c6e392ec80 2024-09-13T23:08:29.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.031+0000 7fc79ce01640 1 -- 172.21.15.164:0/1721770478 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc89c01b6f0 con 0x55c6e392ec80 2024-09-13T23:08:29.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.031+0000 7fc79ce01640 1 -- 172.21.15.164:0/1721770478 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c01b9d0 con 0x55c6e392ec80 2024-09-13T23:08:29.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.031+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1721770478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c6e392f870 con 0x55c6e392ec80 2024-09-13T23:08:29.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.031+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1721770478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6e3932550 con 0x55c6e392ec80 2024-09-13T23:08:29.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.032+0000 7fc79ce01640 1 -- 172.21.15.164:0/1721770478 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc89c023020 con 0x55c6e392ec80 2024-09-13T23:08:29.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.032+0000 7fc79ce01640 1 --2- 172.21.15.164:0/1721770478 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc78c036b90 0x7fc78c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:29.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.032+0000 7fc79ce01640 1 -- 172.21.15.164:0/1721770478 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc89c021020 con 0x55c6e392ec80 2024-09-13T23:08:29.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.032+0000 7fc8b37b0640 1 --2- 172.21.15.164:0/1721770478 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc78c036b90 0x7fc78c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:29.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.032+0000 7fc8b54bb800 1 Processor -- start 2024-09-13T23:08:29.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.032+0000 7fc8b37b0640 1 --2- 172.21.15.164:0/1721770478 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc78c036b90 0x7fc78c039050 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x55c6e391f3c0 tx=0x7fc8ac005840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:29.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.032+0000 7fc8b54bb800 1 -- start start 2024-09-13T23:08:29.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.033+0000 7fc8b54bb800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e393b990 0x55c6e393bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:29.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.033+0000 7fc8b54bb800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c6e390ffd0 con 0x55c6e393b990 2024-09-13T23:08:29.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.033+0000 7fc8abfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e393b990 0x55c6e393bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:29.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.033+0000 7fc8abfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e393b990 0x55c6e393bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:59500/0 (socket says 172.21.15.164:59500) 2024-09-13T23:08:29.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.033+0000 7fc8abfff640 1 -- 172.21.15.164:0/947054338 learned_addr learned my addr 172.21.15.164:0/947054338 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:08:29.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.033+0000 7fc8abfff640 1 -- 172.21.15.164:0/947054338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6e393c360 con 0x55c6e393b990 2024-09-13T23:08:29.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.033+0000 7fc8abfff640 1 --2- 172.21.15.164:0/947054338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e393b990 0x55c6e393bd90 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fc89c04d040 tx=0x7fc89c04d210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef0394d7ec70021 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:29.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.033+0000 7fc7967fc640 1 -- 172.21.15.164:0/947054338 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c024cc0 con 0x55c6e393b990 2024-09-13T23:08:29.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.034+0000 7fc7967fc640 1 -- 172.21.15.164:0/947054338 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc89c0258e0 con 0x55c6e393b990 2024-09-13T23:08:29.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.034+0000 7fc7967fc640 1 -- 172.21.15.164:0/947054338 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c025410 con 0x55c6e393b990 2024-09-13T23:08:29.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.034+0000 7fc8b54bb800 1 -- 172.21.15.164:0/947054338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e393b990 msgr2=0x55c6e393bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:29.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.034+0000 7fc8b54bb800 1 --2- 172.21.15.164:0/947054338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e393b990 0x55c6e393bd90 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fc89c04d040 tx=0x7fc89c04d210 comp rx=0 tx=0).stop 2024-09-13T23:08:29.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.034+0000 7fc8b54bb800 1 -- 172.21.15.164:0/947054338 shutdown_connections 2024-09-13T23:08:29.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.034+0000 7fc8b54bb800 1 --2- 172.21.15.164:0/947054338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e393b990 0x55c6e393bd90 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:29.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.034+0000 7fc8b54bb800 1 -- 172.21.15.164:0/947054338 >> 172.21.15.164:0/947054338 conn(0x55c6e3937cf0 msgr2=0x55c6e3935df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:29.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.034+0000 7fc8b54bb800 1 -- 172.21.15.164:0/947054338 shutdown_connections 2024-09-13T23:08:29.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.034+0000 7fc8b54bb800 1 -- 172.21.15.164:0/947054338 wait complete. 2024-09-13T23:08:29.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.034+0000 7fc8b54bb800 1 Processor -- start 2024-09-13T23:08:29.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.034+0000 7fc8b54bb800 1 -- start start 2024-09-13T23:08:29.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.034+0000 7fc8b54bb800 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e393b990 0x55c6e3942ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:29.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.034+0000 7fc8b54bb800 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c6e393c9d0 con 0x55c6e393b990 2024-09-13T23:08:29.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.035+0000 7fc8abfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e393b990 0x55c6e3942ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:29.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.035+0000 7fc8abfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e393b990 0x55c6e3942ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.164:59506/0 (socket says 172.21.15.164:59506) 2024-09-13T23:08:29.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.035+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 learned_addr learned my addr 172.21.15.164:0/1336205977 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-13T23:08:29.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.035+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6e39433e0 con 0x55c6e393b990 2024-09-13T23:08:29.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.035+0000 7fc8abfff640 1 --2- 172.21.15.164:0/1336205977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e393b990 0x55c6e3942ea0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc89c04d250 tx=0x7fc89c04cfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:29.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.035+0000 7fc794ff9640 1 -- 172.21.15.164:0/1336205977 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c024cc0 con 0x55c6e393b990 2024-09-13T23:08:29.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.035+0000 7fc794ff9640 1 -- 172.21.15.164:0/1336205977 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc89c00cc60 con 0x55c6e393b990 2024-09-13T23:08:29.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.035+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c6e3943670 con 0x55c6e393b990 2024-09-13T23:08:29.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.035+0000 7fc794ff9640 1 -- 172.21.15.164:0/1336205977 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89c00ce10 con 0x55c6e393b990 2024-09-13T23:08:29.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.035+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6e3943670 con 0x55c6e393b990 2024-09-13T23:08:29.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.036+0000 7fc794ff9640 1 -- 172.21.15.164:0/1336205977 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc89c040340 con 0x55c6e393b990 2024-09-13T23:08:29.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.036+0000 7fc794ff9640 1 --2- 172.21.15.164:0/1336205977 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc77c036b40 0x7fc77c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:29.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.036+0000 7fc794ff9640 1 -- 172.21.15.164:0/1336205977 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc89c035070 con 0x55c6e393b990 2024-09-13T23:08:29.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.037+0000 7fc8b37b0640 1 --2- 172.21.15.164:0/1336205977 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc77c036b40 0x7fc77c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:29.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.037+0000 7fc8b37b0640 1 --2- 172.21.15.164:0/1336205977 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc77c036b40 0x7fc77c039000 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x55c6e391b770 tx=0x7fc8ac01f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:29.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.037+0000 7fc8b54bb800 20 rados->read ofs=0 len=0 2024-09-13T23:08:29.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.037+0000 7fc8b54bb800 1 --2- 172.21.15.164:0/1336205977 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c6e394e7c0 0x55c6e3950c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:29.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.037+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39513d0 con 0x55c6e394e7c0 2024-09-13T23:08:29.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.037+0000 7fc8b2faf640 1 --2- 172.21.15.164:0/1336205977 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c6e394e7c0 0x55c6e3950c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:29.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.037+0000 7fc8b2faf640 1 --2- 172.21.15.164:0/1336205977 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c6e394e7c0 0x55c6e3950c80 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:29.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.038+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.038+0000 7fc8b54bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:08:29.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.038+0000 7fc8b54bb800 20 realm 2024-09-13T23:08:29.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.038+0000 7fc8b54bb800 20 rados->read ofs=0 len=0 2024-09-13T23:08:29.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.038+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39517e0 con 0x55c6e394e7c0 2024-09-13T23:08:29.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.038+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.038+0000 7fc8b54bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:08:29.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.038+0000 7fc8b54bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:08:29.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.038+0000 7fc8b54bb800 20 rados->read ofs=0 len=0 2024-09-13T23:08:29.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.038+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39520b0 con 0x55c6e394e7c0 2024-09-13T23:08:29.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.038+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.038+0000 7fc8b54bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:08:29.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.038+0000 7fc8b54bb800 20 rados->read ofs=0 len=0 2024-09-13T23:08:29.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.038+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3952450 con 0x55c6e394e7c0 2024-09-13T23:08:29.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.038+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.038+0000 7fc8b54bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:08:29.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.038+0000 7fc8b54bb800 20 rados->read ofs=0 len=0 2024-09-13T23:08:29.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.038+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:5 5.1d 5:ba5e1f37:::zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3952ca0 con 0x55c6e394e7c0 2024-09-13T23:08:29.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.039+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 5 ==== osd_op_reply(5 zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.039+0000 7fc8b54bb800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:08:29.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.039+0000 7fc8b54bb800 20 searching for the correct realm 2024-09-13T23:08:29.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.039+0000 7fc8b54bb800 1 --2- 172.21.15.164:0/1336205977 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55c6e3954a10 0x55c6e3956e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:29.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.039+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x55c6e3954a10 2024-09-13T23:08:29.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.039+0000 7fc8abfff640 1 --2- 172.21.15.164:0/1336205977 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55c6e3954a10 0x55c6e3956e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:29.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.039+0000 7fc8abfff640 1 --2- 172.21.15.164:0/1336205977 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55c6e3954a10 0x55c6e3956e00 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:29.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.039+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.039+0000 7fc8abfff640 1 --2- 172.21.15.164:0/1336205977 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc89c00c7e0 0x7fc89c02f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:29.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.039+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x7fc89c00c7e0 2024-09-13T23:08:29.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.039+0000 7fc8b37b0640 1 --2- 172.21.15.164:0/1336205977 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc89c00c7e0 0x7fc89c02f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:29.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.040+0000 7fc8b37b0640 1 --2- 172.21.15.164:0/1336205977 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc89c00c7e0 0x7fc89c02f430 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:29.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.040+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8ac01f070 con 0x7fc89c00c7e0 2024-09-13T23:08:29.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.040+0000 7fc8b37b0640 1 --2- 172.21.15.164:0/1336205977 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc8ac031040 0x7fc8ac032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:29.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.040+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x7fc8ac031040 2024-09-13T23:08:29.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.040+0000 7fc8b2faf640 1 --2- 172.21.15.164:0/1336205977 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc8ac031040 0x7fc8ac032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:29.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.041+0000 7fc8b2faf640 1 --2- 172.21.15.164:0/1336205977 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc8ac031040 0x7fc8ac032430 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:29.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.041+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.041+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x55c6e394e7c0 2024-09-13T23:08:29.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.042+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.042+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x55c6e394e7c0 2024-09-13T23:08:29.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.042+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.042+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x7fc8ac031040 2024-09-13T23:08:29.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.042+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.042+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x7fc8ac031040 2024-09-13T23:08:29.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.042+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.042+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x7fc89c00c7e0 2024-09-13T23:08:29.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.043+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8ac01f070 con 0x7fc89c00c7e0 2024-09-13T23:08:29.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.043+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x55c6e3954a10 2024-09-13T23:08:29.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.043+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.043+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x55c6e394e7c0 2024-09-13T23:08:29.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.043+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.043+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x7fc8ac031040 2024-09-13T23:08:29.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.044+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.044+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x55c6e394e7c0 2024-09-13T23:08:29.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.044+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.044+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x7fc89c00c7e0 2024-09-13T23:08:29.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.044+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc8ac01f070 con 0x7fc89c00c7e0 2024-09-13T23:08:29.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.044+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x55c6e3954a10 2024-09-13T23:08:29.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.044+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.044+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x55c6e3954a10 2024-09-13T23:08:29.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.045+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.045+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x7fc8ac031040 2024-09-13T23:08:29.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.045+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.045+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x55c6e3954a10 2024-09-13T23:08:29.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.045+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.045+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x55c6e3954a10 2024-09-13T23:08:29.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.045+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.045+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x55c6e394e7c0 2024-09-13T23:08:29.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.046+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.046+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x55c6e394e7c0 2024-09-13T23:08:29.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.046+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.046+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x7fc8ac031040 2024-09-13T23:08:29.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.046+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.046+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x55c6e3954a10 2024-09-13T23:08:29.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.046+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.046+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x7fc89c00c7e0 2024-09-13T23:08:29.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.047+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8ac01f070 con 0x7fc89c00c7e0 2024-09-13T23:08:29.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.047+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x55c6e394e7c0 2024-09-13T23:08:29.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.047+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.047+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x7fc8ac031040 2024-09-13T23:08:29.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.047+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=82b] v34'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.047+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x55c6e3954a10 2024-09-13T23:08:29.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.047+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.047+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x7fc8ac031040 2024-09-13T23:08:29.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.048+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.048+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x7fc89c00c7e0 2024-09-13T23:08:29.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.048+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8ac01f070 con 0x7fc89c00c7e0 2024-09-13T23:08:29.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.048+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x55c6e3954a10 2024-09-13T23:08:29.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.048+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.048+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x7fc89c00c7e0 2024-09-13T23:08:29.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.049+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 6 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8ac01f070 con 0x7fc89c00c7e0 2024-09-13T23:08:29.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.049+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x55c6e394e7c0 2024-09-13T23:08:29.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.049+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.049+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957410 con 0x7fc89c00c7e0 2024-09-13T23:08:29.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.049+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.049+0000 7fc8b54bb800 20 RGWRados::pool_iterate: got zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 2024-09-13T23:08:29.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.049+0000 7fc8b54bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:08:29.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.049+0000 7fc8b54bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:08:29.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.049+0000 7fc8b54bb800 20 RGWRados::pool_iterate: got zone_info.a32fa7f4-f49a-4762-82e4-81303c4fe8ba 2024-09-13T23:08:29.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.049+0000 7fc8b54bb800 20 RGWRados::pool_iterate: got period_config.default 2024-09-13T23:08:29.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.049+0000 7fc8b54bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:08:29.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.049+0000 7fc8b54bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:08:29.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.049+0000 7fc8b54bb800 20 rados->read ofs=0 len=0 2024-09-13T23:08:29.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.049+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3953650 con 0x55c6e394e7c0 2024-09-13T23:08:29.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.049+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.049+0000 7fc8b54bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:08:29.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.049+0000 7fc8b54bb800 20 rados->read ofs=0 len=0 2024-09-13T23:08:29.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.049+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3953ef0 con 0x55c6e394e7c0 2024-09-13T23:08:29.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.050+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.050+0000 7fc8b54bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:08:29.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.050+0000 7fc8b54bb800 20 rados->read ofs=0 len=0 2024-09-13T23:08:29.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.050+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:40 5.18 5:1e9eda9c:::zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957890 con 0x55c6e394e7c0 2024-09-13T23:08:29.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.050+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 16 ==== osd_op_reply(40 zonegroup_info.4d3c0b48-20ce-488a-b409-36cc6d9502d0 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.050+0000 7fc8b54bb800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:08:29.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.050+0000 7fc8b54bb800 20 zone default found 2024-09-13T23:08:29.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.050+0000 7fc8b54bb800 4 Realm: () 2024-09-13T23:08:29.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.050+0000 7fc8b54bb800 4 ZoneGroup: default (4d3c0b48-20ce-488a-b409-36cc6d9502d0) 2024-09-13T23:08:29.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.050+0000 7fc8b54bb800 4 Zone: default (a32fa7f4-f49a-4762-82e4-81303c4fe8ba) 2024-09-13T23:08:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.050+0000 7fc8b54bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:08:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.050+0000 7fc8b54bb800 20 zonegroup default 2024-09-13T23:08:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.050+0000 7fc8b54bb800 20 rados->read ofs=0 len=0 2024-09-13T23:08:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.050+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3957d40 con 0x7fc8ac031040 2024-09-13T23:08:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.050+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 9 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.050+0000 7fc8b54bb800 20 rados_obj.operate() r=0 bl.length=187 2024-09-13T23:08:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.050+0000 7fc8b54bb800 20 rados->read ofs=0 len=0 2024-09-13T23:08:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.050+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39597e0 con 0x55c6e3954a10 2024-09-13T23:08:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.051+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.051+0000 7fc8b54bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:08:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.051+0000 7fc8b54bb800 20 rados->read ofs=0 len=0 2024-09-13T23:08:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.051+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3959cd0 con 0x55c6e3954a10 2024-09-13T23:08:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.051+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.051+0000 7fc8b54bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:08:29.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.051+0000 7fc8b54bb800 20 started sync module instance, tier type = 2024-09-13T23:08:29.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.051+0000 7fc8b54bb800 20 started zone id=a32fa7f4-f49a-4762-82e4-81303c4fe8ba (name=default) with tier type = 2024-09-13T23:08:29.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.051+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3958bb0 con 0x7fc89c00c7e0 2024-09-13T23:08:29.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.052+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 8 ==== osd_op_reply(44 notify.0 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.052+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94312710115232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39593c0 con 0x7fc89c00c7e0 2024-09-13T23:08:29.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.052+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e395aad0 con 0x55c6e394e7c0 2024-09-13T23:08:29.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.053+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94312710115232] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.054+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 17 ==== osd_op_reply(46 notify.1 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.054+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94312710119728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e395aa00 con 0x55c6e394e7c0 2024-09-13T23:08:29.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.054+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e395b4e0 con 0x55c6e3954a10 2024-09-13T23:08:29.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.055+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94312710119728] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.055+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 12 ==== osd_op_reply(48 notify.2 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.055+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94312710120784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e395a970 con 0x55c6e3954a10 2024-09-13T23:08:29.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.055+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e395c3a0 con 0x7fc89c00c7e0 2024-09-13T23:08:29.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.056+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 10 ==== osd_op_reply(50 notify.3 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.056+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94312710127824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e395cb80 con 0x7fc89c00c7e0 2024-09-13T23:08:29.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.056+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e395d680 con 0x55c6e394e7c0 2024-09-13T23:08:29.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.056+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94312710120784] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.057+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94312710127824] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.058+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 19 ==== osd_op_reply(52 notify.4 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.058+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94312710132080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e395d640 con 0x55c6e394e7c0 2024-09-13T23:08:29.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.058+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e395df50 con 0x7fc8ac031040 2024-09-13T23:08:29.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.059+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 10 ==== osd_op_reply(54 notify.5 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.059+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94312710134352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e395e320 con 0x7fc8ac031040 2024-09-13T23:08:29.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.059+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e395eb70 con 0x7fc8ac031040 2024-09-13T23:08:29.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.059+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94312710132080] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.060+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94312710134352] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.060+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 12 ==== osd_op_reply(56 notify.6 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.060+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94312710135408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e395e740 con 0x7fc8ac031040 2024-09-13T23:08:29.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.060+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e395ef90 con 0x7fc8ac031040 2024-09-13T23:08:29.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.061+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 13 ==== osd_op_reply(58 notify.7 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.061+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94312710137936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e395f320 con 0x7fc8ac031040 2024-09-13T23:08:29.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.061+0000 7fc8b54bb800 20 add_watcher() i=0 2024-09-13T23:08:29.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.061+0000 7fc8b54bb800 20 add_watcher() i=1 2024-09-13T23:08:29.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.061+0000 7fc8b54bb800 20 add_watcher() i=2 2024-09-13T23:08:29.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.061+0000 7fc8b54bb800 20 add_watcher() i=3 2024-09-13T23:08:29.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.061+0000 7fc8b54bb800 20 add_watcher() i=4 2024-09-13T23:08:29.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.061+0000 7fc8b54bb800 20 add_watcher() i=5 2024-09-13T23:08:29.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.061+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94312710135408] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.061+0000 7fc8b54bb800 20 add_watcher() i=6 2024-09-13T23:08:29.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.062+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94312710137936] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.062+0000 7fc8b54bb800 20 add_watcher() i=7 2024-09-13T23:08:29.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.062+0000 7fc8b54bb800 2 all 8 watchers are set, enabling cache 2024-09-13T23:08:29.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.062+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e395e2e0 con 0x55c6e394e7c0 2024-09-13T23:08:29.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.062+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.062+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94312710136496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e395f830 con 0x55c6e394e7c0 2024-09-13T23:08:29.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.064+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94312710136496] v34'275 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.064+0000 7fc7697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:08:29.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.064+0000 7fc8b54bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:08:29.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.064+0000 7fc8b54bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:08:29.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.064+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396acc0 con 0x55c6e394e7c0 2024-09-13T23:08:29.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.066+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.066+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396b310 con 0x7fc8ac031040 2024-09-13T23:08:29.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.067+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.067+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396b310 con 0x55c6e3954a10 2024-09-13T23:08:29.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.068+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.068+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396b7c0 con 0x55c6e394e7c0 2024-09-13T23:08:29.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.069+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'276 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.069+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396b850 con 0x7fc89c00c7e0 2024-09-13T23:08:29.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.070+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'83 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.070+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396bdc0 con 0x55c6e3954a10 2024-09-13T23:08:29.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.071+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'55 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.071+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396be50 con 0x55c6e394e7c0 2024-09-13T23:08:29.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.072+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.072+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396be50 con 0x7fc8ac031040 2024-09-13T23:08:29.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.074+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'57 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.074+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396be50 con 0x7fc89c00c7e0 2024-09-13T23:08:29.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.075+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.075+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396c420 con 0x55c6e3954a10 2024-09-13T23:08:29.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.076+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.076+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396c420 con 0x7fc89c00c7e0 2024-09-13T23:08:29.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.077+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'84 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.077+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396c990 con 0x7fc8ac031040 2024-09-13T23:08:29.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.078+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'41 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.078+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396c990 con 0x7fc89c00c7e0 2024-09-13T23:08:29.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.079+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.079+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396ce40 con 0x7fc8ac031040 2024-09-13T23:08:29.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.081+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'62 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.081+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396ce40 con 0x55c6e394e7c0 2024-09-13T23:08:29.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.082+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'277 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.082+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396ce40 con 0x55c6e3954a10 2024-09-13T23:08:29.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.083+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'77 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.083+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396ce40 con 0x7fc89c00c7e0 2024-09-13T23:08:29.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.084+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'85 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.084+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396ce40 con 0x55c6e3954a10 2024-09-13T23:08:29.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.085+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.085+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396ce40 con 0x55c6e394e7c0 2024-09-13T23:08:29.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.086+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.086+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396ce40 con 0x55c6e394e7c0 2024-09-13T23:08:29.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.087+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'278 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.087+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396ce40 con 0x55c6e3954a10 2024-09-13T23:08:29.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.088+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'78 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.088+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396ce40 con 0x7fc89c00c7e0 2024-09-13T23:08:29.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.089+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'41 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.089+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396ce40 con 0x55c6e3954a10 2024-09-13T23:08:29.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.091+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'35 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.091+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396ce40 con 0x55c6e3954a10 2024-09-13T23:08:29.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.092+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.092+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396ce40 con 0x55c6e3954a10 2024-09-13T23:08:29.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.093+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.093+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396ce40 con 0x55c6e3954a10 2024-09-13T23:08:29.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.093+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'56 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.093+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396ce40 con 0x7fc8ac031040 2024-09-13T23:08:29.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.095+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.095+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396ce40 con 0x55c6e3954a10 2024-09-13T23:08:29.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.096+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'33 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.096+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396ce40 con 0x7fc8ac031040 2024-09-13T23:08:29.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.097+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'58 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.097+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396ce40 con 0x55c6e3954a10 2024-09-13T23:08:29.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.098+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'79 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.098+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396ce40 con 0x7fc8ac031040 2024-09-13T23:08:29.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.099+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'63 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.099+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e396ce40 con 0x7fc89c00c7e0 2024-09-13T23:08:29.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.101+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.101+0000 7fc6e3fff640 20 reqs_thread_entry: start 2024-09-13T23:08:29.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.101+0000 7fc8b54bb800 20 init_complete bucket index max shards: 11 2024-09-13T23:08:29.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.101+0000 7fc8b54bb800 20 Filter name: none 2024-09-13T23:08:29.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.101+0000 7fc6e1ffb640 20 reqs_thread_entry: start 2024-09-13T23:08:29.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.101+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-13T23:08:29.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.101+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:94 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.103+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 23 ==== osd_op_reply(94 gc.26 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.103+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:95 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.103+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 24 ==== osd_op_reply(95 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.103+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.103+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:96 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3997e00 con 0x7fc8ac031040 2024-09-13T23:08:29.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.104+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 25 ==== osd_op_reply(96 gc.26 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.104+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:97 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.104+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 26 ==== osd_op_reply(97 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.104+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.104+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:98 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.104+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 27 ==== osd_op_reply(98 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.104+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.104+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:99 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.106+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 28 ==== osd_op_reply(99 gc.26 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.106+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-13T23:08:29.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.106+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:100 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.106+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 26 ==== osd_op_reply(100 gc.27 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.106+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:101 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.107+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 27 ==== osd_op_reply(101 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.107+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.107+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:102 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3997e00 con 0x55c6e3954a10 2024-09-13T23:08:29.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.107+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 28 ==== osd_op_reply(102 gc.27 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.107+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:103 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.107+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 29 ==== osd_op_reply(103 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.107+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.107+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:104 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.108+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 30 ==== osd_op_reply(104 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.108+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.108+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:105 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.109+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 31 ==== osd_op_reply(105 gc.27 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.109+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-13T23:08:29.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.109+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:106 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.110+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 29 ==== osd_op_reply(106 gc.28 [call] v34'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.110+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:107 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.110+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 30 ==== osd_op_reply(107 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.110+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.110+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:108 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3997e00 con 0x7fc8ac031040 2024-09-13T23:08:29.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.111+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 31 ==== osd_op_reply(108 gc.28 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.111+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:109 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.111+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 32 ==== osd_op_reply(109 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.111+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.111+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:110 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.111+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 33 ==== osd_op_reply(110 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.111+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.111+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:111 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.113+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 34 ==== osd_op_reply(111 gc.28 [call] v34'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.113+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-13T23:08:29.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.113+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:112 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.114+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 32 ==== osd_op_reply(112 gc.29 [call] v34'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.114+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:113 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.114+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 33 ==== osd_op_reply(113 gc.29 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.114+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.114+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:114 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3997e00 con 0x55c6e3954a10 2024-09-13T23:08:29.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.114+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 34 ==== osd_op_reply(114 gc.29 [call out=24b] v0'0 uv80 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.115+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:115 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.115+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 35 ==== osd_op_reply(115 gc.29 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.115+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.115+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:116 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.115+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 36 ==== osd_op_reply(116 gc.29 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.115+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.115+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:117 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.116+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 37 ==== osd_op_reply(117 gc.29 [call] v34'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.116+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-13T23:08:29.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.116+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:118 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.117+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 35 ==== osd_op_reply(118 gc.30 [call] v34'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.117+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:119 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.117+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 36 ==== osd_op_reply(119 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.117+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.117+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:120 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3997e00 con 0x7fc8ac031040 2024-09-13T23:08:29.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.118+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 37 ==== osd_op_reply(120 gc.30 [call out=24b] v0'0 uv64 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.118+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:121 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.118+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 38 ==== osd_op_reply(121 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.118+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.118+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:122 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.118+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 39 ==== osd_op_reply(122 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.118+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.118+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:123 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.119+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 40 ==== osd_op_reply(123 gc.30 [call] v34'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.119+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-13T23:08:29.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.119+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:124 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.120+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 19 ==== osd_op_reply(124 gc.31 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.120+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:125 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.121+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 20 ==== osd_op_reply(125 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.121+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.121+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:126 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3997e00 con 0x7fc89c00c7e0 2024-09-13T23:08:29.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.121+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 21 ==== osd_op_reply(126 gc.31 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.121+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:127 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.121+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 22 ==== osd_op_reply(127 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.121+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.121+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:128 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.121+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 23 ==== osd_op_reply(128 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.121+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.121+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:129 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.122+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 24 ==== osd_op_reply(129 gc.31 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.122+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-13T23:08:29.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.122+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:130 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e394e7c0 2024-09-13T23:08:29.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.124+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 29 ==== osd_op_reply(130 gc.0 [call] v34'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.124+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:131 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e394e7c0 2024-09-13T23:08:29.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.124+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 30 ==== osd_op_reply(131 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.124+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.124+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:132 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3997e00 con 0x55c6e394e7c0 2024-09-13T23:08:29.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.124+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 31 ==== osd_op_reply(132 gc.0 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.124+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:133 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e394e7c0 2024-09-13T23:08:29.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.124+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 32 ==== osd_op_reply(133 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.124+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.124+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:134 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e394e7c0 2024-09-13T23:08:29.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.125+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 33 ==== osd_op_reply(134 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.125+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.125+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:135 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e394e7c0 2024-09-13T23:08:29.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.126+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 34 ==== osd_op_reply(135 gc.0 [call] v34'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.126+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-13T23:08:29.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.126+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:136 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.127+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 41 ==== osd_op_reply(136 gc.1 [call] v34'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.127+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:137 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.127+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 42 ==== osd_op_reply(137 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.127+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.127+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:138 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3997e00 con 0x7fc8ac031040 2024-09-13T23:08:29.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.127+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 43 ==== osd_op_reply(138 gc.1 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.127+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:139 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.128+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 44 ==== osd_op_reply(139 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.128+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.128+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:140 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.128+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 45 ==== osd_op_reply(140 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.128+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.128+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:141 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.129+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 46 ==== osd_op_reply(141 gc.1 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.129+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-13T23:08:29.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.129+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:142 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.130+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 38 ==== osd_op_reply(142 gc.2 [call] v34'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.130+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:143 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.130+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 39 ==== osd_op_reply(143 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.130+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.130+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:144 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3997e00 con 0x55c6e3954a10 2024-09-13T23:08:29.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.130+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 40 ==== osd_op_reply(144 gc.2 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.130+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:145 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.131+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 41 ==== osd_op_reply(145 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.131+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.131+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:146 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.131+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 42 ==== osd_op_reply(146 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.131+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.131+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:147 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.132+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 43 ==== osd_op_reply(147 gc.2 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.132+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-13T23:08:29.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.132+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:148 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e394e7c0 2024-09-13T23:08:29.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.133+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 35 ==== osd_op_reply(148 gc.3 [call] v34'279 uv279 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.133+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:149 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e394e7c0 2024-09-13T23:08:29.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.133+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 36 ==== osd_op_reply(149 gc.3 [call out=15b] v0'0 uv279 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.133+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.133+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:150 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3997e00 con 0x55c6e394e7c0 2024-09-13T23:08:29.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.133+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 37 ==== osd_op_reply(150 gc.3 [call out=24b] v0'0 uv279 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.133+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:151 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e394e7c0 2024-09-13T23:08:29.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.134+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 38 ==== osd_op_reply(151 gc.3 [call out=15b] v0'0 uv279 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.134+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.134+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:152 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e394e7c0 2024-09-13T23:08:29.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.134+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 39 ==== osd_op_reply(152 gc.3 [call out=15b] v0'0 uv279 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.134+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.134+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:153 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e394e7c0 2024-09-13T23:08:29.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.135+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 40 ==== osd_op_reply(153 gc.3 [call] v34'280 uv280 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.135+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-13T23:08:29.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.135+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:154 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.136+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 25 ==== osd_op_reply(154 gc.4 [call] v34'86 uv86 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.136+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:155 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.136+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 26 ==== osd_op_reply(155 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.136+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.136+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:156 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3997e00 con 0x7fc89c00c7e0 2024-09-13T23:08:29.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.136+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 27 ==== osd_op_reply(156 gc.4 [call out=24b] v0'0 uv86 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.136+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:157 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.136+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 28 ==== osd_op_reply(157 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.136+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.136+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:158 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.137+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 29 ==== osd_op_reply(158 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.137+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.137+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:159 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.138+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 30 ==== osd_op_reply(159 gc.4 [call] v34'87 uv87 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.138+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-13T23:08:29.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.138+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:160 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.139+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 44 ==== osd_op_reply(160 gc.5 [call] v34'57 uv57 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.139+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:161 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.139+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 45 ==== osd_op_reply(161 gc.5 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.139+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.139+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:162 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3997e00 con 0x55c6e3954a10 2024-09-13T23:08:29.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.139+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 46 ==== osd_op_reply(162 gc.5 [call out=24b] v0'0 uv57 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.139+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:163 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.139+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 47 ==== osd_op_reply(163 gc.5 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.139+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.139+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:164 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.140+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 48 ==== osd_op_reply(164 gc.5 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.140+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.140+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:165 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.140+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 49 ==== osd_op_reply(165 gc.5 [call] v34'58 uv58 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.140+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-13T23:08:29.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.140+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:166 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e394e7c0 2024-09-13T23:08:29.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.142+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 41 ==== osd_op_reply(166 gc.6 [call] v34'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.142+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:167 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e394e7c0 2024-09-13T23:08:29.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.142+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 42 ==== osd_op_reply(167 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.142+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.142+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:168 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3997e00 con 0x55c6e394e7c0 2024-09-13T23:08:29.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.142+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 43 ==== osd_op_reply(168 gc.6 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.143+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:169 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e394e7c0 2024-09-13T23:08:29.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.143+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 44 ==== osd_op_reply(169 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.143+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.143+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:170 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e394e7c0 2024-09-13T23:08:29.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.143+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 45 ==== osd_op_reply(170 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.143+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.143+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:171 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e394e7c0 2024-09-13T23:08:29.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.144+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 46 ==== osd_op_reply(171 gc.6 [call] v34'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.144+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-13T23:08:29.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.144+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:172 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.146+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 47 ==== osd_op_reply(172 gc.7 [call] v34'61 uv61 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.146+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:173 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.146+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 48 ==== osd_op_reply(173 gc.7 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.146+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.146+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:174 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3997e00 con 0x7fc8ac031040 2024-09-13T23:08:29.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.146+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 49 ==== osd_op_reply(174 gc.7 [call out=24b] v0'0 uv61 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.146+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:175 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.147+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 50 ==== osd_op_reply(175 gc.7 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.147+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.147+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:176 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.147+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 51 ==== osd_op_reply(176 gc.7 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.147+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.147+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:177 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.148+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 52 ==== osd_op_reply(177 gc.7 [call] v34'62 uv62 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.148+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-13T23:08:29.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.148+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:178 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.149+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 31 ==== osd_op_reply(178 gc.8 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.149+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:179 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.149+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 32 ==== osd_op_reply(179 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.149+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.149+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:180 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3997e00 con 0x7fc89c00c7e0 2024-09-13T23:08:29.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.150+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 33 ==== osd_op_reply(180 gc.8 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.150+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:181 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.150+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 34 ==== osd_op_reply(181 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.150+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.150+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:182 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.150+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 35 ==== osd_op_reply(182 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.150+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.150+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:183 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.151+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 36 ==== osd_op_reply(183 gc.8 [call] v34'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.151+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-13T23:08:29.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.151+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:184 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.152+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 50 ==== osd_op_reply(184 gc.9 [call] v34'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.152+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:185 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.152+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 51 ==== osd_op_reply(185 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.152+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.152+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:186 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3997e00 con 0x55c6e3954a10 2024-09-13T23:08:29.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.152+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 52 ==== osd_op_reply(186 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.152+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:187 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.153+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 53 ==== osd_op_reply(187 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.153+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.153+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:188 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.153+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 54 ==== osd_op_reply(188 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.153+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.153+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:189 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.154+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 55 ==== osd_op_reply(189 gc.9 [call] v34'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.154+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-13T23:08:29.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.154+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:190 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.155+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 37 ==== osd_op_reply(190 gc.10 [call] v34'88 uv88 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.155+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:191 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.155+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 38 ==== osd_op_reply(191 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.155+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.155+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:192 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3997e00 con 0x7fc89c00c7e0 2024-09-13T23:08:29.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.155+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 39 ==== osd_op_reply(192 gc.10 [call out=24b] v0'0 uv88 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.155+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:193 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.155+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 40 ==== osd_op_reply(193 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.155+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.155+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:194 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.156+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 41 ==== osd_op_reply(194 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.156+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.156+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:195 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.156+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 42 ==== osd_op_reply(195 gc.10 [call] v34'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.156+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-13T23:08:29.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.156+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:196 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.158+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 53 ==== osd_op_reply(196 gc.11 [call] v34'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.158+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:197 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.158+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 54 ==== osd_op_reply(197 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.158+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.158+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:198 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3997e00 con 0x7fc8ac031040 2024-09-13T23:08:29.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.158+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 55 ==== osd_op_reply(198 gc.11 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.158+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:199 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.159+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 56 ==== osd_op_reply(199 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.159+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.159+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:200 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.159+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 57 ==== osd_op_reply(200 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.159+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.159+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:201 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.160+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 58 ==== osd_op_reply(201 gc.11 [call] v34'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.160+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-13T23:08:29.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.160+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:202 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.161+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 43 ==== osd_op_reply(202 gc.12 [call] v34'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.161+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:203 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.161+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 44 ==== osd_op_reply(203 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.161+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.161+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:204 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3997e00 con 0x7fc89c00c7e0 2024-09-13T23:08:29.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.161+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 45 ==== osd_op_reply(204 gc.12 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.161+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:205 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.161+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 46 ==== osd_op_reply(205 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.161+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.161+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:206 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.162+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 47 ==== osd_op_reply(206 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.162+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.162+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:207 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.163+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 48 ==== osd_op_reply(207 gc.12 [call] v34'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.163+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-13T23:08:29.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.163+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:208 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.164+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 59 ==== osd_op_reply(208 gc.13 [call] v34'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.164+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:209 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.164+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 60 ==== osd_op_reply(209 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.164+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.164+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:210 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3997e00 con 0x7fc8ac031040 2024-09-13T23:08:29.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.164+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 61 ==== osd_op_reply(210 gc.13 [call out=24b] v0'0 uv66 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.164+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:211 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.165+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 62 ==== osd_op_reply(211 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.165+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.165+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:212 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.165+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 63 ==== osd_op_reply(212 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.165+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.165+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:213 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc8ac031040 2024-09-13T23:08:29.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.166+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 64 ==== osd_op_reply(213 gc.13 [call] v34'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.166+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-13T23:08:29.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.166+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:214 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e394e7c0 2024-09-13T23:08:29.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.167+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 47 ==== osd_op_reply(214 gc.14 [call] v34'281 uv281 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.167+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:215 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e394e7c0 2024-09-13T23:08:29.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.167+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 48 ==== osd_op_reply(215 gc.14 [call out=15b] v0'0 uv281 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.167+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.167+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:216 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3997e00 con 0x55c6e394e7c0 2024-09-13T23:08:29.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.167+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 49 ==== osd_op_reply(216 gc.14 [call out=24b] v0'0 uv281 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.168+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:217 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e394e7c0 2024-09-13T23:08:29.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.168+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 50 ==== osd_op_reply(217 gc.14 [call out=15b] v0'0 uv281 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.168+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.168+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:218 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e394e7c0 2024-09-13T23:08:29.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.168+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 51 ==== osd_op_reply(218 gc.14 [call out=15b] v0'0 uv281 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.168+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.168+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:219 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e394e7c0 2024-09-13T23:08:29.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.169+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 52 ==== osd_op_reply(219 gc.14 [call] v34'282 uv282 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.169+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-13T23:08:29.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.169+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:220 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.170+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 56 ==== osd_op_reply(220 gc.15 [call] v34'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.171+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:221 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.171+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 57 ==== osd_op_reply(221 gc.15 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.171+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.171+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:222 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3997e00 con 0x55c6e3954a10 2024-09-13T23:08:29.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.171+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 58 ==== osd_op_reply(222 gc.15 [call out=24b] v0'0 uv82 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.171+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:223 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.171+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 59 ==== osd_op_reply(223 gc.15 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.171+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.171+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:224 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.171+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 60 ==== osd_op_reply(224 gc.15 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.171+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.171+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:225 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.172+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 61 ==== osd_op_reply(225 gc.15 [call] v34'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.172+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-13T23:08:29.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.172+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:226 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.173+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 49 ==== osd_op_reply(226 gc.16 [call] v34'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.173+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:227 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.174+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 50 ==== osd_op_reply(227 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.174+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.174+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:228 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3997e00 con 0x7fc89c00c7e0 2024-09-13T23:08:29.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.174+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 51 ==== osd_op_reply(228 gc.16 [call out=24b] v0'0 uv90 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.174+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:229 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.174+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 52 ==== osd_op_reply(229 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.174+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.174+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:230 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.174+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 53 ==== osd_op_reply(230 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.174+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.174+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:231 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x7fc89c00c7e0 2024-09-13T23:08:29.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.175+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 54 ==== osd_op_reply(231 gc.16 [call] v34'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.175+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-13T23:08:29.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.175+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:232 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.176+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 62 ==== osd_op_reply(232 gc.17 [call] v34'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.176+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:233 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.176+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 63 ==== osd_op_reply(233 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.176+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.176+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:234 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3997e00 con 0x55c6e3954a10 2024-09-13T23:08:29.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.177+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 64 ==== osd_op_reply(234 gc.17 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.177+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:235 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.177+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 65 ==== osd_op_reply(235 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.177+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.177+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:236 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3998e10 con 0x55c6e3954a10 2024-09-13T23:08:29.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.177+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 66 ==== osd_op_reply(236 gc.17 [call out=1715b] v0'0 uv33 ondisk = 0) ==== 149+0+1715 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.177+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-13T23:08:29.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.177+0000 7fc8b54bb800 20 garbage collection: RGWGC::process iterating over entry tag='a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.2716125467253779146', time=2024-09-13T23:08:36.940034+0000, chain.objs.size()=7 2024-09-13T23:08:29.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.177+0000 7fc8b54bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11__shadow_.rxdiwhiluYmhhLNhqDXl07DgHGxLKip_1 2024-09-13T23:08:29.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.178+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:237 3.27s0 3:e56958eb:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11__shadow_.rxdiwhiluYmhhLNhqDXl07DgHGxLKip_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3997560 con 0x7fc8ac031040 2024-09-13T23:08:29.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.178+0000 7fc8b54bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11__shadow_.rxdiwhiluYmhhLNhqDXl07DgHGxLKip_2 2024-09-13T23:08:29.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.178+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:238 3.2s0 3:40bdfbd5:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11__shadow_.rxdiwhiluYmhhLNhqDXl07DgHGxLKip_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e399c350 con 0x55c6e3954a10 2024-09-13T23:08:29.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.178+0000 7fc8b54bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11__shadow_.rxdiwhiluYmhhLNhqDXl07DgHGxLKip_3 2024-09-13T23:08:29.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.178+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:239 3.28s0 3:14f607f1:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11__shadow_.rxdiwhiluYmhhLNhqDXl07DgHGxLKip_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e399c350 con 0x55c6e3954a10 2024-09-13T23:08:29.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.178+0000 7fc8b54bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11__shadow_.rxdiwhiluYmhhLNhqDXl07DgHGxLKip_4 2024-09-13T23:08:29.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.178+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:240 3.ds0 3:b3b9b629:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11__shadow_.rxdiwhiluYmhhLNhqDXl07DgHGxLKip_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a1090 con 0x55c6e3954a10 2024-09-13T23:08:29.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.178+0000 7fc8b54bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11__shadow_.rxdiwhiluYmhhLNhqDXl07DgHGxLKip_5 2024-09-13T23:08:29.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.178+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:241 3.cs0 3:32565b33:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11__shadow_.rxdiwhiluYmhhLNhqDXl07DgHGxLKip_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3960 con 0x55c6e3954a10 2024-09-13T23:08:29.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.178+0000 7fc8b54bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11__shadow_.rxdiwhiluYmhhLNhqDXl07DgHGxLKip_6 2024-09-13T23:08:29.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.178+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:242 3.21s0 3:8588423f:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11__shadow_.rxdiwhiluYmhhLNhqDXl07DgHGxLKip_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a6280 con 0x7fc8ac031040 2024-09-13T23:08:29.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.178+0000 7fc8b54bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11__shadow_.rxdiwhiluYmhhLNhqDXl07DgHGxLKip_7 2024-09-13T23:08:29.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.178+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:243 3.20s0 3:04ee364c:::a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11__shadow_.rxdiwhiluYmhhLNhqDXl07DgHGxLKip_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a8af0 con 0x7fc89c00c7e0 2024-09-13T23:08:29.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.182+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 65 ==== osd_op_reply(242 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11__shadow_.rxdiwhiluYmhhLNhqDXl07DgHGxLKip_6 [call] v34'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.182+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 66 ==== osd_op_reply(237 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11__shadow_.rxdiwhiluYmhhLNhqDXl07DgHGxLKip_1 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.183+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 67 ==== osd_op_reply(238 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11__shadow_.rxdiwhiluYmhhLNhqDXl07DgHGxLKip_2 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.183+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 68 ==== osd_op_reply(239 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11__shadow_.rxdiwhiluYmhhLNhqDXl07DgHGxLKip_3 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.183+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 69 ==== osd_op_reply(240 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11__shadow_.rxdiwhiluYmhhLNhqDXl07DgHGxLKip_4 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.183+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 70 ==== osd_op_reply(241 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11__shadow_.rxdiwhiluYmhhLNhqDXl07DgHGxLKip_5 [call] v34'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.184+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 55 ==== osd_op_reply(243 a32fa7f4-f49a-4762-82e4-81303c4fe8ba.4239.11__shadow_.rxdiwhiluYmhhLNhqDXl07DgHGxLKip_7 [call] v34'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.184+0000 7fc8b54bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-13T23:08:29.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.184+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:244 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3420 con 0x55c6e3954a10 2024-09-13T23:08:29.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.190+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 71 ==== osd_op_reply(244 gc.17 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.190+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:245 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3420 con 0x55c6e3954a10 2024-09-13T23:08:29.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.191+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 72 ==== osd_op_reply(245 gc.17 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.191+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-13T23:08:29.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.191+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:246 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3420 con 0x55c6e394e7c0 2024-09-13T23:08:29.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.193+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 53 ==== osd_op_reply(246 gc.18 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.193+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:247 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3420 con 0x55c6e394e7c0 2024-09-13T23:08:29.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.193+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 54 ==== osd_op_reply(247 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.193+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.193+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:248 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a2410 con 0x55c6e394e7c0 2024-09-13T23:08:29.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.193+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 55 ==== osd_op_reply(248 gc.18 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.193+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:249 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3420 con 0x55c6e394e7c0 2024-09-13T23:08:29.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.193+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 56 ==== osd_op_reply(249 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.193+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.193+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:250 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3420 con 0x55c6e394e7c0 2024-09-13T23:08:29.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.194+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 57 ==== osd_op_reply(250 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.194+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.194+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:251 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3420 con 0x55c6e394e7c0 2024-09-13T23:08:29.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.195+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 58 ==== osd_op_reply(251 gc.18 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.195+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-13T23:08:29.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.195+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:252 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3420 con 0x55c6e394e7c0 2024-09-13T23:08:29.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.196+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 59 ==== osd_op_reply(252 gc.19 [call] v34'283 uv283 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.196+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:253 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3420 con 0x55c6e394e7c0 2024-09-13T23:08:29.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.196+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 60 ==== osd_op_reply(253 gc.19 [call out=15b] v0'0 uv283 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.196+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.196+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:254 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a2410 con 0x55c6e394e7c0 2024-09-13T23:08:29.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.196+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 61 ==== osd_op_reply(254 gc.19 [call out=24b] v0'0 uv283 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.196+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:255 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3996f60 con 0x55c6e394e7c0 2024-09-13T23:08:29.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.196+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 62 ==== osd_op_reply(255 gc.19 [call out=15b] v0'0 uv283 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.196+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.196+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:256 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3996f60 con 0x55c6e394e7c0 2024-09-13T23:08:29.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.196+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 63 ==== osd_op_reply(256 gc.19 [call out=15b] v0'0 uv283 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.196+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.196+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:257 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3996f60 con 0x55c6e394e7c0 2024-09-13T23:08:29.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.197+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 64 ==== osd_op_reply(257 gc.19 [call] v34'284 uv284 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.197+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-13T23:08:29.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.197+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:258 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3996f60 con 0x55c6e3954a10 2024-09-13T23:08:29.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.198+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 73 ==== osd_op_reply(258 gc.20 [call] v34'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.198+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:259 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3996f60 con 0x55c6e3954a10 2024-09-13T23:08:29.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.199+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 74 ==== osd_op_reply(259 gc.20 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.199+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.199+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:260 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3996f60 con 0x55c6e3954a10 2024-09-13T23:08:29.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.199+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 75 ==== osd_op_reply(260 gc.20 [call out=24b] v0'0 uv84 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.199+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:261 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3996f60 con 0x55c6e3954a10 2024-09-13T23:08:29.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.199+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 76 ==== osd_op_reply(261 gc.20 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.199+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.199+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:262 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3996f60 con 0x55c6e3954a10 2024-09-13T23:08:29.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.199+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 77 ==== osd_op_reply(262 gc.20 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.199+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.199+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:263 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3996f60 con 0x55c6e3954a10 2024-09-13T23:08:29.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.200+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 78 ==== osd_op_reply(263 gc.20 [call] v34'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.200+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-13T23:08:29.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.200+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:264 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3996f60 con 0x7fc89c00c7e0 2024-09-13T23:08:29.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.201+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 56 ==== osd_op_reply(264 gc.21 [call] v34'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.201+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:265 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3996f60 con 0x7fc89c00c7e0 2024-09-13T23:08:29.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.202+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 57 ==== osd_op_reply(265 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.202+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.202+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:266 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3996f60 con 0x7fc89c00c7e0 2024-09-13T23:08:29.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.202+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 58 ==== osd_op_reply(266 gc.21 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.202+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:267 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3996f60 con 0x7fc89c00c7e0 2024-09-13T23:08:29.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.202+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 59 ==== osd_op_reply(267 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.202+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.202+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:268 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3996f60 con 0x7fc89c00c7e0 2024-09-13T23:08:29.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.202+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 60 ==== osd_op_reply(268 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.202+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.202+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:269 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3996f60 con 0x7fc89c00c7e0 2024-09-13T23:08:29.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.203+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 61 ==== osd_op_reply(269 gc.21 [call] v34'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.203+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-13T23:08:29.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.203+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:270 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3240 con 0x55c6e3954a10 2024-09-13T23:08:29.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.204+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 79 ==== osd_op_reply(270 gc.22 [call] v34'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.204+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:271 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3240 con 0x55c6e3954a10 2024-09-13T23:08:29.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.204+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 80 ==== osd_op_reply(271 gc.22 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.204+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.204+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:272 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a2230 con 0x55c6e3954a10 2024-09-13T23:08:29.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.205+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 81 ==== osd_op_reply(272 gc.22 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.205+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:273 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3240 con 0x55c6e3954a10 2024-09-13T23:08:29.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.205+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 82 ==== osd_op_reply(273 gc.22 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.205+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.205+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:274 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3240 con 0x55c6e3954a10 2024-09-13T23:08:29.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.205+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 83 ==== osd_op_reply(274 gc.22 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.205+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.205+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:275 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3240 con 0x55c6e3954a10 2024-09-13T23:08:29.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.206+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 84 ==== osd_op_reply(275 gc.22 [call] v34'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.206+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-13T23:08:29.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.206+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:276 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3240 con 0x55c6e3954a10 2024-09-13T23:08:29.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.207+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 85 ==== osd_op_reply(276 gc.23 [call] v34'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.207+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:277 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3240 con 0x55c6e3954a10 2024-09-13T23:08:29.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.207+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 86 ==== osd_op_reply(277 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.207+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.207+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:278 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a2230 con 0x55c6e3954a10 2024-09-13T23:08:29.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.207+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 87 ==== osd_op_reply(278 gc.23 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.207+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:279 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3240 con 0x55c6e3954a10 2024-09-13T23:08:29.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.208+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 88 ==== osd_op_reply(279 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.208+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.208+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:280 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3240 con 0x55c6e3954a10 2024-09-13T23:08:29.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.208+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 89 ==== osd_op_reply(280 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.208+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.208+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:281 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3240 con 0x55c6e3954a10 2024-09-13T23:08:29.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.209+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 90 ==== osd_op_reply(281 gc.23 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.209+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-13T23:08:29.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.209+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:282 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3240 con 0x55c6e3954a10 2024-09-13T23:08:29.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.210+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 91 ==== osd_op_reply(282 gc.24 [call] v34'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.210+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:283 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3240 con 0x55c6e3954a10 2024-09-13T23:08:29.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.210+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 92 ==== osd_op_reply(283 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.210+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.210+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:284 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a2230 con 0x55c6e3954a10 2024-09-13T23:08:29.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.210+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 93 ==== osd_op_reply(284 gc.24 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.210+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:285 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3240 con 0x55c6e3954a10 2024-09-13T23:08:29.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.211+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 94 ==== osd_op_reply(285 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.211+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.211+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:286 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3240 con 0x55c6e3954a10 2024-09-13T23:08:29.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.211+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 95 ==== osd_op_reply(286 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.211+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.211+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:287 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3240 con 0x55c6e3954a10 2024-09-13T23:08:29.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.212+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 96 ==== osd_op_reply(287 gc.24 [call] v34'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.212+0000 7fc8b54bb800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-13T23:08:29.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.212+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:288 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3240 con 0x55c6e3954a10 2024-09-13T23:08:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.213+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 97 ==== osd_op_reply(288 gc.25 [call] v34'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.213+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:289 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3240 con 0x55c6e3954a10 2024-09-13T23:08:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.213+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 98 ==== osd_op_reply(289 gc.25 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.213+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.213+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:290 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a2230 con 0x55c6e3954a10 2024-09-13T23:08:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.213+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 99 ==== osd_op_reply(290 gc.25 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.213+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:291 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3240 con 0x55c6e3954a10 2024-09-13T23:08:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.213+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 100 ==== osd_op_reply(291 gc.25 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.213+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:08:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.213+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:292 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3240 con 0x55c6e3954a10 2024-09-13T23:08:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.214+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 101 ==== osd_op_reply(292 gc.25 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.214+0000 7fc8b54bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:08:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.214+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:293 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39a3240 con 0x55c6e3954a10 2024-09-13T23:08:29.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.214+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 102 ==== osd_op_reply(293 gc.25 [call] v34'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.215+0000 7fc7697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:08:29.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.215+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94312710136496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e39967e0 con 0x55c6e394e7c0 2024-09-13T23:08:29.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.216+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 65 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94312710136496] v34'285 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.216+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94312710115232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e395e2b0 con 0x7fc89c00c7e0 2024-09-13T23:08:29.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.218+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 62 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94312710115232] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.218+0000 7fc8b54bb800 20 remove_watcher() i=0 2024-09-13T23:08:29.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.218+0000 7fc8b54bb800 2 removed watcher, disabling cache 2024-09-13T23:08:29.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.218+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94312710119728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3958fa0 con 0x55c6e394e7c0 2024-09-13T23:08:29.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.219+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 66 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94312710119728] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.219+0000 7fc8b54bb800 20 remove_watcher() i=1 2024-09-13T23:08:29.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.219+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94312710120784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3958fa0 con 0x55c6e3954a10 2024-09-13T23:08:29.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.220+0000 7fc8abfff640 1 -- 172.21.15.164:0/1336205977 <== osd.3 v2:172.21.15.164:6816/93809510 103 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94312710120784] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc89c03f020 con 0x55c6e3954a10 2024-09-13T23:08:29.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.220+0000 7fc8b54bb800 20 remove_watcher() i=2 2024-09-13T23:08:29.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.220+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94312710127824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3958fa0 con 0x7fc89c00c7e0 2024-09-13T23:08:29.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.221+0000 7fc8b37b0640 1 -- 172.21.15.164:0/1336205977 <== osd.2 v2:172.21.15.164:6808/3795914978 63 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94312710127824] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8ac040040 con 0x7fc89c00c7e0 2024-09-13T23:08:29.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.221+0000 7fc8b54bb800 20 remove_watcher() i=3 2024-09-13T23:08:29.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.221+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94312710132080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3958fa0 con 0x55c6e394e7c0 2024-09-13T23:08:29.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.222+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.1 v2:172.21.15.164:6800/4060509701 67 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94312710132080] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x55c6e394e7c0 2024-09-13T23:08:29.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.222+0000 7fc8b54bb800 20 remove_watcher() i=4 2024-09-13T23:08:29.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.222+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94312710134352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3958fa0 con 0x7fc8ac031040 2024-09-13T23:08:29.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.223+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 67 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94312710134352] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.223+0000 7fc8b54bb800 20 remove_watcher() i=5 2024-09-13T23:08:29.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.223+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94312710135408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e395da50 con 0x7fc8ac031040 2024-09-13T23:08:29.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.224+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 68 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94312710135408] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.225+0000 7fc8b54bb800 20 remove_watcher() i=6 2024-09-13T23:08:29.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.225+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94312710137936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6e3958fa0 con 0x7fc8ac031040 2024-09-13T23:08:29.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 <== osd.0 v2:172.21.15.17:6800/489863589 69 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94312710137936] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8a4051070 con 0x7fc8ac031040 2024-09-13T23:08:29.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b54bb800 20 remove_watcher() i=7 2024-09-13T23:08:29.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc8ac031040 msgr2=0x7fc8ac032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:29.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b54bb800 1 --2- 172.21.15.164:0/1336205977 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7fc8ac031040 0x7fc8ac032430 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:29.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c6e394e7c0 msgr2=0x55c6e3950c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:29.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b54bb800 1 --2- 172.21.15.164:0/1336205977 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c6e394e7c0 0x55c6e3950c80 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:29.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc89c00c7e0 msgr2=0x7fc89c02f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:29.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b54bb800 1 --2- 172.21.15.164:0/1336205977 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7fc89c00c7e0 0x7fc89c02f430 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:29.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55c6e3954a10 msgr2=0x55c6e3956e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:29.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b54bb800 1 --2- 172.21.15.164:0/1336205977 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x55c6e3954a10 0x55c6e3956e00 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:29.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc77c036b40 msgr2=0x7fc77c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:29.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b54bb800 1 --2- 172.21.15.164:0/1336205977 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc77c036b40 0x7fc77c039000 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x55c6e391b770 tx=0x7fc8ac01f000 comp rx=0 tx=0).stop 2024-09-13T23:08:29.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e393b990 msgr2=0x55c6e3942ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:29.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b54bb800 1 --2- 172.21.15.164:0/1336205977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e393b990 0x55c6e3942ea0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc89c04d250 tx=0x7fc89c04cfa0 comp rx=0 tx=0).stop 2024-09-13T23:08:29.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 reap_dead start 2024-09-13T23:08:29.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b2faf640 1 -- 172.21.15.164:0/1336205977 reap_dead start 2024-09-13T23:08:29.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 shutdown_connections 2024-09-13T23:08:29.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 >> 172.21.15.164:0/1336205977 conn(0x55c6e3937cf0 msgr2=0x55c6e3935dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:29.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 shutdown_connections 2024-09-13T23:08:29.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1336205977 wait complete. 2024-09-13T23:08:29.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1721770478 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc78c036b90 msgr2=0x7fc78c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:29.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b54bb800 1 --2- 172.21.15.164:0/1721770478 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc78c036b90 0x7fc78c039050 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x55c6e391f3c0 tx=0x7fc8ac005840 comp rx=0 tx=0).stop 2024-09-13T23:08:29.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1721770478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e392ec80 msgr2=0x55c6e392f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:29.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b54bb800 1 --2- 172.21.15.164:0/1721770478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e392ec80 0x55c6e392f0a0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fc89c001ed0 tx=0x7fc89c00d7a0 comp rx=0 tx=0).stop 2024-09-13T23:08:29.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1721770478 shutdown_connections 2024-09-13T23:08:29.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b54bb800 1 --2- 172.21.15.164:0/1721770478 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc78c036b90 0x7fc78c039050 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:29.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b54bb800 1 --2- 172.21.15.164:0/1721770478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e392ec80 0x55c6e392f0a0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:29.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1721770478 >> 172.21.15.164:0/1721770478 conn(0x55c6e3923c10 msgr2=0x55c6e3926790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:29.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1721770478 shutdown_connections 2024-09-13T23:08:29.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.226+0000 7fc8b54bb800 1 -- 172.21.15.164:0/1721770478 wait complete. 2024-09-13T23:08:29.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.227+0000 7fc8b54bb800 1 -- 172.21.15.164:0/2126635785 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c6e3823680 msgr2=0x55c6e391e250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:29.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.227+0000 7fc8b54bb800 1 --2- 172.21.15.164:0/2126635785 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c6e3823680 0x55c6e391e250 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:29.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.227+0000 7fc8b54bb800 1 -- 172.21.15.164:0/2126635785 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc798036b40 msgr2=0x7fc798039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:29.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.227+0000 7fc8b54bb800 1 --2- 172.21.15.164:0/2126635785 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc798036b40 0x7fc798039000 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc89c000f60 tx=0x7fc89c0012b0 comp rx=0 tx=0).stop 2024-09-13T23:08:29.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.227+0000 7fc8b54bb800 1 -- 172.21.15.164:0/2126635785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e3793e90 msgr2=0x55c6e39171e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:29.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.227+0000 7fc8b54bb800 1 --2- 172.21.15.164:0/2126635785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e3793e90 0x55c6e39171e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x55c6e39106e0 tx=0x7fc8a4002fb0 comp rx=0 tx=0).stop 2024-09-13T23:08:29.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.227+0000 7fc8b54bb800 1 -- 172.21.15.164:0/2126635785 shutdown_connections 2024-09-13T23:08:29.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.227+0000 7fc8b54bb800 1 --2- 172.21.15.164:0/2126635785 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x55c6e3823680 0x55c6e391e250 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:29.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.227+0000 7fc8b54bb800 1 --2- 172.21.15.164:0/2126635785 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fc798036b40 0x7fc798039000 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:29.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.227+0000 7fc8b54bb800 1 --2- 172.21.15.164:0/2126635785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c6e3793e90 0x55c6e39171e0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:29.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.227+0000 7fc8b54bb800 1 -- 172.21.15.164:0/2126635785 >> 172.21.15.164:0/2126635785 conn(0x55c6e381adf0 msgr2=0x55c6e3909af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:29.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.227+0000 7fc8b54bb800 1 -- 172.21.15.164:0/2126635785 shutdown_connections 2024-09-13T23:08:29.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-13T23:08:29.227+0000 7fc8b54bb800 1 -- 172.21.15.164:0/2126635785 wait complete. 2024-09-13T23:08:29.236 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T23:08:29.246 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T23:08:29.246 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T23:08:29.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.349+0000 7f9d3e166640 1 Processor -- start 2024-09-13T23:08:29.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.349+0000 7f9d3e166640 1 -- start start 2024-09-13T23:08:29.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.350+0000 7f9d3e166640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9d3806eda0 0x7f9d3806f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:29.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.350+0000 7f9d3e166640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d3806eba0 con 0x7f9d3806f6c0 2024-09-13T23:08:29.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.350+0000 7f9d3e166640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f9d3806d2f0 con 0x7f9d3806eda0 2024-09-13T23:08:29.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.350+0000 7f9d377fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9d3806eda0 0x7f9d3806f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:29.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.350+0000 7f9d36ffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f9d3806f6c0 0x7f9d38121a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:52704/0 (socket says 172.21.15.17:52704) 2024-09-13T23:08:29.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.350+0000 7f9d36ffd640 1 -- 172.21.15.17:0/533337039 learned_addr learned my addr 172.21.15.17:0/533337039 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:08:29.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.350+0000 7f9d377fe640 1 -- 172.21.15.17:0/533337039 >> v1:172.21.15.17:6789/0 conn(0x7f9d3806f6c0 legacy=0x7f9d38121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:29.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.350+0000 7f9d377fe640 1 -- 172.21.15.17:0/533337039 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d38070d50 con 0x7f9d3806eda0 2024-09-13T23:08:29.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.350+0000 7f9d367fc640 1 -- 172.21.15.17:0/533337039 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1292537012 0 0) 0x7f9d3806eba0 con 0x7f9d3806f6c0 2024-09-13T23:08:29.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.351+0000 7f9d377fe640 1 --2- 172.21.15.17:0/533337039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d3806eda0 0x7f9d3806f180 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f9d28009720 tx=0x7f9d2802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8cd30ea8b5b81bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:29.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.351+0000 7f9d367fc640 1 -- 172.21.15.17:0/533337039 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d28037070 con 0x7f9d3806eda0 2024-09-13T23:08:29.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.351+0000 7f9d367fc640 1 -- 172.21.15.17:0/533337039 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d2802ae20 con 0x7f9d3806eda0 2024-09-13T23:08:29.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.351+0000 7f9d367fc640 1 -- 172.21.15.17:0/533337039 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d28032590 con 0x7f9d3806eda0 2024-09-13T23:08:29.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.351+0000 7f9d3e166640 1 -- 172.21.15.17:0/533337039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d3806eda0 msgr2=0x7f9d3806f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:29.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.351+0000 7f9d3e166640 1 --2- 172.21.15.17:0/533337039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d3806eda0 0x7f9d3806f180 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f9d28009720 tx=0x7f9d2802a1a0 comp rx=0 tx=0).stop 2024-09-13T23:08:29.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.352+0000 7f9d3e166640 1 -- 172.21.15.17:0/533337039 shutdown_connections 2024-09-13T23:08:29.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.352+0000 7f9d3e166640 1 --2- 172.21.15.17:0/533337039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d3806eda0 0x7f9d3806f180 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:29.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.352+0000 7f9d3e166640 1 -- 172.21.15.17:0/533337039 >> 172.21.15.17:0/533337039 conn(0x7f9d3809a890 msgr2=0x7f9d3809aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:29.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.352+0000 7f9d3e166640 1 -- 172.21.15.17:0/533337039 shutdown_connections 2024-09-13T23:08:29.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.352+0000 7f9d3e166640 1 -- 172.21.15.17:0/533337039 wait complete. 2024-09-13T23:08:29.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.352+0000 7f9d3e166640 1 Processor -- start 2024-09-13T23:08:29.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.353+0000 7f9d3e166640 1 -- start start 2024-09-13T23:08:29.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.353+0000 7f9d3e166640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d3806eda0 0x7f9d3806d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:29.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.353+0000 7f9d3e166640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9d38122160 con 0x7f9d3806eda0 2024-09-13T23:08:29.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.353+0000 7f9d377fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d3806eda0 0x7f9d3806d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:29.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.353+0000 7f9d377fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d3806eda0 0x7f9d3806d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39918/0 (socket says 172.21.15.17:39918) 2024-09-13T23:08:29.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.353+0000 7f9d377fe640 1 -- 172.21.15.17:0/3513469616 learned_addr learned my addr 172.21.15.17:0/3513469616 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:08:29.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.353+0000 7f9d377fe640 1 -- 172.21.15.17:0/3513469616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d38128ba0 con 0x7f9d3806eda0 2024-09-13T23:08:29.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.354+0000 7f9d377fe640 1 --2- 172.21.15.17:0/3513469616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d3806eda0 0x7f9d3806d910 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f9d28035040 tx=0x7f9d280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:29.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.354+0000 7f9d1ffff640 1 -- 172.21.15.17:0/3513469616 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d28037040 con 0x7f9d3806eda0 2024-09-13T23:08:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.354+0000 7f9d1ffff640 1 -- 172.21.15.17:0/3513469616 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d28032e30 con 0x7f9d3806eda0 2024-09-13T23:08:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.354+0000 7f9d1ffff640 1 -- 172.21.15.17:0/3513469616 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d28004160 con 0x7f9d3806eda0 2024-09-13T23:08:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.354+0000 7f9d3e166640 1 -- 172.21.15.17:0/3513469616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d3808c400 con 0x7f9d3806eda0 2024-09-13T23:08:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.354+0000 7f9d3e166640 1 -- 172.21.15.17:0/3513469616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d3806e030 con 0x7f9d3806eda0 2024-09-13T23:08:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.355+0000 7f9d1ffff640 1 -- 172.21.15.17:0/3513469616 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9d2803a040 con 0x7f9d3806eda0 2024-09-13T23:08:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.355+0000 7f9d3e166640 1 -- 172.21.15.17:0/3513469616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d38122670 con 0x7f9d3806eda0 2024-09-13T23:08:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.355+0000 7f9d1ffff640 1 --2- 172.21.15.17:0/3513469616 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9d240382a0 0x7f9d2403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.355+0000 7f9d1ffff640 1 -- 172.21.15.17:0/3513469616 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f9d2806c660 con 0x7f9d3806eda0 2024-09-13T23:08:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.355+0000 7f9d36ffd640 1 --2- 172.21.15.17:0/3513469616 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9d240382a0 0x7f9d2403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.356+0000 7f9d36ffd640 1 --2- 172.21.15.17:0/3513469616 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9d240382a0 0x7f9d2403a760 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c000c00 tx=0x7f9d2c007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:29.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.360+0000 7f9d1ffff640 1 -- 172.21.15.17:0/3513469616 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9d28042020 con 0x7f9d3806eda0 2024-09-13T23:08:29.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.536+0000 7f9d3e166640 1 -- 172.21.15.17:0/3513469616 --> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9d3808cee0 con 0x7f9d240382a0 2024-09-13T23:08:29.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.552+0000 7f9d1ffff640 1 -- 172.21.15.17:0/3513469616 <== mgr.4102 v2:172.21.15.164:6824/713838566 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666093 (secure 0 0 0) 0x7f9d3808cee0 con 0x7f9d240382a0 2024-09-13T23:08:29.562 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:08:29.568 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-13T23:08:29.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.557+0000 7f9d3e166640 1 -- 172.21.15.17:0/3513469616 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9d240382a0 msgr2=0x7f9d2403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:29.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.557+0000 7f9d3e166640 1 --2- 172.21.15.17:0/3513469616 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9d240382a0 0x7f9d2403a760 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c000c00 tx=0x7f9d2c007910 comp rx=0 tx=0).stop 2024-09-13T23:08:29.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.557+0000 7f9d3e166640 1 -- 172.21.15.17:0/3513469616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d3806eda0 msgr2=0x7f9d3806d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:29.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.557+0000 7f9d3e166640 1 --2- 172.21.15.17:0/3513469616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d3806eda0 0x7f9d3806d910 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f9d28035040 tx=0x7f9d280046c0 comp rx=0 tx=0).stop 2024-09-13T23:08:29.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.557+0000 7f9d3e166640 1 -- 172.21.15.17:0/3513469616 shutdown_connections 2024-09-13T23:08:29.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.557+0000 7f9d3e166640 1 --2- 172.21.15.17:0/3513469616 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f9d240382a0 0x7f9d2403a760 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:29.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.557+0000 7f9d3e166640 1 --2- 172.21.15.17:0/3513469616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d3806eda0 0x7f9d3806d910 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:29.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.557+0000 7f9d3e166640 1 -- 172.21.15.17:0/3513469616 >> 172.21.15.17:0/3513469616 conn(0x7f9d3809a890 msgr2=0x7f9d38098040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:29.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.557+0000 7f9d3e166640 1 -- 172.21.15.17:0/3513469616 shutdown_connections 2024-09-13T23:08:29.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.557+0000 7f9d3e166640 1 -- 172.21.15.17:0/3513469616 wait complete. 2024-09-13T23:08:29.573 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-09-13T23:08:28.100388+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416904,"num_objects":229,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4872,"num_read_kb":4449,"num_write":2106,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4479,"ondisk_log_size":4479,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":177912,"kb_used_data":36536,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377309448,"statfs":{"total":386547056640,"available":386364874752,"internally_reserved":0,"allocated":37412864,"data_stored":36211616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815783,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003540"},"pg_stats":[{"pgid":"3.3f","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.357961+0000","last_change":"2024-09-13T23:05:12.130214+0000","last_active":"2024-09-13T23:08:22.357961+0000","last_peered":"2024-09-13T23:08:22.357961+0000","last_clean":"2024-09-13T23:08:22.357961+0000","last_became_active":"2024-09-13T23:05:12.130009+0000","last_became_peered":"2024-09-13T23:05:12.130009+0000","last_unstale":"2024-09-13T23:08:22.357961+0000","last_undegraded":"2024-09-13T23:08:22.357961+0000","last_fullsized":"2024-09-13T23:08:22.357961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:43.041094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.702056+0000","last_change":"2024-09-13T23:05:14.125468+0000","last_active":"2024-09-13T23:05:54.702056+0000","last_peered":"2024-09-13T23:05:54.702056+0000","last_clean":"2024-09-13T23:05:54.702056+0000","last_became_active":"2024-09-13T23:05:14.125215+0000","last_became_peered":"2024-09-13T23:05:14.125215+0000","last_unstale":"2024-09-13T23:05:54.702056+0000","last_undegraded":"2024-09-13T23:05:54.702056+0000","last_fullsized":"2024-09-13T23:05:54.702056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:30:53.032744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160717+0000","last_change":"2024-09-13T23:05:12.119102+0000","last_active":"2024-09-13T23:05:49.160717+0000","last_peered":"2024-09-13T23:05:49.160717+0000","last_clean":"2024-09-13T23:05:49.160717+0000","last_became_active":"2024-09-13T23:05:12.118411+0000","last_became_peered":"2024-09-13T23:05:12.118411+0000","last_unstale":"2024-09-13T23:05:49.160717+0000","last_undegraded":"2024-09-13T23:05:49.160717+0000","last_fullsized":"2024-09-13T23:05:49.160717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:58.196248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.485650+0000","last_change":"2024-09-13T23:05:14.109708+0000","last_active":"2024-09-13T23:07:21.485650+0000","last_peered":"2024-09-13T23:07:21.485650+0000","last_clean":"2024-09-13T23:07:21.485650+0000","last_became_active":"2024-09-13T23:05:14.109464+0000","last_became_peered":"2024-09-13T23:05:14.109464+0000","last_unstale":"2024-09-13T23:07:21.485650+0000","last_undegraded":"2024-09-13T23:07:21.485650+0000","last_fullsized":"2024-09-13T23:07:21.485650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:21.317180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.162506+0000","last_change":"2024-09-13T23:05:12.146564+0000","last_active":"2024-09-13T23:05:49.162506+0000","last_peered":"2024-09-13T23:05:49.162506+0000","last_clean":"2024-09-13T23:05:49.162506+0000","last_became_active":"2024-09-13T23:05:12.146191+0000","last_became_peered":"2024-09-13T23:05:12.146191+0000","last_unstale":"2024-09-13T23:05:49.162506+0000","last_undegraded":"2024-09-13T23:05:49.162506+0000","last_fullsized":"2024-09-13T23:05:49.162506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:15.192342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:17.908206+0000","last_change":"2024-09-13T23:05:14.110454+0000","last_active":"2024-09-13T23:07:17.908206+0000","last_peered":"2024-09-13T23:07:17.908206+0000","last_clean":"2024-09-13T23:07:17.908206+0000","last_became_active":"2024-09-13T23:05:14.110201+0000","last_became_peered":"2024-09-13T23:05:14.110201+0000","last_unstale":"2024-09-13T23:07:17.908206+0000","last_undegraded":"2024-09-13T23:07:17.908206+0000","last_fullsized":"2024-09-13T23:07:17.908206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:13:58.253126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.154369+0000","last_change":"2024-09-13T23:05:12.132812+0000","last_active":"2024-09-13T23:05:49.154369+0000","last_peered":"2024-09-13T23:05:49.154369+0000","last_clean":"2024-09-13T23:05:49.154369+0000","last_became_active":"2024-09-13T23:05:12.132461+0000","last_became_peered":"2024-09-13T23:05:12.132461+0000","last_unstale":"2024-09-13T23:05:49.154369+0000","last_undegraded":"2024-09-13T23:05:49.154369+0000","last_fullsized":"2024-09-13T23:05:49.154369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:16.369831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362602+0000","last_change":"2024-09-13T23:05:14.113718+0000","last_active":"2024-09-13T23:08:22.362602+0000","last_peered":"2024-09-13T23:08:22.362602+0000","last_clean":"2024-09-13T23:08:22.362602+0000","last_became_active":"2024-09-13T23:05:14.113430+0000","last_became_peered":"2024-09-13T23:05:14.113430+0000","last_unstale":"2024-09-13T23:08:22.362602+0000","last_undegraded":"2024-09-13T23:08:22.362602+0000","last_fullsized":"2024-09-13T23:08:22.362602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:49.226302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159928+0000","last_change":"2024-09-13T23:05:12.146576+0000","last_active":"2024-09-13T23:05:49.159928+0000","last_peered":"2024-09-13T23:05:49.159928+0000","last_clean":"2024-09-13T23:05:49.159928+0000","last_became_active":"2024-09-13T23:05:12.146220+0000","last_became_peered":"2024-09-13T23:05:12.146220+0000","last_unstale":"2024-09-13T23:05:49.159928+0000","last_undegraded":"2024-09-13T23:05:49.159928+0000","last_fullsized":"2024-09-13T23:05:49.159928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:20.009582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362602+0000","last_change":"2024-09-13T23:05:14.122808+0000","last_active":"2024-09-13T23:08:22.362602+0000","last_peered":"2024-09-13T23:08:22.362602+0000","last_clean":"2024-09-13T23:08:22.362602+0000","last_became_active":"2024-09-13T23:05:14.122513+0000","last_became_peered":"2024-09-13T23:05:14.122513+0000","last_unstale":"2024-09-13T23:08:22.362602+0000","last_undegraded":"2024-09-13T23:08:22.362602+0000","last_fullsized":"2024-09-13T23:08:22.362602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:32.818885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.238751+0000","last_change":"2024-09-13T23:05:12.113973+0000","last_active":"2024-09-13T23:08:22.238751+0000","last_peered":"2024-09-13T23:08:22.238751+0000","last_clean":"2024-09-13T23:08:22.238751+0000","last_became_active":"2024-09-13T23:05:12.113601+0000","last_became_peered":"2024-09-13T23:05:12.113601+0000","last_unstale":"2024-09-13T23:08:22.238751+0000","last_undegraded":"2024-09-13T23:08:22.238751+0000","last_fullsized":"2024-09-13T23:08:22.238751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:40:11.117182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.250229+0000","last_change":"2024-09-13T23:05:14.125418+0000","last_active":"2024-09-13T23:08:22.250229+0000","last_peered":"2024-09-13T23:08:22.250229+0000","last_clean":"2024-09-13T23:08:22.250229+0000","last_became_active":"2024-09-13T23:05:14.124971+0000","last_became_peered":"2024-09-13T23:05:14.124971+0000","last_unstale":"2024-09-13T23:08:22.250229+0000","last_undegraded":"2024-09-13T23:08:22.250229+0000","last_fullsized":"2024-09-13T23:08:22.250229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:48:34.888252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155922+0000","last_change":"2024-09-13T23:05:12.139628+0000","last_active":"2024-09-13T23:05:49.155922+0000","last_peered":"2024-09-13T23:05:49.155922+0000","last_clean":"2024-09-13T23:05:49.155922+0000","last_became_active":"2024-09-13T23:05:12.138297+0000","last_became_peered":"2024-09-13T23:05:12.138297+0000","last_unstale":"2024-09-13T23:05:49.155922+0000","last_undegraded":"2024-09-13T23:05:49.155922+0000","last_fullsized":"2024-09-13T23:05:49.155922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:12:00.284359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'16","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.984660+0000","last_change":"2024-09-13T23:05:14.124224+0000","last_active":"2024-09-13T23:08:21.984660+0000","last_peered":"2024-09-13T23:08:21.984660+0000","last_clean":"2024-09-13T23:08:21.984660+0000","last_became_active":"2024-09-13T23:05:14.123950+0000","last_became_peered":"2024-09-13T23:05:14.123950+0000","last_unstale":"2024-09-13T23:08:21.984660+0000","last_undegraded":"2024-09-13T23:08:21.984660+0000","last_fullsized":"2024-09-13T23:08:21.984660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:59:21.947772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":68,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.321599+0000","last_change":"2024-09-13T23:05:12.117693+0000","last_active":"2024-09-13T23:05:54.321599+0000","last_peered":"2024-09-13T23:05:54.321599+0000","last_clean":"2024-09-13T23:05:54.321599+0000","last_became_active":"2024-09-13T23:05:12.117028+0000","last_became_peered":"2024-09-13T23:05:12.117028+0000","last_unstale":"2024-09-13T23:05:54.321599+0000","last_undegraded":"2024-09-13T23:05:54.321599+0000","last_fullsized":"2024-09-13T23:05:54.321599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:17.130898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'17","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.328844+0000","last_change":"2024-09-13T23:05:14.115693+0000","last_active":"2024-09-13T23:08:22.328844+0000","last_peered":"2024-09-13T23:08:22.328844+0000","last_clean":"2024-09-13T23:08:22.328844+0000","last_became_active":"2024-09-13T23:05:14.114831+0000","last_became_peered":"2024-09-13T23:05:14.114831+0000","last_unstale":"2024-09-13T23:08:22.328844+0000","last_undegraded":"2024-09-13T23:08:22.328844+0000","last_fullsized":"2024-09-13T23:08:22.328844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:17.230322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'16","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.451482+0000","last_change":"2024-09-13T23:05:14.110322+0000","last_active":"2024-09-13T23:06:37.451482+0000","last_peered":"2024-09-13T23:06:37.451482+0000","last_clean":"2024-09-13T23:06:37.451482+0000","last_became_active":"2024-09-13T23:05:14.109903+0000","last_became_peered":"2024-09-13T23:05:14.109903+0000","last_unstale":"2024-09-13T23:06:37.451482+0000","last_undegraded":"2024-09-13T23:06:37.451482+0000","last_fullsized":"2024-09-13T23:06:37.451482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:04.762255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":66,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.936147+0000","last_change":"2024-09-13T23:05:12.136723+0000","last_active":"2024-09-13T23:08:21.936147+0000","last_peered":"2024-09-13T23:08:21.936147+0000","last_clean":"2024-09-13T23:08:21.936147+0000","last_became_active":"2024-09-13T23:05:12.136334+0000","last_became_peered":"2024-09-13T23:05:12.136334+0000","last_unstale":"2024-09-13T23:08:21.936147+0000","last_undegraded":"2024-09-13T23:08:21.936147+0000","last_fullsized":"2024-09-13T23:08:21.936147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:20.143656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'11","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:38.077492+0000","last_change":"2024-09-13T23:05:14.125935+0000","last_active":"2024-09-13T23:07:38.077492+0000","last_peered":"2024-09-13T23:07:38.077492+0000","last_clean":"2024-09-13T23:07:38.077492+0000","last_became_active":"2024-09-13T23:05:14.124023+0000","last_became_peered":"2024-09-13T23:05:14.124023+0000","last_unstale":"2024-09-13T23:07:38.077492+0000","last_undegraded":"2024-09-13T23:07:38.077492+0000","last_fullsized":"2024-09-13T23:07:38.077492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:33:06.997368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158954+0000","last_change":"2024-09-13T23:05:12.126709+0000","last_active":"2024-09-13T23:05:49.158954+0000","last_peered":"2024-09-13T23:05:49.158954+0000","last_clean":"2024-09-13T23:05:49.158954+0000","last_became_active":"2024-09-13T23:05:12.126336+0000","last_became_peered":"2024-09-13T23:05:12.126336+0000","last_unstale":"2024-09-13T23:05:49.158954+0000","last_undegraded":"2024-09-13T23:05:49.158954+0000","last_fullsized":"2024-09-13T23:05:49.158954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:13:11.279538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.453163+0000","last_change":"2024-09-13T23:05:14.125494+0000","last_active":"2024-09-13T23:06:37.453163+0000","last_peered":"2024-09-13T23:06:37.453163+0000","last_clean":"2024-09-13T23:06:37.453163+0000","last_became_active":"2024-09-13T23:05:14.125247+0000","last_became_peered":"2024-09-13T23:05:14.125247+0000","last_unstale":"2024-09-13T23:06:37.453163+0000","last_undegraded":"2024-09-13T23:06:37.453163+0000","last_fullsized":"2024-09-13T23:06:37.453163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:41.876468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156159+0000","last_change":"2024-09-13T23:05:12.140428+0000","last_active":"2024-09-13T23:05:49.156159+0000","last_peered":"2024-09-13T23:05:49.156159+0000","last_clean":"2024-09-13T23:05:49.156159+0000","last_became_active":"2024-09-13T23:05:12.139103+0000","last_became_peered":"2024-09-13T23:05:12.139103+0000","last_unstale":"2024-09-13T23:05:49.156159+0000","last_undegraded":"2024-09-13T23:05:49.156159+0000","last_fullsized":"2024-09-13T23:05:49.156159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:04.782795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'7","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:39.074749+0000","last_change":"2024-09-13T23:05:14.120825+0000","last_active":"2024-09-13T23:07:39.074749+0000","last_peered":"2024-09-13T23:07:39.074749+0000","last_clean":"2024-09-13T23:07:39.074749+0000","last_became_active":"2024-09-13T23:05:14.120397+0000","last_became_peered":"2024-09-13T23:05:14.120397+0000","last_unstale":"2024-09-13T23:07:39.074749+0000","last_undegraded":"2024-09-13T23:07:39.074749+0000","last_fullsized":"2024-09-13T23:07:39.074749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:33:06.997368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:53.844004+0000","last_change":"2024-09-13T23:05:12.139375+0000","last_active":"2024-09-13T23:05:53.844004+0000","last_peered":"2024-09-13T23:05:53.844004+0000","last_clean":"2024-09-13T23:05:53.844004+0000","last_became_active":"2024-09-13T23:05:12.139022+0000","last_became_peered":"2024-09-13T23:05:12.139022+0000","last_unstale":"2024-09-13T23:05:53.844004+0000","last_undegraded":"2024-09-13T23:05:53.844004+0000","last_fullsized":"2024-09-13T23:05:53.844004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:51.066283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'11","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.329086+0000","last_change":"2024-09-13T23:05:14.114497+0000","last_active":"2024-09-13T23:08:22.329086+0000","last_peered":"2024-09-13T23:08:22.329086+0000","last_clean":"2024-09-13T23:08:22.329086+0000","last_became_active":"2024-09-13T23:05:14.114261+0000","last_became_peered":"2024-09-13T23:05:14.114261+0000","last_unstale":"2024-09-13T23:08:22.329086+0000","last_undegraded":"2024-09-13T23:08:22.329086+0000","last_fullsized":"2024-09-13T23:08:22.329086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:24.193989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:53.841343+0000","last_change":"2024-09-13T23:05:12.130049+0000","last_active":"2024-09-13T23:05:53.841343+0000","last_peered":"2024-09-13T23:05:53.841343+0000","last_clean":"2024-09-13T23:05:53.841343+0000","last_became_active":"2024-09-13T23:05:12.129589+0000","last_became_peered":"2024-09-13T23:05:12.129589+0000","last_unstale":"2024-09-13T23:05:53.841343+0000","last_undegraded":"2024-09-13T23:05:53.841343+0000","last_fullsized":"2024-09-13T23:05:53.841343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:43.763766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.250116+0000","last_change":"2024-09-13T23:05:14.119179+0000","last_active":"2024-09-13T23:08:22.250116+0000","last_peered":"2024-09-13T23:08:22.250116+0000","last_clean":"2024-09-13T23:08:22.250116+0000","last_became_active":"2024-09-13T23:05:14.118922+0000","last_became_peered":"2024-09-13T23:05:14.118922+0000","last_unstale":"2024-09-13T23:08:22.250116+0000","last_undegraded":"2024-09-13T23:08:22.250116+0000","last_fullsized":"2024-09-13T23:08:22.250116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:34:29.752309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156113+0000","last_change":"2024-09-13T23:05:12.140097+0000","last_active":"2024-09-13T23:05:49.156113+0000","last_peered":"2024-09-13T23:05:49.156113+0000","last_clean":"2024-09-13T23:05:49.156113+0000","last_became_active":"2024-09-13T23:05:12.139690+0000","last_became_peered":"2024-09-13T23:05:12.139690+0000","last_unstale":"2024-09-13T23:05:49.156113+0000","last_undegraded":"2024-09-13T23:05:49.156113+0000","last_fullsized":"2024-09-13T23:05:49.156113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:08.185632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'37","reported_seq":102,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.290798+0000","last_change":"2024-09-13T23:05:22.146156+0000","last_active":"2024-09-13T23:08:22.290798+0000","last_peered":"2024-09-13T23:08:22.290798+0000","last_clean":"2024-09-13T23:08:22.290798+0000","last_became_active":"2024-09-13T23:05:22.145872+0000","last_became_peered":"2024-09-13T23:05:22.145872+0000","last_unstale":"2024-09-13T23:08:22.290798+0000","last_undegraded":"2024-09-13T23:08:22.290798+0000","last_fullsized":"2024-09-13T23:08:22.290798+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:03.965843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":174,"num_write":103,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:55.391940+0000","last_change":"2024-09-13T23:05:14.110173+0000","last_active":"2024-09-13T23:05:55.391940+0000","last_peered":"2024-09-13T23:05:55.391940+0000","last_clean":"2024-09-13T23:05:55.391940+0000","last_became_active":"2024-09-13T23:05:14.109928+0000","last_became_peered":"2024-09-13T23:05:14.109928+0000","last_unstale":"2024-09-13T23:05:55.391940+0000","last_undegraded":"2024-09-13T23:05:55.391940+0000","last_fullsized":"2024-09-13T23:05:55.391940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:47:18.620562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.914775+0000","last_change":"2024-09-13T23:05:12.147582+0000","last_active":"2024-09-13T23:05:54.914775+0000","last_peered":"2024-09-13T23:05:54.914775+0000","last_clean":"2024-09-13T23:05:54.914775+0000","last_became_active":"2024-09-13T23:05:12.146236+0000","last_became_peered":"2024-09-13T23:05:12.146236+0000","last_unstale":"2024-09-13T23:05:54.914775+0000","last_undegraded":"2024-09-13T23:05:54.914775+0000","last_fullsized":"2024-09-13T23:05:54.914775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:22:13.152885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.161816+0000","last_change":"2024-09-13T23:05:16.123699+0000","last_active":"2024-09-13T23:05:49.161816+0000","last_peered":"2024-09-13T23:05:49.161816+0000","last_clean":"2024-09-13T23:05:49.161816+0000","last_became_active":"2024-09-13T23:05:16.123362+0000","last_became_peered":"2024-09-13T23:05:16.123362+0000","last_unstale":"2024-09-13T23:05:49.161816+0000","last_undegraded":"2024-09-13T23:05:49.161816+0000","last_fullsized":"2024-09-13T23:05:49.161816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:16:52.649662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'31","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:47.080016+0000","last_change":"2024-09-13T23:05:18.133464+0000","last_active":"2024-09-13T23:07:47.080016+0000","last_peered":"2024-09-13T23:07:47.080016+0000","last_clean":"2024-09-13T23:07:47.080016+0000","last_became_active":"2024-09-13T23:05:18.132642+0000","last_became_peered":"2024-09-13T23:05:18.132642+0000","last_unstale":"2024-09-13T23:07:47.080016+0000","last_undegraded":"2024-09-13T23:07:47.080016+0000","last_fullsized":"2024-09-13T23:07:47.080016+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:36:33.250277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158666+0000","last_change":"2024-09-13T23:05:20.145619+0000","last_active":"2024-09-13T23:05:49.158666+0000","last_peered":"2024-09-13T23:05:49.158666+0000","last_clean":"2024-09-13T23:05:49.158666+0000","last_became_active":"2024-09-13T23:05:20.145271+0000","last_became_peered":"2024-09-13T23:05:20.145271+0000","last_unstale":"2024-09-13T23:05:49.158666+0000","last_undegraded":"2024-09-13T23:05:49.158666+0000","last_fullsized":"2024-09-13T23:05:49.158666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:42:34.341082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.268382+0000","last_change":"2024-09-13T23:05:22.150560+0000","last_active":"2024-09-13T23:06:37.268382+0000","last_peered":"2024-09-13T23:06:37.268382+0000","last_clean":"2024-09-13T23:06:37.268382+0000","last_became_active":"2024-09-13T23:05:22.150260+0000","last_became_peered":"2024-09-13T23:05:22.150260+0000","last_unstale":"2024-09-13T23:06:37.268382+0000","last_undegraded":"2024-09-13T23:06:37.268382+0000","last_fullsized":"2024-09-13T23:06:37.268382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:13.932874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'6","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.101371+0000","last_change":"2024-09-13T23:05:14.113389+0000","last_active":"2024-09-13T23:08:22.101371+0000","last_peered":"2024-09-13T23:08:22.101371+0000","last_clean":"2024-09-13T23:08:22.101371+0000","last_became_active":"2024-09-13T23:05:14.113131+0000","last_became_peered":"2024-09-13T23:05:14.113131+0000","last_unstale":"2024-09-13T23:08:22.101371+0000","last_undegraded":"2024-09-13T23:08:22.101371+0000","last_fullsized":"2024-09-13T23:08:22.101371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:06.652485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.153289+0000","last_change":"2024-09-13T23:05:12.134287+0000","last_active":"2024-09-13T23:05:49.153289+0000","last_peered":"2024-09-13T23:05:49.153289+0000","last_clean":"2024-09-13T23:05:49.153289+0000","last_became_active":"2024-09-13T23:05:12.133505+0000","last_became_peered":"2024-09-13T23:05:12.133505+0000","last_unstale":"2024-09-13T23:05:49.153289+0000","last_undegraded":"2024-09-13T23:05:49.153289+0000","last_fullsized":"2024-09-13T23:05:49.153289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:56.855326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159485+0000","last_change":"2024-09-13T23:05:16.125089+0000","last_active":"2024-09-13T23:05:49.159485+0000","last_peered":"2024-09-13T23:05:49.159485+0000","last_clean":"2024-09-13T23:05:49.159485+0000","last_became_active":"2024-09-13T23:05:16.124724+0000","last_became_peered":"2024-09-13T23:05:16.124724+0000","last_unstale":"2024-09-13T23:05:49.159485+0000","last_undegraded":"2024-09-13T23:05:49.159485+0000","last_fullsized":"2024-09-13T23:05:49.159485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:57:02.718638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:43.078368+0000","last_change":"2024-09-13T23:05:18.126600+0000","last_active":"2024-09-13T23:07:43.078368+0000","last_peered":"2024-09-13T23:07:43.078368+0000","last_clean":"2024-09-13T23:07:43.078368+0000","last_became_active":"2024-09-13T23:05:18.126251+0000","last_became_peered":"2024-09-13T23:05:18.126251+0000","last_unstale":"2024-09-13T23:07:43.078368+0000","last_undegraded":"2024-09-13T23:07:43.078368+0000","last_fullsized":"2024-09-13T23:07:43.078368+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:07:27.243286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156395+0000","last_change":"2024-09-13T23:05:20.142878+0000","last_active":"2024-09-13T23:05:49.156395+0000","last_peered":"2024-09-13T23:05:49.156395+0000","last_clean":"2024-09-13T23:05:49.156395+0000","last_became_active":"2024-09-13T23:05:20.142564+0000","last_became_peered":"2024-09-13T23:05:20.142564+0000","last_unstale":"2024-09-13T23:05:49.156395+0000","last_undegraded":"2024-09-13T23:05:49.156395+0000","last_fullsized":"2024-09-13T23:05:49.156395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:59.655692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158502+0000","last_change":"2024-09-13T23:05:22.147806+0000","last_active":"2024-09-13T23:05:49.158502+0000","last_peered":"2024-09-13T23:05:49.158502+0000","last_clean":"2024-09-13T23:05:49.158502+0000","last_became_active":"2024-09-13T23:05:22.147493+0000","last_became_peered":"2024-09-13T23:05:22.147493+0000","last_unstale":"2024-09-13T23:05:49.158502+0000","last_undegraded":"2024-09-13T23:05:49.158502+0000","last_fullsized":"2024-09-13T23:05:49.158502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:13.932874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.450589+0000","last_change":"2024-09-13T23:05:14.113438+0000","last_active":"2024-09-13T23:06:37.450589+0000","last_peered":"2024-09-13T23:06:37.450589+0000","last_clean":"2024-09-13T23:06:37.450589+0000","last_became_active":"2024-09-13T23:05:14.112986+0000","last_became_peered":"2024-09-13T23:05:14.112986+0000","last_unstale":"2024-09-13T23:06:37.450589+0000","last_undegraded":"2024-09-13T23:06:37.450589+0000","last_fullsized":"2024-09-13T23:06:37.450589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:45:08.233460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155482+0000","last_change":"2024-09-13T23:05:12.139949+0000","last_active":"2024-09-13T23:05:49.155482+0000","last_peered":"2024-09-13T23:05:49.155482+0000","last_clean":"2024-09-13T23:05:49.155482+0000","last_became_active":"2024-09-13T23:05:12.138805+0000","last_became_peered":"2024-09-13T23:05:12.138805+0000","last_unstale":"2024-09-13T23:05:49.155482+0000","last_undegraded":"2024-09-13T23:05:49.155482+0000","last_fullsized":"2024-09-13T23:05:49.155482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:31:38.135658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:51.062287+0000","last_change":"2024-09-13T23:05:49.165573+0000","last_active":"2024-09-13T23:05:51.062287+0000","last_peered":"2024-09-13T23:05:51.062287+0000","last_clean":"2024-09-13T23:05:51.062287+0000","last_became_active":"2024-09-13T23:05:49.165209+0000","last_became_peered":"2024-09-13T23:05:49.165209+0000","last_unstale":"2024-09-13T23:05:51.062287+0000","last_undegraded":"2024-09-13T23:05:51.062287+0000","last_fullsized":"2024-09-13T23:05:51.062287+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:19:50.556651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"34'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:41.077798+0000","last_change":"2024-09-13T23:05:18.134680+0000","last_active":"2024-09-13T23:07:41.077798+0000","last_peered":"2024-09-13T23:07:41.077798+0000","last_clean":"2024-09-13T23:07:41.077798+0000","last_became_active":"2024-09-13T23:05:18.134363+0000","last_became_peered":"2024-09-13T23:05:18.134363+0000","last_unstale":"2024-09-13T23:07:41.077798+0000","last_undegraded":"2024-09-13T23:07:41.077798+0000","last_fullsized":"2024-09-13T23:07:41.077798+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:00.335024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":385,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.612992+0000","last_change":"2024-09-13T23:05:20.144269+0000","last_active":"2024-09-13T23:08:22.612992+0000","last_peered":"2024-09-13T23:08:22.612992+0000","last_clean":"2024-09-13T23:08:22.612992+0000","last_became_active":"2024-09-13T23:05:20.143986+0000","last_became_peered":"2024-09-13T23:05:20.143986+0000","last_unstale":"2024-09-13T23:08:22.612992+0000","last_undegraded":"2024-09-13T23:08:22.612992+0000","last_fullsized":"2024-09-13T23:08:22.612992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:13.991065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'8","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.683567+0000","last_change":"2024-09-13T23:05:22.151271+0000","last_active":"2024-09-13T23:08:21.683567+0000","last_peered":"2024-09-13T23:08:21.683567+0000","last_clean":"2024-09-13T23:08:21.683567+0000","last_became_active":"2024-09-13T23:05:22.150977+0000","last_became_peered":"2024-09-13T23:05:22.150977+0000","last_unstale":"2024-09-13T23:08:21.683567+0000","last_undegraded":"2024-09-13T23:08:21.683567+0000","last_fullsized":"2024-09-13T23:08:21.683567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:52:45.769736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'12","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.106650+0000","last_change":"2024-09-13T23:05:14.122457+0000","last_active":"2024-09-13T23:08:22.106650+0000","last_peered":"2024-09-13T23:08:22.106650+0000","last_clean":"2024-09-13T23:08:22.106650+0000","last_became_active":"2024-09-13T23:05:14.121960+0000","last_became_peered":"2024-09-13T23:05:14.121960+0000","last_unstale":"2024-09-13T23:08:22.106650+0000","last_undegraded":"2024-09-13T23:08:22.106650+0000","last_fullsized":"2024-09-13T23:08:22.106650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:29:29.556013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:53.841405+0000","last_change":"2024-09-13T23:05:12.129400+0000","last_active":"2024-09-13T23:05:53.841405+0000","last_peered":"2024-09-13T23:05:53.841405+0000","last_clean":"2024-09-13T23:05:53.841405+0000","last_became_active":"2024-09-13T23:05:12.129019+0000","last_became_peered":"2024-09-13T23:05:12.129019+0000","last_unstale":"2024-09-13T23:05:53.841405+0000","last_undegraded":"2024-09-13T23:05:53.841405+0000","last_fullsized":"2024-09-13T23:05:53.841405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:17.130898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.162782+0000","last_change":"2024-09-13T23:05:16.122830+0000","last_active":"2024-09-13T23:05:49.162782+0000","last_peered":"2024-09-13T23:05:49.162782+0000","last_clean":"2024-09-13T23:05:49.162782+0000","last_became_active":"2024-09-13T23:05:16.122555+0000","last_became_peered":"2024-09-13T23:05:16.122555+0000","last_unstale":"2024-09-13T23:05:49.162782+0000","last_undegraded":"2024-09-13T23:05:49.162782+0000","last_fullsized":"2024-09-13T23:05:49.162782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:26.261538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.718356+0000","last_change":"2024-09-13T23:05:18.128964+0000","last_active":"2024-09-13T23:07:19.718356+0000","last_peered":"2024-09-13T23:07:19.718356+0000","last_clean":"2024-09-13T23:07:19.718356+0000","last_became_active":"2024-09-13T23:05:18.128626+0000","last_became_peered":"2024-09-13T23:05:18.128626+0000","last_unstale":"2024-09-13T23:07:19.718356+0000","last_undegraded":"2024-09-13T23:07:19.718356+0000","last_fullsized":"2024-09-13T23:07:19.718356+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:06.922448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'282","reported_seq":401,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.365794+0000","last_change":"2024-09-13T23:05:20.132195+0000","last_active":"2024-09-13T23:08:22.365794+0000","last_peered":"2024-09-13T23:08:22.365794+0000","last_clean":"2024-09-13T23:08:22.365794+0000","last_became_active":"2024-09-13T23:05:20.131943+0000","last_became_peered":"2024-09-13T23:05:20.131943+0000","last_unstale":"2024-09-13T23:08:22.365794+0000","last_undegraded":"2024-09-13T23:08:22.365794+0000","last_fullsized":"2024-09-13T23:08:22.365794+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:31.349343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158421+0000","last_change":"2024-09-13T23:05:14.127270+0000","last_active":"2024-09-13T23:05:49.158421+0000","last_peered":"2024-09-13T23:05:49.158421+0000","last_clean":"2024-09-13T23:05:49.158421+0000","last_became_active":"2024-09-13T23:05:14.126659+0000","last_became_peered":"2024-09-13T23:05:14.126659+0000","last_unstale":"2024-09-13T23:05:49.158421+0000","last_undegraded":"2024-09-13T23:05:49.158421+0000","last_fullsized":"2024-09-13T23:05:49.158421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:48.797832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160679+0000","last_change":"2024-09-13T23:05:12.116365+0000","last_active":"2024-09-13T23:05:49.160679+0000","last_peered":"2024-09-13T23:05:49.160679+0000","last_clean":"2024-09-13T23:05:49.160679+0000","last_became_active":"2024-09-13T23:05:12.114453+0000","last_became_peered":"2024-09-13T23:05:12.114453+0000","last_unstale":"2024-09-13T23:05:49.160679+0000","last_undegraded":"2024-09-13T23:05:49.160679+0000","last_fullsized":"2024-09-13T23:05:49.160679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:27.884217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156721+0000","last_change":"2024-09-13T23:05:16.124600+0000","last_active":"2024-09-13T23:05:49.156721+0000","last_peered":"2024-09-13T23:05:49.156721+0000","last_clean":"2024-09-13T23:05:49.156721+0000","last_became_active":"2024-09-13T23:05:16.124324+0000","last_became_peered":"2024-09-13T23:05:16.124324+0000","last_unstale":"2024-09-13T23:05:49.156721+0000","last_undegraded":"2024-09-13T23:05:49.156721+0000","last_fullsized":"2024-09-13T23:05:49.156721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:41.101957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'40","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.728296+0000","last_change":"2024-09-13T23:05:18.130180+0000","last_active":"2024-09-13T23:07:19.728296+0000","last_peered":"2024-09-13T23:07:19.728296+0000","last_clean":"2024-09-13T23:07:19.728296+0000","last_became_active":"2024-09-13T23:05:18.129887+0000","last_became_peered":"2024-09-13T23:05:18.129887+0000","last_unstale":"2024-09-13T23:07:19.728296+0000","last_undegraded":"2024-09-13T23:07:19.728296+0000","last_fullsized":"2024-09-13T23:07:19.728296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:07:09.827042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160148+0000","last_change":"2024-09-13T23:05:20.136290+0000","last_active":"2024-09-13T23:05:49.160148+0000","last_peered":"2024-09-13T23:05:49.160148+0000","last_clean":"2024-09-13T23:05:49.160148+0000","last_became_active":"2024-09-13T23:05:20.135937+0000","last_became_peered":"2024-09-13T23:05:20.135937+0000","last_unstale":"2024-09-13T23:05:49.160148+0000","last_undegraded":"2024-09-13T23:05:49.160148+0000","last_fullsized":"2024-09-13T23:05:49.160148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.119483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.270132+0000","last_change":"2024-09-13T23:05:22.146349+0000","last_active":"2024-09-13T23:06:37.270132+0000","last_peered":"2024-09-13T23:06:37.270132+0000","last_clean":"2024-09-13T23:06:37.270132+0000","last_became_active":"2024-09-13T23:05:22.146044+0000","last_became_peered":"2024-09-13T23:05:22.146044+0000","last_unstale":"2024-09-13T23:06:37.270132+0000","last_undegraded":"2024-09-13T23:06:37.270132+0000","last_fullsized":"2024-09-13T23:06:37.270132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:21.509044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157862+0000","last_change":"2024-09-13T23:05:14.116849+0000","last_active":"2024-09-13T23:05:49.157862+0000","last_peered":"2024-09-13T23:05:49.157862+0000","last_clean":"2024-09-13T23:05:49.157862+0000","last_became_active":"2024-09-13T23:05:14.116507+0000","last_became_peered":"2024-09-13T23:05:14.116507+0000","last_unstale":"2024-09-13T23:05:49.157862+0000","last_undegraded":"2024-09-13T23:05:49.157862+0000","last_fullsized":"2024-09-13T23:05:49.157862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:29:29.556013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.441116+0000","last_change":"2024-09-13T23:05:12.115905+0000","last_active":"2024-09-13T23:06:37.441116+0000","last_peered":"2024-09-13T23:06:37.441116+0000","last_clean":"2024-09-13T23:06:37.441116+0000","last_became_active":"2024-09-13T23:05:12.115025+0000","last_became_peered":"2024-09-13T23:05:12.115025+0000","last_unstale":"2024-09-13T23:06:37.441116+0000","last_undegraded":"2024-09-13T23:06:37.441116+0000","last_fullsized":"2024-09-13T23:06:37.441116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:18.644207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158753+0000","last_change":"2024-09-13T23:05:16.118904+0000","last_active":"2024-09-13T23:05:49.158753+0000","last_peered":"2024-09-13T23:05:49.158753+0000","last_clean":"2024-09-13T23:05:49.158753+0000","last_became_active":"2024-09-13T23:05:16.118494+0000","last_became_peered":"2024-09-13T23:05:16.118494+0000","last_unstale":"2024-09-13T23:05:49.158753+0000","last_undegraded":"2024-09-13T23:05:49.158753+0000","last_fullsized":"2024-09-13T23:05:49.158753+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:04:52.706373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.708412+0000","last_change":"2024-09-13T23:05:18.134435+0000","last_active":"2024-09-13T23:07:19.708412+0000","last_peered":"2024-09-13T23:07:19.708412+0000","last_clean":"2024-09-13T23:07:19.708412+0000","last_became_active":"2024-09-13T23:05:18.134130+0000","last_became_peered":"2024-09-13T23:05:18.134130+0000","last_unstale":"2024-09-13T23:07:19.708412+0000","last_undegraded":"2024-09-13T23:07:19.708412+0000","last_fullsized":"2024-09-13T23:07:19.708412+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:26.188132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159456+0000","last_change":"2024-09-13T23:05:20.140527+0000","last_active":"2024-09-13T23:05:49.159456+0000","last_peered":"2024-09-13T23:05:49.159456+0000","last_clean":"2024-09-13T23:05:49.159456+0000","last_became_active":"2024-09-13T23:05:20.140180+0000","last_became_peered":"2024-09-13T23:05:20.140180+0000","last_unstale":"2024-09-13T23:05:49.159456+0000","last_undegraded":"2024-09-13T23:05:49.159456+0000","last_fullsized":"2024-09-13T23:05:49.159456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:59.655692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'7","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.257996+0000","last_change":"2024-09-13T23:05:22.148436+0000","last_active":"2024-09-13T23:06:37.257996+0000","last_peered":"2024-09-13T23:06:37.257996+0000","last_clean":"2024-09-13T23:06:37.257996+0000","last_became_active":"2024-09-13T23:05:22.148104+0000","last_became_peered":"2024-09-13T23:05:22.148104+0000","last_unstale":"2024-09-13T23:06:37.257996+0000","last_undegraded":"2024-09-13T23:06:37.257996+0000","last_fullsized":"2024-09-13T23:06:37.257996+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:03:42.989142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":18,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.153941+0000","last_change":"2024-09-13T23:05:14.119333+0000","last_active":"2024-09-13T23:05:49.153941+0000","last_peered":"2024-09-13T23:05:49.153941+0000","last_clean":"2024-09-13T23:05:49.153941+0000","last_became_active":"2024-09-13T23:05:14.119071+0000","last_became_peered":"2024-09-13T23:05:14.119071+0000","last_unstale":"2024-09-13T23:05:49.153941+0000","last_undegraded":"2024-09-13T23:05:49.153941+0000","last_fullsized":"2024-09-13T23:05:49.153941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:22.705770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:27.076346+0000","last_change":"2024-09-13T23:05:12.148852+0000","last_active":"2024-09-13T23:07:27.076346+0000","last_peered":"2024-09-13T23:07:27.076346+0000","last_clean":"2024-09-13T23:07:27.076346+0000","last_became_active":"2024-09-13T23:05:12.148439+0000","last_became_peered":"2024-09-13T23:05:12.148439+0000","last_unstale":"2024-09-13T23:07:27.076346+0000","last_undegraded":"2024-09-13T23:07:27.076346+0000","last_fullsized":"2024-09-13T23:07:27.076346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:48:38.654493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159519+0000","last_change":"2024-09-13T23:05:16.123514+0000","last_active":"2024-09-13T23:05:49.159519+0000","last_peered":"2024-09-13T23:05:49.159519+0000","last_clean":"2024-09-13T23:05:49.159519+0000","last_became_active":"2024-09-13T23:05:16.123188+0000","last_became_peered":"2024-09-13T23:05:16.123188+0000","last_unstale":"2024-09-13T23:05:49.159519+0000","last_undegraded":"2024-09-13T23:05:49.159519+0000","last_fullsized":"2024-09-13T23:05:49.159519+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:12:38.123647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.730276+0000","last_change":"2024-09-13T23:05:18.132366+0000","last_active":"2024-09-13T23:07:19.730276+0000","last_peered":"2024-09-13T23:07:19.730276+0000","last_clean":"2024-09-13T23:07:19.730276+0000","last_became_active":"2024-09-13T23:05:18.131446+0000","last_became_peered":"2024-09-13T23:05:18.131446+0000","last_unstale":"2024-09-13T23:07:19.730276+0000","last_undegraded":"2024-09-13T23:07:19.730276+0000","last_fullsized":"2024-09-13T23:07:19.730276+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:53.858562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":348,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.638674+0000","last_change":"2024-09-13T23:05:20.144417+0000","last_active":"2024-09-13T23:08:22.638674+0000","last_peered":"2024-09-13T23:08:22.638674+0000","last_clean":"2024-09-13T23:08:22.638674+0000","last_became_active":"2024-09-13T23:05:20.144104+0000","last_became_peered":"2024-09-13T23:05:20.144104+0000","last_unstale":"2024-09-13T23:08:22.638674+0000","last_undegraded":"2024-09-13T23:08:22.638674+0000","last_fullsized":"2024-09-13T23:08:22.638674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:33.653779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160034+0000","last_change":"2024-09-13T23:05:22.147955+0000","last_active":"2024-09-13T23:05:49.160034+0000","last_peered":"2024-09-13T23:05:49.160034+0000","last_clean":"2024-09-13T23:05:49.160034+0000","last_became_active":"2024-09-13T23:05:22.147645+0000","last_became_peered":"2024-09-13T23:05:22.147645+0000","last_unstale":"2024-09-13T23:05:49.160034+0000","last_undegraded":"2024-09-13T23:05:49.160034+0000","last_fullsized":"2024-09-13T23:05:49.160034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:07.578205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'10","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362666+0000","last_change":"2024-09-13T23:05:14.112569+0000","last_active":"2024-09-13T23:08:22.362666+0000","last_peered":"2024-09-13T23:08:22.362666+0000","last_clean":"2024-09-13T23:08:22.362666+0000","last_became_active":"2024-09-13T23:05:14.112291+0000","last_became_peered":"2024-09-13T23:05:14.112291+0000","last_unstale":"2024-09-13T23:08:22.362666+0000","last_undegraded":"2024-09-13T23:08:22.362666+0000","last_fullsized":"2024-09-13T23:08:22.362666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:17.199234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:27.076285+0000","last_change":"2024-09-13T23:05:12.149813+0000","last_active":"2024-09-13T23:07:27.076285+0000","last_peered":"2024-09-13T23:07:27.076285+0000","last_clean":"2024-09-13T23:07:27.076285+0000","last_became_active":"2024-09-13T23:05:12.149418+0000","last_became_peered":"2024-09-13T23:05:12.149418+0000","last_unstale":"2024-09-13T23:07:27.076285+0000","last_undegraded":"2024-09-13T23:07:27.076285+0000","last_fullsized":"2024-09-13T23:07:27.076285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:40.908784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158966+0000","last_change":"2024-09-13T23:05:16.118930+0000","last_active":"2024-09-13T23:05:49.158966+0000","last_peered":"2024-09-13T23:05:49.158966+0000","last_clean":"2024-09-13T23:05:49.158966+0000","last_became_active":"2024-09-13T23:05:16.118503+0000","last_became_peered":"2024-09-13T23:05:16.118503+0000","last_unstale":"2024-09-13T23:05:49.158966+0000","last_undegraded":"2024-09-13T23:05:49.158966+0000","last_fullsized":"2024-09-13T23:05:49.158966+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:46.202221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'54","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.732160+0000","last_change":"2024-09-13T23:05:18.135615+0000","last_active":"2024-09-13T23:07:19.732160+0000","last_peered":"2024-09-13T23:07:19.732160+0000","last_clean":"2024-09-13T23:07:19.732160+0000","last_became_active":"2024-09-13T23:05:18.135307+0000","last_became_peered":"2024-09-13T23:05:18.135307+0000","last_unstale":"2024-09-13T23:07:19.732160+0000","last_undegraded":"2024-09-13T23:07:19.732160+0000","last_fullsized":"2024-09-13T23:07:19.732160+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:14:46.252331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158506+0000","last_change":"2024-09-13T23:05:20.137752+0000","last_active":"2024-09-13T23:05:49.158506+0000","last_peered":"2024-09-13T23:05:49.158506+0000","last_clean":"2024-09-13T23:05:49.158506+0000","last_became_active":"2024-09-13T23:05:20.137460+0000","last_became_peered":"2024-09-13T23:05:20.137460+0000","last_unstale":"2024-09-13T23:05:49.158506+0000","last_undegraded":"2024-09-13T23:05:49.158506+0000","last_fullsized":"2024-09-13T23:05:49.158506+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:24.969082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.583085+0000","last_change":"2024-09-13T23:05:22.141812+0000","last_active":"2024-09-13T23:08:22.583085+0000","last_peered":"2024-09-13T23:08:22.583085+0000","last_clean":"2024-09-13T23:08:22.583085+0000","last_became_active":"2024-09-13T23:05:22.141472+0000","last_became_peered":"2024-09-13T23:05:22.141472+0000","last_unstale":"2024-09-13T23:08:22.583085+0000","last_undegraded":"2024-09-13T23:08:22.583085+0000","last_fullsized":"2024-09-13T23:08:22.583085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:21:03.848726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.933540+0000","last_change":"2024-09-13T23:05:49.164754+0000","last_active":"2024-09-13T23:05:54.933540+0000","last_peered":"2024-09-13T23:05:54.933540+0000","last_clean":"2024-09-13T23:05:54.933540+0000","last_became_active":"2024-09-13T23:05:49.164426+0000","last_became_peered":"2024-09-13T23:05:49.164426+0000","last_unstale":"2024-09-13T23:05:54.933540+0000","last_undegraded":"2024-09-13T23:05:54.933540+0000","last_fullsized":"2024-09-13T23:05:54.933540+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:05.715216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.230923+0000","last_change":"2024-09-13T23:05:12.130483+0000","last_active":"2024-09-13T23:08:22.230923+0000","last_peered":"2024-09-13T23:08:22.230923+0000","last_clean":"2024-09-13T23:08:22.230923+0000","last_became_active":"2024-09-13T23:05:12.129951+0000","last_became_peered":"2024-09-13T23:05:12.129951+0000","last_unstale":"2024-09-13T23:08:22.230923+0000","last_undegraded":"2024-09-13T23:08:22.230923+0000","last_fullsized":"2024-09-13T23:08:22.230923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:29.788894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156275+0000","last_change":"2024-09-13T23:05:16.127877+0000","last_active":"2024-09-13T23:05:49.156275+0000","last_peered":"2024-09-13T23:05:49.156275+0000","last_clean":"2024-09-13T23:05:49.156275+0000","last_became_active":"2024-09-13T23:05:16.127598+0000","last_became_peered":"2024-09-13T23:05:16.127598+0000","last_unstale":"2024-09-13T23:05:49.156275+0000","last_undegraded":"2024-09-13T23:05:49.156275+0000","last_fullsized":"2024-09-13T23:05:49.156275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:22:17.166855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'32","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.712314+0000","last_change":"2024-09-13T23:05:18.129032+0000","last_active":"2024-09-13T23:07:19.712314+0000","last_peered":"2024-09-13T23:07:19.712314+0000","last_clean":"2024-09-13T23:07:19.712314+0000","last_became_active":"2024-09-13T23:05:18.128238+0000","last_became_peered":"2024-09-13T23:05:18.128238+0000","last_unstale":"2024-09-13T23:07:19.712314+0000","last_undegraded":"2024-09-13T23:07:19.712314+0000","last_fullsized":"2024-09-13T23:07:19.712314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:21.134767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.163889+0000","last_change":"2024-09-13T23:05:20.140091+0000","last_active":"2024-09-13T23:05:49.163889+0000","last_peered":"2024-09-13T23:05:49.163889+0000","last_clean":"2024-09-13T23:05:49.163889+0000","last_became_active":"2024-09-13T23:05:20.139335+0000","last_became_peered":"2024-09-13T23:05:20.139335+0000","last_unstale":"2024-09-13T23:05:49.163889+0000","last_undegraded":"2024-09-13T23:05:49.163889+0000","last_fullsized":"2024-09-13T23:05:49.163889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:55.021863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:22.075235+0000","last_change":"2024-09-13T23:05:22.148481+0000","last_active":"2024-09-13T23:07:22.075235+0000","last_peered":"2024-09-13T23:07:22.075235+0000","last_clean":"2024-09-13T23:07:22.075235+0000","last_became_active":"2024-09-13T23:05:22.148222+0000","last_became_peered":"2024-09-13T23:05:22.148222+0000","last_unstale":"2024-09-13T23:07:22.075235+0000","last_undegraded":"2024-09-13T23:07:22.075235+0000","last_fullsized":"2024-09-13T23:07:22.075235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:17.281151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'34","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.987497+0000","last_change":"2024-09-13T23:05:14.118784+0000","last_active":"2024-09-13T23:08:21.987497+0000","last_peered":"2024-09-13T23:08:21.987497+0000","last_clean":"2024-09-13T23:08:21.987497+0000","last_became_active":"2024-09-13T23:05:14.118545+0000","last_became_peered":"2024-09-13T23:05:14.118545+0000","last_unstale":"2024-09-13T23:08:21.987497+0000","last_undegraded":"2024-09-13T23:08:21.987497+0000","last_fullsized":"2024-09-13T23:08:21.987497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:08.429431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":93,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157506+0000","last_change":"2024-09-13T23:05:12.147234+0000","last_active":"2024-09-13T23:05:49.157506+0000","last_peered":"2024-09-13T23:05:49.157506+0000","last_clean":"2024-09-13T23:05:49.157506+0000","last_became_active":"2024-09-13T23:05:12.146912+0000","last_became_peered":"2024-09-13T23:05:12.146912+0000","last_unstale":"2024-09-13T23:05:49.157506+0000","last_undegraded":"2024-09-13T23:05:49.157506+0000","last_fullsized":"2024-09-13T23:05:49.157506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:38:56.354721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159573+0000","last_change":"2024-09-13T23:05:16.114688+0000","last_active":"2024-09-13T23:05:49.159573+0000","last_peered":"2024-09-13T23:05:49.159573+0000","last_clean":"2024-09-13T23:05:49.159573+0000","last_became_active":"2024-09-13T23:05:16.114369+0000","last_became_peered":"2024-09-13T23:05:16.114369+0000","last_unstale":"2024-09-13T23:05:49.159573+0000","last_undegraded":"2024-09-13T23:05:49.159573+0000","last_fullsized":"2024-09-13T23:05:49.159573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:26:55.819506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'37","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.738671+0000","last_change":"2024-09-13T23:05:18.126484+0000","last_active":"2024-09-13T23:07:19.738671+0000","last_peered":"2024-09-13T23:07:19.738671+0000","last_clean":"2024-09-13T23:07:19.738671+0000","last_became_active":"2024-09-13T23:05:18.126183+0000","last_became_peered":"2024-09-13T23:05:18.126183+0000","last_unstale":"2024-09-13T23:07:19.738671+0000","last_undegraded":"2024-09-13T23:07:19.738671+0000","last_fullsized":"2024-09-13T23:07:19.738671+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:26:42.895522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":403,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.586872+0000","last_change":"2024-09-13T23:05:20.143991+0000","last_active":"2024-09-13T23:08:22.586872+0000","last_peered":"2024-09-13T23:08:22.586872+0000","last_clean":"2024-09-13T23:08:22.586872+0000","last_became_active":"2024-09-13T23:05:20.143659+0000","last_became_peered":"2024-09-13T23:05:20.143659+0000","last_unstale":"2024-09-13T23:08:22.586872+0000","last_undegraded":"2024-09-13T23:08:22.586872+0000","last_fullsized":"2024-09-13T23:08:22.586872+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:12.673687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:29.073132+0000","last_change":"2024-09-13T23:05:22.140956+0000","last_active":"2024-09-13T23:07:29.073132+0000","last_peered":"2024-09-13T23:07:29.073132+0000","last_clean":"2024-09-13T23:07:29.073132+0000","last_became_active":"2024-09-13T23:05:22.140485+0000","last_became_peered":"2024-09-13T23:05:22.140485+0000","last_unstale":"2024-09-13T23:07:29.073132+0000","last_undegraded":"2024-09-13T23:07:29.073132+0000","last_fullsized":"2024-09-13T23:07:29.073132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:59:53.508149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'18","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362666+0000","last_change":"2024-09-13T23:05:14.115429+0000","last_active":"2024-09-13T23:08:22.362666+0000","last_peered":"2024-09-13T23:08:22.362666+0000","last_clean":"2024-09-13T23:08:22.362666+0000","last_became_active":"2024-09-13T23:05:14.115166+0000","last_became_peered":"2024-09-13T23:05:14.115166+0000","last_unstale":"2024-09-13T23:08:22.362666+0000","last_undegraded":"2024-09-13T23:08:22.362666+0000","last_fullsized":"2024-09-13T23:08:22.362666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:32:22.514080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.234005+0000","last_change":"2024-09-13T23:05:12.140202+0000","last_active":"2024-09-13T23:08:22.234005+0000","last_peered":"2024-09-13T23:08:22.234005+0000","last_clean":"2024-09-13T23:08:22.234005+0000","last_became_active":"2024-09-13T23:05:12.139283+0000","last_became_peered":"2024-09-13T23:05:12.139283+0000","last_unstale":"2024-09-13T23:08:22.234005+0000","last_undegraded":"2024-09-13T23:08:22.234005+0000","last_fullsized":"2024-09-13T23:08:22.234005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:48.577483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":424,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:20.838224+0000","last_change":"2024-09-13T23:05:49.171563+0000","last_active":"2024-09-13T23:07:20.838224+0000","last_peered":"2024-09-13T23:07:20.838224+0000","last_clean":"2024-09-13T23:07:20.838224+0000","last_became_active":"2024-09-13T23:05:49.164741+0000","last_became_peered":"2024-09-13T23:05:49.164741+0000","last_unstale":"2024-09-13T23:07:20.838224+0000","last_undegraded":"2024-09-13T23:07:20.838224+0000","last_fullsized":"2024-09-13T23:07:20.838224+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:00:34.765305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160915+0000","last_change":"2024-09-13T23:05:18.135452+0000","last_active":"2024-09-13T23:05:49.160915+0000","last_peered":"2024-09-13T23:05:49.160915+0000","last_clean":"2024-09-13T23:05:49.160915+0000","last_became_active":"2024-09-13T23:05:18.135028+0000","last_became_peered":"2024-09-13T23:05:18.135028+0000","last_unstale":"2024-09-13T23:05:49.160915+0000","last_undegraded":"2024-09-13T23:05:49.160915+0000","last_fullsized":"2024-09-13T23:05:49.160915+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:18.976364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":465,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.473644+0000","last_change":"2024-09-13T23:05:20.133263+0000","last_active":"2024-09-13T23:08:22.473644+0000","last_peered":"2024-09-13T23:08:22.473644+0000","last_clean":"2024-09-13T23:08:22.473644+0000","last_became_active":"2024-09-13T23:05:20.132891+0000","last_became_peered":"2024-09-13T23:05:20.132891+0000","last_unstale":"2024-09-13T23:08:22.473644+0000","last_undegraded":"2024-09-13T23:08:22.473644+0000","last_fullsized":"2024-09-13T23:08:22.473644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:54.194855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.115074+0000","last_change":"2024-09-13T23:05:22.150994+0000","last_active":"2024-09-13T23:07:21.115074+0000","last_peered":"2024-09-13T23:07:21.115074+0000","last_clean":"2024-09-13T23:07:21.115074+0000","last_became_active":"2024-09-13T23:05:22.150258+0000","last_became_peered":"2024-09-13T23:05:22.150258+0000","last_unstale":"2024-09-13T23:07:21.115074+0000","last_undegraded":"2024-09-13T23:07:21.115074+0000","last_fullsized":"2024-09-13T23:07:21.115074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:31:47.069056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362873+0000","last_change":"2024-09-13T23:05:14.126232+0000","last_active":"2024-09-13T23:08:22.362873+0000","last_peered":"2024-09-13T23:08:22.362873+0000","last_clean":"2024-09-13T23:08:22.362873+0000","last_became_active":"2024-09-13T23:05:14.125034+0000","last_became_peered":"2024-09-13T23:05:14.125034+0000","last_unstale":"2024-09-13T23:08:22.362873+0000","last_undegraded":"2024-09-13T23:08:22.362873+0000","last_fullsized":"2024-09-13T23:08:22.362873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:04:50.699295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'3","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.249529+0000","last_change":"2024-09-13T23:05:12.143810+0000","last_active":"2024-09-13T23:06:37.249529+0000","last_peered":"2024-09-13T23:06:37.249529+0000","last_clean":"2024-09-13T23:06:37.249529+0000","last_became_active":"2024-09-13T23:05:12.142185+0000","last_became_peered":"2024-09-13T23:05:12.142185+0000","last_unstale":"2024-09-13T23:06:37.249529+0000","last_undegraded":"2024-09-13T23:06:37.249529+0000","last_fullsized":"2024-09-13T23:06:37.249529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:22.187097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.163377+0000","last_change":"2024-09-13T23:05:16.125331+0000","last_active":"2024-09-13T23:05:49.163377+0000","last_peered":"2024-09-13T23:05:49.163377+0000","last_clean":"2024-09-13T23:05:49.163377+0000","last_became_active":"2024-09-13T23:05:16.125013+0000","last_became_peered":"2024-09-13T23:05:16.125013+0000","last_unstale":"2024-09-13T23:05:49.163377+0000","last_undegraded":"2024-09-13T23:05:49.163377+0000","last_fullsized":"2024-09-13T23:05:49.163377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:44.318931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'38","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.725307+0000","last_change":"2024-09-13T23:05:18.126590+0000","last_active":"2024-09-13T23:07:19.725307+0000","last_peered":"2024-09-13T23:07:19.725307+0000","last_clean":"2024-09-13T23:07:19.725307+0000","last_became_active":"2024-09-13T23:05:18.126271+0000","last_became_peered":"2024-09-13T23:05:18.126271+0000","last_unstale":"2024-09-13T23:07:19.725307+0000","last_undegraded":"2024-09-13T23:07:19.725307+0000","last_fullsized":"2024-09-13T23:07:19.725307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:23.420696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.154145+0000","last_change":"2024-09-13T23:05:20.145937+0000","last_active":"2024-09-13T23:05:49.154145+0000","last_peered":"2024-09-13T23:05:49.154145+0000","last_clean":"2024-09-13T23:05:49.154145+0000","last_became_active":"2024-09-13T23:05:20.145626+0000","last_became_peered":"2024-09-13T23:05:20.145626+0000","last_unstale":"2024-09-13T23:05:49.154145+0000","last_undegraded":"2024-09-13T23:05:49.154145+0000","last_fullsized":"2024-09-13T23:05:49.154145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:12.850248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.421783+0000","last_change":"2024-09-13T23:05:22.137537+0000","last_active":"2024-09-13T23:08:22.421783+0000","last_peered":"2024-09-13T23:08:22.421783+0000","last_clean":"2024-09-13T23:08:22.421783+0000","last_became_active":"2024-09-13T23:05:22.137111+0000","last_became_peered":"2024-09-13T23:05:22.137111+0000","last_unstale":"2024-09-13T23:08:22.421783+0000","last_undegraded":"2024-09-13T23:08:22.421783+0000","last_fullsized":"2024-09-13T23:08:22.421783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:04:57.442372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'16","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:17.907900+0000","last_change":"2024-09-13T23:05:49.168074+0000","last_active":"2024-09-13T23:07:17.907900+0000","last_peered":"2024-09-13T23:07:17.907900+0000","last_clean":"2024-09-13T23:07:17.907900+0000","last_became_active":"2024-09-13T23:05:49.165166+0000","last_became_peered":"2024-09-13T23:05:49.165166+0000","last_unstale":"2024-09-13T23:07:17.907900+0000","last_undegraded":"2024-09-13T23:07:17.907900+0000","last_fullsized":"2024-09-13T23:07:17.907900+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:16:50.642584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":51,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":204,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.154898+0000","last_change":"2024-09-13T23:04:56.151685+0000","last_active":"2024-09-13T23:05:49.154898+0000","last_peered":"2024-09-13T23:05:49.154898+0000","last_clean":"2024-09-13T23:05:49.154898+0000","last_became_active":"2024-09-13T23:04:56.149747+0000","last_became_peered":"2024-09-13T23:04:56.149747+0000","last_unstale":"2024-09-13T23:05:49.154898+0000","last_undegraded":"2024-09-13T23:05:49.154898+0000","last_fullsized":"2024-09-13T23:05:49.154898+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:04:55.054026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:04:55.054026+0000","last_clean_scrub_stamp":"2024-09-13T23:04:55.054026+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:38.290092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160070+0000","last_change":"2024-09-13T23:05:03.078734+0000","last_active":"2024-09-13T23:05:49.160070+0000","last_peered":"2024-09-13T23:05:49.160070+0000","last_clean":"2024-09-13T23:05:49.160070+0000","last_became_active":"2024-09-13T23:05:01.074608+0000","last_became_peered":"2024-09-13T23:05:01.074608+0000","last_unstale":"2024-09-13T23:05:49.160070+0000","last_undegraded":"2024-09-13T23:05:49.160070+0000","last_fullsized":"2024-09-13T23:05:49.160070+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:03.125973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097176599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:17.074746+0000","last_change":"2024-09-13T23:05:12.147068+0000","last_active":"2024-09-13T23:07:17.074746+0000","last_peered":"2024-09-13T23:07:17.074746+0000","last_clean":"2024-09-13T23:07:17.074746+0000","last_became_active":"2024-09-13T23:05:12.146438+0000","last_became_peered":"2024-09-13T23:05:12.146438+0000","last_unstale":"2024-09-13T23:07:17.074746+0000","last_undegraded":"2024-09-13T23:07:17.074746+0000","last_fullsized":"2024-09-13T23:07:17.074746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:25:59.118016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158851+0000","last_change":"2024-09-13T23:05:16.115876+0000","last_active":"2024-09-13T23:05:49.158851+0000","last_peered":"2024-09-13T23:05:49.158851+0000","last_clean":"2024-09-13T23:05:49.158851+0000","last_became_active":"2024-09-13T23:05:16.115599+0000","last_became_peered":"2024-09-13T23:05:16.115599+0000","last_unstale":"2024-09-13T23:05:49.158851+0000","last_undegraded":"2024-09-13T23:05:49.158851+0000","last_fullsized":"2024-09-13T23:05:49.158851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:22.878444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'76","reported_seq":145,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.736517+0000","last_change":"2024-09-13T23:05:18.135412+0000","last_active":"2024-09-13T23:07:19.736517+0000","last_peered":"2024-09-13T23:07:19.736517+0000","last_clean":"2024-09-13T23:07:19.736517+0000","last_became_active":"2024-09-13T23:05:18.135080+0000","last_became_peered":"2024-09-13T23:05:18.135080+0000","last_unstale":"2024-09-13T23:07:19.736517+0000","last_undegraded":"2024-09-13T23:07:19.736517+0000","last_fullsized":"2024-09-13T23:07:19.736517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:46.305461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160178+0000","last_change":"2024-09-13T23:05:20.139707+0000","last_active":"2024-09-13T23:05:49.160178+0000","last_peered":"2024-09-13T23:05:49.160178+0000","last_clean":"2024-09-13T23:05:49.160178+0000","last_became_active":"2024-09-13T23:05:20.139399+0000","last_became_peered":"2024-09-13T23:05:20.139399+0000","last_unstale":"2024-09-13T23:05:49.160178+0000","last_undegraded":"2024-09-13T23:05:49.160178+0000","last_fullsized":"2024-09-13T23:05:49.160178+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:42:34.341082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'87","reported_seq":171,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.374408+0000","last_change":"2024-09-13T23:05:22.140722+0000","last_active":"2024-09-13T23:08:22.374408+0000","last_peered":"2024-09-13T23:08:22.374408+0000","last_clean":"2024-09-13T23:08:22.374408+0000","last_became_active":"2024-09-13T23:05:22.140430+0000","last_became_peered":"2024-09-13T23:05:22.140430+0000","last_unstale":"2024-09-13T23:08:22.374408+0000","last_undegraded":"2024-09-13T23:08:22.374408+0000","last_fullsized":"2024-09-13T23:08:22.374408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:57.254040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":226,"num_write":170,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.101402+0000","last_change":"2024-09-13T23:05:14.113221+0000","last_active":"2024-09-13T23:08:22.101402+0000","last_peered":"2024-09-13T23:08:22.101402+0000","last_clean":"2024-09-13T23:08:22.101402+0000","last_became_active":"2024-09-13T23:05:14.112711+0000","last_became_peered":"2024-09-13T23:05:14.112711+0000","last_unstale":"2024-09-13T23:08:22.101402+0000","last_undegraded":"2024-09-13T23:08:22.101402+0000","last_fullsized":"2024-09-13T23:08:22.101402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:40.124504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157421+0000","last_change":"2024-09-13T23:05:03.078145+0000","last_active":"2024-09-13T23:05:49.157421+0000","last_peered":"2024-09-13T23:05:49.157421+0000","last_clean":"2024-09-13T23:05:49.157421+0000","last_became_active":"2024-09-13T23:05:01.075438+0000","last_became_peered":"2024-09-13T23:05:01.075438+0000","last_unstale":"2024-09-13T23:05:49.157421+0000","last_undegraded":"2024-09-13T23:05:49.157421+0000","last_fullsized":"2024-09-13T23:05:49.157421+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:36:59.019783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043480299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158406+0000","last_change":"2024-09-13T23:05:12.114595+0000","last_active":"2024-09-13T23:05:49.158406+0000","last_peered":"2024-09-13T23:05:49.158406+0000","last_clean":"2024-09-13T23:05:49.158406+0000","last_became_active":"2024-09-13T23:05:12.114087+0000","last_became_peered":"2024-09-13T23:05:12.114087+0000","last_unstale":"2024-09-13T23:05:49.158406+0000","last_undegraded":"2024-09-13T23:05:49.158406+0000","last_fullsized":"2024-09-13T23:05:49.158406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:01:21.996979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.164060+0000","last_change":"2024-09-13T23:05:16.127786+0000","last_active":"2024-09-13T23:05:49.164060+0000","last_peered":"2024-09-13T23:05:49.164060+0000","last_clean":"2024-09-13T23:05:49.164060+0000","last_became_active":"2024-09-13T23:05:16.127404+0000","last_became_peered":"2024-09-13T23:05:16.127404+0000","last_unstale":"2024-09-13T23:05:49.164060+0000","last_undegraded":"2024-09-13T23:05:49.164060+0000","last_fullsized":"2024-09-13T23:05:49.164060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:03:50.653375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'274","reported_seq":477,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.205293+0000","last_change":"2024-09-13T23:05:18.135832+0000","last_active":"2024-09-13T23:08:21.205293+0000","last_peered":"2024-09-13T23:08:21.205293+0000","last_clean":"2024-09-13T23:08:21.205293+0000","last_became_active":"2024-09-13T23:05:18.135536+0000","last_became_peered":"2024-09-13T23:05:18.135536+0000","last_unstale":"2024-09-13T23:08:21.205293+0000","last_undegraded":"2024-09-13T23:08:21.205293+0000","last_fullsized":"2024-09-13T23:08:21.205293+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:46.163680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.161250+0000","last_change":"2024-09-13T23:05:20.139219+0000","last_active":"2024-09-13T23:05:49.161250+0000","last_peered":"2024-09-13T23:05:49.161250+0000","last_clean":"2024-09-13T23:05:49.161250+0000","last_became_active":"2024-09-13T23:05:20.138840+0000","last_became_peered":"2024-09-13T23:05:20.138840+0000","last_unstale":"2024-09-13T23:05:49.161250+0000","last_undegraded":"2024-09-13T23:05:49.161250+0000","last_fullsized":"2024-09-13T23:05:49.161250+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:11.879040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'5","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.012786+0000","last_change":"2024-09-13T23:05:22.149748+0000","last_active":"2024-09-13T23:08:22.012786+0000","last_peered":"2024-09-13T23:08:22.012786+0000","last_clean":"2024-09-13T23:08:22.012786+0000","last_became_active":"2024-09-13T23:05:22.149430+0000","last_became_peered":"2024-09-13T23:05:22.149430+0000","last_unstale":"2024-09-13T23:08:22.012786+0000","last_undegraded":"2024-09-13T23:08:22.012786+0000","last_fullsized":"2024-09-13T23:08:22.012786+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:59:53.508149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:17.907468+0000","last_change":"2024-09-13T23:05:14.122318+0000","last_active":"2024-09-13T23:07:17.907468+0000","last_peered":"2024-09-13T23:07:17.907468+0000","last_clean":"2024-09-13T23:07:17.907468+0000","last_became_active":"2024-09-13T23:05:14.121629+0000","last_became_peered":"2024-09-13T23:05:14.121629+0000","last_unstale":"2024-09-13T23:07:17.907468+0000","last_undegraded":"2024-09-13T23:07:17.907468+0000","last_fullsized":"2024-09-13T23:07:17.907468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:40.466898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.153107+0000","last_change":"2024-09-13T23:05:03.246597+0000","last_active":"2024-09-13T23:05:49.153107+0000","last_peered":"2024-09-13T23:05:49.153107+0000","last_clean":"2024-09-13T23:05:49.153107+0000","last_became_active":"2024-09-13T23:05:01.075422+0000","last_became_peered":"2024-09-13T23:05:01.075422+0000","last_unstale":"2024-09-13T23:05:49.153107+0000","last_undegraded":"2024-09-13T23:05:49.153107+0000","last_fullsized":"2024-09-13T23:05:49.153107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:46.318146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049267099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158237+0000","last_change":"2024-09-13T23:05:12.118437+0000","last_active":"2024-09-13T23:05:49.158237+0000","last_peered":"2024-09-13T23:05:49.158237+0000","last_clean":"2024-09-13T23:05:49.158237+0000","last_became_active":"2024-09-13T23:05:12.117940+0000","last_became_peered":"2024-09-13T23:05:12.117940+0000","last_unstale":"2024-09-13T23:05:49.158237+0000","last_undegraded":"2024-09-13T23:05:49.158237+0000","last_fullsized":"2024-09-13T23:05:49.158237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:14:55.200398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158030+0000","last_change":"2024-09-13T23:05:16.122638+0000","last_active":"2024-09-13T23:05:49.158030+0000","last_peered":"2024-09-13T23:05:49.158030+0000","last_clean":"2024-09-13T23:05:49.158030+0000","last_became_active":"2024-09-13T23:05:16.122318+0000","last_became_peered":"2024-09-13T23:05:16.122318+0000","last_unstale":"2024-09-13T23:05:49.158030+0000","last_undegraded":"2024-09-13T23:05:49.158030+0000","last_fullsized":"2024-09-13T23:05:49.158030+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:42.400087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.205271+0000","last_change":"2024-09-13T23:05:18.128025+0000","last_active":"2024-09-13T23:08:21.205271+0000","last_peered":"2024-09-13T23:08:21.205271+0000","last_clean":"2024-09-13T23:08:21.205271+0000","last_became_active":"2024-09-13T23:05:18.127698+0000","last_became_peered":"2024-09-13T23:05:18.127698+0000","last_unstale":"2024-09-13T23:08:21.205271+0000","last_undegraded":"2024-09-13T23:08:21.205271+0000","last_fullsized":"2024-09-13T23:08:21.205271+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:20.928045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159819+0000","last_change":"2024-09-13T23:05:20.145677+0000","last_active":"2024-09-13T23:05:49.159819+0000","last_peered":"2024-09-13T23:05:49.159819+0000","last_clean":"2024-09-13T23:05:49.159819+0000","last_became_active":"2024-09-13T23:05:20.145330+0000","last_became_peered":"2024-09-13T23:05:20.145330+0000","last_unstale":"2024-09-13T23:05:49.159819+0000","last_undegraded":"2024-09-13T23:05:49.159819+0000","last_fullsized":"2024-09-13T23:05:49.159819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:42.120633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.154815+0000","last_change":"2024-09-13T23:05:22.139303+0000","last_active":"2024-09-13T23:05:49.154815+0000","last_peered":"2024-09-13T23:05:49.154815+0000","last_clean":"2024-09-13T23:05:49.154815+0000","last_became_active":"2024-09-13T23:05:22.138259+0000","last_became_peered":"2024-09-13T23:05:22.138259+0000","last_unstale":"2024-09-13T23:05:49.154815+0000","last_undegraded":"2024-09-13T23:05:49.154815+0000","last_fullsized":"2024-09-13T23:05:49.154815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:37.433723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'6","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362869+0000","last_change":"2024-09-13T23:05:14.110869+0000","last_active":"2024-09-13T23:08:22.362869+0000","last_peered":"2024-09-13T23:08:22.362869+0000","last_clean":"2024-09-13T23:08:22.362869+0000","last_became_active":"2024-09-13T23:05:14.110532+0000","last_became_peered":"2024-09-13T23:05:14.110532+0000","last_unstale":"2024-09-13T23:08:22.362869+0000","last_undegraded":"2024-09-13T23:08:22.362869+0000","last_fullsized":"2024-09-13T23:08:22.362869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:48.481316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155626+0000","last_change":"2024-09-13T23:05:03.078756+0000","last_active":"2024-09-13T23:05:49.155626+0000","last_peered":"2024-09-13T23:05:49.155626+0000","last_clean":"2024-09-13T23:05:49.155626+0000","last_became_active":"2024-09-13T23:05:01.075399+0000","last_became_peered":"2024-09-13T23:05:01.075399+0000","last_unstale":"2024-09-13T23:05:49.155626+0000","last_undegraded":"2024-09-13T23:05:49.155626+0000","last_fullsized":"2024-09-13T23:05:49.155626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:30.026879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010379530000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.154668+0000","last_change":"2024-09-13T23:05:12.131428+0000","last_active":"2024-09-13T23:05:49.154668+0000","last_peered":"2024-09-13T23:05:49.154668+0000","last_clean":"2024-09-13T23:05:49.154668+0000","last_became_active":"2024-09-13T23:05:12.130410+0000","last_became_peered":"2024-09-13T23:05:12.130410+0000","last_unstale":"2024-09-13T23:05:49.154668+0000","last_undegraded":"2024-09-13T23:05:49.154668+0000","last_fullsized":"2024-09-13T23:05:49.154668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:29.799687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160305+0000","last_change":"2024-09-13T23:05:16.124659+0000","last_active":"2024-09-13T23:05:49.160305+0000","last_peered":"2024-09-13T23:05:49.160305+0000","last_clean":"2024-09-13T23:05:49.160305+0000","last_became_active":"2024-09-13T23:05:16.123983+0000","last_became_peered":"2024-09-13T23:05:16.123983+0000","last_unstale":"2024-09-13T23:05:49.160305+0000","last_undegraded":"2024-09-13T23:05:49.160305+0000","last_fullsized":"2024-09-13T23:05:49.160305+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:43.395837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.506942+0000","last_change":"2024-09-13T23:05:18.133997+0000","last_active":"2024-09-13T23:08:21.506942+0000","last_peered":"2024-09-13T23:08:21.506942+0000","last_clean":"2024-09-13T23:08:21.506942+0000","last_became_active":"2024-09-13T23:05:18.133165+0000","last_became_peered":"2024-09-13T23:05:18.133165+0000","last_unstale":"2024-09-13T23:08:21.506942+0000","last_undegraded":"2024-09-13T23:08:21.506942+0000","last_fullsized":"2024-09-13T23:08:21.506942+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:53.112074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.164155+0000","last_change":"2024-09-13T23:05:20.144363+0000","last_active":"2024-09-13T23:05:49.164155+0000","last_peered":"2024-09-13T23:05:49.164155+0000","last_clean":"2024-09-13T23:05:49.164155+0000","last_became_active":"2024-09-13T23:05:20.143748+0000","last_became_peered":"2024-09-13T23:05:20.143748+0000","last_unstale":"2024-09-13T23:05:49.164155+0000","last_undegraded":"2024-09-13T23:05:49.164155+0000","last_fullsized":"2024-09-13T23:05:49.164155+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:34:12.604551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.062072+0000","last_change":"2024-09-13T23:05:22.150796+0000","last_active":"2024-09-13T23:07:21.062072+0000","last_peered":"2024-09-13T23:07:21.062072+0000","last_clean":"2024-09-13T23:07:21.062072+0000","last_became_active":"2024-09-13T23:05:22.150415+0000","last_became_peered":"2024-09-13T23:05:22.150415+0000","last_unstale":"2024-09-13T23:07:21.062072+0000","last_undegraded":"2024-09-13T23:07:21.062072+0000","last_fullsized":"2024-09-13T23:07:21.062072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:56:02.493425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.321880+0000","last_change":"2024-09-13T23:05:14.123934+0000","last_active":"2024-09-13T23:08:22.321880+0000","last_peered":"2024-09-13T23:08:22.321880+0000","last_clean":"2024-09-13T23:08:22.321880+0000","last_became_active":"2024-09-13T23:05:14.123447+0000","last_became_peered":"2024-09-13T23:05:14.123447+0000","last_unstale":"2024-09-13T23:08:22.321880+0000","last_undegraded":"2024-09-13T23:08:22.321880+0000","last_fullsized":"2024-09-13T23:08:22.321880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:40.466898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.917869+0000","last_change":"2024-09-13T23:05:12.124402+0000","last_active":"2024-09-13T23:05:54.917869+0000","last_peered":"2024-09-13T23:05:54.917869+0000","last_clean":"2024-09-13T23:05:54.917869+0000","last_became_active":"2024-09-13T23:05:12.124005+0000","last_became_peered":"2024-09-13T23:05:12.124005+0000","last_unstale":"2024-09-13T23:05:54.917869+0000","last_undegraded":"2024-09-13T23:05:54.917869+0000","last_fullsized":"2024-09-13T23:05:54.917869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:51.362106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159745+0000","last_change":"2024-09-13T23:05:03.080556+0000","last_active":"2024-09-13T23:05:49.159745+0000","last_peered":"2024-09-13T23:05:49.159745+0000","last_clean":"2024-09-13T23:05:49.159745+0000","last_became_active":"2024-09-13T23:05:01.074963+0000","last_became_peered":"2024-09-13T23:05:01.074963+0000","last_unstale":"2024-09-13T23:05:49.159745+0000","last_undegraded":"2024-09-13T23:05:49.159745+0000","last_fullsized":"2024-09-13T23:05:49.159745+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:02.162649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055235699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:24.072212+0000","last_change":"2024-09-13T23:05:16.124473+0000","last_active":"2024-09-13T23:07:24.072212+0000","last_peered":"2024-09-13T23:07:24.072212+0000","last_clean":"2024-09-13T23:07:24.072212+0000","last_became_active":"2024-09-13T23:05:16.123971+0000","last_became_peered":"2024-09-13T23:05:16.123971+0000","last_unstale":"2024-09-13T23:07:24.072212+0000","last_undegraded":"2024-09-13T23:07:24.072212+0000","last_fullsized":"2024-09-13T23:07:24.072212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:46:26.673828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'61","reported_seq":120,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.737622+0000","last_change":"2024-09-13T23:05:18.132525+0000","last_active":"2024-09-13T23:07:19.737622+0000","last_peered":"2024-09-13T23:07:19.737622+0000","last_clean":"2024-09-13T23:07:19.737622+0000","last_became_active":"2024-09-13T23:05:18.132051+0000","last_became_peered":"2024-09-13T23:05:18.132051+0000","last_unstale":"2024-09-13T23:07:19.737622+0000","last_undegraded":"2024-09-13T23:07:19.737622+0000","last_fullsized":"2024-09-13T23:07:19.737622+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:44:32.951876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.152427+0000","last_change":"2024-09-13T23:05:20.143982+0000","last_active":"2024-09-13T23:05:49.152427+0000","last_peered":"2024-09-13T23:05:49.152427+0000","last_clean":"2024-09-13T23:05:49.152427+0000","last_became_active":"2024-09-13T23:05:20.143566+0000","last_became_peered":"2024-09-13T23:05:20.143566+0000","last_unstale":"2024-09-13T23:05:49.152427+0000","last_undegraded":"2024-09-13T23:05:49.152427+0000","last_fullsized":"2024-09-13T23:05:49.152427+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:27.338381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.471422+0000","last_change":"2024-09-13T23:05:22.138169+0000","last_active":"2024-09-13T23:08:22.471422+0000","last_peered":"2024-09-13T23:08:22.471422+0000","last_clean":"2024-09-13T23:08:22.471422+0000","last_became_active":"2024-09-13T23:05:22.137952+0000","last_became_peered":"2024-09-13T23:05:22.137952+0000","last_unstale":"2024-09-13T23:08:22.471422+0000","last_undegraded":"2024-09-13T23:08:22.471422+0000","last_fullsized":"2024-09-13T23:08:22.471422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:49.651698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.702466+0000","last_change":"2024-09-13T23:05:14.125712+0000","last_active":"2024-09-13T23:05:54.702466+0000","last_peered":"2024-09-13T23:05:54.702466+0000","last_clean":"2024-09-13T23:05:54.702466+0000","last_became_active":"2024-09-13T23:05:14.123549+0000","last_became_peered":"2024-09-13T23:05:14.123549+0000","last_unstale":"2024-09-13T23:05:54.702466+0000","last_undegraded":"2024-09-13T23:05:54.702466+0000","last_fullsized":"2024-09-13T23:05:54.702466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:14:21.159008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159984+0000","last_change":"2024-09-13T23:05:12.130717+0000","last_active":"2024-09-13T23:05:49.159984+0000","last_peered":"2024-09-13T23:05:49.159984+0000","last_clean":"2024-09-13T23:05:49.159984+0000","last_became_active":"2024-09-13T23:05:12.130285+0000","last_became_peered":"2024-09-13T23:05:12.130285+0000","last_unstale":"2024-09-13T23:05:49.159984+0000","last_undegraded":"2024-09-13T23:05:49.159984+0000","last_fullsized":"2024-09-13T23:05:49.159984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:20.143656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.163413+0000","last_change":"2024-09-13T23:05:03.078119+0000","last_active":"2024-09-13T23:05:49.163413+0000","last_peered":"2024-09-13T23:05:49.163413+0000","last_clean":"2024-09-13T23:05:49.163413+0000","last_became_active":"2024-09-13T23:05:01.075431+0000","last_became_peered":"2024-09-13T23:05:01.075431+0000","last_unstale":"2024-09-13T23:05:49.163413+0000","last_undegraded":"2024-09-13T23:05:49.163413+0000","last_fullsized":"2024-09-13T23:05:49.163413+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:22:31.741360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041474900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155165+0000","last_change":"2024-09-13T23:05:16.120645+0000","last_active":"2024-09-13T23:05:49.155165+0000","last_peered":"2024-09-13T23:05:49.155165+0000","last_clean":"2024-09-13T23:05:49.155165+0000","last_became_active":"2024-09-13T23:05:16.120337+0000","last_became_peered":"2024-09-13T23:05:16.120337+0000","last_unstale":"2024-09-13T23:05:49.155165+0000","last_undegraded":"2024-09-13T23:05:49.155165+0000","last_fullsized":"2024-09-13T23:05:49.155165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:19:50.556651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'16","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.934809+0000","last_change":"2024-09-13T23:05:18.134351+0000","last_active":"2024-09-13T23:05:54.934809+0000","last_peered":"2024-09-13T23:05:54.934809+0000","last_clean":"2024-09-13T23:05:54.934809+0000","last_became_active":"2024-09-13T23:05:18.133676+0000","last_became_peered":"2024-09-13T23:05:18.133676+0000","last_unstale":"2024-09-13T23:05:54.934809+0000","last_undegraded":"2024-09-13T23:05:54.934809+0000","last_fullsized":"2024-09-13T23:05:54.934809+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:38:10.583942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":355,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.205201+0000","last_change":"2024-09-13T23:05:20.135256+0000","last_active":"2024-09-13T23:08:21.205201+0000","last_peered":"2024-09-13T23:08:21.205201+0000","last_clean":"2024-09-13T23:08:21.205201+0000","last_became_active":"2024-09-13T23:05:20.133332+0000","last_became_peered":"2024-09-13T23:05:20.133332+0000","last_unstale":"2024-09-13T23:08:21.205201+0000","last_undegraded":"2024-09-13T23:08:21.205201+0000","last_fullsized":"2024-09-13T23:08:21.205201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:33.653779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.163699+0000","last_change":"2024-09-13T23:05:22.141887+0000","last_active":"2024-09-13T23:05:49.163699+0000","last_peered":"2024-09-13T23:05:49.163699+0000","last_clean":"2024-09-13T23:05:49.163699+0000","last_became_active":"2024-09-13T23:05:22.141618+0000","last_became_peered":"2024-09-13T23:05:22.141618+0000","last_unstale":"2024-09-13T23:05:49.163699+0000","last_undegraded":"2024-09-13T23:05:49.163699+0000","last_fullsized":"2024-09-13T23:05:49.163699+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:46.604024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'18","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.250583+0000","last_change":"2024-09-13T23:05:14.126543+0000","last_active":"2024-09-13T23:08:22.250583+0000","last_peered":"2024-09-13T23:08:22.250583+0000","last_clean":"2024-09-13T23:08:22.250583+0000","last_became_active":"2024-09-13T23:05:14.126280+0000","last_became_peered":"2024-09-13T23:05:14.126280+0000","last_unstale":"2024-09-13T23:08:22.250583+0000","last_undegraded":"2024-09-13T23:08:22.250583+0000","last_fullsized":"2024-09-13T23:08:22.250583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:15.304261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.921469+0000","last_change":"2024-09-13T23:05:12.149880+0000","last_active":"2024-09-13T23:05:54.921469+0000","last_peered":"2024-09-13T23:05:54.921469+0000","last_clean":"2024-09-13T23:05:54.921469+0000","last_became_active":"2024-09-13T23:05:12.149435+0000","last_became_peered":"2024-09-13T23:05:12.149435+0000","last_unstale":"2024-09-13T23:05:54.921469+0000","last_undegraded":"2024-09-13T23:05:54.921469+0000","last_fullsized":"2024-09-13T23:05:54.921469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:24.657126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160425+0000","last_change":"2024-09-13T23:05:03.080603+0000","last_active":"2024-09-13T23:05:49.160425+0000","last_peered":"2024-09-13T23:05:49.160425+0000","last_clean":"2024-09-13T23:05:49.160425+0000","last_became_active":"2024-09-13T23:05:01.074982+0000","last_became_peered":"2024-09-13T23:05:01.074982+0000","last_unstale":"2024-09-13T23:05:49.160425+0000","last_undegraded":"2024-09-13T23:05:49.160425+0000","last_fullsized":"2024-09-13T23:05:49.160425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:59:19.159167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054650599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155383+0000","last_change":"2024-09-13T23:05:16.123838+0000","last_active":"2024-09-13T23:05:49.155383+0000","last_peered":"2024-09-13T23:05:49.155383+0000","last_clean":"2024-09-13T23:05:49.155383+0000","last_became_active":"2024-09-13T23:05:16.123573+0000","last_became_peered":"2024-09-13T23:05:16.123573+0000","last_unstale":"2024-09-13T23:05:49.155383+0000","last_undegraded":"2024-09-13T23:05:49.155383+0000","last_fullsized":"2024-09-13T23:05:49.155383+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:46.249000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.455631+0000","last_change":"2024-09-13T23:05:18.132921+0000","last_active":"2024-09-13T23:06:37.455631+0000","last_peered":"2024-09-13T23:06:37.455631+0000","last_clean":"2024-09-13T23:06:37.455631+0000","last_became_active":"2024-09-13T23:05:18.132140+0000","last_became_peered":"2024-09-13T23:05:18.132140+0000","last_unstale":"2024-09-13T23:06:37.455631+0000","last_undegraded":"2024-09-13T23:06:37.455631+0000","last_fullsized":"2024-09-13T23:06:37.455631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:50.731504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'282","reported_seq":429,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.583662+0000","last_change":"2024-09-13T23:05:20.136524+0000","last_active":"2024-09-13T23:08:22.583662+0000","last_peered":"2024-09-13T23:08:22.583662+0000","last_clean":"2024-09-13T23:08:22.583662+0000","last_became_active":"2024-09-13T23:05:20.136036+0000","last_became_peered":"2024-09-13T23:05:20.136036+0000","last_unstale":"2024-09-13T23:08:22.583662+0000","last_undegraded":"2024-09-13T23:08:22.583662+0000","last_fullsized":"2024-09-13T23:08:22.583662+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:01:43.280761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157235+0000","last_change":"2024-09-13T23:05:22.145082+0000","last_active":"2024-09-13T23:05:49.157235+0000","last_peered":"2024-09-13T23:05:49.157235+0000","last_clean":"2024-09-13T23:05:49.157235+0000","last_became_active":"2024-09-13T23:05:22.144787+0000","last_became_peered":"2024-09-13T23:05:22.144787+0000","last_unstale":"2024-09-13T23:05:49.157235+0000","last_undegraded":"2024-09-13T23:05:49.157235+0000","last_fullsized":"2024-09-13T23:05:49.157235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:59.821393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.702234+0000","last_change":"2024-09-13T23:05:14.112813+0000","last_active":"2024-09-13T23:05:54.702234+0000","last_peered":"2024-09-13T23:05:54.702234+0000","last_clean":"2024-09-13T23:05:54.702234+0000","last_became_active":"2024-09-13T23:05:14.112565+0000","last_became_peered":"2024-09-13T23:05:14.112565+0000","last_unstale":"2024-09-13T23:05:54.702234+0000","last_undegraded":"2024-09-13T23:05:54.702234+0000","last_fullsized":"2024-09-13T23:05:54.702234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:50.584375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156509+0000","last_change":"2024-09-13T23:05:12.131805+0000","last_active":"2024-09-13T23:05:49.156509+0000","last_peered":"2024-09-13T23:05:49.156509+0000","last_clean":"2024-09-13T23:05:49.156509+0000","last_became_active":"2024-09-13T23:05:12.131413+0000","last_became_peered":"2024-09-13T23:05:12.131413+0000","last_unstale":"2024-09-13T23:05:49.156509+0000","last_undegraded":"2024-09-13T23:05:49.156509+0000","last_fullsized":"2024-09-13T23:05:49.156509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:58.196248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.164465+0000","last_change":"2024-09-13T23:05:03.078956+0000","last_active":"2024-09-13T23:05:49.164465+0000","last_peered":"2024-09-13T23:05:49.164465+0000","last_clean":"2024-09-13T23:05:49.164465+0000","last_became_active":"2024-09-13T23:05:01.323761+0000","last_became_peered":"2024-09-13T23:05:01.323761+0000","last_unstale":"2024-09-13T23:05:49.164465+0000","last_undegraded":"2024-09-13T23:05:49.164465+0000","last_fullsized":"2024-09-13T23:05:49.164465+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:39.972272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001181893,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157273+0000","last_change":"2024-09-13T23:05:16.121458+0000","last_active":"2024-09-13T23:05:49.157273+0000","last_peered":"2024-09-13T23:05:49.157273+0000","last_clean":"2024-09-13T23:05:49.157273+0000","last_became_active":"2024-09-13T23:05:16.120974+0000","last_became_peered":"2024-09-13T23:05:16.120974+0000","last_unstale":"2024-09-13T23:05:49.157273+0000","last_undegraded":"2024-09-13T23:05:49.157273+0000","last_fullsized":"2024-09-13T23:05:49.157273+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:12.719474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'82","reported_seq":154,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.723056+0000","last_change":"2024-09-13T23:05:18.138165+0000","last_active":"2024-09-13T23:07:19.723056+0000","last_peered":"2024-09-13T23:07:19.723056+0000","last_clean":"2024-09-13T23:07:19.723056+0000","last_became_active":"2024-09-13T23:05:18.137925+0000","last_became_peered":"2024-09-13T23:05:18.137925+0000","last_unstale":"2024-09-13T23:07:19.723056+0000","last_undegraded":"2024-09-13T23:07:19.723056+0000","last_fullsized":"2024-09-13T23:07:19.723056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:15.845937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158600+0000","last_change":"2024-09-13T23:05:20.129880+0000","last_active":"2024-09-13T23:05:49.158600+0000","last_peered":"2024-09-13T23:05:49.158600+0000","last_clean":"2024-09-13T23:05:49.158600+0000","last_became_active":"2024-09-13T23:05:20.129363+0000","last_became_peered":"2024-09-13T23:05:20.129363+0000","last_unstale":"2024-09-13T23:05:49.158600+0000","last_undegraded":"2024-09-13T23:05:49.158600+0000","last_fullsized":"2024-09-13T23:05:49.158600+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:50.629881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157130+0000","last_change":"2024-09-13T23:05:22.151007+0000","last_active":"2024-09-13T23:05:49.157130+0000","last_peered":"2024-09-13T23:05:49.157130+0000","last_clean":"2024-09-13T23:05:49.157130+0000","last_became_active":"2024-09-13T23:05:22.149645+0000","last_became_peered":"2024-09-13T23:05:22.149645+0000","last_unstale":"2024-09-13T23:05:49.157130+0000","last_undegraded":"2024-09-13T23:05:49.157130+0000","last_fullsized":"2024-09-13T23:05:49.157130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:14.228653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160576+0000","last_change":"2024-09-13T23:05:22.151921+0000","last_active":"2024-09-13T23:05:49.160576+0000","last_peered":"2024-09-13T23:05:49.160576+0000","last_clean":"2024-09-13T23:05:49.160576+0000","last_became_active":"2024-09-13T23:05:22.151640+0000","last_became_peered":"2024-09-13T23:05:22.151640+0000","last_unstale":"2024-09-13T23:05:49.160576+0000","last_undegraded":"2024-09-13T23:05:49.160576+0000","last_fullsized":"2024-09-13T23:05:49.160576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:38:24.891059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'12","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.323823+0000","last_change":"2024-09-13T23:05:14.113491+0000","last_active":"2024-09-13T23:08:22.323823+0000","last_peered":"2024-09-13T23:08:22.323823+0000","last_clean":"2024-09-13T23:08:22.323823+0000","last_became_active":"2024-09-13T23:05:14.113236+0000","last_became_peered":"2024-09-13T23:05:14.113236+0000","last_unstale":"2024-09-13T23:08:22.323823+0000","last_undegraded":"2024-09-13T23:08:22.323823+0000","last_fullsized":"2024-09-13T23:08:22.323823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:05:09.963242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159820+0000","last_change":"2024-09-13T23:05:12.141658+0000","last_active":"2024-09-13T23:05:49.159820+0000","last_peered":"2024-09-13T23:05:49.159820+0000","last_clean":"2024-09-13T23:05:49.159820+0000","last_became_active":"2024-09-13T23:05:12.141280+0000","last_became_peered":"2024-09-13T23:05:12.141280+0000","last_unstale":"2024-09-13T23:05:49.159820+0000","last_undegraded":"2024-09-13T23:05:49.159820+0000","last_fullsized":"2024-09-13T23:05:49.159820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:07:17.099012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158953+0000","last_change":"2024-09-13T23:05:16.117775+0000","last_active":"2024-09-13T23:05:49.158953+0000","last_peered":"2024-09-13T23:05:49.158953+0000","last_clean":"2024-09-13T23:05:49.158953+0000","last_became_active":"2024-09-13T23:05:16.117468+0000","last_became_peered":"2024-09-13T23:05:16.117468+0000","last_unstale":"2024-09-13T23:05:49.158953+0000","last_undegraded":"2024-09-13T23:05:49.158953+0000","last_fullsized":"2024-09-13T23:05:49.158953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:24.938916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'34","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079072+0000","last_change":"2024-09-13T23:05:18.132556+0000","last_active":"2024-09-13T23:07:42.079072+0000","last_peered":"2024-09-13T23:07:42.079072+0000","last_clean":"2024-09-13T23:07:42.079072+0000","last_became_active":"2024-09-13T23:05:18.131841+0000","last_became_peered":"2024-09-13T23:05:18.131841+0000","last_unstale":"2024-09-13T23:07:42.079072+0000","last_undegraded":"2024-09-13T23:07:42.079072+0000","last_fullsized":"2024-09-13T23:07:42.079072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:38.696780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158497+0000","last_change":"2024-09-13T23:05:20.140436+0000","last_active":"2024-09-13T23:05:49.158497+0000","last_peered":"2024-09-13T23:05:49.158497+0000","last_clean":"2024-09-13T23:05:49.158497+0000","last_became_active":"2024-09-13T23:05:20.138958+0000","last_became_peered":"2024-09-13T23:05:20.138958+0000","last_unstale":"2024-09-13T23:05:49.158497+0000","last_undegraded":"2024-09-13T23:05:49.158497+0000","last_fullsized":"2024-09-13T23:05:49.158497+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:06.294003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.301319+0000","last_change":"2024-09-13T23:05:22.141828+0000","last_active":"2024-09-13T23:08:22.301319+0000","last_peered":"2024-09-13T23:08:22.301319+0000","last_clean":"2024-09-13T23:08:22.301319+0000","last_became_active":"2024-09-13T23:05:22.141471+0000","last_became_peered":"2024-09-13T23:05:22.141471+0000","last_unstale":"2024-09-13T23:08:22.301319+0000","last_undegraded":"2024-09-13T23:08:22.301319+0000","last_fullsized":"2024-09-13T23:08:22.301319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:03:42.989142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'7","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:38.077521+0000","last_change":"2024-09-13T23:05:49.167955+0000","last_active":"2024-09-13T23:07:38.077521+0000","last_peered":"2024-09-13T23:07:38.077521+0000","last_clean":"2024-09-13T23:07:38.077521+0000","last_became_active":"2024-09-13T23:05:49.164131+0000","last_became_peered":"2024-09-13T23:05:49.164131+0000","last_unstale":"2024-09-13T23:07:38.077521+0000","last_undegraded":"2024-09-13T23:07:38.077521+0000","last_fullsized":"2024-09-13T23:07:38.077521+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:24.539346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.227909+0000","last_change":"2024-09-13T23:05:12.116495+0000","last_active":"2024-09-13T23:08:22.227909+0000","last_peered":"2024-09-13T23:08:22.227909+0000","last_clean":"2024-09-13T23:08:22.227909+0000","last_became_active":"2024-09-13T23:05:12.114343+0000","last_became_peered":"2024-09-13T23:05:12.114343+0000","last_unstale":"2024-09-13T23:08:22.227909+0000","last_undegraded":"2024-09-13T23:08:22.227909+0000","last_fullsized":"2024-09-13T23:08:22.227909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:32:52.891315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.162345+0000","last_change":"2024-09-13T23:05:49.160922+0000","last_active":"2024-09-13T23:05:49.162345+0000","last_peered":"2024-09-13T23:05:49.162345+0000","last_clean":"2024-09-13T23:05:49.162345+0000","last_became_active":"2024-09-13T23:05:49.160578+0000","last_became_peered":"2024-09-13T23:05:49.160578+0000","last_unstale":"2024-09-13T23:05:49.162345+0000","last_undegraded":"2024-09-13T23:05:49.162345+0000","last_fullsized":"2024-09-13T23:05:49.162345+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:35:20.664758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.511579+0000","last_change":"2024-09-13T23:05:18.121852+0000","last_active":"2024-09-13T23:08:21.511579+0000","last_peered":"2024-09-13T23:08:21.511579+0000","last_clean":"2024-09-13T23:08:21.511579+0000","last_became_active":"2024-09-13T23:05:18.121514+0000","last_became_peered":"2024-09-13T23:05:18.121514+0000","last_unstale":"2024-09-13T23:08:21.511579+0000","last_undegraded":"2024-09-13T23:08:21.511579+0000","last_fullsized":"2024-09-13T23:08:21.511579+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:00.097701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.152954+0000","last_change":"2024-09-13T23:05:20.140562+0000","last_active":"2024-09-13T23:05:49.152954+0000","last_peered":"2024-09-13T23:05:49.152954+0000","last_clean":"2024-09-13T23:05:49.152954+0000","last_became_active":"2024-09-13T23:05:20.140290+0000","last_became_peered":"2024-09-13T23:05:20.140290+0000","last_unstale":"2024-09-13T23:05:49.152954+0000","last_undegraded":"2024-09-13T23:05:49.152954+0000","last_fullsized":"2024-09-13T23:05:49.152954+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:10.783457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159676+0000","last_change":"2024-09-13T23:05:22.141270+0000","last_active":"2024-09-13T23:05:49.159676+0000","last_peered":"2024-09-13T23:05:49.159676+0000","last_clean":"2024-09-13T23:05:49.159676+0000","last_became_active":"2024-09-13T23:05:22.140963+0000","last_became_peered":"2024-09-13T23:05:22.140963+0000","last_unstale":"2024-09-13T23:05:49.159676+0000","last_undegraded":"2024-09-13T23:05:49.159676+0000","last_fullsized":"2024-09-13T23:05:49.159676+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:59.821393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.485370+0000","last_change":"2024-09-13T23:05:14.120821+0000","last_active":"2024-09-13T23:07:21.485370+0000","last_peered":"2024-09-13T23:07:21.485370+0000","last_clean":"2024-09-13T23:07:21.485370+0000","last_became_active":"2024-09-13T23:05:14.120354+0000","last_became_peered":"2024-09-13T23:05:14.120354+0000","last_unstale":"2024-09-13T23:07:21.485370+0000","last_undegraded":"2024-09-13T23:07:21.485370+0000","last_fullsized":"2024-09-13T23:07:21.485370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:55.219034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158478+0000","last_change":"2024-09-13T23:05:12.117147+0000","last_active":"2024-09-13T23:05:49.158478+0000","last_peered":"2024-09-13T23:05:49.158478+0000","last_clean":"2024-09-13T23:05:49.158478+0000","last_became_active":"2024-09-13T23:05:12.116819+0000","last_became_peered":"2024-09-13T23:05:12.116819+0000","last_unstale":"2024-09-13T23:05:49.158478+0000","last_undegraded":"2024-09-13T23:05:49.158478+0000","last_fullsized":"2024-09-13T23:05:49.158478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:23:49.530592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.152948+0000","last_change":"2024-09-13T23:05:16.124923+0000","last_active":"2024-09-13T23:05:49.152948+0000","last_peered":"2024-09-13T23:05:49.152948+0000","last_clean":"2024-09-13T23:05:49.152948+0000","last_became_active":"2024-09-13T23:05:16.124617+0000","last_became_peered":"2024-09-13T23:05:16.124617+0000","last_unstale":"2024-09-13T23:05:49.152948+0000","last_undegraded":"2024-09-13T23:05:49.152948+0000","last_fullsized":"2024-09-13T23:05:49.152948+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:44.922754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'40","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.638205+0000","last_change":"2024-09-13T23:05:18.126438+0000","last_active":"2024-09-13T23:08:21.638205+0000","last_peered":"2024-09-13T23:08:21.638205+0000","last_clean":"2024-09-13T23:08:21.638205+0000","last_became_active":"2024-09-13T23:05:18.126147+0000","last_became_peered":"2024-09-13T23:05:18.126147+0000","last_unstale":"2024-09-13T23:08:21.638205+0000","last_undegraded":"2024-09-13T23:08:21.638205+0000","last_fullsized":"2024-09-13T23:08:21.638205+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:02:19.823621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158713+0000","last_change":"2024-09-13T23:05:20.129082+0000","last_active":"2024-09-13T23:05:49.158713+0000","last_peered":"2024-09-13T23:05:49.158713+0000","last_clean":"2024-09-13T23:05:49.158713+0000","last_became_active":"2024-09-13T23:05:20.128756+0000","last_became_peered":"2024-09-13T23:05:20.128756+0000","last_unstale":"2024-09-13T23:05:49.158713+0000","last_undegraded":"2024-09-13T23:05:49.158713+0000","last_fullsized":"2024-09-13T23:05:49.158713+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:31.349343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157781+0000","last_change":"2024-09-13T23:05:22.144728+0000","last_active":"2024-09-13T23:05:49.157781+0000","last_peered":"2024-09-13T23:05:49.157781+0000","last_clean":"2024-09-13T23:05:49.157781+0000","last_became_active":"2024-09-13T23:05:22.143767+0000","last_became_peered":"2024-09-13T23:05:22.143767+0000","last_unstale":"2024-09-13T23:05:49.157781+0000","last_undegraded":"2024-09-13T23:05:49.157781+0000","last_fullsized":"2024-09-13T23:05:49.157781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:26.361850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157765+0000","last_change":"2024-09-13T23:05:14.127475+0000","last_active":"2024-09-13T23:05:49.157765+0000","last_peered":"2024-09-13T23:05:49.157765+0000","last_clean":"2024-09-13T23:05:49.157765+0000","last_became_active":"2024-09-13T23:05:14.127000+0000","last_became_peered":"2024-09-13T23:05:14.127000+0000","last_unstale":"2024-09-13T23:05:49.157765+0000","last_undegraded":"2024-09-13T23:05:49.157765+0000","last_fullsized":"2024-09-13T23:05:49.157765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:10:50.930163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158496+0000","last_change":"2024-09-13T23:05:12.136754+0000","last_active":"2024-09-13T23:05:49.158496+0000","last_peered":"2024-09-13T23:05:49.158496+0000","last_clean":"2024-09-13T23:05:49.158496+0000","last_became_active":"2024-09-13T23:05:12.136384+0000","last_became_peered":"2024-09-13T23:05:12.136384+0000","last_unstale":"2024-09-13T23:05:49.158496+0000","last_undegraded":"2024-09-13T23:05:49.158496+0000","last_fullsized":"2024-09-13T23:05:49.158496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:43.763766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155297+0000","last_change":"2024-09-13T23:05:16.124513+0000","last_active":"2024-09-13T23:05:49.155297+0000","last_peered":"2024-09-13T23:05:49.155297+0000","last_clean":"2024-09-13T23:05:49.155297+0000","last_became_active":"2024-09-13T23:05:16.124241+0000","last_became_peered":"2024-09-13T23:05:16.124241+0000","last_unstale":"2024-09-13T23:05:49.155297+0000","last_undegraded":"2024-09-13T23:05:49.155297+0000","last_fullsized":"2024-09-13T23:05:49.155297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:03:40.217865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'31","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.487313+0000","last_change":"2024-09-13T23:05:18.126644+0000","last_active":"2024-09-13T23:07:21.487313+0000","last_peered":"2024-09-13T23:07:21.487313+0000","last_clean":"2024-09-13T23:07:21.487313+0000","last_became_active":"2024-09-13T23:05:18.126188+0000","last_became_peered":"2024-09-13T23:05:18.126188+0000","last_unstale":"2024-09-13T23:07:21.487313+0000","last_undegraded":"2024-09-13T23:07:21.487313+0000","last_fullsized":"2024-09-13T23:07:21.487313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:56.228755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.153697+0000","last_change":"2024-09-13T23:05:20.136386+0000","last_active":"2024-09-13T23:05:49.153697+0000","last_peered":"2024-09-13T23:05:49.153697+0000","last_clean":"2024-09-13T23:05:49.153697+0000","last_became_active":"2024-09-13T23:05:20.136098+0000","last_became_peered":"2024-09-13T23:05:20.136098+0000","last_unstale":"2024-09-13T23:05:49.153697+0000","last_undegraded":"2024-09-13T23:05:49.153697+0000","last_fullsized":"2024-09-13T23:05:49.153697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:47:24.641764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'14","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.321638+0000","last_change":"2024-09-13T23:05:14.113061+0000","last_active":"2024-09-13T23:08:22.321638+0000","last_peered":"2024-09-13T23:08:22.321638+0000","last_clean":"2024-09-13T23:08:22.321638+0000","last_became_active":"2024-09-13T23:05:14.112822+0000","last_became_peered":"2024-09-13T23:05:14.112822+0000","last_unstale":"2024-09-13T23:08:22.321638+0000","last_undegraded":"2024-09-13T23:08:22.321638+0000","last_fullsized":"2024-09-13T23:08:22.321638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:52:37.741998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:53.841518+0000","last_change":"2024-09-13T23:05:12.143550+0000","last_active":"2024-09-13T23:05:53.841518+0000","last_peered":"2024-09-13T23:05:53.841518+0000","last_clean":"2024-09-13T23:05:53.841518+0000","last_became_active":"2024-09-13T23:05:12.141970+0000","last_became_peered":"2024-09-13T23:05:12.141970+0000","last_unstale":"2024-09-13T23:05:53.841518+0000","last_undegraded":"2024-09-13T23:05:53.841518+0000","last_fullsized":"2024-09-13T23:05:53.841518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:20.698878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160495+0000","last_change":"2024-09-13T23:05:16.120920+0000","last_active":"2024-09-13T23:05:49.160495+0000","last_peered":"2024-09-13T23:05:49.160495+0000","last_clean":"2024-09-13T23:05:49.160495+0000","last_became_active":"2024-09-13T23:05:16.120506+0000","last_became_peered":"2024-09-13T23:05:16.120506+0000","last_unstale":"2024-09-13T23:05:49.160495+0000","last_undegraded":"2024-09-13T23:05:49.160495+0000","last_fullsized":"2024-09-13T23:05:49.160495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:05.377747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'56","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.735394+0000","last_change":"2024-09-13T23:05:18.127151+0000","last_active":"2024-09-13T23:07:19.735394+0000","last_peered":"2024-09-13T23:07:19.735394+0000","last_clean":"2024-09-13T23:07:19.735394+0000","last_became_active":"2024-09-13T23:05:18.126811+0000","last_became_peered":"2024-09-13T23:05:18.126811+0000","last_unstale":"2024-09-13T23:07:19.735394+0000","last_undegraded":"2024-09-13T23:07:19.735394+0000","last_fullsized":"2024-09-13T23:07:19.735394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:48.016939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":61,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.154053+0000","last_change":"2024-09-13T23:05:20.136237+0000","last_active":"2024-09-13T23:05:49.154053+0000","last_peered":"2024-09-13T23:05:49.154053+0000","last_clean":"2024-09-13T23:05:49.154053+0000","last_became_active":"2024-09-13T23:05:20.135886+0000","last_became_peered":"2024-09-13T23:05:20.135886+0000","last_unstale":"2024-09-13T23:05:49.154053+0000","last_undegraded":"2024-09-13T23:05:49.154053+0000","last_fullsized":"2024-09-13T23:05:49.154053+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:48:40.909454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.325312+0000","last_change":"2024-09-13T23:05:22.147716+0000","last_active":"2024-09-13T23:08:22.325312+0000","last_peered":"2024-09-13T23:08:22.325312+0000","last_clean":"2024-09-13T23:08:22.325312+0000","last_became_active":"2024-09-13T23:05:22.147394+0000","last_became_peered":"2024-09-13T23:05:22.147394+0000","last_unstale":"2024-09-13T23:08:22.325312+0000","last_undegraded":"2024-09-13T23:08:22.325312+0000","last_fullsized":"2024-09-13T23:08:22.325312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:04:57.442372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362850+0000","last_change":"2024-09-13T23:05:14.121676+0000","last_active":"2024-09-13T23:08:22.362850+0000","last_peered":"2024-09-13T23:08:22.362850+0000","last_clean":"2024-09-13T23:08:22.362850+0000","last_became_active":"2024-09-13T23:05:14.121349+0000","last_became_peered":"2024-09-13T23:05:14.121349+0000","last_unstale":"2024-09-13T23:08:22.362850+0000","last_undegraded":"2024-09-13T23:08:22.362850+0000","last_fullsized":"2024-09-13T23:08:22.362850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:57:39.861849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156531+0000","last_change":"2024-09-13T23:05:12.139567+0000","last_active":"2024-09-13T23:05:49.156531+0000","last_peered":"2024-09-13T23:05:49.156531+0000","last_clean":"2024-09-13T23:05:49.156531+0000","last_became_active":"2024-09-13T23:05:12.137092+0000","last_became_peered":"2024-09-13T23:05:12.137092+0000","last_unstale":"2024-09-13T23:05:49.156531+0000","last_undegraded":"2024-09-13T23:05:49.156531+0000","last_fullsized":"2024-09-13T23:05:49.156531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:26.997997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.161054+0000","last_change":"2024-09-13T23:05:16.121760+0000","last_active":"2024-09-13T23:05:49.161054+0000","last_peered":"2024-09-13T23:05:49.161054+0000","last_clean":"2024-09-13T23:05:49.161054+0000","last_became_active":"2024-09-13T23:05:16.121476+0000","last_became_peered":"2024-09-13T23:05:16.121476+0000","last_unstale":"2024-09-13T23:05:49.161054+0000","last_undegraded":"2024-09-13T23:05:49.161054+0000","last_fullsized":"2024-09-13T23:05:49.161054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:26:03.131986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.715418+0000","last_change":"2024-09-13T23:05:18.132726+0000","last_active":"2024-09-13T23:07:19.715418+0000","last_peered":"2024-09-13T23:07:19.715418+0000","last_clean":"2024-09-13T23:07:19.715418+0000","last_became_active":"2024-09-13T23:05:18.132060+0000","last_became_peered":"2024-09-13T23:05:18.132060+0000","last_unstale":"2024-09-13T23:07:19.715418+0000","last_undegraded":"2024-09-13T23:07:19.715418+0000","last_fullsized":"2024-09-13T23:07:19.715418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:03.383636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155314+0000","last_change":"2024-09-13T23:05:20.140626+0000","last_active":"2024-09-13T23:05:49.155314+0000","last_peered":"2024-09-13T23:05:49.155314+0000","last_clean":"2024-09-13T23:05:49.155314+0000","last_became_active":"2024-09-13T23:05:20.140333+0000","last_became_peered":"2024-09-13T23:05:20.140333+0000","last_unstale":"2024-09-13T23:05:49.155314+0000","last_undegraded":"2024-09-13T23:05:49.155314+0000","last_fullsized":"2024-09-13T23:05:49.155314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:54:01.951032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155007+0000","last_change":"2024-09-13T23:05:22.140239+0000","last_active":"2024-09-13T23:05:49.155007+0000","last_peered":"2024-09-13T23:05:49.155007+0000","last_clean":"2024-09-13T23:05:49.155007+0000","last_became_active":"2024-09-13T23:05:22.139984+0000","last_became_peered":"2024-09-13T23:05:22.139984+0000","last_unstale":"2024-09-13T23:05:49.155007+0000","last_undegraded":"2024-09-13T23:05:49.155007+0000","last_fullsized":"2024-09-13T23:05:49.155007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:58.124207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362755+0000","last_change":"2024-09-13T23:05:14.125224+0000","last_active":"2024-09-13T23:08:22.362755+0000","last_peered":"2024-09-13T23:08:22.362755+0000","last_clean":"2024-09-13T23:08:22.362755+0000","last_became_active":"2024-09-13T23:05:14.124660+0000","last_became_peered":"2024-09-13T23:05:14.124660+0000","last_unstale":"2024-09-13T23:08:22.362755+0000","last_undegraded":"2024-09-13T23:08:22.362755+0000","last_fullsized":"2024-09-13T23:08:22.362755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:48.609572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159133+0000","last_change":"2024-09-13T23:05:12.141582+0000","last_active":"2024-09-13T23:05:49.159133+0000","last_peered":"2024-09-13T23:05:49.159133+0000","last_clean":"2024-09-13T23:05:49.159133+0000","last_became_active":"2024-09-13T23:05:12.137136+0000","last_became_peered":"2024-09-13T23:05:12.137136+0000","last_unstale":"2024-09-13T23:05:49.159133+0000","last_undegraded":"2024-09-13T23:05:49.159133+0000","last_fullsized":"2024-09-13T23:05:49.159133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:20.740109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157357+0000","last_change":"2024-09-13T23:05:16.123946+0000","last_active":"2024-09-13T23:05:49.157357+0000","last_peered":"2024-09-13T23:05:49.157357+0000","last_clean":"2024-09-13T23:05:49.157357+0000","last_became_active":"2024-09-13T23:05:16.123607+0000","last_became_peered":"2024-09-13T23:05:16.123607+0000","last_unstale":"2024-09-13T23:05:49.157357+0000","last_undegraded":"2024-09-13T23:05:49.157357+0000","last_fullsized":"2024-09-13T23:05:49.157357+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:28.671096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'32","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.733164+0000","last_change":"2024-09-13T23:05:18.136609+0000","last_active":"2024-09-13T23:07:19.733164+0000","last_peered":"2024-09-13T23:07:19.733164+0000","last_clean":"2024-09-13T23:07:19.733164+0000","last_became_active":"2024-09-13T23:05:18.136279+0000","last_became_peered":"2024-09-13T23:05:18.136279+0000","last_unstale":"2024-09-13T23:07:19.733164+0000","last_undegraded":"2024-09-13T23:07:19.733164+0000","last_fullsized":"2024-09-13T23:07:19.733164+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:59.720739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160101+0000","last_change":"2024-09-13T23:05:20.141584+0000","last_active":"2024-09-13T23:05:49.160101+0000","last_peered":"2024-09-13T23:05:49.160101+0000","last_clean":"2024-09-13T23:05:49.160101+0000","last_became_active":"2024-09-13T23:05:20.141266+0000","last_became_peered":"2024-09-13T23:05:20.141266+0000","last_unstale":"2024-09-13T23:05:49.160101+0000","last_undegraded":"2024-09-13T23:05:49.160101+0000","last_fullsized":"2024-09-13T23:05:49.160101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:54:01.951032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'9","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.481681+0000","last_change":"2024-09-13T23:05:22.151767+0000","last_active":"2024-09-13T23:07:21.481681+0000","last_peered":"2024-09-13T23:07:21.481681+0000","last_clean":"2024-09-13T23:07:21.481681+0000","last_became_active":"2024-09-13T23:05:22.151339+0000","last_became_peered":"2024-09-13T23:05:22.151339+0000","last_unstale":"2024-09-13T23:07:21.481681+0000","last_undegraded":"2024-09-13T23:07:21.481681+0000","last_fullsized":"2024-09-13T23:07:21.481681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:27:36.638035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.322085+0000","last_change":"2024-09-13T23:05:14.112792+0000","last_active":"2024-09-13T23:08:22.322085+0000","last_peered":"2024-09-13T23:08:22.322085+0000","last_clean":"2024-09-13T23:08:22.322085+0000","last_became_active":"2024-09-13T23:05:14.112175+0000","last_became_peered":"2024-09-13T23:05:14.112175+0000","last_unstale":"2024-09-13T23:08:22.322085+0000","last_undegraded":"2024-09-13T23:08:22.322085+0000","last_fullsized":"2024-09-13T23:08:22.322085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:39.333340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159759+0000","last_change":"2024-09-13T23:05:12.141910+0000","last_active":"2024-09-13T23:05:49.159759+0000","last_peered":"2024-09-13T23:05:49.159759+0000","last_clean":"2024-09-13T23:05:49.159759+0000","last_became_active":"2024-09-13T23:05:12.141459+0000","last_became_peered":"2024-09-13T23:05:12.141459+0000","last_unstale":"2024-09-13T23:05:49.159759+0000","last_undegraded":"2024-09-13T23:05:49.159759+0000","last_fullsized":"2024-09-13T23:05:49.159759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:48.232382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"34'4","reported_seq":226,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:20.828655+0000","last_change":"2024-09-13T23:05:16.118050+0000","last_active":"2024-09-13T23:07:20.828655+0000","last_peered":"2024-09-13T23:07:20.828655+0000","last_clean":"2024-09-13T23:07:20.828655+0000","last_became_active":"2024-09-13T23:05:16.117736+0000","last_became_peered":"2024-09-13T23:05:16.117736+0000","last_unstale":"2024-09-13T23:07:20.828655+0000","last_undegraded":"2024-09-13T23:07:20.828655+0000","last_fullsized":"2024-09-13T23:07:20.828655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:34:57.565004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.163113+0000","last_change":"2024-09-13T23:05:18.133743+0000","last_active":"2024-09-13T23:05:49.163113+0000","last_peered":"2024-09-13T23:05:49.163113+0000","last_clean":"2024-09-13T23:05:49.163113+0000","last_became_active":"2024-09-13T23:05:18.132507+0000","last_became_peered":"2024-09-13T23:05:18.132507+0000","last_unstale":"2024-09-13T23:05:49.163113+0000","last_undegraded":"2024-09-13T23:05:49.163113+0000","last_fullsized":"2024-09-13T23:05:49.163113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:25:07.613170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":417,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.367435+0000","last_change":"2024-09-13T23:05:20.144647+0000","last_active":"2024-09-13T23:08:22.367435+0000","last_peered":"2024-09-13T23:08:22.367435+0000","last_clean":"2024-09-13T23:08:22.367435+0000","last_became_active":"2024-09-13T23:05:20.144334+0000","last_became_peered":"2024-09-13T23:05:20.144334+0000","last_unstale":"2024-09-13T23:08:22.367435+0000","last_undegraded":"2024-09-13T23:08:22.367435+0000","last_fullsized":"2024-09-13T23:08:22.367435+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:55.153699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156789+0000","last_change":"2024-09-13T23:05:22.149167+0000","last_active":"2024-09-13T23:05:49.156789+0000","last_peered":"2024-09-13T23:05:49.156789+0000","last_clean":"2024-09-13T23:05:49.156789+0000","last_became_active":"2024-09-13T23:05:22.148894+0000","last_became_peered":"2024-09-13T23:05:22.148894+0000","last_unstale":"2024-09-13T23:05:49.156789+0000","last_undegraded":"2024-09-13T23:05:49.156789+0000","last_fullsized":"2024-09-13T23:05:49.156789+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:15.779050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.469692+0000","last_change":"2024-09-13T23:05:14.112197+0000","last_active":"2024-09-13T23:08:22.469692+0000","last_peered":"2024-09-13T23:08:22.469692+0000","last_clean":"2024-09-13T23:08:22.469692+0000","last_became_active":"2024-09-13T23:05:14.111891+0000","last_became_peered":"2024-09-13T23:05:14.111891+0000","last_unstale":"2024-09-13T23:08:22.469692+0000","last_undegraded":"2024-09-13T23:08:22.469692+0000","last_fullsized":"2024-09-13T23:08:22.469692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:22.016474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158445+0000","last_change":"2024-09-13T23:05:12.139920+0000","last_active":"2024-09-13T23:05:49.158445+0000","last_peered":"2024-09-13T23:05:49.158445+0000","last_clean":"2024-09-13T23:05:49.158445+0000","last_became_active":"2024-09-13T23:05:12.139564+0000","last_became_peered":"2024-09-13T23:05:12.139564+0000","last_unstale":"2024-09-13T23:05:49.158445+0000","last_undegraded":"2024-09-13T23:05:49.158445+0000","last_fullsized":"2024-09-13T23:05:49.158445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:48:38.750102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158925+0000","last_change":"2024-09-13T23:05:16.118845+0000","last_active":"2024-09-13T23:05:49.158925+0000","last_peered":"2024-09-13T23:05:49.158925+0000","last_clean":"2024-09-13T23:05:49.158925+0000","last_became_active":"2024-09-13T23:05:16.118353+0000","last_became_peered":"2024-09-13T23:05:16.118353+0000","last_unstale":"2024-09-13T23:05:49.158925+0000","last_undegraded":"2024-09-13T23:05:49.158925+0000","last_fullsized":"2024-09-13T23:05:49.158925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:58.090312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.706353+0000","last_change":"2024-09-13T23:05:18.129142+0000","last_active":"2024-09-13T23:07:19.706353+0000","last_peered":"2024-09-13T23:07:19.706353+0000","last_clean":"2024-09-13T23:07:19.706353+0000","last_became_active":"2024-09-13T23:05:18.127975+0000","last_became_peered":"2024-09-13T23:05:18.127975+0000","last_unstale":"2024-09-13T23:07:19.706353+0000","last_undegraded":"2024-09-13T23:07:19.706353+0000","last_fullsized":"2024-09-13T23:07:19.706353+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:19:28.546902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158396+0000","last_change":"2024-09-13T23:05:20.139596+0000","last_active":"2024-09-13T23:05:49.158396+0000","last_peered":"2024-09-13T23:05:49.158396+0000","last_clean":"2024-09-13T23:05:49.158396+0000","last_became_active":"2024-09-13T23:05:20.139329+0000","last_became_peered":"2024-09-13T23:05:20.139329+0000","last_unstale":"2024-09-13T23:05:49.158396+0000","last_undegraded":"2024-09-13T23:05:49.158396+0000","last_fullsized":"2024-09-13T23:05:49.158396+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:14.460878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159092+0000","last_change":"2024-09-13T23:05:22.148249+0000","last_active":"2024-09-13T23:05:49.159092+0000","last_peered":"2024-09-13T23:05:49.159092+0000","last_clean":"2024-09-13T23:05:49.159092+0000","last_became_active":"2024-09-13T23:05:22.147949+0000","last_became_peered":"2024-09-13T23:05:22.147949+0000","last_unstale":"2024-09-13T23:05:49.159092+0000","last_undegraded":"2024-09-13T23:05:49.159092+0000","last_fullsized":"2024-09-13T23:05:49.159092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:07.578205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:55.392471+0000","last_change":"2024-09-13T23:05:14.114061+0000","last_active":"2024-09-13T23:05:55.392471+0000","last_peered":"2024-09-13T23:05:55.392471+0000","last_clean":"2024-09-13T23:05:55.392471+0000","last_became_active":"2024-09-13T23:05:14.113816+0000","last_became_peered":"2024-09-13T23:05:14.113816+0000","last_unstale":"2024-09-13T23:05:55.392471+0000","last_undegraded":"2024-09-13T23:05:55.392471+0000","last_fullsized":"2024-09-13T23:05:55.392471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:31:40.142550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.162049+0000","last_change":"2024-09-13T23:05:12.149692+0000","last_active":"2024-09-13T23:05:49.162049+0000","last_peered":"2024-09-13T23:05:49.162049+0000","last_clean":"2024-09-13T23:05:49.162049+0000","last_became_active":"2024-09-13T23:05:12.149292+0000","last_became_peered":"2024-09-13T23:05:12.149292+0000","last_unstale":"2024-09-13T23:05:49.162049+0000","last_undegraded":"2024-09-13T23:05:49.162049+0000","last_fullsized":"2024-09-13T23:05:49.162049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:05:07.956349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155102+0000","last_change":"2024-09-13T23:05:16.128264+0000","last_active":"2024-09-13T23:05:49.155102+0000","last_peered":"2024-09-13T23:05:49.155102+0000","last_clean":"2024-09-13T23:05:49.155102+0000","last_became_active":"2024-09-13T23:05:16.128023+0000","last_became_peered":"2024-09-13T23:05:16.128023+0000","last_unstale":"2024-09-13T23:05:49.155102+0000","last_undegraded":"2024-09-13T23:05:49.155102+0000","last_fullsized":"2024-09-13T23:05:49.155102+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:29.344309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.707477+0000","last_change":"2024-09-13T23:05:18.132864+0000","last_active":"2024-09-13T23:07:19.707477+0000","last_peered":"2024-09-13T23:07:19.707477+0000","last_clean":"2024-09-13T23:07:19.707477+0000","last_became_active":"2024-09-13T23:05:18.132579+0000","last_became_peered":"2024-09-13T23:05:18.132579+0000","last_unstale":"2024-09-13T23:07:19.707477+0000","last_undegraded":"2024-09-13T23:07:19.707477+0000","last_fullsized":"2024-09-13T23:07:19.707477+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:26.946305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.154964+0000","last_change":"2024-09-13T23:05:20.136330+0000","last_active":"2024-09-13T23:05:49.154964+0000","last_peered":"2024-09-13T23:05:49.154964+0000","last_clean":"2024-09-13T23:05:49.154964+0000","last_became_active":"2024-09-13T23:05:20.136023+0000","last_became_peered":"2024-09-13T23:05:20.136023+0000","last_unstale":"2024-09-13T23:05:49.154964+0000","last_undegraded":"2024-09-13T23:05:49.154964+0000","last_fullsized":"2024-09-13T23:05:49.154964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:54.602234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.162874+0000","last_change":"2024-09-13T23:05:22.149740+0000","last_active":"2024-09-13T23:05:49.162874+0000","last_peered":"2024-09-13T23:05:49.162874+0000","last_clean":"2024-09-13T23:05:49.162874+0000","last_became_active":"2024-09-13T23:05:22.149468+0000","last_became_peered":"2024-09-13T23:05:22.149468+0000","last_unstale":"2024-09-13T23:05:49.162874+0000","last_undegraded":"2024-09-13T23:05:49.162874+0000","last_fullsized":"2024-09-13T23:05:49.162874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:05.061174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079088+0000","last_change":"2024-09-13T23:05:14.109581+0000","last_active":"2024-09-13T23:07:42.079088+0000","last_peered":"2024-09-13T23:07:42.079088+0000","last_clean":"2024-09-13T23:07:42.079088+0000","last_became_active":"2024-09-13T23:05:14.109323+0000","last_became_peered":"2024-09-13T23:05:14.109323+0000","last_unstale":"2024-09-13T23:07:42.079088+0000","last_undegraded":"2024-09-13T23:07:42.079088+0000","last_fullsized":"2024-09-13T23:07:42.079088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:09.879028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160689+0000","last_change":"2024-09-13T23:05:12.121655+0000","last_active":"2024-09-13T23:05:49.160689+0000","last_peered":"2024-09-13T23:05:49.160689+0000","last_clean":"2024-09-13T23:05:49.160689+0000","last_became_active":"2024-09-13T23:05:12.121050+0000","last_became_peered":"2024-09-13T23:05:12.121050+0000","last_unstale":"2024-09-13T23:05:49.160689+0000","last_undegraded":"2024-09-13T23:05:49.160689+0000","last_fullsized":"2024-09-13T23:05:49.160689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:12.628284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"25'1","reported_seq":218,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:20.838539+0000","last_change":"2024-09-13T23:05:16.123977+0000","last_active":"2024-09-13T23:07:20.838539+0000","last_peered":"2024-09-13T23:07:20.838539+0000","last_clean":"2024-09-13T23:07:20.838539+0000","last_became_active":"2024-09-13T23:05:16.123673+0000","last_became_peered":"2024-09-13T23:05:16.123673+0000","last_unstale":"2024-09-13T23:07:20.838539+0000","last_undegraded":"2024-09-13T23:07:20.838539+0000","last_fullsized":"2024-09-13T23:07:20.838539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:04.185929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'26","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.731194+0000","last_change":"2024-09-13T23:05:18.134891+0000","last_active":"2024-09-13T23:07:19.731194+0000","last_peered":"2024-09-13T23:07:19.731194+0000","last_clean":"2024-09-13T23:07:19.731194+0000","last_became_active":"2024-09-13T23:05:18.134152+0000","last_became_peered":"2024-09-13T23:05:18.134152+0000","last_unstale":"2024-09-13T23:07:19.731194+0000","last_undegraded":"2024-09-13T23:07:19.731194+0000","last_fullsized":"2024-09-13T23:07:19.731194+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:38.762106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155513+0000","last_change":"2024-09-13T23:05:20.139704+0000","last_active":"2024-09-13T23:05:49.155513+0000","last_peered":"2024-09-13T23:05:49.155513+0000","last_clean":"2024-09-13T23:05:49.155513+0000","last_became_active":"2024-09-13T23:05:20.139133+0000","last_became_peered":"2024-09-13T23:05:20.139133+0000","last_unstale":"2024-09-13T23:05:49.155513+0000","last_undegraded":"2024-09-13T23:05:49.155513+0000","last_fullsized":"2024-09-13T23:05:49.155513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:54.483387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'12","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.740945+0000","last_change":"2024-09-13T23:05:22.144173+0000","last_active":"2024-09-13T23:07:19.740945+0000","last_peered":"2024-09-13T23:07:19.740945+0000","last_clean":"2024-09-13T23:07:19.740945+0000","last_became_active":"2024-09-13T23:05:22.143886+0000","last_became_peered":"2024-09-13T23:05:22.143886+0000","last_unstale":"2024-09-13T23:07:19.740945+0000","last_undegraded":"2024-09-13T23:07:19.740945+0000","last_fullsized":"2024-09-13T23:07:19.740945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:32.073594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":59,"num_write":33,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:55.392329+0000","last_change":"2024-09-13T23:05:14.112092+0000","last_active":"2024-09-13T23:05:55.392329+0000","last_peered":"2024-09-13T23:05:55.392329+0000","last_clean":"2024-09-13T23:05:55.392329+0000","last_became_active":"2024-09-13T23:05:14.111836+0000","last_became_peered":"2024-09-13T23:05:14.111836+0000","last_unstale":"2024-09-13T23:05:55.392329+0000","last_undegraded":"2024-09-13T23:05:55.392329+0000","last_fullsized":"2024-09-13T23:05:55.392329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:12:02.291251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159037+0000","last_change":"2024-09-13T23:05:12.135245+0000","last_active":"2024-09-13T23:05:49.159037+0000","last_peered":"2024-09-13T23:05:49.159037+0000","last_clean":"2024-09-13T23:05:49.159037+0000","last_became_active":"2024-09-13T23:05:12.134820+0000","last_became_peered":"2024-09-13T23:05:12.134820+0000","last_unstale":"2024-09-13T23:05:49.159037+0000","last_undegraded":"2024-09-13T23:05:49.159037+0000","last_fullsized":"2024-09-13T23:05:49.159037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:36.907610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:18.281573+0000","last_change":"2024-09-13T23:05:16.124579+0000","last_active":"2024-09-13T23:07:18.281573+0000","last_peered":"2024-09-13T23:07:18.281573+0000","last_clean":"2024-09-13T23:07:18.281573+0000","last_became_active":"2024-09-13T23:05:16.124295+0000","last_became_peered":"2024-09-13T23:05:16.124295+0000","last_unstale":"2024-09-13T23:07:18.281573+0000","last_undegraded":"2024-09-13T23:07:18.281573+0000","last_fullsized":"2024-09-13T23:07:18.281573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:53:47.490114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'32","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.512451+0000","last_change":"2024-09-13T23:05:18.132070+0000","last_active":"2024-09-13T23:08:21.512451+0000","last_peered":"2024-09-13T23:08:21.512451+0000","last_clean":"2024-09-13T23:08:21.512451+0000","last_became_active":"2024-09-13T23:05:18.131796+0000","last_became_peered":"2024-09-13T23:05:18.131796+0000","last_unstale":"2024-09-13T23:08:21.512451+0000","last_undegraded":"2024-09-13T23:08:21.512451+0000","last_fullsized":"2024-09-13T23:08:21.512451+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:56.183512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159253+0000","last_change":"2024-09-13T23:05:20.145706+0000","last_active":"2024-09-13T23:05:49.159253+0000","last_peered":"2024-09-13T23:05:49.159253+0000","last_clean":"2024-09-13T23:05:49.159253+0000","last_became_active":"2024-09-13T23:05:20.145356+0000","last_became_peered":"2024-09-13T23:05:20.145356+0000","last_unstale":"2024-09-13T23:05:49.159253+0000","last_undegraded":"2024-09-13T23:05:49.159253+0000","last_fullsized":"2024-09-13T23:05:49.159253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:54.194855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.743464+0000","last_change":"2024-09-13T23:05:22.147988+0000","last_active":"2024-09-13T23:07:19.743464+0000","last_peered":"2024-09-13T23:07:19.743464+0000","last_clean":"2024-09-13T23:07:19.743464+0000","last_became_active":"2024-09-13T23:05:22.147707+0000","last_became_peered":"2024-09-13T23:05:22.147707+0000","last_unstale":"2024-09-13T23:07:19.743464+0000","last_undegraded":"2024-09-13T23:07:19.743464+0000","last_fullsized":"2024-09-13T23:07:19.743464+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:27.322255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'16","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.250273+0000","last_change":"2024-09-13T23:05:14.123908+0000","last_active":"2024-09-13T23:08:22.250273+0000","last_peered":"2024-09-13T23:08:22.250273+0000","last_clean":"2024-09-13T23:08:22.250273+0000","last_became_active":"2024-09-13T23:05:14.123513+0000","last_became_peered":"2024-09-13T23:05:14.123513+0000","last_unstale":"2024-09-13T23:08:22.250273+0000","last_undegraded":"2024-09-13T23:08:22.250273+0000","last_fullsized":"2024-09-13T23:08:22.250273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:10.807036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.074649+0000","last_change":"2024-09-13T23:05:12.129469+0000","last_active":"2024-09-13T23:07:21.074649+0000","last_peered":"2024-09-13T23:07:21.074649+0000","last_clean":"2024-09-13T23:07:21.074649+0000","last_became_active":"2024-09-13T23:05:12.125740+0000","last_became_peered":"2024-09-13T23:05:12.125740+0000","last_unstale":"2024-09-13T23:07:21.074649+0000","last_undegraded":"2024-09-13T23:07:21.074649+0000","last_fullsized":"2024-09-13T23:07:21.074649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:29.212129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.322046+0000","last_change":"2024-09-13T23:05:14.110713+0000","last_active":"2024-09-13T23:08:22.322046+0000","last_peered":"2024-09-13T23:08:22.322046+0000","last_clean":"2024-09-13T23:08:22.322046+0000","last_became_active":"2024-09-13T23:05:14.109959+0000","last_became_peered":"2024-09-13T23:05:14.109959+0000","last_unstale":"2024-09-13T23:08:22.322046+0000","last_undegraded":"2024-09-13T23:08:22.322046+0000","last_fullsized":"2024-09-13T23:08:22.322046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:14:21.159008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.463371+0000","last_change":"2024-09-13T23:05:12.114302+0000","last_active":"2024-09-13T23:07:21.463371+0000","last_peered":"2024-09-13T23:07:21.463371+0000","last_clean":"2024-09-13T23:07:21.463371+0000","last_became_active":"2024-09-13T23:05:12.113972+0000","last_became_peered":"2024-09-13T23:05:12.113972+0000","last_unstale":"2024-09-13T23:07:21.463371+0000","last_undegraded":"2024-09-13T23:07:21.463371+0000","last_fullsized":"2024-09-13T23:07:21.463371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:48:38.750102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'10","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362921+0000","last_change":"2024-09-13T23:05:49.165777+0000","last_active":"2024-09-13T23:08:22.362921+0000","last_peered":"2024-09-13T23:08:22.362921+0000","last_clean":"2024-09-13T23:08:22.362921+0000","last_became_active":"2024-09-13T23:05:49.159488+0000","last_became_peered":"2024-09-13T23:05:49.159488+0000","last_unstale":"2024-09-13T23:08:22.362921+0000","last_undegraded":"2024-09-13T23:08:22.362921+0000","last_fullsized":"2024-09-13T23:08:22.362921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:40.422062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.966513+0000","last_change":"2024-09-13T23:05:12.140088+0000","last_active":"2024-09-13T23:08:21.966513+0000","last_peered":"2024-09-13T23:08:21.966513+0000","last_clean":"2024-09-13T23:08:21.966513+0000","last_became_active":"2024-09-13T23:05:12.139673+0000","last_became_peered":"2024-09-13T23:05:12.139673+0000","last_unstale":"2024-09-13T23:08:21.966513+0000","last_undegraded":"2024-09-13T23:08:21.966513+0000","last_fullsized":"2024-09-13T23:08:21.966513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:32:20.507188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'9","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.257272+0000","last_change":"2024-09-13T23:05:14.112656+0000","last_active":"2024-09-13T23:08:22.257272+0000","last_peered":"2024-09-13T23:08:22.257272+0000","last_clean":"2024-09-13T23:08:22.257272+0000","last_became_active":"2024-09-13T23:05:14.112168+0000","last_became_peered":"2024-09-13T23:05:14.112168+0000","last_unstale":"2024-09-13T23:08:22.257272+0000","last_undegraded":"2024-09-13T23:08:22.257272+0000","last_fullsized":"2024-09-13T23:08:22.257272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:08.501106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160289+0000","last_change":"2024-09-13T23:05:12.118979+0000","last_active":"2024-09-13T23:05:49.160289+0000","last_peered":"2024-09-13T23:05:49.160289+0000","last_clean":"2024-09-13T23:05:49.160289+0000","last_became_active":"2024-09-13T23:05:12.118425+0000","last_became_peered":"2024-09-13T23:05:12.118425+0000","last_unstale":"2024-09-13T23:05:49.160289+0000","last_undegraded":"2024-09-13T23:05:49.160289+0000","last_fullsized":"2024-09-13T23:05:49.160289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:36.907610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'14","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362935+0000","last_change":"2024-09-13T23:05:14.120992+0000","last_active":"2024-09-13T23:08:22.362935+0000","last_peered":"2024-09-13T23:08:22.362935+0000","last_clean":"2024-09-13T23:08:22.362935+0000","last_became_active":"2024-09-13T23:05:14.120456+0000","last_became_peered":"2024-09-13T23:05:14.120456+0000","last_unstale":"2024-09-13T23:08:22.362935+0000","last_undegraded":"2024-09-13T23:08:22.362935+0000","last_fullsized":"2024-09-13T23:08:22.362935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:33:19.901997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160111+0000","last_change":"2024-09-13T23:05:12.114509+0000","last_active":"2024-09-13T23:05:49.160111+0000","last_peered":"2024-09-13T23:05:49.160111+0000","last_clean":"2024-09-13T23:05:49.160111+0000","last_became_active":"2024-09-13T23:05:12.114046+0000","last_became_peered":"2024-09-13T23:05:12.114046+0000","last_unstale":"2024-09-13T23:05:49.160111+0000","last_undegraded":"2024-09-13T23:05:49.160111+0000","last_fullsized":"2024-09-13T23:05:49.160111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:04.782795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.161547+0000","last_change":"2024-09-13T23:05:14.124864+0000","last_active":"2024-09-13T23:05:49.161547+0000","last_peered":"2024-09-13T23:05:49.161547+0000","last_clean":"2024-09-13T23:05:49.161547+0000","last_became_active":"2024-09-13T23:05:14.123783+0000","last_became_peered":"2024-09-13T23:05:14.123783+0000","last_unstale":"2024-09-13T23:05:49.161547+0000","last_undegraded":"2024-09-13T23:05:49.161547+0000","last_fullsized":"2024-09-13T23:05:49.161547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:21.273774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.293717+0000","last_change":"2024-09-13T23:05:12.140004+0000","last_active":"2024-09-13T23:07:21.293717+0000","last_peered":"2024-09-13T23:07:21.293717+0000","last_clean":"2024-09-13T23:07:21.293717+0000","last_became_active":"2024-09-13T23:05:12.137465+0000","last_became_peered":"2024-09-13T23:05:12.137465+0000","last_unstale":"2024-09-13T23:07:21.293717+0000","last_undegraded":"2024-09-13T23:07:21.293717+0000","last_fullsized":"2024-09-13T23:07:21.293717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:29.788894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.701866+0000","last_change":"2024-09-13T23:05:14.121847+0000","last_active":"2024-09-13T23:05:54.701866+0000","last_peered":"2024-09-13T23:05:54.701866+0000","last_clean":"2024-09-13T23:05:54.701866+0000","last_became_active":"2024-09-13T23:05:14.121425+0000","last_became_peered":"2024-09-13T23:05:14.121425+0000","last_unstale":"2024-09-13T23:05:54.701866+0000","last_undegraded":"2024-09-13T23:05:54.701866+0000","last_fullsized":"2024-09-13T23:05:54.701866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:02.456301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158590+0000","last_change":"2024-09-13T23:05:12.116219+0000","last_active":"2024-09-13T23:05:49.158590+0000","last_peered":"2024-09-13T23:05:49.158590+0000","last_clean":"2024-09-13T23:05:49.158590+0000","last_became_active":"2024-09-13T23:05:12.115546+0000","last_became_peered":"2024-09-13T23:05:12.115546+0000","last_unstale":"2024-09-13T23:05:49.158590+0000","last_undegraded":"2024-09-13T23:05:49.158590+0000","last_fullsized":"2024-09-13T23:05:49.158590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:46.740162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.321747+0000","last_change":"2024-09-13T23:05:14.123460+0000","last_active":"2024-09-13T23:08:22.321747+0000","last_peered":"2024-09-13T23:08:22.321747+0000","last_clean":"2024-09-13T23:08:22.321747+0000","last_became_active":"2024-09-13T23:05:14.122944+0000","last_became_peered":"2024-09-13T23:05:14.122944+0000","last_unstale":"2024-09-13T23:08:22.321747+0000","last_undegraded":"2024-09-13T23:08:22.321747+0000","last_fullsized":"2024-09-13T23:08:22.321747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:27.479160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:24.072349+0000","last_change":"2024-09-13T23:05:12.119016+0000","last_active":"2024-09-13T23:07:24.072349+0000","last_peered":"2024-09-13T23:07:24.072349+0000","last_clean":"2024-09-13T23:07:24.072349+0000","last_became_active":"2024-09-13T23:05:12.118347+0000","last_became_peered":"2024-09-13T23:05:12.118347+0000","last_unstale":"2024-09-13T23:07:24.072349+0000","last_undegraded":"2024-09-13T23:07:24.072349+0000","last_fullsized":"2024-09-13T23:07:24.072349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:22.242350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.452882+0000","last_change":"2024-09-13T23:05:14.126164+0000","last_active":"2024-09-13T23:06:37.452882+0000","last_peered":"2024-09-13T23:06:37.452882+0000","last_clean":"2024-09-13T23:06:37.452882+0000","last_became_active":"2024-09-13T23:05:14.124593+0000","last_became_peered":"2024-09-13T23:05:14.124593+0000","last_unstale":"2024-09-13T23:06:37.452882+0000","last_undegraded":"2024-09-13T23:06:37.452882+0000","last_fullsized":"2024-09-13T23:06:37.452882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:44.195143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:22.075262+0000","last_change":"2024-09-13T23:05:12.144032+0000","last_active":"2024-09-13T23:07:22.075262+0000","last_peered":"2024-09-13T23:07:22.075262+0000","last_clean":"2024-09-13T23:07:22.075262+0000","last_became_active":"2024-09-13T23:05:12.141628+0000","last_became_peered":"2024-09-13T23:05:12.141628+0000","last_unstale":"2024-09-13T23:07:22.075262+0000","last_undegraded":"2024-09-13T23:07:22.075262+0000","last_fullsized":"2024-09-13T23:07:22.075262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:15.223430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.701817+0000","last_change":"2024-09-13T23:05:14.113960+0000","last_active":"2024-09-13T23:05:54.701817+0000","last_peered":"2024-09-13T23:05:54.701817+0000","last_clean":"2024-09-13T23:05:54.701817+0000","last_became_active":"2024-09-13T23:05:14.113710+0000","last_became_peered":"2024-09-13T23:05:14.113710+0000","last_unstale":"2024-09-13T23:05:54.701817+0000","last_undegraded":"2024-09-13T23:05:54.701817+0000","last_fullsized":"2024-09-13T23:05:54.701817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:34.129089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158574+0000","last_change":"2024-09-13T23:05:12.119408+0000","last_active":"2024-09-13T23:05:49.158574+0000","last_peered":"2024-09-13T23:05:49.158574+0000","last_clean":"2024-09-13T23:05:49.158574+0000","last_became_active":"2024-09-13T23:05:12.118716+0000","last_became_peered":"2024-09-13T23:05:12.118716+0000","last_unstale":"2024-09-13T23:05:49.158574+0000","last_undegraded":"2024-09-13T23:05:49.158574+0000","last_fullsized":"2024-09-13T23:05:49.158574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:51.066283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.263470+0000","last_change":"2024-09-13T23:05:14.120905+0000","last_active":"2024-09-13T23:06:37.263470+0000","last_peered":"2024-09-13T23:06:37.263470+0000","last_clean":"2024-09-13T23:06:37.263470+0000","last_became_active":"2024-09-13T23:05:14.120489+0000","last_became_peered":"2024-09-13T23:05:14.120489+0000","last_unstale":"2024-09-13T23:06:37.263470+0000","last_undegraded":"2024-09-13T23:06:37.263470+0000","last_fullsized":"2024-09-13T23:06:37.263470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:34.163619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.911022+0000","last_change":"2024-09-13T23:05:12.141835+0000","last_active":"2024-09-13T23:05:54.911022+0000","last_peered":"2024-09-13T23:05:54.911022+0000","last_clean":"2024-09-13T23:05:54.911022+0000","last_became_active":"2024-09-13T23:05:12.137735+0000","last_became_peered":"2024-09-13T23:05:12.137735+0000","last_unstale":"2024-09-13T23:05:54.911022+0000","last_undegraded":"2024-09-13T23:05:54.911022+0000","last_fullsized":"2024-09-13T23:05:54.911022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:14:55.200398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'3","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:33.076769+0000","last_change":"2024-09-13T23:05:14.122103+0000","last_active":"2024-09-13T23:07:33.076769+0000","last_peered":"2024-09-13T23:07:33.076769+0000","last_clean":"2024-09-13T23:07:33.076769+0000","last_became_active":"2024-09-13T23:05:14.121389+0000","last_became_peered":"2024-09-13T23:05:14.121389+0000","last_unstale":"2024-09-13T23:07:33.076769+0000","last_undegraded":"2024-09-13T23:07:33.076769+0000","last_fullsized":"2024-09-13T23:07:33.076769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:57:39.861849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155167+0000","last_change":"2024-09-13T23:05:12.139774+0000","last_active":"2024-09-13T23:05:49.155167+0000","last_peered":"2024-09-13T23:05:49.155167+0000","last_clean":"2024-09-13T23:05:49.155167+0000","last_became_active":"2024-09-13T23:05:12.137118+0000","last_became_peered":"2024-09-13T23:05:12.137118+0000","last_unstale":"2024-09-13T23:05:49.155167+0000","last_undegraded":"2024-09-13T23:05:49.155167+0000","last_fullsized":"2024-09-13T23:05:49.155167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:01:21.996979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362651+0000","last_change":"2024-09-13T23:05:14.125962+0000","last_active":"2024-09-13T23:08:22.362651+0000","last_peered":"2024-09-13T23:08:22.362651+0000","last_clean":"2024-09-13T23:08:22.362651+0000","last_became_active":"2024-09-13T23:05:14.124507+0000","last_became_peered":"2024-09-13T23:05:14.124507+0000","last_unstale":"2024-09-13T23:08:22.362651+0000","last_undegraded":"2024-09-13T23:08:22.362651+0000","last_fullsized":"2024-09-13T23:08:22.362651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:39.333340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160223+0000","last_change":"2024-09-13T23:05:12.138932+0000","last_active":"2024-09-13T23:05:49.160223+0000","last_peered":"2024-09-13T23:05:49.160223+0000","last_clean":"2024-09-13T23:05:49.160223+0000","last_became_active":"2024-09-13T23:05:12.138577+0000","last_became_peered":"2024-09-13T23:05:12.138577+0000","last_unstale":"2024-09-13T23:05:49.160223+0000","last_undegraded":"2024-09-13T23:05:49.160223+0000","last_fullsized":"2024-09-13T23:05:49.160223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:20.700653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.257347+0000","last_change":"2024-09-13T23:05:14.125069+0000","last_active":"2024-09-13T23:08:22.257347+0000","last_peered":"2024-09-13T23:08:22.257347+0000","last_clean":"2024-09-13T23:08:22.257347+0000","last_became_active":"2024-09-13T23:05:14.124604+0000","last_became_peered":"2024-09-13T23:05:14.124604+0000","last_unstale":"2024-09-13T23:08:22.257347+0000","last_undegraded":"2024-09-13T23:08:22.257347+0000","last_fullsized":"2024-09-13T23:08:22.257347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:41.404040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.162242+0000","last_change":"2024-09-13T23:05:12.141608+0000","last_active":"2024-09-13T23:05:49.162242+0000","last_peered":"2024-09-13T23:05:49.162242+0000","last_clean":"2024-09-13T23:05:49.162242+0000","last_became_active":"2024-09-13T23:05:12.140686+0000","last_became_peered":"2024-09-13T23:05:12.140686+0000","last_unstale":"2024-09-13T23:05:49.162242+0000","last_undegraded":"2024-09-13T23:05:49.162242+0000","last_fullsized":"2024-09-13T23:05:49.162242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:59:19.940880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156146+0000","last_change":"2024-09-13T23:05:14.126009+0000","last_active":"2024-09-13T23:05:49.156146+0000","last_peered":"2024-09-13T23:05:49.156146+0000","last_clean":"2024-09-13T23:05:49.156146+0000","last_became_active":"2024-09-13T23:05:14.125747+0000","last_became_peered":"2024-09-13T23:05:14.125747+0000","last_unstale":"2024-09-13T23:05:49.156146+0000","last_undegraded":"2024-09-13T23:05:49.156146+0000","last_fullsized":"2024-09-13T23:05:49.156146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:34:19.493607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158853+0000","last_change":"2024-09-13T23:05:12.126550+0000","last_active":"2024-09-13T23:05:49.158853+0000","last_peered":"2024-09-13T23:05:49.158853+0000","last_clean":"2024-09-13T23:05:49.158853+0000","last_became_active":"2024-09-13T23:05:12.126202+0000","last_became_peered":"2024-09-13T23:05:12.126202+0000","last_unstale":"2024-09-13T23:05:49.158853+0000","last_undegraded":"2024-09-13T23:05:49.158853+0000","last_fullsized":"2024-09-13T23:05:49.158853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:31.807454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.100783+0000","last_change":"2024-09-13T23:05:14.125692+0000","last_active":"2024-09-13T23:08:22.100783+0000","last_peered":"2024-09-13T23:08:22.100783+0000","last_clean":"2024-09-13T23:08:22.100783+0000","last_became_active":"2024-09-13T23:05:14.125457+0000","last_became_peered":"2024-09-13T23:05:14.125457+0000","last_unstale":"2024-09-13T23:08:22.100783+0000","last_undegraded":"2024-09-13T23:08:22.100783+0000","last_fullsized":"2024-09-13T23:08:22.100783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:30.709764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.164256+0000","last_change":"2024-09-13T23:05:12.150036+0000","last_active":"2024-09-13T23:05:49.164256+0000","last_peered":"2024-09-13T23:05:49.164256+0000","last_clean":"2024-09-13T23:05:49.164256+0000","last_became_active":"2024-09-13T23:05:12.149345+0000","last_became_peered":"2024-09-13T23:05:12.149345+0000","last_unstale":"2024-09-13T23:05:49.164256+0000","last_undegraded":"2024-09-13T23:05:49.164256+0000","last_fullsized":"2024-09-13T23:05:49.164256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:08.953763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:17.897299+0000","last_change":"2024-09-13T23:05:12.142386+0000","last_active":"2024-09-13T23:07:17.897299+0000","last_peered":"2024-09-13T23:07:17.897299+0000","last_clean":"2024-09-13T23:07:17.897299+0000","last_became_active":"2024-09-13T23:05:12.140432+0000","last_became_peered":"2024-09-13T23:05:12.140432+0000","last_unstale":"2024-09-13T23:07:17.897299+0000","last_undegraded":"2024-09-13T23:07:17.897299+0000","last_fullsized":"2024-09-13T23:07:17.897299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:03:40.790581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'16","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.324175+0000","last_change":"2024-09-13T23:05:14.122670+0000","last_active":"2024-09-13T23:08:22.324175+0000","last_peered":"2024-09-13T23:08:22.324175+0000","last_clean":"2024-09-13T23:08:22.324175+0000","last_became_active":"2024-09-13T23:05:14.122105+0000","last_became_peered":"2024-09-13T23:05:14.122105+0000","last_unstale":"2024-09-13T23:08:22.324175+0000","last_undegraded":"2024-09-13T23:08:22.324175+0000","last_fullsized":"2024-09-13T23:08:22.324175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:32.818885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.243675+0000","last_change":"2024-09-13T23:05:12.121856+0000","last_active":"2024-09-13T23:08:22.243675+0000","last_peered":"2024-09-13T23:08:22.243675+0000","last_clean":"2024-09-13T23:08:22.243675+0000","last_became_active":"2024-09-13T23:05:12.120703+0000","last_became_peered":"2024-09-13T23:05:12.120703+0000","last_unstale":"2024-09-13T23:08:22.243675+0000","last_undegraded":"2024-09-13T23:08:22.243675+0000","last_fullsized":"2024-09-13T23:08:22.243675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:20.740109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'9","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:43.078358+0000","last_change":"2024-09-13T23:05:14.122765+0000","last_active":"2024-09-13T23:07:43.078358+0000","last_peered":"2024-09-13T23:07:43.078358+0000","last_clean":"2024-09-13T23:07:43.078358+0000","last_became_active":"2024-09-13T23:05:14.121636+0000","last_became_peered":"2024-09-13T23:05:14.121636+0000","last_unstale":"2024-09-13T23:07:43.078358+0000","last_undegraded":"2024-09-13T23:07:43.078358+0000","last_fullsized":"2024-09-13T23:07:43.078358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:08.481848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1600,"num_read_kb":1490,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":12,"seq":51539607599,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48384,"kb_used_data":8880,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323456,"statfs":{"total":96636764160,"available":96587218944,"internally_reserved":0,"allocated":9093120,"data_stored":8759400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640301,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44736,"kb_used_data":9392,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327104,"statfs":{"total":96636764160,"available":96590954496,"internally_reserved":0,"allocated":9617408,"data_stored":9345424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705710,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44768,"kb_used_data":9424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327072,"statfs":{"total":96636764160,"available":96590921728,"internally_reserved":0,"allocated":9650176,"data_stored":9349228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40024,"kb_used_data":8840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331816,"statfs":{"total":96636764160,"available":96595779584,"internally_reserved":0,"allocated":9052160,"data_stored":8757564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T23:08:29.584 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T23:08:29.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.709+0000 7feaab30a640 1 Processor -- start 2024-09-13T23:08:29.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.709+0000 7feaab30a640 1 -- start start 2024-09-13T23:08:29.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.709+0000 7feaab30a640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7feaa412e940 0x7feaa4130d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:29.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.709+0000 7feaab30a640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaa406eba0 con 0x7feaa406eda0 2024-09-13T23:08:29.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.709+0000 7feaab30a640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7feaa406d2f0 con 0x7feaa412e940 2024-09-13T23:08:29.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.709+0000 7feaa88a5640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7feaa412e940 0x7feaa4130d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:29.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.709+0000 7feaa90a6640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7feaa406eda0 0x7feaa406f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:52706/0 (socket says 172.21.15.17:52706) 2024-09-13T23:08:29.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.709+0000 7feaa90a6640 1 -- 172.21.15.17:0/3653373611 learned_addr learned my addr 172.21.15.17:0/3653373611 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:08:29.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.710+0000 7feaa88a5640 1 -- 172.21.15.17:0/3653373611 >> v1:172.21.15.17:6789/0 conn(0x7feaa406eda0 legacy=0x7feaa406f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:29.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.710+0000 7feaa88a5640 1 -- 172.21.15.17:0/3653373611 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa4070d50 con 0x7feaa412e940 2024-09-13T23:08:29.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.710+0000 7feaa88a5640 1 --2- 172.21.15.17:0/3653373611 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaa412e940 0x7feaa4130d30 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fea94009720 tx=0x7fea9402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc709cc198c86b28 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:29.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.711+0000 7fea9bfff640 1 -- 172.21.15.17:0/3653373611 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea94037070 con 0x7feaa412e940 2024-09-13T23:08:29.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.711+0000 7fea9bfff640 1 -- 172.21.15.17:0/3653373611 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea9402ae20 con 0x7feaa412e940 2024-09-13T23:08:29.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.711+0000 7fea9bfff640 1 -- 172.21.15.17:0/3653373611 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea94032590 con 0x7feaa412e940 2024-09-13T23:08:29.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.711+0000 7feaab30a640 1 -- 172.21.15.17:0/3653373611 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaa412e940 msgr2=0x7feaa4130d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:29.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.711+0000 7feaab30a640 1 --2- 172.21.15.17:0/3653373611 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaa412e940 0x7feaa4130d30 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fea94009720 tx=0x7fea9402a1a0 comp rx=0 tx=0).stop 2024-09-13T23:08:29.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.711+0000 7feaab30a640 1 -- 172.21.15.17:0/3653373611 shutdown_connections 2024-09-13T23:08:29.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.711+0000 7feaab30a640 1 --2- 172.21.15.17:0/3653373611 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaa412e940 0x7feaa4130d30 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:29.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.711+0000 7feaab30a640 1 -- 172.21.15.17:0/3653373611 >> 172.21.15.17:0/3653373611 conn(0x7feaa409a890 msgr2=0x7feaa409aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:29.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.711+0000 7feaab30a640 1 -- 172.21.15.17:0/3653373611 shutdown_connections 2024-09-13T23:08:29.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.711+0000 7feaab30a640 1 -- 172.21.15.17:0/3653373611 wait complete. 2024-09-13T23:08:29.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.712+0000 7feaab30a640 1 Processor -- start 2024-09-13T23:08:29.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.712+0000 7feaab30a640 1 -- start start 2024-09-13T23:08:29.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.713+0000 7feaab30a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaa406eda0 0x7feaa41c1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:29.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.713+0000 7feaab30a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7feaa406fcd0 con 0x7feaa406eda0 2024-09-13T23:08:29.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.713+0000 7feaa90a6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaa406eda0 0x7feaa41c1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:29.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.713+0000 7feaa90a6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaa406eda0 0x7feaa41c1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39936/0 (socket says 172.21.15.17:39936) 2024-09-13T23:08:29.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.713+0000 7feaa90a6640 1 -- 172.21.15.17:0/1846862740 learned_addr learned my addr 172.21.15.17:0/1846862740 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:08:29.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.713+0000 7feaa90a6640 1 -- 172.21.15.17:0/1846862740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa412b8c0 con 0x7feaa406eda0 2024-09-13T23:08:29.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.713+0000 7feaa90a6640 1 --2- 172.21.15.17:0/1846862740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaa406eda0 0x7feaa41c1530 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7feaa000c4a0 tx=0x7feaa000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:29.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.713+0000 7fea99ffb640 1 -- 172.21.15.17:0/1846862740 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feaa0017070 con 0x7feaa406eda0 2024-09-13T23:08:29.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.713+0000 7fea99ffb640 1 -- 172.21.15.17:0/1846862740 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaa0005c10 con 0x7feaa406eda0 2024-09-13T23:08:29.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.713+0000 7feaab30a640 1 -- 172.21.15.17:0/1846862740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaa4125750 con 0x7feaa406eda0 2024-09-13T23:08:29.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.713+0000 7fea99ffb640 1 -- 172.21.15.17:0/1846862740 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feaa0007070 con 0x7feaa406eda0 2024-09-13T23:08:29.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.713+0000 7feaab30a640 1 -- 172.21.15.17:0/1846862740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaa4123bb0 con 0x7feaa406eda0 2024-09-13T23:08:29.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.714+0000 7fea99ffb640 1 -- 172.21.15.17:0/1846862740 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7feaa001a070 con 0x7feaa406eda0 2024-09-13T23:08:29.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.715+0000 7fea99ffb640 1 --2- 172.21.15.17:0/1846862740 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fea880382a0 0x7fea8803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:29.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.715+0000 7feaab30a640 1 -- 172.21.15.17:0/1846862740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaa412c170 con 0x7feaa406eda0 2024-09-13T23:08:29.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.715+0000 7fea99ffb640 1 -- 172.21.15.17:0/1846862740 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7feaa004afb0 con 0x7feaa406eda0 2024-09-13T23:08:29.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.715+0000 7feaa88a5640 1 --2- 172.21.15.17:0/1846862740 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fea880382a0 0x7fea8803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:29.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.715+0000 7feaa88a5640 1 --2- 172.21.15.17:0/1846862740 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fea880382a0 0x7fea8803a760 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fea94034000 tx=0x7fea9402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:29.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.719+0000 7fea99ffb640 1 -- 172.21.15.17:0/1846862740 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feaa00117a0 con 0x7feaa406eda0 2024-09-13T23:08:29.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.889+0000 7feaab30a640 1 -- 172.21.15.17:0/1846862740 --> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feaa4125d80 con 0x7fea880382a0 2024-09-13T23:08:29.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.905+0000 7fea99ffb640 1 -- 172.21.15.17:0/1846862740 <== mgr.4102 v2:172.21.15.164:6824/713838566 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666093 (secure 0 0 0) 0x7feaa4125d80 con 0x7fea880382a0 2024-09-13T23:08:29.913 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:08:29.918 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-13T23:08:29.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.910+0000 7feaab30a640 1 -- 172.21.15.17:0/1846862740 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fea880382a0 msgr2=0x7fea8803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:29.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.910+0000 7feaab30a640 1 --2- 172.21.15.17:0/1846862740 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fea880382a0 0x7fea8803a760 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fea94034000 tx=0x7fea9402e000 comp rx=0 tx=0).stop 2024-09-13T23:08:29.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.910+0000 7feaab30a640 1 -- 172.21.15.17:0/1846862740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaa406eda0 msgr2=0x7feaa41c1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:29.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.910+0000 7feaab30a640 1 --2- 172.21.15.17:0/1846862740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaa406eda0 0x7feaa41c1530 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7feaa000c4a0 tx=0x7feaa000c960 comp rx=0 tx=0).stop 2024-09-13T23:08:29.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.910+0000 7feaab30a640 1 -- 172.21.15.17:0/1846862740 shutdown_connections 2024-09-13T23:08:29.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.910+0000 7feaab30a640 1 --2- 172.21.15.17:0/1846862740 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fea880382a0 0x7fea8803a760 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:29.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.910+0000 7feaab30a640 1 --2- 172.21.15.17:0/1846862740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaa406eda0 0x7feaa41c1530 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:29.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.910+0000 7feaab30a640 1 -- 172.21.15.17:0/1846862740 >> 172.21.15.17:0/1846862740 conn(0x7feaa409a890 msgr2=0x7feaa4071300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:29.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.910+0000 7feaab30a640 1 -- 172.21.15.17:0/1846862740 shutdown_connections 2024-09-13T23:08:29.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:29.910+0000 7feaab30a640 1 -- 172.21.15.17:0/1846862740 wait complete. 2024-09-13T23:08:29.922 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-09-13T23:08:28.100388+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416904,"num_objects":229,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4872,"num_read_kb":4449,"num_write":2106,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4479,"ondisk_log_size":4479,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":177912,"kb_used_data":36536,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377309448,"statfs":{"total":386547056640,"available":386364874752,"internally_reserved":0,"allocated":37412864,"data_stored":36211616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815783,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003540"},"pg_stats":[{"pgid":"3.3f","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.357961+0000","last_change":"2024-09-13T23:05:12.130214+0000","last_active":"2024-09-13T23:08:22.357961+0000","last_peered":"2024-09-13T23:08:22.357961+0000","last_clean":"2024-09-13T23:08:22.357961+0000","last_became_active":"2024-09-13T23:05:12.130009+0000","last_became_peered":"2024-09-13T23:05:12.130009+0000","last_unstale":"2024-09-13T23:08:22.357961+0000","last_undegraded":"2024-09-13T23:08:22.357961+0000","last_fullsized":"2024-09-13T23:08:22.357961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:43.041094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.702056+0000","last_change":"2024-09-13T23:05:14.125468+0000","last_active":"2024-09-13T23:05:54.702056+0000","last_peered":"2024-09-13T23:05:54.702056+0000","last_clean":"2024-09-13T23:05:54.702056+0000","last_became_active":"2024-09-13T23:05:14.125215+0000","last_became_peered":"2024-09-13T23:05:14.125215+0000","last_unstale":"2024-09-13T23:05:54.702056+0000","last_undegraded":"2024-09-13T23:05:54.702056+0000","last_fullsized":"2024-09-13T23:05:54.702056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:30:53.032744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160717+0000","last_change":"2024-09-13T23:05:12.119102+0000","last_active":"2024-09-13T23:05:49.160717+0000","last_peered":"2024-09-13T23:05:49.160717+0000","last_clean":"2024-09-13T23:05:49.160717+0000","last_became_active":"2024-09-13T23:05:12.118411+0000","last_became_peered":"2024-09-13T23:05:12.118411+0000","last_unstale":"2024-09-13T23:05:49.160717+0000","last_undegraded":"2024-09-13T23:05:49.160717+0000","last_fullsized":"2024-09-13T23:05:49.160717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:58.196248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.485650+0000","last_change":"2024-09-13T23:05:14.109708+0000","last_active":"2024-09-13T23:07:21.485650+0000","last_peered":"2024-09-13T23:07:21.485650+0000","last_clean":"2024-09-13T23:07:21.485650+0000","last_became_active":"2024-09-13T23:05:14.109464+0000","last_became_peered":"2024-09-13T23:05:14.109464+0000","last_unstale":"2024-09-13T23:07:21.485650+0000","last_undegraded":"2024-09-13T23:07:21.485650+0000","last_fullsized":"2024-09-13T23:07:21.485650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:21.317180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.162506+0000","last_change":"2024-09-13T23:05:12.146564+0000","last_active":"2024-09-13T23:05:49.162506+0000","last_peered":"2024-09-13T23:05:49.162506+0000","last_clean":"2024-09-13T23:05:49.162506+0000","last_became_active":"2024-09-13T23:05:12.146191+0000","last_became_peered":"2024-09-13T23:05:12.146191+0000","last_unstale":"2024-09-13T23:05:49.162506+0000","last_undegraded":"2024-09-13T23:05:49.162506+0000","last_fullsized":"2024-09-13T23:05:49.162506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:15.192342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:17.908206+0000","last_change":"2024-09-13T23:05:14.110454+0000","last_active":"2024-09-13T23:07:17.908206+0000","last_peered":"2024-09-13T23:07:17.908206+0000","last_clean":"2024-09-13T23:07:17.908206+0000","last_became_active":"2024-09-13T23:05:14.110201+0000","last_became_peered":"2024-09-13T23:05:14.110201+0000","last_unstale":"2024-09-13T23:07:17.908206+0000","last_undegraded":"2024-09-13T23:07:17.908206+0000","last_fullsized":"2024-09-13T23:07:17.908206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:13:58.253126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.154369+0000","last_change":"2024-09-13T23:05:12.132812+0000","last_active":"2024-09-13T23:05:49.154369+0000","last_peered":"2024-09-13T23:05:49.154369+0000","last_clean":"2024-09-13T23:05:49.154369+0000","last_became_active":"2024-09-13T23:05:12.132461+0000","last_became_peered":"2024-09-13T23:05:12.132461+0000","last_unstale":"2024-09-13T23:05:49.154369+0000","last_undegraded":"2024-09-13T23:05:49.154369+0000","last_fullsized":"2024-09-13T23:05:49.154369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:16.369831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362602+0000","last_change":"2024-09-13T23:05:14.113718+0000","last_active":"2024-09-13T23:08:22.362602+0000","last_peered":"2024-09-13T23:08:22.362602+0000","last_clean":"2024-09-13T23:08:22.362602+0000","last_became_active":"2024-09-13T23:05:14.113430+0000","last_became_peered":"2024-09-13T23:05:14.113430+0000","last_unstale":"2024-09-13T23:08:22.362602+0000","last_undegraded":"2024-09-13T23:08:22.362602+0000","last_fullsized":"2024-09-13T23:08:22.362602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:49.226302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159928+0000","last_change":"2024-09-13T23:05:12.146576+0000","last_active":"2024-09-13T23:05:49.159928+0000","last_peered":"2024-09-13T23:05:49.159928+0000","last_clean":"2024-09-13T23:05:49.159928+0000","last_became_active":"2024-09-13T23:05:12.146220+0000","last_became_peered":"2024-09-13T23:05:12.146220+0000","last_unstale":"2024-09-13T23:05:49.159928+0000","last_undegraded":"2024-09-13T23:05:49.159928+0000","last_fullsized":"2024-09-13T23:05:49.159928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:20.009582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362602+0000","last_change":"2024-09-13T23:05:14.122808+0000","last_active":"2024-09-13T23:08:22.362602+0000","last_peered":"2024-09-13T23:08:22.362602+0000","last_clean":"2024-09-13T23:08:22.362602+0000","last_became_active":"2024-09-13T23:05:14.122513+0000","last_became_peered":"2024-09-13T23:05:14.122513+0000","last_unstale":"2024-09-13T23:08:22.362602+0000","last_undegraded":"2024-09-13T23:08:22.362602+0000","last_fullsized":"2024-09-13T23:08:22.362602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:32.818885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.238751+0000","last_change":"2024-09-13T23:05:12.113973+0000","last_active":"2024-09-13T23:08:22.238751+0000","last_peered":"2024-09-13T23:08:22.238751+0000","last_clean":"2024-09-13T23:08:22.238751+0000","last_became_active":"2024-09-13T23:05:12.113601+0000","last_became_peered":"2024-09-13T23:05:12.113601+0000","last_unstale":"2024-09-13T23:08:22.238751+0000","last_undegraded":"2024-09-13T23:08:22.238751+0000","last_fullsized":"2024-09-13T23:08:22.238751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:40:11.117182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.250229+0000","last_change":"2024-09-13T23:05:14.125418+0000","last_active":"2024-09-13T23:08:22.250229+0000","last_peered":"2024-09-13T23:08:22.250229+0000","last_clean":"2024-09-13T23:08:22.250229+0000","last_became_active":"2024-09-13T23:05:14.124971+0000","last_became_peered":"2024-09-13T23:05:14.124971+0000","last_unstale":"2024-09-13T23:08:22.250229+0000","last_undegraded":"2024-09-13T23:08:22.250229+0000","last_fullsized":"2024-09-13T23:08:22.250229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:48:34.888252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155922+0000","last_change":"2024-09-13T23:05:12.139628+0000","last_active":"2024-09-13T23:05:49.155922+0000","last_peered":"2024-09-13T23:05:49.155922+0000","last_clean":"2024-09-13T23:05:49.155922+0000","last_became_active":"2024-09-13T23:05:12.138297+0000","last_became_peered":"2024-09-13T23:05:12.138297+0000","last_unstale":"2024-09-13T23:05:49.155922+0000","last_undegraded":"2024-09-13T23:05:49.155922+0000","last_fullsized":"2024-09-13T23:05:49.155922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:12:00.284359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'16","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.984660+0000","last_change":"2024-09-13T23:05:14.124224+0000","last_active":"2024-09-13T23:08:21.984660+0000","last_peered":"2024-09-13T23:08:21.984660+0000","last_clean":"2024-09-13T23:08:21.984660+0000","last_became_active":"2024-09-13T23:05:14.123950+0000","last_became_peered":"2024-09-13T23:05:14.123950+0000","last_unstale":"2024-09-13T23:08:21.984660+0000","last_undegraded":"2024-09-13T23:08:21.984660+0000","last_fullsized":"2024-09-13T23:08:21.984660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:59:21.947772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":68,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.321599+0000","last_change":"2024-09-13T23:05:12.117693+0000","last_active":"2024-09-13T23:05:54.321599+0000","last_peered":"2024-09-13T23:05:54.321599+0000","last_clean":"2024-09-13T23:05:54.321599+0000","last_became_active":"2024-09-13T23:05:12.117028+0000","last_became_peered":"2024-09-13T23:05:12.117028+0000","last_unstale":"2024-09-13T23:05:54.321599+0000","last_undegraded":"2024-09-13T23:05:54.321599+0000","last_fullsized":"2024-09-13T23:05:54.321599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:17.130898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'17","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.328844+0000","last_change":"2024-09-13T23:05:14.115693+0000","last_active":"2024-09-13T23:08:22.328844+0000","last_peered":"2024-09-13T23:08:22.328844+0000","last_clean":"2024-09-13T23:08:22.328844+0000","last_became_active":"2024-09-13T23:05:14.114831+0000","last_became_peered":"2024-09-13T23:05:14.114831+0000","last_unstale":"2024-09-13T23:08:22.328844+0000","last_undegraded":"2024-09-13T23:08:22.328844+0000","last_fullsized":"2024-09-13T23:08:22.328844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:17.230322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'16","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.451482+0000","last_change":"2024-09-13T23:05:14.110322+0000","last_active":"2024-09-13T23:06:37.451482+0000","last_peered":"2024-09-13T23:06:37.451482+0000","last_clean":"2024-09-13T23:06:37.451482+0000","last_became_active":"2024-09-13T23:05:14.109903+0000","last_became_peered":"2024-09-13T23:05:14.109903+0000","last_unstale":"2024-09-13T23:06:37.451482+0000","last_undegraded":"2024-09-13T23:06:37.451482+0000","last_fullsized":"2024-09-13T23:06:37.451482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:04.762255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":66,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.936147+0000","last_change":"2024-09-13T23:05:12.136723+0000","last_active":"2024-09-13T23:08:21.936147+0000","last_peered":"2024-09-13T23:08:21.936147+0000","last_clean":"2024-09-13T23:08:21.936147+0000","last_became_active":"2024-09-13T23:05:12.136334+0000","last_became_peered":"2024-09-13T23:05:12.136334+0000","last_unstale":"2024-09-13T23:08:21.936147+0000","last_undegraded":"2024-09-13T23:08:21.936147+0000","last_fullsized":"2024-09-13T23:08:21.936147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:20.143656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'11","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:38.077492+0000","last_change":"2024-09-13T23:05:14.125935+0000","last_active":"2024-09-13T23:07:38.077492+0000","last_peered":"2024-09-13T23:07:38.077492+0000","last_clean":"2024-09-13T23:07:38.077492+0000","last_became_active":"2024-09-13T23:05:14.124023+0000","last_became_peered":"2024-09-13T23:05:14.124023+0000","last_unstale":"2024-09-13T23:07:38.077492+0000","last_undegraded":"2024-09-13T23:07:38.077492+0000","last_fullsized":"2024-09-13T23:07:38.077492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:33:06.997368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158954+0000","last_change":"2024-09-13T23:05:12.126709+0000","last_active":"2024-09-13T23:05:49.158954+0000","last_peered":"2024-09-13T23:05:49.158954+0000","last_clean":"2024-09-13T23:05:49.158954+0000","last_became_active":"2024-09-13T23:05:12.126336+0000","last_became_peered":"2024-09-13T23:05:12.126336+0000","last_unstale":"2024-09-13T23:05:49.158954+0000","last_undegraded":"2024-09-13T23:05:49.158954+0000","last_fullsized":"2024-09-13T23:05:49.158954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:13:11.279538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.453163+0000","last_change":"2024-09-13T23:05:14.125494+0000","last_active":"2024-09-13T23:06:37.453163+0000","last_peered":"2024-09-13T23:06:37.453163+0000","last_clean":"2024-09-13T23:06:37.453163+0000","last_became_active":"2024-09-13T23:05:14.125247+0000","last_became_peered":"2024-09-13T23:05:14.125247+0000","last_unstale":"2024-09-13T23:06:37.453163+0000","last_undegraded":"2024-09-13T23:06:37.453163+0000","last_fullsized":"2024-09-13T23:06:37.453163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:41.876468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156159+0000","last_change":"2024-09-13T23:05:12.140428+0000","last_active":"2024-09-13T23:05:49.156159+0000","last_peered":"2024-09-13T23:05:49.156159+0000","last_clean":"2024-09-13T23:05:49.156159+0000","last_became_active":"2024-09-13T23:05:12.139103+0000","last_became_peered":"2024-09-13T23:05:12.139103+0000","last_unstale":"2024-09-13T23:05:49.156159+0000","last_undegraded":"2024-09-13T23:05:49.156159+0000","last_fullsized":"2024-09-13T23:05:49.156159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:04.782795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'7","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:39.074749+0000","last_change":"2024-09-13T23:05:14.120825+0000","last_active":"2024-09-13T23:07:39.074749+0000","last_peered":"2024-09-13T23:07:39.074749+0000","last_clean":"2024-09-13T23:07:39.074749+0000","last_became_active":"2024-09-13T23:05:14.120397+0000","last_became_peered":"2024-09-13T23:05:14.120397+0000","last_unstale":"2024-09-13T23:07:39.074749+0000","last_undegraded":"2024-09-13T23:07:39.074749+0000","last_fullsized":"2024-09-13T23:07:39.074749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:33:06.997368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:53.844004+0000","last_change":"2024-09-13T23:05:12.139375+0000","last_active":"2024-09-13T23:05:53.844004+0000","last_peered":"2024-09-13T23:05:53.844004+0000","last_clean":"2024-09-13T23:05:53.844004+0000","last_became_active":"2024-09-13T23:05:12.139022+0000","last_became_peered":"2024-09-13T23:05:12.139022+0000","last_unstale":"2024-09-13T23:05:53.844004+0000","last_undegraded":"2024-09-13T23:05:53.844004+0000","last_fullsized":"2024-09-13T23:05:53.844004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:51.066283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'11","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.329086+0000","last_change":"2024-09-13T23:05:14.114497+0000","last_active":"2024-09-13T23:08:22.329086+0000","last_peered":"2024-09-13T23:08:22.329086+0000","last_clean":"2024-09-13T23:08:22.329086+0000","last_became_active":"2024-09-13T23:05:14.114261+0000","last_became_peered":"2024-09-13T23:05:14.114261+0000","last_unstale":"2024-09-13T23:08:22.329086+0000","last_undegraded":"2024-09-13T23:08:22.329086+0000","last_fullsized":"2024-09-13T23:08:22.329086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:24.193989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:53.841343+0000","last_change":"2024-09-13T23:05:12.130049+0000","last_active":"2024-09-13T23:05:53.841343+0000","last_peered":"2024-09-13T23:05:53.841343+0000","last_clean":"2024-09-13T23:05:53.841343+0000","last_became_active":"2024-09-13T23:05:12.129589+0000","last_became_peered":"2024-09-13T23:05:12.129589+0000","last_unstale":"2024-09-13T23:05:53.841343+0000","last_undegraded":"2024-09-13T23:05:53.841343+0000","last_fullsized":"2024-09-13T23:05:53.841343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:43.763766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.250116+0000","last_change":"2024-09-13T23:05:14.119179+0000","last_active":"2024-09-13T23:08:22.250116+0000","last_peered":"2024-09-13T23:08:22.250116+0000","last_clean":"2024-09-13T23:08:22.250116+0000","last_became_active":"2024-09-13T23:05:14.118922+0000","last_became_peered":"2024-09-13T23:05:14.118922+0000","last_unstale":"2024-09-13T23:08:22.250116+0000","last_undegraded":"2024-09-13T23:08:22.250116+0000","last_fullsized":"2024-09-13T23:08:22.250116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:34:29.752309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156113+0000","last_change":"2024-09-13T23:05:12.140097+0000","last_active":"2024-09-13T23:05:49.156113+0000","last_peered":"2024-09-13T23:05:49.156113+0000","last_clean":"2024-09-13T23:05:49.156113+0000","last_became_active":"2024-09-13T23:05:12.139690+0000","last_became_peered":"2024-09-13T23:05:12.139690+0000","last_unstale":"2024-09-13T23:05:49.156113+0000","last_undegraded":"2024-09-13T23:05:49.156113+0000","last_fullsized":"2024-09-13T23:05:49.156113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:08.185632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'37","reported_seq":102,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.290798+0000","last_change":"2024-09-13T23:05:22.146156+0000","last_active":"2024-09-13T23:08:22.290798+0000","last_peered":"2024-09-13T23:08:22.290798+0000","last_clean":"2024-09-13T23:08:22.290798+0000","last_became_active":"2024-09-13T23:05:22.145872+0000","last_became_peered":"2024-09-13T23:05:22.145872+0000","last_unstale":"2024-09-13T23:08:22.290798+0000","last_undegraded":"2024-09-13T23:08:22.290798+0000","last_fullsized":"2024-09-13T23:08:22.290798+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:03.965843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":174,"num_write":103,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:55.391940+0000","last_change":"2024-09-13T23:05:14.110173+0000","last_active":"2024-09-13T23:05:55.391940+0000","last_peered":"2024-09-13T23:05:55.391940+0000","last_clean":"2024-09-13T23:05:55.391940+0000","last_became_active":"2024-09-13T23:05:14.109928+0000","last_became_peered":"2024-09-13T23:05:14.109928+0000","last_unstale":"2024-09-13T23:05:55.391940+0000","last_undegraded":"2024-09-13T23:05:55.391940+0000","last_fullsized":"2024-09-13T23:05:55.391940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:47:18.620562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.914775+0000","last_change":"2024-09-13T23:05:12.147582+0000","last_active":"2024-09-13T23:05:54.914775+0000","last_peered":"2024-09-13T23:05:54.914775+0000","last_clean":"2024-09-13T23:05:54.914775+0000","last_became_active":"2024-09-13T23:05:12.146236+0000","last_became_peered":"2024-09-13T23:05:12.146236+0000","last_unstale":"2024-09-13T23:05:54.914775+0000","last_undegraded":"2024-09-13T23:05:54.914775+0000","last_fullsized":"2024-09-13T23:05:54.914775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:22:13.152885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.161816+0000","last_change":"2024-09-13T23:05:16.123699+0000","last_active":"2024-09-13T23:05:49.161816+0000","last_peered":"2024-09-13T23:05:49.161816+0000","last_clean":"2024-09-13T23:05:49.161816+0000","last_became_active":"2024-09-13T23:05:16.123362+0000","last_became_peered":"2024-09-13T23:05:16.123362+0000","last_unstale":"2024-09-13T23:05:49.161816+0000","last_undegraded":"2024-09-13T23:05:49.161816+0000","last_fullsized":"2024-09-13T23:05:49.161816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:16:52.649662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'31","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:47.080016+0000","last_change":"2024-09-13T23:05:18.133464+0000","last_active":"2024-09-13T23:07:47.080016+0000","last_peered":"2024-09-13T23:07:47.080016+0000","last_clean":"2024-09-13T23:07:47.080016+0000","last_became_active":"2024-09-13T23:05:18.132642+0000","last_became_peered":"2024-09-13T23:05:18.132642+0000","last_unstale":"2024-09-13T23:07:47.080016+0000","last_undegraded":"2024-09-13T23:07:47.080016+0000","last_fullsized":"2024-09-13T23:07:47.080016+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:36:33.250277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158666+0000","last_change":"2024-09-13T23:05:20.145619+0000","last_active":"2024-09-13T23:05:49.158666+0000","last_peered":"2024-09-13T23:05:49.158666+0000","last_clean":"2024-09-13T23:05:49.158666+0000","last_became_active":"2024-09-13T23:05:20.145271+0000","last_became_peered":"2024-09-13T23:05:20.145271+0000","last_unstale":"2024-09-13T23:05:49.158666+0000","last_undegraded":"2024-09-13T23:05:49.158666+0000","last_fullsized":"2024-09-13T23:05:49.158666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:42:34.341082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.268382+0000","last_change":"2024-09-13T23:05:22.150560+0000","last_active":"2024-09-13T23:06:37.268382+0000","last_peered":"2024-09-13T23:06:37.268382+0000","last_clean":"2024-09-13T23:06:37.268382+0000","last_became_active":"2024-09-13T23:05:22.150260+0000","last_became_peered":"2024-09-13T23:05:22.150260+0000","last_unstale":"2024-09-13T23:06:37.268382+0000","last_undegraded":"2024-09-13T23:06:37.268382+0000","last_fullsized":"2024-09-13T23:06:37.268382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:13.932874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'6","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.101371+0000","last_change":"2024-09-13T23:05:14.113389+0000","last_active":"2024-09-13T23:08:22.101371+0000","last_peered":"2024-09-13T23:08:22.101371+0000","last_clean":"2024-09-13T23:08:22.101371+0000","last_became_active":"2024-09-13T23:05:14.113131+0000","last_became_peered":"2024-09-13T23:05:14.113131+0000","last_unstale":"2024-09-13T23:08:22.101371+0000","last_undegraded":"2024-09-13T23:08:22.101371+0000","last_fullsized":"2024-09-13T23:08:22.101371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:06.652485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.153289+0000","last_change":"2024-09-13T23:05:12.134287+0000","last_active":"2024-09-13T23:05:49.153289+0000","last_peered":"2024-09-13T23:05:49.153289+0000","last_clean":"2024-09-13T23:05:49.153289+0000","last_became_active":"2024-09-13T23:05:12.133505+0000","last_became_peered":"2024-09-13T23:05:12.133505+0000","last_unstale":"2024-09-13T23:05:49.153289+0000","last_undegraded":"2024-09-13T23:05:49.153289+0000","last_fullsized":"2024-09-13T23:05:49.153289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:56.855326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159485+0000","last_change":"2024-09-13T23:05:16.125089+0000","last_active":"2024-09-13T23:05:49.159485+0000","last_peered":"2024-09-13T23:05:49.159485+0000","last_clean":"2024-09-13T23:05:49.159485+0000","last_became_active":"2024-09-13T23:05:16.124724+0000","last_became_peered":"2024-09-13T23:05:16.124724+0000","last_unstale":"2024-09-13T23:05:49.159485+0000","last_undegraded":"2024-09-13T23:05:49.159485+0000","last_fullsized":"2024-09-13T23:05:49.159485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:57:02.718638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:43.078368+0000","last_change":"2024-09-13T23:05:18.126600+0000","last_active":"2024-09-13T23:07:43.078368+0000","last_peered":"2024-09-13T23:07:43.078368+0000","last_clean":"2024-09-13T23:07:43.078368+0000","last_became_active":"2024-09-13T23:05:18.126251+0000","last_became_peered":"2024-09-13T23:05:18.126251+0000","last_unstale":"2024-09-13T23:07:43.078368+0000","last_undegraded":"2024-09-13T23:07:43.078368+0000","last_fullsized":"2024-09-13T23:07:43.078368+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:07:27.243286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156395+0000","last_change":"2024-09-13T23:05:20.142878+0000","last_active":"2024-09-13T23:05:49.156395+0000","last_peered":"2024-09-13T23:05:49.156395+0000","last_clean":"2024-09-13T23:05:49.156395+0000","last_became_active":"2024-09-13T23:05:20.142564+0000","last_became_peered":"2024-09-13T23:05:20.142564+0000","last_unstale":"2024-09-13T23:05:49.156395+0000","last_undegraded":"2024-09-13T23:05:49.156395+0000","last_fullsized":"2024-09-13T23:05:49.156395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:59.655692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158502+0000","last_change":"2024-09-13T23:05:22.147806+0000","last_active":"2024-09-13T23:05:49.158502+0000","last_peered":"2024-09-13T23:05:49.158502+0000","last_clean":"2024-09-13T23:05:49.158502+0000","last_became_active":"2024-09-13T23:05:22.147493+0000","last_became_peered":"2024-09-13T23:05:22.147493+0000","last_unstale":"2024-09-13T23:05:49.158502+0000","last_undegraded":"2024-09-13T23:05:49.158502+0000","last_fullsized":"2024-09-13T23:05:49.158502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:13.932874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.450589+0000","last_change":"2024-09-13T23:05:14.113438+0000","last_active":"2024-09-13T23:06:37.450589+0000","last_peered":"2024-09-13T23:06:37.450589+0000","last_clean":"2024-09-13T23:06:37.450589+0000","last_became_active":"2024-09-13T23:05:14.112986+0000","last_became_peered":"2024-09-13T23:05:14.112986+0000","last_unstale":"2024-09-13T23:06:37.450589+0000","last_undegraded":"2024-09-13T23:06:37.450589+0000","last_fullsized":"2024-09-13T23:06:37.450589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:45:08.233460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155482+0000","last_change":"2024-09-13T23:05:12.139949+0000","last_active":"2024-09-13T23:05:49.155482+0000","last_peered":"2024-09-13T23:05:49.155482+0000","last_clean":"2024-09-13T23:05:49.155482+0000","last_became_active":"2024-09-13T23:05:12.138805+0000","last_became_peered":"2024-09-13T23:05:12.138805+0000","last_unstale":"2024-09-13T23:05:49.155482+0000","last_undegraded":"2024-09-13T23:05:49.155482+0000","last_fullsized":"2024-09-13T23:05:49.155482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:31:38.135658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:51.062287+0000","last_change":"2024-09-13T23:05:49.165573+0000","last_active":"2024-09-13T23:05:51.062287+0000","last_peered":"2024-09-13T23:05:51.062287+0000","last_clean":"2024-09-13T23:05:51.062287+0000","last_became_active":"2024-09-13T23:05:49.165209+0000","last_became_peered":"2024-09-13T23:05:49.165209+0000","last_unstale":"2024-09-13T23:05:51.062287+0000","last_undegraded":"2024-09-13T23:05:51.062287+0000","last_fullsized":"2024-09-13T23:05:51.062287+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:19:50.556651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"34'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:41.077798+0000","last_change":"2024-09-13T23:05:18.134680+0000","last_active":"2024-09-13T23:07:41.077798+0000","last_peered":"2024-09-13T23:07:41.077798+0000","last_clean":"2024-09-13T23:07:41.077798+0000","last_became_active":"2024-09-13T23:05:18.134363+0000","last_became_peered":"2024-09-13T23:05:18.134363+0000","last_unstale":"2024-09-13T23:07:41.077798+0000","last_undegraded":"2024-09-13T23:07:41.077798+0000","last_fullsized":"2024-09-13T23:07:41.077798+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:00.335024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":385,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.612992+0000","last_change":"2024-09-13T23:05:20.144269+0000","last_active":"2024-09-13T23:08:22.612992+0000","last_peered":"2024-09-13T23:08:22.612992+0000","last_clean":"2024-09-13T23:08:22.612992+0000","last_became_active":"2024-09-13T23:05:20.143986+0000","last_became_peered":"2024-09-13T23:05:20.143986+0000","last_unstale":"2024-09-13T23:08:22.612992+0000","last_undegraded":"2024-09-13T23:08:22.612992+0000","last_fullsized":"2024-09-13T23:08:22.612992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:13.991065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'8","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.683567+0000","last_change":"2024-09-13T23:05:22.151271+0000","last_active":"2024-09-13T23:08:21.683567+0000","last_peered":"2024-09-13T23:08:21.683567+0000","last_clean":"2024-09-13T23:08:21.683567+0000","last_became_active":"2024-09-13T23:05:22.150977+0000","last_became_peered":"2024-09-13T23:05:22.150977+0000","last_unstale":"2024-09-13T23:08:21.683567+0000","last_undegraded":"2024-09-13T23:08:21.683567+0000","last_fullsized":"2024-09-13T23:08:21.683567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:52:45.769736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'12","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.106650+0000","last_change":"2024-09-13T23:05:14.122457+0000","last_active":"2024-09-13T23:08:22.106650+0000","last_peered":"2024-09-13T23:08:22.106650+0000","last_clean":"2024-09-13T23:08:22.106650+0000","last_became_active":"2024-09-13T23:05:14.121960+0000","last_became_peered":"2024-09-13T23:05:14.121960+0000","last_unstale":"2024-09-13T23:08:22.106650+0000","last_undegraded":"2024-09-13T23:08:22.106650+0000","last_fullsized":"2024-09-13T23:08:22.106650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:29:29.556013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:53.841405+0000","last_change":"2024-09-13T23:05:12.129400+0000","last_active":"2024-09-13T23:05:53.841405+0000","last_peered":"2024-09-13T23:05:53.841405+0000","last_clean":"2024-09-13T23:05:53.841405+0000","last_became_active":"2024-09-13T23:05:12.129019+0000","last_became_peered":"2024-09-13T23:05:12.129019+0000","last_unstale":"2024-09-13T23:05:53.841405+0000","last_undegraded":"2024-09-13T23:05:53.841405+0000","last_fullsized":"2024-09-13T23:05:53.841405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:17.130898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.162782+0000","last_change":"2024-09-13T23:05:16.122830+0000","last_active":"2024-09-13T23:05:49.162782+0000","last_peered":"2024-09-13T23:05:49.162782+0000","last_clean":"2024-09-13T23:05:49.162782+0000","last_became_active":"2024-09-13T23:05:16.122555+0000","last_became_peered":"2024-09-13T23:05:16.122555+0000","last_unstale":"2024-09-13T23:05:49.162782+0000","last_undegraded":"2024-09-13T23:05:49.162782+0000","last_fullsized":"2024-09-13T23:05:49.162782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:26.261538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.718356+0000","last_change":"2024-09-13T23:05:18.128964+0000","last_active":"2024-09-13T23:07:19.718356+0000","last_peered":"2024-09-13T23:07:19.718356+0000","last_clean":"2024-09-13T23:07:19.718356+0000","last_became_active":"2024-09-13T23:05:18.128626+0000","last_became_peered":"2024-09-13T23:05:18.128626+0000","last_unstale":"2024-09-13T23:07:19.718356+0000","last_undegraded":"2024-09-13T23:07:19.718356+0000","last_fullsized":"2024-09-13T23:07:19.718356+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:06.922448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'282","reported_seq":401,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.365794+0000","last_change":"2024-09-13T23:05:20.132195+0000","last_active":"2024-09-13T23:08:22.365794+0000","last_peered":"2024-09-13T23:08:22.365794+0000","last_clean":"2024-09-13T23:08:22.365794+0000","last_became_active":"2024-09-13T23:05:20.131943+0000","last_became_peered":"2024-09-13T23:05:20.131943+0000","last_unstale":"2024-09-13T23:08:22.365794+0000","last_undegraded":"2024-09-13T23:08:22.365794+0000","last_fullsized":"2024-09-13T23:08:22.365794+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:31.349343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158421+0000","last_change":"2024-09-13T23:05:14.127270+0000","last_active":"2024-09-13T23:05:49.158421+0000","last_peered":"2024-09-13T23:05:49.158421+0000","last_clean":"2024-09-13T23:05:49.158421+0000","last_became_active":"2024-09-13T23:05:14.126659+0000","last_became_peered":"2024-09-13T23:05:14.126659+0000","last_unstale":"2024-09-13T23:05:49.158421+0000","last_undegraded":"2024-09-13T23:05:49.158421+0000","last_fullsized":"2024-09-13T23:05:49.158421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:48.797832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160679+0000","last_change":"2024-09-13T23:05:12.116365+0000","last_active":"2024-09-13T23:05:49.160679+0000","last_peered":"2024-09-13T23:05:49.160679+0000","last_clean":"2024-09-13T23:05:49.160679+0000","last_became_active":"2024-09-13T23:05:12.114453+0000","last_became_peered":"2024-09-13T23:05:12.114453+0000","last_unstale":"2024-09-13T23:05:49.160679+0000","last_undegraded":"2024-09-13T23:05:49.160679+0000","last_fullsized":"2024-09-13T23:05:49.160679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:27.884217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156721+0000","last_change":"2024-09-13T23:05:16.124600+0000","last_active":"2024-09-13T23:05:49.156721+0000","last_peered":"2024-09-13T23:05:49.156721+0000","last_clean":"2024-09-13T23:05:49.156721+0000","last_became_active":"2024-09-13T23:05:16.124324+0000","last_became_peered":"2024-09-13T23:05:16.124324+0000","last_unstale":"2024-09-13T23:05:49.156721+0000","last_undegraded":"2024-09-13T23:05:49.156721+0000","last_fullsized":"2024-09-13T23:05:49.156721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:41.101957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'40","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.728296+0000","last_change":"2024-09-13T23:05:18.130180+0000","last_active":"2024-09-13T23:07:19.728296+0000","last_peered":"2024-09-13T23:07:19.728296+0000","last_clean":"2024-09-13T23:07:19.728296+0000","last_became_active":"2024-09-13T23:05:18.129887+0000","last_became_peered":"2024-09-13T23:05:18.129887+0000","last_unstale":"2024-09-13T23:07:19.728296+0000","last_undegraded":"2024-09-13T23:07:19.728296+0000","last_fullsized":"2024-09-13T23:07:19.728296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:07:09.827042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160148+0000","last_change":"2024-09-13T23:05:20.136290+0000","last_active":"2024-09-13T23:05:49.160148+0000","last_peered":"2024-09-13T23:05:49.160148+0000","last_clean":"2024-09-13T23:05:49.160148+0000","last_became_active":"2024-09-13T23:05:20.135937+0000","last_became_peered":"2024-09-13T23:05:20.135937+0000","last_unstale":"2024-09-13T23:05:49.160148+0000","last_undegraded":"2024-09-13T23:05:49.160148+0000","last_fullsized":"2024-09-13T23:05:49.160148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.119483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.270132+0000","last_change":"2024-09-13T23:05:22.146349+0000","last_active":"2024-09-13T23:06:37.270132+0000","last_peered":"2024-09-13T23:06:37.270132+0000","last_clean":"2024-09-13T23:06:37.270132+0000","last_became_active":"2024-09-13T23:05:22.146044+0000","last_became_peered":"2024-09-13T23:05:22.146044+0000","last_unstale":"2024-09-13T23:06:37.270132+0000","last_undegraded":"2024-09-13T23:06:37.270132+0000","last_fullsized":"2024-09-13T23:06:37.270132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:21.509044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157862+0000","last_change":"2024-09-13T23:05:14.116849+0000","last_active":"2024-09-13T23:05:49.157862+0000","last_peered":"2024-09-13T23:05:49.157862+0000","last_clean":"2024-09-13T23:05:49.157862+0000","last_became_active":"2024-09-13T23:05:14.116507+0000","last_became_peered":"2024-09-13T23:05:14.116507+0000","last_unstale":"2024-09-13T23:05:49.157862+0000","last_undegraded":"2024-09-13T23:05:49.157862+0000","last_fullsized":"2024-09-13T23:05:49.157862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:29:29.556013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.441116+0000","last_change":"2024-09-13T23:05:12.115905+0000","last_active":"2024-09-13T23:06:37.441116+0000","last_peered":"2024-09-13T23:06:37.441116+0000","last_clean":"2024-09-13T23:06:37.441116+0000","last_became_active":"2024-09-13T23:05:12.115025+0000","last_became_peered":"2024-09-13T23:05:12.115025+0000","last_unstale":"2024-09-13T23:06:37.441116+0000","last_undegraded":"2024-09-13T23:06:37.441116+0000","last_fullsized":"2024-09-13T23:06:37.441116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:18.644207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158753+0000","last_change":"2024-09-13T23:05:16.118904+0000","last_active":"2024-09-13T23:05:49.158753+0000","last_peered":"2024-09-13T23:05:49.158753+0000","last_clean":"2024-09-13T23:05:49.158753+0000","last_became_active":"2024-09-13T23:05:16.118494+0000","last_became_peered":"2024-09-13T23:05:16.118494+0000","last_unstale":"2024-09-13T23:05:49.158753+0000","last_undegraded":"2024-09-13T23:05:49.158753+0000","last_fullsized":"2024-09-13T23:05:49.158753+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:04:52.706373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.708412+0000","last_change":"2024-09-13T23:05:18.134435+0000","last_active":"2024-09-13T23:07:19.708412+0000","last_peered":"2024-09-13T23:07:19.708412+0000","last_clean":"2024-09-13T23:07:19.708412+0000","last_became_active":"2024-09-13T23:05:18.134130+0000","last_became_peered":"2024-09-13T23:05:18.134130+0000","last_unstale":"2024-09-13T23:07:19.708412+0000","last_undegraded":"2024-09-13T23:07:19.708412+0000","last_fullsized":"2024-09-13T23:07:19.708412+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:26.188132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159456+0000","last_change":"2024-09-13T23:05:20.140527+0000","last_active":"2024-09-13T23:05:49.159456+0000","last_peered":"2024-09-13T23:05:49.159456+0000","last_clean":"2024-09-13T23:05:49.159456+0000","last_became_active":"2024-09-13T23:05:20.140180+0000","last_became_peered":"2024-09-13T23:05:20.140180+0000","last_unstale":"2024-09-13T23:05:49.159456+0000","last_undegraded":"2024-09-13T23:05:49.159456+0000","last_fullsized":"2024-09-13T23:05:49.159456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:59.655692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'7","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.257996+0000","last_change":"2024-09-13T23:05:22.148436+0000","last_active":"2024-09-13T23:06:37.257996+0000","last_peered":"2024-09-13T23:06:37.257996+0000","last_clean":"2024-09-13T23:06:37.257996+0000","last_became_active":"2024-09-13T23:05:22.148104+0000","last_became_peered":"2024-09-13T23:05:22.148104+0000","last_unstale":"2024-09-13T23:06:37.257996+0000","last_undegraded":"2024-09-13T23:06:37.257996+0000","last_fullsized":"2024-09-13T23:06:37.257996+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:03:42.989142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":18,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.153941+0000","last_change":"2024-09-13T23:05:14.119333+0000","last_active":"2024-09-13T23:05:49.153941+0000","last_peered":"2024-09-13T23:05:49.153941+0000","last_clean":"2024-09-13T23:05:49.153941+0000","last_became_active":"2024-09-13T23:05:14.119071+0000","last_became_peered":"2024-09-13T23:05:14.119071+0000","last_unstale":"2024-09-13T23:05:49.153941+0000","last_undegraded":"2024-09-13T23:05:49.153941+0000","last_fullsized":"2024-09-13T23:05:49.153941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:22.705770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:27.076346+0000","last_change":"2024-09-13T23:05:12.148852+0000","last_active":"2024-09-13T23:07:27.076346+0000","last_peered":"2024-09-13T23:07:27.076346+0000","last_clean":"2024-09-13T23:07:27.076346+0000","last_became_active":"2024-09-13T23:05:12.148439+0000","last_became_peered":"2024-09-13T23:05:12.148439+0000","last_unstale":"2024-09-13T23:07:27.076346+0000","last_undegraded":"2024-09-13T23:07:27.076346+0000","last_fullsized":"2024-09-13T23:07:27.076346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:48:38.654493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159519+0000","last_change":"2024-09-13T23:05:16.123514+0000","last_active":"2024-09-13T23:05:49.159519+0000","last_peered":"2024-09-13T23:05:49.159519+0000","last_clean":"2024-09-13T23:05:49.159519+0000","last_became_active":"2024-09-13T23:05:16.123188+0000","last_became_peered":"2024-09-13T23:05:16.123188+0000","last_unstale":"2024-09-13T23:05:49.159519+0000","last_undegraded":"2024-09-13T23:05:49.159519+0000","last_fullsized":"2024-09-13T23:05:49.159519+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:12:38.123647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.730276+0000","last_change":"2024-09-13T23:05:18.132366+0000","last_active":"2024-09-13T23:07:19.730276+0000","last_peered":"2024-09-13T23:07:19.730276+0000","last_clean":"2024-09-13T23:07:19.730276+0000","last_became_active":"2024-09-13T23:05:18.131446+0000","last_became_peered":"2024-09-13T23:05:18.131446+0000","last_unstale":"2024-09-13T23:07:19.730276+0000","last_undegraded":"2024-09-13T23:07:19.730276+0000","last_fullsized":"2024-09-13T23:07:19.730276+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:53.858562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":348,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.638674+0000","last_change":"2024-09-13T23:05:20.144417+0000","last_active":"2024-09-13T23:08:22.638674+0000","last_peered":"2024-09-13T23:08:22.638674+0000","last_clean":"2024-09-13T23:08:22.638674+0000","last_became_active":"2024-09-13T23:05:20.144104+0000","last_became_peered":"2024-09-13T23:05:20.144104+0000","last_unstale":"2024-09-13T23:08:22.638674+0000","last_undegraded":"2024-09-13T23:08:22.638674+0000","last_fullsized":"2024-09-13T23:08:22.638674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:33.653779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160034+0000","last_change":"2024-09-13T23:05:22.147955+0000","last_active":"2024-09-13T23:05:49.160034+0000","last_peered":"2024-09-13T23:05:49.160034+0000","last_clean":"2024-09-13T23:05:49.160034+0000","last_became_active":"2024-09-13T23:05:22.147645+0000","last_became_peered":"2024-09-13T23:05:22.147645+0000","last_unstale":"2024-09-13T23:05:49.160034+0000","last_undegraded":"2024-09-13T23:05:49.160034+0000","last_fullsized":"2024-09-13T23:05:49.160034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:07.578205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'10","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362666+0000","last_change":"2024-09-13T23:05:14.112569+0000","last_active":"2024-09-13T23:08:22.362666+0000","last_peered":"2024-09-13T23:08:22.362666+0000","last_clean":"2024-09-13T23:08:22.362666+0000","last_became_active":"2024-09-13T23:05:14.112291+0000","last_became_peered":"2024-09-13T23:05:14.112291+0000","last_unstale":"2024-09-13T23:08:22.362666+0000","last_undegraded":"2024-09-13T23:08:22.362666+0000","last_fullsized":"2024-09-13T23:08:22.362666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:17.199234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:27.076285+0000","last_change":"2024-09-13T23:05:12.149813+0000","last_active":"2024-09-13T23:07:27.076285+0000","last_peered":"2024-09-13T23:07:27.076285+0000","last_clean":"2024-09-13T23:07:27.076285+0000","last_became_active":"2024-09-13T23:05:12.149418+0000","last_became_peered":"2024-09-13T23:05:12.149418+0000","last_unstale":"2024-09-13T23:07:27.076285+0000","last_undegraded":"2024-09-13T23:07:27.076285+0000","last_fullsized":"2024-09-13T23:07:27.076285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:40.908784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158966+0000","last_change":"2024-09-13T23:05:16.118930+0000","last_active":"2024-09-13T23:05:49.158966+0000","last_peered":"2024-09-13T23:05:49.158966+0000","last_clean":"2024-09-13T23:05:49.158966+0000","last_became_active":"2024-09-13T23:05:16.118503+0000","last_became_peered":"2024-09-13T23:05:16.118503+0000","last_unstale":"2024-09-13T23:05:49.158966+0000","last_undegraded":"2024-09-13T23:05:49.158966+0000","last_fullsized":"2024-09-13T23:05:49.158966+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:46.202221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'54","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.732160+0000","last_change":"2024-09-13T23:05:18.135615+0000","last_active":"2024-09-13T23:07:19.732160+0000","last_peered":"2024-09-13T23:07:19.732160+0000","last_clean":"2024-09-13T23:07:19.732160+0000","last_became_active":"2024-09-13T23:05:18.135307+0000","last_became_peered":"2024-09-13T23:05:18.135307+0000","last_unstale":"2024-09-13T23:07:19.732160+0000","last_undegraded":"2024-09-13T23:07:19.732160+0000","last_fullsized":"2024-09-13T23:07:19.732160+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:14:46.252331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158506+0000","last_change":"2024-09-13T23:05:20.137752+0000","last_active":"2024-09-13T23:05:49.158506+0000","last_peered":"2024-09-13T23:05:49.158506+0000","last_clean":"2024-09-13T23:05:49.158506+0000","last_became_active":"2024-09-13T23:05:20.137460+0000","last_became_peered":"2024-09-13T23:05:20.137460+0000","last_unstale":"2024-09-13T23:05:49.158506+0000","last_undegraded":"2024-09-13T23:05:49.158506+0000","last_fullsized":"2024-09-13T23:05:49.158506+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:24.969082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.583085+0000","last_change":"2024-09-13T23:05:22.141812+0000","last_active":"2024-09-13T23:08:22.583085+0000","last_peered":"2024-09-13T23:08:22.583085+0000","last_clean":"2024-09-13T23:08:22.583085+0000","last_became_active":"2024-09-13T23:05:22.141472+0000","last_became_peered":"2024-09-13T23:05:22.141472+0000","last_unstale":"2024-09-13T23:08:22.583085+0000","last_undegraded":"2024-09-13T23:08:22.583085+0000","last_fullsized":"2024-09-13T23:08:22.583085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:21:03.848726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.933540+0000","last_change":"2024-09-13T23:05:49.164754+0000","last_active":"2024-09-13T23:05:54.933540+0000","last_peered":"2024-09-13T23:05:54.933540+0000","last_clean":"2024-09-13T23:05:54.933540+0000","last_became_active":"2024-09-13T23:05:49.164426+0000","last_became_peered":"2024-09-13T23:05:49.164426+0000","last_unstale":"2024-09-13T23:05:54.933540+0000","last_undegraded":"2024-09-13T23:05:54.933540+0000","last_fullsized":"2024-09-13T23:05:54.933540+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:05.715216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.230923+0000","last_change":"2024-09-13T23:05:12.130483+0000","last_active":"2024-09-13T23:08:22.230923+0000","last_peered":"2024-09-13T23:08:22.230923+0000","last_clean":"2024-09-13T23:08:22.230923+0000","last_became_active":"2024-09-13T23:05:12.129951+0000","last_became_peered":"2024-09-13T23:05:12.129951+0000","last_unstale":"2024-09-13T23:08:22.230923+0000","last_undegraded":"2024-09-13T23:08:22.230923+0000","last_fullsized":"2024-09-13T23:08:22.230923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:29.788894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156275+0000","last_change":"2024-09-13T23:05:16.127877+0000","last_active":"2024-09-13T23:05:49.156275+0000","last_peered":"2024-09-13T23:05:49.156275+0000","last_clean":"2024-09-13T23:05:49.156275+0000","last_became_active":"2024-09-13T23:05:16.127598+0000","last_became_peered":"2024-09-13T23:05:16.127598+0000","last_unstale":"2024-09-13T23:05:49.156275+0000","last_undegraded":"2024-09-13T23:05:49.156275+0000","last_fullsized":"2024-09-13T23:05:49.156275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:22:17.166855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'32","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.712314+0000","last_change":"2024-09-13T23:05:18.129032+0000","last_active":"2024-09-13T23:07:19.712314+0000","last_peered":"2024-09-13T23:07:19.712314+0000","last_clean":"2024-09-13T23:07:19.712314+0000","last_became_active":"2024-09-13T23:05:18.128238+0000","last_became_peered":"2024-09-13T23:05:18.128238+0000","last_unstale":"2024-09-13T23:07:19.712314+0000","last_undegraded":"2024-09-13T23:07:19.712314+0000","last_fullsized":"2024-09-13T23:07:19.712314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:21.134767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.163889+0000","last_change":"2024-09-13T23:05:20.140091+0000","last_active":"2024-09-13T23:05:49.163889+0000","last_peered":"2024-09-13T23:05:49.163889+0000","last_clean":"2024-09-13T23:05:49.163889+0000","last_became_active":"2024-09-13T23:05:20.139335+0000","last_became_peered":"2024-09-13T23:05:20.139335+0000","last_unstale":"2024-09-13T23:05:49.163889+0000","last_undegraded":"2024-09-13T23:05:49.163889+0000","last_fullsized":"2024-09-13T23:05:49.163889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:55.021863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:22.075235+0000","last_change":"2024-09-13T23:05:22.148481+0000","last_active":"2024-09-13T23:07:22.075235+0000","last_peered":"2024-09-13T23:07:22.075235+0000","last_clean":"2024-09-13T23:07:22.075235+0000","last_became_active":"2024-09-13T23:05:22.148222+0000","last_became_peered":"2024-09-13T23:05:22.148222+0000","last_unstale":"2024-09-13T23:07:22.075235+0000","last_undegraded":"2024-09-13T23:07:22.075235+0000","last_fullsized":"2024-09-13T23:07:22.075235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:17.281151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'34","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.987497+0000","last_change":"2024-09-13T23:05:14.118784+0000","last_active":"2024-09-13T23:08:21.987497+0000","last_peered":"2024-09-13T23:08:21.987497+0000","last_clean":"2024-09-13T23:08:21.987497+0000","last_became_active":"2024-09-13T23:05:14.118545+0000","last_became_peered":"2024-09-13T23:05:14.118545+0000","last_unstale":"2024-09-13T23:08:21.987497+0000","last_undegraded":"2024-09-13T23:08:21.987497+0000","last_fullsized":"2024-09-13T23:08:21.987497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:08.429431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":93,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157506+0000","last_change":"2024-09-13T23:05:12.147234+0000","last_active":"2024-09-13T23:05:49.157506+0000","last_peered":"2024-09-13T23:05:49.157506+0000","last_clean":"2024-09-13T23:05:49.157506+0000","last_became_active":"2024-09-13T23:05:12.146912+0000","last_became_peered":"2024-09-13T23:05:12.146912+0000","last_unstale":"2024-09-13T23:05:49.157506+0000","last_undegraded":"2024-09-13T23:05:49.157506+0000","last_fullsized":"2024-09-13T23:05:49.157506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:38:56.354721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159573+0000","last_change":"2024-09-13T23:05:16.114688+0000","last_active":"2024-09-13T23:05:49.159573+0000","last_peered":"2024-09-13T23:05:49.159573+0000","last_clean":"2024-09-13T23:05:49.159573+0000","last_became_active":"2024-09-13T23:05:16.114369+0000","last_became_peered":"2024-09-13T23:05:16.114369+0000","last_unstale":"2024-09-13T23:05:49.159573+0000","last_undegraded":"2024-09-13T23:05:49.159573+0000","last_fullsized":"2024-09-13T23:05:49.159573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:26:55.819506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'37","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.738671+0000","last_change":"2024-09-13T23:05:18.126484+0000","last_active":"2024-09-13T23:07:19.738671+0000","last_peered":"2024-09-13T23:07:19.738671+0000","last_clean":"2024-09-13T23:07:19.738671+0000","last_became_active":"2024-09-13T23:05:18.126183+0000","last_became_peered":"2024-09-13T23:05:18.126183+0000","last_unstale":"2024-09-13T23:07:19.738671+0000","last_undegraded":"2024-09-13T23:07:19.738671+0000","last_fullsized":"2024-09-13T23:07:19.738671+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:26:42.895522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":403,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.586872+0000","last_change":"2024-09-13T23:05:20.143991+0000","last_active":"2024-09-13T23:08:22.586872+0000","last_peered":"2024-09-13T23:08:22.586872+0000","last_clean":"2024-09-13T23:08:22.586872+0000","last_became_active":"2024-09-13T23:05:20.143659+0000","last_became_peered":"2024-09-13T23:05:20.143659+0000","last_unstale":"2024-09-13T23:08:22.586872+0000","last_undegraded":"2024-09-13T23:08:22.586872+0000","last_fullsized":"2024-09-13T23:08:22.586872+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:12.673687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:29.073132+0000","last_change":"2024-09-13T23:05:22.140956+0000","last_active":"2024-09-13T23:07:29.073132+0000","last_peered":"2024-09-13T23:07:29.073132+0000","last_clean":"2024-09-13T23:07:29.073132+0000","last_became_active":"2024-09-13T23:05:22.140485+0000","last_became_peered":"2024-09-13T23:05:22.140485+0000","last_unstale":"2024-09-13T23:07:29.073132+0000","last_undegraded":"2024-09-13T23:07:29.073132+0000","last_fullsized":"2024-09-13T23:07:29.073132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:59:53.508149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'18","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362666+0000","last_change":"2024-09-13T23:05:14.115429+0000","last_active":"2024-09-13T23:08:22.362666+0000","last_peered":"2024-09-13T23:08:22.362666+0000","last_clean":"2024-09-13T23:08:22.362666+0000","last_became_active":"2024-09-13T23:05:14.115166+0000","last_became_peered":"2024-09-13T23:05:14.115166+0000","last_unstale":"2024-09-13T23:08:22.362666+0000","last_undegraded":"2024-09-13T23:08:22.362666+0000","last_fullsized":"2024-09-13T23:08:22.362666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:32:22.514080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.234005+0000","last_change":"2024-09-13T23:05:12.140202+0000","last_active":"2024-09-13T23:08:22.234005+0000","last_peered":"2024-09-13T23:08:22.234005+0000","last_clean":"2024-09-13T23:08:22.234005+0000","last_became_active":"2024-09-13T23:05:12.139283+0000","last_became_peered":"2024-09-13T23:05:12.139283+0000","last_unstale":"2024-09-13T23:08:22.234005+0000","last_undegraded":"2024-09-13T23:08:22.234005+0000","last_fullsized":"2024-09-13T23:08:22.234005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:48.577483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":424,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:20.838224+0000","last_change":"2024-09-13T23:05:49.171563+0000","last_active":"2024-09-13T23:07:20.838224+0000","last_peered":"2024-09-13T23:07:20.838224+0000","last_clean":"2024-09-13T23:07:20.838224+0000","last_became_active":"2024-09-13T23:05:49.164741+0000","last_became_peered":"2024-09-13T23:05:49.164741+0000","last_unstale":"2024-09-13T23:07:20.838224+0000","last_undegraded":"2024-09-13T23:07:20.838224+0000","last_fullsized":"2024-09-13T23:07:20.838224+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:00:34.765305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160915+0000","last_change":"2024-09-13T23:05:18.135452+0000","last_active":"2024-09-13T23:05:49.160915+0000","last_peered":"2024-09-13T23:05:49.160915+0000","last_clean":"2024-09-13T23:05:49.160915+0000","last_became_active":"2024-09-13T23:05:18.135028+0000","last_became_peered":"2024-09-13T23:05:18.135028+0000","last_unstale":"2024-09-13T23:05:49.160915+0000","last_undegraded":"2024-09-13T23:05:49.160915+0000","last_fullsized":"2024-09-13T23:05:49.160915+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:18.976364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":465,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.473644+0000","last_change":"2024-09-13T23:05:20.133263+0000","last_active":"2024-09-13T23:08:22.473644+0000","last_peered":"2024-09-13T23:08:22.473644+0000","last_clean":"2024-09-13T23:08:22.473644+0000","last_became_active":"2024-09-13T23:05:20.132891+0000","last_became_peered":"2024-09-13T23:05:20.132891+0000","last_unstale":"2024-09-13T23:08:22.473644+0000","last_undegraded":"2024-09-13T23:08:22.473644+0000","last_fullsized":"2024-09-13T23:08:22.473644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:54.194855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.115074+0000","last_change":"2024-09-13T23:05:22.150994+0000","last_active":"2024-09-13T23:07:21.115074+0000","last_peered":"2024-09-13T23:07:21.115074+0000","last_clean":"2024-09-13T23:07:21.115074+0000","last_became_active":"2024-09-13T23:05:22.150258+0000","last_became_peered":"2024-09-13T23:05:22.150258+0000","last_unstale":"2024-09-13T23:07:21.115074+0000","last_undegraded":"2024-09-13T23:07:21.115074+0000","last_fullsized":"2024-09-13T23:07:21.115074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:31:47.069056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362873+0000","last_change":"2024-09-13T23:05:14.126232+0000","last_active":"2024-09-13T23:08:22.362873+0000","last_peered":"2024-09-13T23:08:22.362873+0000","last_clean":"2024-09-13T23:08:22.362873+0000","last_became_active":"2024-09-13T23:05:14.125034+0000","last_became_peered":"2024-09-13T23:05:14.125034+0000","last_unstale":"2024-09-13T23:08:22.362873+0000","last_undegraded":"2024-09-13T23:08:22.362873+0000","last_fullsized":"2024-09-13T23:08:22.362873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:04:50.699295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'3","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.249529+0000","last_change":"2024-09-13T23:05:12.143810+0000","last_active":"2024-09-13T23:06:37.249529+0000","last_peered":"2024-09-13T23:06:37.249529+0000","last_clean":"2024-09-13T23:06:37.249529+0000","last_became_active":"2024-09-13T23:05:12.142185+0000","last_became_peered":"2024-09-13T23:05:12.142185+0000","last_unstale":"2024-09-13T23:06:37.249529+0000","last_undegraded":"2024-09-13T23:06:37.249529+0000","last_fullsized":"2024-09-13T23:06:37.249529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:22.187097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.163377+0000","last_change":"2024-09-13T23:05:16.125331+0000","last_active":"2024-09-13T23:05:49.163377+0000","last_peered":"2024-09-13T23:05:49.163377+0000","last_clean":"2024-09-13T23:05:49.163377+0000","last_became_active":"2024-09-13T23:05:16.125013+0000","last_became_peered":"2024-09-13T23:05:16.125013+0000","last_unstale":"2024-09-13T23:05:49.163377+0000","last_undegraded":"2024-09-13T23:05:49.163377+0000","last_fullsized":"2024-09-13T23:05:49.163377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:44.318931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'38","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.725307+0000","last_change":"2024-09-13T23:05:18.126590+0000","last_active":"2024-09-13T23:07:19.725307+0000","last_peered":"2024-09-13T23:07:19.725307+0000","last_clean":"2024-09-13T23:07:19.725307+0000","last_became_active":"2024-09-13T23:05:18.126271+0000","last_became_peered":"2024-09-13T23:05:18.126271+0000","last_unstale":"2024-09-13T23:07:19.725307+0000","last_undegraded":"2024-09-13T23:07:19.725307+0000","last_fullsized":"2024-09-13T23:07:19.725307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:23.420696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.154145+0000","last_change":"2024-09-13T23:05:20.145937+0000","last_active":"2024-09-13T23:05:49.154145+0000","last_peered":"2024-09-13T23:05:49.154145+0000","last_clean":"2024-09-13T23:05:49.154145+0000","last_became_active":"2024-09-13T23:05:20.145626+0000","last_became_peered":"2024-09-13T23:05:20.145626+0000","last_unstale":"2024-09-13T23:05:49.154145+0000","last_undegraded":"2024-09-13T23:05:49.154145+0000","last_fullsized":"2024-09-13T23:05:49.154145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:12.850248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.421783+0000","last_change":"2024-09-13T23:05:22.137537+0000","last_active":"2024-09-13T23:08:22.421783+0000","last_peered":"2024-09-13T23:08:22.421783+0000","last_clean":"2024-09-13T23:08:22.421783+0000","last_became_active":"2024-09-13T23:05:22.137111+0000","last_became_peered":"2024-09-13T23:05:22.137111+0000","last_unstale":"2024-09-13T23:08:22.421783+0000","last_undegraded":"2024-09-13T23:08:22.421783+0000","last_fullsized":"2024-09-13T23:08:22.421783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:04:57.442372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'16","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:17.907900+0000","last_change":"2024-09-13T23:05:49.168074+0000","last_active":"2024-09-13T23:07:17.907900+0000","last_peered":"2024-09-13T23:07:17.907900+0000","last_clean":"2024-09-13T23:07:17.907900+0000","last_became_active":"2024-09-13T23:05:49.165166+0000","last_became_peered":"2024-09-13T23:05:49.165166+0000","last_unstale":"2024-09-13T23:07:17.907900+0000","last_undegraded":"2024-09-13T23:07:17.907900+0000","last_fullsized":"2024-09-13T23:07:17.907900+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:16:50.642584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":51,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":204,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.154898+0000","last_change":"2024-09-13T23:04:56.151685+0000","last_active":"2024-09-13T23:05:49.154898+0000","last_peered":"2024-09-13T23:05:49.154898+0000","last_clean":"2024-09-13T23:05:49.154898+0000","last_became_active":"2024-09-13T23:04:56.149747+0000","last_became_peered":"2024-09-13T23:04:56.149747+0000","last_unstale":"2024-09-13T23:05:49.154898+0000","last_undegraded":"2024-09-13T23:05:49.154898+0000","last_fullsized":"2024-09-13T23:05:49.154898+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:04:55.054026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:04:55.054026+0000","last_clean_scrub_stamp":"2024-09-13T23:04:55.054026+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:38.290092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160070+0000","last_change":"2024-09-13T23:05:03.078734+0000","last_active":"2024-09-13T23:05:49.160070+0000","last_peered":"2024-09-13T23:05:49.160070+0000","last_clean":"2024-09-13T23:05:49.160070+0000","last_became_active":"2024-09-13T23:05:01.074608+0000","last_became_peered":"2024-09-13T23:05:01.074608+0000","last_unstale":"2024-09-13T23:05:49.160070+0000","last_undegraded":"2024-09-13T23:05:49.160070+0000","last_fullsized":"2024-09-13T23:05:49.160070+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:03.125973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097176599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:17.074746+0000","last_change":"2024-09-13T23:05:12.147068+0000","last_active":"2024-09-13T23:07:17.074746+0000","last_peered":"2024-09-13T23:07:17.074746+0000","last_clean":"2024-09-13T23:07:17.074746+0000","last_became_active":"2024-09-13T23:05:12.146438+0000","last_became_peered":"2024-09-13T23:05:12.146438+0000","last_unstale":"2024-09-13T23:07:17.074746+0000","last_undegraded":"2024-09-13T23:07:17.074746+0000","last_fullsized":"2024-09-13T23:07:17.074746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:25:59.118016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158851+0000","last_change":"2024-09-13T23:05:16.115876+0000","last_active":"2024-09-13T23:05:49.158851+0000","last_peered":"2024-09-13T23:05:49.158851+0000","last_clean":"2024-09-13T23:05:49.158851+0000","last_became_active":"2024-09-13T23:05:16.115599+0000","last_became_peered":"2024-09-13T23:05:16.115599+0000","last_unstale":"2024-09-13T23:05:49.158851+0000","last_undegraded":"2024-09-13T23:05:49.158851+0000","last_fullsized":"2024-09-13T23:05:49.158851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:22.878444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'76","reported_seq":145,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.736517+0000","last_change":"2024-09-13T23:05:18.135412+0000","last_active":"2024-09-13T23:07:19.736517+0000","last_peered":"2024-09-13T23:07:19.736517+0000","last_clean":"2024-09-13T23:07:19.736517+0000","last_became_active":"2024-09-13T23:05:18.135080+0000","last_became_peered":"2024-09-13T23:05:18.135080+0000","last_unstale":"2024-09-13T23:07:19.736517+0000","last_undegraded":"2024-09-13T23:07:19.736517+0000","last_fullsized":"2024-09-13T23:07:19.736517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:46.305461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160178+0000","last_change":"2024-09-13T23:05:20.139707+0000","last_active":"2024-09-13T23:05:49.160178+0000","last_peered":"2024-09-13T23:05:49.160178+0000","last_clean":"2024-09-13T23:05:49.160178+0000","last_became_active":"2024-09-13T23:05:20.139399+0000","last_became_peered":"2024-09-13T23:05:20.139399+0000","last_unstale":"2024-09-13T23:05:49.160178+0000","last_undegraded":"2024-09-13T23:05:49.160178+0000","last_fullsized":"2024-09-13T23:05:49.160178+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:42:34.341082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'87","reported_seq":171,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.374408+0000","last_change":"2024-09-13T23:05:22.140722+0000","last_active":"2024-09-13T23:08:22.374408+0000","last_peered":"2024-09-13T23:08:22.374408+0000","last_clean":"2024-09-13T23:08:22.374408+0000","last_became_active":"2024-09-13T23:05:22.140430+0000","last_became_peered":"2024-09-13T23:05:22.140430+0000","last_unstale":"2024-09-13T23:08:22.374408+0000","last_undegraded":"2024-09-13T23:08:22.374408+0000","last_fullsized":"2024-09-13T23:08:22.374408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:57.254040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":226,"num_write":170,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.101402+0000","last_change":"2024-09-13T23:05:14.113221+0000","last_active":"2024-09-13T23:08:22.101402+0000","last_peered":"2024-09-13T23:08:22.101402+0000","last_clean":"2024-09-13T23:08:22.101402+0000","last_became_active":"2024-09-13T23:05:14.112711+0000","last_became_peered":"2024-09-13T23:05:14.112711+0000","last_unstale":"2024-09-13T23:08:22.101402+0000","last_undegraded":"2024-09-13T23:08:22.101402+0000","last_fullsized":"2024-09-13T23:08:22.101402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:40.124504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157421+0000","last_change":"2024-09-13T23:05:03.078145+0000","last_active":"2024-09-13T23:05:49.157421+0000","last_peered":"2024-09-13T23:05:49.157421+0000","last_clean":"2024-09-13T23:05:49.157421+0000","last_became_active":"2024-09-13T23:05:01.075438+0000","last_became_peered":"2024-09-13T23:05:01.075438+0000","last_unstale":"2024-09-13T23:05:49.157421+0000","last_undegraded":"2024-09-13T23:05:49.157421+0000","last_fullsized":"2024-09-13T23:05:49.157421+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:36:59.019783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043480299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158406+0000","last_change":"2024-09-13T23:05:12.114595+0000","last_active":"2024-09-13T23:05:49.158406+0000","last_peered":"2024-09-13T23:05:49.158406+0000","last_clean":"2024-09-13T23:05:49.158406+0000","last_became_active":"2024-09-13T23:05:12.114087+0000","last_became_peered":"2024-09-13T23:05:12.114087+0000","last_unstale":"2024-09-13T23:05:49.158406+0000","last_undegraded":"2024-09-13T23:05:49.158406+0000","last_fullsized":"2024-09-13T23:05:49.158406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:01:21.996979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.164060+0000","last_change":"2024-09-13T23:05:16.127786+0000","last_active":"2024-09-13T23:05:49.164060+0000","last_peered":"2024-09-13T23:05:49.164060+0000","last_clean":"2024-09-13T23:05:49.164060+0000","last_became_active":"2024-09-13T23:05:16.127404+0000","last_became_peered":"2024-09-13T23:05:16.127404+0000","last_unstale":"2024-09-13T23:05:49.164060+0000","last_undegraded":"2024-09-13T23:05:49.164060+0000","last_fullsized":"2024-09-13T23:05:49.164060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:03:50.653375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'274","reported_seq":477,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.205293+0000","last_change":"2024-09-13T23:05:18.135832+0000","last_active":"2024-09-13T23:08:21.205293+0000","last_peered":"2024-09-13T23:08:21.205293+0000","last_clean":"2024-09-13T23:08:21.205293+0000","last_became_active":"2024-09-13T23:05:18.135536+0000","last_became_peered":"2024-09-13T23:05:18.135536+0000","last_unstale":"2024-09-13T23:08:21.205293+0000","last_undegraded":"2024-09-13T23:08:21.205293+0000","last_fullsized":"2024-09-13T23:08:21.205293+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:46.163680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.161250+0000","last_change":"2024-09-13T23:05:20.139219+0000","last_active":"2024-09-13T23:05:49.161250+0000","last_peered":"2024-09-13T23:05:49.161250+0000","last_clean":"2024-09-13T23:05:49.161250+0000","last_became_active":"2024-09-13T23:05:20.138840+0000","last_became_peered":"2024-09-13T23:05:20.138840+0000","last_unstale":"2024-09-13T23:05:49.161250+0000","last_undegraded":"2024-09-13T23:05:49.161250+0000","last_fullsized":"2024-09-13T23:05:49.161250+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:11.879040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'5","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.012786+0000","last_change":"2024-09-13T23:05:22.149748+0000","last_active":"2024-09-13T23:08:22.012786+0000","last_peered":"2024-09-13T23:08:22.012786+0000","last_clean":"2024-09-13T23:08:22.012786+0000","last_became_active":"2024-09-13T23:05:22.149430+0000","last_became_peered":"2024-09-13T23:05:22.149430+0000","last_unstale":"2024-09-13T23:08:22.012786+0000","last_undegraded":"2024-09-13T23:08:22.012786+0000","last_fullsized":"2024-09-13T23:08:22.012786+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:59:53.508149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:17.907468+0000","last_change":"2024-09-13T23:05:14.122318+0000","last_active":"2024-09-13T23:07:17.907468+0000","last_peered":"2024-09-13T23:07:17.907468+0000","last_clean":"2024-09-13T23:07:17.907468+0000","last_became_active":"2024-09-13T23:05:14.121629+0000","last_became_peered":"2024-09-13T23:05:14.121629+0000","last_unstale":"2024-09-13T23:07:17.907468+0000","last_undegraded":"2024-09-13T23:07:17.907468+0000","last_fullsized":"2024-09-13T23:07:17.907468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:40.466898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.153107+0000","last_change":"2024-09-13T23:05:03.246597+0000","last_active":"2024-09-13T23:05:49.153107+0000","last_peered":"2024-09-13T23:05:49.153107+0000","last_clean":"2024-09-13T23:05:49.153107+0000","last_became_active":"2024-09-13T23:05:01.075422+0000","last_became_peered":"2024-09-13T23:05:01.075422+0000","last_unstale":"2024-09-13T23:05:49.153107+0000","last_undegraded":"2024-09-13T23:05:49.153107+0000","last_fullsized":"2024-09-13T23:05:49.153107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:46.318146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049267099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158237+0000","last_change":"2024-09-13T23:05:12.118437+0000","last_active":"2024-09-13T23:05:49.158237+0000","last_peered":"2024-09-13T23:05:49.158237+0000","last_clean":"2024-09-13T23:05:49.158237+0000","last_became_active":"2024-09-13T23:05:12.117940+0000","last_became_peered":"2024-09-13T23:05:12.117940+0000","last_unstale":"2024-09-13T23:05:49.158237+0000","last_undegraded":"2024-09-13T23:05:49.158237+0000","last_fullsized":"2024-09-13T23:05:49.158237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:14:55.200398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158030+0000","last_change":"2024-09-13T23:05:16.122638+0000","last_active":"2024-09-13T23:05:49.158030+0000","last_peered":"2024-09-13T23:05:49.158030+0000","last_clean":"2024-09-13T23:05:49.158030+0000","last_became_active":"2024-09-13T23:05:16.122318+0000","last_became_peered":"2024-09-13T23:05:16.122318+0000","last_unstale":"2024-09-13T23:05:49.158030+0000","last_undegraded":"2024-09-13T23:05:49.158030+0000","last_fullsized":"2024-09-13T23:05:49.158030+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:42.400087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.205271+0000","last_change":"2024-09-13T23:05:18.128025+0000","last_active":"2024-09-13T23:08:21.205271+0000","last_peered":"2024-09-13T23:08:21.205271+0000","last_clean":"2024-09-13T23:08:21.205271+0000","last_became_active":"2024-09-13T23:05:18.127698+0000","last_became_peered":"2024-09-13T23:05:18.127698+0000","last_unstale":"2024-09-13T23:08:21.205271+0000","last_undegraded":"2024-09-13T23:08:21.205271+0000","last_fullsized":"2024-09-13T23:08:21.205271+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:20.928045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159819+0000","last_change":"2024-09-13T23:05:20.145677+0000","last_active":"2024-09-13T23:05:49.159819+0000","last_peered":"2024-09-13T23:05:49.159819+0000","last_clean":"2024-09-13T23:05:49.159819+0000","last_became_active":"2024-09-13T23:05:20.145330+0000","last_became_peered":"2024-09-13T23:05:20.145330+0000","last_unstale":"2024-09-13T23:05:49.159819+0000","last_undegraded":"2024-09-13T23:05:49.159819+0000","last_fullsized":"2024-09-13T23:05:49.159819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:42.120633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.154815+0000","last_change":"2024-09-13T23:05:22.139303+0000","last_active":"2024-09-13T23:05:49.154815+0000","last_peered":"2024-09-13T23:05:49.154815+0000","last_clean":"2024-09-13T23:05:49.154815+0000","last_became_active":"2024-09-13T23:05:22.138259+0000","last_became_peered":"2024-09-13T23:05:22.138259+0000","last_unstale":"2024-09-13T23:05:49.154815+0000","last_undegraded":"2024-09-13T23:05:49.154815+0000","last_fullsized":"2024-09-13T23:05:49.154815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:37.433723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'6","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362869+0000","last_change":"2024-09-13T23:05:14.110869+0000","last_active":"2024-09-13T23:08:22.362869+0000","last_peered":"2024-09-13T23:08:22.362869+0000","last_clean":"2024-09-13T23:08:22.362869+0000","last_became_active":"2024-09-13T23:05:14.110532+0000","last_became_peered":"2024-09-13T23:05:14.110532+0000","last_unstale":"2024-09-13T23:08:22.362869+0000","last_undegraded":"2024-09-13T23:08:22.362869+0000","last_fullsized":"2024-09-13T23:08:22.362869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:48.481316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155626+0000","last_change":"2024-09-13T23:05:03.078756+0000","last_active":"2024-09-13T23:05:49.155626+0000","last_peered":"2024-09-13T23:05:49.155626+0000","last_clean":"2024-09-13T23:05:49.155626+0000","last_became_active":"2024-09-13T23:05:01.075399+0000","last_became_peered":"2024-09-13T23:05:01.075399+0000","last_unstale":"2024-09-13T23:05:49.155626+0000","last_undegraded":"2024-09-13T23:05:49.155626+0000","last_fullsized":"2024-09-13T23:05:49.155626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:30.026879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010379530000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.154668+0000","last_change":"2024-09-13T23:05:12.131428+0000","last_active":"2024-09-13T23:05:49.154668+0000","last_peered":"2024-09-13T23:05:49.154668+0000","last_clean":"2024-09-13T23:05:49.154668+0000","last_became_active":"2024-09-13T23:05:12.130410+0000","last_became_peered":"2024-09-13T23:05:12.130410+0000","last_unstale":"2024-09-13T23:05:49.154668+0000","last_undegraded":"2024-09-13T23:05:49.154668+0000","last_fullsized":"2024-09-13T23:05:49.154668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:29.799687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160305+0000","last_change":"2024-09-13T23:05:16.124659+0000","last_active":"2024-09-13T23:05:49.160305+0000","last_peered":"2024-09-13T23:05:49.160305+0000","last_clean":"2024-09-13T23:05:49.160305+0000","last_became_active":"2024-09-13T23:05:16.123983+0000","last_became_peered":"2024-09-13T23:05:16.123983+0000","last_unstale":"2024-09-13T23:05:49.160305+0000","last_undegraded":"2024-09-13T23:05:49.160305+0000","last_fullsized":"2024-09-13T23:05:49.160305+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:43.395837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.506942+0000","last_change":"2024-09-13T23:05:18.133997+0000","last_active":"2024-09-13T23:08:21.506942+0000","last_peered":"2024-09-13T23:08:21.506942+0000","last_clean":"2024-09-13T23:08:21.506942+0000","last_became_active":"2024-09-13T23:05:18.133165+0000","last_became_peered":"2024-09-13T23:05:18.133165+0000","last_unstale":"2024-09-13T23:08:21.506942+0000","last_undegraded":"2024-09-13T23:08:21.506942+0000","last_fullsized":"2024-09-13T23:08:21.506942+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:53.112074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.164155+0000","last_change":"2024-09-13T23:05:20.144363+0000","last_active":"2024-09-13T23:05:49.164155+0000","last_peered":"2024-09-13T23:05:49.164155+0000","last_clean":"2024-09-13T23:05:49.164155+0000","last_became_active":"2024-09-13T23:05:20.143748+0000","last_became_peered":"2024-09-13T23:05:20.143748+0000","last_unstale":"2024-09-13T23:05:49.164155+0000","last_undegraded":"2024-09-13T23:05:49.164155+0000","last_fullsized":"2024-09-13T23:05:49.164155+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:34:12.604551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.062072+0000","last_change":"2024-09-13T23:05:22.150796+0000","last_active":"2024-09-13T23:07:21.062072+0000","last_peered":"2024-09-13T23:07:21.062072+0000","last_clean":"2024-09-13T23:07:21.062072+0000","last_became_active":"2024-09-13T23:05:22.150415+0000","last_became_peered":"2024-09-13T23:05:22.150415+0000","last_unstale":"2024-09-13T23:07:21.062072+0000","last_undegraded":"2024-09-13T23:07:21.062072+0000","last_fullsized":"2024-09-13T23:07:21.062072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:56:02.493425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.321880+0000","last_change":"2024-09-13T23:05:14.123934+0000","last_active":"2024-09-13T23:08:22.321880+0000","last_peered":"2024-09-13T23:08:22.321880+0000","last_clean":"2024-09-13T23:08:22.321880+0000","last_became_active":"2024-09-13T23:05:14.123447+0000","last_became_peered":"2024-09-13T23:05:14.123447+0000","last_unstale":"2024-09-13T23:08:22.321880+0000","last_undegraded":"2024-09-13T23:08:22.321880+0000","last_fullsized":"2024-09-13T23:08:22.321880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:40.466898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.917869+0000","last_change":"2024-09-13T23:05:12.124402+0000","last_active":"2024-09-13T23:05:54.917869+0000","last_peered":"2024-09-13T23:05:54.917869+0000","last_clean":"2024-09-13T23:05:54.917869+0000","last_became_active":"2024-09-13T23:05:12.124005+0000","last_became_peered":"2024-09-13T23:05:12.124005+0000","last_unstale":"2024-09-13T23:05:54.917869+0000","last_undegraded":"2024-09-13T23:05:54.917869+0000","last_fullsized":"2024-09-13T23:05:54.917869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:51.362106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159745+0000","last_change":"2024-09-13T23:05:03.080556+0000","last_active":"2024-09-13T23:05:49.159745+0000","last_peered":"2024-09-13T23:05:49.159745+0000","last_clean":"2024-09-13T23:05:49.159745+0000","last_became_active":"2024-09-13T23:05:01.074963+0000","last_became_peered":"2024-09-13T23:05:01.074963+0000","last_unstale":"2024-09-13T23:05:49.159745+0000","last_undegraded":"2024-09-13T23:05:49.159745+0000","last_fullsized":"2024-09-13T23:05:49.159745+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:02.162649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055235699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:24.072212+0000","last_change":"2024-09-13T23:05:16.124473+0000","last_active":"2024-09-13T23:07:24.072212+0000","last_peered":"2024-09-13T23:07:24.072212+0000","last_clean":"2024-09-13T23:07:24.072212+0000","last_became_active":"2024-09-13T23:05:16.123971+0000","last_became_peered":"2024-09-13T23:05:16.123971+0000","last_unstale":"2024-09-13T23:07:24.072212+0000","last_undegraded":"2024-09-13T23:07:24.072212+0000","last_fullsized":"2024-09-13T23:07:24.072212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:46:26.673828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'61","reported_seq":120,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.737622+0000","last_change":"2024-09-13T23:05:18.132525+0000","last_active":"2024-09-13T23:07:19.737622+0000","last_peered":"2024-09-13T23:07:19.737622+0000","last_clean":"2024-09-13T23:07:19.737622+0000","last_became_active":"2024-09-13T23:05:18.132051+0000","last_became_peered":"2024-09-13T23:05:18.132051+0000","last_unstale":"2024-09-13T23:07:19.737622+0000","last_undegraded":"2024-09-13T23:07:19.737622+0000","last_fullsized":"2024-09-13T23:07:19.737622+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:44:32.951876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.152427+0000","last_change":"2024-09-13T23:05:20.143982+0000","last_active":"2024-09-13T23:05:49.152427+0000","last_peered":"2024-09-13T23:05:49.152427+0000","last_clean":"2024-09-13T23:05:49.152427+0000","last_became_active":"2024-09-13T23:05:20.143566+0000","last_became_peered":"2024-09-13T23:05:20.143566+0000","last_unstale":"2024-09-13T23:05:49.152427+0000","last_undegraded":"2024-09-13T23:05:49.152427+0000","last_fullsized":"2024-09-13T23:05:49.152427+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:27.338381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.471422+0000","last_change":"2024-09-13T23:05:22.138169+0000","last_active":"2024-09-13T23:08:22.471422+0000","last_peered":"2024-09-13T23:08:22.471422+0000","last_clean":"2024-09-13T23:08:22.471422+0000","last_became_active":"2024-09-13T23:05:22.137952+0000","last_became_peered":"2024-09-13T23:05:22.137952+0000","last_unstale":"2024-09-13T23:08:22.471422+0000","last_undegraded":"2024-09-13T23:08:22.471422+0000","last_fullsized":"2024-09-13T23:08:22.471422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:49.651698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.702466+0000","last_change":"2024-09-13T23:05:14.125712+0000","last_active":"2024-09-13T23:05:54.702466+0000","last_peered":"2024-09-13T23:05:54.702466+0000","last_clean":"2024-09-13T23:05:54.702466+0000","last_became_active":"2024-09-13T23:05:14.123549+0000","last_became_peered":"2024-09-13T23:05:14.123549+0000","last_unstale":"2024-09-13T23:05:54.702466+0000","last_undegraded":"2024-09-13T23:05:54.702466+0000","last_fullsized":"2024-09-13T23:05:54.702466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:14:21.159008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159984+0000","last_change":"2024-09-13T23:05:12.130717+0000","last_active":"2024-09-13T23:05:49.159984+0000","last_peered":"2024-09-13T23:05:49.159984+0000","last_clean":"2024-09-13T23:05:49.159984+0000","last_became_active":"2024-09-13T23:05:12.130285+0000","last_became_peered":"2024-09-13T23:05:12.130285+0000","last_unstale":"2024-09-13T23:05:49.159984+0000","last_undegraded":"2024-09-13T23:05:49.159984+0000","last_fullsized":"2024-09-13T23:05:49.159984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:20.143656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.163413+0000","last_change":"2024-09-13T23:05:03.078119+0000","last_active":"2024-09-13T23:05:49.163413+0000","last_peered":"2024-09-13T23:05:49.163413+0000","last_clean":"2024-09-13T23:05:49.163413+0000","last_became_active":"2024-09-13T23:05:01.075431+0000","last_became_peered":"2024-09-13T23:05:01.075431+0000","last_unstale":"2024-09-13T23:05:49.163413+0000","last_undegraded":"2024-09-13T23:05:49.163413+0000","last_fullsized":"2024-09-13T23:05:49.163413+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:22:31.741360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041474900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155165+0000","last_change":"2024-09-13T23:05:16.120645+0000","last_active":"2024-09-13T23:05:49.155165+0000","last_peered":"2024-09-13T23:05:49.155165+0000","last_clean":"2024-09-13T23:05:49.155165+0000","last_became_active":"2024-09-13T23:05:16.120337+0000","last_became_peered":"2024-09-13T23:05:16.120337+0000","last_unstale":"2024-09-13T23:05:49.155165+0000","last_undegraded":"2024-09-13T23:05:49.155165+0000","last_fullsized":"2024-09-13T23:05:49.155165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:19:50.556651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'16","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.934809+0000","last_change":"2024-09-13T23:05:18.134351+0000","last_active":"2024-09-13T23:05:54.934809+0000","last_peered":"2024-09-13T23:05:54.934809+0000","last_clean":"2024-09-13T23:05:54.934809+0000","last_became_active":"2024-09-13T23:05:18.133676+0000","last_became_peered":"2024-09-13T23:05:18.133676+0000","last_unstale":"2024-09-13T23:05:54.934809+0000","last_undegraded":"2024-09-13T23:05:54.934809+0000","last_fullsized":"2024-09-13T23:05:54.934809+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:38:10.583942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":355,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.205201+0000","last_change":"2024-09-13T23:05:20.135256+0000","last_active":"2024-09-13T23:08:21.205201+0000","last_peered":"2024-09-13T23:08:21.205201+0000","last_clean":"2024-09-13T23:08:21.205201+0000","last_became_active":"2024-09-13T23:05:20.133332+0000","last_became_peered":"2024-09-13T23:05:20.133332+0000","last_unstale":"2024-09-13T23:08:21.205201+0000","last_undegraded":"2024-09-13T23:08:21.205201+0000","last_fullsized":"2024-09-13T23:08:21.205201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:33.653779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.163699+0000","last_change":"2024-09-13T23:05:22.141887+0000","last_active":"2024-09-13T23:05:49.163699+0000","last_peered":"2024-09-13T23:05:49.163699+0000","last_clean":"2024-09-13T23:05:49.163699+0000","last_became_active":"2024-09-13T23:05:22.141618+0000","last_became_peered":"2024-09-13T23:05:22.141618+0000","last_unstale":"2024-09-13T23:05:49.163699+0000","last_undegraded":"2024-09-13T23:05:49.163699+0000","last_fullsized":"2024-09-13T23:05:49.163699+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:46.604024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'18","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.250583+0000","last_change":"2024-09-13T23:05:14.126543+0000","last_active":"2024-09-13T23:08:22.250583+0000","last_peered":"2024-09-13T23:08:22.250583+0000","last_clean":"2024-09-13T23:08:22.250583+0000","last_became_active":"2024-09-13T23:05:14.126280+0000","last_became_peered":"2024-09-13T23:05:14.126280+0000","last_unstale":"2024-09-13T23:08:22.250583+0000","last_undegraded":"2024-09-13T23:08:22.250583+0000","last_fullsized":"2024-09-13T23:08:22.250583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:15.304261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.921469+0000","last_change":"2024-09-13T23:05:12.149880+0000","last_active":"2024-09-13T23:05:54.921469+0000","last_peered":"2024-09-13T23:05:54.921469+0000","last_clean":"2024-09-13T23:05:54.921469+0000","last_became_active":"2024-09-13T23:05:12.149435+0000","last_became_peered":"2024-09-13T23:05:12.149435+0000","last_unstale":"2024-09-13T23:05:54.921469+0000","last_undegraded":"2024-09-13T23:05:54.921469+0000","last_fullsized":"2024-09-13T23:05:54.921469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:24.657126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160425+0000","last_change":"2024-09-13T23:05:03.080603+0000","last_active":"2024-09-13T23:05:49.160425+0000","last_peered":"2024-09-13T23:05:49.160425+0000","last_clean":"2024-09-13T23:05:49.160425+0000","last_became_active":"2024-09-13T23:05:01.074982+0000","last_became_peered":"2024-09-13T23:05:01.074982+0000","last_unstale":"2024-09-13T23:05:49.160425+0000","last_undegraded":"2024-09-13T23:05:49.160425+0000","last_fullsized":"2024-09-13T23:05:49.160425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:59:19.159167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054650599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155383+0000","last_change":"2024-09-13T23:05:16.123838+0000","last_active":"2024-09-13T23:05:49.155383+0000","last_peered":"2024-09-13T23:05:49.155383+0000","last_clean":"2024-09-13T23:05:49.155383+0000","last_became_active":"2024-09-13T23:05:16.123573+0000","last_became_peered":"2024-09-13T23:05:16.123573+0000","last_unstale":"2024-09-13T23:05:49.155383+0000","last_undegraded":"2024-09-13T23:05:49.155383+0000","last_fullsized":"2024-09-13T23:05:49.155383+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:46.249000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.455631+0000","last_change":"2024-09-13T23:05:18.132921+0000","last_active":"2024-09-13T23:06:37.455631+0000","last_peered":"2024-09-13T23:06:37.455631+0000","last_clean":"2024-09-13T23:06:37.455631+0000","last_became_active":"2024-09-13T23:05:18.132140+0000","last_became_peered":"2024-09-13T23:05:18.132140+0000","last_unstale":"2024-09-13T23:06:37.455631+0000","last_undegraded":"2024-09-13T23:06:37.455631+0000","last_fullsized":"2024-09-13T23:06:37.455631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:50.731504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'282","reported_seq":429,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.583662+0000","last_change":"2024-09-13T23:05:20.136524+0000","last_active":"2024-09-13T23:08:22.583662+0000","last_peered":"2024-09-13T23:08:22.583662+0000","last_clean":"2024-09-13T23:08:22.583662+0000","last_became_active":"2024-09-13T23:05:20.136036+0000","last_became_peered":"2024-09-13T23:05:20.136036+0000","last_unstale":"2024-09-13T23:08:22.583662+0000","last_undegraded":"2024-09-13T23:08:22.583662+0000","last_fullsized":"2024-09-13T23:08:22.583662+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:01:43.280761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157235+0000","last_change":"2024-09-13T23:05:22.145082+0000","last_active":"2024-09-13T23:05:49.157235+0000","last_peered":"2024-09-13T23:05:49.157235+0000","last_clean":"2024-09-13T23:05:49.157235+0000","last_became_active":"2024-09-13T23:05:22.144787+0000","last_became_peered":"2024-09-13T23:05:22.144787+0000","last_unstale":"2024-09-13T23:05:49.157235+0000","last_undegraded":"2024-09-13T23:05:49.157235+0000","last_fullsized":"2024-09-13T23:05:49.157235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:59.821393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.702234+0000","last_change":"2024-09-13T23:05:14.112813+0000","last_active":"2024-09-13T23:05:54.702234+0000","last_peered":"2024-09-13T23:05:54.702234+0000","last_clean":"2024-09-13T23:05:54.702234+0000","last_became_active":"2024-09-13T23:05:14.112565+0000","last_became_peered":"2024-09-13T23:05:14.112565+0000","last_unstale":"2024-09-13T23:05:54.702234+0000","last_undegraded":"2024-09-13T23:05:54.702234+0000","last_fullsized":"2024-09-13T23:05:54.702234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:50.584375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156509+0000","last_change":"2024-09-13T23:05:12.131805+0000","last_active":"2024-09-13T23:05:49.156509+0000","last_peered":"2024-09-13T23:05:49.156509+0000","last_clean":"2024-09-13T23:05:49.156509+0000","last_became_active":"2024-09-13T23:05:12.131413+0000","last_became_peered":"2024-09-13T23:05:12.131413+0000","last_unstale":"2024-09-13T23:05:49.156509+0000","last_undegraded":"2024-09-13T23:05:49.156509+0000","last_fullsized":"2024-09-13T23:05:49.156509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:58.196248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.164465+0000","last_change":"2024-09-13T23:05:03.078956+0000","last_active":"2024-09-13T23:05:49.164465+0000","last_peered":"2024-09-13T23:05:49.164465+0000","last_clean":"2024-09-13T23:05:49.164465+0000","last_became_active":"2024-09-13T23:05:01.323761+0000","last_became_peered":"2024-09-13T23:05:01.323761+0000","last_unstale":"2024-09-13T23:05:49.164465+0000","last_undegraded":"2024-09-13T23:05:49.164465+0000","last_fullsized":"2024-09-13T23:05:49.164465+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:39.972272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001181893,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157273+0000","last_change":"2024-09-13T23:05:16.121458+0000","last_active":"2024-09-13T23:05:49.157273+0000","last_peered":"2024-09-13T23:05:49.157273+0000","last_clean":"2024-09-13T23:05:49.157273+0000","last_became_active":"2024-09-13T23:05:16.120974+0000","last_became_peered":"2024-09-13T23:05:16.120974+0000","last_unstale":"2024-09-13T23:05:49.157273+0000","last_undegraded":"2024-09-13T23:05:49.157273+0000","last_fullsized":"2024-09-13T23:05:49.157273+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:12.719474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'82","reported_seq":154,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.723056+0000","last_change":"2024-09-13T23:05:18.138165+0000","last_active":"2024-09-13T23:07:19.723056+0000","last_peered":"2024-09-13T23:07:19.723056+0000","last_clean":"2024-09-13T23:07:19.723056+0000","last_became_active":"2024-09-13T23:05:18.137925+0000","last_became_peered":"2024-09-13T23:05:18.137925+0000","last_unstale":"2024-09-13T23:07:19.723056+0000","last_undegraded":"2024-09-13T23:07:19.723056+0000","last_fullsized":"2024-09-13T23:07:19.723056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:15.845937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158600+0000","last_change":"2024-09-13T23:05:20.129880+0000","last_active":"2024-09-13T23:05:49.158600+0000","last_peered":"2024-09-13T23:05:49.158600+0000","last_clean":"2024-09-13T23:05:49.158600+0000","last_became_active":"2024-09-13T23:05:20.129363+0000","last_became_peered":"2024-09-13T23:05:20.129363+0000","last_unstale":"2024-09-13T23:05:49.158600+0000","last_undegraded":"2024-09-13T23:05:49.158600+0000","last_fullsized":"2024-09-13T23:05:49.158600+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:50.629881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157130+0000","last_change":"2024-09-13T23:05:22.151007+0000","last_active":"2024-09-13T23:05:49.157130+0000","last_peered":"2024-09-13T23:05:49.157130+0000","last_clean":"2024-09-13T23:05:49.157130+0000","last_became_active":"2024-09-13T23:05:22.149645+0000","last_became_peered":"2024-09-13T23:05:22.149645+0000","last_unstale":"2024-09-13T23:05:49.157130+0000","last_undegraded":"2024-09-13T23:05:49.157130+0000","last_fullsized":"2024-09-13T23:05:49.157130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:14.228653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160576+0000","last_change":"2024-09-13T23:05:22.151921+0000","last_active":"2024-09-13T23:05:49.160576+0000","last_peered":"2024-09-13T23:05:49.160576+0000","last_clean":"2024-09-13T23:05:49.160576+0000","last_became_active":"2024-09-13T23:05:22.151640+0000","last_became_peered":"2024-09-13T23:05:22.151640+0000","last_unstale":"2024-09-13T23:05:49.160576+0000","last_undegraded":"2024-09-13T23:05:49.160576+0000","last_fullsized":"2024-09-13T23:05:49.160576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:38:24.891059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'12","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.323823+0000","last_change":"2024-09-13T23:05:14.113491+0000","last_active":"2024-09-13T23:08:22.323823+0000","last_peered":"2024-09-13T23:08:22.323823+0000","last_clean":"2024-09-13T23:08:22.323823+0000","last_became_active":"2024-09-13T23:05:14.113236+0000","last_became_peered":"2024-09-13T23:05:14.113236+0000","last_unstale":"2024-09-13T23:08:22.323823+0000","last_undegraded":"2024-09-13T23:08:22.323823+0000","last_fullsized":"2024-09-13T23:08:22.323823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:05:09.963242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159820+0000","last_change":"2024-09-13T23:05:12.141658+0000","last_active":"2024-09-13T23:05:49.159820+0000","last_peered":"2024-09-13T23:05:49.159820+0000","last_clean":"2024-09-13T23:05:49.159820+0000","last_became_active":"2024-09-13T23:05:12.141280+0000","last_became_peered":"2024-09-13T23:05:12.141280+0000","last_unstale":"2024-09-13T23:05:49.159820+0000","last_undegraded":"2024-09-13T23:05:49.159820+0000","last_fullsized":"2024-09-13T23:05:49.159820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:07:17.099012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158953+0000","last_change":"2024-09-13T23:05:16.117775+0000","last_active":"2024-09-13T23:05:49.158953+0000","last_peered":"2024-09-13T23:05:49.158953+0000","last_clean":"2024-09-13T23:05:49.158953+0000","last_became_active":"2024-09-13T23:05:16.117468+0000","last_became_peered":"2024-09-13T23:05:16.117468+0000","last_unstale":"2024-09-13T23:05:49.158953+0000","last_undegraded":"2024-09-13T23:05:49.158953+0000","last_fullsized":"2024-09-13T23:05:49.158953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:24.938916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'34","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079072+0000","last_change":"2024-09-13T23:05:18.132556+0000","last_active":"2024-09-13T23:07:42.079072+0000","last_peered":"2024-09-13T23:07:42.079072+0000","last_clean":"2024-09-13T23:07:42.079072+0000","last_became_active":"2024-09-13T23:05:18.131841+0000","last_became_peered":"2024-09-13T23:05:18.131841+0000","last_unstale":"2024-09-13T23:07:42.079072+0000","last_undegraded":"2024-09-13T23:07:42.079072+0000","last_fullsized":"2024-09-13T23:07:42.079072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:38.696780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158497+0000","last_change":"2024-09-13T23:05:20.140436+0000","last_active":"2024-09-13T23:05:49.158497+0000","last_peered":"2024-09-13T23:05:49.158497+0000","last_clean":"2024-09-13T23:05:49.158497+0000","last_became_active":"2024-09-13T23:05:20.138958+0000","last_became_peered":"2024-09-13T23:05:20.138958+0000","last_unstale":"2024-09-13T23:05:49.158497+0000","last_undegraded":"2024-09-13T23:05:49.158497+0000","last_fullsized":"2024-09-13T23:05:49.158497+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:06.294003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.301319+0000","last_change":"2024-09-13T23:05:22.141828+0000","last_active":"2024-09-13T23:08:22.301319+0000","last_peered":"2024-09-13T23:08:22.301319+0000","last_clean":"2024-09-13T23:08:22.301319+0000","last_became_active":"2024-09-13T23:05:22.141471+0000","last_became_peered":"2024-09-13T23:05:22.141471+0000","last_unstale":"2024-09-13T23:08:22.301319+0000","last_undegraded":"2024-09-13T23:08:22.301319+0000","last_fullsized":"2024-09-13T23:08:22.301319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:03:42.989142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'7","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:38.077521+0000","last_change":"2024-09-13T23:05:49.167955+0000","last_active":"2024-09-13T23:07:38.077521+0000","last_peered":"2024-09-13T23:07:38.077521+0000","last_clean":"2024-09-13T23:07:38.077521+0000","last_became_active":"2024-09-13T23:05:49.164131+0000","last_became_peered":"2024-09-13T23:05:49.164131+0000","last_unstale":"2024-09-13T23:07:38.077521+0000","last_undegraded":"2024-09-13T23:07:38.077521+0000","last_fullsized":"2024-09-13T23:07:38.077521+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:24.539346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.227909+0000","last_change":"2024-09-13T23:05:12.116495+0000","last_active":"2024-09-13T23:08:22.227909+0000","last_peered":"2024-09-13T23:08:22.227909+0000","last_clean":"2024-09-13T23:08:22.227909+0000","last_became_active":"2024-09-13T23:05:12.114343+0000","last_became_peered":"2024-09-13T23:05:12.114343+0000","last_unstale":"2024-09-13T23:08:22.227909+0000","last_undegraded":"2024-09-13T23:08:22.227909+0000","last_fullsized":"2024-09-13T23:08:22.227909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:32:52.891315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.162345+0000","last_change":"2024-09-13T23:05:49.160922+0000","last_active":"2024-09-13T23:05:49.162345+0000","last_peered":"2024-09-13T23:05:49.162345+0000","last_clean":"2024-09-13T23:05:49.162345+0000","last_became_active":"2024-09-13T23:05:49.160578+0000","last_became_peered":"2024-09-13T23:05:49.160578+0000","last_unstale":"2024-09-13T23:05:49.162345+0000","last_undegraded":"2024-09-13T23:05:49.162345+0000","last_fullsized":"2024-09-13T23:05:49.162345+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:35:20.664758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.511579+0000","last_change":"2024-09-13T23:05:18.121852+0000","last_active":"2024-09-13T23:08:21.511579+0000","last_peered":"2024-09-13T23:08:21.511579+0000","last_clean":"2024-09-13T23:08:21.511579+0000","last_became_active":"2024-09-13T23:05:18.121514+0000","last_became_peered":"2024-09-13T23:05:18.121514+0000","last_unstale":"2024-09-13T23:08:21.511579+0000","last_undegraded":"2024-09-13T23:08:21.511579+0000","last_fullsized":"2024-09-13T23:08:21.511579+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:00.097701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.152954+0000","last_change":"2024-09-13T23:05:20.140562+0000","last_active":"2024-09-13T23:05:49.152954+0000","last_peered":"2024-09-13T23:05:49.152954+0000","last_clean":"2024-09-13T23:05:49.152954+0000","last_became_active":"2024-09-13T23:05:20.140290+0000","last_became_peered":"2024-09-13T23:05:20.140290+0000","last_unstale":"2024-09-13T23:05:49.152954+0000","last_undegraded":"2024-09-13T23:05:49.152954+0000","last_fullsized":"2024-09-13T23:05:49.152954+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:10.783457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159676+0000","last_change":"2024-09-13T23:05:22.141270+0000","last_active":"2024-09-13T23:05:49.159676+0000","last_peered":"2024-09-13T23:05:49.159676+0000","last_clean":"2024-09-13T23:05:49.159676+0000","last_became_active":"2024-09-13T23:05:22.140963+0000","last_became_peered":"2024-09-13T23:05:22.140963+0000","last_unstale":"2024-09-13T23:05:49.159676+0000","last_undegraded":"2024-09-13T23:05:49.159676+0000","last_fullsized":"2024-09-13T23:05:49.159676+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:59.821393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.485370+0000","last_change":"2024-09-13T23:05:14.120821+0000","last_active":"2024-09-13T23:07:21.485370+0000","last_peered":"2024-09-13T23:07:21.485370+0000","last_clean":"2024-09-13T23:07:21.485370+0000","last_became_active":"2024-09-13T23:05:14.120354+0000","last_became_peered":"2024-09-13T23:05:14.120354+0000","last_unstale":"2024-09-13T23:07:21.485370+0000","last_undegraded":"2024-09-13T23:07:21.485370+0000","last_fullsized":"2024-09-13T23:07:21.485370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:55.219034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158478+0000","last_change":"2024-09-13T23:05:12.117147+0000","last_active":"2024-09-13T23:05:49.158478+0000","last_peered":"2024-09-13T23:05:49.158478+0000","last_clean":"2024-09-13T23:05:49.158478+0000","last_became_active":"2024-09-13T23:05:12.116819+0000","last_became_peered":"2024-09-13T23:05:12.116819+0000","last_unstale":"2024-09-13T23:05:49.158478+0000","last_undegraded":"2024-09-13T23:05:49.158478+0000","last_fullsized":"2024-09-13T23:05:49.158478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:23:49.530592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.152948+0000","last_change":"2024-09-13T23:05:16.124923+0000","last_active":"2024-09-13T23:05:49.152948+0000","last_peered":"2024-09-13T23:05:49.152948+0000","last_clean":"2024-09-13T23:05:49.152948+0000","last_became_active":"2024-09-13T23:05:16.124617+0000","last_became_peered":"2024-09-13T23:05:16.124617+0000","last_unstale":"2024-09-13T23:05:49.152948+0000","last_undegraded":"2024-09-13T23:05:49.152948+0000","last_fullsized":"2024-09-13T23:05:49.152948+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:44.922754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'40","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.638205+0000","last_change":"2024-09-13T23:05:18.126438+0000","last_active":"2024-09-13T23:08:21.638205+0000","last_peered":"2024-09-13T23:08:21.638205+0000","last_clean":"2024-09-13T23:08:21.638205+0000","last_became_active":"2024-09-13T23:05:18.126147+0000","last_became_peered":"2024-09-13T23:05:18.126147+0000","last_unstale":"2024-09-13T23:08:21.638205+0000","last_undegraded":"2024-09-13T23:08:21.638205+0000","last_fullsized":"2024-09-13T23:08:21.638205+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:02:19.823621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158713+0000","last_change":"2024-09-13T23:05:20.129082+0000","last_active":"2024-09-13T23:05:49.158713+0000","last_peered":"2024-09-13T23:05:49.158713+0000","last_clean":"2024-09-13T23:05:49.158713+0000","last_became_active":"2024-09-13T23:05:20.128756+0000","last_became_peered":"2024-09-13T23:05:20.128756+0000","last_unstale":"2024-09-13T23:05:49.158713+0000","last_undegraded":"2024-09-13T23:05:49.158713+0000","last_fullsized":"2024-09-13T23:05:49.158713+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:31.349343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157781+0000","last_change":"2024-09-13T23:05:22.144728+0000","last_active":"2024-09-13T23:05:49.157781+0000","last_peered":"2024-09-13T23:05:49.157781+0000","last_clean":"2024-09-13T23:05:49.157781+0000","last_became_active":"2024-09-13T23:05:22.143767+0000","last_became_peered":"2024-09-13T23:05:22.143767+0000","last_unstale":"2024-09-13T23:05:49.157781+0000","last_undegraded":"2024-09-13T23:05:49.157781+0000","last_fullsized":"2024-09-13T23:05:49.157781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:26.361850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157765+0000","last_change":"2024-09-13T23:05:14.127475+0000","last_active":"2024-09-13T23:05:49.157765+0000","last_peered":"2024-09-13T23:05:49.157765+0000","last_clean":"2024-09-13T23:05:49.157765+0000","last_became_active":"2024-09-13T23:05:14.127000+0000","last_became_peered":"2024-09-13T23:05:14.127000+0000","last_unstale":"2024-09-13T23:05:49.157765+0000","last_undegraded":"2024-09-13T23:05:49.157765+0000","last_fullsized":"2024-09-13T23:05:49.157765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:10:50.930163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158496+0000","last_change":"2024-09-13T23:05:12.136754+0000","last_active":"2024-09-13T23:05:49.158496+0000","last_peered":"2024-09-13T23:05:49.158496+0000","last_clean":"2024-09-13T23:05:49.158496+0000","last_became_active":"2024-09-13T23:05:12.136384+0000","last_became_peered":"2024-09-13T23:05:12.136384+0000","last_unstale":"2024-09-13T23:05:49.158496+0000","last_undegraded":"2024-09-13T23:05:49.158496+0000","last_fullsized":"2024-09-13T23:05:49.158496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:43.763766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155297+0000","last_change":"2024-09-13T23:05:16.124513+0000","last_active":"2024-09-13T23:05:49.155297+0000","last_peered":"2024-09-13T23:05:49.155297+0000","last_clean":"2024-09-13T23:05:49.155297+0000","last_became_active":"2024-09-13T23:05:16.124241+0000","last_became_peered":"2024-09-13T23:05:16.124241+0000","last_unstale":"2024-09-13T23:05:49.155297+0000","last_undegraded":"2024-09-13T23:05:49.155297+0000","last_fullsized":"2024-09-13T23:05:49.155297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:03:40.217865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'31","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.487313+0000","last_change":"2024-09-13T23:05:18.126644+0000","last_active":"2024-09-13T23:07:21.487313+0000","last_peered":"2024-09-13T23:07:21.487313+0000","last_clean":"2024-09-13T23:07:21.487313+0000","last_became_active":"2024-09-13T23:05:18.126188+0000","last_became_peered":"2024-09-13T23:05:18.126188+0000","last_unstale":"2024-09-13T23:07:21.487313+0000","last_undegraded":"2024-09-13T23:07:21.487313+0000","last_fullsized":"2024-09-13T23:07:21.487313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:56.228755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.153697+0000","last_change":"2024-09-13T23:05:20.136386+0000","last_active":"2024-09-13T23:05:49.153697+0000","last_peered":"2024-09-13T23:05:49.153697+0000","last_clean":"2024-09-13T23:05:49.153697+0000","last_became_active":"2024-09-13T23:05:20.136098+0000","last_became_peered":"2024-09-13T23:05:20.136098+0000","last_unstale":"2024-09-13T23:05:49.153697+0000","last_undegraded":"2024-09-13T23:05:49.153697+0000","last_fullsized":"2024-09-13T23:05:49.153697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:47:24.641764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'14","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.321638+0000","last_change":"2024-09-13T23:05:14.113061+0000","last_active":"2024-09-13T23:08:22.321638+0000","last_peered":"2024-09-13T23:08:22.321638+0000","last_clean":"2024-09-13T23:08:22.321638+0000","last_became_active":"2024-09-13T23:05:14.112822+0000","last_became_peered":"2024-09-13T23:05:14.112822+0000","last_unstale":"2024-09-13T23:08:22.321638+0000","last_undegraded":"2024-09-13T23:08:22.321638+0000","last_fullsized":"2024-09-13T23:08:22.321638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:52:37.741998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:53.841518+0000","last_change":"2024-09-13T23:05:12.143550+0000","last_active":"2024-09-13T23:05:53.841518+0000","last_peered":"2024-09-13T23:05:53.841518+0000","last_clean":"2024-09-13T23:05:53.841518+0000","last_became_active":"2024-09-13T23:05:12.141970+0000","last_became_peered":"2024-09-13T23:05:12.141970+0000","last_unstale":"2024-09-13T23:05:53.841518+0000","last_undegraded":"2024-09-13T23:05:53.841518+0000","last_fullsized":"2024-09-13T23:05:53.841518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:20.698878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160495+0000","last_change":"2024-09-13T23:05:16.120920+0000","last_active":"2024-09-13T23:05:49.160495+0000","last_peered":"2024-09-13T23:05:49.160495+0000","last_clean":"2024-09-13T23:05:49.160495+0000","last_became_active":"2024-09-13T23:05:16.120506+0000","last_became_peered":"2024-09-13T23:05:16.120506+0000","last_unstale":"2024-09-13T23:05:49.160495+0000","last_undegraded":"2024-09-13T23:05:49.160495+0000","last_fullsized":"2024-09-13T23:05:49.160495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:05.377747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'56","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.735394+0000","last_change":"2024-09-13T23:05:18.127151+0000","last_active":"2024-09-13T23:07:19.735394+0000","last_peered":"2024-09-13T23:07:19.735394+0000","last_clean":"2024-09-13T23:07:19.735394+0000","last_became_active":"2024-09-13T23:05:18.126811+0000","last_became_peered":"2024-09-13T23:05:18.126811+0000","last_unstale":"2024-09-13T23:07:19.735394+0000","last_undegraded":"2024-09-13T23:07:19.735394+0000","last_fullsized":"2024-09-13T23:07:19.735394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:48.016939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":61,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.154053+0000","last_change":"2024-09-13T23:05:20.136237+0000","last_active":"2024-09-13T23:05:49.154053+0000","last_peered":"2024-09-13T23:05:49.154053+0000","last_clean":"2024-09-13T23:05:49.154053+0000","last_became_active":"2024-09-13T23:05:20.135886+0000","last_became_peered":"2024-09-13T23:05:20.135886+0000","last_unstale":"2024-09-13T23:05:49.154053+0000","last_undegraded":"2024-09-13T23:05:49.154053+0000","last_fullsized":"2024-09-13T23:05:49.154053+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:48:40.909454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.325312+0000","last_change":"2024-09-13T23:05:22.147716+0000","last_active":"2024-09-13T23:08:22.325312+0000","last_peered":"2024-09-13T23:08:22.325312+0000","last_clean":"2024-09-13T23:08:22.325312+0000","last_became_active":"2024-09-13T23:05:22.147394+0000","last_became_peered":"2024-09-13T23:05:22.147394+0000","last_unstale":"2024-09-13T23:08:22.325312+0000","last_undegraded":"2024-09-13T23:08:22.325312+0000","last_fullsized":"2024-09-13T23:08:22.325312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:04:57.442372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362850+0000","last_change":"2024-09-13T23:05:14.121676+0000","last_active":"2024-09-13T23:08:22.362850+0000","last_peered":"2024-09-13T23:08:22.362850+0000","last_clean":"2024-09-13T23:08:22.362850+0000","last_became_active":"2024-09-13T23:05:14.121349+0000","last_became_peered":"2024-09-13T23:05:14.121349+0000","last_unstale":"2024-09-13T23:08:22.362850+0000","last_undegraded":"2024-09-13T23:08:22.362850+0000","last_fullsized":"2024-09-13T23:08:22.362850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:57:39.861849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156531+0000","last_change":"2024-09-13T23:05:12.139567+0000","last_active":"2024-09-13T23:05:49.156531+0000","last_peered":"2024-09-13T23:05:49.156531+0000","last_clean":"2024-09-13T23:05:49.156531+0000","last_became_active":"2024-09-13T23:05:12.137092+0000","last_became_peered":"2024-09-13T23:05:12.137092+0000","last_unstale":"2024-09-13T23:05:49.156531+0000","last_undegraded":"2024-09-13T23:05:49.156531+0000","last_fullsized":"2024-09-13T23:05:49.156531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:26.997997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.161054+0000","last_change":"2024-09-13T23:05:16.121760+0000","last_active":"2024-09-13T23:05:49.161054+0000","last_peered":"2024-09-13T23:05:49.161054+0000","last_clean":"2024-09-13T23:05:49.161054+0000","last_became_active":"2024-09-13T23:05:16.121476+0000","last_became_peered":"2024-09-13T23:05:16.121476+0000","last_unstale":"2024-09-13T23:05:49.161054+0000","last_undegraded":"2024-09-13T23:05:49.161054+0000","last_fullsized":"2024-09-13T23:05:49.161054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:26:03.131986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.715418+0000","last_change":"2024-09-13T23:05:18.132726+0000","last_active":"2024-09-13T23:07:19.715418+0000","last_peered":"2024-09-13T23:07:19.715418+0000","last_clean":"2024-09-13T23:07:19.715418+0000","last_became_active":"2024-09-13T23:05:18.132060+0000","last_became_peered":"2024-09-13T23:05:18.132060+0000","last_unstale":"2024-09-13T23:07:19.715418+0000","last_undegraded":"2024-09-13T23:07:19.715418+0000","last_fullsized":"2024-09-13T23:07:19.715418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:03.383636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155314+0000","last_change":"2024-09-13T23:05:20.140626+0000","last_active":"2024-09-13T23:05:49.155314+0000","last_peered":"2024-09-13T23:05:49.155314+0000","last_clean":"2024-09-13T23:05:49.155314+0000","last_became_active":"2024-09-13T23:05:20.140333+0000","last_became_peered":"2024-09-13T23:05:20.140333+0000","last_unstale":"2024-09-13T23:05:49.155314+0000","last_undegraded":"2024-09-13T23:05:49.155314+0000","last_fullsized":"2024-09-13T23:05:49.155314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:54:01.951032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155007+0000","last_change":"2024-09-13T23:05:22.140239+0000","last_active":"2024-09-13T23:05:49.155007+0000","last_peered":"2024-09-13T23:05:49.155007+0000","last_clean":"2024-09-13T23:05:49.155007+0000","last_became_active":"2024-09-13T23:05:22.139984+0000","last_became_peered":"2024-09-13T23:05:22.139984+0000","last_unstale":"2024-09-13T23:05:49.155007+0000","last_undegraded":"2024-09-13T23:05:49.155007+0000","last_fullsized":"2024-09-13T23:05:49.155007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:58.124207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362755+0000","last_change":"2024-09-13T23:05:14.125224+0000","last_active":"2024-09-13T23:08:22.362755+0000","last_peered":"2024-09-13T23:08:22.362755+0000","last_clean":"2024-09-13T23:08:22.362755+0000","last_became_active":"2024-09-13T23:05:14.124660+0000","last_became_peered":"2024-09-13T23:05:14.124660+0000","last_unstale":"2024-09-13T23:08:22.362755+0000","last_undegraded":"2024-09-13T23:08:22.362755+0000","last_fullsized":"2024-09-13T23:08:22.362755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:48.609572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159133+0000","last_change":"2024-09-13T23:05:12.141582+0000","last_active":"2024-09-13T23:05:49.159133+0000","last_peered":"2024-09-13T23:05:49.159133+0000","last_clean":"2024-09-13T23:05:49.159133+0000","last_became_active":"2024-09-13T23:05:12.137136+0000","last_became_peered":"2024-09-13T23:05:12.137136+0000","last_unstale":"2024-09-13T23:05:49.159133+0000","last_undegraded":"2024-09-13T23:05:49.159133+0000","last_fullsized":"2024-09-13T23:05:49.159133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:20.740109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157357+0000","last_change":"2024-09-13T23:05:16.123946+0000","last_active":"2024-09-13T23:05:49.157357+0000","last_peered":"2024-09-13T23:05:49.157357+0000","last_clean":"2024-09-13T23:05:49.157357+0000","last_became_active":"2024-09-13T23:05:16.123607+0000","last_became_peered":"2024-09-13T23:05:16.123607+0000","last_unstale":"2024-09-13T23:05:49.157357+0000","last_undegraded":"2024-09-13T23:05:49.157357+0000","last_fullsized":"2024-09-13T23:05:49.157357+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:28.671096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'32","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.733164+0000","last_change":"2024-09-13T23:05:18.136609+0000","last_active":"2024-09-13T23:07:19.733164+0000","last_peered":"2024-09-13T23:07:19.733164+0000","last_clean":"2024-09-13T23:07:19.733164+0000","last_became_active":"2024-09-13T23:05:18.136279+0000","last_became_peered":"2024-09-13T23:05:18.136279+0000","last_unstale":"2024-09-13T23:07:19.733164+0000","last_undegraded":"2024-09-13T23:07:19.733164+0000","last_fullsized":"2024-09-13T23:07:19.733164+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:59.720739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160101+0000","last_change":"2024-09-13T23:05:20.141584+0000","last_active":"2024-09-13T23:05:49.160101+0000","last_peered":"2024-09-13T23:05:49.160101+0000","last_clean":"2024-09-13T23:05:49.160101+0000","last_became_active":"2024-09-13T23:05:20.141266+0000","last_became_peered":"2024-09-13T23:05:20.141266+0000","last_unstale":"2024-09-13T23:05:49.160101+0000","last_undegraded":"2024-09-13T23:05:49.160101+0000","last_fullsized":"2024-09-13T23:05:49.160101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:54:01.951032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'9","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.481681+0000","last_change":"2024-09-13T23:05:22.151767+0000","last_active":"2024-09-13T23:07:21.481681+0000","last_peered":"2024-09-13T23:07:21.481681+0000","last_clean":"2024-09-13T23:07:21.481681+0000","last_became_active":"2024-09-13T23:05:22.151339+0000","last_became_peered":"2024-09-13T23:05:22.151339+0000","last_unstale":"2024-09-13T23:07:21.481681+0000","last_undegraded":"2024-09-13T23:07:21.481681+0000","last_fullsized":"2024-09-13T23:07:21.481681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:27:36.638035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.322085+0000","last_change":"2024-09-13T23:05:14.112792+0000","last_active":"2024-09-13T23:08:22.322085+0000","last_peered":"2024-09-13T23:08:22.322085+0000","last_clean":"2024-09-13T23:08:22.322085+0000","last_became_active":"2024-09-13T23:05:14.112175+0000","last_became_peered":"2024-09-13T23:05:14.112175+0000","last_unstale":"2024-09-13T23:08:22.322085+0000","last_undegraded":"2024-09-13T23:08:22.322085+0000","last_fullsized":"2024-09-13T23:08:22.322085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:39.333340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159759+0000","last_change":"2024-09-13T23:05:12.141910+0000","last_active":"2024-09-13T23:05:49.159759+0000","last_peered":"2024-09-13T23:05:49.159759+0000","last_clean":"2024-09-13T23:05:49.159759+0000","last_became_active":"2024-09-13T23:05:12.141459+0000","last_became_peered":"2024-09-13T23:05:12.141459+0000","last_unstale":"2024-09-13T23:05:49.159759+0000","last_undegraded":"2024-09-13T23:05:49.159759+0000","last_fullsized":"2024-09-13T23:05:49.159759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:48.232382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"34'4","reported_seq":226,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:20.828655+0000","last_change":"2024-09-13T23:05:16.118050+0000","last_active":"2024-09-13T23:07:20.828655+0000","last_peered":"2024-09-13T23:07:20.828655+0000","last_clean":"2024-09-13T23:07:20.828655+0000","last_became_active":"2024-09-13T23:05:16.117736+0000","last_became_peered":"2024-09-13T23:05:16.117736+0000","last_unstale":"2024-09-13T23:07:20.828655+0000","last_undegraded":"2024-09-13T23:07:20.828655+0000","last_fullsized":"2024-09-13T23:07:20.828655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:34:57.565004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.163113+0000","last_change":"2024-09-13T23:05:18.133743+0000","last_active":"2024-09-13T23:05:49.163113+0000","last_peered":"2024-09-13T23:05:49.163113+0000","last_clean":"2024-09-13T23:05:49.163113+0000","last_became_active":"2024-09-13T23:05:18.132507+0000","last_became_peered":"2024-09-13T23:05:18.132507+0000","last_unstale":"2024-09-13T23:05:49.163113+0000","last_undegraded":"2024-09-13T23:05:49.163113+0000","last_fullsized":"2024-09-13T23:05:49.163113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:25:07.613170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":417,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.367435+0000","last_change":"2024-09-13T23:05:20.144647+0000","last_active":"2024-09-13T23:08:22.367435+0000","last_peered":"2024-09-13T23:08:22.367435+0000","last_clean":"2024-09-13T23:08:22.367435+0000","last_became_active":"2024-09-13T23:05:20.144334+0000","last_became_peered":"2024-09-13T23:05:20.144334+0000","last_unstale":"2024-09-13T23:08:22.367435+0000","last_undegraded":"2024-09-13T23:08:22.367435+0000","last_fullsized":"2024-09-13T23:08:22.367435+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:55.153699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156789+0000","last_change":"2024-09-13T23:05:22.149167+0000","last_active":"2024-09-13T23:05:49.156789+0000","last_peered":"2024-09-13T23:05:49.156789+0000","last_clean":"2024-09-13T23:05:49.156789+0000","last_became_active":"2024-09-13T23:05:22.148894+0000","last_became_peered":"2024-09-13T23:05:22.148894+0000","last_unstale":"2024-09-13T23:05:49.156789+0000","last_undegraded":"2024-09-13T23:05:49.156789+0000","last_fullsized":"2024-09-13T23:05:49.156789+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:15.779050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.469692+0000","last_change":"2024-09-13T23:05:14.112197+0000","last_active":"2024-09-13T23:08:22.469692+0000","last_peered":"2024-09-13T23:08:22.469692+0000","last_clean":"2024-09-13T23:08:22.469692+0000","last_became_active":"2024-09-13T23:05:14.111891+0000","last_became_peered":"2024-09-13T23:05:14.111891+0000","last_unstale":"2024-09-13T23:08:22.469692+0000","last_undegraded":"2024-09-13T23:08:22.469692+0000","last_fullsized":"2024-09-13T23:08:22.469692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:22.016474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158445+0000","last_change":"2024-09-13T23:05:12.139920+0000","last_active":"2024-09-13T23:05:49.158445+0000","last_peered":"2024-09-13T23:05:49.158445+0000","last_clean":"2024-09-13T23:05:49.158445+0000","last_became_active":"2024-09-13T23:05:12.139564+0000","last_became_peered":"2024-09-13T23:05:12.139564+0000","last_unstale":"2024-09-13T23:05:49.158445+0000","last_undegraded":"2024-09-13T23:05:49.158445+0000","last_fullsized":"2024-09-13T23:05:49.158445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:48:38.750102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158925+0000","last_change":"2024-09-13T23:05:16.118845+0000","last_active":"2024-09-13T23:05:49.158925+0000","last_peered":"2024-09-13T23:05:49.158925+0000","last_clean":"2024-09-13T23:05:49.158925+0000","last_became_active":"2024-09-13T23:05:16.118353+0000","last_became_peered":"2024-09-13T23:05:16.118353+0000","last_unstale":"2024-09-13T23:05:49.158925+0000","last_undegraded":"2024-09-13T23:05:49.158925+0000","last_fullsized":"2024-09-13T23:05:49.158925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:58.090312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.706353+0000","last_change":"2024-09-13T23:05:18.129142+0000","last_active":"2024-09-13T23:07:19.706353+0000","last_peered":"2024-09-13T23:07:19.706353+0000","last_clean":"2024-09-13T23:07:19.706353+0000","last_became_active":"2024-09-13T23:05:18.127975+0000","last_became_peered":"2024-09-13T23:05:18.127975+0000","last_unstale":"2024-09-13T23:07:19.706353+0000","last_undegraded":"2024-09-13T23:07:19.706353+0000","last_fullsized":"2024-09-13T23:07:19.706353+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:19:28.546902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158396+0000","last_change":"2024-09-13T23:05:20.139596+0000","last_active":"2024-09-13T23:05:49.158396+0000","last_peered":"2024-09-13T23:05:49.158396+0000","last_clean":"2024-09-13T23:05:49.158396+0000","last_became_active":"2024-09-13T23:05:20.139329+0000","last_became_peered":"2024-09-13T23:05:20.139329+0000","last_unstale":"2024-09-13T23:05:49.158396+0000","last_undegraded":"2024-09-13T23:05:49.158396+0000","last_fullsized":"2024-09-13T23:05:49.158396+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:14.460878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159092+0000","last_change":"2024-09-13T23:05:22.148249+0000","last_active":"2024-09-13T23:05:49.159092+0000","last_peered":"2024-09-13T23:05:49.159092+0000","last_clean":"2024-09-13T23:05:49.159092+0000","last_became_active":"2024-09-13T23:05:22.147949+0000","last_became_peered":"2024-09-13T23:05:22.147949+0000","last_unstale":"2024-09-13T23:05:49.159092+0000","last_undegraded":"2024-09-13T23:05:49.159092+0000","last_fullsized":"2024-09-13T23:05:49.159092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:07.578205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:55.392471+0000","last_change":"2024-09-13T23:05:14.114061+0000","last_active":"2024-09-13T23:05:55.392471+0000","last_peered":"2024-09-13T23:05:55.392471+0000","last_clean":"2024-09-13T23:05:55.392471+0000","last_became_active":"2024-09-13T23:05:14.113816+0000","last_became_peered":"2024-09-13T23:05:14.113816+0000","last_unstale":"2024-09-13T23:05:55.392471+0000","last_undegraded":"2024-09-13T23:05:55.392471+0000","last_fullsized":"2024-09-13T23:05:55.392471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:31:40.142550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.162049+0000","last_change":"2024-09-13T23:05:12.149692+0000","last_active":"2024-09-13T23:05:49.162049+0000","last_peered":"2024-09-13T23:05:49.162049+0000","last_clean":"2024-09-13T23:05:49.162049+0000","last_became_active":"2024-09-13T23:05:12.149292+0000","last_became_peered":"2024-09-13T23:05:12.149292+0000","last_unstale":"2024-09-13T23:05:49.162049+0000","last_undegraded":"2024-09-13T23:05:49.162049+0000","last_fullsized":"2024-09-13T23:05:49.162049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:05:07.956349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155102+0000","last_change":"2024-09-13T23:05:16.128264+0000","last_active":"2024-09-13T23:05:49.155102+0000","last_peered":"2024-09-13T23:05:49.155102+0000","last_clean":"2024-09-13T23:05:49.155102+0000","last_became_active":"2024-09-13T23:05:16.128023+0000","last_became_peered":"2024-09-13T23:05:16.128023+0000","last_unstale":"2024-09-13T23:05:49.155102+0000","last_undegraded":"2024-09-13T23:05:49.155102+0000","last_fullsized":"2024-09-13T23:05:49.155102+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:29.344309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.707477+0000","last_change":"2024-09-13T23:05:18.132864+0000","last_active":"2024-09-13T23:07:19.707477+0000","last_peered":"2024-09-13T23:07:19.707477+0000","last_clean":"2024-09-13T23:07:19.707477+0000","last_became_active":"2024-09-13T23:05:18.132579+0000","last_became_peered":"2024-09-13T23:05:18.132579+0000","last_unstale":"2024-09-13T23:07:19.707477+0000","last_undegraded":"2024-09-13T23:07:19.707477+0000","last_fullsized":"2024-09-13T23:07:19.707477+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:26.946305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.154964+0000","last_change":"2024-09-13T23:05:20.136330+0000","last_active":"2024-09-13T23:05:49.154964+0000","last_peered":"2024-09-13T23:05:49.154964+0000","last_clean":"2024-09-13T23:05:49.154964+0000","last_became_active":"2024-09-13T23:05:20.136023+0000","last_became_peered":"2024-09-13T23:05:20.136023+0000","last_unstale":"2024-09-13T23:05:49.154964+0000","last_undegraded":"2024-09-13T23:05:49.154964+0000","last_fullsized":"2024-09-13T23:05:49.154964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:54.602234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.162874+0000","last_change":"2024-09-13T23:05:22.149740+0000","last_active":"2024-09-13T23:05:49.162874+0000","last_peered":"2024-09-13T23:05:49.162874+0000","last_clean":"2024-09-13T23:05:49.162874+0000","last_became_active":"2024-09-13T23:05:22.149468+0000","last_became_peered":"2024-09-13T23:05:22.149468+0000","last_unstale":"2024-09-13T23:05:49.162874+0000","last_undegraded":"2024-09-13T23:05:49.162874+0000","last_fullsized":"2024-09-13T23:05:49.162874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:05.061174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079088+0000","last_change":"2024-09-13T23:05:14.109581+0000","last_active":"2024-09-13T23:07:42.079088+0000","last_peered":"2024-09-13T23:07:42.079088+0000","last_clean":"2024-09-13T23:07:42.079088+0000","last_became_active":"2024-09-13T23:05:14.109323+0000","last_became_peered":"2024-09-13T23:05:14.109323+0000","last_unstale":"2024-09-13T23:07:42.079088+0000","last_undegraded":"2024-09-13T23:07:42.079088+0000","last_fullsized":"2024-09-13T23:07:42.079088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:09.879028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160689+0000","last_change":"2024-09-13T23:05:12.121655+0000","last_active":"2024-09-13T23:05:49.160689+0000","last_peered":"2024-09-13T23:05:49.160689+0000","last_clean":"2024-09-13T23:05:49.160689+0000","last_became_active":"2024-09-13T23:05:12.121050+0000","last_became_peered":"2024-09-13T23:05:12.121050+0000","last_unstale":"2024-09-13T23:05:49.160689+0000","last_undegraded":"2024-09-13T23:05:49.160689+0000","last_fullsized":"2024-09-13T23:05:49.160689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:12.628284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"25'1","reported_seq":218,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:20.838539+0000","last_change":"2024-09-13T23:05:16.123977+0000","last_active":"2024-09-13T23:07:20.838539+0000","last_peered":"2024-09-13T23:07:20.838539+0000","last_clean":"2024-09-13T23:07:20.838539+0000","last_became_active":"2024-09-13T23:05:16.123673+0000","last_became_peered":"2024-09-13T23:05:16.123673+0000","last_unstale":"2024-09-13T23:07:20.838539+0000","last_undegraded":"2024-09-13T23:07:20.838539+0000","last_fullsized":"2024-09-13T23:07:20.838539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:04.185929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'26","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.731194+0000","last_change":"2024-09-13T23:05:18.134891+0000","last_active":"2024-09-13T23:07:19.731194+0000","last_peered":"2024-09-13T23:07:19.731194+0000","last_clean":"2024-09-13T23:07:19.731194+0000","last_became_active":"2024-09-13T23:05:18.134152+0000","last_became_peered":"2024-09-13T23:05:18.134152+0000","last_unstale":"2024-09-13T23:07:19.731194+0000","last_undegraded":"2024-09-13T23:07:19.731194+0000","last_fullsized":"2024-09-13T23:07:19.731194+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:38.762106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155513+0000","last_change":"2024-09-13T23:05:20.139704+0000","last_active":"2024-09-13T23:05:49.155513+0000","last_peered":"2024-09-13T23:05:49.155513+0000","last_clean":"2024-09-13T23:05:49.155513+0000","last_became_active":"2024-09-13T23:05:20.139133+0000","last_became_peered":"2024-09-13T23:05:20.139133+0000","last_unstale":"2024-09-13T23:05:49.155513+0000","last_undegraded":"2024-09-13T23:05:49.155513+0000","last_fullsized":"2024-09-13T23:05:49.155513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:54.483387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'12","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.740945+0000","last_change":"2024-09-13T23:05:22.144173+0000","last_active":"2024-09-13T23:07:19.740945+0000","last_peered":"2024-09-13T23:07:19.740945+0000","last_clean":"2024-09-13T23:07:19.740945+0000","last_became_active":"2024-09-13T23:05:22.143886+0000","last_became_peered":"2024-09-13T23:05:22.143886+0000","last_unstale":"2024-09-13T23:07:19.740945+0000","last_undegraded":"2024-09-13T23:07:19.740945+0000","last_fullsized":"2024-09-13T23:07:19.740945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:32.073594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":59,"num_write":33,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:55.392329+0000","last_change":"2024-09-13T23:05:14.112092+0000","last_active":"2024-09-13T23:05:55.392329+0000","last_peered":"2024-09-13T23:05:55.392329+0000","last_clean":"2024-09-13T23:05:55.392329+0000","last_became_active":"2024-09-13T23:05:14.111836+0000","last_became_peered":"2024-09-13T23:05:14.111836+0000","last_unstale":"2024-09-13T23:05:55.392329+0000","last_undegraded":"2024-09-13T23:05:55.392329+0000","last_fullsized":"2024-09-13T23:05:55.392329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:12:02.291251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159037+0000","last_change":"2024-09-13T23:05:12.135245+0000","last_active":"2024-09-13T23:05:49.159037+0000","last_peered":"2024-09-13T23:05:49.159037+0000","last_clean":"2024-09-13T23:05:49.159037+0000","last_became_active":"2024-09-13T23:05:12.134820+0000","last_became_peered":"2024-09-13T23:05:12.134820+0000","last_unstale":"2024-09-13T23:05:49.159037+0000","last_undegraded":"2024-09-13T23:05:49.159037+0000","last_fullsized":"2024-09-13T23:05:49.159037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:36.907610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:18.281573+0000","last_change":"2024-09-13T23:05:16.124579+0000","last_active":"2024-09-13T23:07:18.281573+0000","last_peered":"2024-09-13T23:07:18.281573+0000","last_clean":"2024-09-13T23:07:18.281573+0000","last_became_active":"2024-09-13T23:05:16.124295+0000","last_became_peered":"2024-09-13T23:05:16.124295+0000","last_unstale":"2024-09-13T23:07:18.281573+0000","last_undegraded":"2024-09-13T23:07:18.281573+0000","last_fullsized":"2024-09-13T23:07:18.281573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:53:47.490114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'32","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.512451+0000","last_change":"2024-09-13T23:05:18.132070+0000","last_active":"2024-09-13T23:08:21.512451+0000","last_peered":"2024-09-13T23:08:21.512451+0000","last_clean":"2024-09-13T23:08:21.512451+0000","last_became_active":"2024-09-13T23:05:18.131796+0000","last_became_peered":"2024-09-13T23:05:18.131796+0000","last_unstale":"2024-09-13T23:08:21.512451+0000","last_undegraded":"2024-09-13T23:08:21.512451+0000","last_fullsized":"2024-09-13T23:08:21.512451+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:56.183512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159253+0000","last_change":"2024-09-13T23:05:20.145706+0000","last_active":"2024-09-13T23:05:49.159253+0000","last_peered":"2024-09-13T23:05:49.159253+0000","last_clean":"2024-09-13T23:05:49.159253+0000","last_became_active":"2024-09-13T23:05:20.145356+0000","last_became_peered":"2024-09-13T23:05:20.145356+0000","last_unstale":"2024-09-13T23:05:49.159253+0000","last_undegraded":"2024-09-13T23:05:49.159253+0000","last_fullsized":"2024-09-13T23:05:49.159253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:54.194855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.743464+0000","last_change":"2024-09-13T23:05:22.147988+0000","last_active":"2024-09-13T23:07:19.743464+0000","last_peered":"2024-09-13T23:07:19.743464+0000","last_clean":"2024-09-13T23:07:19.743464+0000","last_became_active":"2024-09-13T23:05:22.147707+0000","last_became_peered":"2024-09-13T23:05:22.147707+0000","last_unstale":"2024-09-13T23:07:19.743464+0000","last_undegraded":"2024-09-13T23:07:19.743464+0000","last_fullsized":"2024-09-13T23:07:19.743464+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:27.322255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'16","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.250273+0000","last_change":"2024-09-13T23:05:14.123908+0000","last_active":"2024-09-13T23:08:22.250273+0000","last_peered":"2024-09-13T23:08:22.250273+0000","last_clean":"2024-09-13T23:08:22.250273+0000","last_became_active":"2024-09-13T23:05:14.123513+0000","last_became_peered":"2024-09-13T23:05:14.123513+0000","last_unstale":"2024-09-13T23:08:22.250273+0000","last_undegraded":"2024-09-13T23:08:22.250273+0000","last_fullsized":"2024-09-13T23:08:22.250273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:10.807036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.074649+0000","last_change":"2024-09-13T23:05:12.129469+0000","last_active":"2024-09-13T23:07:21.074649+0000","last_peered":"2024-09-13T23:07:21.074649+0000","last_clean":"2024-09-13T23:07:21.074649+0000","last_became_active":"2024-09-13T23:05:12.125740+0000","last_became_peered":"2024-09-13T23:05:12.125740+0000","last_unstale":"2024-09-13T23:07:21.074649+0000","last_undegraded":"2024-09-13T23:07:21.074649+0000","last_fullsized":"2024-09-13T23:07:21.074649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:29.212129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.322046+0000","last_change":"2024-09-13T23:05:14.110713+0000","last_active":"2024-09-13T23:08:22.322046+0000","last_peered":"2024-09-13T23:08:22.322046+0000","last_clean":"2024-09-13T23:08:22.322046+0000","last_became_active":"2024-09-13T23:05:14.109959+0000","last_became_peered":"2024-09-13T23:05:14.109959+0000","last_unstale":"2024-09-13T23:08:22.322046+0000","last_undegraded":"2024-09-13T23:08:22.322046+0000","last_fullsized":"2024-09-13T23:08:22.322046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:14:21.159008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.463371+0000","last_change":"2024-09-13T23:05:12.114302+0000","last_active":"2024-09-13T23:07:21.463371+0000","last_peered":"2024-09-13T23:07:21.463371+0000","last_clean":"2024-09-13T23:07:21.463371+0000","last_became_active":"2024-09-13T23:05:12.113972+0000","last_became_peered":"2024-09-13T23:05:12.113972+0000","last_unstale":"2024-09-13T23:07:21.463371+0000","last_undegraded":"2024-09-13T23:07:21.463371+0000","last_fullsized":"2024-09-13T23:07:21.463371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:48:38.750102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'10","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362921+0000","last_change":"2024-09-13T23:05:49.165777+0000","last_active":"2024-09-13T23:08:22.362921+0000","last_peered":"2024-09-13T23:08:22.362921+0000","last_clean":"2024-09-13T23:08:22.362921+0000","last_became_active":"2024-09-13T23:05:49.159488+0000","last_became_peered":"2024-09-13T23:05:49.159488+0000","last_unstale":"2024-09-13T23:08:22.362921+0000","last_undegraded":"2024-09-13T23:08:22.362921+0000","last_fullsized":"2024-09-13T23:08:22.362921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:40.422062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.966513+0000","last_change":"2024-09-13T23:05:12.140088+0000","last_active":"2024-09-13T23:08:21.966513+0000","last_peered":"2024-09-13T23:08:21.966513+0000","last_clean":"2024-09-13T23:08:21.966513+0000","last_became_active":"2024-09-13T23:05:12.139673+0000","last_became_peered":"2024-09-13T23:05:12.139673+0000","last_unstale":"2024-09-13T23:08:21.966513+0000","last_undegraded":"2024-09-13T23:08:21.966513+0000","last_fullsized":"2024-09-13T23:08:21.966513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:32:20.507188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'9","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.257272+0000","last_change":"2024-09-13T23:05:14.112656+0000","last_active":"2024-09-13T23:08:22.257272+0000","last_peered":"2024-09-13T23:08:22.257272+0000","last_clean":"2024-09-13T23:08:22.257272+0000","last_became_active":"2024-09-13T23:05:14.112168+0000","last_became_peered":"2024-09-13T23:05:14.112168+0000","last_unstale":"2024-09-13T23:08:22.257272+0000","last_undegraded":"2024-09-13T23:08:22.257272+0000","last_fullsized":"2024-09-13T23:08:22.257272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:08.501106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160289+0000","last_change":"2024-09-13T23:05:12.118979+0000","last_active":"2024-09-13T23:05:49.160289+0000","last_peered":"2024-09-13T23:05:49.160289+0000","last_clean":"2024-09-13T23:05:49.160289+0000","last_became_active":"2024-09-13T23:05:12.118425+0000","last_became_peered":"2024-09-13T23:05:12.118425+0000","last_unstale":"2024-09-13T23:05:49.160289+0000","last_undegraded":"2024-09-13T23:05:49.160289+0000","last_fullsized":"2024-09-13T23:05:49.160289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:36.907610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'14","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362935+0000","last_change":"2024-09-13T23:05:14.120992+0000","last_active":"2024-09-13T23:08:22.362935+0000","last_peered":"2024-09-13T23:08:22.362935+0000","last_clean":"2024-09-13T23:08:22.362935+0000","last_became_active":"2024-09-13T23:05:14.120456+0000","last_became_peered":"2024-09-13T23:05:14.120456+0000","last_unstale":"2024-09-13T23:08:22.362935+0000","last_undegraded":"2024-09-13T23:08:22.362935+0000","last_fullsized":"2024-09-13T23:08:22.362935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:33:19.901997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160111+0000","last_change":"2024-09-13T23:05:12.114509+0000","last_active":"2024-09-13T23:05:49.160111+0000","last_peered":"2024-09-13T23:05:49.160111+0000","last_clean":"2024-09-13T23:05:49.160111+0000","last_became_active":"2024-09-13T23:05:12.114046+0000","last_became_peered":"2024-09-13T23:05:12.114046+0000","last_unstale":"2024-09-13T23:05:49.160111+0000","last_undegraded":"2024-09-13T23:05:49.160111+0000","last_fullsized":"2024-09-13T23:05:49.160111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:04.782795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.161547+0000","last_change":"2024-09-13T23:05:14.124864+0000","last_active":"2024-09-13T23:05:49.161547+0000","last_peered":"2024-09-13T23:05:49.161547+0000","last_clean":"2024-09-13T23:05:49.161547+0000","last_became_active":"2024-09-13T23:05:14.123783+0000","last_became_peered":"2024-09-13T23:05:14.123783+0000","last_unstale":"2024-09-13T23:05:49.161547+0000","last_undegraded":"2024-09-13T23:05:49.161547+0000","last_fullsized":"2024-09-13T23:05:49.161547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:21.273774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.293717+0000","last_change":"2024-09-13T23:05:12.140004+0000","last_active":"2024-09-13T23:07:21.293717+0000","last_peered":"2024-09-13T23:07:21.293717+0000","last_clean":"2024-09-13T23:07:21.293717+0000","last_became_active":"2024-09-13T23:05:12.137465+0000","last_became_peered":"2024-09-13T23:05:12.137465+0000","last_unstale":"2024-09-13T23:07:21.293717+0000","last_undegraded":"2024-09-13T23:07:21.293717+0000","last_fullsized":"2024-09-13T23:07:21.293717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:29.788894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.701866+0000","last_change":"2024-09-13T23:05:14.121847+0000","last_active":"2024-09-13T23:05:54.701866+0000","last_peered":"2024-09-13T23:05:54.701866+0000","last_clean":"2024-09-13T23:05:54.701866+0000","last_became_active":"2024-09-13T23:05:14.121425+0000","last_became_peered":"2024-09-13T23:05:14.121425+0000","last_unstale":"2024-09-13T23:05:54.701866+0000","last_undegraded":"2024-09-13T23:05:54.701866+0000","last_fullsized":"2024-09-13T23:05:54.701866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:02.456301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158590+0000","last_change":"2024-09-13T23:05:12.116219+0000","last_active":"2024-09-13T23:05:49.158590+0000","last_peered":"2024-09-13T23:05:49.158590+0000","last_clean":"2024-09-13T23:05:49.158590+0000","last_became_active":"2024-09-13T23:05:12.115546+0000","last_became_peered":"2024-09-13T23:05:12.115546+0000","last_unstale":"2024-09-13T23:05:49.158590+0000","last_undegraded":"2024-09-13T23:05:49.158590+0000","last_fullsized":"2024-09-13T23:05:49.158590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:46.740162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.321747+0000","last_change":"2024-09-13T23:05:14.123460+0000","last_active":"2024-09-13T23:08:22.321747+0000","last_peered":"2024-09-13T23:08:22.321747+0000","last_clean":"2024-09-13T23:08:22.321747+0000","last_became_active":"2024-09-13T23:05:14.122944+0000","last_became_peered":"2024-09-13T23:05:14.122944+0000","last_unstale":"2024-09-13T23:08:22.321747+0000","last_undegraded":"2024-09-13T23:08:22.321747+0000","last_fullsized":"2024-09-13T23:08:22.321747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:27.479160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:24.072349+0000","last_change":"2024-09-13T23:05:12.119016+0000","last_active":"2024-09-13T23:07:24.072349+0000","last_peered":"2024-09-13T23:07:24.072349+0000","last_clean":"2024-09-13T23:07:24.072349+0000","last_became_active":"2024-09-13T23:05:12.118347+0000","last_became_peered":"2024-09-13T23:05:12.118347+0000","last_unstale":"2024-09-13T23:07:24.072349+0000","last_undegraded":"2024-09-13T23:07:24.072349+0000","last_fullsized":"2024-09-13T23:07:24.072349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:22.242350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.452882+0000","last_change":"2024-09-13T23:05:14.126164+0000","last_active":"2024-09-13T23:06:37.452882+0000","last_peered":"2024-09-13T23:06:37.452882+0000","last_clean":"2024-09-13T23:06:37.452882+0000","last_became_active":"2024-09-13T23:05:14.124593+0000","last_became_peered":"2024-09-13T23:05:14.124593+0000","last_unstale":"2024-09-13T23:06:37.452882+0000","last_undegraded":"2024-09-13T23:06:37.452882+0000","last_fullsized":"2024-09-13T23:06:37.452882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:44.195143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:22.075262+0000","last_change":"2024-09-13T23:05:12.144032+0000","last_active":"2024-09-13T23:07:22.075262+0000","last_peered":"2024-09-13T23:07:22.075262+0000","last_clean":"2024-09-13T23:07:22.075262+0000","last_became_active":"2024-09-13T23:05:12.141628+0000","last_became_peered":"2024-09-13T23:05:12.141628+0000","last_unstale":"2024-09-13T23:07:22.075262+0000","last_undegraded":"2024-09-13T23:07:22.075262+0000","last_fullsized":"2024-09-13T23:07:22.075262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:15.223430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.701817+0000","last_change":"2024-09-13T23:05:14.113960+0000","last_active":"2024-09-13T23:05:54.701817+0000","last_peered":"2024-09-13T23:05:54.701817+0000","last_clean":"2024-09-13T23:05:54.701817+0000","last_became_active":"2024-09-13T23:05:14.113710+0000","last_became_peered":"2024-09-13T23:05:14.113710+0000","last_unstale":"2024-09-13T23:05:54.701817+0000","last_undegraded":"2024-09-13T23:05:54.701817+0000","last_fullsized":"2024-09-13T23:05:54.701817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:34.129089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158574+0000","last_change":"2024-09-13T23:05:12.119408+0000","last_active":"2024-09-13T23:05:49.158574+0000","last_peered":"2024-09-13T23:05:49.158574+0000","last_clean":"2024-09-13T23:05:49.158574+0000","last_became_active":"2024-09-13T23:05:12.118716+0000","last_became_peered":"2024-09-13T23:05:12.118716+0000","last_unstale":"2024-09-13T23:05:49.158574+0000","last_undegraded":"2024-09-13T23:05:49.158574+0000","last_fullsized":"2024-09-13T23:05:49.158574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:51.066283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.263470+0000","last_change":"2024-09-13T23:05:14.120905+0000","last_active":"2024-09-13T23:06:37.263470+0000","last_peered":"2024-09-13T23:06:37.263470+0000","last_clean":"2024-09-13T23:06:37.263470+0000","last_became_active":"2024-09-13T23:05:14.120489+0000","last_became_peered":"2024-09-13T23:05:14.120489+0000","last_unstale":"2024-09-13T23:06:37.263470+0000","last_undegraded":"2024-09-13T23:06:37.263470+0000","last_fullsized":"2024-09-13T23:06:37.263470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:34.163619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.911022+0000","last_change":"2024-09-13T23:05:12.141835+0000","last_active":"2024-09-13T23:05:54.911022+0000","last_peered":"2024-09-13T23:05:54.911022+0000","last_clean":"2024-09-13T23:05:54.911022+0000","last_became_active":"2024-09-13T23:05:12.137735+0000","last_became_peered":"2024-09-13T23:05:12.137735+0000","last_unstale":"2024-09-13T23:05:54.911022+0000","last_undegraded":"2024-09-13T23:05:54.911022+0000","last_fullsized":"2024-09-13T23:05:54.911022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:14:55.200398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'3","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:33.076769+0000","last_change":"2024-09-13T23:05:14.122103+0000","last_active":"2024-09-13T23:07:33.076769+0000","last_peered":"2024-09-13T23:07:33.076769+0000","last_clean":"2024-09-13T23:07:33.076769+0000","last_became_active":"2024-09-13T23:05:14.121389+0000","last_became_peered":"2024-09-13T23:05:14.121389+0000","last_unstale":"2024-09-13T23:07:33.076769+0000","last_undegraded":"2024-09-13T23:07:33.076769+0000","last_fullsized":"2024-09-13T23:07:33.076769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:57:39.861849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155167+0000","last_change":"2024-09-13T23:05:12.139774+0000","last_active":"2024-09-13T23:05:49.155167+0000","last_peered":"2024-09-13T23:05:49.155167+0000","last_clean":"2024-09-13T23:05:49.155167+0000","last_became_active":"2024-09-13T23:05:12.137118+0000","last_became_peered":"2024-09-13T23:05:12.137118+0000","last_unstale":"2024-09-13T23:05:49.155167+0000","last_undegraded":"2024-09-13T23:05:49.155167+0000","last_fullsized":"2024-09-13T23:05:49.155167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:01:21.996979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362651+0000","last_change":"2024-09-13T23:05:14.125962+0000","last_active":"2024-09-13T23:08:22.362651+0000","last_peered":"2024-09-13T23:08:22.362651+0000","last_clean":"2024-09-13T23:08:22.362651+0000","last_became_active":"2024-09-13T23:05:14.124507+0000","last_became_peered":"2024-09-13T23:05:14.124507+0000","last_unstale":"2024-09-13T23:08:22.362651+0000","last_undegraded":"2024-09-13T23:08:22.362651+0000","last_fullsized":"2024-09-13T23:08:22.362651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:39.333340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160223+0000","last_change":"2024-09-13T23:05:12.138932+0000","last_active":"2024-09-13T23:05:49.160223+0000","last_peered":"2024-09-13T23:05:49.160223+0000","last_clean":"2024-09-13T23:05:49.160223+0000","last_became_active":"2024-09-13T23:05:12.138577+0000","last_became_peered":"2024-09-13T23:05:12.138577+0000","last_unstale":"2024-09-13T23:05:49.160223+0000","last_undegraded":"2024-09-13T23:05:49.160223+0000","last_fullsized":"2024-09-13T23:05:49.160223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:20.700653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.257347+0000","last_change":"2024-09-13T23:05:14.125069+0000","last_active":"2024-09-13T23:08:22.257347+0000","last_peered":"2024-09-13T23:08:22.257347+0000","last_clean":"2024-09-13T23:08:22.257347+0000","last_became_active":"2024-09-13T23:05:14.124604+0000","last_became_peered":"2024-09-13T23:05:14.124604+0000","last_unstale":"2024-09-13T23:08:22.257347+0000","last_undegraded":"2024-09-13T23:08:22.257347+0000","last_fullsized":"2024-09-13T23:08:22.257347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:41.404040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.162242+0000","last_change":"2024-09-13T23:05:12.141608+0000","last_active":"2024-09-13T23:05:49.162242+0000","last_peered":"2024-09-13T23:05:49.162242+0000","last_clean":"2024-09-13T23:05:49.162242+0000","last_became_active":"2024-09-13T23:05:12.140686+0000","last_became_peered":"2024-09-13T23:05:12.140686+0000","last_unstale":"2024-09-13T23:05:49.162242+0000","last_undegraded":"2024-09-13T23:05:49.162242+0000","last_fullsized":"2024-09-13T23:05:49.162242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:59:19.940880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156146+0000","last_change":"2024-09-13T23:05:14.126009+0000","last_active":"2024-09-13T23:05:49.156146+0000","last_peered":"2024-09-13T23:05:49.156146+0000","last_clean":"2024-09-13T23:05:49.156146+0000","last_became_active":"2024-09-13T23:05:14.125747+0000","last_became_peered":"2024-09-13T23:05:14.125747+0000","last_unstale":"2024-09-13T23:05:49.156146+0000","last_undegraded":"2024-09-13T23:05:49.156146+0000","last_fullsized":"2024-09-13T23:05:49.156146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:34:19.493607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158853+0000","last_change":"2024-09-13T23:05:12.126550+0000","last_active":"2024-09-13T23:05:49.158853+0000","last_peered":"2024-09-13T23:05:49.158853+0000","last_clean":"2024-09-13T23:05:49.158853+0000","last_became_active":"2024-09-13T23:05:12.126202+0000","last_became_peered":"2024-09-13T23:05:12.126202+0000","last_unstale":"2024-09-13T23:05:49.158853+0000","last_undegraded":"2024-09-13T23:05:49.158853+0000","last_fullsized":"2024-09-13T23:05:49.158853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:31.807454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.100783+0000","last_change":"2024-09-13T23:05:14.125692+0000","last_active":"2024-09-13T23:08:22.100783+0000","last_peered":"2024-09-13T23:08:22.100783+0000","last_clean":"2024-09-13T23:08:22.100783+0000","last_became_active":"2024-09-13T23:05:14.125457+0000","last_became_peered":"2024-09-13T23:05:14.125457+0000","last_unstale":"2024-09-13T23:08:22.100783+0000","last_undegraded":"2024-09-13T23:08:22.100783+0000","last_fullsized":"2024-09-13T23:08:22.100783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:30.709764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.164256+0000","last_change":"2024-09-13T23:05:12.150036+0000","last_active":"2024-09-13T23:05:49.164256+0000","last_peered":"2024-09-13T23:05:49.164256+0000","last_clean":"2024-09-13T23:05:49.164256+0000","last_became_active":"2024-09-13T23:05:12.149345+0000","last_became_peered":"2024-09-13T23:05:12.149345+0000","last_unstale":"2024-09-13T23:05:49.164256+0000","last_undegraded":"2024-09-13T23:05:49.164256+0000","last_fullsized":"2024-09-13T23:05:49.164256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:08.953763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:17.897299+0000","last_change":"2024-09-13T23:05:12.142386+0000","last_active":"2024-09-13T23:07:17.897299+0000","last_peered":"2024-09-13T23:07:17.897299+0000","last_clean":"2024-09-13T23:07:17.897299+0000","last_became_active":"2024-09-13T23:05:12.140432+0000","last_became_peered":"2024-09-13T23:05:12.140432+0000","last_unstale":"2024-09-13T23:07:17.897299+0000","last_undegraded":"2024-09-13T23:07:17.897299+0000","last_fullsized":"2024-09-13T23:07:17.897299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:03:40.790581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'16","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.324175+0000","last_change":"2024-09-13T23:05:14.122670+0000","last_active":"2024-09-13T23:08:22.324175+0000","last_peered":"2024-09-13T23:08:22.324175+0000","last_clean":"2024-09-13T23:08:22.324175+0000","last_became_active":"2024-09-13T23:05:14.122105+0000","last_became_peered":"2024-09-13T23:05:14.122105+0000","last_unstale":"2024-09-13T23:08:22.324175+0000","last_undegraded":"2024-09-13T23:08:22.324175+0000","last_fullsized":"2024-09-13T23:08:22.324175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:32.818885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.243675+0000","last_change":"2024-09-13T23:05:12.121856+0000","last_active":"2024-09-13T23:08:22.243675+0000","last_peered":"2024-09-13T23:08:22.243675+0000","last_clean":"2024-09-13T23:08:22.243675+0000","last_became_active":"2024-09-13T23:05:12.120703+0000","last_became_peered":"2024-09-13T23:05:12.120703+0000","last_unstale":"2024-09-13T23:08:22.243675+0000","last_undegraded":"2024-09-13T23:08:22.243675+0000","last_fullsized":"2024-09-13T23:08:22.243675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:20.740109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'9","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:43.078358+0000","last_change":"2024-09-13T23:05:14.122765+0000","last_active":"2024-09-13T23:07:43.078358+0000","last_peered":"2024-09-13T23:07:43.078358+0000","last_clean":"2024-09-13T23:07:43.078358+0000","last_became_active":"2024-09-13T23:05:14.121636+0000","last_became_peered":"2024-09-13T23:05:14.121636+0000","last_unstale":"2024-09-13T23:07:43.078358+0000","last_undegraded":"2024-09-13T23:07:43.078358+0000","last_fullsized":"2024-09-13T23:07:43.078358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:08.481848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1600,"num_read_kb":1490,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":12,"seq":51539607599,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48384,"kb_used_data":8880,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323456,"statfs":{"total":96636764160,"available":96587218944,"internally_reserved":0,"allocated":9093120,"data_stored":8759400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640301,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44736,"kb_used_data":9392,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327104,"statfs":{"total":96636764160,"available":96590954496,"internally_reserved":0,"allocated":9617408,"data_stored":9345424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705710,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44768,"kb_used_data":9424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327072,"statfs":{"total":96636764160,"available":96590921728,"internally_reserved":0,"allocated":9650176,"data_stored":9349228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40024,"kb_used_data":8840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331816,"statfs":{"total":96636764160,"available":96595779584,"internally_reserved":0,"allocated":9052160,"data_stored":8757564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T23:08:29.931 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T23:08:29.931 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T23:08:30.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.062+0000 7fd0b8d54640 1 Processor -- start 2024-09-13T23:08:30.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.062+0000 7fd0b8d54640 1 -- start start 2024-09-13T23:08:30.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.062+0000 7fd0b8d54640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd0b412f9d0 0x7fd0b4131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:30.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.062+0000 7fd0b8d54640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0b4071f70 con 0x7fd0b412cca0 2024-09-13T23:08:30.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.062+0000 7fd0b8d54640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fd0b406e350 con 0x7fd0b412f9d0 2024-09-13T23:08:30.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.062+0000 7fd0b1d9b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd0b412f9d0 0x7fd0b4131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:30.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.062+0000 7fd0b259c640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd0b412cca0 0x7fd0b412d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:52712/0 (socket says 172.21.15.17:52712) 2024-09-13T23:08:30.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.062+0000 7fd0b259c640 1 -- 172.21.15.17:0/3301773596 learned_addr learned my addr 172.21.15.17:0/3301773596 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:08:30.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.063+0000 7fd0b1d9b640 1 -- 172.21.15.17:0/3301773596 >> v1:172.21.15.17:6789/0 conn(0x7fd0b412cca0 legacy=0x7fd0b412d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:30.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.063+0000 7fd0b1d9b640 1 -- 172.21.15.17:0/3301773596 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0b40715c0 con 0x7fd0b412f9d0 2024-09-13T23:08:30.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.063+0000 7fd0b1d9b640 1 --2- 172.21.15.17:0/3301773596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b412f9d0 0x7fd0b4131dc0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009720 tx=0x7fd0a802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3610565e7cec0d92 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:30.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.064+0000 7fd0b159a640 1 -- 172.21.15.17:0/3301773596 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0a8037070 con 0x7fd0b412f9d0 2024-09-13T23:08:30.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.064+0000 7fd0b159a640 1 -- 172.21.15.17:0/3301773596 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0a802ad90 con 0x7fd0b412f9d0 2024-09-13T23:08:30.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.064+0000 7fd0b159a640 1 -- 172.21.15.17:0/3301773596 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0a8032590 con 0x7fd0b412f9d0 2024-09-13T23:08:30.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.064+0000 7fd0b8d54640 1 -- 172.21.15.17:0/3301773596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b412f9d0 msgr2=0x7fd0b4131dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:30.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.064+0000 7fd0b8d54640 1 --2- 172.21.15.17:0/3301773596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b412f9d0 0x7fd0b4131dc0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009720 tx=0x7fd0a802a110 comp rx=0 tx=0).stop 2024-09-13T23:08:30.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.064+0000 7fd0b8d54640 1 -- 172.21.15.17:0/3301773596 shutdown_connections 2024-09-13T23:08:30.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.064+0000 7fd0b8d54640 1 --2- 172.21.15.17:0/3301773596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b412f9d0 0x7fd0b4131dc0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:30.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.064+0000 7fd0b8d54640 1 -- 172.21.15.17:0/3301773596 >> 172.21.15.17:0/3301773596 conn(0x7fd0b409a890 msgr2=0x7fd0b409aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:30.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.064+0000 7fd0b8d54640 1 -- 172.21.15.17:0/3301773596 shutdown_connections 2024-09-13T23:08:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.064+0000 7fd0b8d54640 1 -- 172.21.15.17:0/3301773596 wait complete. 2024-09-13T23:08:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.065+0000 7fd0b8d54640 1 Processor -- start 2024-09-13T23:08:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.065+0000 7fd0b8d54640 1 -- start start 2024-09-13T23:08:30.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.066+0000 7fd0b8d54640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b412cca0 0x7fd0b41258b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:30.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.066+0000 7fd0b8d54640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b412ca50 con 0x7fd0b412cca0 2024-09-13T23:08:30.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.066+0000 7fd0b259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b412cca0 0x7fd0b41258b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:30.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.066+0000 7fd0b259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b412cca0 0x7fd0b41258b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39956/0 (socket says 172.21.15.17:39956) 2024-09-13T23:08:30.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.066+0000 7fd0b259c640 1 -- 172.21.15.17:0/2372454640 learned_addr learned my addr 172.21.15.17:0/2372454640 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:08:30.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.066+0000 7fd0b259c640 1 -- 172.21.15.17:0/2372454640 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0b4123af0 con 0x7fd0b412cca0 2024-09-13T23:08:30.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.066+0000 7fd0b259c640 1 --2- 172.21.15.17:0/2372454640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b412cca0 0x7fd0b41258b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fd0a400c480 tx=0x7fd0a400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:30.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.066+0000 7fd0a2ffd640 1 -- 172.21.15.17:0/2372454640 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0a4017070 con 0x7fd0b412cca0 2024-09-13T23:08:30.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.066+0000 7fd0a2ffd640 1 -- 172.21.15.17:0/2372454640 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0a4005c10 con 0x7fd0b412cca0 2024-09-13T23:08:30.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.066+0000 7fd0a2ffd640 1 -- 172.21.15.17:0/2372454640 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0a40070d0 con 0x7fd0b412cca0 2024-09-13T23:08:30.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.066+0000 7fd0b8d54640 1 -- 172.21.15.17:0/2372454640 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0b4126db0 con 0x7fd0b412cca0 2024-09-13T23:08:30.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.067+0000 7fd0b8d54640 1 -- 172.21.15.17:0/2372454640 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0b4125df0 con 0x7fd0b412cca0 2024-09-13T23:08:30.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.067+0000 7fd0a2ffd640 1 -- 172.21.15.17:0/2372454640 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd0a401a070 con 0x7fd0b412cca0 2024-09-13T23:08:30.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.067+0000 7fd0b8d54640 1 -- 172.21.15.17:0/2372454640 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0b4073120 con 0x7fd0b412cca0 2024-09-13T23:08:30.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.068+0000 7fd0a2ffd640 1 --2- 172.21.15.17:0/2372454640 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd0940382a0 0x7fd09403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:30.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.068+0000 7fd0a2ffd640 1 -- 172.21.15.17:0/2372454640 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd0a404af80 con 0x7fd0b412cca0 2024-09-13T23:08:30.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.068+0000 7fd0b1d9b640 1 --2- 172.21.15.17:0/2372454640 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd0940382a0 0x7fd09403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:30.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.068+0000 7fd0b1d9b640 1 --2- 172.21.15.17:0/2372454640 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd0940382a0 0x7fd09403a760 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009720 tx=0x7fd0a802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:30.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.072+0000 7fd0a2ffd640 1 -- 172.21.15.17:0/2372454640 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd0b4073120 con 0x7fd0b412cca0 2024-09-13T23:08:30.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.244+0000 7fd0b8d54640 1 -- 172.21.15.17:0/2372454640 --> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd0b4124af0 con 0x7fd0940382a0 2024-09-13T23:08:30.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.260+0000 7fd0a2ffd640 1 -- 172.21.15.17:0/2372454640 <== mgr.4102 v2:172.21.15.164:6824/713838566 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666094 (secure 0 0 0) 0x7fd0b4124af0 con 0x7fd0940382a0 2024-09-13T23:08:30.269 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:08:30.275 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-13T23:08:30.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.264+0000 7fd0b8d54640 1 -- 172.21.15.17:0/2372454640 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd0940382a0 msgr2=0x7fd09403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:30.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.264+0000 7fd0b8d54640 1 --2- 172.21.15.17:0/2372454640 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd0940382a0 0x7fd09403a760 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009720 tx=0x7fd0a802e000 comp rx=0 tx=0).stop 2024-09-13T23:08:30.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.264+0000 7fd0b8d54640 1 -- 172.21.15.17:0/2372454640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b412cca0 msgr2=0x7fd0b41258b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:30.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.264+0000 7fd0b8d54640 1 --2- 172.21.15.17:0/2372454640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b412cca0 0x7fd0b41258b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fd0a400c480 tx=0x7fd0a400c940 comp rx=0 tx=0).stop 2024-09-13T23:08:30.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.264+0000 7fd0b8d54640 1 -- 172.21.15.17:0/2372454640 shutdown_connections 2024-09-13T23:08:30.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.264+0000 7fd0b8d54640 1 --2- 172.21.15.17:0/2372454640 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd0940382a0 0x7fd09403a760 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:30.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.264+0000 7fd0b8d54640 1 --2- 172.21.15.17:0/2372454640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b412cca0 0x7fd0b41258b0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:30.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.264+0000 7fd0b8d54640 1 -- 172.21.15.17:0/2372454640 >> 172.21.15.17:0/2372454640 conn(0x7fd0b409a890 msgr2=0x7fd0b4097ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:30.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.264+0000 7fd0b8d54640 1 -- 172.21.15.17:0/2372454640 shutdown_connections 2024-09-13T23:08:30.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.265+0000 7fd0b8d54640 1 -- 172.21.15.17:0/2372454640 wait complete. 2024-09-13T23:08:30.278 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2024-09-13T23:08:30.101126+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416904,"num_objects":229,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4873,"num_read_kb":4450,"num_write":2106,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4489,"ondisk_log_size":4489,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":177912,"kb_used_data":36536,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377309448,"statfs":{"total":386547056640,"available":386364874752,"internally_reserved":0,"allocated":37412864,"data_stored":36211616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815783,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":498,"num_read_kb":453,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003727"},"pg_stats":[{"pgid":"3.3f","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.357961+0000","last_change":"2024-09-13T23:05:12.130214+0000","last_active":"2024-09-13T23:08:22.357961+0000","last_peered":"2024-09-13T23:08:22.357961+0000","last_clean":"2024-09-13T23:08:22.357961+0000","last_became_active":"2024-09-13T23:05:12.130009+0000","last_became_peered":"2024-09-13T23:05:12.130009+0000","last_unstale":"2024-09-13T23:08:22.357961+0000","last_undegraded":"2024-09-13T23:08:22.357961+0000","last_fullsized":"2024-09-13T23:08:22.357961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:43.041094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.702056+0000","last_change":"2024-09-13T23:05:14.125468+0000","last_active":"2024-09-13T23:05:54.702056+0000","last_peered":"2024-09-13T23:05:54.702056+0000","last_clean":"2024-09-13T23:05:54.702056+0000","last_became_active":"2024-09-13T23:05:14.125215+0000","last_became_peered":"2024-09-13T23:05:14.125215+0000","last_unstale":"2024-09-13T23:05:54.702056+0000","last_undegraded":"2024-09-13T23:05:54.702056+0000","last_fullsized":"2024-09-13T23:05:54.702056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:30:53.032744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160717+0000","last_change":"2024-09-13T23:05:12.119102+0000","last_active":"2024-09-13T23:05:49.160717+0000","last_peered":"2024-09-13T23:05:49.160717+0000","last_clean":"2024-09-13T23:05:49.160717+0000","last_became_active":"2024-09-13T23:05:12.118411+0000","last_became_peered":"2024-09-13T23:05:12.118411+0000","last_unstale":"2024-09-13T23:05:49.160717+0000","last_undegraded":"2024-09-13T23:05:49.160717+0000","last_fullsized":"2024-09-13T23:05:49.160717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:58.196248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.485650+0000","last_change":"2024-09-13T23:05:14.109708+0000","last_active":"2024-09-13T23:07:21.485650+0000","last_peered":"2024-09-13T23:07:21.485650+0000","last_clean":"2024-09-13T23:07:21.485650+0000","last_became_active":"2024-09-13T23:05:14.109464+0000","last_became_peered":"2024-09-13T23:05:14.109464+0000","last_unstale":"2024-09-13T23:07:21.485650+0000","last_undegraded":"2024-09-13T23:07:21.485650+0000","last_fullsized":"2024-09-13T23:07:21.485650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:21.317180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.162506+0000","last_change":"2024-09-13T23:05:12.146564+0000","last_active":"2024-09-13T23:05:49.162506+0000","last_peered":"2024-09-13T23:05:49.162506+0000","last_clean":"2024-09-13T23:05:49.162506+0000","last_became_active":"2024-09-13T23:05:12.146191+0000","last_became_peered":"2024-09-13T23:05:12.146191+0000","last_unstale":"2024-09-13T23:05:49.162506+0000","last_undegraded":"2024-09-13T23:05:49.162506+0000","last_fullsized":"2024-09-13T23:05:49.162506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:15.192342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:17.908206+0000","last_change":"2024-09-13T23:05:14.110454+0000","last_active":"2024-09-13T23:07:17.908206+0000","last_peered":"2024-09-13T23:07:17.908206+0000","last_clean":"2024-09-13T23:07:17.908206+0000","last_became_active":"2024-09-13T23:05:14.110201+0000","last_became_peered":"2024-09-13T23:05:14.110201+0000","last_unstale":"2024-09-13T23:07:17.908206+0000","last_undegraded":"2024-09-13T23:07:17.908206+0000","last_fullsized":"2024-09-13T23:07:17.908206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:13:58.253126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.154369+0000","last_change":"2024-09-13T23:05:12.132812+0000","last_active":"2024-09-13T23:05:49.154369+0000","last_peered":"2024-09-13T23:05:49.154369+0000","last_clean":"2024-09-13T23:05:49.154369+0000","last_became_active":"2024-09-13T23:05:12.132461+0000","last_became_peered":"2024-09-13T23:05:12.132461+0000","last_unstale":"2024-09-13T23:05:49.154369+0000","last_undegraded":"2024-09-13T23:05:49.154369+0000","last_fullsized":"2024-09-13T23:05:49.154369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:16.369831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362602+0000","last_change":"2024-09-13T23:05:14.113718+0000","last_active":"2024-09-13T23:08:22.362602+0000","last_peered":"2024-09-13T23:08:22.362602+0000","last_clean":"2024-09-13T23:08:22.362602+0000","last_became_active":"2024-09-13T23:05:14.113430+0000","last_became_peered":"2024-09-13T23:05:14.113430+0000","last_unstale":"2024-09-13T23:08:22.362602+0000","last_undegraded":"2024-09-13T23:08:22.362602+0000","last_fullsized":"2024-09-13T23:08:22.362602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:49.226302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159928+0000","last_change":"2024-09-13T23:05:12.146576+0000","last_active":"2024-09-13T23:05:49.159928+0000","last_peered":"2024-09-13T23:05:49.159928+0000","last_clean":"2024-09-13T23:05:49.159928+0000","last_became_active":"2024-09-13T23:05:12.146220+0000","last_became_peered":"2024-09-13T23:05:12.146220+0000","last_unstale":"2024-09-13T23:05:49.159928+0000","last_undegraded":"2024-09-13T23:05:49.159928+0000","last_fullsized":"2024-09-13T23:05:49.159928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:20.009582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362602+0000","last_change":"2024-09-13T23:05:14.122808+0000","last_active":"2024-09-13T23:08:22.362602+0000","last_peered":"2024-09-13T23:08:22.362602+0000","last_clean":"2024-09-13T23:08:22.362602+0000","last_became_active":"2024-09-13T23:05:14.122513+0000","last_became_peered":"2024-09-13T23:05:14.122513+0000","last_unstale":"2024-09-13T23:08:22.362602+0000","last_undegraded":"2024-09-13T23:08:22.362602+0000","last_fullsized":"2024-09-13T23:08:22.362602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:32.818885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.238751+0000","last_change":"2024-09-13T23:05:12.113973+0000","last_active":"2024-09-13T23:08:22.238751+0000","last_peered":"2024-09-13T23:08:22.238751+0000","last_clean":"2024-09-13T23:08:22.238751+0000","last_became_active":"2024-09-13T23:05:12.113601+0000","last_became_peered":"2024-09-13T23:05:12.113601+0000","last_unstale":"2024-09-13T23:08:22.238751+0000","last_undegraded":"2024-09-13T23:08:22.238751+0000","last_fullsized":"2024-09-13T23:08:22.238751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:40:11.117182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.250229+0000","last_change":"2024-09-13T23:05:14.125418+0000","last_active":"2024-09-13T23:08:22.250229+0000","last_peered":"2024-09-13T23:08:22.250229+0000","last_clean":"2024-09-13T23:08:22.250229+0000","last_became_active":"2024-09-13T23:05:14.124971+0000","last_became_peered":"2024-09-13T23:05:14.124971+0000","last_unstale":"2024-09-13T23:08:22.250229+0000","last_undegraded":"2024-09-13T23:08:22.250229+0000","last_fullsized":"2024-09-13T23:08:22.250229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:48:34.888252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155922+0000","last_change":"2024-09-13T23:05:12.139628+0000","last_active":"2024-09-13T23:05:49.155922+0000","last_peered":"2024-09-13T23:05:49.155922+0000","last_clean":"2024-09-13T23:05:49.155922+0000","last_became_active":"2024-09-13T23:05:12.138297+0000","last_became_peered":"2024-09-13T23:05:12.138297+0000","last_unstale":"2024-09-13T23:05:49.155922+0000","last_undegraded":"2024-09-13T23:05:49.155922+0000","last_fullsized":"2024-09-13T23:05:49.155922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:12:00.284359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'16","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.984660+0000","last_change":"2024-09-13T23:05:14.124224+0000","last_active":"2024-09-13T23:08:21.984660+0000","last_peered":"2024-09-13T23:08:21.984660+0000","last_clean":"2024-09-13T23:08:21.984660+0000","last_became_active":"2024-09-13T23:05:14.123950+0000","last_became_peered":"2024-09-13T23:05:14.123950+0000","last_unstale":"2024-09-13T23:08:21.984660+0000","last_undegraded":"2024-09-13T23:08:21.984660+0000","last_fullsized":"2024-09-13T23:08:21.984660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:59:21.947772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":68,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.321599+0000","last_change":"2024-09-13T23:05:12.117693+0000","last_active":"2024-09-13T23:05:54.321599+0000","last_peered":"2024-09-13T23:05:54.321599+0000","last_clean":"2024-09-13T23:05:54.321599+0000","last_became_active":"2024-09-13T23:05:12.117028+0000","last_became_peered":"2024-09-13T23:05:12.117028+0000","last_unstale":"2024-09-13T23:05:54.321599+0000","last_undegraded":"2024-09-13T23:05:54.321599+0000","last_fullsized":"2024-09-13T23:05:54.321599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:17.130898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'17","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.328844+0000","last_change":"2024-09-13T23:05:14.115693+0000","last_active":"2024-09-13T23:08:22.328844+0000","last_peered":"2024-09-13T23:08:22.328844+0000","last_clean":"2024-09-13T23:08:22.328844+0000","last_became_active":"2024-09-13T23:05:14.114831+0000","last_became_peered":"2024-09-13T23:05:14.114831+0000","last_unstale":"2024-09-13T23:08:22.328844+0000","last_undegraded":"2024-09-13T23:08:22.328844+0000","last_fullsized":"2024-09-13T23:08:22.328844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:17.230322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'16","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.451482+0000","last_change":"2024-09-13T23:05:14.110322+0000","last_active":"2024-09-13T23:06:37.451482+0000","last_peered":"2024-09-13T23:06:37.451482+0000","last_clean":"2024-09-13T23:06:37.451482+0000","last_became_active":"2024-09-13T23:05:14.109903+0000","last_became_peered":"2024-09-13T23:05:14.109903+0000","last_unstale":"2024-09-13T23:06:37.451482+0000","last_undegraded":"2024-09-13T23:06:37.451482+0000","last_fullsized":"2024-09-13T23:06:37.451482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:04.762255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":66,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.936147+0000","last_change":"2024-09-13T23:05:12.136723+0000","last_active":"2024-09-13T23:08:21.936147+0000","last_peered":"2024-09-13T23:08:21.936147+0000","last_clean":"2024-09-13T23:08:21.936147+0000","last_became_active":"2024-09-13T23:05:12.136334+0000","last_became_peered":"2024-09-13T23:05:12.136334+0000","last_unstale":"2024-09-13T23:08:21.936147+0000","last_undegraded":"2024-09-13T23:08:21.936147+0000","last_fullsized":"2024-09-13T23:08:21.936147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:20.143656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'11","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:38.077492+0000","last_change":"2024-09-13T23:05:14.125935+0000","last_active":"2024-09-13T23:07:38.077492+0000","last_peered":"2024-09-13T23:07:38.077492+0000","last_clean":"2024-09-13T23:07:38.077492+0000","last_became_active":"2024-09-13T23:05:14.124023+0000","last_became_peered":"2024-09-13T23:05:14.124023+0000","last_unstale":"2024-09-13T23:07:38.077492+0000","last_undegraded":"2024-09-13T23:07:38.077492+0000","last_fullsized":"2024-09-13T23:07:38.077492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:33:06.997368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158954+0000","last_change":"2024-09-13T23:05:12.126709+0000","last_active":"2024-09-13T23:05:49.158954+0000","last_peered":"2024-09-13T23:05:49.158954+0000","last_clean":"2024-09-13T23:05:49.158954+0000","last_became_active":"2024-09-13T23:05:12.126336+0000","last_became_peered":"2024-09-13T23:05:12.126336+0000","last_unstale":"2024-09-13T23:05:49.158954+0000","last_undegraded":"2024-09-13T23:05:49.158954+0000","last_fullsized":"2024-09-13T23:05:49.158954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:13:11.279538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.453163+0000","last_change":"2024-09-13T23:05:14.125494+0000","last_active":"2024-09-13T23:06:37.453163+0000","last_peered":"2024-09-13T23:06:37.453163+0000","last_clean":"2024-09-13T23:06:37.453163+0000","last_became_active":"2024-09-13T23:05:14.125247+0000","last_became_peered":"2024-09-13T23:05:14.125247+0000","last_unstale":"2024-09-13T23:06:37.453163+0000","last_undegraded":"2024-09-13T23:06:37.453163+0000","last_fullsized":"2024-09-13T23:06:37.453163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:41.876468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156159+0000","last_change":"2024-09-13T23:05:12.140428+0000","last_active":"2024-09-13T23:05:49.156159+0000","last_peered":"2024-09-13T23:05:49.156159+0000","last_clean":"2024-09-13T23:05:49.156159+0000","last_became_active":"2024-09-13T23:05:12.139103+0000","last_became_peered":"2024-09-13T23:05:12.139103+0000","last_unstale":"2024-09-13T23:05:49.156159+0000","last_undegraded":"2024-09-13T23:05:49.156159+0000","last_fullsized":"2024-09-13T23:05:49.156159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:04.782795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'7","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:39.074749+0000","last_change":"2024-09-13T23:05:14.120825+0000","last_active":"2024-09-13T23:07:39.074749+0000","last_peered":"2024-09-13T23:07:39.074749+0000","last_clean":"2024-09-13T23:07:39.074749+0000","last_became_active":"2024-09-13T23:05:14.120397+0000","last_became_peered":"2024-09-13T23:05:14.120397+0000","last_unstale":"2024-09-13T23:07:39.074749+0000","last_undegraded":"2024-09-13T23:07:39.074749+0000","last_fullsized":"2024-09-13T23:07:39.074749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:33:06.997368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:53.844004+0000","last_change":"2024-09-13T23:05:12.139375+0000","last_active":"2024-09-13T23:05:53.844004+0000","last_peered":"2024-09-13T23:05:53.844004+0000","last_clean":"2024-09-13T23:05:53.844004+0000","last_became_active":"2024-09-13T23:05:12.139022+0000","last_became_peered":"2024-09-13T23:05:12.139022+0000","last_unstale":"2024-09-13T23:05:53.844004+0000","last_undegraded":"2024-09-13T23:05:53.844004+0000","last_fullsized":"2024-09-13T23:05:53.844004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:51.066283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'11","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.329086+0000","last_change":"2024-09-13T23:05:14.114497+0000","last_active":"2024-09-13T23:08:22.329086+0000","last_peered":"2024-09-13T23:08:22.329086+0000","last_clean":"2024-09-13T23:08:22.329086+0000","last_became_active":"2024-09-13T23:05:14.114261+0000","last_became_peered":"2024-09-13T23:05:14.114261+0000","last_unstale":"2024-09-13T23:08:22.329086+0000","last_undegraded":"2024-09-13T23:08:22.329086+0000","last_fullsized":"2024-09-13T23:08:22.329086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:24.193989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:53.841343+0000","last_change":"2024-09-13T23:05:12.130049+0000","last_active":"2024-09-13T23:05:53.841343+0000","last_peered":"2024-09-13T23:05:53.841343+0000","last_clean":"2024-09-13T23:05:53.841343+0000","last_became_active":"2024-09-13T23:05:12.129589+0000","last_became_peered":"2024-09-13T23:05:12.129589+0000","last_unstale":"2024-09-13T23:05:53.841343+0000","last_undegraded":"2024-09-13T23:05:53.841343+0000","last_fullsized":"2024-09-13T23:05:53.841343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:43.763766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.250116+0000","last_change":"2024-09-13T23:05:14.119179+0000","last_active":"2024-09-13T23:08:22.250116+0000","last_peered":"2024-09-13T23:08:22.250116+0000","last_clean":"2024-09-13T23:08:22.250116+0000","last_became_active":"2024-09-13T23:05:14.118922+0000","last_became_peered":"2024-09-13T23:05:14.118922+0000","last_unstale":"2024-09-13T23:08:22.250116+0000","last_undegraded":"2024-09-13T23:08:22.250116+0000","last_fullsized":"2024-09-13T23:08:22.250116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:34:29.752309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156113+0000","last_change":"2024-09-13T23:05:12.140097+0000","last_active":"2024-09-13T23:05:49.156113+0000","last_peered":"2024-09-13T23:05:49.156113+0000","last_clean":"2024-09-13T23:05:49.156113+0000","last_became_active":"2024-09-13T23:05:12.139690+0000","last_became_peered":"2024-09-13T23:05:12.139690+0000","last_unstale":"2024-09-13T23:05:49.156113+0000","last_undegraded":"2024-09-13T23:05:49.156113+0000","last_fullsized":"2024-09-13T23:05:49.156113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:08.185632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'37","reported_seq":102,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.290798+0000","last_change":"2024-09-13T23:05:22.146156+0000","last_active":"2024-09-13T23:08:22.290798+0000","last_peered":"2024-09-13T23:08:22.290798+0000","last_clean":"2024-09-13T23:08:22.290798+0000","last_became_active":"2024-09-13T23:05:22.145872+0000","last_became_peered":"2024-09-13T23:05:22.145872+0000","last_unstale":"2024-09-13T23:08:22.290798+0000","last_undegraded":"2024-09-13T23:08:22.290798+0000","last_fullsized":"2024-09-13T23:08:22.290798+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:03.965843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":174,"num_write":103,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:55.391940+0000","last_change":"2024-09-13T23:05:14.110173+0000","last_active":"2024-09-13T23:05:55.391940+0000","last_peered":"2024-09-13T23:05:55.391940+0000","last_clean":"2024-09-13T23:05:55.391940+0000","last_became_active":"2024-09-13T23:05:14.109928+0000","last_became_peered":"2024-09-13T23:05:14.109928+0000","last_unstale":"2024-09-13T23:05:55.391940+0000","last_undegraded":"2024-09-13T23:05:55.391940+0000","last_fullsized":"2024-09-13T23:05:55.391940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:47:18.620562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.914775+0000","last_change":"2024-09-13T23:05:12.147582+0000","last_active":"2024-09-13T23:05:54.914775+0000","last_peered":"2024-09-13T23:05:54.914775+0000","last_clean":"2024-09-13T23:05:54.914775+0000","last_became_active":"2024-09-13T23:05:12.146236+0000","last_became_peered":"2024-09-13T23:05:12.146236+0000","last_unstale":"2024-09-13T23:05:54.914775+0000","last_undegraded":"2024-09-13T23:05:54.914775+0000","last_fullsized":"2024-09-13T23:05:54.914775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:22:13.152885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.161816+0000","last_change":"2024-09-13T23:05:16.123699+0000","last_active":"2024-09-13T23:05:49.161816+0000","last_peered":"2024-09-13T23:05:49.161816+0000","last_clean":"2024-09-13T23:05:49.161816+0000","last_became_active":"2024-09-13T23:05:16.123362+0000","last_became_peered":"2024-09-13T23:05:16.123362+0000","last_unstale":"2024-09-13T23:05:49.161816+0000","last_undegraded":"2024-09-13T23:05:49.161816+0000","last_fullsized":"2024-09-13T23:05:49.161816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:16:52.649662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'31","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:47.080016+0000","last_change":"2024-09-13T23:05:18.133464+0000","last_active":"2024-09-13T23:07:47.080016+0000","last_peered":"2024-09-13T23:07:47.080016+0000","last_clean":"2024-09-13T23:07:47.080016+0000","last_became_active":"2024-09-13T23:05:18.132642+0000","last_became_peered":"2024-09-13T23:05:18.132642+0000","last_unstale":"2024-09-13T23:07:47.080016+0000","last_undegraded":"2024-09-13T23:07:47.080016+0000","last_fullsized":"2024-09-13T23:07:47.080016+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:36:33.250277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158666+0000","last_change":"2024-09-13T23:05:20.145619+0000","last_active":"2024-09-13T23:05:49.158666+0000","last_peered":"2024-09-13T23:05:49.158666+0000","last_clean":"2024-09-13T23:05:49.158666+0000","last_became_active":"2024-09-13T23:05:20.145271+0000","last_became_peered":"2024-09-13T23:05:20.145271+0000","last_unstale":"2024-09-13T23:05:49.158666+0000","last_undegraded":"2024-09-13T23:05:49.158666+0000","last_fullsized":"2024-09-13T23:05:49.158666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:42:34.341082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.268382+0000","last_change":"2024-09-13T23:05:22.150560+0000","last_active":"2024-09-13T23:06:37.268382+0000","last_peered":"2024-09-13T23:06:37.268382+0000","last_clean":"2024-09-13T23:06:37.268382+0000","last_became_active":"2024-09-13T23:05:22.150260+0000","last_became_peered":"2024-09-13T23:05:22.150260+0000","last_unstale":"2024-09-13T23:06:37.268382+0000","last_undegraded":"2024-09-13T23:06:37.268382+0000","last_fullsized":"2024-09-13T23:06:37.268382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:13.932874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'6","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.101371+0000","last_change":"2024-09-13T23:05:14.113389+0000","last_active":"2024-09-13T23:08:22.101371+0000","last_peered":"2024-09-13T23:08:22.101371+0000","last_clean":"2024-09-13T23:08:22.101371+0000","last_became_active":"2024-09-13T23:05:14.113131+0000","last_became_peered":"2024-09-13T23:05:14.113131+0000","last_unstale":"2024-09-13T23:08:22.101371+0000","last_undegraded":"2024-09-13T23:08:22.101371+0000","last_fullsized":"2024-09-13T23:08:22.101371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:06.652485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.153289+0000","last_change":"2024-09-13T23:05:12.134287+0000","last_active":"2024-09-13T23:05:49.153289+0000","last_peered":"2024-09-13T23:05:49.153289+0000","last_clean":"2024-09-13T23:05:49.153289+0000","last_became_active":"2024-09-13T23:05:12.133505+0000","last_became_peered":"2024-09-13T23:05:12.133505+0000","last_unstale":"2024-09-13T23:05:49.153289+0000","last_undegraded":"2024-09-13T23:05:49.153289+0000","last_fullsized":"2024-09-13T23:05:49.153289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:56.855326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159485+0000","last_change":"2024-09-13T23:05:16.125089+0000","last_active":"2024-09-13T23:05:49.159485+0000","last_peered":"2024-09-13T23:05:49.159485+0000","last_clean":"2024-09-13T23:05:49.159485+0000","last_became_active":"2024-09-13T23:05:16.124724+0000","last_became_peered":"2024-09-13T23:05:16.124724+0000","last_unstale":"2024-09-13T23:05:49.159485+0000","last_undegraded":"2024-09-13T23:05:49.159485+0000","last_fullsized":"2024-09-13T23:05:49.159485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:57:02.718638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:43.078368+0000","last_change":"2024-09-13T23:05:18.126600+0000","last_active":"2024-09-13T23:07:43.078368+0000","last_peered":"2024-09-13T23:07:43.078368+0000","last_clean":"2024-09-13T23:07:43.078368+0000","last_became_active":"2024-09-13T23:05:18.126251+0000","last_became_peered":"2024-09-13T23:05:18.126251+0000","last_unstale":"2024-09-13T23:07:43.078368+0000","last_undegraded":"2024-09-13T23:07:43.078368+0000","last_fullsized":"2024-09-13T23:07:43.078368+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:07:27.243286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156395+0000","last_change":"2024-09-13T23:05:20.142878+0000","last_active":"2024-09-13T23:05:49.156395+0000","last_peered":"2024-09-13T23:05:49.156395+0000","last_clean":"2024-09-13T23:05:49.156395+0000","last_became_active":"2024-09-13T23:05:20.142564+0000","last_became_peered":"2024-09-13T23:05:20.142564+0000","last_unstale":"2024-09-13T23:05:49.156395+0000","last_undegraded":"2024-09-13T23:05:49.156395+0000","last_fullsized":"2024-09-13T23:05:49.156395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:59.655692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158502+0000","last_change":"2024-09-13T23:05:22.147806+0000","last_active":"2024-09-13T23:05:49.158502+0000","last_peered":"2024-09-13T23:05:49.158502+0000","last_clean":"2024-09-13T23:05:49.158502+0000","last_became_active":"2024-09-13T23:05:22.147493+0000","last_became_peered":"2024-09-13T23:05:22.147493+0000","last_unstale":"2024-09-13T23:05:49.158502+0000","last_undegraded":"2024-09-13T23:05:49.158502+0000","last_fullsized":"2024-09-13T23:05:49.158502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:13.932874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.450589+0000","last_change":"2024-09-13T23:05:14.113438+0000","last_active":"2024-09-13T23:06:37.450589+0000","last_peered":"2024-09-13T23:06:37.450589+0000","last_clean":"2024-09-13T23:06:37.450589+0000","last_became_active":"2024-09-13T23:05:14.112986+0000","last_became_peered":"2024-09-13T23:05:14.112986+0000","last_unstale":"2024-09-13T23:06:37.450589+0000","last_undegraded":"2024-09-13T23:06:37.450589+0000","last_fullsized":"2024-09-13T23:06:37.450589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:45:08.233460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155482+0000","last_change":"2024-09-13T23:05:12.139949+0000","last_active":"2024-09-13T23:05:49.155482+0000","last_peered":"2024-09-13T23:05:49.155482+0000","last_clean":"2024-09-13T23:05:49.155482+0000","last_became_active":"2024-09-13T23:05:12.138805+0000","last_became_peered":"2024-09-13T23:05:12.138805+0000","last_unstale":"2024-09-13T23:05:49.155482+0000","last_undegraded":"2024-09-13T23:05:49.155482+0000","last_fullsized":"2024-09-13T23:05:49.155482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:31:38.135658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:51.062287+0000","last_change":"2024-09-13T23:05:49.165573+0000","last_active":"2024-09-13T23:05:51.062287+0000","last_peered":"2024-09-13T23:05:51.062287+0000","last_clean":"2024-09-13T23:05:51.062287+0000","last_became_active":"2024-09-13T23:05:49.165209+0000","last_became_peered":"2024-09-13T23:05:49.165209+0000","last_unstale":"2024-09-13T23:05:51.062287+0000","last_undegraded":"2024-09-13T23:05:51.062287+0000","last_fullsized":"2024-09-13T23:05:51.062287+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:19:50.556651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"34'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:41.077798+0000","last_change":"2024-09-13T23:05:18.134680+0000","last_active":"2024-09-13T23:07:41.077798+0000","last_peered":"2024-09-13T23:07:41.077798+0000","last_clean":"2024-09-13T23:07:41.077798+0000","last_became_active":"2024-09-13T23:05:18.134363+0000","last_became_peered":"2024-09-13T23:05:18.134363+0000","last_unstale":"2024-09-13T23:07:41.077798+0000","last_undegraded":"2024-09-13T23:07:41.077798+0000","last_fullsized":"2024-09-13T23:07:41.077798+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:00.335024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":385,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.612992+0000","last_change":"2024-09-13T23:05:20.144269+0000","last_active":"2024-09-13T23:08:22.612992+0000","last_peered":"2024-09-13T23:08:22.612992+0000","last_clean":"2024-09-13T23:08:22.612992+0000","last_became_active":"2024-09-13T23:05:20.143986+0000","last_became_peered":"2024-09-13T23:05:20.143986+0000","last_unstale":"2024-09-13T23:08:22.612992+0000","last_undegraded":"2024-09-13T23:08:22.612992+0000","last_fullsized":"2024-09-13T23:08:22.612992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:13.991065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'8","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.683567+0000","last_change":"2024-09-13T23:05:22.151271+0000","last_active":"2024-09-13T23:08:21.683567+0000","last_peered":"2024-09-13T23:08:21.683567+0000","last_clean":"2024-09-13T23:08:21.683567+0000","last_became_active":"2024-09-13T23:05:22.150977+0000","last_became_peered":"2024-09-13T23:05:22.150977+0000","last_unstale":"2024-09-13T23:08:21.683567+0000","last_undegraded":"2024-09-13T23:08:21.683567+0000","last_fullsized":"2024-09-13T23:08:21.683567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:52:45.769736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'12","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.106650+0000","last_change":"2024-09-13T23:05:14.122457+0000","last_active":"2024-09-13T23:08:22.106650+0000","last_peered":"2024-09-13T23:08:22.106650+0000","last_clean":"2024-09-13T23:08:22.106650+0000","last_became_active":"2024-09-13T23:05:14.121960+0000","last_became_peered":"2024-09-13T23:05:14.121960+0000","last_unstale":"2024-09-13T23:08:22.106650+0000","last_undegraded":"2024-09-13T23:08:22.106650+0000","last_fullsized":"2024-09-13T23:08:22.106650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:29:29.556013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:53.841405+0000","last_change":"2024-09-13T23:05:12.129400+0000","last_active":"2024-09-13T23:05:53.841405+0000","last_peered":"2024-09-13T23:05:53.841405+0000","last_clean":"2024-09-13T23:05:53.841405+0000","last_became_active":"2024-09-13T23:05:12.129019+0000","last_became_peered":"2024-09-13T23:05:12.129019+0000","last_unstale":"2024-09-13T23:05:53.841405+0000","last_undegraded":"2024-09-13T23:05:53.841405+0000","last_fullsized":"2024-09-13T23:05:53.841405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:17.130898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.162782+0000","last_change":"2024-09-13T23:05:16.122830+0000","last_active":"2024-09-13T23:05:49.162782+0000","last_peered":"2024-09-13T23:05:49.162782+0000","last_clean":"2024-09-13T23:05:49.162782+0000","last_became_active":"2024-09-13T23:05:16.122555+0000","last_became_peered":"2024-09-13T23:05:16.122555+0000","last_unstale":"2024-09-13T23:05:49.162782+0000","last_undegraded":"2024-09-13T23:05:49.162782+0000","last_fullsized":"2024-09-13T23:05:49.162782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:26.261538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.718356+0000","last_change":"2024-09-13T23:05:18.128964+0000","last_active":"2024-09-13T23:07:19.718356+0000","last_peered":"2024-09-13T23:07:19.718356+0000","last_clean":"2024-09-13T23:07:19.718356+0000","last_became_active":"2024-09-13T23:05:18.128626+0000","last_became_peered":"2024-09-13T23:05:18.128626+0000","last_unstale":"2024-09-13T23:07:19.718356+0000","last_undegraded":"2024-09-13T23:07:19.718356+0000","last_fullsized":"2024-09-13T23:07:19.718356+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:06.922448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'284","reported_seq":403,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.061012+0000","last_change":"2024-09-13T23:05:20.132195+0000","last_active":"2024-09-13T23:08:29.061012+0000","last_peered":"2024-09-13T23:08:29.061012+0000","last_clean":"2024-09-13T23:08:29.061012+0000","last_became_active":"2024-09-13T23:05:20.131943+0000","last_became_peered":"2024-09-13T23:05:20.131943+0000","last_unstale":"2024-09-13T23:08:29.061012+0000","last_undegraded":"2024-09-13T23:08:29.061012+0000","last_fullsized":"2024-09-13T23:08:29.061012+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:31.349343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158421+0000","last_change":"2024-09-13T23:05:14.127270+0000","last_active":"2024-09-13T23:05:49.158421+0000","last_peered":"2024-09-13T23:05:49.158421+0000","last_clean":"2024-09-13T23:05:49.158421+0000","last_became_active":"2024-09-13T23:05:14.126659+0000","last_became_peered":"2024-09-13T23:05:14.126659+0000","last_unstale":"2024-09-13T23:05:49.158421+0000","last_undegraded":"2024-09-13T23:05:49.158421+0000","last_fullsized":"2024-09-13T23:05:49.158421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:48.797832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160679+0000","last_change":"2024-09-13T23:05:12.116365+0000","last_active":"2024-09-13T23:05:49.160679+0000","last_peered":"2024-09-13T23:05:49.160679+0000","last_clean":"2024-09-13T23:05:49.160679+0000","last_became_active":"2024-09-13T23:05:12.114453+0000","last_became_peered":"2024-09-13T23:05:12.114453+0000","last_unstale":"2024-09-13T23:05:49.160679+0000","last_undegraded":"2024-09-13T23:05:49.160679+0000","last_fullsized":"2024-09-13T23:05:49.160679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:27.884217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156721+0000","last_change":"2024-09-13T23:05:16.124600+0000","last_active":"2024-09-13T23:05:49.156721+0000","last_peered":"2024-09-13T23:05:49.156721+0000","last_clean":"2024-09-13T23:05:49.156721+0000","last_became_active":"2024-09-13T23:05:16.124324+0000","last_became_peered":"2024-09-13T23:05:16.124324+0000","last_unstale":"2024-09-13T23:05:49.156721+0000","last_undegraded":"2024-09-13T23:05:49.156721+0000","last_fullsized":"2024-09-13T23:05:49.156721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:41.101957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'40","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.728296+0000","last_change":"2024-09-13T23:05:18.130180+0000","last_active":"2024-09-13T23:07:19.728296+0000","last_peered":"2024-09-13T23:07:19.728296+0000","last_clean":"2024-09-13T23:07:19.728296+0000","last_became_active":"2024-09-13T23:05:18.129887+0000","last_became_peered":"2024-09-13T23:05:18.129887+0000","last_unstale":"2024-09-13T23:07:19.728296+0000","last_undegraded":"2024-09-13T23:07:19.728296+0000","last_fullsized":"2024-09-13T23:07:19.728296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:07:09.827042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160148+0000","last_change":"2024-09-13T23:05:20.136290+0000","last_active":"2024-09-13T23:05:49.160148+0000","last_peered":"2024-09-13T23:05:49.160148+0000","last_clean":"2024-09-13T23:05:49.160148+0000","last_became_active":"2024-09-13T23:05:20.135937+0000","last_became_peered":"2024-09-13T23:05:20.135937+0000","last_unstale":"2024-09-13T23:05:49.160148+0000","last_undegraded":"2024-09-13T23:05:49.160148+0000","last_fullsized":"2024-09-13T23:05:49.160148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.119483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.270132+0000","last_change":"2024-09-13T23:05:22.146349+0000","last_active":"2024-09-13T23:06:37.270132+0000","last_peered":"2024-09-13T23:06:37.270132+0000","last_clean":"2024-09-13T23:06:37.270132+0000","last_became_active":"2024-09-13T23:05:22.146044+0000","last_became_peered":"2024-09-13T23:05:22.146044+0000","last_unstale":"2024-09-13T23:06:37.270132+0000","last_undegraded":"2024-09-13T23:06:37.270132+0000","last_fullsized":"2024-09-13T23:06:37.270132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:21.509044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157862+0000","last_change":"2024-09-13T23:05:14.116849+0000","last_active":"2024-09-13T23:05:49.157862+0000","last_peered":"2024-09-13T23:05:49.157862+0000","last_clean":"2024-09-13T23:05:49.157862+0000","last_became_active":"2024-09-13T23:05:14.116507+0000","last_became_peered":"2024-09-13T23:05:14.116507+0000","last_unstale":"2024-09-13T23:05:49.157862+0000","last_undegraded":"2024-09-13T23:05:49.157862+0000","last_fullsized":"2024-09-13T23:05:49.157862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:29:29.556013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.441116+0000","last_change":"2024-09-13T23:05:12.115905+0000","last_active":"2024-09-13T23:06:37.441116+0000","last_peered":"2024-09-13T23:06:37.441116+0000","last_clean":"2024-09-13T23:06:37.441116+0000","last_became_active":"2024-09-13T23:05:12.115025+0000","last_became_peered":"2024-09-13T23:05:12.115025+0000","last_unstale":"2024-09-13T23:06:37.441116+0000","last_undegraded":"2024-09-13T23:06:37.441116+0000","last_fullsized":"2024-09-13T23:06:37.441116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:18.644207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158753+0000","last_change":"2024-09-13T23:05:16.118904+0000","last_active":"2024-09-13T23:05:49.158753+0000","last_peered":"2024-09-13T23:05:49.158753+0000","last_clean":"2024-09-13T23:05:49.158753+0000","last_became_active":"2024-09-13T23:05:16.118494+0000","last_became_peered":"2024-09-13T23:05:16.118494+0000","last_unstale":"2024-09-13T23:05:49.158753+0000","last_undegraded":"2024-09-13T23:05:49.158753+0000","last_fullsized":"2024-09-13T23:05:49.158753+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:04:52.706373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.708412+0000","last_change":"2024-09-13T23:05:18.134435+0000","last_active":"2024-09-13T23:07:19.708412+0000","last_peered":"2024-09-13T23:07:19.708412+0000","last_clean":"2024-09-13T23:07:19.708412+0000","last_became_active":"2024-09-13T23:05:18.134130+0000","last_became_peered":"2024-09-13T23:05:18.134130+0000","last_unstale":"2024-09-13T23:07:19.708412+0000","last_undegraded":"2024-09-13T23:07:19.708412+0000","last_fullsized":"2024-09-13T23:07:19.708412+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:26.188132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159456+0000","last_change":"2024-09-13T23:05:20.140527+0000","last_active":"2024-09-13T23:05:49.159456+0000","last_peered":"2024-09-13T23:05:49.159456+0000","last_clean":"2024-09-13T23:05:49.159456+0000","last_became_active":"2024-09-13T23:05:20.140180+0000","last_became_peered":"2024-09-13T23:05:20.140180+0000","last_unstale":"2024-09-13T23:05:49.159456+0000","last_undegraded":"2024-09-13T23:05:49.159456+0000","last_fullsized":"2024-09-13T23:05:49.159456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:59.655692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'7","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.257996+0000","last_change":"2024-09-13T23:05:22.148436+0000","last_active":"2024-09-13T23:06:37.257996+0000","last_peered":"2024-09-13T23:06:37.257996+0000","last_clean":"2024-09-13T23:06:37.257996+0000","last_became_active":"2024-09-13T23:05:22.148104+0000","last_became_peered":"2024-09-13T23:05:22.148104+0000","last_unstale":"2024-09-13T23:06:37.257996+0000","last_undegraded":"2024-09-13T23:06:37.257996+0000","last_fullsized":"2024-09-13T23:06:37.257996+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:03:42.989142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":18,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.153941+0000","last_change":"2024-09-13T23:05:14.119333+0000","last_active":"2024-09-13T23:05:49.153941+0000","last_peered":"2024-09-13T23:05:49.153941+0000","last_clean":"2024-09-13T23:05:49.153941+0000","last_became_active":"2024-09-13T23:05:14.119071+0000","last_became_peered":"2024-09-13T23:05:14.119071+0000","last_unstale":"2024-09-13T23:05:49.153941+0000","last_undegraded":"2024-09-13T23:05:49.153941+0000","last_fullsized":"2024-09-13T23:05:49.153941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:22.705770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:27.076346+0000","last_change":"2024-09-13T23:05:12.148852+0000","last_active":"2024-09-13T23:07:27.076346+0000","last_peered":"2024-09-13T23:07:27.076346+0000","last_clean":"2024-09-13T23:07:27.076346+0000","last_became_active":"2024-09-13T23:05:12.148439+0000","last_became_peered":"2024-09-13T23:05:12.148439+0000","last_unstale":"2024-09-13T23:07:27.076346+0000","last_undegraded":"2024-09-13T23:07:27.076346+0000","last_fullsized":"2024-09-13T23:07:27.076346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:48:38.654493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159519+0000","last_change":"2024-09-13T23:05:16.123514+0000","last_active":"2024-09-13T23:05:49.159519+0000","last_peered":"2024-09-13T23:05:49.159519+0000","last_clean":"2024-09-13T23:05:49.159519+0000","last_became_active":"2024-09-13T23:05:16.123188+0000","last_became_peered":"2024-09-13T23:05:16.123188+0000","last_unstale":"2024-09-13T23:05:49.159519+0000","last_undegraded":"2024-09-13T23:05:49.159519+0000","last_fullsized":"2024-09-13T23:05:49.159519+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:12:38.123647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.730276+0000","last_change":"2024-09-13T23:05:18.132366+0000","last_active":"2024-09-13T23:07:19.730276+0000","last_peered":"2024-09-13T23:07:19.730276+0000","last_clean":"2024-09-13T23:07:19.730276+0000","last_became_active":"2024-09-13T23:05:18.131446+0000","last_became_peered":"2024-09-13T23:05:18.131446+0000","last_unstale":"2024-09-13T23:07:19.730276+0000","last_undegraded":"2024-09-13T23:07:19.730276+0000","last_fullsized":"2024-09-13T23:07:19.730276+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:53.858562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'284","reported_seq":350,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.062101+0000","last_change":"2024-09-13T23:05:20.144417+0000","last_active":"2024-09-13T23:08:29.062101+0000","last_peered":"2024-09-13T23:08:29.062101+0000","last_clean":"2024-09-13T23:08:29.062101+0000","last_became_active":"2024-09-13T23:05:20.144104+0000","last_became_peered":"2024-09-13T23:05:20.144104+0000","last_unstale":"2024-09-13T23:08:29.062101+0000","last_undegraded":"2024-09-13T23:08:29.062101+0000","last_fullsized":"2024-09-13T23:08:29.062101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:33.653779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160034+0000","last_change":"2024-09-13T23:05:22.147955+0000","last_active":"2024-09-13T23:05:49.160034+0000","last_peered":"2024-09-13T23:05:49.160034+0000","last_clean":"2024-09-13T23:05:49.160034+0000","last_became_active":"2024-09-13T23:05:22.147645+0000","last_became_peered":"2024-09-13T23:05:22.147645+0000","last_unstale":"2024-09-13T23:05:49.160034+0000","last_undegraded":"2024-09-13T23:05:49.160034+0000","last_fullsized":"2024-09-13T23:05:49.160034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:07.578205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'10","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362666+0000","last_change":"2024-09-13T23:05:14.112569+0000","last_active":"2024-09-13T23:08:22.362666+0000","last_peered":"2024-09-13T23:08:22.362666+0000","last_clean":"2024-09-13T23:08:22.362666+0000","last_became_active":"2024-09-13T23:05:14.112291+0000","last_became_peered":"2024-09-13T23:05:14.112291+0000","last_unstale":"2024-09-13T23:08:22.362666+0000","last_undegraded":"2024-09-13T23:08:22.362666+0000","last_fullsized":"2024-09-13T23:08:22.362666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:17.199234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:27.076285+0000","last_change":"2024-09-13T23:05:12.149813+0000","last_active":"2024-09-13T23:07:27.076285+0000","last_peered":"2024-09-13T23:07:27.076285+0000","last_clean":"2024-09-13T23:07:27.076285+0000","last_became_active":"2024-09-13T23:05:12.149418+0000","last_became_peered":"2024-09-13T23:05:12.149418+0000","last_unstale":"2024-09-13T23:07:27.076285+0000","last_undegraded":"2024-09-13T23:07:27.076285+0000","last_fullsized":"2024-09-13T23:07:27.076285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:40.908784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158966+0000","last_change":"2024-09-13T23:05:16.118930+0000","last_active":"2024-09-13T23:05:49.158966+0000","last_peered":"2024-09-13T23:05:49.158966+0000","last_clean":"2024-09-13T23:05:49.158966+0000","last_became_active":"2024-09-13T23:05:16.118503+0000","last_became_peered":"2024-09-13T23:05:16.118503+0000","last_unstale":"2024-09-13T23:05:49.158966+0000","last_undegraded":"2024-09-13T23:05:49.158966+0000","last_fullsized":"2024-09-13T23:05:49.158966+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:46.202221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'54","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.732160+0000","last_change":"2024-09-13T23:05:18.135615+0000","last_active":"2024-09-13T23:07:19.732160+0000","last_peered":"2024-09-13T23:07:19.732160+0000","last_clean":"2024-09-13T23:07:19.732160+0000","last_became_active":"2024-09-13T23:05:18.135307+0000","last_became_peered":"2024-09-13T23:05:18.135307+0000","last_unstale":"2024-09-13T23:07:19.732160+0000","last_undegraded":"2024-09-13T23:07:19.732160+0000","last_fullsized":"2024-09-13T23:07:19.732160+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:14:46.252331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158506+0000","last_change":"2024-09-13T23:05:20.137752+0000","last_active":"2024-09-13T23:05:49.158506+0000","last_peered":"2024-09-13T23:05:49.158506+0000","last_clean":"2024-09-13T23:05:49.158506+0000","last_became_active":"2024-09-13T23:05:20.137460+0000","last_became_peered":"2024-09-13T23:05:20.137460+0000","last_unstale":"2024-09-13T23:05:49.158506+0000","last_undegraded":"2024-09-13T23:05:49.158506+0000","last_fullsized":"2024-09-13T23:05:49.158506+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:24.969082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.583085+0000","last_change":"2024-09-13T23:05:22.141812+0000","last_active":"2024-09-13T23:08:22.583085+0000","last_peered":"2024-09-13T23:08:22.583085+0000","last_clean":"2024-09-13T23:08:22.583085+0000","last_became_active":"2024-09-13T23:05:22.141472+0000","last_became_peered":"2024-09-13T23:05:22.141472+0000","last_unstale":"2024-09-13T23:08:22.583085+0000","last_undegraded":"2024-09-13T23:08:22.583085+0000","last_fullsized":"2024-09-13T23:08:22.583085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:21:03.848726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.933540+0000","last_change":"2024-09-13T23:05:49.164754+0000","last_active":"2024-09-13T23:05:54.933540+0000","last_peered":"2024-09-13T23:05:54.933540+0000","last_clean":"2024-09-13T23:05:54.933540+0000","last_became_active":"2024-09-13T23:05:49.164426+0000","last_became_peered":"2024-09-13T23:05:49.164426+0000","last_unstale":"2024-09-13T23:05:54.933540+0000","last_undegraded":"2024-09-13T23:05:54.933540+0000","last_fullsized":"2024-09-13T23:05:54.933540+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:05.715216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.230923+0000","last_change":"2024-09-13T23:05:12.130483+0000","last_active":"2024-09-13T23:08:22.230923+0000","last_peered":"2024-09-13T23:08:22.230923+0000","last_clean":"2024-09-13T23:08:22.230923+0000","last_became_active":"2024-09-13T23:05:12.129951+0000","last_became_peered":"2024-09-13T23:05:12.129951+0000","last_unstale":"2024-09-13T23:08:22.230923+0000","last_undegraded":"2024-09-13T23:08:22.230923+0000","last_fullsized":"2024-09-13T23:08:22.230923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:29.788894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156275+0000","last_change":"2024-09-13T23:05:16.127877+0000","last_active":"2024-09-13T23:05:49.156275+0000","last_peered":"2024-09-13T23:05:49.156275+0000","last_clean":"2024-09-13T23:05:49.156275+0000","last_became_active":"2024-09-13T23:05:16.127598+0000","last_became_peered":"2024-09-13T23:05:16.127598+0000","last_unstale":"2024-09-13T23:05:49.156275+0000","last_undegraded":"2024-09-13T23:05:49.156275+0000","last_fullsized":"2024-09-13T23:05:49.156275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:22:17.166855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'32","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.712314+0000","last_change":"2024-09-13T23:05:18.129032+0000","last_active":"2024-09-13T23:07:19.712314+0000","last_peered":"2024-09-13T23:07:19.712314+0000","last_clean":"2024-09-13T23:07:19.712314+0000","last_became_active":"2024-09-13T23:05:18.128238+0000","last_became_peered":"2024-09-13T23:05:18.128238+0000","last_unstale":"2024-09-13T23:07:19.712314+0000","last_undegraded":"2024-09-13T23:07:19.712314+0000","last_fullsized":"2024-09-13T23:07:19.712314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:21.134767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.163889+0000","last_change":"2024-09-13T23:05:20.140091+0000","last_active":"2024-09-13T23:05:49.163889+0000","last_peered":"2024-09-13T23:05:49.163889+0000","last_clean":"2024-09-13T23:05:49.163889+0000","last_became_active":"2024-09-13T23:05:20.139335+0000","last_became_peered":"2024-09-13T23:05:20.139335+0000","last_unstale":"2024-09-13T23:05:49.163889+0000","last_undegraded":"2024-09-13T23:05:49.163889+0000","last_fullsized":"2024-09-13T23:05:49.163889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:55.021863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:22.075235+0000","last_change":"2024-09-13T23:05:22.148481+0000","last_active":"2024-09-13T23:07:22.075235+0000","last_peered":"2024-09-13T23:07:22.075235+0000","last_clean":"2024-09-13T23:07:22.075235+0000","last_became_active":"2024-09-13T23:05:22.148222+0000","last_became_peered":"2024-09-13T23:05:22.148222+0000","last_unstale":"2024-09-13T23:07:22.075235+0000","last_undegraded":"2024-09-13T23:07:22.075235+0000","last_fullsized":"2024-09-13T23:07:22.075235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:17.281151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'34","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.987497+0000","last_change":"2024-09-13T23:05:14.118784+0000","last_active":"2024-09-13T23:08:21.987497+0000","last_peered":"2024-09-13T23:08:21.987497+0000","last_clean":"2024-09-13T23:08:21.987497+0000","last_became_active":"2024-09-13T23:05:14.118545+0000","last_became_peered":"2024-09-13T23:05:14.118545+0000","last_unstale":"2024-09-13T23:08:21.987497+0000","last_undegraded":"2024-09-13T23:08:21.987497+0000","last_fullsized":"2024-09-13T23:08:21.987497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:08.429431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":93,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157506+0000","last_change":"2024-09-13T23:05:12.147234+0000","last_active":"2024-09-13T23:05:49.157506+0000","last_peered":"2024-09-13T23:05:49.157506+0000","last_clean":"2024-09-13T23:05:49.157506+0000","last_became_active":"2024-09-13T23:05:12.146912+0000","last_became_peered":"2024-09-13T23:05:12.146912+0000","last_unstale":"2024-09-13T23:05:49.157506+0000","last_undegraded":"2024-09-13T23:05:49.157506+0000","last_fullsized":"2024-09-13T23:05:49.157506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:38:56.354721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159573+0000","last_change":"2024-09-13T23:05:16.114688+0000","last_active":"2024-09-13T23:05:49.159573+0000","last_peered":"2024-09-13T23:05:49.159573+0000","last_clean":"2024-09-13T23:05:49.159573+0000","last_became_active":"2024-09-13T23:05:16.114369+0000","last_became_peered":"2024-09-13T23:05:16.114369+0000","last_unstale":"2024-09-13T23:05:49.159573+0000","last_undegraded":"2024-09-13T23:05:49.159573+0000","last_fullsized":"2024-09-13T23:05:49.159573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:26:55.819506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'37","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.738671+0000","last_change":"2024-09-13T23:05:18.126484+0000","last_active":"2024-09-13T23:07:19.738671+0000","last_peered":"2024-09-13T23:07:19.738671+0000","last_clean":"2024-09-13T23:07:19.738671+0000","last_became_active":"2024-09-13T23:05:18.126183+0000","last_became_peered":"2024-09-13T23:05:18.126183+0000","last_unstale":"2024-09-13T23:07:19.738671+0000","last_undegraded":"2024-09-13T23:07:19.738671+0000","last_fullsized":"2024-09-13T23:07:19.738671+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:26:42.895522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":403,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.586872+0000","last_change":"2024-09-13T23:05:20.143991+0000","last_active":"2024-09-13T23:08:22.586872+0000","last_peered":"2024-09-13T23:08:22.586872+0000","last_clean":"2024-09-13T23:08:22.586872+0000","last_became_active":"2024-09-13T23:05:20.143659+0000","last_became_peered":"2024-09-13T23:05:20.143659+0000","last_unstale":"2024-09-13T23:08:22.586872+0000","last_undegraded":"2024-09-13T23:08:22.586872+0000","last_fullsized":"2024-09-13T23:08:22.586872+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:12.673687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:29.073132+0000","last_change":"2024-09-13T23:05:22.140956+0000","last_active":"2024-09-13T23:07:29.073132+0000","last_peered":"2024-09-13T23:07:29.073132+0000","last_clean":"2024-09-13T23:07:29.073132+0000","last_became_active":"2024-09-13T23:05:22.140485+0000","last_became_peered":"2024-09-13T23:05:22.140485+0000","last_unstale":"2024-09-13T23:07:29.073132+0000","last_undegraded":"2024-09-13T23:07:29.073132+0000","last_fullsized":"2024-09-13T23:07:29.073132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:59:53.508149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'18","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362666+0000","last_change":"2024-09-13T23:05:14.115429+0000","last_active":"2024-09-13T23:08:22.362666+0000","last_peered":"2024-09-13T23:08:22.362666+0000","last_clean":"2024-09-13T23:08:22.362666+0000","last_became_active":"2024-09-13T23:05:14.115166+0000","last_became_peered":"2024-09-13T23:05:14.115166+0000","last_unstale":"2024-09-13T23:08:22.362666+0000","last_undegraded":"2024-09-13T23:08:22.362666+0000","last_fullsized":"2024-09-13T23:08:22.362666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:32:22.514080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.234005+0000","last_change":"2024-09-13T23:05:12.140202+0000","last_active":"2024-09-13T23:08:22.234005+0000","last_peered":"2024-09-13T23:08:22.234005+0000","last_clean":"2024-09-13T23:08:22.234005+0000","last_became_active":"2024-09-13T23:05:12.139283+0000","last_became_peered":"2024-09-13T23:05:12.139283+0000","last_unstale":"2024-09-13T23:08:22.234005+0000","last_undegraded":"2024-09-13T23:08:22.234005+0000","last_fullsized":"2024-09-13T23:08:22.234005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:48.577483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":424,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:20.838224+0000","last_change":"2024-09-13T23:05:49.171563+0000","last_active":"2024-09-13T23:07:20.838224+0000","last_peered":"2024-09-13T23:07:20.838224+0000","last_clean":"2024-09-13T23:07:20.838224+0000","last_became_active":"2024-09-13T23:05:49.164741+0000","last_became_peered":"2024-09-13T23:05:49.164741+0000","last_unstale":"2024-09-13T23:07:20.838224+0000","last_undegraded":"2024-09-13T23:07:20.838224+0000","last_fullsized":"2024-09-13T23:07:20.838224+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:00:34.765305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160915+0000","last_change":"2024-09-13T23:05:18.135452+0000","last_active":"2024-09-13T23:05:49.160915+0000","last_peered":"2024-09-13T23:05:49.160915+0000","last_clean":"2024-09-13T23:05:49.160915+0000","last_became_active":"2024-09-13T23:05:18.135028+0000","last_became_peered":"2024-09-13T23:05:18.135028+0000","last_unstale":"2024-09-13T23:05:49.160915+0000","last_undegraded":"2024-09-13T23:05:49.160915+0000","last_fullsized":"2024-09-13T23:05:49.160915+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:18.976364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":465,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.473644+0000","last_change":"2024-09-13T23:05:20.133263+0000","last_active":"2024-09-13T23:08:22.473644+0000","last_peered":"2024-09-13T23:08:22.473644+0000","last_clean":"2024-09-13T23:08:22.473644+0000","last_became_active":"2024-09-13T23:05:20.132891+0000","last_became_peered":"2024-09-13T23:05:20.132891+0000","last_unstale":"2024-09-13T23:08:22.473644+0000","last_undegraded":"2024-09-13T23:08:22.473644+0000","last_fullsized":"2024-09-13T23:08:22.473644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:54.194855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.115074+0000","last_change":"2024-09-13T23:05:22.150994+0000","last_active":"2024-09-13T23:07:21.115074+0000","last_peered":"2024-09-13T23:07:21.115074+0000","last_clean":"2024-09-13T23:07:21.115074+0000","last_became_active":"2024-09-13T23:05:22.150258+0000","last_became_peered":"2024-09-13T23:05:22.150258+0000","last_unstale":"2024-09-13T23:07:21.115074+0000","last_undegraded":"2024-09-13T23:07:21.115074+0000","last_fullsized":"2024-09-13T23:07:21.115074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:31:47.069056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362873+0000","last_change":"2024-09-13T23:05:14.126232+0000","last_active":"2024-09-13T23:08:22.362873+0000","last_peered":"2024-09-13T23:08:22.362873+0000","last_clean":"2024-09-13T23:08:22.362873+0000","last_became_active":"2024-09-13T23:05:14.125034+0000","last_became_peered":"2024-09-13T23:05:14.125034+0000","last_unstale":"2024-09-13T23:08:22.362873+0000","last_undegraded":"2024-09-13T23:08:22.362873+0000","last_fullsized":"2024-09-13T23:08:22.362873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:04:50.699295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'3","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.249529+0000","last_change":"2024-09-13T23:05:12.143810+0000","last_active":"2024-09-13T23:06:37.249529+0000","last_peered":"2024-09-13T23:06:37.249529+0000","last_clean":"2024-09-13T23:06:37.249529+0000","last_became_active":"2024-09-13T23:05:12.142185+0000","last_became_peered":"2024-09-13T23:05:12.142185+0000","last_unstale":"2024-09-13T23:06:37.249529+0000","last_undegraded":"2024-09-13T23:06:37.249529+0000","last_fullsized":"2024-09-13T23:06:37.249529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:22.187097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.163377+0000","last_change":"2024-09-13T23:05:16.125331+0000","last_active":"2024-09-13T23:05:49.163377+0000","last_peered":"2024-09-13T23:05:49.163377+0000","last_clean":"2024-09-13T23:05:49.163377+0000","last_became_active":"2024-09-13T23:05:16.125013+0000","last_became_peered":"2024-09-13T23:05:16.125013+0000","last_unstale":"2024-09-13T23:05:49.163377+0000","last_undegraded":"2024-09-13T23:05:49.163377+0000","last_fullsized":"2024-09-13T23:05:49.163377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:44.318931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'38","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.725307+0000","last_change":"2024-09-13T23:05:18.126590+0000","last_active":"2024-09-13T23:07:19.725307+0000","last_peered":"2024-09-13T23:07:19.725307+0000","last_clean":"2024-09-13T23:07:19.725307+0000","last_became_active":"2024-09-13T23:05:18.126271+0000","last_became_peered":"2024-09-13T23:05:18.126271+0000","last_unstale":"2024-09-13T23:07:19.725307+0000","last_undegraded":"2024-09-13T23:07:19.725307+0000","last_fullsized":"2024-09-13T23:07:19.725307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:23.420696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.154145+0000","last_change":"2024-09-13T23:05:20.145937+0000","last_active":"2024-09-13T23:05:49.154145+0000","last_peered":"2024-09-13T23:05:49.154145+0000","last_clean":"2024-09-13T23:05:49.154145+0000","last_became_active":"2024-09-13T23:05:20.145626+0000","last_became_peered":"2024-09-13T23:05:20.145626+0000","last_unstale":"2024-09-13T23:05:49.154145+0000","last_undegraded":"2024-09-13T23:05:49.154145+0000","last_fullsized":"2024-09-13T23:05:49.154145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:12.850248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.421783+0000","last_change":"2024-09-13T23:05:22.137537+0000","last_active":"2024-09-13T23:08:22.421783+0000","last_peered":"2024-09-13T23:08:22.421783+0000","last_clean":"2024-09-13T23:08:22.421783+0000","last_became_active":"2024-09-13T23:05:22.137111+0000","last_became_peered":"2024-09-13T23:05:22.137111+0000","last_unstale":"2024-09-13T23:08:22.421783+0000","last_undegraded":"2024-09-13T23:08:22.421783+0000","last_fullsized":"2024-09-13T23:08:22.421783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:04:57.442372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'16","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:17.907900+0000","last_change":"2024-09-13T23:05:49.168074+0000","last_active":"2024-09-13T23:07:17.907900+0000","last_peered":"2024-09-13T23:07:17.907900+0000","last_clean":"2024-09-13T23:07:17.907900+0000","last_became_active":"2024-09-13T23:05:49.165166+0000","last_became_peered":"2024-09-13T23:05:49.165166+0000","last_unstale":"2024-09-13T23:07:17.907900+0000","last_undegraded":"2024-09-13T23:07:17.907900+0000","last_fullsized":"2024-09-13T23:07:17.907900+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:16:50.642584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":51,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":204,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.154898+0000","last_change":"2024-09-13T23:04:56.151685+0000","last_active":"2024-09-13T23:05:49.154898+0000","last_peered":"2024-09-13T23:05:49.154898+0000","last_clean":"2024-09-13T23:05:49.154898+0000","last_became_active":"2024-09-13T23:04:56.149747+0000","last_became_peered":"2024-09-13T23:04:56.149747+0000","last_unstale":"2024-09-13T23:05:49.154898+0000","last_undegraded":"2024-09-13T23:05:49.154898+0000","last_fullsized":"2024-09-13T23:05:49.154898+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:04:55.054026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:04:55.054026+0000","last_clean_scrub_stamp":"2024-09-13T23:04:55.054026+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:38.290092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160070+0000","last_change":"2024-09-13T23:05:03.078734+0000","last_active":"2024-09-13T23:05:49.160070+0000","last_peered":"2024-09-13T23:05:49.160070+0000","last_clean":"2024-09-13T23:05:49.160070+0000","last_became_active":"2024-09-13T23:05:01.074608+0000","last_became_peered":"2024-09-13T23:05:01.074608+0000","last_unstale":"2024-09-13T23:05:49.160070+0000","last_undegraded":"2024-09-13T23:05:49.160070+0000","last_fullsized":"2024-09-13T23:05:49.160070+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:03.125973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097176599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:17.074746+0000","last_change":"2024-09-13T23:05:12.147068+0000","last_active":"2024-09-13T23:07:17.074746+0000","last_peered":"2024-09-13T23:07:17.074746+0000","last_clean":"2024-09-13T23:07:17.074746+0000","last_became_active":"2024-09-13T23:05:12.146438+0000","last_became_peered":"2024-09-13T23:05:12.146438+0000","last_unstale":"2024-09-13T23:07:17.074746+0000","last_undegraded":"2024-09-13T23:07:17.074746+0000","last_fullsized":"2024-09-13T23:07:17.074746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:25:59.118016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158851+0000","last_change":"2024-09-13T23:05:16.115876+0000","last_active":"2024-09-13T23:05:49.158851+0000","last_peered":"2024-09-13T23:05:49.158851+0000","last_clean":"2024-09-13T23:05:49.158851+0000","last_became_active":"2024-09-13T23:05:16.115599+0000","last_became_peered":"2024-09-13T23:05:16.115599+0000","last_unstale":"2024-09-13T23:05:49.158851+0000","last_undegraded":"2024-09-13T23:05:49.158851+0000","last_fullsized":"2024-09-13T23:05:49.158851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:22.878444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'76","reported_seq":145,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.736517+0000","last_change":"2024-09-13T23:05:18.135412+0000","last_active":"2024-09-13T23:07:19.736517+0000","last_peered":"2024-09-13T23:07:19.736517+0000","last_clean":"2024-09-13T23:07:19.736517+0000","last_became_active":"2024-09-13T23:05:18.135080+0000","last_became_peered":"2024-09-13T23:05:18.135080+0000","last_unstale":"2024-09-13T23:07:19.736517+0000","last_undegraded":"2024-09-13T23:07:19.736517+0000","last_fullsized":"2024-09-13T23:07:19.736517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:46.305461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160178+0000","last_change":"2024-09-13T23:05:20.139707+0000","last_active":"2024-09-13T23:05:49.160178+0000","last_peered":"2024-09-13T23:05:49.160178+0000","last_clean":"2024-09-13T23:05:49.160178+0000","last_became_active":"2024-09-13T23:05:20.139399+0000","last_became_peered":"2024-09-13T23:05:20.139399+0000","last_unstale":"2024-09-13T23:05:49.160178+0000","last_undegraded":"2024-09-13T23:05:49.160178+0000","last_fullsized":"2024-09-13T23:05:49.160178+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:42:34.341082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'87","reported_seq":171,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.374408+0000","last_change":"2024-09-13T23:05:22.140722+0000","last_active":"2024-09-13T23:08:22.374408+0000","last_peered":"2024-09-13T23:08:22.374408+0000","last_clean":"2024-09-13T23:08:22.374408+0000","last_became_active":"2024-09-13T23:05:22.140430+0000","last_became_peered":"2024-09-13T23:05:22.140430+0000","last_unstale":"2024-09-13T23:08:22.374408+0000","last_undegraded":"2024-09-13T23:08:22.374408+0000","last_fullsized":"2024-09-13T23:08:22.374408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:57.254040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":226,"num_write":170,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.101402+0000","last_change":"2024-09-13T23:05:14.113221+0000","last_active":"2024-09-13T23:08:22.101402+0000","last_peered":"2024-09-13T23:08:22.101402+0000","last_clean":"2024-09-13T23:08:22.101402+0000","last_became_active":"2024-09-13T23:05:14.112711+0000","last_became_peered":"2024-09-13T23:05:14.112711+0000","last_unstale":"2024-09-13T23:08:22.101402+0000","last_undegraded":"2024-09-13T23:08:22.101402+0000","last_fullsized":"2024-09-13T23:08:22.101402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:40.124504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157421+0000","last_change":"2024-09-13T23:05:03.078145+0000","last_active":"2024-09-13T23:05:49.157421+0000","last_peered":"2024-09-13T23:05:49.157421+0000","last_clean":"2024-09-13T23:05:49.157421+0000","last_became_active":"2024-09-13T23:05:01.075438+0000","last_became_peered":"2024-09-13T23:05:01.075438+0000","last_unstale":"2024-09-13T23:05:49.157421+0000","last_undegraded":"2024-09-13T23:05:49.157421+0000","last_fullsized":"2024-09-13T23:05:49.157421+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:36:59.019783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043480299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158406+0000","last_change":"2024-09-13T23:05:12.114595+0000","last_active":"2024-09-13T23:05:49.158406+0000","last_peered":"2024-09-13T23:05:49.158406+0000","last_clean":"2024-09-13T23:05:49.158406+0000","last_became_active":"2024-09-13T23:05:12.114087+0000","last_became_peered":"2024-09-13T23:05:12.114087+0000","last_unstale":"2024-09-13T23:05:49.158406+0000","last_undegraded":"2024-09-13T23:05:49.158406+0000","last_fullsized":"2024-09-13T23:05:49.158406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:01:21.996979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.164060+0000","last_change":"2024-09-13T23:05:16.127786+0000","last_active":"2024-09-13T23:05:49.164060+0000","last_peered":"2024-09-13T23:05:49.164060+0000","last_clean":"2024-09-13T23:05:49.164060+0000","last_became_active":"2024-09-13T23:05:16.127404+0000","last_became_peered":"2024-09-13T23:05:16.127404+0000","last_unstale":"2024-09-13T23:05:49.164060+0000","last_undegraded":"2024-09-13T23:05:49.164060+0000","last_fullsized":"2024-09-13T23:05:49.164060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:03:50.653375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'274","reported_seq":477,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.205293+0000","last_change":"2024-09-13T23:05:18.135832+0000","last_active":"2024-09-13T23:08:21.205293+0000","last_peered":"2024-09-13T23:08:21.205293+0000","last_clean":"2024-09-13T23:08:21.205293+0000","last_became_active":"2024-09-13T23:05:18.135536+0000","last_became_peered":"2024-09-13T23:05:18.135536+0000","last_unstale":"2024-09-13T23:08:21.205293+0000","last_undegraded":"2024-09-13T23:08:21.205293+0000","last_fullsized":"2024-09-13T23:08:21.205293+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:46.163680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.161250+0000","last_change":"2024-09-13T23:05:20.139219+0000","last_active":"2024-09-13T23:05:49.161250+0000","last_peered":"2024-09-13T23:05:49.161250+0000","last_clean":"2024-09-13T23:05:49.161250+0000","last_became_active":"2024-09-13T23:05:20.138840+0000","last_became_peered":"2024-09-13T23:05:20.138840+0000","last_unstale":"2024-09-13T23:05:49.161250+0000","last_undegraded":"2024-09-13T23:05:49.161250+0000","last_fullsized":"2024-09-13T23:05:49.161250+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:11.879040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'5","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.012786+0000","last_change":"2024-09-13T23:05:22.149748+0000","last_active":"2024-09-13T23:08:22.012786+0000","last_peered":"2024-09-13T23:08:22.012786+0000","last_clean":"2024-09-13T23:08:22.012786+0000","last_became_active":"2024-09-13T23:05:22.149430+0000","last_became_peered":"2024-09-13T23:05:22.149430+0000","last_unstale":"2024-09-13T23:08:22.012786+0000","last_undegraded":"2024-09-13T23:08:22.012786+0000","last_fullsized":"2024-09-13T23:08:22.012786+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:59:53.508149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:17.907468+0000","last_change":"2024-09-13T23:05:14.122318+0000","last_active":"2024-09-13T23:07:17.907468+0000","last_peered":"2024-09-13T23:07:17.907468+0000","last_clean":"2024-09-13T23:07:17.907468+0000","last_became_active":"2024-09-13T23:05:14.121629+0000","last_became_peered":"2024-09-13T23:05:14.121629+0000","last_unstale":"2024-09-13T23:07:17.907468+0000","last_undegraded":"2024-09-13T23:07:17.907468+0000","last_fullsized":"2024-09-13T23:07:17.907468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:40.466898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.153107+0000","last_change":"2024-09-13T23:05:03.246597+0000","last_active":"2024-09-13T23:05:49.153107+0000","last_peered":"2024-09-13T23:05:49.153107+0000","last_clean":"2024-09-13T23:05:49.153107+0000","last_became_active":"2024-09-13T23:05:01.075422+0000","last_became_peered":"2024-09-13T23:05:01.075422+0000","last_unstale":"2024-09-13T23:05:49.153107+0000","last_undegraded":"2024-09-13T23:05:49.153107+0000","last_fullsized":"2024-09-13T23:05:49.153107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:46.318146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049267099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158237+0000","last_change":"2024-09-13T23:05:12.118437+0000","last_active":"2024-09-13T23:05:49.158237+0000","last_peered":"2024-09-13T23:05:49.158237+0000","last_clean":"2024-09-13T23:05:49.158237+0000","last_became_active":"2024-09-13T23:05:12.117940+0000","last_became_peered":"2024-09-13T23:05:12.117940+0000","last_unstale":"2024-09-13T23:05:49.158237+0000","last_undegraded":"2024-09-13T23:05:49.158237+0000","last_fullsized":"2024-09-13T23:05:49.158237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:14:55.200398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158030+0000","last_change":"2024-09-13T23:05:16.122638+0000","last_active":"2024-09-13T23:05:49.158030+0000","last_peered":"2024-09-13T23:05:49.158030+0000","last_clean":"2024-09-13T23:05:49.158030+0000","last_became_active":"2024-09-13T23:05:16.122318+0000","last_became_peered":"2024-09-13T23:05:16.122318+0000","last_unstale":"2024-09-13T23:05:49.158030+0000","last_undegraded":"2024-09-13T23:05:49.158030+0000","last_fullsized":"2024-09-13T23:05:49.158030+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:42.400087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.205271+0000","last_change":"2024-09-13T23:05:18.128025+0000","last_active":"2024-09-13T23:08:21.205271+0000","last_peered":"2024-09-13T23:08:21.205271+0000","last_clean":"2024-09-13T23:08:21.205271+0000","last_became_active":"2024-09-13T23:05:18.127698+0000","last_became_peered":"2024-09-13T23:05:18.127698+0000","last_unstale":"2024-09-13T23:08:21.205271+0000","last_undegraded":"2024-09-13T23:08:21.205271+0000","last_fullsized":"2024-09-13T23:08:21.205271+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:20.928045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159819+0000","last_change":"2024-09-13T23:05:20.145677+0000","last_active":"2024-09-13T23:05:49.159819+0000","last_peered":"2024-09-13T23:05:49.159819+0000","last_clean":"2024-09-13T23:05:49.159819+0000","last_became_active":"2024-09-13T23:05:20.145330+0000","last_became_peered":"2024-09-13T23:05:20.145330+0000","last_unstale":"2024-09-13T23:05:49.159819+0000","last_undegraded":"2024-09-13T23:05:49.159819+0000","last_fullsized":"2024-09-13T23:05:49.159819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:42.120633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.154815+0000","last_change":"2024-09-13T23:05:22.139303+0000","last_active":"2024-09-13T23:05:49.154815+0000","last_peered":"2024-09-13T23:05:49.154815+0000","last_clean":"2024-09-13T23:05:49.154815+0000","last_became_active":"2024-09-13T23:05:22.138259+0000","last_became_peered":"2024-09-13T23:05:22.138259+0000","last_unstale":"2024-09-13T23:05:49.154815+0000","last_undegraded":"2024-09-13T23:05:49.154815+0000","last_fullsized":"2024-09-13T23:05:49.154815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:37.433723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'6","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362869+0000","last_change":"2024-09-13T23:05:14.110869+0000","last_active":"2024-09-13T23:08:22.362869+0000","last_peered":"2024-09-13T23:08:22.362869+0000","last_clean":"2024-09-13T23:08:22.362869+0000","last_became_active":"2024-09-13T23:05:14.110532+0000","last_became_peered":"2024-09-13T23:05:14.110532+0000","last_unstale":"2024-09-13T23:08:22.362869+0000","last_undegraded":"2024-09-13T23:08:22.362869+0000","last_fullsized":"2024-09-13T23:08:22.362869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:48.481316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155626+0000","last_change":"2024-09-13T23:05:03.078756+0000","last_active":"2024-09-13T23:05:49.155626+0000","last_peered":"2024-09-13T23:05:49.155626+0000","last_clean":"2024-09-13T23:05:49.155626+0000","last_became_active":"2024-09-13T23:05:01.075399+0000","last_became_peered":"2024-09-13T23:05:01.075399+0000","last_unstale":"2024-09-13T23:05:49.155626+0000","last_undegraded":"2024-09-13T23:05:49.155626+0000","last_fullsized":"2024-09-13T23:05:49.155626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:30.026879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010379530000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.154668+0000","last_change":"2024-09-13T23:05:12.131428+0000","last_active":"2024-09-13T23:05:49.154668+0000","last_peered":"2024-09-13T23:05:49.154668+0000","last_clean":"2024-09-13T23:05:49.154668+0000","last_became_active":"2024-09-13T23:05:12.130410+0000","last_became_peered":"2024-09-13T23:05:12.130410+0000","last_unstale":"2024-09-13T23:05:49.154668+0000","last_undegraded":"2024-09-13T23:05:49.154668+0000","last_fullsized":"2024-09-13T23:05:49.154668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:29.799687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160305+0000","last_change":"2024-09-13T23:05:16.124659+0000","last_active":"2024-09-13T23:05:49.160305+0000","last_peered":"2024-09-13T23:05:49.160305+0000","last_clean":"2024-09-13T23:05:49.160305+0000","last_became_active":"2024-09-13T23:05:16.123983+0000","last_became_peered":"2024-09-13T23:05:16.123983+0000","last_unstale":"2024-09-13T23:05:49.160305+0000","last_undegraded":"2024-09-13T23:05:49.160305+0000","last_fullsized":"2024-09-13T23:05:49.160305+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:43.395837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.506942+0000","last_change":"2024-09-13T23:05:18.133997+0000","last_active":"2024-09-13T23:08:21.506942+0000","last_peered":"2024-09-13T23:08:21.506942+0000","last_clean":"2024-09-13T23:08:21.506942+0000","last_became_active":"2024-09-13T23:05:18.133165+0000","last_became_peered":"2024-09-13T23:05:18.133165+0000","last_unstale":"2024-09-13T23:08:21.506942+0000","last_undegraded":"2024-09-13T23:08:21.506942+0000","last_fullsized":"2024-09-13T23:08:21.506942+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:53.112074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.164155+0000","last_change":"2024-09-13T23:05:20.144363+0000","last_active":"2024-09-13T23:05:49.164155+0000","last_peered":"2024-09-13T23:05:49.164155+0000","last_clean":"2024-09-13T23:05:49.164155+0000","last_became_active":"2024-09-13T23:05:20.143748+0000","last_became_peered":"2024-09-13T23:05:20.143748+0000","last_unstale":"2024-09-13T23:05:49.164155+0000","last_undegraded":"2024-09-13T23:05:49.164155+0000","last_fullsized":"2024-09-13T23:05:49.164155+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:34:12.604551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.062072+0000","last_change":"2024-09-13T23:05:22.150796+0000","last_active":"2024-09-13T23:07:21.062072+0000","last_peered":"2024-09-13T23:07:21.062072+0000","last_clean":"2024-09-13T23:07:21.062072+0000","last_became_active":"2024-09-13T23:05:22.150415+0000","last_became_peered":"2024-09-13T23:05:22.150415+0000","last_unstale":"2024-09-13T23:07:21.062072+0000","last_undegraded":"2024-09-13T23:07:21.062072+0000","last_fullsized":"2024-09-13T23:07:21.062072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:56:02.493425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.321880+0000","last_change":"2024-09-13T23:05:14.123934+0000","last_active":"2024-09-13T23:08:22.321880+0000","last_peered":"2024-09-13T23:08:22.321880+0000","last_clean":"2024-09-13T23:08:22.321880+0000","last_became_active":"2024-09-13T23:05:14.123447+0000","last_became_peered":"2024-09-13T23:05:14.123447+0000","last_unstale":"2024-09-13T23:08:22.321880+0000","last_undegraded":"2024-09-13T23:08:22.321880+0000","last_fullsized":"2024-09-13T23:08:22.321880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:40.466898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.917869+0000","last_change":"2024-09-13T23:05:12.124402+0000","last_active":"2024-09-13T23:05:54.917869+0000","last_peered":"2024-09-13T23:05:54.917869+0000","last_clean":"2024-09-13T23:05:54.917869+0000","last_became_active":"2024-09-13T23:05:12.124005+0000","last_became_peered":"2024-09-13T23:05:12.124005+0000","last_unstale":"2024-09-13T23:05:54.917869+0000","last_undegraded":"2024-09-13T23:05:54.917869+0000","last_fullsized":"2024-09-13T23:05:54.917869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:51.362106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159745+0000","last_change":"2024-09-13T23:05:03.080556+0000","last_active":"2024-09-13T23:05:49.159745+0000","last_peered":"2024-09-13T23:05:49.159745+0000","last_clean":"2024-09-13T23:05:49.159745+0000","last_became_active":"2024-09-13T23:05:01.074963+0000","last_became_peered":"2024-09-13T23:05:01.074963+0000","last_unstale":"2024-09-13T23:05:49.159745+0000","last_undegraded":"2024-09-13T23:05:49.159745+0000","last_fullsized":"2024-09-13T23:05:49.159745+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:02.162649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055235699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.638099+0000","last_change":"2024-09-13T23:05:16.124473+0000","last_active":"2024-09-13T23:08:22.638099+0000","last_peered":"2024-09-13T23:08:22.638099+0000","last_clean":"2024-09-13T23:08:22.638099+0000","last_became_active":"2024-09-13T23:05:16.123971+0000","last_became_peered":"2024-09-13T23:05:16.123971+0000","last_unstale":"2024-09-13T23:08:22.638099+0000","last_undegraded":"2024-09-13T23:08:22.638099+0000","last_fullsized":"2024-09-13T23:08:22.638099+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:46:26.673828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'62","reported_seq":121,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.661697+0000","last_change":"2024-09-13T23:05:18.132525+0000","last_active":"2024-09-13T23:08:22.661697+0000","last_peered":"2024-09-13T23:08:22.661697+0000","last_clean":"2024-09-13T23:08:22.661697+0000","last_became_active":"2024-09-13T23:05:18.132051+0000","last_became_peered":"2024-09-13T23:05:18.132051+0000","last_unstale":"2024-09-13T23:08:22.661697+0000","last_undegraded":"2024-09-13T23:08:22.661697+0000","last_fullsized":"2024-09-13T23:08:22.661697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:44:32.951876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.152427+0000","last_change":"2024-09-13T23:05:20.143982+0000","last_active":"2024-09-13T23:05:49.152427+0000","last_peered":"2024-09-13T23:05:49.152427+0000","last_clean":"2024-09-13T23:05:49.152427+0000","last_became_active":"2024-09-13T23:05:20.143566+0000","last_became_peered":"2024-09-13T23:05:20.143566+0000","last_unstale":"2024-09-13T23:05:49.152427+0000","last_undegraded":"2024-09-13T23:05:49.152427+0000","last_fullsized":"2024-09-13T23:05:49.152427+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:27.338381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.471422+0000","last_change":"2024-09-13T23:05:22.138169+0000","last_active":"2024-09-13T23:08:22.471422+0000","last_peered":"2024-09-13T23:08:22.471422+0000","last_clean":"2024-09-13T23:08:22.471422+0000","last_became_active":"2024-09-13T23:05:22.137952+0000","last_became_peered":"2024-09-13T23:05:22.137952+0000","last_unstale":"2024-09-13T23:08:22.471422+0000","last_undegraded":"2024-09-13T23:08:22.471422+0000","last_fullsized":"2024-09-13T23:08:22.471422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:49.651698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.702466+0000","last_change":"2024-09-13T23:05:14.125712+0000","last_active":"2024-09-13T23:05:54.702466+0000","last_peered":"2024-09-13T23:05:54.702466+0000","last_clean":"2024-09-13T23:05:54.702466+0000","last_became_active":"2024-09-13T23:05:14.123549+0000","last_became_peered":"2024-09-13T23:05:14.123549+0000","last_unstale":"2024-09-13T23:05:54.702466+0000","last_undegraded":"2024-09-13T23:05:54.702466+0000","last_fullsized":"2024-09-13T23:05:54.702466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:14:21.159008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159984+0000","last_change":"2024-09-13T23:05:12.130717+0000","last_active":"2024-09-13T23:05:49.159984+0000","last_peered":"2024-09-13T23:05:49.159984+0000","last_clean":"2024-09-13T23:05:49.159984+0000","last_became_active":"2024-09-13T23:05:12.130285+0000","last_became_peered":"2024-09-13T23:05:12.130285+0000","last_unstale":"2024-09-13T23:05:49.159984+0000","last_undegraded":"2024-09-13T23:05:49.159984+0000","last_fullsized":"2024-09-13T23:05:49.159984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:20.143656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.163413+0000","last_change":"2024-09-13T23:05:03.078119+0000","last_active":"2024-09-13T23:05:49.163413+0000","last_peered":"2024-09-13T23:05:49.163413+0000","last_clean":"2024-09-13T23:05:49.163413+0000","last_became_active":"2024-09-13T23:05:01.075431+0000","last_became_peered":"2024-09-13T23:05:01.075431+0000","last_unstale":"2024-09-13T23:05:49.163413+0000","last_undegraded":"2024-09-13T23:05:49.163413+0000","last_fullsized":"2024-09-13T23:05:49.163413+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:22:31.741360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041474900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155165+0000","last_change":"2024-09-13T23:05:16.120645+0000","last_active":"2024-09-13T23:05:49.155165+0000","last_peered":"2024-09-13T23:05:49.155165+0000","last_clean":"2024-09-13T23:05:49.155165+0000","last_became_active":"2024-09-13T23:05:16.120337+0000","last_became_peered":"2024-09-13T23:05:16.120337+0000","last_unstale":"2024-09-13T23:05:49.155165+0000","last_undegraded":"2024-09-13T23:05:49.155165+0000","last_fullsized":"2024-09-13T23:05:49.155165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:19:50.556651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'16","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.934809+0000","last_change":"2024-09-13T23:05:18.134351+0000","last_active":"2024-09-13T23:05:54.934809+0000","last_peered":"2024-09-13T23:05:54.934809+0000","last_clean":"2024-09-13T23:05:54.934809+0000","last_became_active":"2024-09-13T23:05:18.133676+0000","last_became_peered":"2024-09-13T23:05:18.133676+0000","last_unstale":"2024-09-13T23:05:54.934809+0000","last_undegraded":"2024-09-13T23:05:54.934809+0000","last_fullsized":"2024-09-13T23:05:54.934809+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:38:10.583942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":355,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.205201+0000","last_change":"2024-09-13T23:05:20.135256+0000","last_active":"2024-09-13T23:08:21.205201+0000","last_peered":"2024-09-13T23:08:21.205201+0000","last_clean":"2024-09-13T23:08:21.205201+0000","last_became_active":"2024-09-13T23:05:20.133332+0000","last_became_peered":"2024-09-13T23:05:20.133332+0000","last_unstale":"2024-09-13T23:08:21.205201+0000","last_undegraded":"2024-09-13T23:08:21.205201+0000","last_fullsized":"2024-09-13T23:08:21.205201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:33.653779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.163699+0000","last_change":"2024-09-13T23:05:22.141887+0000","last_active":"2024-09-13T23:05:49.163699+0000","last_peered":"2024-09-13T23:05:49.163699+0000","last_clean":"2024-09-13T23:05:49.163699+0000","last_became_active":"2024-09-13T23:05:22.141618+0000","last_became_peered":"2024-09-13T23:05:22.141618+0000","last_unstale":"2024-09-13T23:05:49.163699+0000","last_undegraded":"2024-09-13T23:05:49.163699+0000","last_fullsized":"2024-09-13T23:05:49.163699+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:46.604024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'18","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.250583+0000","last_change":"2024-09-13T23:05:14.126543+0000","last_active":"2024-09-13T23:08:22.250583+0000","last_peered":"2024-09-13T23:08:22.250583+0000","last_clean":"2024-09-13T23:08:22.250583+0000","last_became_active":"2024-09-13T23:05:14.126280+0000","last_became_peered":"2024-09-13T23:05:14.126280+0000","last_unstale":"2024-09-13T23:08:22.250583+0000","last_undegraded":"2024-09-13T23:08:22.250583+0000","last_fullsized":"2024-09-13T23:08:22.250583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:15.304261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.921469+0000","last_change":"2024-09-13T23:05:12.149880+0000","last_active":"2024-09-13T23:05:54.921469+0000","last_peered":"2024-09-13T23:05:54.921469+0000","last_clean":"2024-09-13T23:05:54.921469+0000","last_became_active":"2024-09-13T23:05:12.149435+0000","last_became_peered":"2024-09-13T23:05:12.149435+0000","last_unstale":"2024-09-13T23:05:54.921469+0000","last_undegraded":"2024-09-13T23:05:54.921469+0000","last_fullsized":"2024-09-13T23:05:54.921469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:24.657126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160425+0000","last_change":"2024-09-13T23:05:03.080603+0000","last_active":"2024-09-13T23:05:49.160425+0000","last_peered":"2024-09-13T23:05:49.160425+0000","last_clean":"2024-09-13T23:05:49.160425+0000","last_became_active":"2024-09-13T23:05:01.074982+0000","last_became_peered":"2024-09-13T23:05:01.074982+0000","last_unstale":"2024-09-13T23:05:49.160425+0000","last_undegraded":"2024-09-13T23:05:49.160425+0000","last_fullsized":"2024-09-13T23:05:49.160425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:59:19.159167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054650599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155383+0000","last_change":"2024-09-13T23:05:16.123838+0000","last_active":"2024-09-13T23:05:49.155383+0000","last_peered":"2024-09-13T23:05:49.155383+0000","last_clean":"2024-09-13T23:05:49.155383+0000","last_became_active":"2024-09-13T23:05:16.123573+0000","last_became_peered":"2024-09-13T23:05:16.123573+0000","last_unstale":"2024-09-13T23:05:49.155383+0000","last_undegraded":"2024-09-13T23:05:49.155383+0000","last_fullsized":"2024-09-13T23:05:49.155383+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:46.249000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.455631+0000","last_change":"2024-09-13T23:05:18.132921+0000","last_active":"2024-09-13T23:06:37.455631+0000","last_peered":"2024-09-13T23:06:37.455631+0000","last_clean":"2024-09-13T23:06:37.455631+0000","last_became_active":"2024-09-13T23:05:18.132140+0000","last_became_peered":"2024-09-13T23:05:18.132140+0000","last_unstale":"2024-09-13T23:06:37.455631+0000","last_undegraded":"2024-09-13T23:06:37.455631+0000","last_fullsized":"2024-09-13T23:06:37.455631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:50.731504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'284","reported_seq":431,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.059765+0000","last_change":"2024-09-13T23:05:20.136524+0000","last_active":"2024-09-13T23:08:29.059765+0000","last_peered":"2024-09-13T23:08:29.059765+0000","last_clean":"2024-09-13T23:08:29.059765+0000","last_became_active":"2024-09-13T23:05:20.136036+0000","last_became_peered":"2024-09-13T23:05:20.136036+0000","last_unstale":"2024-09-13T23:08:29.059765+0000","last_undegraded":"2024-09-13T23:08:29.059765+0000","last_fullsized":"2024-09-13T23:08:29.059765+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:01:43.280761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157235+0000","last_change":"2024-09-13T23:05:22.145082+0000","last_active":"2024-09-13T23:05:49.157235+0000","last_peered":"2024-09-13T23:05:49.157235+0000","last_clean":"2024-09-13T23:05:49.157235+0000","last_became_active":"2024-09-13T23:05:22.144787+0000","last_became_peered":"2024-09-13T23:05:22.144787+0000","last_unstale":"2024-09-13T23:05:49.157235+0000","last_undegraded":"2024-09-13T23:05:49.157235+0000","last_fullsized":"2024-09-13T23:05:49.157235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:59.821393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.702234+0000","last_change":"2024-09-13T23:05:14.112813+0000","last_active":"2024-09-13T23:05:54.702234+0000","last_peered":"2024-09-13T23:05:54.702234+0000","last_clean":"2024-09-13T23:05:54.702234+0000","last_became_active":"2024-09-13T23:05:14.112565+0000","last_became_peered":"2024-09-13T23:05:14.112565+0000","last_unstale":"2024-09-13T23:05:54.702234+0000","last_undegraded":"2024-09-13T23:05:54.702234+0000","last_fullsized":"2024-09-13T23:05:54.702234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:50.584375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156509+0000","last_change":"2024-09-13T23:05:12.131805+0000","last_active":"2024-09-13T23:05:49.156509+0000","last_peered":"2024-09-13T23:05:49.156509+0000","last_clean":"2024-09-13T23:05:49.156509+0000","last_became_active":"2024-09-13T23:05:12.131413+0000","last_became_peered":"2024-09-13T23:05:12.131413+0000","last_unstale":"2024-09-13T23:05:49.156509+0000","last_undegraded":"2024-09-13T23:05:49.156509+0000","last_fullsized":"2024-09-13T23:05:49.156509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:58.196248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.164465+0000","last_change":"2024-09-13T23:05:03.078956+0000","last_active":"2024-09-13T23:05:49.164465+0000","last_peered":"2024-09-13T23:05:49.164465+0000","last_clean":"2024-09-13T23:05:49.164465+0000","last_became_active":"2024-09-13T23:05:01.323761+0000","last_became_peered":"2024-09-13T23:05:01.323761+0000","last_unstale":"2024-09-13T23:05:49.164465+0000","last_undegraded":"2024-09-13T23:05:49.164465+0000","last_fullsized":"2024-09-13T23:05:49.164465+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:39.972272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001181893,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157273+0000","last_change":"2024-09-13T23:05:16.121458+0000","last_active":"2024-09-13T23:05:49.157273+0000","last_peered":"2024-09-13T23:05:49.157273+0000","last_clean":"2024-09-13T23:05:49.157273+0000","last_became_active":"2024-09-13T23:05:16.120974+0000","last_became_peered":"2024-09-13T23:05:16.120974+0000","last_unstale":"2024-09-13T23:05:49.157273+0000","last_undegraded":"2024-09-13T23:05:49.157273+0000","last_fullsized":"2024-09-13T23:05:49.157273+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:12.719474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'82","reported_seq":154,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.723056+0000","last_change":"2024-09-13T23:05:18.138165+0000","last_active":"2024-09-13T23:07:19.723056+0000","last_peered":"2024-09-13T23:07:19.723056+0000","last_clean":"2024-09-13T23:07:19.723056+0000","last_became_active":"2024-09-13T23:05:18.137925+0000","last_became_peered":"2024-09-13T23:05:18.137925+0000","last_unstale":"2024-09-13T23:07:19.723056+0000","last_undegraded":"2024-09-13T23:07:19.723056+0000","last_fullsized":"2024-09-13T23:07:19.723056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:15.845937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158600+0000","last_change":"2024-09-13T23:05:20.129880+0000","last_active":"2024-09-13T23:05:49.158600+0000","last_peered":"2024-09-13T23:05:49.158600+0000","last_clean":"2024-09-13T23:05:49.158600+0000","last_became_active":"2024-09-13T23:05:20.129363+0000","last_became_peered":"2024-09-13T23:05:20.129363+0000","last_unstale":"2024-09-13T23:05:49.158600+0000","last_undegraded":"2024-09-13T23:05:49.158600+0000","last_fullsized":"2024-09-13T23:05:49.158600+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:50.629881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157130+0000","last_change":"2024-09-13T23:05:22.151007+0000","last_active":"2024-09-13T23:05:49.157130+0000","last_peered":"2024-09-13T23:05:49.157130+0000","last_clean":"2024-09-13T23:05:49.157130+0000","last_became_active":"2024-09-13T23:05:22.149645+0000","last_became_peered":"2024-09-13T23:05:22.149645+0000","last_unstale":"2024-09-13T23:05:49.157130+0000","last_undegraded":"2024-09-13T23:05:49.157130+0000","last_fullsized":"2024-09-13T23:05:49.157130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:14.228653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160576+0000","last_change":"2024-09-13T23:05:22.151921+0000","last_active":"2024-09-13T23:05:49.160576+0000","last_peered":"2024-09-13T23:05:49.160576+0000","last_clean":"2024-09-13T23:05:49.160576+0000","last_became_active":"2024-09-13T23:05:22.151640+0000","last_became_peered":"2024-09-13T23:05:22.151640+0000","last_unstale":"2024-09-13T23:05:49.160576+0000","last_undegraded":"2024-09-13T23:05:49.160576+0000","last_fullsized":"2024-09-13T23:05:49.160576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:38:24.891059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'12","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.323823+0000","last_change":"2024-09-13T23:05:14.113491+0000","last_active":"2024-09-13T23:08:22.323823+0000","last_peered":"2024-09-13T23:08:22.323823+0000","last_clean":"2024-09-13T23:08:22.323823+0000","last_became_active":"2024-09-13T23:05:14.113236+0000","last_became_peered":"2024-09-13T23:05:14.113236+0000","last_unstale":"2024-09-13T23:08:22.323823+0000","last_undegraded":"2024-09-13T23:08:22.323823+0000","last_fullsized":"2024-09-13T23:08:22.323823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:05:09.963242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159820+0000","last_change":"2024-09-13T23:05:12.141658+0000","last_active":"2024-09-13T23:05:49.159820+0000","last_peered":"2024-09-13T23:05:49.159820+0000","last_clean":"2024-09-13T23:05:49.159820+0000","last_became_active":"2024-09-13T23:05:12.141280+0000","last_became_peered":"2024-09-13T23:05:12.141280+0000","last_unstale":"2024-09-13T23:05:49.159820+0000","last_undegraded":"2024-09-13T23:05:49.159820+0000","last_fullsized":"2024-09-13T23:05:49.159820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:07:17.099012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158953+0000","last_change":"2024-09-13T23:05:16.117775+0000","last_active":"2024-09-13T23:05:49.158953+0000","last_peered":"2024-09-13T23:05:49.158953+0000","last_clean":"2024-09-13T23:05:49.158953+0000","last_became_active":"2024-09-13T23:05:16.117468+0000","last_became_peered":"2024-09-13T23:05:16.117468+0000","last_unstale":"2024-09-13T23:05:49.158953+0000","last_undegraded":"2024-09-13T23:05:49.158953+0000","last_fullsized":"2024-09-13T23:05:49.158953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:24.938916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'34","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079072+0000","last_change":"2024-09-13T23:05:18.132556+0000","last_active":"2024-09-13T23:07:42.079072+0000","last_peered":"2024-09-13T23:07:42.079072+0000","last_clean":"2024-09-13T23:07:42.079072+0000","last_became_active":"2024-09-13T23:05:18.131841+0000","last_became_peered":"2024-09-13T23:05:18.131841+0000","last_unstale":"2024-09-13T23:07:42.079072+0000","last_undegraded":"2024-09-13T23:07:42.079072+0000","last_fullsized":"2024-09-13T23:07:42.079072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:38.696780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158497+0000","last_change":"2024-09-13T23:05:20.140436+0000","last_active":"2024-09-13T23:05:49.158497+0000","last_peered":"2024-09-13T23:05:49.158497+0000","last_clean":"2024-09-13T23:05:49.158497+0000","last_became_active":"2024-09-13T23:05:20.138958+0000","last_became_peered":"2024-09-13T23:05:20.138958+0000","last_unstale":"2024-09-13T23:05:49.158497+0000","last_undegraded":"2024-09-13T23:05:49.158497+0000","last_fullsized":"2024-09-13T23:05:49.158497+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:06.294003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.301319+0000","last_change":"2024-09-13T23:05:22.141828+0000","last_active":"2024-09-13T23:08:22.301319+0000","last_peered":"2024-09-13T23:08:22.301319+0000","last_clean":"2024-09-13T23:08:22.301319+0000","last_became_active":"2024-09-13T23:05:22.141471+0000","last_became_peered":"2024-09-13T23:05:22.141471+0000","last_unstale":"2024-09-13T23:08:22.301319+0000","last_undegraded":"2024-09-13T23:08:22.301319+0000","last_fullsized":"2024-09-13T23:08:22.301319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:03:42.989142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'7","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:38.077521+0000","last_change":"2024-09-13T23:05:49.167955+0000","last_active":"2024-09-13T23:07:38.077521+0000","last_peered":"2024-09-13T23:07:38.077521+0000","last_clean":"2024-09-13T23:07:38.077521+0000","last_became_active":"2024-09-13T23:05:49.164131+0000","last_became_peered":"2024-09-13T23:05:49.164131+0000","last_unstale":"2024-09-13T23:07:38.077521+0000","last_undegraded":"2024-09-13T23:07:38.077521+0000","last_fullsized":"2024-09-13T23:07:38.077521+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:24.539346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.227909+0000","last_change":"2024-09-13T23:05:12.116495+0000","last_active":"2024-09-13T23:08:22.227909+0000","last_peered":"2024-09-13T23:08:22.227909+0000","last_clean":"2024-09-13T23:08:22.227909+0000","last_became_active":"2024-09-13T23:05:12.114343+0000","last_became_peered":"2024-09-13T23:05:12.114343+0000","last_unstale":"2024-09-13T23:08:22.227909+0000","last_undegraded":"2024-09-13T23:08:22.227909+0000","last_fullsized":"2024-09-13T23:08:22.227909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:32:52.891315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.162345+0000","last_change":"2024-09-13T23:05:49.160922+0000","last_active":"2024-09-13T23:05:49.162345+0000","last_peered":"2024-09-13T23:05:49.162345+0000","last_clean":"2024-09-13T23:05:49.162345+0000","last_became_active":"2024-09-13T23:05:49.160578+0000","last_became_peered":"2024-09-13T23:05:49.160578+0000","last_unstale":"2024-09-13T23:05:49.162345+0000","last_undegraded":"2024-09-13T23:05:49.162345+0000","last_fullsized":"2024-09-13T23:05:49.162345+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:35:20.664758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.511579+0000","last_change":"2024-09-13T23:05:18.121852+0000","last_active":"2024-09-13T23:08:21.511579+0000","last_peered":"2024-09-13T23:08:21.511579+0000","last_clean":"2024-09-13T23:08:21.511579+0000","last_became_active":"2024-09-13T23:05:18.121514+0000","last_became_peered":"2024-09-13T23:05:18.121514+0000","last_unstale":"2024-09-13T23:08:21.511579+0000","last_undegraded":"2024-09-13T23:08:21.511579+0000","last_fullsized":"2024-09-13T23:08:21.511579+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:00.097701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.152954+0000","last_change":"2024-09-13T23:05:20.140562+0000","last_active":"2024-09-13T23:05:49.152954+0000","last_peered":"2024-09-13T23:05:49.152954+0000","last_clean":"2024-09-13T23:05:49.152954+0000","last_became_active":"2024-09-13T23:05:20.140290+0000","last_became_peered":"2024-09-13T23:05:20.140290+0000","last_unstale":"2024-09-13T23:05:49.152954+0000","last_undegraded":"2024-09-13T23:05:49.152954+0000","last_fullsized":"2024-09-13T23:05:49.152954+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:10.783457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159676+0000","last_change":"2024-09-13T23:05:22.141270+0000","last_active":"2024-09-13T23:05:49.159676+0000","last_peered":"2024-09-13T23:05:49.159676+0000","last_clean":"2024-09-13T23:05:49.159676+0000","last_became_active":"2024-09-13T23:05:22.140963+0000","last_became_peered":"2024-09-13T23:05:22.140963+0000","last_unstale":"2024-09-13T23:05:49.159676+0000","last_undegraded":"2024-09-13T23:05:49.159676+0000","last_fullsized":"2024-09-13T23:05:49.159676+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:59.821393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.485370+0000","last_change":"2024-09-13T23:05:14.120821+0000","last_active":"2024-09-13T23:07:21.485370+0000","last_peered":"2024-09-13T23:07:21.485370+0000","last_clean":"2024-09-13T23:07:21.485370+0000","last_became_active":"2024-09-13T23:05:14.120354+0000","last_became_peered":"2024-09-13T23:05:14.120354+0000","last_unstale":"2024-09-13T23:07:21.485370+0000","last_undegraded":"2024-09-13T23:07:21.485370+0000","last_fullsized":"2024-09-13T23:07:21.485370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:55.219034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158478+0000","last_change":"2024-09-13T23:05:12.117147+0000","last_active":"2024-09-13T23:05:49.158478+0000","last_peered":"2024-09-13T23:05:49.158478+0000","last_clean":"2024-09-13T23:05:49.158478+0000","last_became_active":"2024-09-13T23:05:12.116819+0000","last_became_peered":"2024-09-13T23:05:12.116819+0000","last_unstale":"2024-09-13T23:05:49.158478+0000","last_undegraded":"2024-09-13T23:05:49.158478+0000","last_fullsized":"2024-09-13T23:05:49.158478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:23:49.530592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.152948+0000","last_change":"2024-09-13T23:05:16.124923+0000","last_active":"2024-09-13T23:05:49.152948+0000","last_peered":"2024-09-13T23:05:49.152948+0000","last_clean":"2024-09-13T23:05:49.152948+0000","last_became_active":"2024-09-13T23:05:16.124617+0000","last_became_peered":"2024-09-13T23:05:16.124617+0000","last_unstale":"2024-09-13T23:05:49.152948+0000","last_undegraded":"2024-09-13T23:05:49.152948+0000","last_fullsized":"2024-09-13T23:05:49.152948+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:44.922754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'41","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.660356+0000","last_change":"2024-09-13T23:05:18.126438+0000","last_active":"2024-09-13T23:08:22.660356+0000","last_peered":"2024-09-13T23:08:22.660356+0000","last_clean":"2024-09-13T23:08:22.660356+0000","last_became_active":"2024-09-13T23:05:18.126147+0000","last_became_peered":"2024-09-13T23:05:18.126147+0000","last_unstale":"2024-09-13T23:08:22.660356+0000","last_undegraded":"2024-09-13T23:08:22.660356+0000","last_fullsized":"2024-09-13T23:08:22.660356+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:02:19.823621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158713+0000","last_change":"2024-09-13T23:05:20.129082+0000","last_active":"2024-09-13T23:05:49.158713+0000","last_peered":"2024-09-13T23:05:49.158713+0000","last_clean":"2024-09-13T23:05:49.158713+0000","last_became_active":"2024-09-13T23:05:20.128756+0000","last_became_peered":"2024-09-13T23:05:20.128756+0000","last_unstale":"2024-09-13T23:05:49.158713+0000","last_undegraded":"2024-09-13T23:05:49.158713+0000","last_fullsized":"2024-09-13T23:05:49.158713+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:31.349343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157781+0000","last_change":"2024-09-13T23:05:22.144728+0000","last_active":"2024-09-13T23:05:49.157781+0000","last_peered":"2024-09-13T23:05:49.157781+0000","last_clean":"2024-09-13T23:05:49.157781+0000","last_became_active":"2024-09-13T23:05:22.143767+0000","last_became_peered":"2024-09-13T23:05:22.143767+0000","last_unstale":"2024-09-13T23:05:49.157781+0000","last_undegraded":"2024-09-13T23:05:49.157781+0000","last_fullsized":"2024-09-13T23:05:49.157781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:26.361850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157765+0000","last_change":"2024-09-13T23:05:14.127475+0000","last_active":"2024-09-13T23:05:49.157765+0000","last_peered":"2024-09-13T23:05:49.157765+0000","last_clean":"2024-09-13T23:05:49.157765+0000","last_became_active":"2024-09-13T23:05:14.127000+0000","last_became_peered":"2024-09-13T23:05:14.127000+0000","last_unstale":"2024-09-13T23:05:49.157765+0000","last_undegraded":"2024-09-13T23:05:49.157765+0000","last_fullsized":"2024-09-13T23:05:49.157765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:10:50.930163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158496+0000","last_change":"2024-09-13T23:05:12.136754+0000","last_active":"2024-09-13T23:05:49.158496+0000","last_peered":"2024-09-13T23:05:49.158496+0000","last_clean":"2024-09-13T23:05:49.158496+0000","last_became_active":"2024-09-13T23:05:12.136384+0000","last_became_peered":"2024-09-13T23:05:12.136384+0000","last_unstale":"2024-09-13T23:05:49.158496+0000","last_undegraded":"2024-09-13T23:05:49.158496+0000","last_fullsized":"2024-09-13T23:05:49.158496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:43.763766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155297+0000","last_change":"2024-09-13T23:05:16.124513+0000","last_active":"2024-09-13T23:05:49.155297+0000","last_peered":"2024-09-13T23:05:49.155297+0000","last_clean":"2024-09-13T23:05:49.155297+0000","last_became_active":"2024-09-13T23:05:16.124241+0000","last_became_peered":"2024-09-13T23:05:16.124241+0000","last_unstale":"2024-09-13T23:05:49.155297+0000","last_undegraded":"2024-09-13T23:05:49.155297+0000","last_fullsized":"2024-09-13T23:05:49.155297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:03:40.217865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'31","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.487313+0000","last_change":"2024-09-13T23:05:18.126644+0000","last_active":"2024-09-13T23:07:21.487313+0000","last_peered":"2024-09-13T23:07:21.487313+0000","last_clean":"2024-09-13T23:07:21.487313+0000","last_became_active":"2024-09-13T23:05:18.126188+0000","last_became_peered":"2024-09-13T23:05:18.126188+0000","last_unstale":"2024-09-13T23:07:21.487313+0000","last_undegraded":"2024-09-13T23:07:21.487313+0000","last_fullsized":"2024-09-13T23:07:21.487313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:56.228755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.153697+0000","last_change":"2024-09-13T23:05:20.136386+0000","last_active":"2024-09-13T23:05:49.153697+0000","last_peered":"2024-09-13T23:05:49.153697+0000","last_clean":"2024-09-13T23:05:49.153697+0000","last_became_active":"2024-09-13T23:05:20.136098+0000","last_became_peered":"2024-09-13T23:05:20.136098+0000","last_unstale":"2024-09-13T23:05:49.153697+0000","last_undegraded":"2024-09-13T23:05:49.153697+0000","last_fullsized":"2024-09-13T23:05:49.153697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:47:24.641764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'14","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.321638+0000","last_change":"2024-09-13T23:05:14.113061+0000","last_active":"2024-09-13T23:08:22.321638+0000","last_peered":"2024-09-13T23:08:22.321638+0000","last_clean":"2024-09-13T23:08:22.321638+0000","last_became_active":"2024-09-13T23:05:14.112822+0000","last_became_peered":"2024-09-13T23:05:14.112822+0000","last_unstale":"2024-09-13T23:08:22.321638+0000","last_undegraded":"2024-09-13T23:08:22.321638+0000","last_fullsized":"2024-09-13T23:08:22.321638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:52:37.741998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:53.841518+0000","last_change":"2024-09-13T23:05:12.143550+0000","last_active":"2024-09-13T23:05:53.841518+0000","last_peered":"2024-09-13T23:05:53.841518+0000","last_clean":"2024-09-13T23:05:53.841518+0000","last_became_active":"2024-09-13T23:05:12.141970+0000","last_became_peered":"2024-09-13T23:05:12.141970+0000","last_unstale":"2024-09-13T23:05:53.841518+0000","last_undegraded":"2024-09-13T23:05:53.841518+0000","last_fullsized":"2024-09-13T23:05:53.841518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:20.698878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160495+0000","last_change":"2024-09-13T23:05:16.120920+0000","last_active":"2024-09-13T23:05:49.160495+0000","last_peered":"2024-09-13T23:05:49.160495+0000","last_clean":"2024-09-13T23:05:49.160495+0000","last_became_active":"2024-09-13T23:05:16.120506+0000","last_became_peered":"2024-09-13T23:05:16.120506+0000","last_unstale":"2024-09-13T23:05:49.160495+0000","last_undegraded":"2024-09-13T23:05:49.160495+0000","last_fullsized":"2024-09-13T23:05:49.160495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:05.377747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'57","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:49.076315+0000","last_change":"2024-09-13T23:05:18.127151+0000","last_active":"2024-09-13T23:07:49.076315+0000","last_peered":"2024-09-13T23:07:49.076315+0000","last_clean":"2024-09-13T23:07:49.076315+0000","last_became_active":"2024-09-13T23:05:18.126811+0000","last_became_peered":"2024-09-13T23:05:18.126811+0000","last_unstale":"2024-09-13T23:07:49.076315+0000","last_undegraded":"2024-09-13T23:07:49.076315+0000","last_fullsized":"2024-09-13T23:07:49.076315+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:48.016939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":61,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.154053+0000","last_change":"2024-09-13T23:05:20.136237+0000","last_active":"2024-09-13T23:05:49.154053+0000","last_peered":"2024-09-13T23:05:49.154053+0000","last_clean":"2024-09-13T23:05:49.154053+0000","last_became_active":"2024-09-13T23:05:20.135886+0000","last_became_peered":"2024-09-13T23:05:20.135886+0000","last_unstale":"2024-09-13T23:05:49.154053+0000","last_undegraded":"2024-09-13T23:05:49.154053+0000","last_fullsized":"2024-09-13T23:05:49.154053+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:48:40.909454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.325312+0000","last_change":"2024-09-13T23:05:22.147716+0000","last_active":"2024-09-13T23:08:22.325312+0000","last_peered":"2024-09-13T23:08:22.325312+0000","last_clean":"2024-09-13T23:08:22.325312+0000","last_became_active":"2024-09-13T23:05:22.147394+0000","last_became_peered":"2024-09-13T23:05:22.147394+0000","last_unstale":"2024-09-13T23:08:22.325312+0000","last_undegraded":"2024-09-13T23:08:22.325312+0000","last_fullsized":"2024-09-13T23:08:22.325312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:04:57.442372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362850+0000","last_change":"2024-09-13T23:05:14.121676+0000","last_active":"2024-09-13T23:08:22.362850+0000","last_peered":"2024-09-13T23:08:22.362850+0000","last_clean":"2024-09-13T23:08:22.362850+0000","last_became_active":"2024-09-13T23:05:14.121349+0000","last_became_peered":"2024-09-13T23:05:14.121349+0000","last_unstale":"2024-09-13T23:08:22.362850+0000","last_undegraded":"2024-09-13T23:08:22.362850+0000","last_fullsized":"2024-09-13T23:08:22.362850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:57:39.861849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156531+0000","last_change":"2024-09-13T23:05:12.139567+0000","last_active":"2024-09-13T23:05:49.156531+0000","last_peered":"2024-09-13T23:05:49.156531+0000","last_clean":"2024-09-13T23:05:49.156531+0000","last_became_active":"2024-09-13T23:05:12.137092+0000","last_became_peered":"2024-09-13T23:05:12.137092+0000","last_unstale":"2024-09-13T23:05:49.156531+0000","last_undegraded":"2024-09-13T23:05:49.156531+0000","last_fullsized":"2024-09-13T23:05:49.156531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:26.997997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.161054+0000","last_change":"2024-09-13T23:05:16.121760+0000","last_active":"2024-09-13T23:05:49.161054+0000","last_peered":"2024-09-13T23:05:49.161054+0000","last_clean":"2024-09-13T23:05:49.161054+0000","last_became_active":"2024-09-13T23:05:16.121476+0000","last_became_peered":"2024-09-13T23:05:16.121476+0000","last_unstale":"2024-09-13T23:05:49.161054+0000","last_undegraded":"2024-09-13T23:05:49.161054+0000","last_fullsized":"2024-09-13T23:05:49.161054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:26:03.131986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.715418+0000","last_change":"2024-09-13T23:05:18.132726+0000","last_active":"2024-09-13T23:07:19.715418+0000","last_peered":"2024-09-13T23:07:19.715418+0000","last_clean":"2024-09-13T23:07:19.715418+0000","last_became_active":"2024-09-13T23:05:18.132060+0000","last_became_peered":"2024-09-13T23:05:18.132060+0000","last_unstale":"2024-09-13T23:07:19.715418+0000","last_undegraded":"2024-09-13T23:07:19.715418+0000","last_fullsized":"2024-09-13T23:07:19.715418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:03.383636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155314+0000","last_change":"2024-09-13T23:05:20.140626+0000","last_active":"2024-09-13T23:05:49.155314+0000","last_peered":"2024-09-13T23:05:49.155314+0000","last_clean":"2024-09-13T23:05:49.155314+0000","last_became_active":"2024-09-13T23:05:20.140333+0000","last_became_peered":"2024-09-13T23:05:20.140333+0000","last_unstale":"2024-09-13T23:05:49.155314+0000","last_undegraded":"2024-09-13T23:05:49.155314+0000","last_fullsized":"2024-09-13T23:05:49.155314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:54:01.951032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155007+0000","last_change":"2024-09-13T23:05:22.140239+0000","last_active":"2024-09-13T23:05:49.155007+0000","last_peered":"2024-09-13T23:05:49.155007+0000","last_clean":"2024-09-13T23:05:49.155007+0000","last_became_active":"2024-09-13T23:05:22.139984+0000","last_became_peered":"2024-09-13T23:05:22.139984+0000","last_unstale":"2024-09-13T23:05:49.155007+0000","last_undegraded":"2024-09-13T23:05:49.155007+0000","last_fullsized":"2024-09-13T23:05:49.155007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:58.124207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362755+0000","last_change":"2024-09-13T23:05:14.125224+0000","last_active":"2024-09-13T23:08:22.362755+0000","last_peered":"2024-09-13T23:08:22.362755+0000","last_clean":"2024-09-13T23:08:22.362755+0000","last_became_active":"2024-09-13T23:05:14.124660+0000","last_became_peered":"2024-09-13T23:05:14.124660+0000","last_unstale":"2024-09-13T23:08:22.362755+0000","last_undegraded":"2024-09-13T23:08:22.362755+0000","last_fullsized":"2024-09-13T23:08:22.362755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:48.609572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159133+0000","last_change":"2024-09-13T23:05:12.141582+0000","last_active":"2024-09-13T23:05:49.159133+0000","last_peered":"2024-09-13T23:05:49.159133+0000","last_clean":"2024-09-13T23:05:49.159133+0000","last_became_active":"2024-09-13T23:05:12.137136+0000","last_became_peered":"2024-09-13T23:05:12.137136+0000","last_unstale":"2024-09-13T23:05:49.159133+0000","last_undegraded":"2024-09-13T23:05:49.159133+0000","last_fullsized":"2024-09-13T23:05:49.159133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:20.740109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157357+0000","last_change":"2024-09-13T23:05:16.123946+0000","last_active":"2024-09-13T23:05:49.157357+0000","last_peered":"2024-09-13T23:05:49.157357+0000","last_clean":"2024-09-13T23:05:49.157357+0000","last_became_active":"2024-09-13T23:05:16.123607+0000","last_became_peered":"2024-09-13T23:05:16.123607+0000","last_unstale":"2024-09-13T23:05:49.157357+0000","last_undegraded":"2024-09-13T23:05:49.157357+0000","last_fullsized":"2024-09-13T23:05:49.157357+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:28.671096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'32","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.733164+0000","last_change":"2024-09-13T23:05:18.136609+0000","last_active":"2024-09-13T23:07:19.733164+0000","last_peered":"2024-09-13T23:07:19.733164+0000","last_clean":"2024-09-13T23:07:19.733164+0000","last_became_active":"2024-09-13T23:05:18.136279+0000","last_became_peered":"2024-09-13T23:05:18.136279+0000","last_unstale":"2024-09-13T23:07:19.733164+0000","last_undegraded":"2024-09-13T23:07:19.733164+0000","last_fullsized":"2024-09-13T23:07:19.733164+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:59.720739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160101+0000","last_change":"2024-09-13T23:05:20.141584+0000","last_active":"2024-09-13T23:05:49.160101+0000","last_peered":"2024-09-13T23:05:49.160101+0000","last_clean":"2024-09-13T23:05:49.160101+0000","last_became_active":"2024-09-13T23:05:20.141266+0000","last_became_peered":"2024-09-13T23:05:20.141266+0000","last_unstale":"2024-09-13T23:05:49.160101+0000","last_undegraded":"2024-09-13T23:05:49.160101+0000","last_fullsized":"2024-09-13T23:05:49.160101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:54:01.951032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'9","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.481681+0000","last_change":"2024-09-13T23:05:22.151767+0000","last_active":"2024-09-13T23:07:21.481681+0000","last_peered":"2024-09-13T23:07:21.481681+0000","last_clean":"2024-09-13T23:07:21.481681+0000","last_became_active":"2024-09-13T23:05:22.151339+0000","last_became_peered":"2024-09-13T23:05:22.151339+0000","last_unstale":"2024-09-13T23:07:21.481681+0000","last_undegraded":"2024-09-13T23:07:21.481681+0000","last_fullsized":"2024-09-13T23:07:21.481681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:27:36.638035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.322085+0000","last_change":"2024-09-13T23:05:14.112792+0000","last_active":"2024-09-13T23:08:22.322085+0000","last_peered":"2024-09-13T23:08:22.322085+0000","last_clean":"2024-09-13T23:08:22.322085+0000","last_became_active":"2024-09-13T23:05:14.112175+0000","last_became_peered":"2024-09-13T23:05:14.112175+0000","last_unstale":"2024-09-13T23:08:22.322085+0000","last_undegraded":"2024-09-13T23:08:22.322085+0000","last_fullsized":"2024-09-13T23:08:22.322085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:39.333340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159759+0000","last_change":"2024-09-13T23:05:12.141910+0000","last_active":"2024-09-13T23:05:49.159759+0000","last_peered":"2024-09-13T23:05:49.159759+0000","last_clean":"2024-09-13T23:05:49.159759+0000","last_became_active":"2024-09-13T23:05:12.141459+0000","last_became_peered":"2024-09-13T23:05:12.141459+0000","last_unstale":"2024-09-13T23:05:49.159759+0000","last_undegraded":"2024-09-13T23:05:49.159759+0000","last_fullsized":"2024-09-13T23:05:49.159759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:48.232382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"34'4","reported_seq":226,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:20.828655+0000","last_change":"2024-09-13T23:05:16.118050+0000","last_active":"2024-09-13T23:07:20.828655+0000","last_peered":"2024-09-13T23:07:20.828655+0000","last_clean":"2024-09-13T23:07:20.828655+0000","last_became_active":"2024-09-13T23:05:16.117736+0000","last_became_peered":"2024-09-13T23:05:16.117736+0000","last_unstale":"2024-09-13T23:07:20.828655+0000","last_undegraded":"2024-09-13T23:07:20.828655+0000","last_fullsized":"2024-09-13T23:07:20.828655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:34:57.565004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.163113+0000","last_change":"2024-09-13T23:05:18.133743+0000","last_active":"2024-09-13T23:05:49.163113+0000","last_peered":"2024-09-13T23:05:49.163113+0000","last_clean":"2024-09-13T23:05:49.163113+0000","last_became_active":"2024-09-13T23:05:18.132507+0000","last_became_peered":"2024-09-13T23:05:18.132507+0000","last_unstale":"2024-09-13T23:05:49.163113+0000","last_undegraded":"2024-09-13T23:05:49.163113+0000","last_fullsized":"2024-09-13T23:05:49.163113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:25:07.613170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":417,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.367435+0000","last_change":"2024-09-13T23:05:20.144647+0000","last_active":"2024-09-13T23:08:22.367435+0000","last_peered":"2024-09-13T23:08:22.367435+0000","last_clean":"2024-09-13T23:08:22.367435+0000","last_became_active":"2024-09-13T23:05:20.144334+0000","last_became_peered":"2024-09-13T23:05:20.144334+0000","last_unstale":"2024-09-13T23:08:22.367435+0000","last_undegraded":"2024-09-13T23:08:22.367435+0000","last_fullsized":"2024-09-13T23:08:22.367435+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:55.153699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156789+0000","last_change":"2024-09-13T23:05:22.149167+0000","last_active":"2024-09-13T23:05:49.156789+0000","last_peered":"2024-09-13T23:05:49.156789+0000","last_clean":"2024-09-13T23:05:49.156789+0000","last_became_active":"2024-09-13T23:05:22.148894+0000","last_became_peered":"2024-09-13T23:05:22.148894+0000","last_unstale":"2024-09-13T23:05:49.156789+0000","last_undegraded":"2024-09-13T23:05:49.156789+0000","last_fullsized":"2024-09-13T23:05:49.156789+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:15.779050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.469692+0000","last_change":"2024-09-13T23:05:14.112197+0000","last_active":"2024-09-13T23:08:22.469692+0000","last_peered":"2024-09-13T23:08:22.469692+0000","last_clean":"2024-09-13T23:08:22.469692+0000","last_became_active":"2024-09-13T23:05:14.111891+0000","last_became_peered":"2024-09-13T23:05:14.111891+0000","last_unstale":"2024-09-13T23:08:22.469692+0000","last_undegraded":"2024-09-13T23:08:22.469692+0000","last_fullsized":"2024-09-13T23:08:22.469692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:22.016474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158445+0000","last_change":"2024-09-13T23:05:12.139920+0000","last_active":"2024-09-13T23:05:49.158445+0000","last_peered":"2024-09-13T23:05:49.158445+0000","last_clean":"2024-09-13T23:05:49.158445+0000","last_became_active":"2024-09-13T23:05:12.139564+0000","last_became_peered":"2024-09-13T23:05:12.139564+0000","last_unstale":"2024-09-13T23:05:49.158445+0000","last_undegraded":"2024-09-13T23:05:49.158445+0000","last_fullsized":"2024-09-13T23:05:49.158445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:48:38.750102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158925+0000","last_change":"2024-09-13T23:05:16.118845+0000","last_active":"2024-09-13T23:05:49.158925+0000","last_peered":"2024-09-13T23:05:49.158925+0000","last_clean":"2024-09-13T23:05:49.158925+0000","last_became_active":"2024-09-13T23:05:16.118353+0000","last_became_peered":"2024-09-13T23:05:16.118353+0000","last_unstale":"2024-09-13T23:05:49.158925+0000","last_undegraded":"2024-09-13T23:05:49.158925+0000","last_fullsized":"2024-09-13T23:05:49.158925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:58.090312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.706353+0000","last_change":"2024-09-13T23:05:18.129142+0000","last_active":"2024-09-13T23:07:19.706353+0000","last_peered":"2024-09-13T23:07:19.706353+0000","last_clean":"2024-09-13T23:07:19.706353+0000","last_became_active":"2024-09-13T23:05:18.127975+0000","last_became_peered":"2024-09-13T23:05:18.127975+0000","last_unstale":"2024-09-13T23:07:19.706353+0000","last_undegraded":"2024-09-13T23:07:19.706353+0000","last_fullsized":"2024-09-13T23:07:19.706353+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:19:28.546902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158396+0000","last_change":"2024-09-13T23:05:20.139596+0000","last_active":"2024-09-13T23:05:49.158396+0000","last_peered":"2024-09-13T23:05:49.158396+0000","last_clean":"2024-09-13T23:05:49.158396+0000","last_became_active":"2024-09-13T23:05:20.139329+0000","last_became_peered":"2024-09-13T23:05:20.139329+0000","last_unstale":"2024-09-13T23:05:49.158396+0000","last_undegraded":"2024-09-13T23:05:49.158396+0000","last_fullsized":"2024-09-13T23:05:49.158396+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:14.460878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159092+0000","last_change":"2024-09-13T23:05:22.148249+0000","last_active":"2024-09-13T23:05:49.159092+0000","last_peered":"2024-09-13T23:05:49.159092+0000","last_clean":"2024-09-13T23:05:49.159092+0000","last_became_active":"2024-09-13T23:05:22.147949+0000","last_became_peered":"2024-09-13T23:05:22.147949+0000","last_unstale":"2024-09-13T23:05:49.159092+0000","last_undegraded":"2024-09-13T23:05:49.159092+0000","last_fullsized":"2024-09-13T23:05:49.159092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:07.578205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:55.392471+0000","last_change":"2024-09-13T23:05:14.114061+0000","last_active":"2024-09-13T23:05:55.392471+0000","last_peered":"2024-09-13T23:05:55.392471+0000","last_clean":"2024-09-13T23:05:55.392471+0000","last_became_active":"2024-09-13T23:05:14.113816+0000","last_became_peered":"2024-09-13T23:05:14.113816+0000","last_unstale":"2024-09-13T23:05:55.392471+0000","last_undegraded":"2024-09-13T23:05:55.392471+0000","last_fullsized":"2024-09-13T23:05:55.392471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:31:40.142550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.162049+0000","last_change":"2024-09-13T23:05:12.149692+0000","last_active":"2024-09-13T23:05:49.162049+0000","last_peered":"2024-09-13T23:05:49.162049+0000","last_clean":"2024-09-13T23:05:49.162049+0000","last_became_active":"2024-09-13T23:05:12.149292+0000","last_became_peered":"2024-09-13T23:05:12.149292+0000","last_unstale":"2024-09-13T23:05:49.162049+0000","last_undegraded":"2024-09-13T23:05:49.162049+0000","last_fullsized":"2024-09-13T23:05:49.162049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:05:07.956349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155102+0000","last_change":"2024-09-13T23:05:16.128264+0000","last_active":"2024-09-13T23:05:49.155102+0000","last_peered":"2024-09-13T23:05:49.155102+0000","last_clean":"2024-09-13T23:05:49.155102+0000","last_became_active":"2024-09-13T23:05:16.128023+0000","last_became_peered":"2024-09-13T23:05:16.128023+0000","last_unstale":"2024-09-13T23:05:49.155102+0000","last_undegraded":"2024-09-13T23:05:49.155102+0000","last_fullsized":"2024-09-13T23:05:49.155102+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:29.344309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'31","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:44.075365+0000","last_change":"2024-09-13T23:05:18.132864+0000","last_active":"2024-09-13T23:07:44.075365+0000","last_peered":"2024-09-13T23:07:44.075365+0000","last_clean":"2024-09-13T23:07:44.075365+0000","last_became_active":"2024-09-13T23:05:18.132579+0000","last_became_peered":"2024-09-13T23:05:18.132579+0000","last_unstale":"2024-09-13T23:07:44.075365+0000","last_undegraded":"2024-09-13T23:07:44.075365+0000","last_fullsized":"2024-09-13T23:07:44.075365+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:26.946305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.154964+0000","last_change":"2024-09-13T23:05:20.136330+0000","last_active":"2024-09-13T23:05:49.154964+0000","last_peered":"2024-09-13T23:05:49.154964+0000","last_clean":"2024-09-13T23:05:49.154964+0000","last_became_active":"2024-09-13T23:05:20.136023+0000","last_became_peered":"2024-09-13T23:05:20.136023+0000","last_unstale":"2024-09-13T23:05:49.154964+0000","last_undegraded":"2024-09-13T23:05:49.154964+0000","last_fullsized":"2024-09-13T23:05:49.154964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:54.602234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.162874+0000","last_change":"2024-09-13T23:05:22.149740+0000","last_active":"2024-09-13T23:05:49.162874+0000","last_peered":"2024-09-13T23:05:49.162874+0000","last_clean":"2024-09-13T23:05:49.162874+0000","last_became_active":"2024-09-13T23:05:22.149468+0000","last_became_peered":"2024-09-13T23:05:22.149468+0000","last_unstale":"2024-09-13T23:05:49.162874+0000","last_undegraded":"2024-09-13T23:05:49.162874+0000","last_fullsized":"2024-09-13T23:05:49.162874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:05.061174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079088+0000","last_change":"2024-09-13T23:05:14.109581+0000","last_active":"2024-09-13T23:07:42.079088+0000","last_peered":"2024-09-13T23:07:42.079088+0000","last_clean":"2024-09-13T23:07:42.079088+0000","last_became_active":"2024-09-13T23:05:14.109323+0000","last_became_peered":"2024-09-13T23:05:14.109323+0000","last_unstale":"2024-09-13T23:07:42.079088+0000","last_undegraded":"2024-09-13T23:07:42.079088+0000","last_fullsized":"2024-09-13T23:07:42.079088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:09.879028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160689+0000","last_change":"2024-09-13T23:05:12.121655+0000","last_active":"2024-09-13T23:05:49.160689+0000","last_peered":"2024-09-13T23:05:49.160689+0000","last_clean":"2024-09-13T23:05:49.160689+0000","last_became_active":"2024-09-13T23:05:12.121050+0000","last_became_peered":"2024-09-13T23:05:12.121050+0000","last_unstale":"2024-09-13T23:05:49.160689+0000","last_undegraded":"2024-09-13T23:05:49.160689+0000","last_fullsized":"2024-09-13T23:05:49.160689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:12.628284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"25'1","reported_seq":218,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:20.838539+0000","last_change":"2024-09-13T23:05:16.123977+0000","last_active":"2024-09-13T23:07:20.838539+0000","last_peered":"2024-09-13T23:07:20.838539+0000","last_clean":"2024-09-13T23:07:20.838539+0000","last_became_active":"2024-09-13T23:05:16.123673+0000","last_became_peered":"2024-09-13T23:05:16.123673+0000","last_unstale":"2024-09-13T23:07:20.838539+0000","last_undegraded":"2024-09-13T23:07:20.838539+0000","last_fullsized":"2024-09-13T23:07:20.838539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:04.185929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'26","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.731194+0000","last_change":"2024-09-13T23:05:18.134891+0000","last_active":"2024-09-13T23:07:19.731194+0000","last_peered":"2024-09-13T23:07:19.731194+0000","last_clean":"2024-09-13T23:07:19.731194+0000","last_became_active":"2024-09-13T23:05:18.134152+0000","last_became_peered":"2024-09-13T23:05:18.134152+0000","last_unstale":"2024-09-13T23:07:19.731194+0000","last_undegraded":"2024-09-13T23:07:19.731194+0000","last_fullsized":"2024-09-13T23:07:19.731194+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:38.762106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155513+0000","last_change":"2024-09-13T23:05:20.139704+0000","last_active":"2024-09-13T23:05:49.155513+0000","last_peered":"2024-09-13T23:05:49.155513+0000","last_clean":"2024-09-13T23:05:49.155513+0000","last_became_active":"2024-09-13T23:05:20.139133+0000","last_became_peered":"2024-09-13T23:05:20.139133+0000","last_unstale":"2024-09-13T23:05:49.155513+0000","last_undegraded":"2024-09-13T23:05:49.155513+0000","last_fullsized":"2024-09-13T23:05:49.155513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:54.483387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'12","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.740945+0000","last_change":"2024-09-13T23:05:22.144173+0000","last_active":"2024-09-13T23:07:19.740945+0000","last_peered":"2024-09-13T23:07:19.740945+0000","last_clean":"2024-09-13T23:07:19.740945+0000","last_became_active":"2024-09-13T23:05:22.143886+0000","last_became_peered":"2024-09-13T23:05:22.143886+0000","last_unstale":"2024-09-13T23:07:19.740945+0000","last_undegraded":"2024-09-13T23:07:19.740945+0000","last_fullsized":"2024-09-13T23:07:19.740945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:32.073594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":59,"num_write":33,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:55.392329+0000","last_change":"2024-09-13T23:05:14.112092+0000","last_active":"2024-09-13T23:05:55.392329+0000","last_peered":"2024-09-13T23:05:55.392329+0000","last_clean":"2024-09-13T23:05:55.392329+0000","last_became_active":"2024-09-13T23:05:14.111836+0000","last_became_peered":"2024-09-13T23:05:14.111836+0000","last_unstale":"2024-09-13T23:05:55.392329+0000","last_undegraded":"2024-09-13T23:05:55.392329+0000","last_fullsized":"2024-09-13T23:05:55.392329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:12:02.291251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159037+0000","last_change":"2024-09-13T23:05:12.135245+0000","last_active":"2024-09-13T23:05:49.159037+0000","last_peered":"2024-09-13T23:05:49.159037+0000","last_clean":"2024-09-13T23:05:49.159037+0000","last_became_active":"2024-09-13T23:05:12.134820+0000","last_became_peered":"2024-09-13T23:05:12.134820+0000","last_unstale":"2024-09-13T23:05:49.159037+0000","last_undegraded":"2024-09-13T23:05:49.159037+0000","last_fullsized":"2024-09-13T23:05:49.159037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:36.907610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:18.281573+0000","last_change":"2024-09-13T23:05:16.124579+0000","last_active":"2024-09-13T23:07:18.281573+0000","last_peered":"2024-09-13T23:07:18.281573+0000","last_clean":"2024-09-13T23:07:18.281573+0000","last_became_active":"2024-09-13T23:05:16.124295+0000","last_became_peered":"2024-09-13T23:05:16.124295+0000","last_unstale":"2024-09-13T23:07:18.281573+0000","last_undegraded":"2024-09-13T23:07:18.281573+0000","last_fullsized":"2024-09-13T23:07:18.281573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:53:47.490114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'32","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.512451+0000","last_change":"2024-09-13T23:05:18.132070+0000","last_active":"2024-09-13T23:08:21.512451+0000","last_peered":"2024-09-13T23:08:21.512451+0000","last_clean":"2024-09-13T23:08:21.512451+0000","last_became_active":"2024-09-13T23:05:18.131796+0000","last_became_peered":"2024-09-13T23:05:18.131796+0000","last_unstale":"2024-09-13T23:08:21.512451+0000","last_undegraded":"2024-09-13T23:08:21.512451+0000","last_fullsized":"2024-09-13T23:08:21.512451+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:56.183512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159253+0000","last_change":"2024-09-13T23:05:20.145706+0000","last_active":"2024-09-13T23:05:49.159253+0000","last_peered":"2024-09-13T23:05:49.159253+0000","last_clean":"2024-09-13T23:05:49.159253+0000","last_became_active":"2024-09-13T23:05:20.145356+0000","last_became_peered":"2024-09-13T23:05:20.145356+0000","last_unstale":"2024-09-13T23:05:49.159253+0000","last_undegraded":"2024-09-13T23:05:49.159253+0000","last_fullsized":"2024-09-13T23:05:49.159253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:54.194855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.743464+0000","last_change":"2024-09-13T23:05:22.147988+0000","last_active":"2024-09-13T23:07:19.743464+0000","last_peered":"2024-09-13T23:07:19.743464+0000","last_clean":"2024-09-13T23:07:19.743464+0000","last_became_active":"2024-09-13T23:05:22.147707+0000","last_became_peered":"2024-09-13T23:05:22.147707+0000","last_unstale":"2024-09-13T23:07:19.743464+0000","last_undegraded":"2024-09-13T23:07:19.743464+0000","last_fullsized":"2024-09-13T23:07:19.743464+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:27.322255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'16","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.250273+0000","last_change":"2024-09-13T23:05:14.123908+0000","last_active":"2024-09-13T23:08:22.250273+0000","last_peered":"2024-09-13T23:08:22.250273+0000","last_clean":"2024-09-13T23:08:22.250273+0000","last_became_active":"2024-09-13T23:05:14.123513+0000","last_became_peered":"2024-09-13T23:05:14.123513+0000","last_unstale":"2024-09-13T23:08:22.250273+0000","last_undegraded":"2024-09-13T23:08:22.250273+0000","last_fullsized":"2024-09-13T23:08:22.250273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:10.807036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.074649+0000","last_change":"2024-09-13T23:05:12.129469+0000","last_active":"2024-09-13T23:07:21.074649+0000","last_peered":"2024-09-13T23:07:21.074649+0000","last_clean":"2024-09-13T23:07:21.074649+0000","last_became_active":"2024-09-13T23:05:12.125740+0000","last_became_peered":"2024-09-13T23:05:12.125740+0000","last_unstale":"2024-09-13T23:07:21.074649+0000","last_undegraded":"2024-09-13T23:07:21.074649+0000","last_fullsized":"2024-09-13T23:07:21.074649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:29.212129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.322046+0000","last_change":"2024-09-13T23:05:14.110713+0000","last_active":"2024-09-13T23:08:22.322046+0000","last_peered":"2024-09-13T23:08:22.322046+0000","last_clean":"2024-09-13T23:08:22.322046+0000","last_became_active":"2024-09-13T23:05:14.109959+0000","last_became_peered":"2024-09-13T23:05:14.109959+0000","last_unstale":"2024-09-13T23:08:22.322046+0000","last_undegraded":"2024-09-13T23:08:22.322046+0000","last_fullsized":"2024-09-13T23:08:22.322046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:14:21.159008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.463371+0000","last_change":"2024-09-13T23:05:12.114302+0000","last_active":"2024-09-13T23:07:21.463371+0000","last_peered":"2024-09-13T23:07:21.463371+0000","last_clean":"2024-09-13T23:07:21.463371+0000","last_became_active":"2024-09-13T23:05:12.113972+0000","last_became_peered":"2024-09-13T23:05:12.113972+0000","last_unstale":"2024-09-13T23:07:21.463371+0000","last_undegraded":"2024-09-13T23:07:21.463371+0000","last_fullsized":"2024-09-13T23:07:21.463371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:48:38.750102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'10","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362921+0000","last_change":"2024-09-13T23:05:49.165777+0000","last_active":"2024-09-13T23:08:22.362921+0000","last_peered":"2024-09-13T23:08:22.362921+0000","last_clean":"2024-09-13T23:08:22.362921+0000","last_became_active":"2024-09-13T23:05:49.159488+0000","last_became_peered":"2024-09-13T23:05:49.159488+0000","last_unstale":"2024-09-13T23:08:22.362921+0000","last_undegraded":"2024-09-13T23:08:22.362921+0000","last_fullsized":"2024-09-13T23:08:22.362921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:40.422062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.966513+0000","last_change":"2024-09-13T23:05:12.140088+0000","last_active":"2024-09-13T23:08:21.966513+0000","last_peered":"2024-09-13T23:08:21.966513+0000","last_clean":"2024-09-13T23:08:21.966513+0000","last_became_active":"2024-09-13T23:05:12.139673+0000","last_became_peered":"2024-09-13T23:05:12.139673+0000","last_unstale":"2024-09-13T23:08:21.966513+0000","last_undegraded":"2024-09-13T23:08:21.966513+0000","last_fullsized":"2024-09-13T23:08:21.966513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:32:20.507188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'9","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.257272+0000","last_change":"2024-09-13T23:05:14.112656+0000","last_active":"2024-09-13T23:08:22.257272+0000","last_peered":"2024-09-13T23:08:22.257272+0000","last_clean":"2024-09-13T23:08:22.257272+0000","last_became_active":"2024-09-13T23:05:14.112168+0000","last_became_peered":"2024-09-13T23:05:14.112168+0000","last_unstale":"2024-09-13T23:08:22.257272+0000","last_undegraded":"2024-09-13T23:08:22.257272+0000","last_fullsized":"2024-09-13T23:08:22.257272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:08.501106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160289+0000","last_change":"2024-09-13T23:05:12.118979+0000","last_active":"2024-09-13T23:05:49.160289+0000","last_peered":"2024-09-13T23:05:49.160289+0000","last_clean":"2024-09-13T23:05:49.160289+0000","last_became_active":"2024-09-13T23:05:12.118425+0000","last_became_peered":"2024-09-13T23:05:12.118425+0000","last_unstale":"2024-09-13T23:05:49.160289+0000","last_undegraded":"2024-09-13T23:05:49.160289+0000","last_fullsized":"2024-09-13T23:05:49.160289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:36.907610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'14","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362935+0000","last_change":"2024-09-13T23:05:14.120992+0000","last_active":"2024-09-13T23:08:22.362935+0000","last_peered":"2024-09-13T23:08:22.362935+0000","last_clean":"2024-09-13T23:08:22.362935+0000","last_became_active":"2024-09-13T23:05:14.120456+0000","last_became_peered":"2024-09-13T23:05:14.120456+0000","last_unstale":"2024-09-13T23:08:22.362935+0000","last_undegraded":"2024-09-13T23:08:22.362935+0000","last_fullsized":"2024-09-13T23:08:22.362935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:33:19.901997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160111+0000","last_change":"2024-09-13T23:05:12.114509+0000","last_active":"2024-09-13T23:05:49.160111+0000","last_peered":"2024-09-13T23:05:49.160111+0000","last_clean":"2024-09-13T23:05:49.160111+0000","last_became_active":"2024-09-13T23:05:12.114046+0000","last_became_peered":"2024-09-13T23:05:12.114046+0000","last_unstale":"2024-09-13T23:05:49.160111+0000","last_undegraded":"2024-09-13T23:05:49.160111+0000","last_fullsized":"2024-09-13T23:05:49.160111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:04.782795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.161547+0000","last_change":"2024-09-13T23:05:14.124864+0000","last_active":"2024-09-13T23:05:49.161547+0000","last_peered":"2024-09-13T23:05:49.161547+0000","last_clean":"2024-09-13T23:05:49.161547+0000","last_became_active":"2024-09-13T23:05:14.123783+0000","last_became_peered":"2024-09-13T23:05:14.123783+0000","last_unstale":"2024-09-13T23:05:49.161547+0000","last_undegraded":"2024-09-13T23:05:49.161547+0000","last_fullsized":"2024-09-13T23:05:49.161547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:21.273774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.293717+0000","last_change":"2024-09-13T23:05:12.140004+0000","last_active":"2024-09-13T23:07:21.293717+0000","last_peered":"2024-09-13T23:07:21.293717+0000","last_clean":"2024-09-13T23:07:21.293717+0000","last_became_active":"2024-09-13T23:05:12.137465+0000","last_became_peered":"2024-09-13T23:05:12.137465+0000","last_unstale":"2024-09-13T23:07:21.293717+0000","last_undegraded":"2024-09-13T23:07:21.293717+0000","last_fullsized":"2024-09-13T23:07:21.293717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:29.788894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.701866+0000","last_change":"2024-09-13T23:05:14.121847+0000","last_active":"2024-09-13T23:05:54.701866+0000","last_peered":"2024-09-13T23:05:54.701866+0000","last_clean":"2024-09-13T23:05:54.701866+0000","last_became_active":"2024-09-13T23:05:14.121425+0000","last_became_peered":"2024-09-13T23:05:14.121425+0000","last_unstale":"2024-09-13T23:05:54.701866+0000","last_undegraded":"2024-09-13T23:05:54.701866+0000","last_fullsized":"2024-09-13T23:05:54.701866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:02.456301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158590+0000","last_change":"2024-09-13T23:05:12.116219+0000","last_active":"2024-09-13T23:05:49.158590+0000","last_peered":"2024-09-13T23:05:49.158590+0000","last_clean":"2024-09-13T23:05:49.158590+0000","last_became_active":"2024-09-13T23:05:12.115546+0000","last_became_peered":"2024-09-13T23:05:12.115546+0000","last_unstale":"2024-09-13T23:05:49.158590+0000","last_undegraded":"2024-09-13T23:05:49.158590+0000","last_fullsized":"2024-09-13T23:05:49.158590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:46.740162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.321747+0000","last_change":"2024-09-13T23:05:14.123460+0000","last_active":"2024-09-13T23:08:22.321747+0000","last_peered":"2024-09-13T23:08:22.321747+0000","last_clean":"2024-09-13T23:08:22.321747+0000","last_became_active":"2024-09-13T23:05:14.122944+0000","last_became_peered":"2024-09-13T23:05:14.122944+0000","last_unstale":"2024-09-13T23:08:22.321747+0000","last_undegraded":"2024-09-13T23:08:22.321747+0000","last_fullsized":"2024-09-13T23:08:22.321747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:27.479160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:24.072349+0000","last_change":"2024-09-13T23:05:12.119016+0000","last_active":"2024-09-13T23:07:24.072349+0000","last_peered":"2024-09-13T23:07:24.072349+0000","last_clean":"2024-09-13T23:07:24.072349+0000","last_became_active":"2024-09-13T23:05:12.118347+0000","last_became_peered":"2024-09-13T23:05:12.118347+0000","last_unstale":"2024-09-13T23:07:24.072349+0000","last_undegraded":"2024-09-13T23:07:24.072349+0000","last_fullsized":"2024-09-13T23:07:24.072349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:22.242350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.452882+0000","last_change":"2024-09-13T23:05:14.126164+0000","last_active":"2024-09-13T23:06:37.452882+0000","last_peered":"2024-09-13T23:06:37.452882+0000","last_clean":"2024-09-13T23:06:37.452882+0000","last_became_active":"2024-09-13T23:05:14.124593+0000","last_became_peered":"2024-09-13T23:05:14.124593+0000","last_unstale":"2024-09-13T23:06:37.452882+0000","last_undegraded":"2024-09-13T23:06:37.452882+0000","last_fullsized":"2024-09-13T23:06:37.452882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:44.195143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:22.075262+0000","last_change":"2024-09-13T23:05:12.144032+0000","last_active":"2024-09-13T23:07:22.075262+0000","last_peered":"2024-09-13T23:07:22.075262+0000","last_clean":"2024-09-13T23:07:22.075262+0000","last_became_active":"2024-09-13T23:05:12.141628+0000","last_became_peered":"2024-09-13T23:05:12.141628+0000","last_unstale":"2024-09-13T23:07:22.075262+0000","last_undegraded":"2024-09-13T23:07:22.075262+0000","last_fullsized":"2024-09-13T23:07:22.075262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:15.223430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.701817+0000","last_change":"2024-09-13T23:05:14.113960+0000","last_active":"2024-09-13T23:05:54.701817+0000","last_peered":"2024-09-13T23:05:54.701817+0000","last_clean":"2024-09-13T23:05:54.701817+0000","last_became_active":"2024-09-13T23:05:14.113710+0000","last_became_peered":"2024-09-13T23:05:14.113710+0000","last_unstale":"2024-09-13T23:05:54.701817+0000","last_undegraded":"2024-09-13T23:05:54.701817+0000","last_fullsized":"2024-09-13T23:05:54.701817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:34.129089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158574+0000","last_change":"2024-09-13T23:05:12.119408+0000","last_active":"2024-09-13T23:05:49.158574+0000","last_peered":"2024-09-13T23:05:49.158574+0000","last_clean":"2024-09-13T23:05:49.158574+0000","last_became_active":"2024-09-13T23:05:12.118716+0000","last_became_peered":"2024-09-13T23:05:12.118716+0000","last_unstale":"2024-09-13T23:05:49.158574+0000","last_undegraded":"2024-09-13T23:05:49.158574+0000","last_fullsized":"2024-09-13T23:05:49.158574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:51.066283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.263470+0000","last_change":"2024-09-13T23:05:14.120905+0000","last_active":"2024-09-13T23:06:37.263470+0000","last_peered":"2024-09-13T23:06:37.263470+0000","last_clean":"2024-09-13T23:06:37.263470+0000","last_became_active":"2024-09-13T23:05:14.120489+0000","last_became_peered":"2024-09-13T23:05:14.120489+0000","last_unstale":"2024-09-13T23:06:37.263470+0000","last_undegraded":"2024-09-13T23:06:37.263470+0000","last_fullsized":"2024-09-13T23:06:37.263470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:34.163619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.911022+0000","last_change":"2024-09-13T23:05:12.141835+0000","last_active":"2024-09-13T23:05:54.911022+0000","last_peered":"2024-09-13T23:05:54.911022+0000","last_clean":"2024-09-13T23:05:54.911022+0000","last_became_active":"2024-09-13T23:05:12.137735+0000","last_became_peered":"2024-09-13T23:05:12.137735+0000","last_unstale":"2024-09-13T23:05:54.911022+0000","last_undegraded":"2024-09-13T23:05:54.911022+0000","last_fullsized":"2024-09-13T23:05:54.911022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:14:55.200398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'3","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:33.076769+0000","last_change":"2024-09-13T23:05:14.122103+0000","last_active":"2024-09-13T23:07:33.076769+0000","last_peered":"2024-09-13T23:07:33.076769+0000","last_clean":"2024-09-13T23:07:33.076769+0000","last_became_active":"2024-09-13T23:05:14.121389+0000","last_became_peered":"2024-09-13T23:05:14.121389+0000","last_unstale":"2024-09-13T23:07:33.076769+0000","last_undegraded":"2024-09-13T23:07:33.076769+0000","last_fullsized":"2024-09-13T23:07:33.076769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:57:39.861849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155167+0000","last_change":"2024-09-13T23:05:12.139774+0000","last_active":"2024-09-13T23:05:49.155167+0000","last_peered":"2024-09-13T23:05:49.155167+0000","last_clean":"2024-09-13T23:05:49.155167+0000","last_became_active":"2024-09-13T23:05:12.137118+0000","last_became_peered":"2024-09-13T23:05:12.137118+0000","last_unstale":"2024-09-13T23:05:49.155167+0000","last_undegraded":"2024-09-13T23:05:49.155167+0000","last_fullsized":"2024-09-13T23:05:49.155167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:01:21.996979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362651+0000","last_change":"2024-09-13T23:05:14.125962+0000","last_active":"2024-09-13T23:08:22.362651+0000","last_peered":"2024-09-13T23:08:22.362651+0000","last_clean":"2024-09-13T23:08:22.362651+0000","last_became_active":"2024-09-13T23:05:14.124507+0000","last_became_peered":"2024-09-13T23:05:14.124507+0000","last_unstale":"2024-09-13T23:08:22.362651+0000","last_undegraded":"2024-09-13T23:08:22.362651+0000","last_fullsized":"2024-09-13T23:08:22.362651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:39.333340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160223+0000","last_change":"2024-09-13T23:05:12.138932+0000","last_active":"2024-09-13T23:05:49.160223+0000","last_peered":"2024-09-13T23:05:49.160223+0000","last_clean":"2024-09-13T23:05:49.160223+0000","last_became_active":"2024-09-13T23:05:12.138577+0000","last_became_peered":"2024-09-13T23:05:12.138577+0000","last_unstale":"2024-09-13T23:05:49.160223+0000","last_undegraded":"2024-09-13T23:05:49.160223+0000","last_fullsized":"2024-09-13T23:05:49.160223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:20.700653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.257347+0000","last_change":"2024-09-13T23:05:14.125069+0000","last_active":"2024-09-13T23:08:22.257347+0000","last_peered":"2024-09-13T23:08:22.257347+0000","last_clean":"2024-09-13T23:08:22.257347+0000","last_became_active":"2024-09-13T23:05:14.124604+0000","last_became_peered":"2024-09-13T23:05:14.124604+0000","last_unstale":"2024-09-13T23:08:22.257347+0000","last_undegraded":"2024-09-13T23:08:22.257347+0000","last_fullsized":"2024-09-13T23:08:22.257347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:41.404040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.162242+0000","last_change":"2024-09-13T23:05:12.141608+0000","last_active":"2024-09-13T23:05:49.162242+0000","last_peered":"2024-09-13T23:05:49.162242+0000","last_clean":"2024-09-13T23:05:49.162242+0000","last_became_active":"2024-09-13T23:05:12.140686+0000","last_became_peered":"2024-09-13T23:05:12.140686+0000","last_unstale":"2024-09-13T23:05:49.162242+0000","last_undegraded":"2024-09-13T23:05:49.162242+0000","last_fullsized":"2024-09-13T23:05:49.162242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:59:19.940880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156146+0000","last_change":"2024-09-13T23:05:14.126009+0000","last_active":"2024-09-13T23:05:49.156146+0000","last_peered":"2024-09-13T23:05:49.156146+0000","last_clean":"2024-09-13T23:05:49.156146+0000","last_became_active":"2024-09-13T23:05:14.125747+0000","last_became_peered":"2024-09-13T23:05:14.125747+0000","last_unstale":"2024-09-13T23:05:49.156146+0000","last_undegraded":"2024-09-13T23:05:49.156146+0000","last_fullsized":"2024-09-13T23:05:49.156146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:34:19.493607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158853+0000","last_change":"2024-09-13T23:05:12.126550+0000","last_active":"2024-09-13T23:05:49.158853+0000","last_peered":"2024-09-13T23:05:49.158853+0000","last_clean":"2024-09-13T23:05:49.158853+0000","last_became_active":"2024-09-13T23:05:12.126202+0000","last_became_peered":"2024-09-13T23:05:12.126202+0000","last_unstale":"2024-09-13T23:05:49.158853+0000","last_undegraded":"2024-09-13T23:05:49.158853+0000","last_fullsized":"2024-09-13T23:05:49.158853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:31.807454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.100783+0000","last_change":"2024-09-13T23:05:14.125692+0000","last_active":"2024-09-13T23:08:22.100783+0000","last_peered":"2024-09-13T23:08:22.100783+0000","last_clean":"2024-09-13T23:08:22.100783+0000","last_became_active":"2024-09-13T23:05:14.125457+0000","last_became_peered":"2024-09-13T23:05:14.125457+0000","last_unstale":"2024-09-13T23:08:22.100783+0000","last_undegraded":"2024-09-13T23:08:22.100783+0000","last_fullsized":"2024-09-13T23:08:22.100783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:30.709764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.164256+0000","last_change":"2024-09-13T23:05:12.150036+0000","last_active":"2024-09-13T23:05:49.164256+0000","last_peered":"2024-09-13T23:05:49.164256+0000","last_clean":"2024-09-13T23:05:49.164256+0000","last_became_active":"2024-09-13T23:05:12.149345+0000","last_became_peered":"2024-09-13T23:05:12.149345+0000","last_unstale":"2024-09-13T23:05:49.164256+0000","last_undegraded":"2024-09-13T23:05:49.164256+0000","last_fullsized":"2024-09-13T23:05:49.164256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:08.953763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:17.897299+0000","last_change":"2024-09-13T23:05:12.142386+0000","last_active":"2024-09-13T23:07:17.897299+0000","last_peered":"2024-09-13T23:07:17.897299+0000","last_clean":"2024-09-13T23:07:17.897299+0000","last_became_active":"2024-09-13T23:05:12.140432+0000","last_became_peered":"2024-09-13T23:05:12.140432+0000","last_unstale":"2024-09-13T23:07:17.897299+0000","last_undegraded":"2024-09-13T23:07:17.897299+0000","last_fullsized":"2024-09-13T23:07:17.897299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:03:40.790581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'16","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.324175+0000","last_change":"2024-09-13T23:05:14.122670+0000","last_active":"2024-09-13T23:08:22.324175+0000","last_peered":"2024-09-13T23:08:22.324175+0000","last_clean":"2024-09-13T23:08:22.324175+0000","last_became_active":"2024-09-13T23:05:14.122105+0000","last_became_peered":"2024-09-13T23:05:14.122105+0000","last_unstale":"2024-09-13T23:08:22.324175+0000","last_undegraded":"2024-09-13T23:08:22.324175+0000","last_fullsized":"2024-09-13T23:08:22.324175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:32.818885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.243675+0000","last_change":"2024-09-13T23:05:12.121856+0000","last_active":"2024-09-13T23:08:22.243675+0000","last_peered":"2024-09-13T23:08:22.243675+0000","last_clean":"2024-09-13T23:08:22.243675+0000","last_became_active":"2024-09-13T23:05:12.120703+0000","last_became_peered":"2024-09-13T23:05:12.120703+0000","last_unstale":"2024-09-13T23:08:22.243675+0000","last_undegraded":"2024-09-13T23:08:22.243675+0000","last_fullsized":"2024-09-13T23:08:22.243675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:20.740109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'9","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:43.078358+0000","last_change":"2024-09-13T23:05:14.122765+0000","last_active":"2024-09-13T23:07:43.078358+0000","last_peered":"2024-09-13T23:07:43.078358+0000","last_clean":"2024-09-13T23:07:43.078358+0000","last_became_active":"2024-09-13T23:05:14.121636+0000","last_became_peered":"2024-09-13T23:05:14.121636+0000","last_unstale":"2024-09-13T23:07:43.078358+0000","last_undegraded":"2024-09-13T23:07:43.078358+0000","last_fullsized":"2024-09-13T23:07:43.078358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:08.481848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2262,"ondisk_log_size":2262,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1279,"ondisk_log_size":1279,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":962,"num_read_kb":962,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1600,"num_read_kb":1490,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":12,"seq":51539607599,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48384,"kb_used_data":8880,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323456,"statfs":{"total":96636764160,"available":96587218944,"internally_reserved":0,"allocated":9093120,"data_stored":8759400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640301,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44736,"kb_used_data":9392,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327104,"statfs":{"total":96636764160,"available":96590954496,"internally_reserved":0,"allocated":9617408,"data_stored":9345424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705710,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44768,"kb_used_data":9424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327072,"statfs":{"total":96636764160,"available":96590921728,"internally_reserved":0,"allocated":9650176,"data_stored":9349228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40024,"kb_used_data":8840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331816,"statfs":{"total":96636764160,"available":96595779584,"internally_reserved":0,"allocated":9052160,"data_stored":8757564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T23:08:30.344 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T23:08:30.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.443+0000 7fd0ca526640 1 Processor -- start 2024-09-13T23:08:30.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.443+0000 7fd0ca526640 1 -- start start 2024-09-13T23:08:30.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.444+0000 7fd0ca526640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd0c409bd50 0x7fd0c409c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:30.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.444+0000 7fd0ca526640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0c409d3b0 con 0x7fd0c409c670 2024-09-13T23:08:30.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.444+0000 7fd0ca526640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fd0c4098230 con 0x7fd0c409bd50 2024-09-13T23:08:30.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.444+0000 7fd0c3fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd0c409bd50 0x7fd0c409c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:30.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.444+0000 7fd0c37fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd0c409c670 0x7fd0c40990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:52718/0 (socket says 172.21.15.17:52718) 2024-09-13T23:08:30.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.444+0000 7fd0c37fe640 1 -- 172.21.15.17:0/3887515227 learned_addr learned my addr 172.21.15.17:0/3887515227 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:08:30.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.444+0000 7fd0c3fff640 1 -- 172.21.15.17:0/3887515227 >> v1:172.21.15.17:6789/0 conn(0x7fd0c409c670 legacy=0x7fd0c40990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:30.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.444+0000 7fd0c3fff640 1 -- 172.21.15.17:0/3887515227 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c40983e0 con 0x7fd0c409bd50 2024-09-13T23:08:30.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.445+0000 7fd0c3fff640 1 --2- 172.21.15.17:0/3887515227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0c409bd50 0x7fd0c409c130 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009720 tx=0x7fd0b402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=329b230d83c8c19c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:30.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.445+0000 7fd0c2ffd640 1 -- 172.21.15.17:0/3887515227 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0b4037070 con 0x7fd0c409bd50 2024-09-13T23:08:30.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.445+0000 7fd0c2ffd640 1 -- 172.21.15.17:0/3887515227 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0b402ad90 con 0x7fd0c409bd50 2024-09-13T23:08:30.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.445+0000 7fd0c2ffd640 1 -- 172.21.15.17:0/3887515227 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0b4032590 con 0x7fd0c409bd50 2024-09-13T23:08:30.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.446+0000 7fd0ca526640 1 -- 172.21.15.17:0/3887515227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0c409bd50 msgr2=0x7fd0c409c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:30.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.446+0000 7fd0ca526640 1 --2- 172.21.15.17:0/3887515227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0c409bd50 0x7fd0c409c130 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009720 tx=0x7fd0b402a110 comp rx=0 tx=0).stop 2024-09-13T23:08:30.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.446+0000 7fd0ca526640 1 -- 172.21.15.17:0/3887515227 shutdown_connections 2024-09-13T23:08:30.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.446+0000 7fd0ca526640 1 --2- 172.21.15.17:0/3887515227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0c409bd50 0x7fd0c409c130 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:30.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.446+0000 7fd0ca526640 1 -- 172.21.15.17:0/3887515227 >> 172.21.15.17:0/3887515227 conn(0x7fd0c406d4a0 msgr2=0x7fd0c406d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:30.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.446+0000 7fd0ca526640 1 -- 172.21.15.17:0/3887515227 shutdown_connections 2024-09-13T23:08:30.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.446+0000 7fd0ca526640 1 -- 172.21.15.17:0/3887515227 wait complete. 2024-09-13T23:08:30.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.447+0000 7fd0ca526640 1 Processor -- start 2024-09-13T23:08:30.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.447+0000 7fd0ca526640 1 -- start start 2024-09-13T23:08:30.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.447+0000 7fd0ca526640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0c409bd50 0x7fd0c4093570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:30.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.447+0000 7fd0ca526640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c4099b90 con 0x7fd0c409bd50 2024-09-13T23:08:30.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.447+0000 7fd0c3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0c409bd50 0x7fd0c4093570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:30.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.447+0000 7fd0c3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0c409bd50 0x7fd0c4093570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39966/0 (socket says 172.21.15.17:39966) 2024-09-13T23:08:30.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.447+0000 7fd0c3fff640 1 -- 172.21.15.17:0/2890932793 learned_addr learned my addr 172.21.15.17:0/2890932793 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:08:30.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.448+0000 7fd0c3fff640 1 -- 172.21.15.17:0/2890932793 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c4094eb0 con 0x7fd0c409bd50 2024-09-13T23:08:30.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.448+0000 7fd0c3fff640 1 --2- 172.21.15.17:0/2890932793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0c409bd50 0x7fd0c4093570 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009840 tx=0x7fd0b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:30.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.448+0000 7fd0c0ff9640 1 -- 172.21.15.17:0/2890932793 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0b4041070 con 0x7fd0c409bd50 2024-09-13T23:08:30.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.448+0000 7fd0c0ff9640 1 -- 172.21.15.17:0/2890932793 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0b403c460 con 0x7fd0c409bd50 2024-09-13T23:08:30.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.448+0000 7fd0ca526640 1 -- 172.21.15.17:0/2890932793 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0c4095590 con 0x7fd0c409bd50 2024-09-13T23:08:30.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.448+0000 7fd0c0ff9640 1 -- 172.21.15.17:0/2890932793 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0b4037040 con 0x7fd0c409bd50 2024-09-13T23:08:30.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.448+0000 7fd0ca526640 1 -- 172.21.15.17:0/2890932793 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0c40961c0 con 0x7fd0c409bd50 2024-09-13T23:08:30.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.449+0000 7fd0c0ff9640 1 -- 172.21.15.17:0/2890932793 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd0b4044070 con 0x7fd0c409bd50 2024-09-13T23:08:30.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.449+0000 7fd0c0ff9640 1 --2- 172.21.15.17:0/2890932793 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd0b00382a0 0x7fd0b003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:30.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.449+0000 7fd0c0ff9640 1 -- 172.21.15.17:0/2890932793 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd0b406c5a0 con 0x7fd0c409bd50 2024-09-13T23:08:30.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.449+0000 7fd0ca526640 1 -- 172.21.15.17:0/2890932793 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0c409a130 con 0x7fd0c409bd50 2024-09-13T23:08:30.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.449+0000 7fd0c37fe640 1 --2- 172.21.15.17:0/2890932793 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd0b00382a0 0x7fd0b003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:30.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.450+0000 7fd0c37fe640 1 --2- 172.21.15.17:0/2890932793 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd0b00382a0 0x7fd0b003a760 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8007fd0 tx=0x7fd0b8007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:30.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.454+0000 7fd0c0ff9640 1 -- 172.21.15.17:0/2890932793 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd0c40961c0 con 0x7fd0c409bd50 2024-09-13T23:08:30.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.632+0000 7fd0ca526640 1 -- 172.21.15.17:0/2890932793 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd0c409d020 con 0x7fd0c409bd50 2024-09-13T23:08:30.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.634+0000 7fd0c0ff9640 1 -- 172.21.15.17:0/2890932793 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+21173 (secure 0 0 0) 0x7fd0b4044360 con 0x7fd0c409bd50 2024-09-13T23:08:30.636 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:08:30.636 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":34,"fsid":"cf23c940-4ed5-4d79-b536-21dd117d26cb","created":"2024-09-13T23:04:43.818362+0000","modified":"2024-09-13T23:05:49.149398+0000","last_up_change":"2024-09-13T23:04:56.054738+0000","last_in_change":"2024-09-13T23:04:44.898009+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T23:04:54.087115+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T23:04:59.440302+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-13T23:05:10.119610+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-13T23:05:12.448858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-13T23:05:14.445509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-13T23:05:16.220783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-13T23:05:18.168047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-13T23:05:20.241803+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1aaccac6-e1e9-4353-846a-47ea97c7bafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":489863589},{"type":"v1","addr":"172.21.15.17:6801","nonce":489863589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":489863589},{"type":"v1","addr":"172.21.15.17:6803","nonce":489863589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":489863589},{"type":"v1","addr":"172.21.15.17:6807","nonce":489863589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":489863589},{"type":"v1","addr":"172.21.15.17:6805","nonce":489863589}]},"public_addr":"172.21.15.17:6801/489863589","cluster_addr":"172.21.15.17:6803/489863589","heartbeat_back_addr":"172.21.15.17:6807/489863589","heartbeat_front_addr":"172.21.15.17:6805/489863589","state":["exists","up"]},{"osd":1,"uuid":"ea6cecf5-527b-441a-96f0-942169c28c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":4060509701},{"type":"v1","addr":"172.21.15.164:6801","nonce":4060509701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":4060509701},{"type":"v1","addr":"172.21.15.164:6803","nonce":4060509701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":4060509701},{"type":"v1","addr":"172.21.15.164:6807","nonce":4060509701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":4060509701},{"type":"v1","addr":"172.21.15.164:6805","nonce":4060509701}]},"public_addr":"172.21.15.164:6801/4060509701","cluster_addr":"172.21.15.164:6803/4060509701","heartbeat_back_addr":"172.21.15.164:6807/4060509701","heartbeat_front_addr":"172.21.15.164:6805/4060509701","state":["exists","up"]},{"osd":2,"uuid":"7e05691a-818f-4fa2-9543-1be239750d9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3795914978},{"type":"v1","addr":"172.21.15.164:6809","nonce":3795914978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":3795914978},{"type":"v1","addr":"172.21.15.164:6811","nonce":3795914978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":3795914978},{"type":"v1","addr":"172.21.15.164:6815","nonce":3795914978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":3795914978},{"type":"v1","addr":"172.21.15.164:6813","nonce":3795914978}]},"public_addr":"172.21.15.164:6809/3795914978","cluster_addr":"172.21.15.164:6811/3795914978","heartbeat_back_addr":"172.21.15.164:6815/3795914978","heartbeat_front_addr":"172.21.15.164:6813/3795914978","state":["exists","up"]},{"osd":3,"uuid":"230fdf2b-0a05-4cae-937e-e642ae9fb49e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":93809510},{"type":"v1","addr":"172.21.15.164:6817","nonce":93809510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":93809510},{"type":"v1","addr":"172.21.15.164:6819","nonce":93809510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":93809510},{"type":"v1","addr":"172.21.15.164:6823","nonce":93809510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":93809510},{"type":"v1","addr":"172.21.15.164:6821","nonce":93809510}]},"public_addr":"172.21.15.164:6817/93809510","cluster_addr":"172.21.15.164:6819/93809510","heartbeat_back_addr":"172.21.15.164:6823/93809510","heartbeat_front_addr":"172.21.15.164:6821/93809510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:04:51.331306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:04:51.258107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:04:52.223303+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:04:52.153336+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":3,"to":0}]},{"pgid":"4.25","mappings":[{"from":3,"to":2}]},{"pgid":"5.f","mappings":[{"from":0,"to":2}]},{"pgid":"5.13","mappings":[{"from":0,"to":2}]},{"pgid":"5.17","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T23:08:30.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.636+0000 7fd0ca526640 1 -- 172.21.15.17:0/2890932793 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd0b00382a0 msgr2=0x7fd0b003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:30.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.636+0000 7fd0ca526640 1 --2- 172.21.15.17:0/2890932793 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd0b00382a0 0x7fd0b003a760 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8007fd0 tx=0x7fd0b8007ac0 comp rx=0 tx=0).stop 2024-09-13T23:08:30.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.636+0000 7fd0ca526640 1 -- 172.21.15.17:0/2890932793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0c409bd50 msgr2=0x7fd0c4093570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:30.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.636+0000 7fd0ca526640 1 --2- 172.21.15.17:0/2890932793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0c409bd50 0x7fd0c4093570 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009840 tx=0x7fd0b40046c0 comp rx=0 tx=0).stop 2024-09-13T23:08:30.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.636+0000 7fd0ca526640 1 -- 172.21.15.17:0/2890932793 shutdown_connections 2024-09-13T23:08:30.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.636+0000 7fd0ca526640 1 --2- 172.21.15.17:0/2890932793 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd0b00382a0 0x7fd0b003a760 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:30.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.636+0000 7fd0ca526640 1 --2- 172.21.15.17:0/2890932793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0c409bd50 0x7fd0c4093570 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:30.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.636+0000 7fd0ca526640 1 -- 172.21.15.17:0/2890932793 >> 172.21.15.17:0/2890932793 conn(0x7fd0c406d4a0 msgr2=0x7fd0c409eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:30.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.636+0000 7fd0ca526640 1 -- 172.21.15.17:0/2890932793 shutdown_connections 2024-09-13T23:08:30.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:30.636+0000 7fd0ca526640 1 -- 172.21.15.17:0/2890932793 wait complete. 2024-09-13T23:08:31.649 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T23:08:31.653 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T23:08:31.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.770+0000 7f29b2103640 1 Processor -- start 2024-09-13T23:08:31.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.770+0000 7f29b2103640 1 -- start start 2024-09-13T23:08:31.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.771+0000 7f29b2103640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f29ac095cb0 0x7f29ac134250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:31.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.771+0000 7f29b2103640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29ac050520 con 0x7f29ac093c10 2024-09-13T23:08:31.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.771+0000 7f29b2103640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f29ac074dc0 con 0x7f29ac095cb0 2024-09-13T23:08:31.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.771+0000 7f29aaffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f29ac095cb0 0x7f29ac134250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:31.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.771+0000 7f29ab7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f29ac093c10 0x7f29ac0955a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:52724/0 (socket says 172.21.15.17:52724) 2024-09-13T23:08:31.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.771+0000 7f29ab7fe640 1 -- 172.21.15.17:0/3163681430 learned_addr learned my addr 172.21.15.17:0/3163681430 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:08:31.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.771+0000 7f29aaffd640 1 -- 172.21.15.17:0/3163681430 >> v1:172.21.15.17:6789/0 conn(0x7f29ac093c10 legacy=0x7f29ac0955a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:31.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.771+0000 7f29aaffd640 1 -- 172.21.15.17:0/3163681430 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29ac09c910 con 0x7f29ac095cb0 2024-09-13T23:08:31.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.771+0000 7f29aa7fc640 1 -- 172.21.15.17:0/3163681430 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3853756177 0 0) 0x7f29ac050520 con 0x7f29ac093c10 2024-09-13T23:08:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.772+0000 7f29aaffd640 1 --2- 172.21.15.17:0/3163681430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29ac095cb0 0x7f29ac134250 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f29a0009720 tx=0x7f29a002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ed8fb44f35a665 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.772+0000 7f29aa7fc640 1 -- 172.21.15.17:0/3163681430 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29a0037070 con 0x7f29ac095cb0 2024-09-13T23:08:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.772+0000 7f29aa7fc640 1 -- 172.21.15.17:0/3163681430 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a002ad90 con 0x7f29ac095cb0 2024-09-13T23:08:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.772+0000 7f29aa7fc640 1 -- 172.21.15.17:0/3163681430 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29a0032590 con 0x7f29ac095cb0 2024-09-13T23:08:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.773+0000 7f29b2103640 1 -- 172.21.15.17:0/3163681430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29ac095cb0 msgr2=0x7f29ac134250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.773+0000 7f29b2103640 1 --2- 172.21.15.17:0/3163681430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29ac095cb0 0x7f29ac134250 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f29a0009720 tx=0x7f29a002a110 comp rx=0 tx=0).stop 2024-09-13T23:08:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.773+0000 7f29b2103640 1 -- 172.21.15.17:0/3163681430 shutdown_connections 2024-09-13T23:08:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.773+0000 7f29b2103640 1 --2- 172.21.15.17:0/3163681430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29ac095cb0 0x7f29ac134250 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.773+0000 7f29b2103640 1 -- 172.21.15.17:0/3163681430 >> 172.21.15.17:0/3163681430 conn(0x7f29ac09b5c0 msgr2=0x7f29ac09b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.773+0000 7f29b2103640 1 -- 172.21.15.17:0/3163681430 shutdown_connections 2024-09-13T23:08:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.773+0000 7f29b2103640 1 -- 172.21.15.17:0/3163681430 wait complete. 2024-09-13T23:08:31.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.774+0000 7f29b2103640 1 Processor -- start 2024-09-13T23:08:31.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.774+0000 7f29b2103640 1 -- start start 2024-09-13T23:08:31.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.774+0000 7f29b2103640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29ac093c10 0x7f29ac1bfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:31.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.774+0000 7f29b2103640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac0960c0 con 0x7f29ac093c10 2024-09-13T23:08:31.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.774+0000 7f29ab7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29ac093c10 0x7f29ac1bfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:31.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.774+0000 7f29ab7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29ac093c10 0x7f29ac1bfda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39974/0 (socket says 172.21.15.17:39974) 2024-09-13T23:08:31.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.774+0000 7f29ab7fe640 1 -- 172.21.15.17:0/2032663712 learned_addr learned my addr 172.21.15.17:0/2032663712 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:08:31.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.775+0000 7f29ab7fe640 1 -- 172.21.15.17:0/2032663712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29ac1aa470 con 0x7f29ac093c10 2024-09-13T23:08:31.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.775+0000 7f29ab7fe640 1 --2- 172.21.15.17:0/2032663712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29ac093c10 0x7f29ac1bfda0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f299c00c370 tx=0x7f299c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:31.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.775+0000 7f2993fff640 1 -- 172.21.15.17:0/2032663712 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f299c007410 con 0x7f29ac093c10 2024-09-13T23:08:31.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.775+0000 7f2993fff640 1 -- 172.21.15.17:0/2032663712 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f299c0075d0 con 0x7f29ac093c10 2024-09-13T23:08:31.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.775+0000 7f29b2103640 1 -- 172.21.15.17:0/2032663712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29ac1a9800 con 0x7f29ac093c10 2024-09-13T23:08:31.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.775+0000 7f2993fff640 1 -- 172.21.15.17:0/2032663712 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f299c004950 con 0x7f29ac093c10 2024-09-13T23:08:31.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.775+0000 7f29b2103640 1 -- 172.21.15.17:0/2032663712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29ac1aaae0 con 0x7f29ac093c10 2024-09-13T23:08:31.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.776+0000 7f29b2103640 1 -- 172.21.15.17:0/2032663712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f29ac1a9050 con 0x7f29ac093c10 2024-09-13T23:08:31.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.776+0000 7f2993fff640 1 -- 172.21.15.17:0/2032663712 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f299c011070 con 0x7f29ac093c10 2024-09-13T23:08:31.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.776+0000 7f2993fff640 1 --2- 172.21.15.17:0/2032663712 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f29980382a0 0x7f299803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:31.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.776+0000 7f2993fff640 1 -- 172.21.15.17:0/2032663712 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f299c04b8e0 con 0x7f29ac093c10 2024-09-13T23:08:31.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.776+0000 7f2993fff640 1 --2- 172.21.15.17:0/2032663712 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f2998044710 0x7f2998046bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:31.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.776+0000 7f2993fff640 1 -- 172.21.15.17:0/2032663712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f299c009e50 con 0x7f2998044710 2024-09-13T23:08:31.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.776+0000 7f2993fff640 1 -- 172.21.15.17:0/2032663712 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f299c0502a0 con 0x7f29ac093c10 2024-09-13T23:08:31.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.776+0000 7f29abfff640 1 --2- 172.21.15.17:0/2032663712 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f2998044710 0x7f2998046bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:31.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.777+0000 7f29aaffd640 1 --2- 172.21.15.17:0/2032663712 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f29980382a0 0x7f299803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:31.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.777+0000 7f29abfff640 1 --2- 172.21.15.17:0/2032663712 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f2998044710 0x7f2998046bb0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:31.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.777+0000 7f29aaffd640 1 --2- 172.21.15.17:0/2032663712 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f29980382a0 0x7f299803a760 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f29a0034000 tx=0x7f29a002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:31.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.777+0000 7f2993fff640 1 -- 172.21.15.17:0/2032663712 <== osd.0 v2:172.21.15.17:6800/489863589 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f299c009e50 con 0x7f2998044710 2024-09-13T23:08:31.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.790+0000 7f29b2103640 1 -- 172.21.15.17:0/2032663712 --> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f29ac1aa830 con 0x7f2998044710 2024-09-13T23:08:31.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.790+0000 7f2993fff640 1 -- 172.21.15.17:0/2032663712 <== osd.0 v2:172.21.15.17:6800/489863589 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f29ac1aa830 con 0x7f2998044710 2024-09-13T23:08:31.792 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-13T23:08:31.792 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T23:08:31.792 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-13T23:08:31.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.791+0000 7f29b2103640 1 -- 172.21.15.17:0/2032663712 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f2998044710 msgr2=0x7f2998046bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:31.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.791+0000 7f29b2103640 1 --2- 172.21.15.17:0/2032663712 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f2998044710 0x7f2998046bb0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:31.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.791+0000 7f29b2103640 1 -- 172.21.15.17:0/2032663712 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f29980382a0 msgr2=0x7f299803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:31.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.791+0000 7f29b2103640 1 --2- 172.21.15.17:0/2032663712 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f29980382a0 0x7f299803a760 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f29a0034000 tx=0x7f29a002e000 comp rx=0 tx=0).stop 2024-09-13T23:08:31.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.791+0000 7f29b2103640 1 -- 172.21.15.17:0/2032663712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29ac093c10 msgr2=0x7f29ac1bfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:31.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.791+0000 7f29b2103640 1 --2- 172.21.15.17:0/2032663712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29ac093c10 0x7f29ac1bfda0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f299c00c370 tx=0x7f299c00c830 comp rx=0 tx=0).stop 2024-09-13T23:08:31.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.791+0000 7f29b2103640 1 -- 172.21.15.17:0/2032663712 shutdown_connections 2024-09-13T23:08:31.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.791+0000 7f29b2103640 1 --2- 172.21.15.17:0/2032663712 >> [v2:172.21.15.17:6800/489863589,v1:172.21.15.17:6801/489863589] conn(0x7f2998044710 0x7f2998046bb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:31.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.791+0000 7f29b2103640 1 --2- 172.21.15.17:0/2032663712 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f29980382a0 0x7f299803a760 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:31.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.791+0000 7f29b2103640 1 --2- 172.21.15.17:0/2032663712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29ac093c10 0x7f29ac1bfda0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:31.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.791+0000 7f29b2103640 1 -- 172.21.15.17:0/2032663712 >> 172.21.15.17:0/2032663712 conn(0x7f29ac09b5c0 msgr2=0x7f29ac06d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:31.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.791+0000 7f29b2103640 1 -- 172.21.15.17:0/2032663712 shutdown_connections 2024-09-13T23:08:31.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.791+0000 7f29b2103640 1 -- 172.21.15.17:0/2032663712 wait complete. 2024-09-13T23:08:31.803 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T23:08:31.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.904+0000 7fd7b7a27640 1 Processor -- start 2024-09-13T23:08:31.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.904+0000 7fd7b7a27640 1 -- start start 2024-09-13T23:08:31.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.904+0000 7fd7b7a27640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd7b006d080 0x7fd7b0096630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:31.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.904+0000 7fd7b7a27640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7b00702f0 con 0x7fd7b006d460 2024-09-13T23:08:31.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.904+0000 7fd7b7a27640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fd7b006f1f0 con 0x7fd7b006d080 2024-09-13T23:08:31.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.904+0000 7fd7b57c3640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd7b006d080 0x7fd7b0096630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:31.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.904+0000 7fd7b4fc2640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd7b006d460 0x7fd7b0130050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:52726/0 (socket says 172.21.15.17:52726) 2024-09-13T23:08:31.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.904+0000 7fd7b4fc2640 1 -- 172.21.15.17:0/1473580308 learned_addr learned my addr 172.21.15.17:0/1473580308 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:08:31.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.905+0000 7fd7b57c3640 1 -- 172.21.15.17:0/1473580308 >> v1:172.21.15.17:6789/0 conn(0x7fd7b006d460 legacy=0x7fd7b0130050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:31.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.905+0000 7fd7b57c3640 1 -- 172.21.15.17:0/1473580308 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b006fb80 con 0x7fd7b006d080 2024-09-13T23:08:31.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.905+0000 7fd7b57c3640 1 --2- 172.21.15.17:0/1473580308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7b006d080 0x7fd7b0096630 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac009720 tx=0x7fd7ac02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61c014fb8c446fb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:31.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.905+0000 7fd7a7fff640 1 -- 172.21.15.17:0/1473580308 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7ac037070 con 0x7fd7b006d080 2024-09-13T23:08:31.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.906+0000 7fd7a7fff640 1 -- 172.21.15.17:0/1473580308 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7ac02ae20 con 0x7fd7b006d080 2024-09-13T23:08:31.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.906+0000 7fd7a7fff640 1 -- 172.21.15.17:0/1473580308 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7ac032590 con 0x7fd7b006d080 2024-09-13T23:08:31.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.906+0000 7fd7b7a27640 1 -- 172.21.15.17:0/1473580308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7b006d080 msgr2=0x7fd7b0096630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:31.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.906+0000 7fd7b7a27640 1 --2- 172.21.15.17:0/1473580308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7b006d080 0x7fd7b0096630 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac009720 tx=0x7fd7ac02a1a0 comp rx=0 tx=0).stop 2024-09-13T23:08:31.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.906+0000 7fd7b7a27640 1 -- 172.21.15.17:0/1473580308 shutdown_connections 2024-09-13T23:08:31.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.906+0000 7fd7b7a27640 1 --2- 172.21.15.17:0/1473580308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7b006d080 0x7fd7b0096630 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:31.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.906+0000 7fd7b7a27640 1 -- 172.21.15.17:0/1473580308 >> 172.21.15.17:0/1473580308 conn(0x7fd7b009a890 msgr2=0x7fd7b009aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:31.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.906+0000 7fd7b7a27640 1 -- 172.21.15.17:0/1473580308 shutdown_connections 2024-09-13T23:08:31.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.906+0000 7fd7b7a27640 1 -- 172.21.15.17:0/1473580308 wait complete. 2024-09-13T23:08:31.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.907+0000 7fd7b7a27640 1 Processor -- start 2024-09-13T23:08:31.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.907+0000 7fd7b7a27640 1 -- start start 2024-09-13T23:08:31.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.907+0000 7fd7b7a27640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7b006d080 0x7fd7b0125c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:31.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.907+0000 7fd7b7a27640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b0096cf0 con 0x7fd7b006d080 2024-09-13T23:08:31.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.907+0000 7fd7b57c3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7b006d080 0x7fd7b0125c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:31.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.907+0000 7fd7b57c3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7b006d080 0x7fd7b0125c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39992/0 (socket says 172.21.15.17:39992) 2024-09-13T23:08:31.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.907+0000 7fd7b57c3640 1 -- 172.21.15.17:0/3925861652 learned_addr learned my addr 172.21.15.17:0/3925861652 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:08:31.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.908+0000 7fd7b57c3640 1 -- 172.21.15.17:0/3925861652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b006dbf0 con 0x7fd7b006d080 2024-09-13T23:08:31.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.908+0000 7fd7b57c3640 1 --2- 172.21.15.17:0/3925861652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7b006d080 0x7fd7b0125c00 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac02a1e0 tx=0x7fd7ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:31.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.908+0000 7fd7a5ffb640 1 -- 172.21.15.17:0/3925861652 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7ac042070 con 0x7fd7b006d080 2024-09-13T23:08:31.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.908+0000 7fd7a5ffb640 1 -- 172.21.15.17:0/3925861652 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7ac03e590 con 0x7fd7b006d080 2024-09-13T23:08:31.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.908+0000 7fd7a5ffb640 1 -- 172.21.15.17:0/3925861652 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7ac037040 con 0x7fd7b006d080 2024-09-13T23:08:31.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.908+0000 7fd7b7a27640 1 -- 172.21.15.17:0/3925861652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7b006e4f0 con 0x7fd7b006d080 2024-09-13T23:08:31.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.908+0000 7fd7b7a27640 1 -- 172.21.15.17:0/3925861652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7b0126140 con 0x7fd7b006d080 2024-09-13T23:08:31.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.909+0000 7fd7a5ffb640 1 -- 172.21.15.17:0/3925861652 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd7ac045070 con 0x7fd7b006d080 2024-09-13T23:08:31.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.909+0000 7fd7b7a27640 1 -- 172.21.15.17:0/3925861652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7b0096630 con 0x7fd7b006d080 2024-09-13T23:08:31.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.909+0000 7fd7a5ffb640 1 --2- 172.21.15.17:0/3925861652 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd7940382a0 0x7fd79403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:31.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.909+0000 7fd7a5ffb640 1 -- 172.21.15.17:0/3925861652 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd7ac06c8f0 con 0x7fd7b006d080 2024-09-13T23:08:31.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.910+0000 7fd7b4fc2640 1 --2- 172.21.15.17:0/3925861652 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd7940382a0 0x7fd79403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:31.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.910+0000 7fd7b4fc2640 1 --2- 172.21.15.17:0/3925861652 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd7940382a0 0x7fd79403a760 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0007fd0 tx=0x7fd7a0007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:31.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:31.914+0000 7fd7a5ffb640 1 -- 172.21.15.17:0/3925861652 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd7ac03c810 con 0x7fd7b006d080 2024-09-13T23:08:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.088+0000 7fd7b7a27640 1 -- 172.21.15.17:0/3925861652 --> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fd7b0128510 con 0x7fd7940382a0 2024-09-13T23:08:32.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.090+0000 7fd7a5ffb640 1 -- 172.21.15.17:0/3925861652 <== mgr.4102 v2:172.21.15.164:6824/713838566 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd7b0128510 con 0x7fd7940382a0 2024-09-13T23:08:32.090 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T23:08:32.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.091+0000 7fd7b7a27640 1 -- 172.21.15.17:0/3925861652 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd7940382a0 msgr2=0x7fd79403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.091+0000 7fd7b7a27640 1 --2- 172.21.15.17:0/3925861652 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd7940382a0 0x7fd79403a760 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0007fd0 tx=0x7fd7a0007ac0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.091+0000 7fd7b7a27640 1 -- 172.21.15.17:0/3925861652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7b006d080 msgr2=0x7fd7b0125c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.091+0000 7fd7b7a27640 1 --2- 172.21.15.17:0/3925861652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7b006d080 0x7fd7b0125c00 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac02a1e0 tx=0x7fd7ac0046c0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.091+0000 7fd7b7a27640 1 -- 172.21.15.17:0/3925861652 shutdown_connections 2024-09-13T23:08:32.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.091+0000 7fd7b7a27640 1 --2- 172.21.15.17:0/3925861652 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fd7940382a0 0x7fd79403a760 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.091+0000 7fd7b7a27640 1 --2- 172.21.15.17:0/3925861652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7b006d080 0x7fd7b0125c00 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.091+0000 7fd7b7a27640 1 -- 172.21.15.17:0/3925861652 >> 172.21.15.17:0/3925861652 conn(0x7fd7b009a890 msgr2=0x7fd7b0097eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:32.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.091+0000 7fd7b7a27640 1 -- 172.21.15.17:0/3925861652 shutdown_connections 2024-09-13T23:08:32.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.091+0000 7fd7b7a27640 1 -- 172.21.15.17:0/3925861652 wait complete. 2024-09-13T23:08:32.104 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T23:08:32.104 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T23:08:32.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.209+0000 7fa62a4af640 1 Processor -- start 2024-09-13T23:08:32.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.209+0000 7fa62a4af640 1 -- start start 2024-09-13T23:08:32.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.210+0000 7fa62a4af640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa624095cb0 0x7fa6240960c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:32.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.210+0000 7fa62a4af640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa624096960 con 0x7fa624093b70 2024-09-13T23:08:32.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.210+0000 7fa62a4af640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fa624093f50 con 0x7fa624095cb0 2024-09-13T23:08:32.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.210+0000 7fa6237fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa624095cb0 0x7fa6240960c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:32.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.210+0000 7fa623fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa624093b70 0x7fa6240955a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:52738/0 (socket says 172.21.15.17:52738) 2024-09-13T23:08:32.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.210+0000 7fa623fff640 1 -- 172.21.15.17:0/591053513 learned_addr learned my addr 172.21.15.17:0/591053513 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:08:32.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.210+0000 7fa6237fe640 1 -- 172.21.15.17:0/591053513 >> v1:172.21.15.17:6789/0 conn(0x7fa624093b70 legacy=0x7fa6240955a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.210+0000 7fa6237fe640 1 -- 172.21.15.17:0/591053513 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa624074dc0 con 0x7fa624095cb0 2024-09-13T23:08:32.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.210+0000 7fa622ffd640 1 -- 172.21.15.17:0/591053513 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4102070170 0 0) 0x7fa624096960 con 0x7fa624093b70 2024-09-13T23:08:32.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.211+0000 7fa6237fe640 1 --2- 172.21.15.17:0/591053513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa624095cb0 0x7fa6240960c0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fa618009720 tx=0x7fa61802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec4f05fabeeaae70 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:32.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.211+0000 7fa622ffd640 1 -- 172.21.15.17:0/591053513 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa618037070 con 0x7fa624095cb0 2024-09-13T23:08:32.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.211+0000 7fa622ffd640 1 -- 172.21.15.17:0/591053513 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa61802ad90 con 0x7fa624095cb0 2024-09-13T23:08:32.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.211+0000 7fa622ffd640 1 -- 172.21.15.17:0/591053513 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa618032590 con 0x7fa624095cb0 2024-09-13T23:08:32.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.211+0000 7fa62a4af640 1 -- 172.21.15.17:0/591053513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa624095cb0 msgr2=0x7fa6240960c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.211+0000 7fa62a4af640 1 --2- 172.21.15.17:0/591053513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa624095cb0 0x7fa6240960c0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fa618009720 tx=0x7fa61802a110 comp rx=0 tx=0).stop 2024-09-13T23:08:32.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.211+0000 7fa62a4af640 1 -- 172.21.15.17:0/591053513 shutdown_connections 2024-09-13T23:08:32.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.211+0000 7fa62a4af640 1 --2- 172.21.15.17:0/591053513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa624095cb0 0x7fa6240960c0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.211+0000 7fa62a4af640 1 -- 172.21.15.17:0/591053513 >> 172.21.15.17:0/591053513 conn(0x7fa62409b5c0 msgr2=0x7fa62409b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:32.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.212+0000 7fa62a4af640 1 -- 172.21.15.17:0/591053513 shutdown_connections 2024-09-13T23:08:32.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.212+0000 7fa62a4af640 1 -- 172.21.15.17:0/591053513 wait complete. 2024-09-13T23:08:32.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.212+0000 7fa62a4af640 1 Processor -- start 2024-09-13T23:08:32.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.213+0000 7fa62a4af640 1 -- start start 2024-09-13T23:08:32.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.213+0000 7fa62a4af640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa624093b70 0x7fa624122ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:32.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.213+0000 7fa62a4af640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa624134460 con 0x7fa624093b70 2024-09-13T23:08:32.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.213+0000 7fa623fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa624093b70 0x7fa624122ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:32.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.213+0000 7fa623fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa624093b70 0x7fa624122ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40006/0 (socket says 172.21.15.17:40006) 2024-09-13T23:08:32.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.213+0000 7fa623fff640 1 -- 172.21.15.17:0/1049824259 learned_addr learned my addr 172.21.15.17:0/1049824259 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:08:32.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.213+0000 7fa623fff640 1 -- 172.21.15.17:0/1049824259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa624124b90 con 0x7fa624093b70 2024-09-13T23:08:32.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.213+0000 7fa623fff640 1 --2- 172.21.15.17:0/1049824259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa624093b70 0x7fa624122ba0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fa61400c420 tx=0x7fa61400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:32.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.214+0000 7fa620ff9640 1 -- 172.21.15.17:0/1049824259 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa614018070 con 0x7fa624093b70 2024-09-13T23:08:32.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.214+0000 7fa620ff9640 1 -- 172.21.15.17:0/1049824259 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6140074d0 con 0x7fa624093b70 2024-09-13T23:08:32.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.214+0000 7fa62a4af640 1 -- 172.21.15.17:0/1049824259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6241255e0 con 0x7fa624093b70 2024-09-13T23:08:32.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.214+0000 7fa620ff9640 1 -- 172.21.15.17:0/1049824259 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa614004950 con 0x7fa624093b70 2024-09-13T23:08:32.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.214+0000 7fa62a4af640 1 -- 172.21.15.17:0/1049824259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6241232c0 con 0x7fa624093b70 2024-09-13T23:08:32.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.214+0000 7fa620ff9640 1 -- 172.21.15.17:0/1049824259 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa61401b070 con 0x7fa624093b70 2024-09-13T23:08:32.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.215+0000 7fa62a4af640 1 -- 172.21.15.17:0/1049824259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa6241244b0 con 0x7fa624093b70 2024-09-13T23:08:32.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.215+0000 7fa620ff9640 1 --2- 172.21.15.17:0/1049824259 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fa6100382a0 0x7fa61003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:32.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.215+0000 7fa620ff9640 1 -- 172.21.15.17:0/1049824259 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fa61404b0e0 con 0x7fa624093b70 2024-09-13T23:08:32.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.215+0000 7fa620ff9640 1 --2- 172.21.15.17:0/1049824259 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x7fa610044690 0x7fa610046b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:32.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.215+0000 7fa620ff9640 1 -- 172.21.15.17:0/1049824259 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa614017ec0 con 0x7fa610044690 2024-09-13T23:08:32.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.215+0000 7fa620ff9640 1 -- 172.21.15.17:0/1049824259 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa614052050 con 0x7fa624093b70 2024-09-13T23:08:32.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.215+0000 7fa6237fe640 1 --2- 172.21.15.17:0/1049824259 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fa6100382a0 0x7fa61003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:32.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.215+0000 7fa628a4c640 1 --2- 172.21.15.17:0/1049824259 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x7fa610044690 0x7fa610046b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:32.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.216+0000 7fa628a4c640 1 --2- 172.21.15.17:0/1049824259 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x7fa610044690 0x7fa610046b30 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:32.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.216+0000 7fa6237fe640 1 --2- 172.21.15.17:0/1049824259 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fa6100382a0 0x7fa61003a760 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa618034000 tx=0x7fa61802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:32.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.216+0000 7fa620ff9640 1 -- 172.21.15.17:0/1049824259 <== osd.1 v2:172.21.15.164:6800/4060509701 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa614017ec0 con 0x7fa610044690 2024-09-13T23:08:32.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.229+0000 7fa62a4af640 1 -- 172.21.15.17:0/1049824259 --> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa6241258c0 con 0x7fa610044690 2024-09-13T23:08:32.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.229+0000 7fa620ff9640 1 -- 172.21.15.17:0/1049824259 <== osd.1 v2:172.21.15.164:6800/4060509701 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa6241258c0 con 0x7fa610044690 2024-09-13T23:08:32.231 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-13T23:08:32.231 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T23:08:32.231 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-13T23:08:32.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.230+0000 7fa62a4af640 1 -- 172.21.15.17:0/1049824259 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x7fa610044690 msgr2=0x7fa610046b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.230+0000 7fa62a4af640 1 --2- 172.21.15.17:0/1049824259 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x7fa610044690 0x7fa610046b30 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.230+0000 7fa62a4af640 1 -- 172.21.15.17:0/1049824259 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fa6100382a0 msgr2=0x7fa61003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.230+0000 7fa62a4af640 1 --2- 172.21.15.17:0/1049824259 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fa6100382a0 0x7fa61003a760 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa618034000 tx=0x7fa61802e000 comp rx=0 tx=0).stop 2024-09-13T23:08:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.230+0000 7fa62a4af640 1 -- 172.21.15.17:0/1049824259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa624093b70 msgr2=0x7fa624122ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.230+0000 7fa62a4af640 1 --2- 172.21.15.17:0/1049824259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa624093b70 0x7fa624122ba0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fa61400c420 tx=0x7fa61400c8e0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.230+0000 7fa62a4af640 1 -- 172.21.15.17:0/1049824259 shutdown_connections 2024-09-13T23:08:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.230+0000 7fa62a4af640 1 --2- 172.21.15.17:0/1049824259 >> [v2:172.21.15.164:6800/4060509701,v1:172.21.15.164:6801/4060509701] conn(0x7fa610044690 0x7fa610046b30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.230+0000 7fa62a4af640 1 --2- 172.21.15.17:0/1049824259 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fa6100382a0 0x7fa61003a760 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.230+0000 7fa62a4af640 1 --2- 172.21.15.17:0/1049824259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa624093b70 0x7fa624122ba0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.230+0000 7fa62a4af640 1 -- 172.21.15.17:0/1049824259 >> 172.21.15.17:0/1049824259 conn(0x7fa62409b5c0 msgr2=0x7fa624098550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.230+0000 7fa62a4af640 1 -- 172.21.15.17:0/1049824259 shutdown_connections 2024-09-13T23:08:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.230+0000 7fa62a4af640 1 -- 172.21.15.17:0/1049824259 wait complete. 2024-09-13T23:08:32.242 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T23:08:32.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.342+0000 7f72f5ee6640 1 Processor -- start 2024-09-13T23:08:32.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.343+0000 7f72f5ee6640 1 -- start start 2024-09-13T23:08:32.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.343+0000 7f72f5ee6640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f72f009a100 0x7f72f0133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:32.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.343+0000 7f72f5ee6640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72f009d3b0 con 0x7f72f009bd50 2024-09-13T23:08:32.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.343+0000 7f72f5ee6640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f72f009c840 con 0x7f72f009a100 2024-09-13T23:08:32.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.343+0000 7f72eeffd640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f72f009a100 0x7f72f0133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:32.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.343+0000 7f72ef7fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f72f009bd50 0x7f72f009c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:57710/0 (socket says 172.21.15.17:57710) 2024-09-13T23:08:32.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.343+0000 7f72ef7fe640 1 -- 172.21.15.17:0/4157675745 learned_addr learned my addr 172.21.15.17:0/4157675745 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:08:32.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.343+0000 7f72eeffd640 1 -- 172.21.15.17:0/4157675745 >> v1:172.21.15.17:6789/0 conn(0x7f72f009bd50 legacy=0x7f72f009c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.343+0000 7f72eeffd640 1 -- 172.21.15.17:0/4157675745 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f0098230 con 0x7f72f009a100 2024-09-13T23:08:32.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.344+0000 7f72eeffd640 1 --2- 172.21.15.17:0/4157675745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72f009a100 0x7f72f0133da0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f72e4009720 tx=0x7f72e402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51981824ea5343fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:32.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.344+0000 7f72ee7fc640 1 -- 172.21.15.17:0/4157675745 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72e4037070 con 0x7f72f009a100 2024-09-13T23:08:32.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.344+0000 7f72ee7fc640 1 -- 172.21.15.17:0/4157675745 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e402ad90 con 0x7f72f009a100 2024-09-13T23:08:32.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.344+0000 7f72ee7fc640 1 -- 172.21.15.17:0/4157675745 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72e4032590 con 0x7f72f009a100 2024-09-13T23:08:32.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.345+0000 7f72f5ee6640 1 -- 172.21.15.17:0/4157675745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72f009a100 msgr2=0x7f72f0133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.345+0000 7f72f5ee6640 1 --2- 172.21.15.17:0/4157675745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72f009a100 0x7f72f0133da0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f72e4009720 tx=0x7f72e402a110 comp rx=0 tx=0).stop 2024-09-13T23:08:32.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.345+0000 7f72f5ee6640 1 -- 172.21.15.17:0/4157675745 shutdown_connections 2024-09-13T23:08:32.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.345+0000 7f72f5ee6640 1 --2- 172.21.15.17:0/4157675745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72f009a100 0x7f72f0133da0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.345+0000 7f72f5ee6640 1 -- 172.21.15.17:0/4157675745 >> 172.21.15.17:0/4157675745 conn(0x7f72f006d4a0 msgr2=0x7f72f006d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:32.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.345+0000 7f72f5ee6640 1 -- 172.21.15.17:0/4157675745 shutdown_connections 2024-09-13T23:08:32.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.345+0000 7f72f5ee6640 1 -- 172.21.15.17:0/4157675745 wait complete. 2024-09-13T23:08:32.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.346+0000 7f72f5ee6640 1 Processor -- start 2024-09-13T23:08:32.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.346+0000 7f72f5ee6640 1 -- start start 2024-09-13T23:08:32.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.346+0000 7f72f5ee6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72f009a100 0x7f72f01c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:32.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.346+0000 7f72f5ee6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f72f0134670 con 0x7f72f009a100 2024-09-13T23:08:32.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.346+0000 7f72ef7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72f009a100 0x7f72f01c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:32.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.346+0000 7f72ef7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72f009a100 0x7f72f01c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52090/0 (socket says 172.21.15.17:52090) 2024-09-13T23:08:32.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.346+0000 7f72ef7fe640 1 -- 172.21.15.17:0/1704059743 learned_addr learned my addr 172.21.15.17:0/1704059743 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:08:32.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.347+0000 7f72ef7fe640 1 -- 172.21.15.17:0/1704059743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f0125ee0 con 0x7f72f009a100 2024-09-13T23:08:32.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.347+0000 7f72ef7fe640 1 --2- 172.21.15.17:0/1704059743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72f009a100 0x7f72f01c3990 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f72e000c4a0 tx=0x7f72e000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:32.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.347+0000 7f72d7fff640 1 -- 172.21.15.17:0/1704059743 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72e0017070 con 0x7f72f009a100 2024-09-13T23:08:32.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.347+0000 7f72d7fff640 1 -- 172.21.15.17:0/1704059743 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e0005c10 con 0x7f72f009a100 2024-09-13T23:08:32.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.347+0000 7f72d7fff640 1 -- 172.21.15.17:0/1704059743 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72e0007070 con 0x7f72f009a100 2024-09-13T23:08:32.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.347+0000 7f72f5ee6640 1 -- 172.21.15.17:0/1704059743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f0095510 con 0x7f72f009a100 2024-09-13T23:08:32.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.347+0000 7f72f5ee6640 1 -- 172.21.15.17:0/1704059743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f00961a0 con 0x7f72f009a100 2024-09-13T23:08:32.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.348+0000 7f72d7fff640 1 -- 172.21.15.17:0/1704059743 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f72e001a070 con 0x7f72f009a100 2024-09-13T23:08:32.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.348+0000 7f72f5ee6640 1 -- 172.21.15.17:0/1704059743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72f0096490 con 0x7f72f009a100 2024-09-13T23:08:32.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.348+0000 7f72d7fff640 1 --2- 172.21.15.17:0/1704059743 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f72dc0382a0 0x7f72dc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:32.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.348+0000 7f72d7fff640 1 -- 172.21.15.17:0/1704059743 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f72e004aff0 con 0x7f72f009a100 2024-09-13T23:08:32.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.348+0000 7f72eeffd640 1 --2- 172.21.15.17:0/1704059743 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f72dc0382a0 0x7f72dc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:32.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.349+0000 7f72eeffd640 1 --2- 172.21.15.17:0/1704059743 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f72dc0382a0 0x7f72dc03a760 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f72e4034000 tx=0x7f72e402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:32.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.353+0000 7f72d7fff640 1 -- 172.21.15.17:0/1704059743 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f72f0096490 con 0x7f72f009a100 2024-09-13T23:08:32.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.527+0000 7f72f5ee6640 1 -- 172.21.15.17:0/1704059743 --> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f72f009a760 con 0x7f72dc0382a0 2024-09-13T23:08:32.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.528+0000 7f72d7fff640 1 -- 172.21.15.17:0/1704059743 <== mgr.4102 v2:172.21.15.164:6824/713838566 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f72e4032710 con 0x7f72dc0382a0 2024-09-13T23:08:32.530 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T23:08:32.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.530+0000 7f72f5ee6640 1 -- 172.21.15.17:0/1704059743 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f72dc0382a0 msgr2=0x7f72dc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.530+0000 7f72f5ee6640 1 --2- 172.21.15.17:0/1704059743 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f72dc0382a0 0x7f72dc03a760 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f72e4034000 tx=0x7f72e402e000 comp rx=0 tx=0).stop 2024-09-13T23:08:32.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.530+0000 7f72f5ee6640 1 -- 172.21.15.17:0/1704059743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72f009a100 msgr2=0x7f72f01c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.530+0000 7f72f5ee6640 1 --2- 172.21.15.17:0/1704059743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72f009a100 0x7f72f01c3990 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f72e000c4a0 tx=0x7f72e000c960 comp rx=0 tx=0).stop 2024-09-13T23:08:32.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.530+0000 7f72f5ee6640 1 -- 172.21.15.17:0/1704059743 shutdown_connections 2024-09-13T23:08:32.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.530+0000 7f72f5ee6640 1 --2- 172.21.15.17:0/1704059743 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f72dc0382a0 0x7f72dc03a760 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.530+0000 7f72f5ee6640 1 --2- 172.21.15.17:0/1704059743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72f009a100 0x7f72f01c3990 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.530+0000 7f72f5ee6640 1 -- 172.21.15.17:0/1704059743 >> 172.21.15.17:0/1704059743 conn(0x7f72f006d4a0 msgr2=0x7f72f0096af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:32.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.530+0000 7f72f5ee6640 1 -- 172.21.15.17:0/1704059743 shutdown_connections 2024-09-13T23:08:32.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.530+0000 7f72f5ee6640 1 -- 172.21.15.17:0/1704059743 wait complete. 2024-09-13T23:08:32.543 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T23:08:32.543 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T23:08:32.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.647+0000 7f5bd7152640 1 Processor -- start 2024-09-13T23:08:32.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.647+0000 7f5bd7152640 1 -- start start 2024-09-13T23:08:32.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.647+0000 7f5bd7152640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5bd006dbb0 0x7f5bd0131b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:32.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.647+0000 7f5bd7152640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bd0099260 con 0x7f5bd006d0c0 2024-09-13T23:08:32.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.647+0000 7f5bd7152640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f5bd0070670 con 0x7f5bd006dbb0 2024-09-13T23:08:32.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.648+0000 7f5bcffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5bd006dbb0 0x7f5bd0131b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:32.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.648+0000 7f5bcffff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5bd006dbb0 0x7f5bd0131b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52094/0 (socket says 172.21.15.17:52094) 2024-09-13T23:08:32.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.648+0000 7f5bcffff640 1 -- 172.21.15.17:0/2817624765 learned_addr learned my addr 172.21.15.17:0/2817624765 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:08:32.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.648+0000 7f5bd4eee640 1 --1- 172.21.15.17:0/2817624765 >> v1:172.21.15.17:6789/0 conn(0x7f5bd006d0c0 0x7f5bd006d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:57714/0 (socket says 172.21.15.17:57714) 2024-09-13T23:08:32.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.648+0000 7f5bcffff640 1 -- 172.21.15.17:0/2817624765 >> v1:172.21.15.17:6789/0 conn(0x7f5bd006d0c0 legacy=0x7f5bd006d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.648+0000 7f5bcffff640 1 -- 172.21.15.17:0/2817624765 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bd0071d70 con 0x7f5bd006dbb0 2024-09-13T23:08:32.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.649+0000 7f5bcffff640 1 --2- 172.21.15.17:0/2817624765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bd006dbb0 0x7f5bd0131b30 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4009820 tx=0x7f5bc402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1c75b9c4799ce6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:32.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.649+0000 7f5bcf7fe640 1 -- 172.21.15.17:0/2817624765 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bc4037070 con 0x7f5bd006dbb0 2024-09-13T23:08:32.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.649+0000 7f5bcf7fe640 1 -- 172.21.15.17:0/2817624765 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bc402ae50 con 0x7f5bd006dbb0 2024-09-13T23:08:32.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.649+0000 7f5bcf7fe640 1 -- 172.21.15.17:0/2817624765 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bc4032590 con 0x7f5bd006dbb0 2024-09-13T23:08:32.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.649+0000 7f5bd7152640 1 -- 172.21.15.17:0/2817624765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bd006dbb0 msgr2=0x7f5bd0131b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.649+0000 7f5bd7152640 1 --2- 172.21.15.17:0/2817624765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bd006dbb0 0x7f5bd0131b30 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4009820 tx=0x7f5bc402a210 comp rx=0 tx=0).stop 2024-09-13T23:08:32.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.649+0000 7f5bd7152640 1 -- 172.21.15.17:0/2817624765 shutdown_connections 2024-09-13T23:08:32.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.649+0000 7f5bd7152640 1 --2- 172.21.15.17:0/2817624765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bd006dbb0 0x7f5bd0131b30 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.649+0000 7f5bd7152640 1 -- 172.21.15.17:0/2817624765 >> 172.21.15.17:0/2817624765 conn(0x7f5bd00998b0 msgr2=0x7f5bd0099cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:32.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.649+0000 7f5bd7152640 1 -- 172.21.15.17:0/2817624765 shutdown_connections 2024-09-13T23:08:32.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.649+0000 7f5bd7152640 1 -- 172.21.15.17:0/2817624765 wait complete. 2024-09-13T23:08:32.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.650+0000 7f5bd7152640 1 Processor -- start 2024-09-13T23:08:32.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.650+0000 7f5bd7152640 1 -- start start 2024-09-13T23:08:32.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.651+0000 7f5bd7152640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bd006d0c0 0x7f5bd0093f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:32.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.651+0000 7f5bd7152640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd01321f0 con 0x7f5bd006d0c0 2024-09-13T23:08:32.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.651+0000 7f5bd4eee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bd006d0c0 0x7f5bd0093f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:32.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.651+0000 7f5bd4eee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bd006d0c0 0x7f5bd0093f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52100/0 (socket says 172.21.15.17:52100) 2024-09-13T23:08:32.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.651+0000 7f5bd4eee640 1 -- 172.21.15.17:0/808622829 learned_addr learned my addr 172.21.15.17:0/808622829 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:08:32.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.651+0000 7f5bd4eee640 1 -- 172.21.15.17:0/808622829 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bd0096430 con 0x7f5bd006d0c0 2024-09-13T23:08:32.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.651+0000 7f5bd4eee640 1 --2- 172.21.15.17:0/808622829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bd006d0c0 0x7f5bd0093f40 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f5bc000c450 tx=0x7f5bc000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:32.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.651+0000 7f5bcd7fa640 1 -- 172.21.15.17:0/808622829 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bc0007410 con 0x7f5bd006d0c0 2024-09-13T23:08:32.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.651+0000 7f5bcd7fa640 1 -- 172.21.15.17:0/808622829 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bc00075b0 con 0x7f5bd006d0c0 2024-09-13T23:08:32.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.651+0000 7f5bd7152640 1 -- 172.21.15.17:0/808622829 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bd0122220 con 0x7f5bd006d0c0 2024-09-13T23:08:32.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.651+0000 7f5bcd7fa640 1 -- 172.21.15.17:0/808622829 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bc0004910 con 0x7f5bd006d0c0 2024-09-13T23:08:32.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.652+0000 7f5bd7152640 1 -- 172.21.15.17:0/808622829 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bd0094660 con 0x7f5bd006d0c0 2024-09-13T23:08:32.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.652+0000 7f5bcd7fa640 1 -- 172.21.15.17:0/808622829 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5bc001a020 con 0x7f5bd006d0c0 2024-09-13T23:08:32.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.652+0000 7f5bd7152640 1 -- 172.21.15.17:0/808622829 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5bd00950a0 con 0x7f5bd006d0c0 2024-09-13T23:08:32.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.653+0000 7f5bcd7fa640 1 --2- 172.21.15.17:0/808622829 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5bbc0382a0 0x7f5bbc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:32.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.653+0000 7f5bcd7fa640 1 -- 172.21.15.17:0/808622829 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f5bc004b530 con 0x7f5bd006d0c0 2024-09-13T23:08:32.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.653+0000 7f5bcd7fa640 1 --2- 172.21.15.17:0/808622829 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f5bbc044710 0x7f5bbc046bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:32.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.653+0000 7f5bcd7fa640 1 -- 172.21.15.17:0/808622829 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5bbc047280 con 0x7f5bbc044710 2024-09-13T23:08:32.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.653+0000 7f5bcd7fa640 1 -- 172.21.15.17:0/808622829 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5bc0052050 con 0x7f5bd006d0c0 2024-09-13T23:08:32.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.653+0000 7f5bd56ef640 1 --2- 172.21.15.17:0/808622829 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f5bbc044710 0x7f5bbc046bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:32.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.653+0000 7f5bcffff640 1 --2- 172.21.15.17:0/808622829 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5bbc0382a0 0x7f5bbc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:32.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.654+0000 7f5bd56ef640 1 --2- 172.21.15.17:0/808622829 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f5bbc044710 0x7f5bbc046bb0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:32.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.654+0000 7f5bcffff640 1 --2- 172.21.15.17:0/808622829 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5bbc0382a0 0x7f5bbc03a760 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4034000 tx=0x7f5bc402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:32.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.654+0000 7f5bcd7fa640 1 -- 172.21.15.17:0/808622829 <== osd.2 v2:172.21.15.164:6808/3795914978 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5bbc047280 con 0x7f5bbc044710 2024-09-13T23:08:32.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.667+0000 7f5bd7152640 1 -- 172.21.15.17:0/808622829 --> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5bd0096760 con 0x7f5bbc044710 2024-09-13T23:08:32.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.667+0000 7f5bcd7fa640 1 -- 172.21.15.17:0/808622829 <== osd.2 v2:172.21.15.164:6808/3795914978 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5bd0096760 con 0x7f5bbc044710 2024-09-13T23:08:32.669 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-13T23:08:32.669 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T23:08:32.669 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-13T23:08:32.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.667+0000 7f5bd7152640 1 -- 172.21.15.17:0/808622829 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f5bbc044710 msgr2=0x7f5bbc046bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.668+0000 7f5bd7152640 1 --2- 172.21.15.17:0/808622829 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f5bbc044710 0x7f5bbc046bb0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.668+0000 7f5bd7152640 1 -- 172.21.15.17:0/808622829 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5bbc0382a0 msgr2=0x7f5bbc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.668+0000 7f5bd7152640 1 --2- 172.21.15.17:0/808622829 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5bbc0382a0 0x7f5bbc03a760 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4034000 tx=0x7f5bc402e000 comp rx=0 tx=0).stop 2024-09-13T23:08:32.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.668+0000 7f5bd7152640 1 -- 172.21.15.17:0/808622829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bd006d0c0 msgr2=0x7f5bd0093f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.668+0000 7f5bd7152640 1 --2- 172.21.15.17:0/808622829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bd006d0c0 0x7f5bd0093f40 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f5bc000c450 tx=0x7f5bc000c910 comp rx=0 tx=0).stop 2024-09-13T23:08:32.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.668+0000 7f5bd7152640 1 -- 172.21.15.17:0/808622829 shutdown_connections 2024-09-13T23:08:32.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.668+0000 7f5bd7152640 1 --2- 172.21.15.17:0/808622829 >> [v2:172.21.15.164:6808/3795914978,v1:172.21.15.164:6809/3795914978] conn(0x7f5bbc044710 0x7f5bbc046bb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.668+0000 7f5bd7152640 1 --2- 172.21.15.17:0/808622829 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f5bbc0382a0 0x7f5bbc03a760 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.668+0000 7f5bd7152640 1 --2- 172.21.15.17:0/808622829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bd006d0c0 0x7f5bd0093f40 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.668+0000 7f5bd7152640 1 -- 172.21.15.17:0/808622829 >> 172.21.15.17:0/808622829 conn(0x7f5bd00998b0 msgr2=0x7f5bd008cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:32.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.668+0000 7f5bd7152640 1 -- 172.21.15.17:0/808622829 shutdown_connections 2024-09-13T23:08:32.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.668+0000 7f5bd7152640 1 -- 172.21.15.17:0/808622829 wait complete. 2024-09-13T23:08:32.679 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T23:08:32.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.780+0000 7f788e391640 1 Processor -- start 2024-09-13T23:08:32.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.780+0000 7f788e391640 1 -- start start 2024-09-13T23:08:32.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.780+0000 7f788e391640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7888096a10 0x7f788806e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:32.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.780+0000 7f788e391640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78880702f0 con 0x7f7888096630 2024-09-13T23:08:32.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.780+0000 7f788e391640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f7888096e20 con 0x7f7888096a10 2024-09-13T23:08:32.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.781+0000 7f7887fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f7888096630 0x7f788806d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:57724/0 (socket says 172.21.15.17:57724) 2024-09-13T23:08:32.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.781+0000 7f7887fff640 1 -- 172.21.15.17:0/1096463301 learned_addr learned my addr 172.21.15.17:0/1096463301 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:08:32.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.781+0000 7f78877fe640 1 --2- 172.21.15.17:0/1096463301 >> v2:172.21.15.17:3300/0 conn(0x7f7888096a10 0x7f788806e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:32.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.781+0000 7f7886ffd640 1 -- 172.21.15.17:0/1096463301 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1971534490 0 0) 0x7f78880702f0 con 0x7f7888096630 2024-09-13T23:08:32.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.781+0000 7f7886ffd640 1 -- 172.21.15.17:0/1096463301 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7870003520 con 0x7f7888096630 2024-09-13T23:08:32.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.781+0000 7f78877fe640 1 -- 172.21.15.17:0/1096463301 >> v1:172.21.15.17:6789/0 conn(0x7f7888096630 legacy=0x7f788806d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.781+0000 7f78877fe640 1 -- 172.21.15.17:0/1096463301 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f788806f1f0 con 0x7f7888096a10 2024-09-13T23:08:32.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.782+0000 7f78877fe640 1 --2- 172.21.15.17:0/1096463301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7888096a10 0x7f788806e020 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f787c00a8c0 tx=0x7f787c02b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57beeaf90f6eb794 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:32.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.782+0000 7f7886ffd640 1 -- 172.21.15.17:0/1096463301 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f787c00b040 con 0x7f7888096a10 2024-09-13T23:08:32.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.782+0000 7f7886ffd640 1 -- 172.21.15.17:0/1096463301 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f787c030640 con 0x7f7888096a10 2024-09-13T23:08:32.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.782+0000 7f7886ffd640 1 -- 172.21.15.17:0/1096463301 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f787c030940 con 0x7f7888096a10 2024-09-13T23:08:32.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.782+0000 7f788e391640 1 -- 172.21.15.17:0/1096463301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7888096a10 msgr2=0x7f788806e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.782+0000 7f788e391640 1 --2- 172.21.15.17:0/1096463301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7888096a10 0x7f788806e020 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f787c00a8c0 tx=0x7f787c02b4d0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.782+0000 7f788e391640 1 -- 172.21.15.17:0/1096463301 shutdown_connections 2024-09-13T23:08:32.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.782+0000 7f788e391640 1 --2- 172.21.15.17:0/1096463301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7888096a10 0x7f788806e020 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.782+0000 7f788e391640 1 -- 172.21.15.17:0/1096463301 >> 172.21.15.17:0/1096463301 conn(0x7f788809a890 msgr2=0x7f788809aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:32.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.782+0000 7f788e391640 1 -- 172.21.15.17:0/1096463301 shutdown_connections 2024-09-13T23:08:32.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.782+0000 7f788e391640 1 -- 172.21.15.17:0/1096463301 wait complete. 2024-09-13T23:08:32.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.783+0000 7f788e391640 1 Processor -- start 2024-09-13T23:08:32.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.783+0000 7f788e391640 1 -- start start 2024-09-13T23:08:32.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.784+0000 7f788e391640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7888096630 0x7f7888128d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:32.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.784+0000 7f788e391640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f788806e6e0 con 0x7f7888096630 2024-09-13T23:08:32.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.784+0000 7f7887fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7888096630 0x7f7888128d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:32.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.784+0000 7f7887fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7888096630 0x7f7888128d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52116/0 (socket says 172.21.15.17:52116) 2024-09-13T23:08:32.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.784+0000 7f7887fff640 1 -- 172.21.15.17:0/3302609613 learned_addr learned my addr 172.21.15.17:0/3302609613 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:08:32.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.784+0000 7f7887fff640 1 -- 172.21.15.17:0/3302609613 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7888095b60 con 0x7f7888096630 2024-09-13T23:08:32.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.784+0000 7f7887fff640 1 --2- 172.21.15.17:0/3302609613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7888096630 0x7f7888128d00 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f787800c480 tx=0x7f787800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:32.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.785+0000 7f7884ff9640 1 -- 172.21.15.17:0/3302609613 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7878017070 con 0x7f7888096630 2024-09-13T23:08:32.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.785+0000 7f7884ff9640 1 -- 172.21.15.17:0/3302609613 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7878005c10 con 0x7f7888096630 2024-09-13T23:08:32.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.785+0000 7f788e391640 1 -- 172.21.15.17:0/3302609613 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7888125550 con 0x7f7888096630 2024-09-13T23:08:32.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.785+0000 7f7884ff9640 1 -- 172.21.15.17:0/3302609613 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7878007070 con 0x7f7888096630 2024-09-13T23:08:32.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.785+0000 7f788e391640 1 -- 172.21.15.17:0/3302609613 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7888129240 con 0x7f7888096630 2024-09-13T23:08:32.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.786+0000 7f7884ff9640 1 -- 172.21.15.17:0/3302609613 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f787801a070 con 0x7f7888096630 2024-09-13T23:08:32.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.786+0000 7f788e391640 1 -- 172.21.15.17:0/3302609613 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f788806d080 con 0x7f7888096630 2024-09-13T23:08:32.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.786+0000 7f7884ff9640 1 --2- 172.21.15.17:0/3302609613 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f78740382a0 0x7f787403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:32.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.786+0000 7f7884ff9640 1 -- 172.21.15.17:0/3302609613 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f787804b0d0 con 0x7f7888096630 2024-09-13T23:08:32.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.786+0000 7f78877fe640 1 --2- 172.21.15.17:0/3302609613 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f78740382a0 0x7f787403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:32.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.787+0000 7f78877fe640 1 --2- 172.21.15.17:0/3302609613 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f78740382a0 0x7f787403a760 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f787c035000 tx=0x7f787c030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:32.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.791+0000 7f7884ff9640 1 -- 172.21.15.17:0/3302609613 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f787801b7b0 con 0x7f7888096630 2024-09-13T23:08:32.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.967+0000 7f788e391640 1 -- 172.21.15.17:0/3302609613 --> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f7888072ea0 con 0x7f78740382a0 2024-09-13T23:08:32.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.968+0000 7f7884ff9640 1 -- 172.21.15.17:0/3302609613 <== mgr.4102 v2:172.21.15.164:6824/713838566 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7888072ea0 con 0x7f78740382a0 2024-09-13T23:08:32.970 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T23:08:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.970+0000 7f788e391640 1 -- 172.21.15.17:0/3302609613 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f78740382a0 msgr2=0x7f787403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.970+0000 7f788e391640 1 --2- 172.21.15.17:0/3302609613 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f78740382a0 0x7f787403a760 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f787c035000 tx=0x7f787c030000 comp rx=0 tx=0).stop 2024-09-13T23:08:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.970+0000 7f788e391640 1 -- 172.21.15.17:0/3302609613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7888096630 msgr2=0x7f7888128d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.970+0000 7f788e391640 1 --2- 172.21.15.17:0/3302609613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7888096630 0x7f7888128d00 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f787800c480 tx=0x7f787800c940 comp rx=0 tx=0).stop 2024-09-13T23:08:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.970+0000 7f788e391640 1 -- 172.21.15.17:0/3302609613 shutdown_connections 2024-09-13T23:08:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.970+0000 7f788e391640 1 --2- 172.21.15.17:0/3302609613 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f78740382a0 0x7f787403a760 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.970+0000 7f788e391640 1 --2- 172.21.15.17:0/3302609613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7888096630 0x7f7888128d00 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.970+0000 7f788e391640 1 -- 172.21.15.17:0/3302609613 >> 172.21.15.17:0/3302609613 conn(0x7f788809a890 msgr2=0x7f7888097390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.970+0000 7f788e391640 1 -- 172.21.15.17:0/3302609613 shutdown_connections 2024-09-13T23:08:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:32.970+0000 7f788e391640 1 -- 172.21.15.17:0/3302609613 wait complete. 2024-09-13T23:08:32.982 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T23:08:32.983 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T23:08:33.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.086+0000 7efda1c8d640 1 Processor -- start 2024-09-13T23:08:33.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.086+0000 7efda1c8d640 1 -- start start 2024-09-13T23:08:33.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.087+0000 7efda1c8d640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7efd9c0949b0 0x7efd9c094d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:33.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.087+0000 7efda1c8d640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd9c097300 con 0x7efd9c0952d0 2024-09-13T23:08:33.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.087+0000 7efda1c8d640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7efd9c0970d0 con 0x7efd9c0949b0 2024-09-13T23:08:33.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.087+0000 7efd9b7fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7efd9c0949b0 0x7efd9c094d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:33.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.087+0000 7efd9affd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7efd9c0952d0 0x7efd9c12c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:57732/0 (socket says 172.21.15.17:57732) 2024-09-13T23:08:33.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.087+0000 7efd9affd640 1 -- 172.21.15.17:0/1712737330 learned_addr learned my addr 172.21.15.17:0/1712737330 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:08:33.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.087+0000 7efd9b7fe640 1 -- 172.21.15.17:0/1712737330 >> v1:172.21.15.17:6789/0 conn(0x7efd9c0952d0 legacy=0x7efd9c12c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:33.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.087+0000 7efd9b7fe640 1 -- 172.21.15.17:0/1712737330 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9c095700 con 0x7efd9c0949b0 2024-09-13T23:08:33.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.088+0000 7efd9b7fe640 1 --2- 172.21.15.17:0/1712737330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd9c0949b0 0x7efd9c094d90 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7efd8c009720 tx=0x7efd8c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a96ef41dc1006403 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:33.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.088+0000 7efd9a7fc640 1 -- 172.21.15.17:0/1712737330 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd8c037070 con 0x7efd9c0949b0 2024-09-13T23:08:33.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.088+0000 7efd9a7fc640 1 -- 172.21.15.17:0/1712737330 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd8c02ad90 con 0x7efd9c0949b0 2024-09-13T23:08:33.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.088+0000 7efd9a7fc640 1 -- 172.21.15.17:0/1712737330 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd8c032590 con 0x7efd9c0949b0 2024-09-13T23:08:33.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.089+0000 7efda1c8d640 1 -- 172.21.15.17:0/1712737330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd9c0949b0 msgr2=0x7efd9c094d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:33.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.089+0000 7efda1c8d640 1 --2- 172.21.15.17:0/1712737330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd9c0949b0 0x7efd9c094d90 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7efd8c009720 tx=0x7efd8c02a110 comp rx=0 tx=0).stop 2024-09-13T23:08:33.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.089+0000 7efda1c8d640 1 -- 172.21.15.17:0/1712737330 shutdown_connections 2024-09-13T23:08:33.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.089+0000 7efda1c8d640 1 --2- 172.21.15.17:0/1712737330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd9c0949b0 0x7efd9c094d90 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.089+0000 7efda1c8d640 1 -- 172.21.15.17:0/1712737330 >> 172.21.15.17:0/1712737330 conn(0x7efd9c09d2f0 msgr2=0x7efd9c09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:33.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.089+0000 7efda1c8d640 1 -- 172.21.15.17:0/1712737330 shutdown_connections 2024-09-13T23:08:33.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.089+0000 7efda1c8d640 1 -- 172.21.15.17:0/1712737330 wait complete. 2024-09-13T23:08:33.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.089+0000 7efda1c8d640 1 Processor -- start 2024-09-13T23:08:33.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.090+0000 7efda1c8d640 1 -- start start 2024-09-13T23:08:33.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.090+0000 7efda1c8d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd9c0949b0 0x7efd9c1c1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:33.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.090+0000 7efda1c8d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c12d0d0 con 0x7efd9c0949b0 2024-09-13T23:08:33.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.090+0000 7efd9b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd9c0949b0 0x7efd9c1c1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:33.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.090+0000 7efd9b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd9c0949b0 0x7efd9c1c1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52140/0 (socket says 172.21.15.17:52140) 2024-09-13T23:08:33.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.090+0000 7efd9b7fe640 1 -- 172.21.15.17:0/1398570952 learned_addr learned my addr 172.21.15.17:0/1398570952 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:08:33.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.090+0000 7efd9b7fe640 1 -- 172.21.15.17:0/1398570952 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9c125d80 con 0x7efd9c0949b0 2024-09-13T23:08:33.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.091+0000 7efd9b7fe640 1 --2- 172.21.15.17:0/1398570952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd9c0949b0 0x7efd9c1c1680 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7efd8c02ad60 tx=0x7efd8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:33.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.091+0000 7efd83fff640 1 -- 172.21.15.17:0/1398570952 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd8c041020 con 0x7efd9c0949b0 2024-09-13T23:08:33.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.091+0000 7efd83fff640 1 -- 172.21.15.17:0/1398570952 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd8c03d550 con 0x7efd9c0949b0 2024-09-13T23:08:33.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.091+0000 7efda1c8d640 1 -- 172.21.15.17:0/1398570952 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd9c126f40 con 0x7efd9c0949b0 2024-09-13T23:08:33.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.091+0000 7efd83fff640 1 -- 172.21.15.17:0/1398570952 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd8c037040 con 0x7efd9c0949b0 2024-09-13T23:08:33.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.091+0000 7efda1c8d640 1 -- 172.21.15.17:0/1398570952 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd9c08b370 con 0x7efd9c0949b0 2024-09-13T23:08:33.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.092+0000 7efda1c8d640 1 -- 172.21.15.17:0/1398570952 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efd9c094d90 con 0x7efd9c0949b0 2024-09-13T23:08:33.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.092+0000 7efd83fff640 1 -- 172.21.15.17:0/1398570952 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7efd8c044020 con 0x7efd9c0949b0 2024-09-13T23:08:33.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.092+0000 7efd83fff640 1 --2- 172.21.15.17:0/1398570952 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efd880382a0 0x7efd8803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:33.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.092+0000 7efd83fff640 1 -- 172.21.15.17:0/1398570952 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7efd8c06c330 con 0x7efd9c0949b0 2024-09-13T23:08:33.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.092+0000 7efd83fff640 1 --2- 172.21.15.17:0/1398570952 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x7efd88044710 0x7efd88046bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:33.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.092+0000 7efd83fff640 1 -- 172.21.15.17:0/1398570952 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd8c02ad90 con 0x7efd88044710 2024-09-13T23:08:33.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.092+0000 7efd83fff640 1 -- 172.21.15.17:0/1398570952 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7efd8c073050 con 0x7efd9c0949b0 2024-09-13T23:08:33.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.092+0000 7efd9affd640 1 --2- 172.21.15.17:0/1398570952 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efd880382a0 0x7efd8803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:33.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.092+0000 7efd9bfff640 1 --2- 172.21.15.17:0/1398570952 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x7efd88044710 0x7efd88046bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:33.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.093+0000 7efd9affd640 1 --2- 172.21.15.17:0/1398570952 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efd880382a0 0x7efd8803a760 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7efd90007fd0 tx=0x7efd90007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:33.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.093+0000 7efd9bfff640 1 --2- 172.21.15.17:0/1398570952 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x7efd88044710 0x7efd88046bb0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:33.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.094+0000 7efd83fff640 1 -- 172.21.15.17:0/1398570952 <== osd.3 v2:172.21.15.164:6816/93809510 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efd8c02ad90 con 0x7efd88044710 2024-09-13T23:08:33.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.107+0000 7efda1c8d640 1 -- 172.21.15.17:0/1398570952 --> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7efd9c074990 con 0x7efd88044710 2024-09-13T23:08:33.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.107+0000 7efd83fff640 1 -- 172.21.15.17:0/1398570952 <== osd.3 v2:172.21.15.164:6816/93809510 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7efd9c074990 con 0x7efd88044710 2024-09-13T23:08:33.109 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-13T23:08:33.109 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T23:08:33.109 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-13T23:08:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.107+0000 7efda1c8d640 1 -- 172.21.15.17:0/1398570952 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x7efd88044710 msgr2=0x7efd88046bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.107+0000 7efda1c8d640 1 --2- 172.21.15.17:0/1398570952 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x7efd88044710 0x7efd88046bb0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.107+0000 7efda1c8d640 1 -- 172.21.15.17:0/1398570952 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efd880382a0 msgr2=0x7efd8803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.107+0000 7efda1c8d640 1 --2- 172.21.15.17:0/1398570952 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efd880382a0 0x7efd8803a760 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7efd90007fd0 tx=0x7efd90007ac0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.107+0000 7efda1c8d640 1 -- 172.21.15.17:0/1398570952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd9c0949b0 msgr2=0x7efd9c1c1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.107+0000 7efda1c8d640 1 --2- 172.21.15.17:0/1398570952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd9c0949b0 0x7efd9c1c1680 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7efd8c02ad60 tx=0x7efd8c0046c0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.107+0000 7efda1c8d640 1 -- 172.21.15.17:0/1398570952 shutdown_connections 2024-09-13T23:08:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.107+0000 7efda1c8d640 1 --2- 172.21.15.17:0/1398570952 >> [v2:172.21.15.164:6816/93809510,v1:172.21.15.164:6817/93809510] conn(0x7efd88044710 0x7efd88046bb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.107+0000 7efda1c8d640 1 --2- 172.21.15.17:0/1398570952 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7efd880382a0 0x7efd8803a760 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.107+0000 7efda1c8d640 1 --2- 172.21.15.17:0/1398570952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd9c0949b0 0x7efd9c1c1680 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.107+0000 7efda1c8d640 1 -- 172.21.15.17:0/1398570952 >> 172.21.15.17:0/1398570952 conn(0x7efd9c09d2f0 msgr2=0x7efd9c129200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.108+0000 7efda1c8d640 1 -- 172.21.15.17:0/1398570952 shutdown_connections 2024-09-13T23:08:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.108+0000 7efda1c8d640 1 -- 172.21.15.17:0/1398570952 wait complete. 2024-09-13T23:08:33.119 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T23:08:33.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.219+0000 7f48782ba640 1 Processor -- start 2024-09-13T23:08:33.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.219+0000 7f48782ba640 1 -- start start 2024-09-13T23:08:33.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.220+0000 7f48782ba640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f487009a100 0x7f4870133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:33.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.220+0000 7f48782ba640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f487009d3b0 con 0x7f487009bd50 2024-09-13T23:08:33.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.220+0000 7f48782ba640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f487009c840 con 0x7f487009a100 2024-09-13T23:08:33.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.220+0000 7f4875855640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f487009a100 0x7f4870133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:33.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.220+0000 7f4876056640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f487009bd50 0x7f487009c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:57734/0 (socket says 172.21.15.17:57734) 2024-09-13T23:08:33.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.220+0000 7f4875855640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f487009a100 0x7f4870133da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52156/0 (socket says 172.21.15.17:52156) 2024-09-13T23:08:33.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.220+0000 7f4876056640 1 -- 172.21.15.17:0/83068957 learned_addr learned my addr 172.21.15.17:0/83068957 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:08:33.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.220+0000 7f4875855640 1 -- 172.21.15.17:0/83068957 >> v1:172.21.15.17:6789/0 conn(0x7f487009bd50 legacy=0x7f487009c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:33.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.220+0000 7f4875855640 1 -- 172.21.15.17:0/83068957 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4870098230 con 0x7f487009a100 2024-09-13T23:08:33.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.221+0000 7f4875855640 1 --2- 172.21.15.17:0/83068957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f487009a100 0x7f4870133da0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f4864009720 tx=0x7f486402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd45785962adf96b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:33.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.221+0000 7f4875054640 1 -- 172.21.15.17:0/83068957 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4864037070 con 0x7f487009a100 2024-09-13T23:08:33.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.221+0000 7f4875054640 1 -- 172.21.15.17:0/83068957 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f486402ad90 con 0x7f487009a100 2024-09-13T23:08:33.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.221+0000 7f4875054640 1 -- 172.21.15.17:0/83068957 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4864032590 con 0x7f487009a100 2024-09-13T23:08:33.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.221+0000 7f48782ba640 1 -- 172.21.15.17:0/83068957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f487009a100 msgr2=0x7f4870133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:33.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.221+0000 7f48782ba640 1 --2- 172.21.15.17:0/83068957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f487009a100 0x7f4870133da0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f4864009720 tx=0x7f486402a110 comp rx=0 tx=0).stop 2024-09-13T23:08:33.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.222+0000 7f48782ba640 1 -- 172.21.15.17:0/83068957 shutdown_connections 2024-09-13T23:08:33.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.222+0000 7f48782ba640 1 --2- 172.21.15.17:0/83068957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f487009a100 0x7f4870133da0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.222+0000 7f48782ba640 1 -- 172.21.15.17:0/83068957 >> 172.21.15.17:0/83068957 conn(0x7f487006d4a0 msgr2=0x7f487006d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:33.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.222+0000 7f48782ba640 1 -- 172.21.15.17:0/83068957 shutdown_connections 2024-09-13T23:08:33.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.222+0000 7f48782ba640 1 -- 172.21.15.17:0/83068957 wait complete. 2024-09-13T23:08:33.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.222+0000 7f48782ba640 1 Processor -- start 2024-09-13T23:08:33.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.222+0000 7f48782ba640 1 -- start start 2024-09-13T23:08:33.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.223+0000 7f48782ba640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f487009a100 0x7f48701c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:33.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.223+0000 7f48782ba640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4870134670 con 0x7f487009a100 2024-09-13T23:08:33.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.223+0000 7f4876056640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f487009a100 0x7f48701c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:33.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.223+0000 7f4876056640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f487009a100 0x7f48701c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52164/0 (socket says 172.21.15.17:52164) 2024-09-13T23:08:33.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.223+0000 7f4876056640 1 -- 172.21.15.17:0/2567362174 learned_addr learned my addr 172.21.15.17:0/2567362174 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:08:33.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.223+0000 7f4876056640 1 -- 172.21.15.17:0/2567362174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4870125ee0 con 0x7f487009a100 2024-09-13T23:08:33.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.223+0000 7f4876056640 1 --2- 172.21.15.17:0/2567362174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f487009a100 0x7f48701c3990 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f486800c4a0 tx=0x7f486800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:33.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.223+0000 7f486effd640 1 -- 172.21.15.17:0/2567362174 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4868017070 con 0x7f487009a100 2024-09-13T23:08:33.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.223+0000 7f486effd640 1 -- 172.21.15.17:0/2567362174 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4868005c10 con 0x7f487009a100 2024-09-13T23:08:33.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.224+0000 7f48782ba640 1 -- 172.21.15.17:0/2567362174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4870095510 con 0x7f487009a100 2024-09-13T23:08:33.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.224+0000 7f486effd640 1 -- 172.21.15.17:0/2567362174 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4868007070 con 0x7f487009a100 2024-09-13T23:08:33.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.224+0000 7f48782ba640 1 -- 172.21.15.17:0/2567362174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48700961a0 con 0x7f487009a100 2024-09-13T23:08:33.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.224+0000 7f486effd640 1 -- 172.21.15.17:0/2567362174 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f486801a070 con 0x7f487009a100 2024-09-13T23:08:33.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.224+0000 7f48782ba640 1 -- 172.21.15.17:0/2567362174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4870096490 con 0x7f487009a100 2024-09-13T23:08:33.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.225+0000 7f486effd640 1 --2- 172.21.15.17:0/2567362174 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f485c0382a0 0x7f485c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:33.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.225+0000 7f486effd640 1 -- 172.21.15.17:0/2567362174 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f486804b0b0 con 0x7f487009a100 2024-09-13T23:08:33.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.225+0000 7f4875855640 1 --2- 172.21.15.17:0/2567362174 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f485c0382a0 0x7f485c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:33.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.225+0000 7f4875855640 1 --2- 172.21.15.17:0/2567362174 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f485c0382a0 0x7f485c03a760 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4864034000 tx=0x7f486402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:33.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.229+0000 7f486effd640 1 -- 172.21.15.17:0/2567362174 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4870096490 con 0x7f487009a100 2024-09-13T23:08:33.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.407+0000 7f48782ba640 1 -- 172.21.15.17:0/2567362174 --> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f487009a760 con 0x7f485c0382a0 2024-09-13T23:08:33.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.408+0000 7f486effd640 1 -- 172.21.15.17:0/2567362174 <== mgr.4102 v2:172.21.15.164:6824/713838566 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4864032710 con 0x7f485c0382a0 2024-09-13T23:08:33.410 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T23:08:33.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.410+0000 7f48782ba640 1 -- 172.21.15.17:0/2567362174 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f485c0382a0 msgr2=0x7f485c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:33.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.410+0000 7f48782ba640 1 --2- 172.21.15.17:0/2567362174 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f485c0382a0 0x7f485c03a760 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4864034000 tx=0x7f486402e000 comp rx=0 tx=0).stop 2024-09-13T23:08:33.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.410+0000 7f48782ba640 1 -- 172.21.15.17:0/2567362174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f487009a100 msgr2=0x7f48701c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:33.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.410+0000 7f48782ba640 1 --2- 172.21.15.17:0/2567362174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f487009a100 0x7f48701c3990 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f486800c4a0 tx=0x7f486800c960 comp rx=0 tx=0).stop 2024-09-13T23:08:33.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.410+0000 7f48782ba640 1 -- 172.21.15.17:0/2567362174 shutdown_connections 2024-09-13T23:08:33.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.410+0000 7f48782ba640 1 --2- 172.21.15.17:0/2567362174 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f485c0382a0 0x7f485c03a760 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.410+0000 7f48782ba640 1 --2- 172.21.15.17:0/2567362174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f487009a100 0x7f48701c3990 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.410+0000 7f48782ba640 1 -- 172.21.15.17:0/2567362174 >> 172.21.15.17:0/2567362174 conn(0x7f487006d4a0 msgr2=0x7f4870096af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:33.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.410+0000 7f48782ba640 1 -- 172.21.15.17:0/2567362174 shutdown_connections 2024-09-13T23:08:33.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.410+0000 7f48782ba640 1 -- 172.21.15.17:0/2567362174 wait complete. 2024-09-13T23:08:33.422 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T23:08:33.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.521+0000 7fb111566640 1 Processor -- start 2024-09-13T23:08:33.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.521+0000 7fb111566640 1 -- start start 2024-09-13T23:08:33.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.521+0000 7fb111566640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb10c12e940 0x7fb10c130d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:33.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.521+0000 7fb111566640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb10c06eba0 con 0x7fb10c06eda0 2024-09-13T23:08:33.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.521+0000 7fb111566640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fb10c06d2f0 con 0x7fb10c12e940 2024-09-13T23:08:33.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.521+0000 7fb10a7fc640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb10c12e940 0x7fb10c130d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:33.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.521+0000 7fb10affd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb10c06eda0 0x7fb10c06f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:57740/0 (socket says 172.21.15.17:57740) 2024-09-13T23:08:33.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.521+0000 7fb10affd640 1 -- 172.21.15.17:0/1525732823 learned_addr learned my addr 172.21.15.17:0/1525732823 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:08:33.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.522+0000 7fb10a7fc640 1 -- 172.21.15.17:0/1525732823 >> v1:172.21.15.17:6789/0 conn(0x7fb10c06eda0 legacy=0x7fb10c06f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:33.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.522+0000 7fb10a7fc640 1 -- 172.21.15.17:0/1525732823 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb10c070d50 con 0x7fb10c12e940 2024-09-13T23:08:33.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.522+0000 7fb10a7fc640 1 --2- 172.21.15.17:0/1525732823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb10c12e940 0x7fb10c130d30 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fb100009720 tx=0x7fb10002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd643f8b0b8296e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:33.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.522+0000 7fb109ffb640 1 -- 172.21.15.17:0/1525732823 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb100037070 con 0x7fb10c12e940 2024-09-13T23:08:33.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.522+0000 7fb109ffb640 1 -- 172.21.15.17:0/1525732823 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb10002ae20 con 0x7fb10c12e940 2024-09-13T23:08:33.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.522+0000 7fb109ffb640 1 -- 172.21.15.17:0/1525732823 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb100032590 con 0x7fb10c12e940 2024-09-13T23:08:33.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.523+0000 7fb111566640 1 -- 172.21.15.17:0/1525732823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb10c12e940 msgr2=0x7fb10c130d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:33.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.523+0000 7fb111566640 1 --2- 172.21.15.17:0/1525732823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb10c12e940 0x7fb10c130d30 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fb100009720 tx=0x7fb10002a1a0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.523+0000 7fb111566640 1 -- 172.21.15.17:0/1525732823 shutdown_connections 2024-09-13T23:08:33.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.523+0000 7fb111566640 1 --2- 172.21.15.17:0/1525732823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb10c12e940 0x7fb10c130d30 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.523+0000 7fb111566640 1 -- 172.21.15.17:0/1525732823 >> 172.21.15.17:0/1525732823 conn(0x7fb10c09a890 msgr2=0x7fb10c09aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:33.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.523+0000 7fb111566640 1 -- 172.21.15.17:0/1525732823 shutdown_connections 2024-09-13T23:08:33.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.523+0000 7fb111566640 1 -- 172.21.15.17:0/1525732823 wait complete. 2024-09-13T23:08:33.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.524+0000 7fb111566640 1 Processor -- start 2024-09-13T23:08:33.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.524+0000 7fb111566640 1 -- start start 2024-09-13T23:08:33.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.524+0000 7fb111566640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb10c06eda0 0x7fb10c0968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:33.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.524+0000 7fb111566640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb10c06fcd0 con 0x7fb10c06eda0 2024-09-13T23:08:33.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.524+0000 7fb10affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb10c06eda0 0x7fb10c0968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:33.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.524+0000 7fb10affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb10c06eda0 0x7fb10c0968f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52172/0 (socket says 172.21.15.17:52172) 2024-09-13T23:08:33.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.524+0000 7fb10affd640 1 -- 172.21.15.17:0/157293920 learned_addr learned my addr 172.21.15.17:0/157293920 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:08:33.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.525+0000 7fb10affd640 1 -- 172.21.15.17:0/157293920 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb10c06dbb0 con 0x7fb10c06eda0 2024-09-13T23:08:33.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.525+0000 7fb10affd640 1 --2- 172.21.15.17:0/157293920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb10c06eda0 0x7fb10c0968f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00c380 tx=0x7fb0fc00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:33.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.525+0000 7fb0f37fe640 1 -- 172.21.15.17:0/157293920 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0fc005c10 con 0x7fb10c06eda0 2024-09-13T23:08:33.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.525+0000 7fb0f37fe640 1 -- 172.21.15.17:0/157293920 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0fc005db0 con 0x7fb10c06eda0 2024-09-13T23:08:33.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.525+0000 7fb111566640 1 -- 172.21.15.17:0/157293920 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb10c125d80 con 0x7fb10c06eda0 2024-09-13T23:08:33.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.525+0000 7fb0f37fe640 1 -- 172.21.15.17:0/157293920 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0fc004930 con 0x7fb10c06eda0 2024-09-13T23:08:33.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.525+0000 7fb111566640 1 -- 172.21.15.17:0/157293920 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb10c096e30 con 0x7fb10c06eda0 2024-09-13T23:08:33.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.526+0000 7fb0f37fe640 1 -- 172.21.15.17:0/157293920 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb0fc01a020 con 0x7fb10c06eda0 2024-09-13T23:08:33.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.526+0000 7fb0f37fe640 1 --2- 172.21.15.17:0/157293920 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb0f80382a0 0x7fb0f803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:33.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.526+0000 7fb111566640 1 -- 172.21.15.17:0/157293920 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb10c070fc0 con 0x7fb10c06eda0 2024-09-13T23:08:33.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.526+0000 7fb0f37fe640 1 -- 172.21.15.17:0/157293920 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb0fc04b600 con 0x7fb10c06eda0 2024-09-13T23:08:33.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.526+0000 7fb10a7fc640 1 --2- 172.21.15.17:0/157293920 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb0f80382a0 0x7fb0f803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:33.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.527+0000 7fb10a7fc640 1 --2- 172.21.15.17:0/157293920 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb0f80382a0 0x7fb0f803a760 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb100034000 tx=0x7fb10002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:33.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.531+0000 7fb0f37fe640 1 -- 172.21.15.17:0/157293920 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb0fc0127f0 con 0x7fb10c06eda0 2024-09-13T23:08:33.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.703+0000 7fb111566640 1 -- 172.21.15.17:0/157293920 --> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb10c06f180 con 0x7fb0f80382a0 2024-09-13T23:08:33.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.719+0000 7fb0f37fe640 1 -- 172.21.15.17:0/157293920 <== mgr.4102 v2:172.21.15.164:6824/713838566 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666009 (secure 0 0 0) 0x7fb10c06f180 con 0x7fb0f80382a0 2024-09-13T23:08:33.728 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:08:33.734 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-13T23:08:33.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.723+0000 7fb111566640 1 -- 172.21.15.17:0/157293920 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb0f80382a0 msgr2=0x7fb0f803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:33.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.723+0000 7fb111566640 1 --2- 172.21.15.17:0/157293920 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb0f80382a0 0x7fb0f803a760 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb100034000 tx=0x7fb10002e000 comp rx=0 tx=0).stop 2024-09-13T23:08:33.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.723+0000 7fb111566640 1 -- 172.21.15.17:0/157293920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb10c06eda0 msgr2=0x7fb10c0968f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:33.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.723+0000 7fb111566640 1 --2- 172.21.15.17:0/157293920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb10c06eda0 0x7fb10c0968f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00c380 tx=0x7fb0fc00c840 comp rx=0 tx=0).stop 2024-09-13T23:08:33.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.723+0000 7fb111566640 1 -- 172.21.15.17:0/157293920 shutdown_connections 2024-09-13T23:08:33.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.723+0000 7fb111566640 1 --2- 172.21.15.17:0/157293920 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fb0f80382a0 0x7fb0f803a760 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.723+0000 7fb111566640 1 --2- 172.21.15.17:0/157293920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb10c06eda0 0x7fb10c0968f0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.723+0000 7fb111566640 1 -- 172.21.15.17:0/157293920 >> 172.21.15.17:0/157293920 conn(0x7fb10c09a890 msgr2=0x7fb10c097390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:33.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.723+0000 7fb111566640 1 -- 172.21.15.17:0/157293920 shutdown_connections 2024-09-13T23:08:33.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:33.723+0000 7fb111566640 1 -- 172.21.15.17:0/157293920 wait complete. 2024-09-13T23:08:33.738 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-09-13T23:08:32.101647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8985818,"num_objects":224,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":224,"num_whiteouts":0,"num_read":4995,"num_read_kb":4575,"num_write":2151,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4561,"ondisk_log_size":4561,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":165264,"kb_used_data":19724,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377322096,"statfs":{"total":386547056640,"available":386377826304,"internally_reserved":0,"allocated":20197376,"data_stored":18998514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8384697,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":620,"num_read_kb":578,"num_write":429,"num_write_kb":29372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003509"},"pg_stats":[{"pgid":"3.3f","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.357961+0000","last_change":"2024-09-13T23:05:12.130214+0000","last_active":"2024-09-13T23:08:22.357961+0000","last_peered":"2024-09-13T23:08:22.357961+0000","last_clean":"2024-09-13T23:08:22.357961+0000","last_became_active":"2024-09-13T23:05:12.130009+0000","last_became_peered":"2024-09-13T23:05:12.130009+0000","last_unstale":"2024-09-13T23:08:22.357961+0000","last_undegraded":"2024-09-13T23:08:22.357961+0000","last_fullsized":"2024-09-13T23:08:22.357961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:43.041094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.702056+0000","last_change":"2024-09-13T23:05:14.125468+0000","last_active":"2024-09-13T23:05:54.702056+0000","last_peered":"2024-09-13T23:05:54.702056+0000","last_clean":"2024-09-13T23:05:54.702056+0000","last_became_active":"2024-09-13T23:05:14.125215+0000","last_became_peered":"2024-09-13T23:05:14.125215+0000","last_unstale":"2024-09-13T23:05:54.702056+0000","last_undegraded":"2024-09-13T23:05:54.702056+0000","last_fullsized":"2024-09-13T23:05:54.702056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:30:53.032744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160717+0000","last_change":"2024-09-13T23:05:12.119102+0000","last_active":"2024-09-13T23:05:49.160717+0000","last_peered":"2024-09-13T23:05:49.160717+0000","last_clean":"2024-09-13T23:05:49.160717+0000","last_became_active":"2024-09-13T23:05:12.118411+0000","last_became_peered":"2024-09-13T23:05:12.118411+0000","last_unstale":"2024-09-13T23:05:49.160717+0000","last_undegraded":"2024-09-13T23:05:49.160717+0000","last_fullsized":"2024-09-13T23:05:49.160717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:58.196248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.485650+0000","last_change":"2024-09-13T23:05:14.109708+0000","last_active":"2024-09-13T23:07:21.485650+0000","last_peered":"2024-09-13T23:07:21.485650+0000","last_clean":"2024-09-13T23:07:21.485650+0000","last_became_active":"2024-09-13T23:05:14.109464+0000","last_became_peered":"2024-09-13T23:05:14.109464+0000","last_unstale":"2024-09-13T23:07:21.485650+0000","last_undegraded":"2024-09-13T23:07:21.485650+0000","last_fullsized":"2024-09-13T23:07:21.485650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:21.317180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.162506+0000","last_change":"2024-09-13T23:05:12.146564+0000","last_active":"2024-09-13T23:05:49.162506+0000","last_peered":"2024-09-13T23:05:49.162506+0000","last_clean":"2024-09-13T23:05:49.162506+0000","last_became_active":"2024-09-13T23:05:12.146191+0000","last_became_peered":"2024-09-13T23:05:12.146191+0000","last_unstale":"2024-09-13T23:05:49.162506+0000","last_undegraded":"2024-09-13T23:05:49.162506+0000","last_fullsized":"2024-09-13T23:05:49.162506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:15.192342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:17.908206+0000","last_change":"2024-09-13T23:05:14.110454+0000","last_active":"2024-09-13T23:07:17.908206+0000","last_peered":"2024-09-13T23:07:17.908206+0000","last_clean":"2024-09-13T23:07:17.908206+0000","last_became_active":"2024-09-13T23:05:14.110201+0000","last_became_peered":"2024-09-13T23:05:14.110201+0000","last_unstale":"2024-09-13T23:07:17.908206+0000","last_undegraded":"2024-09-13T23:07:17.908206+0000","last_fullsized":"2024-09-13T23:07:17.908206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:13:58.253126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.154369+0000","last_change":"2024-09-13T23:05:12.132812+0000","last_active":"2024-09-13T23:05:49.154369+0000","last_peered":"2024-09-13T23:05:49.154369+0000","last_clean":"2024-09-13T23:05:49.154369+0000","last_became_active":"2024-09-13T23:05:12.132461+0000","last_became_peered":"2024-09-13T23:05:12.132461+0000","last_unstale":"2024-09-13T23:05:49.154369+0000","last_undegraded":"2024-09-13T23:05:49.154369+0000","last_fullsized":"2024-09-13T23:05:49.154369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:16.369831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362602+0000","last_change":"2024-09-13T23:05:14.113718+0000","last_active":"2024-09-13T23:08:22.362602+0000","last_peered":"2024-09-13T23:08:22.362602+0000","last_clean":"2024-09-13T23:08:22.362602+0000","last_became_active":"2024-09-13T23:05:14.113430+0000","last_became_peered":"2024-09-13T23:05:14.113430+0000","last_unstale":"2024-09-13T23:08:22.362602+0000","last_undegraded":"2024-09-13T23:08:22.362602+0000","last_fullsized":"2024-09-13T23:08:22.362602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:49.226302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159928+0000","last_change":"2024-09-13T23:05:12.146576+0000","last_active":"2024-09-13T23:05:49.159928+0000","last_peered":"2024-09-13T23:05:49.159928+0000","last_clean":"2024-09-13T23:05:49.159928+0000","last_became_active":"2024-09-13T23:05:12.146220+0000","last_became_peered":"2024-09-13T23:05:12.146220+0000","last_unstale":"2024-09-13T23:05:49.159928+0000","last_undegraded":"2024-09-13T23:05:49.159928+0000","last_fullsized":"2024-09-13T23:05:49.159928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:20.009582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362602+0000","last_change":"2024-09-13T23:05:14.122808+0000","last_active":"2024-09-13T23:08:22.362602+0000","last_peered":"2024-09-13T23:08:22.362602+0000","last_clean":"2024-09-13T23:08:22.362602+0000","last_became_active":"2024-09-13T23:05:14.122513+0000","last_became_peered":"2024-09-13T23:05:14.122513+0000","last_unstale":"2024-09-13T23:08:22.362602+0000","last_undegraded":"2024-09-13T23:08:22.362602+0000","last_fullsized":"2024-09-13T23:08:22.362602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:32.818885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.238751+0000","last_change":"2024-09-13T23:05:12.113973+0000","last_active":"2024-09-13T23:08:22.238751+0000","last_peered":"2024-09-13T23:08:22.238751+0000","last_clean":"2024-09-13T23:08:22.238751+0000","last_became_active":"2024-09-13T23:05:12.113601+0000","last_became_peered":"2024-09-13T23:05:12.113601+0000","last_unstale":"2024-09-13T23:08:22.238751+0000","last_undegraded":"2024-09-13T23:08:22.238751+0000","last_fullsized":"2024-09-13T23:08:22.238751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:40:11.117182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.250229+0000","last_change":"2024-09-13T23:05:14.125418+0000","last_active":"2024-09-13T23:08:22.250229+0000","last_peered":"2024-09-13T23:08:22.250229+0000","last_clean":"2024-09-13T23:08:22.250229+0000","last_became_active":"2024-09-13T23:05:14.124971+0000","last_became_peered":"2024-09-13T23:05:14.124971+0000","last_unstale":"2024-09-13T23:08:22.250229+0000","last_undegraded":"2024-09-13T23:08:22.250229+0000","last_fullsized":"2024-09-13T23:08:22.250229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:48:34.888252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155922+0000","last_change":"2024-09-13T23:05:12.139628+0000","last_active":"2024-09-13T23:05:49.155922+0000","last_peered":"2024-09-13T23:05:49.155922+0000","last_clean":"2024-09-13T23:05:49.155922+0000","last_became_active":"2024-09-13T23:05:12.138297+0000","last_became_peered":"2024-09-13T23:05:12.138297+0000","last_unstale":"2024-09-13T23:05:49.155922+0000","last_undegraded":"2024-09-13T23:05:49.155922+0000","last_fullsized":"2024-09-13T23:05:49.155922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:12:00.284359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'16","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.984660+0000","last_change":"2024-09-13T23:05:14.124224+0000","last_active":"2024-09-13T23:08:21.984660+0000","last_peered":"2024-09-13T23:08:21.984660+0000","last_clean":"2024-09-13T23:08:21.984660+0000","last_became_active":"2024-09-13T23:05:14.123950+0000","last_became_peered":"2024-09-13T23:05:14.123950+0000","last_unstale":"2024-09-13T23:08:21.984660+0000","last_undegraded":"2024-09-13T23:08:21.984660+0000","last_fullsized":"2024-09-13T23:08:21.984660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:59:21.947772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":68,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.321599+0000","last_change":"2024-09-13T23:05:12.117693+0000","last_active":"2024-09-13T23:05:54.321599+0000","last_peered":"2024-09-13T23:05:54.321599+0000","last_clean":"2024-09-13T23:05:54.321599+0000","last_became_active":"2024-09-13T23:05:12.117028+0000","last_became_peered":"2024-09-13T23:05:12.117028+0000","last_unstale":"2024-09-13T23:05:54.321599+0000","last_undegraded":"2024-09-13T23:05:54.321599+0000","last_fullsized":"2024-09-13T23:05:54.321599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:17.130898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'17","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.328844+0000","last_change":"2024-09-13T23:05:14.115693+0000","last_active":"2024-09-13T23:08:22.328844+0000","last_peered":"2024-09-13T23:08:22.328844+0000","last_clean":"2024-09-13T23:08:22.328844+0000","last_became_active":"2024-09-13T23:05:14.114831+0000","last_became_peered":"2024-09-13T23:05:14.114831+0000","last_unstale":"2024-09-13T23:08:22.328844+0000","last_undegraded":"2024-09-13T23:08:22.328844+0000","last_fullsized":"2024-09-13T23:08:22.328844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:17.230322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'16","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.451482+0000","last_change":"2024-09-13T23:05:14.110322+0000","last_active":"2024-09-13T23:06:37.451482+0000","last_peered":"2024-09-13T23:06:37.451482+0000","last_clean":"2024-09-13T23:06:37.451482+0000","last_became_active":"2024-09-13T23:05:14.109903+0000","last_became_peered":"2024-09-13T23:05:14.109903+0000","last_unstale":"2024-09-13T23:06:37.451482+0000","last_undegraded":"2024-09-13T23:06:37.451482+0000","last_fullsized":"2024-09-13T23:06:37.451482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:04.762255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":66,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.936147+0000","last_change":"2024-09-13T23:05:12.136723+0000","last_active":"2024-09-13T23:08:21.936147+0000","last_peered":"2024-09-13T23:08:21.936147+0000","last_clean":"2024-09-13T23:08:21.936147+0000","last_became_active":"2024-09-13T23:05:12.136334+0000","last_became_peered":"2024-09-13T23:05:12.136334+0000","last_unstale":"2024-09-13T23:08:21.936147+0000","last_undegraded":"2024-09-13T23:08:21.936147+0000","last_fullsized":"2024-09-13T23:08:21.936147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:20.143656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'11","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:38.077492+0000","last_change":"2024-09-13T23:05:14.125935+0000","last_active":"2024-09-13T23:07:38.077492+0000","last_peered":"2024-09-13T23:07:38.077492+0000","last_clean":"2024-09-13T23:07:38.077492+0000","last_became_active":"2024-09-13T23:05:14.124023+0000","last_became_peered":"2024-09-13T23:05:14.124023+0000","last_unstale":"2024-09-13T23:07:38.077492+0000","last_undegraded":"2024-09-13T23:07:38.077492+0000","last_fullsized":"2024-09-13T23:07:38.077492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:33:06.997368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158954+0000","last_change":"2024-09-13T23:05:12.126709+0000","last_active":"2024-09-13T23:05:49.158954+0000","last_peered":"2024-09-13T23:05:49.158954+0000","last_clean":"2024-09-13T23:05:49.158954+0000","last_became_active":"2024-09-13T23:05:12.126336+0000","last_became_peered":"2024-09-13T23:05:12.126336+0000","last_unstale":"2024-09-13T23:05:49.158954+0000","last_undegraded":"2024-09-13T23:05:49.158954+0000","last_fullsized":"2024-09-13T23:05:49.158954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:13:11.279538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.453163+0000","last_change":"2024-09-13T23:05:14.125494+0000","last_active":"2024-09-13T23:06:37.453163+0000","last_peered":"2024-09-13T23:06:37.453163+0000","last_clean":"2024-09-13T23:06:37.453163+0000","last_became_active":"2024-09-13T23:05:14.125247+0000","last_became_peered":"2024-09-13T23:05:14.125247+0000","last_unstale":"2024-09-13T23:06:37.453163+0000","last_undegraded":"2024-09-13T23:06:37.453163+0000","last_fullsized":"2024-09-13T23:06:37.453163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:41.876468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156159+0000","last_change":"2024-09-13T23:05:12.140428+0000","last_active":"2024-09-13T23:05:49.156159+0000","last_peered":"2024-09-13T23:05:49.156159+0000","last_clean":"2024-09-13T23:05:49.156159+0000","last_became_active":"2024-09-13T23:05:12.139103+0000","last_became_peered":"2024-09-13T23:05:12.139103+0000","last_unstale":"2024-09-13T23:05:49.156159+0000","last_undegraded":"2024-09-13T23:05:49.156159+0000","last_fullsized":"2024-09-13T23:05:49.156159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:04.782795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'7","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:39.074749+0000","last_change":"2024-09-13T23:05:14.120825+0000","last_active":"2024-09-13T23:07:39.074749+0000","last_peered":"2024-09-13T23:07:39.074749+0000","last_clean":"2024-09-13T23:07:39.074749+0000","last_became_active":"2024-09-13T23:05:14.120397+0000","last_became_peered":"2024-09-13T23:05:14.120397+0000","last_unstale":"2024-09-13T23:07:39.074749+0000","last_undegraded":"2024-09-13T23:07:39.074749+0000","last_fullsized":"2024-09-13T23:07:39.074749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:33:06.997368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:53.844004+0000","last_change":"2024-09-13T23:05:12.139375+0000","last_active":"2024-09-13T23:05:53.844004+0000","last_peered":"2024-09-13T23:05:53.844004+0000","last_clean":"2024-09-13T23:05:53.844004+0000","last_became_active":"2024-09-13T23:05:12.139022+0000","last_became_peered":"2024-09-13T23:05:12.139022+0000","last_unstale":"2024-09-13T23:05:53.844004+0000","last_undegraded":"2024-09-13T23:05:53.844004+0000","last_fullsized":"2024-09-13T23:05:53.844004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:51.066283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'11","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.329086+0000","last_change":"2024-09-13T23:05:14.114497+0000","last_active":"2024-09-13T23:08:22.329086+0000","last_peered":"2024-09-13T23:08:22.329086+0000","last_clean":"2024-09-13T23:08:22.329086+0000","last_became_active":"2024-09-13T23:05:14.114261+0000","last_became_peered":"2024-09-13T23:05:14.114261+0000","last_unstale":"2024-09-13T23:08:22.329086+0000","last_undegraded":"2024-09-13T23:08:22.329086+0000","last_fullsized":"2024-09-13T23:08:22.329086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:24.193989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:53.841343+0000","last_change":"2024-09-13T23:05:12.130049+0000","last_active":"2024-09-13T23:05:53.841343+0000","last_peered":"2024-09-13T23:05:53.841343+0000","last_clean":"2024-09-13T23:05:53.841343+0000","last_became_active":"2024-09-13T23:05:12.129589+0000","last_became_peered":"2024-09-13T23:05:12.129589+0000","last_unstale":"2024-09-13T23:05:53.841343+0000","last_undegraded":"2024-09-13T23:05:53.841343+0000","last_fullsized":"2024-09-13T23:05:53.841343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:43.763766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.250116+0000","last_change":"2024-09-13T23:05:14.119179+0000","last_active":"2024-09-13T23:08:22.250116+0000","last_peered":"2024-09-13T23:08:22.250116+0000","last_clean":"2024-09-13T23:08:22.250116+0000","last_became_active":"2024-09-13T23:05:14.118922+0000","last_became_peered":"2024-09-13T23:05:14.118922+0000","last_unstale":"2024-09-13T23:08:22.250116+0000","last_undegraded":"2024-09-13T23:08:22.250116+0000","last_fullsized":"2024-09-13T23:08:22.250116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:34:29.752309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156113+0000","last_change":"2024-09-13T23:05:12.140097+0000","last_active":"2024-09-13T23:05:49.156113+0000","last_peered":"2024-09-13T23:05:49.156113+0000","last_clean":"2024-09-13T23:05:49.156113+0000","last_became_active":"2024-09-13T23:05:12.139690+0000","last_became_peered":"2024-09-13T23:05:12.139690+0000","last_unstale":"2024-09-13T23:05:49.156113+0000","last_undegraded":"2024-09-13T23:05:49.156113+0000","last_fullsized":"2024-09-13T23:05:49.156113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:08.185632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'37","reported_seq":102,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.290798+0000","last_change":"2024-09-13T23:05:22.146156+0000","last_active":"2024-09-13T23:08:22.290798+0000","last_peered":"2024-09-13T23:08:22.290798+0000","last_clean":"2024-09-13T23:08:22.290798+0000","last_became_active":"2024-09-13T23:05:22.145872+0000","last_became_peered":"2024-09-13T23:05:22.145872+0000","last_unstale":"2024-09-13T23:08:22.290798+0000","last_undegraded":"2024-09-13T23:08:22.290798+0000","last_fullsized":"2024-09-13T23:08:22.290798+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:03.965843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":174,"num_write":103,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:55.391940+0000","last_change":"2024-09-13T23:05:14.110173+0000","last_active":"2024-09-13T23:05:55.391940+0000","last_peered":"2024-09-13T23:05:55.391940+0000","last_clean":"2024-09-13T23:05:55.391940+0000","last_became_active":"2024-09-13T23:05:14.109928+0000","last_became_peered":"2024-09-13T23:05:14.109928+0000","last_unstale":"2024-09-13T23:05:55.391940+0000","last_undegraded":"2024-09-13T23:05:55.391940+0000","last_fullsized":"2024-09-13T23:05:55.391940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:47:18.620562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.914775+0000","last_change":"2024-09-13T23:05:12.147582+0000","last_active":"2024-09-13T23:05:54.914775+0000","last_peered":"2024-09-13T23:05:54.914775+0000","last_clean":"2024-09-13T23:05:54.914775+0000","last_became_active":"2024-09-13T23:05:12.146236+0000","last_became_peered":"2024-09-13T23:05:12.146236+0000","last_unstale":"2024-09-13T23:05:54.914775+0000","last_undegraded":"2024-09-13T23:05:54.914775+0000","last_fullsized":"2024-09-13T23:05:54.914775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:22:13.152885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.161816+0000","last_change":"2024-09-13T23:05:16.123699+0000","last_active":"2024-09-13T23:05:49.161816+0000","last_peered":"2024-09-13T23:05:49.161816+0000","last_clean":"2024-09-13T23:05:49.161816+0000","last_became_active":"2024-09-13T23:05:16.123362+0000","last_became_peered":"2024-09-13T23:05:16.123362+0000","last_unstale":"2024-09-13T23:05:49.161816+0000","last_undegraded":"2024-09-13T23:05:49.161816+0000","last_fullsized":"2024-09-13T23:05:49.161816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:16:52.649662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'35","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.191309+0000","last_change":"2024-09-13T23:05:18.133464+0000","last_active":"2024-09-13T23:08:29.191309+0000","last_peered":"2024-09-13T23:08:29.191309+0000","last_clean":"2024-09-13T23:08:29.191309+0000","last_became_active":"2024-09-13T23:05:18.132642+0000","last_became_peered":"2024-09-13T23:05:18.132642+0000","last_unstale":"2024-09-13T23:08:29.191309+0000","last_undegraded":"2024-09-13T23:08:29.191309+0000","last_fullsized":"2024-09-13T23:08:29.191309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:36:33.250277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158666+0000","last_change":"2024-09-13T23:05:20.145619+0000","last_active":"2024-09-13T23:05:49.158666+0000","last_peered":"2024-09-13T23:05:49.158666+0000","last_clean":"2024-09-13T23:05:49.158666+0000","last_became_active":"2024-09-13T23:05:20.145271+0000","last_became_peered":"2024-09-13T23:05:20.145271+0000","last_unstale":"2024-09-13T23:05:49.158666+0000","last_undegraded":"2024-09-13T23:05:49.158666+0000","last_fullsized":"2024-09-13T23:05:49.158666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:42:34.341082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.268382+0000","last_change":"2024-09-13T23:05:22.150560+0000","last_active":"2024-09-13T23:06:37.268382+0000","last_peered":"2024-09-13T23:06:37.268382+0000","last_clean":"2024-09-13T23:06:37.268382+0000","last_became_active":"2024-09-13T23:05:22.150260+0000","last_became_peered":"2024-09-13T23:05:22.150260+0000","last_unstale":"2024-09-13T23:06:37.268382+0000","last_undegraded":"2024-09-13T23:06:37.268382+0000","last_fullsized":"2024-09-13T23:06:37.268382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:13.932874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'6","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.101371+0000","last_change":"2024-09-13T23:05:14.113389+0000","last_active":"2024-09-13T23:08:22.101371+0000","last_peered":"2024-09-13T23:08:22.101371+0000","last_clean":"2024-09-13T23:08:22.101371+0000","last_became_active":"2024-09-13T23:05:14.113131+0000","last_became_peered":"2024-09-13T23:05:14.113131+0000","last_unstale":"2024-09-13T23:08:22.101371+0000","last_undegraded":"2024-09-13T23:08:22.101371+0000","last_fullsized":"2024-09-13T23:08:22.101371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:06.652485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.153289+0000","last_change":"2024-09-13T23:05:12.134287+0000","last_active":"2024-09-13T23:05:49.153289+0000","last_peered":"2024-09-13T23:05:49.153289+0000","last_clean":"2024-09-13T23:05:49.153289+0000","last_became_active":"2024-09-13T23:05:12.133505+0000","last_became_peered":"2024-09-13T23:05:12.133505+0000","last_unstale":"2024-09-13T23:05:49.153289+0000","last_undegraded":"2024-09-13T23:05:49.153289+0000","last_fullsized":"2024-09-13T23:05:49.153289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:56.855326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159485+0000","last_change":"2024-09-13T23:05:16.125089+0000","last_active":"2024-09-13T23:05:49.159485+0000","last_peered":"2024-09-13T23:05:49.159485+0000","last_clean":"2024-09-13T23:05:49.159485+0000","last_became_active":"2024-09-13T23:05:16.124724+0000","last_became_peered":"2024-09-13T23:05:16.124724+0000","last_unstale":"2024-09-13T23:05:49.159485+0000","last_undegraded":"2024-09-13T23:05:49.159485+0000","last_fullsized":"2024-09-13T23:05:49.159485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:57:02.718638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:43.078368+0000","last_change":"2024-09-13T23:05:18.126600+0000","last_active":"2024-09-13T23:07:43.078368+0000","last_peered":"2024-09-13T23:07:43.078368+0000","last_clean":"2024-09-13T23:07:43.078368+0000","last_became_active":"2024-09-13T23:05:18.126251+0000","last_became_peered":"2024-09-13T23:05:18.126251+0000","last_unstale":"2024-09-13T23:07:43.078368+0000","last_undegraded":"2024-09-13T23:07:43.078368+0000","last_fullsized":"2024-09-13T23:07:43.078368+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:07:27.243286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156395+0000","last_change":"2024-09-13T23:05:20.142878+0000","last_active":"2024-09-13T23:05:49.156395+0000","last_peered":"2024-09-13T23:05:49.156395+0000","last_clean":"2024-09-13T23:05:49.156395+0000","last_became_active":"2024-09-13T23:05:20.142564+0000","last_became_peered":"2024-09-13T23:05:20.142564+0000","last_unstale":"2024-09-13T23:05:49.156395+0000","last_undegraded":"2024-09-13T23:05:49.156395+0000","last_fullsized":"2024-09-13T23:05:49.156395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:59.655692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158502+0000","last_change":"2024-09-13T23:05:22.147806+0000","last_active":"2024-09-13T23:05:49.158502+0000","last_peered":"2024-09-13T23:05:49.158502+0000","last_clean":"2024-09-13T23:05:49.158502+0000","last_became_active":"2024-09-13T23:05:22.147493+0000","last_became_peered":"2024-09-13T23:05:22.147493+0000","last_unstale":"2024-09-13T23:05:49.158502+0000","last_undegraded":"2024-09-13T23:05:49.158502+0000","last_fullsized":"2024-09-13T23:05:49.158502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:13.932874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.450589+0000","last_change":"2024-09-13T23:05:14.113438+0000","last_active":"2024-09-13T23:06:37.450589+0000","last_peered":"2024-09-13T23:06:37.450589+0000","last_clean":"2024-09-13T23:06:37.450589+0000","last_became_active":"2024-09-13T23:05:14.112986+0000","last_became_peered":"2024-09-13T23:05:14.112986+0000","last_unstale":"2024-09-13T23:06:37.450589+0000","last_undegraded":"2024-09-13T23:06:37.450589+0000","last_fullsized":"2024-09-13T23:06:37.450589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:45:08.233460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155482+0000","last_change":"2024-09-13T23:05:12.139949+0000","last_active":"2024-09-13T23:05:49.155482+0000","last_peered":"2024-09-13T23:05:49.155482+0000","last_clean":"2024-09-13T23:05:49.155482+0000","last_became_active":"2024-09-13T23:05:12.138805+0000","last_became_peered":"2024-09-13T23:05:12.138805+0000","last_unstale":"2024-09-13T23:05:49.155482+0000","last_undegraded":"2024-09-13T23:05:49.155482+0000","last_fullsized":"2024-09-13T23:05:49.155482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:31:38.135658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:51.062287+0000","last_change":"2024-09-13T23:05:49.165573+0000","last_active":"2024-09-13T23:05:51.062287+0000","last_peered":"2024-09-13T23:05:51.062287+0000","last_clean":"2024-09-13T23:05:51.062287+0000","last_became_active":"2024-09-13T23:05:49.165209+0000","last_became_peered":"2024-09-13T23:05:49.165209+0000","last_unstale":"2024-09-13T23:05:51.062287+0000","last_undegraded":"2024-09-13T23:05:51.062287+0000","last_fullsized":"2024-09-13T23:05:51.062287+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:19:50.556651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"34'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:41.077798+0000","last_change":"2024-09-13T23:05:18.134680+0000","last_active":"2024-09-13T23:07:41.077798+0000","last_peered":"2024-09-13T23:07:41.077798+0000","last_clean":"2024-09-13T23:07:41.077798+0000","last_became_active":"2024-09-13T23:05:18.134363+0000","last_became_peered":"2024-09-13T23:05:18.134363+0000","last_unstale":"2024-09-13T23:07:41.077798+0000","last_undegraded":"2024-09-13T23:07:41.077798+0000","last_fullsized":"2024-09-13T23:07:41.077798+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:00.335024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":388,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.057397+0000","last_change":"2024-09-13T23:05:20.144269+0000","last_active":"2024-09-13T23:08:29.057397+0000","last_peered":"2024-09-13T23:08:29.057397+0000","last_clean":"2024-09-13T23:08:29.057397+0000","last_became_active":"2024-09-13T23:05:20.143986+0000","last_became_peered":"2024-09-13T23:05:20.143986+0000","last_unstale":"2024-09-13T23:08:29.057397+0000","last_undegraded":"2024-09-13T23:08:29.057397+0000","last_fullsized":"2024-09-13T23:08:29.057397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:13.991065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'8","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.683567+0000","last_change":"2024-09-13T23:05:22.151271+0000","last_active":"2024-09-13T23:08:21.683567+0000","last_peered":"2024-09-13T23:08:21.683567+0000","last_clean":"2024-09-13T23:08:21.683567+0000","last_became_active":"2024-09-13T23:05:22.150977+0000","last_became_peered":"2024-09-13T23:05:22.150977+0000","last_unstale":"2024-09-13T23:08:21.683567+0000","last_undegraded":"2024-09-13T23:08:21.683567+0000","last_fullsized":"2024-09-13T23:08:21.683567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:52:45.769736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'12","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.106650+0000","last_change":"2024-09-13T23:05:14.122457+0000","last_active":"2024-09-13T23:08:22.106650+0000","last_peered":"2024-09-13T23:08:22.106650+0000","last_clean":"2024-09-13T23:08:22.106650+0000","last_became_active":"2024-09-13T23:05:14.121960+0000","last_became_peered":"2024-09-13T23:05:14.121960+0000","last_unstale":"2024-09-13T23:08:22.106650+0000","last_undegraded":"2024-09-13T23:08:22.106650+0000","last_fullsized":"2024-09-13T23:08:22.106650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:29:29.556013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:53.841405+0000","last_change":"2024-09-13T23:05:12.129400+0000","last_active":"2024-09-13T23:05:53.841405+0000","last_peered":"2024-09-13T23:05:53.841405+0000","last_clean":"2024-09-13T23:05:53.841405+0000","last_became_active":"2024-09-13T23:05:12.129019+0000","last_became_peered":"2024-09-13T23:05:12.129019+0000","last_unstale":"2024-09-13T23:05:53.841405+0000","last_undegraded":"2024-09-13T23:05:53.841405+0000","last_fullsized":"2024-09-13T23:05:53.841405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:17.130898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.162782+0000","last_change":"2024-09-13T23:05:16.122830+0000","last_active":"2024-09-13T23:05:49.162782+0000","last_peered":"2024-09-13T23:05:49.162782+0000","last_clean":"2024-09-13T23:05:49.162782+0000","last_became_active":"2024-09-13T23:05:16.122555+0000","last_became_peered":"2024-09-13T23:05:16.122555+0000","last_unstale":"2024-09-13T23:05:49.162782+0000","last_undegraded":"2024-09-13T23:05:49.162782+0000","last_fullsized":"2024-09-13T23:05:49.162782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:26.261538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'33","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.162705+0000","last_change":"2024-09-13T23:05:18.128964+0000","last_active":"2024-09-13T23:08:29.162705+0000","last_peered":"2024-09-13T23:08:29.162705+0000","last_clean":"2024-09-13T23:08:29.162705+0000","last_became_active":"2024-09-13T23:05:18.128626+0000","last_became_peered":"2024-09-13T23:05:18.128626+0000","last_unstale":"2024-09-13T23:08:29.162705+0000","last_undegraded":"2024-09-13T23:08:29.162705+0000","last_fullsized":"2024-09-13T23:08:29.162705+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:06.922448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'284","reported_seq":403,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.061012+0000","last_change":"2024-09-13T23:05:20.132195+0000","last_active":"2024-09-13T23:08:29.061012+0000","last_peered":"2024-09-13T23:08:29.061012+0000","last_clean":"2024-09-13T23:08:29.061012+0000","last_became_active":"2024-09-13T23:05:20.131943+0000","last_became_peered":"2024-09-13T23:05:20.131943+0000","last_unstale":"2024-09-13T23:08:29.061012+0000","last_undegraded":"2024-09-13T23:08:29.061012+0000","last_fullsized":"2024-09-13T23:08:29.061012+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:31.349343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158421+0000","last_change":"2024-09-13T23:05:14.127270+0000","last_active":"2024-09-13T23:05:49.158421+0000","last_peered":"2024-09-13T23:05:49.158421+0000","last_clean":"2024-09-13T23:05:49.158421+0000","last_became_active":"2024-09-13T23:05:14.126659+0000","last_became_peered":"2024-09-13T23:05:14.126659+0000","last_unstale":"2024-09-13T23:05:49.158421+0000","last_undegraded":"2024-09-13T23:05:49.158421+0000","last_fullsized":"2024-09-13T23:05:49.158421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:48.797832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160679+0000","last_change":"2024-09-13T23:05:12.116365+0000","last_active":"2024-09-13T23:05:49.160679+0000","last_peered":"2024-09-13T23:05:49.160679+0000","last_clean":"2024-09-13T23:05:49.160679+0000","last_became_active":"2024-09-13T23:05:12.114453+0000","last_became_peered":"2024-09-13T23:05:12.114453+0000","last_unstale":"2024-09-13T23:05:49.160679+0000","last_undegraded":"2024-09-13T23:05:49.160679+0000","last_fullsized":"2024-09-13T23:05:49.160679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:27.884217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156721+0000","last_change":"2024-09-13T23:05:16.124600+0000","last_active":"2024-09-13T23:05:49.156721+0000","last_peered":"2024-09-13T23:05:49.156721+0000","last_clean":"2024-09-13T23:05:49.156721+0000","last_became_active":"2024-09-13T23:05:16.124324+0000","last_became_peered":"2024-09-13T23:05:16.124324+0000","last_unstale":"2024-09-13T23:05:49.156721+0000","last_undegraded":"2024-09-13T23:05:49.156721+0000","last_fullsized":"2024-09-13T23:05:49.156721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:41.101957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'43","reported_seq":94,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.203312+0000","last_change":"2024-09-13T23:05:18.130180+0000","last_active":"2024-09-13T23:08:29.203312+0000","last_peered":"2024-09-13T23:08:29.203312+0000","last_clean":"2024-09-13T23:08:29.203312+0000","last_became_active":"2024-09-13T23:05:18.129887+0000","last_became_peered":"2024-09-13T23:05:18.129887+0000","last_unstale":"2024-09-13T23:08:29.203312+0000","last_undegraded":"2024-09-13T23:08:29.203312+0000","last_fullsized":"2024-09-13T23:08:29.203312+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:07:09.827042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160148+0000","last_change":"2024-09-13T23:05:20.136290+0000","last_active":"2024-09-13T23:05:49.160148+0000","last_peered":"2024-09-13T23:05:49.160148+0000","last_clean":"2024-09-13T23:05:49.160148+0000","last_became_active":"2024-09-13T23:05:20.135937+0000","last_became_peered":"2024-09-13T23:05:20.135937+0000","last_unstale":"2024-09-13T23:05:49.160148+0000","last_undegraded":"2024-09-13T23:05:49.160148+0000","last_fullsized":"2024-09-13T23:05:49.160148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.119483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.270132+0000","last_change":"2024-09-13T23:05:22.146349+0000","last_active":"2024-09-13T23:06:37.270132+0000","last_peered":"2024-09-13T23:06:37.270132+0000","last_clean":"2024-09-13T23:06:37.270132+0000","last_became_active":"2024-09-13T23:05:22.146044+0000","last_became_peered":"2024-09-13T23:05:22.146044+0000","last_unstale":"2024-09-13T23:06:37.270132+0000","last_undegraded":"2024-09-13T23:06:37.270132+0000","last_fullsized":"2024-09-13T23:06:37.270132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:21.509044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157862+0000","last_change":"2024-09-13T23:05:14.116849+0000","last_active":"2024-09-13T23:05:49.157862+0000","last_peered":"2024-09-13T23:05:49.157862+0000","last_clean":"2024-09-13T23:05:49.157862+0000","last_became_active":"2024-09-13T23:05:14.116507+0000","last_became_peered":"2024-09-13T23:05:14.116507+0000","last_unstale":"2024-09-13T23:05:49.157862+0000","last_undegraded":"2024-09-13T23:05:49.157862+0000","last_fullsized":"2024-09-13T23:05:49.157862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:29:29.556013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.441116+0000","last_change":"2024-09-13T23:05:12.115905+0000","last_active":"2024-09-13T23:06:37.441116+0000","last_peered":"2024-09-13T23:06:37.441116+0000","last_clean":"2024-09-13T23:06:37.441116+0000","last_became_active":"2024-09-13T23:05:12.115025+0000","last_became_peered":"2024-09-13T23:05:12.115025+0000","last_unstale":"2024-09-13T23:06:37.441116+0000","last_undegraded":"2024-09-13T23:06:37.441116+0000","last_fullsized":"2024-09-13T23:06:37.441116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:18.644207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158753+0000","last_change":"2024-09-13T23:05:16.118904+0000","last_active":"2024-09-13T23:05:49.158753+0000","last_peered":"2024-09-13T23:05:49.158753+0000","last_clean":"2024-09-13T23:05:49.158753+0000","last_became_active":"2024-09-13T23:05:16.118494+0000","last_became_peered":"2024-09-13T23:05:16.118494+0000","last_unstale":"2024-09-13T23:05:49.158753+0000","last_undegraded":"2024-09-13T23:05:49.158753+0000","last_fullsized":"2024-09-13T23:05:49.158753+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:04:52.706373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'33","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.131917+0000","last_change":"2024-09-13T23:05:18.134435+0000","last_active":"2024-09-13T23:08:29.131917+0000","last_peered":"2024-09-13T23:08:29.131917+0000","last_clean":"2024-09-13T23:08:29.131917+0000","last_became_active":"2024-09-13T23:05:18.134130+0000","last_became_peered":"2024-09-13T23:05:18.134130+0000","last_unstale":"2024-09-13T23:08:29.131917+0000","last_undegraded":"2024-09-13T23:08:29.131917+0000","last_fullsized":"2024-09-13T23:08:29.131917+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:26.188132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159456+0000","last_change":"2024-09-13T23:05:20.140527+0000","last_active":"2024-09-13T23:05:49.159456+0000","last_peered":"2024-09-13T23:05:49.159456+0000","last_clean":"2024-09-13T23:05:49.159456+0000","last_became_active":"2024-09-13T23:05:20.140180+0000","last_became_peered":"2024-09-13T23:05:20.140180+0000","last_unstale":"2024-09-13T23:05:49.159456+0000","last_undegraded":"2024-09-13T23:05:49.159456+0000","last_fullsized":"2024-09-13T23:05:49.159456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:59.655692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'7","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.257996+0000","last_change":"2024-09-13T23:05:22.148436+0000","last_active":"2024-09-13T23:06:37.257996+0000","last_peered":"2024-09-13T23:06:37.257996+0000","last_clean":"2024-09-13T23:06:37.257996+0000","last_became_active":"2024-09-13T23:05:22.148104+0000","last_became_peered":"2024-09-13T23:05:22.148104+0000","last_unstale":"2024-09-13T23:06:37.257996+0000","last_undegraded":"2024-09-13T23:06:37.257996+0000","last_fullsized":"2024-09-13T23:06:37.257996+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:03:42.989142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":18,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.153941+0000","last_change":"2024-09-13T23:05:14.119333+0000","last_active":"2024-09-13T23:05:49.153941+0000","last_peered":"2024-09-13T23:05:49.153941+0000","last_clean":"2024-09-13T23:05:49.153941+0000","last_became_active":"2024-09-13T23:05:14.119071+0000","last_became_peered":"2024-09-13T23:05:14.119071+0000","last_unstale":"2024-09-13T23:05:49.153941+0000","last_undegraded":"2024-09-13T23:05:49.153941+0000","last_fullsized":"2024-09-13T23:05:49.153941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:22.705770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.891247+0000","last_change":"2024-09-13T23:05:12.148852+0000","last_active":"2024-09-13T23:08:21.891247+0000","last_peered":"2024-09-13T23:08:21.891247+0000","last_clean":"2024-09-13T23:08:21.891247+0000","last_became_active":"2024-09-13T23:05:12.148439+0000","last_became_peered":"2024-09-13T23:05:12.148439+0000","last_unstale":"2024-09-13T23:08:21.891247+0000","last_undegraded":"2024-09-13T23:08:21.891247+0000","last_fullsized":"2024-09-13T23:08:21.891247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:48:38.654493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159519+0000","last_change":"2024-09-13T23:05:16.123514+0000","last_active":"2024-09-13T23:05:49.159519+0000","last_peered":"2024-09-13T23:05:49.159519+0000","last_clean":"2024-09-13T23:05:49.159519+0000","last_became_active":"2024-09-13T23:05:16.123188+0000","last_became_peered":"2024-09-13T23:05:16.123188+0000","last_unstale":"2024-09-13T23:05:49.159519+0000","last_undegraded":"2024-09-13T23:05:49.159519+0000","last_fullsized":"2024-09-13T23:05:49.159519+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:12:38.123647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'39","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.208818+0000","last_change":"2024-09-13T23:05:18.132366+0000","last_active":"2024-09-13T23:08:29.208818+0000","last_peered":"2024-09-13T23:08:29.208818+0000","last_clean":"2024-09-13T23:08:29.208818+0000","last_became_active":"2024-09-13T23:05:18.131446+0000","last_became_peered":"2024-09-13T23:05:18.131446+0000","last_unstale":"2024-09-13T23:08:29.208818+0000","last_undegraded":"2024-09-13T23:08:29.208818+0000","last_fullsized":"2024-09-13T23:08:29.208818+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:53.858562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'284","reported_seq":350,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.062101+0000","last_change":"2024-09-13T23:05:20.144417+0000","last_active":"2024-09-13T23:08:29.062101+0000","last_peered":"2024-09-13T23:08:29.062101+0000","last_clean":"2024-09-13T23:08:29.062101+0000","last_became_active":"2024-09-13T23:05:20.144104+0000","last_became_peered":"2024-09-13T23:05:20.144104+0000","last_unstale":"2024-09-13T23:08:29.062101+0000","last_undegraded":"2024-09-13T23:08:29.062101+0000","last_fullsized":"2024-09-13T23:08:29.062101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:33.653779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160034+0000","last_change":"2024-09-13T23:05:22.147955+0000","last_active":"2024-09-13T23:05:49.160034+0000","last_peered":"2024-09-13T23:05:49.160034+0000","last_clean":"2024-09-13T23:05:49.160034+0000","last_became_active":"2024-09-13T23:05:22.147645+0000","last_became_peered":"2024-09-13T23:05:22.147645+0000","last_unstale":"2024-09-13T23:05:49.160034+0000","last_undegraded":"2024-09-13T23:05:49.160034+0000","last_fullsized":"2024-09-13T23:05:49.160034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:07.578205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'10","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362666+0000","last_change":"2024-09-13T23:05:14.112569+0000","last_active":"2024-09-13T23:08:22.362666+0000","last_peered":"2024-09-13T23:08:22.362666+0000","last_clean":"2024-09-13T23:08:22.362666+0000","last_became_active":"2024-09-13T23:05:14.112291+0000","last_became_peered":"2024-09-13T23:05:14.112291+0000","last_unstale":"2024-09-13T23:08:22.362666+0000","last_undegraded":"2024-09-13T23:08:22.362666+0000","last_fullsized":"2024-09-13T23:08:22.362666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:17.199234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.902946+0000","last_change":"2024-09-13T23:05:12.149813+0000","last_active":"2024-09-13T23:08:21.902946+0000","last_peered":"2024-09-13T23:08:21.902946+0000","last_clean":"2024-09-13T23:08:21.902946+0000","last_became_active":"2024-09-13T23:05:12.149418+0000","last_became_peered":"2024-09-13T23:05:12.149418+0000","last_unstale":"2024-09-13T23:08:21.902946+0000","last_undegraded":"2024-09-13T23:08:21.902946+0000","last_fullsized":"2024-09-13T23:08:21.902946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:40.908784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158966+0000","last_change":"2024-09-13T23:05:16.118930+0000","last_active":"2024-09-13T23:05:49.158966+0000","last_peered":"2024-09-13T23:05:49.158966+0000","last_clean":"2024-09-13T23:05:49.158966+0000","last_became_active":"2024-09-13T23:05:16.118503+0000","last_became_peered":"2024-09-13T23:05:16.118503+0000","last_unstale":"2024-09-13T23:05:49.158966+0000","last_undegraded":"2024-09-13T23:05:49.158966+0000","last_fullsized":"2024-09-13T23:05:49.158966+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:46.202221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'60","reported_seq":124,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.214599+0000","last_change":"2024-09-13T23:05:18.135615+0000","last_active":"2024-09-13T23:08:29.214599+0000","last_peered":"2024-09-13T23:08:29.214599+0000","last_clean":"2024-09-13T23:08:29.214599+0000","last_became_active":"2024-09-13T23:05:18.135307+0000","last_became_peered":"2024-09-13T23:05:18.135307+0000","last_unstale":"2024-09-13T23:08:29.214599+0000","last_undegraded":"2024-09-13T23:08:29.214599+0000","last_fullsized":"2024-09-13T23:08:29.214599+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:14:46.252331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158506+0000","last_change":"2024-09-13T23:05:20.137752+0000","last_active":"2024-09-13T23:05:49.158506+0000","last_peered":"2024-09-13T23:05:49.158506+0000","last_clean":"2024-09-13T23:05:49.158506+0000","last_became_active":"2024-09-13T23:05:20.137460+0000","last_became_peered":"2024-09-13T23:05:20.137460+0000","last_unstale":"2024-09-13T23:05:49.158506+0000","last_undegraded":"2024-09-13T23:05:49.158506+0000","last_fullsized":"2024-09-13T23:05:49.158506+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:24.969082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.583085+0000","last_change":"2024-09-13T23:05:22.141812+0000","last_active":"2024-09-13T23:08:22.583085+0000","last_peered":"2024-09-13T23:08:22.583085+0000","last_clean":"2024-09-13T23:08:22.583085+0000","last_became_active":"2024-09-13T23:05:22.141472+0000","last_became_peered":"2024-09-13T23:05:22.141472+0000","last_unstale":"2024-09-13T23:08:22.583085+0000","last_undegraded":"2024-09-13T23:08:22.583085+0000","last_fullsized":"2024-09-13T23:08:22.583085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:21:03.848726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.933540+0000","last_change":"2024-09-13T23:05:49.164754+0000","last_active":"2024-09-13T23:05:54.933540+0000","last_peered":"2024-09-13T23:05:54.933540+0000","last_clean":"2024-09-13T23:05:54.933540+0000","last_became_active":"2024-09-13T23:05:49.164426+0000","last_became_peered":"2024-09-13T23:05:49.164426+0000","last_unstale":"2024-09-13T23:05:54.933540+0000","last_undegraded":"2024-09-13T23:05:54.933540+0000","last_fullsized":"2024-09-13T23:05:54.933540+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:05.715216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.230923+0000","last_change":"2024-09-13T23:05:12.130483+0000","last_active":"2024-09-13T23:08:22.230923+0000","last_peered":"2024-09-13T23:08:22.230923+0000","last_clean":"2024-09-13T23:08:22.230923+0000","last_became_active":"2024-09-13T23:05:12.129951+0000","last_became_peered":"2024-09-13T23:05:12.129951+0000","last_unstale":"2024-09-13T23:08:22.230923+0000","last_undegraded":"2024-09-13T23:08:22.230923+0000","last_fullsized":"2024-09-13T23:08:22.230923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:29.788894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156275+0000","last_change":"2024-09-13T23:05:16.127877+0000","last_active":"2024-09-13T23:05:49.156275+0000","last_peered":"2024-09-13T23:05:49.156275+0000","last_clean":"2024-09-13T23:05:49.156275+0000","last_became_active":"2024-09-13T23:05:16.127598+0000","last_became_peered":"2024-09-13T23:05:16.127598+0000","last_unstale":"2024-09-13T23:05:49.156275+0000","last_undegraded":"2024-09-13T23:05:49.156275+0000","last_fullsized":"2024-09-13T23:05:49.156275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:22:17.166855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'32","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.712314+0000","last_change":"2024-09-13T23:05:18.129032+0000","last_active":"2024-09-13T23:07:19.712314+0000","last_peered":"2024-09-13T23:07:19.712314+0000","last_clean":"2024-09-13T23:07:19.712314+0000","last_became_active":"2024-09-13T23:05:18.128238+0000","last_became_peered":"2024-09-13T23:05:18.128238+0000","last_unstale":"2024-09-13T23:07:19.712314+0000","last_undegraded":"2024-09-13T23:07:19.712314+0000","last_fullsized":"2024-09-13T23:07:19.712314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:21.134767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.163889+0000","last_change":"2024-09-13T23:05:20.140091+0000","last_active":"2024-09-13T23:05:49.163889+0000","last_peered":"2024-09-13T23:05:49.163889+0000","last_clean":"2024-09-13T23:05:49.163889+0000","last_became_active":"2024-09-13T23:05:20.139335+0000","last_became_peered":"2024-09-13T23:05:20.139335+0000","last_unstale":"2024-09-13T23:05:49.163889+0000","last_undegraded":"2024-09-13T23:05:49.163889+0000","last_fullsized":"2024-09-13T23:05:49.163889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:55.021863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:22.075235+0000","last_change":"2024-09-13T23:05:22.148481+0000","last_active":"2024-09-13T23:07:22.075235+0000","last_peered":"2024-09-13T23:07:22.075235+0000","last_clean":"2024-09-13T23:07:22.075235+0000","last_became_active":"2024-09-13T23:05:22.148222+0000","last_became_peered":"2024-09-13T23:05:22.148222+0000","last_unstale":"2024-09-13T23:07:22.075235+0000","last_undegraded":"2024-09-13T23:07:22.075235+0000","last_fullsized":"2024-09-13T23:07:22.075235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:17.281151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'34","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.987497+0000","last_change":"2024-09-13T23:05:14.118784+0000","last_active":"2024-09-13T23:08:21.987497+0000","last_peered":"2024-09-13T23:08:21.987497+0000","last_clean":"2024-09-13T23:08:21.987497+0000","last_became_active":"2024-09-13T23:05:14.118545+0000","last_became_peered":"2024-09-13T23:05:14.118545+0000","last_unstale":"2024-09-13T23:08:21.987497+0000","last_undegraded":"2024-09-13T23:08:21.987497+0000","last_fullsized":"2024-09-13T23:08:21.987497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:08.429431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":93,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157506+0000","last_change":"2024-09-13T23:05:12.147234+0000","last_active":"2024-09-13T23:05:49.157506+0000","last_peered":"2024-09-13T23:05:49.157506+0000","last_clean":"2024-09-13T23:05:49.157506+0000","last_became_active":"2024-09-13T23:05:12.146912+0000","last_became_peered":"2024-09-13T23:05:12.146912+0000","last_unstale":"2024-09-13T23:05:49.157506+0000","last_undegraded":"2024-09-13T23:05:49.157506+0000","last_fullsized":"2024-09-13T23:05:49.157506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:38:56.354721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159573+0000","last_change":"2024-09-13T23:05:16.114688+0000","last_active":"2024-09-13T23:05:49.159573+0000","last_peered":"2024-09-13T23:05:49.159573+0000","last_clean":"2024-09-13T23:05:49.159573+0000","last_became_active":"2024-09-13T23:05:16.114369+0000","last_became_peered":"2024-09-13T23:05:16.114369+0000","last_unstale":"2024-09-13T23:05:49.159573+0000","last_undegraded":"2024-09-13T23:05:49.159573+0000","last_fullsized":"2024-09-13T23:05:49.159573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:26:55.819506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'40","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.122427+0000","last_change":"2024-09-13T23:05:18.126484+0000","last_active":"2024-09-13T23:08:29.122427+0000","last_peered":"2024-09-13T23:08:29.122427+0000","last_clean":"2024-09-13T23:08:29.122427+0000","last_became_active":"2024-09-13T23:05:18.126183+0000","last_became_peered":"2024-09-13T23:05:18.126183+0000","last_unstale":"2024-09-13T23:08:29.122427+0000","last_undegraded":"2024-09-13T23:08:29.122427+0000","last_fullsized":"2024-09-13T23:08:29.122427+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:26:42.895522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":406,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.058456+0000","last_change":"2024-09-13T23:05:20.143991+0000","last_active":"2024-09-13T23:08:29.058456+0000","last_peered":"2024-09-13T23:08:29.058456+0000","last_clean":"2024-09-13T23:08:29.058456+0000","last_became_active":"2024-09-13T23:05:20.143659+0000","last_became_peered":"2024-09-13T23:05:20.143659+0000","last_unstale":"2024-09-13T23:08:29.058456+0000","last_undegraded":"2024-09-13T23:08:29.058456+0000","last_fullsized":"2024-09-13T23:08:29.058456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:12.673687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:29.073132+0000","last_change":"2024-09-13T23:05:22.140956+0000","last_active":"2024-09-13T23:07:29.073132+0000","last_peered":"2024-09-13T23:07:29.073132+0000","last_clean":"2024-09-13T23:07:29.073132+0000","last_became_active":"2024-09-13T23:05:22.140485+0000","last_became_peered":"2024-09-13T23:05:22.140485+0000","last_unstale":"2024-09-13T23:07:29.073132+0000","last_undegraded":"2024-09-13T23:07:29.073132+0000","last_fullsized":"2024-09-13T23:07:29.073132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:59:53.508149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'18","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362666+0000","last_change":"2024-09-13T23:05:14.115429+0000","last_active":"2024-09-13T23:08:22.362666+0000","last_peered":"2024-09-13T23:08:22.362666+0000","last_clean":"2024-09-13T23:08:22.362666+0000","last_became_active":"2024-09-13T23:05:14.115166+0000","last_became_peered":"2024-09-13T23:05:14.115166+0000","last_unstale":"2024-09-13T23:08:22.362666+0000","last_undegraded":"2024-09-13T23:08:22.362666+0000","last_fullsized":"2024-09-13T23:08:22.362666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:32:22.514080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.234005+0000","last_change":"2024-09-13T23:05:12.140202+0000","last_active":"2024-09-13T23:08:22.234005+0000","last_peered":"2024-09-13T23:08:22.234005+0000","last_clean":"2024-09-13T23:08:22.234005+0000","last_became_active":"2024-09-13T23:05:12.139283+0000","last_became_peered":"2024-09-13T23:05:12.139283+0000","last_unstale":"2024-09-13T23:08:22.234005+0000","last_undegraded":"2024-09-13T23:08:22.234005+0000","last_fullsized":"2024-09-13T23:08:22.234005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:48.577483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":424,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:20.838224+0000","last_change":"2024-09-13T23:05:49.171563+0000","last_active":"2024-09-13T23:07:20.838224+0000","last_peered":"2024-09-13T23:07:20.838224+0000","last_clean":"2024-09-13T23:07:20.838224+0000","last_became_active":"2024-09-13T23:05:49.164741+0000","last_became_peered":"2024-09-13T23:05:49.164741+0000","last_unstale":"2024-09-13T23:07:20.838224+0000","last_undegraded":"2024-09-13T23:07:20.838224+0000","last_fullsized":"2024-09-13T23:07:20.838224+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:00:34.765305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160915+0000","last_change":"2024-09-13T23:05:18.135452+0000","last_active":"2024-09-13T23:05:49.160915+0000","last_peered":"2024-09-13T23:05:49.160915+0000","last_clean":"2024-09-13T23:05:49.160915+0000","last_became_active":"2024-09-13T23:05:18.135028+0000","last_became_peered":"2024-09-13T23:05:18.135028+0000","last_unstale":"2024-09-13T23:05:49.160915+0000","last_undegraded":"2024-09-13T23:05:49.160915+0000","last_fullsized":"2024-09-13T23:05:49.160915+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:18.976364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":465,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.473644+0000","last_change":"2024-09-13T23:05:20.133263+0000","last_active":"2024-09-13T23:08:22.473644+0000","last_peered":"2024-09-13T23:08:22.473644+0000","last_clean":"2024-09-13T23:08:22.473644+0000","last_became_active":"2024-09-13T23:05:20.132891+0000","last_became_peered":"2024-09-13T23:05:20.132891+0000","last_unstale":"2024-09-13T23:08:22.473644+0000","last_undegraded":"2024-09-13T23:08:22.473644+0000","last_fullsized":"2024-09-13T23:08:22.473644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:54.194855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.115074+0000","last_change":"2024-09-13T23:05:22.150994+0000","last_active":"2024-09-13T23:07:21.115074+0000","last_peered":"2024-09-13T23:07:21.115074+0000","last_clean":"2024-09-13T23:07:21.115074+0000","last_became_active":"2024-09-13T23:05:22.150258+0000","last_became_peered":"2024-09-13T23:05:22.150258+0000","last_unstale":"2024-09-13T23:07:21.115074+0000","last_undegraded":"2024-09-13T23:07:21.115074+0000","last_fullsized":"2024-09-13T23:07:21.115074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:31:47.069056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362873+0000","last_change":"2024-09-13T23:05:14.126232+0000","last_active":"2024-09-13T23:08:22.362873+0000","last_peered":"2024-09-13T23:08:22.362873+0000","last_clean":"2024-09-13T23:08:22.362873+0000","last_became_active":"2024-09-13T23:05:14.125034+0000","last_became_peered":"2024-09-13T23:05:14.125034+0000","last_unstale":"2024-09-13T23:08:22.362873+0000","last_undegraded":"2024-09-13T23:08:22.362873+0000","last_fullsized":"2024-09-13T23:08:22.362873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:04:50.699295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'3","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.249529+0000","last_change":"2024-09-13T23:05:12.143810+0000","last_active":"2024-09-13T23:06:37.249529+0000","last_peered":"2024-09-13T23:06:37.249529+0000","last_clean":"2024-09-13T23:06:37.249529+0000","last_became_active":"2024-09-13T23:05:12.142185+0000","last_became_peered":"2024-09-13T23:05:12.142185+0000","last_unstale":"2024-09-13T23:06:37.249529+0000","last_undegraded":"2024-09-13T23:06:37.249529+0000","last_fullsized":"2024-09-13T23:06:37.249529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:22.187097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.163377+0000","last_change":"2024-09-13T23:05:16.125331+0000","last_active":"2024-09-13T23:05:49.163377+0000","last_peered":"2024-09-13T23:05:49.163377+0000","last_clean":"2024-09-13T23:05:49.163377+0000","last_became_active":"2024-09-13T23:05:16.125013+0000","last_became_peered":"2024-09-13T23:05:16.125013+0000","last_unstale":"2024-09-13T23:05:49.163377+0000","last_undegraded":"2024-09-13T23:05:49.163377+0000","last_fullsized":"2024-09-13T23:05:49.163377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:44.318931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'38","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.725307+0000","last_change":"2024-09-13T23:05:18.126590+0000","last_active":"2024-09-13T23:07:19.725307+0000","last_peered":"2024-09-13T23:07:19.725307+0000","last_clean":"2024-09-13T23:07:19.725307+0000","last_became_active":"2024-09-13T23:05:18.126271+0000","last_became_peered":"2024-09-13T23:05:18.126271+0000","last_unstale":"2024-09-13T23:07:19.725307+0000","last_undegraded":"2024-09-13T23:07:19.725307+0000","last_fullsized":"2024-09-13T23:07:19.725307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:23.420696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.154145+0000","last_change":"2024-09-13T23:05:20.145937+0000","last_active":"2024-09-13T23:05:49.154145+0000","last_peered":"2024-09-13T23:05:49.154145+0000","last_clean":"2024-09-13T23:05:49.154145+0000","last_became_active":"2024-09-13T23:05:20.145626+0000","last_became_peered":"2024-09-13T23:05:20.145626+0000","last_unstale":"2024-09-13T23:05:49.154145+0000","last_undegraded":"2024-09-13T23:05:49.154145+0000","last_fullsized":"2024-09-13T23:05:49.154145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:12.850248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.421783+0000","last_change":"2024-09-13T23:05:22.137537+0000","last_active":"2024-09-13T23:08:22.421783+0000","last_peered":"2024-09-13T23:08:22.421783+0000","last_clean":"2024-09-13T23:08:22.421783+0000","last_became_active":"2024-09-13T23:05:22.137111+0000","last_became_peered":"2024-09-13T23:05:22.137111+0000","last_unstale":"2024-09-13T23:08:22.421783+0000","last_undegraded":"2024-09-13T23:08:22.421783+0000","last_fullsized":"2024-09-13T23:08:22.421783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:04:57.442372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'16","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:17.907900+0000","last_change":"2024-09-13T23:05:49.168074+0000","last_active":"2024-09-13T23:07:17.907900+0000","last_peered":"2024-09-13T23:07:17.907900+0000","last_clean":"2024-09-13T23:07:17.907900+0000","last_became_active":"2024-09-13T23:05:49.165166+0000","last_became_peered":"2024-09-13T23:05:49.165166+0000","last_unstale":"2024-09-13T23:07:17.907900+0000","last_undegraded":"2024-09-13T23:07:17.907900+0000","last_fullsized":"2024-09-13T23:07:17.907900+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:16:50.642584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":51,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":204,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.154898+0000","last_change":"2024-09-13T23:04:56.151685+0000","last_active":"2024-09-13T23:05:49.154898+0000","last_peered":"2024-09-13T23:05:49.154898+0000","last_clean":"2024-09-13T23:05:49.154898+0000","last_became_active":"2024-09-13T23:04:56.149747+0000","last_became_peered":"2024-09-13T23:04:56.149747+0000","last_unstale":"2024-09-13T23:05:49.154898+0000","last_undegraded":"2024-09-13T23:05:49.154898+0000","last_fullsized":"2024-09-13T23:05:49.154898+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:04:55.054026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:04:55.054026+0000","last_clean_scrub_stamp":"2024-09-13T23:04:55.054026+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:38.290092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160070+0000","last_change":"2024-09-13T23:05:03.078734+0000","last_active":"2024-09-13T23:05:49.160070+0000","last_peered":"2024-09-13T23:05:49.160070+0000","last_clean":"2024-09-13T23:05:49.160070+0000","last_became_active":"2024-09-13T23:05:01.074608+0000","last_became_peered":"2024-09-13T23:05:01.074608+0000","last_unstale":"2024-09-13T23:05:49.160070+0000","last_undegraded":"2024-09-13T23:05:49.160070+0000","last_fullsized":"2024-09-13T23:05:49.160070+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:03.125973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097176599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.866624+0000","last_change":"2024-09-13T23:05:12.147068+0000","last_active":"2024-09-13T23:08:21.866624+0000","last_peered":"2024-09-13T23:08:21.866624+0000","last_clean":"2024-09-13T23:08:21.866624+0000","last_became_active":"2024-09-13T23:05:12.146438+0000","last_became_peered":"2024-09-13T23:05:12.146438+0000","last_unstale":"2024-09-13T23:08:21.866624+0000","last_undegraded":"2024-09-13T23:08:21.866624+0000","last_fullsized":"2024-09-13T23:08:21.866624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:25:59.118016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158851+0000","last_change":"2024-09-13T23:05:16.115876+0000","last_active":"2024-09-13T23:05:49.158851+0000","last_peered":"2024-09-13T23:05:49.158851+0000","last_clean":"2024-09-13T23:05:49.158851+0000","last_became_active":"2024-09-13T23:05:16.115599+0000","last_became_peered":"2024-09-13T23:05:16.115599+0000","last_unstale":"2024-09-13T23:05:49.158851+0000","last_undegraded":"2024-09-13T23:05:49.158851+0000","last_fullsized":"2024-09-13T23:05:49.158851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:22.878444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'85","reported_seq":166,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.200215+0000","last_change":"2024-09-13T23:05:18.135412+0000","last_active":"2024-09-13T23:08:29.200215+0000","last_peered":"2024-09-13T23:08:29.200215+0000","last_clean":"2024-09-13T23:08:29.200215+0000","last_became_active":"2024-09-13T23:05:18.135080+0000","last_became_peered":"2024-09-13T23:05:18.135080+0000","last_unstale":"2024-09-13T23:08:29.200215+0000","last_undegraded":"2024-09-13T23:08:29.200215+0000","last_fullsized":"2024-09-13T23:08:29.200215+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:46.305461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160178+0000","last_change":"2024-09-13T23:05:20.139707+0000","last_active":"2024-09-13T23:05:49.160178+0000","last_peered":"2024-09-13T23:05:49.160178+0000","last_clean":"2024-09-13T23:05:49.160178+0000","last_became_active":"2024-09-13T23:05:20.139399+0000","last_became_peered":"2024-09-13T23:05:20.139399+0000","last_unstale":"2024-09-13T23:05:49.160178+0000","last_undegraded":"2024-09-13T23:05:49.160178+0000","last_fullsized":"2024-09-13T23:05:49.160178+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:42:34.341082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'87","reported_seq":171,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.374408+0000","last_change":"2024-09-13T23:05:22.140722+0000","last_active":"2024-09-13T23:08:22.374408+0000","last_peered":"2024-09-13T23:08:22.374408+0000","last_clean":"2024-09-13T23:08:22.374408+0000","last_became_active":"2024-09-13T23:05:22.140430+0000","last_became_peered":"2024-09-13T23:05:22.140430+0000","last_unstale":"2024-09-13T23:08:22.374408+0000","last_undegraded":"2024-09-13T23:08:22.374408+0000","last_fullsized":"2024-09-13T23:08:22.374408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:57.254040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":226,"num_write":170,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.101402+0000","last_change":"2024-09-13T23:05:14.113221+0000","last_active":"2024-09-13T23:08:22.101402+0000","last_peered":"2024-09-13T23:08:22.101402+0000","last_clean":"2024-09-13T23:08:22.101402+0000","last_became_active":"2024-09-13T23:05:14.112711+0000","last_became_peered":"2024-09-13T23:05:14.112711+0000","last_unstale":"2024-09-13T23:08:22.101402+0000","last_undegraded":"2024-09-13T23:08:22.101402+0000","last_fullsized":"2024-09-13T23:08:22.101402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:40.124504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157421+0000","last_change":"2024-09-13T23:05:03.078145+0000","last_active":"2024-09-13T23:05:49.157421+0000","last_peered":"2024-09-13T23:05:49.157421+0000","last_clean":"2024-09-13T23:05:49.157421+0000","last_became_active":"2024-09-13T23:05:01.075438+0000","last_became_peered":"2024-09-13T23:05:01.075438+0000","last_unstale":"2024-09-13T23:05:49.157421+0000","last_undegraded":"2024-09-13T23:05:49.157421+0000","last_fullsized":"2024-09-13T23:05:49.157421+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:36:59.019783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043480299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158406+0000","last_change":"2024-09-13T23:05:12.114595+0000","last_active":"2024-09-13T23:05:49.158406+0000","last_peered":"2024-09-13T23:05:49.158406+0000","last_clean":"2024-09-13T23:05:49.158406+0000","last_became_active":"2024-09-13T23:05:12.114087+0000","last_became_peered":"2024-09-13T23:05:12.114087+0000","last_unstale":"2024-09-13T23:05:49.158406+0000","last_undegraded":"2024-09-13T23:05:49.158406+0000","last_fullsized":"2024-09-13T23:05:49.158406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:01:21.996979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.164060+0000","last_change":"2024-09-13T23:05:16.127786+0000","last_active":"2024-09-13T23:05:49.164060+0000","last_peered":"2024-09-13T23:05:49.164060+0000","last_clean":"2024-09-13T23:05:49.164060+0000","last_became_active":"2024-09-13T23:05:16.127404+0000","last_became_peered":"2024-09-13T23:05:16.127404+0000","last_unstale":"2024-09-13T23:05:49.164060+0000","last_undegraded":"2024-09-13T23:05:49.164060+0000","last_fullsized":"2024-09-13T23:05:49.164060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:03:50.653375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'274","reported_seq":477,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.205293+0000","last_change":"2024-09-13T23:05:18.135832+0000","last_active":"2024-09-13T23:08:21.205293+0000","last_peered":"2024-09-13T23:08:21.205293+0000","last_clean":"2024-09-13T23:08:21.205293+0000","last_became_active":"2024-09-13T23:05:18.135536+0000","last_became_peered":"2024-09-13T23:05:18.135536+0000","last_unstale":"2024-09-13T23:08:21.205293+0000","last_undegraded":"2024-09-13T23:08:21.205293+0000","last_fullsized":"2024-09-13T23:08:21.205293+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:46.163680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.161250+0000","last_change":"2024-09-13T23:05:20.139219+0000","last_active":"2024-09-13T23:05:49.161250+0000","last_peered":"2024-09-13T23:05:49.161250+0000","last_clean":"2024-09-13T23:05:49.161250+0000","last_became_active":"2024-09-13T23:05:20.138840+0000","last_became_peered":"2024-09-13T23:05:20.138840+0000","last_unstale":"2024-09-13T23:05:49.161250+0000","last_undegraded":"2024-09-13T23:05:49.161250+0000","last_fullsized":"2024-09-13T23:05:49.161250+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:11.879040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'5","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.012786+0000","last_change":"2024-09-13T23:05:22.149748+0000","last_active":"2024-09-13T23:08:22.012786+0000","last_peered":"2024-09-13T23:08:22.012786+0000","last_clean":"2024-09-13T23:08:22.012786+0000","last_became_active":"2024-09-13T23:05:22.149430+0000","last_became_peered":"2024-09-13T23:05:22.149430+0000","last_unstale":"2024-09-13T23:08:22.012786+0000","last_undegraded":"2024-09-13T23:08:22.012786+0000","last_fullsized":"2024-09-13T23:08:22.012786+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:59:53.508149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:17.907468+0000","last_change":"2024-09-13T23:05:14.122318+0000","last_active":"2024-09-13T23:07:17.907468+0000","last_peered":"2024-09-13T23:07:17.907468+0000","last_clean":"2024-09-13T23:07:17.907468+0000","last_became_active":"2024-09-13T23:05:14.121629+0000","last_became_peered":"2024-09-13T23:05:14.121629+0000","last_unstale":"2024-09-13T23:07:17.907468+0000","last_undegraded":"2024-09-13T23:07:17.907468+0000","last_fullsized":"2024-09-13T23:07:17.907468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:40.466898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.153107+0000","last_change":"2024-09-13T23:05:03.246597+0000","last_active":"2024-09-13T23:05:49.153107+0000","last_peered":"2024-09-13T23:05:49.153107+0000","last_clean":"2024-09-13T23:05:49.153107+0000","last_became_active":"2024-09-13T23:05:01.075422+0000","last_became_peered":"2024-09-13T23:05:01.075422+0000","last_unstale":"2024-09-13T23:05:49.153107+0000","last_undegraded":"2024-09-13T23:05:49.153107+0000","last_fullsized":"2024-09-13T23:05:49.153107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:46.318146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049267099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158237+0000","last_change":"2024-09-13T23:05:12.118437+0000","last_active":"2024-09-13T23:05:49.158237+0000","last_peered":"2024-09-13T23:05:49.158237+0000","last_clean":"2024-09-13T23:05:49.158237+0000","last_became_active":"2024-09-13T23:05:12.117940+0000","last_became_peered":"2024-09-13T23:05:12.117940+0000","last_unstale":"2024-09-13T23:05:49.158237+0000","last_undegraded":"2024-09-13T23:05:49.158237+0000","last_fullsized":"2024-09-13T23:05:49.158237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:14:55.200398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158030+0000","last_change":"2024-09-13T23:05:16.122638+0000","last_active":"2024-09-13T23:05:49.158030+0000","last_peered":"2024-09-13T23:05:49.158030+0000","last_clean":"2024-09-13T23:05:49.158030+0000","last_became_active":"2024-09-13T23:05:16.122318+0000","last_became_peered":"2024-09-13T23:05:16.122318+0000","last_unstale":"2024-09-13T23:05:49.158030+0000","last_undegraded":"2024-09-13T23:05:49.158030+0000","last_fullsized":"2024-09-13T23:05:49.158030+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:42.400087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.205271+0000","last_change":"2024-09-13T23:05:18.128025+0000","last_active":"2024-09-13T23:08:21.205271+0000","last_peered":"2024-09-13T23:08:21.205271+0000","last_clean":"2024-09-13T23:08:21.205271+0000","last_became_active":"2024-09-13T23:05:18.127698+0000","last_became_peered":"2024-09-13T23:05:18.127698+0000","last_unstale":"2024-09-13T23:08:21.205271+0000","last_undegraded":"2024-09-13T23:08:21.205271+0000","last_fullsized":"2024-09-13T23:08:21.205271+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:20.928045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159819+0000","last_change":"2024-09-13T23:05:20.145677+0000","last_active":"2024-09-13T23:05:49.159819+0000","last_peered":"2024-09-13T23:05:49.159819+0000","last_clean":"2024-09-13T23:05:49.159819+0000","last_became_active":"2024-09-13T23:05:20.145330+0000","last_became_peered":"2024-09-13T23:05:20.145330+0000","last_unstale":"2024-09-13T23:05:49.159819+0000","last_undegraded":"2024-09-13T23:05:49.159819+0000","last_fullsized":"2024-09-13T23:05:49.159819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:42.120633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.154815+0000","last_change":"2024-09-13T23:05:22.139303+0000","last_active":"2024-09-13T23:05:49.154815+0000","last_peered":"2024-09-13T23:05:49.154815+0000","last_clean":"2024-09-13T23:05:49.154815+0000","last_became_active":"2024-09-13T23:05:22.138259+0000","last_became_peered":"2024-09-13T23:05:22.138259+0000","last_unstale":"2024-09-13T23:05:49.154815+0000","last_undegraded":"2024-09-13T23:05:49.154815+0000","last_fullsized":"2024-09-13T23:05:49.154815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:37.433723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'6","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362869+0000","last_change":"2024-09-13T23:05:14.110869+0000","last_active":"2024-09-13T23:08:22.362869+0000","last_peered":"2024-09-13T23:08:22.362869+0000","last_clean":"2024-09-13T23:08:22.362869+0000","last_became_active":"2024-09-13T23:05:14.110532+0000","last_became_peered":"2024-09-13T23:05:14.110532+0000","last_unstale":"2024-09-13T23:08:22.362869+0000","last_undegraded":"2024-09-13T23:08:22.362869+0000","last_fullsized":"2024-09-13T23:08:22.362869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:48.481316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155626+0000","last_change":"2024-09-13T23:05:03.078756+0000","last_active":"2024-09-13T23:05:49.155626+0000","last_peered":"2024-09-13T23:05:49.155626+0000","last_clean":"2024-09-13T23:05:49.155626+0000","last_became_active":"2024-09-13T23:05:01.075399+0000","last_became_peered":"2024-09-13T23:05:01.075399+0000","last_unstale":"2024-09-13T23:05:49.155626+0000","last_undegraded":"2024-09-13T23:05:49.155626+0000","last_fullsized":"2024-09-13T23:05:49.155626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:30.026879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010379530000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.154668+0000","last_change":"2024-09-13T23:05:12.131428+0000","last_active":"2024-09-13T23:05:49.154668+0000","last_peered":"2024-09-13T23:05:49.154668+0000","last_clean":"2024-09-13T23:05:49.154668+0000","last_became_active":"2024-09-13T23:05:12.130410+0000","last_became_peered":"2024-09-13T23:05:12.130410+0000","last_unstale":"2024-09-13T23:05:49.154668+0000","last_undegraded":"2024-09-13T23:05:49.154668+0000","last_fullsized":"2024-09-13T23:05:49.154668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:29.799687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160305+0000","last_change":"2024-09-13T23:05:16.124659+0000","last_active":"2024-09-13T23:05:49.160305+0000","last_peered":"2024-09-13T23:05:49.160305+0000","last_clean":"2024-09-13T23:05:49.160305+0000","last_became_active":"2024-09-13T23:05:16.123983+0000","last_became_peered":"2024-09-13T23:05:16.123983+0000","last_unstale":"2024-09-13T23:05:49.160305+0000","last_undegraded":"2024-09-13T23:05:49.160305+0000","last_fullsized":"2024-09-13T23:05:49.160305+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:43.395837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.506942+0000","last_change":"2024-09-13T23:05:18.133997+0000","last_active":"2024-09-13T23:08:21.506942+0000","last_peered":"2024-09-13T23:08:21.506942+0000","last_clean":"2024-09-13T23:08:21.506942+0000","last_became_active":"2024-09-13T23:05:18.133165+0000","last_became_peered":"2024-09-13T23:05:18.133165+0000","last_unstale":"2024-09-13T23:08:21.506942+0000","last_undegraded":"2024-09-13T23:08:21.506942+0000","last_fullsized":"2024-09-13T23:08:21.506942+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:53.112074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.164155+0000","last_change":"2024-09-13T23:05:20.144363+0000","last_active":"2024-09-13T23:05:49.164155+0000","last_peered":"2024-09-13T23:05:49.164155+0000","last_clean":"2024-09-13T23:05:49.164155+0000","last_became_active":"2024-09-13T23:05:20.143748+0000","last_became_peered":"2024-09-13T23:05:20.143748+0000","last_unstale":"2024-09-13T23:05:49.164155+0000","last_undegraded":"2024-09-13T23:05:49.164155+0000","last_fullsized":"2024-09-13T23:05:49.164155+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:34:12.604551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.062072+0000","last_change":"2024-09-13T23:05:22.150796+0000","last_active":"2024-09-13T23:07:21.062072+0000","last_peered":"2024-09-13T23:07:21.062072+0000","last_clean":"2024-09-13T23:07:21.062072+0000","last_became_active":"2024-09-13T23:05:22.150415+0000","last_became_peered":"2024-09-13T23:05:22.150415+0000","last_unstale":"2024-09-13T23:07:21.062072+0000","last_undegraded":"2024-09-13T23:07:21.062072+0000","last_fullsized":"2024-09-13T23:07:21.062072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:56:02.493425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.321880+0000","last_change":"2024-09-13T23:05:14.123934+0000","last_active":"2024-09-13T23:08:22.321880+0000","last_peered":"2024-09-13T23:08:22.321880+0000","last_clean":"2024-09-13T23:08:22.321880+0000","last_became_active":"2024-09-13T23:05:14.123447+0000","last_became_peered":"2024-09-13T23:05:14.123447+0000","last_unstale":"2024-09-13T23:08:22.321880+0000","last_undegraded":"2024-09-13T23:08:22.321880+0000","last_fullsized":"2024-09-13T23:08:22.321880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:40.466898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.917869+0000","last_change":"2024-09-13T23:05:12.124402+0000","last_active":"2024-09-13T23:05:54.917869+0000","last_peered":"2024-09-13T23:05:54.917869+0000","last_clean":"2024-09-13T23:05:54.917869+0000","last_became_active":"2024-09-13T23:05:12.124005+0000","last_became_peered":"2024-09-13T23:05:12.124005+0000","last_unstale":"2024-09-13T23:05:54.917869+0000","last_undegraded":"2024-09-13T23:05:54.917869+0000","last_fullsized":"2024-09-13T23:05:54.917869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:51.362106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159745+0000","last_change":"2024-09-13T23:05:03.080556+0000","last_active":"2024-09-13T23:05:49.159745+0000","last_peered":"2024-09-13T23:05:49.159745+0000","last_clean":"2024-09-13T23:05:49.159745+0000","last_became_active":"2024-09-13T23:05:01.074963+0000","last_became_peered":"2024-09-13T23:05:01.074963+0000","last_unstale":"2024-09-13T23:05:49.159745+0000","last_undegraded":"2024-09-13T23:05:49.159745+0000","last_fullsized":"2024-09-13T23:05:49.159745+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:02.162649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055235699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.638099+0000","last_change":"2024-09-13T23:05:16.124473+0000","last_active":"2024-09-13T23:08:22.638099+0000","last_peered":"2024-09-13T23:08:22.638099+0000","last_clean":"2024-09-13T23:08:22.638099+0000","last_became_active":"2024-09-13T23:05:16.123971+0000","last_became_peered":"2024-09-13T23:05:16.123971+0000","last_unstale":"2024-09-13T23:08:22.638099+0000","last_undegraded":"2024-09-13T23:08:22.638099+0000","last_fullsized":"2024-09-13T23:08:22.638099+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:46:26.673828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'62","reported_seq":121,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.661697+0000","last_change":"2024-09-13T23:05:18.132525+0000","last_active":"2024-09-13T23:08:22.661697+0000","last_peered":"2024-09-13T23:08:22.661697+0000","last_clean":"2024-09-13T23:08:22.661697+0000","last_became_active":"2024-09-13T23:05:18.132051+0000","last_became_peered":"2024-09-13T23:05:18.132051+0000","last_unstale":"2024-09-13T23:08:22.661697+0000","last_undegraded":"2024-09-13T23:08:22.661697+0000","last_fullsized":"2024-09-13T23:08:22.661697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:44:32.951876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.152427+0000","last_change":"2024-09-13T23:05:20.143982+0000","last_active":"2024-09-13T23:05:49.152427+0000","last_peered":"2024-09-13T23:05:49.152427+0000","last_clean":"2024-09-13T23:05:49.152427+0000","last_became_active":"2024-09-13T23:05:20.143566+0000","last_became_peered":"2024-09-13T23:05:20.143566+0000","last_unstale":"2024-09-13T23:05:49.152427+0000","last_undegraded":"2024-09-13T23:05:49.152427+0000","last_fullsized":"2024-09-13T23:05:49.152427+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:27.338381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.471422+0000","last_change":"2024-09-13T23:05:22.138169+0000","last_active":"2024-09-13T23:08:22.471422+0000","last_peered":"2024-09-13T23:08:22.471422+0000","last_clean":"2024-09-13T23:08:22.471422+0000","last_became_active":"2024-09-13T23:05:22.137952+0000","last_became_peered":"2024-09-13T23:05:22.137952+0000","last_unstale":"2024-09-13T23:08:22.471422+0000","last_undegraded":"2024-09-13T23:08:22.471422+0000","last_fullsized":"2024-09-13T23:08:22.471422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:49.651698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.702466+0000","last_change":"2024-09-13T23:05:14.125712+0000","last_active":"2024-09-13T23:05:54.702466+0000","last_peered":"2024-09-13T23:05:54.702466+0000","last_clean":"2024-09-13T23:05:54.702466+0000","last_became_active":"2024-09-13T23:05:14.123549+0000","last_became_peered":"2024-09-13T23:05:14.123549+0000","last_unstale":"2024-09-13T23:05:54.702466+0000","last_undegraded":"2024-09-13T23:05:54.702466+0000","last_fullsized":"2024-09-13T23:05:54.702466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:14:21.159008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159984+0000","last_change":"2024-09-13T23:05:12.130717+0000","last_active":"2024-09-13T23:05:49.159984+0000","last_peered":"2024-09-13T23:05:49.159984+0000","last_clean":"2024-09-13T23:05:49.159984+0000","last_became_active":"2024-09-13T23:05:12.130285+0000","last_became_peered":"2024-09-13T23:05:12.130285+0000","last_unstale":"2024-09-13T23:05:49.159984+0000","last_undegraded":"2024-09-13T23:05:49.159984+0000","last_fullsized":"2024-09-13T23:05:49.159984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:20.143656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.163413+0000","last_change":"2024-09-13T23:05:03.078119+0000","last_active":"2024-09-13T23:05:49.163413+0000","last_peered":"2024-09-13T23:05:49.163413+0000","last_clean":"2024-09-13T23:05:49.163413+0000","last_became_active":"2024-09-13T23:05:01.075431+0000","last_became_peered":"2024-09-13T23:05:01.075431+0000","last_unstale":"2024-09-13T23:05:49.163413+0000","last_undegraded":"2024-09-13T23:05:49.163413+0000","last_fullsized":"2024-09-13T23:05:49.163413+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:22:31.741360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041474900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155165+0000","last_change":"2024-09-13T23:05:16.120645+0000","last_active":"2024-09-13T23:05:49.155165+0000","last_peered":"2024-09-13T23:05:49.155165+0000","last_clean":"2024-09-13T23:05:49.155165+0000","last_became_active":"2024-09-13T23:05:16.120337+0000","last_became_peered":"2024-09-13T23:05:16.120337+0000","last_unstale":"2024-09-13T23:05:49.155165+0000","last_undegraded":"2024-09-13T23:05:49.155165+0000","last_fullsized":"2024-09-13T23:05:49.155165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:19:50.556651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'16","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.934809+0000","last_change":"2024-09-13T23:05:18.134351+0000","last_active":"2024-09-13T23:05:54.934809+0000","last_peered":"2024-09-13T23:05:54.934809+0000","last_clean":"2024-09-13T23:05:54.934809+0000","last_became_active":"2024-09-13T23:05:18.133676+0000","last_became_peered":"2024-09-13T23:05:18.133676+0000","last_unstale":"2024-09-13T23:05:54.934809+0000","last_undegraded":"2024-09-13T23:05:54.934809+0000","last_fullsized":"2024-09-13T23:05:54.934809+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:38:10.583942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":355,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.205201+0000","last_change":"2024-09-13T23:05:20.135256+0000","last_active":"2024-09-13T23:08:21.205201+0000","last_peered":"2024-09-13T23:08:21.205201+0000","last_clean":"2024-09-13T23:08:21.205201+0000","last_became_active":"2024-09-13T23:05:20.133332+0000","last_became_peered":"2024-09-13T23:05:20.133332+0000","last_unstale":"2024-09-13T23:08:21.205201+0000","last_undegraded":"2024-09-13T23:08:21.205201+0000","last_fullsized":"2024-09-13T23:08:21.205201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:33.653779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.163699+0000","last_change":"2024-09-13T23:05:22.141887+0000","last_active":"2024-09-13T23:05:49.163699+0000","last_peered":"2024-09-13T23:05:49.163699+0000","last_clean":"2024-09-13T23:05:49.163699+0000","last_became_active":"2024-09-13T23:05:22.141618+0000","last_became_peered":"2024-09-13T23:05:22.141618+0000","last_unstale":"2024-09-13T23:05:49.163699+0000","last_undegraded":"2024-09-13T23:05:49.163699+0000","last_fullsized":"2024-09-13T23:05:49.163699+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:46.604024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'18","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.250583+0000","last_change":"2024-09-13T23:05:14.126543+0000","last_active":"2024-09-13T23:08:22.250583+0000","last_peered":"2024-09-13T23:08:22.250583+0000","last_clean":"2024-09-13T23:08:22.250583+0000","last_became_active":"2024-09-13T23:05:14.126280+0000","last_became_peered":"2024-09-13T23:05:14.126280+0000","last_unstale":"2024-09-13T23:08:22.250583+0000","last_undegraded":"2024-09-13T23:08:22.250583+0000","last_fullsized":"2024-09-13T23:08:22.250583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:15.304261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.921469+0000","last_change":"2024-09-13T23:05:12.149880+0000","last_active":"2024-09-13T23:05:54.921469+0000","last_peered":"2024-09-13T23:05:54.921469+0000","last_clean":"2024-09-13T23:05:54.921469+0000","last_became_active":"2024-09-13T23:05:12.149435+0000","last_became_peered":"2024-09-13T23:05:12.149435+0000","last_unstale":"2024-09-13T23:05:54.921469+0000","last_undegraded":"2024-09-13T23:05:54.921469+0000","last_fullsized":"2024-09-13T23:05:54.921469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:24.657126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160425+0000","last_change":"2024-09-13T23:05:03.080603+0000","last_active":"2024-09-13T23:05:49.160425+0000","last_peered":"2024-09-13T23:05:49.160425+0000","last_clean":"2024-09-13T23:05:49.160425+0000","last_became_active":"2024-09-13T23:05:01.074982+0000","last_became_peered":"2024-09-13T23:05:01.074982+0000","last_unstale":"2024-09-13T23:05:49.160425+0000","last_undegraded":"2024-09-13T23:05:49.160425+0000","last_fullsized":"2024-09-13T23:05:49.160425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:59:19.159167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054650599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155383+0000","last_change":"2024-09-13T23:05:16.123838+0000","last_active":"2024-09-13T23:05:49.155383+0000","last_peered":"2024-09-13T23:05:49.155383+0000","last_clean":"2024-09-13T23:05:49.155383+0000","last_became_active":"2024-09-13T23:05:16.123573+0000","last_became_peered":"2024-09-13T23:05:16.123573+0000","last_unstale":"2024-09-13T23:05:49.155383+0000","last_undegraded":"2024-09-13T23:05:49.155383+0000","last_fullsized":"2024-09-13T23:05:49.155383+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:46.249000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.455631+0000","last_change":"2024-09-13T23:05:18.132921+0000","last_active":"2024-09-13T23:06:37.455631+0000","last_peered":"2024-09-13T23:06:37.455631+0000","last_clean":"2024-09-13T23:06:37.455631+0000","last_became_active":"2024-09-13T23:05:18.132140+0000","last_became_peered":"2024-09-13T23:05:18.132140+0000","last_unstale":"2024-09-13T23:06:37.455631+0000","last_undegraded":"2024-09-13T23:06:37.455631+0000","last_fullsized":"2024-09-13T23:06:37.455631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:50.731504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'284","reported_seq":431,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.059765+0000","last_change":"2024-09-13T23:05:20.136524+0000","last_active":"2024-09-13T23:08:29.059765+0000","last_peered":"2024-09-13T23:08:29.059765+0000","last_clean":"2024-09-13T23:08:29.059765+0000","last_became_active":"2024-09-13T23:05:20.136036+0000","last_became_peered":"2024-09-13T23:05:20.136036+0000","last_unstale":"2024-09-13T23:08:29.059765+0000","last_undegraded":"2024-09-13T23:08:29.059765+0000","last_fullsized":"2024-09-13T23:08:29.059765+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:01:43.280761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157235+0000","last_change":"2024-09-13T23:05:22.145082+0000","last_active":"2024-09-13T23:05:49.157235+0000","last_peered":"2024-09-13T23:05:49.157235+0000","last_clean":"2024-09-13T23:05:49.157235+0000","last_became_active":"2024-09-13T23:05:22.144787+0000","last_became_peered":"2024-09-13T23:05:22.144787+0000","last_unstale":"2024-09-13T23:05:49.157235+0000","last_undegraded":"2024-09-13T23:05:49.157235+0000","last_fullsized":"2024-09-13T23:05:49.157235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:59.821393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.702234+0000","last_change":"2024-09-13T23:05:14.112813+0000","last_active":"2024-09-13T23:05:54.702234+0000","last_peered":"2024-09-13T23:05:54.702234+0000","last_clean":"2024-09-13T23:05:54.702234+0000","last_became_active":"2024-09-13T23:05:14.112565+0000","last_became_peered":"2024-09-13T23:05:14.112565+0000","last_unstale":"2024-09-13T23:05:54.702234+0000","last_undegraded":"2024-09-13T23:05:54.702234+0000","last_fullsized":"2024-09-13T23:05:54.702234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:50.584375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156509+0000","last_change":"2024-09-13T23:05:12.131805+0000","last_active":"2024-09-13T23:05:49.156509+0000","last_peered":"2024-09-13T23:05:49.156509+0000","last_clean":"2024-09-13T23:05:49.156509+0000","last_became_active":"2024-09-13T23:05:12.131413+0000","last_became_peered":"2024-09-13T23:05:12.131413+0000","last_unstale":"2024-09-13T23:05:49.156509+0000","last_undegraded":"2024-09-13T23:05:49.156509+0000","last_fullsized":"2024-09-13T23:05:49.156509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:58.196248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.164465+0000","last_change":"2024-09-13T23:05:03.078956+0000","last_active":"2024-09-13T23:05:49.164465+0000","last_peered":"2024-09-13T23:05:49.164465+0000","last_clean":"2024-09-13T23:05:49.164465+0000","last_became_active":"2024-09-13T23:05:01.323761+0000","last_became_peered":"2024-09-13T23:05:01.323761+0000","last_unstale":"2024-09-13T23:05:49.164465+0000","last_undegraded":"2024-09-13T23:05:49.164465+0000","last_fullsized":"2024-09-13T23:05:49.164465+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:39.972272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001181893,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157273+0000","last_change":"2024-09-13T23:05:16.121458+0000","last_active":"2024-09-13T23:05:49.157273+0000","last_peered":"2024-09-13T23:05:49.157273+0000","last_clean":"2024-09-13T23:05:49.157273+0000","last_became_active":"2024-09-13T23:05:16.120974+0000","last_became_peered":"2024-09-13T23:05:16.120974+0000","last_unstale":"2024-09-13T23:05:49.157273+0000","last_undegraded":"2024-09-13T23:05:49.157273+0000","last_fullsized":"2024-09-13T23:05:49.157273+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:12.719474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'91","reported_seq":175,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.175294+0000","last_change":"2024-09-13T23:05:18.138165+0000","last_active":"2024-09-13T23:08:29.175294+0000","last_peered":"2024-09-13T23:08:29.175294+0000","last_clean":"2024-09-13T23:08:29.175294+0000","last_became_active":"2024-09-13T23:05:18.137925+0000","last_became_peered":"2024-09-13T23:05:18.137925+0000","last_unstale":"2024-09-13T23:08:29.175294+0000","last_undegraded":"2024-09-13T23:08:29.175294+0000","last_fullsized":"2024-09-13T23:08:29.175294+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:15.845937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158600+0000","last_change":"2024-09-13T23:05:20.129880+0000","last_active":"2024-09-13T23:05:49.158600+0000","last_peered":"2024-09-13T23:05:49.158600+0000","last_clean":"2024-09-13T23:05:49.158600+0000","last_became_active":"2024-09-13T23:05:20.129363+0000","last_became_peered":"2024-09-13T23:05:20.129363+0000","last_unstale":"2024-09-13T23:05:49.158600+0000","last_undegraded":"2024-09-13T23:05:49.158600+0000","last_fullsized":"2024-09-13T23:05:49.158600+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:50.629881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157130+0000","last_change":"2024-09-13T23:05:22.151007+0000","last_active":"2024-09-13T23:05:49.157130+0000","last_peered":"2024-09-13T23:05:49.157130+0000","last_clean":"2024-09-13T23:05:49.157130+0000","last_became_active":"2024-09-13T23:05:22.149645+0000","last_became_peered":"2024-09-13T23:05:22.149645+0000","last_unstale":"2024-09-13T23:05:49.157130+0000","last_undegraded":"2024-09-13T23:05:49.157130+0000","last_fullsized":"2024-09-13T23:05:49.157130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:14.228653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160576+0000","last_change":"2024-09-13T23:05:22.151921+0000","last_active":"2024-09-13T23:05:49.160576+0000","last_peered":"2024-09-13T23:05:49.160576+0000","last_clean":"2024-09-13T23:05:49.160576+0000","last_became_active":"2024-09-13T23:05:22.151640+0000","last_became_peered":"2024-09-13T23:05:22.151640+0000","last_unstale":"2024-09-13T23:05:49.160576+0000","last_undegraded":"2024-09-13T23:05:49.160576+0000","last_fullsized":"2024-09-13T23:05:49.160576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:38:24.891059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'12","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.323823+0000","last_change":"2024-09-13T23:05:14.113491+0000","last_active":"2024-09-13T23:08:22.323823+0000","last_peered":"2024-09-13T23:08:22.323823+0000","last_clean":"2024-09-13T23:08:22.323823+0000","last_became_active":"2024-09-13T23:05:14.113236+0000","last_became_peered":"2024-09-13T23:05:14.113236+0000","last_unstale":"2024-09-13T23:08:22.323823+0000","last_undegraded":"2024-09-13T23:08:22.323823+0000","last_fullsized":"2024-09-13T23:08:22.323823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:05:09.963242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159820+0000","last_change":"2024-09-13T23:05:12.141658+0000","last_active":"2024-09-13T23:05:49.159820+0000","last_peered":"2024-09-13T23:05:49.159820+0000","last_clean":"2024-09-13T23:05:49.159820+0000","last_became_active":"2024-09-13T23:05:12.141280+0000","last_became_peered":"2024-09-13T23:05:12.141280+0000","last_unstale":"2024-09-13T23:05:49.159820+0000","last_undegraded":"2024-09-13T23:05:49.159820+0000","last_fullsized":"2024-09-13T23:05:49.159820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:07:17.099012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158953+0000","last_change":"2024-09-13T23:05:16.117775+0000","last_active":"2024-09-13T23:05:49.158953+0000","last_peered":"2024-09-13T23:05:49.158953+0000","last_clean":"2024-09-13T23:05:49.158953+0000","last_became_active":"2024-09-13T23:05:16.117468+0000","last_became_peered":"2024-09-13T23:05:16.117468+0000","last_unstale":"2024-09-13T23:05:49.158953+0000","last_undegraded":"2024-09-13T23:05:49.158953+0000","last_fullsized":"2024-09-13T23:05:49.158953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:24.938916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'37","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.206046+0000","last_change":"2024-09-13T23:05:18.132556+0000","last_active":"2024-09-13T23:08:29.206046+0000","last_peered":"2024-09-13T23:08:29.206046+0000","last_clean":"2024-09-13T23:08:29.206046+0000","last_became_active":"2024-09-13T23:05:18.131841+0000","last_became_peered":"2024-09-13T23:05:18.131841+0000","last_unstale":"2024-09-13T23:08:29.206046+0000","last_undegraded":"2024-09-13T23:08:29.206046+0000","last_fullsized":"2024-09-13T23:08:29.206046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:38.696780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158497+0000","last_change":"2024-09-13T23:05:20.140436+0000","last_active":"2024-09-13T23:05:49.158497+0000","last_peered":"2024-09-13T23:05:49.158497+0000","last_clean":"2024-09-13T23:05:49.158497+0000","last_became_active":"2024-09-13T23:05:20.138958+0000","last_became_peered":"2024-09-13T23:05:20.138958+0000","last_unstale":"2024-09-13T23:05:49.158497+0000","last_undegraded":"2024-09-13T23:05:49.158497+0000","last_fullsized":"2024-09-13T23:05:49.158497+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:06.294003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.301319+0000","last_change":"2024-09-13T23:05:22.141828+0000","last_active":"2024-09-13T23:08:22.301319+0000","last_peered":"2024-09-13T23:08:22.301319+0000","last_clean":"2024-09-13T23:08:22.301319+0000","last_became_active":"2024-09-13T23:05:22.141471+0000","last_became_peered":"2024-09-13T23:05:22.141471+0000","last_unstale":"2024-09-13T23:08:22.301319+0000","last_undegraded":"2024-09-13T23:08:22.301319+0000","last_fullsized":"2024-09-13T23:08:22.301319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:03:42.989142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'7","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:38.077521+0000","last_change":"2024-09-13T23:05:49.167955+0000","last_active":"2024-09-13T23:07:38.077521+0000","last_peered":"2024-09-13T23:07:38.077521+0000","last_clean":"2024-09-13T23:07:38.077521+0000","last_became_active":"2024-09-13T23:05:49.164131+0000","last_became_peered":"2024-09-13T23:05:49.164131+0000","last_unstale":"2024-09-13T23:07:38.077521+0000","last_undegraded":"2024-09-13T23:07:38.077521+0000","last_fullsized":"2024-09-13T23:07:38.077521+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:24.539346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.227909+0000","last_change":"2024-09-13T23:05:12.116495+0000","last_active":"2024-09-13T23:08:22.227909+0000","last_peered":"2024-09-13T23:08:22.227909+0000","last_clean":"2024-09-13T23:08:22.227909+0000","last_became_active":"2024-09-13T23:05:12.114343+0000","last_became_peered":"2024-09-13T23:05:12.114343+0000","last_unstale":"2024-09-13T23:08:22.227909+0000","last_undegraded":"2024-09-13T23:08:22.227909+0000","last_fullsized":"2024-09-13T23:08:22.227909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:32:52.891315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.162345+0000","last_change":"2024-09-13T23:05:49.160922+0000","last_active":"2024-09-13T23:05:49.162345+0000","last_peered":"2024-09-13T23:05:49.162345+0000","last_clean":"2024-09-13T23:05:49.162345+0000","last_became_active":"2024-09-13T23:05:49.160578+0000","last_became_peered":"2024-09-13T23:05:49.160578+0000","last_unstale":"2024-09-13T23:05:49.162345+0000","last_undegraded":"2024-09-13T23:05:49.162345+0000","last_fullsized":"2024-09-13T23:05:49.162345+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:35:20.664758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.511579+0000","last_change":"2024-09-13T23:05:18.121852+0000","last_active":"2024-09-13T23:08:21.511579+0000","last_peered":"2024-09-13T23:08:21.511579+0000","last_clean":"2024-09-13T23:08:21.511579+0000","last_became_active":"2024-09-13T23:05:18.121514+0000","last_became_peered":"2024-09-13T23:05:18.121514+0000","last_unstale":"2024-09-13T23:08:21.511579+0000","last_undegraded":"2024-09-13T23:08:21.511579+0000","last_fullsized":"2024-09-13T23:08:21.511579+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:00.097701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.152954+0000","last_change":"2024-09-13T23:05:20.140562+0000","last_active":"2024-09-13T23:05:49.152954+0000","last_peered":"2024-09-13T23:05:49.152954+0000","last_clean":"2024-09-13T23:05:49.152954+0000","last_became_active":"2024-09-13T23:05:20.140290+0000","last_became_peered":"2024-09-13T23:05:20.140290+0000","last_unstale":"2024-09-13T23:05:49.152954+0000","last_undegraded":"2024-09-13T23:05:49.152954+0000","last_fullsized":"2024-09-13T23:05:49.152954+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:10.783457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159676+0000","last_change":"2024-09-13T23:05:22.141270+0000","last_active":"2024-09-13T23:05:49.159676+0000","last_peered":"2024-09-13T23:05:49.159676+0000","last_clean":"2024-09-13T23:05:49.159676+0000","last_became_active":"2024-09-13T23:05:22.140963+0000","last_became_peered":"2024-09-13T23:05:22.140963+0000","last_unstale":"2024-09-13T23:05:49.159676+0000","last_undegraded":"2024-09-13T23:05:49.159676+0000","last_fullsized":"2024-09-13T23:05:49.159676+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:59.821393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.485370+0000","last_change":"2024-09-13T23:05:14.120821+0000","last_active":"2024-09-13T23:07:21.485370+0000","last_peered":"2024-09-13T23:07:21.485370+0000","last_clean":"2024-09-13T23:07:21.485370+0000","last_became_active":"2024-09-13T23:05:14.120354+0000","last_became_peered":"2024-09-13T23:05:14.120354+0000","last_unstale":"2024-09-13T23:07:21.485370+0000","last_undegraded":"2024-09-13T23:07:21.485370+0000","last_fullsized":"2024-09-13T23:07:21.485370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:55.219034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158478+0000","last_change":"2024-09-13T23:05:12.117147+0000","last_active":"2024-09-13T23:05:49.158478+0000","last_peered":"2024-09-13T23:05:49.158478+0000","last_clean":"2024-09-13T23:05:49.158478+0000","last_became_active":"2024-09-13T23:05:12.116819+0000","last_became_peered":"2024-09-13T23:05:12.116819+0000","last_unstale":"2024-09-13T23:05:49.158478+0000","last_undegraded":"2024-09-13T23:05:49.158478+0000","last_fullsized":"2024-09-13T23:05:49.158478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:23:49.530592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.152948+0000","last_change":"2024-09-13T23:05:16.124923+0000","last_active":"2024-09-13T23:05:49.152948+0000","last_peered":"2024-09-13T23:05:49.152948+0000","last_clean":"2024-09-13T23:05:49.152948+0000","last_became_active":"2024-09-13T23:05:16.124617+0000","last_became_peered":"2024-09-13T23:05:16.124617+0000","last_unstale":"2024-09-13T23:05:49.152948+0000","last_undegraded":"2024-09-13T23:05:49.152948+0000","last_fullsized":"2024-09-13T23:05:49.152948+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:44.922754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'41","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.660356+0000","last_change":"2024-09-13T23:05:18.126438+0000","last_active":"2024-09-13T23:08:22.660356+0000","last_peered":"2024-09-13T23:08:22.660356+0000","last_clean":"2024-09-13T23:08:22.660356+0000","last_became_active":"2024-09-13T23:05:18.126147+0000","last_became_peered":"2024-09-13T23:05:18.126147+0000","last_unstale":"2024-09-13T23:08:22.660356+0000","last_undegraded":"2024-09-13T23:08:22.660356+0000","last_fullsized":"2024-09-13T23:08:22.660356+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:02:19.823621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158713+0000","last_change":"2024-09-13T23:05:20.129082+0000","last_active":"2024-09-13T23:05:49.158713+0000","last_peered":"2024-09-13T23:05:49.158713+0000","last_clean":"2024-09-13T23:05:49.158713+0000","last_became_active":"2024-09-13T23:05:20.128756+0000","last_became_peered":"2024-09-13T23:05:20.128756+0000","last_unstale":"2024-09-13T23:05:49.158713+0000","last_undegraded":"2024-09-13T23:05:49.158713+0000","last_fullsized":"2024-09-13T23:05:49.158713+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:31.349343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157781+0000","last_change":"2024-09-13T23:05:22.144728+0000","last_active":"2024-09-13T23:05:49.157781+0000","last_peered":"2024-09-13T23:05:49.157781+0000","last_clean":"2024-09-13T23:05:49.157781+0000","last_became_active":"2024-09-13T23:05:22.143767+0000","last_became_peered":"2024-09-13T23:05:22.143767+0000","last_unstale":"2024-09-13T23:05:49.157781+0000","last_undegraded":"2024-09-13T23:05:49.157781+0000","last_fullsized":"2024-09-13T23:05:49.157781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:26.361850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157765+0000","last_change":"2024-09-13T23:05:14.127475+0000","last_active":"2024-09-13T23:05:49.157765+0000","last_peered":"2024-09-13T23:05:49.157765+0000","last_clean":"2024-09-13T23:05:49.157765+0000","last_became_active":"2024-09-13T23:05:14.127000+0000","last_became_peered":"2024-09-13T23:05:14.127000+0000","last_unstale":"2024-09-13T23:05:49.157765+0000","last_undegraded":"2024-09-13T23:05:49.157765+0000","last_fullsized":"2024-09-13T23:05:49.157765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:10:50.930163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158496+0000","last_change":"2024-09-13T23:05:12.136754+0000","last_active":"2024-09-13T23:05:49.158496+0000","last_peered":"2024-09-13T23:05:49.158496+0000","last_clean":"2024-09-13T23:05:49.158496+0000","last_became_active":"2024-09-13T23:05:12.136384+0000","last_became_peered":"2024-09-13T23:05:12.136384+0000","last_unstale":"2024-09-13T23:05:49.158496+0000","last_undegraded":"2024-09-13T23:05:49.158496+0000","last_fullsized":"2024-09-13T23:05:49.158496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:43.763766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155297+0000","last_change":"2024-09-13T23:05:16.124513+0000","last_active":"2024-09-13T23:05:49.155297+0000","last_peered":"2024-09-13T23:05:49.155297+0000","last_clean":"2024-09-13T23:05:49.155297+0000","last_became_active":"2024-09-13T23:05:16.124241+0000","last_became_peered":"2024-09-13T23:05:16.124241+0000","last_unstale":"2024-09-13T23:05:49.155297+0000","last_undegraded":"2024-09-13T23:05:49.155297+0000","last_fullsized":"2024-09-13T23:05:49.155297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:03:40.217865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'34","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.150975+0000","last_change":"2024-09-13T23:05:18.126644+0000","last_active":"2024-09-13T23:08:29.150975+0000","last_peered":"2024-09-13T23:08:29.150975+0000","last_clean":"2024-09-13T23:08:29.150975+0000","last_became_active":"2024-09-13T23:05:18.126188+0000","last_became_peered":"2024-09-13T23:05:18.126188+0000","last_unstale":"2024-09-13T23:08:29.150975+0000","last_undegraded":"2024-09-13T23:08:29.150975+0000","last_fullsized":"2024-09-13T23:08:29.150975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:56.228755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.153697+0000","last_change":"2024-09-13T23:05:20.136386+0000","last_active":"2024-09-13T23:05:49.153697+0000","last_peered":"2024-09-13T23:05:49.153697+0000","last_clean":"2024-09-13T23:05:49.153697+0000","last_became_active":"2024-09-13T23:05:20.136098+0000","last_became_peered":"2024-09-13T23:05:20.136098+0000","last_unstale":"2024-09-13T23:05:49.153697+0000","last_undegraded":"2024-09-13T23:05:49.153697+0000","last_fullsized":"2024-09-13T23:05:49.153697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:47:24.641764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'14","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.321638+0000","last_change":"2024-09-13T23:05:14.113061+0000","last_active":"2024-09-13T23:08:22.321638+0000","last_peered":"2024-09-13T23:08:22.321638+0000","last_clean":"2024-09-13T23:08:22.321638+0000","last_became_active":"2024-09-13T23:05:14.112822+0000","last_became_peered":"2024-09-13T23:05:14.112822+0000","last_unstale":"2024-09-13T23:08:22.321638+0000","last_undegraded":"2024-09-13T23:08:22.321638+0000","last_fullsized":"2024-09-13T23:08:22.321638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:52:37.741998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:53.841518+0000","last_change":"2024-09-13T23:05:12.143550+0000","last_active":"2024-09-13T23:05:53.841518+0000","last_peered":"2024-09-13T23:05:53.841518+0000","last_clean":"2024-09-13T23:05:53.841518+0000","last_became_active":"2024-09-13T23:05:12.141970+0000","last_became_peered":"2024-09-13T23:05:12.141970+0000","last_unstale":"2024-09-13T23:05:53.841518+0000","last_undegraded":"2024-09-13T23:05:53.841518+0000","last_fullsized":"2024-09-13T23:05:53.841518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:20.698878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160495+0000","last_change":"2024-09-13T23:05:16.120920+0000","last_active":"2024-09-13T23:05:49.160495+0000","last_peered":"2024-09-13T23:05:49.160495+0000","last_clean":"2024-09-13T23:05:49.160495+0000","last_became_active":"2024-09-13T23:05:16.120506+0000","last_became_peered":"2024-09-13T23:05:16.120506+0000","last_unstale":"2024-09-13T23:05:49.160495+0000","last_undegraded":"2024-09-13T23:05:49.160495+0000","last_fullsized":"2024-09-13T23:05:49.160495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:05.377747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'57","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:49.076315+0000","last_change":"2024-09-13T23:05:18.127151+0000","last_active":"2024-09-13T23:07:49.076315+0000","last_peered":"2024-09-13T23:07:49.076315+0000","last_clean":"2024-09-13T23:07:49.076315+0000","last_became_active":"2024-09-13T23:05:18.126811+0000","last_became_peered":"2024-09-13T23:05:18.126811+0000","last_unstale":"2024-09-13T23:07:49.076315+0000","last_undegraded":"2024-09-13T23:07:49.076315+0000","last_fullsized":"2024-09-13T23:07:49.076315+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:48.016939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":61,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.154053+0000","last_change":"2024-09-13T23:05:20.136237+0000","last_active":"2024-09-13T23:05:49.154053+0000","last_peered":"2024-09-13T23:05:49.154053+0000","last_clean":"2024-09-13T23:05:49.154053+0000","last_became_active":"2024-09-13T23:05:20.135886+0000","last_became_peered":"2024-09-13T23:05:20.135886+0000","last_unstale":"2024-09-13T23:05:49.154053+0000","last_undegraded":"2024-09-13T23:05:49.154053+0000","last_fullsized":"2024-09-13T23:05:49.154053+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:48:40.909454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.325312+0000","last_change":"2024-09-13T23:05:22.147716+0000","last_active":"2024-09-13T23:08:22.325312+0000","last_peered":"2024-09-13T23:08:22.325312+0000","last_clean":"2024-09-13T23:08:22.325312+0000","last_became_active":"2024-09-13T23:05:22.147394+0000","last_became_peered":"2024-09-13T23:05:22.147394+0000","last_unstale":"2024-09-13T23:08:22.325312+0000","last_undegraded":"2024-09-13T23:08:22.325312+0000","last_fullsized":"2024-09-13T23:08:22.325312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:04:57.442372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362850+0000","last_change":"2024-09-13T23:05:14.121676+0000","last_active":"2024-09-13T23:08:22.362850+0000","last_peered":"2024-09-13T23:08:22.362850+0000","last_clean":"2024-09-13T23:08:22.362850+0000","last_became_active":"2024-09-13T23:05:14.121349+0000","last_became_peered":"2024-09-13T23:05:14.121349+0000","last_unstale":"2024-09-13T23:08:22.362850+0000","last_undegraded":"2024-09-13T23:08:22.362850+0000","last_fullsized":"2024-09-13T23:08:22.362850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:57:39.861849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156531+0000","last_change":"2024-09-13T23:05:12.139567+0000","last_active":"2024-09-13T23:05:49.156531+0000","last_peered":"2024-09-13T23:05:49.156531+0000","last_clean":"2024-09-13T23:05:49.156531+0000","last_became_active":"2024-09-13T23:05:12.137092+0000","last_became_peered":"2024-09-13T23:05:12.137092+0000","last_unstale":"2024-09-13T23:05:49.156531+0000","last_undegraded":"2024-09-13T23:05:49.156531+0000","last_fullsized":"2024-09-13T23:05:49.156531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:26.997997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.161054+0000","last_change":"2024-09-13T23:05:16.121760+0000","last_active":"2024-09-13T23:05:49.161054+0000","last_peered":"2024-09-13T23:05:49.161054+0000","last_clean":"2024-09-13T23:05:49.161054+0000","last_became_active":"2024-09-13T23:05:16.121476+0000","last_became_peered":"2024-09-13T23:05:16.121476+0000","last_unstale":"2024-09-13T23:05:49.161054+0000","last_undegraded":"2024-09-13T23:05:49.161054+0000","last_fullsized":"2024-09-13T23:05:49.161054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:26:03.131986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'39","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.153872+0000","last_change":"2024-09-13T23:05:18.132726+0000","last_active":"2024-09-13T23:08:29.153872+0000","last_peered":"2024-09-13T23:08:29.153872+0000","last_clean":"2024-09-13T23:08:29.153872+0000","last_became_active":"2024-09-13T23:05:18.132060+0000","last_became_peered":"2024-09-13T23:05:18.132060+0000","last_unstale":"2024-09-13T23:08:29.153872+0000","last_undegraded":"2024-09-13T23:08:29.153872+0000","last_fullsized":"2024-09-13T23:08:29.153872+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:03.383636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155314+0000","last_change":"2024-09-13T23:05:20.140626+0000","last_active":"2024-09-13T23:05:49.155314+0000","last_peered":"2024-09-13T23:05:49.155314+0000","last_clean":"2024-09-13T23:05:49.155314+0000","last_became_active":"2024-09-13T23:05:20.140333+0000","last_became_peered":"2024-09-13T23:05:20.140333+0000","last_unstale":"2024-09-13T23:05:49.155314+0000","last_undegraded":"2024-09-13T23:05:49.155314+0000","last_fullsized":"2024-09-13T23:05:49.155314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:54:01.951032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155007+0000","last_change":"2024-09-13T23:05:22.140239+0000","last_active":"2024-09-13T23:05:49.155007+0000","last_peered":"2024-09-13T23:05:49.155007+0000","last_clean":"2024-09-13T23:05:49.155007+0000","last_became_active":"2024-09-13T23:05:22.139984+0000","last_became_peered":"2024-09-13T23:05:22.139984+0000","last_unstale":"2024-09-13T23:05:49.155007+0000","last_undegraded":"2024-09-13T23:05:49.155007+0000","last_fullsized":"2024-09-13T23:05:49.155007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:58.124207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362755+0000","last_change":"2024-09-13T23:05:14.125224+0000","last_active":"2024-09-13T23:08:22.362755+0000","last_peered":"2024-09-13T23:08:22.362755+0000","last_clean":"2024-09-13T23:08:22.362755+0000","last_became_active":"2024-09-13T23:05:14.124660+0000","last_became_peered":"2024-09-13T23:05:14.124660+0000","last_unstale":"2024-09-13T23:08:22.362755+0000","last_undegraded":"2024-09-13T23:08:22.362755+0000","last_fullsized":"2024-09-13T23:08:22.362755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:48.609572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159133+0000","last_change":"2024-09-13T23:05:12.141582+0000","last_active":"2024-09-13T23:05:49.159133+0000","last_peered":"2024-09-13T23:05:49.159133+0000","last_clean":"2024-09-13T23:05:49.159133+0000","last_became_active":"2024-09-13T23:05:12.137136+0000","last_became_peered":"2024-09-13T23:05:12.137136+0000","last_unstale":"2024-09-13T23:05:49.159133+0000","last_undegraded":"2024-09-13T23:05:49.159133+0000","last_fullsized":"2024-09-13T23:05:49.159133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:20.740109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.157357+0000","last_change":"2024-09-13T23:05:16.123946+0000","last_active":"2024-09-13T23:05:49.157357+0000","last_peered":"2024-09-13T23:05:49.157357+0000","last_clean":"2024-09-13T23:05:49.157357+0000","last_became_active":"2024-09-13T23:05:16.123607+0000","last_became_peered":"2024-09-13T23:05:16.123607+0000","last_unstale":"2024-09-13T23:05:49.157357+0000","last_undegraded":"2024-09-13T23:05:49.157357+0000","last_fullsized":"2024-09-13T23:05:49.157357+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:28.671096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'32","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.733164+0000","last_change":"2024-09-13T23:05:18.136609+0000","last_active":"2024-09-13T23:07:19.733164+0000","last_peered":"2024-09-13T23:07:19.733164+0000","last_clean":"2024-09-13T23:07:19.733164+0000","last_became_active":"2024-09-13T23:05:18.136279+0000","last_became_peered":"2024-09-13T23:05:18.136279+0000","last_unstale":"2024-09-13T23:07:19.733164+0000","last_undegraded":"2024-09-13T23:07:19.733164+0000","last_fullsized":"2024-09-13T23:07:19.733164+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:59.720739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160101+0000","last_change":"2024-09-13T23:05:20.141584+0000","last_active":"2024-09-13T23:05:49.160101+0000","last_peered":"2024-09-13T23:05:49.160101+0000","last_clean":"2024-09-13T23:05:49.160101+0000","last_became_active":"2024-09-13T23:05:20.141266+0000","last_became_peered":"2024-09-13T23:05:20.141266+0000","last_unstale":"2024-09-13T23:05:49.160101+0000","last_undegraded":"2024-09-13T23:05:49.160101+0000","last_fullsized":"2024-09-13T23:05:49.160101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:54:01.951032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'9","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.481681+0000","last_change":"2024-09-13T23:05:22.151767+0000","last_active":"2024-09-13T23:07:21.481681+0000","last_peered":"2024-09-13T23:07:21.481681+0000","last_clean":"2024-09-13T23:07:21.481681+0000","last_became_active":"2024-09-13T23:05:22.151339+0000","last_became_peered":"2024-09-13T23:05:22.151339+0000","last_unstale":"2024-09-13T23:07:21.481681+0000","last_undegraded":"2024-09-13T23:07:21.481681+0000","last_fullsized":"2024-09-13T23:07:21.481681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:27:36.638035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.322085+0000","last_change":"2024-09-13T23:05:14.112792+0000","last_active":"2024-09-13T23:08:22.322085+0000","last_peered":"2024-09-13T23:08:22.322085+0000","last_clean":"2024-09-13T23:08:22.322085+0000","last_became_active":"2024-09-13T23:05:14.112175+0000","last_became_peered":"2024-09-13T23:05:14.112175+0000","last_unstale":"2024-09-13T23:08:22.322085+0000","last_undegraded":"2024-09-13T23:08:22.322085+0000","last_fullsized":"2024-09-13T23:08:22.322085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:39.333340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159759+0000","last_change":"2024-09-13T23:05:12.141910+0000","last_active":"2024-09-13T23:05:49.159759+0000","last_peered":"2024-09-13T23:05:49.159759+0000","last_clean":"2024-09-13T23:05:49.159759+0000","last_became_active":"2024-09-13T23:05:12.141459+0000","last_became_peered":"2024-09-13T23:05:12.141459+0000","last_unstale":"2024-09-13T23:05:49.159759+0000","last_undegraded":"2024-09-13T23:05:49.159759+0000","last_fullsized":"2024-09-13T23:05:49.159759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:48.232382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"34'4","reported_seq":226,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:20.828655+0000","last_change":"2024-09-13T23:05:16.118050+0000","last_active":"2024-09-13T23:07:20.828655+0000","last_peered":"2024-09-13T23:07:20.828655+0000","last_clean":"2024-09-13T23:07:20.828655+0000","last_became_active":"2024-09-13T23:05:16.117736+0000","last_became_peered":"2024-09-13T23:05:16.117736+0000","last_unstale":"2024-09-13T23:07:20.828655+0000","last_undegraded":"2024-09-13T23:07:20.828655+0000","last_fullsized":"2024-09-13T23:07:20.828655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:34:57.565004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.163113+0000","last_change":"2024-09-13T23:05:18.133743+0000","last_active":"2024-09-13T23:05:49.163113+0000","last_peered":"2024-09-13T23:05:49.163113+0000","last_clean":"2024-09-13T23:05:49.163113+0000","last_became_active":"2024-09-13T23:05:18.132507+0000","last_became_peered":"2024-09-13T23:05:18.132507+0000","last_unstale":"2024-09-13T23:05:49.163113+0000","last_undegraded":"2024-09-13T23:05:49.163113+0000","last_fullsized":"2024-09-13T23:05:49.163113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:25:07.613170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":420,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.054200+0000","last_change":"2024-09-13T23:05:20.144647+0000","last_active":"2024-09-13T23:08:29.054200+0000","last_peered":"2024-09-13T23:08:29.054200+0000","last_clean":"2024-09-13T23:08:29.054200+0000","last_became_active":"2024-09-13T23:05:20.144334+0000","last_became_peered":"2024-09-13T23:05:20.144334+0000","last_unstale":"2024-09-13T23:08:29.054200+0000","last_undegraded":"2024-09-13T23:08:29.054200+0000","last_fullsized":"2024-09-13T23:08:29.054200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:55.153699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156789+0000","last_change":"2024-09-13T23:05:22.149167+0000","last_active":"2024-09-13T23:05:49.156789+0000","last_peered":"2024-09-13T23:05:49.156789+0000","last_clean":"2024-09-13T23:05:49.156789+0000","last_became_active":"2024-09-13T23:05:22.148894+0000","last_became_peered":"2024-09-13T23:05:22.148894+0000","last_unstale":"2024-09-13T23:05:49.156789+0000","last_undegraded":"2024-09-13T23:05:49.156789+0000","last_fullsized":"2024-09-13T23:05:49.156789+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:15.779050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.469692+0000","last_change":"2024-09-13T23:05:14.112197+0000","last_active":"2024-09-13T23:08:22.469692+0000","last_peered":"2024-09-13T23:08:22.469692+0000","last_clean":"2024-09-13T23:08:22.469692+0000","last_became_active":"2024-09-13T23:05:14.111891+0000","last_became_peered":"2024-09-13T23:05:14.111891+0000","last_unstale":"2024-09-13T23:08:22.469692+0000","last_undegraded":"2024-09-13T23:08:22.469692+0000","last_fullsized":"2024-09-13T23:08:22.469692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:22.016474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158445+0000","last_change":"2024-09-13T23:05:12.139920+0000","last_active":"2024-09-13T23:05:49.158445+0000","last_peered":"2024-09-13T23:05:49.158445+0000","last_clean":"2024-09-13T23:05:49.158445+0000","last_became_active":"2024-09-13T23:05:12.139564+0000","last_became_peered":"2024-09-13T23:05:12.139564+0000","last_unstale":"2024-09-13T23:05:49.158445+0000","last_undegraded":"2024-09-13T23:05:49.158445+0000","last_fullsized":"2024-09-13T23:05:49.158445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:48:38.750102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158925+0000","last_change":"2024-09-13T23:05:16.118845+0000","last_active":"2024-09-13T23:05:49.158925+0000","last_peered":"2024-09-13T23:05:49.158925+0000","last_clean":"2024-09-13T23:05:49.158925+0000","last_became_active":"2024-09-13T23:05:16.118353+0000","last_became_peered":"2024-09-13T23:05:16.118353+0000","last_unstale":"2024-09-13T23:05:49.158925+0000","last_undegraded":"2024-09-13T23:05:49.158925+0000","last_fullsized":"2024-09-13T23:05:49.158925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:58.090312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.706353+0000","last_change":"2024-09-13T23:05:18.129142+0000","last_active":"2024-09-13T23:07:19.706353+0000","last_peered":"2024-09-13T23:07:19.706353+0000","last_clean":"2024-09-13T23:07:19.706353+0000","last_became_active":"2024-09-13T23:05:18.127975+0000","last_became_peered":"2024-09-13T23:05:18.127975+0000","last_unstale":"2024-09-13T23:07:19.706353+0000","last_undegraded":"2024-09-13T23:07:19.706353+0000","last_fullsized":"2024-09-13T23:07:19.706353+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:19:28.546902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158396+0000","last_change":"2024-09-13T23:05:20.139596+0000","last_active":"2024-09-13T23:05:49.158396+0000","last_peered":"2024-09-13T23:05:49.158396+0000","last_clean":"2024-09-13T23:05:49.158396+0000","last_became_active":"2024-09-13T23:05:20.139329+0000","last_became_peered":"2024-09-13T23:05:20.139329+0000","last_unstale":"2024-09-13T23:05:49.158396+0000","last_undegraded":"2024-09-13T23:05:49.158396+0000","last_fullsized":"2024-09-13T23:05:49.158396+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:14.460878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159092+0000","last_change":"2024-09-13T23:05:22.148249+0000","last_active":"2024-09-13T23:05:49.159092+0000","last_peered":"2024-09-13T23:05:49.159092+0000","last_clean":"2024-09-13T23:05:49.159092+0000","last_became_active":"2024-09-13T23:05:22.147949+0000","last_became_peered":"2024-09-13T23:05:22.147949+0000","last_unstale":"2024-09-13T23:05:49.159092+0000","last_undegraded":"2024-09-13T23:05:49.159092+0000","last_fullsized":"2024-09-13T23:05:49.159092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:07.578205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:55.392471+0000","last_change":"2024-09-13T23:05:14.114061+0000","last_active":"2024-09-13T23:05:55.392471+0000","last_peered":"2024-09-13T23:05:55.392471+0000","last_clean":"2024-09-13T23:05:55.392471+0000","last_became_active":"2024-09-13T23:05:14.113816+0000","last_became_peered":"2024-09-13T23:05:14.113816+0000","last_unstale":"2024-09-13T23:05:55.392471+0000","last_undegraded":"2024-09-13T23:05:55.392471+0000","last_fullsized":"2024-09-13T23:05:55.392471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:31:40.142550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.162049+0000","last_change":"2024-09-13T23:05:12.149692+0000","last_active":"2024-09-13T23:05:49.162049+0000","last_peered":"2024-09-13T23:05:49.162049+0000","last_clean":"2024-09-13T23:05:49.162049+0000","last_became_active":"2024-09-13T23:05:12.149292+0000","last_became_peered":"2024-09-13T23:05:12.149292+0000","last_unstale":"2024-09-13T23:05:49.162049+0000","last_undegraded":"2024-09-13T23:05:49.162049+0000","last_fullsized":"2024-09-13T23:05:49.162049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:05:07.956349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155102+0000","last_change":"2024-09-13T23:05:16.128264+0000","last_active":"2024-09-13T23:05:49.155102+0000","last_peered":"2024-09-13T23:05:49.155102+0000","last_clean":"2024-09-13T23:05:49.155102+0000","last_became_active":"2024-09-13T23:05:16.128023+0000","last_became_peered":"2024-09-13T23:05:16.128023+0000","last_unstale":"2024-09-13T23:05:49.155102+0000","last_undegraded":"2024-09-13T23:05:49.155102+0000","last_fullsized":"2024-09-13T23:05:49.155102+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:29.344309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'31","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:44.075365+0000","last_change":"2024-09-13T23:05:18.132864+0000","last_active":"2024-09-13T23:07:44.075365+0000","last_peered":"2024-09-13T23:07:44.075365+0000","last_clean":"2024-09-13T23:07:44.075365+0000","last_became_active":"2024-09-13T23:05:18.132579+0000","last_became_peered":"2024-09-13T23:05:18.132579+0000","last_unstale":"2024-09-13T23:07:44.075365+0000","last_undegraded":"2024-09-13T23:07:44.075365+0000","last_fullsized":"2024-09-13T23:07:44.075365+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:26.946305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.154964+0000","last_change":"2024-09-13T23:05:20.136330+0000","last_active":"2024-09-13T23:05:49.154964+0000","last_peered":"2024-09-13T23:05:49.154964+0000","last_clean":"2024-09-13T23:05:49.154964+0000","last_became_active":"2024-09-13T23:05:20.136023+0000","last_became_peered":"2024-09-13T23:05:20.136023+0000","last_unstale":"2024-09-13T23:05:49.154964+0000","last_undegraded":"2024-09-13T23:05:49.154964+0000","last_fullsized":"2024-09-13T23:05:49.154964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:54.602234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.162874+0000","last_change":"2024-09-13T23:05:22.149740+0000","last_active":"2024-09-13T23:05:49.162874+0000","last_peered":"2024-09-13T23:05:49.162874+0000","last_clean":"2024-09-13T23:05:49.162874+0000","last_became_active":"2024-09-13T23:05:22.149468+0000","last_became_peered":"2024-09-13T23:05:22.149468+0000","last_unstale":"2024-09-13T23:05:49.162874+0000","last_undegraded":"2024-09-13T23:05:49.162874+0000","last_fullsized":"2024-09-13T23:05:49.162874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:05.061174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079088+0000","last_change":"2024-09-13T23:05:14.109581+0000","last_active":"2024-09-13T23:07:42.079088+0000","last_peered":"2024-09-13T23:07:42.079088+0000","last_clean":"2024-09-13T23:07:42.079088+0000","last_became_active":"2024-09-13T23:05:14.109323+0000","last_became_peered":"2024-09-13T23:05:14.109323+0000","last_unstale":"2024-09-13T23:07:42.079088+0000","last_undegraded":"2024-09-13T23:07:42.079088+0000","last_fullsized":"2024-09-13T23:07:42.079088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:09.879028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160689+0000","last_change":"2024-09-13T23:05:12.121655+0000","last_active":"2024-09-13T23:05:49.160689+0000","last_peered":"2024-09-13T23:05:49.160689+0000","last_clean":"2024-09-13T23:05:49.160689+0000","last_became_active":"2024-09-13T23:05:12.121050+0000","last_became_peered":"2024-09-13T23:05:12.121050+0000","last_unstale":"2024-09-13T23:05:49.160689+0000","last_undegraded":"2024-09-13T23:05:49.160689+0000","last_fullsized":"2024-09-13T23:05:49.160689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:12.628284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"25'1","reported_seq":218,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:20.838539+0000","last_change":"2024-09-13T23:05:16.123977+0000","last_active":"2024-09-13T23:07:20.838539+0000","last_peered":"2024-09-13T23:07:20.838539+0000","last_clean":"2024-09-13T23:07:20.838539+0000","last_became_active":"2024-09-13T23:05:16.123673+0000","last_became_peered":"2024-09-13T23:05:16.123673+0000","last_unstale":"2024-09-13T23:07:20.838539+0000","last_undegraded":"2024-09-13T23:07:20.838539+0000","last_fullsized":"2024-09-13T23:07:20.838539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:04.185929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'29","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.211762+0000","last_change":"2024-09-13T23:05:18.134891+0000","last_active":"2024-09-13T23:08:29.211762+0000","last_peered":"2024-09-13T23:08:29.211762+0000","last_clean":"2024-09-13T23:08:29.211762+0000","last_became_active":"2024-09-13T23:05:18.134152+0000","last_became_peered":"2024-09-13T23:05:18.134152+0000","last_unstale":"2024-09-13T23:08:29.211762+0000","last_undegraded":"2024-09-13T23:08:29.211762+0000","last_fullsized":"2024-09-13T23:08:29.211762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:38.762106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155513+0000","last_change":"2024-09-13T23:05:20.139704+0000","last_active":"2024-09-13T23:05:49.155513+0000","last_peered":"2024-09-13T23:05:49.155513+0000","last_clean":"2024-09-13T23:05:49.155513+0000","last_became_active":"2024-09-13T23:05:20.139133+0000","last_became_peered":"2024-09-13T23:05:20.139133+0000","last_unstale":"2024-09-13T23:05:49.155513+0000","last_undegraded":"2024-09-13T23:05:49.155513+0000","last_fullsized":"2024-09-13T23:05:49.155513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:54.483387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'12","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.740945+0000","last_change":"2024-09-13T23:05:22.144173+0000","last_active":"2024-09-13T23:07:19.740945+0000","last_peered":"2024-09-13T23:07:19.740945+0000","last_clean":"2024-09-13T23:07:19.740945+0000","last_became_active":"2024-09-13T23:05:22.143886+0000","last_became_peered":"2024-09-13T23:05:22.143886+0000","last_unstale":"2024-09-13T23:07:19.740945+0000","last_undegraded":"2024-09-13T23:07:19.740945+0000","last_fullsized":"2024-09-13T23:07:19.740945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:32.073594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":59,"num_write":33,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:55.392329+0000","last_change":"2024-09-13T23:05:14.112092+0000","last_active":"2024-09-13T23:05:55.392329+0000","last_peered":"2024-09-13T23:05:55.392329+0000","last_clean":"2024-09-13T23:05:55.392329+0000","last_became_active":"2024-09-13T23:05:14.111836+0000","last_became_peered":"2024-09-13T23:05:14.111836+0000","last_unstale":"2024-09-13T23:05:55.392329+0000","last_undegraded":"2024-09-13T23:05:55.392329+0000","last_fullsized":"2024-09-13T23:05:55.392329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:12:02.291251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159037+0000","last_change":"2024-09-13T23:05:12.135245+0000","last_active":"2024-09-13T23:05:49.159037+0000","last_peered":"2024-09-13T23:05:49.159037+0000","last_clean":"2024-09-13T23:05:49.159037+0000","last_became_active":"2024-09-13T23:05:12.134820+0000","last_became_peered":"2024-09-13T23:05:12.134820+0000","last_unstale":"2024-09-13T23:05:49.159037+0000","last_undegraded":"2024-09-13T23:05:49.159037+0000","last_fullsized":"2024-09-13T23:05:49.159037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:36.907610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:18.281573+0000","last_change":"2024-09-13T23:05:16.124579+0000","last_active":"2024-09-13T23:07:18.281573+0000","last_peered":"2024-09-13T23:07:18.281573+0000","last_clean":"2024-09-13T23:07:18.281573+0000","last_became_active":"2024-09-13T23:05:16.124295+0000","last_became_peered":"2024-09-13T23:05:16.124295+0000","last_unstale":"2024-09-13T23:07:18.281573+0000","last_undegraded":"2024-09-13T23:07:18.281573+0000","last_fullsized":"2024-09-13T23:07:18.281573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:53:47.490114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'35","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.108554+0000","last_change":"2024-09-13T23:05:18.132070+0000","last_active":"2024-09-13T23:08:29.108554+0000","last_peered":"2024-09-13T23:08:29.108554+0000","last_clean":"2024-09-13T23:08:29.108554+0000","last_became_active":"2024-09-13T23:05:18.131796+0000","last_became_peered":"2024-09-13T23:05:18.131796+0000","last_unstale":"2024-09-13T23:08:29.108554+0000","last_undegraded":"2024-09-13T23:08:29.108554+0000","last_fullsized":"2024-09-13T23:08:29.108554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:56.183512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.159253+0000","last_change":"2024-09-13T23:05:20.145706+0000","last_active":"2024-09-13T23:05:49.159253+0000","last_peered":"2024-09-13T23:05:49.159253+0000","last_clean":"2024-09-13T23:05:49.159253+0000","last_became_active":"2024-09-13T23:05:20.145356+0000","last_became_peered":"2024-09-13T23:05:20.145356+0000","last_unstale":"2024-09-13T23:05:49.159253+0000","last_undegraded":"2024-09-13T23:05:49.159253+0000","last_fullsized":"2024-09-13T23:05:49.159253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:54.194855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.743464+0000","last_change":"2024-09-13T23:05:22.147988+0000","last_active":"2024-09-13T23:07:19.743464+0000","last_peered":"2024-09-13T23:07:19.743464+0000","last_clean":"2024-09-13T23:07:19.743464+0000","last_became_active":"2024-09-13T23:05:22.147707+0000","last_became_peered":"2024-09-13T23:05:22.147707+0000","last_unstale":"2024-09-13T23:07:19.743464+0000","last_undegraded":"2024-09-13T23:07:19.743464+0000","last_fullsized":"2024-09-13T23:07:19.743464+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:27.322255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'16","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.250273+0000","last_change":"2024-09-13T23:05:14.123908+0000","last_active":"2024-09-13T23:08:22.250273+0000","last_peered":"2024-09-13T23:08:22.250273+0000","last_clean":"2024-09-13T23:08:22.250273+0000","last_became_active":"2024-09-13T23:05:14.123513+0000","last_became_peered":"2024-09-13T23:05:14.123513+0000","last_unstale":"2024-09-13T23:08:22.250273+0000","last_undegraded":"2024-09-13T23:08:22.250273+0000","last_fullsized":"2024-09-13T23:08:22.250273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:10.807036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.911000+0000","last_change":"2024-09-13T23:05:12.129469+0000","last_active":"2024-09-13T23:08:21.911000+0000","last_peered":"2024-09-13T23:08:21.911000+0000","last_clean":"2024-09-13T23:08:21.911000+0000","last_became_active":"2024-09-13T23:05:12.125740+0000","last_became_peered":"2024-09-13T23:05:12.125740+0000","last_unstale":"2024-09-13T23:08:21.911000+0000","last_undegraded":"2024-09-13T23:08:21.911000+0000","last_fullsized":"2024-09-13T23:08:21.911000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:29.212129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.322046+0000","last_change":"2024-09-13T23:05:14.110713+0000","last_active":"2024-09-13T23:08:22.322046+0000","last_peered":"2024-09-13T23:08:22.322046+0000","last_clean":"2024-09-13T23:08:22.322046+0000","last_became_active":"2024-09-13T23:05:14.109959+0000","last_became_peered":"2024-09-13T23:05:14.109959+0000","last_unstale":"2024-09-13T23:08:22.322046+0000","last_undegraded":"2024-09-13T23:08:22.322046+0000","last_fullsized":"2024-09-13T23:08:22.322046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:14:21.159008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.463371+0000","last_change":"2024-09-13T23:05:12.114302+0000","last_active":"2024-09-13T23:07:21.463371+0000","last_peered":"2024-09-13T23:07:21.463371+0000","last_clean":"2024-09-13T23:07:21.463371+0000","last_became_active":"2024-09-13T23:05:12.113972+0000","last_became_peered":"2024-09-13T23:05:12.113972+0000","last_unstale":"2024-09-13T23:07:21.463371+0000","last_undegraded":"2024-09-13T23:07:21.463371+0000","last_fullsized":"2024-09-13T23:07:21.463371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:48:38.750102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'10","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362921+0000","last_change":"2024-09-13T23:05:49.165777+0000","last_active":"2024-09-13T23:08:22.362921+0000","last_peered":"2024-09-13T23:08:22.362921+0000","last_clean":"2024-09-13T23:08:22.362921+0000","last_became_active":"2024-09-13T23:05:49.159488+0000","last_became_peered":"2024-09-13T23:05:49.159488+0000","last_unstale":"2024-09-13T23:08:22.362921+0000","last_undegraded":"2024-09-13T23:08:22.362921+0000","last_fullsized":"2024-09-13T23:08:22.362921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:40.422062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.966513+0000","last_change":"2024-09-13T23:05:12.140088+0000","last_active":"2024-09-13T23:08:21.966513+0000","last_peered":"2024-09-13T23:08:21.966513+0000","last_clean":"2024-09-13T23:08:21.966513+0000","last_became_active":"2024-09-13T23:05:12.139673+0000","last_became_peered":"2024-09-13T23:05:12.139673+0000","last_unstale":"2024-09-13T23:08:21.966513+0000","last_undegraded":"2024-09-13T23:08:21.966513+0000","last_fullsized":"2024-09-13T23:08:21.966513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:32:20.507188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'9","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.257272+0000","last_change":"2024-09-13T23:05:14.112656+0000","last_active":"2024-09-13T23:08:22.257272+0000","last_peered":"2024-09-13T23:08:22.257272+0000","last_clean":"2024-09-13T23:08:22.257272+0000","last_became_active":"2024-09-13T23:05:14.112168+0000","last_became_peered":"2024-09-13T23:05:14.112168+0000","last_unstale":"2024-09-13T23:08:22.257272+0000","last_undegraded":"2024-09-13T23:08:22.257272+0000","last_fullsized":"2024-09-13T23:08:22.257272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:08.501106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160289+0000","last_change":"2024-09-13T23:05:12.118979+0000","last_active":"2024-09-13T23:05:49.160289+0000","last_peered":"2024-09-13T23:05:49.160289+0000","last_clean":"2024-09-13T23:05:49.160289+0000","last_became_active":"2024-09-13T23:05:12.118425+0000","last_became_peered":"2024-09-13T23:05:12.118425+0000","last_unstale":"2024-09-13T23:05:49.160289+0000","last_undegraded":"2024-09-13T23:05:49.160289+0000","last_fullsized":"2024-09-13T23:05:49.160289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:36.907610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'14","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362935+0000","last_change":"2024-09-13T23:05:14.120992+0000","last_active":"2024-09-13T23:08:22.362935+0000","last_peered":"2024-09-13T23:08:22.362935+0000","last_clean":"2024-09-13T23:08:22.362935+0000","last_became_active":"2024-09-13T23:05:14.120456+0000","last_became_peered":"2024-09-13T23:05:14.120456+0000","last_unstale":"2024-09-13T23:08:22.362935+0000","last_undegraded":"2024-09-13T23:08:22.362935+0000","last_fullsized":"2024-09-13T23:08:22.362935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:33:19.901997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160111+0000","last_change":"2024-09-13T23:05:12.114509+0000","last_active":"2024-09-13T23:05:49.160111+0000","last_peered":"2024-09-13T23:05:49.160111+0000","last_clean":"2024-09-13T23:05:49.160111+0000","last_became_active":"2024-09-13T23:05:12.114046+0000","last_became_peered":"2024-09-13T23:05:12.114046+0000","last_unstale":"2024-09-13T23:05:49.160111+0000","last_undegraded":"2024-09-13T23:05:49.160111+0000","last_fullsized":"2024-09-13T23:05:49.160111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:04.782795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.161547+0000","last_change":"2024-09-13T23:05:14.124864+0000","last_active":"2024-09-13T23:05:49.161547+0000","last_peered":"2024-09-13T23:05:49.161547+0000","last_clean":"2024-09-13T23:05:49.161547+0000","last_became_active":"2024-09-13T23:05:14.123783+0000","last_became_peered":"2024-09-13T23:05:14.123783+0000","last_unstale":"2024-09-13T23:05:49.161547+0000","last_undegraded":"2024-09-13T23:05:49.161547+0000","last_fullsized":"2024-09-13T23:05:49.161547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:21.273774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.293717+0000","last_change":"2024-09-13T23:05:12.140004+0000","last_active":"2024-09-13T23:07:21.293717+0000","last_peered":"2024-09-13T23:07:21.293717+0000","last_clean":"2024-09-13T23:07:21.293717+0000","last_became_active":"2024-09-13T23:05:12.137465+0000","last_became_peered":"2024-09-13T23:05:12.137465+0000","last_unstale":"2024-09-13T23:07:21.293717+0000","last_undegraded":"2024-09-13T23:07:21.293717+0000","last_fullsized":"2024-09-13T23:07:21.293717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:29.788894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.701866+0000","last_change":"2024-09-13T23:05:14.121847+0000","last_active":"2024-09-13T23:05:54.701866+0000","last_peered":"2024-09-13T23:05:54.701866+0000","last_clean":"2024-09-13T23:05:54.701866+0000","last_became_active":"2024-09-13T23:05:14.121425+0000","last_became_peered":"2024-09-13T23:05:14.121425+0000","last_unstale":"2024-09-13T23:05:54.701866+0000","last_undegraded":"2024-09-13T23:05:54.701866+0000","last_fullsized":"2024-09-13T23:05:54.701866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:02.456301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158590+0000","last_change":"2024-09-13T23:05:12.116219+0000","last_active":"2024-09-13T23:05:49.158590+0000","last_peered":"2024-09-13T23:05:49.158590+0000","last_clean":"2024-09-13T23:05:49.158590+0000","last_became_active":"2024-09-13T23:05:12.115546+0000","last_became_peered":"2024-09-13T23:05:12.115546+0000","last_unstale":"2024-09-13T23:05:49.158590+0000","last_undegraded":"2024-09-13T23:05:49.158590+0000","last_fullsized":"2024-09-13T23:05:49.158590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:46.740162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.321747+0000","last_change":"2024-09-13T23:05:14.123460+0000","last_active":"2024-09-13T23:08:22.321747+0000","last_peered":"2024-09-13T23:08:22.321747+0000","last_clean":"2024-09-13T23:08:22.321747+0000","last_became_active":"2024-09-13T23:05:14.122944+0000","last_became_peered":"2024-09-13T23:05:14.122944+0000","last_unstale":"2024-09-13T23:08:22.321747+0000","last_undegraded":"2024-09-13T23:08:22.321747+0000","last_fullsized":"2024-09-13T23:08:22.321747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:27.479160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:24.072349+0000","last_change":"2024-09-13T23:05:12.119016+0000","last_active":"2024-09-13T23:07:24.072349+0000","last_peered":"2024-09-13T23:07:24.072349+0000","last_clean":"2024-09-13T23:07:24.072349+0000","last_became_active":"2024-09-13T23:05:12.118347+0000","last_became_peered":"2024-09-13T23:05:12.118347+0000","last_unstale":"2024-09-13T23:07:24.072349+0000","last_undegraded":"2024-09-13T23:07:24.072349+0000","last_fullsized":"2024-09-13T23:07:24.072349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:22.242350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.452882+0000","last_change":"2024-09-13T23:05:14.126164+0000","last_active":"2024-09-13T23:06:37.452882+0000","last_peered":"2024-09-13T23:06:37.452882+0000","last_clean":"2024-09-13T23:06:37.452882+0000","last_became_active":"2024-09-13T23:05:14.124593+0000","last_became_peered":"2024-09-13T23:05:14.124593+0000","last_unstale":"2024-09-13T23:06:37.452882+0000","last_undegraded":"2024-09-13T23:06:37.452882+0000","last_fullsized":"2024-09-13T23:06:37.452882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:44.195143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.878523+0000","last_change":"2024-09-13T23:05:12.144032+0000","last_active":"2024-09-13T23:08:21.878523+0000","last_peered":"2024-09-13T23:08:21.878523+0000","last_clean":"2024-09-13T23:08:21.878523+0000","last_became_active":"2024-09-13T23:05:12.141628+0000","last_became_peered":"2024-09-13T23:05:12.141628+0000","last_unstale":"2024-09-13T23:08:21.878523+0000","last_undegraded":"2024-09-13T23:08:21.878523+0000","last_fullsized":"2024-09-13T23:08:21.878523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:15.223430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.701817+0000","last_change":"2024-09-13T23:05:14.113960+0000","last_active":"2024-09-13T23:05:54.701817+0000","last_peered":"2024-09-13T23:05:54.701817+0000","last_clean":"2024-09-13T23:05:54.701817+0000","last_became_active":"2024-09-13T23:05:14.113710+0000","last_became_peered":"2024-09-13T23:05:14.113710+0000","last_unstale":"2024-09-13T23:05:54.701817+0000","last_undegraded":"2024-09-13T23:05:54.701817+0000","last_fullsized":"2024-09-13T23:05:54.701817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:34.129089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158574+0000","last_change":"2024-09-13T23:05:12.119408+0000","last_active":"2024-09-13T23:05:49.158574+0000","last_peered":"2024-09-13T23:05:49.158574+0000","last_clean":"2024-09-13T23:05:49.158574+0000","last_became_active":"2024-09-13T23:05:12.118716+0000","last_became_peered":"2024-09-13T23:05:12.118716+0000","last_unstale":"2024-09-13T23:05:49.158574+0000","last_undegraded":"2024-09-13T23:05:49.158574+0000","last_fullsized":"2024-09-13T23:05:49.158574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:51.066283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:37.263470+0000","last_change":"2024-09-13T23:05:14.120905+0000","last_active":"2024-09-13T23:06:37.263470+0000","last_peered":"2024-09-13T23:06:37.263470+0000","last_clean":"2024-09-13T23:06:37.263470+0000","last_became_active":"2024-09-13T23:05:14.120489+0000","last_became_peered":"2024-09-13T23:05:14.120489+0000","last_unstale":"2024-09-13T23:06:37.263470+0000","last_undegraded":"2024-09-13T23:06:37.263470+0000","last_fullsized":"2024-09-13T23:06:37.263470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:34.163619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:54.911022+0000","last_change":"2024-09-13T23:05:12.141835+0000","last_active":"2024-09-13T23:05:54.911022+0000","last_peered":"2024-09-13T23:05:54.911022+0000","last_clean":"2024-09-13T23:05:54.911022+0000","last_became_active":"2024-09-13T23:05:12.137735+0000","last_became_peered":"2024-09-13T23:05:12.137735+0000","last_unstale":"2024-09-13T23:05:54.911022+0000","last_undegraded":"2024-09-13T23:05:54.911022+0000","last_fullsized":"2024-09-13T23:05:54.911022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:14:55.200398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'3","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:33.076769+0000","last_change":"2024-09-13T23:05:14.122103+0000","last_active":"2024-09-13T23:07:33.076769+0000","last_peered":"2024-09-13T23:07:33.076769+0000","last_clean":"2024-09-13T23:07:33.076769+0000","last_became_active":"2024-09-13T23:05:14.121389+0000","last_became_peered":"2024-09-13T23:05:14.121389+0000","last_unstale":"2024-09-13T23:07:33.076769+0000","last_undegraded":"2024-09-13T23:07:33.076769+0000","last_fullsized":"2024-09-13T23:07:33.076769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:57:39.861849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.155167+0000","last_change":"2024-09-13T23:05:12.139774+0000","last_active":"2024-09-13T23:05:49.155167+0000","last_peered":"2024-09-13T23:05:49.155167+0000","last_clean":"2024-09-13T23:05:49.155167+0000","last_became_active":"2024-09-13T23:05:12.137118+0000","last_became_peered":"2024-09-13T23:05:12.137118+0000","last_unstale":"2024-09-13T23:05:49.155167+0000","last_undegraded":"2024-09-13T23:05:49.155167+0000","last_fullsized":"2024-09-13T23:05:49.155167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:01:21.996979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.362651+0000","last_change":"2024-09-13T23:05:14.125962+0000","last_active":"2024-09-13T23:08:22.362651+0000","last_peered":"2024-09-13T23:08:22.362651+0000","last_clean":"2024-09-13T23:08:22.362651+0000","last_became_active":"2024-09-13T23:05:14.124507+0000","last_became_peered":"2024-09-13T23:05:14.124507+0000","last_unstale":"2024-09-13T23:08:22.362651+0000","last_undegraded":"2024-09-13T23:08:22.362651+0000","last_fullsized":"2024-09-13T23:08:22.362651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:39.333340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.160223+0000","last_change":"2024-09-13T23:05:12.138932+0000","last_active":"2024-09-13T23:05:49.160223+0000","last_peered":"2024-09-13T23:05:49.160223+0000","last_clean":"2024-09-13T23:05:49.160223+0000","last_became_active":"2024-09-13T23:05:12.138577+0000","last_became_peered":"2024-09-13T23:05:12.138577+0000","last_unstale":"2024-09-13T23:05:49.160223+0000","last_undegraded":"2024-09-13T23:05:49.160223+0000","last_fullsized":"2024-09-13T23:05:49.160223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:20.700653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.257347+0000","last_change":"2024-09-13T23:05:14.125069+0000","last_active":"2024-09-13T23:08:22.257347+0000","last_peered":"2024-09-13T23:08:22.257347+0000","last_clean":"2024-09-13T23:08:22.257347+0000","last_became_active":"2024-09-13T23:05:14.124604+0000","last_became_peered":"2024-09-13T23:05:14.124604+0000","last_unstale":"2024-09-13T23:08:22.257347+0000","last_undegraded":"2024-09-13T23:08:22.257347+0000","last_fullsized":"2024-09-13T23:08:22.257347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:41.404040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.162242+0000","last_change":"2024-09-13T23:05:12.141608+0000","last_active":"2024-09-13T23:05:49.162242+0000","last_peered":"2024-09-13T23:05:49.162242+0000","last_clean":"2024-09-13T23:05:49.162242+0000","last_became_active":"2024-09-13T23:05:12.140686+0000","last_became_peered":"2024-09-13T23:05:12.140686+0000","last_unstale":"2024-09-13T23:05:49.162242+0000","last_undegraded":"2024-09-13T23:05:49.162242+0000","last_fullsized":"2024-09-13T23:05:49.162242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:59:19.940880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.156146+0000","last_change":"2024-09-13T23:05:14.126009+0000","last_active":"2024-09-13T23:05:49.156146+0000","last_peered":"2024-09-13T23:05:49.156146+0000","last_clean":"2024-09-13T23:05:49.156146+0000","last_became_active":"2024-09-13T23:05:14.125747+0000","last_became_peered":"2024-09-13T23:05:14.125747+0000","last_unstale":"2024-09-13T23:05:49.156146+0000","last_undegraded":"2024-09-13T23:05:49.156146+0000","last_fullsized":"2024-09-13T23:05:49.156146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:34:19.493607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.158853+0000","last_change":"2024-09-13T23:05:12.126550+0000","last_active":"2024-09-13T23:05:49.158853+0000","last_peered":"2024-09-13T23:05:49.158853+0000","last_clean":"2024-09-13T23:05:49.158853+0000","last_became_active":"2024-09-13T23:05:12.126202+0000","last_became_peered":"2024-09-13T23:05:12.126202+0000","last_unstale":"2024-09-13T23:05:49.158853+0000","last_undegraded":"2024-09-13T23:05:49.158853+0000","last_fullsized":"2024-09-13T23:05:49.158853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:31.807454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.100783+0000","last_change":"2024-09-13T23:05:14.125692+0000","last_active":"2024-09-13T23:08:22.100783+0000","last_peered":"2024-09-13T23:08:22.100783+0000","last_clean":"2024-09-13T23:08:22.100783+0000","last_became_active":"2024-09-13T23:05:14.125457+0000","last_became_peered":"2024-09-13T23:05:14.125457+0000","last_unstale":"2024-09-13T23:08:22.100783+0000","last_undegraded":"2024-09-13T23:08:22.100783+0000","last_fullsized":"2024-09-13T23:08:22.100783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:30.709764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:05:49.164256+0000","last_change":"2024-09-13T23:05:12.150036+0000","last_active":"2024-09-13T23:05:49.164256+0000","last_peered":"2024-09-13T23:05:49.164256+0000","last_clean":"2024-09-13T23:05:49.164256+0000","last_became_active":"2024-09-13T23:05:12.149345+0000","last_became_peered":"2024-09-13T23:05:12.149345+0000","last_unstale":"2024-09-13T23:05:49.164256+0000","last_undegraded":"2024-09-13T23:05:49.164256+0000","last_fullsized":"2024-09-13T23:05:49.164256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:08.953763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:17.897299+0000","last_change":"2024-09-13T23:05:12.142386+0000","last_active":"2024-09-13T23:07:17.897299+0000","last_peered":"2024-09-13T23:07:17.897299+0000","last_clean":"2024-09-13T23:07:17.897299+0000","last_became_active":"2024-09-13T23:05:12.140432+0000","last_became_peered":"2024-09-13T23:05:12.140432+0000","last_unstale":"2024-09-13T23:07:17.897299+0000","last_undegraded":"2024-09-13T23:07:17.897299+0000","last_fullsized":"2024-09-13T23:07:17.897299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:03:40.790581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'16","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.324175+0000","last_change":"2024-09-13T23:05:14.122670+0000","last_active":"2024-09-13T23:08:22.324175+0000","last_peered":"2024-09-13T23:08:22.324175+0000","last_clean":"2024-09-13T23:08:22.324175+0000","last_became_active":"2024-09-13T23:05:14.122105+0000","last_became_peered":"2024-09-13T23:05:14.122105+0000","last_unstale":"2024-09-13T23:08:22.324175+0000","last_undegraded":"2024-09-13T23:08:22.324175+0000","last_fullsized":"2024-09-13T23:08:22.324175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:32.818885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.243675+0000","last_change":"2024-09-13T23:05:12.121856+0000","last_active":"2024-09-13T23:08:22.243675+0000","last_peered":"2024-09-13T23:08:22.243675+0000","last_clean":"2024-09-13T23:08:22.243675+0000","last_became_active":"2024-09-13T23:05:12.120703+0000","last_became_peered":"2024-09-13T23:05:12.120703+0000","last_unstale":"2024-09-13T23:08:22.243675+0000","last_undegraded":"2024-09-13T23:08:22.243675+0000","last_fullsized":"2024-09-13T23:08:22.243675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:20.740109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'9","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:43.078358+0000","last_change":"2024-09-13T23:05:14.122765+0000","last_active":"2024-09-13T23:07:43.078358+0000","last_peered":"2024-09-13T23:07:43.078358+0000","last_clean":"2024-09-13T23:07:43.078358+0000","last_became_active":"2024-09-13T23:05:14.121636+0000","last_became_peered":"2024-09-13T23:05:14.121636+0000","last_unstale":"2024-09-13T23:07:43.078358+0000","last_undegraded":"2024-09-13T23:07:43.078358+0000","last_fullsized":"2024-09-13T23:07:43.078358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:08.481848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2271,"ondisk_log_size":2271,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1519,"num_read_kb":1313,"num_write":571,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":9114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1337,"ondisk_log_size":1337,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":962,"num_read_kb":962,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1600,"num_read_kb":1490,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8380416,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":143,"num_read_kb":87,"num_write":314,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17211392,"data_stored":17211392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":12,"seq":51539607600,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39980,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331860,"statfs":{"total":96636764160,"available":96595824640,"internally_reserved":0,"allocated":483328,"data_stored":151994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640302,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40492,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331348,"statfs":{"total":96636764160,"available":96595300352,"internally_reserved":0,"allocated":1011712,"data_stored":739728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705710,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44768,"kb_used_data":9424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327072,"statfs":{"total":96636764160,"available":96590921728,"internally_reserved":0,"allocated":9650176,"data_stored":9349228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40024,"kb_used_data":8840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331816,"statfs":{"total":96636764160,"available":96595779584,"internally_reserved":0,"allocated":9052160,"data_stored":8757564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T23:08:33.750 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.750 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.750 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.750 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.750 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.750 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.751 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.751 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.751 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.751 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.751 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.751 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.751 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.751 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.751 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.752 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.752 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.752 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.752 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.752 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.752 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.752 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.752 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.752 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.753 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.753 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.753 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.753 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.753 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.753 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.753 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.754 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.754 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.754 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.754 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.754 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.754 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.754 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.754 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.754 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.755 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.755 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.755 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.755 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.755 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.755 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.755 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.755 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.755 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.756 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.756 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.756 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.756 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.756 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.756 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.756 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.756 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.757 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.757 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.757 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.757 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.757 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.757 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.757 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.757 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.757 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.758 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.758 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.758 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.758 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.758 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.758 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.758 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.758 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.758 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.759 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.759 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.759 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.759 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.759 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.759 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.759 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.759 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.759 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.759 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.760 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.760 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.760 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.760 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.760 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.760 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.760 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.760 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.760 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.761 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.761 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.761 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.761 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.761 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.761 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.761 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.761 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T23:04:55.054026+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=4, tm_sec=55, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.762 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.762 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.762 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.762 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.762 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.762 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.762 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.762 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.762 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.762 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.763 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.763 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.763 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.763 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.763 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.763 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.763 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.763 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.763 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.764 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.764 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.764 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.764 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.764 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.764 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.764 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.765 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.765 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.765 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.765 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.765 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.765 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.765 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.765 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.766 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.766 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.766 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.766 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.766 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.766 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.766 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.766 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.766 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.767 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.767 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.767 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.767 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.767 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.767 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.767 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.767 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.767 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.767 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.768 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.768 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.768 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.768 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.768 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.769 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.769 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.769 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.769 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.770 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.770 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.770 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.770 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.770 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.770 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.770 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.770 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.771 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.771 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.771 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.771 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.772 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.772 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.772 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.772 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.772 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.772 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.772 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.772 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.773 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.773 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.773 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.773 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.773 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.773 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.773 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.774 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.774 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.774 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.774 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.774 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.774 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.774 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.775 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.775 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.775 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.775 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.775 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.775 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.775 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.775 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.776 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.776 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.776 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.776 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.776 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.776 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.776 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.776 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.776 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.777 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.777 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.777 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.777 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.777 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.777 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.777 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.777 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.777 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.778 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.778 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.778 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.778 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.778 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.778 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.778 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.778 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.778 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.779 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.779 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.779 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.779 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.779 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.779 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.779 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.779 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.779 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.780 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.780 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.780 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.780 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.780 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.780 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.780 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.780 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.780 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.781 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.781 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.781 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.781 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.781 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.781 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.781 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.781 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.781 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.782 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.782 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.782 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.782 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.782 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:33.782 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T23:08:53.783 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T23:08:53.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.896+0000 7fa305731640 1 Processor -- start 2024-09-13T23:08:53.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.896+0000 7fa305731640 1 -- start start 2024-09-13T23:08:53.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.897+0000 7fa305731640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa30012e940 0x7fa300130d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:53.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.897+0000 7fa305731640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa30006eba0 con 0x7fa30006eda0 2024-09-13T23:08:53.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.897+0000 7fa305731640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7fa30006d2f0 con 0x7fa30012e940 2024-09-13T23:08:53.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.897+0000 7fa2feffd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa30006eda0 0x7fa30006f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:56338/0 (socket says 172.21.15.17:56338) 2024-09-13T23:08:53.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.897+0000 7fa2feffd640 1 -- 172.21.15.17:0/1636288318 learned_addr learned my addr 172.21.15.17:0/1636288318 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:08:53.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.897+0000 7fa2fe7fc640 1 --2- 172.21.15.17:0/1636288318 >> v2:172.21.15.17:3300/0 conn(0x7fa30012e940 0x7fa300130d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:53.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.897+0000 7fa2fdffb640 1 -- 172.21.15.17:0/1636288318 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1523976073 0 0) 0x7fa30006eba0 con 0x7fa30006eda0 2024-09-13T23:08:53.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.897+0000 7fa2fdffb640 1 -- 172.21.15.17:0/1636288318 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2e8003520 con 0x7fa30006eda0 2024-09-13T23:08:53.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.897+0000 7fa2fe7fc640 1 -- 172.21.15.17:0/1636288318 >> v1:172.21.15.17:6789/0 conn(0x7fa30006eda0 legacy=0x7fa30006f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:53.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.897+0000 7fa2fe7fc640 1 -- 172.21.15.17:0/1636288318 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa300070d50 con 0x7fa30012e940 2024-09-13T23:08:53.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.898+0000 7fa2fe7fc640 1 --2- 172.21.15.17:0/1636288318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa30012e940 0x7fa300130d30 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4009720 tx=0x7fa2f402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcaee7e34b3be51e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:53.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.898+0000 7fa2fdffb640 1 -- 172.21.15.17:0/1636288318 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2f4037070 con 0x7fa30012e940 2024-09-13T23:08:53.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.898+0000 7fa2fdffb640 1 -- 172.21.15.17:0/1636288318 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2f402ae20 con 0x7fa30012e940 2024-09-13T23:08:53.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.898+0000 7fa2fdffb640 1 -- 172.21.15.17:0/1636288318 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2f4032570 con 0x7fa30012e940 2024-09-13T23:08:53.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.899+0000 7fa305731640 1 -- 172.21.15.17:0/1636288318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa30012e940 msgr2=0x7fa300130d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:53.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.899+0000 7fa305731640 1 --2- 172.21.15.17:0/1636288318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa30012e940 0x7fa300130d30 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4009720 tx=0x7fa2f402a1a0 comp rx=0 tx=0).stop 2024-09-13T23:08:53.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.899+0000 7fa305731640 1 -- 172.21.15.17:0/1636288318 shutdown_connections 2024-09-13T23:08:53.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.899+0000 7fa305731640 1 --2- 172.21.15.17:0/1636288318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa30012e940 0x7fa300130d30 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:53.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.899+0000 7fa305731640 1 -- 172.21.15.17:0/1636288318 >> 172.21.15.17:0/1636288318 conn(0x7fa30009a890 msgr2=0x7fa30009aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:53.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.899+0000 7fa305731640 1 -- 172.21.15.17:0/1636288318 shutdown_connections 2024-09-13T23:08:53.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.899+0000 7fa305731640 1 -- 172.21.15.17:0/1636288318 wait complete. 2024-09-13T23:08:53.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.900+0000 7fa305731640 1 Processor -- start 2024-09-13T23:08:53.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.900+0000 7fa305731640 1 -- start start 2024-09-13T23:08:53.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.900+0000 7fa305731640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa30006eda0 0x7fa300096670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:53.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.900+0000 7fa305731640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa30006fcd0 con 0x7fa30006eda0 2024-09-13T23:08:53.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.900+0000 7fa2feffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa30006eda0 0x7fa300096670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:53.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.901+0000 7fa2feffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa30006eda0 0x7fa300096670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50714/0 (socket says 172.21.15.17:50714) 2024-09-13T23:08:53.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.901+0000 7fa2feffd640 1 -- 172.21.15.17:0/365728857 learned_addr learned my addr 172.21.15.17:0/365728857 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:08:53.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.901+0000 7fa2feffd640 1 -- 172.21.15.17:0/365728857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa300127c00 con 0x7fa30006eda0 2024-09-13T23:08:53.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.901+0000 7fa2feffd640 1 --2- 172.21.15.17:0/365728857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa30006eda0 0x7fa300096670 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000cb40 tx=0x7fa2f00021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:53.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.901+0000 7fa2e77fe640 1 -- 172.21.15.17:0/365728857 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2f0017070 con 0x7fa30006eda0 2024-09-13T23:08:53.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.901+0000 7fa2e77fe640 1 -- 172.21.15.17:0/365728857 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2f000ab80 con 0x7fa30006eda0 2024-09-13T23:08:53.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.901+0000 7fa2e77fe640 1 -- 172.21.15.17:0/365728857 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2f0012400 con 0x7fa30006eda0 2024-09-13T23:08:53.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.901+0000 7fa305731640 1 -- 172.21.15.17:0/365728857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa30012c0a0 con 0x7fa30006eda0 2024-09-13T23:08:53.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.901+0000 7fa305731640 1 -- 172.21.15.17:0/365728857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa300128dc0 con 0x7fa30006eda0 2024-09-13T23:08:53.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.902+0000 7fa2e77fe640 1 -- 172.21.15.17:0/365728857 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa2f001a070 con 0x7fa30006eda0 2024-09-13T23:08:53.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.902+0000 7fa305731640 1 -- 172.21.15.17:0/365728857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa30006f180 con 0x7fa30006eda0 2024-09-13T23:08:53.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.902+0000 7fa2e77fe640 1 --2- 172.21.15.17:0/365728857 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fa2ec0382a0 0x7fa2ec03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:53.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.902+0000 7fa2e77fe640 1 -- 172.21.15.17:0/365728857 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fa2f004bac0 con 0x7fa30006eda0 2024-09-13T23:08:53.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.903+0000 7fa2fe7fc640 1 --2- 172.21.15.17:0/365728857 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fa2ec0382a0 0x7fa2ec03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:53.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.903+0000 7fa2fe7fc640 1 --2- 172.21.15.17:0/365728857 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fa2ec0382a0 0x7fa2ec03a760 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4034000 tx=0x7fa2f402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:53.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:53.907+0000 7fa2e77fe640 1 -- 172.21.15.17:0/365728857 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa2f001a360 con 0x7fa30006eda0 2024-09-13T23:08:54.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:54.078+0000 7fa305731640 1 -- 172.21.15.17:0/365728857 --> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa30006bba0 con 0x7fa2ec0382a0 2024-09-13T23:08:54.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:54.093+0000 7fa2e77fe640 1 -- 172.21.15.17:0/365728857 <== mgr.4102 v2:172.21.15.164:6824/713838566 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+658819 (secure 0 0 0) 0x7fa30006bba0 con 0x7fa2ec0382a0 2024-09-13T23:08:54.101 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:08:54.106 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-13T23:08:54.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:54.098+0000 7fa305731640 1 -- 172.21.15.17:0/365728857 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fa2ec0382a0 msgr2=0x7fa2ec03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:54.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:54.098+0000 7fa305731640 1 --2- 172.21.15.17:0/365728857 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fa2ec0382a0 0x7fa2ec03a760 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4034000 tx=0x7fa2f402e000 comp rx=0 tx=0).stop 2024-09-13T23:08:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:54.098+0000 7fa305731640 1 -- 172.21.15.17:0/365728857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa30006eda0 msgr2=0x7fa300096670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:54.098+0000 7fa305731640 1 --2- 172.21.15.17:0/365728857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa30006eda0 0x7fa300096670 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000cb40 tx=0x7fa2f00021e0 comp rx=0 tx=0).stop 2024-09-13T23:08:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:54.098+0000 7fa305731640 1 -- 172.21.15.17:0/365728857 shutdown_connections 2024-09-13T23:08:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:54.098+0000 7fa305731640 1 --2- 172.21.15.17:0/365728857 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7fa2ec0382a0 0x7fa2ec03a760 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:54.098+0000 7fa305731640 1 --2- 172.21.15.17:0/365728857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa30006eda0 0x7fa300096670 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:54.098+0000 7fa305731640 1 -- 172.21.15.17:0/365728857 >> 172.21.15.17:0/365728857 conn(0x7fa30009a890 msgr2=0x7fa30006e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:54.098+0000 7fa305731640 1 -- 172.21.15.17:0/365728857 shutdown_connections 2024-09-13T23:08:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:08:54.098+0000 7fa305731640 1 -- 172.21.15.17:0/365728857 wait complete. 2024-09-13T23:08:54.110 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-09-13T23:08:52.108164+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5088,"num_read_kb":4669,"num_write":2179,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2342,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4730,"ondisk_log_size":4730,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152608,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334752,"statfs":{"total":386547056640,"available":386390786048,"internally_reserved":0,"allocated":2981888,"data_stored":1785412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2342,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003870"},"pg_stats":[{"pgid":"3.3f","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.360410+0000","last_change":"2024-09-13T23:05:12.130214+0000","last_active":"2024-09-13T23:08:22.360410+0000","last_peered":"2024-09-13T23:08:22.360410+0000","last_clean":"2024-09-13T23:08:22.360410+0000","last_became_active":"2024-09-13T23:05:12.130009+0000","last_became_peered":"2024-09-13T23:05:12.130009+0000","last_unstale":"2024-09-13T23:08:22.360410+0000","last_undegraded":"2024-09-13T23:08:22.360410+0000","last_fullsized":"2024-09-13T23:08:22.360410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:48.078878+0000","last_change":"2024-09-13T23:05:14.125468+0000","last_active":"2024-09-13T23:07:48.078878+0000","last_peered":"2024-09-13T23:07:48.078878+0000","last_clean":"2024-09-13T23:07:48.078878+0000","last_became_active":"2024-09-13T23:05:14.125215+0000","last_became_peered":"2024-09-13T23:05:14.125215+0000","last_unstale":"2024-09-13T23:07:48.078878+0000","last_undegraded":"2024-09-13T23:07:48.078878+0000","last_fullsized":"2024-09-13T23:07:48.078878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.071518+0000","last_change":"2024-09-13T23:05:12.119102+0000","last_active":"2024-09-13T23:07:19.071518+0000","last_peered":"2024-09-13T23:07:19.071518+0000","last_clean":"2024-09-13T23:07:19.071518+0000","last_became_active":"2024-09-13T23:05:12.118411+0000","last_became_peered":"2024-09-13T23:05:12.118411+0000","last_unstale":"2024-09-13T23:07:19.071518+0000","last_undegraded":"2024-09-13T23:07:19.071518+0000","last_fullsized":"2024-09-13T23:07:19.071518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'8","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:47.079882+0000","last_change":"2024-09-13T23:05:14.109708+0000","last_active":"2024-09-13T23:07:47.079882+0000","last_peered":"2024-09-13T23:07:47.079882+0000","last_clean":"2024-09-13T23:07:47.079882+0000","last_became_active":"2024-09-13T23:05:14.109464+0000","last_became_peered":"2024-09-13T23:05:14.109464+0000","last_unstale":"2024-09-13T23:07:47.079882+0000","last_undegraded":"2024-09-13T23:07:47.079882+0000","last_fullsized":"2024-09-13T23:07:47.079882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:17.074811+0000","last_change":"2024-09-13T23:05:12.146564+0000","last_active":"2024-09-13T23:07:17.074811+0000","last_peered":"2024-09-13T23:07:17.074811+0000","last_clean":"2024-09-13T23:07:17.074811+0000","last_became_active":"2024-09-13T23:05:12.146191+0000","last_became_peered":"2024-09-13T23:05:12.146191+0000","last_unstale":"2024-09-13T23:07:17.074811+0000","last_undegraded":"2024-09-13T23:07:17.074811+0000","last_fullsized":"2024-09-13T23:07:17.074811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:47.079912+0000","last_change":"2024-09-13T23:05:14.110454+0000","last_active":"2024-09-13T23:07:47.079912+0000","last_peered":"2024-09-13T23:07:47.079912+0000","last_clean":"2024-09-13T23:07:47.079912+0000","last_became_active":"2024-09-13T23:05:14.110201+0000","last_became_peered":"2024-09-13T23:05:14.110201+0000","last_unstale":"2024-09-13T23:07:47.079912+0000","last_undegraded":"2024-09-13T23:07:47.079912+0000","last_fullsized":"2024-09-13T23:07:47.079912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:16.074167+0000","last_change":"2024-09-13T23:05:12.132812+0000","last_active":"2024-09-13T23:07:16.074167+0000","last_peered":"2024-09-13T23:07:16.074167+0000","last_clean":"2024-09-13T23:07:16.074167+0000","last_became_active":"2024-09-13T23:05:12.132461+0000","last_became_peered":"2024-09-13T23:05:12.132461+0000","last_unstale":"2024-09-13T23:07:16.074167+0000","last_undegraded":"2024-09-13T23:07:16.074167+0000","last_fullsized":"2024-09-13T23:07:16.074167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.368977+0000","last_change":"2024-09-13T23:05:14.113718+0000","last_active":"2024-09-13T23:08:22.368977+0000","last_peered":"2024-09-13T23:08:22.368977+0000","last_clean":"2024-09-13T23:08:22.368977+0000","last_became_active":"2024-09-13T23:05:14.113430+0000","last_became_peered":"2024-09-13T23:05:14.113430+0000","last_unstale":"2024-09-13T23:08:22.368977+0000","last_undegraded":"2024-09-13T23:08:22.368977+0000","last_fullsized":"2024-09-13T23:08:22.368977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079177+0000","last_change":"2024-09-13T23:05:12.146576+0000","last_active":"2024-09-13T23:07:42.079177+0000","last_peered":"2024-09-13T23:07:42.079177+0000","last_clean":"2024-09-13T23:07:42.079177+0000","last_became_active":"2024-09-13T23:05:12.146220+0000","last_became_peered":"2024-09-13T23:05:12.146220+0000","last_unstale":"2024-09-13T23:07:42.079177+0000","last_undegraded":"2024-09-13T23:07:42.079177+0000","last_fullsized":"2024-09-13T23:07:42.079177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.368970+0000","last_change":"2024-09-13T23:05:14.122808+0000","last_active":"2024-09-13T23:08:22.368970+0000","last_peered":"2024-09-13T23:08:22.368970+0000","last_clean":"2024-09-13T23:08:22.368970+0000","last_became_active":"2024-09-13T23:05:14.122513+0000","last_became_peered":"2024-09-13T23:05:14.122513+0000","last_unstale":"2024-09-13T23:08:22.368970+0000","last_undegraded":"2024-09-13T23:08:22.368970+0000","last_fullsized":"2024-09-13T23:08:22.368970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.243329+0000","last_change":"2024-09-13T23:05:12.113973+0000","last_active":"2024-09-13T23:08:22.243329+0000","last_peered":"2024-09-13T23:08:22.243329+0000","last_clean":"2024-09-13T23:08:22.243329+0000","last_became_active":"2024-09-13T23:05:12.113601+0000","last_became_peered":"2024-09-13T23:05:12.113601+0000","last_unstale":"2024-09-13T23:08:22.243329+0000","last_undegraded":"2024-09-13T23:08:22.243329+0000","last_fullsized":"2024-09-13T23:08:22.243329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:51.435636+0000","last_change":"2024-09-13T23:08:51.435662+0000","last_active":"2024-09-13T23:08:51.435636+0000","last_peered":"2024-09-13T23:08:51.435636+0000","last_clean":"2024-09-13T23:08:51.435636+0000","last_became_active":"2024-09-13T23:05:14.124971+0000","last_became_peered":"2024-09-13T23:05:14.124971+0000","last_unstale":"2024-09-13T23:08:51.435636+0000","last_undegraded":"2024-09-13T23:08:51.435636+0000","last_fullsized":"2024-09-13T23:08:51.435636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:08:51.435544+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:08:51.435544+0000","last_clean_scrub_stamp":"2024-09-13T23:08:51.435544+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:42:37.254383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079100+0000","last_change":"2024-09-13T23:05:12.139628+0000","last_active":"2024-09-13T23:07:42.079100+0000","last_peered":"2024-09-13T23:07:42.079100+0000","last_clean":"2024-09-13T23:07:42.079100+0000","last_became_active":"2024-09-13T23:05:12.138297+0000","last_became_peered":"2024-09-13T23:05:12.138297+0000","last_unstale":"2024-09-13T23:07:42.079100+0000","last_undegraded":"2024-09-13T23:07:42.079100+0000","last_fullsized":"2024-09-13T23:07:42.079100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'16","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.993950+0000","last_change":"2024-09-13T23:05:14.124224+0000","last_active":"2024-09-13T23:08:21.993950+0000","last_peered":"2024-09-13T23:08:21.993950+0000","last_clean":"2024-09-13T23:08:21.993950+0000","last_became_active":"2024-09-13T23:05:14.123950+0000","last_became_peered":"2024-09-13T23:05:14.123950+0000","last_unstale":"2024-09-13T23:08:21.993950+0000","last_undegraded":"2024-09-13T23:08:21.993950+0000","last_fullsized":"2024-09-13T23:08:21.993950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":68,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:44.075413+0000","last_change":"2024-09-13T23:05:12.117693+0000","last_active":"2024-09-13T23:07:44.075413+0000","last_peered":"2024-09-13T23:07:44.075413+0000","last_clean":"2024-09-13T23:07:44.075413+0000","last_became_active":"2024-09-13T23:05:12.117028+0000","last_became_peered":"2024-09-13T23:05:12.117028+0000","last_unstale":"2024-09-13T23:07:44.075413+0000","last_undegraded":"2024-09-13T23:07:44.075413+0000","last_fullsized":"2024-09-13T23:07:44.075413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'17","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.470056+0000","last_change":"2024-09-13T23:05:14.115693+0000","last_active":"2024-09-13T23:08:22.470056+0000","last_peered":"2024-09-13T23:08:22.470056+0000","last_clean":"2024-09-13T23:08:22.470056+0000","last_became_active":"2024-09-13T23:05:14.114831+0000","last_became_peered":"2024-09-13T23:05:14.114831+0000","last_unstale":"2024-09-13T23:08:22.470056+0000","last_undegraded":"2024-09-13T23:08:22.470056+0000","last_fullsized":"2024-09-13T23:08:22.470056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'16","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:37.078063+0000","last_change":"2024-09-13T23:05:14.110322+0000","last_active":"2024-09-13T23:07:37.078063+0000","last_peered":"2024-09-13T23:07:37.078063+0000","last_clean":"2024-09-13T23:07:37.078063+0000","last_became_active":"2024-09-13T23:05:14.109903+0000","last_became_peered":"2024-09-13T23:05:14.109903+0000","last_unstale":"2024-09-13T23:07:37.078063+0000","last_undegraded":"2024-09-13T23:07:37.078063+0000","last_fullsized":"2024-09-13T23:07:37.078063+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":66,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.939380+0000","last_change":"2024-09-13T23:05:12.136723+0000","last_active":"2024-09-13T23:08:21.939380+0000","last_peered":"2024-09-13T23:08:21.939380+0000","last_clean":"2024-09-13T23:08:21.939380+0000","last_became_active":"2024-09-13T23:05:12.136334+0000","last_became_peered":"2024-09-13T23:05:12.136334+0000","last_unstale":"2024-09-13T23:08:21.939380+0000","last_undegraded":"2024-09-13T23:08:21.939380+0000","last_fullsized":"2024-09-13T23:08:21.939380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'11","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.470341+0000","last_change":"2024-09-13T23:05:14.125935+0000","last_active":"2024-09-13T23:08:22.470341+0000","last_peered":"2024-09-13T23:08:22.470341+0000","last_clean":"2024-09-13T23:08:22.470341+0000","last_became_active":"2024-09-13T23:05:14.124023+0000","last_became_peered":"2024-09-13T23:05:14.124023+0000","last_unstale":"2024-09-13T23:08:22.470341+0000","last_undegraded":"2024-09-13T23:08:22.470341+0000","last_fullsized":"2024-09-13T23:08:22.470341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:41.077876+0000","last_change":"2024-09-13T23:05:12.126709+0000","last_active":"2024-09-13T23:07:41.077876+0000","last_peered":"2024-09-13T23:07:41.077876+0000","last_clean":"2024-09-13T23:07:41.077876+0000","last_became_active":"2024-09-13T23:05:12.126336+0000","last_became_peered":"2024-09-13T23:05:12.126336+0000","last_unstale":"2024-09-13T23:07:41.077876+0000","last_undegraded":"2024-09-13T23:07:41.077876+0000","last_fullsized":"2024-09-13T23:07:41.077876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'8","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:38.077549+0000","last_change":"2024-09-13T23:05:14.125494+0000","last_active":"2024-09-13T23:07:38.077549+0000","last_peered":"2024-09-13T23:07:38.077549+0000","last_clean":"2024-09-13T23:07:38.077549+0000","last_became_active":"2024-09-13T23:05:14.125247+0000","last_became_peered":"2024-09-13T23:05:14.125247+0000","last_unstale":"2024-09-13T23:07:38.077549+0000","last_undegraded":"2024-09-13T23:07:38.077549+0000","last_fullsized":"2024-09-13T23:07:38.077549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:38.077640+0000","last_change":"2024-09-13T23:05:12.140428+0000","last_active":"2024-09-13T23:07:38.077640+0000","last_peered":"2024-09-13T23:07:38.077640+0000","last_clean":"2024-09-13T23:07:38.077640+0000","last_became_active":"2024-09-13T23:05:12.139103+0000","last_became_peered":"2024-09-13T23:05:12.139103+0000","last_unstale":"2024-09-13T23:07:38.077640+0000","last_undegraded":"2024-09-13T23:07:38.077640+0000","last_fullsized":"2024-09-13T23:07:38.077640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'7","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.469366+0000","last_change":"2024-09-13T23:05:14.120825+0000","last_active":"2024-09-13T23:08:22.469366+0000","last_peered":"2024-09-13T23:08:22.469366+0000","last_clean":"2024-09-13T23:08:22.469366+0000","last_became_active":"2024-09-13T23:05:14.120397+0000","last_became_peered":"2024-09-13T23:05:14.120397+0000","last_unstale":"2024-09-13T23:08:22.469366+0000","last_undegraded":"2024-09-13T23:08:22.469366+0000","last_fullsized":"2024-09-13T23:08:22.469366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:38.077588+0000","last_change":"2024-09-13T23:05:12.139375+0000","last_active":"2024-09-13T23:07:38.077588+0000","last_peered":"2024-09-13T23:07:38.077588+0000","last_clean":"2024-09-13T23:07:38.077588+0000","last_became_active":"2024-09-13T23:05:12.139022+0000","last_became_peered":"2024-09-13T23:05:12.139022+0000","last_unstale":"2024-09-13T23:07:38.077588+0000","last_undegraded":"2024-09-13T23:07:38.077588+0000","last_fullsized":"2024-09-13T23:07:38.077588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'11","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.469394+0000","last_change":"2024-09-13T23:05:14.114497+0000","last_active":"2024-09-13T23:08:22.469394+0000","last_peered":"2024-09-13T23:08:22.469394+0000","last_clean":"2024-09-13T23:08:22.469394+0000","last_became_active":"2024-09-13T23:05:14.114261+0000","last_became_peered":"2024-09-13T23:05:14.114261+0000","last_unstale":"2024-09-13T23:08:22.469394+0000","last_undegraded":"2024-09-13T23:08:22.469394+0000","last_fullsized":"2024-09-13T23:08:22.469394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:39.074737+0000","last_change":"2024-09-13T23:05:12.130049+0000","last_active":"2024-09-13T23:07:39.074737+0000","last_peered":"2024-09-13T23:07:39.074737+0000","last_clean":"2024-09-13T23:07:39.074737+0000","last_became_active":"2024-09-13T23:05:12.129589+0000","last_became_peered":"2024-09-13T23:05:12.129589+0000","last_unstale":"2024-09-13T23:07:39.074737+0000","last_undegraded":"2024-09-13T23:07:39.074737+0000","last_fullsized":"2024-09-13T23:07:39.074737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.256604+0000","last_change":"2024-09-13T23:05:14.119179+0000","last_active":"2024-09-13T23:08:22.256604+0000","last_peered":"2024-09-13T23:08:22.256604+0000","last_clean":"2024-09-13T23:08:22.256604+0000","last_became_active":"2024-09-13T23:05:14.118922+0000","last_became_peered":"2024-09-13T23:05:14.118922+0000","last_unstale":"2024-09-13T23:08:22.256604+0000","last_undegraded":"2024-09-13T23:08:22.256604+0000","last_fullsized":"2024-09-13T23:08:22.256604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:32.077071+0000","last_change":"2024-09-13T23:05:12.140097+0000","last_active":"2024-09-13T23:07:32.077071+0000","last_peered":"2024-09-13T23:07:32.077071+0000","last_clean":"2024-09-13T23:07:32.077071+0000","last_became_active":"2024-09-13T23:05:12.139690+0000","last_became_peered":"2024-09-13T23:05:12.139690+0000","last_unstale":"2024-09-13T23:07:32.077071+0000","last_undegraded":"2024-09-13T23:07:32.077071+0000","last_fullsized":"2024-09-13T23:07:32.077071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'37","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.380336+0000","last_change":"2024-09-13T23:05:22.146156+0000","last_active":"2024-09-13T23:08:22.380336+0000","last_peered":"2024-09-13T23:08:22.380336+0000","last_clean":"2024-09-13T23:08:22.380336+0000","last_became_active":"2024-09-13T23:05:22.145872+0000","last_became_peered":"2024-09-13T23:05:22.145872+0000","last_unstale":"2024-09-13T23:08:22.380336+0000","last_undegraded":"2024-09-13T23:08:22.380336+0000","last_fullsized":"2024-09-13T23:08:22.380336+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":174,"num_write":103,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:37.078230+0000","last_change":"2024-09-13T23:05:14.110173+0000","last_active":"2024-09-13T23:07:37.078230+0000","last_peered":"2024-09-13T23:07:37.078230+0000","last_clean":"2024-09-13T23:07:37.078230+0000","last_became_active":"2024-09-13T23:05:14.109928+0000","last_became_peered":"2024-09-13T23:05:14.109928+0000","last_unstale":"2024-09-13T23:07:37.078230+0000","last_undegraded":"2024-09-13T23:07:37.078230+0000","last_fullsized":"2024-09-13T23:07:37.078230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:32.077095+0000","last_change":"2024-09-13T23:05:12.147582+0000","last_active":"2024-09-13T23:07:32.077095+0000","last_peered":"2024-09-13T23:07:32.077095+0000","last_clean":"2024-09-13T23:07:32.077095+0000","last_became_active":"2024-09-13T23:05:12.146236+0000","last_became_peered":"2024-09-13T23:05:12.146236+0000","last_unstale":"2024-09-13T23:07:32.077095+0000","last_undegraded":"2024-09-13T23:07:32.077095+0000","last_fullsized":"2024-09-13T23:07:32.077095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:39.624374+0000","last_change":"2024-09-13T23:08:39.624399+0000","last_active":"2024-09-13T23:08:39.624374+0000","last_peered":"2024-09-13T23:08:39.624374+0000","last_clean":"2024-09-13T23:08:39.624374+0000","last_became_active":"2024-09-13T23:05:16.123362+0000","last_became_peered":"2024-09-13T23:05:16.123362+0000","last_unstale":"2024-09-13T23:08:39.624374+0000","last_undegraded":"2024-09-13T23:08:39.624374+0000","last_fullsized":"2024-09-13T23:08:39.624374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:39.624277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:39.624277+0000","last_clean_scrub_stamp":"2024-09-13T23:08:39.624277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:59.071768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'35","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.192333+0000","last_change":"2024-09-13T23:05:18.133464+0000","last_active":"2024-09-13T23:08:29.192333+0000","last_peered":"2024-09-13T23:08:29.192333+0000","last_clean":"2024-09-13T23:08:29.192333+0000","last_became_active":"2024-09-13T23:05:18.132642+0000","last_became_peered":"2024-09-13T23:05:18.132642+0000","last_unstale":"2024-09-13T23:08:29.192333+0000","last_undegraded":"2024-09-13T23:08:29.192333+0000","last_fullsized":"2024-09-13T23:08:29.192333+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:48.079058+0000","last_change":"2024-09-13T23:05:20.145619+0000","last_active":"2024-09-13T23:07:48.079058+0000","last_peered":"2024-09-13T23:07:48.079058+0000","last_clean":"2024-09-13T23:07:48.079058+0000","last_became_active":"2024-09-13T23:05:20.145271+0000","last_became_peered":"2024-09-13T23:05:20.145271+0000","last_unstale":"2024-09-13T23:07:48.079058+0000","last_undegraded":"2024-09-13T23:07:48.079058+0000","last_fullsized":"2024-09-13T23:07:48.079058+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:48.078911+0000","last_change":"2024-09-13T23:05:22.150560+0000","last_active":"2024-09-13T23:07:48.078911+0000","last_peered":"2024-09-13T23:07:48.078911+0000","last_clean":"2024-09-13T23:07:48.078911+0000","last_became_active":"2024-09-13T23:05:22.150260+0000","last_became_peered":"2024-09-13T23:05:22.150260+0000","last_unstale":"2024-09-13T23:07:48.078911+0000","last_undegraded":"2024-09-13T23:07:48.078911+0000","last_fullsized":"2024-09-13T23:07:48.078911+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'6","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.106811+0000","last_change":"2024-09-13T23:05:14.113389+0000","last_active":"2024-09-13T23:08:22.106811+0000","last_peered":"2024-09-13T23:08:22.106811+0000","last_clean":"2024-09-13T23:08:22.106811+0000","last_became_active":"2024-09-13T23:05:14.113131+0000","last_became_peered":"2024-09-13T23:05:14.113131+0000","last_unstale":"2024-09-13T23:08:22.106811+0000","last_undegraded":"2024-09-13T23:08:22.106811+0000","last_fullsized":"2024-09-13T23:08:22.106811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:36.076945+0000","last_change":"2024-09-13T23:05:12.134287+0000","last_active":"2024-09-13T23:07:36.076945+0000","last_peered":"2024-09-13T23:07:36.076945+0000","last_clean":"2024-09-13T23:07:36.076945+0000","last_became_active":"2024-09-13T23:05:12.133505+0000","last_became_peered":"2024-09-13T23:05:12.133505+0000","last_unstale":"2024-09-13T23:07:36.076945+0000","last_undegraded":"2024-09-13T23:07:36.076945+0000","last_fullsized":"2024-09-13T23:07:36.076945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:48.133232+0000","last_change":"2024-09-13T23:08:48.133256+0000","last_active":"2024-09-13T23:08:48.133232+0000","last_peered":"2024-09-13T23:08:48.133232+0000","last_clean":"2024-09-13T23:08:48.133232+0000","last_became_active":"2024-09-13T23:05:16.124724+0000","last_became_peered":"2024-09-13T23:05:16.124724+0000","last_unstale":"2024-09-13T23:08:48.133232+0000","last_undegraded":"2024-09-13T23:08:48.133232+0000","last_fullsized":"2024-09-13T23:08:48.133232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:48.133136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:48.133136+0000","last_clean_scrub_stamp":"2024-09-13T23:08:48.133136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:23:32.736027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'10","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:38.121648+0000","last_change":"2024-09-13T23:08:38.121680+0000","last_active":"2024-09-13T23:08:38.121648+0000","last_peered":"2024-09-13T23:08:38.121648+0000","last_clean":"2024-09-13T23:08:38.121648+0000","last_became_active":"2024-09-13T23:05:18.126251+0000","last_became_peered":"2024-09-13T23:05:18.126251+0000","last_unstale":"2024-09-13T23:08:38.121648+0000","last_undegraded":"2024-09-13T23:08:38.121648+0000","last_fullsized":"2024-09-13T23:08:38.121648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T23:08:38.121563+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T23:08:38.121563+0000","last_clean_scrub_stamp":"2024-09-13T23:08:38.121563+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:16:06.466530+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:48.079029+0000","last_change":"2024-09-13T23:05:20.142878+0000","last_active":"2024-09-13T23:07:48.079029+0000","last_peered":"2024-09-13T23:07:48.079029+0000","last_clean":"2024-09-13T23:07:48.079029+0000","last_became_active":"2024-09-13T23:05:20.142564+0000","last_became_peered":"2024-09-13T23:05:20.142564+0000","last_unstale":"2024-09-13T23:07:48.079029+0000","last_undegraded":"2024-09-13T23:07:48.079029+0000","last_fullsized":"2024-09-13T23:07:48.079029+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:54.076957+0000","last_change":"2024-09-13T23:05:22.147806+0000","last_active":"2024-09-13T23:07:54.076957+0000","last_peered":"2024-09-13T23:07:54.076957+0000","last_clean":"2024-09-13T23:07:54.076957+0000","last_became_active":"2024-09-13T23:05:22.147493+0000","last_became_peered":"2024-09-13T23:05:22.147493+0000","last_unstale":"2024-09-13T23:07:54.076957+0000","last_undegraded":"2024-09-13T23:07:54.076957+0000","last_fullsized":"2024-09-13T23:07:54.076957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079282+0000","last_change":"2024-09-13T23:05:14.113438+0000","last_active":"2024-09-13T23:07:42.079282+0000","last_peered":"2024-09-13T23:07:42.079282+0000","last_clean":"2024-09-13T23:07:42.079282+0000","last_became_active":"2024-09-13T23:05:14.112986+0000","last_became_peered":"2024-09-13T23:05:14.112986+0000","last_unstale":"2024-09-13T23:07:42.079282+0000","last_undegraded":"2024-09-13T23:07:42.079282+0000","last_fullsized":"2024-09-13T23:07:42.079282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:32.077024+0000","last_change":"2024-09-13T23:05:12.139949+0000","last_active":"2024-09-13T23:07:32.077024+0000","last_peered":"2024-09-13T23:07:32.077024+0000","last_clean":"2024-09-13T23:07:32.077024+0000","last_became_active":"2024-09-13T23:05:12.138805+0000","last_became_peered":"2024-09-13T23:05:12.138805+0000","last_unstale":"2024-09-13T23:07:32.077024+0000","last_undegraded":"2024-09-13T23:07:32.077024+0000","last_fullsized":"2024-09-13T23:07:32.077024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:16.082806+0000","last_change":"2024-09-13T23:05:49.165573+0000","last_active":"2024-09-13T23:08:16.082806+0000","last_peered":"2024-09-13T23:08:16.082806+0000","last_clean":"2024-09-13T23:08:16.082806+0000","last_became_active":"2024-09-13T23:05:49.165209+0000","last_became_peered":"2024-09-13T23:05:49.165209+0000","last_unstale":"2024-09-13T23:08:16.082806+0000","last_undegraded":"2024-09-13T23:08:16.082806+0000","last_fullsized":"2024-09-13T23:08:16.082806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"34'16","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:39.564155+0000","last_change":"2024-09-13T23:08:39.564192+0000","last_active":"2024-09-13T23:08:39.564155+0000","last_peered":"2024-09-13T23:08:39.564155+0000","last_clean":"2024-09-13T23:08:39.564155+0000","last_became_active":"2024-09-13T23:05:18.134363+0000","last_became_peered":"2024-09-13T23:05:18.134363+0000","last_unstale":"2024-09-13T23:08:39.564155+0000","last_undegraded":"2024-09-13T23:08:39.564155+0000","last_fullsized":"2024-09-13T23:08:39.564155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:08:39.564067+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:08:39.564067+0000","last_clean_scrub_stamp":"2024-09-13T23:08:39.564067+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:23.504537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":389,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.220948+0000","last_change":"2024-09-13T23:05:20.144269+0000","last_active":"2024-09-13T23:08:29.220948+0000","last_peered":"2024-09-13T23:08:29.220948+0000","last_clean":"2024-09-13T23:08:29.220948+0000","last_became_active":"2024-09-13T23:05:20.143986+0000","last_became_peered":"2024-09-13T23:05:20.143986+0000","last_unstale":"2024-09-13T23:08:29.220948+0000","last_undegraded":"2024-09-13T23:08:29.220948+0000","last_fullsized":"2024-09-13T23:08:29.220948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.991331+0000","last_change":"2024-09-13T23:05:22.151271+0000","last_active":"2024-09-13T23:08:21.991331+0000","last_peered":"2024-09-13T23:08:21.991331+0000","last_clean":"2024-09-13T23:08:21.991331+0000","last_became_active":"2024-09-13T23:05:22.150977+0000","last_became_peered":"2024-09-13T23:05:22.150977+0000","last_unstale":"2024-09-13T23:08:21.991331+0000","last_undegraded":"2024-09-13T23:08:21.991331+0000","last_fullsized":"2024-09-13T23:08:21.991331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'12","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.106837+0000","last_change":"2024-09-13T23:05:14.122457+0000","last_active":"2024-09-13T23:08:22.106837+0000","last_peered":"2024-09-13T23:08:22.106837+0000","last_clean":"2024-09-13T23:08:22.106837+0000","last_became_active":"2024-09-13T23:05:14.121960+0000","last_became_peered":"2024-09-13T23:05:14.121960+0000","last_unstale":"2024-09-13T23:08:22.106837+0000","last_undegraded":"2024-09-13T23:08:22.106837+0000","last_fullsized":"2024-09-13T23:08:22.106837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:33.076650+0000","last_change":"2024-09-13T23:05:12.129400+0000","last_active":"2024-09-13T23:07:33.076650+0000","last_peered":"2024-09-13T23:07:33.076650+0000","last_clean":"2024-09-13T23:07:33.076650+0000","last_became_active":"2024-09-13T23:05:12.129019+0000","last_became_peered":"2024-09-13T23:05:12.129019+0000","last_unstale":"2024-09-13T23:07:33.076650+0000","last_undegraded":"2024-09-13T23:07:33.076650+0000","last_fullsized":"2024-09-13T23:07:33.076650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:41.570101+0000","last_change":"2024-09-13T23:08:41.570127+0000","last_active":"2024-09-13T23:08:41.570101+0000","last_peered":"2024-09-13T23:08:41.570101+0000","last_clean":"2024-09-13T23:08:41.570101+0000","last_became_active":"2024-09-13T23:05:16.122555+0000","last_became_peered":"2024-09-13T23:05:16.122555+0000","last_unstale":"2024-09-13T23:08:41.570101+0000","last_undegraded":"2024-09-13T23:08:41.570101+0000","last_fullsized":"2024-09-13T23:08:41.570101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:41.570017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:41.570017+0000","last_clean_scrub_stamp":"2024-09-13T23:08:41.570017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:53.974996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:41.566787+0000","last_change":"2024-09-13T23:08:41.566822+0000","last_active":"2024-09-13T23:08:41.566787+0000","last_peered":"2024-09-13T23:08:41.566787+0000","last_clean":"2024-09-13T23:08:41.566787+0000","last_became_active":"2024-09-13T23:05:18.128626+0000","last_became_peered":"2024-09-13T23:05:18.128626+0000","last_unstale":"2024-09-13T23:08:41.566787+0000","last_undegraded":"2024-09-13T23:08:41.566787+0000","last_fullsized":"2024-09-13T23:08:41.566787+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-13T23:08:41.566699+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-13T23:08:41.566699+0000","last_clean_scrub_stamp":"2024-09-13T23:08:41.566699+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:31.161100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:37.047437+0000","last_change":"2024-09-13T23:08:37.047469+0000","last_active":"2024-09-13T23:08:37.047437+0000","last_peered":"2024-09-13T23:08:37.047437+0000","last_clean":"2024-09-13T23:08:37.047437+0000","last_became_active":"2024-09-13T23:05:20.131943+0000","last_became_peered":"2024-09-13T23:05:20.131943+0000","last_unstale":"2024-09-13T23:08:37.047437+0000","last_undegraded":"2024-09-13T23:08:37.047437+0000","last_fullsized":"2024-09-13T23:08:37.047437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:37.047343+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:37.047343+0000","last_clean_scrub_stamp":"2024-09-13T23:08:37.047343+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:51:19.741192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:47.398582+0000","last_change":"2024-09-13T23:08:47.398608+0000","last_active":"2024-09-13T23:08:47.398582+0000","last_peered":"2024-09-13T23:08:47.398582+0000","last_clean":"2024-09-13T23:08:47.398582+0000","last_became_active":"2024-09-13T23:05:14.126659+0000","last_became_peered":"2024-09-13T23:05:14.126659+0000","last_unstale":"2024-09-13T23:08:47.398582+0000","last_undegraded":"2024-09-13T23:08:47.398582+0000","last_fullsized":"2024-09-13T23:08:47.398582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:47.398478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:47.398478+0000","last_clean_scrub_stamp":"2024-09-13T23:08:47.398478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:48.669511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:31.076281+0000","last_change":"2024-09-13T23:05:12.116365+0000","last_active":"2024-09-13T23:07:31.076281+0000","last_peered":"2024-09-13T23:07:31.076281+0000","last_clean":"2024-09-13T23:07:31.076281+0000","last_became_active":"2024-09-13T23:05:12.114453+0000","last_became_peered":"2024-09-13T23:05:12.114453+0000","last_unstale":"2024-09-13T23:07:31.076281+0000","last_undegraded":"2024-09-13T23:07:31.076281+0000","last_fullsized":"2024-09-13T23:07:31.076281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:40.158881+0000","last_change":"2024-09-13T23:08:40.158918+0000","last_active":"2024-09-13T23:08:40.158881+0000","last_peered":"2024-09-13T23:08:40.158881+0000","last_clean":"2024-09-13T23:08:40.158881+0000","last_became_active":"2024-09-13T23:05:16.124324+0000","last_became_peered":"2024-09-13T23:05:16.124324+0000","last_unstale":"2024-09-13T23:08:40.158881+0000","last_undegraded":"2024-09-13T23:08:40.158881+0000","last_fullsized":"2024-09-13T23:08:40.158881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:40.158756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:40.158756+0000","last_clean_scrub_stamp":"2024-09-13T23:08:40.158756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:01.139147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'51","reported_seq":111,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:40.531470+0000","last_change":"2024-09-13T23:08:40.531513+0000","last_active":"2024-09-13T23:08:40.531470+0000","last_peered":"2024-09-13T23:08:40.531470+0000","last_clean":"2024-09-13T23:08:40.531470+0000","last_became_active":"2024-09-13T23:05:18.129887+0000","last_became_peered":"2024-09-13T23:05:18.129887+0000","last_unstale":"2024-09-13T23:08:40.531470+0000","last_undegraded":"2024-09-13T23:08:40.531470+0000","last_fullsized":"2024-09-13T23:08:40.531470+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'51","last_scrub_stamp":"2024-09-13T23:08:40.531386+0000","last_deep_scrub":"34'51","last_deep_scrub_stamp":"2024-09-13T23:08:40.531386+0000","last_clean_scrub_stamp":"2024-09-13T23:08:40.531386+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:00:53.584234+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:36.003924+0000","last_change":"2024-09-13T23:08:36.003951+0000","last_active":"2024-09-13T23:08:36.003924+0000","last_peered":"2024-09-13T23:08:36.003924+0000","last_clean":"2024-09-13T23:08:36.003924+0000","last_became_active":"2024-09-13T23:05:20.135937+0000","last_became_peered":"2024-09-13T23:05:20.135937+0000","last_unstale":"2024-09-13T23:08:36.003924+0000","last_undegraded":"2024-09-13T23:08:36.003924+0000","last_fullsized":"2024-09-13T23:08:36.003924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:36.003822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:36.003822+0000","last_clean_scrub_stamp":"2024-09-13T23:08:36.003822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:36.100827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:31.076191+0000","last_change":"2024-09-13T23:05:22.146349+0000","last_active":"2024-09-13T23:07:31.076191+0000","last_peered":"2024-09-13T23:07:31.076191+0000","last_clean":"2024-09-13T23:07:31.076191+0000","last_became_active":"2024-09-13T23:05:22.146044+0000","last_became_peered":"2024-09-13T23:05:22.146044+0000","last_unstale":"2024-09-13T23:07:31.076191+0000","last_undegraded":"2024-09-13T23:07:31.076191+0000","last_fullsized":"2024-09-13T23:07:31.076191+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:28.075984+0000","last_change":"2024-09-13T23:05:14.116849+0000","last_active":"2024-09-13T23:07:28.075984+0000","last_peered":"2024-09-13T23:07:28.075984+0000","last_clean":"2024-09-13T23:07:28.075984+0000","last_became_active":"2024-09-13T23:05:14.116507+0000","last_became_peered":"2024-09-13T23:05:14.116507+0000","last_unstale":"2024-09-13T23:07:28.075984+0000","last_undegraded":"2024-09-13T23:07:28.075984+0000","last_fullsized":"2024-09-13T23:07:28.075984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:31.076241+0000","last_change":"2024-09-13T23:05:12.115905+0000","last_active":"2024-09-13T23:07:31.076241+0000","last_peered":"2024-09-13T23:07:31.076241+0000","last_clean":"2024-09-13T23:07:31.076241+0000","last_became_active":"2024-09-13T23:05:12.115025+0000","last_became_peered":"2024-09-13T23:05:12.115025+0000","last_unstale":"2024-09-13T23:07:31.076241+0000","last_undegraded":"2024-09-13T23:07:31.076241+0000","last_fullsized":"2024-09-13T23:07:31.076241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:29.073103+0000","last_change":"2024-09-13T23:05:16.118904+0000","last_active":"2024-09-13T23:07:29.073103+0000","last_peered":"2024-09-13T23:07:29.073103+0000","last_clean":"2024-09-13T23:07:29.073103+0000","last_became_active":"2024-09-13T23:05:16.118494+0000","last_became_peered":"2024-09-13T23:05:16.118494+0000","last_unstale":"2024-09-13T23:07:29.073103+0000","last_undegraded":"2024-09-13T23:07:29.073103+0000","last_fullsized":"2024-09-13T23:07:29.073103+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.132800+0000","last_change":"2024-09-13T23:05:18.134435+0000","last_active":"2024-09-13T23:08:29.132800+0000","last_peered":"2024-09-13T23:08:29.132800+0000","last_clean":"2024-09-13T23:08:29.132800+0000","last_became_active":"2024-09-13T23:05:18.134130+0000","last_became_peered":"2024-09-13T23:05:18.134130+0000","last_unstale":"2024-09-13T23:08:29.132800+0000","last_undegraded":"2024-09-13T23:08:29.132800+0000","last_fullsized":"2024-09-13T23:08:29.132800+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:42.005317+0000","last_change":"2024-09-13T23:08:42.005343+0000","last_active":"2024-09-13T23:08:42.005317+0000","last_peered":"2024-09-13T23:08:42.005317+0000","last_clean":"2024-09-13T23:08:42.005317+0000","last_became_active":"2024-09-13T23:05:20.140180+0000","last_became_peered":"2024-09-13T23:05:20.140180+0000","last_unstale":"2024-09-13T23:08:42.005317+0000","last_undegraded":"2024-09-13T23:08:42.005317+0000","last_fullsized":"2024-09-13T23:08:42.005317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:42.005224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:42.005224+0000","last_clean_scrub_stamp":"2024-09-13T23:08:42.005224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:49:52.491200+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'7","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:28.076088+0000","last_change":"2024-09-13T23:05:22.148436+0000","last_active":"2024-09-13T23:07:28.076088+0000","last_peered":"2024-09-13T23:07:28.076088+0000","last_clean":"2024-09-13T23:07:28.076088+0000","last_became_active":"2024-09-13T23:05:22.148104+0000","last_became_peered":"2024-09-13T23:05:22.148104+0000","last_unstale":"2024-09-13T23:07:28.076088+0000","last_undegraded":"2024-09-13T23:07:28.076088+0000","last_fullsized":"2024-09-13T23:07:28.076088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":18,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:26.075397+0000","last_change":"2024-09-13T23:05:14.119333+0000","last_active":"2024-09-13T23:07:26.075397+0000","last_peered":"2024-09-13T23:07:26.075397+0000","last_clean":"2024-09-13T23:07:26.075397+0000","last_became_active":"2024-09-13T23:05:14.119071+0000","last_became_peered":"2024-09-13T23:05:14.119071+0000","last_unstale":"2024-09-13T23:07:26.075397+0000","last_undegraded":"2024-09-13T23:07:26.075397+0000","last_fullsized":"2024-09-13T23:07:26.075397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.183265+0000","last_change":"2024-09-13T23:05:12.148852+0000","last_active":"2024-09-13T23:08:29.183265+0000","last_peered":"2024-09-13T23:08:29.183265+0000","last_clean":"2024-09-13T23:08:29.183265+0000","last_became_active":"2024-09-13T23:05:12.148439+0000","last_became_peered":"2024-09-13T23:05:12.148439+0000","last_unstale":"2024-09-13T23:08:29.183265+0000","last_undegraded":"2024-09-13T23:08:29.183265+0000","last_fullsized":"2024-09-13T23:08:29.183265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:34.073932+0000","last_change":"2024-09-13T23:05:16.123514+0000","last_active":"2024-09-13T23:07:34.073932+0000","last_peered":"2024-09-13T23:07:34.073932+0000","last_clean":"2024-09-13T23:07:34.073932+0000","last_became_active":"2024-09-13T23:05:16.123188+0000","last_became_peered":"2024-09-13T23:05:16.123188+0000","last_unstale":"2024-09-13T23:07:34.073932+0000","last_undegraded":"2024-09-13T23:07:34.073932+0000","last_fullsized":"2024-09-13T23:07:34.073932+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:40.622211+0000","last_change":"2024-09-13T23:08:40.622258+0000","last_active":"2024-09-13T23:08:40.622211+0000","last_peered":"2024-09-13T23:08:40.622211+0000","last_clean":"2024-09-13T23:08:40.622211+0000","last_became_active":"2024-09-13T23:05:18.131446+0000","last_became_peered":"2024-09-13T23:05:18.131446+0000","last_unstale":"2024-09-13T23:08:40.622211+0000","last_undegraded":"2024-09-13T23:08:40.622211+0000","last_fullsized":"2024-09-13T23:08:40.622211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-09-13T23:08:40.622115+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-09-13T23:08:40.622115+0000","last_clean_scrub_stamp":"2024-09-13T23:08:40.622115+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:07.613322+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":352,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.226510+0000","last_change":"2024-09-13T23:05:20.144417+0000","last_active":"2024-09-13T23:08:29.226510+0000","last_peered":"2024-09-13T23:08:29.226510+0000","last_clean":"2024-09-13T23:08:29.226510+0000","last_became_active":"2024-09-13T23:05:20.144104+0000","last_became_peered":"2024-09-13T23:05:20.144104+0000","last_unstale":"2024-09-13T23:08:29.226510+0000","last_undegraded":"2024-09-13T23:08:29.226510+0000","last_fullsized":"2024-09-13T23:08:29.226510+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:34.073991+0000","last_change":"2024-09-13T23:05:22.147955+0000","last_active":"2024-09-13T23:07:34.073991+0000","last_peered":"2024-09-13T23:07:34.073991+0000","last_clean":"2024-09-13T23:07:34.073991+0000","last_became_active":"2024-09-13T23:05:22.147645+0000","last_became_peered":"2024-09-13T23:05:22.147645+0000","last_unstale":"2024-09-13T23:07:34.073991+0000","last_undegraded":"2024-09-13T23:07:34.073991+0000","last_fullsized":"2024-09-13T23:07:34.073991+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.371777+0000","last_change":"2024-09-13T23:05:14.112569+0000","last_active":"2024-09-13T23:08:22.371777+0000","last_peered":"2024-09-13T23:08:22.371777+0000","last_clean":"2024-09-13T23:08:22.371777+0000","last_became_active":"2024-09-13T23:05:14.112291+0000","last_became_peered":"2024-09-13T23:05:14.112291+0000","last_unstale":"2024-09-13T23:08:22.371777+0000","last_undegraded":"2024-09-13T23:08:22.371777+0000","last_fullsized":"2024-09-13T23:08:22.371777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.183297+0000","last_change":"2024-09-13T23:05:12.149813+0000","last_active":"2024-09-13T23:08:29.183297+0000","last_peered":"2024-09-13T23:08:29.183297+0000","last_clean":"2024-09-13T23:08:29.183297+0000","last_became_active":"2024-09-13T23:05:12.149418+0000","last_became_peered":"2024-09-13T23:05:12.149418+0000","last_unstale":"2024-09-13T23:08:29.183297+0000","last_undegraded":"2024-09-13T23:08:29.183297+0000","last_fullsized":"2024-09-13T23:08:29.183297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:29.073179+0000","last_change":"2024-09-13T23:05:16.118930+0000","last_active":"2024-09-13T23:07:29.073179+0000","last_peered":"2024-09-13T23:07:29.073179+0000","last_clean":"2024-09-13T23:07:29.073179+0000","last_became_active":"2024-09-13T23:05:16.118503+0000","last_became_peered":"2024-09-13T23:05:16.118503+0000","last_unstale":"2024-09-13T23:07:29.073179+0000","last_undegraded":"2024-09-13T23:07:29.073179+0000","last_fullsized":"2024-09-13T23:07:29.073179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'60","reported_seq":125,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.215468+0000","last_change":"2024-09-13T23:05:18.135615+0000","last_active":"2024-09-13T23:08:29.215468+0000","last_peered":"2024-09-13T23:08:29.215468+0000","last_clean":"2024-09-13T23:08:29.215468+0000","last_became_active":"2024-09-13T23:05:18.135307+0000","last_became_peered":"2024-09-13T23:05:18.135307+0000","last_unstale":"2024-09-13T23:08:29.215468+0000","last_undegraded":"2024-09-13T23:08:29.215468+0000","last_fullsized":"2024-09-13T23:08:29.215468+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:32.955706+0000","last_change":"2024-09-13T23:08:32.955726+0000","last_active":"2024-09-13T23:08:32.955706+0000","last_peered":"2024-09-13T23:08:32.955706+0000","last_clean":"2024-09-13T23:08:32.955706+0000","last_became_active":"2024-09-13T23:05:20.137460+0000","last_became_peered":"2024-09-13T23:05:20.137460+0000","last_unstale":"2024-09-13T23:08:32.955706+0000","last_undegraded":"2024-09-13T23:08:32.955706+0000","last_fullsized":"2024-09-13T23:08:32.955706+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:32.955629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:32.955629+0000","last_clean_scrub_stamp":"2024-09-13T23:08:32.955629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:14.847447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.586373+0000","last_change":"2024-09-13T23:05:22.141812+0000","last_active":"2024-09-13T23:08:22.586373+0000","last_peered":"2024-09-13T23:08:22.586373+0000","last_clean":"2024-09-13T23:08:22.586373+0000","last_became_active":"2024-09-13T23:05:22.141472+0000","last_became_peered":"2024-09-13T23:05:22.141472+0000","last_unstale":"2024-09-13T23:08:22.586373+0000","last_undegraded":"2024-09-13T23:08:22.586373+0000","last_fullsized":"2024-09-13T23:08:22.586373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:33.076781+0000","last_change":"2024-09-13T23:05:49.164754+0000","last_active":"2024-09-13T23:07:33.076781+0000","last_peered":"2024-09-13T23:07:33.076781+0000","last_clean":"2024-09-13T23:07:33.076781+0000","last_became_active":"2024-09-13T23:05:49.164426+0000","last_became_peered":"2024-09-13T23:05:49.164426+0000","last_unstale":"2024-09-13T23:07:33.076781+0000","last_undegraded":"2024-09-13T23:07:33.076781+0000","last_fullsized":"2024-09-13T23:07:33.076781+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.233555+0000","last_change":"2024-09-13T23:05:12.130483+0000","last_active":"2024-09-13T23:08:22.233555+0000","last_peered":"2024-09-13T23:08:22.233555+0000","last_clean":"2024-09-13T23:08:22.233555+0000","last_became_active":"2024-09-13T23:05:12.129951+0000","last_became_peered":"2024-09-13T23:05:12.129951+0000","last_unstale":"2024-09-13T23:08:22.233555+0000","last_undegraded":"2024-09-13T23:08:22.233555+0000","last_fullsized":"2024-09-13T23:08:22.233555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:48.682481+0000","last_change":"2024-09-13T23:08:48.682504+0000","last_active":"2024-09-13T23:08:48.682481+0000","last_peered":"2024-09-13T23:08:48.682481+0000","last_clean":"2024-09-13T23:08:48.682481+0000","last_became_active":"2024-09-13T23:05:16.127598+0000","last_became_peered":"2024-09-13T23:05:16.127598+0000","last_unstale":"2024-09-13T23:08:48.682481+0000","last_undegraded":"2024-09-13T23:08:48.682481+0000","last_fullsized":"2024-09-13T23:08:48.682481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:48.682390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:48.682390+0000","last_clean_scrub_stamp":"2024-09-13T23:08:48.682390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:16:51.142230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'39","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:36.095129+0000","last_change":"2024-09-13T23:08:36.095166+0000","last_active":"2024-09-13T23:08:36.095129+0000","last_peered":"2024-09-13T23:08:36.095129+0000","last_clean":"2024-09-13T23:08:36.095129+0000","last_became_active":"2024-09-13T23:05:18.128238+0000","last_became_peered":"2024-09-13T23:05:18.128238+0000","last_unstale":"2024-09-13T23:08:36.095129+0000","last_undegraded":"2024-09-13T23:08:36.095129+0000","last_fullsized":"2024-09-13T23:08:36.095129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-13T23:08:36.095044+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-13T23:08:36.095044+0000","last_clean_scrub_stamp":"2024-09-13T23:08:36.095044+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:48:40.542578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:37.078315+0000","last_change":"2024-09-13T23:05:20.140091+0000","last_active":"2024-09-13T23:07:37.078315+0000","last_peered":"2024-09-13T23:07:37.078315+0000","last_clean":"2024-09-13T23:07:37.078315+0000","last_became_active":"2024-09-13T23:05:20.139335+0000","last_became_peered":"2024-09-13T23:05:20.139335+0000","last_unstale":"2024-09-13T23:07:37.078315+0000","last_undegraded":"2024-09-13T23:07:37.078315+0000","last_fullsized":"2024-09-13T23:07:37.078315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.473025+0000","last_change":"2024-09-13T23:05:22.148481+0000","last_active":"2024-09-13T23:08:22.473025+0000","last_peered":"2024-09-13T23:08:22.473025+0000","last_clean":"2024-09-13T23:08:22.473025+0000","last_became_active":"2024-09-13T23:05:22.148222+0000","last_became_peered":"2024-09-13T23:05:22.148222+0000","last_unstale":"2024-09-13T23:08:22.473025+0000","last_undegraded":"2024-09-13T23:08:22.473025+0000","last_fullsized":"2024-09-13T23:08:22.473025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'34","reported_seq":90,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.993994+0000","last_change":"2024-09-13T23:05:14.118784+0000","last_active":"2024-09-13T23:08:21.993994+0000","last_peered":"2024-09-13T23:08:21.993994+0000","last_clean":"2024-09-13T23:08:21.993994+0000","last_became_active":"2024-09-13T23:05:14.118545+0000","last_became_peered":"2024-09-13T23:05:14.118545+0000","last_unstale":"2024-09-13T23:08:21.993994+0000","last_undegraded":"2024-09-13T23:08:21.993994+0000","last_fullsized":"2024-09-13T23:08:21.993994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":93,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:22.075347+0000","last_change":"2024-09-13T23:05:12.147234+0000","last_active":"2024-09-13T23:07:22.075347+0000","last_peered":"2024-09-13T23:07:22.075347+0000","last_clean":"2024-09-13T23:07:22.075347+0000","last_became_active":"2024-09-13T23:05:12.146912+0000","last_became_peered":"2024-09-13T23:05:12.146912+0000","last_unstale":"2024-09-13T23:07:22.075347+0000","last_undegraded":"2024-09-13T23:07:22.075347+0000","last_fullsized":"2024-09-13T23:07:22.075347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:34.073959+0000","last_change":"2024-09-13T23:05:16.114688+0000","last_active":"2024-09-13T23:07:34.073959+0000","last_peered":"2024-09-13T23:07:34.073959+0000","last_clean":"2024-09-13T23:07:34.073959+0000","last_became_active":"2024-09-13T23:05:16.114369+0000","last_became_peered":"2024-09-13T23:05:16.114369+0000","last_unstale":"2024-09-13T23:07:34.073959+0000","last_undegraded":"2024-09-13T23:07:34.073959+0000","last_fullsized":"2024-09-13T23:07:34.073959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:45.676576+0000","last_change":"2024-09-13T23:08:45.676635+0000","last_active":"2024-09-13T23:08:45.676576+0000","last_peered":"2024-09-13T23:08:45.676576+0000","last_clean":"2024-09-13T23:08:45.676576+0000","last_became_active":"2024-09-13T23:05:18.126183+0000","last_became_peered":"2024-09-13T23:05:18.126183+0000","last_unstale":"2024-09-13T23:08:45.676576+0000","last_undegraded":"2024-09-13T23:08:45.676576+0000","last_fullsized":"2024-09-13T23:08:45.676576+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-13T23:08:45.676456+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-13T23:08:45.676456+0000","last_clean_scrub_stamp":"2024-09-13T23:08:45.676456+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:40.391001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":415,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:38.549051+0000","last_change":"2024-09-13T23:08:38.549085+0000","last_active":"2024-09-13T23:08:38.549051+0000","last_peered":"2024-09-13T23:08:38.549051+0000","last_clean":"2024-09-13T23:08:38.549051+0000","last_became_active":"2024-09-13T23:05:20.143659+0000","last_became_peered":"2024-09-13T23:05:20.143659+0000","last_unstale":"2024-09-13T23:08:38.549051+0000","last_undegraded":"2024-09-13T23:08:38.549051+0000","last_fullsized":"2024-09-13T23:08:38.549051+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:38.548964+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:38.548964+0000","last_clean_scrub_stamp":"2024-09-13T23:08:38.548964+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:04.032284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.474697+0000","last_change":"2024-09-13T23:05:22.140956+0000","last_active":"2024-09-13T23:08:22.474697+0000","last_peered":"2024-09-13T23:08:22.474697+0000","last_clean":"2024-09-13T23:08:22.474697+0000","last_became_active":"2024-09-13T23:05:22.140485+0000","last_became_peered":"2024-09-13T23:05:22.140485+0000","last_unstale":"2024-09-13T23:08:22.474697+0000","last_undegraded":"2024-09-13T23:08:22.474697+0000","last_fullsized":"2024-09-13T23:08:22.474697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'18","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.369268+0000","last_change":"2024-09-13T23:05:14.115429+0000","last_active":"2024-09-13T23:08:22.369268+0000","last_peered":"2024-09-13T23:08:22.369268+0000","last_clean":"2024-09-13T23:08:22.369268+0000","last_became_active":"2024-09-13T23:05:14.115166+0000","last_became_peered":"2024-09-13T23:05:14.115166+0000","last_unstale":"2024-09-13T23:08:22.369268+0000","last_undegraded":"2024-09-13T23:08:22.369268+0000","last_fullsized":"2024-09-13T23:08:22.369268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.238337+0000","last_change":"2024-09-13T23:05:12.140202+0000","last_active":"2024-09-13T23:08:22.238337+0000","last_peered":"2024-09-13T23:08:22.238337+0000","last_clean":"2024-09-13T23:08:22.238337+0000","last_became_active":"2024-09-13T23:05:12.139283+0000","last_became_peered":"2024-09-13T23:05:12.139283+0000","last_unstale":"2024-09-13T23:08:22.238337+0000","last_undegraded":"2024-09-13T23:08:22.238337+0000","last_fullsized":"2024-09-13T23:08:22.238337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":429,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.050609+0000","last_change":"2024-09-13T23:05:49.171563+0000","last_active":"2024-09-13T23:08:29.050609+0000","last_peered":"2024-09-13T23:08:29.050609+0000","last_clean":"2024-09-13T23:08:29.050609+0000","last_became_active":"2024-09-13T23:05:49.164741+0000","last_became_peered":"2024-09-13T23:05:49.164741+0000","last_unstale":"2024-09-13T23:08:29.050609+0000","last_undegraded":"2024-09-13T23:08:29.050609+0000","last_fullsized":"2024-09-13T23:08:29.050609+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'11","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:37.078249+0000","last_change":"2024-09-13T23:05:18.135452+0000","last_active":"2024-09-13T23:07:37.078249+0000","last_peered":"2024-09-13T23:07:37.078249+0000","last_clean":"2024-09-13T23:07:37.078249+0000","last_became_active":"2024-09-13T23:05:18.135028+0000","last_became_peered":"2024-09-13T23:05:18.135028+0000","last_unstale":"2024-09-13T23:07:37.078249+0000","last_undegraded":"2024-09-13T23:07:37.078249+0000","last_fullsized":"2024-09-13T23:07:37.078249+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":477,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:41.117643+0000","last_change":"2024-09-13T23:08:41.117670+0000","last_active":"2024-09-13T23:08:41.117643+0000","last_peered":"2024-09-13T23:08:41.117643+0000","last_clean":"2024-09-13T23:08:41.117643+0000","last_became_active":"2024-09-13T23:05:20.132891+0000","last_became_peered":"2024-09-13T23:05:20.132891+0000","last_unstale":"2024-09-13T23:08:41.117643+0000","last_undegraded":"2024-09-13T23:08:41.117643+0000","last_fullsized":"2024-09-13T23:08:41.117643+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:41.117524+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:41.117524+0000","last_clean_scrub_stamp":"2024-09-13T23:08:41.117524+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:31.490095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:31.076149+0000","last_change":"2024-09-13T23:05:22.150994+0000","last_active":"2024-09-13T23:07:31.076149+0000","last_peered":"2024-09-13T23:07:31.076149+0000","last_clean":"2024-09-13T23:07:31.076149+0000","last_became_active":"2024-09-13T23:05:22.150258+0000","last_became_peered":"2024-09-13T23:05:22.150258+0000","last_unstale":"2024-09-13T23:07:31.076149+0000","last_undegraded":"2024-09-13T23:07:31.076149+0000","last_fullsized":"2024-09-13T23:07:31.076149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.369534+0000","last_change":"2024-09-13T23:05:14.126232+0000","last_active":"2024-09-13T23:08:22.369534+0000","last_peered":"2024-09-13T23:08:22.369534+0000","last_clean":"2024-09-13T23:08:22.369534+0000","last_became_active":"2024-09-13T23:05:14.125034+0000","last_became_peered":"2024-09-13T23:05:14.125034+0000","last_unstale":"2024-09-13T23:08:22.369534+0000","last_undegraded":"2024-09-13T23:08:22.369534+0000","last_fullsized":"2024-09-13T23:08:22.369534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'3","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:22.075273+0000","last_change":"2024-09-13T23:05:12.143810+0000","last_active":"2024-09-13T23:07:22.075273+0000","last_peered":"2024-09-13T23:07:22.075273+0000","last_clean":"2024-09-13T23:07:22.075273+0000","last_became_active":"2024-09-13T23:05:12.142185+0000","last_became_peered":"2024-09-13T23:05:12.142185+0000","last_unstale":"2024-09-13T23:07:22.075273+0000","last_undegraded":"2024-09-13T23:07:22.075273+0000","last_fullsized":"2024-09-13T23:07:22.075273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.512216+0000","last_change":"2024-09-13T23:08:33.512256+0000","last_active":"2024-09-13T23:08:33.512216+0000","last_peered":"2024-09-13T23:08:33.512216+0000","last_clean":"2024-09-13T23:08:33.512216+0000","last_became_active":"2024-09-13T23:05:16.125013+0000","last_became_peered":"2024-09-13T23:05:16.125013+0000","last_unstale":"2024-09-13T23:08:33.512216+0000","last_undegraded":"2024-09-13T23:08:33.512216+0000","last_fullsized":"2024-09-13T23:08:33.512216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:33.512107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:33.512107+0000","last_clean_scrub_stamp":"2024-09-13T23:08:33.512107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:00.070785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'48","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:39.155632+0000","last_change":"2024-09-13T23:08:39.155672+0000","last_active":"2024-09-13T23:08:39.155632+0000","last_peered":"2024-09-13T23:08:39.155632+0000","last_clean":"2024-09-13T23:08:39.155632+0000","last_became_active":"2024-09-13T23:05:18.126271+0000","last_became_peered":"2024-09-13T23:05:18.126271+0000","last_unstale":"2024-09-13T23:08:39.155632+0000","last_undegraded":"2024-09-13T23:08:39.155632+0000","last_fullsized":"2024-09-13T23:08:39.155632+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-09-13T23:08:39.155548+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-09-13T23:08:39.155548+0000","last_clean_scrub_stamp":"2024-09-13T23:08:39.155548+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:48.512044+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:46.633023+0000","last_change":"2024-09-13T23:08:46.633049+0000","last_active":"2024-09-13T23:08:46.633023+0000","last_peered":"2024-09-13T23:08:46.633023+0000","last_clean":"2024-09-13T23:08:46.633023+0000","last_became_active":"2024-09-13T23:05:20.145626+0000","last_became_peered":"2024-09-13T23:05:20.145626+0000","last_unstale":"2024-09-13T23:08:46.633023+0000","last_undegraded":"2024-09-13T23:08:46.633023+0000","last_fullsized":"2024-09-13T23:08:46.633023+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:46.632934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:46.632934+0000","last_clean_scrub_stamp":"2024-09-13T23:08:46.632934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:54.822821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.584792+0000","last_change":"2024-09-13T23:05:22.137537+0000","last_active":"2024-09-13T23:08:22.584792+0000","last_peered":"2024-09-13T23:08:22.584792+0000","last_clean":"2024-09-13T23:08:22.584792+0000","last_became_active":"2024-09-13T23:05:22.137111+0000","last_became_peered":"2024-09-13T23:05:22.137111+0000","last_unstale":"2024-09-13T23:08:22.584792+0000","last_undegraded":"2024-09-13T23:08:22.584792+0000","last_fullsized":"2024-09-13T23:08:22.584792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'16","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:56.080220+0000","last_change":"2024-09-13T23:05:49.168074+0000","last_active":"2024-09-13T23:07:56.080220+0000","last_peered":"2024-09-13T23:07:56.080220+0000","last_clean":"2024-09-13T23:07:56.080220+0000","last_became_active":"2024-09-13T23:05:49.165166+0000","last_became_peered":"2024-09-13T23:05:49.165166+0000","last_unstale":"2024-09-13T23:07:56.080220+0000","last_undegraded":"2024-09-13T23:07:56.080220+0000","last_fullsized":"2024-09-13T23:07:56.080220+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":51,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":205,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:06:58.071943+0000","last_change":"2024-09-13T23:04:56.151685+0000","last_active":"2024-09-13T23:06:58.071943+0000","last_peered":"2024-09-13T23:06:58.071943+0000","last_clean":"2024-09-13T23:06:58.071943+0000","last_became_active":"2024-09-13T23:04:56.149747+0000","last_became_peered":"2024-09-13T23:04:56.149747+0000","last_unstale":"2024-09-13T23:06:58.071943+0000","last_undegraded":"2024-09-13T23:06:58.071943+0000","last_fullsized":"2024-09-13T23:06:58.071943+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:04:55.054026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:04:55.054026+0000","last_clean_scrub_stamp":"2024-09-13T23:04:55.054026+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:07.073385+0000","last_change":"2024-09-13T23:05:03.078734+0000","last_active":"2024-09-13T23:07:07.073385+0000","last_peered":"2024-09-13T23:07:07.073385+0000","last_clean":"2024-09-13T23:07:07.073385+0000","last_became_active":"2024-09-13T23:05:01.074608+0000","last_became_peered":"2024-09-13T23:05:01.074608+0000","last_unstale":"2024-09-13T23:07:07.073385+0000","last_undegraded":"2024-09-13T23:07:07.073385+0000","last_fullsized":"2024-09-13T23:07:07.073385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097176599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.183094+0000","last_change":"2024-09-13T23:05:12.147068+0000","last_active":"2024-09-13T23:08:29.183094+0000","last_peered":"2024-09-13T23:08:29.183094+0000","last_clean":"2024-09-13T23:08:29.183094+0000","last_became_active":"2024-09-13T23:05:12.146438+0000","last_became_peered":"2024-09-13T23:05:12.146438+0000","last_unstale":"2024-09-13T23:08:29.183094+0000","last_undegraded":"2024-09-13T23:08:29.183094+0000","last_fullsized":"2024-09-13T23:08:29.183094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:23.075225+0000","last_change":"2024-09-13T23:05:16.115876+0000","last_active":"2024-09-13T23:07:23.075225+0000","last_peered":"2024-09-13T23:07:23.075225+0000","last_clean":"2024-09-13T23:07:23.075225+0000","last_became_active":"2024-09-13T23:05:16.115599+0000","last_became_peered":"2024-09-13T23:05:16.115599+0000","last_unstale":"2024-09-13T23:07:23.075225+0000","last_undegraded":"2024-09-13T23:07:23.075225+0000","last_fullsized":"2024-09-13T23:07:23.075225+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'85","reported_seq":167,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.201429+0000","last_change":"2024-09-13T23:05:18.135412+0000","last_active":"2024-09-13T23:08:29.201429+0000","last_peered":"2024-09-13T23:08:29.201429+0000","last_clean":"2024-09-13T23:08:29.201429+0000","last_became_active":"2024-09-13T23:05:18.135080+0000","last_became_peered":"2024-09-13T23:05:18.135080+0000","last_unstale":"2024-09-13T23:08:29.201429+0000","last_undegraded":"2024-09-13T23:08:29.201429+0000","last_fullsized":"2024-09-13T23:08:29.201429+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:38.028204+0000","last_change":"2024-09-13T23:08:38.028280+0000","last_active":"2024-09-13T23:08:38.028204+0000","last_peered":"2024-09-13T23:08:38.028204+0000","last_clean":"2024-09-13T23:08:38.028204+0000","last_became_active":"2024-09-13T23:05:20.139399+0000","last_became_peered":"2024-09-13T23:05:20.139399+0000","last_unstale":"2024-09-13T23:08:38.028204+0000","last_undegraded":"2024-09-13T23:08:38.028204+0000","last_fullsized":"2024-09-13T23:08:38.028204+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:38.028097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:38.028097+0000","last_clean_scrub_stamp":"2024-09-13T23:08:38.028097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:47.384593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'87","reported_seq":180,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:50.698918+0000","last_change":"2024-09-13T23:08:50.698944+0000","last_active":"2024-09-13T23:08:50.698918+0000","last_peered":"2024-09-13T23:08:50.698918+0000","last_clean":"2024-09-13T23:08:50.698918+0000","last_became_active":"2024-09-13T23:05:22.140430+0000","last_became_peered":"2024-09-13T23:05:22.140430+0000","last_unstale":"2024-09-13T23:08:50.698918+0000","last_undegraded":"2024-09-13T23:08:50.698918+0000","last_fullsized":"2024-09-13T23:08:50.698918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'87","last_scrub_stamp":"2024-09-13T23:08:50.698827+0000","last_deep_scrub":"34'87","last_deep_scrub_stamp":"2024-09-13T23:08:50.698827+0000","last_clean_scrub_stamp":"2024-09-13T23:08:50.698827+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:09.410253+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":226,"num_write":170,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.106729+0000","last_change":"2024-09-13T23:05:14.113221+0000","last_active":"2024-09-13T23:08:22.106729+0000","last_peered":"2024-09-13T23:08:22.106729+0000","last_clean":"2024-09-13T23:08:22.106729+0000","last_became_active":"2024-09-13T23:05:14.112711+0000","last_became_peered":"2024-09-13T23:05:14.112711+0000","last_unstale":"2024-09-13T23:08:22.106729+0000","last_undegraded":"2024-09-13T23:08:22.106729+0000","last_fullsized":"2024-09-13T23:08:22.106729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:02.072403+0000","last_change":"2024-09-13T23:05:03.078145+0000","last_active":"2024-09-13T23:07:02.072403+0000","last_peered":"2024-09-13T23:07:02.072403+0000","last_clean":"2024-09-13T23:07:02.072403+0000","last_became_active":"2024-09-13T23:05:01.075438+0000","last_became_peered":"2024-09-13T23:05:01.075438+0000","last_unstale":"2024-09-13T23:07:02.072403+0000","last_undegraded":"2024-09-13T23:07:02.072403+0000","last_fullsized":"2024-09-13T23:07:02.072403+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043480299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.071388+0000","last_change":"2024-09-13T23:05:12.114595+0000","last_active":"2024-09-13T23:07:19.071388+0000","last_peered":"2024-09-13T23:07:19.071388+0000","last_clean":"2024-09-13T23:07:19.071388+0000","last_became_active":"2024-09-13T23:05:12.114087+0000","last_became_peered":"2024-09-13T23:05:12.114087+0000","last_unstale":"2024-09-13T23:07:19.071388+0000","last_undegraded":"2024-09-13T23:07:19.071388+0000","last_fullsized":"2024-09-13T23:07:19.071388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:36.535774+0000","last_change":"2024-09-13T23:08:36.535799+0000","last_active":"2024-09-13T23:08:36.535774+0000","last_peered":"2024-09-13T23:08:36.535774+0000","last_clean":"2024-09-13T23:08:36.535774+0000","last_became_active":"2024-09-13T23:05:16.127404+0000","last_became_peered":"2024-09-13T23:05:16.127404+0000","last_unstale":"2024-09-13T23:08:36.535774+0000","last_undegraded":"2024-09-13T23:08:36.535774+0000","last_fullsized":"2024-09-13T23:08:36.535774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:36.535683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:36.535683+0000","last_clean_scrub_stamp":"2024-09-13T23:08:36.535683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:53.587715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'291","reported_seq":516,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.140582+0000","last_change":"2024-09-13T23:08:33.140621+0000","last_active":"2024-09-13T23:08:33.140582+0000","last_peered":"2024-09-13T23:08:33.140582+0000","last_clean":"2024-09-13T23:08:33.140582+0000","last_became_active":"2024-09-13T23:05:18.135536+0000","last_became_peered":"2024-09-13T23:05:18.135536+0000","last_unstale":"2024-09-13T23:08:33.140582+0000","last_undegraded":"2024-09-13T23:08:33.140582+0000","last_fullsized":"2024-09-13T23:08:33.140582+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'291","last_scrub_stamp":"2024-09-13T23:08:33.140485+0000","last_deep_scrub":"34'291","last_deep_scrub_stamp":"2024-09-13T23:08:33.140485+0000","last_clean_scrub_stamp":"2024-09-13T23:08:33.140485+0000","objects_scrubbed":10,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:37:26.815426+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:27.076317+0000","last_change":"2024-09-13T23:05:20.139219+0000","last_active":"2024-09-13T23:07:27.076317+0000","last_peered":"2024-09-13T23:07:27.076317+0000","last_clean":"2024-09-13T23:07:27.076317+0000","last_became_active":"2024-09-13T23:05:20.138840+0000","last_became_peered":"2024-09-13T23:05:20.138840+0000","last_unstale":"2024-09-13T23:07:27.076317+0000","last_undegraded":"2024-09-13T23:07:27.076317+0000","last_fullsized":"2024-09-13T23:07:27.076317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.254236+0000","last_change":"2024-09-13T23:05:22.149748+0000","last_active":"2024-09-13T23:08:22.254236+0000","last_peered":"2024-09-13T23:08:22.254236+0000","last_clean":"2024-09-13T23:08:22.254236+0000","last_became_active":"2024-09-13T23:05:22.149430+0000","last_became_peered":"2024-09-13T23:05:22.149430+0000","last_unstale":"2024-09-13T23:08:22.254236+0000","last_undegraded":"2024-09-13T23:08:22.254236+0000","last_fullsized":"2024-09-13T23:08:22.254236+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:24.072360+0000","last_change":"2024-09-13T23:05:14.122318+0000","last_active":"2024-09-13T23:07:24.072360+0000","last_peered":"2024-09-13T23:07:24.072360+0000","last_clean":"2024-09-13T23:07:24.072360+0000","last_became_active":"2024-09-13T23:05:14.121629+0000","last_became_peered":"2024-09-13T23:05:14.121629+0000","last_unstale":"2024-09-13T23:07:24.072360+0000","last_undegraded":"2024-09-13T23:07:24.072360+0000","last_fullsized":"2024-09-13T23:07:24.072360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:06.072738+0000","last_change":"2024-09-13T23:05:03.246597+0000","last_active":"2024-09-13T23:07:06.072738+0000","last_peered":"2024-09-13T23:07:06.072738+0000","last_clean":"2024-09-13T23:07:06.072738+0000","last_became_active":"2024-09-13T23:05:01.075422+0000","last_became_peered":"2024-09-13T23:05:01.075422+0000","last_unstale":"2024-09-13T23:07:06.072738+0000","last_undegraded":"2024-09-13T23:07:06.072738+0000","last_fullsized":"2024-09-13T23:07:06.072738+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049267099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:14.070748+0000","last_change":"2024-09-13T23:05:12.118437+0000","last_active":"2024-09-13T23:07:14.070748+0000","last_peered":"2024-09-13T23:07:14.070748+0000","last_clean":"2024-09-13T23:07:14.070748+0000","last_became_active":"2024-09-13T23:05:12.117940+0000","last_became_peered":"2024-09-13T23:05:12.117940+0000","last_unstale":"2024-09-13T23:07:14.070748+0000","last_undegraded":"2024-09-13T23:07:14.070748+0000","last_fullsized":"2024-09-13T23:07:14.070748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:26.075500+0000","last_change":"2024-09-13T23:05:16.122638+0000","last_active":"2024-09-13T23:07:26.075500+0000","last_peered":"2024-09-13T23:07:26.075500+0000","last_clean":"2024-09-13T23:07:26.075500+0000","last_became_active":"2024-09-13T23:05:16.122318+0000","last_became_peered":"2024-09-13T23:05:16.122318+0000","last_unstale":"2024-09-13T23:07:26.075500+0000","last_undegraded":"2024-09-13T23:07:26.075500+0000","last_fullsized":"2024-09-13T23:07:26.075500+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'23","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:43.618881+0000","last_change":"2024-09-13T23:08:43.618923+0000","last_active":"2024-09-13T23:08:43.618881+0000","last_peered":"2024-09-13T23:08:43.618881+0000","last_clean":"2024-09-13T23:08:43.618881+0000","last_became_active":"2024-09-13T23:05:18.127698+0000","last_became_peered":"2024-09-13T23:05:18.127698+0000","last_unstale":"2024-09-13T23:08:43.618881+0000","last_undegraded":"2024-09-13T23:08:43.618881+0000","last_fullsized":"2024-09-13T23:08:43.618881+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-09-13T23:08:43.618795+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-09-13T23:08:43.618795+0000","last_clean_scrub_stamp":"2024-09-13T23:08:43.618795+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:08.067385+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:29.073235+0000","last_change":"2024-09-13T23:05:20.145677+0000","last_active":"2024-09-13T23:07:29.073235+0000","last_peered":"2024-09-13T23:07:29.073235+0000","last_clean":"2024-09-13T23:07:29.073235+0000","last_became_active":"2024-09-13T23:05:20.145330+0000","last_became_peered":"2024-09-13T23:05:20.145330+0000","last_unstale":"2024-09-13T23:07:29.073235+0000","last_undegraded":"2024-09-13T23:07:29.073235+0000","last_fullsized":"2024-09-13T23:07:29.073235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:37.078155+0000","last_change":"2024-09-13T23:05:22.139303+0000","last_active":"2024-09-13T23:07:37.078155+0000","last_peered":"2024-09-13T23:07:37.078155+0000","last_clean":"2024-09-13T23:07:37.078155+0000","last_became_active":"2024-09-13T23:05:22.138259+0000","last_became_peered":"2024-09-13T23:05:22.138259+0000","last_unstale":"2024-09-13T23:07:37.078155+0000","last_undegraded":"2024-09-13T23:07:37.078155+0000","last_fullsized":"2024-09-13T23:07:37.078155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.369509+0000","last_change":"2024-09-13T23:05:14.110869+0000","last_active":"2024-09-13T23:08:22.369509+0000","last_peered":"2024-09-13T23:08:22.369509+0000","last_clean":"2024-09-13T23:08:22.369509+0000","last_became_active":"2024-09-13T23:05:14.110532+0000","last_became_peered":"2024-09-13T23:05:14.110532+0000","last_unstale":"2024-09-13T23:08:22.369509+0000","last_undegraded":"2024-09-13T23:08:22.369509+0000","last_fullsized":"2024-09-13T23:08:22.369509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:07.073338+0000","last_change":"2024-09-13T23:05:03.078756+0000","last_active":"2024-09-13T23:07:07.073338+0000","last_peered":"2024-09-13T23:07:07.073338+0000","last_clean":"2024-09-13T23:07:07.073338+0000","last_became_active":"2024-09-13T23:05:01.075399+0000","last_became_peered":"2024-09-13T23:05:01.075399+0000","last_unstale":"2024-09-13T23:07:07.073338+0000","last_undegraded":"2024-09-13T23:07:07.073338+0000","last_fullsized":"2024-09-13T23:07:07.073338+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010379530000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.074708+0000","last_change":"2024-09-13T23:05:12.131428+0000","last_active":"2024-09-13T23:07:21.074708+0000","last_peered":"2024-09-13T23:07:21.074708+0000","last_clean":"2024-09-13T23:07:21.074708+0000","last_became_active":"2024-09-13T23:05:12.130410+0000","last_became_peered":"2024-09-13T23:05:12.130410+0000","last_unstale":"2024-09-13T23:07:21.074708+0000","last_undegraded":"2024-09-13T23:07:21.074708+0000","last_fullsized":"2024-09-13T23:07:21.074708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:24.072283+0000","last_change":"2024-09-13T23:05:16.124659+0000","last_active":"2024-09-13T23:07:24.072283+0000","last_peered":"2024-09-13T23:07:24.072283+0000","last_clean":"2024-09-13T23:07:24.072283+0000","last_became_active":"2024-09-13T23:05:16.123983+0000","last_became_peered":"2024-09-13T23:05:16.123983+0000","last_unstale":"2024-09-13T23:07:24.072283+0000","last_undegraded":"2024-09-13T23:07:24.072283+0000","last_fullsized":"2024-09-13T23:07:24.072283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.531891+0000","last_change":"2024-09-13T23:05:18.133997+0000","last_active":"2024-09-13T23:08:21.531891+0000","last_peered":"2024-09-13T23:08:21.531891+0000","last_clean":"2024-09-13T23:08:21.531891+0000","last_became_active":"2024-09-13T23:05:18.133165+0000","last_became_peered":"2024-09-13T23:05:18.133165+0000","last_unstale":"2024-09-13T23:08:21.531891+0000","last_undegraded":"2024-09-13T23:08:21.531891+0000","last_fullsized":"2024-09-13T23:08:21.531891+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:32.077208+0000","last_change":"2024-09-13T23:05:20.144363+0000","last_active":"2024-09-13T23:07:32.077208+0000","last_peered":"2024-09-13T23:07:32.077208+0000","last_clean":"2024-09-13T23:07:32.077208+0000","last_became_active":"2024-09-13T23:05:20.143748+0000","last_became_peered":"2024-09-13T23:05:20.143748+0000","last_unstale":"2024-09-13T23:07:32.077208+0000","last_undegraded":"2024-09-13T23:07:32.077208+0000","last_fullsized":"2024-09-13T23:07:32.077208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:33.076591+0000","last_change":"2024-09-13T23:05:22.150796+0000","last_active":"2024-09-13T23:07:33.076591+0000","last_peered":"2024-09-13T23:07:33.076591+0000","last_clean":"2024-09-13T23:07:33.076591+0000","last_became_active":"2024-09-13T23:05:22.150415+0000","last_became_peered":"2024-09-13T23:05:22.150415+0000","last_unstale":"2024-09-13T23:07:33.076591+0000","last_undegraded":"2024-09-13T23:07:33.076591+0000","last_fullsized":"2024-09-13T23:07:33.076591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.328739+0000","last_change":"2024-09-13T23:05:14.123934+0000","last_active":"2024-09-13T23:08:22.328739+0000","last_peered":"2024-09-13T23:08:22.328739+0000","last_clean":"2024-09-13T23:08:22.328739+0000","last_became_active":"2024-09-13T23:05:14.123447+0000","last_became_peered":"2024-09-13T23:05:14.123447+0000","last_unstale":"2024-09-13T23:08:22.328739+0000","last_undegraded":"2024-09-13T23:08:22.328739+0000","last_fullsized":"2024-09-13T23:08:22.328739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.074737+0000","last_change":"2024-09-13T23:05:12.124402+0000","last_active":"2024-09-13T23:07:21.074737+0000","last_peered":"2024-09-13T23:07:21.074737+0000","last_clean":"2024-09-13T23:07:21.074737+0000","last_became_active":"2024-09-13T23:05:12.124005+0000","last_became_peered":"2024-09-13T23:05:12.124005+0000","last_unstale":"2024-09-13T23:07:21.074737+0000","last_undegraded":"2024-09-13T23:07:21.074737+0000","last_fullsized":"2024-09-13T23:07:21.074737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:09.069976+0000","last_change":"2024-09-13T23:05:03.080556+0000","last_active":"2024-09-13T23:07:09.069976+0000","last_peered":"2024-09-13T23:07:09.069976+0000","last_clean":"2024-09-13T23:07:09.069976+0000","last_became_active":"2024-09-13T23:05:01.074963+0000","last_became_peered":"2024-09-13T23:05:01.074963+0000","last_unstale":"2024-09-13T23:07:09.069976+0000","last_undegraded":"2024-09-13T23:07:09.069976+0000","last_fullsized":"2024-09-13T23:07:09.069976+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055235699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.051330+0000","last_change":"2024-09-13T23:05:16.124473+0000","last_active":"2024-09-13T23:08:29.051330+0000","last_peered":"2024-09-13T23:08:29.051330+0000","last_clean":"2024-09-13T23:08:29.051330+0000","last_became_active":"2024-09-13T23:05:16.123971+0000","last_became_peered":"2024-09-13T23:05:16.123971+0000","last_unstale":"2024-09-13T23:08:29.051330+0000","last_undegraded":"2024-09-13T23:08:29.051330+0000","last_fullsized":"2024-09-13T23:08:29.051330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'73","reported_seq":149,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:43.048521+0000","last_change":"2024-09-13T23:08:43.048564+0000","last_active":"2024-09-13T23:08:43.048521+0000","last_peered":"2024-09-13T23:08:43.048521+0000","last_clean":"2024-09-13T23:08:43.048521+0000","last_became_active":"2024-09-13T23:05:18.132051+0000","last_became_peered":"2024-09-13T23:05:18.132051+0000","last_unstale":"2024-09-13T23:08:43.048521+0000","last_undegraded":"2024-09-13T23:08:43.048521+0000","last_fullsized":"2024-09-13T23:08:43.048521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'73","last_scrub_stamp":"2024-09-13T23:08:43.048427+0000","last_deep_scrub":"34'73","last_deep_scrub_stamp":"2024-09-13T23:08:43.048427+0000","last_clean_scrub_stamp":"2024-09-13T23:08:43.048427+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:30.653285+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:34.656045+0000","last_change":"2024-09-13T23:08:34.656091+0000","last_active":"2024-09-13T23:08:34.656045+0000","last_peered":"2024-09-13T23:08:34.656045+0000","last_clean":"2024-09-13T23:08:34.656045+0000","last_became_active":"2024-09-13T23:05:20.143566+0000","last_became_peered":"2024-09-13T23:05:20.143566+0000","last_unstale":"2024-09-13T23:08:34.656045+0000","last_undegraded":"2024-09-13T23:08:34.656045+0000","last_fullsized":"2024-09-13T23:08:34.656045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:34.655943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:34.655943+0000","last_clean_scrub_stamp":"2024-09-13T23:08:34.655943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:57.192299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.612390+0000","last_change":"2024-09-13T23:05:22.138169+0000","last_active":"2024-09-13T23:08:22.612390+0000","last_peered":"2024-09-13T23:08:22.612390+0000","last_clean":"2024-09-13T23:08:22.612390+0000","last_became_active":"2024-09-13T23:05:22.137952+0000","last_became_peered":"2024-09-13T23:05:22.137952+0000","last_unstale":"2024-09-13T23:08:22.612390+0000","last_undegraded":"2024-09-13T23:08:22.612390+0000","last_fullsized":"2024-09-13T23:08:22.612390+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:23.075201+0000","last_change":"2024-09-13T23:05:14.125712+0000","last_active":"2024-09-13T23:07:23.075201+0000","last_peered":"2024-09-13T23:07:23.075201+0000","last_clean":"2024-09-13T23:07:23.075201+0000","last_became_active":"2024-09-13T23:05:14.123549+0000","last_became_peered":"2024-09-13T23:05:14.123549+0000","last_unstale":"2024-09-13T23:07:23.075201+0000","last_undegraded":"2024-09-13T23:07:23.075201+0000","last_fullsized":"2024-09-13T23:07:23.075201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.071467+0000","last_change":"2024-09-13T23:05:12.130717+0000","last_active":"2024-09-13T23:07:19.071467+0000","last_peered":"2024-09-13T23:07:19.071467+0000","last_clean":"2024-09-13T23:07:19.071467+0000","last_became_active":"2024-09-13T23:05:12.130285+0000","last_became_peered":"2024-09-13T23:05:12.130285+0000","last_unstale":"2024-09-13T23:07:19.071467+0000","last_undegraded":"2024-09-13T23:07:19.071467+0000","last_fullsized":"2024-09-13T23:07:19.071467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:07.073421+0000","last_change":"2024-09-13T23:05:03.078119+0000","last_active":"2024-09-13T23:07:07.073421+0000","last_peered":"2024-09-13T23:07:07.073421+0000","last_clean":"2024-09-13T23:07:07.073421+0000","last_became_active":"2024-09-13T23:05:01.075431+0000","last_became_peered":"2024-09-13T23:05:01.075431+0000","last_unstale":"2024-09-13T23:07:07.073421+0000","last_undegraded":"2024-09-13T23:07:07.073421+0000","last_fullsized":"2024-09-13T23:07:07.073421+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041474900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:43.475029+0000","last_change":"2024-09-13T23:08:43.475069+0000","last_active":"2024-09-13T23:08:43.475029+0000","last_peered":"2024-09-13T23:08:43.475029+0000","last_clean":"2024-09-13T23:08:43.475029+0000","last_became_active":"2024-09-13T23:05:16.120337+0000","last_became_peered":"2024-09-13T23:05:16.120337+0000","last_unstale":"2024-09-13T23:08:43.475029+0000","last_undegraded":"2024-09-13T23:08:43.475029+0000","last_fullsized":"2024-09-13T23:08:43.475029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:43.474930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:43.474930+0000","last_clean_scrub_stamp":"2024-09-13T23:08:43.474930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:26.685113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'23","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:34.131751+0000","last_change":"2024-09-13T23:08:34.131801+0000","last_active":"2024-09-13T23:08:34.131751+0000","last_peered":"2024-09-13T23:08:34.131751+0000","last_clean":"2024-09-13T23:08:34.131751+0000","last_became_active":"2024-09-13T23:05:18.133676+0000","last_became_peered":"2024-09-13T23:05:18.133676+0000","last_unstale":"2024-09-13T23:08:34.131751+0000","last_undegraded":"2024-09-13T23:08:34.131751+0000","last_fullsized":"2024-09-13T23:08:34.131751+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-09-13T23:08:34.131649+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-09-13T23:08:34.131649+0000","last_clean_scrub_stamp":"2024-09-13T23:08:34.131649+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:29.113824+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":367,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:45.156181+0000","last_change":"2024-09-13T23:08:45.156231+0000","last_active":"2024-09-13T23:08:45.156181+0000","last_peered":"2024-09-13T23:08:45.156181+0000","last_clean":"2024-09-13T23:08:45.156181+0000","last_became_active":"2024-09-13T23:05:20.133332+0000","last_became_peered":"2024-09-13T23:05:20.133332+0000","last_unstale":"2024-09-13T23:08:45.156181+0000","last_undegraded":"2024-09-13T23:08:45.156181+0000","last_fullsized":"2024-09-13T23:08:45.156181+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:45.156073+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:45.156073+0000","last_clean_scrub_stamp":"2024-09-13T23:08:45.156073+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:16:24.872283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:37.078305+0000","last_change":"2024-09-13T23:05:22.141887+0000","last_active":"2024-09-13T23:07:37.078305+0000","last_peered":"2024-09-13T23:07:37.078305+0000","last_clean":"2024-09-13T23:07:37.078305+0000","last_became_active":"2024-09-13T23:05:22.141618+0000","last_became_peered":"2024-09-13T23:05:22.141618+0000","last_unstale":"2024-09-13T23:07:37.078305+0000","last_undegraded":"2024-09-13T23:07:37.078305+0000","last_fullsized":"2024-09-13T23:07:37.078305+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'18","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:49.406013+0000","last_change":"2024-09-13T23:08:49.406065+0000","last_active":"2024-09-13T23:08:49.406013+0000","last_peered":"2024-09-13T23:08:49.406013+0000","last_clean":"2024-09-13T23:08:49.406013+0000","last_became_active":"2024-09-13T23:05:14.126280+0000","last_became_peered":"2024-09-13T23:05:14.126280+0000","last_unstale":"2024-09-13T23:08:49.406013+0000","last_undegraded":"2024-09-13T23:08:49.406013+0000","last_fullsized":"2024-09-13T23:08:49.406013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-13T23:08:49.405905+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-13T23:08:49.405905+0000","last_clean_scrub_stamp":"2024-09-13T23:08:49.405905+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:10.813213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:22.075455+0000","last_change":"2024-09-13T23:05:12.149880+0000","last_active":"2024-09-13T23:07:22.075455+0000","last_peered":"2024-09-13T23:07:22.075455+0000","last_clean":"2024-09-13T23:07:22.075455+0000","last_became_active":"2024-09-13T23:05:12.149435+0000","last_became_peered":"2024-09-13T23:05:12.149435+0000","last_unstale":"2024-09-13T23:07:22.075455+0000","last_undegraded":"2024-09-13T23:07:22.075455+0000","last_fullsized":"2024-09-13T23:07:22.075455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:14.070866+0000","last_change":"2024-09-13T23:05:03.080603+0000","last_active":"2024-09-13T23:07:14.070866+0000","last_peered":"2024-09-13T23:07:14.070866+0000","last_clean":"2024-09-13T23:07:14.070866+0000","last_became_active":"2024-09-13T23:05:01.074982+0000","last_became_peered":"2024-09-13T23:05:01.074982+0000","last_unstale":"2024-09-13T23:07:14.070866+0000","last_undegraded":"2024-09-13T23:07:14.070866+0000","last_fullsized":"2024-09-13T23:07:14.070866+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054650599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:35.535003+0000","last_change":"2024-09-13T23:08:35.535037+0000","last_active":"2024-09-13T23:08:35.535003+0000","last_peered":"2024-09-13T23:08:35.535003+0000","last_clean":"2024-09-13T23:08:35.535003+0000","last_became_active":"2024-09-13T23:05:16.123573+0000","last_became_peered":"2024-09-13T23:05:16.123573+0000","last_unstale":"2024-09-13T23:08:35.535003+0000","last_undegraded":"2024-09-13T23:08:35.535003+0000","last_fullsized":"2024-09-13T23:08:35.535003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:35.534875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:35.534875+0000","last_clean_scrub_stamp":"2024-09-13T23:08:35.534875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:03:04.742631+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'11","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:27.076235+0000","last_change":"2024-09-13T23:05:18.132921+0000","last_active":"2024-09-13T23:07:27.076235+0000","last_peered":"2024-09-13T23:07:27.076235+0000","last_clean":"2024-09-13T23:07:27.076235+0000","last_became_active":"2024-09-13T23:05:18.132140+0000","last_became_peered":"2024-09-13T23:05:18.132140+0000","last_unstale":"2024-09-13T23:07:27.076235+0000","last_undegraded":"2024-09-13T23:07:27.076235+0000","last_fullsized":"2024-09-13T23:07:27.076235+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":441,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:34.964458+0000","last_change":"2024-09-13T23:08:34.964488+0000","last_active":"2024-09-13T23:08:34.964458+0000","last_peered":"2024-09-13T23:08:34.964458+0000","last_clean":"2024-09-13T23:08:34.964458+0000","last_became_active":"2024-09-13T23:05:20.136036+0000","last_became_peered":"2024-09-13T23:05:20.136036+0000","last_unstale":"2024-09-13T23:08:34.964458+0000","last_undegraded":"2024-09-13T23:08:34.964458+0000","last_fullsized":"2024-09-13T23:08:34.964458+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:34.964357+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:34.964357+0000","last_clean_scrub_stamp":"2024-09-13T23:08:34.964357+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:48:39.411891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:38.077573+0000","last_change":"2024-09-13T23:05:22.145082+0000","last_active":"2024-09-13T23:07:38.077573+0000","last_peered":"2024-09-13T23:07:38.077573+0000","last_clean":"2024-09-13T23:07:38.077573+0000","last_became_active":"2024-09-13T23:05:22.144787+0000","last_became_peered":"2024-09-13T23:05:22.144787+0000","last_unstale":"2024-09-13T23:07:38.077573+0000","last_undegraded":"2024-09-13T23:07:38.077573+0000","last_fullsized":"2024-09-13T23:07:38.077573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.074671+0000","last_change":"2024-09-13T23:05:14.112813+0000","last_active":"2024-09-13T23:07:21.074671+0000","last_peered":"2024-09-13T23:07:21.074671+0000","last_clean":"2024-09-13T23:07:21.074671+0000","last_became_active":"2024-09-13T23:05:14.112565+0000","last_became_peered":"2024-09-13T23:05:14.112565+0000","last_unstale":"2024-09-13T23:07:21.074671+0000","last_undegraded":"2024-09-13T23:07:21.074671+0000","last_fullsized":"2024-09-13T23:07:21.074671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:23.075286+0000","last_change":"2024-09-13T23:05:12.131805+0000","last_active":"2024-09-13T23:07:23.075286+0000","last_peered":"2024-09-13T23:07:23.075286+0000","last_clean":"2024-09-13T23:07:23.075286+0000","last_became_active":"2024-09-13T23:05:12.131413+0000","last_became_peered":"2024-09-13T23:05:12.131413+0000","last_unstale":"2024-09-13T23:07:23.075286+0000","last_undegraded":"2024-09-13T23:07:23.075286+0000","last_fullsized":"2024-09-13T23:07:23.075286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:12.074026+0000","last_change":"2024-09-13T23:05:03.078956+0000","last_active":"2024-09-13T23:07:12.074026+0000","last_peered":"2024-09-13T23:07:12.074026+0000","last_clean":"2024-09-13T23:07:12.074026+0000","last_became_active":"2024-09-13T23:05:01.323761+0000","last_became_peered":"2024-09-13T23:05:01.323761+0000","last_unstale":"2024-09-13T23:07:12.074026+0000","last_undegraded":"2024-09-13T23:07:12.074026+0000","last_fullsized":"2024-09-13T23:07:12.074026+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001181893,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:42.524246+0000","last_change":"2024-09-13T23:08:42.524284+0000","last_active":"2024-09-13T23:08:42.524246+0000","last_peered":"2024-09-13T23:08:42.524246+0000","last_clean":"2024-09-13T23:08:42.524246+0000","last_became_active":"2024-09-13T23:05:16.120974+0000","last_became_peered":"2024-09-13T23:05:16.120974+0000","last_unstale":"2024-09-13T23:08:42.524246+0000","last_undegraded":"2024-09-13T23:08:42.524246+0000","last_fullsized":"2024-09-13T23:08:42.524246+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:42.524136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:42.524136+0000","last_clean_scrub_stamp":"2024-09-13T23:08:42.524136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:38.191251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'96","reported_seq":189,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:37.565615+0000","last_change":"2024-09-13T23:08:37.565659+0000","last_active":"2024-09-13T23:08:37.565615+0000","last_peered":"2024-09-13T23:08:37.565615+0000","last_clean":"2024-09-13T23:08:37.565615+0000","last_became_active":"2024-09-13T23:05:18.137925+0000","last_became_peered":"2024-09-13T23:05:18.137925+0000","last_unstale":"2024-09-13T23:08:37.565615+0000","last_undegraded":"2024-09-13T23:08:37.565615+0000","last_fullsized":"2024-09-13T23:08:37.565615+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'96","last_scrub_stamp":"2024-09-13T23:08:37.565507+0000","last_deep_scrub":"34'96","last_deep_scrub_stamp":"2024-09-13T23:08:37.565507+0000","last_clean_scrub_stamp":"2024-09-13T23:08:37.565507+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:03:42.806653+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:39.048919+0000","last_change":"2024-09-13T23:08:39.048948+0000","last_active":"2024-09-13T23:08:39.048919+0000","last_peered":"2024-09-13T23:08:39.048919+0000","last_clean":"2024-09-13T23:08:39.048919+0000","last_became_active":"2024-09-13T23:05:20.129363+0000","last_became_peered":"2024-09-13T23:05:20.129363+0000","last_unstale":"2024-09-13T23:08:39.048919+0000","last_undegraded":"2024-09-13T23:08:39.048919+0000","last_fullsized":"2024-09-13T23:08:39.048919+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:39.048809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:39.048809+0000","last_clean_scrub_stamp":"2024-09-13T23:08:39.048809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:47.267359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:41.077846+0000","last_change":"2024-09-13T23:05:22.151007+0000","last_active":"2024-09-13T23:07:41.077846+0000","last_peered":"2024-09-13T23:07:41.077846+0000","last_clean":"2024-09-13T23:07:41.077846+0000","last_became_active":"2024-09-13T23:05:22.149645+0000","last_became_peered":"2024-09-13T23:05:22.149645+0000","last_unstale":"2024-09-13T23:07:41.077846+0000","last_undegraded":"2024-09-13T23:07:41.077846+0000","last_fullsized":"2024-09-13T23:07:41.077846+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:31.076271+0000","last_change":"2024-09-13T23:05:22.151921+0000","last_active":"2024-09-13T23:07:31.076271+0000","last_peered":"2024-09-13T23:07:31.076271+0000","last_clean":"2024-09-13T23:07:31.076271+0000","last_became_active":"2024-09-13T23:05:22.151640+0000","last_became_peered":"2024-09-13T23:05:22.151640+0000","last_unstale":"2024-09-13T23:07:31.076271+0000","last_undegraded":"2024-09-13T23:07:31.076271+0000","last_fullsized":"2024-09-13T23:07:31.076271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'12","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.329323+0000","last_change":"2024-09-13T23:05:14.113491+0000","last_active":"2024-09-13T23:08:22.329323+0000","last_peered":"2024-09-13T23:08:22.329323+0000","last_clean":"2024-09-13T23:08:22.329323+0000","last_became_active":"2024-09-13T23:05:14.113236+0000","last_became_peered":"2024-09-13T23:05:14.113236+0000","last_unstale":"2024-09-13T23:08:22.329323+0000","last_undegraded":"2024-09-13T23:08:22.329323+0000","last_fullsized":"2024-09-13T23:08:22.329323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:32.077121+0000","last_change":"2024-09-13T23:05:12.141658+0000","last_active":"2024-09-13T23:07:32.077121+0000","last_peered":"2024-09-13T23:07:32.077121+0000","last_clean":"2024-09-13T23:07:32.077121+0000","last_became_active":"2024-09-13T23:05:12.141280+0000","last_became_peered":"2024-09-13T23:05:12.141280+0000","last_unstale":"2024-09-13T23:07:32.077121+0000","last_undegraded":"2024-09-13T23:07:32.077121+0000","last_fullsized":"2024-09-13T23:07:32.077121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:47.188405+0000","last_change":"2024-09-13T23:08:47.188431+0000","last_active":"2024-09-13T23:08:47.188405+0000","last_peered":"2024-09-13T23:08:47.188405+0000","last_clean":"2024-09-13T23:08:47.188405+0000","last_became_active":"2024-09-13T23:05:16.117468+0000","last_became_peered":"2024-09-13T23:05:16.117468+0000","last_unstale":"2024-09-13T23:08:47.188405+0000","last_undegraded":"2024-09-13T23:08:47.188405+0000","last_fullsized":"2024-09-13T23:08:47.188405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:47.188316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:47.188316+0000","last_clean_scrub_stamp":"2024-09-13T23:08:47.188316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:30:41.738969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'41","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:44.467262+0000","last_change":"2024-09-13T23:08:44.467306+0000","last_active":"2024-09-13T23:08:44.467262+0000","last_peered":"2024-09-13T23:08:44.467262+0000","last_clean":"2024-09-13T23:08:44.467262+0000","last_became_active":"2024-09-13T23:05:18.131841+0000","last_became_peered":"2024-09-13T23:05:18.131841+0000","last_unstale":"2024-09-13T23:08:44.467262+0000","last_undegraded":"2024-09-13T23:08:44.467262+0000","last_fullsized":"2024-09-13T23:08:44.467262+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'41","last_scrub_stamp":"2024-09-13T23:08:44.467169+0000","last_deep_scrub":"34'41","last_deep_scrub_stamp":"2024-09-13T23:08:44.467169+0000","last_clean_scrub_stamp":"2024-09-13T23:08:44.467169+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:11.320136+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079057+0000","last_change":"2024-09-13T23:05:20.140436+0000","last_active":"2024-09-13T23:07:42.079057+0000","last_peered":"2024-09-13T23:07:42.079057+0000","last_clean":"2024-09-13T23:07:42.079057+0000","last_became_active":"2024-09-13T23:05:20.138958+0000","last_became_peered":"2024-09-13T23:05:20.138958+0000","last_unstale":"2024-09-13T23:07:42.079057+0000","last_undegraded":"2024-09-13T23:07:42.079057+0000","last_fullsized":"2024-09-13T23:07:42.079057+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'5","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.366898+0000","last_change":"2024-09-13T23:05:22.141828+0000","last_active":"2024-09-13T23:08:22.366898+0000","last_peered":"2024-09-13T23:08:22.366898+0000","last_clean":"2024-09-13T23:08:22.366898+0000","last_became_active":"2024-09-13T23:05:22.141471+0000","last_became_peered":"2024-09-13T23:05:22.141471+0000","last_unstale":"2024-09-13T23:08:22.366898+0000","last_undegraded":"2024-09-13T23:08:22.366898+0000","last_fullsized":"2024-09-13T23:08:22.366898+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'7","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.468832+0000","last_change":"2024-09-13T23:05:49.167955+0000","last_active":"2024-09-13T23:08:22.468832+0000","last_peered":"2024-09-13T23:08:22.468832+0000","last_clean":"2024-09-13T23:08:22.468832+0000","last_became_active":"2024-09-13T23:05:49.164131+0000","last_became_peered":"2024-09-13T23:05:49.164131+0000","last_unstale":"2024-09-13T23:08:22.468832+0000","last_undegraded":"2024-09-13T23:08:22.468832+0000","last_fullsized":"2024-09-13T23:08:22.468832+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.230548+0000","last_change":"2024-09-13T23:05:12.116495+0000","last_active":"2024-09-13T23:08:22.230548+0000","last_peered":"2024-09-13T23:08:22.230548+0000","last_clean":"2024-09-13T23:08:22.230548+0000","last_became_active":"2024-09-13T23:05:12.114343+0000","last_became_peered":"2024-09-13T23:05:12.114343+0000","last_unstale":"2024-09-13T23:08:22.230548+0000","last_undegraded":"2024-09-13T23:08:22.230548+0000","last_fullsized":"2024-09-13T23:08:22.230548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:37.573201+0000","last_change":"2024-09-13T23:08:37.573239+0000","last_active":"2024-09-13T23:08:37.573201+0000","last_peered":"2024-09-13T23:08:37.573201+0000","last_clean":"2024-09-13T23:08:37.573201+0000","last_became_active":"2024-09-13T23:05:49.160578+0000","last_became_peered":"2024-09-13T23:05:49.160578+0000","last_unstale":"2024-09-13T23:08:37.573201+0000","last_undegraded":"2024-09-13T23:08:37.573201+0000","last_fullsized":"2024-09-13T23:08:37.573201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:37.573092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:37.573092+0000","last_clean_scrub_stamp":"2024-09-13T23:08:37.573092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:12:43.684366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:47.139182+0000","last_change":"2024-09-13T23:08:47.139236+0000","last_active":"2024-09-13T23:08:47.139182+0000","last_peered":"2024-09-13T23:08:47.139182+0000","last_clean":"2024-09-13T23:08:47.139182+0000","last_became_active":"2024-09-13T23:05:18.121514+0000","last_became_peered":"2024-09-13T23:05:18.121514+0000","last_unstale":"2024-09-13T23:08:47.139182+0000","last_undegraded":"2024-09-13T23:08:47.139182+0000","last_fullsized":"2024-09-13T23:08:47.139182+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:08:47.139074+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:08:47.139074+0000","last_clean_scrub_stamp":"2024-09-13T23:08:47.139074+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:36.671882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.698449+0000","last_change":"2024-09-13T23:08:33.698474+0000","last_active":"2024-09-13T23:08:33.698449+0000","last_peered":"2024-09-13T23:08:33.698449+0000","last_clean":"2024-09-13T23:08:33.698449+0000","last_became_active":"2024-09-13T23:05:20.140290+0000","last_became_peered":"2024-09-13T23:05:20.140290+0000","last_unstale":"2024-09-13T23:08:33.698449+0000","last_undegraded":"2024-09-13T23:08:33.698449+0000","last_fullsized":"2024-09-13T23:08:33.698449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:33.698356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:33.698356+0000","last_clean_scrub_stamp":"2024-09-13T23:08:33.698356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:32:32.081819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:54.077032+0000","last_change":"2024-09-13T23:05:22.141270+0000","last_active":"2024-09-13T23:07:54.077032+0000","last_peered":"2024-09-13T23:07:54.077032+0000","last_clean":"2024-09-13T23:07:54.077032+0000","last_became_active":"2024-09-13T23:05:22.140963+0000","last_became_peered":"2024-09-13T23:05:22.140963+0000","last_unstale":"2024-09-13T23:07:54.077032+0000","last_undegraded":"2024-09-13T23:07:54.077032+0000","last_fullsized":"2024-09-13T23:07:54.077032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:34.073898+0000","last_change":"2024-09-13T23:05:14.120821+0000","last_active":"2024-09-13T23:07:34.073898+0000","last_peered":"2024-09-13T23:07:34.073898+0000","last_clean":"2024-09-13T23:07:34.073898+0000","last_became_active":"2024-09-13T23:05:14.120354+0000","last_became_peered":"2024-09-13T23:05:14.120354+0000","last_unstale":"2024-09-13T23:07:34.073898+0000","last_undegraded":"2024-09-13T23:07:34.073898+0000","last_fullsized":"2024-09-13T23:07:34.073898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:41.077861+0000","last_change":"2024-09-13T23:05:12.117147+0000","last_active":"2024-09-13T23:07:41.077861+0000","last_peered":"2024-09-13T23:07:41.077861+0000","last_clean":"2024-09-13T23:07:41.077861+0000","last_became_active":"2024-09-13T23:05:12.116819+0000","last_became_peered":"2024-09-13T23:05:12.116819+0000","last_unstale":"2024-09-13T23:07:41.077861+0000","last_undegraded":"2024-09-13T23:07:41.077861+0000","last_fullsized":"2024-09-13T23:07:41.077861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:49.713458+0000","last_change":"2024-09-13T23:08:49.713485+0000","last_active":"2024-09-13T23:08:49.713458+0000","last_peered":"2024-09-13T23:08:49.713458+0000","last_clean":"2024-09-13T23:08:49.713458+0000","last_became_active":"2024-09-13T23:05:16.124617+0000","last_became_peered":"2024-09-13T23:05:16.124617+0000","last_unstale":"2024-09-13T23:08:49.713458+0000","last_undegraded":"2024-09-13T23:08:49.713458+0000","last_fullsized":"2024-09-13T23:08:49.713458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:49.713367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:49.713367+0000","last_clean_scrub_stamp":"2024-09-13T23:08:49.713367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:31.248692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'47","reported_seq":119,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:45.136532+0000","last_change":"2024-09-13T23:08:45.136578+0000","last_active":"2024-09-13T23:08:45.136532+0000","last_peered":"2024-09-13T23:08:45.136532+0000","last_clean":"2024-09-13T23:08:45.136532+0000","last_became_active":"2024-09-13T23:05:18.126147+0000","last_became_peered":"2024-09-13T23:05:18.126147+0000","last_unstale":"2024-09-13T23:08:45.136532+0000","last_undegraded":"2024-09-13T23:08:45.136532+0000","last_fullsized":"2024-09-13T23:08:45.136532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-09-13T23:08:45.136425+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-09-13T23:08:45.136425+0000","last_clean_scrub_stamp":"2024-09-13T23:08:45.136425+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:12:33.611238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:37.125232+0000","last_change":"2024-09-13T23:08:37.125288+0000","last_active":"2024-09-13T23:08:37.125232+0000","last_peered":"2024-09-13T23:08:37.125232+0000","last_clean":"2024-09-13T23:08:37.125232+0000","last_became_active":"2024-09-13T23:05:20.128756+0000","last_became_peered":"2024-09-13T23:05:20.128756+0000","last_unstale":"2024-09-13T23:08:37.125232+0000","last_undegraded":"2024-09-13T23:08:37.125232+0000","last_fullsized":"2024-09-13T23:08:37.125232+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:37.125127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:37.125127+0000","last_clean_scrub_stamp":"2024-09-13T23:08:37.125127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:37.222133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:52.080856+0000","last_change":"2024-09-13T23:05:22.144728+0000","last_active":"2024-09-13T23:07:52.080856+0000","last_peered":"2024-09-13T23:07:52.080856+0000","last_clean":"2024-09-13T23:07:52.080856+0000","last_became_active":"2024-09-13T23:05:22.143767+0000","last_became_peered":"2024-09-13T23:05:22.143767+0000","last_unstale":"2024-09-13T23:07:52.080856+0000","last_undegraded":"2024-09-13T23:07:52.080856+0000","last_fullsized":"2024-09-13T23:07:52.080856+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:45.412765+0000","last_change":"2024-09-13T23:08:45.412793+0000","last_active":"2024-09-13T23:08:45.412765+0000","last_peered":"2024-09-13T23:08:45.412765+0000","last_clean":"2024-09-13T23:08:45.412765+0000","last_became_active":"2024-09-13T23:05:14.127000+0000","last_became_peered":"2024-09-13T23:05:14.127000+0000","last_unstale":"2024-09-13T23:08:45.412765+0000","last_undegraded":"2024-09-13T23:08:45.412765+0000","last_fullsized":"2024-09-13T23:08:45.412765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:45.412659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:45.412659+0000","last_clean_scrub_stamp":"2024-09-13T23:08:45.412659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:39.470592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:38.077668+0000","last_change":"2024-09-13T23:05:12.136754+0000","last_active":"2024-09-13T23:07:38.077668+0000","last_peered":"2024-09-13T23:07:38.077668+0000","last_clean":"2024-09-13T23:07:38.077668+0000","last_became_active":"2024-09-13T23:05:12.136384+0000","last_became_peered":"2024-09-13T23:05:12.136384+0000","last_unstale":"2024-09-13T23:07:38.077668+0000","last_undegraded":"2024-09-13T23:07:38.077668+0000","last_fullsized":"2024-09-13T23:07:38.077668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:34.507232+0000","last_change":"2024-09-13T23:08:34.507259+0000","last_active":"2024-09-13T23:08:34.507232+0000","last_peered":"2024-09-13T23:08:34.507232+0000","last_clean":"2024-09-13T23:08:34.507232+0000","last_became_active":"2024-09-13T23:05:16.124241+0000","last_became_peered":"2024-09-13T23:05:16.124241+0000","last_unstale":"2024-09-13T23:08:34.507232+0000","last_undegraded":"2024-09-13T23:08:34.507232+0000","last_fullsized":"2024-09-13T23:08:34.507232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:34.507140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:34.507140+0000","last_clean_scrub_stamp":"2024-09-13T23:08:34.507140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:44.378397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'37","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:44.633825+0000","last_change":"2024-09-13T23:08:44.633861+0000","last_active":"2024-09-13T23:08:44.633825+0000","last_peered":"2024-09-13T23:08:44.633825+0000","last_clean":"2024-09-13T23:08:44.633825+0000","last_became_active":"2024-09-13T23:05:18.126188+0000","last_became_peered":"2024-09-13T23:05:18.126188+0000","last_unstale":"2024-09-13T23:08:44.633825+0000","last_undegraded":"2024-09-13T23:08:44.633825+0000","last_fullsized":"2024-09-13T23:08:44.633825+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-13T23:08:44.633726+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-13T23:08:44.633726+0000","last_clean_scrub_stamp":"2024-09-13T23:08:44.633726+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:30.569822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:35.618513+0000","last_change":"2024-09-13T23:08:35.618558+0000","last_active":"2024-09-13T23:08:35.618513+0000","last_peered":"2024-09-13T23:08:35.618513+0000","last_clean":"2024-09-13T23:08:35.618513+0000","last_became_active":"2024-09-13T23:05:20.136098+0000","last_became_peered":"2024-09-13T23:05:20.136098+0000","last_unstale":"2024-09-13T23:08:35.618513+0000","last_undegraded":"2024-09-13T23:08:35.618513+0000","last_fullsized":"2024-09-13T23:08:35.618513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:35.618400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:35.618400+0000","last_clean_scrub_stamp":"2024-09-13T23:08:35.618400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:30.276746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'14","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.328958+0000","last_change":"2024-09-13T23:05:14.113061+0000","last_active":"2024-09-13T23:08:22.328958+0000","last_peered":"2024-09-13T23:08:22.328958+0000","last_clean":"2024-09-13T23:08:22.328958+0000","last_became_active":"2024-09-13T23:05:14.112822+0000","last_became_peered":"2024-09-13T23:05:14.112822+0000","last_unstale":"2024-09-13T23:08:22.328958+0000","last_undegraded":"2024-09-13T23:08:22.328958+0000","last_fullsized":"2024-09-13T23:08:22.328958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:37.077990+0000","last_change":"2024-09-13T23:05:12.143550+0000","last_active":"2024-09-13T23:07:37.077990+0000","last_peered":"2024-09-13T23:07:37.077990+0000","last_clean":"2024-09-13T23:07:37.077990+0000","last_became_active":"2024-09-13T23:05:12.141970+0000","last_became_peered":"2024-09-13T23:05:12.141970+0000","last_unstale":"2024-09-13T23:07:37.077990+0000","last_undegraded":"2024-09-13T23:07:37.077990+0000","last_fullsized":"2024-09-13T23:07:37.077990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.071506+0000","last_change":"2024-09-13T23:05:16.120920+0000","last_active":"2024-09-13T23:07:19.071506+0000","last_peered":"2024-09-13T23:07:19.071506+0000","last_clean":"2024-09-13T23:07:19.071506+0000","last_became_active":"2024-09-13T23:05:16.120506+0000","last_became_peered":"2024-09-13T23:05:16.120506+0000","last_unstale":"2024-09-13T23:07:19.071506+0000","last_undegraded":"2024-09-13T23:07:19.071506+0000","last_fullsized":"2024-09-13T23:07:19.071506+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'65","reported_seq":138,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:44.096079+0000","last_change":"2024-09-13T23:08:44.096120+0000","last_active":"2024-09-13T23:08:44.096079+0000","last_peered":"2024-09-13T23:08:44.096079+0000","last_clean":"2024-09-13T23:08:44.096079+0000","last_became_active":"2024-09-13T23:05:18.126811+0000","last_became_peered":"2024-09-13T23:05:18.126811+0000","last_unstale":"2024-09-13T23:08:44.096079+0000","last_undegraded":"2024-09-13T23:08:44.096079+0000","last_fullsized":"2024-09-13T23:08:44.096079+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'65","last_scrub_stamp":"2024-09-13T23:08:44.095997+0000","last_deep_scrub":"34'65","last_deep_scrub_stamp":"2024-09-13T23:08:44.095997+0000","last_clean_scrub_stamp":"2024-09-13T23:08:44.095997+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:01.263619+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:36.593190+0000","last_change":"2024-09-13T23:08:36.593215+0000","last_active":"2024-09-13T23:08:36.593190+0000","last_peered":"2024-09-13T23:08:36.593190+0000","last_clean":"2024-09-13T23:08:36.593190+0000","last_became_active":"2024-09-13T23:05:20.135886+0000","last_became_peered":"2024-09-13T23:05:20.135886+0000","last_unstale":"2024-09-13T23:08:36.593190+0000","last_undegraded":"2024-09-13T23:08:36.593190+0000","last_fullsized":"2024-09-13T23:08:36.593190+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:36.593096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:36.593096+0000","last_clean_scrub_stamp":"2024-09-13T23:08:36.593096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:13.596600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.330781+0000","last_change":"2024-09-13T23:05:22.147716+0000","last_active":"2024-09-13T23:08:22.330781+0000","last_peered":"2024-09-13T23:08:22.330781+0000","last_clean":"2024-09-13T23:08:22.330781+0000","last_became_active":"2024-09-13T23:05:22.147394+0000","last_became_peered":"2024-09-13T23:05:22.147394+0000","last_unstale":"2024-09-13T23:08:22.330781+0000","last_undegraded":"2024-09-13T23:08:22.330781+0000","last_fullsized":"2024-09-13T23:08:22.330781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.369084+0000","last_change":"2024-09-13T23:05:14.121676+0000","last_active":"2024-09-13T23:08:22.369084+0000","last_peered":"2024-09-13T23:08:22.369084+0000","last_clean":"2024-09-13T23:08:22.369084+0000","last_became_active":"2024-09-13T23:05:14.121349+0000","last_became_peered":"2024-09-13T23:05:14.121349+0000","last_unstale":"2024-09-13T23:08:22.369084+0000","last_undegraded":"2024-09-13T23:08:22.369084+0000","last_fullsized":"2024-09-13T23:08:22.369084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:38.077464+0000","last_change":"2024-09-13T23:05:12.139567+0000","last_active":"2024-09-13T23:07:38.077464+0000","last_peered":"2024-09-13T23:07:38.077464+0000","last_clean":"2024-09-13T23:07:38.077464+0000","last_became_active":"2024-09-13T23:05:12.137092+0000","last_became_peered":"2024-09-13T23:05:12.137092+0000","last_unstale":"2024-09-13T23:07:38.077464+0000","last_undegraded":"2024-09-13T23:07:38.077464+0000","last_fullsized":"2024-09-13T23:07:38.077464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.074790+0000","last_change":"2024-09-13T23:05:16.121760+0000","last_active":"2024-09-13T23:07:21.074790+0000","last_peered":"2024-09-13T23:07:21.074790+0000","last_clean":"2024-09-13T23:07:21.074790+0000","last_became_active":"2024-09-13T23:05:16.121476+0000","last_became_peered":"2024-09-13T23:05:16.121476+0000","last_unstale":"2024-09-13T23:07:21.074790+0000","last_undegraded":"2024-09-13T23:07:21.074790+0000","last_fullsized":"2024-09-13T23:07:21.074790+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:46.445606+0000","last_change":"2024-09-13T23:08:46.445654+0000","last_active":"2024-09-13T23:08:46.445606+0000","last_peered":"2024-09-13T23:08:46.445606+0000","last_clean":"2024-09-13T23:08:46.445606+0000","last_became_active":"2024-09-13T23:05:18.132060+0000","last_became_peered":"2024-09-13T23:05:18.132060+0000","last_unstale":"2024-09-13T23:08:46.445606+0000","last_undegraded":"2024-09-13T23:08:46.445606+0000","last_fullsized":"2024-09-13T23:08:46.445606+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-09-13T23:08:46.445495+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-09-13T23:08:46.445495+0000","last_clean_scrub_stamp":"2024-09-13T23:08:46.445495+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:05:59.233056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:53.079756+0000","last_change":"2024-09-13T23:05:20.140626+0000","last_active":"2024-09-13T23:07:53.079756+0000","last_peered":"2024-09-13T23:07:53.079756+0000","last_clean":"2024-09-13T23:07:53.079756+0000","last_became_active":"2024-09-13T23:05:20.140333+0000","last_became_peered":"2024-09-13T23:05:20.140333+0000","last_unstale":"2024-09-13T23:07:53.079756+0000","last_undegraded":"2024-09-13T23:07:53.079756+0000","last_fullsized":"2024-09-13T23:07:53.079756+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079127+0000","last_change":"2024-09-13T23:05:22.140239+0000","last_active":"2024-09-13T23:07:42.079127+0000","last_peered":"2024-09-13T23:07:42.079127+0000","last_clean":"2024-09-13T23:07:42.079127+0000","last_became_active":"2024-09-13T23:05:22.139984+0000","last_became_peered":"2024-09-13T23:05:22.139984+0000","last_unstale":"2024-09-13T23:07:42.079127+0000","last_undegraded":"2024-09-13T23:07:42.079127+0000","last_fullsized":"2024-09-13T23:07:42.079127+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.371989+0000","last_change":"2024-09-13T23:05:14.125224+0000","last_active":"2024-09-13T23:08:22.371989+0000","last_peered":"2024-09-13T23:08:22.371989+0000","last_clean":"2024-09-13T23:08:22.371989+0000","last_became_active":"2024-09-13T23:05:14.124660+0000","last_became_peered":"2024-09-13T23:05:14.124660+0000","last_unstale":"2024-09-13T23:08:22.371989+0000","last_undegraded":"2024-09-13T23:08:22.371989+0000","last_fullsized":"2024-09-13T23:08:22.371989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:43.078257+0000","last_change":"2024-09-13T23:05:12.141582+0000","last_active":"2024-09-13T23:07:43.078257+0000","last_peered":"2024-09-13T23:07:43.078257+0000","last_clean":"2024-09-13T23:07:43.078257+0000","last_became_active":"2024-09-13T23:05:12.137136+0000","last_became_peered":"2024-09-13T23:05:12.137136+0000","last_unstale":"2024-09-13T23:07:43.078257+0000","last_undegraded":"2024-09-13T23:07:43.078257+0000","last_fullsized":"2024-09-13T23:07:43.078257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:46.078633+0000","last_change":"2024-09-13T23:05:16.123946+0000","last_active":"2024-09-13T23:07:46.078633+0000","last_peered":"2024-09-13T23:07:46.078633+0000","last_clean":"2024-09-13T23:07:46.078633+0000","last_became_active":"2024-09-13T23:05:16.123607+0000","last_became_peered":"2024-09-13T23:05:16.123607+0000","last_unstale":"2024-09-13T23:07:46.078633+0000","last_undegraded":"2024-09-13T23:07:46.078633+0000","last_fullsized":"2024-09-13T23:07:46.078633+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'39","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:40.011713+0000","last_change":"2024-09-13T23:08:40.011754+0000","last_active":"2024-09-13T23:08:40.011713+0000","last_peered":"2024-09-13T23:08:40.011713+0000","last_clean":"2024-09-13T23:08:40.011713+0000","last_became_active":"2024-09-13T23:05:18.136279+0000","last_became_peered":"2024-09-13T23:05:18.136279+0000","last_unstale":"2024-09-13T23:08:40.011713+0000","last_undegraded":"2024-09-13T23:08:40.011713+0000","last_fullsized":"2024-09-13T23:08:40.011713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-13T23:08:40.011606+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-13T23:08:40.011606+0000","last_clean_scrub_stamp":"2024-09-13T23:08:40.011606+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:05.066896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:46.122268+0000","last_change":"2024-09-13T23:08:46.122297+0000","last_active":"2024-09-13T23:08:46.122268+0000","last_peered":"2024-09-13T23:08:46.122268+0000","last_clean":"2024-09-13T23:08:46.122268+0000","last_became_active":"2024-09-13T23:05:20.141266+0000","last_became_peered":"2024-09-13T23:05:20.141266+0000","last_unstale":"2024-09-13T23:08:46.122268+0000","last_undegraded":"2024-09-13T23:08:46.122268+0000","last_fullsized":"2024-09-13T23:08:46.122268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:46.122177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:46.122177+0000","last_clean_scrub_stamp":"2024-09-13T23:08:46.122177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:29.240444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'9","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079113+0000","last_change":"2024-09-13T23:05:22.151767+0000","last_active":"2024-09-13T23:07:42.079113+0000","last_peered":"2024-09-13T23:07:42.079113+0000","last_clean":"2024-09-13T23:07:42.079113+0000","last_became_active":"2024-09-13T23:05:22.151339+0000","last_became_peered":"2024-09-13T23:05:22.151339+0000","last_unstale":"2024-09-13T23:07:42.079113+0000","last_undegraded":"2024-09-13T23:07:42.079113+0000","last_fullsized":"2024-09-13T23:07:42.079113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.329790+0000","last_change":"2024-09-13T23:05:14.112792+0000","last_active":"2024-09-13T23:08:22.329790+0000","last_peered":"2024-09-13T23:08:22.329790+0000","last_clean":"2024-09-13T23:08:22.329790+0000","last_became_active":"2024-09-13T23:05:14.112175+0000","last_became_peered":"2024-09-13T23:05:14.112175+0000","last_unstale":"2024-09-13T23:08:22.329790+0000","last_undegraded":"2024-09-13T23:08:22.329790+0000","last_fullsized":"2024-09-13T23:08:22.329790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079166+0000","last_change":"2024-09-13T23:05:12.141910+0000","last_active":"2024-09-13T23:07:42.079166+0000","last_peered":"2024-09-13T23:07:42.079166+0000","last_clean":"2024-09-13T23:07:42.079166+0000","last_became_active":"2024-09-13T23:05:12.141459+0000","last_became_peered":"2024-09-13T23:05:12.141459+0000","last_unstale":"2024-09-13T23:07:42.079166+0000","last_undegraded":"2024-09-13T23:07:42.079166+0000","last_fullsized":"2024-09-13T23:07:42.079166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"34'5","reported_seq":238,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:46.150879+0000","last_change":"2024-09-13T23:08:46.150906+0000","last_active":"2024-09-13T23:08:46.150879+0000","last_peered":"2024-09-13T23:08:46.150879+0000","last_clean":"2024-09-13T23:08:46.150879+0000","last_became_active":"2024-09-13T23:05:16.117736+0000","last_became_peered":"2024-09-13T23:05:16.117736+0000","last_unstale":"2024-09-13T23:08:46.150879+0000","last_undegraded":"2024-09-13T23:08:46.150879+0000","last_fullsized":"2024-09-13T23:08:46.150879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T23:08:46.150798+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T23:08:46.150798+0000","last_clean_scrub_stamp":"2024-09-13T23:08:46.150798+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:35.594124+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'16","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:48.450286+0000","last_change":"2024-09-13T23:08:48.450353+0000","last_active":"2024-09-13T23:08:48.450286+0000","last_peered":"2024-09-13T23:08:48.450286+0000","last_clean":"2024-09-13T23:08:48.450286+0000","last_became_active":"2024-09-13T23:05:18.132507+0000","last_became_peered":"2024-09-13T23:05:18.132507+0000","last_unstale":"2024-09-13T23:08:48.450286+0000","last_undegraded":"2024-09-13T23:08:48.450286+0000","last_fullsized":"2024-09-13T23:08:48.450286+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:08:48.450186+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:08:48.450186+0000","last_clean_scrub_stamp":"2024-09-13T23:08:48.450186+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:23.338330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":429,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:42.605579+0000","last_change":"2024-09-13T23:08:42.605617+0000","last_active":"2024-09-13T23:08:42.605579+0000","last_peered":"2024-09-13T23:08:42.605579+0000","last_clean":"2024-09-13T23:08:42.605579+0000","last_became_active":"2024-09-13T23:05:20.144334+0000","last_became_peered":"2024-09-13T23:05:20.144334+0000","last_unstale":"2024-09-13T23:08:42.605579+0000","last_undegraded":"2024-09-13T23:08:42.605579+0000","last_fullsized":"2024-09-13T23:08:42.605579+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:42.605465+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:42.605465+0000","last_clean_scrub_stamp":"2024-09-13T23:08:42.605465+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:53.293281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079015+0000","last_change":"2024-09-13T23:05:22.149167+0000","last_active":"2024-09-13T23:07:42.079015+0000","last_peered":"2024-09-13T23:07:42.079015+0000","last_clean":"2024-09-13T23:07:42.079015+0000","last_became_active":"2024-09-13T23:05:22.148894+0000","last_became_peered":"2024-09-13T23:05:22.148894+0000","last_unstale":"2024-09-13T23:07:42.079015+0000","last_undegraded":"2024-09-13T23:07:42.079015+0000","last_fullsized":"2024-09-13T23:07:42.079015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.470218+0000","last_change":"2024-09-13T23:05:14.112197+0000","last_active":"2024-09-13T23:08:22.470218+0000","last_peered":"2024-09-13T23:08:22.470218+0000","last_clean":"2024-09-13T23:08:22.470218+0000","last_became_active":"2024-09-13T23:05:14.111891+0000","last_became_peered":"2024-09-13T23:05:14.111891+0000","last_unstale":"2024-09-13T23:08:22.470218+0000","last_undegraded":"2024-09-13T23:08:22.470218+0000","last_fullsized":"2024-09-13T23:08:22.470218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:43.078291+0000","last_change":"2024-09-13T23:05:12.139920+0000","last_active":"2024-09-13T23:07:43.078291+0000","last_peered":"2024-09-13T23:07:43.078291+0000","last_clean":"2024-09-13T23:07:43.078291+0000","last_became_active":"2024-09-13T23:05:12.139564+0000","last_became_peered":"2024-09-13T23:05:12.139564+0000","last_unstale":"2024-09-13T23:07:43.078291+0000","last_undegraded":"2024-09-13T23:07:43.078291+0000","last_fullsized":"2024-09-13T23:07:43.078291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:44.189431+0000","last_change":"2024-09-13T23:08:44.189458+0000","last_active":"2024-09-13T23:08:44.189431+0000","last_peered":"2024-09-13T23:08:44.189431+0000","last_clean":"2024-09-13T23:08:44.189431+0000","last_became_active":"2024-09-13T23:05:16.118353+0000","last_became_peered":"2024-09-13T23:05:16.118353+0000","last_unstale":"2024-09-13T23:08:44.189431+0000","last_undegraded":"2024-09-13T23:08:44.189431+0000","last_fullsized":"2024-09-13T23:08:44.189431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:44.189340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:44.189340+0000","last_clean_scrub_stamp":"2024-09-13T23:08:44.189340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:31.794198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:35.089857+0000","last_change":"2024-09-13T23:08:35.089897+0000","last_active":"2024-09-13T23:08:35.089857+0000","last_peered":"2024-09-13T23:08:35.089857+0000","last_clean":"2024-09-13T23:08:35.089857+0000","last_became_active":"2024-09-13T23:05:18.127975+0000","last_became_peered":"2024-09-13T23:05:18.127975+0000","last_unstale":"2024-09-13T23:08:35.089857+0000","last_undegraded":"2024-09-13T23:08:35.089857+0000","last_fullsized":"2024-09-13T23:08:35.089857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-09-13T23:08:35.089767+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-09-13T23:08:35.089767+0000","last_clean_scrub_stamp":"2024-09-13T23:08:35.089767+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:53:49.326025+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:34.005517+0000","last_change":"2024-09-13T23:08:34.005539+0000","last_active":"2024-09-13T23:08:34.005517+0000","last_peered":"2024-09-13T23:08:34.005517+0000","last_clean":"2024-09-13T23:08:34.005517+0000","last_became_active":"2024-09-13T23:05:20.139329+0000","last_became_peered":"2024-09-13T23:05:20.139329+0000","last_unstale":"2024-09-13T23:08:34.005517+0000","last_undegraded":"2024-09-13T23:08:34.005517+0000","last_fullsized":"2024-09-13T23:08:34.005517+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:34.005418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:34.005418+0000","last_clean_scrub_stamp":"2024-09-13T23:08:34.005418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:17:06.755531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:48.079075+0000","last_change":"2024-09-13T23:05:22.148249+0000","last_active":"2024-09-13T23:07:48.079075+0000","last_peered":"2024-09-13T23:07:48.079075+0000","last_clean":"2024-09-13T23:07:48.079075+0000","last_became_active":"2024-09-13T23:05:22.147949+0000","last_became_peered":"2024-09-13T23:05:22.147949+0000","last_unstale":"2024-09-13T23:07:48.079075+0000","last_undegraded":"2024-09-13T23:07:48.079075+0000","last_fullsized":"2024-09-13T23:07:48.079075+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:46.078511+0000","last_change":"2024-09-13T23:05:14.114061+0000","last_active":"2024-09-13T23:07:46.078511+0000","last_peered":"2024-09-13T23:07:46.078511+0000","last_clean":"2024-09-13T23:07:46.078511+0000","last_became_active":"2024-09-13T23:05:14.113816+0000","last_became_peered":"2024-09-13T23:05:14.113816+0000","last_unstale":"2024-09-13T23:07:46.078511+0000","last_undegraded":"2024-09-13T23:07:46.078511+0000","last_fullsized":"2024-09-13T23:07:46.078511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079231+0000","last_change":"2024-09-13T23:05:12.149692+0000","last_active":"2024-09-13T23:07:42.079231+0000","last_peered":"2024-09-13T23:07:42.079231+0000","last_clean":"2024-09-13T23:07:42.079231+0000","last_became_active":"2024-09-13T23:05:12.149292+0000","last_became_peered":"2024-09-13T23:05:12.149292+0000","last_unstale":"2024-09-13T23:07:42.079231+0000","last_undegraded":"2024-09-13T23:07:42.079231+0000","last_fullsized":"2024-09-13T23:07:42.079231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:47.679656+0000","last_change":"2024-09-13T23:08:47.679695+0000","last_active":"2024-09-13T23:08:47.679656+0000","last_peered":"2024-09-13T23:08:47.679656+0000","last_clean":"2024-09-13T23:08:47.679656+0000","last_became_active":"2024-09-13T23:05:16.128023+0000","last_became_peered":"2024-09-13T23:05:16.128023+0000","last_unstale":"2024-09-13T23:08:47.679656+0000","last_undegraded":"2024-09-13T23:08:47.679656+0000","last_fullsized":"2024-09-13T23:08:47.679656+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:47.679555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:47.679555+0000","last_clean_scrub_stamp":"2024-09-13T23:08:47.679555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:54.252885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:40.988262+0000","last_change":"2024-09-13T23:08:40.988296+0000","last_active":"2024-09-13T23:08:40.988262+0000","last_peered":"2024-09-13T23:08:40.988262+0000","last_clean":"2024-09-13T23:08:40.988262+0000","last_became_active":"2024-09-13T23:05:18.132579+0000","last_became_peered":"2024-09-13T23:05:18.132579+0000","last_unstale":"2024-09-13T23:08:40.988262+0000","last_undegraded":"2024-09-13T23:08:40.988262+0000","last_fullsized":"2024-09-13T23:08:40.988262+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-13T23:08:40.988170+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-13T23:08:40.988170+0000","last_clean_scrub_stamp":"2024-09-13T23:08:40.988170+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:13:33.042844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:47.079846+0000","last_change":"2024-09-13T23:05:20.136330+0000","last_active":"2024-09-13T23:07:47.079846+0000","last_peered":"2024-09-13T23:07:47.079846+0000","last_clean":"2024-09-13T23:07:47.079846+0000","last_became_active":"2024-09-13T23:05:20.136023+0000","last_became_peered":"2024-09-13T23:05:20.136023+0000","last_unstale":"2024-09-13T23:07:47.079846+0000","last_undegraded":"2024-09-13T23:07:47.079846+0000","last_fullsized":"2024-09-13T23:07:47.079846+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:47.080030+0000","last_change":"2024-09-13T23:05:22.149740+0000","last_active":"2024-09-13T23:07:47.080030+0000","last_peered":"2024-09-13T23:07:47.080030+0000","last_clean":"2024-09-13T23:07:47.080030+0000","last_became_active":"2024-09-13T23:05:22.149468+0000","last_became_peered":"2024-09-13T23:05:22.149468+0000","last_unstale":"2024-09-13T23:07:47.080030+0000","last_undegraded":"2024-09-13T23:07:47.080030+0000","last_fullsized":"2024-09-13T23:07:47.080030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.469396+0000","last_change":"2024-09-13T23:05:14.109581+0000","last_active":"2024-09-13T23:08:22.469396+0000","last_peered":"2024-09-13T23:08:22.469396+0000","last_clean":"2024-09-13T23:08:22.469396+0000","last_became_active":"2024-09-13T23:05:14.109323+0000","last_became_peered":"2024-09-13T23:05:14.109323+0000","last_unstale":"2024-09-13T23:08:22.469396+0000","last_undegraded":"2024-09-13T23:08:22.469396+0000","last_fullsized":"2024-09-13T23:08:22.469396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:14.070879+0000","last_change":"2024-09-13T23:05:12.121655+0000","last_active":"2024-09-13T23:07:14.070879+0000","last_peered":"2024-09-13T23:07:14.070879+0000","last_clean":"2024-09-13T23:07:14.070879+0000","last_became_active":"2024-09-13T23:05:12.121050+0000","last_became_peered":"2024-09-13T23:05:12.121050+0000","last_unstale":"2024-09-13T23:07:14.070879+0000","last_undegraded":"2024-09-13T23:07:14.070879+0000","last_fullsized":"2024-09-13T23:07:14.070879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"34'2","reported_seq":230,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:43.150446+0000","last_change":"2024-09-13T23:08:43.150481+0000","last_active":"2024-09-13T23:08:43.150446+0000","last_peered":"2024-09-13T23:08:43.150446+0000","last_clean":"2024-09-13T23:08:43.150446+0000","last_became_active":"2024-09-13T23:05:16.123673+0000","last_became_peered":"2024-09-13T23:05:16.123673+0000","last_unstale":"2024-09-13T23:08:43.150446+0000","last_undegraded":"2024-09-13T23:08:43.150446+0000","last_fullsized":"2024-09-13T23:08:43.150446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:08:43.150340+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:08:43.150340+0000","last_clean_scrub_stamp":"2024-09-13T23:08:43.150340+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:26.284636+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'29","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.212691+0000","last_change":"2024-09-13T23:05:18.134891+0000","last_active":"2024-09-13T23:08:29.212691+0000","last_peered":"2024-09-13T23:08:29.212691+0000","last_clean":"2024-09-13T23:08:29.212691+0000","last_became_active":"2024-09-13T23:05:18.134152+0000","last_became_peered":"2024-09-13T23:05:18.134152+0000","last_unstale":"2024-09-13T23:08:29.212691+0000","last_undegraded":"2024-09-13T23:08:29.212691+0000","last_fullsized":"2024-09-13T23:08:29.212691+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:17.107433+0000","last_clean_scrub_stamp":"2024-09-13T23:05:17.107433+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:52.080786+0000","last_change":"2024-09-13T23:05:20.139704+0000","last_active":"2024-09-13T23:07:52.080786+0000","last_peered":"2024-09-13T23:07:52.080786+0000","last_clean":"2024-09-13T23:07:52.080786+0000","last_became_active":"2024-09-13T23:05:20.139133+0000","last_became_peered":"2024-09-13T23:05:20.139133+0000","last_unstale":"2024-09-13T23:07:52.080786+0000","last_undegraded":"2024-09-13T23:07:52.080786+0000","last_fullsized":"2024-09-13T23:07:52.080786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'12","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:47.079969+0000","last_change":"2024-09-13T23:05:22.144173+0000","last_active":"2024-09-13T23:07:47.079969+0000","last_peered":"2024-09-13T23:07:47.079969+0000","last_clean":"2024-09-13T23:07:47.079969+0000","last_became_active":"2024-09-13T23:05:22.143886+0000","last_became_peered":"2024-09-13T23:05:22.143886+0000","last_unstale":"2024-09-13T23:07:47.079969+0000","last_undegraded":"2024-09-13T23:07:47.079969+0000","last_fullsized":"2024-09-13T23:07:47.079969+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":59,"num_write":33,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:41.077666+0000","last_change":"2024-09-13T23:05:14.112092+0000","last_active":"2024-09-13T23:07:41.077666+0000","last_peered":"2024-09-13T23:07:41.077666+0000","last_clean":"2024-09-13T23:07:41.077666+0000","last_became_active":"2024-09-13T23:05:14.111836+0000","last_became_peered":"2024-09-13T23:05:14.111836+0000","last_unstale":"2024-09-13T23:07:41.077666+0000","last_undegraded":"2024-09-13T23:07:41.077666+0000","last_fullsized":"2024-09-13T23:07:41.077666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:18.074392+0000","last_change":"2024-09-13T23:05:12.135245+0000","last_active":"2024-09-13T23:07:18.074392+0000","last_peered":"2024-09-13T23:07:18.074392+0000","last_clean":"2024-09-13T23:07:18.074392+0000","last_became_active":"2024-09-13T23:05:12.134820+0000","last_became_peered":"2024-09-13T23:05:12.134820+0000","last_unstale":"2024-09-13T23:07:18.074392+0000","last_undegraded":"2024-09-13T23:07:18.074392+0000","last_fullsized":"2024-09-13T23:07:18.074392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:42.120392+0000","last_change":"2024-09-13T23:08:42.120463+0000","last_active":"2024-09-13T23:08:42.120392+0000","last_peered":"2024-09-13T23:08:42.120392+0000","last_clean":"2024-09-13T23:08:42.120392+0000","last_became_active":"2024-09-13T23:05:16.124295+0000","last_became_peered":"2024-09-13T23:05:16.124295+0000","last_unstale":"2024-09-13T23:08:42.120392+0000","last_undegraded":"2024-09-13T23:08:42.120392+0000","last_fullsized":"2024-09-13T23:08:42.120392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T23:08:42.120283+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T23:08:42.120283+0000","last_clean_scrub_stamp":"2024-09-13T23:08:42.120283+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:16.924419+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'39","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:38.609156+0000","last_change":"2024-09-13T23:08:38.609215+0000","last_active":"2024-09-13T23:08:38.609156+0000","last_peered":"2024-09-13T23:08:38.609156+0000","last_clean":"2024-09-13T23:08:38.609156+0000","last_became_active":"2024-09-13T23:05:18.131796+0000","last_became_peered":"2024-09-13T23:05:18.131796+0000","last_unstale":"2024-09-13T23:08:38.609156+0000","last_undegraded":"2024-09-13T23:08:38.609156+0000","last_fullsized":"2024-09-13T23:08:38.609156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-13T23:08:38.609041+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-13T23:08:38.609041+0000","last_clean_scrub_stamp":"2024-09-13T23:08:38.609041+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:03:15.467219+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:54.076987+0000","last_change":"2024-09-13T23:05:20.145706+0000","last_active":"2024-09-13T23:07:54.076987+0000","last_peered":"2024-09-13T23:07:54.076987+0000","last_clean":"2024-09-13T23:07:54.076987+0000","last_became_active":"2024-09-13T23:05:20.145356+0000","last_became_peered":"2024-09-13T23:05:20.145356+0000","last_unstale":"2024-09-13T23:07:54.076987+0000","last_undegraded":"2024-09-13T23:07:54.076987+0000","last_fullsized":"2024-09-13T23:07:54.076987+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079192+0000","last_change":"2024-09-13T23:05:22.147988+0000","last_active":"2024-09-13T23:07:42.079192+0000","last_peered":"2024-09-13T23:07:42.079192+0000","last_clean":"2024-09-13T23:07:42.079192+0000","last_became_active":"2024-09-13T23:05:22.147707+0000","last_became_peered":"2024-09-13T23:05:22.147707+0000","last_unstale":"2024-09-13T23:07:42.079192+0000","last_undegraded":"2024-09-13T23:07:42.079192+0000","last_fullsized":"2024-09-13T23:07:42.079192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'16","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.257267+0000","last_change":"2024-09-13T23:05:14.123908+0000","last_active":"2024-09-13T23:08:22.257267+0000","last_peered":"2024-09-13T23:08:22.257267+0000","last_clean":"2024-09-13T23:08:22.257267+0000","last_became_active":"2024-09-13T23:05:14.123513+0000","last_became_peered":"2024-09-13T23:05:14.123513+0000","last_unstale":"2024-09-13T23:08:22.257267+0000","last_undegraded":"2024-09-13T23:08:22.257267+0000","last_fullsized":"2024-09-13T23:08:22.257267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.184254+0000","last_change":"2024-09-13T23:05:12.129469+0000","last_active":"2024-09-13T23:08:29.184254+0000","last_peered":"2024-09-13T23:08:29.184254+0000","last_clean":"2024-09-13T23:08:29.184254+0000","last_became_active":"2024-09-13T23:05:12.125740+0000","last_became_peered":"2024-09-13T23:05:12.125740+0000","last_unstale":"2024-09-13T23:08:29.184254+0000","last_undegraded":"2024-09-13T23:08:29.184254+0000","last_fullsized":"2024-09-13T23:08:29.184254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.329819+0000","last_change":"2024-09-13T23:05:14.110713+0000","last_active":"2024-09-13T23:08:22.329819+0000","last_peered":"2024-09-13T23:08:22.329819+0000","last_clean":"2024-09-13T23:08:22.329819+0000","last_became_active":"2024-09-13T23:05:14.109959+0000","last_became_peered":"2024-09-13T23:05:14.109959+0000","last_unstale":"2024-09-13T23:08:22.329819+0000","last_undegraded":"2024-09-13T23:08:22.329819+0000","last_fullsized":"2024-09-13T23:08:22.329819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.183000+0000","last_change":"2024-09-13T23:05:12.114302+0000","last_active":"2024-09-13T23:08:29.183000+0000","last_peered":"2024-09-13T23:08:29.183000+0000","last_clean":"2024-09-13T23:08:29.183000+0000","last_became_active":"2024-09-13T23:05:12.113972+0000","last_became_peered":"2024-09-13T23:05:12.113972+0000","last_unstale":"2024-09-13T23:08:29.183000+0000","last_undegraded":"2024-09-13T23:08:29.183000+0000","last_fullsized":"2024-09-13T23:08:29.183000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'10","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.371798+0000","last_change":"2024-09-13T23:05:49.165777+0000","last_active":"2024-09-13T23:08:22.371798+0000","last_peered":"2024-09-13T23:08:22.371798+0000","last_clean":"2024-09-13T23:08:22.371798+0000","last_became_active":"2024-09-13T23:05:49.159488+0000","last_became_peered":"2024-09-13T23:05:49.159488+0000","last_unstale":"2024-09-13T23:08:22.371798+0000","last_undegraded":"2024-09-13T23:08:22.371798+0000","last_fullsized":"2024-09-13T23:08:22.371798+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.969033+0000","last_change":"2024-09-13T23:05:12.140088+0000","last_active":"2024-09-13T23:08:21.969033+0000","last_peered":"2024-09-13T23:08:21.969033+0000","last_clean":"2024-09-13T23:08:21.969033+0000","last_became_active":"2024-09-13T23:05:12.139673+0000","last_became_peered":"2024-09-13T23:05:12.139673+0000","last_unstale":"2024-09-13T23:08:21.969033+0000","last_undegraded":"2024-09-13T23:08:21.969033+0000","last_fullsized":"2024-09-13T23:08:21.969033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'9","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.470316+0000","last_change":"2024-09-13T23:05:14.112656+0000","last_active":"2024-09-13T23:08:22.470316+0000","last_peered":"2024-09-13T23:08:22.470316+0000","last_clean":"2024-09-13T23:08:22.470316+0000","last_became_active":"2024-09-13T23:05:14.112168+0000","last_became_peered":"2024-09-13T23:05:14.112168+0000","last_unstale":"2024-09-13T23:08:22.470316+0000","last_undegraded":"2024-09-13T23:08:22.470316+0000","last_fullsized":"2024-09-13T23:08:22.470316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.071445+0000","last_change":"2024-09-13T23:05:12.118979+0000","last_active":"2024-09-13T23:07:19.071445+0000","last_peered":"2024-09-13T23:07:19.071445+0000","last_clean":"2024-09-13T23:07:19.071445+0000","last_became_active":"2024-09-13T23:05:12.118425+0000","last_became_peered":"2024-09-13T23:05:12.118425+0000","last_unstale":"2024-09-13T23:07:19.071445+0000","last_undegraded":"2024-09-13T23:07:19.071445+0000","last_fullsized":"2024-09-13T23:07:19.071445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'14","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.369255+0000","last_change":"2024-09-13T23:05:14.120992+0000","last_active":"2024-09-13T23:08:22.369255+0000","last_peered":"2024-09-13T23:08:22.369255+0000","last_clean":"2024-09-13T23:08:22.369255+0000","last_became_active":"2024-09-13T23:05:14.120456+0000","last_became_peered":"2024-09-13T23:05:14.120456+0000","last_unstale":"2024-09-13T23:08:22.369255+0000","last_undegraded":"2024-09-13T23:08:22.369255+0000","last_fullsized":"2024-09-13T23:08:22.369255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:24.072264+0000","last_change":"2024-09-13T23:05:12.114509+0000","last_active":"2024-09-13T23:07:24.072264+0000","last_peered":"2024-09-13T23:07:24.072264+0000","last_clean":"2024-09-13T23:07:24.072264+0000","last_became_active":"2024-09-13T23:05:12.114046+0000","last_became_peered":"2024-09-13T23:05:12.114046+0000","last_unstale":"2024-09-13T23:07:24.072264+0000","last_undegraded":"2024-09-13T23:07:24.072264+0000","last_fullsized":"2024-09-13T23:07:24.072264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:23.075186+0000","last_change":"2024-09-13T23:05:14.124864+0000","last_active":"2024-09-13T23:07:23.075186+0000","last_peered":"2024-09-13T23:07:23.075186+0000","last_clean":"2024-09-13T23:07:23.075186+0000","last_became_active":"2024-09-13T23:05:14.123783+0000","last_became_peered":"2024-09-13T23:05:14.123783+0000","last_unstale":"2024-09-13T23:07:23.075186+0000","last_undegraded":"2024-09-13T23:07:23.075186+0000","last_fullsized":"2024-09-13T23:07:23.075186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:23.075264+0000","last_change":"2024-09-13T23:05:12.140004+0000","last_active":"2024-09-13T23:07:23.075264+0000","last_peered":"2024-09-13T23:07:23.075264+0000","last_clean":"2024-09-13T23:07:23.075264+0000","last_became_active":"2024-09-13T23:05:12.137465+0000","last_became_peered":"2024-09-13T23:05:12.137465+0000","last_unstale":"2024-09-13T23:07:23.075264+0000","last_undegraded":"2024-09-13T23:07:23.075264+0000","last_fullsized":"2024-09-13T23:07:23.075264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.071403+0000","last_change":"2024-09-13T23:05:14.121847+0000","last_active":"2024-09-13T23:07:19.071403+0000","last_peered":"2024-09-13T23:07:19.071403+0000","last_clean":"2024-09-13T23:07:19.071403+0000","last_became_active":"2024-09-13T23:05:14.121425+0000","last_became_peered":"2024-09-13T23:05:14.121425+0000","last_unstale":"2024-09-13T23:07:19.071403+0000","last_undegraded":"2024-09-13T23:07:19.071403+0000","last_fullsized":"2024-09-13T23:07:19.071403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:26.075512+0000","last_change":"2024-09-13T23:05:12.116219+0000","last_active":"2024-09-13T23:07:26.075512+0000","last_peered":"2024-09-13T23:07:26.075512+0000","last_clean":"2024-09-13T23:07:26.075512+0000","last_became_active":"2024-09-13T23:05:12.115546+0000","last_became_peered":"2024-09-13T23:05:12.115546+0000","last_unstale":"2024-09-13T23:07:26.075512+0000","last_undegraded":"2024-09-13T23:07:26.075512+0000","last_fullsized":"2024-09-13T23:07:26.075512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.329446+0000","last_change":"2024-09-13T23:05:14.123460+0000","last_active":"2024-09-13T23:08:22.329446+0000","last_peered":"2024-09-13T23:08:22.329446+0000","last_clean":"2024-09-13T23:08:22.329446+0000","last_became_active":"2024-09-13T23:05:14.122944+0000","last_became_peered":"2024-09-13T23:05:14.122944+0000","last_unstale":"2024-09-13T23:08:22.329446+0000","last_undegraded":"2024-09-13T23:08:22.329446+0000","last_fullsized":"2024-09-13T23:08:22.329446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.183001+0000","last_change":"2024-09-13T23:05:12.119016+0000","last_active":"2024-09-13T23:08:29.183001+0000","last_peered":"2024-09-13T23:08:29.183001+0000","last_clean":"2024-09-13T23:08:29.183001+0000","last_became_active":"2024-09-13T23:05:12.118347+0000","last_became_peered":"2024-09-13T23:05:12.118347+0000","last_unstale":"2024-09-13T23:08:29.183001+0000","last_undegraded":"2024-09-13T23:08:29.183001+0000","last_fullsized":"2024-09-13T23:08:29.183001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'8","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:38.077704+0000","last_change":"2024-09-13T23:05:14.126164+0000","last_active":"2024-09-13T23:07:38.077704+0000","last_peered":"2024-09-13T23:07:38.077704+0000","last_clean":"2024-09-13T23:07:38.077704+0000","last_became_active":"2024-09-13T23:05:14.124593+0000","last_became_peered":"2024-09-13T23:05:14.124593+0000","last_unstale":"2024-09-13T23:07:38.077704+0000","last_undegraded":"2024-09-13T23:07:38.077704+0000","last_fullsized":"2024-09-13T23:07:38.077704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.183209+0000","last_change":"2024-09-13T23:05:12.144032+0000","last_active":"2024-09-13T23:08:29.183209+0000","last_peered":"2024-09-13T23:08:29.183209+0000","last_clean":"2024-09-13T23:08:29.183209+0000","last_became_active":"2024-09-13T23:05:12.141628+0000","last_became_peered":"2024-09-13T23:05:12.141628+0000","last_unstale":"2024-09-13T23:08:29.183209+0000","last_undegraded":"2024-09-13T23:08:29.183209+0000","last_fullsized":"2024-09-13T23:08:29.183209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:37.078292+0000","last_change":"2024-09-13T23:05:14.113960+0000","last_active":"2024-09-13T23:07:37.078292+0000","last_peered":"2024-09-13T23:07:37.078292+0000","last_clean":"2024-09-13T23:07:37.078292+0000","last_became_active":"2024-09-13T23:05:14.113710+0000","last_became_peered":"2024-09-13T23:05:14.113710+0000","last_unstale":"2024-09-13T23:07:37.078292+0000","last_undegraded":"2024-09-13T23:07:37.078292+0000","last_fullsized":"2024-09-13T23:07:37.078292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:29.073149+0000","last_change":"2024-09-13T23:05:12.119408+0000","last_active":"2024-09-13T23:07:29.073149+0000","last_peered":"2024-09-13T23:07:29.073149+0000","last_clean":"2024-09-13T23:07:29.073149+0000","last_became_active":"2024-09-13T23:05:12.118716+0000","last_became_peered":"2024-09-13T23:05:12.118716+0000","last_unstale":"2024-09-13T23:07:29.073149+0000","last_undegraded":"2024-09-13T23:07:29.073149+0000","last_fullsized":"2024-09-13T23:07:29.073149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:29.073259+0000","last_change":"2024-09-13T23:05:14.120905+0000","last_active":"2024-09-13T23:07:29.073259+0000","last_peered":"2024-09-13T23:07:29.073259+0000","last_clean":"2024-09-13T23:07:29.073259+0000","last_became_active":"2024-09-13T23:05:14.120489+0000","last_became_peered":"2024-09-13T23:05:14.120489+0000","last_unstale":"2024-09-13T23:07:29.073259+0000","last_undegraded":"2024-09-13T23:07:29.073259+0000","last_fullsized":"2024-09-13T23:07:29.073259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:28.076007+0000","last_change":"2024-09-13T23:05:12.141835+0000","last_active":"2024-09-13T23:07:28.076007+0000","last_peered":"2024-09-13T23:07:28.076007+0000","last_clean":"2024-09-13T23:07:28.076007+0000","last_became_active":"2024-09-13T23:05:12.137735+0000","last_became_peered":"2024-09-13T23:05:12.137735+0000","last_unstale":"2024-09-13T23:07:28.076007+0000","last_undegraded":"2024-09-13T23:07:28.076007+0000","last_fullsized":"2024-09-13T23:07:28.076007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'3","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.469115+0000","last_change":"2024-09-13T23:05:14.122103+0000","last_active":"2024-09-13T23:08:22.469115+0000","last_peered":"2024-09-13T23:08:22.469115+0000","last_clean":"2024-09-13T23:08:22.469115+0000","last_became_active":"2024-09-13T23:05:14.121389+0000","last_became_peered":"2024-09-13T23:05:14.121389+0000","last_unstale":"2024-09-13T23:08:22.469115+0000","last_undegraded":"2024-09-13T23:08:22.469115+0000","last_fullsized":"2024-09-13T23:08:22.469115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:28.076038+0000","last_change":"2024-09-13T23:05:12.139774+0000","last_active":"2024-09-13T23:07:28.076038+0000","last_peered":"2024-09-13T23:07:28.076038+0000","last_clean":"2024-09-13T23:07:28.076038+0000","last_became_active":"2024-09-13T23:05:12.137118+0000","last_became_peered":"2024-09-13T23:05:12.137118+0000","last_unstale":"2024-09-13T23:07:28.076038+0000","last_undegraded":"2024-09-13T23:07:28.076038+0000","last_fullsized":"2024-09-13T23:07:28.076038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.369261+0000","last_change":"2024-09-13T23:05:14.125962+0000","last_active":"2024-09-13T23:08:22.369261+0000","last_peered":"2024-09-13T23:08:22.369261+0000","last_clean":"2024-09-13T23:08:22.369261+0000","last_became_active":"2024-09-13T23:05:14.124507+0000","last_became_peered":"2024-09-13T23:05:14.124507+0000","last_unstale":"2024-09-13T23:08:22.369261+0000","last_undegraded":"2024-09-13T23:08:22.369261+0000","last_fullsized":"2024-09-13T23:08:22.369261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:27.076303+0000","last_change":"2024-09-13T23:05:12.138932+0000","last_active":"2024-09-13T23:07:27.076303+0000","last_peered":"2024-09-13T23:07:27.076303+0000","last_clean":"2024-09-13T23:07:27.076303+0000","last_became_active":"2024-09-13T23:05:12.138577+0000","last_became_peered":"2024-09-13T23:05:12.138577+0000","last_unstale":"2024-09-13T23:07:27.076303+0000","last_undegraded":"2024-09-13T23:07:27.076303+0000","last_fullsized":"2024-09-13T23:07:27.076303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.259731+0000","last_change":"2024-09-13T23:05:14.125069+0000","last_active":"2024-09-13T23:08:22.259731+0000","last_peered":"2024-09-13T23:08:22.259731+0000","last_clean":"2024-09-13T23:08:22.259731+0000","last_became_active":"2024-09-13T23:05:14.124604+0000","last_became_peered":"2024-09-13T23:05:14.124604+0000","last_unstale":"2024-09-13T23:08:22.259731+0000","last_undegraded":"2024-09-13T23:08:22.259731+0000","last_fullsized":"2024-09-13T23:08:22.259731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:27.076337+0000","last_change":"2024-09-13T23:05:12.141608+0000","last_active":"2024-09-13T23:07:27.076337+0000","last_peered":"2024-09-13T23:07:27.076337+0000","last_clean":"2024-09-13T23:07:27.076337+0000","last_became_active":"2024-09-13T23:05:12.140686+0000","last_became_peered":"2024-09-13T23:05:12.140686+0000","last_unstale":"2024-09-13T23:07:27.076337+0000","last_undegraded":"2024-09-13T23:07:27.076337+0000","last_fullsized":"2024-09-13T23:07:27.076337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:50.447099+0000","last_change":"2024-09-13T23:08:50.447124+0000","last_active":"2024-09-13T23:08:50.447099+0000","last_peered":"2024-09-13T23:08:50.447099+0000","last_clean":"2024-09-13T23:08:50.447099+0000","last_became_active":"2024-09-13T23:05:14.125747+0000","last_became_peered":"2024-09-13T23:05:14.125747+0000","last_unstale":"2024-09-13T23:08:50.447099+0000","last_undegraded":"2024-09-13T23:08:50.447099+0000","last_fullsized":"2024-09-13T23:08:50.447099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T23:08:50.447009+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T23:08:50.447009+0000","last_clean_scrub_stamp":"2024-09-13T23:08:50.447009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:55.562708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:36.077046+0000","last_change":"2024-09-13T23:05:12.126550+0000","last_active":"2024-09-13T23:07:36.077046+0000","last_peered":"2024-09-13T23:07:36.077046+0000","last_clean":"2024-09-13T23:07:36.077046+0000","last_became_active":"2024-09-13T23:05:12.126202+0000","last_became_peered":"2024-09-13T23:05:12.126202+0000","last_unstale":"2024-09-13T23:07:36.077046+0000","last_undegraded":"2024-09-13T23:07:36.077046+0000","last_fullsized":"2024-09-13T23:07:36.077046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.106695+0000","last_change":"2024-09-13T23:05:14.125692+0000","last_active":"2024-09-13T23:08:22.106695+0000","last_peered":"2024-09-13T23:08:22.106695+0000","last_clean":"2024-09-13T23:08:22.106695+0000","last_became_active":"2024-09-13T23:05:14.125457+0000","last_became_peered":"2024-09-13T23:05:14.125457+0000","last_unstale":"2024-09-13T23:08:22.106695+0000","last_undegraded":"2024-09-13T23:08:22.106695+0000","last_fullsized":"2024-09-13T23:08:22.106695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:32.077217+0000","last_change":"2024-09-13T23:05:12.150036+0000","last_active":"2024-09-13T23:07:32.077217+0000","last_peered":"2024-09-13T23:07:32.077217+0000","last_clean":"2024-09-13T23:07:32.077217+0000","last_became_active":"2024-09-13T23:05:12.149345+0000","last_became_peered":"2024-09-13T23:05:12.149345+0000","last_unstale":"2024-09-13T23:07:32.077217+0000","last_undegraded":"2024-09-13T23:07:32.077217+0000","last_fullsized":"2024-09-13T23:07:32.077217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:32.076997+0000","last_change":"2024-09-13T23:05:12.142386+0000","last_active":"2024-09-13T23:07:32.076997+0000","last_peered":"2024-09-13T23:07:32.076997+0000","last_clean":"2024-09-13T23:07:32.076997+0000","last_became_active":"2024-09-13T23:05:12.140432+0000","last_became_peered":"2024-09-13T23:05:12.140432+0000","last_unstale":"2024-09-13T23:07:32.076997+0000","last_undegraded":"2024-09-13T23:07:32.076997+0000","last_fullsized":"2024-09-13T23:07:32.076997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'16","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.329243+0000","last_change":"2024-09-13T23:05:14.122670+0000","last_active":"2024-09-13T23:08:22.329243+0000","last_peered":"2024-09-13T23:08:22.329243+0000","last_clean":"2024-09-13T23:08:22.329243+0000","last_became_active":"2024-09-13T23:05:14.122105+0000","last_became_peered":"2024-09-13T23:05:14.122105+0000","last_unstale":"2024-09-13T23:08:22.329243+0000","last_undegraded":"2024-09-13T23:08:22.329243+0000","last_fullsized":"2024-09-13T23:08:22.329243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.247835+0000","last_change":"2024-09-13T23:05:12.121856+0000","last_active":"2024-09-13T23:08:22.247835+0000","last_peered":"2024-09-13T23:08:22.247835+0000","last_clean":"2024-09-13T23:08:22.247835+0000","last_became_active":"2024-09-13T23:05:12.120703+0000","last_became_peered":"2024-09-13T23:05:12.120703+0000","last_unstale":"2024-09-13T23:08:22.247835+0000","last_undegraded":"2024-09-13T23:08:22.247835+0000","last_fullsized":"2024-09-13T23:08:22.247835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'9","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.469411+0000","last_change":"2024-09-13T23:05:14.122765+0000","last_active":"2024-09-13T23:08:22.469411+0000","last_peered":"2024-09-13T23:08:22.469411+0000","last_clean":"2024-09-13T23:08:22.469411+0000","last_became_active":"2024-09-13T23:05:14.121636+0000","last_became_peered":"2024-09-13T23:05:14.121636+0000","last_unstale":"2024-09-13T23:08:22.469411+0000","last_undegraded":"2024-09-13T23:08:22.469411+0000","last_fullsized":"2024-09-13T23:08:22.469411+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2342,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1492,"ondisk_log_size":1492,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1600,"num_read_kb":1490,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":12,"seq":51539607604,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":151994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640306,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40492,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331348,"statfs":{"total":96636764160,"available":96595300352,"internally_reserved":0,"allocated":1011712,"data_stored":739728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705714,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40520,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331320,"statfs":{"total":96636764160,"available":96595271680,"internally_reserved":0,"allocated":1040384,"data_stored":741822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705714,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":446464,"data_stored":151868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T23:08:54.120 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.120 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.120 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.120 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.120 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.121 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.121 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.121 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.121 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.121 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.121 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.121 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.121 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.121 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.122 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.122 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.122 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.122 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.122 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.122 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.122 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.122 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.122 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.123 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.123 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.123 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.123 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.123 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.123 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.123 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.123 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.124 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.124 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.124 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.124 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.124 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.124 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.124 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.124 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.125 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.125 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.125 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.125 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.125 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.125 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.125 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.126 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.126 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.126 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.126 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.126 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.126 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.126 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.126 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.126 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.126 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.127 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.127 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.127 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.127 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.127 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.127 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.127 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.127 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.127 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.128 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.128 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.128 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.128 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.128 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.128 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.128 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.128 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.128 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.128 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.129 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.129 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.129 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.129 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T23:04:55.054026+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=4, tm_sec=55, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.129 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.129 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.129 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.129 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.130 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.130 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.130 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.130 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.130 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.130 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.130 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.130 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.130 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.131 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.131 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.131 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.131 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.131 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.131 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.131 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.131 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.131 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.131 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.132 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.132 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.132 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.132 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.132 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.132 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.132 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.132 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.133 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.133 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.133 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.133 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.133 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.133 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.133 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.133 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.134 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.134 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.134 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.134 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.134 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.134 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.134 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.134 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.134 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.135 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.135 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.135 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.135 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.135 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.135 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.135 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.135 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.136 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.136 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.136 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.136 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.136 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.136 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.136 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.136 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.137 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.137 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.137 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.137 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.137 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.137 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.137 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.137 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.138 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.138 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.138 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.138 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.138 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-13T23:05:17.107433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.138 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.138 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.138 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.138 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.139 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.139 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.139 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.139 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.139 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.139 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.139 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.139 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.139 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.139 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.140 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.140 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.140 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.140 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.140 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.140 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.140 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.140 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.140 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.141 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.141 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.141 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.141 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.141 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.141 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.141 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.141 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.141 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.142 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.142 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.142 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.142 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.142 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.142 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.142 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.142 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.142 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:08:54.142 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T23:09:14.144 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T23:09:14.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.258+0000 7f1c9e253640 1 Processor -- start 2024-09-13T23:09:14.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.258+0000 7f1c9e253640 1 -- start start 2024-09-13T23:09:14.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.258+0000 7f1c9e253640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1c9809bd50 0x7f1c9809c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:14.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.258+0000 7f1c9e253640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c9809d3b0 con 0x7f1c9809c670 2024-09-13T23:09:14.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.258+0000 7f1c9e253640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f1c98098230 con 0x7f1c9809bd50 2024-09-13T23:09:14.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.258+0000 7f1c977fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1c9809bd50 0x7f1c9809c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:14.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.258+0000 7f1c8effd640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f1c9809c670 0x7f1c980990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:51874/0 (socket says 172.21.15.17:51874) 2024-09-13T23:09:14.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.258+0000 7f1c8effd640 1 -- 172.21.15.17:0/2381995848 learned_addr learned my addr 172.21.15.17:0/2381995848 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:09:14.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.259+0000 7f1c977fe640 1 -- 172.21.15.17:0/2381995848 >> v1:172.21.15.17:6789/0 conn(0x7f1c9809c670 legacy=0x7f1c980990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:14.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.259+0000 7f1c977fe640 1 -- 172.21.15.17:0/2381995848 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c980983e0 con 0x7f1c9809bd50 2024-09-13T23:09:14.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.259+0000 7f1c977fe640 1 --2- 172.21.15.17:0/2381995848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c9809bd50 0x7f1c9809c130 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f1c88009720 tx=0x7f1c8802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cca221541e14716 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:14.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.259+0000 7f1c96ffd640 1 -- 172.21.15.17:0/2381995848 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c88037070 con 0x7f1c9809bd50 2024-09-13T23:09:14.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.260+0000 7f1c96ffd640 1 -- 172.21.15.17:0/2381995848 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c8802ad90 con 0x7f1c9809bd50 2024-09-13T23:09:14.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.260+0000 7f1c96ffd640 1 -- 172.21.15.17:0/2381995848 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c88032590 con 0x7f1c9809bd50 2024-09-13T23:09:14.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.260+0000 7f1c9e253640 1 -- 172.21.15.17:0/2381995848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c9809bd50 msgr2=0x7f1c9809c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:14.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.260+0000 7f1c9e253640 1 --2- 172.21.15.17:0/2381995848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c9809bd50 0x7f1c9809c130 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f1c88009720 tx=0x7f1c8802a110 comp rx=0 tx=0).stop 2024-09-13T23:09:14.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.260+0000 7f1c9e253640 1 -- 172.21.15.17:0/2381995848 shutdown_connections 2024-09-13T23:09:14.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.260+0000 7f1c9e253640 1 --2- 172.21.15.17:0/2381995848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c9809bd50 0x7f1c9809c130 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:14.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.260+0000 7f1c9e253640 1 -- 172.21.15.17:0/2381995848 >> 172.21.15.17:0/2381995848 conn(0x7f1c9806d4a0 msgr2=0x7f1c9806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:14.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.260+0000 7f1c9e253640 1 -- 172.21.15.17:0/2381995848 shutdown_connections 2024-09-13T23:09:14.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.260+0000 7f1c9e253640 1 -- 172.21.15.17:0/2381995848 wait complete. 2024-09-13T23:09:14.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.261+0000 7f1c9e253640 1 Processor -- start 2024-09-13T23:09:14.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.261+0000 7f1c9e253640 1 -- start start 2024-09-13T23:09:14.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.262+0000 7f1c9e253640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c9809bd50 0x7f1c98093570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:14.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.262+0000 7f1c9e253640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1c98099b90 con 0x7f1c9809bd50 2024-09-13T23:09:14.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.262+0000 7f1c977fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c9809bd50 0x7f1c98093570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:14.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.262+0000 7f1c977fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c9809bd50 0x7f1c98093570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55866/0 (socket says 172.21.15.17:55866) 2024-09-13T23:09:14.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.262+0000 7f1c977fe640 1 -- 172.21.15.17:0/4045027795 learned_addr learned my addr 172.21.15.17:0/4045027795 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:09:14.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.262+0000 7f1c977fe640 1 -- 172.21.15.17:0/4045027795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c98094eb0 con 0x7f1c9809bd50 2024-09-13T23:09:14.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.262+0000 7f1c977fe640 1 --2- 172.21.15.17:0/4045027795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c9809bd50 0x7f1c98093570 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f1c88009840 tx=0x7f1c880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:14.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.262+0000 7f1c94ff9640 1 -- 172.21.15.17:0/4045027795 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c88041070 con 0x7f1c9809bd50 2024-09-13T23:09:14.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.262+0000 7f1c94ff9640 1 -- 172.21.15.17:0/4045027795 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c8803c460 con 0x7f1c9809bd50 2024-09-13T23:09:14.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.262+0000 7f1c9e253640 1 -- 172.21.15.17:0/4045027795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c98095590 con 0x7f1c9809bd50 2024-09-13T23:09:14.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.262+0000 7f1c94ff9640 1 -- 172.21.15.17:0/4045027795 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c88037040 con 0x7f1c9809bd50 2024-09-13T23:09:14.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.262+0000 7f1c9e253640 1 -- 172.21.15.17:0/4045027795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c980961c0 con 0x7f1c9809bd50 2024-09-13T23:09:14.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.263+0000 7f1c94ff9640 1 -- 172.21.15.17:0/4045027795 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1c88044070 con 0x7f1c9809bd50 2024-09-13T23:09:14.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.263+0000 7f1c9e253640 1 -- 172.21.15.17:0/4045027795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c9809a130 con 0x7f1c9809bd50 2024-09-13T23:09:14.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.264+0000 7f1c94ff9640 1 --2- 172.21.15.17:0/4045027795 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1c780382a0 0x7f1c7803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:14.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.264+0000 7f1c94ff9640 1 -- 172.21.15.17:0/4045027795 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1c8806c840 con 0x7f1c9809bd50 2024-09-13T23:09:14.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.264+0000 7f1c8effd640 1 --2- 172.21.15.17:0/4045027795 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1c780382a0 0x7f1c7803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:14.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.264+0000 7f1c8effd640 1 --2- 172.21.15.17:0/4045027795 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1c780382a0 0x7f1c7803a760 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1c80007fd0 tx=0x7f1c80007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:14.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.268+0000 7f1c94ff9640 1 -- 172.21.15.17:0/4045027795 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1c980961c0 con 0x7f1c9809bd50 2024-09-13T23:09:14.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.442+0000 7f1c9e253640 1 -- 172.21.15.17:0/4045027795 --> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1c9809d020 con 0x7f1c780382a0 2024-09-13T23:09:14.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.458+0000 7f1c94ff9640 1 -- 172.21.15.17:0/4045027795 <== mgr.4102 v2:172.21.15.164:6824/713838566 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+662368 (secure 0 0 0) 0x7f1c9809d020 con 0x7f1c780382a0 2024-09-13T23:09:14.467 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:09:14.472 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-13T23:09:14.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.463+0000 7f1c9e253640 1 -- 172.21.15.17:0/4045027795 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1c780382a0 msgr2=0x7f1c7803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:14.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.463+0000 7f1c9e253640 1 --2- 172.21.15.17:0/4045027795 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1c780382a0 0x7f1c7803a760 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1c80007fd0 tx=0x7f1c80007ac0 comp rx=0 tx=0).stop 2024-09-13T23:09:14.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.463+0000 7f1c9e253640 1 -- 172.21.15.17:0/4045027795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c9809bd50 msgr2=0x7f1c98093570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:14.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.463+0000 7f1c9e253640 1 --2- 172.21.15.17:0/4045027795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c9809bd50 0x7f1c98093570 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f1c88009840 tx=0x7f1c880046c0 comp rx=0 tx=0).stop 2024-09-13T23:09:14.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.463+0000 7f1c9e253640 1 -- 172.21.15.17:0/4045027795 shutdown_connections 2024-09-13T23:09:14.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.463+0000 7f1c9e253640 1 --2- 172.21.15.17:0/4045027795 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f1c780382a0 0x7f1c7803a760 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:14.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.463+0000 7f1c9e253640 1 --2- 172.21.15.17:0/4045027795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c9809bd50 0x7f1c98093570 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:14.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.463+0000 7f1c9e253640 1 -- 172.21.15.17:0/4045027795 >> 172.21.15.17:0/4045027795 conn(0x7f1c9806d4a0 msgr2=0x7f1c9809eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:14.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.463+0000 7f1c9e253640 1 -- 172.21.15.17:0/4045027795 shutdown_connections 2024-09-13T23:09:14.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:14.463+0000 7f1c9e253640 1 -- 172.21.15.17:0/4045027795 wait complete. 2024-09-13T23:09:14.476 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-09-13T23:09:14.115601+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5088,"num_read_kb":4669,"num_write":2179,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4781,"ondisk_log_size":4781,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152608,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334752,"statfs":{"total":386547056640,"available":386390786048,"internally_reserved":0,"allocated":2981888,"data_stored":1785412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004186"},"pg_stats":[{"pgid":"3.3f","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:05.685794+0000","last_change":"2024-09-13T23:09:05.685819+0000","last_active":"2024-09-13T23:09:05.685794+0000","last_peered":"2024-09-13T23:09:05.685794+0000","last_clean":"2024-09-13T23:09:05.685794+0000","last_became_active":"2024-09-13T23:05:12.130009+0000","last_became_peered":"2024-09-13T23:05:12.130009+0000","last_unstale":"2024-09-13T23:09:05.685794+0000","last_undegraded":"2024-09-13T23:09:05.685794+0000","last_fullsized":"2024-09-13T23:09:05.685794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:05.685705+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:05.685705+0000","last_clean_scrub_stamp":"2024-09-13T23:09:05.685705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:20:30.741148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:00.090836+0000","last_change":"2024-09-13T23:09:00.090903+0000","last_active":"2024-09-13T23:09:00.090836+0000","last_peered":"2024-09-13T23:09:00.090836+0000","last_clean":"2024-09-13T23:09:00.090836+0000","last_became_active":"2024-09-13T23:05:14.125215+0000","last_became_peered":"2024-09-13T23:05:14.125215+0000","last_unstale":"2024-09-13T23:09:00.090836+0000","last_undegraded":"2024-09-13T23:09:00.090836+0000","last_fullsized":"2024-09-13T23:09:00.090836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:00.090719+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:00.090719+0000","last_clean_scrub_stamp":"2024-09-13T23:09:00.090719+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:25.638836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.071518+0000","last_change":"2024-09-13T23:05:12.119102+0000","last_active":"2024-09-13T23:07:19.071518+0000","last_peered":"2024-09-13T23:07:19.071518+0000","last_clean":"2024-09-13T23:07:19.071518+0000","last_became_active":"2024-09-13T23:05:12.118411+0000","last_became_peered":"2024-09-13T23:05:12.118411+0000","last_unstale":"2024-09-13T23:07:19.071518+0000","last_undegraded":"2024-09-13T23:07:19.071518+0000","last_fullsized":"2024-09-13T23:07:19.071518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'8","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:47.079882+0000","last_change":"2024-09-13T23:05:14.109708+0000","last_active":"2024-09-13T23:07:47.079882+0000","last_peered":"2024-09-13T23:07:47.079882+0000","last_clean":"2024-09-13T23:07:47.079882+0000","last_became_active":"2024-09-13T23:05:14.109464+0000","last_became_peered":"2024-09-13T23:05:14.109464+0000","last_unstale":"2024-09-13T23:07:47.079882+0000","last_undegraded":"2024-09-13T23:07:47.079882+0000","last_fullsized":"2024-09-13T23:07:47.079882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:17.074811+0000","last_change":"2024-09-13T23:05:12.146564+0000","last_active":"2024-09-13T23:07:17.074811+0000","last_peered":"2024-09-13T23:07:17.074811+0000","last_clean":"2024-09-13T23:07:17.074811+0000","last_became_active":"2024-09-13T23:05:12.146191+0000","last_became_peered":"2024-09-13T23:05:12.146191+0000","last_unstale":"2024-09-13T23:07:17.074811+0000","last_undegraded":"2024-09-13T23:07:17.074811+0000","last_fullsized":"2024-09-13T23:07:17.074811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:47.079912+0000","last_change":"2024-09-13T23:05:14.110454+0000","last_active":"2024-09-13T23:07:47.079912+0000","last_peered":"2024-09-13T23:07:47.079912+0000","last_clean":"2024-09-13T23:07:47.079912+0000","last_became_active":"2024-09-13T23:05:14.110201+0000","last_became_peered":"2024-09-13T23:05:14.110201+0000","last_unstale":"2024-09-13T23:07:47.079912+0000","last_undegraded":"2024-09-13T23:07:47.079912+0000","last_fullsized":"2024-09-13T23:07:47.079912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:01.547273+0000","last_change":"2024-09-13T23:09:01.547312+0000","last_active":"2024-09-13T23:09:01.547273+0000","last_peered":"2024-09-13T23:09:01.547273+0000","last_clean":"2024-09-13T23:09:01.547273+0000","last_became_active":"2024-09-13T23:05:12.132461+0000","last_became_peered":"2024-09-13T23:05:12.132461+0000","last_unstale":"2024-09-13T23:09:01.547273+0000","last_undegraded":"2024-09-13T23:09:01.547273+0000","last_fullsized":"2024-09-13T23:09:01.547273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:01.547143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:01.547143+0000","last_clean_scrub_stamp":"2024-09-13T23:09:01.547143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:01.270260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:09.323049+0000","last_change":"2024-09-13T23:09:09.323075+0000","last_active":"2024-09-13T23:09:09.323049+0000","last_peered":"2024-09-13T23:09:09.323049+0000","last_clean":"2024-09-13T23:09:09.323049+0000","last_became_active":"2024-09-13T23:05:14.113430+0000","last_became_peered":"2024-09-13T23:05:14.113430+0000","last_unstale":"2024-09-13T23:09:09.323049+0000","last_undegraded":"2024-09-13T23:09:09.323049+0000","last_fullsized":"2024-09-13T23:09:09.323049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:09.322940+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:09.322940+0000","last_clean_scrub_stamp":"2024-09-13T23:09:09.322940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:32.644280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079177+0000","last_change":"2024-09-13T23:05:12.146576+0000","last_active":"2024-09-13T23:07:42.079177+0000","last_peered":"2024-09-13T23:07:42.079177+0000","last_clean":"2024-09-13T23:07:42.079177+0000","last_became_active":"2024-09-13T23:05:12.146220+0000","last_became_peered":"2024-09-13T23:05:12.146220+0000","last_unstale":"2024-09-13T23:07:42.079177+0000","last_undegraded":"2024-09-13T23:07:42.079177+0000","last_fullsized":"2024-09-13T23:07:42.079177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'4","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:09.140839+0000","last_change":"2024-09-13T23:09:09.140867+0000","last_active":"2024-09-13T23:09:09.140839+0000","last_peered":"2024-09-13T23:09:09.140839+0000","last_clean":"2024-09-13T23:09:09.140839+0000","last_became_active":"2024-09-13T23:05:14.122513+0000","last_became_peered":"2024-09-13T23:05:14.122513+0000","last_unstale":"2024-09-13T23:09:09.140839+0000","last_undegraded":"2024-09-13T23:09:09.140839+0000","last_fullsized":"2024-09-13T23:09:09.140839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:09.140751+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:09.140751+0000","last_clean_scrub_stamp":"2024-09-13T23:09:09.140751+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:41.543687+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.243329+0000","last_change":"2024-09-13T23:05:12.113973+0000","last_active":"2024-09-13T23:08:22.243329+0000","last_peered":"2024-09-13T23:08:22.243329+0000","last_clean":"2024-09-13T23:08:22.243329+0000","last_became_active":"2024-09-13T23:05:12.113601+0000","last_became_peered":"2024-09-13T23:05:12.113601+0000","last_unstale":"2024-09-13T23:08:22.243329+0000","last_undegraded":"2024-09-13T23:08:22.243329+0000","last_fullsized":"2024-09-13T23:08:22.243329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:51.435636+0000","last_change":"2024-09-13T23:08:51.435662+0000","last_active":"2024-09-13T23:08:51.435636+0000","last_peered":"2024-09-13T23:08:51.435636+0000","last_clean":"2024-09-13T23:08:51.435636+0000","last_became_active":"2024-09-13T23:05:14.124971+0000","last_became_peered":"2024-09-13T23:05:14.124971+0000","last_unstale":"2024-09-13T23:08:51.435636+0000","last_undegraded":"2024-09-13T23:08:51.435636+0000","last_fullsized":"2024-09-13T23:08:51.435636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:08:51.435544+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:08:51.435544+0000","last_clean_scrub_stamp":"2024-09-13T23:08:51.435544+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:42:37.254383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079100+0000","last_change":"2024-09-13T23:05:12.139628+0000","last_active":"2024-09-13T23:07:42.079100+0000","last_peered":"2024-09-13T23:07:42.079100+0000","last_clean":"2024-09-13T23:07:42.079100+0000","last_became_active":"2024-09-13T23:05:12.138297+0000","last_became_peered":"2024-09-13T23:05:12.138297+0000","last_unstale":"2024-09-13T23:07:42.079100+0000","last_undegraded":"2024-09-13T23:07:42.079100+0000","last_fullsized":"2024-09-13T23:07:42.079100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'16","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:55.622744+0000","last_change":"2024-09-13T23:08:55.622772+0000","last_active":"2024-09-13T23:08:55.622744+0000","last_peered":"2024-09-13T23:08:55.622744+0000","last_clean":"2024-09-13T23:08:55.622744+0000","last_became_active":"2024-09-13T23:05:14.123950+0000","last_became_peered":"2024-09-13T23:05:14.123950+0000","last_unstale":"2024-09-13T23:08:55.622744+0000","last_undegraded":"2024-09-13T23:08:55.622744+0000","last_fullsized":"2024-09-13T23:08:55.622744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:08:55.622652+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:08:55.622652+0000","last_clean_scrub_stamp":"2024-09-13T23:08:55.622652+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:33.082242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":68,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:44.075413+0000","last_change":"2024-09-13T23:05:12.117693+0000","last_active":"2024-09-13T23:07:44.075413+0000","last_peered":"2024-09-13T23:07:44.075413+0000","last_clean":"2024-09-13T23:07:44.075413+0000","last_became_active":"2024-09-13T23:05:12.117028+0000","last_became_peered":"2024-09-13T23:05:12.117028+0000","last_unstale":"2024-09-13T23:07:44.075413+0000","last_undegraded":"2024-09-13T23:07:44.075413+0000","last_fullsized":"2024-09-13T23:07:44.075413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'18","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:08.738713+0000","last_change":"2024-09-13T23:09:08.738777+0000","last_active":"2024-09-13T23:09:08.738713+0000","last_peered":"2024-09-13T23:09:08.738713+0000","last_clean":"2024-09-13T23:09:08.738713+0000","last_became_active":"2024-09-13T23:05:14.114831+0000","last_became_peered":"2024-09-13T23:05:14.114831+0000","last_unstale":"2024-09-13T23:09:08.738713+0000","last_undegraded":"2024-09-13T23:09:08.738713+0000","last_fullsized":"2024-09-13T23:09:08.738713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-13T23:09:08.738611+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-13T23:09:08.738611+0000","last_clean_scrub_stamp":"2024-09-13T23:09:08.738611+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:35.297289+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'16","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:37.078063+0000","last_change":"2024-09-13T23:05:14.110322+0000","last_active":"2024-09-13T23:07:37.078063+0000","last_peered":"2024-09-13T23:07:37.078063+0000","last_clean":"2024-09-13T23:07:37.078063+0000","last_became_active":"2024-09-13T23:05:14.109903+0000","last_became_peered":"2024-09-13T23:05:14.109903+0000","last_unstale":"2024-09-13T23:07:37.078063+0000","last_undegraded":"2024-09-13T23:07:37.078063+0000","last_fullsized":"2024-09-13T23:07:37.078063+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":66,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.939380+0000","last_change":"2024-09-13T23:05:12.136723+0000","last_active":"2024-09-13T23:08:21.939380+0000","last_peered":"2024-09-13T23:08:21.939380+0000","last_clean":"2024-09-13T23:08:21.939380+0000","last_became_active":"2024-09-13T23:05:12.136334+0000","last_became_peered":"2024-09-13T23:05:12.136334+0000","last_unstale":"2024-09-13T23:08:21.939380+0000","last_undegraded":"2024-09-13T23:08:21.939380+0000","last_fullsized":"2024-09-13T23:08:21.939380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'12","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:56.098271+0000","last_change":"2024-09-13T23:08:56.098300+0000","last_active":"2024-09-13T23:08:56.098271+0000","last_peered":"2024-09-13T23:08:56.098271+0000","last_clean":"2024-09-13T23:08:56.098271+0000","last_became_active":"2024-09-13T23:05:14.124023+0000","last_became_peered":"2024-09-13T23:05:14.124023+0000","last_unstale":"2024-09-13T23:08:56.098271+0000","last_undegraded":"2024-09-13T23:08:56.098271+0000","last_fullsized":"2024-09-13T23:08:56.098271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T23:08:56.098169+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T23:08:56.098169+0000","last_clean_scrub_stamp":"2024-09-13T23:08:56.098169+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:57:17.059952+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:09.755839+0000","last_change":"2024-09-13T23:09:09.755866+0000","last_active":"2024-09-13T23:09:09.755839+0000","last_peered":"2024-09-13T23:09:09.755839+0000","last_clean":"2024-09-13T23:09:09.755839+0000","last_became_active":"2024-09-13T23:05:12.126336+0000","last_became_peered":"2024-09-13T23:05:12.126336+0000","last_unstale":"2024-09-13T23:09:09.755839+0000","last_undegraded":"2024-09-13T23:09:09.755839+0000","last_fullsized":"2024-09-13T23:09:09.755839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:09.755744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:09.755744+0000","last_clean_scrub_stamp":"2024-09-13T23:09:09.755744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:45:37.055339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:59.078407+0000","last_change":"2024-09-13T23:08:59.078435+0000","last_active":"2024-09-13T23:08:59.078407+0000","last_peered":"2024-09-13T23:08:59.078407+0000","last_clean":"2024-09-13T23:08:59.078407+0000","last_became_active":"2024-09-13T23:05:14.125247+0000","last_became_peered":"2024-09-13T23:05:14.125247+0000","last_unstale":"2024-09-13T23:08:59.078407+0000","last_undegraded":"2024-09-13T23:08:59.078407+0000","last_fullsized":"2024-09-13T23:08:59.078407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:08:59.078318+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:08:59.078318+0000","last_clean_scrub_stamp":"2024-09-13T23:08:59.078318+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:22:14.387256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:12.069311+0000","last_change":"2024-09-13T23:09:12.069334+0000","last_active":"2024-09-13T23:09:12.069311+0000","last_peered":"2024-09-13T23:09:12.069311+0000","last_clean":"2024-09-13T23:09:12.069311+0000","last_became_active":"2024-09-13T23:05:12.139103+0000","last_became_peered":"2024-09-13T23:05:12.139103+0000","last_unstale":"2024-09-13T23:09:12.069311+0000","last_undegraded":"2024-09-13T23:09:12.069311+0000","last_fullsized":"2024-09-13T23:09:12.069311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:12.069217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:12.069217+0000","last_clean_scrub_stamp":"2024-09-13T23:09:12.069217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:18.902550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:12.323567+0000","last_change":"2024-09-13T23:09:12.323598+0000","last_active":"2024-09-13T23:09:12.323567+0000","last_peered":"2024-09-13T23:09:12.323567+0000","last_clean":"2024-09-13T23:09:12.323567+0000","last_became_active":"2024-09-13T23:05:14.120397+0000","last_became_peered":"2024-09-13T23:05:14.120397+0000","last_unstale":"2024-09-13T23:09:12.323567+0000","last_undegraded":"2024-09-13T23:09:12.323567+0000","last_fullsized":"2024-09-13T23:09:12.323567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:09:12.323473+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:09:12.323473+0000","last_clean_scrub_stamp":"2024-09-13T23:09:12.323473+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:44.704923+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:38.077588+0000","last_change":"2024-09-13T23:05:12.139375+0000","last_active":"2024-09-13T23:07:38.077588+0000","last_peered":"2024-09-13T23:07:38.077588+0000","last_clean":"2024-09-13T23:07:38.077588+0000","last_became_active":"2024-09-13T23:05:12.139022+0000","last_became_peered":"2024-09-13T23:05:12.139022+0000","last_unstale":"2024-09-13T23:07:38.077588+0000","last_undegraded":"2024-09-13T23:07:38.077588+0000","last_fullsized":"2024-09-13T23:07:38.077588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:06.687548+0000","last_change":"2024-09-13T23:09:06.687578+0000","last_active":"2024-09-13T23:09:06.687548+0000","last_peered":"2024-09-13T23:09:06.687548+0000","last_clean":"2024-09-13T23:09:06.687548+0000","last_became_active":"2024-09-13T23:05:14.114261+0000","last_became_peered":"2024-09-13T23:05:14.114261+0000","last_unstale":"2024-09-13T23:09:06.687548+0000","last_undegraded":"2024-09-13T23:09:06.687548+0000","last_fullsized":"2024-09-13T23:09:06.687548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T23:09:06.687450+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T23:09:06.687450+0000","last_clean_scrub_stamp":"2024-09-13T23:09:06.687450+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:18:07.608760+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:09.256822+0000","last_change":"2024-09-13T23:09:09.256855+0000","last_active":"2024-09-13T23:09:09.256822+0000","last_peered":"2024-09-13T23:09:09.256822+0000","last_clean":"2024-09-13T23:09:09.256822+0000","last_became_active":"2024-09-13T23:05:12.129589+0000","last_became_peered":"2024-09-13T23:05:12.129589+0000","last_unstale":"2024-09-13T23:09:09.256822+0000","last_undegraded":"2024-09-13T23:09:09.256822+0000","last_fullsized":"2024-09-13T23:09:09.256822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:09.256730+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:09.256730+0000","last_clean_scrub_stamp":"2024-09-13T23:09:09.256730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:49.454652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'6","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:04.139177+0000","last_change":"2024-09-13T23:09:04.139219+0000","last_active":"2024-09-13T23:09:04.139177+0000","last_peered":"2024-09-13T23:09:04.139177+0000","last_clean":"2024-09-13T23:09:04.139177+0000","last_became_active":"2024-09-13T23:05:14.118922+0000","last_became_peered":"2024-09-13T23:05:14.118922+0000","last_unstale":"2024-09-13T23:09:04.139177+0000","last_undegraded":"2024-09-13T23:09:04.139177+0000","last_fullsized":"2024-09-13T23:09:04.139177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:04.139018+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:04.139018+0000","last_clean_scrub_stamp":"2024-09-13T23:09:04.139018+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:18.107915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:32.077071+0000","last_change":"2024-09-13T23:05:12.140097+0000","last_active":"2024-09-13T23:07:32.077071+0000","last_peered":"2024-09-13T23:07:32.077071+0000","last_clean":"2024-09-13T23:07:32.077071+0000","last_became_active":"2024-09-13T23:05:12.139690+0000","last_became_peered":"2024-09-13T23:05:12.139690+0000","last_unstale":"2024-09-13T23:07:32.077071+0000","last_undegraded":"2024-09-13T23:07:32.077071+0000","last_fullsized":"2024-09-13T23:07:32.077071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'37","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.380336+0000","last_change":"2024-09-13T23:05:22.146156+0000","last_active":"2024-09-13T23:08:22.380336+0000","last_peered":"2024-09-13T23:08:22.380336+0000","last_clean":"2024-09-13T23:08:22.380336+0000","last_became_active":"2024-09-13T23:05:22.145872+0000","last_became_peered":"2024-09-13T23:05:22.145872+0000","last_unstale":"2024-09-13T23:08:22.380336+0000","last_undegraded":"2024-09-13T23:08:22.380336+0000","last_fullsized":"2024-09-13T23:08:22.380336+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":174,"num_write":103,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:37.078230+0000","last_change":"2024-09-13T23:05:14.110173+0000","last_active":"2024-09-13T23:07:37.078230+0000","last_peered":"2024-09-13T23:07:37.078230+0000","last_clean":"2024-09-13T23:07:37.078230+0000","last_became_active":"2024-09-13T23:05:14.109928+0000","last_became_peered":"2024-09-13T23:05:14.109928+0000","last_unstale":"2024-09-13T23:07:37.078230+0000","last_undegraded":"2024-09-13T23:07:37.078230+0000","last_fullsized":"2024-09-13T23:07:37.078230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:32.077095+0000","last_change":"2024-09-13T23:05:12.147582+0000","last_active":"2024-09-13T23:07:32.077095+0000","last_peered":"2024-09-13T23:07:32.077095+0000","last_clean":"2024-09-13T23:07:32.077095+0000","last_became_active":"2024-09-13T23:05:12.146236+0000","last_became_peered":"2024-09-13T23:05:12.146236+0000","last_unstale":"2024-09-13T23:07:32.077095+0000","last_undegraded":"2024-09-13T23:07:32.077095+0000","last_fullsized":"2024-09-13T23:07:32.077095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:39.624374+0000","last_change":"2024-09-13T23:08:39.624399+0000","last_active":"2024-09-13T23:08:39.624374+0000","last_peered":"2024-09-13T23:08:39.624374+0000","last_clean":"2024-09-13T23:08:39.624374+0000","last_became_active":"2024-09-13T23:05:16.123362+0000","last_became_peered":"2024-09-13T23:05:16.123362+0000","last_unstale":"2024-09-13T23:08:39.624374+0000","last_undegraded":"2024-09-13T23:08:39.624374+0000","last_fullsized":"2024-09-13T23:08:39.624374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:39.624277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:39.624277+0000","last_clean_scrub_stamp":"2024-09-13T23:08:39.624277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:59.071768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'39","reported_seq":94,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:02.251520+0000","last_change":"2024-09-13T23:09:02.251564+0000","last_active":"2024-09-13T23:09:02.251520+0000","last_peered":"2024-09-13T23:09:02.251520+0000","last_clean":"2024-09-13T23:09:02.251520+0000","last_became_active":"2024-09-13T23:05:18.132642+0000","last_became_peered":"2024-09-13T23:05:18.132642+0000","last_unstale":"2024-09-13T23:09:02.251520+0000","last_undegraded":"2024-09-13T23:09:02.251520+0000","last_fullsized":"2024-09-13T23:09:02.251520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-13T23:09:02.251433+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-13T23:09:02.251433+0000","last_clean_scrub_stamp":"2024-09-13T23:09:02.251433+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:58:30.036599+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:57.089213+0000","last_change":"2024-09-13T23:08:57.089257+0000","last_active":"2024-09-13T23:08:57.089213+0000","last_peered":"2024-09-13T23:08:57.089213+0000","last_clean":"2024-09-13T23:08:57.089213+0000","last_became_active":"2024-09-13T23:05:20.145271+0000","last_became_peered":"2024-09-13T23:05:20.145271+0000","last_unstale":"2024-09-13T23:08:57.089213+0000","last_undegraded":"2024-09-13T23:08:57.089213+0000","last_fullsized":"2024-09-13T23:08:57.089213+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:57.089110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:57.089110+0000","last_clean_scrub_stamp":"2024-09-13T23:08:57.089110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:10.929142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:48.078911+0000","last_change":"2024-09-13T23:05:22.150560+0000","last_active":"2024-09-13T23:07:48.078911+0000","last_peered":"2024-09-13T23:07:48.078911+0000","last_clean":"2024-09-13T23:07:48.078911+0000","last_became_active":"2024-09-13T23:05:22.150260+0000","last_became_peered":"2024-09-13T23:05:22.150260+0000","last_unstale":"2024-09-13T23:07:48.078911+0000","last_undegraded":"2024-09-13T23:07:48.078911+0000","last_fullsized":"2024-09-13T23:07:48.078911+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:10.302360+0000","last_change":"2024-09-13T23:09:10.302387+0000","last_active":"2024-09-13T23:09:10.302360+0000","last_peered":"2024-09-13T23:09:10.302360+0000","last_clean":"2024-09-13T23:09:10.302360+0000","last_became_active":"2024-09-13T23:05:14.113131+0000","last_became_peered":"2024-09-13T23:05:14.113131+0000","last_unstale":"2024-09-13T23:09:10.302360+0000","last_undegraded":"2024-09-13T23:09:10.302360+0000","last_fullsized":"2024-09-13T23:09:10.302360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:10.302251+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:10.302251+0000","last_clean_scrub_stamp":"2024-09-13T23:09:10.302251+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:23.722716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:59.616967+0000","last_change":"2024-09-13T23:08:59.616993+0000","last_active":"2024-09-13T23:08:59.616967+0000","last_peered":"2024-09-13T23:08:59.616967+0000","last_clean":"2024-09-13T23:08:59.616967+0000","last_became_active":"2024-09-13T23:05:12.133505+0000","last_became_peered":"2024-09-13T23:05:12.133505+0000","last_unstale":"2024-09-13T23:08:59.616967+0000","last_undegraded":"2024-09-13T23:08:59.616967+0000","last_fullsized":"2024-09-13T23:08:59.616967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:59.616881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:59.616881+0000","last_clean_scrub_stamp":"2024-09-13T23:08:59.616881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:40.852888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:48.133232+0000","last_change":"2024-09-13T23:08:48.133256+0000","last_active":"2024-09-13T23:08:48.133232+0000","last_peered":"2024-09-13T23:08:48.133232+0000","last_clean":"2024-09-13T23:08:48.133232+0000","last_became_active":"2024-09-13T23:05:16.124724+0000","last_became_peered":"2024-09-13T23:05:16.124724+0000","last_unstale":"2024-09-13T23:08:48.133232+0000","last_undegraded":"2024-09-13T23:08:48.133232+0000","last_fullsized":"2024-09-13T23:08:48.133232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:48.133136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:48.133136+0000","last_clean_scrub_stamp":"2024-09-13T23:08:48.133136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:23:32.736027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'10","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:38.121648+0000","last_change":"2024-09-13T23:08:38.121680+0000","last_active":"2024-09-13T23:08:38.121648+0000","last_peered":"2024-09-13T23:08:38.121648+0000","last_clean":"2024-09-13T23:08:38.121648+0000","last_became_active":"2024-09-13T23:05:18.126251+0000","last_became_peered":"2024-09-13T23:05:18.126251+0000","last_unstale":"2024-09-13T23:08:38.121648+0000","last_undegraded":"2024-09-13T23:08:38.121648+0000","last_fullsized":"2024-09-13T23:08:38.121648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T23:08:38.121563+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T23:08:38.121563+0000","last_clean_scrub_stamp":"2024-09-13T23:08:38.121563+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:16:06.466530+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:53.193423+0000","last_change":"2024-09-13T23:08:53.193447+0000","last_active":"2024-09-13T23:08:53.193423+0000","last_peered":"2024-09-13T23:08:53.193423+0000","last_clean":"2024-09-13T23:08:53.193423+0000","last_became_active":"2024-09-13T23:05:20.142564+0000","last_became_peered":"2024-09-13T23:05:20.142564+0000","last_unstale":"2024-09-13T23:08:53.193423+0000","last_undegraded":"2024-09-13T23:08:53.193423+0000","last_fullsized":"2024-09-13T23:08:53.193423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:53.193295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:53.193295+0000","last_clean_scrub_stamp":"2024-09-13T23:08:53.193295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:07:13.524706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:54.076957+0000","last_change":"2024-09-13T23:05:22.147806+0000","last_active":"2024-09-13T23:07:54.076957+0000","last_peered":"2024-09-13T23:07:54.076957+0000","last_clean":"2024-09-13T23:07:54.076957+0000","last_became_active":"2024-09-13T23:05:22.147493+0000","last_became_peered":"2024-09-13T23:05:22.147493+0000","last_unstale":"2024-09-13T23:07:54.076957+0000","last_undegraded":"2024-09-13T23:07:54.076957+0000","last_fullsized":"2024-09-13T23:07:54.076957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:11.254327+0000","last_change":"2024-09-13T23:09:11.254390+0000","last_active":"2024-09-13T23:09:11.254327+0000","last_peered":"2024-09-13T23:09:11.254327+0000","last_clean":"2024-09-13T23:09:11.254327+0000","last_became_active":"2024-09-13T23:05:14.112986+0000","last_became_peered":"2024-09-13T23:05:14.112986+0000","last_unstale":"2024-09-13T23:09:11.254327+0000","last_undegraded":"2024-09-13T23:09:11.254327+0000","last_fullsized":"2024-09-13T23:09:11.254327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:11.254218+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:11.254218+0000","last_clean_scrub_stamp":"2024-09-13T23:09:11.254218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:42.812871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:32.077024+0000","last_change":"2024-09-13T23:05:12.139949+0000","last_active":"2024-09-13T23:07:32.077024+0000","last_peered":"2024-09-13T23:07:32.077024+0000","last_clean":"2024-09-13T23:07:32.077024+0000","last_became_active":"2024-09-13T23:05:12.138805+0000","last_became_peered":"2024-09-13T23:05:12.138805+0000","last_unstale":"2024-09-13T23:07:32.077024+0000","last_undegraded":"2024-09-13T23:07:32.077024+0000","last_fullsized":"2024-09-13T23:07:32.077024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:16.082806+0000","last_change":"2024-09-13T23:05:49.165573+0000","last_active":"2024-09-13T23:08:16.082806+0000","last_peered":"2024-09-13T23:08:16.082806+0000","last_clean":"2024-09-13T23:08:16.082806+0000","last_became_active":"2024-09-13T23:05:49.165209+0000","last_became_peered":"2024-09-13T23:05:49.165209+0000","last_unstale":"2024-09-13T23:08:16.082806+0000","last_undegraded":"2024-09-13T23:08:16.082806+0000","last_fullsized":"2024-09-13T23:08:16.082806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:15.100044+0000","last_clean_scrub_stamp":"2024-09-13T23:05:15.100044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"34'16","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:39.564155+0000","last_change":"2024-09-13T23:08:39.564192+0000","last_active":"2024-09-13T23:08:39.564155+0000","last_peered":"2024-09-13T23:08:39.564155+0000","last_clean":"2024-09-13T23:08:39.564155+0000","last_became_active":"2024-09-13T23:05:18.134363+0000","last_became_peered":"2024-09-13T23:05:18.134363+0000","last_unstale":"2024-09-13T23:08:39.564155+0000","last_undegraded":"2024-09-13T23:08:39.564155+0000","last_fullsized":"2024-09-13T23:08:39.564155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:08:39.564067+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:08:39.564067+0000","last_clean_scrub_stamp":"2024-09-13T23:08:39.564067+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:23.504537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'286","reported_seq":398,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:08.293685+0000","last_change":"2024-09-13T23:09:08.293738+0000","last_active":"2024-09-13T23:09:08.293685+0000","last_peered":"2024-09-13T23:09:08.293685+0000","last_clean":"2024-09-13T23:09:08.293685+0000","last_became_active":"2024-09-13T23:05:20.143986+0000","last_became_peered":"2024-09-13T23:05:20.143986+0000","last_unstale":"2024-09-13T23:09:08.293685+0000","last_undegraded":"2024-09-13T23:09:08.293685+0000","last_fullsized":"2024-09-13T23:09:08.293685+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-13T23:09:08.293563+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-13T23:09:08.293563+0000","last_clean_scrub_stamp":"2024-09-13T23:09:08.293563+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:25.538117+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.991331+0000","last_change":"2024-09-13T23:05:22.151271+0000","last_active":"2024-09-13T23:08:21.991331+0000","last_peered":"2024-09-13T23:08:21.991331+0000","last_clean":"2024-09-13T23:08:21.991331+0000","last_became_active":"2024-09-13T23:05:22.150977+0000","last_became_peered":"2024-09-13T23:05:22.150977+0000","last_unstale":"2024-09-13T23:08:21.991331+0000","last_undegraded":"2024-09-13T23:08:21.991331+0000","last_fullsized":"2024-09-13T23:08:21.991331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'12","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:00.231436+0000","last_change":"2024-09-13T23:09:00.231505+0000","last_active":"2024-09-13T23:09:00.231436+0000","last_peered":"2024-09-13T23:09:00.231436+0000","last_clean":"2024-09-13T23:09:00.231436+0000","last_became_active":"2024-09-13T23:05:14.121960+0000","last_became_peered":"2024-09-13T23:05:14.121960+0000","last_unstale":"2024-09-13T23:09:00.231436+0000","last_undegraded":"2024-09-13T23:09:00.231436+0000","last_fullsized":"2024-09-13T23:09:00.231436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T23:09:00.231337+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T23:09:00.231337+0000","last_clean_scrub_stamp":"2024-09-13T23:09:00.231337+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:56.146066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:33.076650+0000","last_change":"2024-09-13T23:05:12.129400+0000","last_active":"2024-09-13T23:07:33.076650+0000","last_peered":"2024-09-13T23:07:33.076650+0000","last_clean":"2024-09-13T23:07:33.076650+0000","last_became_active":"2024-09-13T23:05:12.129019+0000","last_became_peered":"2024-09-13T23:05:12.129019+0000","last_unstale":"2024-09-13T23:07:33.076650+0000","last_undegraded":"2024-09-13T23:07:33.076650+0000","last_fullsized":"2024-09-13T23:07:33.076650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:41.570101+0000","last_change":"2024-09-13T23:08:41.570127+0000","last_active":"2024-09-13T23:08:41.570101+0000","last_peered":"2024-09-13T23:08:41.570101+0000","last_clean":"2024-09-13T23:08:41.570101+0000","last_became_active":"2024-09-13T23:05:16.122555+0000","last_became_peered":"2024-09-13T23:05:16.122555+0000","last_unstale":"2024-09-13T23:08:41.570101+0000","last_undegraded":"2024-09-13T23:08:41.570101+0000","last_fullsized":"2024-09-13T23:08:41.570101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:41.570017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:41.570017+0000","last_clean_scrub_stamp":"2024-09-13T23:08:41.570017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:53.974996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:41.566787+0000","last_change":"2024-09-13T23:08:41.566822+0000","last_active":"2024-09-13T23:08:41.566787+0000","last_peered":"2024-09-13T23:08:41.566787+0000","last_clean":"2024-09-13T23:08:41.566787+0000","last_became_active":"2024-09-13T23:05:18.128626+0000","last_became_peered":"2024-09-13T23:05:18.128626+0000","last_unstale":"2024-09-13T23:08:41.566787+0000","last_undegraded":"2024-09-13T23:08:41.566787+0000","last_fullsized":"2024-09-13T23:08:41.566787+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-13T23:08:41.566699+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-13T23:08:41.566699+0000","last_clean_scrub_stamp":"2024-09-13T23:08:41.566699+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:31.161100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:37.047437+0000","last_change":"2024-09-13T23:08:37.047469+0000","last_active":"2024-09-13T23:08:37.047437+0000","last_peered":"2024-09-13T23:08:37.047437+0000","last_clean":"2024-09-13T23:08:37.047437+0000","last_became_active":"2024-09-13T23:05:20.131943+0000","last_became_peered":"2024-09-13T23:05:20.131943+0000","last_unstale":"2024-09-13T23:08:37.047437+0000","last_undegraded":"2024-09-13T23:08:37.047437+0000","last_fullsized":"2024-09-13T23:08:37.047437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:37.047343+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:37.047343+0000","last_clean_scrub_stamp":"2024-09-13T23:08:37.047343+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:51:19.741192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:47.398582+0000","last_change":"2024-09-13T23:08:47.398608+0000","last_active":"2024-09-13T23:08:47.398582+0000","last_peered":"2024-09-13T23:08:47.398582+0000","last_clean":"2024-09-13T23:08:47.398582+0000","last_became_active":"2024-09-13T23:05:14.126659+0000","last_became_peered":"2024-09-13T23:05:14.126659+0000","last_unstale":"2024-09-13T23:08:47.398582+0000","last_undegraded":"2024-09-13T23:08:47.398582+0000","last_fullsized":"2024-09-13T23:08:47.398582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:47.398478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:47.398478+0000","last_clean_scrub_stamp":"2024-09-13T23:08:47.398478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:48.669511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:31.076281+0000","last_change":"2024-09-13T23:05:12.116365+0000","last_active":"2024-09-13T23:07:31.076281+0000","last_peered":"2024-09-13T23:07:31.076281+0000","last_clean":"2024-09-13T23:07:31.076281+0000","last_became_active":"2024-09-13T23:05:12.114453+0000","last_became_peered":"2024-09-13T23:05:12.114453+0000","last_unstale":"2024-09-13T23:07:31.076281+0000","last_undegraded":"2024-09-13T23:07:31.076281+0000","last_fullsized":"2024-09-13T23:07:31.076281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:40.158881+0000","last_change":"2024-09-13T23:08:40.158918+0000","last_active":"2024-09-13T23:08:40.158881+0000","last_peered":"2024-09-13T23:08:40.158881+0000","last_clean":"2024-09-13T23:08:40.158881+0000","last_became_active":"2024-09-13T23:05:16.124324+0000","last_became_peered":"2024-09-13T23:05:16.124324+0000","last_unstale":"2024-09-13T23:08:40.158881+0000","last_undegraded":"2024-09-13T23:08:40.158881+0000","last_fullsized":"2024-09-13T23:08:40.158881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:40.158756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:40.158756+0000","last_clean_scrub_stamp":"2024-09-13T23:08:40.158756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:01.139147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'51","reported_seq":111,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:40.531470+0000","last_change":"2024-09-13T23:08:40.531513+0000","last_active":"2024-09-13T23:08:40.531470+0000","last_peered":"2024-09-13T23:08:40.531470+0000","last_clean":"2024-09-13T23:08:40.531470+0000","last_became_active":"2024-09-13T23:05:18.129887+0000","last_became_peered":"2024-09-13T23:05:18.129887+0000","last_unstale":"2024-09-13T23:08:40.531470+0000","last_undegraded":"2024-09-13T23:08:40.531470+0000","last_fullsized":"2024-09-13T23:08:40.531470+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'51","last_scrub_stamp":"2024-09-13T23:08:40.531386+0000","last_deep_scrub":"34'51","last_deep_scrub_stamp":"2024-09-13T23:08:40.531386+0000","last_clean_scrub_stamp":"2024-09-13T23:08:40.531386+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:00:53.584234+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:36.003924+0000","last_change":"2024-09-13T23:08:36.003951+0000","last_active":"2024-09-13T23:08:36.003924+0000","last_peered":"2024-09-13T23:08:36.003924+0000","last_clean":"2024-09-13T23:08:36.003924+0000","last_became_active":"2024-09-13T23:05:20.135937+0000","last_became_peered":"2024-09-13T23:05:20.135937+0000","last_unstale":"2024-09-13T23:08:36.003924+0000","last_undegraded":"2024-09-13T23:08:36.003924+0000","last_fullsized":"2024-09-13T23:08:36.003924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:36.003822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:36.003822+0000","last_clean_scrub_stamp":"2024-09-13T23:08:36.003822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:36.100827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:54.634286+0000","last_change":"2024-09-13T23:08:54.634313+0000","last_active":"2024-09-13T23:08:54.634286+0000","last_peered":"2024-09-13T23:08:54.634286+0000","last_clean":"2024-09-13T23:08:54.634286+0000","last_became_active":"2024-09-13T23:05:22.146044+0000","last_became_peered":"2024-09-13T23:05:22.146044+0000","last_unstale":"2024-09-13T23:08:54.634286+0000","last_undegraded":"2024-09-13T23:08:54.634286+0000","last_fullsized":"2024-09-13T23:08:54.634286+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T23:08:54.634198+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T23:08:54.634198+0000","last_clean_scrub_stamp":"2024-09-13T23:08:54.634198+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:58:43.552913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:06.131139+0000","last_change":"2024-09-13T23:09:06.131179+0000","last_active":"2024-09-13T23:09:06.131139+0000","last_peered":"2024-09-13T23:09:06.131139+0000","last_clean":"2024-09-13T23:09:06.131139+0000","last_became_active":"2024-09-13T23:05:14.116507+0000","last_became_peered":"2024-09-13T23:05:14.116507+0000","last_unstale":"2024-09-13T23:09:06.131139+0000","last_undegraded":"2024-09-13T23:09:06.131139+0000","last_fullsized":"2024-09-13T23:09:06.131139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:06.131036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:06.131036+0000","last_clean_scrub_stamp":"2024-09-13T23:09:06.131036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:00.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:31.076241+0000","last_change":"2024-09-13T23:05:12.115905+0000","last_active":"2024-09-13T23:07:31.076241+0000","last_peered":"2024-09-13T23:07:31.076241+0000","last_clean":"2024-09-13T23:07:31.076241+0000","last_became_active":"2024-09-13T23:05:12.115025+0000","last_became_peered":"2024-09-13T23:05:12.115025+0000","last_unstale":"2024-09-13T23:07:31.076241+0000","last_undegraded":"2024-09-13T23:07:31.076241+0000","last_fullsized":"2024-09-13T23:07:31.076241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:56.177848+0000","last_change":"2024-09-13T23:08:56.177873+0000","last_active":"2024-09-13T23:08:56.177848+0000","last_peered":"2024-09-13T23:08:56.177848+0000","last_clean":"2024-09-13T23:08:56.177848+0000","last_became_active":"2024-09-13T23:05:16.118494+0000","last_became_peered":"2024-09-13T23:05:16.118494+0000","last_unstale":"2024-09-13T23:08:56.177848+0000","last_undegraded":"2024-09-13T23:08:56.177848+0000","last_fullsized":"2024-09-13T23:08:56.177848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:56.177744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:56.177744+0000","last_clean_scrub_stamp":"2024-09-13T23:08:56.177744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:53.534857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'37","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:03.229885+0000","last_change":"2024-09-13T23:09:03.229920+0000","last_active":"2024-09-13T23:09:03.229885+0000","last_peered":"2024-09-13T23:09:03.229885+0000","last_clean":"2024-09-13T23:09:03.229885+0000","last_became_active":"2024-09-13T23:05:18.134130+0000","last_became_peered":"2024-09-13T23:05:18.134130+0000","last_unstale":"2024-09-13T23:09:03.229885+0000","last_undegraded":"2024-09-13T23:09:03.229885+0000","last_fullsized":"2024-09-13T23:09:03.229885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-13T23:09:03.229792+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-13T23:09:03.229792+0000","last_clean_scrub_stamp":"2024-09-13T23:09:03.229792+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:13.414475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:42.005317+0000","last_change":"2024-09-13T23:08:42.005343+0000","last_active":"2024-09-13T23:08:42.005317+0000","last_peered":"2024-09-13T23:08:42.005317+0000","last_clean":"2024-09-13T23:08:42.005317+0000","last_became_active":"2024-09-13T23:05:20.140180+0000","last_became_peered":"2024-09-13T23:05:20.140180+0000","last_unstale":"2024-09-13T23:08:42.005317+0000","last_undegraded":"2024-09-13T23:08:42.005317+0000","last_fullsized":"2024-09-13T23:08:42.005317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:42.005224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:42.005224+0000","last_clean_scrub_stamp":"2024-09-13T23:08:42.005224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:49:52.491200+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'7","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:28.076088+0000","last_change":"2024-09-13T23:05:22.148436+0000","last_active":"2024-09-13T23:07:28.076088+0000","last_peered":"2024-09-13T23:07:28.076088+0000","last_clean":"2024-09-13T23:07:28.076088+0000","last_became_active":"2024-09-13T23:05:22.148104+0000","last_became_peered":"2024-09-13T23:05:22.148104+0000","last_unstale":"2024-09-13T23:07:28.076088+0000","last_undegraded":"2024-09-13T23:07:28.076088+0000","last_fullsized":"2024-09-13T23:07:28.076088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":18,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:26.075397+0000","last_change":"2024-09-13T23:05:14.119333+0000","last_active":"2024-09-13T23:07:26.075397+0000","last_peered":"2024-09-13T23:07:26.075397+0000","last_clean":"2024-09-13T23:07:26.075397+0000","last_became_active":"2024-09-13T23:05:14.119071+0000","last_became_peered":"2024-09-13T23:05:14.119071+0000","last_unstale":"2024-09-13T23:07:26.075397+0000","last_undegraded":"2024-09-13T23:07:26.075397+0000","last_fullsized":"2024-09-13T23:07:26.075397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.183265+0000","last_change":"2024-09-13T23:05:12.148852+0000","last_active":"2024-09-13T23:08:29.183265+0000","last_peered":"2024-09-13T23:08:29.183265+0000","last_clean":"2024-09-13T23:08:29.183265+0000","last_became_active":"2024-09-13T23:05:12.148439+0000","last_became_peered":"2024-09-13T23:05:12.148439+0000","last_unstale":"2024-09-13T23:08:29.183265+0000","last_undegraded":"2024-09-13T23:08:29.183265+0000","last_fullsized":"2024-09-13T23:08:29.183265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:52.165226+0000","last_change":"2024-09-13T23:08:52.165250+0000","last_active":"2024-09-13T23:08:52.165226+0000","last_peered":"2024-09-13T23:08:52.165226+0000","last_clean":"2024-09-13T23:08:52.165226+0000","last_became_active":"2024-09-13T23:05:16.123188+0000","last_became_peered":"2024-09-13T23:05:16.123188+0000","last_unstale":"2024-09-13T23:08:52.165226+0000","last_undegraded":"2024-09-13T23:08:52.165226+0000","last_fullsized":"2024-09-13T23:08:52.165226+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:52.165141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:52.165141+0000","last_clean_scrub_stamp":"2024-09-13T23:08:52.165141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:55:30.699678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:40.622211+0000","last_change":"2024-09-13T23:08:40.622258+0000","last_active":"2024-09-13T23:08:40.622211+0000","last_peered":"2024-09-13T23:08:40.622211+0000","last_clean":"2024-09-13T23:08:40.622211+0000","last_became_active":"2024-09-13T23:05:18.131446+0000","last_became_peered":"2024-09-13T23:05:18.131446+0000","last_unstale":"2024-09-13T23:08:40.622211+0000","last_undegraded":"2024-09-13T23:08:40.622211+0000","last_fullsized":"2024-09-13T23:08:40.622211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-09-13T23:08:40.622115+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-09-13T23:08:40.622115+0000","last_clean_scrub_stamp":"2024-09-13T23:08:40.622115+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:07.613322+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":360,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:50.174742+0000","last_change":"2024-09-13T23:08:50.174769+0000","last_active":"2024-09-13T23:08:50.174742+0000","last_peered":"2024-09-13T23:08:50.174742+0000","last_clean":"2024-09-13T23:08:50.174742+0000","last_became_active":"2024-09-13T23:05:20.144104+0000","last_became_peered":"2024-09-13T23:05:20.144104+0000","last_unstale":"2024-09-13T23:08:50.174742+0000","last_undegraded":"2024-09-13T23:08:50.174742+0000","last_fullsized":"2024-09-13T23:08:50.174742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:50.174650+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:50.174650+0000","last_clean_scrub_stamp":"2024-09-13T23:08:50.174650+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:45:01.149565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:34.073991+0000","last_change":"2024-09-13T23:05:22.147955+0000","last_active":"2024-09-13T23:07:34.073991+0000","last_peered":"2024-09-13T23:07:34.073991+0000","last_clean":"2024-09-13T23:07:34.073991+0000","last_became_active":"2024-09-13T23:05:22.147645+0000","last_became_peered":"2024-09-13T23:05:22.147645+0000","last_unstale":"2024-09-13T23:07:34.073991+0000","last_undegraded":"2024-09-13T23:07:34.073991+0000","last_fullsized":"2024-09-13T23:07:34.073991+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'10","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:58.567622+0000","last_change":"2024-09-13T23:08:58.567649+0000","last_active":"2024-09-13T23:08:58.567622+0000","last_peered":"2024-09-13T23:08:58.567622+0000","last_clean":"2024-09-13T23:08:58.567622+0000","last_became_active":"2024-09-13T23:05:14.112291+0000","last_became_peered":"2024-09-13T23:05:14.112291+0000","last_unstale":"2024-09-13T23:08:58.567622+0000","last_undegraded":"2024-09-13T23:08:58.567622+0000","last_fullsized":"2024-09-13T23:08:58.567622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T23:08:58.567512+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T23:08:58.567512+0000","last_clean_scrub_stamp":"2024-09-13T23:08:58.567512+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:43.527393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.183297+0000","last_change":"2024-09-13T23:05:12.149813+0000","last_active":"2024-09-13T23:08:29.183297+0000","last_peered":"2024-09-13T23:08:29.183297+0000","last_clean":"2024-09-13T23:08:29.183297+0000","last_became_active":"2024-09-13T23:05:12.149418+0000","last_became_peered":"2024-09-13T23:05:12.149418+0000","last_unstale":"2024-09-13T23:08:29.183297+0000","last_undegraded":"2024-09-13T23:08:29.183297+0000","last_fullsized":"2024-09-13T23:08:29.183297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:55.175221+0000","last_change":"2024-09-13T23:08:55.175246+0000","last_active":"2024-09-13T23:08:55.175221+0000","last_peered":"2024-09-13T23:08:55.175221+0000","last_clean":"2024-09-13T23:08:55.175221+0000","last_became_active":"2024-09-13T23:05:16.118503+0000","last_became_peered":"2024-09-13T23:05:16.118503+0000","last_unstale":"2024-09-13T23:08:55.175221+0000","last_undegraded":"2024-09-13T23:08:55.175221+0000","last_fullsized":"2024-09-13T23:08:55.175221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:55.175127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:55.175127+0000","last_clean_scrub_stamp":"2024-09-13T23:08:55.175127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:05.711566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'63","reported_seq":136,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:57.374041+0000","last_change":"2024-09-13T23:08:57.374099+0000","last_active":"2024-09-13T23:08:57.374041+0000","last_peered":"2024-09-13T23:08:57.374041+0000","last_clean":"2024-09-13T23:08:57.374041+0000","last_became_active":"2024-09-13T23:05:18.135307+0000","last_became_peered":"2024-09-13T23:05:18.135307+0000","last_unstale":"2024-09-13T23:08:57.374041+0000","last_undegraded":"2024-09-13T23:08:57.374041+0000","last_fullsized":"2024-09-13T23:08:57.374041+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'63","last_scrub_stamp":"2024-09-13T23:08:57.373955+0000","last_deep_scrub":"34'63","last_deep_scrub_stamp":"2024-09-13T23:08:57.373955+0000","last_clean_scrub_stamp":"2024-09-13T23:08:57.373955+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:00.678457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:32.955706+0000","last_change":"2024-09-13T23:08:32.955726+0000","last_active":"2024-09-13T23:08:32.955706+0000","last_peered":"2024-09-13T23:08:32.955706+0000","last_clean":"2024-09-13T23:08:32.955706+0000","last_became_active":"2024-09-13T23:05:20.137460+0000","last_became_peered":"2024-09-13T23:05:20.137460+0000","last_unstale":"2024-09-13T23:08:32.955706+0000","last_undegraded":"2024-09-13T23:08:32.955706+0000","last_fullsized":"2024-09-13T23:08:32.955706+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:32.955629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:32.955629+0000","last_clean_scrub_stamp":"2024-09-13T23:08:32.955629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:14.847447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'18","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.586373+0000","last_change":"2024-09-13T23:05:22.141812+0000","last_active":"2024-09-13T23:08:22.586373+0000","last_peered":"2024-09-13T23:08:22.586373+0000","last_clean":"2024-09-13T23:08:22.586373+0000","last_became_active":"2024-09-13T23:05:22.141472+0000","last_became_peered":"2024-09-13T23:05:22.141472+0000","last_unstale":"2024-09-13T23:08:22.586373+0000","last_undegraded":"2024-09-13T23:08:22.586373+0000","last_fullsized":"2024-09-13T23:08:22.586373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:05.149534+0000","last_change":"2024-09-13T23:09:05.149603+0000","last_active":"2024-09-13T23:09:05.149534+0000","last_peered":"2024-09-13T23:09:05.149534+0000","last_clean":"2024-09-13T23:09:05.149534+0000","last_became_active":"2024-09-13T23:05:49.164426+0000","last_became_peered":"2024-09-13T23:05:49.164426+0000","last_unstale":"2024-09-13T23:09:05.149534+0000","last_undegraded":"2024-09-13T23:09:05.149534+0000","last_fullsized":"2024-09-13T23:09:05.149534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T23:09:05.149414+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T23:09:05.149414+0000","last_clean_scrub_stamp":"2024-09-13T23:09:05.149414+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:09.148923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:07.243503+0000","last_change":"2024-09-13T23:09:07.243570+0000","last_active":"2024-09-13T23:09:07.243503+0000","last_peered":"2024-09-13T23:09:07.243503+0000","last_clean":"2024-09-13T23:09:07.243503+0000","last_became_active":"2024-09-13T23:05:12.129951+0000","last_became_peered":"2024-09-13T23:05:12.129951+0000","last_unstale":"2024-09-13T23:09:07.243503+0000","last_undegraded":"2024-09-13T23:09:07.243503+0000","last_fullsized":"2024-09-13T23:09:07.243503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:07.243394+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:07.243394+0000","last_clean_scrub_stamp":"2024-09-13T23:09:07.243394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:18.684549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:48.682481+0000","last_change":"2024-09-13T23:08:48.682504+0000","last_active":"2024-09-13T23:08:48.682481+0000","last_peered":"2024-09-13T23:08:48.682481+0000","last_clean":"2024-09-13T23:08:48.682481+0000","last_became_active":"2024-09-13T23:05:16.127598+0000","last_became_peered":"2024-09-13T23:05:16.127598+0000","last_unstale":"2024-09-13T23:08:48.682481+0000","last_undegraded":"2024-09-13T23:08:48.682481+0000","last_fullsized":"2024-09-13T23:08:48.682481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:48.682390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:48.682390+0000","last_clean_scrub_stamp":"2024-09-13T23:08:48.682390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:16:51.142230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'39","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:36.095129+0000","last_change":"2024-09-13T23:08:36.095166+0000","last_active":"2024-09-13T23:08:36.095129+0000","last_peered":"2024-09-13T23:08:36.095129+0000","last_clean":"2024-09-13T23:08:36.095129+0000","last_became_active":"2024-09-13T23:05:18.128238+0000","last_became_peered":"2024-09-13T23:05:18.128238+0000","last_unstale":"2024-09-13T23:08:36.095129+0000","last_undegraded":"2024-09-13T23:08:36.095129+0000","last_fullsized":"2024-09-13T23:08:36.095129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-13T23:08:36.095044+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-13T23:08:36.095044+0000","last_clean_scrub_stamp":"2024-09-13T23:08:36.095044+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:48:40.542578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:00.311517+0000","last_change":"2024-09-13T23:09:00.311550+0000","last_active":"2024-09-13T23:09:00.311517+0000","last_peered":"2024-09-13T23:09:00.311517+0000","last_clean":"2024-09-13T23:09:00.311517+0000","last_became_active":"2024-09-13T23:05:20.139335+0000","last_became_peered":"2024-09-13T23:05:20.139335+0000","last_unstale":"2024-09-13T23:09:00.311517+0000","last_undegraded":"2024-09-13T23:09:00.311517+0000","last_fullsized":"2024-09-13T23:09:00.311517+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:00.311418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:00.311418+0000","last_clean_scrub_stamp":"2024-09-13T23:09:00.311418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:28.885656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.473025+0000","last_change":"2024-09-13T23:05:22.148481+0000","last_active":"2024-09-13T23:08:22.473025+0000","last_peered":"2024-09-13T23:08:22.473025+0000","last_clean":"2024-09-13T23:08:22.473025+0000","last_became_active":"2024-09-13T23:05:22.148222+0000","last_became_peered":"2024-09-13T23:05:22.148222+0000","last_unstale":"2024-09-13T23:08:22.473025+0000","last_undegraded":"2024-09-13T23:08:22.473025+0000","last_fullsized":"2024-09-13T23:08:22.473025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'34","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:06.266284+0000","last_change":"2024-09-13T23:09:06.266334+0000","last_active":"2024-09-13T23:09:06.266284+0000","last_peered":"2024-09-13T23:09:06.266284+0000","last_clean":"2024-09-13T23:09:06.266284+0000","last_became_active":"2024-09-13T23:05:14.118545+0000","last_became_peered":"2024-09-13T23:05:14.118545+0000","last_unstale":"2024-09-13T23:09:06.266284+0000","last_undegraded":"2024-09-13T23:09:06.266284+0000","last_fullsized":"2024-09-13T23:09:06.266284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'34","last_scrub_stamp":"2024-09-13T23:09:06.266184+0000","last_deep_scrub":"34'34","last_deep_scrub_stamp":"2024-09-13T23:09:06.266184+0000","last_clean_scrub_stamp":"2024-09-13T23:09:06.266184+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:12.667320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":93,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:22.075347+0000","last_change":"2024-09-13T23:05:12.147234+0000","last_active":"2024-09-13T23:07:22.075347+0000","last_peered":"2024-09-13T23:07:22.075347+0000","last_clean":"2024-09-13T23:07:22.075347+0000","last_became_active":"2024-09-13T23:05:12.146912+0000","last_became_peered":"2024-09-13T23:05:12.146912+0000","last_unstale":"2024-09-13T23:07:22.075347+0000","last_undegraded":"2024-09-13T23:07:22.075347+0000","last_fullsized":"2024-09-13T23:07:22.075347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:57.227690+0000","last_change":"2024-09-13T23:08:57.227716+0000","last_active":"2024-09-13T23:08:57.227690+0000","last_peered":"2024-09-13T23:08:57.227690+0000","last_clean":"2024-09-13T23:08:57.227690+0000","last_became_active":"2024-09-13T23:05:16.114369+0000","last_became_peered":"2024-09-13T23:05:16.114369+0000","last_unstale":"2024-09-13T23:08:57.227690+0000","last_undegraded":"2024-09-13T23:08:57.227690+0000","last_fullsized":"2024-09-13T23:08:57.227690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:57.227595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:57.227595+0000","last_clean_scrub_stamp":"2024-09-13T23:08:57.227595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:37:59.143867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:45.676576+0000","last_change":"2024-09-13T23:08:45.676635+0000","last_active":"2024-09-13T23:08:45.676576+0000","last_peered":"2024-09-13T23:08:45.676576+0000","last_clean":"2024-09-13T23:08:45.676576+0000","last_became_active":"2024-09-13T23:05:18.126183+0000","last_became_peered":"2024-09-13T23:05:18.126183+0000","last_unstale":"2024-09-13T23:08:45.676576+0000","last_undegraded":"2024-09-13T23:08:45.676576+0000","last_fullsized":"2024-09-13T23:08:45.676576+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-13T23:08:45.676456+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-13T23:08:45.676456+0000","last_clean_scrub_stamp":"2024-09-13T23:08:45.676456+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:40.391001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":415,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:38.549051+0000","last_change":"2024-09-13T23:08:38.549085+0000","last_active":"2024-09-13T23:08:38.549051+0000","last_peered":"2024-09-13T23:08:38.549051+0000","last_clean":"2024-09-13T23:08:38.549051+0000","last_became_active":"2024-09-13T23:05:20.143659+0000","last_became_peered":"2024-09-13T23:05:20.143659+0000","last_unstale":"2024-09-13T23:08:38.549051+0000","last_undegraded":"2024-09-13T23:08:38.549051+0000","last_fullsized":"2024-09-13T23:08:38.549051+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:38.548964+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:38.548964+0000","last_clean_scrub_stamp":"2024-09-13T23:08:38.548964+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:04.032284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.474697+0000","last_change":"2024-09-13T23:05:22.140956+0000","last_active":"2024-09-13T23:08:22.474697+0000","last_peered":"2024-09-13T23:08:22.474697+0000","last_clean":"2024-09-13T23:08:22.474697+0000","last_became_active":"2024-09-13T23:05:22.140485+0000","last_became_peered":"2024-09-13T23:05:22.140485+0000","last_unstale":"2024-09-13T23:08:22.474697+0000","last_undegraded":"2024-09-13T23:08:22.474697+0000","last_fullsized":"2024-09-13T23:08:22.474697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'18","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:10.779162+0000","last_change":"2024-09-13T23:09:10.779210+0000","last_active":"2024-09-13T23:09:10.779162+0000","last_peered":"2024-09-13T23:09:10.779162+0000","last_clean":"2024-09-13T23:09:10.779162+0000","last_became_active":"2024-09-13T23:05:14.115166+0000","last_became_peered":"2024-09-13T23:05:14.115166+0000","last_unstale":"2024-09-13T23:09:10.779162+0000","last_undegraded":"2024-09-13T23:09:10.779162+0000","last_fullsized":"2024-09-13T23:09:10.779162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-13T23:09:10.779044+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-13T23:09:10.779044+0000","last_clean_scrub_stamp":"2024-09-13T23:09:10.779044+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:03:39.986800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.238337+0000","last_change":"2024-09-13T23:05:12.140202+0000","last_active":"2024-09-13T23:08:22.238337+0000","last_peered":"2024-09-13T23:08:22.238337+0000","last_clean":"2024-09-13T23:08:22.238337+0000","last_became_active":"2024-09-13T23:05:12.139283+0000","last_became_peered":"2024-09-13T23:05:12.139283+0000","last_unstale":"2024-09-13T23:08:22.238337+0000","last_undegraded":"2024-09-13T23:08:22.238337+0000","last_fullsized":"2024-09-13T23:08:22.238337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":439,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:50.100446+0000","last_change":"2024-09-13T23:08:50.100480+0000","last_active":"2024-09-13T23:08:50.100446+0000","last_peered":"2024-09-13T23:08:50.100446+0000","last_clean":"2024-09-13T23:08:50.100446+0000","last_became_active":"2024-09-13T23:05:49.164741+0000","last_became_peered":"2024-09-13T23:05:49.164741+0000","last_unstale":"2024-09-13T23:08:50.100446+0000","last_undegraded":"2024-09-13T23:08:50.100446+0000","last_fullsized":"2024-09-13T23:08:50.100446+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T23:08:50.100356+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T23:08:50.100356+0000","last_clean_scrub_stamp":"2024-09-13T23:08:50.100356+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:15:10.416249+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'16","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:58.338081+0000","last_change":"2024-09-13T23:08:58.338158+0000","last_active":"2024-09-13T23:08:58.338081+0000","last_peered":"2024-09-13T23:08:58.338081+0000","last_clean":"2024-09-13T23:08:58.338081+0000","last_became_active":"2024-09-13T23:05:18.135028+0000","last_became_peered":"2024-09-13T23:05:18.135028+0000","last_unstale":"2024-09-13T23:08:58.338081+0000","last_undegraded":"2024-09-13T23:08:58.338081+0000","last_fullsized":"2024-09-13T23:08:58.338081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:08:58.337970+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:08:58.337970+0000","last_clean_scrub_stamp":"2024-09-13T23:08:58.337970+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:47.871335+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":477,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:41.117643+0000","last_change":"2024-09-13T23:08:41.117670+0000","last_active":"2024-09-13T23:08:41.117643+0000","last_peered":"2024-09-13T23:08:41.117643+0000","last_clean":"2024-09-13T23:08:41.117643+0000","last_became_active":"2024-09-13T23:05:20.132891+0000","last_became_peered":"2024-09-13T23:05:20.132891+0000","last_unstale":"2024-09-13T23:08:41.117643+0000","last_undegraded":"2024-09-13T23:08:41.117643+0000","last_fullsized":"2024-09-13T23:08:41.117643+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:41.117524+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:41.117524+0000","last_clean_scrub_stamp":"2024-09-13T23:08:41.117524+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:31.490095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:31.076149+0000","last_change":"2024-09-13T23:05:22.150994+0000","last_active":"2024-09-13T23:07:31.076149+0000","last_peered":"2024-09-13T23:07:31.076149+0000","last_clean":"2024-09-13T23:07:31.076149+0000","last_became_active":"2024-09-13T23:05:22.150258+0000","last_became_peered":"2024-09-13T23:05:22.150258+0000","last_unstale":"2024-09-13T23:07:31.076149+0000","last_undegraded":"2024-09-13T23:07:31.076149+0000","last_fullsized":"2024-09-13T23:07:31.076149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:51.145119+0000","last_change":"2024-09-13T23:08:51.145168+0000","last_active":"2024-09-13T23:08:51.145119+0000","last_peered":"2024-09-13T23:08:51.145119+0000","last_clean":"2024-09-13T23:08:51.145119+0000","last_became_active":"2024-09-13T23:05:14.125034+0000","last_became_peered":"2024-09-13T23:05:14.125034+0000","last_unstale":"2024-09-13T23:08:51.145119+0000","last_undegraded":"2024-09-13T23:08:51.145119+0000","last_fullsized":"2024-09-13T23:08:51.145119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:08:51.145025+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:08:51.145025+0000","last_clean_scrub_stamp":"2024-09-13T23:08:51.145025+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:58.481808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'3","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:22.075273+0000","last_change":"2024-09-13T23:05:12.143810+0000","last_active":"2024-09-13T23:07:22.075273+0000","last_peered":"2024-09-13T23:07:22.075273+0000","last_clean":"2024-09-13T23:07:22.075273+0000","last_became_active":"2024-09-13T23:05:12.142185+0000","last_became_peered":"2024-09-13T23:05:12.142185+0000","last_unstale":"2024-09-13T23:07:22.075273+0000","last_undegraded":"2024-09-13T23:07:22.075273+0000","last_fullsized":"2024-09-13T23:07:22.075273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.512216+0000","last_change":"2024-09-13T23:08:33.512256+0000","last_active":"2024-09-13T23:08:33.512216+0000","last_peered":"2024-09-13T23:08:33.512216+0000","last_clean":"2024-09-13T23:08:33.512216+0000","last_became_active":"2024-09-13T23:05:16.125013+0000","last_became_peered":"2024-09-13T23:05:16.125013+0000","last_unstale":"2024-09-13T23:08:33.512216+0000","last_undegraded":"2024-09-13T23:08:33.512216+0000","last_fullsized":"2024-09-13T23:08:33.512216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:33.512107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:33.512107+0000","last_clean_scrub_stamp":"2024-09-13T23:08:33.512107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:00.070785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'48","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:39.155632+0000","last_change":"2024-09-13T23:08:39.155672+0000","last_active":"2024-09-13T23:08:39.155632+0000","last_peered":"2024-09-13T23:08:39.155632+0000","last_clean":"2024-09-13T23:08:39.155632+0000","last_became_active":"2024-09-13T23:05:18.126271+0000","last_became_peered":"2024-09-13T23:05:18.126271+0000","last_unstale":"2024-09-13T23:08:39.155632+0000","last_undegraded":"2024-09-13T23:08:39.155632+0000","last_fullsized":"2024-09-13T23:08:39.155632+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-09-13T23:08:39.155548+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-09-13T23:08:39.155548+0000","last_clean_scrub_stamp":"2024-09-13T23:08:39.155548+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:48.512044+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:46.633023+0000","last_change":"2024-09-13T23:08:46.633049+0000","last_active":"2024-09-13T23:08:46.633023+0000","last_peered":"2024-09-13T23:08:46.633023+0000","last_clean":"2024-09-13T23:08:46.633023+0000","last_became_active":"2024-09-13T23:05:20.145626+0000","last_became_peered":"2024-09-13T23:05:20.145626+0000","last_unstale":"2024-09-13T23:08:46.633023+0000","last_undegraded":"2024-09-13T23:08:46.633023+0000","last_fullsized":"2024-09-13T23:08:46.633023+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:46.632934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:46.632934+0000","last_clean_scrub_stamp":"2024-09-13T23:08:46.632934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:54.822821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'7","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:01.125774+0000","last_change":"2024-09-13T23:09:01.125815+0000","last_active":"2024-09-13T23:09:01.125774+0000","last_peered":"2024-09-13T23:09:01.125774+0000","last_clean":"2024-09-13T23:09:01.125774+0000","last_became_active":"2024-09-13T23:05:22.137111+0000","last_became_peered":"2024-09-13T23:05:22.137111+0000","last_unstale":"2024-09-13T23:09:01.125774+0000","last_undegraded":"2024-09-13T23:09:01.125774+0000","last_fullsized":"2024-09-13T23:09:01.125774+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-13T23:09:01.125676+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-13T23:09:01.125676+0000","last_clean_scrub_stamp":"2024-09-13T23:09:01.125676+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:57.040405+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'16","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:56.080220+0000","last_change":"2024-09-13T23:05:49.168074+0000","last_active":"2024-09-13T23:07:56.080220+0000","last_peered":"2024-09-13T23:07:56.080220+0000","last_clean":"2024-09-13T23:07:56.080220+0000","last_became_active":"2024-09-13T23:05:49.165166+0000","last_became_peered":"2024-09-13T23:05:49.165166+0000","last_unstale":"2024-09-13T23:07:56.080220+0000","last_undegraded":"2024-09-13T23:07:56.080220+0000","last_fullsized":"2024-09-13T23:07:56.080220+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":51,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":206,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:32.530617+0000","last_change":"2024-09-13T23:04:56.151685+0000","last_active":"2024-09-13T23:08:32.530617+0000","last_peered":"2024-09-13T23:08:32.530617+0000","last_clean":"2024-09-13T23:08:32.530617+0000","last_became_active":"2024-09-13T23:04:56.149747+0000","last_became_peered":"2024-09-13T23:04:56.149747+0000","last_unstale":"2024-09-13T23:08:32.530617+0000","last_undegraded":"2024-09-13T23:08:32.530617+0000","last_fullsized":"2024-09-13T23:08:32.530617+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:04:55.054026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:04:55.054026+0000","last_clean_scrub_stamp":"2024-09-13T23:04:55.054026+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.410232+0000","last_change":"2024-09-13T23:05:03.078734+0000","last_active":"2024-09-13T23:08:33.410232+0000","last_peered":"2024-09-13T23:08:33.410232+0000","last_clean":"2024-09-13T23:08:33.410232+0000","last_became_active":"2024-09-13T23:05:01.074608+0000","last_became_peered":"2024-09-13T23:05:01.074608+0000","last_unstale":"2024-09-13T23:08:33.410232+0000","last_undegraded":"2024-09-13T23:08:33.410232+0000","last_fullsized":"2024-09-13T23:08:33.410232+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097176599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.183094+0000","last_change":"2024-09-13T23:05:12.147068+0000","last_active":"2024-09-13T23:08:29.183094+0000","last_peered":"2024-09-13T23:08:29.183094+0000","last_clean":"2024-09-13T23:08:29.183094+0000","last_became_active":"2024-09-13T23:05:12.146438+0000","last_became_peered":"2024-09-13T23:05:12.146438+0000","last_unstale":"2024-09-13T23:08:29.183094+0000","last_undegraded":"2024-09-13T23:08:29.183094+0000","last_fullsized":"2024-09-13T23:08:29.183094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:48.172016+0000","last_change":"2024-09-13T23:08:48.172057+0000","last_active":"2024-09-13T23:08:48.172016+0000","last_peered":"2024-09-13T23:08:48.172016+0000","last_clean":"2024-09-13T23:08:48.172016+0000","last_became_active":"2024-09-13T23:05:16.115599+0000","last_became_peered":"2024-09-13T23:05:16.115599+0000","last_unstale":"2024-09-13T23:08:48.172016+0000","last_undegraded":"2024-09-13T23:08:48.172016+0000","last_fullsized":"2024-09-13T23:08:48.172016+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:48.171913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:48.171913+0000","last_clean_scrub_stamp":"2024-09-13T23:08:48.171913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:18.538546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'90","reported_seq":180,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:59.300087+0000","last_change":"2024-09-13T23:08:59.300155+0000","last_active":"2024-09-13T23:08:59.300087+0000","last_peered":"2024-09-13T23:08:59.300087+0000","last_clean":"2024-09-13T23:08:59.300087+0000","last_became_active":"2024-09-13T23:05:18.135080+0000","last_became_peered":"2024-09-13T23:05:18.135080+0000","last_unstale":"2024-09-13T23:08:59.300087+0000","last_undegraded":"2024-09-13T23:08:59.300087+0000","last_fullsized":"2024-09-13T23:08:59.300087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'90","last_scrub_stamp":"2024-09-13T23:08:59.299983+0000","last_deep_scrub":"34'90","last_deep_scrub_stamp":"2024-09-13T23:08:59.299983+0000","last_clean_scrub_stamp":"2024-09-13T23:08:59.299983+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:55:55.335307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:38.028204+0000","last_change":"2024-09-13T23:08:38.028280+0000","last_active":"2024-09-13T23:08:38.028204+0000","last_peered":"2024-09-13T23:08:38.028204+0000","last_clean":"2024-09-13T23:08:38.028204+0000","last_became_active":"2024-09-13T23:05:20.139399+0000","last_became_peered":"2024-09-13T23:05:20.139399+0000","last_unstale":"2024-09-13T23:08:38.028204+0000","last_undegraded":"2024-09-13T23:08:38.028204+0000","last_fullsized":"2024-09-13T23:08:38.028204+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:38.028097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:38.028097+0000","last_clean_scrub_stamp":"2024-09-13T23:08:38.028097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:47.384593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'87","reported_seq":180,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:50.698918+0000","last_change":"2024-09-13T23:08:50.698944+0000","last_active":"2024-09-13T23:08:50.698918+0000","last_peered":"2024-09-13T23:08:50.698918+0000","last_clean":"2024-09-13T23:08:50.698918+0000","last_became_active":"2024-09-13T23:05:22.140430+0000","last_became_peered":"2024-09-13T23:05:22.140430+0000","last_unstale":"2024-09-13T23:08:50.698918+0000","last_undegraded":"2024-09-13T23:08:50.698918+0000","last_fullsized":"2024-09-13T23:08:50.698918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'87","last_scrub_stamp":"2024-09-13T23:08:50.698827+0000","last_deep_scrub":"34'87","last_deep_scrub_stamp":"2024-09-13T23:08:50.698827+0000","last_clean_scrub_stamp":"2024-09-13T23:08:50.698827+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:09.410253+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":226,"num_write":170,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.106729+0000","last_change":"2024-09-13T23:05:14.113221+0000","last_active":"2024-09-13T23:08:22.106729+0000","last_peered":"2024-09-13T23:08:22.106729+0000","last_clean":"2024-09-13T23:08:22.106729+0000","last_became_active":"2024-09-13T23:05:14.112711+0000","last_became_peered":"2024-09-13T23:05:14.112711+0000","last_unstale":"2024-09-13T23:08:22.106729+0000","last_undegraded":"2024-09-13T23:08:22.106729+0000","last_fullsized":"2024-09-13T23:08:22.106729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.410193+0000","last_change":"2024-09-13T23:05:03.078145+0000","last_active":"2024-09-13T23:08:33.410193+0000","last_peered":"2024-09-13T23:08:33.410193+0000","last_clean":"2024-09-13T23:08:33.410193+0000","last_became_active":"2024-09-13T23:05:01.075438+0000","last_became_peered":"2024-09-13T23:05:01.075438+0000","last_unstale":"2024-09-13T23:08:33.410193+0000","last_undegraded":"2024-09-13T23:08:33.410193+0000","last_fullsized":"2024-09-13T23:08:33.410193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043480299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.071388+0000","last_change":"2024-09-13T23:05:12.114595+0000","last_active":"2024-09-13T23:07:19.071388+0000","last_peered":"2024-09-13T23:07:19.071388+0000","last_clean":"2024-09-13T23:07:19.071388+0000","last_became_active":"2024-09-13T23:05:12.114087+0000","last_became_peered":"2024-09-13T23:05:12.114087+0000","last_unstale":"2024-09-13T23:07:19.071388+0000","last_undegraded":"2024-09-13T23:07:19.071388+0000","last_fullsized":"2024-09-13T23:07:19.071388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:36.535774+0000","last_change":"2024-09-13T23:08:36.535799+0000","last_active":"2024-09-13T23:08:36.535774+0000","last_peered":"2024-09-13T23:08:36.535774+0000","last_clean":"2024-09-13T23:08:36.535774+0000","last_became_active":"2024-09-13T23:05:16.127404+0000","last_became_peered":"2024-09-13T23:05:16.127404+0000","last_unstale":"2024-09-13T23:08:36.535774+0000","last_undegraded":"2024-09-13T23:08:36.535774+0000","last_fullsized":"2024-09-13T23:08:36.535774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:36.535683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:36.535683+0000","last_clean_scrub_stamp":"2024-09-13T23:08:36.535683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:53.587715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'291","reported_seq":516,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.140582+0000","last_change":"2024-09-13T23:08:33.140621+0000","last_active":"2024-09-13T23:08:33.140582+0000","last_peered":"2024-09-13T23:08:33.140582+0000","last_clean":"2024-09-13T23:08:33.140582+0000","last_became_active":"2024-09-13T23:05:18.135536+0000","last_became_peered":"2024-09-13T23:05:18.135536+0000","last_unstale":"2024-09-13T23:08:33.140582+0000","last_undegraded":"2024-09-13T23:08:33.140582+0000","last_fullsized":"2024-09-13T23:08:33.140582+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'291","last_scrub_stamp":"2024-09-13T23:08:33.140485+0000","last_deep_scrub":"34'291","last_deep_scrub_stamp":"2024-09-13T23:08:33.140485+0000","last_clean_scrub_stamp":"2024-09-13T23:08:33.140485+0000","objects_scrubbed":10,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:37:26.815426+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:54.455714+0000","last_change":"2024-09-13T23:08:54.455735+0000","last_active":"2024-09-13T23:08:54.455714+0000","last_peered":"2024-09-13T23:08:54.455714+0000","last_clean":"2024-09-13T23:08:54.455714+0000","last_became_active":"2024-09-13T23:05:20.138840+0000","last_became_peered":"2024-09-13T23:05:20.138840+0000","last_unstale":"2024-09-13T23:08:54.455714+0000","last_undegraded":"2024-09-13T23:08:54.455714+0000","last_fullsized":"2024-09-13T23:08:54.455714+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:54.455627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:54.455627+0000","last_clean_scrub_stamp":"2024-09-13T23:08:54.455627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:31:31.023076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.254236+0000","last_change":"2024-09-13T23:05:22.149748+0000","last_active":"2024-09-13T23:08:22.254236+0000","last_peered":"2024-09-13T23:08:22.254236+0000","last_clean":"2024-09-13T23:08:22.254236+0000","last_became_active":"2024-09-13T23:05:22.149430+0000","last_became_peered":"2024-09-13T23:05:22.149430+0000","last_unstale":"2024-09-13T23:08:22.254236+0000","last_undegraded":"2024-09-13T23:08:22.254236+0000","last_fullsized":"2024-09-13T23:08:22.254236+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:01.252337+0000","last_change":"2024-09-13T23:09:01.252393+0000","last_active":"2024-09-13T23:09:01.252337+0000","last_peered":"2024-09-13T23:09:01.252337+0000","last_clean":"2024-09-13T23:09:01.252337+0000","last_became_active":"2024-09-13T23:05:14.121629+0000","last_became_peered":"2024-09-13T23:05:14.121629+0000","last_unstale":"2024-09-13T23:09:01.252337+0000","last_undegraded":"2024-09-13T23:09:01.252337+0000","last_fullsized":"2024-09-13T23:09:01.252337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:01.252231+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:01.252231+0000","last_clean_scrub_stamp":"2024-09-13T23:09:01.252231+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:41.769830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:32.970122+0000","last_change":"2024-09-13T23:05:03.246597+0000","last_active":"2024-09-13T23:08:32.970122+0000","last_peered":"2024-09-13T23:08:32.970122+0000","last_clean":"2024-09-13T23:08:32.970122+0000","last_became_active":"2024-09-13T23:05:01.075422+0000","last_became_peered":"2024-09-13T23:05:01.075422+0000","last_unstale":"2024-09-13T23:08:32.970122+0000","last_undegraded":"2024-09-13T23:08:32.970122+0000","last_fullsized":"2024-09-13T23:08:32.970122+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049267099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:32.091296+0000","last_change":"2024-09-13T23:05:12.118437+0000","last_active":"2024-09-13T23:08:32.091296+0000","last_peered":"2024-09-13T23:08:32.091296+0000","last_clean":"2024-09-13T23:08:32.091296+0000","last_became_active":"2024-09-13T23:05:12.117940+0000","last_became_peered":"2024-09-13T23:05:12.117940+0000","last_unstale":"2024-09-13T23:08:32.091296+0000","last_undegraded":"2024-09-13T23:08:32.091296+0000","last_fullsized":"2024-09-13T23:08:32.091296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:52.616476+0000","last_change":"2024-09-13T23:08:52.616505+0000","last_active":"2024-09-13T23:08:52.616476+0000","last_peered":"2024-09-13T23:08:52.616476+0000","last_clean":"2024-09-13T23:08:52.616476+0000","last_became_active":"2024-09-13T23:05:16.122318+0000","last_became_peered":"2024-09-13T23:05:16.122318+0000","last_unstale":"2024-09-13T23:08:52.616476+0000","last_undegraded":"2024-09-13T23:08:52.616476+0000","last_fullsized":"2024-09-13T23:08:52.616476+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:08:52.616388+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:08:52.616388+0000","last_clean_scrub_stamp":"2024-09-13T23:08:52.616388+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:55:21.961122+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'23","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:43.618881+0000","last_change":"2024-09-13T23:08:43.618923+0000","last_active":"2024-09-13T23:08:43.618881+0000","last_peered":"2024-09-13T23:08:43.618881+0000","last_clean":"2024-09-13T23:08:43.618881+0000","last_became_active":"2024-09-13T23:05:18.127698+0000","last_became_peered":"2024-09-13T23:05:18.127698+0000","last_unstale":"2024-09-13T23:08:43.618881+0000","last_undegraded":"2024-09-13T23:08:43.618881+0000","last_fullsized":"2024-09-13T23:08:43.618881+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-09-13T23:08:43.618795+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-09-13T23:08:43.618795+0000","last_clean_scrub_stamp":"2024-09-13T23:08:43.618795+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:08.067385+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:54.192244+0000","last_change":"2024-09-13T23:08:54.192277+0000","last_active":"2024-09-13T23:08:54.192244+0000","last_peered":"2024-09-13T23:08:54.192244+0000","last_clean":"2024-09-13T23:08:54.192244+0000","last_became_active":"2024-09-13T23:05:20.145330+0000","last_became_peered":"2024-09-13T23:05:20.145330+0000","last_unstale":"2024-09-13T23:08:54.192244+0000","last_undegraded":"2024-09-13T23:08:54.192244+0000","last_fullsized":"2024-09-13T23:08:54.192244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:54.192167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:54.192167+0000","last_clean_scrub_stamp":"2024-09-13T23:08:54.192167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:57.546243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:37.078155+0000","last_change":"2024-09-13T23:05:22.139303+0000","last_active":"2024-09-13T23:07:37.078155+0000","last_peered":"2024-09-13T23:07:37.078155+0000","last_clean":"2024-09-13T23:07:37.078155+0000","last_became_active":"2024-09-13T23:05:22.138259+0000","last_became_peered":"2024-09-13T23:05:22.138259+0000","last_unstale":"2024-09-13T23:07:37.078155+0000","last_undegraded":"2024-09-13T23:07:37.078155+0000","last_fullsized":"2024-09-13T23:07:37.078155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'6","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:06.214693+0000","last_change":"2024-09-13T23:09:06.214718+0000","last_active":"2024-09-13T23:09:06.214693+0000","last_peered":"2024-09-13T23:09:06.214693+0000","last_clean":"2024-09-13T23:09:06.214693+0000","last_became_active":"2024-09-13T23:05:14.110532+0000","last_became_peered":"2024-09-13T23:05:14.110532+0000","last_unstale":"2024-09-13T23:09:06.214693+0000","last_undegraded":"2024-09-13T23:09:06.214693+0000","last_fullsized":"2024-09-13T23:09:06.214693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:06.214603+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:06.214603+0000","last_clean_scrub_stamp":"2024-09-13T23:09:06.214603+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:32.509898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.410219+0000","last_change":"2024-09-13T23:05:03.078756+0000","last_active":"2024-09-13T23:08:33.410219+0000","last_peered":"2024-09-13T23:08:33.410219+0000","last_clean":"2024-09-13T23:08:33.410219+0000","last_became_active":"2024-09-13T23:05:01.075399+0000","last_became_peered":"2024-09-13T23:05:01.075399+0000","last_unstale":"2024-09-13T23:08:33.410219+0000","last_undegraded":"2024-09-13T23:08:33.410219+0000","last_fullsized":"2024-09-13T23:08:33.410219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010379530000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:03.637942+0000","last_change":"2024-09-13T23:09:03.637970+0000","last_active":"2024-09-13T23:09:03.637942+0000","last_peered":"2024-09-13T23:09:03.637942+0000","last_clean":"2024-09-13T23:09:03.637942+0000","last_became_active":"2024-09-13T23:05:12.130410+0000","last_became_peered":"2024-09-13T23:05:12.130410+0000","last_unstale":"2024-09-13T23:09:03.637942+0000","last_undegraded":"2024-09-13T23:09:03.637942+0000","last_fullsized":"2024-09-13T23:09:03.637942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:03.637848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:03.637848+0000","last_clean_scrub_stamp":"2024-09-13T23:09:03.637848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:25.877408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:49.163451+0000","last_change":"2024-09-13T23:08:49.163497+0000","last_active":"2024-09-13T23:08:49.163451+0000","last_peered":"2024-09-13T23:08:49.163451+0000","last_clean":"2024-09-13T23:08:49.163451+0000","last_became_active":"2024-09-13T23:05:16.123983+0000","last_became_peered":"2024-09-13T23:05:16.123983+0000","last_unstale":"2024-09-13T23:08:49.163451+0000","last_undegraded":"2024-09-13T23:08:49.163451+0000","last_fullsized":"2024-09-13T23:08:49.163451+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:49.163347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:49.163347+0000","last_clean_scrub_stamp":"2024-09-13T23:08:49.163347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:37:31.793295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:52.437499+0000","last_change":"2024-09-13T23:08:52.437554+0000","last_active":"2024-09-13T23:08:52.437499+0000","last_peered":"2024-09-13T23:08:52.437499+0000","last_clean":"2024-09-13T23:08:52.437499+0000","last_became_active":"2024-09-13T23:05:18.133165+0000","last_became_peered":"2024-09-13T23:05:18.133165+0000","last_unstale":"2024-09-13T23:08:52.437499+0000","last_undegraded":"2024-09-13T23:08:52.437499+0000","last_fullsized":"2024-09-13T23:08:52.437499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-13T23:08:52.437407+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-13T23:08:52.437407+0000","last_clean_scrub_stamp":"2024-09-13T23:08:52.437407+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:53:28.383722+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:32.077208+0000","last_change":"2024-09-13T23:05:20.144363+0000","last_active":"2024-09-13T23:07:32.077208+0000","last_peered":"2024-09-13T23:07:32.077208+0000","last_clean":"2024-09-13T23:07:32.077208+0000","last_became_active":"2024-09-13T23:05:20.143748+0000","last_became_peered":"2024-09-13T23:05:20.143748+0000","last_unstale":"2024-09-13T23:07:32.077208+0000","last_undegraded":"2024-09-13T23:07:32.077208+0000","last_fullsized":"2024-09-13T23:07:32.077208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:19.114167+0000","last_clean_scrub_stamp":"2024-09-13T23:05:19.114167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:33.076591+0000","last_change":"2024-09-13T23:05:22.150796+0000","last_active":"2024-09-13T23:07:33.076591+0000","last_peered":"2024-09-13T23:07:33.076591+0000","last_clean":"2024-09-13T23:07:33.076591+0000","last_became_active":"2024-09-13T23:05:22.150415+0000","last_became_peered":"2024-09-13T23:05:22.150415+0000","last_unstale":"2024-09-13T23:07:33.076591+0000","last_undegraded":"2024-09-13T23:07:33.076591+0000","last_fullsized":"2024-09-13T23:07:33.076591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.328739+0000","last_change":"2024-09-13T23:05:14.123934+0000","last_active":"2024-09-13T23:08:22.328739+0000","last_peered":"2024-09-13T23:08:22.328739+0000","last_clean":"2024-09-13T23:08:22.328739+0000","last_became_active":"2024-09-13T23:05:14.123447+0000","last_became_peered":"2024-09-13T23:05:14.123447+0000","last_unstale":"2024-09-13T23:08:22.328739+0000","last_undegraded":"2024-09-13T23:08:22.328739+0000","last_fullsized":"2024-09-13T23:08:22.328739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:21.074737+0000","last_change":"2024-09-13T23:05:12.124402+0000","last_active":"2024-09-13T23:07:21.074737+0000","last_peered":"2024-09-13T23:07:21.074737+0000","last_clean":"2024-09-13T23:07:21.074737+0000","last_became_active":"2024-09-13T23:05:12.124005+0000","last_became_peered":"2024-09-13T23:05:12.124005+0000","last_unstale":"2024-09-13T23:07:21.074737+0000","last_undegraded":"2024-09-13T23:07:21.074737+0000","last_fullsized":"2024-09-13T23:07:21.074737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:32.091221+0000","last_change":"2024-09-13T23:05:03.080556+0000","last_active":"2024-09-13T23:08:32.091221+0000","last_peered":"2024-09-13T23:08:32.091221+0000","last_clean":"2024-09-13T23:08:32.091221+0000","last_became_active":"2024-09-13T23:05:01.074963+0000","last_became_peered":"2024-09-13T23:05:01.074963+0000","last_unstale":"2024-09-13T23:08:32.091221+0000","last_undegraded":"2024-09-13T23:08:32.091221+0000","last_fullsized":"2024-09-13T23:08:32.091221+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055235699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:51.145590+0000","last_change":"2024-09-13T23:08:51.145619+0000","last_active":"2024-09-13T23:08:51.145590+0000","last_peered":"2024-09-13T23:08:51.145590+0000","last_clean":"2024-09-13T23:08:51.145590+0000","last_became_active":"2024-09-13T23:05:16.123971+0000","last_became_peered":"2024-09-13T23:05:16.123971+0000","last_unstale":"2024-09-13T23:08:51.145590+0000","last_undegraded":"2024-09-13T23:08:51.145590+0000","last_fullsized":"2024-09-13T23:08:51.145590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'1","last_scrub_stamp":"2024-09-13T23:08:51.145496+0000","last_deep_scrub":"34'1","last_deep_scrub_stamp":"2024-09-13T23:08:51.145496+0000","last_clean_scrub_stamp":"2024-09-13T23:08:51.145496+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:32.511958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'73","reported_seq":149,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:43.048521+0000","last_change":"2024-09-13T23:08:43.048564+0000","last_active":"2024-09-13T23:08:43.048521+0000","last_peered":"2024-09-13T23:08:43.048521+0000","last_clean":"2024-09-13T23:08:43.048521+0000","last_became_active":"2024-09-13T23:05:18.132051+0000","last_became_peered":"2024-09-13T23:05:18.132051+0000","last_unstale":"2024-09-13T23:08:43.048521+0000","last_undegraded":"2024-09-13T23:08:43.048521+0000","last_fullsized":"2024-09-13T23:08:43.048521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'73","last_scrub_stamp":"2024-09-13T23:08:43.048427+0000","last_deep_scrub":"34'73","last_deep_scrub_stamp":"2024-09-13T23:08:43.048427+0000","last_clean_scrub_stamp":"2024-09-13T23:08:43.048427+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:30.653285+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:34.656045+0000","last_change":"2024-09-13T23:08:34.656091+0000","last_active":"2024-09-13T23:08:34.656045+0000","last_peered":"2024-09-13T23:08:34.656045+0000","last_clean":"2024-09-13T23:08:34.656045+0000","last_became_active":"2024-09-13T23:05:20.143566+0000","last_became_peered":"2024-09-13T23:05:20.143566+0000","last_unstale":"2024-09-13T23:08:34.656045+0000","last_undegraded":"2024-09-13T23:08:34.656045+0000","last_fullsized":"2024-09-13T23:08:34.656045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:34.655943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:34.655943+0000","last_clean_scrub_stamp":"2024-09-13T23:08:34.655943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:57.192299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'12","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:02.264101+0000","last_change":"2024-09-13T23:09:02.264138+0000","last_active":"2024-09-13T23:09:02.264101+0000","last_peered":"2024-09-13T23:09:02.264101+0000","last_clean":"2024-09-13T23:09:02.264101+0000","last_became_active":"2024-09-13T23:05:22.137952+0000","last_became_peered":"2024-09-13T23:05:22.137952+0000","last_unstale":"2024-09-13T23:09:02.264101+0000","last_undegraded":"2024-09-13T23:09:02.264101+0000","last_fullsized":"2024-09-13T23:09:02.264101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T23:09:02.264003+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T23:09:02.264003+0000","last_clean_scrub_stamp":"2024-09-13T23:09:02.264003+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:12.926079+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:58.060862+0000","last_change":"2024-09-13T23:08:58.060890+0000","last_active":"2024-09-13T23:08:58.060862+0000","last_peered":"2024-09-13T23:08:58.060862+0000","last_clean":"2024-09-13T23:08:58.060862+0000","last_became_active":"2024-09-13T23:05:14.123549+0000","last_became_peered":"2024-09-13T23:05:14.123549+0000","last_unstale":"2024-09-13T23:08:58.060862+0000","last_undegraded":"2024-09-13T23:08:58.060862+0000","last_fullsized":"2024-09-13T23:08:58.060862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:08:58.060770+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:08:58.060770+0000","last_clean_scrub_stamp":"2024-09-13T23:08:58.060770+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:37:59.977042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:05.222804+0000","last_change":"2024-09-13T23:09:05.222854+0000","last_active":"2024-09-13T23:09:05.222804+0000","last_peered":"2024-09-13T23:09:05.222804+0000","last_clean":"2024-09-13T23:09:05.222804+0000","last_became_active":"2024-09-13T23:05:12.130285+0000","last_became_peered":"2024-09-13T23:05:12.130285+0000","last_unstale":"2024-09-13T23:09:05.222804+0000","last_undegraded":"2024-09-13T23:09:05.222804+0000","last_fullsized":"2024-09-13T23:09:05.222804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:05.222712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:05.222712+0000","last_clean_scrub_stamp":"2024-09-13T23:09:05.222712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:59.676566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.410215+0000","last_change":"2024-09-13T23:05:03.078119+0000","last_active":"2024-09-13T23:08:33.410215+0000","last_peered":"2024-09-13T23:08:33.410215+0000","last_clean":"2024-09-13T23:08:33.410215+0000","last_became_active":"2024-09-13T23:05:01.075431+0000","last_became_peered":"2024-09-13T23:05:01.075431+0000","last_unstale":"2024-09-13T23:08:33.410215+0000","last_undegraded":"2024-09-13T23:08:33.410215+0000","last_fullsized":"2024-09-13T23:08:33.410215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041474900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:43.475029+0000","last_change":"2024-09-13T23:08:43.475069+0000","last_active":"2024-09-13T23:08:43.475029+0000","last_peered":"2024-09-13T23:08:43.475029+0000","last_clean":"2024-09-13T23:08:43.475029+0000","last_became_active":"2024-09-13T23:05:16.120337+0000","last_became_peered":"2024-09-13T23:05:16.120337+0000","last_unstale":"2024-09-13T23:08:43.475029+0000","last_undegraded":"2024-09-13T23:08:43.475029+0000","last_fullsized":"2024-09-13T23:08:43.475029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:43.474930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:43.474930+0000","last_clean_scrub_stamp":"2024-09-13T23:08:43.474930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:26.685113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'23","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:34.131751+0000","last_change":"2024-09-13T23:08:34.131801+0000","last_active":"2024-09-13T23:08:34.131751+0000","last_peered":"2024-09-13T23:08:34.131751+0000","last_clean":"2024-09-13T23:08:34.131751+0000","last_became_active":"2024-09-13T23:05:18.133676+0000","last_became_peered":"2024-09-13T23:05:18.133676+0000","last_unstale":"2024-09-13T23:08:34.131751+0000","last_undegraded":"2024-09-13T23:08:34.131751+0000","last_fullsized":"2024-09-13T23:08:34.131751+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-09-13T23:08:34.131649+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-09-13T23:08:34.131649+0000","last_clean_scrub_stamp":"2024-09-13T23:08:34.131649+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:29.113824+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":367,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:45.156181+0000","last_change":"2024-09-13T23:08:45.156231+0000","last_active":"2024-09-13T23:08:45.156181+0000","last_peered":"2024-09-13T23:08:45.156181+0000","last_clean":"2024-09-13T23:08:45.156181+0000","last_became_active":"2024-09-13T23:05:20.133332+0000","last_became_peered":"2024-09-13T23:05:20.133332+0000","last_unstale":"2024-09-13T23:08:45.156181+0000","last_undegraded":"2024-09-13T23:08:45.156181+0000","last_fullsized":"2024-09-13T23:08:45.156181+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:45.156073+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:45.156073+0000","last_clean_scrub_stamp":"2024-09-13T23:08:45.156073+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:16:24.872283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:37.078305+0000","last_change":"2024-09-13T23:05:22.141887+0000","last_active":"2024-09-13T23:07:37.078305+0000","last_peered":"2024-09-13T23:07:37.078305+0000","last_clean":"2024-09-13T23:07:37.078305+0000","last_became_active":"2024-09-13T23:05:22.141618+0000","last_became_peered":"2024-09-13T23:05:22.141618+0000","last_unstale":"2024-09-13T23:07:37.078305+0000","last_undegraded":"2024-09-13T23:07:37.078305+0000","last_fullsized":"2024-09-13T23:07:37.078305+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'18","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:49.406013+0000","last_change":"2024-09-13T23:08:49.406065+0000","last_active":"2024-09-13T23:08:49.406013+0000","last_peered":"2024-09-13T23:08:49.406013+0000","last_clean":"2024-09-13T23:08:49.406013+0000","last_became_active":"2024-09-13T23:05:14.126280+0000","last_became_peered":"2024-09-13T23:05:14.126280+0000","last_unstale":"2024-09-13T23:08:49.406013+0000","last_undegraded":"2024-09-13T23:08:49.406013+0000","last_fullsized":"2024-09-13T23:08:49.406013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-13T23:08:49.405905+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-13T23:08:49.405905+0000","last_clean_scrub_stamp":"2024-09-13T23:08:49.405905+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:10.813213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:22.075455+0000","last_change":"2024-09-13T23:05:12.149880+0000","last_active":"2024-09-13T23:07:22.075455+0000","last_peered":"2024-09-13T23:07:22.075455+0000","last_clean":"2024-09-13T23:07:22.075455+0000","last_became_active":"2024-09-13T23:05:12.149435+0000","last_became_peered":"2024-09-13T23:05:12.149435+0000","last_unstale":"2024-09-13T23:07:22.075455+0000","last_undegraded":"2024-09-13T23:07:22.075455+0000","last_fullsized":"2024-09-13T23:07:22.075455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:14.070866+0000","last_change":"2024-09-13T23:05:03.080603+0000","last_active":"2024-09-13T23:07:14.070866+0000","last_peered":"2024-09-13T23:07:14.070866+0000","last_clean":"2024-09-13T23:07:14.070866+0000","last_became_active":"2024-09-13T23:05:01.074982+0000","last_became_peered":"2024-09-13T23:05:01.074982+0000","last_unstale":"2024-09-13T23:07:14.070866+0000","last_undegraded":"2024-09-13T23:07:14.070866+0000","last_fullsized":"2024-09-13T23:07:14.070866+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054650599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:35.535003+0000","last_change":"2024-09-13T23:08:35.535037+0000","last_active":"2024-09-13T23:08:35.535003+0000","last_peered":"2024-09-13T23:08:35.535003+0000","last_clean":"2024-09-13T23:08:35.535003+0000","last_became_active":"2024-09-13T23:05:16.123573+0000","last_became_peered":"2024-09-13T23:05:16.123573+0000","last_unstale":"2024-09-13T23:08:35.535003+0000","last_undegraded":"2024-09-13T23:08:35.535003+0000","last_fullsized":"2024-09-13T23:08:35.535003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:35.534875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:35.534875+0000","last_clean_scrub_stamp":"2024-09-13T23:08:35.534875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:03:04.742631+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:05.270673+0000","last_change":"2024-09-13T23:09:05.270708+0000","last_active":"2024-09-13T23:09:05.270673+0000","last_peered":"2024-09-13T23:09:05.270673+0000","last_clean":"2024-09-13T23:09:05.270673+0000","last_became_active":"2024-09-13T23:05:18.132140+0000","last_became_peered":"2024-09-13T23:05:18.132140+0000","last_unstale":"2024-09-13T23:09:05.270673+0000","last_undegraded":"2024-09-13T23:09:05.270673+0000","last_fullsized":"2024-09-13T23:09:05.270673+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:09:05.270587+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:09:05.270587+0000","last_clean_scrub_stamp":"2024-09-13T23:09:05.270587+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:38.747157+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":441,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:34.964458+0000","last_change":"2024-09-13T23:08:34.964488+0000","last_active":"2024-09-13T23:08:34.964458+0000","last_peered":"2024-09-13T23:08:34.964458+0000","last_clean":"2024-09-13T23:08:34.964458+0000","last_became_active":"2024-09-13T23:05:20.136036+0000","last_became_peered":"2024-09-13T23:05:20.136036+0000","last_unstale":"2024-09-13T23:08:34.964458+0000","last_undegraded":"2024-09-13T23:08:34.964458+0000","last_fullsized":"2024-09-13T23:08:34.964458+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:34.964357+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:34.964357+0000","last_clean_scrub_stamp":"2024-09-13T23:08:34.964357+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:48:39.411891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:38.077573+0000","last_change":"2024-09-13T23:05:22.145082+0000","last_active":"2024-09-13T23:07:38.077573+0000","last_peered":"2024-09-13T23:07:38.077573+0000","last_clean":"2024-09-13T23:07:38.077573+0000","last_became_active":"2024-09-13T23:05:22.144787+0000","last_became_peered":"2024-09-13T23:05:22.144787+0000","last_unstale":"2024-09-13T23:07:38.077573+0000","last_undegraded":"2024-09-13T23:07:38.077573+0000","last_fullsized":"2024-09-13T23:07:38.077573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:00.592582+0000","last_change":"2024-09-13T23:09:00.592608+0000","last_active":"2024-09-13T23:09:00.592582+0000","last_peered":"2024-09-13T23:09:00.592582+0000","last_clean":"2024-09-13T23:09:00.592582+0000","last_became_active":"2024-09-13T23:05:14.112565+0000","last_became_peered":"2024-09-13T23:05:14.112565+0000","last_unstale":"2024-09-13T23:09:00.592582+0000","last_undegraded":"2024-09-13T23:09:00.592582+0000","last_fullsized":"2024-09-13T23:09:00.592582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:09:00.592449+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:09:00.592449+0000","last_clean_scrub_stamp":"2024-09-13T23:09:00.592449+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:17.593917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:23.075286+0000","last_change":"2024-09-13T23:05:12.131805+0000","last_active":"2024-09-13T23:07:23.075286+0000","last_peered":"2024-09-13T23:07:23.075286+0000","last_clean":"2024-09-13T23:07:23.075286+0000","last_became_active":"2024-09-13T23:05:12.131413+0000","last_became_peered":"2024-09-13T23:05:12.131413+0000","last_unstale":"2024-09-13T23:07:23.075286+0000","last_undegraded":"2024-09-13T23:07:23.075286+0000","last_fullsized":"2024-09-13T23:07:23.075286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:12.074026+0000","last_change":"2024-09-13T23:05:03.078956+0000","last_active":"2024-09-13T23:07:12.074026+0000","last_peered":"2024-09-13T23:07:12.074026+0000","last_clean":"2024-09-13T23:07:12.074026+0000","last_became_active":"2024-09-13T23:05:01.323761+0000","last_became_peered":"2024-09-13T23:05:01.323761+0000","last_unstale":"2024-09-13T23:07:12.074026+0000","last_undegraded":"2024-09-13T23:07:12.074026+0000","last_fullsized":"2024-09-13T23:07:12.074026+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001181893,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:42.524246+0000","last_change":"2024-09-13T23:08:42.524284+0000","last_active":"2024-09-13T23:08:42.524246+0000","last_peered":"2024-09-13T23:08:42.524246+0000","last_clean":"2024-09-13T23:08:42.524246+0000","last_became_active":"2024-09-13T23:05:16.120974+0000","last_became_peered":"2024-09-13T23:05:16.120974+0000","last_unstale":"2024-09-13T23:08:42.524246+0000","last_undegraded":"2024-09-13T23:08:42.524246+0000","last_fullsized":"2024-09-13T23:08:42.524246+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:42.524136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:42.524136+0000","last_clean_scrub_stamp":"2024-09-13T23:08:42.524136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:38.191251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'96","reported_seq":189,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:37.565615+0000","last_change":"2024-09-13T23:08:37.565659+0000","last_active":"2024-09-13T23:08:37.565615+0000","last_peered":"2024-09-13T23:08:37.565615+0000","last_clean":"2024-09-13T23:08:37.565615+0000","last_became_active":"2024-09-13T23:05:18.137925+0000","last_became_peered":"2024-09-13T23:05:18.137925+0000","last_unstale":"2024-09-13T23:08:37.565615+0000","last_undegraded":"2024-09-13T23:08:37.565615+0000","last_fullsized":"2024-09-13T23:08:37.565615+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'96","last_scrub_stamp":"2024-09-13T23:08:37.565507+0000","last_deep_scrub":"34'96","last_deep_scrub_stamp":"2024-09-13T23:08:37.565507+0000","last_clean_scrub_stamp":"2024-09-13T23:08:37.565507+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:03:42.806653+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:39.048919+0000","last_change":"2024-09-13T23:08:39.048948+0000","last_active":"2024-09-13T23:08:39.048919+0000","last_peered":"2024-09-13T23:08:39.048919+0000","last_clean":"2024-09-13T23:08:39.048919+0000","last_became_active":"2024-09-13T23:05:20.129363+0000","last_became_peered":"2024-09-13T23:05:20.129363+0000","last_unstale":"2024-09-13T23:08:39.048919+0000","last_undegraded":"2024-09-13T23:08:39.048919+0000","last_fullsized":"2024-09-13T23:08:39.048919+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:39.048809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:39.048809+0000","last_clean_scrub_stamp":"2024-09-13T23:08:39.048809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:47.267359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:41.077846+0000","last_change":"2024-09-13T23:05:22.151007+0000","last_active":"2024-09-13T23:07:41.077846+0000","last_peered":"2024-09-13T23:07:41.077846+0000","last_clean":"2024-09-13T23:07:41.077846+0000","last_became_active":"2024-09-13T23:05:22.149645+0000","last_became_peered":"2024-09-13T23:05:22.149645+0000","last_unstale":"2024-09-13T23:07:41.077846+0000","last_undegraded":"2024-09-13T23:07:41.077846+0000","last_fullsized":"2024-09-13T23:07:41.077846+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:31.076271+0000","last_change":"2024-09-13T23:05:22.151921+0000","last_active":"2024-09-13T23:07:31.076271+0000","last_peered":"2024-09-13T23:07:31.076271+0000","last_clean":"2024-09-13T23:07:31.076271+0000","last_became_active":"2024-09-13T23:05:22.151640+0000","last_became_peered":"2024-09-13T23:05:22.151640+0000","last_unstale":"2024-09-13T23:07:31.076271+0000","last_undegraded":"2024-09-13T23:07:31.076271+0000","last_fullsized":"2024-09-13T23:07:31.076271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'12","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:02.595390+0000","last_change":"2024-09-13T23:09:02.595417+0000","last_active":"2024-09-13T23:09:02.595390+0000","last_peered":"2024-09-13T23:09:02.595390+0000","last_clean":"2024-09-13T23:09:02.595390+0000","last_became_active":"2024-09-13T23:05:14.113236+0000","last_became_peered":"2024-09-13T23:05:14.113236+0000","last_unstale":"2024-09-13T23:09:02.595390+0000","last_undegraded":"2024-09-13T23:09:02.595390+0000","last_fullsized":"2024-09-13T23:09:02.595390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T23:09:02.595304+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T23:09:02.595304+0000","last_clean_scrub_stamp":"2024-09-13T23:09:02.595304+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:26.214597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:32.077121+0000","last_change":"2024-09-13T23:05:12.141658+0000","last_active":"2024-09-13T23:07:32.077121+0000","last_peered":"2024-09-13T23:07:32.077121+0000","last_clean":"2024-09-13T23:07:32.077121+0000","last_became_active":"2024-09-13T23:05:12.141280+0000","last_became_peered":"2024-09-13T23:05:12.141280+0000","last_unstale":"2024-09-13T23:07:32.077121+0000","last_undegraded":"2024-09-13T23:07:32.077121+0000","last_fullsized":"2024-09-13T23:07:32.077121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:47.188405+0000","last_change":"2024-09-13T23:08:47.188431+0000","last_active":"2024-09-13T23:08:47.188405+0000","last_peered":"2024-09-13T23:08:47.188405+0000","last_clean":"2024-09-13T23:08:47.188405+0000","last_became_active":"2024-09-13T23:05:16.117468+0000","last_became_peered":"2024-09-13T23:05:16.117468+0000","last_unstale":"2024-09-13T23:08:47.188405+0000","last_undegraded":"2024-09-13T23:08:47.188405+0000","last_fullsized":"2024-09-13T23:08:47.188405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:47.188316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:47.188316+0000","last_clean_scrub_stamp":"2024-09-13T23:08:47.188316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:30:41.738969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'41","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:44.467262+0000","last_change":"2024-09-13T23:08:44.467306+0000","last_active":"2024-09-13T23:08:44.467262+0000","last_peered":"2024-09-13T23:08:44.467262+0000","last_clean":"2024-09-13T23:08:44.467262+0000","last_became_active":"2024-09-13T23:05:18.131841+0000","last_became_peered":"2024-09-13T23:05:18.131841+0000","last_unstale":"2024-09-13T23:08:44.467262+0000","last_undegraded":"2024-09-13T23:08:44.467262+0000","last_fullsized":"2024-09-13T23:08:44.467262+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'41","last_scrub_stamp":"2024-09-13T23:08:44.467169+0000","last_deep_scrub":"34'41","last_deep_scrub_stamp":"2024-09-13T23:08:44.467169+0000","last_clean_scrub_stamp":"2024-09-13T23:08:44.467169+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:11.320136+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:04.223034+0000","last_change":"2024-09-13T23:09:04.223060+0000","last_active":"2024-09-13T23:09:04.223034+0000","last_peered":"2024-09-13T23:09:04.223034+0000","last_clean":"2024-09-13T23:09:04.223034+0000","last_became_active":"2024-09-13T23:05:20.138958+0000","last_became_peered":"2024-09-13T23:05:20.138958+0000","last_unstale":"2024-09-13T23:09:04.223034+0000","last_undegraded":"2024-09-13T23:09:04.223034+0000","last_fullsized":"2024-09-13T23:09:04.223034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:04.222933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:04.222933+0000","last_clean_scrub_stamp":"2024-09-13T23:09:04.222933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:27.241190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'5","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.366898+0000","last_change":"2024-09-13T23:05:22.141828+0000","last_active":"2024-09-13T23:08:22.366898+0000","last_peered":"2024-09-13T23:08:22.366898+0000","last_clean":"2024-09-13T23:08:22.366898+0000","last_became_active":"2024-09-13T23:05:22.141471+0000","last_became_peered":"2024-09-13T23:05:22.141471+0000","last_unstale":"2024-09-13T23:08:22.366898+0000","last_undegraded":"2024-09-13T23:08:22.366898+0000","last_fullsized":"2024-09-13T23:08:22.366898+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'8","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:13.077681+0000","last_change":"2024-09-13T23:09:13.077712+0000","last_active":"2024-09-13T23:09:13.077681+0000","last_peered":"2024-09-13T23:09:13.077681+0000","last_clean":"2024-09-13T23:09:13.077681+0000","last_became_active":"2024-09-13T23:05:49.164131+0000","last_became_peered":"2024-09-13T23:05:49.164131+0000","last_unstale":"2024-09-13T23:09:13.077681+0000","last_undegraded":"2024-09-13T23:09:13.077681+0000","last_fullsized":"2024-09-13T23:09:13.077681+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:09:13.077595+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:09:13.077595+0000","last_clean_scrub_stamp":"2024-09-13T23:09:13.077595+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:46.551346+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.230548+0000","last_change":"2024-09-13T23:05:12.116495+0000","last_active":"2024-09-13T23:08:22.230548+0000","last_peered":"2024-09-13T23:08:22.230548+0000","last_clean":"2024-09-13T23:08:22.230548+0000","last_became_active":"2024-09-13T23:05:12.114343+0000","last_became_peered":"2024-09-13T23:05:12.114343+0000","last_unstale":"2024-09-13T23:08:22.230548+0000","last_undegraded":"2024-09-13T23:08:22.230548+0000","last_fullsized":"2024-09-13T23:08:22.230548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:37.573201+0000","last_change":"2024-09-13T23:08:37.573239+0000","last_active":"2024-09-13T23:08:37.573201+0000","last_peered":"2024-09-13T23:08:37.573201+0000","last_clean":"2024-09-13T23:08:37.573201+0000","last_became_active":"2024-09-13T23:05:49.160578+0000","last_became_peered":"2024-09-13T23:05:49.160578+0000","last_unstale":"2024-09-13T23:08:37.573201+0000","last_undegraded":"2024-09-13T23:08:37.573201+0000","last_fullsized":"2024-09-13T23:08:37.573201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:37.573092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:37.573092+0000","last_clean_scrub_stamp":"2024-09-13T23:08:37.573092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:12:43.684366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:47.139182+0000","last_change":"2024-09-13T23:08:47.139236+0000","last_active":"2024-09-13T23:08:47.139182+0000","last_peered":"2024-09-13T23:08:47.139182+0000","last_clean":"2024-09-13T23:08:47.139182+0000","last_became_active":"2024-09-13T23:05:18.121514+0000","last_became_peered":"2024-09-13T23:05:18.121514+0000","last_unstale":"2024-09-13T23:08:47.139182+0000","last_undegraded":"2024-09-13T23:08:47.139182+0000","last_fullsized":"2024-09-13T23:08:47.139182+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:08:47.139074+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:08:47.139074+0000","last_clean_scrub_stamp":"2024-09-13T23:08:47.139074+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:36.671882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.698449+0000","last_change":"2024-09-13T23:08:33.698474+0000","last_active":"2024-09-13T23:08:33.698449+0000","last_peered":"2024-09-13T23:08:33.698449+0000","last_clean":"2024-09-13T23:08:33.698449+0000","last_became_active":"2024-09-13T23:05:20.140290+0000","last_became_peered":"2024-09-13T23:05:20.140290+0000","last_unstale":"2024-09-13T23:08:33.698449+0000","last_undegraded":"2024-09-13T23:08:33.698449+0000","last_fullsized":"2024-09-13T23:08:33.698449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:33.698356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:33.698356+0000","last_clean_scrub_stamp":"2024-09-13T23:08:33.698356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:32:32.081819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:54.077032+0000","last_change":"2024-09-13T23:05:22.141270+0000","last_active":"2024-09-13T23:07:54.077032+0000","last_peered":"2024-09-13T23:07:54.077032+0000","last_clean":"2024-09-13T23:07:54.077032+0000","last_became_active":"2024-09-13T23:05:22.140963+0000","last_became_peered":"2024-09-13T23:05:22.140963+0000","last_unstale":"2024-09-13T23:07:54.077032+0000","last_undegraded":"2024-09-13T23:07:54.077032+0000","last_fullsized":"2024-09-13T23:07:54.077032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:34.073898+0000","last_change":"2024-09-13T23:05:14.120821+0000","last_active":"2024-09-13T23:07:34.073898+0000","last_peered":"2024-09-13T23:07:34.073898+0000","last_clean":"2024-09-13T23:07:34.073898+0000","last_became_active":"2024-09-13T23:05:14.120354+0000","last_became_peered":"2024-09-13T23:05:14.120354+0000","last_unstale":"2024-09-13T23:07:34.073898+0000","last_undegraded":"2024-09-13T23:07:34.073898+0000","last_fullsized":"2024-09-13T23:07:34.073898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:41.077861+0000","last_change":"2024-09-13T23:05:12.117147+0000","last_active":"2024-09-13T23:07:41.077861+0000","last_peered":"2024-09-13T23:07:41.077861+0000","last_clean":"2024-09-13T23:07:41.077861+0000","last_became_active":"2024-09-13T23:05:12.116819+0000","last_became_peered":"2024-09-13T23:05:12.116819+0000","last_unstale":"2024-09-13T23:07:41.077861+0000","last_undegraded":"2024-09-13T23:07:41.077861+0000","last_fullsized":"2024-09-13T23:07:41.077861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:49.713458+0000","last_change":"2024-09-13T23:08:49.713485+0000","last_active":"2024-09-13T23:08:49.713458+0000","last_peered":"2024-09-13T23:08:49.713458+0000","last_clean":"2024-09-13T23:08:49.713458+0000","last_became_active":"2024-09-13T23:05:16.124617+0000","last_became_peered":"2024-09-13T23:05:16.124617+0000","last_unstale":"2024-09-13T23:08:49.713458+0000","last_undegraded":"2024-09-13T23:08:49.713458+0000","last_fullsized":"2024-09-13T23:08:49.713458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:49.713367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:49.713367+0000","last_clean_scrub_stamp":"2024-09-13T23:08:49.713367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:31.248692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'47","reported_seq":119,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:45.136532+0000","last_change":"2024-09-13T23:08:45.136578+0000","last_active":"2024-09-13T23:08:45.136532+0000","last_peered":"2024-09-13T23:08:45.136532+0000","last_clean":"2024-09-13T23:08:45.136532+0000","last_became_active":"2024-09-13T23:05:18.126147+0000","last_became_peered":"2024-09-13T23:05:18.126147+0000","last_unstale":"2024-09-13T23:08:45.136532+0000","last_undegraded":"2024-09-13T23:08:45.136532+0000","last_fullsized":"2024-09-13T23:08:45.136532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-09-13T23:08:45.136425+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-09-13T23:08:45.136425+0000","last_clean_scrub_stamp":"2024-09-13T23:08:45.136425+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:12:33.611238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:37.125232+0000","last_change":"2024-09-13T23:08:37.125288+0000","last_active":"2024-09-13T23:08:37.125232+0000","last_peered":"2024-09-13T23:08:37.125232+0000","last_clean":"2024-09-13T23:08:37.125232+0000","last_became_active":"2024-09-13T23:05:20.128756+0000","last_became_peered":"2024-09-13T23:05:20.128756+0000","last_unstale":"2024-09-13T23:08:37.125232+0000","last_undegraded":"2024-09-13T23:08:37.125232+0000","last_fullsized":"2024-09-13T23:08:37.125232+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:37.125127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:37.125127+0000","last_clean_scrub_stamp":"2024-09-13T23:08:37.125127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:37.222133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:52.080856+0000","last_change":"2024-09-13T23:05:22.144728+0000","last_active":"2024-09-13T23:07:52.080856+0000","last_peered":"2024-09-13T23:07:52.080856+0000","last_clean":"2024-09-13T23:07:52.080856+0000","last_became_active":"2024-09-13T23:05:22.143767+0000","last_became_peered":"2024-09-13T23:05:22.143767+0000","last_unstale":"2024-09-13T23:07:52.080856+0000","last_undegraded":"2024-09-13T23:07:52.080856+0000","last_fullsized":"2024-09-13T23:07:52.080856+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:45.412765+0000","last_change":"2024-09-13T23:08:45.412793+0000","last_active":"2024-09-13T23:08:45.412765+0000","last_peered":"2024-09-13T23:08:45.412765+0000","last_clean":"2024-09-13T23:08:45.412765+0000","last_became_active":"2024-09-13T23:05:14.127000+0000","last_became_peered":"2024-09-13T23:05:14.127000+0000","last_unstale":"2024-09-13T23:08:45.412765+0000","last_undegraded":"2024-09-13T23:08:45.412765+0000","last_fullsized":"2024-09-13T23:08:45.412765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:45.412659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:45.412659+0000","last_clean_scrub_stamp":"2024-09-13T23:08:45.412659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:39.470592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:38.077668+0000","last_change":"2024-09-13T23:05:12.136754+0000","last_active":"2024-09-13T23:07:38.077668+0000","last_peered":"2024-09-13T23:07:38.077668+0000","last_clean":"2024-09-13T23:07:38.077668+0000","last_became_active":"2024-09-13T23:05:12.136384+0000","last_became_peered":"2024-09-13T23:05:12.136384+0000","last_unstale":"2024-09-13T23:07:38.077668+0000","last_undegraded":"2024-09-13T23:07:38.077668+0000","last_fullsized":"2024-09-13T23:07:38.077668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:34.507232+0000","last_change":"2024-09-13T23:08:34.507259+0000","last_active":"2024-09-13T23:08:34.507232+0000","last_peered":"2024-09-13T23:08:34.507232+0000","last_clean":"2024-09-13T23:08:34.507232+0000","last_became_active":"2024-09-13T23:05:16.124241+0000","last_became_peered":"2024-09-13T23:05:16.124241+0000","last_unstale":"2024-09-13T23:08:34.507232+0000","last_undegraded":"2024-09-13T23:08:34.507232+0000","last_fullsized":"2024-09-13T23:08:34.507232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:34.507140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:34.507140+0000","last_clean_scrub_stamp":"2024-09-13T23:08:34.507140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:44.378397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'37","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:44.633825+0000","last_change":"2024-09-13T23:08:44.633861+0000","last_active":"2024-09-13T23:08:44.633825+0000","last_peered":"2024-09-13T23:08:44.633825+0000","last_clean":"2024-09-13T23:08:44.633825+0000","last_became_active":"2024-09-13T23:05:18.126188+0000","last_became_peered":"2024-09-13T23:05:18.126188+0000","last_unstale":"2024-09-13T23:08:44.633825+0000","last_undegraded":"2024-09-13T23:08:44.633825+0000","last_fullsized":"2024-09-13T23:08:44.633825+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-13T23:08:44.633726+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-13T23:08:44.633726+0000","last_clean_scrub_stamp":"2024-09-13T23:08:44.633726+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:30.569822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:35.618513+0000","last_change":"2024-09-13T23:08:35.618558+0000","last_active":"2024-09-13T23:08:35.618513+0000","last_peered":"2024-09-13T23:08:35.618513+0000","last_clean":"2024-09-13T23:08:35.618513+0000","last_became_active":"2024-09-13T23:05:20.136098+0000","last_became_peered":"2024-09-13T23:05:20.136098+0000","last_unstale":"2024-09-13T23:08:35.618513+0000","last_undegraded":"2024-09-13T23:08:35.618513+0000","last_fullsized":"2024-09-13T23:08:35.618513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:35.618400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:35.618400+0000","last_clean_scrub_stamp":"2024-09-13T23:08:35.618400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:30.276746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'14","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.328958+0000","last_change":"2024-09-13T23:05:14.113061+0000","last_active":"2024-09-13T23:08:22.328958+0000","last_peered":"2024-09-13T23:08:22.328958+0000","last_clean":"2024-09-13T23:08:22.328958+0000","last_became_active":"2024-09-13T23:05:14.112822+0000","last_became_peered":"2024-09-13T23:05:14.112822+0000","last_unstale":"2024-09-13T23:08:22.328958+0000","last_undegraded":"2024-09-13T23:08:22.328958+0000","last_fullsized":"2024-09-13T23:08:22.328958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:37.077990+0000","last_change":"2024-09-13T23:05:12.143550+0000","last_active":"2024-09-13T23:07:37.077990+0000","last_peered":"2024-09-13T23:07:37.077990+0000","last_clean":"2024-09-13T23:07:37.077990+0000","last_became_active":"2024-09-13T23:05:12.141970+0000","last_became_peered":"2024-09-13T23:05:12.141970+0000","last_unstale":"2024-09-13T23:07:37.077990+0000","last_undegraded":"2024-09-13T23:07:37.077990+0000","last_fullsized":"2024-09-13T23:07:37.077990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:53.200283+0000","last_change":"2024-09-13T23:08:53.200311+0000","last_active":"2024-09-13T23:08:53.200283+0000","last_peered":"2024-09-13T23:08:53.200283+0000","last_clean":"2024-09-13T23:08:53.200283+0000","last_became_active":"2024-09-13T23:05:16.120506+0000","last_became_peered":"2024-09-13T23:05:16.120506+0000","last_unstale":"2024-09-13T23:08:53.200283+0000","last_undegraded":"2024-09-13T23:08:53.200283+0000","last_fullsized":"2024-09-13T23:08:53.200283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:53.200178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:53.200178+0000","last_clean_scrub_stamp":"2024-09-13T23:08:53.200178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:52:22.107307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'65","reported_seq":138,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:44.096079+0000","last_change":"2024-09-13T23:08:44.096120+0000","last_active":"2024-09-13T23:08:44.096079+0000","last_peered":"2024-09-13T23:08:44.096079+0000","last_clean":"2024-09-13T23:08:44.096079+0000","last_became_active":"2024-09-13T23:05:18.126811+0000","last_became_peered":"2024-09-13T23:05:18.126811+0000","last_unstale":"2024-09-13T23:08:44.096079+0000","last_undegraded":"2024-09-13T23:08:44.096079+0000","last_fullsized":"2024-09-13T23:08:44.096079+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'65","last_scrub_stamp":"2024-09-13T23:08:44.095997+0000","last_deep_scrub":"34'65","last_deep_scrub_stamp":"2024-09-13T23:08:44.095997+0000","last_clean_scrub_stamp":"2024-09-13T23:08:44.095997+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:01.263619+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:36.593190+0000","last_change":"2024-09-13T23:08:36.593215+0000","last_active":"2024-09-13T23:08:36.593190+0000","last_peered":"2024-09-13T23:08:36.593190+0000","last_clean":"2024-09-13T23:08:36.593190+0000","last_became_active":"2024-09-13T23:05:20.135886+0000","last_became_peered":"2024-09-13T23:05:20.135886+0000","last_unstale":"2024-09-13T23:08:36.593190+0000","last_undegraded":"2024-09-13T23:08:36.593190+0000","last_fullsized":"2024-09-13T23:08:36.593190+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:36.593096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:36.593096+0000","last_clean_scrub_stamp":"2024-09-13T23:08:36.593096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:13.596600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.330781+0000","last_change":"2024-09-13T23:05:22.147716+0000","last_active":"2024-09-13T23:08:22.330781+0000","last_peered":"2024-09-13T23:08:22.330781+0000","last_clean":"2024-09-13T23:08:22.330781+0000","last_became_active":"2024-09-13T23:05:22.147394+0000","last_became_peered":"2024-09-13T23:05:22.147394+0000","last_unstale":"2024-09-13T23:08:22.330781+0000","last_undegraded":"2024-09-13T23:08:22.330781+0000","last_fullsized":"2024-09-13T23:08:22.330781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'6","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:32.091572+0000","last_change":"2024-09-13T23:05:14.121676+0000","last_active":"2024-09-13T23:08:32.091572+0000","last_peered":"2024-09-13T23:08:32.091572+0000","last_clean":"2024-09-13T23:08:32.091572+0000","last_became_active":"2024-09-13T23:05:14.121349+0000","last_became_peered":"2024-09-13T23:05:14.121349+0000","last_unstale":"2024-09-13T23:08:32.091572+0000","last_undegraded":"2024-09-13T23:08:32.091572+0000","last_fullsized":"2024-09-13T23:08:32.091572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:38.077464+0000","last_change":"2024-09-13T23:05:12.139567+0000","last_active":"2024-09-13T23:07:38.077464+0000","last_peered":"2024-09-13T23:07:38.077464+0000","last_clean":"2024-09-13T23:07:38.077464+0000","last_became_active":"2024-09-13T23:05:12.137092+0000","last_became_peered":"2024-09-13T23:05:12.137092+0000","last_unstale":"2024-09-13T23:07:38.077464+0000","last_undegraded":"2024-09-13T23:07:38.077464+0000","last_fullsized":"2024-09-13T23:07:38.077464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:53.660077+0000","last_change":"2024-09-13T23:08:53.660121+0000","last_active":"2024-09-13T23:08:53.660077+0000","last_peered":"2024-09-13T23:08:53.660077+0000","last_clean":"2024-09-13T23:08:53.660077+0000","last_became_active":"2024-09-13T23:05:16.121476+0000","last_became_peered":"2024-09-13T23:05:16.121476+0000","last_unstale":"2024-09-13T23:08:53.660077+0000","last_undegraded":"2024-09-13T23:08:53.660077+0000","last_fullsized":"2024-09-13T23:08:53.660077+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:53.659974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:53.659974+0000","last_clean_scrub_stamp":"2024-09-13T23:08:53.659974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:50.966119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:46.445606+0000","last_change":"2024-09-13T23:08:46.445654+0000","last_active":"2024-09-13T23:08:46.445606+0000","last_peered":"2024-09-13T23:08:46.445606+0000","last_clean":"2024-09-13T23:08:46.445606+0000","last_became_active":"2024-09-13T23:05:18.132060+0000","last_became_peered":"2024-09-13T23:05:18.132060+0000","last_unstale":"2024-09-13T23:08:46.445606+0000","last_undegraded":"2024-09-13T23:08:46.445606+0000","last_fullsized":"2024-09-13T23:08:46.445606+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-09-13T23:08:46.445495+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-09-13T23:08:46.445495+0000","last_clean_scrub_stamp":"2024-09-13T23:08:46.445495+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:05:59.233056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:49.128648+0000","last_change":"2024-09-13T23:08:49.128681+0000","last_active":"2024-09-13T23:08:49.128648+0000","last_peered":"2024-09-13T23:08:49.128648+0000","last_clean":"2024-09-13T23:08:49.128648+0000","last_became_active":"2024-09-13T23:05:20.140333+0000","last_became_peered":"2024-09-13T23:05:20.140333+0000","last_unstale":"2024-09-13T23:08:49.128648+0000","last_undegraded":"2024-09-13T23:08:49.128648+0000","last_fullsized":"2024-09-13T23:08:49.128648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:49.128546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:49.128546+0000","last_clean_scrub_stamp":"2024-09-13T23:08:49.128546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:23:33.731436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079127+0000","last_change":"2024-09-13T23:05:22.140239+0000","last_active":"2024-09-13T23:07:42.079127+0000","last_peered":"2024-09-13T23:07:42.079127+0000","last_clean":"2024-09-13T23:07:42.079127+0000","last_became_active":"2024-09-13T23:05:22.139984+0000","last_became_peered":"2024-09-13T23:05:22.139984+0000","last_unstale":"2024-09-13T23:07:42.079127+0000","last_undegraded":"2024-09-13T23:07:42.079127+0000","last_fullsized":"2024-09-13T23:07:42.079127+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:53.426271+0000","last_change":"2024-09-13T23:08:53.426301+0000","last_active":"2024-09-13T23:08:53.426271+0000","last_peered":"2024-09-13T23:08:53.426271+0000","last_clean":"2024-09-13T23:08:53.426271+0000","last_became_active":"2024-09-13T23:05:14.124660+0000","last_became_peered":"2024-09-13T23:05:14.124660+0000","last_unstale":"2024-09-13T23:08:53.426271+0000","last_undegraded":"2024-09-13T23:08:53.426271+0000","last_fullsized":"2024-09-13T23:08:53.426271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:08:53.426181+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:08:53.426181+0000","last_clean_scrub_stamp":"2024-09-13T23:08:53.426181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:11.981314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:10.115211+0000","last_change":"2024-09-13T23:09:10.115237+0000","last_active":"2024-09-13T23:09:10.115211+0000","last_peered":"2024-09-13T23:09:10.115211+0000","last_clean":"2024-09-13T23:09:10.115211+0000","last_became_active":"2024-09-13T23:05:12.137136+0000","last_became_peered":"2024-09-13T23:05:12.137136+0000","last_unstale":"2024-09-13T23:09:10.115211+0000","last_undegraded":"2024-09-13T23:09:10.115211+0000","last_fullsized":"2024-09-13T23:09:10.115211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:10.115117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:10.115117+0000","last_clean_scrub_stamp":"2024-09-13T23:09:10.115117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:50.313039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:51.653427+0000","last_change":"2024-09-13T23:08:51.653449+0000","last_active":"2024-09-13T23:08:51.653427+0000","last_peered":"2024-09-13T23:08:51.653427+0000","last_clean":"2024-09-13T23:08:51.653427+0000","last_became_active":"2024-09-13T23:05:16.123607+0000","last_became_peered":"2024-09-13T23:05:16.123607+0000","last_unstale":"2024-09-13T23:08:51.653427+0000","last_undegraded":"2024-09-13T23:08:51.653427+0000","last_fullsized":"2024-09-13T23:08:51.653427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:51.653336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:51.653336+0000","last_clean_scrub_stamp":"2024-09-13T23:08:51.653336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:03:16.566313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'39","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:40.011713+0000","last_change":"2024-09-13T23:08:40.011754+0000","last_active":"2024-09-13T23:08:40.011713+0000","last_peered":"2024-09-13T23:08:40.011713+0000","last_clean":"2024-09-13T23:08:40.011713+0000","last_became_active":"2024-09-13T23:05:18.136279+0000","last_became_peered":"2024-09-13T23:05:18.136279+0000","last_unstale":"2024-09-13T23:08:40.011713+0000","last_undegraded":"2024-09-13T23:08:40.011713+0000","last_fullsized":"2024-09-13T23:08:40.011713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-13T23:08:40.011606+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-13T23:08:40.011606+0000","last_clean_scrub_stamp":"2024-09-13T23:08:40.011606+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:05.066896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:46.122268+0000","last_change":"2024-09-13T23:08:46.122297+0000","last_active":"2024-09-13T23:08:46.122268+0000","last_peered":"2024-09-13T23:08:46.122268+0000","last_clean":"2024-09-13T23:08:46.122268+0000","last_became_active":"2024-09-13T23:05:20.141266+0000","last_became_peered":"2024-09-13T23:05:20.141266+0000","last_unstale":"2024-09-13T23:08:46.122268+0000","last_undegraded":"2024-09-13T23:08:46.122268+0000","last_fullsized":"2024-09-13T23:08:46.122268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:46.122177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:46.122177+0000","last_clean_scrub_stamp":"2024-09-13T23:08:46.122177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:29.240444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'9","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079113+0000","last_change":"2024-09-13T23:05:22.151767+0000","last_active":"2024-09-13T23:07:42.079113+0000","last_peered":"2024-09-13T23:07:42.079113+0000","last_clean":"2024-09-13T23:07:42.079113+0000","last_became_active":"2024-09-13T23:05:22.151339+0000","last_became_peered":"2024-09-13T23:05:22.151339+0000","last_unstale":"2024-09-13T23:07:42.079113+0000","last_undegraded":"2024-09-13T23:07:42.079113+0000","last_fullsized":"2024-09-13T23:07:42.079113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'8","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:10.305675+0000","last_change":"2024-09-13T23:09:10.305706+0000","last_active":"2024-09-13T23:09:10.305675+0000","last_peered":"2024-09-13T23:09:10.305675+0000","last_clean":"2024-09-13T23:09:10.305675+0000","last_became_active":"2024-09-13T23:05:14.112175+0000","last_became_peered":"2024-09-13T23:05:14.112175+0000","last_unstale":"2024-09-13T23:09:10.305675+0000","last_undegraded":"2024-09-13T23:09:10.305675+0000","last_fullsized":"2024-09-13T23:09:10.305675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:09:10.305573+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:09:10.305573+0000","last_clean_scrub_stamp":"2024-09-13T23:09:10.305573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:24:52.419767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079166+0000","last_change":"2024-09-13T23:05:12.141910+0000","last_active":"2024-09-13T23:07:42.079166+0000","last_peered":"2024-09-13T23:07:42.079166+0000","last_clean":"2024-09-13T23:07:42.079166+0000","last_became_active":"2024-09-13T23:05:12.141459+0000","last_became_peered":"2024-09-13T23:05:12.141459+0000","last_unstale":"2024-09-13T23:07:42.079166+0000","last_undegraded":"2024-09-13T23:07:42.079166+0000","last_fullsized":"2024-09-13T23:07:42.079166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"34'5","reported_seq":238,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:46.150879+0000","last_change":"2024-09-13T23:08:46.150906+0000","last_active":"2024-09-13T23:08:46.150879+0000","last_peered":"2024-09-13T23:08:46.150879+0000","last_clean":"2024-09-13T23:08:46.150879+0000","last_became_active":"2024-09-13T23:05:16.117736+0000","last_became_peered":"2024-09-13T23:05:16.117736+0000","last_unstale":"2024-09-13T23:08:46.150879+0000","last_undegraded":"2024-09-13T23:08:46.150879+0000","last_fullsized":"2024-09-13T23:08:46.150879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T23:08:46.150798+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T23:08:46.150798+0000","last_clean_scrub_stamp":"2024-09-13T23:08:46.150798+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:35.594124+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'16","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:48.450286+0000","last_change":"2024-09-13T23:08:48.450353+0000","last_active":"2024-09-13T23:08:48.450286+0000","last_peered":"2024-09-13T23:08:48.450286+0000","last_clean":"2024-09-13T23:08:48.450286+0000","last_became_active":"2024-09-13T23:05:18.132507+0000","last_became_peered":"2024-09-13T23:05:18.132507+0000","last_unstale":"2024-09-13T23:08:48.450286+0000","last_undegraded":"2024-09-13T23:08:48.450286+0000","last_fullsized":"2024-09-13T23:08:48.450286+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:08:48.450186+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:08:48.450186+0000","last_clean_scrub_stamp":"2024-09-13T23:08:48.450186+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:23.338330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":429,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:42.605579+0000","last_change":"2024-09-13T23:08:42.605617+0000","last_active":"2024-09-13T23:08:42.605579+0000","last_peered":"2024-09-13T23:08:42.605579+0000","last_clean":"2024-09-13T23:08:42.605579+0000","last_became_active":"2024-09-13T23:05:20.144334+0000","last_became_peered":"2024-09-13T23:05:20.144334+0000","last_unstale":"2024-09-13T23:08:42.605579+0000","last_undegraded":"2024-09-13T23:08:42.605579+0000","last_fullsized":"2024-09-13T23:08:42.605579+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:42.605465+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:42.605465+0000","last_clean_scrub_stamp":"2024-09-13T23:08:42.605465+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:53.293281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079015+0000","last_change":"2024-09-13T23:05:22.149167+0000","last_active":"2024-09-13T23:07:42.079015+0000","last_peered":"2024-09-13T23:07:42.079015+0000","last_clean":"2024-09-13T23:07:42.079015+0000","last_became_active":"2024-09-13T23:05:22.148894+0000","last_became_peered":"2024-09-13T23:05:22.148894+0000","last_unstale":"2024-09-13T23:07:42.079015+0000","last_undegraded":"2024-09-13T23:07:42.079015+0000","last_fullsized":"2024-09-13T23:07:42.079015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:56.577914+0000","last_change":"2024-09-13T23:08:56.577947+0000","last_active":"2024-09-13T23:08:56.577914+0000","last_peered":"2024-09-13T23:08:56.577914+0000","last_clean":"2024-09-13T23:08:56.577914+0000","last_became_active":"2024-09-13T23:05:14.111891+0000","last_became_peered":"2024-09-13T23:05:14.111891+0000","last_unstale":"2024-09-13T23:08:56.577914+0000","last_undegraded":"2024-09-13T23:08:56.577914+0000","last_fullsized":"2024-09-13T23:08:56.577914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:08:56.577794+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:08:56.577794+0000","last_clean_scrub_stamp":"2024-09-13T23:08:56.577794+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:52:00.290749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:43.078291+0000","last_change":"2024-09-13T23:05:12.139920+0000","last_active":"2024-09-13T23:07:43.078291+0000","last_peered":"2024-09-13T23:07:43.078291+0000","last_clean":"2024-09-13T23:07:43.078291+0000","last_became_active":"2024-09-13T23:05:12.139564+0000","last_became_peered":"2024-09-13T23:05:12.139564+0000","last_unstale":"2024-09-13T23:07:43.078291+0000","last_undegraded":"2024-09-13T23:07:43.078291+0000","last_fullsized":"2024-09-13T23:07:43.078291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:44.189431+0000","last_change":"2024-09-13T23:08:44.189458+0000","last_active":"2024-09-13T23:08:44.189431+0000","last_peered":"2024-09-13T23:08:44.189431+0000","last_clean":"2024-09-13T23:08:44.189431+0000","last_became_active":"2024-09-13T23:05:16.118353+0000","last_became_peered":"2024-09-13T23:05:16.118353+0000","last_unstale":"2024-09-13T23:08:44.189431+0000","last_undegraded":"2024-09-13T23:08:44.189431+0000","last_fullsized":"2024-09-13T23:08:44.189431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:44.189340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:44.189340+0000","last_clean_scrub_stamp":"2024-09-13T23:08:44.189340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:31.794198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:35.089857+0000","last_change":"2024-09-13T23:08:35.089897+0000","last_active":"2024-09-13T23:08:35.089857+0000","last_peered":"2024-09-13T23:08:35.089857+0000","last_clean":"2024-09-13T23:08:35.089857+0000","last_became_active":"2024-09-13T23:05:18.127975+0000","last_became_peered":"2024-09-13T23:05:18.127975+0000","last_unstale":"2024-09-13T23:08:35.089857+0000","last_undegraded":"2024-09-13T23:08:35.089857+0000","last_fullsized":"2024-09-13T23:08:35.089857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-09-13T23:08:35.089767+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-09-13T23:08:35.089767+0000","last_clean_scrub_stamp":"2024-09-13T23:08:35.089767+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:53:49.326025+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:34.005517+0000","last_change":"2024-09-13T23:08:34.005539+0000","last_active":"2024-09-13T23:08:34.005517+0000","last_peered":"2024-09-13T23:08:34.005517+0000","last_clean":"2024-09-13T23:08:34.005517+0000","last_became_active":"2024-09-13T23:05:20.139329+0000","last_became_peered":"2024-09-13T23:05:20.139329+0000","last_unstale":"2024-09-13T23:08:34.005517+0000","last_undegraded":"2024-09-13T23:08:34.005517+0000","last_fullsized":"2024-09-13T23:08:34.005517+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:34.005418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:34.005418+0000","last_clean_scrub_stamp":"2024-09-13T23:08:34.005418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:17:06.755531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:48.079075+0000","last_change":"2024-09-13T23:05:22.148249+0000","last_active":"2024-09-13T23:07:48.079075+0000","last_peered":"2024-09-13T23:07:48.079075+0000","last_clean":"2024-09-13T23:07:48.079075+0000","last_became_active":"2024-09-13T23:05:22.147949+0000","last_became_peered":"2024-09-13T23:05:22.147949+0000","last_unstale":"2024-09-13T23:07:48.079075+0000","last_undegraded":"2024-09-13T23:07:48.079075+0000","last_fullsized":"2024-09-13T23:07:48.079075+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:04.647264+0000","last_change":"2024-09-13T23:09:04.647321+0000","last_active":"2024-09-13T23:09:04.647264+0000","last_peered":"2024-09-13T23:09:04.647264+0000","last_clean":"2024-09-13T23:09:04.647264+0000","last_became_active":"2024-09-13T23:05:14.113816+0000","last_became_peered":"2024-09-13T23:05:14.113816+0000","last_unstale":"2024-09-13T23:09:04.647264+0000","last_undegraded":"2024-09-13T23:09:04.647264+0000","last_fullsized":"2024-09-13T23:09:04.647264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:04.647142+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:04.647142+0000","last_clean_scrub_stamp":"2024-09-13T23:09:04.647142+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:23:47.909278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079231+0000","last_change":"2024-09-13T23:05:12.149692+0000","last_active":"2024-09-13T23:07:42.079231+0000","last_peered":"2024-09-13T23:07:42.079231+0000","last_clean":"2024-09-13T23:07:42.079231+0000","last_became_active":"2024-09-13T23:05:12.149292+0000","last_became_peered":"2024-09-13T23:05:12.149292+0000","last_unstale":"2024-09-13T23:07:42.079231+0000","last_undegraded":"2024-09-13T23:07:42.079231+0000","last_fullsized":"2024-09-13T23:07:42.079231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:47.679656+0000","last_change":"2024-09-13T23:08:47.679695+0000","last_active":"2024-09-13T23:08:47.679656+0000","last_peered":"2024-09-13T23:08:47.679656+0000","last_clean":"2024-09-13T23:08:47.679656+0000","last_became_active":"2024-09-13T23:05:16.128023+0000","last_became_peered":"2024-09-13T23:05:16.128023+0000","last_unstale":"2024-09-13T23:08:47.679656+0000","last_undegraded":"2024-09-13T23:08:47.679656+0000","last_fullsized":"2024-09-13T23:08:47.679656+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:47.679555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:47.679555+0000","last_clean_scrub_stamp":"2024-09-13T23:08:47.679555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:54.252885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:40.988262+0000","last_change":"2024-09-13T23:08:40.988296+0000","last_active":"2024-09-13T23:08:40.988262+0000","last_peered":"2024-09-13T23:08:40.988262+0000","last_clean":"2024-09-13T23:08:40.988262+0000","last_became_active":"2024-09-13T23:05:18.132579+0000","last_became_peered":"2024-09-13T23:05:18.132579+0000","last_unstale":"2024-09-13T23:08:40.988262+0000","last_undegraded":"2024-09-13T23:08:40.988262+0000","last_fullsized":"2024-09-13T23:08:40.988262+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-13T23:08:40.988170+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-13T23:08:40.988170+0000","last_clean_scrub_stamp":"2024-09-13T23:08:40.988170+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:13:33.042844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:55.408559+0000","last_change":"2024-09-13T23:08:55.408584+0000","last_active":"2024-09-13T23:08:55.408559+0000","last_peered":"2024-09-13T23:08:55.408559+0000","last_clean":"2024-09-13T23:08:55.408559+0000","last_became_active":"2024-09-13T23:05:20.136023+0000","last_became_peered":"2024-09-13T23:05:20.136023+0000","last_unstale":"2024-09-13T23:08:55.408559+0000","last_undegraded":"2024-09-13T23:08:55.408559+0000","last_fullsized":"2024-09-13T23:08:55.408559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:55.408445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:55.408445+0000","last_clean_scrub_stamp":"2024-09-13T23:08:55.408445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:23:49.047903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:47.080030+0000","last_change":"2024-09-13T23:05:22.149740+0000","last_active":"2024-09-13T23:07:47.080030+0000","last_peered":"2024-09-13T23:07:47.080030+0000","last_clean":"2024-09-13T23:07:47.080030+0000","last_became_active":"2024-09-13T23:05:22.149468+0000","last_became_peered":"2024-09-13T23:05:22.149468+0000","last_unstale":"2024-09-13T23:07:47.080030+0000","last_undegraded":"2024-09-13T23:07:47.080030+0000","last_fullsized":"2024-09-13T23:07:47.080030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.469396+0000","last_change":"2024-09-13T23:05:14.109581+0000","last_active":"2024-09-13T23:08:22.469396+0000","last_peered":"2024-09-13T23:08:22.469396+0000","last_clean":"2024-09-13T23:08:22.469396+0000","last_became_active":"2024-09-13T23:05:14.109323+0000","last_became_peered":"2024-09-13T23:05:14.109323+0000","last_unstale":"2024-09-13T23:08:22.469396+0000","last_undegraded":"2024-09-13T23:08:22.469396+0000","last_fullsized":"2024-09-13T23:08:22.469396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:13.313691+0000","last_change":"2024-09-13T23:09:13.313691+0000","last_active":"2024-09-13T23:09:13.313691+0000","last_peered":"2024-09-13T23:09:13.313691+0000","last_clean":"2024-09-13T23:09:13.313691+0000","last_became_active":"2024-09-13T23:05:12.121050+0000","last_became_peered":"2024-09-13T23:05:12.121050+0000","last_unstale":"2024-09-13T23:09:13.313691+0000","last_undegraded":"2024-09-13T23:09:13.313691+0000","last_fullsized":"2024-09-13T23:09:13.313691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:13.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:13.313570+0000","last_clean_scrub_stamp":"2024-09-13T23:09:13.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:21.265185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"34'2","reported_seq":230,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:43.150446+0000","last_change":"2024-09-13T23:08:43.150481+0000","last_active":"2024-09-13T23:08:43.150446+0000","last_peered":"2024-09-13T23:08:43.150446+0000","last_clean":"2024-09-13T23:08:43.150446+0000","last_became_active":"2024-09-13T23:05:16.123673+0000","last_became_peered":"2024-09-13T23:05:16.123673+0000","last_unstale":"2024-09-13T23:08:43.150446+0000","last_undegraded":"2024-09-13T23:08:43.150446+0000","last_fullsized":"2024-09-13T23:08:43.150446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:08:43.150340+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:08:43.150340+0000","last_clean_scrub_stamp":"2024-09-13T23:08:43.150340+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:26.284636+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'31","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:01.289992+0000","last_change":"2024-09-13T23:09:01.290029+0000","last_active":"2024-09-13T23:09:01.289992+0000","last_peered":"2024-09-13T23:09:01.289992+0000","last_clean":"2024-09-13T23:09:01.289992+0000","last_became_active":"2024-09-13T23:05:18.134152+0000","last_became_peered":"2024-09-13T23:05:18.134152+0000","last_unstale":"2024-09-13T23:09:01.289992+0000","last_undegraded":"2024-09-13T23:09:01.289992+0000","last_fullsized":"2024-09-13T23:09:01.289992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'31","last_scrub_stamp":"2024-09-13T23:09:01.289900+0000","last_deep_scrub":"34'31","last_deep_scrub_stamp":"2024-09-13T23:09:01.289900+0000","last_clean_scrub_stamp":"2024-09-13T23:09:01.289900+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:26.269605+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:56.399566+0000","last_change":"2024-09-13T23:08:56.399590+0000","last_active":"2024-09-13T23:08:56.399566+0000","last_peered":"2024-09-13T23:08:56.399566+0000","last_clean":"2024-09-13T23:08:56.399566+0000","last_became_active":"2024-09-13T23:05:20.139133+0000","last_became_peered":"2024-09-13T23:05:20.139133+0000","last_unstale":"2024-09-13T23:08:56.399566+0000","last_undegraded":"2024-09-13T23:08:56.399566+0000","last_fullsized":"2024-09-13T23:08:56.399566+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:56.399466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:56.399466+0000","last_clean_scrub_stamp":"2024-09-13T23:08:56.399466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:07.409062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'12","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:47.079969+0000","last_change":"2024-09-13T23:05:22.144173+0000","last_active":"2024-09-13T23:07:47.079969+0000","last_peered":"2024-09-13T23:07:47.079969+0000","last_clean":"2024-09-13T23:07:47.079969+0000","last_became_active":"2024-09-13T23:05:22.143886+0000","last_became_peered":"2024-09-13T23:05:22.143886+0000","last_unstale":"2024-09-13T23:07:47.079969+0000","last_undegraded":"2024-09-13T23:07:47.079969+0000","last_fullsized":"2024-09-13T23:07:47.079969+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":59,"num_write":33,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:57.527931+0000","last_change":"2024-09-13T23:08:57.527982+0000","last_active":"2024-09-13T23:08:57.527931+0000","last_peered":"2024-09-13T23:08:57.527931+0000","last_clean":"2024-09-13T23:08:57.527931+0000","last_became_active":"2024-09-13T23:05:14.111836+0000","last_became_peered":"2024-09-13T23:05:14.111836+0000","last_unstale":"2024-09-13T23:08:57.527931+0000","last_undegraded":"2024-09-13T23:08:57.527931+0000","last_fullsized":"2024-09-13T23:08:57.527931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:08:57.527825+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:08:57.527825+0000","last_clean_scrub_stamp":"2024-09-13T23:08:57.527825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:46.405099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:18.074392+0000","last_change":"2024-09-13T23:05:12.135245+0000","last_active":"2024-09-13T23:07:18.074392+0000","last_peered":"2024-09-13T23:07:18.074392+0000","last_clean":"2024-09-13T23:07:18.074392+0000","last_became_active":"2024-09-13T23:05:12.134820+0000","last_became_peered":"2024-09-13T23:05:12.134820+0000","last_unstale":"2024-09-13T23:07:18.074392+0000","last_undegraded":"2024-09-13T23:07:18.074392+0000","last_fullsized":"2024-09-13T23:07:18.074392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:42.120392+0000","last_change":"2024-09-13T23:08:42.120463+0000","last_active":"2024-09-13T23:08:42.120392+0000","last_peered":"2024-09-13T23:08:42.120392+0000","last_clean":"2024-09-13T23:08:42.120392+0000","last_became_active":"2024-09-13T23:05:16.124295+0000","last_became_peered":"2024-09-13T23:05:16.124295+0000","last_unstale":"2024-09-13T23:08:42.120392+0000","last_undegraded":"2024-09-13T23:08:42.120392+0000","last_fullsized":"2024-09-13T23:08:42.120392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T23:08:42.120283+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T23:08:42.120283+0000","last_clean_scrub_stamp":"2024-09-13T23:08:42.120283+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:16.924419+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'39","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:38.609156+0000","last_change":"2024-09-13T23:08:38.609215+0000","last_active":"2024-09-13T23:08:38.609156+0000","last_peered":"2024-09-13T23:08:38.609156+0000","last_clean":"2024-09-13T23:08:38.609156+0000","last_became_active":"2024-09-13T23:05:18.131796+0000","last_became_peered":"2024-09-13T23:05:18.131796+0000","last_unstale":"2024-09-13T23:08:38.609156+0000","last_undegraded":"2024-09-13T23:08:38.609156+0000","last_fullsized":"2024-09-13T23:08:38.609156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-13T23:08:38.609041+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-13T23:08:38.609041+0000","last_clean_scrub_stamp":"2024-09-13T23:08:38.609041+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:03:15.467219+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:58.257173+0000","last_change":"2024-09-13T23:08:58.257200+0000","last_active":"2024-09-13T23:08:58.257173+0000","last_peered":"2024-09-13T23:08:58.257173+0000","last_clean":"2024-09-13T23:08:58.257173+0000","last_became_active":"2024-09-13T23:05:20.145356+0000","last_became_peered":"2024-09-13T23:05:20.145356+0000","last_unstale":"2024-09-13T23:08:58.257173+0000","last_undegraded":"2024-09-13T23:08:58.257173+0000","last_fullsized":"2024-09-13T23:08:58.257173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:58.257079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:58.257079+0000","last_clean_scrub_stamp":"2024-09-13T23:08:58.257079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:22:13.566018+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079192+0000","last_change":"2024-09-13T23:05:22.147988+0000","last_active":"2024-09-13T23:07:42.079192+0000","last_peered":"2024-09-13T23:07:42.079192+0000","last_clean":"2024-09-13T23:07:42.079192+0000","last_became_active":"2024-09-13T23:05:22.147707+0000","last_became_peered":"2024-09-13T23:05:22.147707+0000","last_unstale":"2024-09-13T23:07:42.079192+0000","last_undegraded":"2024-09-13T23:07:42.079192+0000","last_fullsized":"2024-09-13T23:07:42.079192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'16","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.257267+0000","last_change":"2024-09-13T23:05:14.123908+0000","last_active":"2024-09-13T23:08:22.257267+0000","last_peered":"2024-09-13T23:08:22.257267+0000","last_clean":"2024-09-13T23:08:22.257267+0000","last_became_active":"2024-09-13T23:05:14.123513+0000","last_became_peered":"2024-09-13T23:05:14.123513+0000","last_unstale":"2024-09-13T23:08:22.257267+0000","last_undegraded":"2024-09-13T23:08:22.257267+0000","last_fullsized":"2024-09-13T23:08:22.257267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:07.690171+0000","last_change":"2024-09-13T23:09:07.690221+0000","last_active":"2024-09-13T23:09:07.690171+0000","last_peered":"2024-09-13T23:09:07.690171+0000","last_clean":"2024-09-13T23:09:07.690171+0000","last_became_active":"2024-09-13T23:05:12.125740+0000","last_became_peered":"2024-09-13T23:05:12.125740+0000","last_unstale":"2024-09-13T23:09:07.690171+0000","last_undegraded":"2024-09-13T23:09:07.690171+0000","last_fullsized":"2024-09-13T23:09:07.690171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:07.690053+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:07.690053+0000","last_clean_scrub_stamp":"2024-09-13T23:09:07.690053+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:34.895020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:04.232624+0000","last_change":"2024-09-13T23:09:04.232707+0000","last_active":"2024-09-13T23:09:04.232624+0000","last_peered":"2024-09-13T23:09:04.232624+0000","last_clean":"2024-09-13T23:09:04.232624+0000","last_became_active":"2024-09-13T23:05:14.109959+0000","last_became_peered":"2024-09-13T23:05:14.109959+0000","last_unstale":"2024-09-13T23:09:04.232624+0000","last_undegraded":"2024-09-13T23:09:04.232624+0000","last_fullsized":"2024-09-13T23:09:04.232624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:04.232517+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:04.232517+0000","last_clean_scrub_stamp":"2024-09-13T23:09:04.232517+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:08.232026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.183000+0000","last_change":"2024-09-13T23:05:12.114302+0000","last_active":"2024-09-13T23:08:29.183000+0000","last_peered":"2024-09-13T23:08:29.183000+0000","last_clean":"2024-09-13T23:08:29.183000+0000","last_became_active":"2024-09-13T23:05:12.113972+0000","last_became_peered":"2024-09-13T23:05:12.113972+0000","last_unstale":"2024-09-13T23:08:29.183000+0000","last_undegraded":"2024-09-13T23:08:29.183000+0000","last_fullsized":"2024-09-13T23:08:29.183000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'10","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.371798+0000","last_change":"2024-09-13T23:05:49.165777+0000","last_active":"2024-09-13T23:08:22.371798+0000","last_peered":"2024-09-13T23:08:22.371798+0000","last_clean":"2024-09-13T23:08:22.371798+0000","last_became_active":"2024-09-13T23:05:49.159488+0000","last_became_peered":"2024-09-13T23:05:49.159488+0000","last_unstale":"2024-09-13T23:08:22.371798+0000","last_undegraded":"2024-09-13T23:08:22.371798+0000","last_fullsized":"2024-09-13T23:08:22.371798+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:21.969033+0000","last_change":"2024-09-13T23:05:12.140088+0000","last_active":"2024-09-13T23:08:21.969033+0000","last_peered":"2024-09-13T23:08:21.969033+0000","last_clean":"2024-09-13T23:08:21.969033+0000","last_became_active":"2024-09-13T23:05:12.139673+0000","last_became_peered":"2024-09-13T23:05:12.139673+0000","last_unstale":"2024-09-13T23:08:21.969033+0000","last_undegraded":"2024-09-13T23:08:21.969033+0000","last_fullsized":"2024-09-13T23:08:21.969033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'10","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:08.208040+0000","last_change":"2024-09-13T23:09:08.208070+0000","last_active":"2024-09-13T23:09:08.208040+0000","last_peered":"2024-09-13T23:09:08.208040+0000","last_clean":"2024-09-13T23:09:08.208040+0000","last_became_active":"2024-09-13T23:05:14.112168+0000","last_became_peered":"2024-09-13T23:05:14.112168+0000","last_unstale":"2024-09-13T23:09:08.208040+0000","last_undegraded":"2024-09-13T23:09:08.208040+0000","last_fullsized":"2024-09-13T23:09:08.208040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T23:09:08.207945+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T23:09:08.207945+0000","last_clean_scrub_stamp":"2024-09-13T23:09:08.207945+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:40.610882+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:19.071445+0000","last_change":"2024-09-13T23:05:12.118979+0000","last_active":"2024-09-13T23:07:19.071445+0000","last_peered":"2024-09-13T23:07:19.071445+0000","last_clean":"2024-09-13T23:07:19.071445+0000","last_became_active":"2024-09-13T23:05:12.118425+0000","last_became_peered":"2024-09-13T23:05:12.118425+0000","last_unstale":"2024-09-13T23:07:19.071445+0000","last_undegraded":"2024-09-13T23:07:19.071445+0000","last_fullsized":"2024-09-13T23:07:19.071445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'14","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:22.369255+0000","last_change":"2024-09-13T23:05:14.120992+0000","last_active":"2024-09-13T23:08:22.369255+0000","last_peered":"2024-09-13T23:08:22.369255+0000","last_clean":"2024-09-13T23:08:22.369255+0000","last_became_active":"2024-09-13T23:05:14.120456+0000","last_became_peered":"2024-09-13T23:05:14.120456+0000","last_unstale":"2024-09-13T23:08:22.369255+0000","last_undegraded":"2024-09-13T23:08:22.369255+0000","last_fullsized":"2024-09-13T23:08:22.369255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:24.072264+0000","last_change":"2024-09-13T23:05:12.114509+0000","last_active":"2024-09-13T23:07:24.072264+0000","last_peered":"2024-09-13T23:07:24.072264+0000","last_clean":"2024-09-13T23:07:24.072264+0000","last_became_active":"2024-09-13T23:05:12.114046+0000","last_became_peered":"2024-09-13T23:05:12.114046+0000","last_unstale":"2024-09-13T23:07:24.072264+0000","last_undegraded":"2024-09-13T23:07:24.072264+0000","last_fullsized":"2024-09-13T23:07:24.072264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:23.075186+0000","last_change":"2024-09-13T23:05:14.124864+0000","last_active":"2024-09-13T23:07:23.075186+0000","last_peered":"2024-09-13T23:07:23.075186+0000","last_clean":"2024-09-13T23:07:23.075186+0000","last_became_active":"2024-09-13T23:05:14.123783+0000","last_became_peered":"2024-09-13T23:05:14.123783+0000","last_unstale":"2024-09-13T23:07:23.075186+0000","last_undegraded":"2024-09-13T23:07:23.075186+0000","last_fullsized":"2024-09-13T23:07:23.075186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:23.075264+0000","last_change":"2024-09-13T23:05:12.140004+0000","last_active":"2024-09-13T23:07:23.075264+0000","last_peered":"2024-09-13T23:07:23.075264+0000","last_clean":"2024-09-13T23:07:23.075264+0000","last_became_active":"2024-09-13T23:05:12.137465+0000","last_became_peered":"2024-09-13T23:05:12.137465+0000","last_unstale":"2024-09-13T23:07:23.075264+0000","last_undegraded":"2024-09-13T23:07:23.075264+0000","last_fullsized":"2024-09-13T23:07:23.075264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:03.259710+0000","last_change":"2024-09-13T23:09:03.259762+0000","last_active":"2024-09-13T23:09:03.259710+0000","last_peered":"2024-09-13T23:09:03.259710+0000","last_clean":"2024-09-13T23:09:03.259710+0000","last_became_active":"2024-09-13T23:05:14.121425+0000","last_became_peered":"2024-09-13T23:05:14.121425+0000","last_unstale":"2024-09-13T23:09:03.259710+0000","last_undegraded":"2024-09-13T23:09:03.259710+0000","last_fullsized":"2024-09-13T23:09:03.259710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:03.259607+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:03.259607+0000","last_clean_scrub_stamp":"2024-09-13T23:09:03.259607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:17.228503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:26.075512+0000","last_change":"2024-09-13T23:05:12.116219+0000","last_active":"2024-09-13T23:07:26.075512+0000","last_peered":"2024-09-13T23:07:26.075512+0000","last_clean":"2024-09-13T23:07:26.075512+0000","last_became_active":"2024-09-13T23:05:12.115546+0000","last_became_peered":"2024-09-13T23:05:12.115546+0000","last_unstale":"2024-09-13T23:07:26.075512+0000","last_undegraded":"2024-09-13T23:07:26.075512+0000","last_fullsized":"2024-09-13T23:07:26.075512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'6","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:11.116733+0000","last_change":"2024-09-13T23:09:11.116761+0000","last_active":"2024-09-13T23:09:11.116733+0000","last_peered":"2024-09-13T23:09:11.116733+0000","last_clean":"2024-09-13T23:09:11.116733+0000","last_became_active":"2024-09-13T23:05:14.122944+0000","last_became_peered":"2024-09-13T23:05:14.122944+0000","last_unstale":"2024-09-13T23:09:11.116733+0000","last_undegraded":"2024-09-13T23:09:11.116733+0000","last_fullsized":"2024-09-13T23:09:11.116733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:11.116646+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:11.116646+0000","last_clean_scrub_stamp":"2024-09-13T23:09:11.116646+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:13.491798+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.183001+0000","last_change":"2024-09-13T23:05:12.119016+0000","last_active":"2024-09-13T23:08:29.183001+0000","last_peered":"2024-09-13T23:08:29.183001+0000","last_clean":"2024-09-13T23:08:29.183001+0000","last_became_active":"2024-09-13T23:05:12.118347+0000","last_became_peered":"2024-09-13T23:05:12.118347+0000","last_unstale":"2024-09-13T23:08:29.183001+0000","last_undegraded":"2024-09-13T23:08:29.183001+0000","last_fullsized":"2024-09-13T23:08:29.183001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:52.144661+0000","last_change":"2024-09-13T23:08:52.144724+0000","last_active":"2024-09-13T23:08:52.144661+0000","last_peered":"2024-09-13T23:08:52.144661+0000","last_clean":"2024-09-13T23:08:52.144661+0000","last_became_active":"2024-09-13T23:05:14.124593+0000","last_became_peered":"2024-09-13T23:05:14.124593+0000","last_unstale":"2024-09-13T23:08:52.144661+0000","last_undegraded":"2024-09-13T23:08:52.144661+0000","last_fullsized":"2024-09-13T23:08:52.144661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:08:52.144556+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:08:52.144556+0000","last_clean_scrub_stamp":"2024-09-13T23:08:52.144556+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:42.175168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.183209+0000","last_change":"2024-09-13T23:05:12.144032+0000","last_active":"2024-09-13T23:08:29.183209+0000","last_peered":"2024-09-13T23:08:29.183209+0000","last_clean":"2024-09-13T23:08:29.183209+0000","last_became_active":"2024-09-13T23:05:12.141628+0000","last_became_peered":"2024-09-13T23:05:12.141628+0000","last_unstale":"2024-09-13T23:08:29.183209+0000","last_undegraded":"2024-09-13T23:08:29.183209+0000","last_fullsized":"2024-09-13T23:08:29.183209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:07.305283+0000","last_change":"2024-09-13T23:09:07.305307+0000","last_active":"2024-09-13T23:09:07.305283+0000","last_peered":"2024-09-13T23:09:07.305283+0000","last_clean":"2024-09-13T23:09:07.305283+0000","last_became_active":"2024-09-13T23:05:14.113710+0000","last_became_peered":"2024-09-13T23:05:14.113710+0000","last_unstale":"2024-09-13T23:09:07.305283+0000","last_undegraded":"2024-09-13T23:09:07.305283+0000","last_fullsized":"2024-09-13T23:09:07.305283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:07.305196+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:07.305196+0000","last_clean_scrub_stamp":"2024-09-13T23:09:07.305196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:09.207268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:29.073149+0000","last_change":"2024-09-13T23:05:12.119408+0000","last_active":"2024-09-13T23:07:29.073149+0000","last_peered":"2024-09-13T23:07:29.073149+0000","last_clean":"2024-09-13T23:07:29.073149+0000","last_became_active":"2024-09-13T23:05:12.118716+0000","last_became_peered":"2024-09-13T23:05:12.118716+0000","last_unstale":"2024-09-13T23:07:29.073149+0000","last_undegraded":"2024-09-13T23:07:29.073149+0000","last_fullsized":"2024-09-13T23:07:29.073149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:29.073259+0000","last_change":"2024-09-13T23:05:14.120905+0000","last_active":"2024-09-13T23:07:29.073259+0000","last_peered":"2024-09-13T23:07:29.073259+0000","last_clean":"2024-09-13T23:07:29.073259+0000","last_became_active":"2024-09-13T23:05:14.120489+0000","last_became_peered":"2024-09-13T23:05:14.120489+0000","last_unstale":"2024-09-13T23:07:29.073259+0000","last_undegraded":"2024-09-13T23:07:29.073259+0000","last_fullsized":"2024-09-13T23:07:29.073259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:13.092965+0000","last_clean_scrub_stamp":"2024-09-13T23:05:13.092965+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:08.181541+0000","last_change":"2024-09-13T23:09:08.181573+0000","last_active":"2024-09-13T23:09:08.181541+0000","last_peered":"2024-09-13T23:09:08.181541+0000","last_clean":"2024-09-13T23:09:08.181541+0000","last_became_active":"2024-09-13T23:05:12.137735+0000","last_became_peered":"2024-09-13T23:05:12.137735+0000","last_unstale":"2024-09-13T23:09:08.181541+0000","last_undegraded":"2024-09-13T23:09:08.181541+0000","last_fullsized":"2024-09-13T23:09:08.181541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:08.181438+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:08.181438+0000","last_clean_scrub_stamp":"2024-09-13T23:09:08.181438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:17:01.878876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:03.187889+0000","last_change":"2024-09-13T23:09:03.187963+0000","last_active":"2024-09-13T23:09:03.187889+0000","last_peered":"2024-09-13T23:09:03.187889+0000","last_clean":"2024-09-13T23:09:03.187889+0000","last_became_active":"2024-09-13T23:05:14.121389+0000","last_became_peered":"2024-09-13T23:05:14.121389+0000","last_unstale":"2024-09-13T23:09:03.187889+0000","last_undegraded":"2024-09-13T23:09:03.187889+0000","last_fullsized":"2024-09-13T23:09:03.187889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:03.187749+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:03.187749+0000","last_clean_scrub_stamp":"2024-09-13T23:09:03.187749+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:13.849825+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:28.076038+0000","last_change":"2024-09-13T23:05:12.139774+0000","last_active":"2024-09-13T23:07:28.076038+0000","last_peered":"2024-09-13T23:07:28.076038+0000","last_clean":"2024-09-13T23:07:28.076038+0000","last_became_active":"2024-09-13T23:05:12.137118+0000","last_became_peered":"2024-09-13T23:05:12.137118+0000","last_unstale":"2024-09-13T23:07:28.076038+0000","last_undegraded":"2024-09-13T23:07:28.076038+0000","last_fullsized":"2024-09-13T23:07:28.076038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'4","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:54.159363+0000","last_change":"2024-09-13T23:08:54.159390+0000","last_active":"2024-09-13T23:08:54.159363+0000","last_peered":"2024-09-13T23:08:54.159363+0000","last_clean":"2024-09-13T23:08:54.159363+0000","last_became_active":"2024-09-13T23:05:14.124507+0000","last_became_peered":"2024-09-13T23:05:14.124507+0000","last_unstale":"2024-09-13T23:08:54.159363+0000","last_undegraded":"2024-09-13T23:08:54.159363+0000","last_fullsized":"2024-09-13T23:08:54.159363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:08:54.159267+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:08:54.159267+0000","last_clean_scrub_stamp":"2024-09-13T23:08:54.159267+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:56.506120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:27.076303+0000","last_change":"2024-09-13T23:05:12.138932+0000","last_active":"2024-09-13T23:07:27.076303+0000","last_peered":"2024-09-13T23:07:27.076303+0000","last_clean":"2024-09-13T23:07:27.076303+0000","last_became_active":"2024-09-13T23:05:12.138577+0000","last_became_peered":"2024-09-13T23:05:12.138577+0000","last_unstale":"2024-09-13T23:07:27.076303+0000","last_undegraded":"2024-09-13T23:07:27.076303+0000","last_fullsized":"2024-09-13T23:07:27.076303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:02.166151+0000","last_change":"2024-09-13T23:09:02.166179+0000","last_active":"2024-09-13T23:09:02.166151+0000","last_peered":"2024-09-13T23:09:02.166151+0000","last_clean":"2024-09-13T23:09:02.166151+0000","last_became_active":"2024-09-13T23:05:14.124604+0000","last_became_peered":"2024-09-13T23:05:14.124604+0000","last_unstale":"2024-09-13T23:09:02.166151+0000","last_undegraded":"2024-09-13T23:09:02.166151+0000","last_fullsized":"2024-09-13T23:09:02.166151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:02.166057+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:02.166057+0000","last_clean_scrub_stamp":"2024-09-13T23:09:02.166057+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:42.683656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:27.076337+0000","last_change":"2024-09-13T23:05:12.141608+0000","last_active":"2024-09-13T23:07:27.076337+0000","last_peered":"2024-09-13T23:07:27.076337+0000","last_clean":"2024-09-13T23:07:27.076337+0000","last_became_active":"2024-09-13T23:05:12.140686+0000","last_became_peered":"2024-09-13T23:05:12.140686+0000","last_unstale":"2024-09-13T23:07:27.076337+0000","last_undegraded":"2024-09-13T23:07:27.076337+0000","last_fullsized":"2024-09-13T23:07:27.076337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:50.447099+0000","last_change":"2024-09-13T23:08:50.447124+0000","last_active":"2024-09-13T23:08:50.447099+0000","last_peered":"2024-09-13T23:08:50.447099+0000","last_clean":"2024-09-13T23:08:50.447099+0000","last_became_active":"2024-09-13T23:05:14.125747+0000","last_became_peered":"2024-09-13T23:05:14.125747+0000","last_unstale":"2024-09-13T23:08:50.447099+0000","last_undegraded":"2024-09-13T23:08:50.447099+0000","last_fullsized":"2024-09-13T23:08:50.447099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T23:08:50.447009+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T23:08:50.447009+0000","last_clean_scrub_stamp":"2024-09-13T23:08:50.447009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:55.562708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:36.077046+0000","last_change":"2024-09-13T23:05:12.126550+0000","last_active":"2024-09-13T23:07:36.077046+0000","last_peered":"2024-09-13T23:07:36.077046+0000","last_clean":"2024-09-13T23:07:36.077046+0000","last_became_active":"2024-09-13T23:05:12.126202+0000","last_became_peered":"2024-09-13T23:05:12.126202+0000","last_unstale":"2024-09-13T23:07:36.077046+0000","last_undegraded":"2024-09-13T23:07:36.077046+0000","last_fullsized":"2024-09-13T23:07:36.077046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:55.125436+0000","last_change":"2024-09-13T23:08:55.125462+0000","last_active":"2024-09-13T23:08:55.125436+0000","last_peered":"2024-09-13T23:08:55.125436+0000","last_clean":"2024-09-13T23:08:55.125436+0000","last_became_active":"2024-09-13T23:05:14.125457+0000","last_became_peered":"2024-09-13T23:05:14.125457+0000","last_unstale":"2024-09-13T23:08:55.125436+0000","last_undegraded":"2024-09-13T23:08:55.125436+0000","last_fullsized":"2024-09-13T23:08:55.125436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:08:55.125347+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:08:55.125347+0000","last_clean_scrub_stamp":"2024-09-13T23:08:55.125347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:52:24.032476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:32.077217+0000","last_change":"2024-09-13T23:05:12.150036+0000","last_active":"2024-09-13T23:07:32.077217+0000","last_peered":"2024-09-13T23:07:32.077217+0000","last_clean":"2024-09-13T23:07:32.077217+0000","last_became_active":"2024-09-13T23:05:12.149345+0000","last_became_peered":"2024-09-13T23:05:12.149345+0000","last_unstale":"2024-09-13T23:07:32.077217+0000","last_undegraded":"2024-09-13T23:07:32.077217+0000","last_fullsized":"2024-09-13T23:07:32.077217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:32.076997+0000","last_change":"2024-09-13T23:05:12.142386+0000","last_active":"2024-09-13T23:07:32.076997+0000","last_peered":"2024-09-13T23:07:32.076997+0000","last_clean":"2024-09-13T23:07:32.076997+0000","last_became_active":"2024-09-13T23:05:12.140432+0000","last_became_peered":"2024-09-13T23:05:12.140432+0000","last_unstale":"2024-09-13T23:07:32.076997+0000","last_undegraded":"2024-09-13T23:07:32.076997+0000","last_fullsized":"2024-09-13T23:07:32.076997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:59.214167+0000","last_change":"2024-09-13T23:08:59.214240+0000","last_active":"2024-09-13T23:08:59.214167+0000","last_peered":"2024-09-13T23:08:59.214167+0000","last_clean":"2024-09-13T23:08:59.214167+0000","last_became_active":"2024-09-13T23:05:14.122105+0000","last_became_peered":"2024-09-13T23:05:14.122105+0000","last_unstale":"2024-09-13T23:08:59.214167+0000","last_undegraded":"2024-09-13T23:08:59.214167+0000","last_fullsized":"2024-09-13T23:08:59.214167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:08:59.214060+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:08:59.214060+0000","last_clean_scrub_stamp":"2024-09-13T23:08:59.214060+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:09.073630+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:11.352230+0000","last_change":"2024-09-13T23:09:11.352289+0000","last_active":"2024-09-13T23:09:11.352230+0000","last_peered":"2024-09-13T23:09:11.352230+0000","last_clean":"2024-09-13T23:09:11.352230+0000","last_became_active":"2024-09-13T23:05:12.120703+0000","last_became_peered":"2024-09-13T23:05:12.120703+0000","last_unstale":"2024-09-13T23:09:11.352230+0000","last_undegraded":"2024-09-13T23:09:11.352230+0000","last_fullsized":"2024-09-13T23:09:11.352230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:11.352120+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:11.352120+0000","last_clean_scrub_stamp":"2024-09-13T23:09:11.352120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:42:29.036211+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:07.162774+0000","last_change":"2024-09-13T23:09:07.162805+0000","last_active":"2024-09-13T23:09:07.162774+0000","last_peered":"2024-09-13T23:09:07.162774+0000","last_clean":"2024-09-13T23:09:07.162774+0000","last_became_active":"2024-09-13T23:05:14.121636+0000","last_became_peered":"2024-09-13T23:05:14.121636+0000","last_unstale":"2024-09-13T23:09:07.162774+0000","last_undegraded":"2024-09-13T23:09:07.162774+0000","last_fullsized":"2024-09-13T23:09:07.162774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T23:09:07.162687+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T23:09:07.162687+0000","last_clean_scrub_stamp":"2024-09-13T23:09:07.162687+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:33.457982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":269,"ondisk_log_size":269,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1527,"ondisk_log_size":1527,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1600,"num_read_kb":1490,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":12,"seq":51539607608,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":151994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640310,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40492,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331348,"statfs":{"total":96636764160,"available":96595300352,"internally_reserved":0,"allocated":1011712,"data_stored":739728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705719,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40520,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331320,"statfs":{"total":96636764160,"available":96595271680,"internally_reserved":0,"allocated":1040384,"data_stored":741822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705719,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":446464,"data_stored":151868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T23:09:14.488 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.488 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.488 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.488 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.489 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.489 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.489 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.489 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.489 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.489 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.489 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.490 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.490 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.490 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.490 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.490 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.490 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.491 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.491 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-13T23:05:15.100044+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=15, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.491 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.491 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.491 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.491 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.491 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.492 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.492 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.492 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.492 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.492 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.492 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.492 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.493 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.493 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.493 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.493 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.493 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.493 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T23:04:55.054026+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=4, tm_sec=55, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.493 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.494 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.494 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.494 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.494 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.494 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.494 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.494 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.495 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.495 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.495 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-13T23:05:19.114167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.495 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.495 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.495 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.495 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.496 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.496 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.496 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.496 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.496 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.496 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.497 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.497 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.497 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.497 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.497 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.497 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.497 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.498 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.498 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.498 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.498 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.498 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.498 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.498 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.498 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.499 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.499 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.499 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.499 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.499 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.499 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.500 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.500 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.500 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.500 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.500 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.500 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.500 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.501 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.501 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.501 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.501 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.501 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.501 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.501 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.501 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.502 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.502 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.502 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.502 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.502 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.502 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-13T23:05:13.092965+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.502 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.502 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.503 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.503 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.503 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.503 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:14.503 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T23:09:34.504 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T23:09:34.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.619+0000 7f737e47b640 1 Processor -- start 2024-09-13T23:09:34.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.619+0000 7f737e47b640 1 -- start start 2024-09-13T23:09:34.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.620+0000 7f737e47b640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7378094970 0x7f7378133eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:34.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.620+0000 7f737e47b640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7378073e80 con 0x7f7378093a70 2024-09-13T23:09:34.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.620+0000 7f737e47b640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f7378093e50 con 0x7f7378094970 2024-09-13T23:09:34.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.620+0000 7f73777fe640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7378094970 0x7f7378133eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:34.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.620+0000 7f7377fff640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f7378093a70 0x7f7378094260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:40786/0 (socket says 172.21.15.17:40786) 2024-09-13T23:09:34.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.620+0000 7f7377fff640 1 -- 172.21.15.17:0/3137936586 learned_addr learned my addr 172.21.15.17:0/3137936586 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:09:34.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.620+0000 7f73777fe640 1 -- 172.21.15.17:0/3137936586 >> v1:172.21.15.17:6789/0 conn(0x7f7378093a70 legacy=0x7f7378094260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:34.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.620+0000 7f73777fe640 1 -- 172.21.15.17:0/3137936586 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73780966d0 con 0x7f7378094970 2024-09-13T23:09:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.621+0000 7f73777fe640 1 --2- 172.21.15.17:0/3137936586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7378094970 0x7f7378133eb0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f736c009720 tx=0x7f736c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf68d8c69b525a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.621+0000 7f7376ffd640 1 -- 172.21.15.17:0/3137936586 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f736c037070 con 0x7f7378094970 2024-09-13T23:09:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.621+0000 7f7376ffd640 1 -- 172.21.15.17:0/3137936586 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f736c02ad90 con 0x7f7378094970 2024-09-13T23:09:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.621+0000 7f7376ffd640 1 -- 172.21.15.17:0/3137936586 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f736c032590 con 0x7f7378094970 2024-09-13T23:09:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.621+0000 7f737e47b640 1 -- 172.21.15.17:0/3137936586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7378094970 msgr2=0x7f7378133eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.621+0000 7f737e47b640 1 --2- 172.21.15.17:0/3137936586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7378094970 0x7f7378133eb0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f736c009720 tx=0x7f736c02a110 comp rx=0 tx=0).stop 2024-09-13T23:09:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.622+0000 7f737e47b640 1 -- 172.21.15.17:0/3137936586 shutdown_connections 2024-09-13T23:09:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.622+0000 7f737e47b640 1 --2- 172.21.15.17:0/3137936586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7378094970 0x7f7378133eb0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.622+0000 7f737e47b640 1 -- 172.21.15.17:0/3137936586 >> 172.21.15.17:0/3137936586 conn(0x7f737809ccf0 msgr2=0x7f737809d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.622+0000 7f737e47b640 1 -- 172.21.15.17:0/3137936586 shutdown_connections 2024-09-13T23:09:34.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.622+0000 7f737e47b640 1 -- 172.21.15.17:0/3137936586 wait complete. 2024-09-13T23:09:34.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.622+0000 7f737e47b640 1 Processor -- start 2024-09-13T23:09:34.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.623+0000 7f737e47b640 1 -- start start 2024-09-13T23:09:34.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.623+0000 7f737e47b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7378093a70 0x7f73781a7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:34.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.623+0000 7f737e47b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7378094da0 con 0x7f7378093a70 2024-09-13T23:09:34.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.623+0000 7f7377fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7378093a70 0x7f73781a7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:34.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.623+0000 7f7377fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7378093a70 0x7f73781a7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42316/0 (socket says 172.21.15.17:42316) 2024-09-13T23:09:34.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.623+0000 7f7377fff640 1 -- 172.21.15.17:0/3394961084 learned_addr learned my addr 172.21.15.17:0/3394961084 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:09:34.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.624+0000 7f7377fff640 1 -- 172.21.15.17:0/3394961084 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73781ab2c0 con 0x7f7378093a70 2024-09-13T23:09:34.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.624+0000 7f7377fff640 1 --2- 172.21.15.17:0/3394961084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7378093a70 0x7f73781a7ee0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f736800c4a0 tx=0x7f736800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:34.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.624+0000 7f7374ff9640 1 -- 172.21.15.17:0/3394961084 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7368017070 con 0x7f7378093a70 2024-09-13T23:09:34.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.624+0000 7f7374ff9640 1 -- 172.21.15.17:0/3394961084 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7368005c10 con 0x7f7378093a70 2024-09-13T23:09:34.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.624+0000 7f737e47b640 1 -- 172.21.15.17:0/3394961084 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73781a9880 con 0x7f7378093a70 2024-09-13T23:09:34.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.624+0000 7f7374ff9640 1 -- 172.21.15.17:0/3394961084 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7368007070 con 0x7f7378093a70 2024-09-13T23:09:34.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.624+0000 7f737e47b640 1 -- 172.21.15.17:0/3394961084 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73781aabf0 con 0x7f7378093a70 2024-09-13T23:09:34.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.625+0000 7f7374ff9640 1 -- 172.21.15.17:0/3394961084 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f736801a070 con 0x7f7378093a70 2024-09-13T23:09:34.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.625+0000 7f737e47b640 1 -- 172.21.15.17:0/3394961084 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7378094260 con 0x7f7378093a70 2024-09-13T23:09:34.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.625+0000 7f7374ff9640 1 --2- 172.21.15.17:0/3394961084 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f73640382a0 0x7f736403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:34.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.625+0000 7f7374ff9640 1 -- 172.21.15.17:0/3394961084 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f736804aff0 con 0x7f7378093a70 2024-09-13T23:09:34.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.625+0000 7f73777fe640 1 --2- 172.21.15.17:0/3394961084 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f73640382a0 0x7f736403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:34.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.626+0000 7f73777fe640 1 --2- 172.21.15.17:0/3394961084 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f73640382a0 0x7f736403a760 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f736c034000 tx=0x7f736c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:34.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.630+0000 7f7374ff9640 1 -- 172.21.15.17:0/3394961084 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f73781ab2c0 con 0x7f7378093a70 2024-09-13T23:09:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.802+0000 7f737e47b640 1 -- 172.21.15.17:0/3394961084 --> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f73781aa8f0 con 0x7f73640382a0 2024-09-13T23:09:34.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.818+0000 7f7374ff9640 1 -- 172.21.15.17:0/3394961084 <== mgr.4102 v2:172.21.15.164:6824/713838566 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665304 (secure 0 0 0) 0x7f73781aa8f0 con 0x7f73640382a0 2024-09-13T23:09:34.826 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:09:34.832 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-13T23:09:34.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.822+0000 7f737e47b640 1 -- 172.21.15.17:0/3394961084 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f73640382a0 msgr2=0x7f736403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:34.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.822+0000 7f737e47b640 1 --2- 172.21.15.17:0/3394961084 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f73640382a0 0x7f736403a760 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f736c034000 tx=0x7f736c02e000 comp rx=0 tx=0).stop 2024-09-13T23:09:34.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.822+0000 7f737e47b640 1 -- 172.21.15.17:0/3394961084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7378093a70 msgr2=0x7f73781a7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:34.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.822+0000 7f737e47b640 1 --2- 172.21.15.17:0/3394961084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7378093a70 0x7f73781a7ee0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f736800c4a0 tx=0x7f736800c960 comp rx=0 tx=0).stop 2024-09-13T23:09:34.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.822+0000 7f737e47b640 1 -- 172.21.15.17:0/3394961084 shutdown_connections 2024-09-13T23:09:34.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.822+0000 7f737e47b640 1 --2- 172.21.15.17:0/3394961084 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f73640382a0 0x7f736403a760 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:34.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.822+0000 7f737e47b640 1 --2- 172.21.15.17:0/3394961084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7378093a70 0x7f73781a7ee0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:34.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.822+0000 7f737e47b640 1 -- 172.21.15.17:0/3394961084 >> 172.21.15.17:0/3394961084 conn(0x7f737809ccf0 msgr2=0x7f737806d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:34.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.822+0000 7f737e47b640 1 -- 172.21.15.17:0/3394961084 shutdown_connections 2024-09-13T23:09:34.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:34.822+0000 7f737e47b640 1 -- 172.21.15.17:0/3394961084 wait complete. 2024-09-13T23:09:34.841 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":171,"stamp":"2024-09-13T23:09:34.121987+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5088,"num_read_kb":4669,"num_write":2179,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4790,"ondisk_log_size":4790,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152608,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334752,"statfs":{"total":386547056640,"available":386390786048,"internally_reserved":0,"allocated":2981888,"data_stored":1785412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004064"},"pg_stats":[{"pgid":"3.3f","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:05.685819+0000","last_change":"2024-09-13T23:09:05.685819+0000","last_active":"2024-09-13T23:09:05.685819+0000","last_peered":"2024-09-13T23:09:05.685819+0000","last_clean":"2024-09-13T23:09:05.685819+0000","last_became_active":"2024-09-13T23:05:12.130009+0000","last_became_peered":"2024-09-13T23:05:12.130009+0000","last_unstale":"2024-09-13T23:09:05.685819+0000","last_undegraded":"2024-09-13T23:09:05.685819+0000","last_fullsized":"2024-09-13T23:09:05.685819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:05.685705+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:05.685705+0000","last_clean_scrub_stamp":"2024-09-13T23:09:05.685705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:20:30.741148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:00.090836+0000","last_change":"2024-09-13T23:09:00.090903+0000","last_active":"2024-09-13T23:09:00.090836+0000","last_peered":"2024-09-13T23:09:00.090836+0000","last_clean":"2024-09-13T23:09:00.090836+0000","last_became_active":"2024-09-13T23:05:14.125215+0000","last_became_peered":"2024-09-13T23:05:14.125215+0000","last_unstale":"2024-09-13T23:09:00.090836+0000","last_undegraded":"2024-09-13T23:09:00.090836+0000","last_fullsized":"2024-09-13T23:09:00.090836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:00.090719+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:00.090719+0000","last_clean_scrub_stamp":"2024-09-13T23:09:00.090719+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:25.638836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:19.352952+0000","last_change":"2024-09-13T23:09:19.352952+0000","last_active":"2024-09-13T23:09:19.352952+0000","last_peered":"2024-09-13T23:09:19.352952+0000","last_clean":"2024-09-13T23:09:19.352952+0000","last_became_active":"2024-09-13T23:05:12.118411+0000","last_became_peered":"2024-09-13T23:05:12.118411+0000","last_unstale":"2024-09-13T23:09:19.352952+0000","last_undegraded":"2024-09-13T23:09:19.352952+0000","last_fullsized":"2024-09-13T23:09:19.352952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:19.352818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:19.352818+0000","last_clean_scrub_stamp":"2024-09-13T23:09:19.352818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:01:53.423402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'8","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:19.203533+0000","last_change":"2024-09-13T23:09:19.203561+0000","last_active":"2024-09-13T23:09:19.203533+0000","last_peered":"2024-09-13T23:09:19.203533+0000","last_clean":"2024-09-13T23:09:19.203533+0000","last_became_active":"2024-09-13T23:05:14.109464+0000","last_became_peered":"2024-09-13T23:05:14.109464+0000","last_unstale":"2024-09-13T23:09:19.203533+0000","last_undegraded":"2024-09-13T23:09:19.203533+0000","last_fullsized":"2024-09-13T23:09:19.203533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:09:19.203420+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:09:19.203420+0000","last_clean_scrub_stamp":"2024-09-13T23:09:19.203420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:18.962285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:30.409267+0000","last_change":"2024-09-13T23:09:30.409308+0000","last_active":"2024-09-13T23:09:30.409267+0000","last_peered":"2024-09-13T23:09:30.409267+0000","last_clean":"2024-09-13T23:09:30.409267+0000","last_became_active":"2024-09-13T23:05:12.146191+0000","last_became_peered":"2024-09-13T23:05:12.146191+0000","last_unstale":"2024-09-13T23:09:30.409267+0000","last_undegraded":"2024-09-13T23:09:30.409267+0000","last_fullsized":"2024-09-13T23:09:30.409267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:30.409155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:30.409155+0000","last_clean_scrub_stamp":"2024-09-13T23:09:30.409155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:52.527696+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:15.200771+0000","last_change":"2024-09-13T23:09:15.200800+0000","last_active":"2024-09-13T23:09:15.200771+0000","last_peered":"2024-09-13T23:09:15.200771+0000","last_clean":"2024-09-13T23:09:15.200771+0000","last_became_active":"2024-09-13T23:05:14.110201+0000","last_became_peered":"2024-09-13T23:05:14.110201+0000","last_unstale":"2024-09-13T23:09:15.200771+0000","last_undegraded":"2024-09-13T23:09:15.200771+0000","last_fullsized":"2024-09-13T23:09:15.200771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:15.200679+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:15.200679+0000","last_clean_scrub_stamp":"2024-09-13T23:09:15.200679+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:03.593289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:01.547312+0000","last_change":"2024-09-13T23:09:01.547312+0000","last_active":"2024-09-13T23:09:01.547312+0000","last_peered":"2024-09-13T23:09:01.547312+0000","last_clean":"2024-09-13T23:09:01.547312+0000","last_became_active":"2024-09-13T23:05:12.132461+0000","last_became_peered":"2024-09-13T23:05:12.132461+0000","last_unstale":"2024-09-13T23:09:01.547312+0000","last_undegraded":"2024-09-13T23:09:01.547312+0000","last_fullsized":"2024-09-13T23:09:01.547312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:01.547143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:01.547143+0000","last_clean_scrub_stamp":"2024-09-13T23:09:01.547143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:01.270260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:09.323049+0000","last_change":"2024-09-13T23:09:09.323075+0000","last_active":"2024-09-13T23:09:09.323049+0000","last_peered":"2024-09-13T23:09:09.323049+0000","last_clean":"2024-09-13T23:09:09.323049+0000","last_became_active":"2024-09-13T23:05:14.113430+0000","last_became_peered":"2024-09-13T23:05:14.113430+0000","last_unstale":"2024-09-13T23:09:09.323049+0000","last_undegraded":"2024-09-13T23:09:09.323049+0000","last_fullsized":"2024-09-13T23:09:09.323049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:09.322940+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:09.322940+0000","last_clean_scrub_stamp":"2024-09-13T23:09:09.322940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:32.644280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079177+0000","last_change":"2024-09-13T23:05:12.146576+0000","last_active":"2024-09-13T23:07:42.079177+0000","last_peered":"2024-09-13T23:07:42.079177+0000","last_clean":"2024-09-13T23:07:42.079177+0000","last_became_active":"2024-09-13T23:05:12.146220+0000","last_became_peered":"2024-09-13T23:05:12.146220+0000","last_unstale":"2024-09-13T23:07:42.079177+0000","last_undegraded":"2024-09-13T23:07:42.079177+0000","last_fullsized":"2024-09-13T23:07:42.079177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'4","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:09.140867+0000","last_change":"2024-09-13T23:09:09.140867+0000","last_active":"2024-09-13T23:09:09.140867+0000","last_peered":"2024-09-13T23:09:09.140867+0000","last_clean":"2024-09-13T23:09:09.140867+0000","last_became_active":"2024-09-13T23:05:14.122513+0000","last_became_peered":"2024-09-13T23:05:14.122513+0000","last_unstale":"2024-09-13T23:09:09.140867+0000","last_undegraded":"2024-09-13T23:09:09.140867+0000","last_fullsized":"2024-09-13T23:09:09.140867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:09.140751+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:09.140751+0000","last_clean_scrub_stamp":"2024-09-13T23:09:09.140751+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:41.543687+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:13.729839+0000","last_change":"2024-09-13T23:09:13.729869+0000","last_active":"2024-09-13T23:09:13.729839+0000","last_peered":"2024-09-13T23:09:13.729839+0000","last_clean":"2024-09-13T23:09:13.729839+0000","last_became_active":"2024-09-13T23:05:12.113601+0000","last_became_peered":"2024-09-13T23:05:12.113601+0000","last_unstale":"2024-09-13T23:09:13.729839+0000","last_undegraded":"2024-09-13T23:09:13.729839+0000","last_fullsized":"2024-09-13T23:09:13.729839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:13.729730+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:13.729730+0000","last_clean_scrub_stamp":"2024-09-13T23:09:13.729730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:23:12.017749+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:51.435662+0000","last_change":"2024-09-13T23:08:51.435662+0000","last_active":"2024-09-13T23:08:51.435662+0000","last_peered":"2024-09-13T23:08:51.435662+0000","last_clean":"2024-09-13T23:08:51.435662+0000","last_became_active":"2024-09-13T23:05:14.124971+0000","last_became_peered":"2024-09-13T23:05:14.124971+0000","last_unstale":"2024-09-13T23:08:51.435662+0000","last_undegraded":"2024-09-13T23:08:51.435662+0000","last_fullsized":"2024-09-13T23:08:51.435662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:08:51.435544+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:08:51.435544+0000","last_clean_scrub_stamp":"2024-09-13T23:08:51.435544+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:42:37.254383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079100+0000","last_change":"2024-09-13T23:05:12.139628+0000","last_active":"2024-09-13T23:07:42.079100+0000","last_peered":"2024-09-13T23:07:42.079100+0000","last_clean":"2024-09-13T23:07:42.079100+0000","last_became_active":"2024-09-13T23:05:12.138297+0000","last_became_peered":"2024-09-13T23:05:12.138297+0000","last_unstale":"2024-09-13T23:07:42.079100+0000","last_undegraded":"2024-09-13T23:07:42.079100+0000","last_fullsized":"2024-09-13T23:07:42.079100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'16","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:55.622772+0000","last_change":"2024-09-13T23:08:55.622772+0000","last_active":"2024-09-13T23:08:55.622772+0000","last_peered":"2024-09-13T23:08:55.622772+0000","last_clean":"2024-09-13T23:08:55.622772+0000","last_became_active":"2024-09-13T23:05:14.123950+0000","last_became_peered":"2024-09-13T23:05:14.123950+0000","last_unstale":"2024-09-13T23:08:55.622772+0000","last_undegraded":"2024-09-13T23:08:55.622772+0000","last_fullsized":"2024-09-13T23:08:55.622772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:08:55.622652+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:08:55.622652+0000","last_clean_scrub_stamp":"2024-09-13T23:08:55.622652+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:33.082242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":68,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:25.373379+0000","last_change":"2024-09-13T23:09:25.373412+0000","last_active":"2024-09-13T23:09:25.373379+0000","last_peered":"2024-09-13T23:09:25.373379+0000","last_clean":"2024-09-13T23:09:25.373379+0000","last_became_active":"2024-09-13T23:05:12.117028+0000","last_became_peered":"2024-09-13T23:05:12.117028+0000","last_unstale":"2024-09-13T23:09:25.373379+0000","last_undegraded":"2024-09-13T23:09:25.373379+0000","last_fullsized":"2024-09-13T23:09:25.373379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:25.373281+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:25.373281+0000","last_clean_scrub_stamp":"2024-09-13T23:09:25.373281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:50:11.058455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'18","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:08.738777+0000","last_change":"2024-09-13T23:09:08.738777+0000","last_active":"2024-09-13T23:09:08.738777+0000","last_peered":"2024-09-13T23:09:08.738777+0000","last_clean":"2024-09-13T23:09:08.738777+0000","last_became_active":"2024-09-13T23:05:14.114831+0000","last_became_peered":"2024-09-13T23:05:14.114831+0000","last_unstale":"2024-09-13T23:09:08.738777+0000","last_undegraded":"2024-09-13T23:09:08.738777+0000","last_fullsized":"2024-09-13T23:09:08.738777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-13T23:09:08.738611+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-13T23:09:08.738611+0000","last_clean_scrub_stamp":"2024-09-13T23:09:08.738611+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:35.297289+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'16","reported_seq":90,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:17.206970+0000","last_change":"2024-09-13T23:09:17.207009+0000","last_active":"2024-09-13T23:09:17.206970+0000","last_peered":"2024-09-13T23:09:17.206970+0000","last_clean":"2024-09-13T23:09:17.206970+0000","last_became_active":"2024-09-13T23:05:14.109903+0000","last_became_peered":"2024-09-13T23:05:14.109903+0000","last_unstale":"2024-09-13T23:09:17.206970+0000","last_undegraded":"2024-09-13T23:09:17.206970+0000","last_fullsized":"2024-09-13T23:09:17.206970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:09:17.206881+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:09:17.206881+0000","last_clean_scrub_stamp":"2024-09-13T23:09:17.206881+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:16.967231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":66,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:23.120787+0000","last_change":"2024-09-13T23:09:23.120815+0000","last_active":"2024-09-13T23:09:23.120787+0000","last_peered":"2024-09-13T23:09:23.120787+0000","last_clean":"2024-09-13T23:09:23.120787+0000","last_became_active":"2024-09-13T23:05:12.136334+0000","last_became_peered":"2024-09-13T23:05:12.136334+0000","last_unstale":"2024-09-13T23:09:23.120787+0000","last_undegraded":"2024-09-13T23:09:23.120787+0000","last_fullsized":"2024-09-13T23:09:23.120787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:23.120702+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:23.120702+0000","last_clean_scrub_stamp":"2024-09-13T23:09:23.120702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:00:53.217930+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'12","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:56.098271+0000","last_change":"2024-09-13T23:08:56.098300+0000","last_active":"2024-09-13T23:08:56.098271+0000","last_peered":"2024-09-13T23:08:56.098271+0000","last_clean":"2024-09-13T23:08:56.098271+0000","last_became_active":"2024-09-13T23:05:14.124023+0000","last_became_peered":"2024-09-13T23:05:14.124023+0000","last_unstale":"2024-09-13T23:08:56.098271+0000","last_undegraded":"2024-09-13T23:08:56.098271+0000","last_fullsized":"2024-09-13T23:08:56.098271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T23:08:56.098169+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T23:08:56.098169+0000","last_clean_scrub_stamp":"2024-09-13T23:08:56.098169+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:57:17.059952+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:09.755839+0000","last_change":"2024-09-13T23:09:09.755866+0000","last_active":"2024-09-13T23:09:09.755839+0000","last_peered":"2024-09-13T23:09:09.755839+0000","last_clean":"2024-09-13T23:09:09.755839+0000","last_became_active":"2024-09-13T23:05:12.126336+0000","last_became_peered":"2024-09-13T23:05:12.126336+0000","last_unstale":"2024-09-13T23:09:09.755839+0000","last_undegraded":"2024-09-13T23:09:09.755839+0000","last_fullsized":"2024-09-13T23:09:09.755839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:09.755744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:09.755744+0000","last_clean_scrub_stamp":"2024-09-13T23:09:09.755744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:45:37.055339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:59.078407+0000","last_change":"2024-09-13T23:08:59.078435+0000","last_active":"2024-09-13T23:08:59.078407+0000","last_peered":"2024-09-13T23:08:59.078407+0000","last_clean":"2024-09-13T23:08:59.078407+0000","last_became_active":"2024-09-13T23:05:14.125247+0000","last_became_peered":"2024-09-13T23:05:14.125247+0000","last_unstale":"2024-09-13T23:08:59.078407+0000","last_undegraded":"2024-09-13T23:08:59.078407+0000","last_fullsized":"2024-09-13T23:08:59.078407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:08:59.078318+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:08:59.078318+0000","last_clean_scrub_stamp":"2024-09-13T23:08:59.078318+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:22:14.387256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:12.069311+0000","last_change":"2024-09-13T23:09:12.069334+0000","last_active":"2024-09-13T23:09:12.069311+0000","last_peered":"2024-09-13T23:09:12.069311+0000","last_clean":"2024-09-13T23:09:12.069311+0000","last_became_active":"2024-09-13T23:05:12.139103+0000","last_became_peered":"2024-09-13T23:05:12.139103+0000","last_unstale":"2024-09-13T23:09:12.069311+0000","last_undegraded":"2024-09-13T23:09:12.069311+0000","last_fullsized":"2024-09-13T23:09:12.069311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:12.069217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:12.069217+0000","last_clean_scrub_stamp":"2024-09-13T23:09:12.069217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:18.902550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:12.323567+0000","last_change":"2024-09-13T23:09:12.323598+0000","last_active":"2024-09-13T23:09:12.323567+0000","last_peered":"2024-09-13T23:09:12.323567+0000","last_clean":"2024-09-13T23:09:12.323567+0000","last_became_active":"2024-09-13T23:05:14.120397+0000","last_became_peered":"2024-09-13T23:05:14.120397+0000","last_unstale":"2024-09-13T23:09:12.323567+0000","last_undegraded":"2024-09-13T23:09:12.323567+0000","last_fullsized":"2024-09-13T23:09:12.323567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:09:12.323473+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:09:12.323473+0000","last_clean_scrub_stamp":"2024-09-13T23:09:12.323473+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:44.704923+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:25.203432+0000","last_change":"2024-09-13T23:09:25.203458+0000","last_active":"2024-09-13T23:09:25.203432+0000","last_peered":"2024-09-13T23:09:25.203432+0000","last_clean":"2024-09-13T23:09:25.203432+0000","last_became_active":"2024-09-13T23:05:12.139022+0000","last_became_peered":"2024-09-13T23:05:12.139022+0000","last_unstale":"2024-09-13T23:09:25.203432+0000","last_undegraded":"2024-09-13T23:09:25.203432+0000","last_fullsized":"2024-09-13T23:09:25.203432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:25.203342+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:25.203342+0000","last_clean_scrub_stamp":"2024-09-13T23:09:25.203342+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:50:10.888515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:06.687548+0000","last_change":"2024-09-13T23:09:06.687578+0000","last_active":"2024-09-13T23:09:06.687548+0000","last_peered":"2024-09-13T23:09:06.687548+0000","last_clean":"2024-09-13T23:09:06.687548+0000","last_became_active":"2024-09-13T23:05:14.114261+0000","last_became_peered":"2024-09-13T23:05:14.114261+0000","last_unstale":"2024-09-13T23:09:06.687548+0000","last_undegraded":"2024-09-13T23:09:06.687548+0000","last_fullsized":"2024-09-13T23:09:06.687548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T23:09:06.687450+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T23:09:06.687450+0000","last_clean_scrub_stamp":"2024-09-13T23:09:06.687450+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:18:07.608760+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:09.256822+0000","last_change":"2024-09-13T23:09:09.256855+0000","last_active":"2024-09-13T23:09:09.256822+0000","last_peered":"2024-09-13T23:09:09.256822+0000","last_clean":"2024-09-13T23:09:09.256822+0000","last_became_active":"2024-09-13T23:05:12.129589+0000","last_became_peered":"2024-09-13T23:05:12.129589+0000","last_unstale":"2024-09-13T23:09:09.256822+0000","last_undegraded":"2024-09-13T23:09:09.256822+0000","last_fullsized":"2024-09-13T23:09:09.256822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:09.256730+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:09.256730+0000","last_clean_scrub_stamp":"2024-09-13T23:09:09.256730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:49.454652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'6","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:04.139177+0000","last_change":"2024-09-13T23:09:04.139219+0000","last_active":"2024-09-13T23:09:04.139177+0000","last_peered":"2024-09-13T23:09:04.139177+0000","last_clean":"2024-09-13T23:09:04.139177+0000","last_became_active":"2024-09-13T23:05:14.118922+0000","last_became_peered":"2024-09-13T23:05:14.118922+0000","last_unstale":"2024-09-13T23:09:04.139177+0000","last_undegraded":"2024-09-13T23:09:04.139177+0000","last_fullsized":"2024-09-13T23:09:04.139177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:04.139018+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:04.139018+0000","last_clean_scrub_stamp":"2024-09-13T23:09:04.139018+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:18.107915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:32.077071+0000","last_change":"2024-09-13T23:05:12.140097+0000","last_active":"2024-09-13T23:07:32.077071+0000","last_peered":"2024-09-13T23:07:32.077071+0000","last_clean":"2024-09-13T23:07:32.077071+0000","last_became_active":"2024-09-13T23:05:12.139690+0000","last_became_peered":"2024-09-13T23:05:12.139690+0000","last_unstale":"2024-09-13T23:07:32.077071+0000","last_undegraded":"2024-09-13T23:07:32.077071+0000","last_fullsized":"2024-09-13T23:07:32.077071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'38","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:29.140377+0000","last_change":"2024-09-13T23:09:29.140403+0000","last_active":"2024-09-13T23:09:29.140377+0000","last_peered":"2024-09-13T23:09:29.140377+0000","last_clean":"2024-09-13T23:09:29.140377+0000","last_became_active":"2024-09-13T23:05:22.145872+0000","last_became_peered":"2024-09-13T23:05:22.145872+0000","last_unstale":"2024-09-13T23:09:29.140377+0000","last_undegraded":"2024-09-13T23:09:29.140377+0000","last_fullsized":"2024-09-13T23:09:29.140377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-09-13T23:09:29.140290+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-09-13T23:09:29.140290+0000","last_clean_scrub_stamp":"2024-09-13T23:09:29.140290+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:05.101062+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":174,"num_write":103,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:18.206688+0000","last_change":"2024-09-13T23:09:18.206746+0000","last_active":"2024-09-13T23:09:18.206688+0000","last_peered":"2024-09-13T23:09:18.206688+0000","last_clean":"2024-09-13T23:09:18.206688+0000","last_became_active":"2024-09-13T23:05:14.109928+0000","last_became_peered":"2024-09-13T23:05:14.109928+0000","last_unstale":"2024-09-13T23:09:18.206688+0000","last_undegraded":"2024-09-13T23:09:18.206688+0000","last_fullsized":"2024-09-13T23:09:18.206688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:18.206589+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:18.206589+0000","last_clean_scrub_stamp":"2024-09-13T23:09:18.206589+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:14.724013+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:32.077095+0000","last_change":"2024-09-13T23:05:12.147582+0000","last_active":"2024-09-13T23:07:32.077095+0000","last_peered":"2024-09-13T23:07:32.077095+0000","last_clean":"2024-09-13T23:07:32.077095+0000","last_became_active":"2024-09-13T23:05:12.146236+0000","last_became_peered":"2024-09-13T23:05:12.146236+0000","last_unstale":"2024-09-13T23:07:32.077095+0000","last_undegraded":"2024-09-13T23:07:32.077095+0000","last_fullsized":"2024-09-13T23:07:32.077095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:39.624374+0000","last_change":"2024-09-13T23:08:39.624399+0000","last_active":"2024-09-13T23:08:39.624374+0000","last_peered":"2024-09-13T23:08:39.624374+0000","last_clean":"2024-09-13T23:08:39.624374+0000","last_became_active":"2024-09-13T23:05:16.123362+0000","last_became_peered":"2024-09-13T23:05:16.123362+0000","last_unstale":"2024-09-13T23:08:39.624374+0000","last_undegraded":"2024-09-13T23:08:39.624374+0000","last_fullsized":"2024-09-13T23:08:39.624374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:39.624277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:39.624277+0000","last_clean_scrub_stamp":"2024-09-13T23:08:39.624277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:59.071768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'39","reported_seq":94,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:02.251520+0000","last_change":"2024-09-13T23:09:02.251564+0000","last_active":"2024-09-13T23:09:02.251520+0000","last_peered":"2024-09-13T23:09:02.251520+0000","last_clean":"2024-09-13T23:09:02.251520+0000","last_became_active":"2024-09-13T23:05:18.132642+0000","last_became_peered":"2024-09-13T23:05:18.132642+0000","last_unstale":"2024-09-13T23:09:02.251520+0000","last_undegraded":"2024-09-13T23:09:02.251520+0000","last_fullsized":"2024-09-13T23:09:02.251520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-13T23:09:02.251433+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-13T23:09:02.251433+0000","last_clean_scrub_stamp":"2024-09-13T23:09:02.251433+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:58:30.036599+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:57.089213+0000","last_change":"2024-09-13T23:08:57.089257+0000","last_active":"2024-09-13T23:08:57.089213+0000","last_peered":"2024-09-13T23:08:57.089213+0000","last_clean":"2024-09-13T23:08:57.089213+0000","last_became_active":"2024-09-13T23:05:20.145271+0000","last_became_peered":"2024-09-13T23:05:20.145271+0000","last_unstale":"2024-09-13T23:08:57.089213+0000","last_undegraded":"2024-09-13T23:08:57.089213+0000","last_fullsized":"2024-09-13T23:08:57.089213+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:57.089110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:57.089110+0000","last_clean_scrub_stamp":"2024-09-13T23:08:57.089110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:10.929142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:48.078911+0000","last_change":"2024-09-13T23:05:22.150560+0000","last_active":"2024-09-13T23:07:48.078911+0000","last_peered":"2024-09-13T23:07:48.078911+0000","last_clean":"2024-09-13T23:07:48.078911+0000","last_became_active":"2024-09-13T23:05:22.150260+0000","last_became_peered":"2024-09-13T23:05:22.150260+0000","last_unstale":"2024-09-13T23:07:48.078911+0000","last_undegraded":"2024-09-13T23:07:48.078911+0000","last_fullsized":"2024-09-13T23:07:48.078911+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:10.302360+0000","last_change":"2024-09-13T23:09:10.302387+0000","last_active":"2024-09-13T23:09:10.302360+0000","last_peered":"2024-09-13T23:09:10.302360+0000","last_clean":"2024-09-13T23:09:10.302360+0000","last_became_active":"2024-09-13T23:05:14.113131+0000","last_became_peered":"2024-09-13T23:05:14.113131+0000","last_unstale":"2024-09-13T23:09:10.302360+0000","last_undegraded":"2024-09-13T23:09:10.302360+0000","last_fullsized":"2024-09-13T23:09:10.302360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:10.302251+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:10.302251+0000","last_clean_scrub_stamp":"2024-09-13T23:09:10.302251+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:23.722716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:59.616967+0000","last_change":"2024-09-13T23:08:59.616993+0000","last_active":"2024-09-13T23:08:59.616967+0000","last_peered":"2024-09-13T23:08:59.616967+0000","last_clean":"2024-09-13T23:08:59.616967+0000","last_became_active":"2024-09-13T23:05:12.133505+0000","last_became_peered":"2024-09-13T23:05:12.133505+0000","last_unstale":"2024-09-13T23:08:59.616967+0000","last_undegraded":"2024-09-13T23:08:59.616967+0000","last_fullsized":"2024-09-13T23:08:59.616967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:59.616881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:59.616881+0000","last_clean_scrub_stamp":"2024-09-13T23:08:59.616881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:40.852888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:48.133232+0000","last_change":"2024-09-13T23:08:48.133256+0000","last_active":"2024-09-13T23:08:48.133232+0000","last_peered":"2024-09-13T23:08:48.133232+0000","last_clean":"2024-09-13T23:08:48.133232+0000","last_became_active":"2024-09-13T23:05:16.124724+0000","last_became_peered":"2024-09-13T23:05:16.124724+0000","last_unstale":"2024-09-13T23:08:48.133232+0000","last_undegraded":"2024-09-13T23:08:48.133232+0000","last_fullsized":"2024-09-13T23:08:48.133232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:48.133136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:48.133136+0000","last_clean_scrub_stamp":"2024-09-13T23:08:48.133136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:23:32.736027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'10","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:38.121648+0000","last_change":"2024-09-13T23:08:38.121680+0000","last_active":"2024-09-13T23:08:38.121648+0000","last_peered":"2024-09-13T23:08:38.121648+0000","last_clean":"2024-09-13T23:08:38.121648+0000","last_became_active":"2024-09-13T23:05:18.126251+0000","last_became_peered":"2024-09-13T23:05:18.126251+0000","last_unstale":"2024-09-13T23:08:38.121648+0000","last_undegraded":"2024-09-13T23:08:38.121648+0000","last_fullsized":"2024-09-13T23:08:38.121648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T23:08:38.121563+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T23:08:38.121563+0000","last_clean_scrub_stamp":"2024-09-13T23:08:38.121563+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:16:06.466530+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:53.193423+0000","last_change":"2024-09-13T23:08:53.193447+0000","last_active":"2024-09-13T23:08:53.193423+0000","last_peered":"2024-09-13T23:08:53.193423+0000","last_clean":"2024-09-13T23:08:53.193423+0000","last_became_active":"2024-09-13T23:05:20.142564+0000","last_became_peered":"2024-09-13T23:05:20.142564+0000","last_unstale":"2024-09-13T23:08:53.193423+0000","last_undegraded":"2024-09-13T23:08:53.193423+0000","last_fullsized":"2024-09-13T23:08:53.193423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:53.193295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:53.193295+0000","last_clean_scrub_stamp":"2024-09-13T23:08:53.193295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:07:13.524706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:54.076957+0000","last_change":"2024-09-13T23:05:22.147806+0000","last_active":"2024-09-13T23:07:54.076957+0000","last_peered":"2024-09-13T23:07:54.076957+0000","last_clean":"2024-09-13T23:07:54.076957+0000","last_became_active":"2024-09-13T23:05:22.147493+0000","last_became_peered":"2024-09-13T23:05:22.147493+0000","last_unstale":"2024-09-13T23:07:54.076957+0000","last_undegraded":"2024-09-13T23:07:54.076957+0000","last_fullsized":"2024-09-13T23:07:54.076957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:11.254327+0000","last_change":"2024-09-13T23:09:11.254390+0000","last_active":"2024-09-13T23:09:11.254327+0000","last_peered":"2024-09-13T23:09:11.254327+0000","last_clean":"2024-09-13T23:09:11.254327+0000","last_became_active":"2024-09-13T23:05:14.112986+0000","last_became_peered":"2024-09-13T23:05:14.112986+0000","last_unstale":"2024-09-13T23:09:11.254327+0000","last_undegraded":"2024-09-13T23:09:11.254327+0000","last_fullsized":"2024-09-13T23:09:11.254327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:11.254218+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:11.254218+0000","last_clean_scrub_stamp":"2024-09-13T23:09:11.254218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:42.812871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:32.077024+0000","last_change":"2024-09-13T23:05:12.139949+0000","last_active":"2024-09-13T23:07:32.077024+0000","last_peered":"2024-09-13T23:07:32.077024+0000","last_clean":"2024-09-13T23:07:32.077024+0000","last_became_active":"2024-09-13T23:05:12.138805+0000","last_became_peered":"2024-09-13T23:05:12.138805+0000","last_unstale":"2024-09-13T23:07:32.077024+0000","last_undegraded":"2024-09-13T23:07:32.077024+0000","last_fullsized":"2024-09-13T23:07:32.077024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:25.804482+0000","last_change":"2024-09-13T23:09:25.804507+0000","last_active":"2024-09-13T23:09:25.804482+0000","last_peered":"2024-09-13T23:09:25.804482+0000","last_clean":"2024-09-13T23:09:25.804482+0000","last_became_active":"2024-09-13T23:05:49.165209+0000","last_became_peered":"2024-09-13T23:05:49.165209+0000","last_unstale":"2024-09-13T23:09:25.804482+0000","last_undegraded":"2024-09-13T23:09:25.804482+0000","last_fullsized":"2024-09-13T23:09:25.804482+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:25.804395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:25.804395+0000","last_clean_scrub_stamp":"2024-09-13T23:09:25.804395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:13.335216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"34'16","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:39.564155+0000","last_change":"2024-09-13T23:08:39.564192+0000","last_active":"2024-09-13T23:08:39.564155+0000","last_peered":"2024-09-13T23:08:39.564155+0000","last_clean":"2024-09-13T23:08:39.564155+0000","last_became_active":"2024-09-13T23:05:18.134363+0000","last_became_peered":"2024-09-13T23:05:18.134363+0000","last_unstale":"2024-09-13T23:08:39.564155+0000","last_undegraded":"2024-09-13T23:08:39.564155+0000","last_fullsized":"2024-09-13T23:08:39.564155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:08:39.564067+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:08:39.564067+0000","last_clean_scrub_stamp":"2024-09-13T23:08:39.564067+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:23.504537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'286","reported_seq":398,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:08.293685+0000","last_change":"2024-09-13T23:09:08.293738+0000","last_active":"2024-09-13T23:09:08.293685+0000","last_peered":"2024-09-13T23:09:08.293685+0000","last_clean":"2024-09-13T23:09:08.293685+0000","last_became_active":"2024-09-13T23:05:20.143986+0000","last_became_peered":"2024-09-13T23:05:20.143986+0000","last_unstale":"2024-09-13T23:09:08.293685+0000","last_undegraded":"2024-09-13T23:09:08.293685+0000","last_fullsized":"2024-09-13T23:09:08.293685+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-13T23:09:08.293563+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-13T23:09:08.293563+0000","last_clean_scrub_stamp":"2024-09-13T23:09:08.293563+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:25.538117+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'8","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:23.728251+0000","last_change":"2024-09-13T23:09:23.728279+0000","last_active":"2024-09-13T23:09:23.728251+0000","last_peered":"2024-09-13T23:09:23.728251+0000","last_clean":"2024-09-13T23:09:23.728251+0000","last_became_active":"2024-09-13T23:05:22.150977+0000","last_became_peered":"2024-09-13T23:05:22.150977+0000","last_unstale":"2024-09-13T23:09:23.728251+0000","last_undegraded":"2024-09-13T23:09:23.728251+0000","last_fullsized":"2024-09-13T23:09:23.728251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:09:23.728159+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:09:23.728159+0000","last_clean_scrub_stamp":"2024-09-13T23:09:23.728159+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:58.616304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'12","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:00.231436+0000","last_change":"2024-09-13T23:09:00.231505+0000","last_active":"2024-09-13T23:09:00.231436+0000","last_peered":"2024-09-13T23:09:00.231436+0000","last_clean":"2024-09-13T23:09:00.231436+0000","last_became_active":"2024-09-13T23:05:14.121960+0000","last_became_peered":"2024-09-13T23:05:14.121960+0000","last_unstale":"2024-09-13T23:09:00.231436+0000","last_undegraded":"2024-09-13T23:09:00.231436+0000","last_fullsized":"2024-09-13T23:09:00.231436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T23:09:00.231337+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T23:09:00.231337+0000","last_clean_scrub_stamp":"2024-09-13T23:09:00.231337+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:56.146066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:20.081996+0000","last_change":"2024-09-13T23:09:20.082030+0000","last_active":"2024-09-13T23:09:20.081996+0000","last_peered":"2024-09-13T23:09:20.081996+0000","last_clean":"2024-09-13T23:09:20.081996+0000","last_became_active":"2024-09-13T23:05:12.129019+0000","last_became_peered":"2024-09-13T23:05:12.129019+0000","last_unstale":"2024-09-13T23:09:20.081996+0000","last_undegraded":"2024-09-13T23:09:20.081996+0000","last_fullsized":"2024-09-13T23:09:20.081996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:20.081898+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:20.081898+0000","last_clean_scrub_stamp":"2024-09-13T23:09:20.081898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:08:01.867528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:41.570101+0000","last_change":"2024-09-13T23:08:41.570127+0000","last_active":"2024-09-13T23:08:41.570101+0000","last_peered":"2024-09-13T23:08:41.570101+0000","last_clean":"2024-09-13T23:08:41.570101+0000","last_became_active":"2024-09-13T23:05:16.122555+0000","last_became_peered":"2024-09-13T23:05:16.122555+0000","last_unstale":"2024-09-13T23:08:41.570101+0000","last_undegraded":"2024-09-13T23:08:41.570101+0000","last_fullsized":"2024-09-13T23:08:41.570101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:41.570017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:41.570017+0000","last_clean_scrub_stamp":"2024-09-13T23:08:41.570017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:53.974996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:41.566787+0000","last_change":"2024-09-13T23:08:41.566822+0000","last_active":"2024-09-13T23:08:41.566787+0000","last_peered":"2024-09-13T23:08:41.566787+0000","last_clean":"2024-09-13T23:08:41.566787+0000","last_became_active":"2024-09-13T23:05:18.128626+0000","last_became_peered":"2024-09-13T23:05:18.128626+0000","last_unstale":"2024-09-13T23:08:41.566787+0000","last_undegraded":"2024-09-13T23:08:41.566787+0000","last_fullsized":"2024-09-13T23:08:41.566787+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-13T23:08:41.566699+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-13T23:08:41.566699+0000","last_clean_scrub_stamp":"2024-09-13T23:08:41.566699+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:31.161100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:37.047437+0000","last_change":"2024-09-13T23:08:37.047469+0000","last_active":"2024-09-13T23:08:37.047437+0000","last_peered":"2024-09-13T23:08:37.047437+0000","last_clean":"2024-09-13T23:08:37.047437+0000","last_became_active":"2024-09-13T23:05:20.131943+0000","last_became_peered":"2024-09-13T23:05:20.131943+0000","last_unstale":"2024-09-13T23:08:37.047437+0000","last_undegraded":"2024-09-13T23:08:37.047437+0000","last_fullsized":"2024-09-13T23:08:37.047437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:37.047343+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:37.047343+0000","last_clean_scrub_stamp":"2024-09-13T23:08:37.047343+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:51:19.741192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:47.398582+0000","last_change":"2024-09-13T23:08:47.398608+0000","last_active":"2024-09-13T23:08:47.398582+0000","last_peered":"2024-09-13T23:08:47.398582+0000","last_clean":"2024-09-13T23:08:47.398582+0000","last_became_active":"2024-09-13T23:05:14.126659+0000","last_became_peered":"2024-09-13T23:05:14.126659+0000","last_unstale":"2024-09-13T23:08:47.398582+0000","last_undegraded":"2024-09-13T23:08:47.398582+0000","last_fullsized":"2024-09-13T23:08:47.398582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:47.398478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:47.398478+0000","last_clean_scrub_stamp":"2024-09-13T23:08:47.398478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:48.669511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:16.723609+0000","last_change":"2024-09-13T23:09:16.723632+0000","last_active":"2024-09-13T23:09:16.723609+0000","last_peered":"2024-09-13T23:09:16.723609+0000","last_clean":"2024-09-13T23:09:16.723609+0000","last_became_active":"2024-09-13T23:05:12.114453+0000","last_became_peered":"2024-09-13T23:05:12.114453+0000","last_unstale":"2024-09-13T23:09:16.723609+0000","last_undegraded":"2024-09-13T23:09:16.723609+0000","last_fullsized":"2024-09-13T23:09:16.723609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:16.723508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:16.723508+0000","last_clean_scrub_stamp":"2024-09-13T23:09:16.723508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:30:34.735824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:40.158881+0000","last_change":"2024-09-13T23:08:40.158918+0000","last_active":"2024-09-13T23:08:40.158881+0000","last_peered":"2024-09-13T23:08:40.158881+0000","last_clean":"2024-09-13T23:08:40.158881+0000","last_became_active":"2024-09-13T23:05:16.124324+0000","last_became_peered":"2024-09-13T23:05:16.124324+0000","last_unstale":"2024-09-13T23:08:40.158881+0000","last_undegraded":"2024-09-13T23:08:40.158881+0000","last_fullsized":"2024-09-13T23:08:40.158881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:40.158756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:40.158756+0000","last_clean_scrub_stamp":"2024-09-13T23:08:40.158756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:01.139147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'51","reported_seq":111,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:40.531470+0000","last_change":"2024-09-13T23:08:40.531513+0000","last_active":"2024-09-13T23:08:40.531470+0000","last_peered":"2024-09-13T23:08:40.531470+0000","last_clean":"2024-09-13T23:08:40.531470+0000","last_became_active":"2024-09-13T23:05:18.129887+0000","last_became_peered":"2024-09-13T23:05:18.129887+0000","last_unstale":"2024-09-13T23:08:40.531470+0000","last_undegraded":"2024-09-13T23:08:40.531470+0000","last_fullsized":"2024-09-13T23:08:40.531470+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'51","last_scrub_stamp":"2024-09-13T23:08:40.531386+0000","last_deep_scrub":"34'51","last_deep_scrub_stamp":"2024-09-13T23:08:40.531386+0000","last_clean_scrub_stamp":"2024-09-13T23:08:40.531386+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:00:53.584234+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:36.003924+0000","last_change":"2024-09-13T23:08:36.003951+0000","last_active":"2024-09-13T23:08:36.003924+0000","last_peered":"2024-09-13T23:08:36.003924+0000","last_clean":"2024-09-13T23:08:36.003924+0000","last_became_active":"2024-09-13T23:05:20.135937+0000","last_became_peered":"2024-09-13T23:05:20.135937+0000","last_unstale":"2024-09-13T23:08:36.003924+0000","last_undegraded":"2024-09-13T23:08:36.003924+0000","last_fullsized":"2024-09-13T23:08:36.003924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:36.003822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:36.003822+0000","last_clean_scrub_stamp":"2024-09-13T23:08:36.003822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:36.100827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:54.634286+0000","last_change":"2024-09-13T23:08:54.634313+0000","last_active":"2024-09-13T23:08:54.634286+0000","last_peered":"2024-09-13T23:08:54.634286+0000","last_clean":"2024-09-13T23:08:54.634286+0000","last_became_active":"2024-09-13T23:05:22.146044+0000","last_became_peered":"2024-09-13T23:05:22.146044+0000","last_unstale":"2024-09-13T23:08:54.634286+0000","last_undegraded":"2024-09-13T23:08:54.634286+0000","last_fullsized":"2024-09-13T23:08:54.634286+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T23:08:54.634198+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T23:08:54.634198+0000","last_clean_scrub_stamp":"2024-09-13T23:08:54.634198+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:58:43.552913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:06.131139+0000","last_change":"2024-09-13T23:09:06.131179+0000","last_active":"2024-09-13T23:09:06.131139+0000","last_peered":"2024-09-13T23:09:06.131139+0000","last_clean":"2024-09-13T23:09:06.131139+0000","last_became_active":"2024-09-13T23:05:14.116507+0000","last_became_peered":"2024-09-13T23:05:14.116507+0000","last_unstale":"2024-09-13T23:09:06.131139+0000","last_undegraded":"2024-09-13T23:09:06.131139+0000","last_fullsized":"2024-09-13T23:09:06.131139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:06.131036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:06.131036+0000","last_clean_scrub_stamp":"2024-09-13T23:09:06.131036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:00.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:14.711172+0000","last_change":"2024-09-13T23:09:14.711220+0000","last_active":"2024-09-13T23:09:14.711172+0000","last_peered":"2024-09-13T23:09:14.711172+0000","last_clean":"2024-09-13T23:09:14.711172+0000","last_became_active":"2024-09-13T23:05:12.115025+0000","last_became_peered":"2024-09-13T23:05:12.115025+0000","last_unstale":"2024-09-13T23:09:14.711172+0000","last_undegraded":"2024-09-13T23:09:14.711172+0000","last_fullsized":"2024-09-13T23:09:14.711172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:14.711051+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:14.711051+0000","last_clean_scrub_stamp":"2024-09-13T23:09:14.711051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:35:37.823812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:56.177848+0000","last_change":"2024-09-13T23:08:56.177873+0000","last_active":"2024-09-13T23:08:56.177848+0000","last_peered":"2024-09-13T23:08:56.177848+0000","last_clean":"2024-09-13T23:08:56.177848+0000","last_became_active":"2024-09-13T23:05:16.118494+0000","last_became_peered":"2024-09-13T23:05:16.118494+0000","last_unstale":"2024-09-13T23:08:56.177848+0000","last_undegraded":"2024-09-13T23:08:56.177848+0000","last_fullsized":"2024-09-13T23:08:56.177848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:56.177744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:56.177744+0000","last_clean_scrub_stamp":"2024-09-13T23:08:56.177744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:53.534857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'37","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:03.229885+0000","last_change":"2024-09-13T23:09:03.229920+0000","last_active":"2024-09-13T23:09:03.229885+0000","last_peered":"2024-09-13T23:09:03.229885+0000","last_clean":"2024-09-13T23:09:03.229885+0000","last_became_active":"2024-09-13T23:05:18.134130+0000","last_became_peered":"2024-09-13T23:05:18.134130+0000","last_unstale":"2024-09-13T23:09:03.229885+0000","last_undegraded":"2024-09-13T23:09:03.229885+0000","last_fullsized":"2024-09-13T23:09:03.229885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-13T23:09:03.229792+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-13T23:09:03.229792+0000","last_clean_scrub_stamp":"2024-09-13T23:09:03.229792+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:13.414475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:42.005317+0000","last_change":"2024-09-13T23:08:42.005343+0000","last_active":"2024-09-13T23:08:42.005317+0000","last_peered":"2024-09-13T23:08:42.005317+0000","last_clean":"2024-09-13T23:08:42.005317+0000","last_became_active":"2024-09-13T23:05:20.140180+0000","last_became_peered":"2024-09-13T23:05:20.140180+0000","last_unstale":"2024-09-13T23:08:42.005317+0000","last_undegraded":"2024-09-13T23:08:42.005317+0000","last_fullsized":"2024-09-13T23:08:42.005317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:42.005224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:42.005224+0000","last_clean_scrub_stamp":"2024-09-13T23:08:42.005224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:49:52.491200+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'8","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:31.215235+0000","last_change":"2024-09-13T23:09:31.215235+0000","last_active":"2024-09-13T23:09:31.215235+0000","last_peered":"2024-09-13T23:09:31.215235+0000","last_clean":"2024-09-13T23:09:31.215235+0000","last_became_active":"2024-09-13T23:05:22.148104+0000","last_became_peered":"2024-09-13T23:05:22.148104+0000","last_unstale":"2024-09-13T23:09:31.215235+0000","last_undegraded":"2024-09-13T23:09:31.215235+0000","last_fullsized":"2024-09-13T23:09:31.215235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:09:31.215112+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:09:31.215112+0000","last_clean_scrub_stamp":"2024-09-13T23:09:31.215112+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:13.797313+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":18,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:20.742435+0000","last_change":"2024-09-13T23:09:20.742460+0000","last_active":"2024-09-13T23:09:20.742435+0000","last_peered":"2024-09-13T23:09:20.742435+0000","last_clean":"2024-09-13T23:09:20.742435+0000","last_became_active":"2024-09-13T23:05:14.119071+0000","last_became_peered":"2024-09-13T23:05:14.119071+0000","last_unstale":"2024-09-13T23:09:20.742435+0000","last_undegraded":"2024-09-13T23:09:20.742435+0000","last_fullsized":"2024-09-13T23:09:20.742435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:20.742341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:20.742341+0000","last_clean_scrub_stamp":"2024-09-13T23:09:20.742341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:04.873814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:29.183265+0000","last_change":"2024-09-13T23:05:12.148852+0000","last_active":"2024-09-13T23:08:29.183265+0000","last_peered":"2024-09-13T23:08:29.183265+0000","last_clean":"2024-09-13T23:08:29.183265+0000","last_became_active":"2024-09-13T23:05:12.148439+0000","last_became_peered":"2024-09-13T23:05:12.148439+0000","last_unstale":"2024-09-13T23:08:29.183265+0000","last_undegraded":"2024-09-13T23:08:29.183265+0000","last_fullsized":"2024-09-13T23:08:29.183265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:52.165226+0000","last_change":"2024-09-13T23:08:52.165250+0000","last_active":"2024-09-13T23:08:52.165226+0000","last_peered":"2024-09-13T23:08:52.165226+0000","last_clean":"2024-09-13T23:08:52.165226+0000","last_became_active":"2024-09-13T23:05:16.123188+0000","last_became_peered":"2024-09-13T23:05:16.123188+0000","last_unstale":"2024-09-13T23:08:52.165226+0000","last_undegraded":"2024-09-13T23:08:52.165226+0000","last_fullsized":"2024-09-13T23:08:52.165226+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:52.165141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:52.165141+0000","last_clean_scrub_stamp":"2024-09-13T23:08:52.165141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:55:30.699678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:40.622211+0000","last_change":"2024-09-13T23:08:40.622258+0000","last_active":"2024-09-13T23:08:40.622211+0000","last_peered":"2024-09-13T23:08:40.622211+0000","last_clean":"2024-09-13T23:08:40.622211+0000","last_became_active":"2024-09-13T23:05:18.131446+0000","last_became_peered":"2024-09-13T23:05:18.131446+0000","last_unstale":"2024-09-13T23:08:40.622211+0000","last_undegraded":"2024-09-13T23:08:40.622211+0000","last_fullsized":"2024-09-13T23:08:40.622211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-09-13T23:08:40.622115+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-09-13T23:08:40.622115+0000","last_clean_scrub_stamp":"2024-09-13T23:08:40.622115+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:07.613322+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":360,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:50.174742+0000","last_change":"2024-09-13T23:08:50.174769+0000","last_active":"2024-09-13T23:08:50.174742+0000","last_peered":"2024-09-13T23:08:50.174742+0000","last_clean":"2024-09-13T23:08:50.174742+0000","last_became_active":"2024-09-13T23:05:20.144104+0000","last_became_peered":"2024-09-13T23:05:20.144104+0000","last_unstale":"2024-09-13T23:08:50.174742+0000","last_undegraded":"2024-09-13T23:08:50.174742+0000","last_fullsized":"2024-09-13T23:08:50.174742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:50.174650+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:50.174650+0000","last_clean_scrub_stamp":"2024-09-13T23:08:50.174650+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:45:01.149565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:34.073991+0000","last_change":"2024-09-13T23:05:22.147955+0000","last_active":"2024-09-13T23:07:34.073991+0000","last_peered":"2024-09-13T23:07:34.073991+0000","last_clean":"2024-09-13T23:07:34.073991+0000","last_became_active":"2024-09-13T23:05:22.147645+0000","last_became_peered":"2024-09-13T23:05:22.147645+0000","last_unstale":"2024-09-13T23:07:34.073991+0000","last_undegraded":"2024-09-13T23:07:34.073991+0000","last_fullsized":"2024-09-13T23:07:34.073991+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'10","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:58.567622+0000","last_change":"2024-09-13T23:08:58.567649+0000","last_active":"2024-09-13T23:08:58.567622+0000","last_peered":"2024-09-13T23:08:58.567622+0000","last_clean":"2024-09-13T23:08:58.567622+0000","last_became_active":"2024-09-13T23:05:14.112291+0000","last_became_peered":"2024-09-13T23:05:14.112291+0000","last_unstale":"2024-09-13T23:08:58.567622+0000","last_undegraded":"2024-09-13T23:08:58.567622+0000","last_fullsized":"2024-09-13T23:08:58.567622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T23:08:58.567512+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T23:08:58.567512+0000","last_clean_scrub_stamp":"2024-09-13T23:08:58.567512+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:43.527393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:25.329961+0000","last_change":"2024-09-13T23:09:25.329987+0000","last_active":"2024-09-13T23:09:25.329961+0000","last_peered":"2024-09-13T23:09:25.329961+0000","last_clean":"2024-09-13T23:09:25.329961+0000","last_became_active":"2024-09-13T23:05:12.149418+0000","last_became_peered":"2024-09-13T23:05:12.149418+0000","last_unstale":"2024-09-13T23:09:25.329961+0000","last_undegraded":"2024-09-13T23:09:25.329961+0000","last_fullsized":"2024-09-13T23:09:25.329961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:25.329872+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:25.329872+0000","last_clean_scrub_stamp":"2024-09-13T23:09:25.329872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:34.474798+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:55.175221+0000","last_change":"2024-09-13T23:08:55.175246+0000","last_active":"2024-09-13T23:08:55.175221+0000","last_peered":"2024-09-13T23:08:55.175221+0000","last_clean":"2024-09-13T23:08:55.175221+0000","last_became_active":"2024-09-13T23:05:16.118503+0000","last_became_peered":"2024-09-13T23:05:16.118503+0000","last_unstale":"2024-09-13T23:08:55.175221+0000","last_undegraded":"2024-09-13T23:08:55.175221+0000","last_fullsized":"2024-09-13T23:08:55.175221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:55.175127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:55.175127+0000","last_clean_scrub_stamp":"2024-09-13T23:08:55.175127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:05.711566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'63","reported_seq":136,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:57.374041+0000","last_change":"2024-09-13T23:08:57.374099+0000","last_active":"2024-09-13T23:08:57.374041+0000","last_peered":"2024-09-13T23:08:57.374041+0000","last_clean":"2024-09-13T23:08:57.374041+0000","last_became_active":"2024-09-13T23:05:18.135307+0000","last_became_peered":"2024-09-13T23:05:18.135307+0000","last_unstale":"2024-09-13T23:08:57.374041+0000","last_undegraded":"2024-09-13T23:08:57.374041+0000","last_fullsized":"2024-09-13T23:08:57.374041+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'63","last_scrub_stamp":"2024-09-13T23:08:57.373955+0000","last_deep_scrub":"34'63","last_deep_scrub_stamp":"2024-09-13T23:08:57.373955+0000","last_clean_scrub_stamp":"2024-09-13T23:08:57.373955+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:00.678457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:32.955706+0000","last_change":"2024-09-13T23:08:32.955726+0000","last_active":"2024-09-13T23:08:32.955706+0000","last_peered":"2024-09-13T23:08:32.955706+0000","last_clean":"2024-09-13T23:08:32.955706+0000","last_became_active":"2024-09-13T23:05:20.137460+0000","last_became_peered":"2024-09-13T23:05:20.137460+0000","last_unstale":"2024-09-13T23:08:32.955706+0000","last_undegraded":"2024-09-13T23:08:32.955706+0000","last_fullsized":"2024-09-13T23:08:32.955706+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:32.955629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:32.955629+0000","last_clean_scrub_stamp":"2024-09-13T23:08:32.955629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:14.847447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'21","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:31.333331+0000","last_change":"2024-09-13T23:09:31.333368+0000","last_active":"2024-09-13T23:09:31.333331+0000","last_peered":"2024-09-13T23:09:31.333331+0000","last_clean":"2024-09-13T23:09:31.333331+0000","last_became_active":"2024-09-13T23:05:22.141472+0000","last_became_peered":"2024-09-13T23:05:22.141472+0000","last_unstale":"2024-09-13T23:09:31.333331+0000","last_undegraded":"2024-09-13T23:09:31.333331+0000","last_fullsized":"2024-09-13T23:09:31.333331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-13T23:09:31.333239+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-13T23:09:31.333239+0000","last_clean_scrub_stamp":"2024-09-13T23:09:31.333239+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:05:38.230749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:05.149534+0000","last_change":"2024-09-13T23:09:05.149603+0000","last_active":"2024-09-13T23:09:05.149534+0000","last_peered":"2024-09-13T23:09:05.149534+0000","last_clean":"2024-09-13T23:09:05.149534+0000","last_became_active":"2024-09-13T23:05:49.164426+0000","last_became_peered":"2024-09-13T23:05:49.164426+0000","last_unstale":"2024-09-13T23:09:05.149534+0000","last_undegraded":"2024-09-13T23:09:05.149534+0000","last_fullsized":"2024-09-13T23:09:05.149534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T23:09:05.149414+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T23:09:05.149414+0000","last_clean_scrub_stamp":"2024-09-13T23:09:05.149414+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:09.148923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:07.243503+0000","last_change":"2024-09-13T23:09:07.243570+0000","last_active":"2024-09-13T23:09:07.243503+0000","last_peered":"2024-09-13T23:09:07.243503+0000","last_clean":"2024-09-13T23:09:07.243503+0000","last_became_active":"2024-09-13T23:05:12.129951+0000","last_became_peered":"2024-09-13T23:05:12.129951+0000","last_unstale":"2024-09-13T23:09:07.243503+0000","last_undegraded":"2024-09-13T23:09:07.243503+0000","last_fullsized":"2024-09-13T23:09:07.243503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:07.243394+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:07.243394+0000","last_clean_scrub_stamp":"2024-09-13T23:09:07.243394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:18.684549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:48.682481+0000","last_change":"2024-09-13T23:08:48.682504+0000","last_active":"2024-09-13T23:08:48.682481+0000","last_peered":"2024-09-13T23:08:48.682481+0000","last_clean":"2024-09-13T23:08:48.682481+0000","last_became_active":"2024-09-13T23:05:16.127598+0000","last_became_peered":"2024-09-13T23:05:16.127598+0000","last_unstale":"2024-09-13T23:08:48.682481+0000","last_undegraded":"2024-09-13T23:08:48.682481+0000","last_fullsized":"2024-09-13T23:08:48.682481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:48.682390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:48.682390+0000","last_clean_scrub_stamp":"2024-09-13T23:08:48.682390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:16:51.142230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'39","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:36.095129+0000","last_change":"2024-09-13T23:08:36.095166+0000","last_active":"2024-09-13T23:08:36.095129+0000","last_peered":"2024-09-13T23:08:36.095129+0000","last_clean":"2024-09-13T23:08:36.095129+0000","last_became_active":"2024-09-13T23:05:18.128238+0000","last_became_peered":"2024-09-13T23:05:18.128238+0000","last_unstale":"2024-09-13T23:08:36.095129+0000","last_undegraded":"2024-09-13T23:08:36.095129+0000","last_fullsized":"2024-09-13T23:08:36.095129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-13T23:08:36.095044+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-13T23:08:36.095044+0000","last_clean_scrub_stamp":"2024-09-13T23:08:36.095044+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:48:40.542578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:00.311517+0000","last_change":"2024-09-13T23:09:00.311550+0000","last_active":"2024-09-13T23:09:00.311517+0000","last_peered":"2024-09-13T23:09:00.311517+0000","last_clean":"2024-09-13T23:09:00.311517+0000","last_became_active":"2024-09-13T23:05:20.139335+0000","last_became_peered":"2024-09-13T23:05:20.139335+0000","last_unstale":"2024-09-13T23:09:00.311517+0000","last_undegraded":"2024-09-13T23:09:00.311517+0000","last_fullsized":"2024-09-13T23:09:00.311517+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:00.311418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:00.311418+0000","last_clean_scrub_stamp":"2024-09-13T23:09:00.311418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:28.885656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.411718+0000","last_change":"2024-09-13T23:05:22.148481+0000","last_active":"2024-09-13T23:08:33.411718+0000","last_peered":"2024-09-13T23:08:33.411718+0000","last_clean":"2024-09-13T23:08:33.411718+0000","last_became_active":"2024-09-13T23:05:22.148222+0000","last_became_peered":"2024-09-13T23:05:22.148222+0000","last_unstale":"2024-09-13T23:08:33.411718+0000","last_undegraded":"2024-09-13T23:08:33.411718+0000","last_fullsized":"2024-09-13T23:08:33.411718+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'34","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:06.266284+0000","last_change":"2024-09-13T23:09:06.266334+0000","last_active":"2024-09-13T23:09:06.266284+0000","last_peered":"2024-09-13T23:09:06.266284+0000","last_clean":"2024-09-13T23:09:06.266284+0000","last_became_active":"2024-09-13T23:05:14.118545+0000","last_became_peered":"2024-09-13T23:05:14.118545+0000","last_unstale":"2024-09-13T23:09:06.266284+0000","last_undegraded":"2024-09-13T23:09:06.266284+0000","last_fullsized":"2024-09-13T23:09:06.266284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'34","last_scrub_stamp":"2024-09-13T23:09:06.266184+0000","last_deep_scrub":"34'34","last_deep_scrub_stamp":"2024-09-13T23:09:06.266184+0000","last_clean_scrub_stamp":"2024-09-13T23:09:06.266184+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:12.667320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":93,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.410371+0000","last_change":"2024-09-13T23:05:12.147234+0000","last_active":"2024-09-13T23:08:33.410371+0000","last_peered":"2024-09-13T23:08:33.410371+0000","last_clean":"2024-09-13T23:08:33.410371+0000","last_became_active":"2024-09-13T23:05:12.146912+0000","last_became_peered":"2024-09-13T23:05:12.146912+0000","last_unstale":"2024-09-13T23:08:33.410371+0000","last_undegraded":"2024-09-13T23:08:33.410371+0000","last_fullsized":"2024-09-13T23:08:33.410371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:57.227690+0000","last_change":"2024-09-13T23:08:57.227716+0000","last_active":"2024-09-13T23:08:57.227690+0000","last_peered":"2024-09-13T23:08:57.227690+0000","last_clean":"2024-09-13T23:08:57.227690+0000","last_became_active":"2024-09-13T23:05:16.114369+0000","last_became_peered":"2024-09-13T23:05:16.114369+0000","last_unstale":"2024-09-13T23:08:57.227690+0000","last_undegraded":"2024-09-13T23:08:57.227690+0000","last_fullsized":"2024-09-13T23:08:57.227690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:57.227595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:57.227595+0000","last_clean_scrub_stamp":"2024-09-13T23:08:57.227595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:37:59.143867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:45.676576+0000","last_change":"2024-09-13T23:08:45.676635+0000","last_active":"2024-09-13T23:08:45.676576+0000","last_peered":"2024-09-13T23:08:45.676576+0000","last_clean":"2024-09-13T23:08:45.676576+0000","last_became_active":"2024-09-13T23:05:18.126183+0000","last_became_peered":"2024-09-13T23:05:18.126183+0000","last_unstale":"2024-09-13T23:08:45.676576+0000","last_undegraded":"2024-09-13T23:08:45.676576+0000","last_fullsized":"2024-09-13T23:08:45.676576+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-13T23:08:45.676456+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-13T23:08:45.676456+0000","last_clean_scrub_stamp":"2024-09-13T23:08:45.676456+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:40.391001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":415,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:38.549051+0000","last_change":"2024-09-13T23:08:38.549085+0000","last_active":"2024-09-13T23:08:38.549051+0000","last_peered":"2024-09-13T23:08:38.549051+0000","last_clean":"2024-09-13T23:08:38.549051+0000","last_became_active":"2024-09-13T23:05:20.143659+0000","last_became_peered":"2024-09-13T23:05:20.143659+0000","last_unstale":"2024-09-13T23:08:38.549051+0000","last_undegraded":"2024-09-13T23:08:38.549051+0000","last_fullsized":"2024-09-13T23:08:38.549051+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:38.548964+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:38.548964+0000","last_clean_scrub_stamp":"2024-09-13T23:08:38.548964+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:04.032284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'13","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:29.307050+0000","last_change":"2024-09-13T23:09:29.307050+0000","last_active":"2024-09-13T23:09:29.307050+0000","last_peered":"2024-09-13T23:09:29.307050+0000","last_clean":"2024-09-13T23:09:29.307050+0000","last_became_active":"2024-09-13T23:05:22.140485+0000","last_became_peered":"2024-09-13T23:05:22.140485+0000","last_unstale":"2024-09-13T23:09:29.307050+0000","last_undegraded":"2024-09-13T23:09:29.307050+0000","last_fullsized":"2024-09-13T23:09:29.307050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'13","last_scrub_stamp":"2024-09-13T23:09:29.306883+0000","last_deep_scrub":"34'13","last_deep_scrub_stamp":"2024-09-13T23:09:29.306883+0000","last_clean_scrub_stamp":"2024-09-13T23:09:29.306883+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:05.267654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'18","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:10.779162+0000","last_change":"2024-09-13T23:09:10.779210+0000","last_active":"2024-09-13T23:09:10.779162+0000","last_peered":"2024-09-13T23:09:10.779162+0000","last_clean":"2024-09-13T23:09:10.779162+0000","last_became_active":"2024-09-13T23:05:14.115166+0000","last_became_peered":"2024-09-13T23:05:14.115166+0000","last_unstale":"2024-09-13T23:09:10.779162+0000","last_undegraded":"2024-09-13T23:09:10.779162+0000","last_fullsized":"2024-09-13T23:09:10.779162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-13T23:09:10.779044+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-13T23:09:10.779044+0000","last_clean_scrub_stamp":"2024-09-13T23:09:10.779044+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:03:39.986800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.410352+0000","last_change":"2024-09-13T23:05:12.140202+0000","last_active":"2024-09-13T23:08:33.410352+0000","last_peered":"2024-09-13T23:08:33.410352+0000","last_clean":"2024-09-13T23:08:33.410352+0000","last_became_active":"2024-09-13T23:05:12.139283+0000","last_became_peered":"2024-09-13T23:05:12.139283+0000","last_unstale":"2024-09-13T23:08:33.410352+0000","last_undegraded":"2024-09-13T23:08:33.410352+0000","last_fullsized":"2024-09-13T23:08:33.410352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":439,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:50.100446+0000","last_change":"2024-09-13T23:08:50.100480+0000","last_active":"2024-09-13T23:08:50.100446+0000","last_peered":"2024-09-13T23:08:50.100446+0000","last_clean":"2024-09-13T23:08:50.100446+0000","last_became_active":"2024-09-13T23:05:49.164741+0000","last_became_peered":"2024-09-13T23:05:49.164741+0000","last_unstale":"2024-09-13T23:08:50.100446+0000","last_undegraded":"2024-09-13T23:08:50.100446+0000","last_fullsized":"2024-09-13T23:08:50.100446+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T23:08:50.100356+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T23:08:50.100356+0000","last_clean_scrub_stamp":"2024-09-13T23:08:50.100356+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:15:10.416249+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'16","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:58.338081+0000","last_change":"2024-09-13T23:08:58.338158+0000","last_active":"2024-09-13T23:08:58.338081+0000","last_peered":"2024-09-13T23:08:58.338081+0000","last_clean":"2024-09-13T23:08:58.338081+0000","last_became_active":"2024-09-13T23:05:18.135028+0000","last_became_peered":"2024-09-13T23:05:18.135028+0000","last_unstale":"2024-09-13T23:08:58.338081+0000","last_undegraded":"2024-09-13T23:08:58.338081+0000","last_fullsized":"2024-09-13T23:08:58.338081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:08:58.337970+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:08:58.337970+0000","last_clean_scrub_stamp":"2024-09-13T23:08:58.337970+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:47.871335+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":477,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:41.117643+0000","last_change":"2024-09-13T23:08:41.117670+0000","last_active":"2024-09-13T23:08:41.117643+0000","last_peered":"2024-09-13T23:08:41.117643+0000","last_clean":"2024-09-13T23:08:41.117643+0000","last_became_active":"2024-09-13T23:05:20.132891+0000","last_became_peered":"2024-09-13T23:05:20.132891+0000","last_unstale":"2024-09-13T23:08:41.117643+0000","last_undegraded":"2024-09-13T23:08:41.117643+0000","last_fullsized":"2024-09-13T23:08:41.117643+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:41.117524+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:41.117524+0000","last_clean_scrub_stamp":"2024-09-13T23:08:41.117524+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:31.490095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:21.754859+0000","last_change":"2024-09-13T23:09:21.754886+0000","last_active":"2024-09-13T23:09:21.754859+0000","last_peered":"2024-09-13T23:09:21.754859+0000","last_clean":"2024-09-13T23:09:21.754859+0000","last_became_active":"2024-09-13T23:05:22.150258+0000","last_became_peered":"2024-09-13T23:05:22.150258+0000","last_unstale":"2024-09-13T23:09:21.754859+0000","last_undegraded":"2024-09-13T23:09:21.754859+0000","last_fullsized":"2024-09-13T23:09:21.754859+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:21.754762+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:21.754762+0000","last_clean_scrub_stamp":"2024-09-13T23:09:21.754762+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:55.726221+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:51.145119+0000","last_change":"2024-09-13T23:08:51.145168+0000","last_active":"2024-09-13T23:08:51.145119+0000","last_peered":"2024-09-13T23:08:51.145119+0000","last_clean":"2024-09-13T23:08:51.145119+0000","last_became_active":"2024-09-13T23:05:14.125034+0000","last_became_peered":"2024-09-13T23:05:14.125034+0000","last_unstale":"2024-09-13T23:08:51.145119+0000","last_undegraded":"2024-09-13T23:08:51.145119+0000","last_fullsized":"2024-09-13T23:08:51.145119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:08:51.145025+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:08:51.145025+0000","last_clean_scrub_stamp":"2024-09-13T23:08:51.145025+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:58.481808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'3","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:26.326808+0000","last_change":"2024-09-13T23:09:26.326808+0000","last_active":"2024-09-13T23:09:26.326808+0000","last_peered":"2024-09-13T23:09:26.326808+0000","last_clean":"2024-09-13T23:09:26.326808+0000","last_became_active":"2024-09-13T23:05:12.142185+0000","last_became_peered":"2024-09-13T23:05:12.142185+0000","last_unstale":"2024-09-13T23:09:26.326808+0000","last_undegraded":"2024-09-13T23:09:26.326808+0000","last_fullsized":"2024-09-13T23:09:26.326808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T23:09:26.326631+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T23:09:26.326631+0000","last_clean_scrub_stamp":"2024-09-13T23:09:26.326631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:01.860014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.512216+0000","last_change":"2024-09-13T23:08:33.512256+0000","last_active":"2024-09-13T23:08:33.512216+0000","last_peered":"2024-09-13T23:08:33.512216+0000","last_clean":"2024-09-13T23:08:33.512216+0000","last_became_active":"2024-09-13T23:05:16.125013+0000","last_became_peered":"2024-09-13T23:05:16.125013+0000","last_unstale":"2024-09-13T23:08:33.512216+0000","last_undegraded":"2024-09-13T23:08:33.512216+0000","last_fullsized":"2024-09-13T23:08:33.512216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:33.512107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:33.512107+0000","last_clean_scrub_stamp":"2024-09-13T23:08:33.512107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:00.070785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'48","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:39.155632+0000","last_change":"2024-09-13T23:08:39.155672+0000","last_active":"2024-09-13T23:08:39.155632+0000","last_peered":"2024-09-13T23:08:39.155632+0000","last_clean":"2024-09-13T23:08:39.155632+0000","last_became_active":"2024-09-13T23:05:18.126271+0000","last_became_peered":"2024-09-13T23:05:18.126271+0000","last_unstale":"2024-09-13T23:08:39.155632+0000","last_undegraded":"2024-09-13T23:08:39.155632+0000","last_fullsized":"2024-09-13T23:08:39.155632+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-09-13T23:08:39.155548+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-09-13T23:08:39.155548+0000","last_clean_scrub_stamp":"2024-09-13T23:08:39.155548+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:48.512044+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:46.633023+0000","last_change":"2024-09-13T23:08:46.633049+0000","last_active":"2024-09-13T23:08:46.633023+0000","last_peered":"2024-09-13T23:08:46.633023+0000","last_clean":"2024-09-13T23:08:46.633023+0000","last_became_active":"2024-09-13T23:05:20.145626+0000","last_became_peered":"2024-09-13T23:05:20.145626+0000","last_unstale":"2024-09-13T23:08:46.633023+0000","last_undegraded":"2024-09-13T23:08:46.633023+0000","last_fullsized":"2024-09-13T23:08:46.633023+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:46.632934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:46.632934+0000","last_clean_scrub_stamp":"2024-09-13T23:08:46.632934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:54.822821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:01.125815+0000","last_change":"2024-09-13T23:09:01.125815+0000","last_active":"2024-09-13T23:09:01.125815+0000","last_peered":"2024-09-13T23:09:01.125815+0000","last_clean":"2024-09-13T23:09:01.125815+0000","last_became_active":"2024-09-13T23:05:22.137111+0000","last_became_peered":"2024-09-13T23:05:22.137111+0000","last_unstale":"2024-09-13T23:09:01.125815+0000","last_undegraded":"2024-09-13T23:09:01.125815+0000","last_fullsized":"2024-09-13T23:09:01.125815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-13T23:09:01.125676+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-13T23:09:01.125676+0000","last_clean_scrub_stamp":"2024-09-13T23:09:01.125676+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:57.040405+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'16","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:27.794933+0000","last_change":"2024-09-13T23:09:27.794975+0000","last_active":"2024-09-13T23:09:27.794933+0000","last_peered":"2024-09-13T23:09:27.794933+0000","last_clean":"2024-09-13T23:09:27.794933+0000","last_became_active":"2024-09-13T23:05:49.165166+0000","last_became_peered":"2024-09-13T23:05:49.165166+0000","last_unstale":"2024-09-13T23:09:27.794933+0000","last_undegraded":"2024-09-13T23:09:27.794933+0000","last_fullsized":"2024-09-13T23:09:27.794933+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:09:27.794824+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:09:27.794824+0000","last_clean_scrub_stamp":"2024-09-13T23:09:27.794824+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:46.349957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":51,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"34'119","reported_seq":216,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:19.089115+0000","last_change":"2024-09-13T23:09:19.089153+0000","last_active":"2024-09-13T23:09:19.089115+0000","last_peered":"2024-09-13T23:09:19.089115+0000","last_clean":"2024-09-13T23:09:19.089115+0000","last_became_active":"2024-09-13T23:04:56.149747+0000","last_became_peered":"2024-09-13T23:04:56.149747+0000","last_unstale":"2024-09-13T23:09:19.089115+0000","last_undegraded":"2024-09-13T23:09:19.089115+0000","last_fullsized":"2024-09-13T23:09:19.089115+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'119","last_scrub_stamp":"2024-09-13T23:09:19.089028+0000","last_deep_scrub":"34'119","last_deep_scrub_stamp":"2024-09-13T23:09:19.089028+0000","last_clean_scrub_stamp":"2024-09-13T23:09:19.089028+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:19.626670+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.410232+0000","last_change":"2024-09-13T23:05:03.078734+0000","last_active":"2024-09-13T23:08:33.410232+0000","last_peered":"2024-09-13T23:08:33.410232+0000","last_clean":"2024-09-13T23:08:33.410232+0000","last_became_active":"2024-09-13T23:05:01.074608+0000","last_became_peered":"2024-09-13T23:05:01.074608+0000","last_unstale":"2024-09-13T23:08:33.410232+0000","last_undegraded":"2024-09-13T23:08:33.410232+0000","last_fullsized":"2024-09-13T23:08:33.410232+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097176599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.410255+0000","last_change":"2024-09-13T23:05:12.147068+0000","last_active":"2024-09-13T23:08:33.410255+0000","last_peered":"2024-09-13T23:08:33.410255+0000","last_clean":"2024-09-13T23:08:33.410255+0000","last_became_active":"2024-09-13T23:05:12.146438+0000","last_became_peered":"2024-09-13T23:05:12.146438+0000","last_unstale":"2024-09-13T23:08:33.410255+0000","last_undegraded":"2024-09-13T23:08:33.410255+0000","last_fullsized":"2024-09-13T23:08:33.410255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:48.172057+0000","last_change":"2024-09-13T23:08:48.172057+0000","last_active":"2024-09-13T23:08:48.172057+0000","last_peered":"2024-09-13T23:08:48.172057+0000","last_clean":"2024-09-13T23:08:48.172057+0000","last_became_active":"2024-09-13T23:05:16.115599+0000","last_became_peered":"2024-09-13T23:05:16.115599+0000","last_unstale":"2024-09-13T23:08:48.172057+0000","last_undegraded":"2024-09-13T23:08:48.172057+0000","last_fullsized":"2024-09-13T23:08:48.172057+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:48.171913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:48.171913+0000","last_clean_scrub_stamp":"2024-09-13T23:08:48.171913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:18.538546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'90","reported_seq":180,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:59.300087+0000","last_change":"2024-09-13T23:08:59.300155+0000","last_active":"2024-09-13T23:08:59.300087+0000","last_peered":"2024-09-13T23:08:59.300087+0000","last_clean":"2024-09-13T23:08:59.300087+0000","last_became_active":"2024-09-13T23:05:18.135080+0000","last_became_peered":"2024-09-13T23:05:18.135080+0000","last_unstale":"2024-09-13T23:08:59.300087+0000","last_undegraded":"2024-09-13T23:08:59.300087+0000","last_fullsized":"2024-09-13T23:08:59.300087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'90","last_scrub_stamp":"2024-09-13T23:08:59.299983+0000","last_deep_scrub":"34'90","last_deep_scrub_stamp":"2024-09-13T23:08:59.299983+0000","last_clean_scrub_stamp":"2024-09-13T23:08:59.299983+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:55:55.335307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:38.028204+0000","last_change":"2024-09-13T23:08:38.028280+0000","last_active":"2024-09-13T23:08:38.028204+0000","last_peered":"2024-09-13T23:08:38.028204+0000","last_clean":"2024-09-13T23:08:38.028204+0000","last_became_active":"2024-09-13T23:05:20.139399+0000","last_became_peered":"2024-09-13T23:05:20.139399+0000","last_unstale":"2024-09-13T23:08:38.028204+0000","last_undegraded":"2024-09-13T23:08:38.028204+0000","last_fullsized":"2024-09-13T23:08:38.028204+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:38.028097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:38.028097+0000","last_clean_scrub_stamp":"2024-09-13T23:08:38.028097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:47.384593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'87","reported_seq":180,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:50.698918+0000","last_change":"2024-09-13T23:08:50.698944+0000","last_active":"2024-09-13T23:08:50.698918+0000","last_peered":"2024-09-13T23:08:50.698918+0000","last_clean":"2024-09-13T23:08:50.698918+0000","last_became_active":"2024-09-13T23:05:22.140430+0000","last_became_peered":"2024-09-13T23:05:22.140430+0000","last_unstale":"2024-09-13T23:08:50.698918+0000","last_undegraded":"2024-09-13T23:08:50.698918+0000","last_fullsized":"2024-09-13T23:08:50.698918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'87","last_scrub_stamp":"2024-09-13T23:08:50.698827+0000","last_deep_scrub":"34'87","last_deep_scrub_stamp":"2024-09-13T23:08:50.698827+0000","last_clean_scrub_stamp":"2024-09-13T23:08:50.698827+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:09.410253+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":226,"num_write":170,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:13.223198+0000","last_change":"2024-09-13T23:09:13.223224+0000","last_active":"2024-09-13T23:09:13.223198+0000","last_peered":"2024-09-13T23:09:13.223198+0000","last_clean":"2024-09-13T23:09:13.223198+0000","last_became_active":"2024-09-13T23:05:14.112711+0000","last_became_peered":"2024-09-13T23:05:14.112711+0000","last_unstale":"2024-09-13T23:09:13.223198+0000","last_undegraded":"2024-09-13T23:09:13.223198+0000","last_fullsized":"2024-09-13T23:09:13.223198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:13.223105+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:13.223105+0000","last_clean_scrub_stamp":"2024-09-13T23:09:13.223105+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:32.575985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.410193+0000","last_change":"2024-09-13T23:05:03.078145+0000","last_active":"2024-09-13T23:08:33.410193+0000","last_peered":"2024-09-13T23:08:33.410193+0000","last_clean":"2024-09-13T23:08:33.410193+0000","last_became_active":"2024-09-13T23:05:01.075438+0000","last_became_peered":"2024-09-13T23:05:01.075438+0000","last_unstale":"2024-09-13T23:08:33.410193+0000","last_undegraded":"2024-09-13T23:08:33.410193+0000","last_fullsized":"2024-09-13T23:08:33.410193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043480299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:24.381895+0000","last_change":"2024-09-13T23:09:24.381922+0000","last_active":"2024-09-13T23:09:24.381895+0000","last_peered":"2024-09-13T23:09:24.381895+0000","last_clean":"2024-09-13T23:09:24.381895+0000","last_became_active":"2024-09-13T23:05:12.114087+0000","last_became_peered":"2024-09-13T23:05:12.114087+0000","last_unstale":"2024-09-13T23:09:24.381895+0000","last_undegraded":"2024-09-13T23:09:24.381895+0000","last_fullsized":"2024-09-13T23:09:24.381895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:24.381778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:24.381778+0000","last_clean_scrub_stamp":"2024-09-13T23:09:24.381778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:16:36.593180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:36.535774+0000","last_change":"2024-09-13T23:08:36.535799+0000","last_active":"2024-09-13T23:08:36.535774+0000","last_peered":"2024-09-13T23:08:36.535774+0000","last_clean":"2024-09-13T23:08:36.535774+0000","last_became_active":"2024-09-13T23:05:16.127404+0000","last_became_peered":"2024-09-13T23:05:16.127404+0000","last_unstale":"2024-09-13T23:08:36.535774+0000","last_undegraded":"2024-09-13T23:08:36.535774+0000","last_fullsized":"2024-09-13T23:08:36.535774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:36.535683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:36.535683+0000","last_clean_scrub_stamp":"2024-09-13T23:08:36.535683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:53.587715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'291","reported_seq":517,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.140621+0000","last_change":"2024-09-13T23:08:33.140621+0000","last_active":"2024-09-13T23:08:33.140621+0000","last_peered":"2024-09-13T23:08:33.140621+0000","last_clean":"2024-09-13T23:08:33.140621+0000","last_became_active":"2024-09-13T23:05:18.135536+0000","last_became_peered":"2024-09-13T23:05:18.135536+0000","last_unstale":"2024-09-13T23:08:33.140621+0000","last_undegraded":"2024-09-13T23:08:33.140621+0000","last_fullsized":"2024-09-13T23:08:33.140621+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'291","last_scrub_stamp":"2024-09-13T23:08:33.140485+0000","last_deep_scrub":"34'291","last_deep_scrub_stamp":"2024-09-13T23:08:33.140485+0000","last_clean_scrub_stamp":"2024-09-13T23:08:33.140485+0000","objects_scrubbed":10,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:37:26.815426+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:54.455735+0000","last_change":"2024-09-13T23:08:54.455735+0000","last_active":"2024-09-13T23:08:54.455735+0000","last_peered":"2024-09-13T23:08:54.455735+0000","last_clean":"2024-09-13T23:08:54.455735+0000","last_became_active":"2024-09-13T23:05:20.138840+0000","last_became_peered":"2024-09-13T23:05:20.138840+0000","last_unstale":"2024-09-13T23:08:54.455735+0000","last_undegraded":"2024-09-13T23:08:54.455735+0000","last_fullsized":"2024-09-13T23:08:54.455735+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:54.455627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:54.455627+0000","last_clean_scrub_stamp":"2024-09-13T23:08:54.455627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:31:31.023076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'5","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:32.247152+0000","last_change":"2024-09-13T23:09:32.247198+0000","last_active":"2024-09-13T23:09:32.247152+0000","last_peered":"2024-09-13T23:09:32.247152+0000","last_clean":"2024-09-13T23:09:32.247152+0000","last_became_active":"2024-09-13T23:05:22.149430+0000","last_became_peered":"2024-09-13T23:05:22.149430+0000","last_unstale":"2024-09-13T23:09:32.247152+0000","last_undegraded":"2024-09-13T23:09:32.247152+0000","last_fullsized":"2024-09-13T23:09:32.247152+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T23:09:32.247041+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T23:09:32.247041+0000","last_clean_scrub_stamp":"2024-09-13T23:09:32.247041+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:21.959299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:01.252393+0000","last_change":"2024-09-13T23:09:01.252393+0000","last_active":"2024-09-13T23:09:01.252393+0000","last_peered":"2024-09-13T23:09:01.252393+0000","last_clean":"2024-09-13T23:09:01.252393+0000","last_became_active":"2024-09-13T23:05:14.121629+0000","last_became_peered":"2024-09-13T23:05:14.121629+0000","last_unstale":"2024-09-13T23:09:01.252393+0000","last_undegraded":"2024-09-13T23:09:01.252393+0000","last_fullsized":"2024-09-13T23:09:01.252393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:01.252231+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:01.252231+0000","last_clean_scrub_stamp":"2024-09-13T23:09:01.252231+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:41.769830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:12.723915+0000","last_change":"2024-09-13T23:09:12.723941+0000","last_active":"2024-09-13T23:09:12.723915+0000","last_peered":"2024-09-13T23:09:12.723915+0000","last_clean":"2024-09-13T23:09:12.723915+0000","last_became_active":"2024-09-13T23:05:01.075422+0000","last_became_peered":"2024-09-13T23:05:01.075422+0000","last_unstale":"2024-09-13T23:09:12.723915+0000","last_undegraded":"2024-09-13T23:09:12.723915+0000","last_fullsized":"2024-09-13T23:09:12.723915+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:12.723822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:12.723822+0000","last_clean_scrub_stamp":"2024-09-13T23:09:12.723822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:56.432213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049267099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:26.348988+0000","last_change":"2024-09-13T23:09:26.349035+0000","last_active":"2024-09-13T23:09:26.348988+0000","last_peered":"2024-09-13T23:09:26.348988+0000","last_clean":"2024-09-13T23:09:26.348988+0000","last_became_active":"2024-09-13T23:05:12.117940+0000","last_became_peered":"2024-09-13T23:05:12.117940+0000","last_unstale":"2024-09-13T23:09:26.348988+0000","last_undegraded":"2024-09-13T23:09:26.348988+0000","last_fullsized":"2024-09-13T23:09:26.348988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T23:09:26.348876+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T23:09:26.348876+0000","last_clean_scrub_stamp":"2024-09-13T23:09:26.348876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:19.985644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:52.616476+0000","last_change":"2024-09-13T23:08:52.616505+0000","last_active":"2024-09-13T23:08:52.616476+0000","last_peered":"2024-09-13T23:08:52.616476+0000","last_clean":"2024-09-13T23:08:52.616476+0000","last_became_active":"2024-09-13T23:05:16.122318+0000","last_became_peered":"2024-09-13T23:05:16.122318+0000","last_unstale":"2024-09-13T23:08:52.616476+0000","last_undegraded":"2024-09-13T23:08:52.616476+0000","last_fullsized":"2024-09-13T23:08:52.616476+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:08:52.616388+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:08:52.616388+0000","last_clean_scrub_stamp":"2024-09-13T23:08:52.616388+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:55:21.961122+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'23","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:43.618923+0000","last_change":"2024-09-13T23:08:43.618923+0000","last_active":"2024-09-13T23:08:43.618923+0000","last_peered":"2024-09-13T23:08:43.618923+0000","last_clean":"2024-09-13T23:08:43.618923+0000","last_became_active":"2024-09-13T23:05:18.127698+0000","last_became_peered":"2024-09-13T23:05:18.127698+0000","last_unstale":"2024-09-13T23:08:43.618923+0000","last_undegraded":"2024-09-13T23:08:43.618923+0000","last_fullsized":"2024-09-13T23:08:43.618923+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-09-13T23:08:43.618795+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-09-13T23:08:43.618795+0000","last_clean_scrub_stamp":"2024-09-13T23:08:43.618795+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:08.067385+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:54.192277+0000","last_change":"2024-09-13T23:08:54.192277+0000","last_active":"2024-09-13T23:08:54.192277+0000","last_peered":"2024-09-13T23:08:54.192277+0000","last_clean":"2024-09-13T23:08:54.192277+0000","last_became_active":"2024-09-13T23:05:20.145330+0000","last_became_peered":"2024-09-13T23:05:20.145330+0000","last_unstale":"2024-09-13T23:08:54.192277+0000","last_undegraded":"2024-09-13T23:08:54.192277+0000","last_fullsized":"2024-09-13T23:08:54.192277+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:54.192167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:54.192167+0000","last_clean_scrub_stamp":"2024-09-13T23:08:54.192167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:57.546243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:16.209463+0000","last_change":"2024-09-13T23:09:16.209490+0000","last_active":"2024-09-13T23:09:16.209463+0000","last_peered":"2024-09-13T23:09:16.209463+0000","last_clean":"2024-09-13T23:09:16.209463+0000","last_became_active":"2024-09-13T23:05:22.138259+0000","last_became_peered":"2024-09-13T23:05:22.138259+0000","last_unstale":"2024-09-13T23:09:16.209463+0000","last_undegraded":"2024-09-13T23:09:16.209463+0000","last_fullsized":"2024-09-13T23:09:16.209463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T23:09:16.209368+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T23:09:16.209368+0000","last_clean_scrub_stamp":"2024-09-13T23:09:16.209368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:00.653752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'6","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:06.214718+0000","last_change":"2024-09-13T23:09:06.214718+0000","last_active":"2024-09-13T23:09:06.214718+0000","last_peered":"2024-09-13T23:09:06.214718+0000","last_clean":"2024-09-13T23:09:06.214718+0000","last_became_active":"2024-09-13T23:05:14.110532+0000","last_became_peered":"2024-09-13T23:05:14.110532+0000","last_unstale":"2024-09-13T23:09:06.214718+0000","last_undegraded":"2024-09-13T23:09:06.214718+0000","last_fullsized":"2024-09-13T23:09:06.214718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:06.214603+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:06.214603+0000","last_clean_scrub_stamp":"2024-09-13T23:09:06.214603+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:32.509898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.410219+0000","last_change":"2024-09-13T23:05:03.078756+0000","last_active":"2024-09-13T23:08:33.410219+0000","last_peered":"2024-09-13T23:08:33.410219+0000","last_clean":"2024-09-13T23:08:33.410219+0000","last_became_active":"2024-09-13T23:05:01.075399+0000","last_became_peered":"2024-09-13T23:05:01.075399+0000","last_unstale":"2024-09-13T23:08:33.410219+0000","last_undegraded":"2024-09-13T23:08:33.410219+0000","last_fullsized":"2024-09-13T23:08:33.410219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010379530000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:03.637970+0000","last_change":"2024-09-13T23:09:03.637970+0000","last_active":"2024-09-13T23:09:03.637970+0000","last_peered":"2024-09-13T23:09:03.637970+0000","last_clean":"2024-09-13T23:09:03.637970+0000","last_became_active":"2024-09-13T23:05:12.130410+0000","last_became_peered":"2024-09-13T23:05:12.130410+0000","last_unstale":"2024-09-13T23:09:03.637970+0000","last_undegraded":"2024-09-13T23:09:03.637970+0000","last_fullsized":"2024-09-13T23:09:03.637970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:03.637848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:03.637848+0000","last_clean_scrub_stamp":"2024-09-13T23:09:03.637848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:25.877408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:49.163497+0000","last_change":"2024-09-13T23:08:49.163497+0000","last_active":"2024-09-13T23:08:49.163497+0000","last_peered":"2024-09-13T23:08:49.163497+0000","last_clean":"2024-09-13T23:08:49.163497+0000","last_became_active":"2024-09-13T23:05:16.123983+0000","last_became_peered":"2024-09-13T23:05:16.123983+0000","last_unstale":"2024-09-13T23:08:49.163497+0000","last_undegraded":"2024-09-13T23:08:49.163497+0000","last_fullsized":"2024-09-13T23:08:49.163497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:49.163347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:49.163347+0000","last_clean_scrub_stamp":"2024-09-13T23:08:49.163347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:37:31.793295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:52.437499+0000","last_change":"2024-09-13T23:08:52.437554+0000","last_active":"2024-09-13T23:08:52.437499+0000","last_peered":"2024-09-13T23:08:52.437499+0000","last_clean":"2024-09-13T23:08:52.437499+0000","last_became_active":"2024-09-13T23:05:18.133165+0000","last_became_peered":"2024-09-13T23:05:18.133165+0000","last_unstale":"2024-09-13T23:08:52.437499+0000","last_undegraded":"2024-09-13T23:08:52.437499+0000","last_fullsized":"2024-09-13T23:08:52.437499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-13T23:08:52.437407+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-13T23:08:52.437407+0000","last_clean_scrub_stamp":"2024-09-13T23:08:52.437407+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:53:28.383722+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:12.267217+0000","last_change":"2024-09-13T23:09:12.267243+0000","last_active":"2024-09-13T23:09:12.267217+0000","last_peered":"2024-09-13T23:09:12.267217+0000","last_clean":"2024-09-13T23:09:12.267217+0000","last_became_active":"2024-09-13T23:05:20.143748+0000","last_became_peered":"2024-09-13T23:05:20.143748+0000","last_unstale":"2024-09-13T23:09:12.267217+0000","last_undegraded":"2024-09-13T23:09:12.267217+0000","last_fullsized":"2024-09-13T23:09:12.267217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:12.267122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:12.267122+0000","last_clean_scrub_stamp":"2024-09-13T23:09:12.267122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:08:33.359140+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:33.076591+0000","last_change":"2024-09-13T23:05:22.150796+0000","last_active":"2024-09-13T23:07:33.076591+0000","last_peered":"2024-09-13T23:07:33.076591+0000","last_clean":"2024-09-13T23:07:33.076591+0000","last_became_active":"2024-09-13T23:05:22.150415+0000","last_became_peered":"2024-09-13T23:05:22.150415+0000","last_unstale":"2024-09-13T23:07:33.076591+0000","last_undegraded":"2024-09-13T23:07:33.076591+0000","last_fullsized":"2024-09-13T23:07:33.076591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:15.113820+0000","last_change":"2024-09-13T23:09:15.113820+0000","last_active":"2024-09-13T23:09:15.113820+0000","last_peered":"2024-09-13T23:09:15.113820+0000","last_clean":"2024-09-13T23:09:15.113820+0000","last_became_active":"2024-09-13T23:05:14.123447+0000","last_became_peered":"2024-09-13T23:05:14.123447+0000","last_unstale":"2024-09-13T23:09:15.113820+0000","last_undegraded":"2024-09-13T23:09:15.113820+0000","last_fullsized":"2024-09-13T23:09:15.113820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:15.113706+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:15.113706+0000","last_clean_scrub_stamp":"2024-09-13T23:09:15.113706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:13.411504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:19.753286+0000","last_change":"2024-09-13T23:09:19.753286+0000","last_active":"2024-09-13T23:09:19.753286+0000","last_peered":"2024-09-13T23:09:19.753286+0000","last_clean":"2024-09-13T23:09:19.753286+0000","last_became_active":"2024-09-13T23:05:12.124005+0000","last_became_peered":"2024-09-13T23:05:12.124005+0000","last_unstale":"2024-09-13T23:09:19.753286+0000","last_undegraded":"2024-09-13T23:09:19.753286+0000","last_fullsized":"2024-09-13T23:09:19.753286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:19.753136+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:19.753136+0000","last_clean_scrub_stamp":"2024-09-13T23:09:19.753136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:12.048042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:20.345527+0000","last_change":"2024-09-13T23:09:20.345552+0000","last_active":"2024-09-13T23:09:20.345527+0000","last_peered":"2024-09-13T23:09:20.345527+0000","last_clean":"2024-09-13T23:09:20.345527+0000","last_became_active":"2024-09-13T23:05:01.074963+0000","last_became_peered":"2024-09-13T23:05:01.074963+0000","last_unstale":"2024-09-13T23:09:20.345527+0000","last_undegraded":"2024-09-13T23:09:20.345527+0000","last_fullsized":"2024-09-13T23:09:20.345527+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:20.345432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:20.345432+0000","last_clean_scrub_stamp":"2024-09-13T23:09:20.345432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:43.886868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055235699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:51.145619+0000","last_change":"2024-09-13T23:08:51.145619+0000","last_active":"2024-09-13T23:08:51.145619+0000","last_peered":"2024-09-13T23:08:51.145619+0000","last_clean":"2024-09-13T23:08:51.145619+0000","last_became_active":"2024-09-13T23:05:16.123971+0000","last_became_peered":"2024-09-13T23:05:16.123971+0000","last_unstale":"2024-09-13T23:08:51.145619+0000","last_undegraded":"2024-09-13T23:08:51.145619+0000","last_fullsized":"2024-09-13T23:08:51.145619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'1","last_scrub_stamp":"2024-09-13T23:08:51.145496+0000","last_deep_scrub":"34'1","last_deep_scrub_stamp":"2024-09-13T23:08:51.145496+0000","last_clean_scrub_stamp":"2024-09-13T23:08:51.145496+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:32.511958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'73","reported_seq":150,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:43.048564+0000","last_change":"2024-09-13T23:08:43.048564+0000","last_active":"2024-09-13T23:08:43.048564+0000","last_peered":"2024-09-13T23:08:43.048564+0000","last_clean":"2024-09-13T23:08:43.048564+0000","last_became_active":"2024-09-13T23:05:18.132051+0000","last_became_peered":"2024-09-13T23:05:18.132051+0000","last_unstale":"2024-09-13T23:08:43.048564+0000","last_undegraded":"2024-09-13T23:08:43.048564+0000","last_fullsized":"2024-09-13T23:08:43.048564+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'73","last_scrub_stamp":"2024-09-13T23:08:43.048427+0000","last_deep_scrub":"34'73","last_deep_scrub_stamp":"2024-09-13T23:08:43.048427+0000","last_clean_scrub_stamp":"2024-09-13T23:08:43.048427+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:30.653285+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:34.656091+0000","last_change":"2024-09-13T23:08:34.656091+0000","last_active":"2024-09-13T23:08:34.656091+0000","last_peered":"2024-09-13T23:08:34.656091+0000","last_clean":"2024-09-13T23:08:34.656091+0000","last_became_active":"2024-09-13T23:05:20.143566+0000","last_became_peered":"2024-09-13T23:05:20.143566+0000","last_unstale":"2024-09-13T23:08:34.656091+0000","last_undegraded":"2024-09-13T23:08:34.656091+0000","last_fullsized":"2024-09-13T23:08:34.656091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:34.655943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:34.655943+0000","last_clean_scrub_stamp":"2024-09-13T23:08:34.655943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:57.192299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'12","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:02.264101+0000","last_change":"2024-09-13T23:09:02.264138+0000","last_active":"2024-09-13T23:09:02.264101+0000","last_peered":"2024-09-13T23:09:02.264101+0000","last_clean":"2024-09-13T23:09:02.264101+0000","last_became_active":"2024-09-13T23:05:22.137952+0000","last_became_peered":"2024-09-13T23:05:22.137952+0000","last_unstale":"2024-09-13T23:09:02.264101+0000","last_undegraded":"2024-09-13T23:09:02.264101+0000","last_fullsized":"2024-09-13T23:09:02.264101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T23:09:02.264003+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T23:09:02.264003+0000","last_clean_scrub_stamp":"2024-09-13T23:09:02.264003+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:12.926079+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:58.060890+0000","last_change":"2024-09-13T23:08:58.060890+0000","last_active":"2024-09-13T23:08:58.060890+0000","last_peered":"2024-09-13T23:08:58.060890+0000","last_clean":"2024-09-13T23:08:58.060890+0000","last_became_active":"2024-09-13T23:05:14.123549+0000","last_became_peered":"2024-09-13T23:05:14.123549+0000","last_unstale":"2024-09-13T23:08:58.060890+0000","last_undegraded":"2024-09-13T23:08:58.060890+0000","last_fullsized":"2024-09-13T23:08:58.060890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:08:58.060770+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:08:58.060770+0000","last_clean_scrub_stamp":"2024-09-13T23:08:58.060770+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:37:59.977042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:05.222854+0000","last_change":"2024-09-13T23:09:05.222854+0000","last_active":"2024-09-13T23:09:05.222854+0000","last_peered":"2024-09-13T23:09:05.222854+0000","last_clean":"2024-09-13T23:09:05.222854+0000","last_became_active":"2024-09-13T23:05:12.130285+0000","last_became_peered":"2024-09-13T23:05:12.130285+0000","last_unstale":"2024-09-13T23:09:05.222854+0000","last_undegraded":"2024-09-13T23:09:05.222854+0000","last_fullsized":"2024-09-13T23:09:05.222854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:05.222712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:05.222712+0000","last_clean_scrub_stamp":"2024-09-13T23:09:05.222712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:59.676566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.410215+0000","last_change":"2024-09-13T23:05:03.078119+0000","last_active":"2024-09-13T23:08:33.410215+0000","last_peered":"2024-09-13T23:08:33.410215+0000","last_clean":"2024-09-13T23:08:33.410215+0000","last_became_active":"2024-09-13T23:05:01.075431+0000","last_became_peered":"2024-09-13T23:05:01.075431+0000","last_unstale":"2024-09-13T23:08:33.410215+0000","last_undegraded":"2024-09-13T23:08:33.410215+0000","last_fullsized":"2024-09-13T23:08:33.410215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041474900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:43.475069+0000","last_change":"2024-09-13T23:08:43.475069+0000","last_active":"2024-09-13T23:08:43.475069+0000","last_peered":"2024-09-13T23:08:43.475069+0000","last_clean":"2024-09-13T23:08:43.475069+0000","last_became_active":"2024-09-13T23:05:16.120337+0000","last_became_peered":"2024-09-13T23:05:16.120337+0000","last_unstale":"2024-09-13T23:08:43.475069+0000","last_undegraded":"2024-09-13T23:08:43.475069+0000","last_fullsized":"2024-09-13T23:08:43.475069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:43.474930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:43.474930+0000","last_clean_scrub_stamp":"2024-09-13T23:08:43.474930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:26.685113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'23","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:34.131801+0000","last_change":"2024-09-13T23:08:34.131801+0000","last_active":"2024-09-13T23:08:34.131801+0000","last_peered":"2024-09-13T23:08:34.131801+0000","last_clean":"2024-09-13T23:08:34.131801+0000","last_became_active":"2024-09-13T23:05:18.133676+0000","last_became_peered":"2024-09-13T23:05:18.133676+0000","last_unstale":"2024-09-13T23:08:34.131801+0000","last_undegraded":"2024-09-13T23:08:34.131801+0000","last_fullsized":"2024-09-13T23:08:34.131801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-09-13T23:08:34.131649+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-09-13T23:08:34.131649+0000","last_clean_scrub_stamp":"2024-09-13T23:08:34.131649+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:29.113824+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":368,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:45.156231+0000","last_change":"2024-09-13T23:08:45.156231+0000","last_active":"2024-09-13T23:08:45.156231+0000","last_peered":"2024-09-13T23:08:45.156231+0000","last_clean":"2024-09-13T23:08:45.156231+0000","last_became_active":"2024-09-13T23:05:20.133332+0000","last_became_peered":"2024-09-13T23:05:20.133332+0000","last_unstale":"2024-09-13T23:08:45.156231+0000","last_undegraded":"2024-09-13T23:08:45.156231+0000","last_fullsized":"2024-09-13T23:08:45.156231+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:45.156073+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:45.156073+0000","last_clean_scrub_stamp":"2024-09-13T23:08:45.156073+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:16:24.872283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:24.293553+0000","last_change":"2024-09-13T23:09:24.293596+0000","last_active":"2024-09-13T23:09:24.293553+0000","last_peered":"2024-09-13T23:09:24.293553+0000","last_clean":"2024-09-13T23:09:24.293553+0000","last_became_active":"2024-09-13T23:05:22.141618+0000","last_became_peered":"2024-09-13T23:05:22.141618+0000","last_unstale":"2024-09-13T23:09:24.293553+0000","last_undegraded":"2024-09-13T23:09:24.293553+0000","last_fullsized":"2024-09-13T23:09:24.293553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T23:09:24.293416+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T23:09:24.293416+0000","last_clean_scrub_stamp":"2024-09-13T23:09:24.293416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:41:09.258166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'18","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:49.406065+0000","last_change":"2024-09-13T23:08:49.406065+0000","last_active":"2024-09-13T23:08:49.406065+0000","last_peered":"2024-09-13T23:08:49.406065+0000","last_clean":"2024-09-13T23:08:49.406065+0000","last_became_active":"2024-09-13T23:05:14.126280+0000","last_became_peered":"2024-09-13T23:05:14.126280+0000","last_unstale":"2024-09-13T23:08:49.406065+0000","last_undegraded":"2024-09-13T23:08:49.406065+0000","last_fullsized":"2024-09-13T23:08:49.406065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-13T23:08:49.405905+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-13T23:08:49.405905+0000","last_clean_scrub_stamp":"2024-09-13T23:08:49.405905+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:10.813213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:23.257282+0000","last_change":"2024-09-13T23:09:23.257282+0000","last_active":"2024-09-13T23:09:23.257282+0000","last_peered":"2024-09-13T23:09:23.257282+0000","last_clean":"2024-09-13T23:09:23.257282+0000","last_became_active":"2024-09-13T23:05:12.149435+0000","last_became_peered":"2024-09-13T23:05:12.149435+0000","last_unstale":"2024-09-13T23:09:23.257282+0000","last_undegraded":"2024-09-13T23:09:23.257282+0000","last_fullsized":"2024-09-13T23:09:23.257282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:23.257153+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:23.257153+0000","last_clean_scrub_stamp":"2024-09-13T23:09:23.257153+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:07:06.968192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:21.344821+0000","last_change":"2024-09-13T23:09:21.344821+0000","last_active":"2024-09-13T23:09:21.344821+0000","last_peered":"2024-09-13T23:09:21.344821+0000","last_clean":"2024-09-13T23:09:21.344821+0000","last_became_active":"2024-09-13T23:05:01.074982+0000","last_became_peered":"2024-09-13T23:05:01.074982+0000","last_unstale":"2024-09-13T23:09:21.344821+0000","last_undegraded":"2024-09-13T23:09:21.344821+0000","last_fullsized":"2024-09-13T23:09:21.344821+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:21.344698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:21.344698+0000","last_clean_scrub_stamp":"2024-09-13T23:09:21.344698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:56.827745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054650599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:35.535037+0000","last_change":"2024-09-13T23:08:35.535037+0000","last_active":"2024-09-13T23:08:35.535037+0000","last_peered":"2024-09-13T23:08:35.535037+0000","last_clean":"2024-09-13T23:08:35.535037+0000","last_became_active":"2024-09-13T23:05:16.123573+0000","last_became_peered":"2024-09-13T23:05:16.123573+0000","last_unstale":"2024-09-13T23:08:35.535037+0000","last_undegraded":"2024-09-13T23:08:35.535037+0000","last_fullsized":"2024-09-13T23:08:35.535037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:35.534875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:35.534875+0000","last_clean_scrub_stamp":"2024-09-13T23:08:35.534875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:03:04.742631+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:05.270708+0000","last_change":"2024-09-13T23:09:05.270708+0000","last_active":"2024-09-13T23:09:05.270708+0000","last_peered":"2024-09-13T23:09:05.270708+0000","last_clean":"2024-09-13T23:09:05.270708+0000","last_became_active":"2024-09-13T23:05:18.132140+0000","last_became_peered":"2024-09-13T23:05:18.132140+0000","last_unstale":"2024-09-13T23:09:05.270708+0000","last_undegraded":"2024-09-13T23:09:05.270708+0000","last_fullsized":"2024-09-13T23:09:05.270708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:09:05.270587+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:09:05.270587+0000","last_clean_scrub_stamp":"2024-09-13T23:09:05.270587+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:38.747157+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":442,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:34.964488+0000","last_change":"2024-09-13T23:08:34.964488+0000","last_active":"2024-09-13T23:08:34.964488+0000","last_peered":"2024-09-13T23:08:34.964488+0000","last_clean":"2024-09-13T23:08:34.964488+0000","last_became_active":"2024-09-13T23:05:20.136036+0000","last_became_peered":"2024-09-13T23:05:20.136036+0000","last_unstale":"2024-09-13T23:08:34.964488+0000","last_undegraded":"2024-09-13T23:08:34.964488+0000","last_fullsized":"2024-09-13T23:08:34.964488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:34.964357+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:34.964357+0000","last_clean_scrub_stamp":"2024-09-13T23:08:34.964357+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:48:39.411891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:28.132149+0000","last_change":"2024-09-13T23:09:28.132177+0000","last_active":"2024-09-13T23:09:28.132149+0000","last_peered":"2024-09-13T23:09:28.132149+0000","last_clean":"2024-09-13T23:09:28.132149+0000","last_became_active":"2024-09-13T23:05:22.144787+0000","last_became_peered":"2024-09-13T23:05:22.144787+0000","last_unstale":"2024-09-13T23:09:28.132149+0000","last_undegraded":"2024-09-13T23:09:28.132149+0000","last_fullsized":"2024-09-13T23:09:28.132149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-13T23:09:28.132051+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-13T23:09:28.132051+0000","last_clean_scrub_stamp":"2024-09-13T23:09:28.132051+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:55.955992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:00.592608+0000","last_change":"2024-09-13T23:09:00.592608+0000","last_active":"2024-09-13T23:09:00.592608+0000","last_peered":"2024-09-13T23:09:00.592608+0000","last_clean":"2024-09-13T23:09:00.592608+0000","last_became_active":"2024-09-13T23:05:14.112565+0000","last_became_peered":"2024-09-13T23:05:14.112565+0000","last_unstale":"2024-09-13T23:09:00.592608+0000","last_undegraded":"2024-09-13T23:09:00.592608+0000","last_fullsized":"2024-09-13T23:09:00.592608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:09:00.592449+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:09:00.592449+0000","last_clean_scrub_stamp":"2024-09-13T23:09:00.592449+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:17.593917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:21.106351+0000","last_change":"2024-09-13T23:09:21.106351+0000","last_active":"2024-09-13T23:09:21.106351+0000","last_peered":"2024-09-13T23:09:21.106351+0000","last_clean":"2024-09-13T23:09:21.106351+0000","last_became_active":"2024-09-13T23:05:12.131413+0000","last_became_peered":"2024-09-13T23:05:12.131413+0000","last_unstale":"2024-09-13T23:09:21.106351+0000","last_undegraded":"2024-09-13T23:09:21.106351+0000","last_fullsized":"2024-09-13T23:09:21.106351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:21.106185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:21.106185+0000","last_clean_scrub_stamp":"2024-09-13T23:09:21.106185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:06.617902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.410239+0000","last_change":"2024-09-13T23:05:03.078956+0000","last_active":"2024-09-13T23:08:33.410239+0000","last_peered":"2024-09-13T23:08:33.410239+0000","last_clean":"2024-09-13T23:08:33.410239+0000","last_became_active":"2024-09-13T23:05:01.323761+0000","last_became_peered":"2024-09-13T23:05:01.323761+0000","last_unstale":"2024-09-13T23:08:33.410239+0000","last_undegraded":"2024-09-13T23:08:33.410239+0000","last_fullsized":"2024-09-13T23:08:33.410239+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:00.063955+0000","last_clean_scrub_stamp":"2024-09-13T23:05:00.063955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001181893,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:42.524284+0000","last_change":"2024-09-13T23:08:42.524284+0000","last_active":"2024-09-13T23:08:42.524284+0000","last_peered":"2024-09-13T23:08:42.524284+0000","last_clean":"2024-09-13T23:08:42.524284+0000","last_became_active":"2024-09-13T23:05:16.120974+0000","last_became_peered":"2024-09-13T23:05:16.120974+0000","last_unstale":"2024-09-13T23:08:42.524284+0000","last_undegraded":"2024-09-13T23:08:42.524284+0000","last_fullsized":"2024-09-13T23:08:42.524284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:42.524136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:42.524136+0000","last_clean_scrub_stamp":"2024-09-13T23:08:42.524136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:38.191251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'96","reported_seq":190,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:37.565659+0000","last_change":"2024-09-13T23:08:37.565659+0000","last_active":"2024-09-13T23:08:37.565659+0000","last_peered":"2024-09-13T23:08:37.565659+0000","last_clean":"2024-09-13T23:08:37.565659+0000","last_became_active":"2024-09-13T23:05:18.137925+0000","last_became_peered":"2024-09-13T23:05:18.137925+0000","last_unstale":"2024-09-13T23:08:37.565659+0000","last_undegraded":"2024-09-13T23:08:37.565659+0000","last_fullsized":"2024-09-13T23:08:37.565659+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'96","last_scrub_stamp":"2024-09-13T23:08:37.565507+0000","last_deep_scrub":"34'96","last_deep_scrub_stamp":"2024-09-13T23:08:37.565507+0000","last_clean_scrub_stamp":"2024-09-13T23:08:37.565507+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:03:42.806653+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:39.048948+0000","last_change":"2024-09-13T23:08:39.048948+0000","last_active":"2024-09-13T23:08:39.048948+0000","last_peered":"2024-09-13T23:08:39.048948+0000","last_clean":"2024-09-13T23:08:39.048948+0000","last_became_active":"2024-09-13T23:05:20.129363+0000","last_became_peered":"2024-09-13T23:05:20.129363+0000","last_unstale":"2024-09-13T23:08:39.048948+0000","last_undegraded":"2024-09-13T23:08:39.048948+0000","last_fullsized":"2024-09-13T23:08:39.048948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:39.048809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:39.048809+0000","last_clean_scrub_stamp":"2024-09-13T23:08:39.048809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:47.267359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:22.774752+0000","last_change":"2024-09-13T23:09:22.774774+0000","last_active":"2024-09-13T23:09:22.774752+0000","last_peered":"2024-09-13T23:09:22.774752+0000","last_clean":"2024-09-13T23:09:22.774752+0000","last_became_active":"2024-09-13T23:05:22.149645+0000","last_became_peered":"2024-09-13T23:05:22.149645+0000","last_unstale":"2024-09-13T23:09:22.774752+0000","last_undegraded":"2024-09-13T23:09:22.774752+0000","last_fullsized":"2024-09-13T23:09:22.774752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:22.774657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:22.774657+0000","last_clean_scrub_stamp":"2024-09-13T23:09:22.774657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:18:05.391238+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:24.773299+0000","last_change":"2024-09-13T23:09:24.773325+0000","last_active":"2024-09-13T23:09:24.773299+0000","last_peered":"2024-09-13T23:09:24.773299+0000","last_clean":"2024-09-13T23:09:24.773299+0000","last_became_active":"2024-09-13T23:05:22.151640+0000","last_became_peered":"2024-09-13T23:05:22.151640+0000","last_unstale":"2024-09-13T23:09:24.773299+0000","last_undegraded":"2024-09-13T23:09:24.773299+0000","last_fullsized":"2024-09-13T23:09:24.773299+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:24.773213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:24.773213+0000","last_clean_scrub_stamp":"2024-09-13T23:09:24.773213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:46.180521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'12","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:02.595390+0000","last_change":"2024-09-13T23:09:02.595417+0000","last_active":"2024-09-13T23:09:02.595390+0000","last_peered":"2024-09-13T23:09:02.595390+0000","last_clean":"2024-09-13T23:09:02.595390+0000","last_became_active":"2024-09-13T23:05:14.113236+0000","last_became_peered":"2024-09-13T23:05:14.113236+0000","last_unstale":"2024-09-13T23:09:02.595390+0000","last_undegraded":"2024-09-13T23:09:02.595390+0000","last_fullsized":"2024-09-13T23:09:02.595390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T23:09:02.595304+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T23:09:02.595304+0000","last_clean_scrub_stamp":"2024-09-13T23:09:02.595304+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:26.214597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:32.077121+0000","last_change":"2024-09-13T23:05:12.141658+0000","last_active":"2024-09-13T23:07:32.077121+0000","last_peered":"2024-09-13T23:07:32.077121+0000","last_clean":"2024-09-13T23:07:32.077121+0000","last_became_active":"2024-09-13T23:05:12.141280+0000","last_became_peered":"2024-09-13T23:05:12.141280+0000","last_unstale":"2024-09-13T23:07:32.077121+0000","last_undegraded":"2024-09-13T23:07:32.077121+0000","last_fullsized":"2024-09-13T23:07:32.077121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:47.188405+0000","last_change":"2024-09-13T23:08:47.188431+0000","last_active":"2024-09-13T23:08:47.188405+0000","last_peered":"2024-09-13T23:08:47.188405+0000","last_clean":"2024-09-13T23:08:47.188405+0000","last_became_active":"2024-09-13T23:05:16.117468+0000","last_became_peered":"2024-09-13T23:05:16.117468+0000","last_unstale":"2024-09-13T23:08:47.188405+0000","last_undegraded":"2024-09-13T23:08:47.188405+0000","last_fullsized":"2024-09-13T23:08:47.188405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:47.188316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:47.188316+0000","last_clean_scrub_stamp":"2024-09-13T23:08:47.188316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:30:41.738969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'41","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:44.467262+0000","last_change":"2024-09-13T23:08:44.467306+0000","last_active":"2024-09-13T23:08:44.467262+0000","last_peered":"2024-09-13T23:08:44.467262+0000","last_clean":"2024-09-13T23:08:44.467262+0000","last_became_active":"2024-09-13T23:05:18.131841+0000","last_became_peered":"2024-09-13T23:05:18.131841+0000","last_unstale":"2024-09-13T23:08:44.467262+0000","last_undegraded":"2024-09-13T23:08:44.467262+0000","last_fullsized":"2024-09-13T23:08:44.467262+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'41","last_scrub_stamp":"2024-09-13T23:08:44.467169+0000","last_deep_scrub":"34'41","last_deep_scrub_stamp":"2024-09-13T23:08:44.467169+0000","last_clean_scrub_stamp":"2024-09-13T23:08:44.467169+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:11.320136+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:04.223034+0000","last_change":"2024-09-13T23:09:04.223060+0000","last_active":"2024-09-13T23:09:04.223034+0000","last_peered":"2024-09-13T23:09:04.223034+0000","last_clean":"2024-09-13T23:09:04.223034+0000","last_became_active":"2024-09-13T23:05:20.138958+0000","last_became_peered":"2024-09-13T23:05:20.138958+0000","last_unstale":"2024-09-13T23:09:04.223034+0000","last_undegraded":"2024-09-13T23:09:04.223034+0000","last_fullsized":"2024-09-13T23:09:04.223034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:04.222933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:04.222933+0000","last_clean_scrub_stamp":"2024-09-13T23:09:04.222933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:27.241190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'5","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:32.313092+0000","last_change":"2024-09-13T23:09:32.313119+0000","last_active":"2024-09-13T23:09:32.313092+0000","last_peered":"2024-09-13T23:09:32.313092+0000","last_clean":"2024-09-13T23:09:32.313092+0000","last_became_active":"2024-09-13T23:05:22.141471+0000","last_became_peered":"2024-09-13T23:05:22.141471+0000","last_unstale":"2024-09-13T23:09:32.313092+0000","last_undegraded":"2024-09-13T23:09:32.313092+0000","last_fullsized":"2024-09-13T23:09:32.313092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T23:09:32.313000+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T23:09:32.313000+0000","last_clean_scrub_stamp":"2024-09-13T23:09:32.313000+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:13.281073+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'8","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:13.077681+0000","last_change":"2024-09-13T23:09:13.077712+0000","last_active":"2024-09-13T23:09:13.077681+0000","last_peered":"2024-09-13T23:09:13.077681+0000","last_clean":"2024-09-13T23:09:13.077681+0000","last_became_active":"2024-09-13T23:05:49.164131+0000","last_became_peered":"2024-09-13T23:05:49.164131+0000","last_unstale":"2024-09-13T23:09:13.077681+0000","last_undegraded":"2024-09-13T23:09:13.077681+0000","last_fullsized":"2024-09-13T23:09:13.077681+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:09:13.077595+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:09:13.077595+0000","last_clean_scrub_stamp":"2024-09-13T23:09:13.077595+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:46.551346+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:17.758748+0000","last_change":"2024-09-13T23:09:17.758782+0000","last_active":"2024-09-13T23:09:17.758748+0000","last_peered":"2024-09-13T23:09:17.758748+0000","last_clean":"2024-09-13T23:09:17.758748+0000","last_became_active":"2024-09-13T23:05:12.114343+0000","last_became_peered":"2024-09-13T23:05:12.114343+0000","last_unstale":"2024-09-13T23:09:17.758748+0000","last_undegraded":"2024-09-13T23:09:17.758748+0000","last_fullsized":"2024-09-13T23:09:17.758748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:17.758658+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:17.758658+0000","last_clean_scrub_stamp":"2024-09-13T23:09:17.758658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:46:23.065002+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:37.573201+0000","last_change":"2024-09-13T23:08:37.573239+0000","last_active":"2024-09-13T23:08:37.573201+0000","last_peered":"2024-09-13T23:08:37.573201+0000","last_clean":"2024-09-13T23:08:37.573201+0000","last_became_active":"2024-09-13T23:05:49.160578+0000","last_became_peered":"2024-09-13T23:05:49.160578+0000","last_unstale":"2024-09-13T23:08:37.573201+0000","last_undegraded":"2024-09-13T23:08:37.573201+0000","last_fullsized":"2024-09-13T23:08:37.573201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:37.573092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:37.573092+0000","last_clean_scrub_stamp":"2024-09-13T23:08:37.573092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:12:43.684366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:47.139182+0000","last_change":"2024-09-13T23:08:47.139236+0000","last_active":"2024-09-13T23:08:47.139182+0000","last_peered":"2024-09-13T23:08:47.139182+0000","last_clean":"2024-09-13T23:08:47.139182+0000","last_became_active":"2024-09-13T23:05:18.121514+0000","last_became_peered":"2024-09-13T23:05:18.121514+0000","last_unstale":"2024-09-13T23:08:47.139182+0000","last_undegraded":"2024-09-13T23:08:47.139182+0000","last_fullsized":"2024-09-13T23:08:47.139182+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:08:47.139074+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:08:47.139074+0000","last_clean_scrub_stamp":"2024-09-13T23:08:47.139074+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:36.671882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.698449+0000","last_change":"2024-09-13T23:08:33.698474+0000","last_active":"2024-09-13T23:08:33.698449+0000","last_peered":"2024-09-13T23:08:33.698449+0000","last_clean":"2024-09-13T23:08:33.698449+0000","last_became_active":"2024-09-13T23:05:20.140290+0000","last_became_peered":"2024-09-13T23:05:20.140290+0000","last_unstale":"2024-09-13T23:08:33.698449+0000","last_undegraded":"2024-09-13T23:08:33.698449+0000","last_fullsized":"2024-09-13T23:08:33.698449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:33.698356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:33.698356+0000","last_clean_scrub_stamp":"2024-09-13T23:08:33.698356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:32:32.081819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:30.284441+0000","last_change":"2024-09-13T23:09:30.284466+0000","last_active":"2024-09-13T23:09:30.284441+0000","last_peered":"2024-09-13T23:09:30.284441+0000","last_clean":"2024-09-13T23:09:30.284441+0000","last_became_active":"2024-09-13T23:05:22.140963+0000","last_became_peered":"2024-09-13T23:05:22.140963+0000","last_unstale":"2024-09-13T23:09:30.284441+0000","last_undegraded":"2024-09-13T23:09:30.284441+0000","last_fullsized":"2024-09-13T23:09:30.284441+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:30.284347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:30.284347+0000","last_clean_scrub_stamp":"2024-09-13T23:09:30.284347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:55:22.720680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:14.324035+0000","last_change":"2024-09-13T23:09:14.324059+0000","last_active":"2024-09-13T23:09:14.324035+0000","last_peered":"2024-09-13T23:09:14.324035+0000","last_clean":"2024-09-13T23:09:14.324035+0000","last_became_active":"2024-09-13T23:05:14.120354+0000","last_became_peered":"2024-09-13T23:05:14.120354+0000","last_unstale":"2024-09-13T23:09:14.324035+0000","last_undegraded":"2024-09-13T23:09:14.324035+0000","last_fullsized":"2024-09-13T23:09:14.324035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:14.323958+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:14.323958+0000","last_clean_scrub_stamp":"2024-09-13T23:09:14.323958+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:41.259957+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:18.765414+0000","last_change":"2024-09-13T23:09:18.765460+0000","last_active":"2024-09-13T23:09:18.765414+0000","last_peered":"2024-09-13T23:09:18.765414+0000","last_clean":"2024-09-13T23:09:18.765414+0000","last_became_active":"2024-09-13T23:05:12.116819+0000","last_became_peered":"2024-09-13T23:05:12.116819+0000","last_unstale":"2024-09-13T23:09:18.765414+0000","last_undegraded":"2024-09-13T23:09:18.765414+0000","last_fullsized":"2024-09-13T23:09:18.765414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:18.765313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:18.765313+0000","last_clean_scrub_stamp":"2024-09-13T23:09:18.765313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:14.432428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:49.713458+0000","last_change":"2024-09-13T23:08:49.713485+0000","last_active":"2024-09-13T23:08:49.713458+0000","last_peered":"2024-09-13T23:08:49.713458+0000","last_clean":"2024-09-13T23:08:49.713458+0000","last_became_active":"2024-09-13T23:05:16.124617+0000","last_became_peered":"2024-09-13T23:05:16.124617+0000","last_unstale":"2024-09-13T23:08:49.713458+0000","last_undegraded":"2024-09-13T23:08:49.713458+0000","last_fullsized":"2024-09-13T23:08:49.713458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:49.713367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:49.713367+0000","last_clean_scrub_stamp":"2024-09-13T23:08:49.713367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:31.248692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'47","reported_seq":119,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:45.136532+0000","last_change":"2024-09-13T23:08:45.136578+0000","last_active":"2024-09-13T23:08:45.136532+0000","last_peered":"2024-09-13T23:08:45.136532+0000","last_clean":"2024-09-13T23:08:45.136532+0000","last_became_active":"2024-09-13T23:05:18.126147+0000","last_became_peered":"2024-09-13T23:05:18.126147+0000","last_unstale":"2024-09-13T23:08:45.136532+0000","last_undegraded":"2024-09-13T23:08:45.136532+0000","last_fullsized":"2024-09-13T23:08:45.136532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-09-13T23:08:45.136425+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-09-13T23:08:45.136425+0000","last_clean_scrub_stamp":"2024-09-13T23:08:45.136425+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:12:33.611238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:37.125232+0000","last_change":"2024-09-13T23:08:37.125288+0000","last_active":"2024-09-13T23:08:37.125232+0000","last_peered":"2024-09-13T23:08:37.125232+0000","last_clean":"2024-09-13T23:08:37.125232+0000","last_became_active":"2024-09-13T23:05:20.128756+0000","last_became_peered":"2024-09-13T23:05:20.128756+0000","last_unstale":"2024-09-13T23:08:37.125232+0000","last_undegraded":"2024-09-13T23:08:37.125232+0000","last_fullsized":"2024-09-13T23:08:37.125232+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:37.125127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:37.125127+0000","last_clean_scrub_stamp":"2024-09-13T23:08:37.125127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:37.222133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:52.080856+0000","last_change":"2024-09-13T23:05:22.144728+0000","last_active":"2024-09-13T23:07:52.080856+0000","last_peered":"2024-09-13T23:07:52.080856+0000","last_clean":"2024-09-13T23:07:52.080856+0000","last_became_active":"2024-09-13T23:05:22.143767+0000","last_became_peered":"2024-09-13T23:05:22.143767+0000","last_unstale":"2024-09-13T23:07:52.080856+0000","last_undegraded":"2024-09-13T23:07:52.080856+0000","last_fullsized":"2024-09-13T23:07:52.080856+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:45.412765+0000","last_change":"2024-09-13T23:08:45.412793+0000","last_active":"2024-09-13T23:08:45.412765+0000","last_peered":"2024-09-13T23:08:45.412765+0000","last_clean":"2024-09-13T23:08:45.412765+0000","last_became_active":"2024-09-13T23:05:14.127000+0000","last_became_peered":"2024-09-13T23:05:14.127000+0000","last_unstale":"2024-09-13T23:08:45.412765+0000","last_undegraded":"2024-09-13T23:08:45.412765+0000","last_fullsized":"2024-09-13T23:08:45.412765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:45.412659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:45.412659+0000","last_clean_scrub_stamp":"2024-09-13T23:08:45.412659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:39.470592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:24.156757+0000","last_change":"2024-09-13T23:09:24.156784+0000","last_active":"2024-09-13T23:09:24.156757+0000","last_peered":"2024-09-13T23:09:24.156757+0000","last_clean":"2024-09-13T23:09:24.156757+0000","last_became_active":"2024-09-13T23:05:12.136384+0000","last_became_peered":"2024-09-13T23:05:12.136384+0000","last_unstale":"2024-09-13T23:09:24.156757+0000","last_undegraded":"2024-09-13T23:09:24.156757+0000","last_fullsized":"2024-09-13T23:09:24.156757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:24.156661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:24.156661+0000","last_clean_scrub_stamp":"2024-09-13T23:09:24.156661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:48:06.248758+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:34.507232+0000","last_change":"2024-09-13T23:08:34.507259+0000","last_active":"2024-09-13T23:08:34.507232+0000","last_peered":"2024-09-13T23:08:34.507232+0000","last_clean":"2024-09-13T23:08:34.507232+0000","last_became_active":"2024-09-13T23:05:16.124241+0000","last_became_peered":"2024-09-13T23:05:16.124241+0000","last_unstale":"2024-09-13T23:08:34.507232+0000","last_undegraded":"2024-09-13T23:08:34.507232+0000","last_fullsized":"2024-09-13T23:08:34.507232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:34.507140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:34.507140+0000","last_clean_scrub_stamp":"2024-09-13T23:08:34.507140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:44.378397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'37","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:44.633825+0000","last_change":"2024-09-13T23:08:44.633861+0000","last_active":"2024-09-13T23:08:44.633825+0000","last_peered":"2024-09-13T23:08:44.633825+0000","last_clean":"2024-09-13T23:08:44.633825+0000","last_became_active":"2024-09-13T23:05:18.126188+0000","last_became_peered":"2024-09-13T23:05:18.126188+0000","last_unstale":"2024-09-13T23:08:44.633825+0000","last_undegraded":"2024-09-13T23:08:44.633825+0000","last_fullsized":"2024-09-13T23:08:44.633825+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-13T23:08:44.633726+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-13T23:08:44.633726+0000","last_clean_scrub_stamp":"2024-09-13T23:08:44.633726+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:30.569822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:35.618513+0000","last_change":"2024-09-13T23:08:35.618558+0000","last_active":"2024-09-13T23:08:35.618513+0000","last_peered":"2024-09-13T23:08:35.618513+0000","last_clean":"2024-09-13T23:08:35.618513+0000","last_became_active":"2024-09-13T23:05:20.136098+0000","last_became_peered":"2024-09-13T23:05:20.136098+0000","last_unstale":"2024-09-13T23:08:35.618513+0000","last_undegraded":"2024-09-13T23:08:35.618513+0000","last_fullsized":"2024-09-13T23:08:35.618513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:35.618400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:35.618400+0000","last_clean_scrub_stamp":"2024-09-13T23:08:35.618400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:30.276746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'14","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:14.249283+0000","last_change":"2024-09-13T23:09:14.249283+0000","last_active":"2024-09-13T23:09:14.249283+0000","last_peered":"2024-09-13T23:09:14.249283+0000","last_clean":"2024-09-13T23:09:14.249283+0000","last_became_active":"2024-09-13T23:05:14.112822+0000","last_became_peered":"2024-09-13T23:05:14.112822+0000","last_unstale":"2024-09-13T23:09:14.249283+0000","last_undegraded":"2024-09-13T23:09:14.249283+0000","last_fullsized":"2024-09-13T23:09:14.249283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-13T23:09:14.249078+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-13T23:09:14.249078+0000","last_clean_scrub_stamp":"2024-09-13T23:09:14.249078+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:34.101181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:27.330650+0000","last_change":"2024-09-13T23:09:27.330693+0000","last_active":"2024-09-13T23:09:27.330650+0000","last_peered":"2024-09-13T23:09:27.330650+0000","last_clean":"2024-09-13T23:09:27.330650+0000","last_became_active":"2024-09-13T23:05:12.141970+0000","last_became_peered":"2024-09-13T23:05:12.141970+0000","last_unstale":"2024-09-13T23:09:27.330650+0000","last_undegraded":"2024-09-13T23:09:27.330650+0000","last_fullsized":"2024-09-13T23:09:27.330650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:27.330516+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:27.330516+0000","last_clean_scrub_stamp":"2024-09-13T23:09:27.330516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:54.965684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:53.200311+0000","last_change":"2024-09-13T23:08:53.200311+0000","last_active":"2024-09-13T23:08:53.200311+0000","last_peered":"2024-09-13T23:08:53.200311+0000","last_clean":"2024-09-13T23:08:53.200311+0000","last_became_active":"2024-09-13T23:05:16.120506+0000","last_became_peered":"2024-09-13T23:05:16.120506+0000","last_unstale":"2024-09-13T23:08:53.200311+0000","last_undegraded":"2024-09-13T23:08:53.200311+0000","last_fullsized":"2024-09-13T23:08:53.200311+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:53.200178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:53.200178+0000","last_clean_scrub_stamp":"2024-09-13T23:08:53.200178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:52:22.107307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'65","reported_seq":138,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:44.096079+0000","last_change":"2024-09-13T23:08:44.096120+0000","last_active":"2024-09-13T23:08:44.096079+0000","last_peered":"2024-09-13T23:08:44.096079+0000","last_clean":"2024-09-13T23:08:44.096079+0000","last_became_active":"2024-09-13T23:05:18.126811+0000","last_became_peered":"2024-09-13T23:05:18.126811+0000","last_unstale":"2024-09-13T23:08:44.096079+0000","last_undegraded":"2024-09-13T23:08:44.096079+0000","last_fullsized":"2024-09-13T23:08:44.096079+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'65","last_scrub_stamp":"2024-09-13T23:08:44.095997+0000","last_deep_scrub":"34'65","last_deep_scrub_stamp":"2024-09-13T23:08:44.095997+0000","last_clean_scrub_stamp":"2024-09-13T23:08:44.095997+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:01.263619+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:36.593190+0000","last_change":"2024-09-13T23:08:36.593215+0000","last_active":"2024-09-13T23:08:36.593190+0000","last_peered":"2024-09-13T23:08:36.593190+0000","last_clean":"2024-09-13T23:08:36.593190+0000","last_became_active":"2024-09-13T23:05:20.135886+0000","last_became_peered":"2024-09-13T23:05:20.135886+0000","last_unstale":"2024-09-13T23:08:36.593190+0000","last_undegraded":"2024-09-13T23:08:36.593190+0000","last_fullsized":"2024-09-13T23:08:36.593190+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:36.593096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:36.593096+0000","last_clean_scrub_stamp":"2024-09-13T23:08:36.593096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:13.596600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:33.328848+0000","last_change":"2024-09-13T23:09:33.328876+0000","last_active":"2024-09-13T23:09:33.328848+0000","last_peered":"2024-09-13T23:09:33.328848+0000","last_clean":"2024-09-13T23:09:33.328848+0000","last_became_active":"2024-09-13T23:05:22.147394+0000","last_became_peered":"2024-09-13T23:05:22.147394+0000","last_unstale":"2024-09-13T23:09:33.328848+0000","last_undegraded":"2024-09-13T23:09:33.328848+0000","last_fullsized":"2024-09-13T23:09:33.328848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:09:33.328746+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:09:33.328746+0000","last_clean_scrub_stamp":"2024-09-13T23:09:33.328746+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:39.452384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:28.332489+0000","last_change":"2024-09-13T23:09:28.332514+0000","last_active":"2024-09-13T23:09:28.332489+0000","last_peered":"2024-09-13T23:09:28.332489+0000","last_clean":"2024-09-13T23:09:28.332489+0000","last_became_active":"2024-09-13T23:05:14.121349+0000","last_became_peered":"2024-09-13T23:05:14.121349+0000","last_unstale":"2024-09-13T23:09:28.332489+0000","last_undegraded":"2024-09-13T23:09:28.332489+0000","last_fullsized":"2024-09-13T23:09:28.332489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:28.332397+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:28.332397+0000","last_clean_scrub_stamp":"2024-09-13T23:09:28.332397+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:32.331842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:26.190725+0000","last_change":"2024-09-13T23:09:26.190782+0000","last_active":"2024-09-13T23:09:26.190725+0000","last_peered":"2024-09-13T23:09:26.190725+0000","last_clean":"2024-09-13T23:09:26.190725+0000","last_became_active":"2024-09-13T23:05:12.137092+0000","last_became_peered":"2024-09-13T23:05:12.137092+0000","last_unstale":"2024-09-13T23:09:26.190725+0000","last_undegraded":"2024-09-13T23:09:26.190725+0000","last_fullsized":"2024-09-13T23:09:26.190725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:26.190609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:26.190609+0000","last_clean_scrub_stamp":"2024-09-13T23:09:26.190609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:19.827376+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:53.660121+0000","last_change":"2024-09-13T23:08:53.660121+0000","last_active":"2024-09-13T23:08:53.660121+0000","last_peered":"2024-09-13T23:08:53.660121+0000","last_clean":"2024-09-13T23:08:53.660121+0000","last_became_active":"2024-09-13T23:05:16.121476+0000","last_became_peered":"2024-09-13T23:05:16.121476+0000","last_unstale":"2024-09-13T23:08:53.660121+0000","last_undegraded":"2024-09-13T23:08:53.660121+0000","last_fullsized":"2024-09-13T23:08:53.660121+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:53.659974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:53.659974+0000","last_clean_scrub_stamp":"2024-09-13T23:08:53.659974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:50.966119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:46.445606+0000","last_change":"2024-09-13T23:08:46.445654+0000","last_active":"2024-09-13T23:08:46.445606+0000","last_peered":"2024-09-13T23:08:46.445606+0000","last_clean":"2024-09-13T23:08:46.445606+0000","last_became_active":"2024-09-13T23:05:18.132060+0000","last_became_peered":"2024-09-13T23:05:18.132060+0000","last_unstale":"2024-09-13T23:08:46.445606+0000","last_undegraded":"2024-09-13T23:08:46.445606+0000","last_fullsized":"2024-09-13T23:08:46.445606+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-09-13T23:08:46.445495+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-09-13T23:08:46.445495+0000","last_clean_scrub_stamp":"2024-09-13T23:08:46.445495+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:05:59.233056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:49.128648+0000","last_change":"2024-09-13T23:08:49.128681+0000","last_active":"2024-09-13T23:08:49.128648+0000","last_peered":"2024-09-13T23:08:49.128648+0000","last_clean":"2024-09-13T23:08:49.128648+0000","last_became_active":"2024-09-13T23:05:20.140333+0000","last_became_peered":"2024-09-13T23:05:20.140333+0000","last_unstale":"2024-09-13T23:08:49.128648+0000","last_undegraded":"2024-09-13T23:08:49.128648+0000","last_fullsized":"2024-09-13T23:08:49.128648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:49.128546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:49.128546+0000","last_clean_scrub_stamp":"2024-09-13T23:08:49.128546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:23:33.731436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:20.163598+0000","last_change":"2024-09-13T23:09:20.163621+0000","last_active":"2024-09-13T23:09:20.163598+0000","last_peered":"2024-09-13T23:09:20.163598+0000","last_clean":"2024-09-13T23:09:20.163598+0000","last_became_active":"2024-09-13T23:05:22.139984+0000","last_became_peered":"2024-09-13T23:05:22.139984+0000","last_unstale":"2024-09-13T23:09:20.163598+0000","last_undegraded":"2024-09-13T23:09:20.163598+0000","last_fullsized":"2024-09-13T23:09:20.163598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:20.163488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:20.163488+0000","last_clean_scrub_stamp":"2024-09-13T23:09:20.163488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:27.459780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:53.426271+0000","last_change":"2024-09-13T23:08:53.426301+0000","last_active":"2024-09-13T23:08:53.426271+0000","last_peered":"2024-09-13T23:08:53.426271+0000","last_clean":"2024-09-13T23:08:53.426271+0000","last_became_active":"2024-09-13T23:05:14.124660+0000","last_became_peered":"2024-09-13T23:05:14.124660+0000","last_unstale":"2024-09-13T23:08:53.426271+0000","last_undegraded":"2024-09-13T23:08:53.426271+0000","last_fullsized":"2024-09-13T23:08:53.426271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:08:53.426181+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:08:53.426181+0000","last_clean_scrub_stamp":"2024-09-13T23:08:53.426181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:11.981314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:10.115211+0000","last_change":"2024-09-13T23:09:10.115237+0000","last_active":"2024-09-13T23:09:10.115211+0000","last_peered":"2024-09-13T23:09:10.115211+0000","last_clean":"2024-09-13T23:09:10.115211+0000","last_became_active":"2024-09-13T23:05:12.137136+0000","last_became_peered":"2024-09-13T23:05:12.137136+0000","last_unstale":"2024-09-13T23:09:10.115211+0000","last_undegraded":"2024-09-13T23:09:10.115211+0000","last_fullsized":"2024-09-13T23:09:10.115211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:10.115117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:10.115117+0000","last_clean_scrub_stamp":"2024-09-13T23:09:10.115117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:50.313039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:51.653427+0000","last_change":"2024-09-13T23:08:51.653449+0000","last_active":"2024-09-13T23:08:51.653427+0000","last_peered":"2024-09-13T23:08:51.653427+0000","last_clean":"2024-09-13T23:08:51.653427+0000","last_became_active":"2024-09-13T23:05:16.123607+0000","last_became_peered":"2024-09-13T23:05:16.123607+0000","last_unstale":"2024-09-13T23:08:51.653427+0000","last_undegraded":"2024-09-13T23:08:51.653427+0000","last_fullsized":"2024-09-13T23:08:51.653427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:51.653336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:51.653336+0000","last_clean_scrub_stamp":"2024-09-13T23:08:51.653336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:03:16.566313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'39","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:40.011754+0000","last_change":"2024-09-13T23:08:40.011754+0000","last_active":"2024-09-13T23:08:40.011754+0000","last_peered":"2024-09-13T23:08:40.011754+0000","last_clean":"2024-09-13T23:08:40.011754+0000","last_became_active":"2024-09-13T23:05:18.136279+0000","last_became_peered":"2024-09-13T23:05:18.136279+0000","last_unstale":"2024-09-13T23:08:40.011754+0000","last_undegraded":"2024-09-13T23:08:40.011754+0000","last_fullsized":"2024-09-13T23:08:40.011754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-13T23:08:40.011606+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-13T23:08:40.011606+0000","last_clean_scrub_stamp":"2024-09-13T23:08:40.011606+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:05.066896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:46.122297+0000","last_change":"2024-09-13T23:08:46.122297+0000","last_active":"2024-09-13T23:08:46.122297+0000","last_peered":"2024-09-13T23:08:46.122297+0000","last_clean":"2024-09-13T23:08:46.122297+0000","last_became_active":"2024-09-13T23:05:20.141266+0000","last_became_peered":"2024-09-13T23:05:20.141266+0000","last_unstale":"2024-09-13T23:08:46.122297+0000","last_undegraded":"2024-09-13T23:08:46.122297+0000","last_fullsized":"2024-09-13T23:08:46.122297+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:46.122177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:46.122177+0000","last_clean_scrub_stamp":"2024-09-13T23:08:46.122177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:29.240444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'9","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079113+0000","last_change":"2024-09-13T23:05:22.151767+0000","last_active":"2024-09-13T23:07:42.079113+0000","last_peered":"2024-09-13T23:07:42.079113+0000","last_clean":"2024-09-13T23:07:42.079113+0000","last_became_active":"2024-09-13T23:05:22.151339+0000","last_became_peered":"2024-09-13T23:05:22.151339+0000","last_unstale":"2024-09-13T23:07:42.079113+0000","last_undegraded":"2024-09-13T23:07:42.079113+0000","last_fullsized":"2024-09-13T23:07:42.079113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'8","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:10.305675+0000","last_change":"2024-09-13T23:09:10.305706+0000","last_active":"2024-09-13T23:09:10.305675+0000","last_peered":"2024-09-13T23:09:10.305675+0000","last_clean":"2024-09-13T23:09:10.305675+0000","last_became_active":"2024-09-13T23:05:14.112175+0000","last_became_peered":"2024-09-13T23:05:14.112175+0000","last_unstale":"2024-09-13T23:09:10.305675+0000","last_undegraded":"2024-09-13T23:09:10.305675+0000","last_fullsized":"2024-09-13T23:09:10.305675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:09:10.305573+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:09:10.305573+0000","last_clean_scrub_stamp":"2024-09-13T23:09:10.305573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:24:52.419767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:31.431964+0000","last_change":"2024-09-13T23:09:31.432025+0000","last_active":"2024-09-13T23:09:31.431964+0000","last_peered":"2024-09-13T23:09:31.431964+0000","last_clean":"2024-09-13T23:09:31.431964+0000","last_became_active":"2024-09-13T23:05:12.141459+0000","last_became_peered":"2024-09-13T23:05:12.141459+0000","last_unstale":"2024-09-13T23:09:31.431964+0000","last_undegraded":"2024-09-13T23:09:31.431964+0000","last_fullsized":"2024-09-13T23:09:31.431964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:31.431863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:31.431863+0000","last_clean_scrub_stamp":"2024-09-13T23:09:31.431863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:59.930982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"34'5","reported_seq":238,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:46.150879+0000","last_change":"2024-09-13T23:08:46.150906+0000","last_active":"2024-09-13T23:08:46.150879+0000","last_peered":"2024-09-13T23:08:46.150879+0000","last_clean":"2024-09-13T23:08:46.150879+0000","last_became_active":"2024-09-13T23:05:16.117736+0000","last_became_peered":"2024-09-13T23:05:16.117736+0000","last_unstale":"2024-09-13T23:08:46.150879+0000","last_undegraded":"2024-09-13T23:08:46.150879+0000","last_fullsized":"2024-09-13T23:08:46.150879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T23:08:46.150798+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T23:08:46.150798+0000","last_clean_scrub_stamp":"2024-09-13T23:08:46.150798+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:35.594124+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'16","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:48.450353+0000","last_change":"2024-09-13T23:08:48.450353+0000","last_active":"2024-09-13T23:08:48.450353+0000","last_peered":"2024-09-13T23:08:48.450353+0000","last_clean":"2024-09-13T23:08:48.450353+0000","last_became_active":"2024-09-13T23:05:18.132507+0000","last_became_peered":"2024-09-13T23:05:18.132507+0000","last_unstale":"2024-09-13T23:08:48.450353+0000","last_undegraded":"2024-09-13T23:08:48.450353+0000","last_fullsized":"2024-09-13T23:08:48.450353+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:08:48.450186+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:08:48.450186+0000","last_clean_scrub_stamp":"2024-09-13T23:08:48.450186+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:23.338330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":430,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:42.605617+0000","last_change":"2024-09-13T23:08:42.605617+0000","last_active":"2024-09-13T23:08:42.605617+0000","last_peered":"2024-09-13T23:08:42.605617+0000","last_clean":"2024-09-13T23:08:42.605617+0000","last_became_active":"2024-09-13T23:05:20.144334+0000","last_became_peered":"2024-09-13T23:05:20.144334+0000","last_unstale":"2024-09-13T23:08:42.605617+0000","last_undegraded":"2024-09-13T23:08:42.605617+0000","last_fullsized":"2024-09-13T23:08:42.605617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:42.605465+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:42.605465+0000","last_clean_scrub_stamp":"2024-09-13T23:08:42.605465+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:53.293281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079015+0000","last_change":"2024-09-13T23:05:22.149167+0000","last_active":"2024-09-13T23:07:42.079015+0000","last_peered":"2024-09-13T23:07:42.079015+0000","last_clean":"2024-09-13T23:07:42.079015+0000","last_became_active":"2024-09-13T23:05:22.148894+0000","last_became_peered":"2024-09-13T23:05:22.148894+0000","last_unstale":"2024-09-13T23:07:42.079015+0000","last_undegraded":"2024-09-13T23:07:42.079015+0000","last_fullsized":"2024-09-13T23:07:42.079015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:56.577914+0000","last_change":"2024-09-13T23:08:56.577947+0000","last_active":"2024-09-13T23:08:56.577914+0000","last_peered":"2024-09-13T23:08:56.577914+0000","last_clean":"2024-09-13T23:08:56.577914+0000","last_became_active":"2024-09-13T23:05:14.111891+0000","last_became_peered":"2024-09-13T23:05:14.111891+0000","last_unstale":"2024-09-13T23:08:56.577914+0000","last_undegraded":"2024-09-13T23:08:56.577914+0000","last_fullsized":"2024-09-13T23:08:56.577914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:08:56.577794+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:08:56.577794+0000","last_clean_scrub_stamp":"2024-09-13T23:08:56.577794+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:52:00.290749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:16.155161+0000","last_change":"2024-09-13T23:09:16.155197+0000","last_active":"2024-09-13T23:09:16.155161+0000","last_peered":"2024-09-13T23:09:16.155161+0000","last_clean":"2024-09-13T23:09:16.155161+0000","last_became_active":"2024-09-13T23:05:12.139564+0000","last_became_peered":"2024-09-13T23:05:12.139564+0000","last_unstale":"2024-09-13T23:09:16.155161+0000","last_undegraded":"2024-09-13T23:09:16.155161+0000","last_fullsized":"2024-09-13T23:09:16.155161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:16.155069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:16.155069+0000","last_clean_scrub_stamp":"2024-09-13T23:09:16.155069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:49.723203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:44.189431+0000","last_change":"2024-09-13T23:08:44.189458+0000","last_active":"2024-09-13T23:08:44.189431+0000","last_peered":"2024-09-13T23:08:44.189431+0000","last_clean":"2024-09-13T23:08:44.189431+0000","last_became_active":"2024-09-13T23:05:16.118353+0000","last_became_peered":"2024-09-13T23:05:16.118353+0000","last_unstale":"2024-09-13T23:08:44.189431+0000","last_undegraded":"2024-09-13T23:08:44.189431+0000","last_fullsized":"2024-09-13T23:08:44.189431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:44.189340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:44.189340+0000","last_clean_scrub_stamp":"2024-09-13T23:08:44.189340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:31.794198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:35.089857+0000","last_change":"2024-09-13T23:08:35.089897+0000","last_active":"2024-09-13T23:08:35.089857+0000","last_peered":"2024-09-13T23:08:35.089857+0000","last_clean":"2024-09-13T23:08:35.089857+0000","last_became_active":"2024-09-13T23:05:18.127975+0000","last_became_peered":"2024-09-13T23:05:18.127975+0000","last_unstale":"2024-09-13T23:08:35.089857+0000","last_undegraded":"2024-09-13T23:08:35.089857+0000","last_fullsized":"2024-09-13T23:08:35.089857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-09-13T23:08:35.089767+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-09-13T23:08:35.089767+0000","last_clean_scrub_stamp":"2024-09-13T23:08:35.089767+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:53:49.326025+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:34.005517+0000","last_change":"2024-09-13T23:08:34.005539+0000","last_active":"2024-09-13T23:08:34.005517+0000","last_peered":"2024-09-13T23:08:34.005517+0000","last_clean":"2024-09-13T23:08:34.005517+0000","last_became_active":"2024-09-13T23:05:20.139329+0000","last_became_peered":"2024-09-13T23:05:20.139329+0000","last_unstale":"2024-09-13T23:08:34.005517+0000","last_undegraded":"2024-09-13T23:08:34.005517+0000","last_fullsized":"2024-09-13T23:08:34.005517+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:34.005418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:34.005418+0000","last_clean_scrub_stamp":"2024-09-13T23:08:34.005418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:17:06.755531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:30.179233+0000","last_change":"2024-09-13T23:09:30.179256+0000","last_active":"2024-09-13T23:09:30.179233+0000","last_peered":"2024-09-13T23:09:30.179233+0000","last_clean":"2024-09-13T23:09:30.179233+0000","last_became_active":"2024-09-13T23:05:22.147949+0000","last_became_peered":"2024-09-13T23:05:22.147949+0000","last_unstale":"2024-09-13T23:09:30.179233+0000","last_undegraded":"2024-09-13T23:09:30.179233+0000","last_fullsized":"2024-09-13T23:09:30.179233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:30.179138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:30.179138+0000","last_clean_scrub_stamp":"2024-09-13T23:09:30.179138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:55:22.615471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:04.647264+0000","last_change":"2024-09-13T23:09:04.647321+0000","last_active":"2024-09-13T23:09:04.647264+0000","last_peered":"2024-09-13T23:09:04.647264+0000","last_clean":"2024-09-13T23:09:04.647264+0000","last_became_active":"2024-09-13T23:05:14.113816+0000","last_became_peered":"2024-09-13T23:05:14.113816+0000","last_unstale":"2024-09-13T23:09:04.647264+0000","last_undegraded":"2024-09-13T23:09:04.647264+0000","last_fullsized":"2024-09-13T23:09:04.647264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:04.647142+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:04.647142+0000","last_clean_scrub_stamp":"2024-09-13T23:09:04.647142+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:23:47.909278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079231+0000","last_change":"2024-09-13T23:05:12.149692+0000","last_active":"2024-09-13T23:07:42.079231+0000","last_peered":"2024-09-13T23:07:42.079231+0000","last_clean":"2024-09-13T23:07:42.079231+0000","last_became_active":"2024-09-13T23:05:12.149292+0000","last_became_peered":"2024-09-13T23:05:12.149292+0000","last_unstale":"2024-09-13T23:07:42.079231+0000","last_undegraded":"2024-09-13T23:07:42.079231+0000","last_fullsized":"2024-09-13T23:07:42.079231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:47.679656+0000","last_change":"2024-09-13T23:08:47.679695+0000","last_active":"2024-09-13T23:08:47.679656+0000","last_peered":"2024-09-13T23:08:47.679656+0000","last_clean":"2024-09-13T23:08:47.679656+0000","last_became_active":"2024-09-13T23:05:16.128023+0000","last_became_peered":"2024-09-13T23:05:16.128023+0000","last_unstale":"2024-09-13T23:08:47.679656+0000","last_undegraded":"2024-09-13T23:08:47.679656+0000","last_fullsized":"2024-09-13T23:08:47.679656+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:47.679555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:47.679555+0000","last_clean_scrub_stamp":"2024-09-13T23:08:47.679555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:54.252885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:40.988262+0000","last_change":"2024-09-13T23:08:40.988296+0000","last_active":"2024-09-13T23:08:40.988262+0000","last_peered":"2024-09-13T23:08:40.988262+0000","last_clean":"2024-09-13T23:08:40.988262+0000","last_became_active":"2024-09-13T23:05:18.132579+0000","last_became_peered":"2024-09-13T23:05:18.132579+0000","last_unstale":"2024-09-13T23:08:40.988262+0000","last_undegraded":"2024-09-13T23:08:40.988262+0000","last_fullsized":"2024-09-13T23:08:40.988262+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-13T23:08:40.988170+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-13T23:08:40.988170+0000","last_clean_scrub_stamp":"2024-09-13T23:08:40.988170+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:13:33.042844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:55.408559+0000","last_change":"2024-09-13T23:08:55.408584+0000","last_active":"2024-09-13T23:08:55.408559+0000","last_peered":"2024-09-13T23:08:55.408559+0000","last_clean":"2024-09-13T23:08:55.408559+0000","last_became_active":"2024-09-13T23:05:20.136023+0000","last_became_peered":"2024-09-13T23:05:20.136023+0000","last_unstale":"2024-09-13T23:08:55.408559+0000","last_undegraded":"2024-09-13T23:08:55.408559+0000","last_fullsized":"2024-09-13T23:08:55.408559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:55.408445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:55.408445+0000","last_clean_scrub_stamp":"2024-09-13T23:08:55.408445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:23:49.047903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:47.080030+0000","last_change":"2024-09-13T23:05:22.149740+0000","last_active":"2024-09-13T23:07:47.080030+0000","last_peered":"2024-09-13T23:07:47.080030+0000","last_clean":"2024-09-13T23:07:47.080030+0000","last_became_active":"2024-09-13T23:05:22.149468+0000","last_became_peered":"2024-09-13T23:05:22.149468+0000","last_unstale":"2024-09-13T23:07:47.080030+0000","last_undegraded":"2024-09-13T23:07:47.080030+0000","last_fullsized":"2024-09-13T23:07:47.080030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:21.200924+0000","last_change":"2024-09-13T23:09:21.200959+0000","last_active":"2024-09-13T23:09:21.200924+0000","last_peered":"2024-09-13T23:09:21.200924+0000","last_clean":"2024-09-13T23:09:21.200924+0000","last_became_active":"2024-09-13T23:05:14.109323+0000","last_became_peered":"2024-09-13T23:05:14.109323+0000","last_unstale":"2024-09-13T23:09:21.200924+0000","last_undegraded":"2024-09-13T23:09:21.200924+0000","last_fullsized":"2024-09-13T23:09:21.200924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:21.200822+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:21.200822+0000","last_clean_scrub_stamp":"2024-09-13T23:09:21.200822+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:18.584849+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:13.313691+0000","last_change":"2024-09-13T23:09:13.313691+0000","last_active":"2024-09-13T23:09:13.313691+0000","last_peered":"2024-09-13T23:09:13.313691+0000","last_clean":"2024-09-13T23:09:13.313691+0000","last_became_active":"2024-09-13T23:05:12.121050+0000","last_became_peered":"2024-09-13T23:05:12.121050+0000","last_unstale":"2024-09-13T23:09:13.313691+0000","last_undegraded":"2024-09-13T23:09:13.313691+0000","last_fullsized":"2024-09-13T23:09:13.313691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:13.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:13.313570+0000","last_clean_scrub_stamp":"2024-09-13T23:09:13.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:21.265185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"34'2","reported_seq":230,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:43.150446+0000","last_change":"2024-09-13T23:08:43.150481+0000","last_active":"2024-09-13T23:08:43.150446+0000","last_peered":"2024-09-13T23:08:43.150446+0000","last_clean":"2024-09-13T23:08:43.150446+0000","last_became_active":"2024-09-13T23:05:16.123673+0000","last_became_peered":"2024-09-13T23:05:16.123673+0000","last_unstale":"2024-09-13T23:08:43.150446+0000","last_undegraded":"2024-09-13T23:08:43.150446+0000","last_fullsized":"2024-09-13T23:08:43.150446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:08:43.150340+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:08:43.150340+0000","last_clean_scrub_stamp":"2024-09-13T23:08:43.150340+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:26.284636+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'31","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:01.289992+0000","last_change":"2024-09-13T23:09:01.290029+0000","last_active":"2024-09-13T23:09:01.289992+0000","last_peered":"2024-09-13T23:09:01.289992+0000","last_clean":"2024-09-13T23:09:01.289992+0000","last_became_active":"2024-09-13T23:05:18.134152+0000","last_became_peered":"2024-09-13T23:05:18.134152+0000","last_unstale":"2024-09-13T23:09:01.289992+0000","last_undegraded":"2024-09-13T23:09:01.289992+0000","last_fullsized":"2024-09-13T23:09:01.289992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'31","last_scrub_stamp":"2024-09-13T23:09:01.289900+0000","last_deep_scrub":"34'31","last_deep_scrub_stamp":"2024-09-13T23:09:01.289900+0000","last_clean_scrub_stamp":"2024-09-13T23:09:01.289900+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:26.269605+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:56.399566+0000","last_change":"2024-09-13T23:08:56.399590+0000","last_active":"2024-09-13T23:08:56.399566+0000","last_peered":"2024-09-13T23:08:56.399566+0000","last_clean":"2024-09-13T23:08:56.399566+0000","last_became_active":"2024-09-13T23:05:20.139133+0000","last_became_peered":"2024-09-13T23:05:20.139133+0000","last_unstale":"2024-09-13T23:08:56.399566+0000","last_undegraded":"2024-09-13T23:08:56.399566+0000","last_fullsized":"2024-09-13T23:08:56.399566+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:56.399466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:56.399466+0000","last_clean_scrub_stamp":"2024-09-13T23:08:56.399466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:07.409062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'12","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:47.079969+0000","last_change":"2024-09-13T23:05:22.144173+0000","last_active":"2024-09-13T23:07:47.079969+0000","last_peered":"2024-09-13T23:07:47.079969+0000","last_clean":"2024-09-13T23:07:47.079969+0000","last_became_active":"2024-09-13T23:05:22.143886+0000","last_became_peered":"2024-09-13T23:05:22.143886+0000","last_unstale":"2024-09-13T23:07:47.079969+0000","last_undegraded":"2024-09-13T23:07:47.079969+0000","last_fullsized":"2024-09-13T23:07:47.079969+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":59,"num_write":33,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:57.527931+0000","last_change":"2024-09-13T23:08:57.527982+0000","last_active":"2024-09-13T23:08:57.527931+0000","last_peered":"2024-09-13T23:08:57.527931+0000","last_clean":"2024-09-13T23:08:57.527931+0000","last_became_active":"2024-09-13T23:05:14.111836+0000","last_became_peered":"2024-09-13T23:05:14.111836+0000","last_unstale":"2024-09-13T23:08:57.527931+0000","last_undegraded":"2024-09-13T23:08:57.527931+0000","last_fullsized":"2024-09-13T23:08:57.527931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:08:57.527825+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:08:57.527825+0000","last_clean_scrub_stamp":"2024-09-13T23:08:57.527825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:46.405099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:22.117872+0000","last_change":"2024-09-13T23:09:22.117872+0000","last_active":"2024-09-13T23:09:22.117872+0000","last_peered":"2024-09-13T23:09:22.117872+0000","last_clean":"2024-09-13T23:09:22.117872+0000","last_became_active":"2024-09-13T23:05:12.134820+0000","last_became_peered":"2024-09-13T23:05:12.134820+0000","last_unstale":"2024-09-13T23:09:22.117872+0000","last_undegraded":"2024-09-13T23:09:22.117872+0000","last_fullsized":"2024-09-13T23:09:22.117872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:22.117749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:22.117749+0000","last_clean_scrub_stamp":"2024-09-13T23:09:22.117749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:40.032404+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:42.120392+0000","last_change":"2024-09-13T23:08:42.120463+0000","last_active":"2024-09-13T23:08:42.120392+0000","last_peered":"2024-09-13T23:08:42.120392+0000","last_clean":"2024-09-13T23:08:42.120392+0000","last_became_active":"2024-09-13T23:05:16.124295+0000","last_became_peered":"2024-09-13T23:05:16.124295+0000","last_unstale":"2024-09-13T23:08:42.120392+0000","last_undegraded":"2024-09-13T23:08:42.120392+0000","last_fullsized":"2024-09-13T23:08:42.120392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T23:08:42.120283+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T23:08:42.120283+0000","last_clean_scrub_stamp":"2024-09-13T23:08:42.120283+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:16.924419+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'39","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:38.609156+0000","last_change":"2024-09-13T23:08:38.609215+0000","last_active":"2024-09-13T23:08:38.609156+0000","last_peered":"2024-09-13T23:08:38.609156+0000","last_clean":"2024-09-13T23:08:38.609156+0000","last_became_active":"2024-09-13T23:05:18.131796+0000","last_became_peered":"2024-09-13T23:05:18.131796+0000","last_unstale":"2024-09-13T23:08:38.609156+0000","last_undegraded":"2024-09-13T23:08:38.609156+0000","last_fullsized":"2024-09-13T23:08:38.609156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-13T23:08:38.609041+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-13T23:08:38.609041+0000","last_clean_scrub_stamp":"2024-09-13T23:08:38.609041+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:03:15.467219+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:58.257173+0000","last_change":"2024-09-13T23:08:58.257200+0000","last_active":"2024-09-13T23:08:58.257173+0000","last_peered":"2024-09-13T23:08:58.257173+0000","last_clean":"2024-09-13T23:08:58.257173+0000","last_became_active":"2024-09-13T23:05:20.145356+0000","last_became_peered":"2024-09-13T23:05:20.145356+0000","last_unstale":"2024-09-13T23:08:58.257173+0000","last_undegraded":"2024-09-13T23:08:58.257173+0000","last_fullsized":"2024-09-13T23:08:58.257173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:58.257079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:58.257079+0000","last_clean_scrub_stamp":"2024-09-13T23:08:58.257079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:22:13.566018+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079192+0000","last_change":"2024-09-13T23:05:22.147988+0000","last_active":"2024-09-13T23:07:42.079192+0000","last_peered":"2024-09-13T23:07:42.079192+0000","last_clean":"2024-09-13T23:07:42.079192+0000","last_became_active":"2024-09-13T23:05:22.147707+0000","last_became_peered":"2024-09-13T23:05:22.147707+0000","last_unstale":"2024-09-13T23:07:42.079192+0000","last_undegraded":"2024-09-13T23:07:42.079192+0000","last_fullsized":"2024-09-13T23:07:42.079192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'16","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:17.141777+0000","last_change":"2024-09-13T23:09:17.141806+0000","last_active":"2024-09-13T23:09:17.141777+0000","last_peered":"2024-09-13T23:09:17.141777+0000","last_clean":"2024-09-13T23:09:17.141777+0000","last_became_active":"2024-09-13T23:05:14.123513+0000","last_became_peered":"2024-09-13T23:05:14.123513+0000","last_unstale":"2024-09-13T23:09:17.141777+0000","last_undegraded":"2024-09-13T23:09:17.141777+0000","last_fullsized":"2024-09-13T23:09:17.141777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:09:17.141672+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:09:17.141672+0000","last_clean_scrub_stamp":"2024-09-13T23:09:17.141672+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:49.102998+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:07.690221+0000","last_change":"2024-09-13T23:09:07.690221+0000","last_active":"2024-09-13T23:09:07.690221+0000","last_peered":"2024-09-13T23:09:07.690221+0000","last_clean":"2024-09-13T23:09:07.690221+0000","last_became_active":"2024-09-13T23:05:12.125740+0000","last_became_peered":"2024-09-13T23:05:12.125740+0000","last_unstale":"2024-09-13T23:09:07.690221+0000","last_undegraded":"2024-09-13T23:09:07.690221+0000","last_fullsized":"2024-09-13T23:09:07.690221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:07.690053+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:07.690053+0000","last_clean_scrub_stamp":"2024-09-13T23:09:07.690053+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:34.895020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:04.232707+0000","last_change":"2024-09-13T23:09:04.232707+0000","last_active":"2024-09-13T23:09:04.232707+0000","last_peered":"2024-09-13T23:09:04.232707+0000","last_clean":"2024-09-13T23:09:04.232707+0000","last_became_active":"2024-09-13T23:05:14.109959+0000","last_became_peered":"2024-09-13T23:05:14.109959+0000","last_unstale":"2024-09-13T23:09:04.232707+0000","last_undegraded":"2024-09-13T23:09:04.232707+0000","last_fullsized":"2024-09-13T23:09:04.232707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:04.232517+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:04.232517+0000","last_clean_scrub_stamp":"2024-09-13T23:09:04.232517+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:08.232026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:22.367560+0000","last_change":"2024-09-13T23:09:22.367560+0000","last_active":"2024-09-13T23:09:22.367560+0000","last_peered":"2024-09-13T23:09:22.367560+0000","last_clean":"2024-09-13T23:09:22.367560+0000","last_became_active":"2024-09-13T23:05:12.113972+0000","last_became_peered":"2024-09-13T23:05:12.113972+0000","last_unstale":"2024-09-13T23:09:22.367560+0000","last_undegraded":"2024-09-13T23:09:22.367560+0000","last_fullsized":"2024-09-13T23:09:22.367560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:22.367433+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:22.367433+0000","last_clean_scrub_stamp":"2024-09-13T23:09:22.367433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:28:02.084357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:26.758371+0000","last_change":"2024-09-13T23:09:26.758397+0000","last_active":"2024-09-13T23:09:26.758371+0000","last_peered":"2024-09-13T23:09:26.758371+0000","last_clean":"2024-09-13T23:09:26.758371+0000","last_became_active":"2024-09-13T23:05:49.159488+0000","last_became_peered":"2024-09-13T23:05:49.159488+0000","last_unstale":"2024-09-13T23:09:26.758371+0000","last_undegraded":"2024-09-13T23:09:26.758371+0000","last_fullsized":"2024-09-13T23:09:26.758371+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T23:09:26.758280+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T23:09:26.758280+0000","last_clean_scrub_stamp":"2024-09-13T23:09:26.758280+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:12.577119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.410589+0000","last_change":"2024-09-13T23:05:12.140088+0000","last_active":"2024-09-13T23:08:33.410589+0000","last_peered":"2024-09-13T23:08:33.410589+0000","last_clean":"2024-09-13T23:08:33.410589+0000","last_became_active":"2024-09-13T23:05:12.139673+0000","last_became_peered":"2024-09-13T23:05:12.139673+0000","last_unstale":"2024-09-13T23:08:33.410589+0000","last_undegraded":"2024-09-13T23:08:33.410589+0000","last_fullsized":"2024-09-13T23:08:33.410589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:08.208070+0000","last_change":"2024-09-13T23:09:08.208070+0000","last_active":"2024-09-13T23:09:08.208070+0000","last_peered":"2024-09-13T23:09:08.208070+0000","last_clean":"2024-09-13T23:09:08.208070+0000","last_became_active":"2024-09-13T23:05:14.112168+0000","last_became_peered":"2024-09-13T23:05:14.112168+0000","last_unstale":"2024-09-13T23:09:08.208070+0000","last_undegraded":"2024-09-13T23:09:08.208070+0000","last_fullsized":"2024-09-13T23:09:08.208070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T23:09:08.207945+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T23:09:08.207945+0000","last_clean_scrub_stamp":"2024-09-13T23:09:08.207945+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:40.610882+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:27.313942+0000","last_change":"2024-09-13T23:09:27.313969+0000","last_active":"2024-09-13T23:09:27.313942+0000","last_peered":"2024-09-13T23:09:27.313942+0000","last_clean":"2024-09-13T23:09:27.313942+0000","last_became_active":"2024-09-13T23:05:12.118425+0000","last_became_peered":"2024-09-13T23:05:12.118425+0000","last_unstale":"2024-09-13T23:09:27.313942+0000","last_undegraded":"2024-09-13T23:09:27.313942+0000","last_fullsized":"2024-09-13T23:09:27.313942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:27.313818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:27.313818+0000","last_clean_scrub_stamp":"2024-09-13T23:09:27.313818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:21.569626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'14","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:18.302991+0000","last_change":"2024-09-13T23:09:18.302991+0000","last_active":"2024-09-13T23:09:18.302991+0000","last_peered":"2024-09-13T23:09:18.302991+0000","last_clean":"2024-09-13T23:09:18.302991+0000","last_became_active":"2024-09-13T23:05:14.120456+0000","last_became_peered":"2024-09-13T23:05:14.120456+0000","last_unstale":"2024-09-13T23:09:18.302991+0000","last_undegraded":"2024-09-13T23:09:18.302991+0000","last_fullsized":"2024-09-13T23:09:18.302991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-13T23:09:18.302866+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-13T23:09:18.302866+0000","last_clean_scrub_stamp":"2024-09-13T23:09:18.302866+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:33.793181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:23.369585+0000","last_change":"2024-09-13T23:09:23.369585+0000","last_active":"2024-09-13T23:09:23.369585+0000","last_peered":"2024-09-13T23:09:23.369585+0000","last_clean":"2024-09-13T23:09:23.369585+0000","last_became_active":"2024-09-13T23:05:12.114046+0000","last_became_peered":"2024-09-13T23:05:12.114046+0000","last_unstale":"2024-09-13T23:09:23.369585+0000","last_undegraded":"2024-09-13T23:09:23.369585+0000","last_fullsized":"2024-09-13T23:09:23.369585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:23.369464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:23.369464+0000","last_clean_scrub_stamp":"2024-09-13T23:09:23.369464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:11.044148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:27.144683+0000","last_change":"2024-09-13T23:09:27.144683+0000","last_active":"2024-09-13T23:09:27.144683+0000","last_peered":"2024-09-13T23:09:27.144683+0000","last_clean":"2024-09-13T23:09:27.144683+0000","last_became_active":"2024-09-13T23:05:14.123783+0000","last_became_peered":"2024-09-13T23:05:14.123783+0000","last_unstale":"2024-09-13T23:09:27.144683+0000","last_undegraded":"2024-09-13T23:09:27.144683+0000","last_fullsized":"2024-09-13T23:09:27.144683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:27.144522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:27.144522+0000","last_clean_scrub_stamp":"2024-09-13T23:09:27.144522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:21.400330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:14.109600+0000","last_change":"2024-09-13T23:09:14.109600+0000","last_active":"2024-09-13T23:09:14.109600+0000","last_peered":"2024-09-13T23:09:14.109600+0000","last_clean":"2024-09-13T23:09:14.109600+0000","last_became_active":"2024-09-13T23:05:12.137465+0000","last_became_peered":"2024-09-13T23:05:12.137465+0000","last_unstale":"2024-09-13T23:09:14.109600+0000","last_undegraded":"2024-09-13T23:09:14.109600+0000","last_fullsized":"2024-09-13T23:09:14.109600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:14.109435+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:14.109435+0000","last_clean_scrub_stamp":"2024-09-13T23:09:14.109435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:22.061050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:03.259762+0000","last_change":"2024-09-13T23:09:03.259762+0000","last_active":"2024-09-13T23:09:03.259762+0000","last_peered":"2024-09-13T23:09:03.259762+0000","last_clean":"2024-09-13T23:09:03.259762+0000","last_became_active":"2024-09-13T23:05:14.121425+0000","last_became_peered":"2024-09-13T23:05:14.121425+0000","last_unstale":"2024-09-13T23:09:03.259762+0000","last_undegraded":"2024-09-13T23:09:03.259762+0000","last_fullsized":"2024-09-13T23:09:03.259762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:03.259607+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:03.259607+0000","last_clean_scrub_stamp":"2024-09-13T23:09:03.259607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:17.228503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:15.673431+0000","last_change":"2024-09-13T23:09:15.673456+0000","last_active":"2024-09-13T23:09:15.673431+0000","last_peered":"2024-09-13T23:09:15.673431+0000","last_clean":"2024-09-13T23:09:15.673431+0000","last_became_active":"2024-09-13T23:05:12.115546+0000","last_became_peered":"2024-09-13T23:05:12.115546+0000","last_unstale":"2024-09-13T23:09:15.673431+0000","last_undegraded":"2024-09-13T23:09:15.673431+0000","last_fullsized":"2024-09-13T23:09:15.673431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:15.673343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:15.673343+0000","last_clean_scrub_stamp":"2024-09-13T23:09:15.673343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:52.254618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:11.116761+0000","last_change":"2024-09-13T23:09:11.116761+0000","last_active":"2024-09-13T23:09:11.116761+0000","last_peered":"2024-09-13T23:09:11.116761+0000","last_clean":"2024-09-13T23:09:11.116761+0000","last_became_active":"2024-09-13T23:05:14.122944+0000","last_became_peered":"2024-09-13T23:05:14.122944+0000","last_unstale":"2024-09-13T23:09:11.116761+0000","last_undegraded":"2024-09-13T23:09:11.116761+0000","last_fullsized":"2024-09-13T23:09:11.116761+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:11.116646+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:11.116646+0000","last_clean_scrub_stamp":"2024-09-13T23:09:11.116646+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:13.491798+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:17.266434+0000","last_change":"2024-09-13T23:09:17.266434+0000","last_active":"2024-09-13T23:09:17.266434+0000","last_peered":"2024-09-13T23:09:17.266434+0000","last_clean":"2024-09-13T23:09:17.266434+0000","last_became_active":"2024-09-13T23:05:12.118347+0000","last_became_peered":"2024-09-13T23:05:12.118347+0000","last_unstale":"2024-09-13T23:09:17.266434+0000","last_undegraded":"2024-09-13T23:09:17.266434+0000","last_fullsized":"2024-09-13T23:09:17.266434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:17.266296+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:17.266296+0000","last_clean_scrub_stamp":"2024-09-13T23:09:17.266296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:09:23.350084+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:52.144661+0000","last_change":"2024-09-13T23:08:52.144724+0000","last_active":"2024-09-13T23:08:52.144661+0000","last_peered":"2024-09-13T23:08:52.144661+0000","last_clean":"2024-09-13T23:08:52.144661+0000","last_became_active":"2024-09-13T23:05:14.124593+0000","last_became_peered":"2024-09-13T23:05:14.124593+0000","last_unstale":"2024-09-13T23:08:52.144661+0000","last_undegraded":"2024-09-13T23:08:52.144661+0000","last_fullsized":"2024-09-13T23:08:52.144661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:08:52.144556+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:08:52.144556+0000","last_clean_scrub_stamp":"2024-09-13T23:08:52.144556+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:42.175168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:28.374614+0000","last_change":"2024-09-13T23:09:28.374614+0000","last_active":"2024-09-13T23:09:28.374614+0000","last_peered":"2024-09-13T23:09:28.374614+0000","last_clean":"2024-09-13T23:09:28.374614+0000","last_became_active":"2024-09-13T23:05:12.141628+0000","last_became_peered":"2024-09-13T23:05:12.141628+0000","last_unstale":"2024-09-13T23:09:28.374614+0000","last_undegraded":"2024-09-13T23:09:28.374614+0000","last_fullsized":"2024-09-13T23:09:28.374614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:28.374441+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:28.374441+0000","last_clean_scrub_stamp":"2024-09-13T23:09:28.374441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:02:48.649334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:07.305283+0000","last_change":"2024-09-13T23:09:07.305307+0000","last_active":"2024-09-13T23:09:07.305283+0000","last_peered":"2024-09-13T23:09:07.305283+0000","last_clean":"2024-09-13T23:09:07.305283+0000","last_became_active":"2024-09-13T23:05:14.113710+0000","last_became_peered":"2024-09-13T23:05:14.113710+0000","last_unstale":"2024-09-13T23:09:07.305283+0000","last_undegraded":"2024-09-13T23:09:07.305283+0000","last_fullsized":"2024-09-13T23:09:07.305283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:07.305196+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:07.305196+0000","last_clean_scrub_stamp":"2024-09-13T23:09:07.305196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:09.207268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:15.319813+0000","last_change":"2024-09-13T23:09:15.319854+0000","last_active":"2024-09-13T23:09:15.319813+0000","last_peered":"2024-09-13T23:09:15.319813+0000","last_clean":"2024-09-13T23:09:15.319813+0000","last_became_active":"2024-09-13T23:05:12.118716+0000","last_became_peered":"2024-09-13T23:05:12.118716+0000","last_unstale":"2024-09-13T23:09:15.319813+0000","last_undegraded":"2024-09-13T23:09:15.319813+0000","last_fullsized":"2024-09-13T23:09:15.319813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:15.319694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:15.319694+0000","last_clean_scrub_stamp":"2024-09-13T23:09:15.319694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:48.887827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:16.300552+0000","last_change":"2024-09-13T23:09:16.300578+0000","last_active":"2024-09-13T23:09:16.300552+0000","last_peered":"2024-09-13T23:09:16.300552+0000","last_clean":"2024-09-13T23:09:16.300552+0000","last_became_active":"2024-09-13T23:05:14.120489+0000","last_became_peered":"2024-09-13T23:05:14.120489+0000","last_unstale":"2024-09-13T23:09:16.300552+0000","last_undegraded":"2024-09-13T23:09:16.300552+0000","last_fullsized":"2024-09-13T23:09:16.300552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:16.300464+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:16.300464+0000","last_clean_scrub_stamp":"2024-09-13T23:09:16.300464+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:11:03.837494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:08.181541+0000","last_change":"2024-09-13T23:09:08.181573+0000","last_active":"2024-09-13T23:09:08.181541+0000","last_peered":"2024-09-13T23:09:08.181541+0000","last_clean":"2024-09-13T23:09:08.181541+0000","last_became_active":"2024-09-13T23:05:12.137735+0000","last_became_peered":"2024-09-13T23:05:12.137735+0000","last_unstale":"2024-09-13T23:09:08.181541+0000","last_undegraded":"2024-09-13T23:09:08.181541+0000","last_fullsized":"2024-09-13T23:09:08.181541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:08.181438+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:08.181438+0000","last_clean_scrub_stamp":"2024-09-13T23:09:08.181438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:17:01.878876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:03.187889+0000","last_change":"2024-09-13T23:09:03.187963+0000","last_active":"2024-09-13T23:09:03.187889+0000","last_peered":"2024-09-13T23:09:03.187889+0000","last_clean":"2024-09-13T23:09:03.187889+0000","last_became_active":"2024-09-13T23:05:14.121389+0000","last_became_peered":"2024-09-13T23:05:14.121389+0000","last_unstale":"2024-09-13T23:09:03.187889+0000","last_undegraded":"2024-09-13T23:09:03.187889+0000","last_fullsized":"2024-09-13T23:09:03.187889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:03.187749+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:03.187749+0000","last_clean_scrub_stamp":"2024-09-13T23:09:03.187749+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:13.849825+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:18.114909+0000","last_change":"2024-09-13T23:09:18.114936+0000","last_active":"2024-09-13T23:09:18.114909+0000","last_peered":"2024-09-13T23:09:18.114909+0000","last_clean":"2024-09-13T23:09:18.114909+0000","last_became_active":"2024-09-13T23:05:12.137118+0000","last_became_peered":"2024-09-13T23:05:12.137118+0000","last_unstale":"2024-09-13T23:09:18.114909+0000","last_undegraded":"2024-09-13T23:09:18.114909+0000","last_fullsized":"2024-09-13T23:09:18.114909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:18.114817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:18.114817+0000","last_clean_scrub_stamp":"2024-09-13T23:09:18.114817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:13:09.651355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'4","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:54.159363+0000","last_change":"2024-09-13T23:08:54.159390+0000","last_active":"2024-09-13T23:08:54.159363+0000","last_peered":"2024-09-13T23:08:54.159363+0000","last_clean":"2024-09-13T23:08:54.159363+0000","last_became_active":"2024-09-13T23:05:14.124507+0000","last_became_peered":"2024-09-13T23:05:14.124507+0000","last_unstale":"2024-09-13T23:08:54.159363+0000","last_undegraded":"2024-09-13T23:08:54.159363+0000","last_fullsized":"2024-09-13T23:08:54.159363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:08:54.159267+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:08:54.159267+0000","last_clean_scrub_stamp":"2024-09-13T23:08:54.159267+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:56.506120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:27.076303+0000","last_change":"2024-09-13T23:05:12.138932+0000","last_active":"2024-09-13T23:07:27.076303+0000","last_peered":"2024-09-13T23:07:27.076303+0000","last_clean":"2024-09-13T23:07:27.076303+0000","last_became_active":"2024-09-13T23:05:12.138577+0000","last_became_peered":"2024-09-13T23:05:12.138577+0000","last_unstale":"2024-09-13T23:07:27.076303+0000","last_undegraded":"2024-09-13T23:07:27.076303+0000","last_fullsized":"2024-09-13T23:07:27.076303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:02.166151+0000","last_change":"2024-09-13T23:09:02.166179+0000","last_active":"2024-09-13T23:09:02.166151+0000","last_peered":"2024-09-13T23:09:02.166151+0000","last_clean":"2024-09-13T23:09:02.166151+0000","last_became_active":"2024-09-13T23:05:14.124604+0000","last_became_peered":"2024-09-13T23:05:14.124604+0000","last_unstale":"2024-09-13T23:09:02.166151+0000","last_undegraded":"2024-09-13T23:09:02.166151+0000","last_fullsized":"2024-09-13T23:09:02.166151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:02.166057+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:02.166057+0000","last_clean_scrub_stamp":"2024-09-13T23:09:02.166057+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:42.683656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:27.076337+0000","last_change":"2024-09-13T23:05:12.141608+0000","last_active":"2024-09-13T23:07:27.076337+0000","last_peered":"2024-09-13T23:07:27.076337+0000","last_clean":"2024-09-13T23:07:27.076337+0000","last_became_active":"2024-09-13T23:05:12.140686+0000","last_became_peered":"2024-09-13T23:05:12.140686+0000","last_unstale":"2024-09-13T23:07:27.076337+0000","last_undegraded":"2024-09-13T23:07:27.076337+0000","last_fullsized":"2024-09-13T23:07:27.076337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:11.086073+0000","last_clean_scrub_stamp":"2024-09-13T23:05:11.086073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:50.447099+0000","last_change":"2024-09-13T23:08:50.447124+0000","last_active":"2024-09-13T23:08:50.447099+0000","last_peered":"2024-09-13T23:08:50.447099+0000","last_clean":"2024-09-13T23:08:50.447099+0000","last_became_active":"2024-09-13T23:05:14.125747+0000","last_became_peered":"2024-09-13T23:05:14.125747+0000","last_unstale":"2024-09-13T23:08:50.447099+0000","last_undegraded":"2024-09-13T23:08:50.447099+0000","last_fullsized":"2024-09-13T23:08:50.447099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T23:08:50.447009+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T23:08:50.447009+0000","last_clean_scrub_stamp":"2024-09-13T23:08:50.447009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:55.562708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:11.744115+0000","last_change":"2024-09-13T23:09:11.744140+0000","last_active":"2024-09-13T23:09:11.744115+0000","last_peered":"2024-09-13T23:09:11.744115+0000","last_clean":"2024-09-13T23:09:11.744115+0000","last_became_active":"2024-09-13T23:05:12.126202+0000","last_became_peered":"2024-09-13T23:05:12.126202+0000","last_unstale":"2024-09-13T23:09:11.744115+0000","last_undegraded":"2024-09-13T23:09:11.744115+0000","last_fullsized":"2024-09-13T23:09:11.744115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:11.743996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:11.743996+0000","last_clean_scrub_stamp":"2024-09-13T23:09:11.743996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:55:43.578151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:55.125436+0000","last_change":"2024-09-13T23:08:55.125462+0000","last_active":"2024-09-13T23:08:55.125436+0000","last_peered":"2024-09-13T23:08:55.125436+0000","last_clean":"2024-09-13T23:08:55.125436+0000","last_became_active":"2024-09-13T23:05:14.125457+0000","last_became_peered":"2024-09-13T23:05:14.125457+0000","last_unstale":"2024-09-13T23:08:55.125436+0000","last_undegraded":"2024-09-13T23:08:55.125436+0000","last_fullsized":"2024-09-13T23:08:55.125436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:08:55.125347+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:08:55.125347+0000","last_clean_scrub_stamp":"2024-09-13T23:08:55.125347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:52:24.032476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:22.245272+0000","last_change":"2024-09-13T23:09:22.245297+0000","last_active":"2024-09-13T23:09:22.245272+0000","last_peered":"2024-09-13T23:09:22.245272+0000","last_clean":"2024-09-13T23:09:22.245272+0000","last_became_active":"2024-09-13T23:05:12.149345+0000","last_became_peered":"2024-09-13T23:05:12.149345+0000","last_unstale":"2024-09-13T23:09:22.245272+0000","last_undegraded":"2024-09-13T23:09:22.245272+0000","last_fullsized":"2024-09-13T23:09:22.245272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:22.245177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:22.245177+0000","last_clean_scrub_stamp":"2024-09-13T23:09:22.245177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:23:42.634877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:29.410223+0000","last_change":"2024-09-13T23:09:29.410280+0000","last_active":"2024-09-13T23:09:29.410223+0000","last_peered":"2024-09-13T23:09:29.410223+0000","last_clean":"2024-09-13T23:09:29.410223+0000","last_became_active":"2024-09-13T23:05:12.140432+0000","last_became_peered":"2024-09-13T23:05:12.140432+0000","last_unstale":"2024-09-13T23:09:29.410223+0000","last_undegraded":"2024-09-13T23:09:29.410223+0000","last_fullsized":"2024-09-13T23:09:29.410223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:29.410108+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:29.410108+0000","last_clean_scrub_stamp":"2024-09-13T23:09:29.410108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:12.999465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:59.214167+0000","last_change":"2024-09-13T23:08:59.214240+0000","last_active":"2024-09-13T23:08:59.214167+0000","last_peered":"2024-09-13T23:08:59.214167+0000","last_clean":"2024-09-13T23:08:59.214167+0000","last_became_active":"2024-09-13T23:05:14.122105+0000","last_became_peered":"2024-09-13T23:05:14.122105+0000","last_unstale":"2024-09-13T23:08:59.214167+0000","last_undegraded":"2024-09-13T23:08:59.214167+0000","last_fullsized":"2024-09-13T23:08:59.214167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:08:59.214060+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:08:59.214060+0000","last_clean_scrub_stamp":"2024-09-13T23:08:59.214060+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:09.073630+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:11.352230+0000","last_change":"2024-09-13T23:09:11.352289+0000","last_active":"2024-09-13T23:09:11.352230+0000","last_peered":"2024-09-13T23:09:11.352230+0000","last_clean":"2024-09-13T23:09:11.352230+0000","last_became_active":"2024-09-13T23:05:12.120703+0000","last_became_peered":"2024-09-13T23:05:12.120703+0000","last_unstale":"2024-09-13T23:09:11.352230+0000","last_undegraded":"2024-09-13T23:09:11.352230+0000","last_fullsized":"2024-09-13T23:09:11.352230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:11.352120+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:11.352120+0000","last_clean_scrub_stamp":"2024-09-13T23:09:11.352120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:42:29.036211+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:07.162774+0000","last_change":"2024-09-13T23:09:07.162805+0000","last_active":"2024-09-13T23:09:07.162774+0000","last_peered":"2024-09-13T23:09:07.162774+0000","last_clean":"2024-09-13T23:09:07.162774+0000","last_became_active":"2024-09-13T23:05:14.121636+0000","last_became_peered":"2024-09-13T23:05:14.121636+0000","last_unstale":"2024-09-13T23:09:07.162774+0000","last_undegraded":"2024-09-13T23:09:07.162774+0000","last_fullsized":"2024-09-13T23:09:07.162774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T23:09:07.162687+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T23:09:07.162687+0000","last_clean_scrub_stamp":"2024-09-13T23:09:07.162687+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:33.457982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1527,"ondisk_log_size":1527,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1600,"num_read_kb":1490,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":12,"seq":51539607612,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":151994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640314,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40492,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331348,"statfs":{"total":96636764160,"available":96595300352,"internally_reserved":0,"allocated":1011712,"data_stored":739728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705723,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40520,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331320,"statfs":{"total":96636764160,"available":96595271680,"internally_reserved":0,"allocated":1040384,"data_stored":741822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":446464,"data_stored":151868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T23:09:34.853 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.853 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.854 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.854 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.854 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.854 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.854 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.855 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.855 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.855 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.855 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.856 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.856 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.856 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.856 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.856 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.857 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.857 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.857 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T23:05:00.063955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=0, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.857 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.858 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.858 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.858 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.858 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.859 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.859 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.859 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.859 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.860 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.860 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T23:05:11.086073+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=11, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:34.860 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T23:09:54.860 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T23:09:54.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.974+0000 7f837c4a5640 1 Processor -- start 2024-09-13T23:09:54.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.974+0000 7f837c4a5640 1 -- start start 2024-09-13T23:09:54.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.975+0000 7f837c4a5640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f837412e940 0x7f8374130d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:54.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.975+0000 7f837c4a5640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f837406eba0 con 0x7f837406eda0 2024-09-13T23:09:54.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.975+0000 7f837c4a5640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f837406d2f0 con 0x7f837412e940 2024-09-13T23:09:54.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.975+0000 7f8379a40640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f837412e940 0x7f8374130d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:54.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.975+0000 7f837a241640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f837406eda0 0x7f837406f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:52318/0 (socket says 172.21.15.17:52318) 2024-09-13T23:09:54.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.975+0000 7f837a241640 1 -- 172.21.15.17:0/2670110792 learned_addr learned my addr 172.21.15.17:0/2670110792 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:09:54.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.975+0000 7f8379a40640 1 --2- 172.21.15.17:0/2670110792 >> v2:172.21.15.17:3300/0 conn(0x7f837412e940 0x7f8374130d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46258/0 (socket says 172.21.15.17:46258) 2024-09-13T23:09:54.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.975+0000 7f8379a40640 1 -- 172.21.15.17:0/2670110792 >> v1:172.21.15.17:6789/0 conn(0x7f837406eda0 legacy=0x7f837406f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:54.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.975+0000 7f8379a40640 1 -- 172.21.15.17:0/2670110792 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8374070d50 con 0x7f837412e940 2024-09-13T23:09:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.976+0000 7f8379a40640 1 --2- 172.21.15.17:0/2670110792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f837412e940 0x7f8374130d30 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f8364009720 tx=0x7f836402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b4502041212861 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.976+0000 7f837923f640 1 -- 172.21.15.17:0/2670110792 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8364037070 con 0x7f837412e940 2024-09-13T23:09:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.976+0000 7f837923f640 1 -- 172.21.15.17:0/2670110792 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f836402ae20 con 0x7f837412e940 2024-09-13T23:09:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.976+0000 7f837923f640 1 -- 172.21.15.17:0/2670110792 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8364032590 con 0x7f837412e940 2024-09-13T23:09:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.976+0000 7f837c4a5640 1 -- 172.21.15.17:0/2670110792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f837412e940 msgr2=0x7f8374130d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.976+0000 7f837c4a5640 1 --2- 172.21.15.17:0/2670110792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f837412e940 0x7f8374130d30 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f8364009720 tx=0x7f836402a1a0 comp rx=0 tx=0).stop 2024-09-13T23:09:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.977+0000 7f837c4a5640 1 -- 172.21.15.17:0/2670110792 shutdown_connections 2024-09-13T23:09:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.977+0000 7f837c4a5640 1 --2- 172.21.15.17:0/2670110792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f837412e940 0x7f8374130d30 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:54.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.977+0000 7f837c4a5640 1 -- 172.21.15.17:0/2670110792 >> 172.21.15.17:0/2670110792 conn(0x7f837409a890 msgr2=0x7f837409aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:54.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.977+0000 7f837c4a5640 1 -- 172.21.15.17:0/2670110792 shutdown_connections 2024-09-13T23:09:54.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.977+0000 7f837c4a5640 1 -- 172.21.15.17:0/2670110792 wait complete. 2024-09-13T23:09:54.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.977+0000 7f837c4a5640 1 Processor -- start 2024-09-13T23:09:54.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.978+0000 7f837c4a5640 1 -- start start 2024-09-13T23:09:54.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.978+0000 7f837c4a5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f837406eda0 0x7f8374096850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:54.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.978+0000 7f837c4a5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f837406fcd0 con 0x7f837406eda0 2024-09-13T23:09:54.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.978+0000 7f837a241640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f837406eda0 0x7f8374096850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:54.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.978+0000 7f837a241640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f837406eda0 0x7f8374096850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46260/0 (socket says 172.21.15.17:46260) 2024-09-13T23:09:54.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.978+0000 7f837a241640 1 -- 172.21.15.17:0/565161997 learned_addr learned my addr 172.21.15.17:0/565161997 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:09:54.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.978+0000 7f837a241640 1 -- 172.21.15.17:0/565161997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f837412db00 con 0x7f837406eda0 2024-09-13T23:09:54.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.978+0000 7f837a241640 1 --2- 172.21.15.17:0/565161997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f837406eda0 0x7f8374096850 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f837000c4a0 tx=0x7f837000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:54.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.979+0000 7f836affd640 1 -- 172.21.15.17:0/565161997 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8370017070 con 0x7f837406eda0 2024-09-13T23:09:54.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.979+0000 7f836affd640 1 -- 172.21.15.17:0/565161997 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8370005c10 con 0x7f837406eda0 2024-09-13T23:09:54.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.979+0000 7f836affd640 1 -- 172.21.15.17:0/565161997 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8370007070 con 0x7f837406eda0 2024-09-13T23:09:54.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.979+0000 7f837c4a5640 1 -- 172.21.15.17:0/565161997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f837412b8c0 con 0x7f837406eda0 2024-09-13T23:09:54.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.979+0000 7f837c4a5640 1 -- 172.21.15.17:0/565161997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8374096d90 con 0x7f837406eda0 2024-09-13T23:09:54.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.980+0000 7f836affd640 1 -- 172.21.15.17:0/565161997 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f837001a070 con 0x7f837406eda0 2024-09-13T23:09:54.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.980+0000 7f837c4a5640 1 -- 172.21.15.17:0/565161997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8374097cf0 con 0x7f837406eda0 2024-09-13T23:09:54.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.980+0000 7f836affd640 1 --2- 172.21.15.17:0/565161997 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f83580382a0 0x7f835803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:54.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.980+0000 7f836affd640 1 -- 172.21.15.17:0/565161997 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f837004aff0 con 0x7f837406eda0 2024-09-13T23:09:54.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.980+0000 7f8379a40640 1 --2- 172.21.15.17:0/565161997 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f83580382a0 0x7f835803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:54.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.981+0000 7f8379a40640 1 --2- 172.21.15.17:0/565161997 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f83580382a0 0x7f835803a760 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8364034000 tx=0x7f836402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:54.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:54.985+0000 7f836affd640 1 -- 172.21.15.17:0/565161997 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8374097cf0 con 0x7f837406eda0 2024-09-13T23:09:55.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:55.158+0000 7f837c4a5640 1 -- 172.21.15.17:0/565161997 --> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8374125d80 con 0x7f83580382a0 2024-09-13T23:09:55.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:55.175+0000 7f836affd640 1 -- 172.21.15.17:0/565161997 <== mgr.4102 v2:172.21.15.164:6824/713838566 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666214 (secure 0 0 0) 0x7f8374125d80 con 0x7f83580382a0 2024-09-13T23:09:55.182 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:09:55.188 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-13T23:09:55.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:55.179+0000 7f837c4a5640 1 -- 172.21.15.17:0/565161997 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f83580382a0 msgr2=0x7f835803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:55.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:55.179+0000 7f837c4a5640 1 --2- 172.21.15.17:0/565161997 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f83580382a0 0x7f835803a760 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8364034000 tx=0x7f836402e000 comp rx=0 tx=0).stop 2024-09-13T23:09:55.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:55.179+0000 7f837c4a5640 1 -- 172.21.15.17:0/565161997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f837406eda0 msgr2=0x7f8374096850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:55.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:55.179+0000 7f837c4a5640 1 --2- 172.21.15.17:0/565161997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f837406eda0 0x7f8374096850 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f837000c4a0 tx=0x7f837000c960 comp rx=0 tx=0).stop 2024-09-13T23:09:55.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:55.180+0000 7f837c4a5640 1 -- 172.21.15.17:0/565161997 shutdown_connections 2024-09-13T23:09:55.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:55.180+0000 7f837c4a5640 1 --2- 172.21.15.17:0/565161997 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f83580382a0 0x7f835803a760 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:55.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:55.180+0000 7f837c4a5640 1 --2- 172.21.15.17:0/565161997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f837406eda0 0x7f8374096850 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:55.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:55.180+0000 7f837c4a5640 1 -- 172.21.15.17:0/565161997 >> 172.21.15.17:0/565161997 conn(0x7f837409a890 msgr2=0x7f8374071300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:55.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:55.180+0000 7f837c4a5640 1 -- 172.21.15.17:0/565161997 shutdown_connections 2024-09-13T23:09:55.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:09:55.180+0000 7f837c4a5640 1 -- 172.21.15.17:0/565161997 wait complete. 2024-09-13T23:09:55.192 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-09-13T23:09:54.128112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5088,"num_read_kb":4669,"num_write":2179,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4792,"ondisk_log_size":4792,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152608,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334752,"statfs":{"total":386547056640,"available":386390786048,"internally_reserved":0,"allocated":2981888,"data_stored":1785412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003758"},"pg_stats":[{"pgid":"3.3f","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:05.685819+0000","last_change":"2024-09-13T23:09:05.685819+0000","last_active":"2024-09-13T23:09:05.685819+0000","last_peered":"2024-09-13T23:09:05.685819+0000","last_clean":"2024-09-13T23:09:05.685819+0000","last_became_active":"2024-09-13T23:05:12.130009+0000","last_became_peered":"2024-09-13T23:05:12.130009+0000","last_unstale":"2024-09-13T23:09:05.685819+0000","last_undegraded":"2024-09-13T23:09:05.685819+0000","last_fullsized":"2024-09-13T23:09:05.685819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:05.685705+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:05.685705+0000","last_clean_scrub_stamp":"2024-09-13T23:09:05.685705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:20:30.741148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:00.090836+0000","last_change":"2024-09-13T23:09:00.090903+0000","last_active":"2024-09-13T23:09:00.090836+0000","last_peered":"2024-09-13T23:09:00.090836+0000","last_clean":"2024-09-13T23:09:00.090836+0000","last_became_active":"2024-09-13T23:05:14.125215+0000","last_became_peered":"2024-09-13T23:05:14.125215+0000","last_unstale":"2024-09-13T23:09:00.090836+0000","last_undegraded":"2024-09-13T23:09:00.090836+0000","last_fullsized":"2024-09-13T23:09:00.090836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:00.090719+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:00.090719+0000","last_clean_scrub_stamp":"2024-09-13T23:09:00.090719+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:25.638836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:19.352952+0000","last_change":"2024-09-13T23:09:19.352952+0000","last_active":"2024-09-13T23:09:19.352952+0000","last_peered":"2024-09-13T23:09:19.352952+0000","last_clean":"2024-09-13T23:09:19.352952+0000","last_became_active":"2024-09-13T23:05:12.118411+0000","last_became_peered":"2024-09-13T23:05:12.118411+0000","last_unstale":"2024-09-13T23:09:19.352952+0000","last_undegraded":"2024-09-13T23:09:19.352952+0000","last_fullsized":"2024-09-13T23:09:19.352952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:19.352818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:19.352818+0000","last_clean_scrub_stamp":"2024-09-13T23:09:19.352818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:01:53.423402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'8","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:19.203533+0000","last_change":"2024-09-13T23:09:19.203561+0000","last_active":"2024-09-13T23:09:19.203533+0000","last_peered":"2024-09-13T23:09:19.203533+0000","last_clean":"2024-09-13T23:09:19.203533+0000","last_became_active":"2024-09-13T23:05:14.109464+0000","last_became_peered":"2024-09-13T23:05:14.109464+0000","last_unstale":"2024-09-13T23:09:19.203533+0000","last_undegraded":"2024-09-13T23:09:19.203533+0000","last_fullsized":"2024-09-13T23:09:19.203533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:09:19.203420+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:09:19.203420+0000","last_clean_scrub_stamp":"2024-09-13T23:09:19.203420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:18.962285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:30.409267+0000","last_change":"2024-09-13T23:09:30.409308+0000","last_active":"2024-09-13T23:09:30.409267+0000","last_peered":"2024-09-13T23:09:30.409267+0000","last_clean":"2024-09-13T23:09:30.409267+0000","last_became_active":"2024-09-13T23:05:12.146191+0000","last_became_peered":"2024-09-13T23:05:12.146191+0000","last_unstale":"2024-09-13T23:09:30.409267+0000","last_undegraded":"2024-09-13T23:09:30.409267+0000","last_fullsized":"2024-09-13T23:09:30.409267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:30.409155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:30.409155+0000","last_clean_scrub_stamp":"2024-09-13T23:09:30.409155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:52.527696+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:15.200771+0000","last_change":"2024-09-13T23:09:15.200800+0000","last_active":"2024-09-13T23:09:15.200771+0000","last_peered":"2024-09-13T23:09:15.200771+0000","last_clean":"2024-09-13T23:09:15.200771+0000","last_became_active":"2024-09-13T23:05:14.110201+0000","last_became_peered":"2024-09-13T23:05:14.110201+0000","last_unstale":"2024-09-13T23:09:15.200771+0000","last_undegraded":"2024-09-13T23:09:15.200771+0000","last_fullsized":"2024-09-13T23:09:15.200771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:15.200679+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:15.200679+0000","last_clean_scrub_stamp":"2024-09-13T23:09:15.200679+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:03.593289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:01.547312+0000","last_change":"2024-09-13T23:09:01.547312+0000","last_active":"2024-09-13T23:09:01.547312+0000","last_peered":"2024-09-13T23:09:01.547312+0000","last_clean":"2024-09-13T23:09:01.547312+0000","last_became_active":"2024-09-13T23:05:12.132461+0000","last_became_peered":"2024-09-13T23:05:12.132461+0000","last_unstale":"2024-09-13T23:09:01.547312+0000","last_undegraded":"2024-09-13T23:09:01.547312+0000","last_fullsized":"2024-09-13T23:09:01.547312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:01.547143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:01.547143+0000","last_clean_scrub_stamp":"2024-09-13T23:09:01.547143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:01.270260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:09.323049+0000","last_change":"2024-09-13T23:09:09.323075+0000","last_active":"2024-09-13T23:09:09.323049+0000","last_peered":"2024-09-13T23:09:09.323049+0000","last_clean":"2024-09-13T23:09:09.323049+0000","last_became_active":"2024-09-13T23:05:14.113430+0000","last_became_peered":"2024-09-13T23:05:14.113430+0000","last_unstale":"2024-09-13T23:09:09.323049+0000","last_undegraded":"2024-09-13T23:09:09.323049+0000","last_fullsized":"2024-09-13T23:09:09.323049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:09.322940+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:09.322940+0000","last_clean_scrub_stamp":"2024-09-13T23:09:09.322940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:32.644280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:36.489627+0000","last_change":"2024-09-13T23:09:36.489656+0000","last_active":"2024-09-13T23:09:36.489627+0000","last_peered":"2024-09-13T23:09:36.489627+0000","last_clean":"2024-09-13T23:09:36.489627+0000","last_became_active":"2024-09-13T23:05:12.146220+0000","last_became_peered":"2024-09-13T23:05:12.146220+0000","last_unstale":"2024-09-13T23:09:36.489627+0000","last_undegraded":"2024-09-13T23:09:36.489627+0000","last_fullsized":"2024-09-13T23:09:36.489627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:36.489516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:36.489516+0000","last_clean_scrub_stamp":"2024-09-13T23:09:36.489516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:38:05.614897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'4","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:09.140867+0000","last_change":"2024-09-13T23:09:09.140867+0000","last_active":"2024-09-13T23:09:09.140867+0000","last_peered":"2024-09-13T23:09:09.140867+0000","last_clean":"2024-09-13T23:09:09.140867+0000","last_became_active":"2024-09-13T23:05:14.122513+0000","last_became_peered":"2024-09-13T23:05:14.122513+0000","last_unstale":"2024-09-13T23:09:09.140867+0000","last_undegraded":"2024-09-13T23:09:09.140867+0000","last_fullsized":"2024-09-13T23:09:09.140867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:09.140751+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:09.140751+0000","last_clean_scrub_stamp":"2024-09-13T23:09:09.140751+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:41.543687+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:13.729839+0000","last_change":"2024-09-13T23:09:13.729869+0000","last_active":"2024-09-13T23:09:13.729839+0000","last_peered":"2024-09-13T23:09:13.729839+0000","last_clean":"2024-09-13T23:09:13.729839+0000","last_became_active":"2024-09-13T23:05:12.113601+0000","last_became_peered":"2024-09-13T23:05:12.113601+0000","last_unstale":"2024-09-13T23:09:13.729839+0000","last_undegraded":"2024-09-13T23:09:13.729839+0000","last_fullsized":"2024-09-13T23:09:13.729839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:13.729730+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:13.729730+0000","last_clean_scrub_stamp":"2024-09-13T23:09:13.729730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:23:12.017749+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:51.435662+0000","last_change":"2024-09-13T23:08:51.435662+0000","last_active":"2024-09-13T23:08:51.435662+0000","last_peered":"2024-09-13T23:08:51.435662+0000","last_clean":"2024-09-13T23:08:51.435662+0000","last_became_active":"2024-09-13T23:05:14.124971+0000","last_became_peered":"2024-09-13T23:05:14.124971+0000","last_unstale":"2024-09-13T23:08:51.435662+0000","last_undegraded":"2024-09-13T23:08:51.435662+0000","last_fullsized":"2024-09-13T23:08:51.435662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:08:51.435544+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:08:51.435544+0000","last_clean_scrub_stamp":"2024-09-13T23:08:51.435544+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:42:37.254383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:47.529593+0000","last_change":"2024-09-13T23:09:47.529621+0000","last_active":"2024-09-13T23:09:47.529593+0000","last_peered":"2024-09-13T23:09:47.529593+0000","last_clean":"2024-09-13T23:09:47.529593+0000","last_became_active":"2024-09-13T23:05:12.138297+0000","last_became_peered":"2024-09-13T23:05:12.138297+0000","last_unstale":"2024-09-13T23:09:47.529593+0000","last_undegraded":"2024-09-13T23:09:47.529593+0000","last_fullsized":"2024-09-13T23:09:47.529593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:47.529474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:47.529474+0000","last_clean_scrub_stamp":"2024-09-13T23:09:47.529474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:06.402040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'16","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:55.622772+0000","last_change":"2024-09-13T23:08:55.622772+0000","last_active":"2024-09-13T23:08:55.622772+0000","last_peered":"2024-09-13T23:08:55.622772+0000","last_clean":"2024-09-13T23:08:55.622772+0000","last_became_active":"2024-09-13T23:05:14.123950+0000","last_became_peered":"2024-09-13T23:05:14.123950+0000","last_unstale":"2024-09-13T23:08:55.622772+0000","last_undegraded":"2024-09-13T23:08:55.622772+0000","last_fullsized":"2024-09-13T23:08:55.622772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:08:55.622652+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:08:55.622652+0000","last_clean_scrub_stamp":"2024-09-13T23:08:55.622652+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:33.082242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":68,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:25.373379+0000","last_change":"2024-09-13T23:09:25.373412+0000","last_active":"2024-09-13T23:09:25.373379+0000","last_peered":"2024-09-13T23:09:25.373379+0000","last_clean":"2024-09-13T23:09:25.373379+0000","last_became_active":"2024-09-13T23:05:12.117028+0000","last_became_peered":"2024-09-13T23:05:12.117028+0000","last_unstale":"2024-09-13T23:09:25.373379+0000","last_undegraded":"2024-09-13T23:09:25.373379+0000","last_fullsized":"2024-09-13T23:09:25.373379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:25.373281+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:25.373281+0000","last_clean_scrub_stamp":"2024-09-13T23:09:25.373281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:50:11.058455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'18","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:08.738777+0000","last_change":"2024-09-13T23:09:08.738777+0000","last_active":"2024-09-13T23:09:08.738777+0000","last_peered":"2024-09-13T23:09:08.738777+0000","last_clean":"2024-09-13T23:09:08.738777+0000","last_became_active":"2024-09-13T23:05:14.114831+0000","last_became_peered":"2024-09-13T23:05:14.114831+0000","last_unstale":"2024-09-13T23:09:08.738777+0000","last_undegraded":"2024-09-13T23:09:08.738777+0000","last_fullsized":"2024-09-13T23:09:08.738777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-13T23:09:08.738611+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-13T23:09:08.738611+0000","last_clean_scrub_stamp":"2024-09-13T23:09:08.738611+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:35.297289+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'16","reported_seq":90,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:17.206970+0000","last_change":"2024-09-13T23:09:17.207009+0000","last_active":"2024-09-13T23:09:17.206970+0000","last_peered":"2024-09-13T23:09:17.206970+0000","last_clean":"2024-09-13T23:09:17.206970+0000","last_became_active":"2024-09-13T23:05:14.109903+0000","last_became_peered":"2024-09-13T23:05:14.109903+0000","last_unstale":"2024-09-13T23:09:17.206970+0000","last_undegraded":"2024-09-13T23:09:17.206970+0000","last_fullsized":"2024-09-13T23:09:17.206970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:09:17.206881+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:09:17.206881+0000","last_clean_scrub_stamp":"2024-09-13T23:09:17.206881+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:16.967231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":66,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:23.120787+0000","last_change":"2024-09-13T23:09:23.120815+0000","last_active":"2024-09-13T23:09:23.120787+0000","last_peered":"2024-09-13T23:09:23.120787+0000","last_clean":"2024-09-13T23:09:23.120787+0000","last_became_active":"2024-09-13T23:05:12.136334+0000","last_became_peered":"2024-09-13T23:05:12.136334+0000","last_unstale":"2024-09-13T23:09:23.120787+0000","last_undegraded":"2024-09-13T23:09:23.120787+0000","last_fullsized":"2024-09-13T23:09:23.120787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:23.120702+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:23.120702+0000","last_clean_scrub_stamp":"2024-09-13T23:09:23.120702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:00:53.217930+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'12","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:56.098271+0000","last_change":"2024-09-13T23:08:56.098300+0000","last_active":"2024-09-13T23:08:56.098271+0000","last_peered":"2024-09-13T23:08:56.098271+0000","last_clean":"2024-09-13T23:08:56.098271+0000","last_became_active":"2024-09-13T23:05:14.124023+0000","last_became_peered":"2024-09-13T23:05:14.124023+0000","last_unstale":"2024-09-13T23:08:56.098271+0000","last_undegraded":"2024-09-13T23:08:56.098271+0000","last_fullsized":"2024-09-13T23:08:56.098271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T23:08:56.098169+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T23:08:56.098169+0000","last_clean_scrub_stamp":"2024-09-13T23:08:56.098169+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:57:17.059952+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:09.755839+0000","last_change":"2024-09-13T23:09:09.755866+0000","last_active":"2024-09-13T23:09:09.755839+0000","last_peered":"2024-09-13T23:09:09.755839+0000","last_clean":"2024-09-13T23:09:09.755839+0000","last_became_active":"2024-09-13T23:05:12.126336+0000","last_became_peered":"2024-09-13T23:05:12.126336+0000","last_unstale":"2024-09-13T23:09:09.755839+0000","last_undegraded":"2024-09-13T23:09:09.755839+0000","last_fullsized":"2024-09-13T23:09:09.755839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:09.755744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:09.755744+0000","last_clean_scrub_stamp":"2024-09-13T23:09:09.755744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:45:37.055339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:59.078407+0000","last_change":"2024-09-13T23:08:59.078435+0000","last_active":"2024-09-13T23:08:59.078407+0000","last_peered":"2024-09-13T23:08:59.078407+0000","last_clean":"2024-09-13T23:08:59.078407+0000","last_became_active":"2024-09-13T23:05:14.125247+0000","last_became_peered":"2024-09-13T23:05:14.125247+0000","last_unstale":"2024-09-13T23:08:59.078407+0000","last_undegraded":"2024-09-13T23:08:59.078407+0000","last_fullsized":"2024-09-13T23:08:59.078407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:08:59.078318+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:08:59.078318+0000","last_clean_scrub_stamp":"2024-09-13T23:08:59.078318+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:22:14.387256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:12.069311+0000","last_change":"2024-09-13T23:09:12.069334+0000","last_active":"2024-09-13T23:09:12.069311+0000","last_peered":"2024-09-13T23:09:12.069311+0000","last_clean":"2024-09-13T23:09:12.069311+0000","last_became_active":"2024-09-13T23:05:12.139103+0000","last_became_peered":"2024-09-13T23:05:12.139103+0000","last_unstale":"2024-09-13T23:09:12.069311+0000","last_undegraded":"2024-09-13T23:09:12.069311+0000","last_fullsized":"2024-09-13T23:09:12.069311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:12.069217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:12.069217+0000","last_clean_scrub_stamp":"2024-09-13T23:09:12.069217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:18.902550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:12.323567+0000","last_change":"2024-09-13T23:09:12.323598+0000","last_active":"2024-09-13T23:09:12.323567+0000","last_peered":"2024-09-13T23:09:12.323567+0000","last_clean":"2024-09-13T23:09:12.323567+0000","last_became_active":"2024-09-13T23:05:14.120397+0000","last_became_peered":"2024-09-13T23:05:14.120397+0000","last_unstale":"2024-09-13T23:09:12.323567+0000","last_undegraded":"2024-09-13T23:09:12.323567+0000","last_fullsized":"2024-09-13T23:09:12.323567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:09:12.323473+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:09:12.323473+0000","last_clean_scrub_stamp":"2024-09-13T23:09:12.323473+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:44.704923+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:25.203432+0000","last_change":"2024-09-13T23:09:25.203458+0000","last_active":"2024-09-13T23:09:25.203432+0000","last_peered":"2024-09-13T23:09:25.203432+0000","last_clean":"2024-09-13T23:09:25.203432+0000","last_became_active":"2024-09-13T23:05:12.139022+0000","last_became_peered":"2024-09-13T23:05:12.139022+0000","last_unstale":"2024-09-13T23:09:25.203432+0000","last_undegraded":"2024-09-13T23:09:25.203432+0000","last_fullsized":"2024-09-13T23:09:25.203432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:25.203342+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:25.203342+0000","last_clean_scrub_stamp":"2024-09-13T23:09:25.203342+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:50:10.888515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:06.687548+0000","last_change":"2024-09-13T23:09:06.687578+0000","last_active":"2024-09-13T23:09:06.687548+0000","last_peered":"2024-09-13T23:09:06.687548+0000","last_clean":"2024-09-13T23:09:06.687548+0000","last_became_active":"2024-09-13T23:05:14.114261+0000","last_became_peered":"2024-09-13T23:05:14.114261+0000","last_unstale":"2024-09-13T23:09:06.687548+0000","last_undegraded":"2024-09-13T23:09:06.687548+0000","last_fullsized":"2024-09-13T23:09:06.687548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T23:09:06.687450+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T23:09:06.687450+0000","last_clean_scrub_stamp":"2024-09-13T23:09:06.687450+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:18:07.608760+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:09.256822+0000","last_change":"2024-09-13T23:09:09.256855+0000","last_active":"2024-09-13T23:09:09.256822+0000","last_peered":"2024-09-13T23:09:09.256822+0000","last_clean":"2024-09-13T23:09:09.256822+0000","last_became_active":"2024-09-13T23:05:12.129589+0000","last_became_peered":"2024-09-13T23:05:12.129589+0000","last_unstale":"2024-09-13T23:09:09.256822+0000","last_undegraded":"2024-09-13T23:09:09.256822+0000","last_fullsized":"2024-09-13T23:09:09.256822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:09.256730+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:09.256730+0000","last_clean_scrub_stamp":"2024-09-13T23:09:09.256730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:49.454652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'6","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:04.139177+0000","last_change":"2024-09-13T23:09:04.139219+0000","last_active":"2024-09-13T23:09:04.139177+0000","last_peered":"2024-09-13T23:09:04.139177+0000","last_clean":"2024-09-13T23:09:04.139177+0000","last_became_active":"2024-09-13T23:05:14.118922+0000","last_became_peered":"2024-09-13T23:05:14.118922+0000","last_unstale":"2024-09-13T23:09:04.139177+0000","last_undegraded":"2024-09-13T23:09:04.139177+0000","last_fullsized":"2024-09-13T23:09:04.139177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:04.139018+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:04.139018+0000","last_clean_scrub_stamp":"2024-09-13T23:09:04.139018+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:18.107915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:41.528892+0000","last_change":"2024-09-13T23:09:41.528892+0000","last_active":"2024-09-13T23:09:41.528892+0000","last_peered":"2024-09-13T23:09:41.528892+0000","last_clean":"2024-09-13T23:09:41.528892+0000","last_became_active":"2024-09-13T23:05:12.139690+0000","last_became_peered":"2024-09-13T23:05:12.139690+0000","last_unstale":"2024-09-13T23:09:41.528892+0000","last_undegraded":"2024-09-13T23:09:41.528892+0000","last_fullsized":"2024-09-13T23:09:41.528892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:41.528766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:41.528766+0000","last_clean_scrub_stamp":"2024-09-13T23:09:41.528766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:34.433107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'38","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:29.140377+0000","last_change":"2024-09-13T23:09:29.140403+0000","last_active":"2024-09-13T23:09:29.140377+0000","last_peered":"2024-09-13T23:09:29.140377+0000","last_clean":"2024-09-13T23:09:29.140377+0000","last_became_active":"2024-09-13T23:05:22.145872+0000","last_became_peered":"2024-09-13T23:05:22.145872+0000","last_unstale":"2024-09-13T23:09:29.140377+0000","last_undegraded":"2024-09-13T23:09:29.140377+0000","last_fullsized":"2024-09-13T23:09:29.140377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-09-13T23:09:29.140290+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-09-13T23:09:29.140290+0000","last_clean_scrub_stamp":"2024-09-13T23:09:29.140290+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:05.101062+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":174,"num_write":103,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:18.206688+0000","last_change":"2024-09-13T23:09:18.206746+0000","last_active":"2024-09-13T23:09:18.206688+0000","last_peered":"2024-09-13T23:09:18.206688+0000","last_clean":"2024-09-13T23:09:18.206688+0000","last_became_active":"2024-09-13T23:05:14.109928+0000","last_became_peered":"2024-09-13T23:05:14.109928+0000","last_unstale":"2024-09-13T23:09:18.206688+0000","last_undegraded":"2024-09-13T23:09:18.206688+0000","last_fullsized":"2024-09-13T23:09:18.206688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:18.206589+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:18.206589+0000","last_clean_scrub_stamp":"2024-09-13T23:09:18.206589+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:14.724013+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:38.529119+0000","last_change":"2024-09-13T23:09:38.529119+0000","last_active":"2024-09-13T23:09:38.529119+0000","last_peered":"2024-09-13T23:09:38.529119+0000","last_clean":"2024-09-13T23:09:38.529119+0000","last_became_active":"2024-09-13T23:05:12.146236+0000","last_became_peered":"2024-09-13T23:05:12.146236+0000","last_unstale":"2024-09-13T23:09:38.529119+0000","last_undegraded":"2024-09-13T23:09:38.529119+0000","last_fullsized":"2024-09-13T23:09:38.529119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:38.528969+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:38.528969+0000","last_clean_scrub_stamp":"2024-09-13T23:09:38.528969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:56.953598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:39.624374+0000","last_change":"2024-09-13T23:08:39.624399+0000","last_active":"2024-09-13T23:08:39.624374+0000","last_peered":"2024-09-13T23:08:39.624374+0000","last_clean":"2024-09-13T23:08:39.624374+0000","last_became_active":"2024-09-13T23:05:16.123362+0000","last_became_peered":"2024-09-13T23:05:16.123362+0000","last_unstale":"2024-09-13T23:08:39.624374+0000","last_undegraded":"2024-09-13T23:08:39.624374+0000","last_fullsized":"2024-09-13T23:08:39.624374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:39.624277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:39.624277+0000","last_clean_scrub_stamp":"2024-09-13T23:08:39.624277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:59.071768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'39","reported_seq":94,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:02.251520+0000","last_change":"2024-09-13T23:09:02.251564+0000","last_active":"2024-09-13T23:09:02.251520+0000","last_peered":"2024-09-13T23:09:02.251520+0000","last_clean":"2024-09-13T23:09:02.251520+0000","last_became_active":"2024-09-13T23:05:18.132642+0000","last_became_peered":"2024-09-13T23:05:18.132642+0000","last_unstale":"2024-09-13T23:09:02.251520+0000","last_undegraded":"2024-09-13T23:09:02.251520+0000","last_fullsized":"2024-09-13T23:09:02.251520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-13T23:09:02.251433+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-13T23:09:02.251433+0000","last_clean_scrub_stamp":"2024-09-13T23:09:02.251433+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:58:30.036599+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:57.089213+0000","last_change":"2024-09-13T23:08:57.089257+0000","last_active":"2024-09-13T23:08:57.089213+0000","last_peered":"2024-09-13T23:08:57.089213+0000","last_clean":"2024-09-13T23:08:57.089213+0000","last_became_active":"2024-09-13T23:05:20.145271+0000","last_became_peered":"2024-09-13T23:05:20.145271+0000","last_unstale":"2024-09-13T23:08:57.089213+0000","last_undegraded":"2024-09-13T23:08:57.089213+0000","last_fullsized":"2024-09-13T23:08:57.089213+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:57.089110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:57.089110+0000","last_clean_scrub_stamp":"2024-09-13T23:08:57.089110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:10.929142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:33.260921+0000","last_change":"2024-09-13T23:09:33.260961+0000","last_active":"2024-09-13T23:09:33.260921+0000","last_peered":"2024-09-13T23:09:33.260921+0000","last_clean":"2024-09-13T23:09:33.260921+0000","last_became_active":"2024-09-13T23:05:22.150260+0000","last_became_peered":"2024-09-13T23:05:22.150260+0000","last_unstale":"2024-09-13T23:09:33.260921+0000","last_undegraded":"2024-09-13T23:09:33.260921+0000","last_fullsized":"2024-09-13T23:09:33.260921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-13T23:09:33.260833+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-13T23:09:33.260833+0000","last_clean_scrub_stamp":"2024-09-13T23:09:33.260833+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:59.740644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:10.302360+0000","last_change":"2024-09-13T23:09:10.302387+0000","last_active":"2024-09-13T23:09:10.302360+0000","last_peered":"2024-09-13T23:09:10.302360+0000","last_clean":"2024-09-13T23:09:10.302360+0000","last_became_active":"2024-09-13T23:05:14.113131+0000","last_became_peered":"2024-09-13T23:05:14.113131+0000","last_unstale":"2024-09-13T23:09:10.302360+0000","last_undegraded":"2024-09-13T23:09:10.302360+0000","last_fullsized":"2024-09-13T23:09:10.302360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:10.302251+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:10.302251+0000","last_clean_scrub_stamp":"2024-09-13T23:09:10.302251+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:23.722716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:59.616967+0000","last_change":"2024-09-13T23:08:59.616993+0000","last_active":"2024-09-13T23:08:59.616967+0000","last_peered":"2024-09-13T23:08:59.616967+0000","last_clean":"2024-09-13T23:08:59.616967+0000","last_became_active":"2024-09-13T23:05:12.133505+0000","last_became_peered":"2024-09-13T23:05:12.133505+0000","last_unstale":"2024-09-13T23:08:59.616967+0000","last_undegraded":"2024-09-13T23:08:59.616967+0000","last_fullsized":"2024-09-13T23:08:59.616967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:59.616881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:59.616881+0000","last_clean_scrub_stamp":"2024-09-13T23:08:59.616881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:40.852888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:48.133232+0000","last_change":"2024-09-13T23:08:48.133256+0000","last_active":"2024-09-13T23:08:48.133232+0000","last_peered":"2024-09-13T23:08:48.133232+0000","last_clean":"2024-09-13T23:08:48.133232+0000","last_became_active":"2024-09-13T23:05:16.124724+0000","last_became_peered":"2024-09-13T23:05:16.124724+0000","last_unstale":"2024-09-13T23:08:48.133232+0000","last_undegraded":"2024-09-13T23:08:48.133232+0000","last_fullsized":"2024-09-13T23:08:48.133232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:48.133136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:48.133136+0000","last_clean_scrub_stamp":"2024-09-13T23:08:48.133136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:23:32.736027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'10","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:38.121648+0000","last_change":"2024-09-13T23:08:38.121680+0000","last_active":"2024-09-13T23:08:38.121648+0000","last_peered":"2024-09-13T23:08:38.121648+0000","last_clean":"2024-09-13T23:08:38.121648+0000","last_became_active":"2024-09-13T23:05:18.126251+0000","last_became_peered":"2024-09-13T23:05:18.126251+0000","last_unstale":"2024-09-13T23:08:38.121648+0000","last_undegraded":"2024-09-13T23:08:38.121648+0000","last_fullsized":"2024-09-13T23:08:38.121648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T23:08:38.121563+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T23:08:38.121563+0000","last_clean_scrub_stamp":"2024-09-13T23:08:38.121563+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:16:06.466530+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:53.193423+0000","last_change":"2024-09-13T23:08:53.193447+0000","last_active":"2024-09-13T23:08:53.193423+0000","last_peered":"2024-09-13T23:08:53.193423+0000","last_clean":"2024-09-13T23:08:53.193423+0000","last_became_active":"2024-09-13T23:05:20.142564+0000","last_became_peered":"2024-09-13T23:05:20.142564+0000","last_unstale":"2024-09-13T23:08:53.193423+0000","last_undegraded":"2024-09-13T23:08:53.193423+0000","last_fullsized":"2024-09-13T23:08:53.193423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:53.193295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:53.193295+0000","last_clean_scrub_stamp":"2024-09-13T23:08:53.193295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:07:13.524706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:34.281179+0000","last_change":"2024-09-13T23:09:34.281211+0000","last_active":"2024-09-13T23:09:34.281179+0000","last_peered":"2024-09-13T23:09:34.281179+0000","last_clean":"2024-09-13T23:09:34.281179+0000","last_became_active":"2024-09-13T23:05:22.147493+0000","last_became_peered":"2024-09-13T23:05:22.147493+0000","last_unstale":"2024-09-13T23:09:34.281179+0000","last_undegraded":"2024-09-13T23:09:34.281179+0000","last_fullsized":"2024-09-13T23:09:34.281179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T23:09:34.281084+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T23:09:34.281084+0000","last_clean_scrub_stamp":"2024-09-13T23:09:34.281084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:53:59.476389+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:11.254327+0000","last_change":"2024-09-13T23:09:11.254390+0000","last_active":"2024-09-13T23:09:11.254327+0000","last_peered":"2024-09-13T23:09:11.254327+0000","last_clean":"2024-09-13T23:09:11.254327+0000","last_became_active":"2024-09-13T23:05:14.112986+0000","last_became_peered":"2024-09-13T23:05:14.112986+0000","last_unstale":"2024-09-13T23:09:11.254327+0000","last_undegraded":"2024-09-13T23:09:11.254327+0000","last_fullsized":"2024-09-13T23:09:11.254327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:11.254218+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:11.254218+0000","last_clean_scrub_stamp":"2024-09-13T23:09:11.254218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:42.812871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:48.553225+0000","last_change":"2024-09-13T23:09:48.553225+0000","last_active":"2024-09-13T23:09:48.553225+0000","last_peered":"2024-09-13T23:09:48.553225+0000","last_clean":"2024-09-13T23:09:48.553225+0000","last_became_active":"2024-09-13T23:05:12.138805+0000","last_became_peered":"2024-09-13T23:05:12.138805+0000","last_unstale":"2024-09-13T23:09:48.553225+0000","last_undegraded":"2024-09-13T23:09:48.553225+0000","last_fullsized":"2024-09-13T23:09:48.553225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:48.553088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:48.553088+0000","last_clean_scrub_stamp":"2024-09-13T23:09:48.553088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:19.824507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:25.804482+0000","last_change":"2024-09-13T23:09:25.804507+0000","last_active":"2024-09-13T23:09:25.804482+0000","last_peered":"2024-09-13T23:09:25.804482+0000","last_clean":"2024-09-13T23:09:25.804482+0000","last_became_active":"2024-09-13T23:05:49.165209+0000","last_became_peered":"2024-09-13T23:05:49.165209+0000","last_unstale":"2024-09-13T23:09:25.804482+0000","last_undegraded":"2024-09-13T23:09:25.804482+0000","last_fullsized":"2024-09-13T23:09:25.804482+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:25.804395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:25.804395+0000","last_clean_scrub_stamp":"2024-09-13T23:09:25.804395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:13.335216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"34'16","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:39.564155+0000","last_change":"2024-09-13T23:08:39.564192+0000","last_active":"2024-09-13T23:08:39.564155+0000","last_peered":"2024-09-13T23:08:39.564155+0000","last_clean":"2024-09-13T23:08:39.564155+0000","last_became_active":"2024-09-13T23:05:18.134363+0000","last_became_peered":"2024-09-13T23:05:18.134363+0000","last_unstale":"2024-09-13T23:08:39.564155+0000","last_undegraded":"2024-09-13T23:08:39.564155+0000","last_fullsized":"2024-09-13T23:08:39.564155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:08:39.564067+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:08:39.564067+0000","last_clean_scrub_stamp":"2024-09-13T23:08:39.564067+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:23.504537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'286","reported_seq":398,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:08.293685+0000","last_change":"2024-09-13T23:09:08.293738+0000","last_active":"2024-09-13T23:09:08.293685+0000","last_peered":"2024-09-13T23:09:08.293685+0000","last_clean":"2024-09-13T23:09:08.293685+0000","last_became_active":"2024-09-13T23:05:20.143986+0000","last_became_peered":"2024-09-13T23:05:20.143986+0000","last_unstale":"2024-09-13T23:09:08.293685+0000","last_undegraded":"2024-09-13T23:09:08.293685+0000","last_fullsized":"2024-09-13T23:09:08.293685+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-13T23:09:08.293563+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-13T23:09:08.293563+0000","last_clean_scrub_stamp":"2024-09-13T23:09:08.293563+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:25.538117+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'8","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:23.728251+0000","last_change":"2024-09-13T23:09:23.728279+0000","last_active":"2024-09-13T23:09:23.728251+0000","last_peered":"2024-09-13T23:09:23.728251+0000","last_clean":"2024-09-13T23:09:23.728251+0000","last_became_active":"2024-09-13T23:05:22.150977+0000","last_became_peered":"2024-09-13T23:05:22.150977+0000","last_unstale":"2024-09-13T23:09:23.728251+0000","last_undegraded":"2024-09-13T23:09:23.728251+0000","last_fullsized":"2024-09-13T23:09:23.728251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:09:23.728159+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:09:23.728159+0000","last_clean_scrub_stamp":"2024-09-13T23:09:23.728159+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:58.616304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'12","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:00.231436+0000","last_change":"2024-09-13T23:09:00.231505+0000","last_active":"2024-09-13T23:09:00.231436+0000","last_peered":"2024-09-13T23:09:00.231436+0000","last_clean":"2024-09-13T23:09:00.231436+0000","last_became_active":"2024-09-13T23:05:14.121960+0000","last_became_peered":"2024-09-13T23:05:14.121960+0000","last_unstale":"2024-09-13T23:09:00.231436+0000","last_undegraded":"2024-09-13T23:09:00.231436+0000","last_fullsized":"2024-09-13T23:09:00.231436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T23:09:00.231337+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T23:09:00.231337+0000","last_clean_scrub_stamp":"2024-09-13T23:09:00.231337+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:56.146066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:20.082030+0000","last_change":"2024-09-13T23:09:20.082030+0000","last_active":"2024-09-13T23:09:20.082030+0000","last_peered":"2024-09-13T23:09:20.082030+0000","last_clean":"2024-09-13T23:09:20.082030+0000","last_became_active":"2024-09-13T23:05:12.129019+0000","last_became_peered":"2024-09-13T23:05:12.129019+0000","last_unstale":"2024-09-13T23:09:20.082030+0000","last_undegraded":"2024-09-13T23:09:20.082030+0000","last_fullsized":"2024-09-13T23:09:20.082030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:20.081898+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:20.081898+0000","last_clean_scrub_stamp":"2024-09-13T23:09:20.081898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:08:01.867528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:41.570101+0000","last_change":"2024-09-13T23:08:41.570127+0000","last_active":"2024-09-13T23:08:41.570101+0000","last_peered":"2024-09-13T23:08:41.570101+0000","last_clean":"2024-09-13T23:08:41.570101+0000","last_became_active":"2024-09-13T23:05:16.122555+0000","last_became_peered":"2024-09-13T23:05:16.122555+0000","last_unstale":"2024-09-13T23:08:41.570101+0000","last_undegraded":"2024-09-13T23:08:41.570101+0000","last_fullsized":"2024-09-13T23:08:41.570101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:41.570017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:41.570017+0000","last_clean_scrub_stamp":"2024-09-13T23:08:41.570017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:53.974996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:41.566787+0000","last_change":"2024-09-13T23:08:41.566822+0000","last_active":"2024-09-13T23:08:41.566787+0000","last_peered":"2024-09-13T23:08:41.566787+0000","last_clean":"2024-09-13T23:08:41.566787+0000","last_became_active":"2024-09-13T23:05:18.128626+0000","last_became_peered":"2024-09-13T23:05:18.128626+0000","last_unstale":"2024-09-13T23:08:41.566787+0000","last_undegraded":"2024-09-13T23:08:41.566787+0000","last_fullsized":"2024-09-13T23:08:41.566787+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-13T23:08:41.566699+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-13T23:08:41.566699+0000","last_clean_scrub_stamp":"2024-09-13T23:08:41.566699+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:31.161100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:37.047437+0000","last_change":"2024-09-13T23:08:37.047469+0000","last_active":"2024-09-13T23:08:37.047437+0000","last_peered":"2024-09-13T23:08:37.047437+0000","last_clean":"2024-09-13T23:08:37.047437+0000","last_became_active":"2024-09-13T23:05:20.131943+0000","last_became_peered":"2024-09-13T23:05:20.131943+0000","last_unstale":"2024-09-13T23:08:37.047437+0000","last_undegraded":"2024-09-13T23:08:37.047437+0000","last_fullsized":"2024-09-13T23:08:37.047437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:37.047343+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:37.047343+0000","last_clean_scrub_stamp":"2024-09-13T23:08:37.047343+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:51:19.741192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:47.398608+0000","last_change":"2024-09-13T23:08:47.398608+0000","last_active":"2024-09-13T23:08:47.398608+0000","last_peered":"2024-09-13T23:08:47.398608+0000","last_clean":"2024-09-13T23:08:47.398608+0000","last_became_active":"2024-09-13T23:05:14.126659+0000","last_became_peered":"2024-09-13T23:05:14.126659+0000","last_unstale":"2024-09-13T23:08:47.398608+0000","last_undegraded":"2024-09-13T23:08:47.398608+0000","last_fullsized":"2024-09-13T23:08:47.398608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:47.398478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:47.398478+0000","last_clean_scrub_stamp":"2024-09-13T23:08:47.398478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:48.669511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:16.723632+0000","last_change":"2024-09-13T23:09:16.723632+0000","last_active":"2024-09-13T23:09:16.723632+0000","last_peered":"2024-09-13T23:09:16.723632+0000","last_clean":"2024-09-13T23:09:16.723632+0000","last_became_active":"2024-09-13T23:05:12.114453+0000","last_became_peered":"2024-09-13T23:05:12.114453+0000","last_unstale":"2024-09-13T23:09:16.723632+0000","last_undegraded":"2024-09-13T23:09:16.723632+0000","last_fullsized":"2024-09-13T23:09:16.723632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:16.723508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:16.723508+0000","last_clean_scrub_stamp":"2024-09-13T23:09:16.723508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:30:34.735824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:40.158918+0000","last_change":"2024-09-13T23:08:40.158918+0000","last_active":"2024-09-13T23:08:40.158918+0000","last_peered":"2024-09-13T23:08:40.158918+0000","last_clean":"2024-09-13T23:08:40.158918+0000","last_became_active":"2024-09-13T23:05:16.124324+0000","last_became_peered":"2024-09-13T23:05:16.124324+0000","last_unstale":"2024-09-13T23:08:40.158918+0000","last_undegraded":"2024-09-13T23:08:40.158918+0000","last_fullsized":"2024-09-13T23:08:40.158918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:40.158756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:40.158756+0000","last_clean_scrub_stamp":"2024-09-13T23:08:40.158756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:01.139147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'51","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:40.531513+0000","last_change":"2024-09-13T23:08:40.531513+0000","last_active":"2024-09-13T23:08:40.531513+0000","last_peered":"2024-09-13T23:08:40.531513+0000","last_clean":"2024-09-13T23:08:40.531513+0000","last_became_active":"2024-09-13T23:05:18.129887+0000","last_became_peered":"2024-09-13T23:05:18.129887+0000","last_unstale":"2024-09-13T23:08:40.531513+0000","last_undegraded":"2024-09-13T23:08:40.531513+0000","last_fullsized":"2024-09-13T23:08:40.531513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'51","last_scrub_stamp":"2024-09-13T23:08:40.531386+0000","last_deep_scrub":"34'51","last_deep_scrub_stamp":"2024-09-13T23:08:40.531386+0000","last_clean_scrub_stamp":"2024-09-13T23:08:40.531386+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:00:53.584234+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:36.003951+0000","last_change":"2024-09-13T23:08:36.003951+0000","last_active":"2024-09-13T23:08:36.003951+0000","last_peered":"2024-09-13T23:08:36.003951+0000","last_clean":"2024-09-13T23:08:36.003951+0000","last_became_active":"2024-09-13T23:05:20.135937+0000","last_became_peered":"2024-09-13T23:05:20.135937+0000","last_unstale":"2024-09-13T23:08:36.003951+0000","last_undegraded":"2024-09-13T23:08:36.003951+0000","last_fullsized":"2024-09-13T23:08:36.003951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:36.003822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:36.003822+0000","last_clean_scrub_stamp":"2024-09-13T23:08:36.003822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:36.100827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:54.634313+0000","last_change":"2024-09-13T23:08:54.634313+0000","last_active":"2024-09-13T23:08:54.634313+0000","last_peered":"2024-09-13T23:08:54.634313+0000","last_clean":"2024-09-13T23:08:54.634313+0000","last_became_active":"2024-09-13T23:05:22.146044+0000","last_became_peered":"2024-09-13T23:05:22.146044+0000","last_unstale":"2024-09-13T23:08:54.634313+0000","last_undegraded":"2024-09-13T23:08:54.634313+0000","last_fullsized":"2024-09-13T23:08:54.634313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T23:08:54.634198+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T23:08:54.634198+0000","last_clean_scrub_stamp":"2024-09-13T23:08:54.634198+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:58:43.552913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:06.131179+0000","last_change":"2024-09-13T23:09:06.131179+0000","last_active":"2024-09-13T23:09:06.131179+0000","last_peered":"2024-09-13T23:09:06.131179+0000","last_clean":"2024-09-13T23:09:06.131179+0000","last_became_active":"2024-09-13T23:05:14.116507+0000","last_became_peered":"2024-09-13T23:05:14.116507+0000","last_unstale":"2024-09-13T23:09:06.131179+0000","last_undegraded":"2024-09-13T23:09:06.131179+0000","last_fullsized":"2024-09-13T23:09:06.131179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:06.131036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:06.131036+0000","last_clean_scrub_stamp":"2024-09-13T23:09:06.131036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:00.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:14.711220+0000","last_change":"2024-09-13T23:09:14.711220+0000","last_active":"2024-09-13T23:09:14.711220+0000","last_peered":"2024-09-13T23:09:14.711220+0000","last_clean":"2024-09-13T23:09:14.711220+0000","last_became_active":"2024-09-13T23:05:12.115025+0000","last_became_peered":"2024-09-13T23:05:12.115025+0000","last_unstale":"2024-09-13T23:09:14.711220+0000","last_undegraded":"2024-09-13T23:09:14.711220+0000","last_fullsized":"2024-09-13T23:09:14.711220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:14.711051+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:14.711051+0000","last_clean_scrub_stamp":"2024-09-13T23:09:14.711051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:35:37.823812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:56.177873+0000","last_change":"2024-09-13T23:08:56.177873+0000","last_active":"2024-09-13T23:08:56.177873+0000","last_peered":"2024-09-13T23:08:56.177873+0000","last_clean":"2024-09-13T23:08:56.177873+0000","last_became_active":"2024-09-13T23:05:16.118494+0000","last_became_peered":"2024-09-13T23:05:16.118494+0000","last_unstale":"2024-09-13T23:08:56.177873+0000","last_undegraded":"2024-09-13T23:08:56.177873+0000","last_fullsized":"2024-09-13T23:08:56.177873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:56.177744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:56.177744+0000","last_clean_scrub_stamp":"2024-09-13T23:08:56.177744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:53.534857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:03.229920+0000","last_change":"2024-09-13T23:09:03.229920+0000","last_active":"2024-09-13T23:09:03.229920+0000","last_peered":"2024-09-13T23:09:03.229920+0000","last_clean":"2024-09-13T23:09:03.229920+0000","last_became_active":"2024-09-13T23:05:18.134130+0000","last_became_peered":"2024-09-13T23:05:18.134130+0000","last_unstale":"2024-09-13T23:09:03.229920+0000","last_undegraded":"2024-09-13T23:09:03.229920+0000","last_fullsized":"2024-09-13T23:09:03.229920+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-13T23:09:03.229792+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-13T23:09:03.229792+0000","last_clean_scrub_stamp":"2024-09-13T23:09:03.229792+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:13.414475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:42.005343+0000","last_change":"2024-09-13T23:08:42.005343+0000","last_active":"2024-09-13T23:08:42.005343+0000","last_peered":"2024-09-13T23:08:42.005343+0000","last_clean":"2024-09-13T23:08:42.005343+0000","last_became_active":"2024-09-13T23:05:20.140180+0000","last_became_peered":"2024-09-13T23:05:20.140180+0000","last_unstale":"2024-09-13T23:08:42.005343+0000","last_undegraded":"2024-09-13T23:08:42.005343+0000","last_fullsized":"2024-09-13T23:08:42.005343+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:42.005224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:42.005224+0000","last_clean_scrub_stamp":"2024-09-13T23:08:42.005224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:49:52.491200+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'8","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:31.215235+0000","last_change":"2024-09-13T23:09:31.215235+0000","last_active":"2024-09-13T23:09:31.215235+0000","last_peered":"2024-09-13T23:09:31.215235+0000","last_clean":"2024-09-13T23:09:31.215235+0000","last_became_active":"2024-09-13T23:05:22.148104+0000","last_became_peered":"2024-09-13T23:05:22.148104+0000","last_unstale":"2024-09-13T23:09:31.215235+0000","last_undegraded":"2024-09-13T23:09:31.215235+0000","last_fullsized":"2024-09-13T23:09:31.215235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:09:31.215112+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:09:31.215112+0000","last_clean_scrub_stamp":"2024-09-13T23:09:31.215112+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:13.797313+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":18,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:20.742460+0000","last_change":"2024-09-13T23:09:20.742460+0000","last_active":"2024-09-13T23:09:20.742460+0000","last_peered":"2024-09-13T23:09:20.742460+0000","last_clean":"2024-09-13T23:09:20.742460+0000","last_became_active":"2024-09-13T23:05:14.119071+0000","last_became_peered":"2024-09-13T23:05:14.119071+0000","last_unstale":"2024-09-13T23:09:20.742460+0000","last_undegraded":"2024-09-13T23:09:20.742460+0000","last_fullsized":"2024-09-13T23:09:20.742460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:20.742341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:20.742341+0000","last_clean_scrub_stamp":"2024-09-13T23:09:20.742341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:04.873814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:40.522104+0000","last_change":"2024-09-13T23:09:40.522104+0000","last_active":"2024-09-13T23:09:40.522104+0000","last_peered":"2024-09-13T23:09:40.522104+0000","last_clean":"2024-09-13T23:09:40.522104+0000","last_became_active":"2024-09-13T23:05:12.148439+0000","last_became_peered":"2024-09-13T23:05:12.148439+0000","last_unstale":"2024-09-13T23:09:40.522104+0000","last_undegraded":"2024-09-13T23:09:40.522104+0000","last_fullsized":"2024-09-13T23:09:40.522104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:40.521978+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:40.521978+0000","last_clean_scrub_stamp":"2024-09-13T23:09:40.521978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:23.039772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:52.165250+0000","last_change":"2024-09-13T23:08:52.165250+0000","last_active":"2024-09-13T23:08:52.165250+0000","last_peered":"2024-09-13T23:08:52.165250+0000","last_clean":"2024-09-13T23:08:52.165250+0000","last_became_active":"2024-09-13T23:05:16.123188+0000","last_became_peered":"2024-09-13T23:05:16.123188+0000","last_unstale":"2024-09-13T23:08:52.165250+0000","last_undegraded":"2024-09-13T23:08:52.165250+0000","last_fullsized":"2024-09-13T23:08:52.165250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:52.165141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:52.165141+0000","last_clean_scrub_stamp":"2024-09-13T23:08:52.165141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:55:30.699678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'45","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:40.622258+0000","last_change":"2024-09-13T23:08:40.622258+0000","last_active":"2024-09-13T23:08:40.622258+0000","last_peered":"2024-09-13T23:08:40.622258+0000","last_clean":"2024-09-13T23:08:40.622258+0000","last_became_active":"2024-09-13T23:05:18.131446+0000","last_became_peered":"2024-09-13T23:05:18.131446+0000","last_unstale":"2024-09-13T23:08:40.622258+0000","last_undegraded":"2024-09-13T23:08:40.622258+0000","last_fullsized":"2024-09-13T23:08:40.622258+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-09-13T23:08:40.622115+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-09-13T23:08:40.622115+0000","last_clean_scrub_stamp":"2024-09-13T23:08:40.622115+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:07.613322+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":361,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:50.174769+0000","last_change":"2024-09-13T23:08:50.174769+0000","last_active":"2024-09-13T23:08:50.174769+0000","last_peered":"2024-09-13T23:08:50.174769+0000","last_clean":"2024-09-13T23:08:50.174769+0000","last_became_active":"2024-09-13T23:05:20.144104+0000","last_became_peered":"2024-09-13T23:05:20.144104+0000","last_unstale":"2024-09-13T23:08:50.174769+0000","last_undegraded":"2024-09-13T23:08:50.174769+0000","last_fullsized":"2024-09-13T23:08:50.174769+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:50.174650+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:50.174650+0000","last_clean_scrub_stamp":"2024-09-13T23:08:50.174650+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:45:01.149565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:35.307071+0000","last_change":"2024-09-13T23:09:35.307071+0000","last_active":"2024-09-13T23:09:35.307071+0000","last_peered":"2024-09-13T23:09:35.307071+0000","last_clean":"2024-09-13T23:09:35.307071+0000","last_became_active":"2024-09-13T23:05:22.147645+0000","last_became_peered":"2024-09-13T23:05:22.147645+0000","last_unstale":"2024-09-13T23:09:35.307071+0000","last_undegraded":"2024-09-13T23:09:35.307071+0000","last_fullsized":"2024-09-13T23:09:35.307071+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:35.306936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:35.306936+0000","last_clean_scrub_stamp":"2024-09-13T23:09:35.306936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:19.701402+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'10","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:58.567649+0000","last_change":"2024-09-13T23:08:58.567649+0000","last_active":"2024-09-13T23:08:58.567649+0000","last_peered":"2024-09-13T23:08:58.567649+0000","last_clean":"2024-09-13T23:08:58.567649+0000","last_became_active":"2024-09-13T23:05:14.112291+0000","last_became_peered":"2024-09-13T23:05:14.112291+0000","last_unstale":"2024-09-13T23:08:58.567649+0000","last_undegraded":"2024-09-13T23:08:58.567649+0000","last_fullsized":"2024-09-13T23:08:58.567649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T23:08:58.567512+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T23:08:58.567512+0000","last_clean_scrub_stamp":"2024-09-13T23:08:58.567512+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:43.527393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:25.329987+0000","last_change":"2024-09-13T23:09:25.329987+0000","last_active":"2024-09-13T23:09:25.329987+0000","last_peered":"2024-09-13T23:09:25.329987+0000","last_clean":"2024-09-13T23:09:25.329987+0000","last_became_active":"2024-09-13T23:05:12.149418+0000","last_became_peered":"2024-09-13T23:05:12.149418+0000","last_unstale":"2024-09-13T23:09:25.329987+0000","last_undegraded":"2024-09-13T23:09:25.329987+0000","last_fullsized":"2024-09-13T23:09:25.329987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:25.329872+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:25.329872+0000","last_clean_scrub_stamp":"2024-09-13T23:09:25.329872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:34.474798+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:55.175246+0000","last_change":"2024-09-13T23:08:55.175246+0000","last_active":"2024-09-13T23:08:55.175246+0000","last_peered":"2024-09-13T23:08:55.175246+0000","last_clean":"2024-09-13T23:08:55.175246+0000","last_became_active":"2024-09-13T23:05:16.118503+0000","last_became_peered":"2024-09-13T23:05:16.118503+0000","last_unstale":"2024-09-13T23:08:55.175246+0000","last_undegraded":"2024-09-13T23:08:55.175246+0000","last_fullsized":"2024-09-13T23:08:55.175246+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:55.175127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:55.175127+0000","last_clean_scrub_stamp":"2024-09-13T23:08:55.175127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:05.711566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'63","reported_seq":137,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:57.374099+0000","last_change":"2024-09-13T23:08:57.374099+0000","last_active":"2024-09-13T23:08:57.374099+0000","last_peered":"2024-09-13T23:08:57.374099+0000","last_clean":"2024-09-13T23:08:57.374099+0000","last_became_active":"2024-09-13T23:05:18.135307+0000","last_became_peered":"2024-09-13T23:05:18.135307+0000","last_unstale":"2024-09-13T23:08:57.374099+0000","last_undegraded":"2024-09-13T23:08:57.374099+0000","last_fullsized":"2024-09-13T23:08:57.374099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'63","last_scrub_stamp":"2024-09-13T23:08:57.373955+0000","last_deep_scrub":"34'63","last_deep_scrub_stamp":"2024-09-13T23:08:57.373955+0000","last_clean_scrub_stamp":"2024-09-13T23:08:57.373955+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:00.678457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:32.955726+0000","last_change":"2024-09-13T23:08:32.955726+0000","last_active":"2024-09-13T23:08:32.955726+0000","last_peered":"2024-09-13T23:08:32.955726+0000","last_clean":"2024-09-13T23:08:32.955726+0000","last_became_active":"2024-09-13T23:05:20.137460+0000","last_became_peered":"2024-09-13T23:05:20.137460+0000","last_unstale":"2024-09-13T23:08:32.955726+0000","last_undegraded":"2024-09-13T23:08:32.955726+0000","last_fullsized":"2024-09-13T23:08:32.955726+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:32.955629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:32.955629+0000","last_clean_scrub_stamp":"2024-09-13T23:08:32.955629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:14.847447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'21","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:31.333368+0000","last_change":"2024-09-13T23:09:31.333368+0000","last_active":"2024-09-13T23:09:31.333368+0000","last_peered":"2024-09-13T23:09:31.333368+0000","last_clean":"2024-09-13T23:09:31.333368+0000","last_became_active":"2024-09-13T23:05:22.141472+0000","last_became_peered":"2024-09-13T23:05:22.141472+0000","last_unstale":"2024-09-13T23:09:31.333368+0000","last_undegraded":"2024-09-13T23:09:31.333368+0000","last_fullsized":"2024-09-13T23:09:31.333368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-13T23:09:31.333239+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-13T23:09:31.333239+0000","last_clean_scrub_stamp":"2024-09-13T23:09:31.333239+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:05:38.230749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:05.149603+0000","last_change":"2024-09-13T23:09:05.149603+0000","last_active":"2024-09-13T23:09:05.149603+0000","last_peered":"2024-09-13T23:09:05.149603+0000","last_clean":"2024-09-13T23:09:05.149603+0000","last_became_active":"2024-09-13T23:05:49.164426+0000","last_became_peered":"2024-09-13T23:05:49.164426+0000","last_unstale":"2024-09-13T23:09:05.149603+0000","last_undegraded":"2024-09-13T23:09:05.149603+0000","last_fullsized":"2024-09-13T23:09:05.149603+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T23:09:05.149414+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T23:09:05.149414+0000","last_clean_scrub_stamp":"2024-09-13T23:09:05.149414+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:09.148923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:07.243570+0000","last_change":"2024-09-13T23:09:07.243570+0000","last_active":"2024-09-13T23:09:07.243570+0000","last_peered":"2024-09-13T23:09:07.243570+0000","last_clean":"2024-09-13T23:09:07.243570+0000","last_became_active":"2024-09-13T23:05:12.129951+0000","last_became_peered":"2024-09-13T23:05:12.129951+0000","last_unstale":"2024-09-13T23:09:07.243570+0000","last_undegraded":"2024-09-13T23:09:07.243570+0000","last_fullsized":"2024-09-13T23:09:07.243570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:07.243394+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:07.243394+0000","last_clean_scrub_stamp":"2024-09-13T23:09:07.243394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:18.684549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:48.682504+0000","last_change":"2024-09-13T23:08:48.682504+0000","last_active":"2024-09-13T23:08:48.682504+0000","last_peered":"2024-09-13T23:08:48.682504+0000","last_clean":"2024-09-13T23:08:48.682504+0000","last_became_active":"2024-09-13T23:05:16.127598+0000","last_became_peered":"2024-09-13T23:05:16.127598+0000","last_unstale":"2024-09-13T23:08:48.682504+0000","last_undegraded":"2024-09-13T23:08:48.682504+0000","last_fullsized":"2024-09-13T23:08:48.682504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:48.682390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:48.682390+0000","last_clean_scrub_stamp":"2024-09-13T23:08:48.682390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:16:51.142230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'39","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:36.095166+0000","last_change":"2024-09-13T23:08:36.095166+0000","last_active":"2024-09-13T23:08:36.095166+0000","last_peered":"2024-09-13T23:08:36.095166+0000","last_clean":"2024-09-13T23:08:36.095166+0000","last_became_active":"2024-09-13T23:05:18.128238+0000","last_became_peered":"2024-09-13T23:05:18.128238+0000","last_unstale":"2024-09-13T23:08:36.095166+0000","last_undegraded":"2024-09-13T23:08:36.095166+0000","last_fullsized":"2024-09-13T23:08:36.095166+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-13T23:08:36.095044+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-13T23:08:36.095044+0000","last_clean_scrub_stamp":"2024-09-13T23:08:36.095044+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:48:40.542578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:00.311550+0000","last_change":"2024-09-13T23:09:00.311550+0000","last_active":"2024-09-13T23:09:00.311550+0000","last_peered":"2024-09-13T23:09:00.311550+0000","last_clean":"2024-09-13T23:09:00.311550+0000","last_became_active":"2024-09-13T23:05:20.139335+0000","last_became_peered":"2024-09-13T23:05:20.139335+0000","last_unstale":"2024-09-13T23:09:00.311550+0000","last_undegraded":"2024-09-13T23:09:00.311550+0000","last_fullsized":"2024-09-13T23:09:00.311550+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:00.311418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:00.311418+0000","last_clean_scrub_stamp":"2024-09-13T23:09:00.311418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:28.885656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.411718+0000","last_change":"2024-09-13T23:05:22.148481+0000","last_active":"2024-09-13T23:08:33.411718+0000","last_peered":"2024-09-13T23:08:33.411718+0000","last_clean":"2024-09-13T23:08:33.411718+0000","last_became_active":"2024-09-13T23:05:22.148222+0000","last_became_peered":"2024-09-13T23:05:22.148222+0000","last_unstale":"2024-09-13T23:08:33.411718+0000","last_undegraded":"2024-09-13T23:08:33.411718+0000","last_fullsized":"2024-09-13T23:08:33.411718+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'34","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:06.266334+0000","last_change":"2024-09-13T23:09:06.266334+0000","last_active":"2024-09-13T23:09:06.266334+0000","last_peered":"2024-09-13T23:09:06.266334+0000","last_clean":"2024-09-13T23:09:06.266334+0000","last_became_active":"2024-09-13T23:05:14.118545+0000","last_became_peered":"2024-09-13T23:05:14.118545+0000","last_unstale":"2024-09-13T23:09:06.266334+0000","last_undegraded":"2024-09-13T23:09:06.266334+0000","last_fullsized":"2024-09-13T23:09:06.266334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'34","last_scrub_stamp":"2024-09-13T23:09:06.266184+0000","last_deep_scrub":"34'34","last_deep_scrub_stamp":"2024-09-13T23:09:06.266184+0000","last_clean_scrub_stamp":"2024-09-13T23:09:06.266184+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:12.667320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":93,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:34.409361+0000","last_change":"2024-09-13T23:09:34.409393+0000","last_active":"2024-09-13T23:09:34.409361+0000","last_peered":"2024-09-13T23:09:34.409361+0000","last_clean":"2024-09-13T23:09:34.409361+0000","last_became_active":"2024-09-13T23:05:12.146912+0000","last_became_peered":"2024-09-13T23:05:12.146912+0000","last_unstale":"2024-09-13T23:09:34.409361+0000","last_undegraded":"2024-09-13T23:09:34.409361+0000","last_fullsized":"2024-09-13T23:09:34.409361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:34.409252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:34.409252+0000","last_clean_scrub_stamp":"2024-09-13T23:09:34.409252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:14.359502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:57.227716+0000","last_change":"2024-09-13T23:08:57.227716+0000","last_active":"2024-09-13T23:08:57.227716+0000","last_peered":"2024-09-13T23:08:57.227716+0000","last_clean":"2024-09-13T23:08:57.227716+0000","last_became_active":"2024-09-13T23:05:16.114369+0000","last_became_peered":"2024-09-13T23:05:16.114369+0000","last_unstale":"2024-09-13T23:08:57.227716+0000","last_undegraded":"2024-09-13T23:08:57.227716+0000","last_fullsized":"2024-09-13T23:08:57.227716+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:57.227595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:57.227595+0000","last_clean_scrub_stamp":"2024-09-13T23:08:57.227595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:37:59.143867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:45.676635+0000","last_change":"2024-09-13T23:08:45.676635+0000","last_active":"2024-09-13T23:08:45.676635+0000","last_peered":"2024-09-13T23:08:45.676635+0000","last_clean":"2024-09-13T23:08:45.676635+0000","last_became_active":"2024-09-13T23:05:18.126183+0000","last_became_peered":"2024-09-13T23:05:18.126183+0000","last_unstale":"2024-09-13T23:08:45.676635+0000","last_undegraded":"2024-09-13T23:08:45.676635+0000","last_fullsized":"2024-09-13T23:08:45.676635+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-13T23:08:45.676456+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-13T23:08:45.676456+0000","last_clean_scrub_stamp":"2024-09-13T23:08:45.676456+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:40.391001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":416,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:38.549085+0000","last_change":"2024-09-13T23:08:38.549085+0000","last_active":"2024-09-13T23:08:38.549085+0000","last_peered":"2024-09-13T23:08:38.549085+0000","last_clean":"2024-09-13T23:08:38.549085+0000","last_became_active":"2024-09-13T23:05:20.143659+0000","last_became_peered":"2024-09-13T23:05:20.143659+0000","last_unstale":"2024-09-13T23:08:38.549085+0000","last_undegraded":"2024-09-13T23:08:38.549085+0000","last_fullsized":"2024-09-13T23:08:38.549085+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:38.548964+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:38.548964+0000","last_clean_scrub_stamp":"2024-09-13T23:08:38.548964+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:04.032284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'13","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:29.307050+0000","last_change":"2024-09-13T23:09:29.307050+0000","last_active":"2024-09-13T23:09:29.307050+0000","last_peered":"2024-09-13T23:09:29.307050+0000","last_clean":"2024-09-13T23:09:29.307050+0000","last_became_active":"2024-09-13T23:05:22.140485+0000","last_became_peered":"2024-09-13T23:05:22.140485+0000","last_unstale":"2024-09-13T23:09:29.307050+0000","last_undegraded":"2024-09-13T23:09:29.307050+0000","last_fullsized":"2024-09-13T23:09:29.307050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'13","last_scrub_stamp":"2024-09-13T23:09:29.306883+0000","last_deep_scrub":"34'13","last_deep_scrub_stamp":"2024-09-13T23:09:29.306883+0000","last_clean_scrub_stamp":"2024-09-13T23:09:29.306883+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:05.267654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'18","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:10.779210+0000","last_change":"2024-09-13T23:09:10.779210+0000","last_active":"2024-09-13T23:09:10.779210+0000","last_peered":"2024-09-13T23:09:10.779210+0000","last_clean":"2024-09-13T23:09:10.779210+0000","last_became_active":"2024-09-13T23:05:14.115166+0000","last_became_peered":"2024-09-13T23:05:14.115166+0000","last_unstale":"2024-09-13T23:09:10.779210+0000","last_undegraded":"2024-09-13T23:09:10.779210+0000","last_fullsized":"2024-09-13T23:09:10.779210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-13T23:09:10.779044+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-13T23:09:10.779044+0000","last_clean_scrub_stamp":"2024-09-13T23:09:10.779044+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:03:39.986800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:37.529685+0000","last_change":"2024-09-13T23:09:37.529715+0000","last_active":"2024-09-13T23:09:37.529685+0000","last_peered":"2024-09-13T23:09:37.529685+0000","last_clean":"2024-09-13T23:09:37.529685+0000","last_became_active":"2024-09-13T23:05:12.139283+0000","last_became_peered":"2024-09-13T23:05:12.139283+0000","last_unstale":"2024-09-13T23:09:37.529685+0000","last_undegraded":"2024-09-13T23:09:37.529685+0000","last_fullsized":"2024-09-13T23:09:37.529685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:37.529578+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:37.529578+0000","last_clean_scrub_stamp":"2024-09-13T23:09:37.529578+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:10.479676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":440,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:50.100480+0000","last_change":"2024-09-13T23:08:50.100480+0000","last_active":"2024-09-13T23:08:50.100480+0000","last_peered":"2024-09-13T23:08:50.100480+0000","last_clean":"2024-09-13T23:08:50.100480+0000","last_became_active":"2024-09-13T23:05:49.164741+0000","last_became_peered":"2024-09-13T23:05:49.164741+0000","last_unstale":"2024-09-13T23:08:50.100480+0000","last_undegraded":"2024-09-13T23:08:50.100480+0000","last_fullsized":"2024-09-13T23:08:50.100480+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T23:08:50.100356+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T23:08:50.100356+0000","last_clean_scrub_stamp":"2024-09-13T23:08:50.100356+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:15:10.416249+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'16","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:58.338158+0000","last_change":"2024-09-13T23:08:58.338158+0000","last_active":"2024-09-13T23:08:58.338158+0000","last_peered":"2024-09-13T23:08:58.338158+0000","last_clean":"2024-09-13T23:08:58.338158+0000","last_became_active":"2024-09-13T23:05:18.135028+0000","last_became_peered":"2024-09-13T23:05:18.135028+0000","last_unstale":"2024-09-13T23:08:58.338158+0000","last_undegraded":"2024-09-13T23:08:58.338158+0000","last_fullsized":"2024-09-13T23:08:58.338158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:08:58.337970+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:08:58.337970+0000","last_clean_scrub_stamp":"2024-09-13T23:08:58.337970+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:47.871335+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":478,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:41.117670+0000","last_change":"2024-09-13T23:08:41.117670+0000","last_active":"2024-09-13T23:08:41.117670+0000","last_peered":"2024-09-13T23:08:41.117670+0000","last_clean":"2024-09-13T23:08:41.117670+0000","last_became_active":"2024-09-13T23:05:20.132891+0000","last_became_peered":"2024-09-13T23:05:20.132891+0000","last_unstale":"2024-09-13T23:08:41.117670+0000","last_undegraded":"2024-09-13T23:08:41.117670+0000","last_fullsized":"2024-09-13T23:08:41.117670+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:41.117524+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:41.117524+0000","last_clean_scrub_stamp":"2024-09-13T23:08:41.117524+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:31.490095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:21.754886+0000","last_change":"2024-09-13T23:09:21.754886+0000","last_active":"2024-09-13T23:09:21.754886+0000","last_peered":"2024-09-13T23:09:21.754886+0000","last_clean":"2024-09-13T23:09:21.754886+0000","last_became_active":"2024-09-13T23:05:22.150258+0000","last_became_peered":"2024-09-13T23:05:22.150258+0000","last_unstale":"2024-09-13T23:09:21.754886+0000","last_undegraded":"2024-09-13T23:09:21.754886+0000","last_fullsized":"2024-09-13T23:09:21.754886+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:21.754762+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:21.754762+0000","last_clean_scrub_stamp":"2024-09-13T23:09:21.754762+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:55.726221+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:51.145168+0000","last_change":"2024-09-13T23:08:51.145168+0000","last_active":"2024-09-13T23:08:51.145168+0000","last_peered":"2024-09-13T23:08:51.145168+0000","last_clean":"2024-09-13T23:08:51.145168+0000","last_became_active":"2024-09-13T23:05:14.125034+0000","last_became_peered":"2024-09-13T23:05:14.125034+0000","last_unstale":"2024-09-13T23:08:51.145168+0000","last_undegraded":"2024-09-13T23:08:51.145168+0000","last_fullsized":"2024-09-13T23:08:51.145168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:08:51.145025+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:08:51.145025+0000","last_clean_scrub_stamp":"2024-09-13T23:08:51.145025+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:58.481808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'3","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:26.326808+0000","last_change":"2024-09-13T23:09:26.326808+0000","last_active":"2024-09-13T23:09:26.326808+0000","last_peered":"2024-09-13T23:09:26.326808+0000","last_clean":"2024-09-13T23:09:26.326808+0000","last_became_active":"2024-09-13T23:05:12.142185+0000","last_became_peered":"2024-09-13T23:05:12.142185+0000","last_unstale":"2024-09-13T23:09:26.326808+0000","last_undegraded":"2024-09-13T23:09:26.326808+0000","last_fullsized":"2024-09-13T23:09:26.326808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T23:09:26.326631+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T23:09:26.326631+0000","last_clean_scrub_stamp":"2024-09-13T23:09:26.326631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:01.860014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.512256+0000","last_change":"2024-09-13T23:08:33.512256+0000","last_active":"2024-09-13T23:08:33.512256+0000","last_peered":"2024-09-13T23:08:33.512256+0000","last_clean":"2024-09-13T23:08:33.512256+0000","last_became_active":"2024-09-13T23:05:16.125013+0000","last_became_peered":"2024-09-13T23:05:16.125013+0000","last_unstale":"2024-09-13T23:08:33.512256+0000","last_undegraded":"2024-09-13T23:08:33.512256+0000","last_fullsized":"2024-09-13T23:08:33.512256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:33.512107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:33.512107+0000","last_clean_scrub_stamp":"2024-09-13T23:08:33.512107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:00.070785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'48","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:39.155672+0000","last_change":"2024-09-13T23:08:39.155672+0000","last_active":"2024-09-13T23:08:39.155672+0000","last_peered":"2024-09-13T23:08:39.155672+0000","last_clean":"2024-09-13T23:08:39.155672+0000","last_became_active":"2024-09-13T23:05:18.126271+0000","last_became_peered":"2024-09-13T23:05:18.126271+0000","last_unstale":"2024-09-13T23:08:39.155672+0000","last_undegraded":"2024-09-13T23:08:39.155672+0000","last_fullsized":"2024-09-13T23:08:39.155672+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-09-13T23:08:39.155548+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-09-13T23:08:39.155548+0000","last_clean_scrub_stamp":"2024-09-13T23:08:39.155548+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:48.512044+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:46.633049+0000","last_change":"2024-09-13T23:08:46.633049+0000","last_active":"2024-09-13T23:08:46.633049+0000","last_peered":"2024-09-13T23:08:46.633049+0000","last_clean":"2024-09-13T23:08:46.633049+0000","last_became_active":"2024-09-13T23:05:20.145626+0000","last_became_peered":"2024-09-13T23:05:20.145626+0000","last_unstale":"2024-09-13T23:08:46.633049+0000","last_undegraded":"2024-09-13T23:08:46.633049+0000","last_fullsized":"2024-09-13T23:08:46.633049+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:46.632934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:46.632934+0000","last_clean_scrub_stamp":"2024-09-13T23:08:46.632934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:54.822821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:01.125815+0000","last_change":"2024-09-13T23:09:01.125815+0000","last_active":"2024-09-13T23:09:01.125815+0000","last_peered":"2024-09-13T23:09:01.125815+0000","last_clean":"2024-09-13T23:09:01.125815+0000","last_became_active":"2024-09-13T23:05:22.137111+0000","last_became_peered":"2024-09-13T23:05:22.137111+0000","last_unstale":"2024-09-13T23:09:01.125815+0000","last_undegraded":"2024-09-13T23:09:01.125815+0000","last_fullsized":"2024-09-13T23:09:01.125815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-13T23:09:01.125676+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-13T23:09:01.125676+0000","last_clean_scrub_stamp":"2024-09-13T23:09:01.125676+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:57.040405+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'16","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:27.794933+0000","last_change":"2024-09-13T23:09:27.794975+0000","last_active":"2024-09-13T23:09:27.794933+0000","last_peered":"2024-09-13T23:09:27.794933+0000","last_clean":"2024-09-13T23:09:27.794933+0000","last_became_active":"2024-09-13T23:05:49.165166+0000","last_became_peered":"2024-09-13T23:05:49.165166+0000","last_unstale":"2024-09-13T23:09:27.794933+0000","last_undegraded":"2024-09-13T23:09:27.794933+0000","last_fullsized":"2024-09-13T23:09:27.794933+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:09:27.794824+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:09:27.794824+0000","last_clean_scrub_stamp":"2024-09-13T23:09:27.794824+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:46.349957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":51,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"34'119","reported_seq":216,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:19.089115+0000","last_change":"2024-09-13T23:09:19.089153+0000","last_active":"2024-09-13T23:09:19.089115+0000","last_peered":"2024-09-13T23:09:19.089115+0000","last_clean":"2024-09-13T23:09:19.089115+0000","last_became_active":"2024-09-13T23:04:56.149747+0000","last_became_peered":"2024-09-13T23:04:56.149747+0000","last_unstale":"2024-09-13T23:09:19.089115+0000","last_undegraded":"2024-09-13T23:09:19.089115+0000","last_fullsized":"2024-09-13T23:09:19.089115+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'119","last_scrub_stamp":"2024-09-13T23:09:19.089028+0000","last_deep_scrub":"34'119","last_deep_scrub_stamp":"2024-09-13T23:09:19.089028+0000","last_clean_scrub_stamp":"2024-09-13T23:09:19.089028+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:19.626670+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:44.612195+0000","last_change":"2024-09-13T23:09:44.612239+0000","last_active":"2024-09-13T23:09:44.612195+0000","last_peered":"2024-09-13T23:09:44.612195+0000","last_clean":"2024-09-13T23:09:44.612195+0000","last_became_active":"2024-09-13T23:05:01.074608+0000","last_became_peered":"2024-09-13T23:05:01.074608+0000","last_unstale":"2024-09-13T23:09:44.612195+0000","last_undegraded":"2024-09-13T23:09:44.612195+0000","last_fullsized":"2024-09-13T23:09:44.612195+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:44.612085+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:44.612085+0000","last_clean_scrub_stamp":"2024-09-13T23:09:44.612085+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:12:31.077571+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00097176599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:32.402630+0000","last_change":"2024-09-13T23:09:32.402696+0000","last_active":"2024-09-13T23:09:32.402630+0000","last_peered":"2024-09-13T23:09:32.402630+0000","last_clean":"2024-09-13T23:09:32.402630+0000","last_became_active":"2024-09-13T23:05:12.146438+0000","last_became_peered":"2024-09-13T23:05:12.146438+0000","last_unstale":"2024-09-13T23:09:32.402630+0000","last_undegraded":"2024-09-13T23:09:32.402630+0000","last_fullsized":"2024-09-13T23:09:32.402630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:32.402510+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:32.402510+0000","last_clean_scrub_stamp":"2024-09-13T23:09:32.402510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:10:46.008459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:48.172057+0000","last_change":"2024-09-13T23:08:48.172057+0000","last_active":"2024-09-13T23:08:48.172057+0000","last_peered":"2024-09-13T23:08:48.172057+0000","last_clean":"2024-09-13T23:08:48.172057+0000","last_became_active":"2024-09-13T23:05:16.115599+0000","last_became_peered":"2024-09-13T23:05:16.115599+0000","last_unstale":"2024-09-13T23:08:48.172057+0000","last_undegraded":"2024-09-13T23:08:48.172057+0000","last_fullsized":"2024-09-13T23:08:48.172057+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:48.171913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:48.171913+0000","last_clean_scrub_stamp":"2024-09-13T23:08:48.171913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:18.538546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'90","reported_seq":181,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:59.300155+0000","last_change":"2024-09-13T23:08:59.300155+0000","last_active":"2024-09-13T23:08:59.300155+0000","last_peered":"2024-09-13T23:08:59.300155+0000","last_clean":"2024-09-13T23:08:59.300155+0000","last_became_active":"2024-09-13T23:05:18.135080+0000","last_became_peered":"2024-09-13T23:05:18.135080+0000","last_unstale":"2024-09-13T23:08:59.300155+0000","last_undegraded":"2024-09-13T23:08:59.300155+0000","last_fullsized":"2024-09-13T23:08:59.300155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'90","last_scrub_stamp":"2024-09-13T23:08:59.299983+0000","last_deep_scrub":"34'90","last_deep_scrub_stamp":"2024-09-13T23:08:59.299983+0000","last_clean_scrub_stamp":"2024-09-13T23:08:59.299983+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:55:55.335307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:38.028280+0000","last_change":"2024-09-13T23:08:38.028280+0000","last_active":"2024-09-13T23:08:38.028280+0000","last_peered":"2024-09-13T23:08:38.028280+0000","last_clean":"2024-09-13T23:08:38.028280+0000","last_became_active":"2024-09-13T23:05:20.139399+0000","last_became_peered":"2024-09-13T23:05:20.139399+0000","last_unstale":"2024-09-13T23:08:38.028280+0000","last_undegraded":"2024-09-13T23:08:38.028280+0000","last_fullsized":"2024-09-13T23:08:38.028280+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:38.028097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:38.028097+0000","last_clean_scrub_stamp":"2024-09-13T23:08:38.028097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:47.384593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'87","reported_seq":181,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:50.698944+0000","last_change":"2024-09-13T23:08:50.698944+0000","last_active":"2024-09-13T23:08:50.698944+0000","last_peered":"2024-09-13T23:08:50.698944+0000","last_clean":"2024-09-13T23:08:50.698944+0000","last_became_active":"2024-09-13T23:05:22.140430+0000","last_became_peered":"2024-09-13T23:05:22.140430+0000","last_unstale":"2024-09-13T23:08:50.698944+0000","last_undegraded":"2024-09-13T23:08:50.698944+0000","last_fullsized":"2024-09-13T23:08:50.698944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'87","last_scrub_stamp":"2024-09-13T23:08:50.698827+0000","last_deep_scrub":"34'87","last_deep_scrub_stamp":"2024-09-13T23:08:50.698827+0000","last_clean_scrub_stamp":"2024-09-13T23:08:50.698827+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:09.410253+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":226,"num_write":170,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:13.223224+0000","last_change":"2024-09-13T23:09:13.223224+0000","last_active":"2024-09-13T23:09:13.223224+0000","last_peered":"2024-09-13T23:09:13.223224+0000","last_clean":"2024-09-13T23:09:13.223224+0000","last_became_active":"2024-09-13T23:05:14.112711+0000","last_became_peered":"2024-09-13T23:05:14.112711+0000","last_unstale":"2024-09-13T23:09:13.223224+0000","last_undegraded":"2024-09-13T23:09:13.223224+0000","last_fullsized":"2024-09-13T23:09:13.223224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:13.223105+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:13.223105+0000","last_clean_scrub_stamp":"2024-09-13T23:09:13.223105+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:32.575985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:45.595478+0000","last_change":"2024-09-13T23:09:45.595503+0000","last_active":"2024-09-13T23:09:45.595478+0000","last_peered":"2024-09-13T23:09:45.595478+0000","last_clean":"2024-09-13T23:09:45.595478+0000","last_became_active":"2024-09-13T23:05:01.075438+0000","last_became_peered":"2024-09-13T23:05:01.075438+0000","last_unstale":"2024-09-13T23:09:45.595478+0000","last_undegraded":"2024-09-13T23:09:45.595478+0000","last_fullsized":"2024-09-13T23:09:45.595478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:45.595352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:45.595352+0000","last_clean_scrub_stamp":"2024-09-13T23:09:45.595352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:12:02.671871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043480299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:24.381895+0000","last_change":"2024-09-13T23:09:24.381922+0000","last_active":"2024-09-13T23:09:24.381895+0000","last_peered":"2024-09-13T23:09:24.381895+0000","last_clean":"2024-09-13T23:09:24.381895+0000","last_became_active":"2024-09-13T23:05:12.114087+0000","last_became_peered":"2024-09-13T23:05:12.114087+0000","last_unstale":"2024-09-13T23:09:24.381895+0000","last_undegraded":"2024-09-13T23:09:24.381895+0000","last_fullsized":"2024-09-13T23:09:24.381895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:24.381778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:24.381778+0000","last_clean_scrub_stamp":"2024-09-13T23:09:24.381778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:16:36.593180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:36.535799+0000","last_change":"2024-09-13T23:08:36.535799+0000","last_active":"2024-09-13T23:08:36.535799+0000","last_peered":"2024-09-13T23:08:36.535799+0000","last_clean":"2024-09-13T23:08:36.535799+0000","last_became_active":"2024-09-13T23:05:16.127404+0000","last_became_peered":"2024-09-13T23:05:16.127404+0000","last_unstale":"2024-09-13T23:08:36.535799+0000","last_undegraded":"2024-09-13T23:08:36.535799+0000","last_fullsized":"2024-09-13T23:08:36.535799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:36.535683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:36.535683+0000","last_clean_scrub_stamp":"2024-09-13T23:08:36.535683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:53.587715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'291","reported_seq":517,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.140621+0000","last_change":"2024-09-13T23:08:33.140621+0000","last_active":"2024-09-13T23:08:33.140621+0000","last_peered":"2024-09-13T23:08:33.140621+0000","last_clean":"2024-09-13T23:08:33.140621+0000","last_became_active":"2024-09-13T23:05:18.135536+0000","last_became_peered":"2024-09-13T23:05:18.135536+0000","last_unstale":"2024-09-13T23:08:33.140621+0000","last_undegraded":"2024-09-13T23:08:33.140621+0000","last_fullsized":"2024-09-13T23:08:33.140621+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'291","last_scrub_stamp":"2024-09-13T23:08:33.140485+0000","last_deep_scrub":"34'291","last_deep_scrub_stamp":"2024-09-13T23:08:33.140485+0000","last_clean_scrub_stamp":"2024-09-13T23:08:33.140485+0000","objects_scrubbed":10,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:37:26.815426+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:54.455735+0000","last_change":"2024-09-13T23:08:54.455735+0000","last_active":"2024-09-13T23:08:54.455735+0000","last_peered":"2024-09-13T23:08:54.455735+0000","last_clean":"2024-09-13T23:08:54.455735+0000","last_became_active":"2024-09-13T23:05:20.138840+0000","last_became_peered":"2024-09-13T23:05:20.138840+0000","last_unstale":"2024-09-13T23:08:54.455735+0000","last_undegraded":"2024-09-13T23:08:54.455735+0000","last_fullsized":"2024-09-13T23:08:54.455735+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:54.455627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:54.455627+0000","last_clean_scrub_stamp":"2024-09-13T23:08:54.455627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:31:31.023076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'5","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:32.247198+0000","last_change":"2024-09-13T23:09:32.247198+0000","last_active":"2024-09-13T23:09:32.247198+0000","last_peered":"2024-09-13T23:09:32.247198+0000","last_clean":"2024-09-13T23:09:32.247198+0000","last_became_active":"2024-09-13T23:05:22.149430+0000","last_became_peered":"2024-09-13T23:05:22.149430+0000","last_unstale":"2024-09-13T23:09:32.247198+0000","last_undegraded":"2024-09-13T23:09:32.247198+0000","last_fullsized":"2024-09-13T23:09:32.247198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T23:09:32.247041+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T23:09:32.247041+0000","last_clean_scrub_stamp":"2024-09-13T23:09:32.247041+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:21.959299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:01.252393+0000","last_change":"2024-09-13T23:09:01.252393+0000","last_active":"2024-09-13T23:09:01.252393+0000","last_peered":"2024-09-13T23:09:01.252393+0000","last_clean":"2024-09-13T23:09:01.252393+0000","last_became_active":"2024-09-13T23:05:14.121629+0000","last_became_peered":"2024-09-13T23:05:14.121629+0000","last_unstale":"2024-09-13T23:09:01.252393+0000","last_undegraded":"2024-09-13T23:09:01.252393+0000","last_fullsized":"2024-09-13T23:09:01.252393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:01.252231+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:01.252231+0000","last_clean_scrub_stamp":"2024-09-13T23:09:01.252231+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:41.769830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:12.723915+0000","last_change":"2024-09-13T23:09:12.723941+0000","last_active":"2024-09-13T23:09:12.723915+0000","last_peered":"2024-09-13T23:09:12.723915+0000","last_clean":"2024-09-13T23:09:12.723915+0000","last_became_active":"2024-09-13T23:05:01.075422+0000","last_became_peered":"2024-09-13T23:05:01.075422+0000","last_unstale":"2024-09-13T23:09:12.723915+0000","last_undegraded":"2024-09-13T23:09:12.723915+0000","last_fullsized":"2024-09-13T23:09:12.723915+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:12.723822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:12.723822+0000","last_clean_scrub_stamp":"2024-09-13T23:09:12.723822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:56.432213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049267099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:26.348988+0000","last_change":"2024-09-13T23:09:26.349035+0000","last_active":"2024-09-13T23:09:26.348988+0000","last_peered":"2024-09-13T23:09:26.348988+0000","last_clean":"2024-09-13T23:09:26.348988+0000","last_became_active":"2024-09-13T23:05:12.117940+0000","last_became_peered":"2024-09-13T23:05:12.117940+0000","last_unstale":"2024-09-13T23:09:26.348988+0000","last_undegraded":"2024-09-13T23:09:26.348988+0000","last_fullsized":"2024-09-13T23:09:26.348988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T23:09:26.348876+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T23:09:26.348876+0000","last_clean_scrub_stamp":"2024-09-13T23:09:26.348876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:19.985644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:52.616505+0000","last_change":"2024-09-13T23:08:52.616505+0000","last_active":"2024-09-13T23:08:52.616505+0000","last_peered":"2024-09-13T23:08:52.616505+0000","last_clean":"2024-09-13T23:08:52.616505+0000","last_became_active":"2024-09-13T23:05:16.122318+0000","last_became_peered":"2024-09-13T23:05:16.122318+0000","last_unstale":"2024-09-13T23:08:52.616505+0000","last_undegraded":"2024-09-13T23:08:52.616505+0000","last_fullsized":"2024-09-13T23:08:52.616505+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:08:52.616388+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:08:52.616388+0000","last_clean_scrub_stamp":"2024-09-13T23:08:52.616388+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:55:21.961122+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'23","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:43.618923+0000","last_change":"2024-09-13T23:08:43.618923+0000","last_active":"2024-09-13T23:08:43.618923+0000","last_peered":"2024-09-13T23:08:43.618923+0000","last_clean":"2024-09-13T23:08:43.618923+0000","last_became_active":"2024-09-13T23:05:18.127698+0000","last_became_peered":"2024-09-13T23:05:18.127698+0000","last_unstale":"2024-09-13T23:08:43.618923+0000","last_undegraded":"2024-09-13T23:08:43.618923+0000","last_fullsized":"2024-09-13T23:08:43.618923+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-09-13T23:08:43.618795+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-09-13T23:08:43.618795+0000","last_clean_scrub_stamp":"2024-09-13T23:08:43.618795+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:08.067385+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:54.192277+0000","last_change":"2024-09-13T23:08:54.192277+0000","last_active":"2024-09-13T23:08:54.192277+0000","last_peered":"2024-09-13T23:08:54.192277+0000","last_clean":"2024-09-13T23:08:54.192277+0000","last_became_active":"2024-09-13T23:05:20.145330+0000","last_became_peered":"2024-09-13T23:05:20.145330+0000","last_unstale":"2024-09-13T23:08:54.192277+0000","last_undegraded":"2024-09-13T23:08:54.192277+0000","last_fullsized":"2024-09-13T23:08:54.192277+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:54.192167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:54.192167+0000","last_clean_scrub_stamp":"2024-09-13T23:08:54.192167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:57.546243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:16.209490+0000","last_change":"2024-09-13T23:09:16.209490+0000","last_active":"2024-09-13T23:09:16.209490+0000","last_peered":"2024-09-13T23:09:16.209490+0000","last_clean":"2024-09-13T23:09:16.209490+0000","last_became_active":"2024-09-13T23:05:22.138259+0000","last_became_peered":"2024-09-13T23:05:22.138259+0000","last_unstale":"2024-09-13T23:09:16.209490+0000","last_undegraded":"2024-09-13T23:09:16.209490+0000","last_fullsized":"2024-09-13T23:09:16.209490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T23:09:16.209368+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T23:09:16.209368+0000","last_clean_scrub_stamp":"2024-09-13T23:09:16.209368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:00.653752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'6","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:06.214718+0000","last_change":"2024-09-13T23:09:06.214718+0000","last_active":"2024-09-13T23:09:06.214718+0000","last_peered":"2024-09-13T23:09:06.214718+0000","last_clean":"2024-09-13T23:09:06.214718+0000","last_became_active":"2024-09-13T23:05:14.110532+0000","last_became_peered":"2024-09-13T23:05:14.110532+0000","last_unstale":"2024-09-13T23:09:06.214718+0000","last_undegraded":"2024-09-13T23:09:06.214718+0000","last_fullsized":"2024-09-13T23:09:06.214718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:06.214603+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:06.214603+0000","last_clean_scrub_stamp":"2024-09-13T23:09:06.214603+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:32.509898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:43.564156+0000","last_change":"2024-09-13T23:09:43.564204+0000","last_active":"2024-09-13T23:09:43.564156+0000","last_peered":"2024-09-13T23:09:43.564156+0000","last_clean":"2024-09-13T23:09:43.564156+0000","last_became_active":"2024-09-13T23:05:01.075399+0000","last_became_peered":"2024-09-13T23:05:01.075399+0000","last_unstale":"2024-09-13T23:09:43.564156+0000","last_undegraded":"2024-09-13T23:09:43.564156+0000","last_fullsized":"2024-09-13T23:09:43.564156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T23:09:43.564048+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T23:09:43.564048+0000","last_clean_scrub_stamp":"2024-09-13T23:09:43.564048+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:01.530394+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0010379530000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:03.637970+0000","last_change":"2024-09-13T23:09:03.637970+0000","last_active":"2024-09-13T23:09:03.637970+0000","last_peered":"2024-09-13T23:09:03.637970+0000","last_clean":"2024-09-13T23:09:03.637970+0000","last_became_active":"2024-09-13T23:05:12.130410+0000","last_became_peered":"2024-09-13T23:05:12.130410+0000","last_unstale":"2024-09-13T23:09:03.637970+0000","last_undegraded":"2024-09-13T23:09:03.637970+0000","last_fullsized":"2024-09-13T23:09:03.637970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:03.637848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:03.637848+0000","last_clean_scrub_stamp":"2024-09-13T23:09:03.637848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:25.877408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:49.163497+0000","last_change":"2024-09-13T23:08:49.163497+0000","last_active":"2024-09-13T23:08:49.163497+0000","last_peered":"2024-09-13T23:08:49.163497+0000","last_clean":"2024-09-13T23:08:49.163497+0000","last_became_active":"2024-09-13T23:05:16.123983+0000","last_became_peered":"2024-09-13T23:05:16.123983+0000","last_unstale":"2024-09-13T23:08:49.163497+0000","last_undegraded":"2024-09-13T23:08:49.163497+0000","last_fullsized":"2024-09-13T23:08:49.163497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:49.163347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:49.163347+0000","last_clean_scrub_stamp":"2024-09-13T23:08:49.163347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:37:31.793295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:52.437554+0000","last_change":"2024-09-13T23:08:52.437554+0000","last_active":"2024-09-13T23:08:52.437554+0000","last_peered":"2024-09-13T23:08:52.437554+0000","last_clean":"2024-09-13T23:08:52.437554+0000","last_became_active":"2024-09-13T23:05:18.133165+0000","last_became_peered":"2024-09-13T23:05:18.133165+0000","last_unstale":"2024-09-13T23:08:52.437554+0000","last_undegraded":"2024-09-13T23:08:52.437554+0000","last_fullsized":"2024-09-13T23:08:52.437554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-13T23:08:52.437407+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-13T23:08:52.437407+0000","last_clean_scrub_stamp":"2024-09-13T23:08:52.437407+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:53:28.383722+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:12.267243+0000","last_change":"2024-09-13T23:09:12.267243+0000","last_active":"2024-09-13T23:09:12.267243+0000","last_peered":"2024-09-13T23:09:12.267243+0000","last_clean":"2024-09-13T23:09:12.267243+0000","last_became_active":"2024-09-13T23:05:20.143748+0000","last_became_peered":"2024-09-13T23:05:20.143748+0000","last_unstale":"2024-09-13T23:09:12.267243+0000","last_undegraded":"2024-09-13T23:09:12.267243+0000","last_fullsized":"2024-09-13T23:09:12.267243+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:12.267122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:12.267122+0000","last_clean_scrub_stamp":"2024-09-13T23:09:12.267122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:08:33.359140+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:34.229514+0000","last_change":"2024-09-13T23:09:34.229514+0000","last_active":"2024-09-13T23:09:34.229514+0000","last_peered":"2024-09-13T23:09:34.229514+0000","last_clean":"2024-09-13T23:09:34.229514+0000","last_became_active":"2024-09-13T23:05:22.150415+0000","last_became_peered":"2024-09-13T23:05:22.150415+0000","last_unstale":"2024-09-13T23:09:34.229514+0000","last_undegraded":"2024-09-13T23:09:34.229514+0000","last_fullsized":"2024-09-13T23:09:34.229514+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:34.229391+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:34.229391+0000","last_clean_scrub_stamp":"2024-09-13T23:09:34.229391+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:31:30.252334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:15.113820+0000","last_change":"2024-09-13T23:09:15.113820+0000","last_active":"2024-09-13T23:09:15.113820+0000","last_peered":"2024-09-13T23:09:15.113820+0000","last_clean":"2024-09-13T23:09:15.113820+0000","last_became_active":"2024-09-13T23:05:14.123447+0000","last_became_peered":"2024-09-13T23:05:14.123447+0000","last_unstale":"2024-09-13T23:09:15.113820+0000","last_undegraded":"2024-09-13T23:09:15.113820+0000","last_fullsized":"2024-09-13T23:09:15.113820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:15.113706+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:15.113706+0000","last_clean_scrub_stamp":"2024-09-13T23:09:15.113706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:13.411504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:19.753286+0000","last_change":"2024-09-13T23:09:19.753286+0000","last_active":"2024-09-13T23:09:19.753286+0000","last_peered":"2024-09-13T23:09:19.753286+0000","last_clean":"2024-09-13T23:09:19.753286+0000","last_became_active":"2024-09-13T23:05:12.124005+0000","last_became_peered":"2024-09-13T23:05:12.124005+0000","last_unstale":"2024-09-13T23:09:19.753286+0000","last_undegraded":"2024-09-13T23:09:19.753286+0000","last_fullsized":"2024-09-13T23:09:19.753286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:19.753136+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:19.753136+0000","last_clean_scrub_stamp":"2024-09-13T23:09:19.753136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:12.048042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:20.345527+0000","last_change":"2024-09-13T23:09:20.345552+0000","last_active":"2024-09-13T23:09:20.345527+0000","last_peered":"2024-09-13T23:09:20.345527+0000","last_clean":"2024-09-13T23:09:20.345527+0000","last_became_active":"2024-09-13T23:05:01.074963+0000","last_became_peered":"2024-09-13T23:05:01.074963+0000","last_unstale":"2024-09-13T23:09:20.345527+0000","last_undegraded":"2024-09-13T23:09:20.345527+0000","last_fullsized":"2024-09-13T23:09:20.345527+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:20.345432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:20.345432+0000","last_clean_scrub_stamp":"2024-09-13T23:09:20.345432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:43.886868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055235699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:51.145619+0000","last_change":"2024-09-13T23:08:51.145619+0000","last_active":"2024-09-13T23:08:51.145619+0000","last_peered":"2024-09-13T23:08:51.145619+0000","last_clean":"2024-09-13T23:08:51.145619+0000","last_became_active":"2024-09-13T23:05:16.123971+0000","last_became_peered":"2024-09-13T23:05:16.123971+0000","last_unstale":"2024-09-13T23:08:51.145619+0000","last_undegraded":"2024-09-13T23:08:51.145619+0000","last_fullsized":"2024-09-13T23:08:51.145619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'1","last_scrub_stamp":"2024-09-13T23:08:51.145496+0000","last_deep_scrub":"34'1","last_deep_scrub_stamp":"2024-09-13T23:08:51.145496+0000","last_clean_scrub_stamp":"2024-09-13T23:08:51.145496+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:32.511958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'73","reported_seq":150,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:43.048564+0000","last_change":"2024-09-13T23:08:43.048564+0000","last_active":"2024-09-13T23:08:43.048564+0000","last_peered":"2024-09-13T23:08:43.048564+0000","last_clean":"2024-09-13T23:08:43.048564+0000","last_became_active":"2024-09-13T23:05:18.132051+0000","last_became_peered":"2024-09-13T23:05:18.132051+0000","last_unstale":"2024-09-13T23:08:43.048564+0000","last_undegraded":"2024-09-13T23:08:43.048564+0000","last_fullsized":"2024-09-13T23:08:43.048564+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'73","last_scrub_stamp":"2024-09-13T23:08:43.048427+0000","last_deep_scrub":"34'73","last_deep_scrub_stamp":"2024-09-13T23:08:43.048427+0000","last_clean_scrub_stamp":"2024-09-13T23:08:43.048427+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:30.653285+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:34.656091+0000","last_change":"2024-09-13T23:08:34.656091+0000","last_active":"2024-09-13T23:08:34.656091+0000","last_peered":"2024-09-13T23:08:34.656091+0000","last_clean":"2024-09-13T23:08:34.656091+0000","last_became_active":"2024-09-13T23:05:20.143566+0000","last_became_peered":"2024-09-13T23:05:20.143566+0000","last_unstale":"2024-09-13T23:08:34.656091+0000","last_undegraded":"2024-09-13T23:08:34.656091+0000","last_fullsized":"2024-09-13T23:08:34.656091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:34.655943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:34.655943+0000","last_clean_scrub_stamp":"2024-09-13T23:08:34.655943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:57.192299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'12","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:02.264138+0000","last_change":"2024-09-13T23:09:02.264138+0000","last_active":"2024-09-13T23:09:02.264138+0000","last_peered":"2024-09-13T23:09:02.264138+0000","last_clean":"2024-09-13T23:09:02.264138+0000","last_became_active":"2024-09-13T23:05:22.137952+0000","last_became_peered":"2024-09-13T23:05:22.137952+0000","last_unstale":"2024-09-13T23:09:02.264138+0000","last_undegraded":"2024-09-13T23:09:02.264138+0000","last_fullsized":"2024-09-13T23:09:02.264138+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T23:09:02.264003+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T23:09:02.264003+0000","last_clean_scrub_stamp":"2024-09-13T23:09:02.264003+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:12.926079+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:58.060890+0000","last_change":"2024-09-13T23:08:58.060890+0000","last_active":"2024-09-13T23:08:58.060890+0000","last_peered":"2024-09-13T23:08:58.060890+0000","last_clean":"2024-09-13T23:08:58.060890+0000","last_became_active":"2024-09-13T23:05:14.123549+0000","last_became_peered":"2024-09-13T23:05:14.123549+0000","last_unstale":"2024-09-13T23:08:58.060890+0000","last_undegraded":"2024-09-13T23:08:58.060890+0000","last_fullsized":"2024-09-13T23:08:58.060890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:08:58.060770+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:08:58.060770+0000","last_clean_scrub_stamp":"2024-09-13T23:08:58.060770+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:37:59.977042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:05.222854+0000","last_change":"2024-09-13T23:09:05.222854+0000","last_active":"2024-09-13T23:09:05.222854+0000","last_peered":"2024-09-13T23:09:05.222854+0000","last_clean":"2024-09-13T23:09:05.222854+0000","last_became_active":"2024-09-13T23:05:12.130285+0000","last_became_peered":"2024-09-13T23:05:12.130285+0000","last_unstale":"2024-09-13T23:09:05.222854+0000","last_undegraded":"2024-09-13T23:09:05.222854+0000","last_fullsized":"2024-09-13T23:09:05.222854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:05.222712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:05.222712+0000","last_clean_scrub_stamp":"2024-09-13T23:09:05.222712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:59.676566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:42.568400+0000","last_change":"2024-09-13T23:09:42.568440+0000","last_active":"2024-09-13T23:09:42.568400+0000","last_peered":"2024-09-13T23:09:42.568400+0000","last_clean":"2024-09-13T23:09:42.568400+0000","last_became_active":"2024-09-13T23:05:01.075431+0000","last_became_peered":"2024-09-13T23:05:01.075431+0000","last_unstale":"2024-09-13T23:09:42.568400+0000","last_undegraded":"2024-09-13T23:09:42.568400+0000","last_fullsized":"2024-09-13T23:09:42.568400+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:42.568265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:42.568265+0000","last_clean_scrub_stamp":"2024-09-13T23:09:42.568265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:31.795843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041474900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:43.475069+0000","last_change":"2024-09-13T23:08:43.475069+0000","last_active":"2024-09-13T23:08:43.475069+0000","last_peered":"2024-09-13T23:08:43.475069+0000","last_clean":"2024-09-13T23:08:43.475069+0000","last_became_active":"2024-09-13T23:05:16.120337+0000","last_became_peered":"2024-09-13T23:05:16.120337+0000","last_unstale":"2024-09-13T23:08:43.475069+0000","last_undegraded":"2024-09-13T23:08:43.475069+0000","last_fullsized":"2024-09-13T23:08:43.475069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:43.474930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:43.474930+0000","last_clean_scrub_stamp":"2024-09-13T23:08:43.474930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:26.685113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'23","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:34.131801+0000","last_change":"2024-09-13T23:08:34.131801+0000","last_active":"2024-09-13T23:08:34.131801+0000","last_peered":"2024-09-13T23:08:34.131801+0000","last_clean":"2024-09-13T23:08:34.131801+0000","last_became_active":"2024-09-13T23:05:18.133676+0000","last_became_peered":"2024-09-13T23:05:18.133676+0000","last_unstale":"2024-09-13T23:08:34.131801+0000","last_undegraded":"2024-09-13T23:08:34.131801+0000","last_fullsized":"2024-09-13T23:08:34.131801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-09-13T23:08:34.131649+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-09-13T23:08:34.131649+0000","last_clean_scrub_stamp":"2024-09-13T23:08:34.131649+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:29.113824+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":368,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:45.156231+0000","last_change":"2024-09-13T23:08:45.156231+0000","last_active":"2024-09-13T23:08:45.156231+0000","last_peered":"2024-09-13T23:08:45.156231+0000","last_clean":"2024-09-13T23:08:45.156231+0000","last_became_active":"2024-09-13T23:05:20.133332+0000","last_became_peered":"2024-09-13T23:05:20.133332+0000","last_unstale":"2024-09-13T23:08:45.156231+0000","last_undegraded":"2024-09-13T23:08:45.156231+0000","last_fullsized":"2024-09-13T23:08:45.156231+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:45.156073+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:45.156073+0000","last_clean_scrub_stamp":"2024-09-13T23:08:45.156073+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:16:24.872283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:24.293596+0000","last_change":"2024-09-13T23:09:24.293596+0000","last_active":"2024-09-13T23:09:24.293596+0000","last_peered":"2024-09-13T23:09:24.293596+0000","last_clean":"2024-09-13T23:09:24.293596+0000","last_became_active":"2024-09-13T23:05:22.141618+0000","last_became_peered":"2024-09-13T23:05:22.141618+0000","last_unstale":"2024-09-13T23:09:24.293596+0000","last_undegraded":"2024-09-13T23:09:24.293596+0000","last_fullsized":"2024-09-13T23:09:24.293596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T23:09:24.293416+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T23:09:24.293416+0000","last_clean_scrub_stamp":"2024-09-13T23:09:24.293416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:41:09.258166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'18","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:49.406065+0000","last_change":"2024-09-13T23:08:49.406065+0000","last_active":"2024-09-13T23:08:49.406065+0000","last_peered":"2024-09-13T23:08:49.406065+0000","last_clean":"2024-09-13T23:08:49.406065+0000","last_became_active":"2024-09-13T23:05:14.126280+0000","last_became_peered":"2024-09-13T23:05:14.126280+0000","last_unstale":"2024-09-13T23:08:49.406065+0000","last_undegraded":"2024-09-13T23:08:49.406065+0000","last_fullsized":"2024-09-13T23:08:49.406065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-13T23:08:49.405905+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-13T23:08:49.405905+0000","last_clean_scrub_stamp":"2024-09-13T23:08:49.405905+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:10.813213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:23.257282+0000","last_change":"2024-09-13T23:09:23.257282+0000","last_active":"2024-09-13T23:09:23.257282+0000","last_peered":"2024-09-13T23:09:23.257282+0000","last_clean":"2024-09-13T23:09:23.257282+0000","last_became_active":"2024-09-13T23:05:12.149435+0000","last_became_peered":"2024-09-13T23:05:12.149435+0000","last_unstale":"2024-09-13T23:09:23.257282+0000","last_undegraded":"2024-09-13T23:09:23.257282+0000","last_fullsized":"2024-09-13T23:09:23.257282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:23.257153+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:23.257153+0000","last_clean_scrub_stamp":"2024-09-13T23:09:23.257153+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:07:06.968192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:21.344821+0000","last_change":"2024-09-13T23:09:21.344821+0000","last_active":"2024-09-13T23:09:21.344821+0000","last_peered":"2024-09-13T23:09:21.344821+0000","last_clean":"2024-09-13T23:09:21.344821+0000","last_became_active":"2024-09-13T23:05:01.074982+0000","last_became_peered":"2024-09-13T23:05:01.074982+0000","last_unstale":"2024-09-13T23:09:21.344821+0000","last_undegraded":"2024-09-13T23:09:21.344821+0000","last_fullsized":"2024-09-13T23:09:21.344821+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:21.344698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:21.344698+0000","last_clean_scrub_stamp":"2024-09-13T23:09:21.344698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:56.827745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054650599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:35.535037+0000","last_change":"2024-09-13T23:08:35.535037+0000","last_active":"2024-09-13T23:08:35.535037+0000","last_peered":"2024-09-13T23:08:35.535037+0000","last_clean":"2024-09-13T23:08:35.535037+0000","last_became_active":"2024-09-13T23:05:16.123573+0000","last_became_peered":"2024-09-13T23:05:16.123573+0000","last_unstale":"2024-09-13T23:08:35.535037+0000","last_undegraded":"2024-09-13T23:08:35.535037+0000","last_fullsized":"2024-09-13T23:08:35.535037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:35.534875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:35.534875+0000","last_clean_scrub_stamp":"2024-09-13T23:08:35.534875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:03:04.742631+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:05.270708+0000","last_change":"2024-09-13T23:09:05.270708+0000","last_active":"2024-09-13T23:09:05.270708+0000","last_peered":"2024-09-13T23:09:05.270708+0000","last_clean":"2024-09-13T23:09:05.270708+0000","last_became_active":"2024-09-13T23:05:18.132140+0000","last_became_peered":"2024-09-13T23:05:18.132140+0000","last_unstale":"2024-09-13T23:09:05.270708+0000","last_undegraded":"2024-09-13T23:09:05.270708+0000","last_fullsized":"2024-09-13T23:09:05.270708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:09:05.270587+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:09:05.270587+0000","last_clean_scrub_stamp":"2024-09-13T23:09:05.270587+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:38.747157+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":442,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:34.964488+0000","last_change":"2024-09-13T23:08:34.964488+0000","last_active":"2024-09-13T23:08:34.964488+0000","last_peered":"2024-09-13T23:08:34.964488+0000","last_clean":"2024-09-13T23:08:34.964488+0000","last_became_active":"2024-09-13T23:05:20.136036+0000","last_became_peered":"2024-09-13T23:05:20.136036+0000","last_unstale":"2024-09-13T23:08:34.964488+0000","last_undegraded":"2024-09-13T23:08:34.964488+0000","last_fullsized":"2024-09-13T23:08:34.964488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:34.964357+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:34.964357+0000","last_clean_scrub_stamp":"2024-09-13T23:08:34.964357+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:48:39.411891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:28.132177+0000","last_change":"2024-09-13T23:09:28.132177+0000","last_active":"2024-09-13T23:09:28.132177+0000","last_peered":"2024-09-13T23:09:28.132177+0000","last_clean":"2024-09-13T23:09:28.132177+0000","last_became_active":"2024-09-13T23:05:22.144787+0000","last_became_peered":"2024-09-13T23:05:22.144787+0000","last_unstale":"2024-09-13T23:09:28.132177+0000","last_undegraded":"2024-09-13T23:09:28.132177+0000","last_fullsized":"2024-09-13T23:09:28.132177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-13T23:09:28.132051+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-13T23:09:28.132051+0000","last_clean_scrub_stamp":"2024-09-13T23:09:28.132051+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:55.955992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:00.592608+0000","last_change":"2024-09-13T23:09:00.592608+0000","last_active":"2024-09-13T23:09:00.592608+0000","last_peered":"2024-09-13T23:09:00.592608+0000","last_clean":"2024-09-13T23:09:00.592608+0000","last_became_active":"2024-09-13T23:05:14.112565+0000","last_became_peered":"2024-09-13T23:05:14.112565+0000","last_unstale":"2024-09-13T23:09:00.592608+0000","last_undegraded":"2024-09-13T23:09:00.592608+0000","last_fullsized":"2024-09-13T23:09:00.592608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:09:00.592449+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:09:00.592449+0000","last_clean_scrub_stamp":"2024-09-13T23:09:00.592449+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:17.593917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:21.106351+0000","last_change":"2024-09-13T23:09:21.106351+0000","last_active":"2024-09-13T23:09:21.106351+0000","last_peered":"2024-09-13T23:09:21.106351+0000","last_clean":"2024-09-13T23:09:21.106351+0000","last_became_active":"2024-09-13T23:05:12.131413+0000","last_became_peered":"2024-09-13T23:05:12.131413+0000","last_unstale":"2024-09-13T23:09:21.106351+0000","last_undegraded":"2024-09-13T23:09:21.106351+0000","last_fullsized":"2024-09-13T23:09:21.106351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:21.106185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:21.106185+0000","last_clean_scrub_stamp":"2024-09-13T23:09:21.106185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:06.617902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:46.547784+0000","last_change":"2024-09-13T23:09:46.547809+0000","last_active":"2024-09-13T23:09:46.547784+0000","last_peered":"2024-09-13T23:09:46.547784+0000","last_clean":"2024-09-13T23:09:46.547784+0000","last_became_active":"2024-09-13T23:05:01.323761+0000","last_became_peered":"2024-09-13T23:05:01.323761+0000","last_unstale":"2024-09-13T23:09:46.547784+0000","last_undegraded":"2024-09-13T23:09:46.547784+0000","last_fullsized":"2024-09-13T23:09:46.547784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:46.547688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:46.547688+0000","last_clean_scrub_stamp":"2024-09-13T23:09:46.547688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:12.712112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001181893,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:42.524284+0000","last_change":"2024-09-13T23:08:42.524284+0000","last_active":"2024-09-13T23:08:42.524284+0000","last_peered":"2024-09-13T23:08:42.524284+0000","last_clean":"2024-09-13T23:08:42.524284+0000","last_became_active":"2024-09-13T23:05:16.120974+0000","last_became_peered":"2024-09-13T23:05:16.120974+0000","last_unstale":"2024-09-13T23:08:42.524284+0000","last_undegraded":"2024-09-13T23:08:42.524284+0000","last_fullsized":"2024-09-13T23:08:42.524284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:42.524136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:42.524136+0000","last_clean_scrub_stamp":"2024-09-13T23:08:42.524136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:38.191251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'96","reported_seq":190,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:37.565659+0000","last_change":"2024-09-13T23:08:37.565659+0000","last_active":"2024-09-13T23:08:37.565659+0000","last_peered":"2024-09-13T23:08:37.565659+0000","last_clean":"2024-09-13T23:08:37.565659+0000","last_became_active":"2024-09-13T23:05:18.137925+0000","last_became_peered":"2024-09-13T23:05:18.137925+0000","last_unstale":"2024-09-13T23:08:37.565659+0000","last_undegraded":"2024-09-13T23:08:37.565659+0000","last_fullsized":"2024-09-13T23:08:37.565659+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'96","last_scrub_stamp":"2024-09-13T23:08:37.565507+0000","last_deep_scrub":"34'96","last_deep_scrub_stamp":"2024-09-13T23:08:37.565507+0000","last_clean_scrub_stamp":"2024-09-13T23:08:37.565507+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:03:42.806653+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:39.048948+0000","last_change":"2024-09-13T23:08:39.048948+0000","last_active":"2024-09-13T23:08:39.048948+0000","last_peered":"2024-09-13T23:08:39.048948+0000","last_clean":"2024-09-13T23:08:39.048948+0000","last_became_active":"2024-09-13T23:05:20.129363+0000","last_became_peered":"2024-09-13T23:05:20.129363+0000","last_unstale":"2024-09-13T23:08:39.048948+0000","last_undegraded":"2024-09-13T23:08:39.048948+0000","last_fullsized":"2024-09-13T23:08:39.048948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:39.048809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:39.048809+0000","last_clean_scrub_stamp":"2024-09-13T23:08:39.048809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:47.267359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:22.774752+0000","last_change":"2024-09-13T23:09:22.774774+0000","last_active":"2024-09-13T23:09:22.774752+0000","last_peered":"2024-09-13T23:09:22.774752+0000","last_clean":"2024-09-13T23:09:22.774752+0000","last_became_active":"2024-09-13T23:05:22.149645+0000","last_became_peered":"2024-09-13T23:05:22.149645+0000","last_unstale":"2024-09-13T23:09:22.774752+0000","last_undegraded":"2024-09-13T23:09:22.774752+0000","last_fullsized":"2024-09-13T23:09:22.774752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:22.774657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:22.774657+0000","last_clean_scrub_stamp":"2024-09-13T23:09:22.774657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:18:05.391238+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:24.773325+0000","last_change":"2024-09-13T23:09:24.773325+0000","last_active":"2024-09-13T23:09:24.773325+0000","last_peered":"2024-09-13T23:09:24.773325+0000","last_clean":"2024-09-13T23:09:24.773325+0000","last_became_active":"2024-09-13T23:05:22.151640+0000","last_became_peered":"2024-09-13T23:05:22.151640+0000","last_unstale":"2024-09-13T23:09:24.773325+0000","last_undegraded":"2024-09-13T23:09:24.773325+0000","last_fullsized":"2024-09-13T23:09:24.773325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:24.773213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:24.773213+0000","last_clean_scrub_stamp":"2024-09-13T23:09:24.773213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:46.180521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'12","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:02.595390+0000","last_change":"2024-09-13T23:09:02.595417+0000","last_active":"2024-09-13T23:09:02.595390+0000","last_peered":"2024-09-13T23:09:02.595390+0000","last_clean":"2024-09-13T23:09:02.595390+0000","last_became_active":"2024-09-13T23:05:14.113236+0000","last_became_peered":"2024-09-13T23:05:14.113236+0000","last_unstale":"2024-09-13T23:09:02.595390+0000","last_undegraded":"2024-09-13T23:09:02.595390+0000","last_fullsized":"2024-09-13T23:09:02.595390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T23:09:02.595304+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T23:09:02.595304+0000","last_clean_scrub_stamp":"2024-09-13T23:09:02.595304+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:26.214597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:33.405569+0000","last_change":"2024-09-13T23:09:33.405569+0000","last_active":"2024-09-13T23:09:33.405569+0000","last_peered":"2024-09-13T23:09:33.405569+0000","last_clean":"2024-09-13T23:09:33.405569+0000","last_became_active":"2024-09-13T23:05:12.141280+0000","last_became_peered":"2024-09-13T23:05:12.141280+0000","last_unstale":"2024-09-13T23:09:33.405569+0000","last_undegraded":"2024-09-13T23:09:33.405569+0000","last_fullsized":"2024-09-13T23:09:33.405569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:33.405438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:33.405438+0000","last_clean_scrub_stamp":"2024-09-13T23:09:33.405438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:42.493362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:47.188405+0000","last_change":"2024-09-13T23:08:47.188431+0000","last_active":"2024-09-13T23:08:47.188405+0000","last_peered":"2024-09-13T23:08:47.188405+0000","last_clean":"2024-09-13T23:08:47.188405+0000","last_became_active":"2024-09-13T23:05:16.117468+0000","last_became_peered":"2024-09-13T23:05:16.117468+0000","last_unstale":"2024-09-13T23:08:47.188405+0000","last_undegraded":"2024-09-13T23:08:47.188405+0000","last_fullsized":"2024-09-13T23:08:47.188405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:47.188316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:47.188316+0000","last_clean_scrub_stamp":"2024-09-13T23:08:47.188316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:30:41.738969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'41","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:44.467262+0000","last_change":"2024-09-13T23:08:44.467306+0000","last_active":"2024-09-13T23:08:44.467262+0000","last_peered":"2024-09-13T23:08:44.467262+0000","last_clean":"2024-09-13T23:08:44.467262+0000","last_became_active":"2024-09-13T23:05:18.131841+0000","last_became_peered":"2024-09-13T23:05:18.131841+0000","last_unstale":"2024-09-13T23:08:44.467262+0000","last_undegraded":"2024-09-13T23:08:44.467262+0000","last_fullsized":"2024-09-13T23:08:44.467262+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'41","last_scrub_stamp":"2024-09-13T23:08:44.467169+0000","last_deep_scrub":"34'41","last_deep_scrub_stamp":"2024-09-13T23:08:44.467169+0000","last_clean_scrub_stamp":"2024-09-13T23:08:44.467169+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:11.320136+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:04.223034+0000","last_change":"2024-09-13T23:09:04.223060+0000","last_active":"2024-09-13T23:09:04.223034+0000","last_peered":"2024-09-13T23:09:04.223034+0000","last_clean":"2024-09-13T23:09:04.223034+0000","last_became_active":"2024-09-13T23:05:20.138958+0000","last_became_peered":"2024-09-13T23:05:20.138958+0000","last_unstale":"2024-09-13T23:09:04.223034+0000","last_undegraded":"2024-09-13T23:09:04.223034+0000","last_fullsized":"2024-09-13T23:09:04.223034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:04.222933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:04.222933+0000","last_clean_scrub_stamp":"2024-09-13T23:09:04.222933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:27.241190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'5","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:32.313092+0000","last_change":"2024-09-13T23:09:32.313119+0000","last_active":"2024-09-13T23:09:32.313092+0000","last_peered":"2024-09-13T23:09:32.313092+0000","last_clean":"2024-09-13T23:09:32.313092+0000","last_became_active":"2024-09-13T23:05:22.141471+0000","last_became_peered":"2024-09-13T23:05:22.141471+0000","last_unstale":"2024-09-13T23:09:32.313092+0000","last_undegraded":"2024-09-13T23:09:32.313092+0000","last_fullsized":"2024-09-13T23:09:32.313092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T23:09:32.313000+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T23:09:32.313000+0000","last_clean_scrub_stamp":"2024-09-13T23:09:32.313000+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:13.281073+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'8","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:13.077681+0000","last_change":"2024-09-13T23:09:13.077712+0000","last_active":"2024-09-13T23:09:13.077681+0000","last_peered":"2024-09-13T23:09:13.077681+0000","last_clean":"2024-09-13T23:09:13.077681+0000","last_became_active":"2024-09-13T23:05:49.164131+0000","last_became_peered":"2024-09-13T23:05:49.164131+0000","last_unstale":"2024-09-13T23:09:13.077681+0000","last_undegraded":"2024-09-13T23:09:13.077681+0000","last_fullsized":"2024-09-13T23:09:13.077681+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:09:13.077595+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:09:13.077595+0000","last_clean_scrub_stamp":"2024-09-13T23:09:13.077595+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:46.551346+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:17.758748+0000","last_change":"2024-09-13T23:09:17.758782+0000","last_active":"2024-09-13T23:09:17.758748+0000","last_peered":"2024-09-13T23:09:17.758748+0000","last_clean":"2024-09-13T23:09:17.758748+0000","last_became_active":"2024-09-13T23:05:12.114343+0000","last_became_peered":"2024-09-13T23:05:12.114343+0000","last_unstale":"2024-09-13T23:09:17.758748+0000","last_undegraded":"2024-09-13T23:09:17.758748+0000","last_fullsized":"2024-09-13T23:09:17.758748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:17.758658+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:17.758658+0000","last_clean_scrub_stamp":"2024-09-13T23:09:17.758658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:46:23.065002+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:37.573201+0000","last_change":"2024-09-13T23:08:37.573239+0000","last_active":"2024-09-13T23:08:37.573201+0000","last_peered":"2024-09-13T23:08:37.573201+0000","last_clean":"2024-09-13T23:08:37.573201+0000","last_became_active":"2024-09-13T23:05:49.160578+0000","last_became_peered":"2024-09-13T23:05:49.160578+0000","last_unstale":"2024-09-13T23:08:37.573201+0000","last_undegraded":"2024-09-13T23:08:37.573201+0000","last_fullsized":"2024-09-13T23:08:37.573201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:37.573092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:37.573092+0000","last_clean_scrub_stamp":"2024-09-13T23:08:37.573092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:12:43.684366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:47.139182+0000","last_change":"2024-09-13T23:08:47.139236+0000","last_active":"2024-09-13T23:08:47.139182+0000","last_peered":"2024-09-13T23:08:47.139182+0000","last_clean":"2024-09-13T23:08:47.139182+0000","last_became_active":"2024-09-13T23:05:18.121514+0000","last_became_peered":"2024-09-13T23:05:18.121514+0000","last_unstale":"2024-09-13T23:08:47.139182+0000","last_undegraded":"2024-09-13T23:08:47.139182+0000","last_fullsized":"2024-09-13T23:08:47.139182+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:08:47.139074+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:08:47.139074+0000","last_clean_scrub_stamp":"2024-09-13T23:08:47.139074+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:36.671882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.698449+0000","last_change":"2024-09-13T23:08:33.698474+0000","last_active":"2024-09-13T23:08:33.698449+0000","last_peered":"2024-09-13T23:08:33.698449+0000","last_clean":"2024-09-13T23:08:33.698449+0000","last_became_active":"2024-09-13T23:05:20.140290+0000","last_became_peered":"2024-09-13T23:05:20.140290+0000","last_unstale":"2024-09-13T23:08:33.698449+0000","last_undegraded":"2024-09-13T23:08:33.698449+0000","last_fullsized":"2024-09-13T23:08:33.698449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:33.698356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:33.698356+0000","last_clean_scrub_stamp":"2024-09-13T23:08:33.698356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:32:32.081819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:30.284441+0000","last_change":"2024-09-13T23:09:30.284466+0000","last_active":"2024-09-13T23:09:30.284441+0000","last_peered":"2024-09-13T23:09:30.284441+0000","last_clean":"2024-09-13T23:09:30.284441+0000","last_became_active":"2024-09-13T23:05:22.140963+0000","last_became_peered":"2024-09-13T23:05:22.140963+0000","last_unstale":"2024-09-13T23:09:30.284441+0000","last_undegraded":"2024-09-13T23:09:30.284441+0000","last_fullsized":"2024-09-13T23:09:30.284441+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:30.284347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:30.284347+0000","last_clean_scrub_stamp":"2024-09-13T23:09:30.284347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:55:22.720680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:14.324059+0000","last_change":"2024-09-13T23:09:14.324059+0000","last_active":"2024-09-13T23:09:14.324059+0000","last_peered":"2024-09-13T23:09:14.324059+0000","last_clean":"2024-09-13T23:09:14.324059+0000","last_became_active":"2024-09-13T23:05:14.120354+0000","last_became_peered":"2024-09-13T23:05:14.120354+0000","last_unstale":"2024-09-13T23:09:14.324059+0000","last_undegraded":"2024-09-13T23:09:14.324059+0000","last_fullsized":"2024-09-13T23:09:14.324059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:14.323958+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:14.323958+0000","last_clean_scrub_stamp":"2024-09-13T23:09:14.323958+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:41.259957+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:18.765414+0000","last_change":"2024-09-13T23:09:18.765460+0000","last_active":"2024-09-13T23:09:18.765414+0000","last_peered":"2024-09-13T23:09:18.765414+0000","last_clean":"2024-09-13T23:09:18.765414+0000","last_became_active":"2024-09-13T23:05:12.116819+0000","last_became_peered":"2024-09-13T23:05:12.116819+0000","last_unstale":"2024-09-13T23:09:18.765414+0000","last_undegraded":"2024-09-13T23:09:18.765414+0000","last_fullsized":"2024-09-13T23:09:18.765414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:18.765313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:18.765313+0000","last_clean_scrub_stamp":"2024-09-13T23:09:18.765313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:14.432428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:49.713458+0000","last_change":"2024-09-13T23:08:49.713485+0000","last_active":"2024-09-13T23:08:49.713458+0000","last_peered":"2024-09-13T23:08:49.713458+0000","last_clean":"2024-09-13T23:08:49.713458+0000","last_became_active":"2024-09-13T23:05:16.124617+0000","last_became_peered":"2024-09-13T23:05:16.124617+0000","last_unstale":"2024-09-13T23:08:49.713458+0000","last_undegraded":"2024-09-13T23:08:49.713458+0000","last_fullsized":"2024-09-13T23:08:49.713458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:49.713367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:49.713367+0000","last_clean_scrub_stamp":"2024-09-13T23:08:49.713367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:31.248692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'47","reported_seq":119,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:45.136532+0000","last_change":"2024-09-13T23:08:45.136578+0000","last_active":"2024-09-13T23:08:45.136532+0000","last_peered":"2024-09-13T23:08:45.136532+0000","last_clean":"2024-09-13T23:08:45.136532+0000","last_became_active":"2024-09-13T23:05:18.126147+0000","last_became_peered":"2024-09-13T23:05:18.126147+0000","last_unstale":"2024-09-13T23:08:45.136532+0000","last_undegraded":"2024-09-13T23:08:45.136532+0000","last_fullsized":"2024-09-13T23:08:45.136532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-09-13T23:08:45.136425+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-09-13T23:08:45.136425+0000","last_clean_scrub_stamp":"2024-09-13T23:08:45.136425+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:12:33.611238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:37.125232+0000","last_change":"2024-09-13T23:08:37.125288+0000","last_active":"2024-09-13T23:08:37.125232+0000","last_peered":"2024-09-13T23:08:37.125232+0000","last_clean":"2024-09-13T23:08:37.125232+0000","last_became_active":"2024-09-13T23:05:20.128756+0000","last_became_peered":"2024-09-13T23:05:20.128756+0000","last_unstale":"2024-09-13T23:08:37.125232+0000","last_undegraded":"2024-09-13T23:08:37.125232+0000","last_fullsized":"2024-09-13T23:08:37.125232+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:37.125127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:37.125127+0000","last_clean_scrub_stamp":"2024-09-13T23:08:37.125127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:37.222133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:52.080856+0000","last_change":"2024-09-13T23:05:22.144728+0000","last_active":"2024-09-13T23:07:52.080856+0000","last_peered":"2024-09-13T23:07:52.080856+0000","last_clean":"2024-09-13T23:07:52.080856+0000","last_became_active":"2024-09-13T23:05:22.143767+0000","last_became_peered":"2024-09-13T23:05:22.143767+0000","last_unstale":"2024-09-13T23:07:52.080856+0000","last_undegraded":"2024-09-13T23:07:52.080856+0000","last_fullsized":"2024-09-13T23:07:52.080856+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:45.412765+0000","last_change":"2024-09-13T23:08:45.412793+0000","last_active":"2024-09-13T23:08:45.412765+0000","last_peered":"2024-09-13T23:08:45.412765+0000","last_clean":"2024-09-13T23:08:45.412765+0000","last_became_active":"2024-09-13T23:05:14.127000+0000","last_became_peered":"2024-09-13T23:05:14.127000+0000","last_unstale":"2024-09-13T23:08:45.412765+0000","last_undegraded":"2024-09-13T23:08:45.412765+0000","last_fullsized":"2024-09-13T23:08:45.412765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:45.412659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:45.412659+0000","last_clean_scrub_stamp":"2024-09-13T23:08:45.412659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:39.470592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:24.156757+0000","last_change":"2024-09-13T23:09:24.156784+0000","last_active":"2024-09-13T23:09:24.156757+0000","last_peered":"2024-09-13T23:09:24.156757+0000","last_clean":"2024-09-13T23:09:24.156757+0000","last_became_active":"2024-09-13T23:05:12.136384+0000","last_became_peered":"2024-09-13T23:05:12.136384+0000","last_unstale":"2024-09-13T23:09:24.156757+0000","last_undegraded":"2024-09-13T23:09:24.156757+0000","last_fullsized":"2024-09-13T23:09:24.156757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:24.156661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:24.156661+0000","last_clean_scrub_stamp":"2024-09-13T23:09:24.156661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:48:06.248758+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:34.507232+0000","last_change":"2024-09-13T23:08:34.507259+0000","last_active":"2024-09-13T23:08:34.507232+0000","last_peered":"2024-09-13T23:08:34.507232+0000","last_clean":"2024-09-13T23:08:34.507232+0000","last_became_active":"2024-09-13T23:05:16.124241+0000","last_became_peered":"2024-09-13T23:05:16.124241+0000","last_unstale":"2024-09-13T23:08:34.507232+0000","last_undegraded":"2024-09-13T23:08:34.507232+0000","last_fullsized":"2024-09-13T23:08:34.507232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:34.507140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:34.507140+0000","last_clean_scrub_stamp":"2024-09-13T23:08:34.507140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:44.378397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'37","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:44.633825+0000","last_change":"2024-09-13T23:08:44.633861+0000","last_active":"2024-09-13T23:08:44.633825+0000","last_peered":"2024-09-13T23:08:44.633825+0000","last_clean":"2024-09-13T23:08:44.633825+0000","last_became_active":"2024-09-13T23:05:18.126188+0000","last_became_peered":"2024-09-13T23:05:18.126188+0000","last_unstale":"2024-09-13T23:08:44.633825+0000","last_undegraded":"2024-09-13T23:08:44.633825+0000","last_fullsized":"2024-09-13T23:08:44.633825+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-13T23:08:44.633726+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-13T23:08:44.633726+0000","last_clean_scrub_stamp":"2024-09-13T23:08:44.633726+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:30.569822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:35.618513+0000","last_change":"2024-09-13T23:08:35.618558+0000","last_active":"2024-09-13T23:08:35.618513+0000","last_peered":"2024-09-13T23:08:35.618513+0000","last_clean":"2024-09-13T23:08:35.618513+0000","last_became_active":"2024-09-13T23:05:20.136098+0000","last_became_peered":"2024-09-13T23:05:20.136098+0000","last_unstale":"2024-09-13T23:08:35.618513+0000","last_undegraded":"2024-09-13T23:08:35.618513+0000","last_fullsized":"2024-09-13T23:08:35.618513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:35.618400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:35.618400+0000","last_clean_scrub_stamp":"2024-09-13T23:08:35.618400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:30.276746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'14","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:14.249283+0000","last_change":"2024-09-13T23:09:14.249283+0000","last_active":"2024-09-13T23:09:14.249283+0000","last_peered":"2024-09-13T23:09:14.249283+0000","last_clean":"2024-09-13T23:09:14.249283+0000","last_became_active":"2024-09-13T23:05:14.112822+0000","last_became_peered":"2024-09-13T23:05:14.112822+0000","last_unstale":"2024-09-13T23:09:14.249283+0000","last_undegraded":"2024-09-13T23:09:14.249283+0000","last_fullsized":"2024-09-13T23:09:14.249283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-13T23:09:14.249078+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-13T23:09:14.249078+0000","last_clean_scrub_stamp":"2024-09-13T23:09:14.249078+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:34.101181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:27.330650+0000","last_change":"2024-09-13T23:09:27.330693+0000","last_active":"2024-09-13T23:09:27.330650+0000","last_peered":"2024-09-13T23:09:27.330650+0000","last_clean":"2024-09-13T23:09:27.330650+0000","last_became_active":"2024-09-13T23:05:12.141970+0000","last_became_peered":"2024-09-13T23:05:12.141970+0000","last_unstale":"2024-09-13T23:09:27.330650+0000","last_undegraded":"2024-09-13T23:09:27.330650+0000","last_fullsized":"2024-09-13T23:09:27.330650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:27.330516+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:27.330516+0000","last_clean_scrub_stamp":"2024-09-13T23:09:27.330516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:54.965684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:53.200311+0000","last_change":"2024-09-13T23:08:53.200311+0000","last_active":"2024-09-13T23:08:53.200311+0000","last_peered":"2024-09-13T23:08:53.200311+0000","last_clean":"2024-09-13T23:08:53.200311+0000","last_became_active":"2024-09-13T23:05:16.120506+0000","last_became_peered":"2024-09-13T23:05:16.120506+0000","last_unstale":"2024-09-13T23:08:53.200311+0000","last_undegraded":"2024-09-13T23:08:53.200311+0000","last_fullsized":"2024-09-13T23:08:53.200311+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:53.200178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:53.200178+0000","last_clean_scrub_stamp":"2024-09-13T23:08:53.200178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:52:22.107307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'65","reported_seq":138,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:44.096079+0000","last_change":"2024-09-13T23:08:44.096120+0000","last_active":"2024-09-13T23:08:44.096079+0000","last_peered":"2024-09-13T23:08:44.096079+0000","last_clean":"2024-09-13T23:08:44.096079+0000","last_became_active":"2024-09-13T23:05:18.126811+0000","last_became_peered":"2024-09-13T23:05:18.126811+0000","last_unstale":"2024-09-13T23:08:44.096079+0000","last_undegraded":"2024-09-13T23:08:44.096079+0000","last_fullsized":"2024-09-13T23:08:44.096079+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'65","last_scrub_stamp":"2024-09-13T23:08:44.095997+0000","last_deep_scrub":"34'65","last_deep_scrub_stamp":"2024-09-13T23:08:44.095997+0000","last_clean_scrub_stamp":"2024-09-13T23:08:44.095997+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:01.263619+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:36.593190+0000","last_change":"2024-09-13T23:08:36.593215+0000","last_active":"2024-09-13T23:08:36.593190+0000","last_peered":"2024-09-13T23:08:36.593190+0000","last_clean":"2024-09-13T23:08:36.593190+0000","last_became_active":"2024-09-13T23:05:20.135886+0000","last_became_peered":"2024-09-13T23:05:20.135886+0000","last_unstale":"2024-09-13T23:08:36.593190+0000","last_undegraded":"2024-09-13T23:08:36.593190+0000","last_fullsized":"2024-09-13T23:08:36.593190+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:36.593096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:36.593096+0000","last_clean_scrub_stamp":"2024-09-13T23:08:36.593096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:13.596600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:33.328848+0000","last_change":"2024-09-13T23:09:33.328876+0000","last_active":"2024-09-13T23:09:33.328848+0000","last_peered":"2024-09-13T23:09:33.328848+0000","last_clean":"2024-09-13T23:09:33.328848+0000","last_became_active":"2024-09-13T23:05:22.147394+0000","last_became_peered":"2024-09-13T23:05:22.147394+0000","last_unstale":"2024-09-13T23:09:33.328848+0000","last_undegraded":"2024-09-13T23:09:33.328848+0000","last_fullsized":"2024-09-13T23:09:33.328848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:09:33.328746+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:09:33.328746+0000","last_clean_scrub_stamp":"2024-09-13T23:09:33.328746+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:39.452384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:28.332489+0000","last_change":"2024-09-13T23:09:28.332514+0000","last_active":"2024-09-13T23:09:28.332489+0000","last_peered":"2024-09-13T23:09:28.332489+0000","last_clean":"2024-09-13T23:09:28.332489+0000","last_became_active":"2024-09-13T23:05:14.121349+0000","last_became_peered":"2024-09-13T23:05:14.121349+0000","last_unstale":"2024-09-13T23:09:28.332489+0000","last_undegraded":"2024-09-13T23:09:28.332489+0000","last_fullsized":"2024-09-13T23:09:28.332489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:28.332397+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:28.332397+0000","last_clean_scrub_stamp":"2024-09-13T23:09:28.332397+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:32.331842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:26.190725+0000","last_change":"2024-09-13T23:09:26.190782+0000","last_active":"2024-09-13T23:09:26.190725+0000","last_peered":"2024-09-13T23:09:26.190725+0000","last_clean":"2024-09-13T23:09:26.190725+0000","last_became_active":"2024-09-13T23:05:12.137092+0000","last_became_peered":"2024-09-13T23:05:12.137092+0000","last_unstale":"2024-09-13T23:09:26.190725+0000","last_undegraded":"2024-09-13T23:09:26.190725+0000","last_fullsized":"2024-09-13T23:09:26.190725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:26.190609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:26.190609+0000","last_clean_scrub_stamp":"2024-09-13T23:09:26.190609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:19.827376+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:53.660121+0000","last_change":"2024-09-13T23:08:53.660121+0000","last_active":"2024-09-13T23:08:53.660121+0000","last_peered":"2024-09-13T23:08:53.660121+0000","last_clean":"2024-09-13T23:08:53.660121+0000","last_became_active":"2024-09-13T23:05:16.121476+0000","last_became_peered":"2024-09-13T23:05:16.121476+0000","last_unstale":"2024-09-13T23:08:53.660121+0000","last_undegraded":"2024-09-13T23:08:53.660121+0000","last_fullsized":"2024-09-13T23:08:53.660121+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:53.659974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:53.659974+0000","last_clean_scrub_stamp":"2024-09-13T23:08:53.659974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:50.966119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:46.445606+0000","last_change":"2024-09-13T23:08:46.445654+0000","last_active":"2024-09-13T23:08:46.445606+0000","last_peered":"2024-09-13T23:08:46.445606+0000","last_clean":"2024-09-13T23:08:46.445606+0000","last_became_active":"2024-09-13T23:05:18.132060+0000","last_became_peered":"2024-09-13T23:05:18.132060+0000","last_unstale":"2024-09-13T23:08:46.445606+0000","last_undegraded":"2024-09-13T23:08:46.445606+0000","last_fullsized":"2024-09-13T23:08:46.445606+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-09-13T23:08:46.445495+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-09-13T23:08:46.445495+0000","last_clean_scrub_stamp":"2024-09-13T23:08:46.445495+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:05:59.233056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:49.128648+0000","last_change":"2024-09-13T23:08:49.128681+0000","last_active":"2024-09-13T23:08:49.128648+0000","last_peered":"2024-09-13T23:08:49.128648+0000","last_clean":"2024-09-13T23:08:49.128648+0000","last_became_active":"2024-09-13T23:05:20.140333+0000","last_became_peered":"2024-09-13T23:05:20.140333+0000","last_unstale":"2024-09-13T23:08:49.128648+0000","last_undegraded":"2024-09-13T23:08:49.128648+0000","last_fullsized":"2024-09-13T23:08:49.128648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:49.128546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:49.128546+0000","last_clean_scrub_stamp":"2024-09-13T23:08:49.128546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:23:33.731436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:20.163598+0000","last_change":"2024-09-13T23:09:20.163621+0000","last_active":"2024-09-13T23:09:20.163598+0000","last_peered":"2024-09-13T23:09:20.163598+0000","last_clean":"2024-09-13T23:09:20.163598+0000","last_became_active":"2024-09-13T23:05:22.139984+0000","last_became_peered":"2024-09-13T23:05:22.139984+0000","last_unstale":"2024-09-13T23:09:20.163598+0000","last_undegraded":"2024-09-13T23:09:20.163598+0000","last_fullsized":"2024-09-13T23:09:20.163598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:20.163488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:20.163488+0000","last_clean_scrub_stamp":"2024-09-13T23:09:20.163488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:27.459780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:53.426271+0000","last_change":"2024-09-13T23:08:53.426301+0000","last_active":"2024-09-13T23:08:53.426271+0000","last_peered":"2024-09-13T23:08:53.426271+0000","last_clean":"2024-09-13T23:08:53.426271+0000","last_became_active":"2024-09-13T23:05:14.124660+0000","last_became_peered":"2024-09-13T23:05:14.124660+0000","last_unstale":"2024-09-13T23:08:53.426271+0000","last_undegraded":"2024-09-13T23:08:53.426271+0000","last_fullsized":"2024-09-13T23:08:53.426271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:08:53.426181+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:08:53.426181+0000","last_clean_scrub_stamp":"2024-09-13T23:08:53.426181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:11.981314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:10.115211+0000","last_change":"2024-09-13T23:09:10.115237+0000","last_active":"2024-09-13T23:09:10.115211+0000","last_peered":"2024-09-13T23:09:10.115211+0000","last_clean":"2024-09-13T23:09:10.115211+0000","last_became_active":"2024-09-13T23:05:12.137136+0000","last_became_peered":"2024-09-13T23:05:12.137136+0000","last_unstale":"2024-09-13T23:09:10.115211+0000","last_undegraded":"2024-09-13T23:09:10.115211+0000","last_fullsized":"2024-09-13T23:09:10.115211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:10.115117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:10.115117+0000","last_clean_scrub_stamp":"2024-09-13T23:09:10.115117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:50.313039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:51.653427+0000","last_change":"2024-09-13T23:08:51.653449+0000","last_active":"2024-09-13T23:08:51.653427+0000","last_peered":"2024-09-13T23:08:51.653427+0000","last_clean":"2024-09-13T23:08:51.653427+0000","last_became_active":"2024-09-13T23:05:16.123607+0000","last_became_peered":"2024-09-13T23:05:16.123607+0000","last_unstale":"2024-09-13T23:08:51.653427+0000","last_undegraded":"2024-09-13T23:08:51.653427+0000","last_fullsized":"2024-09-13T23:08:51.653427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:51.653336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:51.653336+0000","last_clean_scrub_stamp":"2024-09-13T23:08:51.653336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:03:16.566313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'39","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:40.011754+0000","last_change":"2024-09-13T23:08:40.011754+0000","last_active":"2024-09-13T23:08:40.011754+0000","last_peered":"2024-09-13T23:08:40.011754+0000","last_clean":"2024-09-13T23:08:40.011754+0000","last_became_active":"2024-09-13T23:05:18.136279+0000","last_became_peered":"2024-09-13T23:05:18.136279+0000","last_unstale":"2024-09-13T23:08:40.011754+0000","last_undegraded":"2024-09-13T23:08:40.011754+0000","last_fullsized":"2024-09-13T23:08:40.011754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-13T23:08:40.011606+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-13T23:08:40.011606+0000","last_clean_scrub_stamp":"2024-09-13T23:08:40.011606+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:05.066896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:46.122297+0000","last_change":"2024-09-13T23:08:46.122297+0000","last_active":"2024-09-13T23:08:46.122297+0000","last_peered":"2024-09-13T23:08:46.122297+0000","last_clean":"2024-09-13T23:08:46.122297+0000","last_became_active":"2024-09-13T23:05:20.141266+0000","last_became_peered":"2024-09-13T23:05:20.141266+0000","last_unstale":"2024-09-13T23:08:46.122297+0000","last_undegraded":"2024-09-13T23:08:46.122297+0000","last_fullsized":"2024-09-13T23:08:46.122297+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:46.122177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:46.122177+0000","last_clean_scrub_stamp":"2024-09-13T23:08:46.122177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:29.240444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'9","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079113+0000","last_change":"2024-09-13T23:05:22.151767+0000","last_active":"2024-09-13T23:07:42.079113+0000","last_peered":"2024-09-13T23:07:42.079113+0000","last_clean":"2024-09-13T23:07:42.079113+0000","last_became_active":"2024-09-13T23:05:22.151339+0000","last_became_peered":"2024-09-13T23:05:22.151339+0000","last_unstale":"2024-09-13T23:07:42.079113+0000","last_undegraded":"2024-09-13T23:07:42.079113+0000","last_fullsized":"2024-09-13T23:07:42.079113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'8","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:10.305675+0000","last_change":"2024-09-13T23:09:10.305706+0000","last_active":"2024-09-13T23:09:10.305675+0000","last_peered":"2024-09-13T23:09:10.305675+0000","last_clean":"2024-09-13T23:09:10.305675+0000","last_became_active":"2024-09-13T23:05:14.112175+0000","last_became_peered":"2024-09-13T23:05:14.112175+0000","last_unstale":"2024-09-13T23:09:10.305675+0000","last_undegraded":"2024-09-13T23:09:10.305675+0000","last_fullsized":"2024-09-13T23:09:10.305675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:09:10.305573+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:09:10.305573+0000","last_clean_scrub_stamp":"2024-09-13T23:09:10.305573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:24:52.419767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:31.431964+0000","last_change":"2024-09-13T23:09:31.432025+0000","last_active":"2024-09-13T23:09:31.431964+0000","last_peered":"2024-09-13T23:09:31.431964+0000","last_clean":"2024-09-13T23:09:31.431964+0000","last_became_active":"2024-09-13T23:05:12.141459+0000","last_became_peered":"2024-09-13T23:05:12.141459+0000","last_unstale":"2024-09-13T23:09:31.431964+0000","last_undegraded":"2024-09-13T23:09:31.431964+0000","last_fullsized":"2024-09-13T23:09:31.431964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:31.431863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:31.431863+0000","last_clean_scrub_stamp":"2024-09-13T23:09:31.431863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:59.930982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"34'5","reported_seq":238,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:46.150879+0000","last_change":"2024-09-13T23:08:46.150906+0000","last_active":"2024-09-13T23:08:46.150879+0000","last_peered":"2024-09-13T23:08:46.150879+0000","last_clean":"2024-09-13T23:08:46.150879+0000","last_became_active":"2024-09-13T23:05:16.117736+0000","last_became_peered":"2024-09-13T23:05:16.117736+0000","last_unstale":"2024-09-13T23:08:46.150879+0000","last_undegraded":"2024-09-13T23:08:46.150879+0000","last_fullsized":"2024-09-13T23:08:46.150879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T23:08:46.150798+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T23:08:46.150798+0000","last_clean_scrub_stamp":"2024-09-13T23:08:46.150798+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:35.594124+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'16","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:48.450353+0000","last_change":"2024-09-13T23:08:48.450353+0000","last_active":"2024-09-13T23:08:48.450353+0000","last_peered":"2024-09-13T23:08:48.450353+0000","last_clean":"2024-09-13T23:08:48.450353+0000","last_became_active":"2024-09-13T23:05:18.132507+0000","last_became_peered":"2024-09-13T23:05:18.132507+0000","last_unstale":"2024-09-13T23:08:48.450353+0000","last_undegraded":"2024-09-13T23:08:48.450353+0000","last_fullsized":"2024-09-13T23:08:48.450353+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:08:48.450186+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:08:48.450186+0000","last_clean_scrub_stamp":"2024-09-13T23:08:48.450186+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:23.338330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":430,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:42.605617+0000","last_change":"2024-09-13T23:08:42.605617+0000","last_active":"2024-09-13T23:08:42.605617+0000","last_peered":"2024-09-13T23:08:42.605617+0000","last_clean":"2024-09-13T23:08:42.605617+0000","last_became_active":"2024-09-13T23:05:20.144334+0000","last_became_peered":"2024-09-13T23:05:20.144334+0000","last_unstale":"2024-09-13T23:08:42.605617+0000","last_undegraded":"2024-09-13T23:08:42.605617+0000","last_fullsized":"2024-09-13T23:08:42.605617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:42.605465+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:42.605465+0000","last_clean_scrub_stamp":"2024-09-13T23:08:42.605465+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:53.293281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079015+0000","last_change":"2024-09-13T23:05:22.149167+0000","last_active":"2024-09-13T23:07:42.079015+0000","last_peered":"2024-09-13T23:07:42.079015+0000","last_clean":"2024-09-13T23:07:42.079015+0000","last_became_active":"2024-09-13T23:05:22.148894+0000","last_became_peered":"2024-09-13T23:05:22.148894+0000","last_unstale":"2024-09-13T23:07:42.079015+0000","last_undegraded":"2024-09-13T23:07:42.079015+0000","last_fullsized":"2024-09-13T23:07:42.079015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:56.577914+0000","last_change":"2024-09-13T23:08:56.577947+0000","last_active":"2024-09-13T23:08:56.577914+0000","last_peered":"2024-09-13T23:08:56.577914+0000","last_clean":"2024-09-13T23:08:56.577914+0000","last_became_active":"2024-09-13T23:05:14.111891+0000","last_became_peered":"2024-09-13T23:05:14.111891+0000","last_unstale":"2024-09-13T23:08:56.577914+0000","last_undegraded":"2024-09-13T23:08:56.577914+0000","last_fullsized":"2024-09-13T23:08:56.577914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:08:56.577794+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:08:56.577794+0000","last_clean_scrub_stamp":"2024-09-13T23:08:56.577794+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:52:00.290749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:16.155161+0000","last_change":"2024-09-13T23:09:16.155197+0000","last_active":"2024-09-13T23:09:16.155161+0000","last_peered":"2024-09-13T23:09:16.155161+0000","last_clean":"2024-09-13T23:09:16.155161+0000","last_became_active":"2024-09-13T23:05:12.139564+0000","last_became_peered":"2024-09-13T23:05:12.139564+0000","last_unstale":"2024-09-13T23:09:16.155161+0000","last_undegraded":"2024-09-13T23:09:16.155161+0000","last_fullsized":"2024-09-13T23:09:16.155161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:16.155069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:16.155069+0000","last_clean_scrub_stamp":"2024-09-13T23:09:16.155069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:49.723203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:44.189431+0000","last_change":"2024-09-13T23:08:44.189458+0000","last_active":"2024-09-13T23:08:44.189431+0000","last_peered":"2024-09-13T23:08:44.189431+0000","last_clean":"2024-09-13T23:08:44.189431+0000","last_became_active":"2024-09-13T23:05:16.118353+0000","last_became_peered":"2024-09-13T23:05:16.118353+0000","last_unstale":"2024-09-13T23:08:44.189431+0000","last_undegraded":"2024-09-13T23:08:44.189431+0000","last_fullsized":"2024-09-13T23:08:44.189431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:44.189340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:44.189340+0000","last_clean_scrub_stamp":"2024-09-13T23:08:44.189340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:31.794198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:35.089857+0000","last_change":"2024-09-13T23:08:35.089897+0000","last_active":"2024-09-13T23:08:35.089857+0000","last_peered":"2024-09-13T23:08:35.089857+0000","last_clean":"2024-09-13T23:08:35.089857+0000","last_became_active":"2024-09-13T23:05:18.127975+0000","last_became_peered":"2024-09-13T23:05:18.127975+0000","last_unstale":"2024-09-13T23:08:35.089857+0000","last_undegraded":"2024-09-13T23:08:35.089857+0000","last_fullsized":"2024-09-13T23:08:35.089857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-09-13T23:08:35.089767+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-09-13T23:08:35.089767+0000","last_clean_scrub_stamp":"2024-09-13T23:08:35.089767+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:53:49.326025+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:34.005517+0000","last_change":"2024-09-13T23:08:34.005539+0000","last_active":"2024-09-13T23:08:34.005517+0000","last_peered":"2024-09-13T23:08:34.005517+0000","last_clean":"2024-09-13T23:08:34.005517+0000","last_became_active":"2024-09-13T23:05:20.139329+0000","last_became_peered":"2024-09-13T23:05:20.139329+0000","last_unstale":"2024-09-13T23:08:34.005517+0000","last_undegraded":"2024-09-13T23:08:34.005517+0000","last_fullsized":"2024-09-13T23:08:34.005517+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:34.005418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:34.005418+0000","last_clean_scrub_stamp":"2024-09-13T23:08:34.005418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:17:06.755531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:30.179233+0000","last_change":"2024-09-13T23:09:30.179256+0000","last_active":"2024-09-13T23:09:30.179233+0000","last_peered":"2024-09-13T23:09:30.179233+0000","last_clean":"2024-09-13T23:09:30.179233+0000","last_became_active":"2024-09-13T23:05:22.147949+0000","last_became_peered":"2024-09-13T23:05:22.147949+0000","last_unstale":"2024-09-13T23:09:30.179233+0000","last_undegraded":"2024-09-13T23:09:30.179233+0000","last_fullsized":"2024-09-13T23:09:30.179233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:30.179138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:30.179138+0000","last_clean_scrub_stamp":"2024-09-13T23:09:30.179138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:55:22.615471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:04.647264+0000","last_change":"2024-09-13T23:09:04.647321+0000","last_active":"2024-09-13T23:09:04.647264+0000","last_peered":"2024-09-13T23:09:04.647264+0000","last_clean":"2024-09-13T23:09:04.647264+0000","last_became_active":"2024-09-13T23:05:14.113816+0000","last_became_peered":"2024-09-13T23:05:14.113816+0000","last_unstale":"2024-09-13T23:09:04.647264+0000","last_undegraded":"2024-09-13T23:09:04.647264+0000","last_fullsized":"2024-09-13T23:09:04.647264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:04.647142+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:04.647142+0000","last_clean_scrub_stamp":"2024-09-13T23:09:04.647142+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:23:47.909278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:50.504506+0000","last_change":"2024-09-13T23:09:50.504543+0000","last_active":"2024-09-13T23:09:50.504506+0000","last_peered":"2024-09-13T23:09:50.504506+0000","last_clean":"2024-09-13T23:09:50.504506+0000","last_became_active":"2024-09-13T23:05:12.149292+0000","last_became_peered":"2024-09-13T23:05:12.149292+0000","last_unstale":"2024-09-13T23:09:50.504506+0000","last_undegraded":"2024-09-13T23:09:50.504506+0000","last_fullsized":"2024-09-13T23:09:50.504506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:50.504397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:50.504397+0000","last_clean_scrub_stamp":"2024-09-13T23:09:50.504397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:48.224569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:47.679656+0000","last_change":"2024-09-13T23:08:47.679695+0000","last_active":"2024-09-13T23:08:47.679656+0000","last_peered":"2024-09-13T23:08:47.679656+0000","last_clean":"2024-09-13T23:08:47.679656+0000","last_became_active":"2024-09-13T23:05:16.128023+0000","last_became_peered":"2024-09-13T23:05:16.128023+0000","last_unstale":"2024-09-13T23:08:47.679656+0000","last_undegraded":"2024-09-13T23:08:47.679656+0000","last_fullsized":"2024-09-13T23:08:47.679656+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:47.679555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:47.679555+0000","last_clean_scrub_stamp":"2024-09-13T23:08:47.679555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:54.252885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:40.988262+0000","last_change":"2024-09-13T23:08:40.988296+0000","last_active":"2024-09-13T23:08:40.988262+0000","last_peered":"2024-09-13T23:08:40.988262+0000","last_clean":"2024-09-13T23:08:40.988262+0000","last_became_active":"2024-09-13T23:05:18.132579+0000","last_became_peered":"2024-09-13T23:05:18.132579+0000","last_unstale":"2024-09-13T23:08:40.988262+0000","last_undegraded":"2024-09-13T23:08:40.988262+0000","last_fullsized":"2024-09-13T23:08:40.988262+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-13T23:08:40.988170+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-13T23:08:40.988170+0000","last_clean_scrub_stamp":"2024-09-13T23:08:40.988170+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:13:33.042844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:55.408559+0000","last_change":"2024-09-13T23:08:55.408584+0000","last_active":"2024-09-13T23:08:55.408559+0000","last_peered":"2024-09-13T23:08:55.408559+0000","last_clean":"2024-09-13T23:08:55.408559+0000","last_became_active":"2024-09-13T23:05:20.136023+0000","last_became_peered":"2024-09-13T23:05:20.136023+0000","last_unstale":"2024-09-13T23:08:55.408559+0000","last_undegraded":"2024-09-13T23:08:55.408559+0000","last_fullsized":"2024-09-13T23:08:55.408559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:55.408445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:55.408445+0000","last_clean_scrub_stamp":"2024-09-13T23:08:55.408445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:23:49.047903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:47.080030+0000","last_change":"2024-09-13T23:05:22.149740+0000","last_active":"2024-09-13T23:07:47.080030+0000","last_peered":"2024-09-13T23:07:47.080030+0000","last_clean":"2024-09-13T23:07:47.080030+0000","last_became_active":"2024-09-13T23:05:22.149468+0000","last_became_peered":"2024-09-13T23:05:22.149468+0000","last_unstale":"2024-09-13T23:07:47.080030+0000","last_undegraded":"2024-09-13T23:07:47.080030+0000","last_fullsized":"2024-09-13T23:07:47.080030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:21.200924+0000","last_change":"2024-09-13T23:09:21.200959+0000","last_active":"2024-09-13T23:09:21.200924+0000","last_peered":"2024-09-13T23:09:21.200924+0000","last_clean":"2024-09-13T23:09:21.200924+0000","last_became_active":"2024-09-13T23:05:14.109323+0000","last_became_peered":"2024-09-13T23:05:14.109323+0000","last_unstale":"2024-09-13T23:09:21.200924+0000","last_undegraded":"2024-09-13T23:09:21.200924+0000","last_fullsized":"2024-09-13T23:09:21.200924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:21.200822+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:21.200822+0000","last_clean_scrub_stamp":"2024-09-13T23:09:21.200822+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:18.584849+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:13.313691+0000","last_change":"2024-09-13T23:09:13.313691+0000","last_active":"2024-09-13T23:09:13.313691+0000","last_peered":"2024-09-13T23:09:13.313691+0000","last_clean":"2024-09-13T23:09:13.313691+0000","last_became_active":"2024-09-13T23:05:12.121050+0000","last_became_peered":"2024-09-13T23:05:12.121050+0000","last_unstale":"2024-09-13T23:09:13.313691+0000","last_undegraded":"2024-09-13T23:09:13.313691+0000","last_fullsized":"2024-09-13T23:09:13.313691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:13.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:13.313570+0000","last_clean_scrub_stamp":"2024-09-13T23:09:13.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:21.265185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"34'2","reported_seq":230,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:43.150446+0000","last_change":"2024-09-13T23:08:43.150481+0000","last_active":"2024-09-13T23:08:43.150446+0000","last_peered":"2024-09-13T23:08:43.150446+0000","last_clean":"2024-09-13T23:08:43.150446+0000","last_became_active":"2024-09-13T23:05:16.123673+0000","last_became_peered":"2024-09-13T23:05:16.123673+0000","last_unstale":"2024-09-13T23:08:43.150446+0000","last_undegraded":"2024-09-13T23:08:43.150446+0000","last_fullsized":"2024-09-13T23:08:43.150446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:08:43.150340+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:08:43.150340+0000","last_clean_scrub_stamp":"2024-09-13T23:08:43.150340+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:26.284636+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'31","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:01.289992+0000","last_change":"2024-09-13T23:09:01.290029+0000","last_active":"2024-09-13T23:09:01.289992+0000","last_peered":"2024-09-13T23:09:01.289992+0000","last_clean":"2024-09-13T23:09:01.289992+0000","last_became_active":"2024-09-13T23:05:18.134152+0000","last_became_peered":"2024-09-13T23:05:18.134152+0000","last_unstale":"2024-09-13T23:09:01.289992+0000","last_undegraded":"2024-09-13T23:09:01.289992+0000","last_fullsized":"2024-09-13T23:09:01.289992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'31","last_scrub_stamp":"2024-09-13T23:09:01.289900+0000","last_deep_scrub":"34'31","last_deep_scrub_stamp":"2024-09-13T23:09:01.289900+0000","last_clean_scrub_stamp":"2024-09-13T23:09:01.289900+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:26.269605+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:56.399566+0000","last_change":"2024-09-13T23:08:56.399590+0000","last_active":"2024-09-13T23:08:56.399566+0000","last_peered":"2024-09-13T23:08:56.399566+0000","last_clean":"2024-09-13T23:08:56.399566+0000","last_became_active":"2024-09-13T23:05:20.139133+0000","last_became_peered":"2024-09-13T23:05:20.139133+0000","last_unstale":"2024-09-13T23:08:56.399566+0000","last_undegraded":"2024-09-13T23:08:56.399566+0000","last_fullsized":"2024-09-13T23:08:56.399566+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:56.399466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:56.399466+0000","last_clean_scrub_stamp":"2024-09-13T23:08:56.399466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:07.409062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'12","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:51.455840+0000","last_change":"2024-09-13T23:09:51.455876+0000","last_active":"2024-09-13T23:09:51.455840+0000","last_peered":"2024-09-13T23:09:51.455840+0000","last_clean":"2024-09-13T23:09:51.455840+0000","last_became_active":"2024-09-13T23:05:22.143886+0000","last_became_peered":"2024-09-13T23:05:22.143886+0000","last_unstale":"2024-09-13T23:09:51.455840+0000","last_undegraded":"2024-09-13T23:09:51.455840+0000","last_fullsized":"2024-09-13T23:09:51.455840+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T23:09:51.455749+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T23:09:51.455749+0000","last_clean_scrub_stamp":"2024-09-13T23:09:51.455749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:23.734950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":59,"num_write":33,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:57.527931+0000","last_change":"2024-09-13T23:08:57.527982+0000","last_active":"2024-09-13T23:08:57.527931+0000","last_peered":"2024-09-13T23:08:57.527931+0000","last_clean":"2024-09-13T23:08:57.527931+0000","last_became_active":"2024-09-13T23:05:14.111836+0000","last_became_peered":"2024-09-13T23:05:14.111836+0000","last_unstale":"2024-09-13T23:08:57.527931+0000","last_undegraded":"2024-09-13T23:08:57.527931+0000","last_fullsized":"2024-09-13T23:08:57.527931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:08:57.527825+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:08:57.527825+0000","last_clean_scrub_stamp":"2024-09-13T23:08:57.527825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:46.405099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:22.117872+0000","last_change":"2024-09-13T23:09:22.117872+0000","last_active":"2024-09-13T23:09:22.117872+0000","last_peered":"2024-09-13T23:09:22.117872+0000","last_clean":"2024-09-13T23:09:22.117872+0000","last_became_active":"2024-09-13T23:05:12.134820+0000","last_became_peered":"2024-09-13T23:05:12.134820+0000","last_unstale":"2024-09-13T23:09:22.117872+0000","last_undegraded":"2024-09-13T23:09:22.117872+0000","last_fullsized":"2024-09-13T23:09:22.117872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:22.117749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:22.117749+0000","last_clean_scrub_stamp":"2024-09-13T23:09:22.117749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:40.032404+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:42.120392+0000","last_change":"2024-09-13T23:08:42.120463+0000","last_active":"2024-09-13T23:08:42.120392+0000","last_peered":"2024-09-13T23:08:42.120392+0000","last_clean":"2024-09-13T23:08:42.120392+0000","last_became_active":"2024-09-13T23:05:16.124295+0000","last_became_peered":"2024-09-13T23:05:16.124295+0000","last_unstale":"2024-09-13T23:08:42.120392+0000","last_undegraded":"2024-09-13T23:08:42.120392+0000","last_fullsized":"2024-09-13T23:08:42.120392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T23:08:42.120283+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T23:08:42.120283+0000","last_clean_scrub_stamp":"2024-09-13T23:08:42.120283+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:16.924419+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'39","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:38.609156+0000","last_change":"2024-09-13T23:08:38.609215+0000","last_active":"2024-09-13T23:08:38.609156+0000","last_peered":"2024-09-13T23:08:38.609156+0000","last_clean":"2024-09-13T23:08:38.609156+0000","last_became_active":"2024-09-13T23:05:18.131796+0000","last_became_peered":"2024-09-13T23:05:18.131796+0000","last_unstale":"2024-09-13T23:08:38.609156+0000","last_undegraded":"2024-09-13T23:08:38.609156+0000","last_fullsized":"2024-09-13T23:08:38.609156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-13T23:08:38.609041+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-13T23:08:38.609041+0000","last_clean_scrub_stamp":"2024-09-13T23:08:38.609041+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:03:15.467219+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:58.257173+0000","last_change":"2024-09-13T23:08:58.257200+0000","last_active":"2024-09-13T23:08:58.257173+0000","last_peered":"2024-09-13T23:08:58.257173+0000","last_clean":"2024-09-13T23:08:58.257173+0000","last_became_active":"2024-09-13T23:05:20.145356+0000","last_became_peered":"2024-09-13T23:05:20.145356+0000","last_unstale":"2024-09-13T23:08:58.257173+0000","last_undegraded":"2024-09-13T23:08:58.257173+0000","last_fullsized":"2024-09-13T23:08:58.257173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:58.257079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:58.257079+0000","last_clean_scrub_stamp":"2024-09-13T23:08:58.257079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:22:13.566018+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:07:42.079192+0000","last_change":"2024-09-13T23:05:22.147988+0000","last_active":"2024-09-13T23:07:42.079192+0000","last_peered":"2024-09-13T23:07:42.079192+0000","last_clean":"2024-09-13T23:07:42.079192+0000","last_became_active":"2024-09-13T23:05:22.147707+0000","last_became_peered":"2024-09-13T23:05:22.147707+0000","last_unstale":"2024-09-13T23:07:42.079192+0000","last_undegraded":"2024-09-13T23:07:42.079192+0000","last_fullsized":"2024-09-13T23:07:42.079192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:05:21.120704+0000","last_clean_scrub_stamp":"2024-09-13T23:05:21.120704+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'16","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:17.141806+0000","last_change":"2024-09-13T23:09:17.141806+0000","last_active":"2024-09-13T23:09:17.141806+0000","last_peered":"2024-09-13T23:09:17.141806+0000","last_clean":"2024-09-13T23:09:17.141806+0000","last_became_active":"2024-09-13T23:05:14.123513+0000","last_became_peered":"2024-09-13T23:05:14.123513+0000","last_unstale":"2024-09-13T23:09:17.141806+0000","last_undegraded":"2024-09-13T23:09:17.141806+0000","last_fullsized":"2024-09-13T23:09:17.141806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:09:17.141672+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:09:17.141672+0000","last_clean_scrub_stamp":"2024-09-13T23:09:17.141672+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:49.102998+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:07.690221+0000","last_change":"2024-09-13T23:09:07.690221+0000","last_active":"2024-09-13T23:09:07.690221+0000","last_peered":"2024-09-13T23:09:07.690221+0000","last_clean":"2024-09-13T23:09:07.690221+0000","last_became_active":"2024-09-13T23:05:12.125740+0000","last_became_peered":"2024-09-13T23:05:12.125740+0000","last_unstale":"2024-09-13T23:09:07.690221+0000","last_undegraded":"2024-09-13T23:09:07.690221+0000","last_fullsized":"2024-09-13T23:09:07.690221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:07.690053+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:07.690053+0000","last_clean_scrub_stamp":"2024-09-13T23:09:07.690053+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:34.895020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:04.232707+0000","last_change":"2024-09-13T23:09:04.232707+0000","last_active":"2024-09-13T23:09:04.232707+0000","last_peered":"2024-09-13T23:09:04.232707+0000","last_clean":"2024-09-13T23:09:04.232707+0000","last_became_active":"2024-09-13T23:05:14.109959+0000","last_became_peered":"2024-09-13T23:05:14.109959+0000","last_unstale":"2024-09-13T23:09:04.232707+0000","last_undegraded":"2024-09-13T23:09:04.232707+0000","last_fullsized":"2024-09-13T23:09:04.232707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:04.232517+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:04.232517+0000","last_clean_scrub_stamp":"2024-09-13T23:09:04.232517+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:08.232026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:22.367560+0000","last_change":"2024-09-13T23:09:22.367560+0000","last_active":"2024-09-13T23:09:22.367560+0000","last_peered":"2024-09-13T23:09:22.367560+0000","last_clean":"2024-09-13T23:09:22.367560+0000","last_became_active":"2024-09-13T23:05:12.113972+0000","last_became_peered":"2024-09-13T23:05:12.113972+0000","last_unstale":"2024-09-13T23:09:22.367560+0000","last_undegraded":"2024-09-13T23:09:22.367560+0000","last_fullsized":"2024-09-13T23:09:22.367560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:22.367433+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:22.367433+0000","last_clean_scrub_stamp":"2024-09-13T23:09:22.367433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:28:02.084357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:26.758371+0000","last_change":"2024-09-13T23:09:26.758397+0000","last_active":"2024-09-13T23:09:26.758371+0000","last_peered":"2024-09-13T23:09:26.758371+0000","last_clean":"2024-09-13T23:09:26.758371+0000","last_became_active":"2024-09-13T23:05:49.159488+0000","last_became_peered":"2024-09-13T23:05:49.159488+0000","last_unstale":"2024-09-13T23:09:26.758371+0000","last_undegraded":"2024-09-13T23:09:26.758371+0000","last_fullsized":"2024-09-13T23:09:26.758371+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T23:09:26.758280+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T23:09:26.758280+0000","last_clean_scrub_stamp":"2024-09-13T23:09:26.758280+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:12.577119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:49.549029+0000","last_change":"2024-09-13T23:09:49.549064+0000","last_active":"2024-09-13T23:09:49.549029+0000","last_peered":"2024-09-13T23:09:49.549029+0000","last_clean":"2024-09-13T23:09:49.549029+0000","last_became_active":"2024-09-13T23:05:12.139673+0000","last_became_peered":"2024-09-13T23:05:12.139673+0000","last_unstale":"2024-09-13T23:09:49.549029+0000","last_undegraded":"2024-09-13T23:09:49.549029+0000","last_fullsized":"2024-09-13T23:09:49.549029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:49.548927+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:49.548927+0000","last_clean_scrub_stamp":"2024-09-13T23:09:49.548927+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:44:43.285834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:08.208070+0000","last_change":"2024-09-13T23:09:08.208070+0000","last_active":"2024-09-13T23:09:08.208070+0000","last_peered":"2024-09-13T23:09:08.208070+0000","last_clean":"2024-09-13T23:09:08.208070+0000","last_became_active":"2024-09-13T23:05:14.112168+0000","last_became_peered":"2024-09-13T23:05:14.112168+0000","last_unstale":"2024-09-13T23:09:08.208070+0000","last_undegraded":"2024-09-13T23:09:08.208070+0000","last_fullsized":"2024-09-13T23:09:08.208070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T23:09:08.207945+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T23:09:08.207945+0000","last_clean_scrub_stamp":"2024-09-13T23:09:08.207945+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:40.610882+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:27.313942+0000","last_change":"2024-09-13T23:09:27.313969+0000","last_active":"2024-09-13T23:09:27.313942+0000","last_peered":"2024-09-13T23:09:27.313942+0000","last_clean":"2024-09-13T23:09:27.313942+0000","last_became_active":"2024-09-13T23:05:12.118425+0000","last_became_peered":"2024-09-13T23:05:12.118425+0000","last_unstale":"2024-09-13T23:09:27.313942+0000","last_undegraded":"2024-09-13T23:09:27.313942+0000","last_fullsized":"2024-09-13T23:09:27.313942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:27.313818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:27.313818+0000","last_clean_scrub_stamp":"2024-09-13T23:09:27.313818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:21.569626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'14","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:18.302991+0000","last_change":"2024-09-13T23:09:18.302991+0000","last_active":"2024-09-13T23:09:18.302991+0000","last_peered":"2024-09-13T23:09:18.302991+0000","last_clean":"2024-09-13T23:09:18.302991+0000","last_became_active":"2024-09-13T23:05:14.120456+0000","last_became_peered":"2024-09-13T23:05:14.120456+0000","last_unstale":"2024-09-13T23:09:18.302991+0000","last_undegraded":"2024-09-13T23:09:18.302991+0000","last_fullsized":"2024-09-13T23:09:18.302991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-13T23:09:18.302866+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-13T23:09:18.302866+0000","last_clean_scrub_stamp":"2024-09-13T23:09:18.302866+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:33.793181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:23.369585+0000","last_change":"2024-09-13T23:09:23.369585+0000","last_active":"2024-09-13T23:09:23.369585+0000","last_peered":"2024-09-13T23:09:23.369585+0000","last_clean":"2024-09-13T23:09:23.369585+0000","last_became_active":"2024-09-13T23:05:12.114046+0000","last_became_peered":"2024-09-13T23:05:12.114046+0000","last_unstale":"2024-09-13T23:09:23.369585+0000","last_undegraded":"2024-09-13T23:09:23.369585+0000","last_fullsized":"2024-09-13T23:09:23.369585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:23.369464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:23.369464+0000","last_clean_scrub_stamp":"2024-09-13T23:09:23.369464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:11.044148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:27.144683+0000","last_change":"2024-09-13T23:09:27.144683+0000","last_active":"2024-09-13T23:09:27.144683+0000","last_peered":"2024-09-13T23:09:27.144683+0000","last_clean":"2024-09-13T23:09:27.144683+0000","last_became_active":"2024-09-13T23:05:14.123783+0000","last_became_peered":"2024-09-13T23:05:14.123783+0000","last_unstale":"2024-09-13T23:09:27.144683+0000","last_undegraded":"2024-09-13T23:09:27.144683+0000","last_fullsized":"2024-09-13T23:09:27.144683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:27.144522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:27.144522+0000","last_clean_scrub_stamp":"2024-09-13T23:09:27.144522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:21.400330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:14.109600+0000","last_change":"2024-09-13T23:09:14.109600+0000","last_active":"2024-09-13T23:09:14.109600+0000","last_peered":"2024-09-13T23:09:14.109600+0000","last_clean":"2024-09-13T23:09:14.109600+0000","last_became_active":"2024-09-13T23:05:12.137465+0000","last_became_peered":"2024-09-13T23:05:12.137465+0000","last_unstale":"2024-09-13T23:09:14.109600+0000","last_undegraded":"2024-09-13T23:09:14.109600+0000","last_fullsized":"2024-09-13T23:09:14.109600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:14.109435+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:14.109435+0000","last_clean_scrub_stamp":"2024-09-13T23:09:14.109435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:22.061050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:03.259762+0000","last_change":"2024-09-13T23:09:03.259762+0000","last_active":"2024-09-13T23:09:03.259762+0000","last_peered":"2024-09-13T23:09:03.259762+0000","last_clean":"2024-09-13T23:09:03.259762+0000","last_became_active":"2024-09-13T23:05:14.121425+0000","last_became_peered":"2024-09-13T23:05:14.121425+0000","last_unstale":"2024-09-13T23:09:03.259762+0000","last_undegraded":"2024-09-13T23:09:03.259762+0000","last_fullsized":"2024-09-13T23:09:03.259762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:03.259607+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:03.259607+0000","last_clean_scrub_stamp":"2024-09-13T23:09:03.259607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:17.228503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:15.673456+0000","last_change":"2024-09-13T23:09:15.673456+0000","last_active":"2024-09-13T23:09:15.673456+0000","last_peered":"2024-09-13T23:09:15.673456+0000","last_clean":"2024-09-13T23:09:15.673456+0000","last_became_active":"2024-09-13T23:05:12.115546+0000","last_became_peered":"2024-09-13T23:05:12.115546+0000","last_unstale":"2024-09-13T23:09:15.673456+0000","last_undegraded":"2024-09-13T23:09:15.673456+0000","last_fullsized":"2024-09-13T23:09:15.673456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:15.673343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:15.673343+0000","last_clean_scrub_stamp":"2024-09-13T23:09:15.673343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:52.254618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:11.116761+0000","last_change":"2024-09-13T23:09:11.116761+0000","last_active":"2024-09-13T23:09:11.116761+0000","last_peered":"2024-09-13T23:09:11.116761+0000","last_clean":"2024-09-13T23:09:11.116761+0000","last_became_active":"2024-09-13T23:05:14.122944+0000","last_became_peered":"2024-09-13T23:05:14.122944+0000","last_unstale":"2024-09-13T23:09:11.116761+0000","last_undegraded":"2024-09-13T23:09:11.116761+0000","last_fullsized":"2024-09-13T23:09:11.116761+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:11.116646+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:11.116646+0000","last_clean_scrub_stamp":"2024-09-13T23:09:11.116646+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:13.491798+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:17.266434+0000","last_change":"2024-09-13T23:09:17.266434+0000","last_active":"2024-09-13T23:09:17.266434+0000","last_peered":"2024-09-13T23:09:17.266434+0000","last_clean":"2024-09-13T23:09:17.266434+0000","last_became_active":"2024-09-13T23:05:12.118347+0000","last_became_peered":"2024-09-13T23:05:12.118347+0000","last_unstale":"2024-09-13T23:09:17.266434+0000","last_undegraded":"2024-09-13T23:09:17.266434+0000","last_fullsized":"2024-09-13T23:09:17.266434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:17.266296+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:17.266296+0000","last_clean_scrub_stamp":"2024-09-13T23:09:17.266296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:09:23.350084+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:52.144661+0000","last_change":"2024-09-13T23:08:52.144724+0000","last_active":"2024-09-13T23:08:52.144661+0000","last_peered":"2024-09-13T23:08:52.144661+0000","last_clean":"2024-09-13T23:08:52.144661+0000","last_became_active":"2024-09-13T23:05:14.124593+0000","last_became_peered":"2024-09-13T23:05:14.124593+0000","last_unstale":"2024-09-13T23:08:52.144661+0000","last_undegraded":"2024-09-13T23:08:52.144661+0000","last_fullsized":"2024-09-13T23:08:52.144661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:08:52.144556+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:08:52.144556+0000","last_clean_scrub_stamp":"2024-09-13T23:08:52.144556+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:42.175168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:28.374614+0000","last_change":"2024-09-13T23:09:28.374614+0000","last_active":"2024-09-13T23:09:28.374614+0000","last_peered":"2024-09-13T23:09:28.374614+0000","last_clean":"2024-09-13T23:09:28.374614+0000","last_became_active":"2024-09-13T23:05:12.141628+0000","last_became_peered":"2024-09-13T23:05:12.141628+0000","last_unstale":"2024-09-13T23:09:28.374614+0000","last_undegraded":"2024-09-13T23:09:28.374614+0000","last_fullsized":"2024-09-13T23:09:28.374614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:28.374441+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:28.374441+0000","last_clean_scrub_stamp":"2024-09-13T23:09:28.374441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:02:48.649334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:07.305283+0000","last_change":"2024-09-13T23:09:07.305307+0000","last_active":"2024-09-13T23:09:07.305283+0000","last_peered":"2024-09-13T23:09:07.305283+0000","last_clean":"2024-09-13T23:09:07.305283+0000","last_became_active":"2024-09-13T23:05:14.113710+0000","last_became_peered":"2024-09-13T23:05:14.113710+0000","last_unstale":"2024-09-13T23:09:07.305283+0000","last_undegraded":"2024-09-13T23:09:07.305283+0000","last_fullsized":"2024-09-13T23:09:07.305283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:07.305196+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:07.305196+0000","last_clean_scrub_stamp":"2024-09-13T23:09:07.305196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:09.207268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:15.319854+0000","last_change":"2024-09-13T23:09:15.319854+0000","last_active":"2024-09-13T23:09:15.319854+0000","last_peered":"2024-09-13T23:09:15.319854+0000","last_clean":"2024-09-13T23:09:15.319854+0000","last_became_active":"2024-09-13T23:05:12.118716+0000","last_became_peered":"2024-09-13T23:05:12.118716+0000","last_unstale":"2024-09-13T23:09:15.319854+0000","last_undegraded":"2024-09-13T23:09:15.319854+0000","last_fullsized":"2024-09-13T23:09:15.319854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:15.319694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:15.319694+0000","last_clean_scrub_stamp":"2024-09-13T23:09:15.319694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:48.887827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:16.300578+0000","last_change":"2024-09-13T23:09:16.300578+0000","last_active":"2024-09-13T23:09:16.300578+0000","last_peered":"2024-09-13T23:09:16.300578+0000","last_clean":"2024-09-13T23:09:16.300578+0000","last_became_active":"2024-09-13T23:05:14.120489+0000","last_became_peered":"2024-09-13T23:05:14.120489+0000","last_unstale":"2024-09-13T23:09:16.300578+0000","last_undegraded":"2024-09-13T23:09:16.300578+0000","last_fullsized":"2024-09-13T23:09:16.300578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:16.300464+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:16.300464+0000","last_clean_scrub_stamp":"2024-09-13T23:09:16.300464+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:11:03.837494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:08.181573+0000","last_change":"2024-09-13T23:09:08.181573+0000","last_active":"2024-09-13T23:09:08.181573+0000","last_peered":"2024-09-13T23:09:08.181573+0000","last_clean":"2024-09-13T23:09:08.181573+0000","last_became_active":"2024-09-13T23:05:12.137735+0000","last_became_peered":"2024-09-13T23:05:12.137735+0000","last_unstale":"2024-09-13T23:09:08.181573+0000","last_undegraded":"2024-09-13T23:09:08.181573+0000","last_fullsized":"2024-09-13T23:09:08.181573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:08.181438+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:08.181438+0000","last_clean_scrub_stamp":"2024-09-13T23:09:08.181438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:17:01.878876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:03.187963+0000","last_change":"2024-09-13T23:09:03.187963+0000","last_active":"2024-09-13T23:09:03.187963+0000","last_peered":"2024-09-13T23:09:03.187963+0000","last_clean":"2024-09-13T23:09:03.187963+0000","last_became_active":"2024-09-13T23:05:14.121389+0000","last_became_peered":"2024-09-13T23:05:14.121389+0000","last_unstale":"2024-09-13T23:09:03.187963+0000","last_undegraded":"2024-09-13T23:09:03.187963+0000","last_fullsized":"2024-09-13T23:09:03.187963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:03.187749+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:03.187749+0000","last_clean_scrub_stamp":"2024-09-13T23:09:03.187749+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:13.849825+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:18.114936+0000","last_change":"2024-09-13T23:09:18.114936+0000","last_active":"2024-09-13T23:09:18.114936+0000","last_peered":"2024-09-13T23:09:18.114936+0000","last_clean":"2024-09-13T23:09:18.114936+0000","last_became_active":"2024-09-13T23:05:12.137118+0000","last_became_peered":"2024-09-13T23:05:12.137118+0000","last_unstale":"2024-09-13T23:09:18.114936+0000","last_undegraded":"2024-09-13T23:09:18.114936+0000","last_fullsized":"2024-09-13T23:09:18.114936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:18.114817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:18.114817+0000","last_clean_scrub_stamp":"2024-09-13T23:09:18.114817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:13:09.651355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'4","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:54.159390+0000","last_change":"2024-09-13T23:08:54.159390+0000","last_active":"2024-09-13T23:08:54.159390+0000","last_peered":"2024-09-13T23:08:54.159390+0000","last_clean":"2024-09-13T23:08:54.159390+0000","last_became_active":"2024-09-13T23:05:14.124507+0000","last_became_peered":"2024-09-13T23:05:14.124507+0000","last_unstale":"2024-09-13T23:08:54.159390+0000","last_undegraded":"2024-09-13T23:08:54.159390+0000","last_fullsized":"2024-09-13T23:08:54.159390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:08:54.159267+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:08:54.159267+0000","last_clean_scrub_stamp":"2024-09-13T23:08:54.159267+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:56.506120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:39.535962+0000","last_change":"2024-09-13T23:09:39.535962+0000","last_active":"2024-09-13T23:09:39.535962+0000","last_peered":"2024-09-13T23:09:39.535962+0000","last_clean":"2024-09-13T23:09:39.535962+0000","last_became_active":"2024-09-13T23:05:12.138577+0000","last_became_peered":"2024-09-13T23:05:12.138577+0000","last_unstale":"2024-09-13T23:09:39.535962+0000","last_undegraded":"2024-09-13T23:09:39.535962+0000","last_fullsized":"2024-09-13T23:09:39.535962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:39.535838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:39.535838+0000","last_clean_scrub_stamp":"2024-09-13T23:09:39.535838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:16.833864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:02.166179+0000","last_change":"2024-09-13T23:09:02.166179+0000","last_active":"2024-09-13T23:09:02.166179+0000","last_peered":"2024-09-13T23:09:02.166179+0000","last_clean":"2024-09-13T23:09:02.166179+0000","last_became_active":"2024-09-13T23:05:14.124604+0000","last_became_peered":"2024-09-13T23:05:14.124604+0000","last_unstale":"2024-09-13T23:09:02.166179+0000","last_undegraded":"2024-09-13T23:09:02.166179+0000","last_fullsized":"2024-09-13T23:09:02.166179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:02.166057+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:02.166057+0000","last_clean_scrub_stamp":"2024-09-13T23:09:02.166057+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:42.683656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:35.450644+0000","last_change":"2024-09-13T23:09:35.450644+0000","last_active":"2024-09-13T23:09:35.450644+0000","last_peered":"2024-09-13T23:09:35.450644+0000","last_clean":"2024-09-13T23:09:35.450644+0000","last_became_active":"2024-09-13T23:05:12.140686+0000","last_became_peered":"2024-09-13T23:05:12.140686+0000","last_unstale":"2024-09-13T23:09:35.450644+0000","last_undegraded":"2024-09-13T23:09:35.450644+0000","last_fullsized":"2024-09-13T23:09:35.450644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:35.450514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:35.450514+0000","last_clean_scrub_stamp":"2024-09-13T23:09:35.450514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:54:14.171644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:50.447124+0000","last_change":"2024-09-13T23:08:50.447124+0000","last_active":"2024-09-13T23:08:50.447124+0000","last_peered":"2024-09-13T23:08:50.447124+0000","last_clean":"2024-09-13T23:08:50.447124+0000","last_became_active":"2024-09-13T23:05:14.125747+0000","last_became_peered":"2024-09-13T23:05:14.125747+0000","last_unstale":"2024-09-13T23:08:50.447124+0000","last_undegraded":"2024-09-13T23:08:50.447124+0000","last_fullsized":"2024-09-13T23:08:50.447124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T23:08:50.447009+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T23:08:50.447009+0000","last_clean_scrub_stamp":"2024-09-13T23:08:50.447009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:55.562708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:11.744115+0000","last_change":"2024-09-13T23:09:11.744140+0000","last_active":"2024-09-13T23:09:11.744115+0000","last_peered":"2024-09-13T23:09:11.744115+0000","last_clean":"2024-09-13T23:09:11.744115+0000","last_became_active":"2024-09-13T23:05:12.126202+0000","last_became_peered":"2024-09-13T23:05:12.126202+0000","last_unstale":"2024-09-13T23:09:11.744115+0000","last_undegraded":"2024-09-13T23:09:11.744115+0000","last_fullsized":"2024-09-13T23:09:11.744115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:11.743996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:11.743996+0000","last_clean_scrub_stamp":"2024-09-13T23:09:11.743996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:55:43.578151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:55.125462+0000","last_change":"2024-09-13T23:08:55.125462+0000","last_active":"2024-09-13T23:08:55.125462+0000","last_peered":"2024-09-13T23:08:55.125462+0000","last_clean":"2024-09-13T23:08:55.125462+0000","last_became_active":"2024-09-13T23:05:14.125457+0000","last_became_peered":"2024-09-13T23:05:14.125457+0000","last_unstale":"2024-09-13T23:08:55.125462+0000","last_undegraded":"2024-09-13T23:08:55.125462+0000","last_fullsized":"2024-09-13T23:08:55.125462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:08:55.125347+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:08:55.125347+0000","last_clean_scrub_stamp":"2024-09-13T23:08:55.125347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:52:24.032476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:22.245297+0000","last_change":"2024-09-13T23:09:22.245297+0000","last_active":"2024-09-13T23:09:22.245297+0000","last_peered":"2024-09-13T23:09:22.245297+0000","last_clean":"2024-09-13T23:09:22.245297+0000","last_became_active":"2024-09-13T23:05:12.149345+0000","last_became_peered":"2024-09-13T23:05:12.149345+0000","last_unstale":"2024-09-13T23:09:22.245297+0000","last_undegraded":"2024-09-13T23:09:22.245297+0000","last_fullsized":"2024-09-13T23:09:22.245297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:22.245177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:22.245177+0000","last_clean_scrub_stamp":"2024-09-13T23:09:22.245177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:23:42.634877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:29.410280+0000","last_change":"2024-09-13T23:09:29.410280+0000","last_active":"2024-09-13T23:09:29.410280+0000","last_peered":"2024-09-13T23:09:29.410280+0000","last_clean":"2024-09-13T23:09:29.410280+0000","last_became_active":"2024-09-13T23:05:12.140432+0000","last_became_peered":"2024-09-13T23:05:12.140432+0000","last_unstale":"2024-09-13T23:09:29.410280+0000","last_undegraded":"2024-09-13T23:09:29.410280+0000","last_fullsized":"2024-09-13T23:09:29.410280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:29.410108+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:29.410108+0000","last_clean_scrub_stamp":"2024-09-13T23:09:29.410108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:12.999465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:59.214167+0000","last_change":"2024-09-13T23:08:59.214240+0000","last_active":"2024-09-13T23:08:59.214167+0000","last_peered":"2024-09-13T23:08:59.214167+0000","last_clean":"2024-09-13T23:08:59.214167+0000","last_became_active":"2024-09-13T23:05:14.122105+0000","last_became_peered":"2024-09-13T23:05:14.122105+0000","last_unstale":"2024-09-13T23:08:59.214167+0000","last_undegraded":"2024-09-13T23:08:59.214167+0000","last_fullsized":"2024-09-13T23:08:59.214167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:08:59.214060+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:08:59.214060+0000","last_clean_scrub_stamp":"2024-09-13T23:08:59.214060+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:09.073630+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:11.352289+0000","last_change":"2024-09-13T23:09:11.352289+0000","last_active":"2024-09-13T23:09:11.352289+0000","last_peered":"2024-09-13T23:09:11.352289+0000","last_clean":"2024-09-13T23:09:11.352289+0000","last_became_active":"2024-09-13T23:05:12.120703+0000","last_became_peered":"2024-09-13T23:05:12.120703+0000","last_unstale":"2024-09-13T23:09:11.352289+0000","last_undegraded":"2024-09-13T23:09:11.352289+0000","last_fullsized":"2024-09-13T23:09:11.352289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:11.352120+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:11.352120+0000","last_clean_scrub_stamp":"2024-09-13T23:09:11.352120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:42:29.036211+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:07.162774+0000","last_change":"2024-09-13T23:09:07.162805+0000","last_active":"2024-09-13T23:09:07.162774+0000","last_peered":"2024-09-13T23:09:07.162774+0000","last_clean":"2024-09-13T23:09:07.162774+0000","last_became_active":"2024-09-13T23:05:14.121636+0000","last_became_peered":"2024-09-13T23:05:14.121636+0000","last_unstale":"2024-09-13T23:09:07.162774+0000","last_undegraded":"2024-09-13T23:09:07.162774+0000","last_fullsized":"2024-09-13T23:09:07.162774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T23:09:07.162687+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T23:09:07.162687+0000","last_clean_scrub_stamp":"2024-09-13T23:09:07.162687+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:33.457982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1527,"ondisk_log_size":1527,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1600,"num_read_kb":1490,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":12,"seq":51539607616,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":151994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640318,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40492,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331348,"statfs":{"total":96636764160,"available":96595300352,"internally_reserved":0,"allocated":1011712,"data_stored":739728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705727,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40520,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331320,"statfs":{"total":96636764160,"available":96595271680,"internally_reserved":0,"allocated":1040384,"data_stored":741822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705727,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":446464,"data_stored":151868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T23:09:55.209 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:55.212 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:55.213 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:55.213 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:55.213 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:55.214 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T23:05:21.120704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=5, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:09:55.215 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T23:10:15.217 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T23:10:15.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.332+0000 7f64ef42e640 1 Processor -- start 2024-09-13T23:10:15.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.332+0000 7f64ef42e640 1 -- start start 2024-09-13T23:10:15.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.332+0000 7f64ef42e640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f64e812e940 0x7f64e8130d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:15.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.332+0000 7f64ef42e640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64e806eba0 con 0x7f64e806eda0 2024-09-13T23:10:15.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.332+0000 7f64ef42e640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7f64e806d2f0 con 0x7f64e812e940 2024-09-13T23:10:15.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.333+0000 7f64ec9c9640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f64e812e940 0x7f64e8130d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:15.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.333+0000 7f64ec9c9640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f64e812e940 0x7f64e8130d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56010/0 (socket says 172.21.15.17:56010) 2024-09-13T23:10:15.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.333+0000 7f64ed1ca640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f64e806eda0 0x7f64e806f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:35464/0 (socket says 172.21.15.17:35464) 2024-09-13T23:10:15.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.333+0000 7f64ec9c9640 1 -- 172.21.15.17:0/4009061420 learned_addr learned my addr 172.21.15.17:0/4009061420 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:10:15.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.333+0000 7f64ec9c9640 1 -- 172.21.15.17:0/4009061420 >> v1:172.21.15.17:6789/0 conn(0x7f64e806eda0 legacy=0x7f64e806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:15.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.333+0000 7f64ec9c9640 1 -- 172.21.15.17:0/4009061420 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e8070d50 con 0x7f64e812e940 2024-09-13T23:10:15.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.334+0000 7f64ec9c9640 1 --2- 172.21.15.17:0/4009061420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e812e940 0x7f64e8130d30 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f64d80097f0 tx=0x7f64d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d327b7e4dc98c047 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:15.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.334+0000 7f64dffff640 1 -- 172.21.15.17:0/4009061420 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64d8037070 con 0x7f64e812e940 2024-09-13T23:10:15.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.334+0000 7f64dffff640 1 -- 172.21.15.17:0/4009061420 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64d8032440 con 0x7f64e812e940 2024-09-13T23:10:15.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.334+0000 7f64dffff640 1 -- 172.21.15.17:0/4009061420 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64d8032740 con 0x7f64e812e940 2024-09-13T23:10:15.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.334+0000 7f64ef42e640 1 -- 172.21.15.17:0/4009061420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e812e940 msgr2=0x7f64e8130d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:15.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.334+0000 7f64ef42e640 1 --2- 172.21.15.17:0/4009061420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e812e940 0x7f64e8130d30 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f64d80097f0 tx=0x7f64d802a270 comp rx=0 tx=0).stop 2024-09-13T23:10:15.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.334+0000 7f64ef42e640 1 -- 172.21.15.17:0/4009061420 shutdown_connections 2024-09-13T23:10:15.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.334+0000 7f64ef42e640 1 --2- 172.21.15.17:0/4009061420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e812e940 0x7f64e8130d30 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:15.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.334+0000 7f64ef42e640 1 -- 172.21.15.17:0/4009061420 >> 172.21.15.17:0/4009061420 conn(0x7f64e809a890 msgr2=0x7f64e809aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:15.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.335+0000 7f64ef42e640 1 -- 172.21.15.17:0/4009061420 shutdown_connections 2024-09-13T23:10:15.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.335+0000 7f64ef42e640 1 -- 172.21.15.17:0/4009061420 wait complete. 2024-09-13T23:10:15.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.335+0000 7f64ef42e640 1 Processor -- start 2024-09-13T23:10:15.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.335+0000 7f64ef42e640 1 -- start start 2024-09-13T23:10:15.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.336+0000 7f64ef42e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e806eda0 0x7f64e8125d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:15.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.336+0000 7f64ef42e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f64e806fcd0 con 0x7f64e806eda0 2024-09-13T23:10:15.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.336+0000 7f64ed1ca640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e806eda0 0x7f64e8125d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:15.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.336+0000 7f64ed1ca640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e806eda0 0x7f64e8125d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56016/0 (socket says 172.21.15.17:56016) 2024-09-13T23:10:15.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.336+0000 7f64ed1ca640 1 -- 172.21.15.17:0/1914510807 learned_addr learned my addr 172.21.15.17:0/1914510807 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:10:15.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.336+0000 7f64ed1ca640 1 -- 172.21.15.17:0/1914510807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e81273e0 con 0x7f64e806eda0 2024-09-13T23:10:15.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.336+0000 7f64ed1ca640 1 --2- 172.21.15.17:0/1914510807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e806eda0 0x7f64e8125d80 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f64e400c450 tx=0x7f64e400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:15.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.337+0000 7f64ddffb640 1 -- 172.21.15.17:0/1914510807 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64e4007410 con 0x7f64e806eda0 2024-09-13T23:10:15.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.337+0000 7f64ddffb640 1 -- 172.21.15.17:0/1914510807 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e40075b0 con 0x7f64e806eda0 2024-09-13T23:10:15.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.337+0000 7f64ef42e640 1 -- 172.21.15.17:0/1914510807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64e8128f30 con 0x7f64e806eda0 2024-09-13T23:10:15.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.337+0000 7f64ddffb640 1 -- 172.21.15.17:0/1914510807 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64e4004910 con 0x7f64e806eda0 2024-09-13T23:10:15.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.337+0000 7f64ef42e640 1 -- 172.21.15.17:0/1914510807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64e812baa0 con 0x7f64e806eda0 2024-09-13T23:10:15.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.338+0000 7f64ddffb640 1 -- 172.21.15.17:0/1914510807 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f64e401a020 con 0x7f64e806eda0 2024-09-13T23:10:15.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.338+0000 7f64ddffb640 1 --2- 172.21.15.17:0/1914510807 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64cc0382a0 0x7f64cc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:15.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.338+0000 7f64ddffb640 1 -- 172.21.15.17:0/1914510807 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f64e404b550 con 0x7f64e806eda0 2024-09-13T23:10:15.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.338+0000 7f64ef42e640 1 -- 172.21.15.17:0/1914510807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64e8127bb0 con 0x7f64e806eda0 2024-09-13T23:10:15.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.338+0000 7f64ec9c9640 1 --2- 172.21.15.17:0/1914510807 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64cc0382a0 0x7f64cc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:15.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.339+0000 7f64ec9c9640 1 --2- 172.21.15.17:0/1914510807 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64cc0382a0 0x7f64cc03a760 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f64d8034000 tx=0x7f64d802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:15.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.343+0000 7f64ddffb640 1 -- 172.21.15.17:0/1914510807 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f64e401bc30 con 0x7f64e806eda0 2024-09-13T23:10:15.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.519+0000 7f64ef42e640 1 -- 172.21.15.17:0/1914510807 --> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f64e806d890 con 0x7f64cc0382a0 2024-09-13T23:10:15.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.535+0000 7f64ddffb640 1 -- 172.21.15.17:0/1914510807 <== mgr.4102 v2:172.21.15.164:6824/713838566 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666442 (secure 0 0 0) 0x7f64e806d890 con 0x7f64cc0382a0 2024-09-13T23:10:15.544 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-13T23:10:15.553 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-13T23:10:15.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.540+0000 7f64ef42e640 1 -- 172.21.15.17:0/1914510807 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64cc0382a0 msgr2=0x7f64cc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:15.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.540+0000 7f64ef42e640 1 --2- 172.21.15.17:0/1914510807 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64cc0382a0 0x7f64cc03a760 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f64d8034000 tx=0x7f64d802e000 comp rx=0 tx=0).stop 2024-09-13T23:10:15.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.540+0000 7f64ef42e640 1 -- 172.21.15.17:0/1914510807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e806eda0 msgr2=0x7f64e8125d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:15.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.540+0000 7f64ef42e640 1 --2- 172.21.15.17:0/1914510807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e806eda0 0x7f64e8125d80 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f64e400c450 tx=0x7f64e400c910 comp rx=0 tx=0).stop 2024-09-13T23:10:15.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.540+0000 7f64ef42e640 1 -- 172.21.15.17:0/1914510807 shutdown_connections 2024-09-13T23:10:15.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.540+0000 7f64ef42e640 1 --2- 172.21.15.17:0/1914510807 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7f64cc0382a0 0x7f64cc03a760 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:15.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.540+0000 7f64ef42e640 1 --2- 172.21.15.17:0/1914510807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e806eda0 0x7f64e8125d80 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:15.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.540+0000 7f64ef42e640 1 -- 172.21.15.17:0/1914510807 >> 172.21.15.17:0/1914510807 conn(0x7f64e809a890 msgr2=0x7f64e8071480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:15.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.540+0000 7f64ef42e640 1 -- 172.21.15.17:0/1914510807 shutdown_connections 2024-09-13T23:10:15.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.540+0000 7f64ef42e640 1 -- 172.21.15.17:0/1914510807 wait complete. 2024-09-13T23:10:15.557 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-09-13T23:10:14.134225+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5088,"num_read_kb":4669,"num_write":2179,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4793,"ondisk_log_size":4793,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152608,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334752,"statfs":{"total":386547056640,"available":386390786048,"internally_reserved":0,"allocated":2981888,"data_stored":1785412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003660"},"pg_stats":[{"pgid":"3.3f","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:05.685819+0000","last_change":"2024-09-13T23:09:05.685819+0000","last_active":"2024-09-13T23:09:05.685819+0000","last_peered":"2024-09-13T23:09:05.685819+0000","last_clean":"2024-09-13T23:09:05.685819+0000","last_became_active":"2024-09-13T23:05:12.130009+0000","last_became_peered":"2024-09-13T23:05:12.130009+0000","last_unstale":"2024-09-13T23:09:05.685819+0000","last_undegraded":"2024-09-13T23:09:05.685819+0000","last_fullsized":"2024-09-13T23:09:05.685819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:05.685705+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:05.685705+0000","last_clean_scrub_stamp":"2024-09-13T23:09:05.685705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:20:30.741148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:00.090836+0000","last_change":"2024-09-13T23:09:00.090903+0000","last_active":"2024-09-13T23:09:00.090836+0000","last_peered":"2024-09-13T23:09:00.090836+0000","last_clean":"2024-09-13T23:09:00.090836+0000","last_became_active":"2024-09-13T23:05:14.125215+0000","last_became_peered":"2024-09-13T23:05:14.125215+0000","last_unstale":"2024-09-13T23:09:00.090836+0000","last_undegraded":"2024-09-13T23:09:00.090836+0000","last_fullsized":"2024-09-13T23:09:00.090836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:00.090719+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:00.090719+0000","last_clean_scrub_stamp":"2024-09-13T23:09:00.090719+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:25.638836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:19.352952+0000","last_change":"2024-09-13T23:09:19.352952+0000","last_active":"2024-09-13T23:09:19.352952+0000","last_peered":"2024-09-13T23:09:19.352952+0000","last_clean":"2024-09-13T23:09:19.352952+0000","last_became_active":"2024-09-13T23:05:12.118411+0000","last_became_peered":"2024-09-13T23:05:12.118411+0000","last_unstale":"2024-09-13T23:09:19.352952+0000","last_undegraded":"2024-09-13T23:09:19.352952+0000","last_fullsized":"2024-09-13T23:09:19.352952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:19.352818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:19.352818+0000","last_clean_scrub_stamp":"2024-09-13T23:09:19.352818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:01:53.423402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'8","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:19.203533+0000","last_change":"2024-09-13T23:09:19.203561+0000","last_active":"2024-09-13T23:09:19.203533+0000","last_peered":"2024-09-13T23:09:19.203533+0000","last_clean":"2024-09-13T23:09:19.203533+0000","last_became_active":"2024-09-13T23:05:14.109464+0000","last_became_peered":"2024-09-13T23:05:14.109464+0000","last_unstale":"2024-09-13T23:09:19.203533+0000","last_undegraded":"2024-09-13T23:09:19.203533+0000","last_fullsized":"2024-09-13T23:09:19.203533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:09:19.203420+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:09:19.203420+0000","last_clean_scrub_stamp":"2024-09-13T23:09:19.203420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:18.962285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:30.409267+0000","last_change":"2024-09-13T23:09:30.409308+0000","last_active":"2024-09-13T23:09:30.409267+0000","last_peered":"2024-09-13T23:09:30.409267+0000","last_clean":"2024-09-13T23:09:30.409267+0000","last_became_active":"2024-09-13T23:05:12.146191+0000","last_became_peered":"2024-09-13T23:05:12.146191+0000","last_unstale":"2024-09-13T23:09:30.409267+0000","last_undegraded":"2024-09-13T23:09:30.409267+0000","last_fullsized":"2024-09-13T23:09:30.409267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:30.409155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:30.409155+0000","last_clean_scrub_stamp":"2024-09-13T23:09:30.409155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:52.527696+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:15.200771+0000","last_change":"2024-09-13T23:09:15.200800+0000","last_active":"2024-09-13T23:09:15.200771+0000","last_peered":"2024-09-13T23:09:15.200771+0000","last_clean":"2024-09-13T23:09:15.200771+0000","last_became_active":"2024-09-13T23:05:14.110201+0000","last_became_peered":"2024-09-13T23:05:14.110201+0000","last_unstale":"2024-09-13T23:09:15.200771+0000","last_undegraded":"2024-09-13T23:09:15.200771+0000","last_fullsized":"2024-09-13T23:09:15.200771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:15.200679+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:15.200679+0000","last_clean_scrub_stamp":"2024-09-13T23:09:15.200679+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:03.593289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:01.547312+0000","last_change":"2024-09-13T23:09:01.547312+0000","last_active":"2024-09-13T23:09:01.547312+0000","last_peered":"2024-09-13T23:09:01.547312+0000","last_clean":"2024-09-13T23:09:01.547312+0000","last_became_active":"2024-09-13T23:05:12.132461+0000","last_became_peered":"2024-09-13T23:05:12.132461+0000","last_unstale":"2024-09-13T23:09:01.547312+0000","last_undegraded":"2024-09-13T23:09:01.547312+0000","last_fullsized":"2024-09-13T23:09:01.547312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:01.547143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:01.547143+0000","last_clean_scrub_stamp":"2024-09-13T23:09:01.547143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:01.270260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:09.323049+0000","last_change":"2024-09-13T23:09:09.323075+0000","last_active":"2024-09-13T23:09:09.323049+0000","last_peered":"2024-09-13T23:09:09.323049+0000","last_clean":"2024-09-13T23:09:09.323049+0000","last_became_active":"2024-09-13T23:05:14.113430+0000","last_became_peered":"2024-09-13T23:05:14.113430+0000","last_unstale":"2024-09-13T23:09:09.323049+0000","last_undegraded":"2024-09-13T23:09:09.323049+0000","last_fullsized":"2024-09-13T23:09:09.323049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:09.322940+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:09.322940+0000","last_clean_scrub_stamp":"2024-09-13T23:09:09.322940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:32.644280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:36.489656+0000","last_change":"2024-09-13T23:09:36.489656+0000","last_active":"2024-09-13T23:09:36.489656+0000","last_peered":"2024-09-13T23:09:36.489656+0000","last_clean":"2024-09-13T23:09:36.489656+0000","last_became_active":"2024-09-13T23:05:12.146220+0000","last_became_peered":"2024-09-13T23:05:12.146220+0000","last_unstale":"2024-09-13T23:09:36.489656+0000","last_undegraded":"2024-09-13T23:09:36.489656+0000","last_fullsized":"2024-09-13T23:09:36.489656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:36.489516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:36.489516+0000","last_clean_scrub_stamp":"2024-09-13T23:09:36.489516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:38:05.614897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'4","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:09.140867+0000","last_change":"2024-09-13T23:09:09.140867+0000","last_active":"2024-09-13T23:09:09.140867+0000","last_peered":"2024-09-13T23:09:09.140867+0000","last_clean":"2024-09-13T23:09:09.140867+0000","last_became_active":"2024-09-13T23:05:14.122513+0000","last_became_peered":"2024-09-13T23:05:14.122513+0000","last_unstale":"2024-09-13T23:09:09.140867+0000","last_undegraded":"2024-09-13T23:09:09.140867+0000","last_fullsized":"2024-09-13T23:09:09.140867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:09.140751+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:09.140751+0000","last_clean_scrub_stamp":"2024-09-13T23:09:09.140751+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:41.543687+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:13.729839+0000","last_change":"2024-09-13T23:09:13.729869+0000","last_active":"2024-09-13T23:09:13.729839+0000","last_peered":"2024-09-13T23:09:13.729839+0000","last_clean":"2024-09-13T23:09:13.729839+0000","last_became_active":"2024-09-13T23:05:12.113601+0000","last_became_peered":"2024-09-13T23:05:12.113601+0000","last_unstale":"2024-09-13T23:09:13.729839+0000","last_undegraded":"2024-09-13T23:09:13.729839+0000","last_fullsized":"2024-09-13T23:09:13.729839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:13.729730+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:13.729730+0000","last_clean_scrub_stamp":"2024-09-13T23:09:13.729730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:23:12.017749+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:51.435662+0000","last_change":"2024-09-13T23:08:51.435662+0000","last_active":"2024-09-13T23:08:51.435662+0000","last_peered":"2024-09-13T23:08:51.435662+0000","last_clean":"2024-09-13T23:08:51.435662+0000","last_became_active":"2024-09-13T23:05:14.124971+0000","last_became_peered":"2024-09-13T23:05:14.124971+0000","last_unstale":"2024-09-13T23:08:51.435662+0000","last_undegraded":"2024-09-13T23:08:51.435662+0000","last_fullsized":"2024-09-13T23:08:51.435662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:08:51.435544+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:08:51.435544+0000","last_clean_scrub_stamp":"2024-09-13T23:08:51.435544+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:42:37.254383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:47.529621+0000","last_change":"2024-09-13T23:09:47.529621+0000","last_active":"2024-09-13T23:09:47.529621+0000","last_peered":"2024-09-13T23:09:47.529621+0000","last_clean":"2024-09-13T23:09:47.529621+0000","last_became_active":"2024-09-13T23:05:12.138297+0000","last_became_peered":"2024-09-13T23:05:12.138297+0000","last_unstale":"2024-09-13T23:09:47.529621+0000","last_undegraded":"2024-09-13T23:09:47.529621+0000","last_fullsized":"2024-09-13T23:09:47.529621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:47.529474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:47.529474+0000","last_clean_scrub_stamp":"2024-09-13T23:09:47.529474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:06.402040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'16","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:55.622772+0000","last_change":"2024-09-13T23:08:55.622772+0000","last_active":"2024-09-13T23:08:55.622772+0000","last_peered":"2024-09-13T23:08:55.622772+0000","last_clean":"2024-09-13T23:08:55.622772+0000","last_became_active":"2024-09-13T23:05:14.123950+0000","last_became_peered":"2024-09-13T23:05:14.123950+0000","last_unstale":"2024-09-13T23:08:55.622772+0000","last_undegraded":"2024-09-13T23:08:55.622772+0000","last_fullsized":"2024-09-13T23:08:55.622772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:08:55.622652+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:08:55.622652+0000","last_clean_scrub_stamp":"2024-09-13T23:08:55.622652+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:33.082242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":68,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:25.373412+0000","last_change":"2024-09-13T23:09:25.373412+0000","last_active":"2024-09-13T23:09:25.373412+0000","last_peered":"2024-09-13T23:09:25.373412+0000","last_clean":"2024-09-13T23:09:25.373412+0000","last_became_active":"2024-09-13T23:05:12.117028+0000","last_became_peered":"2024-09-13T23:05:12.117028+0000","last_unstale":"2024-09-13T23:09:25.373412+0000","last_undegraded":"2024-09-13T23:09:25.373412+0000","last_fullsized":"2024-09-13T23:09:25.373412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:25.373281+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:25.373281+0000","last_clean_scrub_stamp":"2024-09-13T23:09:25.373281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:50:11.058455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'18","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:08.738777+0000","last_change":"2024-09-13T23:09:08.738777+0000","last_active":"2024-09-13T23:09:08.738777+0000","last_peered":"2024-09-13T23:09:08.738777+0000","last_clean":"2024-09-13T23:09:08.738777+0000","last_became_active":"2024-09-13T23:05:14.114831+0000","last_became_peered":"2024-09-13T23:05:14.114831+0000","last_unstale":"2024-09-13T23:09:08.738777+0000","last_undegraded":"2024-09-13T23:09:08.738777+0000","last_fullsized":"2024-09-13T23:09:08.738777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-13T23:09:08.738611+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-13T23:09:08.738611+0000","last_clean_scrub_stamp":"2024-09-13T23:09:08.738611+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:35.297289+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'16","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:17.207009+0000","last_change":"2024-09-13T23:09:17.207009+0000","last_active":"2024-09-13T23:09:17.207009+0000","last_peered":"2024-09-13T23:09:17.207009+0000","last_clean":"2024-09-13T23:09:17.207009+0000","last_became_active":"2024-09-13T23:05:14.109903+0000","last_became_peered":"2024-09-13T23:05:14.109903+0000","last_unstale":"2024-09-13T23:09:17.207009+0000","last_undegraded":"2024-09-13T23:09:17.207009+0000","last_fullsized":"2024-09-13T23:09:17.207009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:09:17.206881+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:09:17.206881+0000","last_clean_scrub_stamp":"2024-09-13T23:09:17.206881+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:16.967231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":66,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:23.120815+0000","last_change":"2024-09-13T23:09:23.120815+0000","last_active":"2024-09-13T23:09:23.120815+0000","last_peered":"2024-09-13T23:09:23.120815+0000","last_clean":"2024-09-13T23:09:23.120815+0000","last_became_active":"2024-09-13T23:05:12.136334+0000","last_became_peered":"2024-09-13T23:05:12.136334+0000","last_unstale":"2024-09-13T23:09:23.120815+0000","last_undegraded":"2024-09-13T23:09:23.120815+0000","last_fullsized":"2024-09-13T23:09:23.120815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:23.120702+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:23.120702+0000","last_clean_scrub_stamp":"2024-09-13T23:09:23.120702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:00:53.217930+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'12","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:56.098300+0000","last_change":"2024-09-13T23:08:56.098300+0000","last_active":"2024-09-13T23:08:56.098300+0000","last_peered":"2024-09-13T23:08:56.098300+0000","last_clean":"2024-09-13T23:08:56.098300+0000","last_became_active":"2024-09-13T23:05:14.124023+0000","last_became_peered":"2024-09-13T23:05:14.124023+0000","last_unstale":"2024-09-13T23:08:56.098300+0000","last_undegraded":"2024-09-13T23:08:56.098300+0000","last_fullsized":"2024-09-13T23:08:56.098300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T23:08:56.098169+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T23:08:56.098169+0000","last_clean_scrub_stamp":"2024-09-13T23:08:56.098169+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:57:17.059952+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:09.755866+0000","last_change":"2024-09-13T23:09:09.755866+0000","last_active":"2024-09-13T23:09:09.755866+0000","last_peered":"2024-09-13T23:09:09.755866+0000","last_clean":"2024-09-13T23:09:09.755866+0000","last_became_active":"2024-09-13T23:05:12.126336+0000","last_became_peered":"2024-09-13T23:05:12.126336+0000","last_unstale":"2024-09-13T23:09:09.755866+0000","last_undegraded":"2024-09-13T23:09:09.755866+0000","last_fullsized":"2024-09-13T23:09:09.755866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:09.755744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:09.755744+0000","last_clean_scrub_stamp":"2024-09-13T23:09:09.755744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:45:37.055339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'8","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:59.078435+0000","last_change":"2024-09-13T23:08:59.078435+0000","last_active":"2024-09-13T23:08:59.078435+0000","last_peered":"2024-09-13T23:08:59.078435+0000","last_clean":"2024-09-13T23:08:59.078435+0000","last_became_active":"2024-09-13T23:05:14.125247+0000","last_became_peered":"2024-09-13T23:05:14.125247+0000","last_unstale":"2024-09-13T23:08:59.078435+0000","last_undegraded":"2024-09-13T23:08:59.078435+0000","last_fullsized":"2024-09-13T23:08:59.078435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:08:59.078318+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:08:59.078318+0000","last_clean_scrub_stamp":"2024-09-13T23:08:59.078318+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:22:14.387256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:12.069334+0000","last_change":"2024-09-13T23:09:12.069334+0000","last_active":"2024-09-13T23:09:12.069334+0000","last_peered":"2024-09-13T23:09:12.069334+0000","last_clean":"2024-09-13T23:09:12.069334+0000","last_became_active":"2024-09-13T23:05:12.139103+0000","last_became_peered":"2024-09-13T23:05:12.139103+0000","last_unstale":"2024-09-13T23:09:12.069334+0000","last_undegraded":"2024-09-13T23:09:12.069334+0000","last_fullsized":"2024-09-13T23:09:12.069334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:12.069217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:12.069217+0000","last_clean_scrub_stamp":"2024-09-13T23:09:12.069217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:18.902550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:12.323598+0000","last_change":"2024-09-13T23:09:12.323598+0000","last_active":"2024-09-13T23:09:12.323598+0000","last_peered":"2024-09-13T23:09:12.323598+0000","last_clean":"2024-09-13T23:09:12.323598+0000","last_became_active":"2024-09-13T23:05:14.120397+0000","last_became_peered":"2024-09-13T23:05:14.120397+0000","last_unstale":"2024-09-13T23:09:12.323598+0000","last_undegraded":"2024-09-13T23:09:12.323598+0000","last_fullsized":"2024-09-13T23:09:12.323598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:09:12.323473+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:09:12.323473+0000","last_clean_scrub_stamp":"2024-09-13T23:09:12.323473+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:44.704923+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:25.203458+0000","last_change":"2024-09-13T23:09:25.203458+0000","last_active":"2024-09-13T23:09:25.203458+0000","last_peered":"2024-09-13T23:09:25.203458+0000","last_clean":"2024-09-13T23:09:25.203458+0000","last_became_active":"2024-09-13T23:05:12.139022+0000","last_became_peered":"2024-09-13T23:05:12.139022+0000","last_unstale":"2024-09-13T23:09:25.203458+0000","last_undegraded":"2024-09-13T23:09:25.203458+0000","last_fullsized":"2024-09-13T23:09:25.203458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:25.203342+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:25.203342+0000","last_clean_scrub_stamp":"2024-09-13T23:09:25.203342+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:50:10.888515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:06.687578+0000","last_change":"2024-09-13T23:09:06.687578+0000","last_active":"2024-09-13T23:09:06.687578+0000","last_peered":"2024-09-13T23:09:06.687578+0000","last_clean":"2024-09-13T23:09:06.687578+0000","last_became_active":"2024-09-13T23:05:14.114261+0000","last_became_peered":"2024-09-13T23:05:14.114261+0000","last_unstale":"2024-09-13T23:09:06.687578+0000","last_undegraded":"2024-09-13T23:09:06.687578+0000","last_fullsized":"2024-09-13T23:09:06.687578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T23:09:06.687450+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T23:09:06.687450+0000","last_clean_scrub_stamp":"2024-09-13T23:09:06.687450+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:18:07.608760+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:09.256855+0000","last_change":"2024-09-13T23:09:09.256855+0000","last_active":"2024-09-13T23:09:09.256855+0000","last_peered":"2024-09-13T23:09:09.256855+0000","last_clean":"2024-09-13T23:09:09.256855+0000","last_became_active":"2024-09-13T23:05:12.129589+0000","last_became_peered":"2024-09-13T23:05:12.129589+0000","last_unstale":"2024-09-13T23:09:09.256855+0000","last_undegraded":"2024-09-13T23:09:09.256855+0000","last_fullsized":"2024-09-13T23:09:09.256855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:09.256730+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:09.256730+0000","last_clean_scrub_stamp":"2024-09-13T23:09:09.256730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:49.454652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'6","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:04.139219+0000","last_change":"2024-09-13T23:09:04.139219+0000","last_active":"2024-09-13T23:09:04.139219+0000","last_peered":"2024-09-13T23:09:04.139219+0000","last_clean":"2024-09-13T23:09:04.139219+0000","last_became_active":"2024-09-13T23:05:14.118922+0000","last_became_peered":"2024-09-13T23:05:14.118922+0000","last_unstale":"2024-09-13T23:09:04.139219+0000","last_undegraded":"2024-09-13T23:09:04.139219+0000","last_fullsized":"2024-09-13T23:09:04.139219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:04.139018+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:04.139018+0000","last_clean_scrub_stamp":"2024-09-13T23:09:04.139018+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:18.107915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:41.528892+0000","last_change":"2024-09-13T23:09:41.528892+0000","last_active":"2024-09-13T23:09:41.528892+0000","last_peered":"2024-09-13T23:09:41.528892+0000","last_clean":"2024-09-13T23:09:41.528892+0000","last_became_active":"2024-09-13T23:05:12.139690+0000","last_became_peered":"2024-09-13T23:05:12.139690+0000","last_unstale":"2024-09-13T23:09:41.528892+0000","last_undegraded":"2024-09-13T23:09:41.528892+0000","last_fullsized":"2024-09-13T23:09:41.528892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:41.528766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:41.528766+0000","last_clean_scrub_stamp":"2024-09-13T23:09:41.528766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:34.433107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'38","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:29.140403+0000","last_change":"2024-09-13T23:09:29.140403+0000","last_active":"2024-09-13T23:09:29.140403+0000","last_peered":"2024-09-13T23:09:29.140403+0000","last_clean":"2024-09-13T23:09:29.140403+0000","last_became_active":"2024-09-13T23:05:22.145872+0000","last_became_peered":"2024-09-13T23:05:22.145872+0000","last_unstale":"2024-09-13T23:09:29.140403+0000","last_undegraded":"2024-09-13T23:09:29.140403+0000","last_fullsized":"2024-09-13T23:09:29.140403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-09-13T23:09:29.140290+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-09-13T23:09:29.140290+0000","last_clean_scrub_stamp":"2024-09-13T23:09:29.140290+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:05.101062+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":174,"num_write":103,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:18.206746+0000","last_change":"2024-09-13T23:09:18.206746+0000","last_active":"2024-09-13T23:09:18.206746+0000","last_peered":"2024-09-13T23:09:18.206746+0000","last_clean":"2024-09-13T23:09:18.206746+0000","last_became_active":"2024-09-13T23:05:14.109928+0000","last_became_peered":"2024-09-13T23:05:14.109928+0000","last_unstale":"2024-09-13T23:09:18.206746+0000","last_undegraded":"2024-09-13T23:09:18.206746+0000","last_fullsized":"2024-09-13T23:09:18.206746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:18.206589+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:18.206589+0000","last_clean_scrub_stamp":"2024-09-13T23:09:18.206589+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:14.724013+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:38.529119+0000","last_change":"2024-09-13T23:09:38.529119+0000","last_active":"2024-09-13T23:09:38.529119+0000","last_peered":"2024-09-13T23:09:38.529119+0000","last_clean":"2024-09-13T23:09:38.529119+0000","last_became_active":"2024-09-13T23:05:12.146236+0000","last_became_peered":"2024-09-13T23:05:12.146236+0000","last_unstale":"2024-09-13T23:09:38.529119+0000","last_undegraded":"2024-09-13T23:09:38.529119+0000","last_fullsized":"2024-09-13T23:09:38.529119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:38.528969+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:38.528969+0000","last_clean_scrub_stamp":"2024-09-13T23:09:38.528969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:56.953598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:39.624399+0000","last_change":"2024-09-13T23:08:39.624399+0000","last_active":"2024-09-13T23:08:39.624399+0000","last_peered":"2024-09-13T23:08:39.624399+0000","last_clean":"2024-09-13T23:08:39.624399+0000","last_became_active":"2024-09-13T23:05:16.123362+0000","last_became_peered":"2024-09-13T23:05:16.123362+0000","last_unstale":"2024-09-13T23:08:39.624399+0000","last_undegraded":"2024-09-13T23:08:39.624399+0000","last_fullsized":"2024-09-13T23:08:39.624399+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:39.624277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:39.624277+0000","last_clean_scrub_stamp":"2024-09-13T23:08:39.624277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:59.071768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'39","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:02.251564+0000","last_change":"2024-09-13T23:09:02.251564+0000","last_active":"2024-09-13T23:09:02.251564+0000","last_peered":"2024-09-13T23:09:02.251564+0000","last_clean":"2024-09-13T23:09:02.251564+0000","last_became_active":"2024-09-13T23:05:18.132642+0000","last_became_peered":"2024-09-13T23:05:18.132642+0000","last_unstale":"2024-09-13T23:09:02.251564+0000","last_undegraded":"2024-09-13T23:09:02.251564+0000","last_fullsized":"2024-09-13T23:09:02.251564+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-13T23:09:02.251433+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-13T23:09:02.251433+0000","last_clean_scrub_stamp":"2024-09-13T23:09:02.251433+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:58:30.036599+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:57.089257+0000","last_change":"2024-09-13T23:08:57.089257+0000","last_active":"2024-09-13T23:08:57.089257+0000","last_peered":"2024-09-13T23:08:57.089257+0000","last_clean":"2024-09-13T23:08:57.089257+0000","last_became_active":"2024-09-13T23:05:20.145271+0000","last_became_peered":"2024-09-13T23:05:20.145271+0000","last_unstale":"2024-09-13T23:08:57.089257+0000","last_undegraded":"2024-09-13T23:08:57.089257+0000","last_fullsized":"2024-09-13T23:08:57.089257+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:57.089110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:57.089110+0000","last_clean_scrub_stamp":"2024-09-13T23:08:57.089110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:10.929142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:33.260961+0000","last_change":"2024-09-13T23:09:33.260961+0000","last_active":"2024-09-13T23:09:33.260961+0000","last_peered":"2024-09-13T23:09:33.260961+0000","last_clean":"2024-09-13T23:09:33.260961+0000","last_became_active":"2024-09-13T23:05:22.150260+0000","last_became_peered":"2024-09-13T23:05:22.150260+0000","last_unstale":"2024-09-13T23:09:33.260961+0000","last_undegraded":"2024-09-13T23:09:33.260961+0000","last_fullsized":"2024-09-13T23:09:33.260961+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-13T23:09:33.260833+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-13T23:09:33.260833+0000","last_clean_scrub_stamp":"2024-09-13T23:09:33.260833+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:59.740644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:10.302387+0000","last_change":"2024-09-13T23:09:10.302387+0000","last_active":"2024-09-13T23:09:10.302387+0000","last_peered":"2024-09-13T23:09:10.302387+0000","last_clean":"2024-09-13T23:09:10.302387+0000","last_became_active":"2024-09-13T23:05:14.113131+0000","last_became_peered":"2024-09-13T23:05:14.113131+0000","last_unstale":"2024-09-13T23:09:10.302387+0000","last_undegraded":"2024-09-13T23:09:10.302387+0000","last_fullsized":"2024-09-13T23:09:10.302387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:10.302251+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:10.302251+0000","last_clean_scrub_stamp":"2024-09-13T23:09:10.302251+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:23.722716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:59.616993+0000","last_change":"2024-09-13T23:08:59.616993+0000","last_active":"2024-09-13T23:08:59.616993+0000","last_peered":"2024-09-13T23:08:59.616993+0000","last_clean":"2024-09-13T23:08:59.616993+0000","last_became_active":"2024-09-13T23:05:12.133505+0000","last_became_peered":"2024-09-13T23:05:12.133505+0000","last_unstale":"2024-09-13T23:08:59.616993+0000","last_undegraded":"2024-09-13T23:08:59.616993+0000","last_fullsized":"2024-09-13T23:08:59.616993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:59.616881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:59.616881+0000","last_clean_scrub_stamp":"2024-09-13T23:08:59.616881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:40.852888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:48.133256+0000","last_change":"2024-09-13T23:08:48.133256+0000","last_active":"2024-09-13T23:08:48.133256+0000","last_peered":"2024-09-13T23:08:48.133256+0000","last_clean":"2024-09-13T23:08:48.133256+0000","last_became_active":"2024-09-13T23:05:16.124724+0000","last_became_peered":"2024-09-13T23:05:16.124724+0000","last_unstale":"2024-09-13T23:08:48.133256+0000","last_undegraded":"2024-09-13T23:08:48.133256+0000","last_fullsized":"2024-09-13T23:08:48.133256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:48.133136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:48.133136+0000","last_clean_scrub_stamp":"2024-09-13T23:08:48.133136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:23:32.736027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'10","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:38.121680+0000","last_change":"2024-09-13T23:08:38.121680+0000","last_active":"2024-09-13T23:08:38.121680+0000","last_peered":"2024-09-13T23:08:38.121680+0000","last_clean":"2024-09-13T23:08:38.121680+0000","last_became_active":"2024-09-13T23:05:18.126251+0000","last_became_peered":"2024-09-13T23:05:18.126251+0000","last_unstale":"2024-09-13T23:08:38.121680+0000","last_undegraded":"2024-09-13T23:08:38.121680+0000","last_fullsized":"2024-09-13T23:08:38.121680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T23:08:38.121563+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T23:08:38.121563+0000","last_clean_scrub_stamp":"2024-09-13T23:08:38.121563+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:16:06.466530+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:53.193447+0000","last_change":"2024-09-13T23:08:53.193447+0000","last_active":"2024-09-13T23:08:53.193447+0000","last_peered":"2024-09-13T23:08:53.193447+0000","last_clean":"2024-09-13T23:08:53.193447+0000","last_became_active":"2024-09-13T23:05:20.142564+0000","last_became_peered":"2024-09-13T23:05:20.142564+0000","last_unstale":"2024-09-13T23:08:53.193447+0000","last_undegraded":"2024-09-13T23:08:53.193447+0000","last_fullsized":"2024-09-13T23:08:53.193447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:53.193295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:53.193295+0000","last_clean_scrub_stamp":"2024-09-13T23:08:53.193295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:07:13.524706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:34.281179+0000","last_change":"2024-09-13T23:09:34.281211+0000","last_active":"2024-09-13T23:09:34.281179+0000","last_peered":"2024-09-13T23:09:34.281179+0000","last_clean":"2024-09-13T23:09:34.281179+0000","last_became_active":"2024-09-13T23:05:22.147493+0000","last_became_peered":"2024-09-13T23:05:22.147493+0000","last_unstale":"2024-09-13T23:09:34.281179+0000","last_undegraded":"2024-09-13T23:09:34.281179+0000","last_fullsized":"2024-09-13T23:09:34.281179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T23:09:34.281084+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T23:09:34.281084+0000","last_clean_scrub_stamp":"2024-09-13T23:09:34.281084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:53:59.476389+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:11.254390+0000","last_change":"2024-09-13T23:09:11.254390+0000","last_active":"2024-09-13T23:09:11.254390+0000","last_peered":"2024-09-13T23:09:11.254390+0000","last_clean":"2024-09-13T23:09:11.254390+0000","last_became_active":"2024-09-13T23:05:14.112986+0000","last_became_peered":"2024-09-13T23:05:14.112986+0000","last_unstale":"2024-09-13T23:09:11.254390+0000","last_undegraded":"2024-09-13T23:09:11.254390+0000","last_fullsized":"2024-09-13T23:09:11.254390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:11.254218+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:11.254218+0000","last_clean_scrub_stamp":"2024-09-13T23:09:11.254218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:42.812871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:48.553225+0000","last_change":"2024-09-13T23:09:48.553225+0000","last_active":"2024-09-13T23:09:48.553225+0000","last_peered":"2024-09-13T23:09:48.553225+0000","last_clean":"2024-09-13T23:09:48.553225+0000","last_became_active":"2024-09-13T23:05:12.138805+0000","last_became_peered":"2024-09-13T23:05:12.138805+0000","last_unstale":"2024-09-13T23:09:48.553225+0000","last_undegraded":"2024-09-13T23:09:48.553225+0000","last_fullsized":"2024-09-13T23:09:48.553225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:48.553088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:48.553088+0000","last_clean_scrub_stamp":"2024-09-13T23:09:48.553088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:19.824507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:25.804482+0000","last_change":"2024-09-13T23:09:25.804507+0000","last_active":"2024-09-13T23:09:25.804482+0000","last_peered":"2024-09-13T23:09:25.804482+0000","last_clean":"2024-09-13T23:09:25.804482+0000","last_became_active":"2024-09-13T23:05:49.165209+0000","last_became_peered":"2024-09-13T23:05:49.165209+0000","last_unstale":"2024-09-13T23:09:25.804482+0000","last_undegraded":"2024-09-13T23:09:25.804482+0000","last_fullsized":"2024-09-13T23:09:25.804482+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:25.804395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:25.804395+0000","last_clean_scrub_stamp":"2024-09-13T23:09:25.804395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:13.335216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"34'16","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:39.564192+0000","last_change":"2024-09-13T23:08:39.564192+0000","last_active":"2024-09-13T23:08:39.564192+0000","last_peered":"2024-09-13T23:08:39.564192+0000","last_clean":"2024-09-13T23:08:39.564192+0000","last_became_active":"2024-09-13T23:05:18.134363+0000","last_became_peered":"2024-09-13T23:05:18.134363+0000","last_unstale":"2024-09-13T23:08:39.564192+0000","last_undegraded":"2024-09-13T23:08:39.564192+0000","last_fullsized":"2024-09-13T23:08:39.564192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:08:39.564067+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:08:39.564067+0000","last_clean_scrub_stamp":"2024-09-13T23:08:39.564067+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:23.504537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'286","reported_seq":399,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:08.293738+0000","last_change":"2024-09-13T23:09:08.293738+0000","last_active":"2024-09-13T23:09:08.293738+0000","last_peered":"2024-09-13T23:09:08.293738+0000","last_clean":"2024-09-13T23:09:08.293738+0000","last_became_active":"2024-09-13T23:05:20.143986+0000","last_became_peered":"2024-09-13T23:05:20.143986+0000","last_unstale":"2024-09-13T23:09:08.293738+0000","last_undegraded":"2024-09-13T23:09:08.293738+0000","last_fullsized":"2024-09-13T23:09:08.293738+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-13T23:09:08.293563+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-13T23:09:08.293563+0000","last_clean_scrub_stamp":"2024-09-13T23:09:08.293563+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:25.538117+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'8","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:23.728251+0000","last_change":"2024-09-13T23:09:23.728279+0000","last_active":"2024-09-13T23:09:23.728251+0000","last_peered":"2024-09-13T23:09:23.728251+0000","last_clean":"2024-09-13T23:09:23.728251+0000","last_became_active":"2024-09-13T23:05:22.150977+0000","last_became_peered":"2024-09-13T23:05:22.150977+0000","last_unstale":"2024-09-13T23:09:23.728251+0000","last_undegraded":"2024-09-13T23:09:23.728251+0000","last_fullsized":"2024-09-13T23:09:23.728251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:09:23.728159+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:09:23.728159+0000","last_clean_scrub_stamp":"2024-09-13T23:09:23.728159+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:58.616304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'12","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:00.231505+0000","last_change":"2024-09-13T23:09:00.231505+0000","last_active":"2024-09-13T23:09:00.231505+0000","last_peered":"2024-09-13T23:09:00.231505+0000","last_clean":"2024-09-13T23:09:00.231505+0000","last_became_active":"2024-09-13T23:05:14.121960+0000","last_became_peered":"2024-09-13T23:05:14.121960+0000","last_unstale":"2024-09-13T23:09:00.231505+0000","last_undegraded":"2024-09-13T23:09:00.231505+0000","last_fullsized":"2024-09-13T23:09:00.231505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T23:09:00.231337+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T23:09:00.231337+0000","last_clean_scrub_stamp":"2024-09-13T23:09:00.231337+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:56.146066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:20.082030+0000","last_change":"2024-09-13T23:09:20.082030+0000","last_active":"2024-09-13T23:09:20.082030+0000","last_peered":"2024-09-13T23:09:20.082030+0000","last_clean":"2024-09-13T23:09:20.082030+0000","last_became_active":"2024-09-13T23:05:12.129019+0000","last_became_peered":"2024-09-13T23:05:12.129019+0000","last_unstale":"2024-09-13T23:09:20.082030+0000","last_undegraded":"2024-09-13T23:09:20.082030+0000","last_fullsized":"2024-09-13T23:09:20.082030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:20.081898+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:20.081898+0000","last_clean_scrub_stamp":"2024-09-13T23:09:20.081898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:08:01.867528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:41.570127+0000","last_change":"2024-09-13T23:08:41.570127+0000","last_active":"2024-09-13T23:08:41.570127+0000","last_peered":"2024-09-13T23:08:41.570127+0000","last_clean":"2024-09-13T23:08:41.570127+0000","last_became_active":"2024-09-13T23:05:16.122555+0000","last_became_peered":"2024-09-13T23:05:16.122555+0000","last_unstale":"2024-09-13T23:08:41.570127+0000","last_undegraded":"2024-09-13T23:08:41.570127+0000","last_fullsized":"2024-09-13T23:08:41.570127+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:41.570017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:41.570017+0000","last_clean_scrub_stamp":"2024-09-13T23:08:41.570017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:53.974996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'36","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:41.566822+0000","last_change":"2024-09-13T23:08:41.566822+0000","last_active":"2024-09-13T23:08:41.566822+0000","last_peered":"2024-09-13T23:08:41.566822+0000","last_clean":"2024-09-13T23:08:41.566822+0000","last_became_active":"2024-09-13T23:05:18.128626+0000","last_became_peered":"2024-09-13T23:05:18.128626+0000","last_unstale":"2024-09-13T23:08:41.566822+0000","last_undegraded":"2024-09-13T23:08:41.566822+0000","last_fullsized":"2024-09-13T23:08:41.566822+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-13T23:08:41.566699+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-13T23:08:41.566699+0000","last_clean_scrub_stamp":"2024-09-13T23:08:41.566699+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:31.161100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":414,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:37.047469+0000","last_change":"2024-09-13T23:08:37.047469+0000","last_active":"2024-09-13T23:08:37.047469+0000","last_peered":"2024-09-13T23:08:37.047469+0000","last_clean":"2024-09-13T23:08:37.047469+0000","last_became_active":"2024-09-13T23:05:20.131943+0000","last_became_peered":"2024-09-13T23:05:20.131943+0000","last_unstale":"2024-09-13T23:08:37.047469+0000","last_undegraded":"2024-09-13T23:08:37.047469+0000","last_fullsized":"2024-09-13T23:08:37.047469+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:37.047343+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:37.047343+0000","last_clean_scrub_stamp":"2024-09-13T23:08:37.047343+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:51:19.741192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:47.398608+0000","last_change":"2024-09-13T23:08:47.398608+0000","last_active":"2024-09-13T23:08:47.398608+0000","last_peered":"2024-09-13T23:08:47.398608+0000","last_clean":"2024-09-13T23:08:47.398608+0000","last_became_active":"2024-09-13T23:05:14.126659+0000","last_became_peered":"2024-09-13T23:05:14.126659+0000","last_unstale":"2024-09-13T23:08:47.398608+0000","last_undegraded":"2024-09-13T23:08:47.398608+0000","last_fullsized":"2024-09-13T23:08:47.398608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:47.398478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:47.398478+0000","last_clean_scrub_stamp":"2024-09-13T23:08:47.398478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:48.669511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:16.723632+0000","last_change":"2024-09-13T23:09:16.723632+0000","last_active":"2024-09-13T23:09:16.723632+0000","last_peered":"2024-09-13T23:09:16.723632+0000","last_clean":"2024-09-13T23:09:16.723632+0000","last_became_active":"2024-09-13T23:05:12.114453+0000","last_became_peered":"2024-09-13T23:05:12.114453+0000","last_unstale":"2024-09-13T23:09:16.723632+0000","last_undegraded":"2024-09-13T23:09:16.723632+0000","last_fullsized":"2024-09-13T23:09:16.723632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:16.723508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:16.723508+0000","last_clean_scrub_stamp":"2024-09-13T23:09:16.723508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:30:34.735824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:40.158918+0000","last_change":"2024-09-13T23:08:40.158918+0000","last_active":"2024-09-13T23:08:40.158918+0000","last_peered":"2024-09-13T23:08:40.158918+0000","last_clean":"2024-09-13T23:08:40.158918+0000","last_became_active":"2024-09-13T23:05:16.124324+0000","last_became_peered":"2024-09-13T23:05:16.124324+0000","last_unstale":"2024-09-13T23:08:40.158918+0000","last_undegraded":"2024-09-13T23:08:40.158918+0000","last_fullsized":"2024-09-13T23:08:40.158918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:40.158756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:40.158756+0000","last_clean_scrub_stamp":"2024-09-13T23:08:40.158756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:01.139147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'51","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:40.531513+0000","last_change":"2024-09-13T23:08:40.531513+0000","last_active":"2024-09-13T23:08:40.531513+0000","last_peered":"2024-09-13T23:08:40.531513+0000","last_clean":"2024-09-13T23:08:40.531513+0000","last_became_active":"2024-09-13T23:05:18.129887+0000","last_became_peered":"2024-09-13T23:05:18.129887+0000","last_unstale":"2024-09-13T23:08:40.531513+0000","last_undegraded":"2024-09-13T23:08:40.531513+0000","last_fullsized":"2024-09-13T23:08:40.531513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'51","last_scrub_stamp":"2024-09-13T23:08:40.531386+0000","last_deep_scrub":"34'51","last_deep_scrub_stamp":"2024-09-13T23:08:40.531386+0000","last_clean_scrub_stamp":"2024-09-13T23:08:40.531386+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:00:53.584234+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:36.003951+0000","last_change":"2024-09-13T23:08:36.003951+0000","last_active":"2024-09-13T23:08:36.003951+0000","last_peered":"2024-09-13T23:08:36.003951+0000","last_clean":"2024-09-13T23:08:36.003951+0000","last_became_active":"2024-09-13T23:05:20.135937+0000","last_became_peered":"2024-09-13T23:05:20.135937+0000","last_unstale":"2024-09-13T23:08:36.003951+0000","last_undegraded":"2024-09-13T23:08:36.003951+0000","last_fullsized":"2024-09-13T23:08:36.003951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:36.003822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:36.003822+0000","last_clean_scrub_stamp":"2024-09-13T23:08:36.003822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:36.100827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:54.634313+0000","last_change":"2024-09-13T23:08:54.634313+0000","last_active":"2024-09-13T23:08:54.634313+0000","last_peered":"2024-09-13T23:08:54.634313+0000","last_clean":"2024-09-13T23:08:54.634313+0000","last_became_active":"2024-09-13T23:05:22.146044+0000","last_became_peered":"2024-09-13T23:05:22.146044+0000","last_unstale":"2024-09-13T23:08:54.634313+0000","last_undegraded":"2024-09-13T23:08:54.634313+0000","last_fullsized":"2024-09-13T23:08:54.634313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T23:08:54.634198+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T23:08:54.634198+0000","last_clean_scrub_stamp":"2024-09-13T23:08:54.634198+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:58:43.552913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:06.131179+0000","last_change":"2024-09-13T23:09:06.131179+0000","last_active":"2024-09-13T23:09:06.131179+0000","last_peered":"2024-09-13T23:09:06.131179+0000","last_clean":"2024-09-13T23:09:06.131179+0000","last_became_active":"2024-09-13T23:05:14.116507+0000","last_became_peered":"2024-09-13T23:05:14.116507+0000","last_unstale":"2024-09-13T23:09:06.131179+0000","last_undegraded":"2024-09-13T23:09:06.131179+0000","last_fullsized":"2024-09-13T23:09:06.131179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:06.131036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:06.131036+0000","last_clean_scrub_stamp":"2024-09-13T23:09:06.131036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:00.584889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:14.711220+0000","last_change":"2024-09-13T23:09:14.711220+0000","last_active":"2024-09-13T23:09:14.711220+0000","last_peered":"2024-09-13T23:09:14.711220+0000","last_clean":"2024-09-13T23:09:14.711220+0000","last_became_active":"2024-09-13T23:05:12.115025+0000","last_became_peered":"2024-09-13T23:05:12.115025+0000","last_unstale":"2024-09-13T23:09:14.711220+0000","last_undegraded":"2024-09-13T23:09:14.711220+0000","last_fullsized":"2024-09-13T23:09:14.711220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:14.711051+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:14.711051+0000","last_clean_scrub_stamp":"2024-09-13T23:09:14.711051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:35:37.823812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:56.177873+0000","last_change":"2024-09-13T23:08:56.177873+0000","last_active":"2024-09-13T23:08:56.177873+0000","last_peered":"2024-09-13T23:08:56.177873+0000","last_clean":"2024-09-13T23:08:56.177873+0000","last_became_active":"2024-09-13T23:05:16.118494+0000","last_became_peered":"2024-09-13T23:05:16.118494+0000","last_unstale":"2024-09-13T23:08:56.177873+0000","last_undegraded":"2024-09-13T23:08:56.177873+0000","last_fullsized":"2024-09-13T23:08:56.177873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:56.177744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:56.177744+0000","last_clean_scrub_stamp":"2024-09-13T23:08:56.177744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:53.534857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:03.229920+0000","last_change":"2024-09-13T23:09:03.229920+0000","last_active":"2024-09-13T23:09:03.229920+0000","last_peered":"2024-09-13T23:09:03.229920+0000","last_clean":"2024-09-13T23:09:03.229920+0000","last_became_active":"2024-09-13T23:05:18.134130+0000","last_became_peered":"2024-09-13T23:05:18.134130+0000","last_unstale":"2024-09-13T23:09:03.229920+0000","last_undegraded":"2024-09-13T23:09:03.229920+0000","last_fullsized":"2024-09-13T23:09:03.229920+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-13T23:09:03.229792+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-13T23:09:03.229792+0000","last_clean_scrub_stamp":"2024-09-13T23:09:03.229792+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:13.414475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:42.005343+0000","last_change":"2024-09-13T23:08:42.005343+0000","last_active":"2024-09-13T23:08:42.005343+0000","last_peered":"2024-09-13T23:08:42.005343+0000","last_clean":"2024-09-13T23:08:42.005343+0000","last_became_active":"2024-09-13T23:05:20.140180+0000","last_became_peered":"2024-09-13T23:05:20.140180+0000","last_unstale":"2024-09-13T23:08:42.005343+0000","last_undegraded":"2024-09-13T23:08:42.005343+0000","last_fullsized":"2024-09-13T23:08:42.005343+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:42.005224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:42.005224+0000","last_clean_scrub_stamp":"2024-09-13T23:08:42.005224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:49:52.491200+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'8","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:31.215235+0000","last_change":"2024-09-13T23:09:31.215235+0000","last_active":"2024-09-13T23:09:31.215235+0000","last_peered":"2024-09-13T23:09:31.215235+0000","last_clean":"2024-09-13T23:09:31.215235+0000","last_became_active":"2024-09-13T23:05:22.148104+0000","last_became_peered":"2024-09-13T23:05:22.148104+0000","last_unstale":"2024-09-13T23:09:31.215235+0000","last_undegraded":"2024-09-13T23:09:31.215235+0000","last_fullsized":"2024-09-13T23:09:31.215235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:09:31.215112+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:09:31.215112+0000","last_clean_scrub_stamp":"2024-09-13T23:09:31.215112+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:13.797313+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":18,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:20.742460+0000","last_change":"2024-09-13T23:09:20.742460+0000","last_active":"2024-09-13T23:09:20.742460+0000","last_peered":"2024-09-13T23:09:20.742460+0000","last_clean":"2024-09-13T23:09:20.742460+0000","last_became_active":"2024-09-13T23:05:14.119071+0000","last_became_peered":"2024-09-13T23:05:14.119071+0000","last_unstale":"2024-09-13T23:09:20.742460+0000","last_undegraded":"2024-09-13T23:09:20.742460+0000","last_fullsized":"2024-09-13T23:09:20.742460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:20.742341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:20.742341+0000","last_clean_scrub_stamp":"2024-09-13T23:09:20.742341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:04.873814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:40.522104+0000","last_change":"2024-09-13T23:09:40.522104+0000","last_active":"2024-09-13T23:09:40.522104+0000","last_peered":"2024-09-13T23:09:40.522104+0000","last_clean":"2024-09-13T23:09:40.522104+0000","last_became_active":"2024-09-13T23:05:12.148439+0000","last_became_peered":"2024-09-13T23:05:12.148439+0000","last_unstale":"2024-09-13T23:09:40.522104+0000","last_undegraded":"2024-09-13T23:09:40.522104+0000","last_fullsized":"2024-09-13T23:09:40.522104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:40.521978+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:40.521978+0000","last_clean_scrub_stamp":"2024-09-13T23:09:40.521978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:23.039772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:52.165250+0000","last_change":"2024-09-13T23:08:52.165250+0000","last_active":"2024-09-13T23:08:52.165250+0000","last_peered":"2024-09-13T23:08:52.165250+0000","last_clean":"2024-09-13T23:08:52.165250+0000","last_became_active":"2024-09-13T23:05:16.123188+0000","last_became_peered":"2024-09-13T23:05:16.123188+0000","last_unstale":"2024-09-13T23:08:52.165250+0000","last_undegraded":"2024-09-13T23:08:52.165250+0000","last_fullsized":"2024-09-13T23:08:52.165250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:52.165141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:52.165141+0000","last_clean_scrub_stamp":"2024-09-13T23:08:52.165141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:55:30.699678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'45","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:40.622258+0000","last_change":"2024-09-13T23:08:40.622258+0000","last_active":"2024-09-13T23:08:40.622258+0000","last_peered":"2024-09-13T23:08:40.622258+0000","last_clean":"2024-09-13T23:08:40.622258+0000","last_became_active":"2024-09-13T23:05:18.131446+0000","last_became_peered":"2024-09-13T23:05:18.131446+0000","last_unstale":"2024-09-13T23:08:40.622258+0000","last_undegraded":"2024-09-13T23:08:40.622258+0000","last_fullsized":"2024-09-13T23:08:40.622258+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-09-13T23:08:40.622115+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-09-13T23:08:40.622115+0000","last_clean_scrub_stamp":"2024-09-13T23:08:40.622115+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:07.613322+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":361,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:50.174769+0000","last_change":"2024-09-13T23:08:50.174769+0000","last_active":"2024-09-13T23:08:50.174769+0000","last_peered":"2024-09-13T23:08:50.174769+0000","last_clean":"2024-09-13T23:08:50.174769+0000","last_became_active":"2024-09-13T23:05:20.144104+0000","last_became_peered":"2024-09-13T23:05:20.144104+0000","last_unstale":"2024-09-13T23:08:50.174769+0000","last_undegraded":"2024-09-13T23:08:50.174769+0000","last_fullsized":"2024-09-13T23:08:50.174769+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:50.174650+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:50.174650+0000","last_clean_scrub_stamp":"2024-09-13T23:08:50.174650+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:45:01.149565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:35.307071+0000","last_change":"2024-09-13T23:09:35.307071+0000","last_active":"2024-09-13T23:09:35.307071+0000","last_peered":"2024-09-13T23:09:35.307071+0000","last_clean":"2024-09-13T23:09:35.307071+0000","last_became_active":"2024-09-13T23:05:22.147645+0000","last_became_peered":"2024-09-13T23:05:22.147645+0000","last_unstale":"2024-09-13T23:09:35.307071+0000","last_undegraded":"2024-09-13T23:09:35.307071+0000","last_fullsized":"2024-09-13T23:09:35.307071+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:35.306936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:35.306936+0000","last_clean_scrub_stamp":"2024-09-13T23:09:35.306936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:19.701402+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'10","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:58.567649+0000","last_change":"2024-09-13T23:08:58.567649+0000","last_active":"2024-09-13T23:08:58.567649+0000","last_peered":"2024-09-13T23:08:58.567649+0000","last_clean":"2024-09-13T23:08:58.567649+0000","last_became_active":"2024-09-13T23:05:14.112291+0000","last_became_peered":"2024-09-13T23:05:14.112291+0000","last_unstale":"2024-09-13T23:08:58.567649+0000","last_undegraded":"2024-09-13T23:08:58.567649+0000","last_fullsized":"2024-09-13T23:08:58.567649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T23:08:58.567512+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T23:08:58.567512+0000","last_clean_scrub_stamp":"2024-09-13T23:08:58.567512+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:43.527393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:25.329987+0000","last_change":"2024-09-13T23:09:25.329987+0000","last_active":"2024-09-13T23:09:25.329987+0000","last_peered":"2024-09-13T23:09:25.329987+0000","last_clean":"2024-09-13T23:09:25.329987+0000","last_became_active":"2024-09-13T23:05:12.149418+0000","last_became_peered":"2024-09-13T23:05:12.149418+0000","last_unstale":"2024-09-13T23:09:25.329987+0000","last_undegraded":"2024-09-13T23:09:25.329987+0000","last_fullsized":"2024-09-13T23:09:25.329987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:25.329872+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:25.329872+0000","last_clean_scrub_stamp":"2024-09-13T23:09:25.329872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:34.474798+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:55.175246+0000","last_change":"2024-09-13T23:08:55.175246+0000","last_active":"2024-09-13T23:08:55.175246+0000","last_peered":"2024-09-13T23:08:55.175246+0000","last_clean":"2024-09-13T23:08:55.175246+0000","last_became_active":"2024-09-13T23:05:16.118503+0000","last_became_peered":"2024-09-13T23:05:16.118503+0000","last_unstale":"2024-09-13T23:08:55.175246+0000","last_undegraded":"2024-09-13T23:08:55.175246+0000","last_fullsized":"2024-09-13T23:08:55.175246+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:55.175127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:55.175127+0000","last_clean_scrub_stamp":"2024-09-13T23:08:55.175127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:13:05.711566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'63","reported_seq":137,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:57.374099+0000","last_change":"2024-09-13T23:08:57.374099+0000","last_active":"2024-09-13T23:08:57.374099+0000","last_peered":"2024-09-13T23:08:57.374099+0000","last_clean":"2024-09-13T23:08:57.374099+0000","last_became_active":"2024-09-13T23:05:18.135307+0000","last_became_peered":"2024-09-13T23:05:18.135307+0000","last_unstale":"2024-09-13T23:08:57.374099+0000","last_undegraded":"2024-09-13T23:08:57.374099+0000","last_fullsized":"2024-09-13T23:08:57.374099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'63","last_scrub_stamp":"2024-09-13T23:08:57.373955+0000","last_deep_scrub":"34'63","last_deep_scrub_stamp":"2024-09-13T23:08:57.373955+0000","last_clean_scrub_stamp":"2024-09-13T23:08:57.373955+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:00.678457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:32.955726+0000","last_change":"2024-09-13T23:08:32.955726+0000","last_active":"2024-09-13T23:08:32.955726+0000","last_peered":"2024-09-13T23:08:32.955726+0000","last_clean":"2024-09-13T23:08:32.955726+0000","last_became_active":"2024-09-13T23:05:20.137460+0000","last_became_peered":"2024-09-13T23:05:20.137460+0000","last_unstale":"2024-09-13T23:08:32.955726+0000","last_undegraded":"2024-09-13T23:08:32.955726+0000","last_fullsized":"2024-09-13T23:08:32.955726+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:32.955629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:32.955629+0000","last_clean_scrub_stamp":"2024-09-13T23:08:32.955629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:14.847447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'21","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:31.333368+0000","last_change":"2024-09-13T23:09:31.333368+0000","last_active":"2024-09-13T23:09:31.333368+0000","last_peered":"2024-09-13T23:09:31.333368+0000","last_clean":"2024-09-13T23:09:31.333368+0000","last_became_active":"2024-09-13T23:05:22.141472+0000","last_became_peered":"2024-09-13T23:05:22.141472+0000","last_unstale":"2024-09-13T23:09:31.333368+0000","last_undegraded":"2024-09-13T23:09:31.333368+0000","last_fullsized":"2024-09-13T23:09:31.333368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-13T23:09:31.333239+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-13T23:09:31.333239+0000","last_clean_scrub_stamp":"2024-09-13T23:09:31.333239+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:05:38.230749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:05.149603+0000","last_change":"2024-09-13T23:09:05.149603+0000","last_active":"2024-09-13T23:09:05.149603+0000","last_peered":"2024-09-13T23:09:05.149603+0000","last_clean":"2024-09-13T23:09:05.149603+0000","last_became_active":"2024-09-13T23:05:49.164426+0000","last_became_peered":"2024-09-13T23:05:49.164426+0000","last_unstale":"2024-09-13T23:09:05.149603+0000","last_undegraded":"2024-09-13T23:09:05.149603+0000","last_fullsized":"2024-09-13T23:09:05.149603+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T23:09:05.149414+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T23:09:05.149414+0000","last_clean_scrub_stamp":"2024-09-13T23:09:05.149414+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:09.148923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:07.243570+0000","last_change":"2024-09-13T23:09:07.243570+0000","last_active":"2024-09-13T23:09:07.243570+0000","last_peered":"2024-09-13T23:09:07.243570+0000","last_clean":"2024-09-13T23:09:07.243570+0000","last_became_active":"2024-09-13T23:05:12.129951+0000","last_became_peered":"2024-09-13T23:05:12.129951+0000","last_unstale":"2024-09-13T23:09:07.243570+0000","last_undegraded":"2024-09-13T23:09:07.243570+0000","last_fullsized":"2024-09-13T23:09:07.243570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:07.243394+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:07.243394+0000","last_clean_scrub_stamp":"2024-09-13T23:09:07.243394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:18.684549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:48.682504+0000","last_change":"2024-09-13T23:08:48.682504+0000","last_active":"2024-09-13T23:08:48.682504+0000","last_peered":"2024-09-13T23:08:48.682504+0000","last_clean":"2024-09-13T23:08:48.682504+0000","last_became_active":"2024-09-13T23:05:16.127598+0000","last_became_peered":"2024-09-13T23:05:16.127598+0000","last_unstale":"2024-09-13T23:08:48.682504+0000","last_undegraded":"2024-09-13T23:08:48.682504+0000","last_fullsized":"2024-09-13T23:08:48.682504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:48.682390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:48.682390+0000","last_clean_scrub_stamp":"2024-09-13T23:08:48.682390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:16:51.142230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'39","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:36.095166+0000","last_change":"2024-09-13T23:08:36.095166+0000","last_active":"2024-09-13T23:08:36.095166+0000","last_peered":"2024-09-13T23:08:36.095166+0000","last_clean":"2024-09-13T23:08:36.095166+0000","last_became_active":"2024-09-13T23:05:18.128238+0000","last_became_peered":"2024-09-13T23:05:18.128238+0000","last_unstale":"2024-09-13T23:08:36.095166+0000","last_undegraded":"2024-09-13T23:08:36.095166+0000","last_fullsized":"2024-09-13T23:08:36.095166+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-13T23:08:36.095044+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-13T23:08:36.095044+0000","last_clean_scrub_stamp":"2024-09-13T23:08:36.095044+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:48:40.542578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:00.311550+0000","last_change":"2024-09-13T23:09:00.311550+0000","last_active":"2024-09-13T23:09:00.311550+0000","last_peered":"2024-09-13T23:09:00.311550+0000","last_clean":"2024-09-13T23:09:00.311550+0000","last_became_active":"2024-09-13T23:05:20.139335+0000","last_became_peered":"2024-09-13T23:05:20.139335+0000","last_unstale":"2024-09-13T23:09:00.311550+0000","last_undegraded":"2024-09-13T23:09:00.311550+0000","last_fullsized":"2024-09-13T23:09:00.311550+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:00.311418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:00.311418+0000","last_clean_scrub_stamp":"2024-09-13T23:09:00.311418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:28.885656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:54.390588+0000","last_change":"2024-09-13T23:09:54.390650+0000","last_active":"2024-09-13T23:09:54.390588+0000","last_peered":"2024-09-13T23:09:54.390588+0000","last_clean":"2024-09-13T23:09:54.390588+0000","last_became_active":"2024-09-13T23:05:22.148222+0000","last_became_peered":"2024-09-13T23:05:22.148222+0000","last_unstale":"2024-09-13T23:09:54.390588+0000","last_undegraded":"2024-09-13T23:09:54.390588+0000","last_fullsized":"2024-09-13T23:09:54.390588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:54.390462+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:54.390462+0000","last_clean_scrub_stamp":"2024-09-13T23:09:54.390462+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:15:57.397638+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'34","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:06.266334+0000","last_change":"2024-09-13T23:09:06.266334+0000","last_active":"2024-09-13T23:09:06.266334+0000","last_peered":"2024-09-13T23:09:06.266334+0000","last_clean":"2024-09-13T23:09:06.266334+0000","last_became_active":"2024-09-13T23:05:14.118545+0000","last_became_peered":"2024-09-13T23:05:14.118545+0000","last_unstale":"2024-09-13T23:09:06.266334+0000","last_undegraded":"2024-09-13T23:09:06.266334+0000","last_fullsized":"2024-09-13T23:09:06.266334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'34","last_scrub_stamp":"2024-09-13T23:09:06.266184+0000","last_deep_scrub":"34'34","last_deep_scrub_stamp":"2024-09-13T23:09:06.266184+0000","last_clean_scrub_stamp":"2024-09-13T23:09:06.266184+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:12.667320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":93,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:34.409361+0000","last_change":"2024-09-13T23:09:34.409393+0000","last_active":"2024-09-13T23:09:34.409361+0000","last_peered":"2024-09-13T23:09:34.409361+0000","last_clean":"2024-09-13T23:09:34.409361+0000","last_became_active":"2024-09-13T23:05:12.146912+0000","last_became_peered":"2024-09-13T23:05:12.146912+0000","last_unstale":"2024-09-13T23:09:34.409361+0000","last_undegraded":"2024-09-13T23:09:34.409361+0000","last_fullsized":"2024-09-13T23:09:34.409361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:34.409252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:34.409252+0000","last_clean_scrub_stamp":"2024-09-13T23:09:34.409252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:14.359502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:57.227716+0000","last_change":"2024-09-13T23:08:57.227716+0000","last_active":"2024-09-13T23:08:57.227716+0000","last_peered":"2024-09-13T23:08:57.227716+0000","last_clean":"2024-09-13T23:08:57.227716+0000","last_became_active":"2024-09-13T23:05:16.114369+0000","last_became_peered":"2024-09-13T23:05:16.114369+0000","last_unstale":"2024-09-13T23:08:57.227716+0000","last_undegraded":"2024-09-13T23:08:57.227716+0000","last_fullsized":"2024-09-13T23:08:57.227716+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:57.227595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:57.227595+0000","last_clean_scrub_stamp":"2024-09-13T23:08:57.227595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:37:59.143867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:45.676635+0000","last_change":"2024-09-13T23:08:45.676635+0000","last_active":"2024-09-13T23:08:45.676635+0000","last_peered":"2024-09-13T23:08:45.676635+0000","last_clean":"2024-09-13T23:08:45.676635+0000","last_became_active":"2024-09-13T23:05:18.126183+0000","last_became_peered":"2024-09-13T23:05:18.126183+0000","last_unstale":"2024-09-13T23:08:45.676635+0000","last_undegraded":"2024-09-13T23:08:45.676635+0000","last_fullsized":"2024-09-13T23:08:45.676635+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-13T23:08:45.676456+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-13T23:08:45.676456+0000","last_clean_scrub_stamp":"2024-09-13T23:08:45.676456+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:40.391001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":416,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:38.549085+0000","last_change":"2024-09-13T23:08:38.549085+0000","last_active":"2024-09-13T23:08:38.549085+0000","last_peered":"2024-09-13T23:08:38.549085+0000","last_clean":"2024-09-13T23:08:38.549085+0000","last_became_active":"2024-09-13T23:05:20.143659+0000","last_became_peered":"2024-09-13T23:05:20.143659+0000","last_unstale":"2024-09-13T23:08:38.549085+0000","last_undegraded":"2024-09-13T23:08:38.549085+0000","last_fullsized":"2024-09-13T23:08:38.549085+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:38.548964+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:38.548964+0000","last_clean_scrub_stamp":"2024-09-13T23:08:38.548964+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:04.032284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'13","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:29.307050+0000","last_change":"2024-09-13T23:09:29.307050+0000","last_active":"2024-09-13T23:09:29.307050+0000","last_peered":"2024-09-13T23:09:29.307050+0000","last_clean":"2024-09-13T23:09:29.307050+0000","last_became_active":"2024-09-13T23:05:22.140485+0000","last_became_peered":"2024-09-13T23:05:22.140485+0000","last_unstale":"2024-09-13T23:09:29.307050+0000","last_undegraded":"2024-09-13T23:09:29.307050+0000","last_fullsized":"2024-09-13T23:09:29.307050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'13","last_scrub_stamp":"2024-09-13T23:09:29.306883+0000","last_deep_scrub":"34'13","last_deep_scrub_stamp":"2024-09-13T23:09:29.306883+0000","last_clean_scrub_stamp":"2024-09-13T23:09:29.306883+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:05.267654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'18","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:10.779210+0000","last_change":"2024-09-13T23:09:10.779210+0000","last_active":"2024-09-13T23:09:10.779210+0000","last_peered":"2024-09-13T23:09:10.779210+0000","last_clean":"2024-09-13T23:09:10.779210+0000","last_became_active":"2024-09-13T23:05:14.115166+0000","last_became_peered":"2024-09-13T23:05:14.115166+0000","last_unstale":"2024-09-13T23:09:10.779210+0000","last_undegraded":"2024-09-13T23:09:10.779210+0000","last_fullsized":"2024-09-13T23:09:10.779210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-13T23:09:10.779044+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-13T23:09:10.779044+0000","last_clean_scrub_stamp":"2024-09-13T23:09:10.779044+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:03:39.986800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:37.529685+0000","last_change":"2024-09-13T23:09:37.529715+0000","last_active":"2024-09-13T23:09:37.529685+0000","last_peered":"2024-09-13T23:09:37.529685+0000","last_clean":"2024-09-13T23:09:37.529685+0000","last_became_active":"2024-09-13T23:05:12.139283+0000","last_became_peered":"2024-09-13T23:05:12.139283+0000","last_unstale":"2024-09-13T23:09:37.529685+0000","last_undegraded":"2024-09-13T23:09:37.529685+0000","last_fullsized":"2024-09-13T23:09:37.529685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:37.529578+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:37.529578+0000","last_clean_scrub_stamp":"2024-09-13T23:09:37.529578+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:10.479676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":440,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:50.100480+0000","last_change":"2024-09-13T23:08:50.100480+0000","last_active":"2024-09-13T23:08:50.100480+0000","last_peered":"2024-09-13T23:08:50.100480+0000","last_clean":"2024-09-13T23:08:50.100480+0000","last_became_active":"2024-09-13T23:05:49.164741+0000","last_became_peered":"2024-09-13T23:05:49.164741+0000","last_unstale":"2024-09-13T23:08:50.100480+0000","last_undegraded":"2024-09-13T23:08:50.100480+0000","last_fullsized":"2024-09-13T23:08:50.100480+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T23:08:50.100356+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T23:08:50.100356+0000","last_clean_scrub_stamp":"2024-09-13T23:08:50.100356+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:15:10.416249+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'16","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:58.338158+0000","last_change":"2024-09-13T23:08:58.338158+0000","last_active":"2024-09-13T23:08:58.338158+0000","last_peered":"2024-09-13T23:08:58.338158+0000","last_clean":"2024-09-13T23:08:58.338158+0000","last_became_active":"2024-09-13T23:05:18.135028+0000","last_became_peered":"2024-09-13T23:05:18.135028+0000","last_unstale":"2024-09-13T23:08:58.338158+0000","last_undegraded":"2024-09-13T23:08:58.338158+0000","last_fullsized":"2024-09-13T23:08:58.338158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:08:58.337970+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:08:58.337970+0000","last_clean_scrub_stamp":"2024-09-13T23:08:58.337970+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:47.871335+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":478,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:41.117670+0000","last_change":"2024-09-13T23:08:41.117670+0000","last_active":"2024-09-13T23:08:41.117670+0000","last_peered":"2024-09-13T23:08:41.117670+0000","last_clean":"2024-09-13T23:08:41.117670+0000","last_became_active":"2024-09-13T23:05:20.132891+0000","last_became_peered":"2024-09-13T23:05:20.132891+0000","last_unstale":"2024-09-13T23:08:41.117670+0000","last_undegraded":"2024-09-13T23:08:41.117670+0000","last_fullsized":"2024-09-13T23:08:41.117670+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:41.117524+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:41.117524+0000","last_clean_scrub_stamp":"2024-09-13T23:08:41.117524+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:31.490095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:21.754886+0000","last_change":"2024-09-13T23:09:21.754886+0000","last_active":"2024-09-13T23:09:21.754886+0000","last_peered":"2024-09-13T23:09:21.754886+0000","last_clean":"2024-09-13T23:09:21.754886+0000","last_became_active":"2024-09-13T23:05:22.150258+0000","last_became_peered":"2024-09-13T23:05:22.150258+0000","last_unstale":"2024-09-13T23:09:21.754886+0000","last_undegraded":"2024-09-13T23:09:21.754886+0000","last_fullsized":"2024-09-13T23:09:21.754886+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:21.754762+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:21.754762+0000","last_clean_scrub_stamp":"2024-09-13T23:09:21.754762+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:55.726221+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:51.145168+0000","last_change":"2024-09-13T23:08:51.145168+0000","last_active":"2024-09-13T23:08:51.145168+0000","last_peered":"2024-09-13T23:08:51.145168+0000","last_clean":"2024-09-13T23:08:51.145168+0000","last_became_active":"2024-09-13T23:05:14.125034+0000","last_became_peered":"2024-09-13T23:05:14.125034+0000","last_unstale":"2024-09-13T23:08:51.145168+0000","last_undegraded":"2024-09-13T23:08:51.145168+0000","last_fullsized":"2024-09-13T23:08:51.145168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:08:51.145025+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:08:51.145025+0000","last_clean_scrub_stamp":"2024-09-13T23:08:51.145025+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:58.481808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'3","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:26.326808+0000","last_change":"2024-09-13T23:09:26.326808+0000","last_active":"2024-09-13T23:09:26.326808+0000","last_peered":"2024-09-13T23:09:26.326808+0000","last_clean":"2024-09-13T23:09:26.326808+0000","last_became_active":"2024-09-13T23:05:12.142185+0000","last_became_peered":"2024-09-13T23:05:12.142185+0000","last_unstale":"2024-09-13T23:09:26.326808+0000","last_undegraded":"2024-09-13T23:09:26.326808+0000","last_fullsized":"2024-09-13T23:09:26.326808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T23:09:26.326631+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T23:09:26.326631+0000","last_clean_scrub_stamp":"2024-09-13T23:09:26.326631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:01.860014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.512256+0000","last_change":"2024-09-13T23:08:33.512256+0000","last_active":"2024-09-13T23:08:33.512256+0000","last_peered":"2024-09-13T23:08:33.512256+0000","last_clean":"2024-09-13T23:08:33.512256+0000","last_became_active":"2024-09-13T23:05:16.125013+0000","last_became_peered":"2024-09-13T23:05:16.125013+0000","last_unstale":"2024-09-13T23:08:33.512256+0000","last_undegraded":"2024-09-13T23:08:33.512256+0000","last_fullsized":"2024-09-13T23:08:33.512256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:33.512107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:33.512107+0000","last_clean_scrub_stamp":"2024-09-13T23:08:33.512107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:00.070785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'48","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:39.155672+0000","last_change":"2024-09-13T23:08:39.155672+0000","last_active":"2024-09-13T23:08:39.155672+0000","last_peered":"2024-09-13T23:08:39.155672+0000","last_clean":"2024-09-13T23:08:39.155672+0000","last_became_active":"2024-09-13T23:05:18.126271+0000","last_became_peered":"2024-09-13T23:05:18.126271+0000","last_unstale":"2024-09-13T23:08:39.155672+0000","last_undegraded":"2024-09-13T23:08:39.155672+0000","last_fullsized":"2024-09-13T23:08:39.155672+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-09-13T23:08:39.155548+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-09-13T23:08:39.155548+0000","last_clean_scrub_stamp":"2024-09-13T23:08:39.155548+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:48.512044+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:46.633049+0000","last_change":"2024-09-13T23:08:46.633049+0000","last_active":"2024-09-13T23:08:46.633049+0000","last_peered":"2024-09-13T23:08:46.633049+0000","last_clean":"2024-09-13T23:08:46.633049+0000","last_became_active":"2024-09-13T23:05:20.145626+0000","last_became_peered":"2024-09-13T23:05:20.145626+0000","last_unstale":"2024-09-13T23:08:46.633049+0000","last_undegraded":"2024-09-13T23:08:46.633049+0000","last_fullsized":"2024-09-13T23:08:46.633049+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:46.632934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:46.632934+0000","last_clean_scrub_stamp":"2024-09-13T23:08:46.632934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:54.822821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:01.125815+0000","last_change":"2024-09-13T23:09:01.125815+0000","last_active":"2024-09-13T23:09:01.125815+0000","last_peered":"2024-09-13T23:09:01.125815+0000","last_clean":"2024-09-13T23:09:01.125815+0000","last_became_active":"2024-09-13T23:05:22.137111+0000","last_became_peered":"2024-09-13T23:05:22.137111+0000","last_unstale":"2024-09-13T23:09:01.125815+0000","last_undegraded":"2024-09-13T23:09:01.125815+0000","last_fullsized":"2024-09-13T23:09:01.125815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-13T23:09:01.125676+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-13T23:09:01.125676+0000","last_clean_scrub_stamp":"2024-09-13T23:09:01.125676+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:57.040405+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'16","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:27.794975+0000","last_change":"2024-09-13T23:09:27.794975+0000","last_active":"2024-09-13T23:09:27.794975+0000","last_peered":"2024-09-13T23:09:27.794975+0000","last_clean":"2024-09-13T23:09:27.794975+0000","last_became_active":"2024-09-13T23:05:49.165166+0000","last_became_peered":"2024-09-13T23:05:49.165166+0000","last_unstale":"2024-09-13T23:09:27.794975+0000","last_undegraded":"2024-09-13T23:09:27.794975+0000","last_fullsized":"2024-09-13T23:09:27.794975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:09:27.794824+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:09:27.794824+0000","last_clean_scrub_stamp":"2024-09-13T23:09:27.794824+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:46.349957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":51,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"34'119","reported_seq":216,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:19.089115+0000","last_change":"2024-09-13T23:09:19.089153+0000","last_active":"2024-09-13T23:09:19.089115+0000","last_peered":"2024-09-13T23:09:19.089115+0000","last_clean":"2024-09-13T23:09:19.089115+0000","last_became_active":"2024-09-13T23:04:56.149747+0000","last_became_peered":"2024-09-13T23:04:56.149747+0000","last_unstale":"2024-09-13T23:09:19.089115+0000","last_undegraded":"2024-09-13T23:09:19.089115+0000","last_fullsized":"2024-09-13T23:09:19.089115+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'119","last_scrub_stamp":"2024-09-13T23:09:19.089028+0000","last_deep_scrub":"34'119","last_deep_scrub_stamp":"2024-09-13T23:09:19.089028+0000","last_clean_scrub_stamp":"2024-09-13T23:09:19.089028+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:19.626670+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:44.612195+0000","last_change":"2024-09-13T23:09:44.612239+0000","last_active":"2024-09-13T23:09:44.612195+0000","last_peered":"2024-09-13T23:09:44.612195+0000","last_clean":"2024-09-13T23:09:44.612195+0000","last_became_active":"2024-09-13T23:05:01.074608+0000","last_became_peered":"2024-09-13T23:05:01.074608+0000","last_unstale":"2024-09-13T23:09:44.612195+0000","last_undegraded":"2024-09-13T23:09:44.612195+0000","last_fullsized":"2024-09-13T23:09:44.612195+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:44.612085+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:44.612085+0000","last_clean_scrub_stamp":"2024-09-13T23:09:44.612085+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:12:31.077571+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00097176599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:32.402630+0000","last_change":"2024-09-13T23:09:32.402696+0000","last_active":"2024-09-13T23:09:32.402630+0000","last_peered":"2024-09-13T23:09:32.402630+0000","last_clean":"2024-09-13T23:09:32.402630+0000","last_became_active":"2024-09-13T23:05:12.146438+0000","last_became_peered":"2024-09-13T23:05:12.146438+0000","last_unstale":"2024-09-13T23:09:32.402630+0000","last_undegraded":"2024-09-13T23:09:32.402630+0000","last_fullsized":"2024-09-13T23:09:32.402630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:32.402510+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:32.402510+0000","last_clean_scrub_stamp":"2024-09-13T23:09:32.402510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:10:46.008459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:48.172057+0000","last_change":"2024-09-13T23:08:48.172057+0000","last_active":"2024-09-13T23:08:48.172057+0000","last_peered":"2024-09-13T23:08:48.172057+0000","last_clean":"2024-09-13T23:08:48.172057+0000","last_became_active":"2024-09-13T23:05:16.115599+0000","last_became_peered":"2024-09-13T23:05:16.115599+0000","last_unstale":"2024-09-13T23:08:48.172057+0000","last_undegraded":"2024-09-13T23:08:48.172057+0000","last_fullsized":"2024-09-13T23:08:48.172057+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:48.171913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:48.171913+0000","last_clean_scrub_stamp":"2024-09-13T23:08:48.171913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:18.538546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'90","reported_seq":181,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:59.300155+0000","last_change":"2024-09-13T23:08:59.300155+0000","last_active":"2024-09-13T23:08:59.300155+0000","last_peered":"2024-09-13T23:08:59.300155+0000","last_clean":"2024-09-13T23:08:59.300155+0000","last_became_active":"2024-09-13T23:05:18.135080+0000","last_became_peered":"2024-09-13T23:05:18.135080+0000","last_unstale":"2024-09-13T23:08:59.300155+0000","last_undegraded":"2024-09-13T23:08:59.300155+0000","last_fullsized":"2024-09-13T23:08:59.300155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'90","last_scrub_stamp":"2024-09-13T23:08:59.299983+0000","last_deep_scrub":"34'90","last_deep_scrub_stamp":"2024-09-13T23:08:59.299983+0000","last_clean_scrub_stamp":"2024-09-13T23:08:59.299983+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:55:55.335307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:38.028280+0000","last_change":"2024-09-13T23:08:38.028280+0000","last_active":"2024-09-13T23:08:38.028280+0000","last_peered":"2024-09-13T23:08:38.028280+0000","last_clean":"2024-09-13T23:08:38.028280+0000","last_became_active":"2024-09-13T23:05:20.139399+0000","last_became_peered":"2024-09-13T23:05:20.139399+0000","last_unstale":"2024-09-13T23:08:38.028280+0000","last_undegraded":"2024-09-13T23:08:38.028280+0000","last_fullsized":"2024-09-13T23:08:38.028280+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:38.028097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:38.028097+0000","last_clean_scrub_stamp":"2024-09-13T23:08:38.028097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:47.384593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'87","reported_seq":181,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:50.698944+0000","last_change":"2024-09-13T23:08:50.698944+0000","last_active":"2024-09-13T23:08:50.698944+0000","last_peered":"2024-09-13T23:08:50.698944+0000","last_clean":"2024-09-13T23:08:50.698944+0000","last_became_active":"2024-09-13T23:05:22.140430+0000","last_became_peered":"2024-09-13T23:05:22.140430+0000","last_unstale":"2024-09-13T23:08:50.698944+0000","last_undegraded":"2024-09-13T23:08:50.698944+0000","last_fullsized":"2024-09-13T23:08:50.698944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'87","last_scrub_stamp":"2024-09-13T23:08:50.698827+0000","last_deep_scrub":"34'87","last_deep_scrub_stamp":"2024-09-13T23:08:50.698827+0000","last_clean_scrub_stamp":"2024-09-13T23:08:50.698827+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:09.410253+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":226,"num_write":170,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:13.223224+0000","last_change":"2024-09-13T23:09:13.223224+0000","last_active":"2024-09-13T23:09:13.223224+0000","last_peered":"2024-09-13T23:09:13.223224+0000","last_clean":"2024-09-13T23:09:13.223224+0000","last_became_active":"2024-09-13T23:05:14.112711+0000","last_became_peered":"2024-09-13T23:05:14.112711+0000","last_unstale":"2024-09-13T23:09:13.223224+0000","last_undegraded":"2024-09-13T23:09:13.223224+0000","last_fullsized":"2024-09-13T23:09:13.223224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:13.223105+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:13.223105+0000","last_clean_scrub_stamp":"2024-09-13T23:09:13.223105+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:32.575985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:45.595478+0000","last_change":"2024-09-13T23:09:45.595503+0000","last_active":"2024-09-13T23:09:45.595478+0000","last_peered":"2024-09-13T23:09:45.595478+0000","last_clean":"2024-09-13T23:09:45.595478+0000","last_became_active":"2024-09-13T23:05:01.075438+0000","last_became_peered":"2024-09-13T23:05:01.075438+0000","last_unstale":"2024-09-13T23:09:45.595478+0000","last_undegraded":"2024-09-13T23:09:45.595478+0000","last_fullsized":"2024-09-13T23:09:45.595478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:45.595352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:45.595352+0000","last_clean_scrub_stamp":"2024-09-13T23:09:45.595352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:12:02.671871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043480299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:24.381895+0000","last_change":"2024-09-13T23:09:24.381922+0000","last_active":"2024-09-13T23:09:24.381895+0000","last_peered":"2024-09-13T23:09:24.381895+0000","last_clean":"2024-09-13T23:09:24.381895+0000","last_became_active":"2024-09-13T23:05:12.114087+0000","last_became_peered":"2024-09-13T23:05:12.114087+0000","last_unstale":"2024-09-13T23:09:24.381895+0000","last_undegraded":"2024-09-13T23:09:24.381895+0000","last_fullsized":"2024-09-13T23:09:24.381895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:24.381778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:24.381778+0000","last_clean_scrub_stamp":"2024-09-13T23:09:24.381778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:16:36.593180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:36.535799+0000","last_change":"2024-09-13T23:08:36.535799+0000","last_active":"2024-09-13T23:08:36.535799+0000","last_peered":"2024-09-13T23:08:36.535799+0000","last_clean":"2024-09-13T23:08:36.535799+0000","last_became_active":"2024-09-13T23:05:16.127404+0000","last_became_peered":"2024-09-13T23:05:16.127404+0000","last_unstale":"2024-09-13T23:08:36.535799+0000","last_undegraded":"2024-09-13T23:08:36.535799+0000","last_fullsized":"2024-09-13T23:08:36.535799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:36.535683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:36.535683+0000","last_clean_scrub_stamp":"2024-09-13T23:08:36.535683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:53.587715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'291","reported_seq":517,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.140621+0000","last_change":"2024-09-13T23:08:33.140621+0000","last_active":"2024-09-13T23:08:33.140621+0000","last_peered":"2024-09-13T23:08:33.140621+0000","last_clean":"2024-09-13T23:08:33.140621+0000","last_became_active":"2024-09-13T23:05:18.135536+0000","last_became_peered":"2024-09-13T23:05:18.135536+0000","last_unstale":"2024-09-13T23:08:33.140621+0000","last_undegraded":"2024-09-13T23:08:33.140621+0000","last_fullsized":"2024-09-13T23:08:33.140621+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'291","last_scrub_stamp":"2024-09-13T23:08:33.140485+0000","last_deep_scrub":"34'291","last_deep_scrub_stamp":"2024-09-13T23:08:33.140485+0000","last_clean_scrub_stamp":"2024-09-13T23:08:33.140485+0000","objects_scrubbed":10,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:37:26.815426+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:54.455735+0000","last_change":"2024-09-13T23:08:54.455735+0000","last_active":"2024-09-13T23:08:54.455735+0000","last_peered":"2024-09-13T23:08:54.455735+0000","last_clean":"2024-09-13T23:08:54.455735+0000","last_became_active":"2024-09-13T23:05:20.138840+0000","last_became_peered":"2024-09-13T23:05:20.138840+0000","last_unstale":"2024-09-13T23:08:54.455735+0000","last_undegraded":"2024-09-13T23:08:54.455735+0000","last_fullsized":"2024-09-13T23:08:54.455735+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:54.455627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:54.455627+0000","last_clean_scrub_stamp":"2024-09-13T23:08:54.455627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:31:31.023076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'5","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:32.247198+0000","last_change":"2024-09-13T23:09:32.247198+0000","last_active":"2024-09-13T23:09:32.247198+0000","last_peered":"2024-09-13T23:09:32.247198+0000","last_clean":"2024-09-13T23:09:32.247198+0000","last_became_active":"2024-09-13T23:05:22.149430+0000","last_became_peered":"2024-09-13T23:05:22.149430+0000","last_unstale":"2024-09-13T23:09:32.247198+0000","last_undegraded":"2024-09-13T23:09:32.247198+0000","last_fullsized":"2024-09-13T23:09:32.247198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T23:09:32.247041+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T23:09:32.247041+0000","last_clean_scrub_stamp":"2024-09-13T23:09:32.247041+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:21.959299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:01.252393+0000","last_change":"2024-09-13T23:09:01.252393+0000","last_active":"2024-09-13T23:09:01.252393+0000","last_peered":"2024-09-13T23:09:01.252393+0000","last_clean":"2024-09-13T23:09:01.252393+0000","last_became_active":"2024-09-13T23:05:14.121629+0000","last_became_peered":"2024-09-13T23:05:14.121629+0000","last_unstale":"2024-09-13T23:09:01.252393+0000","last_undegraded":"2024-09-13T23:09:01.252393+0000","last_fullsized":"2024-09-13T23:09:01.252393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:01.252231+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:01.252231+0000","last_clean_scrub_stamp":"2024-09-13T23:09:01.252231+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:41.769830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:12.723915+0000","last_change":"2024-09-13T23:09:12.723941+0000","last_active":"2024-09-13T23:09:12.723915+0000","last_peered":"2024-09-13T23:09:12.723915+0000","last_clean":"2024-09-13T23:09:12.723915+0000","last_became_active":"2024-09-13T23:05:01.075422+0000","last_became_peered":"2024-09-13T23:05:01.075422+0000","last_unstale":"2024-09-13T23:09:12.723915+0000","last_undegraded":"2024-09-13T23:09:12.723915+0000","last_fullsized":"2024-09-13T23:09:12.723915+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:12.723822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:12.723822+0000","last_clean_scrub_stamp":"2024-09-13T23:09:12.723822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:56.432213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049267099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:26.348988+0000","last_change":"2024-09-13T23:09:26.349035+0000","last_active":"2024-09-13T23:09:26.348988+0000","last_peered":"2024-09-13T23:09:26.348988+0000","last_clean":"2024-09-13T23:09:26.348988+0000","last_became_active":"2024-09-13T23:05:12.117940+0000","last_became_peered":"2024-09-13T23:05:12.117940+0000","last_unstale":"2024-09-13T23:09:26.348988+0000","last_undegraded":"2024-09-13T23:09:26.348988+0000","last_fullsized":"2024-09-13T23:09:26.348988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T23:09:26.348876+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T23:09:26.348876+0000","last_clean_scrub_stamp":"2024-09-13T23:09:26.348876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:19.985644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:52.616505+0000","last_change":"2024-09-13T23:08:52.616505+0000","last_active":"2024-09-13T23:08:52.616505+0000","last_peered":"2024-09-13T23:08:52.616505+0000","last_clean":"2024-09-13T23:08:52.616505+0000","last_became_active":"2024-09-13T23:05:16.122318+0000","last_became_peered":"2024-09-13T23:05:16.122318+0000","last_unstale":"2024-09-13T23:08:52.616505+0000","last_undegraded":"2024-09-13T23:08:52.616505+0000","last_fullsized":"2024-09-13T23:08:52.616505+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:08:52.616388+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:08:52.616388+0000","last_clean_scrub_stamp":"2024-09-13T23:08:52.616388+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:55:21.961122+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'23","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:43.618923+0000","last_change":"2024-09-13T23:08:43.618923+0000","last_active":"2024-09-13T23:08:43.618923+0000","last_peered":"2024-09-13T23:08:43.618923+0000","last_clean":"2024-09-13T23:08:43.618923+0000","last_became_active":"2024-09-13T23:05:18.127698+0000","last_became_peered":"2024-09-13T23:05:18.127698+0000","last_unstale":"2024-09-13T23:08:43.618923+0000","last_undegraded":"2024-09-13T23:08:43.618923+0000","last_fullsized":"2024-09-13T23:08:43.618923+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-09-13T23:08:43.618795+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-09-13T23:08:43.618795+0000","last_clean_scrub_stamp":"2024-09-13T23:08:43.618795+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:08.067385+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:54.192277+0000","last_change":"2024-09-13T23:08:54.192277+0000","last_active":"2024-09-13T23:08:54.192277+0000","last_peered":"2024-09-13T23:08:54.192277+0000","last_clean":"2024-09-13T23:08:54.192277+0000","last_became_active":"2024-09-13T23:05:20.145330+0000","last_became_peered":"2024-09-13T23:05:20.145330+0000","last_unstale":"2024-09-13T23:08:54.192277+0000","last_undegraded":"2024-09-13T23:08:54.192277+0000","last_fullsized":"2024-09-13T23:08:54.192277+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:54.192167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:54.192167+0000","last_clean_scrub_stamp":"2024-09-13T23:08:54.192167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:57.546243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:16.209490+0000","last_change":"2024-09-13T23:09:16.209490+0000","last_active":"2024-09-13T23:09:16.209490+0000","last_peered":"2024-09-13T23:09:16.209490+0000","last_clean":"2024-09-13T23:09:16.209490+0000","last_became_active":"2024-09-13T23:05:22.138259+0000","last_became_peered":"2024-09-13T23:05:22.138259+0000","last_unstale":"2024-09-13T23:09:16.209490+0000","last_undegraded":"2024-09-13T23:09:16.209490+0000","last_fullsized":"2024-09-13T23:09:16.209490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T23:09:16.209368+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T23:09:16.209368+0000","last_clean_scrub_stamp":"2024-09-13T23:09:16.209368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:00.653752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'6","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:06.214718+0000","last_change":"2024-09-13T23:09:06.214718+0000","last_active":"2024-09-13T23:09:06.214718+0000","last_peered":"2024-09-13T23:09:06.214718+0000","last_clean":"2024-09-13T23:09:06.214718+0000","last_became_active":"2024-09-13T23:05:14.110532+0000","last_became_peered":"2024-09-13T23:05:14.110532+0000","last_unstale":"2024-09-13T23:09:06.214718+0000","last_undegraded":"2024-09-13T23:09:06.214718+0000","last_fullsized":"2024-09-13T23:09:06.214718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:06.214603+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:06.214603+0000","last_clean_scrub_stamp":"2024-09-13T23:09:06.214603+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:32.509898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:43.564156+0000","last_change":"2024-09-13T23:09:43.564204+0000","last_active":"2024-09-13T23:09:43.564156+0000","last_peered":"2024-09-13T23:09:43.564156+0000","last_clean":"2024-09-13T23:09:43.564156+0000","last_became_active":"2024-09-13T23:05:01.075399+0000","last_became_peered":"2024-09-13T23:05:01.075399+0000","last_unstale":"2024-09-13T23:09:43.564156+0000","last_undegraded":"2024-09-13T23:09:43.564156+0000","last_fullsized":"2024-09-13T23:09:43.564156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T23:09:43.564048+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T23:09:43.564048+0000","last_clean_scrub_stamp":"2024-09-13T23:09:43.564048+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:01.530394+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0010379530000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:03.637970+0000","last_change":"2024-09-13T23:09:03.637970+0000","last_active":"2024-09-13T23:09:03.637970+0000","last_peered":"2024-09-13T23:09:03.637970+0000","last_clean":"2024-09-13T23:09:03.637970+0000","last_became_active":"2024-09-13T23:05:12.130410+0000","last_became_peered":"2024-09-13T23:05:12.130410+0000","last_unstale":"2024-09-13T23:09:03.637970+0000","last_undegraded":"2024-09-13T23:09:03.637970+0000","last_fullsized":"2024-09-13T23:09:03.637970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:03.637848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:03.637848+0000","last_clean_scrub_stamp":"2024-09-13T23:09:03.637848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:25.877408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:49.163497+0000","last_change":"2024-09-13T23:08:49.163497+0000","last_active":"2024-09-13T23:08:49.163497+0000","last_peered":"2024-09-13T23:08:49.163497+0000","last_clean":"2024-09-13T23:08:49.163497+0000","last_became_active":"2024-09-13T23:05:16.123983+0000","last_became_peered":"2024-09-13T23:05:16.123983+0000","last_unstale":"2024-09-13T23:08:49.163497+0000","last_undegraded":"2024-09-13T23:08:49.163497+0000","last_fullsized":"2024-09-13T23:08:49.163497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:49.163347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:49.163347+0000","last_clean_scrub_stamp":"2024-09-13T23:08:49.163347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:37:31.793295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:52.437554+0000","last_change":"2024-09-13T23:08:52.437554+0000","last_active":"2024-09-13T23:08:52.437554+0000","last_peered":"2024-09-13T23:08:52.437554+0000","last_clean":"2024-09-13T23:08:52.437554+0000","last_became_active":"2024-09-13T23:05:18.133165+0000","last_became_peered":"2024-09-13T23:05:18.133165+0000","last_unstale":"2024-09-13T23:08:52.437554+0000","last_undegraded":"2024-09-13T23:08:52.437554+0000","last_fullsized":"2024-09-13T23:08:52.437554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-13T23:08:52.437407+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-13T23:08:52.437407+0000","last_clean_scrub_stamp":"2024-09-13T23:08:52.437407+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:53:28.383722+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:12.267243+0000","last_change":"2024-09-13T23:09:12.267243+0000","last_active":"2024-09-13T23:09:12.267243+0000","last_peered":"2024-09-13T23:09:12.267243+0000","last_clean":"2024-09-13T23:09:12.267243+0000","last_became_active":"2024-09-13T23:05:20.143748+0000","last_became_peered":"2024-09-13T23:05:20.143748+0000","last_unstale":"2024-09-13T23:09:12.267243+0000","last_undegraded":"2024-09-13T23:09:12.267243+0000","last_fullsized":"2024-09-13T23:09:12.267243+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:12.267122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:12.267122+0000","last_clean_scrub_stamp":"2024-09-13T23:09:12.267122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:08:33.359140+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:34.229514+0000","last_change":"2024-09-13T23:09:34.229514+0000","last_active":"2024-09-13T23:09:34.229514+0000","last_peered":"2024-09-13T23:09:34.229514+0000","last_clean":"2024-09-13T23:09:34.229514+0000","last_became_active":"2024-09-13T23:05:22.150415+0000","last_became_peered":"2024-09-13T23:05:22.150415+0000","last_unstale":"2024-09-13T23:09:34.229514+0000","last_undegraded":"2024-09-13T23:09:34.229514+0000","last_fullsized":"2024-09-13T23:09:34.229514+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:34.229391+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:34.229391+0000","last_clean_scrub_stamp":"2024-09-13T23:09:34.229391+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:31:30.252334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:15.113820+0000","last_change":"2024-09-13T23:09:15.113820+0000","last_active":"2024-09-13T23:09:15.113820+0000","last_peered":"2024-09-13T23:09:15.113820+0000","last_clean":"2024-09-13T23:09:15.113820+0000","last_became_active":"2024-09-13T23:05:14.123447+0000","last_became_peered":"2024-09-13T23:05:14.123447+0000","last_unstale":"2024-09-13T23:09:15.113820+0000","last_undegraded":"2024-09-13T23:09:15.113820+0000","last_fullsized":"2024-09-13T23:09:15.113820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:15.113706+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:15.113706+0000","last_clean_scrub_stamp":"2024-09-13T23:09:15.113706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:13.411504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:19.753286+0000","last_change":"2024-09-13T23:09:19.753286+0000","last_active":"2024-09-13T23:09:19.753286+0000","last_peered":"2024-09-13T23:09:19.753286+0000","last_clean":"2024-09-13T23:09:19.753286+0000","last_became_active":"2024-09-13T23:05:12.124005+0000","last_became_peered":"2024-09-13T23:05:12.124005+0000","last_unstale":"2024-09-13T23:09:19.753286+0000","last_undegraded":"2024-09-13T23:09:19.753286+0000","last_fullsized":"2024-09-13T23:09:19.753286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:19.753136+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:19.753136+0000","last_clean_scrub_stamp":"2024-09-13T23:09:19.753136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:12.048042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:20.345527+0000","last_change":"2024-09-13T23:09:20.345552+0000","last_active":"2024-09-13T23:09:20.345527+0000","last_peered":"2024-09-13T23:09:20.345527+0000","last_clean":"2024-09-13T23:09:20.345527+0000","last_became_active":"2024-09-13T23:05:01.074963+0000","last_became_peered":"2024-09-13T23:05:01.074963+0000","last_unstale":"2024-09-13T23:09:20.345527+0000","last_undegraded":"2024-09-13T23:09:20.345527+0000","last_fullsized":"2024-09-13T23:09:20.345527+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:20.345432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:20.345432+0000","last_clean_scrub_stamp":"2024-09-13T23:09:20.345432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:43.886868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055235699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:51.145619+0000","last_change":"2024-09-13T23:08:51.145619+0000","last_active":"2024-09-13T23:08:51.145619+0000","last_peered":"2024-09-13T23:08:51.145619+0000","last_clean":"2024-09-13T23:08:51.145619+0000","last_became_active":"2024-09-13T23:05:16.123971+0000","last_became_peered":"2024-09-13T23:05:16.123971+0000","last_unstale":"2024-09-13T23:08:51.145619+0000","last_undegraded":"2024-09-13T23:08:51.145619+0000","last_fullsized":"2024-09-13T23:08:51.145619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'1","last_scrub_stamp":"2024-09-13T23:08:51.145496+0000","last_deep_scrub":"34'1","last_deep_scrub_stamp":"2024-09-13T23:08:51.145496+0000","last_clean_scrub_stamp":"2024-09-13T23:08:51.145496+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:32.511958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'73","reported_seq":150,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:43.048564+0000","last_change":"2024-09-13T23:08:43.048564+0000","last_active":"2024-09-13T23:08:43.048564+0000","last_peered":"2024-09-13T23:08:43.048564+0000","last_clean":"2024-09-13T23:08:43.048564+0000","last_became_active":"2024-09-13T23:05:18.132051+0000","last_became_peered":"2024-09-13T23:05:18.132051+0000","last_unstale":"2024-09-13T23:08:43.048564+0000","last_undegraded":"2024-09-13T23:08:43.048564+0000","last_fullsized":"2024-09-13T23:08:43.048564+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'73","last_scrub_stamp":"2024-09-13T23:08:43.048427+0000","last_deep_scrub":"34'73","last_deep_scrub_stamp":"2024-09-13T23:08:43.048427+0000","last_clean_scrub_stamp":"2024-09-13T23:08:43.048427+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:30.653285+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:34.656091+0000","last_change":"2024-09-13T23:08:34.656091+0000","last_active":"2024-09-13T23:08:34.656091+0000","last_peered":"2024-09-13T23:08:34.656091+0000","last_clean":"2024-09-13T23:08:34.656091+0000","last_became_active":"2024-09-13T23:05:20.143566+0000","last_became_peered":"2024-09-13T23:05:20.143566+0000","last_unstale":"2024-09-13T23:08:34.656091+0000","last_undegraded":"2024-09-13T23:08:34.656091+0000","last_fullsized":"2024-09-13T23:08:34.656091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:34.655943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:34.655943+0000","last_clean_scrub_stamp":"2024-09-13T23:08:34.655943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:57.192299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'12","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:02.264138+0000","last_change":"2024-09-13T23:09:02.264138+0000","last_active":"2024-09-13T23:09:02.264138+0000","last_peered":"2024-09-13T23:09:02.264138+0000","last_clean":"2024-09-13T23:09:02.264138+0000","last_became_active":"2024-09-13T23:05:22.137952+0000","last_became_peered":"2024-09-13T23:05:22.137952+0000","last_unstale":"2024-09-13T23:09:02.264138+0000","last_undegraded":"2024-09-13T23:09:02.264138+0000","last_fullsized":"2024-09-13T23:09:02.264138+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T23:09:02.264003+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T23:09:02.264003+0000","last_clean_scrub_stamp":"2024-09-13T23:09:02.264003+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:12.926079+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:58.060890+0000","last_change":"2024-09-13T23:08:58.060890+0000","last_active":"2024-09-13T23:08:58.060890+0000","last_peered":"2024-09-13T23:08:58.060890+0000","last_clean":"2024-09-13T23:08:58.060890+0000","last_became_active":"2024-09-13T23:05:14.123549+0000","last_became_peered":"2024-09-13T23:05:14.123549+0000","last_unstale":"2024-09-13T23:08:58.060890+0000","last_undegraded":"2024-09-13T23:08:58.060890+0000","last_fullsized":"2024-09-13T23:08:58.060890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:08:58.060770+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:08:58.060770+0000","last_clean_scrub_stamp":"2024-09-13T23:08:58.060770+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:37:59.977042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:05.222854+0000","last_change":"2024-09-13T23:09:05.222854+0000","last_active":"2024-09-13T23:09:05.222854+0000","last_peered":"2024-09-13T23:09:05.222854+0000","last_clean":"2024-09-13T23:09:05.222854+0000","last_became_active":"2024-09-13T23:05:12.130285+0000","last_became_peered":"2024-09-13T23:05:12.130285+0000","last_unstale":"2024-09-13T23:09:05.222854+0000","last_undegraded":"2024-09-13T23:09:05.222854+0000","last_fullsized":"2024-09-13T23:09:05.222854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:05.222712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:05.222712+0000","last_clean_scrub_stamp":"2024-09-13T23:09:05.222712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:59.676566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:42.568400+0000","last_change":"2024-09-13T23:09:42.568440+0000","last_active":"2024-09-13T23:09:42.568400+0000","last_peered":"2024-09-13T23:09:42.568400+0000","last_clean":"2024-09-13T23:09:42.568400+0000","last_became_active":"2024-09-13T23:05:01.075431+0000","last_became_peered":"2024-09-13T23:05:01.075431+0000","last_unstale":"2024-09-13T23:09:42.568400+0000","last_undegraded":"2024-09-13T23:09:42.568400+0000","last_fullsized":"2024-09-13T23:09:42.568400+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:42.568265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:42.568265+0000","last_clean_scrub_stamp":"2024-09-13T23:09:42.568265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:31.795843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041474900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:43.475069+0000","last_change":"2024-09-13T23:08:43.475069+0000","last_active":"2024-09-13T23:08:43.475069+0000","last_peered":"2024-09-13T23:08:43.475069+0000","last_clean":"2024-09-13T23:08:43.475069+0000","last_became_active":"2024-09-13T23:05:16.120337+0000","last_became_peered":"2024-09-13T23:05:16.120337+0000","last_unstale":"2024-09-13T23:08:43.475069+0000","last_undegraded":"2024-09-13T23:08:43.475069+0000","last_fullsized":"2024-09-13T23:08:43.475069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:43.474930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:43.474930+0000","last_clean_scrub_stamp":"2024-09-13T23:08:43.474930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:26.685113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'23","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:34.131801+0000","last_change":"2024-09-13T23:08:34.131801+0000","last_active":"2024-09-13T23:08:34.131801+0000","last_peered":"2024-09-13T23:08:34.131801+0000","last_clean":"2024-09-13T23:08:34.131801+0000","last_became_active":"2024-09-13T23:05:18.133676+0000","last_became_peered":"2024-09-13T23:05:18.133676+0000","last_unstale":"2024-09-13T23:08:34.131801+0000","last_undegraded":"2024-09-13T23:08:34.131801+0000","last_fullsized":"2024-09-13T23:08:34.131801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-09-13T23:08:34.131649+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-09-13T23:08:34.131649+0000","last_clean_scrub_stamp":"2024-09-13T23:08:34.131649+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:29.113824+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":368,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:45.156231+0000","last_change":"2024-09-13T23:08:45.156231+0000","last_active":"2024-09-13T23:08:45.156231+0000","last_peered":"2024-09-13T23:08:45.156231+0000","last_clean":"2024-09-13T23:08:45.156231+0000","last_became_active":"2024-09-13T23:05:20.133332+0000","last_became_peered":"2024-09-13T23:05:20.133332+0000","last_unstale":"2024-09-13T23:08:45.156231+0000","last_undegraded":"2024-09-13T23:08:45.156231+0000","last_fullsized":"2024-09-13T23:08:45.156231+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:45.156073+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:45.156073+0000","last_clean_scrub_stamp":"2024-09-13T23:08:45.156073+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:16:24.872283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:24.293596+0000","last_change":"2024-09-13T23:09:24.293596+0000","last_active":"2024-09-13T23:09:24.293596+0000","last_peered":"2024-09-13T23:09:24.293596+0000","last_clean":"2024-09-13T23:09:24.293596+0000","last_became_active":"2024-09-13T23:05:22.141618+0000","last_became_peered":"2024-09-13T23:05:22.141618+0000","last_unstale":"2024-09-13T23:09:24.293596+0000","last_undegraded":"2024-09-13T23:09:24.293596+0000","last_fullsized":"2024-09-13T23:09:24.293596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T23:09:24.293416+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T23:09:24.293416+0000","last_clean_scrub_stamp":"2024-09-13T23:09:24.293416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:41:09.258166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'18","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:49.406065+0000","last_change":"2024-09-13T23:08:49.406065+0000","last_active":"2024-09-13T23:08:49.406065+0000","last_peered":"2024-09-13T23:08:49.406065+0000","last_clean":"2024-09-13T23:08:49.406065+0000","last_became_active":"2024-09-13T23:05:14.126280+0000","last_became_peered":"2024-09-13T23:05:14.126280+0000","last_unstale":"2024-09-13T23:08:49.406065+0000","last_undegraded":"2024-09-13T23:08:49.406065+0000","last_fullsized":"2024-09-13T23:08:49.406065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-13T23:08:49.405905+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-13T23:08:49.405905+0000","last_clean_scrub_stamp":"2024-09-13T23:08:49.405905+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:10.813213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:23.257282+0000","last_change":"2024-09-13T23:09:23.257282+0000","last_active":"2024-09-13T23:09:23.257282+0000","last_peered":"2024-09-13T23:09:23.257282+0000","last_clean":"2024-09-13T23:09:23.257282+0000","last_became_active":"2024-09-13T23:05:12.149435+0000","last_became_peered":"2024-09-13T23:05:12.149435+0000","last_unstale":"2024-09-13T23:09:23.257282+0000","last_undegraded":"2024-09-13T23:09:23.257282+0000","last_fullsized":"2024-09-13T23:09:23.257282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:23.257153+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:23.257153+0000","last_clean_scrub_stamp":"2024-09-13T23:09:23.257153+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:07:06.968192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:21.344821+0000","last_change":"2024-09-13T23:09:21.344821+0000","last_active":"2024-09-13T23:09:21.344821+0000","last_peered":"2024-09-13T23:09:21.344821+0000","last_clean":"2024-09-13T23:09:21.344821+0000","last_became_active":"2024-09-13T23:05:01.074982+0000","last_became_peered":"2024-09-13T23:05:01.074982+0000","last_unstale":"2024-09-13T23:09:21.344821+0000","last_undegraded":"2024-09-13T23:09:21.344821+0000","last_fullsized":"2024-09-13T23:09:21.344821+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:21.344698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:21.344698+0000","last_clean_scrub_stamp":"2024-09-13T23:09:21.344698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:56.827745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054650599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:35.535037+0000","last_change":"2024-09-13T23:08:35.535037+0000","last_active":"2024-09-13T23:08:35.535037+0000","last_peered":"2024-09-13T23:08:35.535037+0000","last_clean":"2024-09-13T23:08:35.535037+0000","last_became_active":"2024-09-13T23:05:16.123573+0000","last_became_peered":"2024-09-13T23:05:16.123573+0000","last_unstale":"2024-09-13T23:08:35.535037+0000","last_undegraded":"2024-09-13T23:08:35.535037+0000","last_fullsized":"2024-09-13T23:08:35.535037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:35.534875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:35.534875+0000","last_clean_scrub_stamp":"2024-09-13T23:08:35.534875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:03:04.742631+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:05.270708+0000","last_change":"2024-09-13T23:09:05.270708+0000","last_active":"2024-09-13T23:09:05.270708+0000","last_peered":"2024-09-13T23:09:05.270708+0000","last_clean":"2024-09-13T23:09:05.270708+0000","last_became_active":"2024-09-13T23:05:18.132140+0000","last_became_peered":"2024-09-13T23:05:18.132140+0000","last_unstale":"2024-09-13T23:09:05.270708+0000","last_undegraded":"2024-09-13T23:09:05.270708+0000","last_fullsized":"2024-09-13T23:09:05.270708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:09:05.270587+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:09:05.270587+0000","last_clean_scrub_stamp":"2024-09-13T23:09:05.270587+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:38.747157+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":442,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:34.964488+0000","last_change":"2024-09-13T23:08:34.964488+0000","last_active":"2024-09-13T23:08:34.964488+0000","last_peered":"2024-09-13T23:08:34.964488+0000","last_clean":"2024-09-13T23:08:34.964488+0000","last_became_active":"2024-09-13T23:05:20.136036+0000","last_became_peered":"2024-09-13T23:05:20.136036+0000","last_unstale":"2024-09-13T23:08:34.964488+0000","last_undegraded":"2024-09-13T23:08:34.964488+0000","last_fullsized":"2024-09-13T23:08:34.964488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:34.964357+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:34.964357+0000","last_clean_scrub_stamp":"2024-09-13T23:08:34.964357+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:48:39.411891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:28.132177+0000","last_change":"2024-09-13T23:09:28.132177+0000","last_active":"2024-09-13T23:09:28.132177+0000","last_peered":"2024-09-13T23:09:28.132177+0000","last_clean":"2024-09-13T23:09:28.132177+0000","last_became_active":"2024-09-13T23:05:22.144787+0000","last_became_peered":"2024-09-13T23:05:22.144787+0000","last_unstale":"2024-09-13T23:09:28.132177+0000","last_undegraded":"2024-09-13T23:09:28.132177+0000","last_fullsized":"2024-09-13T23:09:28.132177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-13T23:09:28.132051+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-13T23:09:28.132051+0000","last_clean_scrub_stamp":"2024-09-13T23:09:28.132051+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:55.955992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:00.592608+0000","last_change":"2024-09-13T23:09:00.592608+0000","last_active":"2024-09-13T23:09:00.592608+0000","last_peered":"2024-09-13T23:09:00.592608+0000","last_clean":"2024-09-13T23:09:00.592608+0000","last_became_active":"2024-09-13T23:05:14.112565+0000","last_became_peered":"2024-09-13T23:05:14.112565+0000","last_unstale":"2024-09-13T23:09:00.592608+0000","last_undegraded":"2024-09-13T23:09:00.592608+0000","last_fullsized":"2024-09-13T23:09:00.592608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:09:00.592449+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:09:00.592449+0000","last_clean_scrub_stamp":"2024-09-13T23:09:00.592449+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:17.593917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:21.106351+0000","last_change":"2024-09-13T23:09:21.106351+0000","last_active":"2024-09-13T23:09:21.106351+0000","last_peered":"2024-09-13T23:09:21.106351+0000","last_clean":"2024-09-13T23:09:21.106351+0000","last_became_active":"2024-09-13T23:05:12.131413+0000","last_became_peered":"2024-09-13T23:05:12.131413+0000","last_unstale":"2024-09-13T23:09:21.106351+0000","last_undegraded":"2024-09-13T23:09:21.106351+0000","last_fullsized":"2024-09-13T23:09:21.106351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:21.106185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:21.106185+0000","last_clean_scrub_stamp":"2024-09-13T23:09:21.106185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:06.617902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:46.547784+0000","last_change":"2024-09-13T23:09:46.547809+0000","last_active":"2024-09-13T23:09:46.547784+0000","last_peered":"2024-09-13T23:09:46.547784+0000","last_clean":"2024-09-13T23:09:46.547784+0000","last_became_active":"2024-09-13T23:05:01.323761+0000","last_became_peered":"2024-09-13T23:05:01.323761+0000","last_unstale":"2024-09-13T23:09:46.547784+0000","last_undegraded":"2024-09-13T23:09:46.547784+0000","last_fullsized":"2024-09-13T23:09:46.547784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:46.547688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:46.547688+0000","last_clean_scrub_stamp":"2024-09-13T23:09:46.547688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:12.712112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001181893,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:42.524284+0000","last_change":"2024-09-13T23:08:42.524284+0000","last_active":"2024-09-13T23:08:42.524284+0000","last_peered":"2024-09-13T23:08:42.524284+0000","last_clean":"2024-09-13T23:08:42.524284+0000","last_became_active":"2024-09-13T23:05:16.120974+0000","last_became_peered":"2024-09-13T23:05:16.120974+0000","last_unstale":"2024-09-13T23:08:42.524284+0000","last_undegraded":"2024-09-13T23:08:42.524284+0000","last_fullsized":"2024-09-13T23:08:42.524284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:42.524136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:42.524136+0000","last_clean_scrub_stamp":"2024-09-13T23:08:42.524136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:38.191251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'96","reported_seq":190,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:37.565659+0000","last_change":"2024-09-13T23:08:37.565659+0000","last_active":"2024-09-13T23:08:37.565659+0000","last_peered":"2024-09-13T23:08:37.565659+0000","last_clean":"2024-09-13T23:08:37.565659+0000","last_became_active":"2024-09-13T23:05:18.137925+0000","last_became_peered":"2024-09-13T23:05:18.137925+0000","last_unstale":"2024-09-13T23:08:37.565659+0000","last_undegraded":"2024-09-13T23:08:37.565659+0000","last_fullsized":"2024-09-13T23:08:37.565659+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'96","last_scrub_stamp":"2024-09-13T23:08:37.565507+0000","last_deep_scrub":"34'96","last_deep_scrub_stamp":"2024-09-13T23:08:37.565507+0000","last_clean_scrub_stamp":"2024-09-13T23:08:37.565507+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:03:42.806653+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:39.048948+0000","last_change":"2024-09-13T23:08:39.048948+0000","last_active":"2024-09-13T23:08:39.048948+0000","last_peered":"2024-09-13T23:08:39.048948+0000","last_clean":"2024-09-13T23:08:39.048948+0000","last_became_active":"2024-09-13T23:05:20.129363+0000","last_became_peered":"2024-09-13T23:05:20.129363+0000","last_unstale":"2024-09-13T23:08:39.048948+0000","last_undegraded":"2024-09-13T23:08:39.048948+0000","last_fullsized":"2024-09-13T23:08:39.048948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:39.048809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:39.048809+0000","last_clean_scrub_stamp":"2024-09-13T23:08:39.048809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:47.267359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:22.774774+0000","last_change":"2024-09-13T23:09:22.774774+0000","last_active":"2024-09-13T23:09:22.774774+0000","last_peered":"2024-09-13T23:09:22.774774+0000","last_clean":"2024-09-13T23:09:22.774774+0000","last_became_active":"2024-09-13T23:05:22.149645+0000","last_became_peered":"2024-09-13T23:05:22.149645+0000","last_unstale":"2024-09-13T23:09:22.774774+0000","last_undegraded":"2024-09-13T23:09:22.774774+0000","last_fullsized":"2024-09-13T23:09:22.774774+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:22.774657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:22.774657+0000","last_clean_scrub_stamp":"2024-09-13T23:09:22.774657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:18:05.391238+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:24.773325+0000","last_change":"2024-09-13T23:09:24.773325+0000","last_active":"2024-09-13T23:09:24.773325+0000","last_peered":"2024-09-13T23:09:24.773325+0000","last_clean":"2024-09-13T23:09:24.773325+0000","last_became_active":"2024-09-13T23:05:22.151640+0000","last_became_peered":"2024-09-13T23:05:22.151640+0000","last_unstale":"2024-09-13T23:09:24.773325+0000","last_undegraded":"2024-09-13T23:09:24.773325+0000","last_fullsized":"2024-09-13T23:09:24.773325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:24.773213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:24.773213+0000","last_clean_scrub_stamp":"2024-09-13T23:09:24.773213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:46.180521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'12","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:02.595417+0000","last_change":"2024-09-13T23:09:02.595417+0000","last_active":"2024-09-13T23:09:02.595417+0000","last_peered":"2024-09-13T23:09:02.595417+0000","last_clean":"2024-09-13T23:09:02.595417+0000","last_became_active":"2024-09-13T23:05:14.113236+0000","last_became_peered":"2024-09-13T23:05:14.113236+0000","last_unstale":"2024-09-13T23:09:02.595417+0000","last_undegraded":"2024-09-13T23:09:02.595417+0000","last_fullsized":"2024-09-13T23:09:02.595417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T23:09:02.595304+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T23:09:02.595304+0000","last_clean_scrub_stamp":"2024-09-13T23:09:02.595304+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:26:26.214597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:33.405569+0000","last_change":"2024-09-13T23:09:33.405569+0000","last_active":"2024-09-13T23:09:33.405569+0000","last_peered":"2024-09-13T23:09:33.405569+0000","last_clean":"2024-09-13T23:09:33.405569+0000","last_became_active":"2024-09-13T23:05:12.141280+0000","last_became_peered":"2024-09-13T23:05:12.141280+0000","last_unstale":"2024-09-13T23:09:33.405569+0000","last_undegraded":"2024-09-13T23:09:33.405569+0000","last_fullsized":"2024-09-13T23:09:33.405569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:33.405438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:33.405438+0000","last_clean_scrub_stamp":"2024-09-13T23:09:33.405438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:42.493362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:47.188431+0000","last_change":"2024-09-13T23:08:47.188431+0000","last_active":"2024-09-13T23:08:47.188431+0000","last_peered":"2024-09-13T23:08:47.188431+0000","last_clean":"2024-09-13T23:08:47.188431+0000","last_became_active":"2024-09-13T23:05:16.117468+0000","last_became_peered":"2024-09-13T23:05:16.117468+0000","last_unstale":"2024-09-13T23:08:47.188431+0000","last_undegraded":"2024-09-13T23:08:47.188431+0000","last_fullsized":"2024-09-13T23:08:47.188431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:47.188316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:47.188316+0000","last_clean_scrub_stamp":"2024-09-13T23:08:47.188316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:30:41.738969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'41","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:44.467306+0000","last_change":"2024-09-13T23:08:44.467306+0000","last_active":"2024-09-13T23:08:44.467306+0000","last_peered":"2024-09-13T23:08:44.467306+0000","last_clean":"2024-09-13T23:08:44.467306+0000","last_became_active":"2024-09-13T23:05:18.131841+0000","last_became_peered":"2024-09-13T23:05:18.131841+0000","last_unstale":"2024-09-13T23:08:44.467306+0000","last_undegraded":"2024-09-13T23:08:44.467306+0000","last_fullsized":"2024-09-13T23:08:44.467306+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'41","last_scrub_stamp":"2024-09-13T23:08:44.467169+0000","last_deep_scrub":"34'41","last_deep_scrub_stamp":"2024-09-13T23:08:44.467169+0000","last_clean_scrub_stamp":"2024-09-13T23:08:44.467169+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:11.320136+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:04.223060+0000","last_change":"2024-09-13T23:09:04.223060+0000","last_active":"2024-09-13T23:09:04.223060+0000","last_peered":"2024-09-13T23:09:04.223060+0000","last_clean":"2024-09-13T23:09:04.223060+0000","last_became_active":"2024-09-13T23:05:20.138958+0000","last_became_peered":"2024-09-13T23:05:20.138958+0000","last_unstale":"2024-09-13T23:09:04.223060+0000","last_undegraded":"2024-09-13T23:09:04.223060+0000","last_fullsized":"2024-09-13T23:09:04.223060+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:04.222933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:04.222933+0000","last_clean_scrub_stamp":"2024-09-13T23:09:04.222933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:27.241190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'5","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:32.313092+0000","last_change":"2024-09-13T23:09:32.313119+0000","last_active":"2024-09-13T23:09:32.313092+0000","last_peered":"2024-09-13T23:09:32.313092+0000","last_clean":"2024-09-13T23:09:32.313092+0000","last_became_active":"2024-09-13T23:05:22.141471+0000","last_became_peered":"2024-09-13T23:05:22.141471+0000","last_unstale":"2024-09-13T23:09:32.313092+0000","last_undegraded":"2024-09-13T23:09:32.313092+0000","last_fullsized":"2024-09-13T23:09:32.313092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T23:09:32.313000+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T23:09:32.313000+0000","last_clean_scrub_stamp":"2024-09-13T23:09:32.313000+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:13.281073+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'8","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:13.077712+0000","last_change":"2024-09-13T23:09:13.077712+0000","last_active":"2024-09-13T23:09:13.077712+0000","last_peered":"2024-09-13T23:09:13.077712+0000","last_clean":"2024-09-13T23:09:13.077712+0000","last_became_active":"2024-09-13T23:05:49.164131+0000","last_became_peered":"2024-09-13T23:05:49.164131+0000","last_unstale":"2024-09-13T23:09:13.077712+0000","last_undegraded":"2024-09-13T23:09:13.077712+0000","last_fullsized":"2024-09-13T23:09:13.077712+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:09:13.077595+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:09:13.077595+0000","last_clean_scrub_stamp":"2024-09-13T23:09:13.077595+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:46.551346+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:17.758782+0000","last_change":"2024-09-13T23:09:17.758782+0000","last_active":"2024-09-13T23:09:17.758782+0000","last_peered":"2024-09-13T23:09:17.758782+0000","last_clean":"2024-09-13T23:09:17.758782+0000","last_became_active":"2024-09-13T23:05:12.114343+0000","last_became_peered":"2024-09-13T23:05:12.114343+0000","last_unstale":"2024-09-13T23:09:17.758782+0000","last_undegraded":"2024-09-13T23:09:17.758782+0000","last_fullsized":"2024-09-13T23:09:17.758782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:17.758658+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:17.758658+0000","last_clean_scrub_stamp":"2024-09-13T23:09:17.758658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:46:23.065002+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:37.573239+0000","last_change":"2024-09-13T23:08:37.573239+0000","last_active":"2024-09-13T23:08:37.573239+0000","last_peered":"2024-09-13T23:08:37.573239+0000","last_clean":"2024-09-13T23:08:37.573239+0000","last_became_active":"2024-09-13T23:05:49.160578+0000","last_became_peered":"2024-09-13T23:05:49.160578+0000","last_unstale":"2024-09-13T23:08:37.573239+0000","last_undegraded":"2024-09-13T23:08:37.573239+0000","last_fullsized":"2024-09-13T23:08:37.573239+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:37.573092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:37.573092+0000","last_clean_scrub_stamp":"2024-09-13T23:08:37.573092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:12:43.684366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:47.139236+0000","last_change":"2024-09-13T23:08:47.139236+0000","last_active":"2024-09-13T23:08:47.139236+0000","last_peered":"2024-09-13T23:08:47.139236+0000","last_clean":"2024-09-13T23:08:47.139236+0000","last_became_active":"2024-09-13T23:05:18.121514+0000","last_became_peered":"2024-09-13T23:05:18.121514+0000","last_unstale":"2024-09-13T23:08:47.139236+0000","last_undegraded":"2024-09-13T23:08:47.139236+0000","last_fullsized":"2024-09-13T23:08:47.139236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:08:47.139074+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:08:47.139074+0000","last_clean_scrub_stamp":"2024-09-13T23:08:47.139074+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:36.671882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:33.698474+0000","last_change":"2024-09-13T23:08:33.698474+0000","last_active":"2024-09-13T23:08:33.698474+0000","last_peered":"2024-09-13T23:08:33.698474+0000","last_clean":"2024-09-13T23:08:33.698474+0000","last_became_active":"2024-09-13T23:05:20.140290+0000","last_became_peered":"2024-09-13T23:05:20.140290+0000","last_unstale":"2024-09-13T23:08:33.698474+0000","last_undegraded":"2024-09-13T23:08:33.698474+0000","last_fullsized":"2024-09-13T23:08:33.698474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:33.698356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:33.698356+0000","last_clean_scrub_stamp":"2024-09-13T23:08:33.698356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:32:32.081819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:30.284441+0000","last_change":"2024-09-13T23:09:30.284466+0000","last_active":"2024-09-13T23:09:30.284441+0000","last_peered":"2024-09-13T23:09:30.284441+0000","last_clean":"2024-09-13T23:09:30.284441+0000","last_became_active":"2024-09-13T23:05:22.140963+0000","last_became_peered":"2024-09-13T23:05:22.140963+0000","last_unstale":"2024-09-13T23:09:30.284441+0000","last_undegraded":"2024-09-13T23:09:30.284441+0000","last_fullsized":"2024-09-13T23:09:30.284441+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:30.284347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:30.284347+0000","last_clean_scrub_stamp":"2024-09-13T23:09:30.284347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:55:22.720680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:14.324059+0000","last_change":"2024-09-13T23:09:14.324059+0000","last_active":"2024-09-13T23:09:14.324059+0000","last_peered":"2024-09-13T23:09:14.324059+0000","last_clean":"2024-09-13T23:09:14.324059+0000","last_became_active":"2024-09-13T23:05:14.120354+0000","last_became_peered":"2024-09-13T23:05:14.120354+0000","last_unstale":"2024-09-13T23:09:14.324059+0000","last_undegraded":"2024-09-13T23:09:14.324059+0000","last_fullsized":"2024-09-13T23:09:14.324059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:14.323958+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:14.323958+0000","last_clean_scrub_stamp":"2024-09-13T23:09:14.323958+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:41.259957+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:18.765460+0000","last_change":"2024-09-13T23:09:18.765460+0000","last_active":"2024-09-13T23:09:18.765460+0000","last_peered":"2024-09-13T23:09:18.765460+0000","last_clean":"2024-09-13T23:09:18.765460+0000","last_became_active":"2024-09-13T23:05:12.116819+0000","last_became_peered":"2024-09-13T23:05:12.116819+0000","last_unstale":"2024-09-13T23:09:18.765460+0000","last_undegraded":"2024-09-13T23:09:18.765460+0000","last_fullsized":"2024-09-13T23:09:18.765460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:18.765313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:18.765313+0000","last_clean_scrub_stamp":"2024-09-13T23:09:18.765313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:14.432428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:49.713485+0000","last_change":"2024-09-13T23:08:49.713485+0000","last_active":"2024-09-13T23:08:49.713485+0000","last_peered":"2024-09-13T23:08:49.713485+0000","last_clean":"2024-09-13T23:08:49.713485+0000","last_became_active":"2024-09-13T23:05:16.124617+0000","last_became_peered":"2024-09-13T23:05:16.124617+0000","last_unstale":"2024-09-13T23:08:49.713485+0000","last_undegraded":"2024-09-13T23:08:49.713485+0000","last_fullsized":"2024-09-13T23:08:49.713485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:49.713367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:49.713367+0000","last_clean_scrub_stamp":"2024-09-13T23:08:49.713367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:31.248692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'47","reported_seq":120,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:45.136578+0000","last_change":"2024-09-13T23:08:45.136578+0000","last_active":"2024-09-13T23:08:45.136578+0000","last_peered":"2024-09-13T23:08:45.136578+0000","last_clean":"2024-09-13T23:08:45.136578+0000","last_became_active":"2024-09-13T23:05:18.126147+0000","last_became_peered":"2024-09-13T23:05:18.126147+0000","last_unstale":"2024-09-13T23:08:45.136578+0000","last_undegraded":"2024-09-13T23:08:45.136578+0000","last_fullsized":"2024-09-13T23:08:45.136578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-09-13T23:08:45.136425+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-09-13T23:08:45.136425+0000","last_clean_scrub_stamp":"2024-09-13T23:08:45.136425+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:12:33.611238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:37.125288+0000","last_change":"2024-09-13T23:08:37.125288+0000","last_active":"2024-09-13T23:08:37.125288+0000","last_peered":"2024-09-13T23:08:37.125288+0000","last_clean":"2024-09-13T23:08:37.125288+0000","last_became_active":"2024-09-13T23:05:20.128756+0000","last_became_peered":"2024-09-13T23:05:20.128756+0000","last_unstale":"2024-09-13T23:08:37.125288+0000","last_undegraded":"2024-09-13T23:08:37.125288+0000","last_fullsized":"2024-09-13T23:08:37.125288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:37.125127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:37.125127+0000","last_clean_scrub_stamp":"2024-09-13T23:08:37.125127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:37.222133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:52.422830+0000","last_change":"2024-09-13T23:09:52.422854+0000","last_active":"2024-09-13T23:09:52.422830+0000","last_peered":"2024-09-13T23:09:52.422830+0000","last_clean":"2024-09-13T23:09:52.422830+0000","last_became_active":"2024-09-13T23:05:22.143767+0000","last_became_peered":"2024-09-13T23:05:22.143767+0000","last_unstale":"2024-09-13T23:09:52.422830+0000","last_undegraded":"2024-09-13T23:09:52.422830+0000","last_fullsized":"2024-09-13T23:09:52.422830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:52.422734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:52.422734+0000","last_clean_scrub_stamp":"2024-09-13T23:09:52.422734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:16:07.864656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:45.412793+0000","last_change":"2024-09-13T23:08:45.412793+0000","last_active":"2024-09-13T23:08:45.412793+0000","last_peered":"2024-09-13T23:08:45.412793+0000","last_clean":"2024-09-13T23:08:45.412793+0000","last_became_active":"2024-09-13T23:05:14.127000+0000","last_became_peered":"2024-09-13T23:05:14.127000+0000","last_unstale":"2024-09-13T23:08:45.412793+0000","last_undegraded":"2024-09-13T23:08:45.412793+0000","last_fullsized":"2024-09-13T23:08:45.412793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:45.412659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:45.412659+0000","last_clean_scrub_stamp":"2024-09-13T23:08:45.412659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:39.470592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:24.156784+0000","last_change":"2024-09-13T23:09:24.156784+0000","last_active":"2024-09-13T23:09:24.156784+0000","last_peered":"2024-09-13T23:09:24.156784+0000","last_clean":"2024-09-13T23:09:24.156784+0000","last_became_active":"2024-09-13T23:05:12.136384+0000","last_became_peered":"2024-09-13T23:05:12.136384+0000","last_unstale":"2024-09-13T23:09:24.156784+0000","last_undegraded":"2024-09-13T23:09:24.156784+0000","last_fullsized":"2024-09-13T23:09:24.156784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:24.156661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:24.156661+0000","last_clean_scrub_stamp":"2024-09-13T23:09:24.156661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:48:06.248758+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:34.507259+0000","last_change":"2024-09-13T23:08:34.507259+0000","last_active":"2024-09-13T23:08:34.507259+0000","last_peered":"2024-09-13T23:08:34.507259+0000","last_clean":"2024-09-13T23:08:34.507259+0000","last_became_active":"2024-09-13T23:05:16.124241+0000","last_became_peered":"2024-09-13T23:05:16.124241+0000","last_unstale":"2024-09-13T23:08:34.507259+0000","last_undegraded":"2024-09-13T23:08:34.507259+0000","last_fullsized":"2024-09-13T23:08:34.507259+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:34.507140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:34.507140+0000","last_clean_scrub_stamp":"2024-09-13T23:08:34.507140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:44.378397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:44.633861+0000","last_change":"2024-09-13T23:08:44.633861+0000","last_active":"2024-09-13T23:08:44.633861+0000","last_peered":"2024-09-13T23:08:44.633861+0000","last_clean":"2024-09-13T23:08:44.633861+0000","last_became_active":"2024-09-13T23:05:18.126188+0000","last_became_peered":"2024-09-13T23:05:18.126188+0000","last_unstale":"2024-09-13T23:08:44.633861+0000","last_undegraded":"2024-09-13T23:08:44.633861+0000","last_fullsized":"2024-09-13T23:08:44.633861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-13T23:08:44.633726+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-13T23:08:44.633726+0000","last_clean_scrub_stamp":"2024-09-13T23:08:44.633726+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:30.569822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:35.618558+0000","last_change":"2024-09-13T23:08:35.618558+0000","last_active":"2024-09-13T23:08:35.618558+0000","last_peered":"2024-09-13T23:08:35.618558+0000","last_clean":"2024-09-13T23:08:35.618558+0000","last_became_active":"2024-09-13T23:05:20.136098+0000","last_became_peered":"2024-09-13T23:05:20.136098+0000","last_unstale":"2024-09-13T23:08:35.618558+0000","last_undegraded":"2024-09-13T23:08:35.618558+0000","last_fullsized":"2024-09-13T23:08:35.618558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:35.618400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:35.618400+0000","last_clean_scrub_stamp":"2024-09-13T23:08:35.618400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:30.276746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'14","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:14.249283+0000","last_change":"2024-09-13T23:09:14.249283+0000","last_active":"2024-09-13T23:09:14.249283+0000","last_peered":"2024-09-13T23:09:14.249283+0000","last_clean":"2024-09-13T23:09:14.249283+0000","last_became_active":"2024-09-13T23:05:14.112822+0000","last_became_peered":"2024-09-13T23:05:14.112822+0000","last_unstale":"2024-09-13T23:09:14.249283+0000","last_undegraded":"2024-09-13T23:09:14.249283+0000","last_fullsized":"2024-09-13T23:09:14.249283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-13T23:09:14.249078+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-13T23:09:14.249078+0000","last_clean_scrub_stamp":"2024-09-13T23:09:14.249078+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:34.101181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:27.330693+0000","last_change":"2024-09-13T23:09:27.330693+0000","last_active":"2024-09-13T23:09:27.330693+0000","last_peered":"2024-09-13T23:09:27.330693+0000","last_clean":"2024-09-13T23:09:27.330693+0000","last_became_active":"2024-09-13T23:05:12.141970+0000","last_became_peered":"2024-09-13T23:05:12.141970+0000","last_unstale":"2024-09-13T23:09:27.330693+0000","last_undegraded":"2024-09-13T23:09:27.330693+0000","last_fullsized":"2024-09-13T23:09:27.330693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:27.330516+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:27.330516+0000","last_clean_scrub_stamp":"2024-09-13T23:09:27.330516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:54.965684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:53.200311+0000","last_change":"2024-09-13T23:08:53.200311+0000","last_active":"2024-09-13T23:08:53.200311+0000","last_peered":"2024-09-13T23:08:53.200311+0000","last_clean":"2024-09-13T23:08:53.200311+0000","last_became_active":"2024-09-13T23:05:16.120506+0000","last_became_peered":"2024-09-13T23:05:16.120506+0000","last_unstale":"2024-09-13T23:08:53.200311+0000","last_undegraded":"2024-09-13T23:08:53.200311+0000","last_fullsized":"2024-09-13T23:08:53.200311+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:53.200178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:53.200178+0000","last_clean_scrub_stamp":"2024-09-13T23:08:53.200178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:52:22.107307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'65","reported_seq":138,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:44.096079+0000","last_change":"2024-09-13T23:08:44.096120+0000","last_active":"2024-09-13T23:08:44.096079+0000","last_peered":"2024-09-13T23:08:44.096079+0000","last_clean":"2024-09-13T23:08:44.096079+0000","last_became_active":"2024-09-13T23:05:18.126811+0000","last_became_peered":"2024-09-13T23:05:18.126811+0000","last_unstale":"2024-09-13T23:08:44.096079+0000","last_undegraded":"2024-09-13T23:08:44.096079+0000","last_fullsized":"2024-09-13T23:08:44.096079+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'65","last_scrub_stamp":"2024-09-13T23:08:44.095997+0000","last_deep_scrub":"34'65","last_deep_scrub_stamp":"2024-09-13T23:08:44.095997+0000","last_clean_scrub_stamp":"2024-09-13T23:08:44.095997+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:01.263619+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:36.593190+0000","last_change":"2024-09-13T23:08:36.593215+0000","last_active":"2024-09-13T23:08:36.593190+0000","last_peered":"2024-09-13T23:08:36.593190+0000","last_clean":"2024-09-13T23:08:36.593190+0000","last_became_active":"2024-09-13T23:05:20.135886+0000","last_became_peered":"2024-09-13T23:05:20.135886+0000","last_unstale":"2024-09-13T23:08:36.593190+0000","last_undegraded":"2024-09-13T23:08:36.593190+0000","last_fullsized":"2024-09-13T23:08:36.593190+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:36.593096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:36.593096+0000","last_clean_scrub_stamp":"2024-09-13T23:08:36.593096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:13.596600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'16","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:33.328876+0000","last_change":"2024-09-13T23:09:33.328876+0000","last_active":"2024-09-13T23:09:33.328876+0000","last_peered":"2024-09-13T23:09:33.328876+0000","last_clean":"2024-09-13T23:09:33.328876+0000","last_became_active":"2024-09-13T23:05:22.147394+0000","last_became_peered":"2024-09-13T23:05:22.147394+0000","last_unstale":"2024-09-13T23:09:33.328876+0000","last_undegraded":"2024-09-13T23:09:33.328876+0000","last_fullsized":"2024-09-13T23:09:33.328876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:09:33.328746+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:09:33.328746+0000","last_clean_scrub_stamp":"2024-09-13T23:09:33.328746+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:39.452384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:28.332489+0000","last_change":"2024-09-13T23:09:28.332514+0000","last_active":"2024-09-13T23:09:28.332489+0000","last_peered":"2024-09-13T23:09:28.332489+0000","last_clean":"2024-09-13T23:09:28.332489+0000","last_became_active":"2024-09-13T23:05:14.121349+0000","last_became_peered":"2024-09-13T23:05:14.121349+0000","last_unstale":"2024-09-13T23:09:28.332489+0000","last_undegraded":"2024-09-13T23:09:28.332489+0000","last_fullsized":"2024-09-13T23:09:28.332489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:28.332397+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:28.332397+0000","last_clean_scrub_stamp":"2024-09-13T23:09:28.332397+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:32.331842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:26.190782+0000","last_change":"2024-09-13T23:09:26.190782+0000","last_active":"2024-09-13T23:09:26.190782+0000","last_peered":"2024-09-13T23:09:26.190782+0000","last_clean":"2024-09-13T23:09:26.190782+0000","last_became_active":"2024-09-13T23:05:12.137092+0000","last_became_peered":"2024-09-13T23:05:12.137092+0000","last_unstale":"2024-09-13T23:09:26.190782+0000","last_undegraded":"2024-09-13T23:09:26.190782+0000","last_fullsized":"2024-09-13T23:09:26.190782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:26.190609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:26.190609+0000","last_clean_scrub_stamp":"2024-09-13T23:09:26.190609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:19.827376+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:53.660121+0000","last_change":"2024-09-13T23:08:53.660121+0000","last_active":"2024-09-13T23:08:53.660121+0000","last_peered":"2024-09-13T23:08:53.660121+0000","last_clean":"2024-09-13T23:08:53.660121+0000","last_became_active":"2024-09-13T23:05:16.121476+0000","last_became_peered":"2024-09-13T23:05:16.121476+0000","last_unstale":"2024-09-13T23:08:53.660121+0000","last_undegraded":"2024-09-13T23:08:53.660121+0000","last_fullsized":"2024-09-13T23:08:53.660121+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:53.659974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:53.659974+0000","last_clean_scrub_stamp":"2024-09-13T23:08:53.659974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:50.966119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:46.445606+0000","last_change":"2024-09-13T23:08:46.445654+0000","last_active":"2024-09-13T23:08:46.445606+0000","last_peered":"2024-09-13T23:08:46.445606+0000","last_clean":"2024-09-13T23:08:46.445606+0000","last_became_active":"2024-09-13T23:05:18.132060+0000","last_became_peered":"2024-09-13T23:05:18.132060+0000","last_unstale":"2024-09-13T23:08:46.445606+0000","last_undegraded":"2024-09-13T23:08:46.445606+0000","last_fullsized":"2024-09-13T23:08:46.445606+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-09-13T23:08:46.445495+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-09-13T23:08:46.445495+0000","last_clean_scrub_stamp":"2024-09-13T23:08:46.445495+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:05:59.233056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:49.128648+0000","last_change":"2024-09-13T23:08:49.128681+0000","last_active":"2024-09-13T23:08:49.128648+0000","last_peered":"2024-09-13T23:08:49.128648+0000","last_clean":"2024-09-13T23:08:49.128648+0000","last_became_active":"2024-09-13T23:05:20.140333+0000","last_became_peered":"2024-09-13T23:05:20.140333+0000","last_unstale":"2024-09-13T23:08:49.128648+0000","last_undegraded":"2024-09-13T23:08:49.128648+0000","last_fullsized":"2024-09-13T23:08:49.128648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:49.128546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:49.128546+0000","last_clean_scrub_stamp":"2024-09-13T23:08:49.128546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:23:33.731436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:20.163621+0000","last_change":"2024-09-13T23:09:20.163621+0000","last_active":"2024-09-13T23:09:20.163621+0000","last_peered":"2024-09-13T23:09:20.163621+0000","last_clean":"2024-09-13T23:09:20.163621+0000","last_became_active":"2024-09-13T23:05:22.139984+0000","last_became_peered":"2024-09-13T23:05:22.139984+0000","last_unstale":"2024-09-13T23:09:20.163621+0000","last_undegraded":"2024-09-13T23:09:20.163621+0000","last_fullsized":"2024-09-13T23:09:20.163621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:20.163488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:20.163488+0000","last_clean_scrub_stamp":"2024-09-13T23:09:20.163488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:27.459780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:53.426271+0000","last_change":"2024-09-13T23:08:53.426301+0000","last_active":"2024-09-13T23:08:53.426271+0000","last_peered":"2024-09-13T23:08:53.426271+0000","last_clean":"2024-09-13T23:08:53.426271+0000","last_became_active":"2024-09-13T23:05:14.124660+0000","last_became_peered":"2024-09-13T23:05:14.124660+0000","last_unstale":"2024-09-13T23:08:53.426271+0000","last_undegraded":"2024-09-13T23:08:53.426271+0000","last_fullsized":"2024-09-13T23:08:53.426271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:08:53.426181+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:08:53.426181+0000","last_clean_scrub_stamp":"2024-09-13T23:08:53.426181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:11.981314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:10.115237+0000","last_change":"2024-09-13T23:09:10.115237+0000","last_active":"2024-09-13T23:09:10.115237+0000","last_peered":"2024-09-13T23:09:10.115237+0000","last_clean":"2024-09-13T23:09:10.115237+0000","last_became_active":"2024-09-13T23:05:12.137136+0000","last_became_peered":"2024-09-13T23:05:12.137136+0000","last_unstale":"2024-09-13T23:09:10.115237+0000","last_undegraded":"2024-09-13T23:09:10.115237+0000","last_fullsized":"2024-09-13T23:09:10.115237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:10.115117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:10.115117+0000","last_clean_scrub_stamp":"2024-09-13T23:09:10.115117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:50.313039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:51.653427+0000","last_change":"2024-09-13T23:08:51.653449+0000","last_active":"2024-09-13T23:08:51.653427+0000","last_peered":"2024-09-13T23:08:51.653427+0000","last_clean":"2024-09-13T23:08:51.653427+0000","last_became_active":"2024-09-13T23:05:16.123607+0000","last_became_peered":"2024-09-13T23:05:16.123607+0000","last_unstale":"2024-09-13T23:08:51.653427+0000","last_undegraded":"2024-09-13T23:08:51.653427+0000","last_fullsized":"2024-09-13T23:08:51.653427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:51.653336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:51.653336+0000","last_clean_scrub_stamp":"2024-09-13T23:08:51.653336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:03:16.566313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'39","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:40.011754+0000","last_change":"2024-09-13T23:08:40.011754+0000","last_active":"2024-09-13T23:08:40.011754+0000","last_peered":"2024-09-13T23:08:40.011754+0000","last_clean":"2024-09-13T23:08:40.011754+0000","last_became_active":"2024-09-13T23:05:18.136279+0000","last_became_peered":"2024-09-13T23:05:18.136279+0000","last_unstale":"2024-09-13T23:08:40.011754+0000","last_undegraded":"2024-09-13T23:08:40.011754+0000","last_fullsized":"2024-09-13T23:08:40.011754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-13T23:08:40.011606+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-13T23:08:40.011606+0000","last_clean_scrub_stamp":"2024-09-13T23:08:40.011606+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:05.066896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:46.122297+0000","last_change":"2024-09-13T23:08:46.122297+0000","last_active":"2024-09-13T23:08:46.122297+0000","last_peered":"2024-09-13T23:08:46.122297+0000","last_clean":"2024-09-13T23:08:46.122297+0000","last_became_active":"2024-09-13T23:05:20.141266+0000","last_became_peered":"2024-09-13T23:05:20.141266+0000","last_unstale":"2024-09-13T23:08:46.122297+0000","last_undegraded":"2024-09-13T23:08:46.122297+0000","last_fullsized":"2024-09-13T23:08:46.122297+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:46.122177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:46.122177+0000","last_clean_scrub_stamp":"2024-09-13T23:08:46.122177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:29.240444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:57.425667+0000","last_change":"2024-09-13T23:09:57.425667+0000","last_active":"2024-09-13T23:09:57.425667+0000","last_peered":"2024-09-13T23:09:57.425667+0000","last_clean":"2024-09-13T23:09:57.425667+0000","last_became_active":"2024-09-13T23:05:22.151339+0000","last_became_peered":"2024-09-13T23:05:22.151339+0000","last_unstale":"2024-09-13T23:09:57.425667+0000","last_undegraded":"2024-09-13T23:09:57.425667+0000","last_fullsized":"2024-09-13T23:09:57.425667+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-13T23:09:57.425484+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-13T23:09:57.425484+0000","last_clean_scrub_stamp":"2024-09-13T23:09:57.425484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:58:48.030483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'8","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:10.305706+0000","last_change":"2024-09-13T23:09:10.305706+0000","last_active":"2024-09-13T23:09:10.305706+0000","last_peered":"2024-09-13T23:09:10.305706+0000","last_clean":"2024-09-13T23:09:10.305706+0000","last_became_active":"2024-09-13T23:05:14.112175+0000","last_became_peered":"2024-09-13T23:05:14.112175+0000","last_unstale":"2024-09-13T23:09:10.305706+0000","last_undegraded":"2024-09-13T23:09:10.305706+0000","last_fullsized":"2024-09-13T23:09:10.305706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:09:10.305573+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:09:10.305573+0000","last_clean_scrub_stamp":"2024-09-13T23:09:10.305573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:24:52.419767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:31.432025+0000","last_change":"2024-09-13T23:09:31.432025+0000","last_active":"2024-09-13T23:09:31.432025+0000","last_peered":"2024-09-13T23:09:31.432025+0000","last_clean":"2024-09-13T23:09:31.432025+0000","last_became_active":"2024-09-13T23:05:12.141459+0000","last_became_peered":"2024-09-13T23:05:12.141459+0000","last_unstale":"2024-09-13T23:09:31.432025+0000","last_undegraded":"2024-09-13T23:09:31.432025+0000","last_fullsized":"2024-09-13T23:09:31.432025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:31.431863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:31.431863+0000","last_clean_scrub_stamp":"2024-09-13T23:09:31.431863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:59.930982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"34'5","reported_seq":238,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:46.150879+0000","last_change":"2024-09-13T23:08:46.150906+0000","last_active":"2024-09-13T23:08:46.150879+0000","last_peered":"2024-09-13T23:08:46.150879+0000","last_clean":"2024-09-13T23:08:46.150879+0000","last_became_active":"2024-09-13T23:05:16.117736+0000","last_became_peered":"2024-09-13T23:05:16.117736+0000","last_unstale":"2024-09-13T23:08:46.150879+0000","last_undegraded":"2024-09-13T23:08:46.150879+0000","last_fullsized":"2024-09-13T23:08:46.150879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T23:08:46.150798+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T23:08:46.150798+0000","last_clean_scrub_stamp":"2024-09-13T23:08:46.150798+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:35.594124+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'16","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:48.450353+0000","last_change":"2024-09-13T23:08:48.450353+0000","last_active":"2024-09-13T23:08:48.450353+0000","last_peered":"2024-09-13T23:08:48.450353+0000","last_clean":"2024-09-13T23:08:48.450353+0000","last_became_active":"2024-09-13T23:05:18.132507+0000","last_became_peered":"2024-09-13T23:05:18.132507+0000","last_unstale":"2024-09-13T23:08:48.450353+0000","last_undegraded":"2024-09-13T23:08:48.450353+0000","last_fullsized":"2024-09-13T23:08:48.450353+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:08:48.450186+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:08:48.450186+0000","last_clean_scrub_stamp":"2024-09-13T23:08:48.450186+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:23.338330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":430,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:42.605617+0000","last_change":"2024-09-13T23:08:42.605617+0000","last_active":"2024-09-13T23:08:42.605617+0000","last_peered":"2024-09-13T23:08:42.605617+0000","last_clean":"2024-09-13T23:08:42.605617+0000","last_became_active":"2024-09-13T23:05:20.144334+0000","last_became_peered":"2024-09-13T23:05:20.144334+0000","last_unstale":"2024-09-13T23:08:42.605617+0000","last_undegraded":"2024-09-13T23:08:42.605617+0000","last_fullsized":"2024-09-13T23:08:42.605617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T23:08:42.605465+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T23:08:42.605465+0000","last_clean_scrub_stamp":"2024-09-13T23:08:42.605465+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:53.293281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:55.414294+0000","last_change":"2024-09-13T23:09:55.414294+0000","last_active":"2024-09-13T23:09:55.414294+0000","last_peered":"2024-09-13T23:09:55.414294+0000","last_clean":"2024-09-13T23:09:55.414294+0000","last_became_active":"2024-09-13T23:05:22.148894+0000","last_became_peered":"2024-09-13T23:05:22.148894+0000","last_unstale":"2024-09-13T23:09:55.414294+0000","last_undegraded":"2024-09-13T23:09:55.414294+0000","last_fullsized":"2024-09-13T23:09:55.414294+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:55.414168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:55.414168+0000","last_clean_scrub_stamp":"2024-09-13T23:09:55.414168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:59.152103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:56.577914+0000","last_change":"2024-09-13T23:08:56.577947+0000","last_active":"2024-09-13T23:08:56.577914+0000","last_peered":"2024-09-13T23:08:56.577914+0000","last_clean":"2024-09-13T23:08:56.577914+0000","last_became_active":"2024-09-13T23:05:14.111891+0000","last_became_peered":"2024-09-13T23:05:14.111891+0000","last_unstale":"2024-09-13T23:08:56.577914+0000","last_undegraded":"2024-09-13T23:08:56.577914+0000","last_fullsized":"2024-09-13T23:08:56.577914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:08:56.577794+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:08:56.577794+0000","last_clean_scrub_stamp":"2024-09-13T23:08:56.577794+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:52:00.290749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:16.155197+0000","last_change":"2024-09-13T23:09:16.155197+0000","last_active":"2024-09-13T23:09:16.155197+0000","last_peered":"2024-09-13T23:09:16.155197+0000","last_clean":"2024-09-13T23:09:16.155197+0000","last_became_active":"2024-09-13T23:05:12.139564+0000","last_became_peered":"2024-09-13T23:05:12.139564+0000","last_unstale":"2024-09-13T23:09:16.155197+0000","last_undegraded":"2024-09-13T23:09:16.155197+0000","last_fullsized":"2024-09-13T23:09:16.155197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:16.155069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:16.155069+0000","last_clean_scrub_stamp":"2024-09-13T23:09:16.155069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:49.723203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:44.189431+0000","last_change":"2024-09-13T23:08:44.189458+0000","last_active":"2024-09-13T23:08:44.189431+0000","last_peered":"2024-09-13T23:08:44.189431+0000","last_clean":"2024-09-13T23:08:44.189431+0000","last_became_active":"2024-09-13T23:05:16.118353+0000","last_became_peered":"2024-09-13T23:05:16.118353+0000","last_unstale":"2024-09-13T23:08:44.189431+0000","last_undegraded":"2024-09-13T23:08:44.189431+0000","last_fullsized":"2024-09-13T23:08:44.189431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:44.189340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:44.189340+0000","last_clean_scrub_stamp":"2024-09-13T23:08:44.189340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:31.794198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'45","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:35.089897+0000","last_change":"2024-09-13T23:08:35.089897+0000","last_active":"2024-09-13T23:08:35.089897+0000","last_peered":"2024-09-13T23:08:35.089897+0000","last_clean":"2024-09-13T23:08:35.089897+0000","last_became_active":"2024-09-13T23:05:18.127975+0000","last_became_peered":"2024-09-13T23:05:18.127975+0000","last_unstale":"2024-09-13T23:08:35.089897+0000","last_undegraded":"2024-09-13T23:08:35.089897+0000","last_fullsized":"2024-09-13T23:08:35.089897+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-09-13T23:08:35.089767+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-09-13T23:08:35.089767+0000","last_clean_scrub_stamp":"2024-09-13T23:08:35.089767+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:53:49.326025+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:34.005539+0000","last_change":"2024-09-13T23:08:34.005539+0000","last_active":"2024-09-13T23:08:34.005539+0000","last_peered":"2024-09-13T23:08:34.005539+0000","last_clean":"2024-09-13T23:08:34.005539+0000","last_became_active":"2024-09-13T23:05:20.139329+0000","last_became_peered":"2024-09-13T23:05:20.139329+0000","last_unstale":"2024-09-13T23:08:34.005539+0000","last_undegraded":"2024-09-13T23:08:34.005539+0000","last_fullsized":"2024-09-13T23:08:34.005539+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:34.005418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:34.005418+0000","last_clean_scrub_stamp":"2024-09-13T23:08:34.005418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:17:06.755531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:30.179256+0000","last_change":"2024-09-13T23:09:30.179256+0000","last_active":"2024-09-13T23:09:30.179256+0000","last_peered":"2024-09-13T23:09:30.179256+0000","last_clean":"2024-09-13T23:09:30.179256+0000","last_became_active":"2024-09-13T23:05:22.147949+0000","last_became_peered":"2024-09-13T23:05:22.147949+0000","last_unstale":"2024-09-13T23:09:30.179256+0000","last_undegraded":"2024-09-13T23:09:30.179256+0000","last_fullsized":"2024-09-13T23:09:30.179256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:30.179138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:30.179138+0000","last_clean_scrub_stamp":"2024-09-13T23:09:30.179138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:55:22.615471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:04.647264+0000","last_change":"2024-09-13T23:09:04.647321+0000","last_active":"2024-09-13T23:09:04.647264+0000","last_peered":"2024-09-13T23:09:04.647264+0000","last_clean":"2024-09-13T23:09:04.647264+0000","last_became_active":"2024-09-13T23:05:14.113816+0000","last_became_peered":"2024-09-13T23:05:14.113816+0000","last_unstale":"2024-09-13T23:09:04.647264+0000","last_undegraded":"2024-09-13T23:09:04.647264+0000","last_fullsized":"2024-09-13T23:09:04.647264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:04.647142+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:04.647142+0000","last_clean_scrub_stamp":"2024-09-13T23:09:04.647142+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:23:47.909278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:50.504543+0000","last_change":"2024-09-13T23:09:50.504543+0000","last_active":"2024-09-13T23:09:50.504543+0000","last_peered":"2024-09-13T23:09:50.504543+0000","last_clean":"2024-09-13T23:09:50.504543+0000","last_became_active":"2024-09-13T23:05:12.149292+0000","last_became_peered":"2024-09-13T23:05:12.149292+0000","last_unstale":"2024-09-13T23:09:50.504543+0000","last_undegraded":"2024-09-13T23:09:50.504543+0000","last_fullsized":"2024-09-13T23:09:50.504543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:50.504397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:50.504397+0000","last_clean_scrub_stamp":"2024-09-13T23:09:50.504397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:48.224569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:47.679656+0000","last_change":"2024-09-13T23:08:47.679695+0000","last_active":"2024-09-13T23:08:47.679656+0000","last_peered":"2024-09-13T23:08:47.679656+0000","last_clean":"2024-09-13T23:08:47.679656+0000","last_became_active":"2024-09-13T23:05:16.128023+0000","last_became_peered":"2024-09-13T23:05:16.128023+0000","last_unstale":"2024-09-13T23:08:47.679656+0000","last_undegraded":"2024-09-13T23:08:47.679656+0000","last_fullsized":"2024-09-13T23:08:47.679656+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:47.679555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:47.679555+0000","last_clean_scrub_stamp":"2024-09-13T23:08:47.679555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:54.252885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'36","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:40.988296+0000","last_change":"2024-09-13T23:08:40.988296+0000","last_active":"2024-09-13T23:08:40.988296+0000","last_peered":"2024-09-13T23:08:40.988296+0000","last_clean":"2024-09-13T23:08:40.988296+0000","last_became_active":"2024-09-13T23:05:18.132579+0000","last_became_peered":"2024-09-13T23:05:18.132579+0000","last_unstale":"2024-09-13T23:08:40.988296+0000","last_undegraded":"2024-09-13T23:08:40.988296+0000","last_fullsized":"2024-09-13T23:08:40.988296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-13T23:08:40.988170+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-13T23:08:40.988170+0000","last_clean_scrub_stamp":"2024-09-13T23:08:40.988170+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:13:33.042844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:55.408584+0000","last_change":"2024-09-13T23:08:55.408584+0000","last_active":"2024-09-13T23:08:55.408584+0000","last_peered":"2024-09-13T23:08:55.408584+0000","last_clean":"2024-09-13T23:08:55.408584+0000","last_became_active":"2024-09-13T23:05:20.136023+0000","last_became_peered":"2024-09-13T23:05:20.136023+0000","last_unstale":"2024-09-13T23:08:55.408584+0000","last_undegraded":"2024-09-13T23:08:55.408584+0000","last_fullsized":"2024-09-13T23:08:55.408584+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:55.408445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:55.408445+0000","last_clean_scrub_stamp":"2024-09-13T23:08:55.408445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:23:49.047903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:56.386246+0000","last_change":"2024-09-13T23:09:56.386246+0000","last_active":"2024-09-13T23:09:56.386246+0000","last_peered":"2024-09-13T23:09:56.386246+0000","last_clean":"2024-09-13T23:09:56.386246+0000","last_became_active":"2024-09-13T23:05:22.149468+0000","last_became_peered":"2024-09-13T23:05:22.149468+0000","last_unstale":"2024-09-13T23:09:56.386246+0000","last_undegraded":"2024-09-13T23:09:56.386246+0000","last_fullsized":"2024-09-13T23:09:56.386246+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:56.386123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:56.386123+0000","last_clean_scrub_stamp":"2024-09-13T23:09:56.386123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:25:18.090424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:21.200959+0000","last_change":"2024-09-13T23:09:21.200959+0000","last_active":"2024-09-13T23:09:21.200959+0000","last_peered":"2024-09-13T23:09:21.200959+0000","last_clean":"2024-09-13T23:09:21.200959+0000","last_became_active":"2024-09-13T23:05:14.109323+0000","last_became_peered":"2024-09-13T23:05:14.109323+0000","last_unstale":"2024-09-13T23:09:21.200959+0000","last_undegraded":"2024-09-13T23:09:21.200959+0000","last_fullsized":"2024-09-13T23:09:21.200959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:21.200822+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:21.200822+0000","last_clean_scrub_stamp":"2024-09-13T23:09:21.200822+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:18.584849+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:13.313691+0000","last_change":"2024-09-13T23:09:13.313691+0000","last_active":"2024-09-13T23:09:13.313691+0000","last_peered":"2024-09-13T23:09:13.313691+0000","last_clean":"2024-09-13T23:09:13.313691+0000","last_became_active":"2024-09-13T23:05:12.121050+0000","last_became_peered":"2024-09-13T23:05:12.121050+0000","last_unstale":"2024-09-13T23:09:13.313691+0000","last_undegraded":"2024-09-13T23:09:13.313691+0000","last_fullsized":"2024-09-13T23:09:13.313691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:13.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:13.313570+0000","last_clean_scrub_stamp":"2024-09-13T23:09:13.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:21.265185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"34'2","reported_seq":231,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:43.150481+0000","last_change":"2024-09-13T23:08:43.150481+0000","last_active":"2024-09-13T23:08:43.150481+0000","last_peered":"2024-09-13T23:08:43.150481+0000","last_clean":"2024-09-13T23:08:43.150481+0000","last_became_active":"2024-09-13T23:05:16.123673+0000","last_became_peered":"2024-09-13T23:05:16.123673+0000","last_unstale":"2024-09-13T23:08:43.150481+0000","last_undegraded":"2024-09-13T23:08:43.150481+0000","last_fullsized":"2024-09-13T23:08:43.150481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:08:43.150340+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:08:43.150340+0000","last_clean_scrub_stamp":"2024-09-13T23:08:43.150340+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:26.284636+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'31","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:01.289992+0000","last_change":"2024-09-13T23:09:01.290029+0000","last_active":"2024-09-13T23:09:01.289992+0000","last_peered":"2024-09-13T23:09:01.289992+0000","last_clean":"2024-09-13T23:09:01.289992+0000","last_became_active":"2024-09-13T23:05:18.134152+0000","last_became_peered":"2024-09-13T23:05:18.134152+0000","last_unstale":"2024-09-13T23:09:01.289992+0000","last_undegraded":"2024-09-13T23:09:01.289992+0000","last_fullsized":"2024-09-13T23:09:01.289992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'31","last_scrub_stamp":"2024-09-13T23:09:01.289900+0000","last_deep_scrub":"34'31","last_deep_scrub_stamp":"2024-09-13T23:09:01.289900+0000","last_clean_scrub_stamp":"2024-09-13T23:09:01.289900+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:26.269605+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:56.399566+0000","last_change":"2024-09-13T23:08:56.399590+0000","last_active":"2024-09-13T23:08:56.399566+0000","last_peered":"2024-09-13T23:08:56.399566+0000","last_clean":"2024-09-13T23:08:56.399566+0000","last_became_active":"2024-09-13T23:05:20.139133+0000","last_became_peered":"2024-09-13T23:05:20.139133+0000","last_unstale":"2024-09-13T23:08:56.399566+0000","last_undegraded":"2024-09-13T23:08:56.399566+0000","last_fullsized":"2024-09-13T23:08:56.399566+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:56.399466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:56.399466+0000","last_clean_scrub_stamp":"2024-09-13T23:08:56.399466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:07.409062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'12","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:51.455876+0000","last_change":"2024-09-13T23:09:51.455876+0000","last_active":"2024-09-13T23:09:51.455876+0000","last_peered":"2024-09-13T23:09:51.455876+0000","last_clean":"2024-09-13T23:09:51.455876+0000","last_became_active":"2024-09-13T23:05:22.143886+0000","last_became_peered":"2024-09-13T23:05:22.143886+0000","last_unstale":"2024-09-13T23:09:51.455876+0000","last_undegraded":"2024-09-13T23:09:51.455876+0000","last_fullsized":"2024-09-13T23:09:51.455876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T23:09:51.455749+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T23:09:51.455749+0000","last_clean_scrub_stamp":"2024-09-13T23:09:51.455749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:23.734950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":59,"num_write":33,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:57.527982+0000","last_change":"2024-09-13T23:08:57.527982+0000","last_active":"2024-09-13T23:08:57.527982+0000","last_peered":"2024-09-13T23:08:57.527982+0000","last_clean":"2024-09-13T23:08:57.527982+0000","last_became_active":"2024-09-13T23:05:14.111836+0000","last_became_peered":"2024-09-13T23:05:14.111836+0000","last_unstale":"2024-09-13T23:08:57.527982+0000","last_undegraded":"2024-09-13T23:08:57.527982+0000","last_fullsized":"2024-09-13T23:08:57.527982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:08:57.527825+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:08:57.527825+0000","last_clean_scrub_stamp":"2024-09-13T23:08:57.527825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:46.405099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:22.117872+0000","last_change":"2024-09-13T23:09:22.117872+0000","last_active":"2024-09-13T23:09:22.117872+0000","last_peered":"2024-09-13T23:09:22.117872+0000","last_clean":"2024-09-13T23:09:22.117872+0000","last_became_active":"2024-09-13T23:05:12.134820+0000","last_became_peered":"2024-09-13T23:05:12.134820+0000","last_unstale":"2024-09-13T23:09:22.117872+0000","last_undegraded":"2024-09-13T23:09:22.117872+0000","last_fullsized":"2024-09-13T23:09:22.117872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:22.117749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:22.117749+0000","last_clean_scrub_stamp":"2024-09-13T23:09:22.117749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:40.032404+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:42.120463+0000","last_change":"2024-09-13T23:08:42.120463+0000","last_active":"2024-09-13T23:08:42.120463+0000","last_peered":"2024-09-13T23:08:42.120463+0000","last_clean":"2024-09-13T23:08:42.120463+0000","last_became_active":"2024-09-13T23:05:16.124295+0000","last_became_peered":"2024-09-13T23:05:16.124295+0000","last_unstale":"2024-09-13T23:08:42.120463+0000","last_undegraded":"2024-09-13T23:08:42.120463+0000","last_fullsized":"2024-09-13T23:08:42.120463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T23:08:42.120283+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T23:08:42.120283+0000","last_clean_scrub_stamp":"2024-09-13T23:08:42.120283+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:16.924419+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'39","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:38.609156+0000","last_change":"2024-09-13T23:08:38.609215+0000","last_active":"2024-09-13T23:08:38.609156+0000","last_peered":"2024-09-13T23:08:38.609156+0000","last_clean":"2024-09-13T23:08:38.609156+0000","last_became_active":"2024-09-13T23:05:18.131796+0000","last_became_peered":"2024-09-13T23:05:18.131796+0000","last_unstale":"2024-09-13T23:08:38.609156+0000","last_undegraded":"2024-09-13T23:08:38.609156+0000","last_fullsized":"2024-09-13T23:08:38.609156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-13T23:08:38.609041+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-13T23:08:38.609041+0000","last_clean_scrub_stamp":"2024-09-13T23:08:38.609041+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:03:15.467219+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:58.257173+0000","last_change":"2024-09-13T23:08:58.257200+0000","last_active":"2024-09-13T23:08:58.257173+0000","last_peered":"2024-09-13T23:08:58.257173+0000","last_clean":"2024-09-13T23:08:58.257173+0000","last_became_active":"2024-09-13T23:05:20.145356+0000","last_became_peered":"2024-09-13T23:05:20.145356+0000","last_unstale":"2024-09-13T23:08:58.257173+0000","last_undegraded":"2024-09-13T23:08:58.257173+0000","last_fullsized":"2024-09-13T23:08:58.257173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:08:58.257079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:08:58.257079+0000","last_clean_scrub_stamp":"2024-09-13T23:08:58.257079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:22:13.566018+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:53.422669+0000","last_change":"2024-09-13T23:09:53.422669+0000","last_active":"2024-09-13T23:09:53.422669+0000","last_peered":"2024-09-13T23:09:53.422669+0000","last_clean":"2024-09-13T23:09:53.422669+0000","last_became_active":"2024-09-13T23:05:22.147707+0000","last_became_peered":"2024-09-13T23:05:22.147707+0000","last_unstale":"2024-09-13T23:09:53.422669+0000","last_undegraded":"2024-09-13T23:09:53.422669+0000","last_fullsized":"2024-09-13T23:09:53.422669+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:53.422545+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:53.422545+0000","last_clean_scrub_stamp":"2024-09-13T23:09:53.422545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:07:51.382261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'16","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:17.141806+0000","last_change":"2024-09-13T23:09:17.141806+0000","last_active":"2024-09-13T23:09:17.141806+0000","last_peered":"2024-09-13T23:09:17.141806+0000","last_clean":"2024-09-13T23:09:17.141806+0000","last_became_active":"2024-09-13T23:05:14.123513+0000","last_became_peered":"2024-09-13T23:05:14.123513+0000","last_unstale":"2024-09-13T23:09:17.141806+0000","last_undegraded":"2024-09-13T23:09:17.141806+0000","last_fullsized":"2024-09-13T23:09:17.141806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:09:17.141672+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:09:17.141672+0000","last_clean_scrub_stamp":"2024-09-13T23:09:17.141672+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:49.102998+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:07.690221+0000","last_change":"2024-09-13T23:09:07.690221+0000","last_active":"2024-09-13T23:09:07.690221+0000","last_peered":"2024-09-13T23:09:07.690221+0000","last_clean":"2024-09-13T23:09:07.690221+0000","last_became_active":"2024-09-13T23:05:12.125740+0000","last_became_peered":"2024-09-13T23:05:12.125740+0000","last_unstale":"2024-09-13T23:09:07.690221+0000","last_undegraded":"2024-09-13T23:09:07.690221+0000","last_fullsized":"2024-09-13T23:09:07.690221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:07.690053+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:07.690053+0000","last_clean_scrub_stamp":"2024-09-13T23:09:07.690053+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:34.895020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:04.232707+0000","last_change":"2024-09-13T23:09:04.232707+0000","last_active":"2024-09-13T23:09:04.232707+0000","last_peered":"2024-09-13T23:09:04.232707+0000","last_clean":"2024-09-13T23:09:04.232707+0000","last_became_active":"2024-09-13T23:05:14.109959+0000","last_became_peered":"2024-09-13T23:05:14.109959+0000","last_unstale":"2024-09-13T23:09:04.232707+0000","last_undegraded":"2024-09-13T23:09:04.232707+0000","last_fullsized":"2024-09-13T23:09:04.232707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:04.232517+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:04.232517+0000","last_clean_scrub_stamp":"2024-09-13T23:09:04.232517+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:08.232026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:22.367560+0000","last_change":"2024-09-13T23:09:22.367560+0000","last_active":"2024-09-13T23:09:22.367560+0000","last_peered":"2024-09-13T23:09:22.367560+0000","last_clean":"2024-09-13T23:09:22.367560+0000","last_became_active":"2024-09-13T23:05:12.113972+0000","last_became_peered":"2024-09-13T23:05:12.113972+0000","last_unstale":"2024-09-13T23:09:22.367560+0000","last_undegraded":"2024-09-13T23:09:22.367560+0000","last_fullsized":"2024-09-13T23:09:22.367560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:22.367433+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:22.367433+0000","last_clean_scrub_stamp":"2024-09-13T23:09:22.367433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:28:02.084357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'10","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:26.758397+0000","last_change":"2024-09-13T23:09:26.758397+0000","last_active":"2024-09-13T23:09:26.758397+0000","last_peered":"2024-09-13T23:09:26.758397+0000","last_clean":"2024-09-13T23:09:26.758397+0000","last_became_active":"2024-09-13T23:05:49.159488+0000","last_became_peered":"2024-09-13T23:05:49.159488+0000","last_unstale":"2024-09-13T23:09:26.758397+0000","last_undegraded":"2024-09-13T23:09:26.758397+0000","last_fullsized":"2024-09-13T23:09:26.758397+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T23:09:26.758280+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T23:09:26.758280+0000","last_clean_scrub_stamp":"2024-09-13T23:09:26.758280+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:12.577119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:49.549029+0000","last_change":"2024-09-13T23:09:49.549064+0000","last_active":"2024-09-13T23:09:49.549029+0000","last_peered":"2024-09-13T23:09:49.549029+0000","last_clean":"2024-09-13T23:09:49.549029+0000","last_became_active":"2024-09-13T23:05:12.139673+0000","last_became_peered":"2024-09-13T23:05:12.139673+0000","last_unstale":"2024-09-13T23:09:49.549029+0000","last_undegraded":"2024-09-13T23:09:49.549029+0000","last_fullsized":"2024-09-13T23:09:49.549029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:49.548927+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:49.548927+0000","last_clean_scrub_stamp":"2024-09-13T23:09:49.548927+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:44:43.285834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:08.208070+0000","last_change":"2024-09-13T23:09:08.208070+0000","last_active":"2024-09-13T23:09:08.208070+0000","last_peered":"2024-09-13T23:09:08.208070+0000","last_clean":"2024-09-13T23:09:08.208070+0000","last_became_active":"2024-09-13T23:05:14.112168+0000","last_became_peered":"2024-09-13T23:05:14.112168+0000","last_unstale":"2024-09-13T23:09:08.208070+0000","last_undegraded":"2024-09-13T23:09:08.208070+0000","last_fullsized":"2024-09-13T23:09:08.208070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T23:09:08.207945+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T23:09:08.207945+0000","last_clean_scrub_stamp":"2024-09-13T23:09:08.207945+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:40.610882+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:27.313942+0000","last_change":"2024-09-13T23:09:27.313969+0000","last_active":"2024-09-13T23:09:27.313942+0000","last_peered":"2024-09-13T23:09:27.313942+0000","last_clean":"2024-09-13T23:09:27.313942+0000","last_became_active":"2024-09-13T23:05:12.118425+0000","last_became_peered":"2024-09-13T23:05:12.118425+0000","last_unstale":"2024-09-13T23:09:27.313942+0000","last_undegraded":"2024-09-13T23:09:27.313942+0000","last_fullsized":"2024-09-13T23:09:27.313942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:27.313818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:27.313818+0000","last_clean_scrub_stamp":"2024-09-13T23:09:27.313818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:21.569626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'14","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:18.302991+0000","last_change":"2024-09-13T23:09:18.302991+0000","last_active":"2024-09-13T23:09:18.302991+0000","last_peered":"2024-09-13T23:09:18.302991+0000","last_clean":"2024-09-13T23:09:18.302991+0000","last_became_active":"2024-09-13T23:05:14.120456+0000","last_became_peered":"2024-09-13T23:05:14.120456+0000","last_unstale":"2024-09-13T23:09:18.302991+0000","last_undegraded":"2024-09-13T23:09:18.302991+0000","last_fullsized":"2024-09-13T23:09:18.302991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-13T23:09:18.302866+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-13T23:09:18.302866+0000","last_clean_scrub_stamp":"2024-09-13T23:09:18.302866+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:33.793181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:23.369585+0000","last_change":"2024-09-13T23:09:23.369585+0000","last_active":"2024-09-13T23:09:23.369585+0000","last_peered":"2024-09-13T23:09:23.369585+0000","last_clean":"2024-09-13T23:09:23.369585+0000","last_became_active":"2024-09-13T23:05:12.114046+0000","last_became_peered":"2024-09-13T23:05:12.114046+0000","last_unstale":"2024-09-13T23:09:23.369585+0000","last_undegraded":"2024-09-13T23:09:23.369585+0000","last_fullsized":"2024-09-13T23:09:23.369585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:23.369464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:23.369464+0000","last_clean_scrub_stamp":"2024-09-13T23:09:23.369464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:11.044148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:27.144683+0000","last_change":"2024-09-13T23:09:27.144683+0000","last_active":"2024-09-13T23:09:27.144683+0000","last_peered":"2024-09-13T23:09:27.144683+0000","last_clean":"2024-09-13T23:09:27.144683+0000","last_became_active":"2024-09-13T23:05:14.123783+0000","last_became_peered":"2024-09-13T23:05:14.123783+0000","last_unstale":"2024-09-13T23:09:27.144683+0000","last_undegraded":"2024-09-13T23:09:27.144683+0000","last_fullsized":"2024-09-13T23:09:27.144683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:27.144522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:27.144522+0000","last_clean_scrub_stamp":"2024-09-13T23:09:27.144522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:21.400330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:14.109600+0000","last_change":"2024-09-13T23:09:14.109600+0000","last_active":"2024-09-13T23:09:14.109600+0000","last_peered":"2024-09-13T23:09:14.109600+0000","last_clean":"2024-09-13T23:09:14.109600+0000","last_became_active":"2024-09-13T23:05:12.137465+0000","last_became_peered":"2024-09-13T23:05:12.137465+0000","last_unstale":"2024-09-13T23:09:14.109600+0000","last_undegraded":"2024-09-13T23:09:14.109600+0000","last_fullsized":"2024-09-13T23:09:14.109600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:14.109435+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:14.109435+0000","last_clean_scrub_stamp":"2024-09-13T23:09:14.109435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:22.061050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:03.259762+0000","last_change":"2024-09-13T23:09:03.259762+0000","last_active":"2024-09-13T23:09:03.259762+0000","last_peered":"2024-09-13T23:09:03.259762+0000","last_clean":"2024-09-13T23:09:03.259762+0000","last_became_active":"2024-09-13T23:05:14.121425+0000","last_became_peered":"2024-09-13T23:05:14.121425+0000","last_unstale":"2024-09-13T23:09:03.259762+0000","last_undegraded":"2024-09-13T23:09:03.259762+0000","last_fullsized":"2024-09-13T23:09:03.259762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:03.259607+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:03.259607+0000","last_clean_scrub_stamp":"2024-09-13T23:09:03.259607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:17.228503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:15.673456+0000","last_change":"2024-09-13T23:09:15.673456+0000","last_active":"2024-09-13T23:09:15.673456+0000","last_peered":"2024-09-13T23:09:15.673456+0000","last_clean":"2024-09-13T23:09:15.673456+0000","last_became_active":"2024-09-13T23:05:12.115546+0000","last_became_peered":"2024-09-13T23:05:12.115546+0000","last_unstale":"2024-09-13T23:09:15.673456+0000","last_undegraded":"2024-09-13T23:09:15.673456+0000","last_fullsized":"2024-09-13T23:09:15.673456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:15.673343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:15.673343+0000","last_clean_scrub_stamp":"2024-09-13T23:09:15.673343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:52.254618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:11.116761+0000","last_change":"2024-09-13T23:09:11.116761+0000","last_active":"2024-09-13T23:09:11.116761+0000","last_peered":"2024-09-13T23:09:11.116761+0000","last_clean":"2024-09-13T23:09:11.116761+0000","last_became_active":"2024-09-13T23:05:14.122944+0000","last_became_peered":"2024-09-13T23:05:14.122944+0000","last_unstale":"2024-09-13T23:09:11.116761+0000","last_undegraded":"2024-09-13T23:09:11.116761+0000","last_fullsized":"2024-09-13T23:09:11.116761+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T23:09:11.116646+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T23:09:11.116646+0000","last_clean_scrub_stamp":"2024-09-13T23:09:11.116646+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:13.491798+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:17.266434+0000","last_change":"2024-09-13T23:09:17.266434+0000","last_active":"2024-09-13T23:09:17.266434+0000","last_peered":"2024-09-13T23:09:17.266434+0000","last_clean":"2024-09-13T23:09:17.266434+0000","last_became_active":"2024-09-13T23:05:12.118347+0000","last_became_peered":"2024-09-13T23:05:12.118347+0000","last_unstale":"2024-09-13T23:09:17.266434+0000","last_undegraded":"2024-09-13T23:09:17.266434+0000","last_fullsized":"2024-09-13T23:09:17.266434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:17.266296+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:17.266296+0000","last_clean_scrub_stamp":"2024-09-13T23:09:17.266296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:09:23.350084+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'8","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:52.144724+0000","last_change":"2024-09-13T23:08:52.144724+0000","last_active":"2024-09-13T23:08:52.144724+0000","last_peered":"2024-09-13T23:08:52.144724+0000","last_clean":"2024-09-13T23:08:52.144724+0000","last_became_active":"2024-09-13T23:05:14.124593+0000","last_became_peered":"2024-09-13T23:05:14.124593+0000","last_unstale":"2024-09-13T23:08:52.144724+0000","last_undegraded":"2024-09-13T23:08:52.144724+0000","last_fullsized":"2024-09-13T23:08:52.144724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T23:08:52.144556+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T23:08:52.144556+0000","last_clean_scrub_stamp":"2024-09-13T23:08:52.144556+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:42.175168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:28.374614+0000","last_change":"2024-09-13T23:09:28.374614+0000","last_active":"2024-09-13T23:09:28.374614+0000","last_peered":"2024-09-13T23:09:28.374614+0000","last_clean":"2024-09-13T23:09:28.374614+0000","last_became_active":"2024-09-13T23:05:12.141628+0000","last_became_peered":"2024-09-13T23:05:12.141628+0000","last_unstale":"2024-09-13T23:09:28.374614+0000","last_undegraded":"2024-09-13T23:09:28.374614+0000","last_fullsized":"2024-09-13T23:09:28.374614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:28.374441+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:28.374441+0000","last_clean_scrub_stamp":"2024-09-13T23:09:28.374441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:02:48.649334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:07.305307+0000","last_change":"2024-09-13T23:09:07.305307+0000","last_active":"2024-09-13T23:09:07.305307+0000","last_peered":"2024-09-13T23:09:07.305307+0000","last_clean":"2024-09-13T23:09:07.305307+0000","last_became_active":"2024-09-13T23:05:14.113710+0000","last_became_peered":"2024-09-13T23:05:14.113710+0000","last_unstale":"2024-09-13T23:09:07.305307+0000","last_undegraded":"2024-09-13T23:09:07.305307+0000","last_fullsized":"2024-09-13T23:09:07.305307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:07.305196+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:07.305196+0000","last_clean_scrub_stamp":"2024-09-13T23:09:07.305196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:09.207268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:15.319854+0000","last_change":"2024-09-13T23:09:15.319854+0000","last_active":"2024-09-13T23:09:15.319854+0000","last_peered":"2024-09-13T23:09:15.319854+0000","last_clean":"2024-09-13T23:09:15.319854+0000","last_became_active":"2024-09-13T23:05:12.118716+0000","last_became_peered":"2024-09-13T23:05:12.118716+0000","last_unstale":"2024-09-13T23:09:15.319854+0000","last_undegraded":"2024-09-13T23:09:15.319854+0000","last_fullsized":"2024-09-13T23:09:15.319854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:15.319694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:15.319694+0000","last_clean_scrub_stamp":"2024-09-13T23:09:15.319694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:48.887827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:16.300578+0000","last_change":"2024-09-13T23:09:16.300578+0000","last_active":"2024-09-13T23:09:16.300578+0000","last_peered":"2024-09-13T23:09:16.300578+0000","last_clean":"2024-09-13T23:09:16.300578+0000","last_became_active":"2024-09-13T23:05:14.120489+0000","last_became_peered":"2024-09-13T23:05:14.120489+0000","last_unstale":"2024-09-13T23:09:16.300578+0000","last_undegraded":"2024-09-13T23:09:16.300578+0000","last_fullsized":"2024-09-13T23:09:16.300578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:16.300464+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:16.300464+0000","last_clean_scrub_stamp":"2024-09-13T23:09:16.300464+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:11:03.837494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:08.181573+0000","last_change":"2024-09-13T23:09:08.181573+0000","last_active":"2024-09-13T23:09:08.181573+0000","last_peered":"2024-09-13T23:09:08.181573+0000","last_clean":"2024-09-13T23:09:08.181573+0000","last_became_active":"2024-09-13T23:05:12.137735+0000","last_became_peered":"2024-09-13T23:05:12.137735+0000","last_unstale":"2024-09-13T23:09:08.181573+0000","last_undegraded":"2024-09-13T23:09:08.181573+0000","last_fullsized":"2024-09-13T23:09:08.181573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:08.181438+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:08.181438+0000","last_clean_scrub_stamp":"2024-09-13T23:09:08.181438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:17:01.878876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:03.187963+0000","last_change":"2024-09-13T23:09:03.187963+0000","last_active":"2024-09-13T23:09:03.187963+0000","last_peered":"2024-09-13T23:09:03.187963+0000","last_clean":"2024-09-13T23:09:03.187963+0000","last_became_active":"2024-09-13T23:05:14.121389+0000","last_became_peered":"2024-09-13T23:05:14.121389+0000","last_unstale":"2024-09-13T23:09:03.187963+0000","last_undegraded":"2024-09-13T23:09:03.187963+0000","last_fullsized":"2024-09-13T23:09:03.187963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:03.187749+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:03.187749+0000","last_clean_scrub_stamp":"2024-09-13T23:09:03.187749+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:13.849825+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:18.114936+0000","last_change":"2024-09-13T23:09:18.114936+0000","last_active":"2024-09-13T23:09:18.114936+0000","last_peered":"2024-09-13T23:09:18.114936+0000","last_clean":"2024-09-13T23:09:18.114936+0000","last_became_active":"2024-09-13T23:05:12.137118+0000","last_became_peered":"2024-09-13T23:05:12.137118+0000","last_unstale":"2024-09-13T23:09:18.114936+0000","last_undegraded":"2024-09-13T23:09:18.114936+0000","last_fullsized":"2024-09-13T23:09:18.114936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:18.114817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:18.114817+0000","last_clean_scrub_stamp":"2024-09-13T23:09:18.114817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:13:09.651355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'4","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:54.159390+0000","last_change":"2024-09-13T23:08:54.159390+0000","last_active":"2024-09-13T23:08:54.159390+0000","last_peered":"2024-09-13T23:08:54.159390+0000","last_clean":"2024-09-13T23:08:54.159390+0000","last_became_active":"2024-09-13T23:05:14.124507+0000","last_became_peered":"2024-09-13T23:05:14.124507+0000","last_unstale":"2024-09-13T23:08:54.159390+0000","last_undegraded":"2024-09-13T23:08:54.159390+0000","last_fullsized":"2024-09-13T23:08:54.159390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:08:54.159267+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:08:54.159267+0000","last_clean_scrub_stamp":"2024-09-13T23:08:54.159267+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:56.506120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:39.535962+0000","last_change":"2024-09-13T23:09:39.535962+0000","last_active":"2024-09-13T23:09:39.535962+0000","last_peered":"2024-09-13T23:09:39.535962+0000","last_clean":"2024-09-13T23:09:39.535962+0000","last_became_active":"2024-09-13T23:05:12.138577+0000","last_became_peered":"2024-09-13T23:05:12.138577+0000","last_unstale":"2024-09-13T23:09:39.535962+0000","last_undegraded":"2024-09-13T23:09:39.535962+0000","last_fullsized":"2024-09-13T23:09:39.535962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:39.535838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:39.535838+0000","last_clean_scrub_stamp":"2024-09-13T23:09:39.535838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:16.833864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:02.166179+0000","last_change":"2024-09-13T23:09:02.166179+0000","last_active":"2024-09-13T23:09:02.166179+0000","last_peered":"2024-09-13T23:09:02.166179+0000","last_clean":"2024-09-13T23:09:02.166179+0000","last_became_active":"2024-09-13T23:05:14.124604+0000","last_became_peered":"2024-09-13T23:05:14.124604+0000","last_unstale":"2024-09-13T23:09:02.166179+0000","last_undegraded":"2024-09-13T23:09:02.166179+0000","last_fullsized":"2024-09-13T23:09:02.166179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:02.166057+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:02.166057+0000","last_clean_scrub_stamp":"2024-09-13T23:09:02.166057+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:42.683656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:35.450644+0000","last_change":"2024-09-13T23:09:35.450644+0000","last_active":"2024-09-13T23:09:35.450644+0000","last_peered":"2024-09-13T23:09:35.450644+0000","last_clean":"2024-09-13T23:09:35.450644+0000","last_became_active":"2024-09-13T23:05:12.140686+0000","last_became_peered":"2024-09-13T23:05:12.140686+0000","last_unstale":"2024-09-13T23:09:35.450644+0000","last_undegraded":"2024-09-13T23:09:35.450644+0000","last_fullsized":"2024-09-13T23:09:35.450644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:35.450514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:35.450514+0000","last_clean_scrub_stamp":"2024-09-13T23:09:35.450514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:54:14.171644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:50.447124+0000","last_change":"2024-09-13T23:08:50.447124+0000","last_active":"2024-09-13T23:08:50.447124+0000","last_peered":"2024-09-13T23:08:50.447124+0000","last_clean":"2024-09-13T23:08:50.447124+0000","last_became_active":"2024-09-13T23:05:14.125747+0000","last_became_peered":"2024-09-13T23:05:14.125747+0000","last_unstale":"2024-09-13T23:08:50.447124+0000","last_undegraded":"2024-09-13T23:08:50.447124+0000","last_fullsized":"2024-09-13T23:08:50.447124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T23:08:50.447009+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T23:08:50.447009+0000","last_clean_scrub_stamp":"2024-09-13T23:08:50.447009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:55.562708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:11.744140+0000","last_change":"2024-09-13T23:09:11.744140+0000","last_active":"2024-09-13T23:09:11.744140+0000","last_peered":"2024-09-13T23:09:11.744140+0000","last_clean":"2024-09-13T23:09:11.744140+0000","last_became_active":"2024-09-13T23:05:12.126202+0000","last_became_peered":"2024-09-13T23:05:12.126202+0000","last_unstale":"2024-09-13T23:09:11.744140+0000","last_undegraded":"2024-09-13T23:09:11.744140+0000","last_fullsized":"2024-09-13T23:09:11.744140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:11.743996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:11.743996+0000","last_clean_scrub_stamp":"2024-09-13T23:09:11.743996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:55:43.578151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:55.125462+0000","last_change":"2024-09-13T23:08:55.125462+0000","last_active":"2024-09-13T23:08:55.125462+0000","last_peered":"2024-09-13T23:08:55.125462+0000","last_clean":"2024-09-13T23:08:55.125462+0000","last_became_active":"2024-09-13T23:05:14.125457+0000","last_became_peered":"2024-09-13T23:05:14.125457+0000","last_unstale":"2024-09-13T23:08:55.125462+0000","last_undegraded":"2024-09-13T23:08:55.125462+0000","last_fullsized":"2024-09-13T23:08:55.125462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:08:55.125347+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:08:55.125347+0000","last_clean_scrub_stamp":"2024-09-13T23:08:55.125347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:52:24.032476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:22.245297+0000","last_change":"2024-09-13T23:09:22.245297+0000","last_active":"2024-09-13T23:09:22.245297+0000","last_peered":"2024-09-13T23:09:22.245297+0000","last_clean":"2024-09-13T23:09:22.245297+0000","last_became_active":"2024-09-13T23:05:12.149345+0000","last_became_peered":"2024-09-13T23:05:12.149345+0000","last_unstale":"2024-09-13T23:09:22.245297+0000","last_undegraded":"2024-09-13T23:09:22.245297+0000","last_fullsized":"2024-09-13T23:09:22.245297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:09:22.245177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:09:22.245177+0000","last_clean_scrub_stamp":"2024-09-13T23:09:22.245177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:23:42.634877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:29.410280+0000","last_change":"2024-09-13T23:09:29.410280+0000","last_active":"2024-09-13T23:09:29.410280+0000","last_peered":"2024-09-13T23:09:29.410280+0000","last_clean":"2024-09-13T23:09:29.410280+0000","last_became_active":"2024-09-13T23:05:12.140432+0000","last_became_peered":"2024-09-13T23:05:12.140432+0000","last_unstale":"2024-09-13T23:09:29.410280+0000","last_undegraded":"2024-09-13T23:09:29.410280+0000","last_fullsized":"2024-09-13T23:09:29.410280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T23:09:29.410108+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T23:09:29.410108+0000","last_clean_scrub_stamp":"2024-09-13T23:09:29.410108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:12.999465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'16","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:08:59.214240+0000","last_change":"2024-09-13T23:08:59.214240+0000","last_active":"2024-09-13T23:08:59.214240+0000","last_peered":"2024-09-13T23:08:59.214240+0000","last_clean":"2024-09-13T23:08:59.214240+0000","last_became_active":"2024-09-13T23:05:14.122105+0000","last_became_peered":"2024-09-13T23:05:14.122105+0000","last_unstale":"2024-09-13T23:08:59.214240+0000","last_undegraded":"2024-09-13T23:08:59.214240+0000","last_fullsized":"2024-09-13T23:08:59.214240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T23:08:59.214060+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T23:08:59.214060+0000","last_clean_scrub_stamp":"2024-09-13T23:08:59.214060+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:09.073630+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:11.352289+0000","last_change":"2024-09-13T23:09:11.352289+0000","last_active":"2024-09-13T23:09:11.352289+0000","last_peered":"2024-09-13T23:09:11.352289+0000","last_clean":"2024-09-13T23:09:11.352289+0000","last_became_active":"2024-09-13T23:05:12.120703+0000","last_became_peered":"2024-09-13T23:05:12.120703+0000","last_unstale":"2024-09-13T23:09:11.352289+0000","last_undegraded":"2024-09-13T23:09:11.352289+0000","last_fullsized":"2024-09-13T23:09:11.352289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T23:09:11.352120+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T23:09:11.352120+0000","last_clean_scrub_stamp":"2024-09-13T23:09:11.352120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:42:29.036211+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'10","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T23:09:07.162805+0000","last_change":"2024-09-13T23:09:07.162805+0000","last_active":"2024-09-13T23:09:07.162805+0000","last_peered":"2024-09-13T23:09:07.162805+0000","last_clean":"2024-09-13T23:09:07.162805+0000","last_became_active":"2024-09-13T23:05:14.121636+0000","last_became_peered":"2024-09-13T23:05:14.121636+0000","last_unstale":"2024-09-13T23:09:07.162805+0000","last_undegraded":"2024-09-13T23:09:07.162805+0000","last_fullsized":"2024-09-13T23:09:07.162805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T23:09:07.162687+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T23:09:07.162687+0000","last_clean_scrub_stamp":"2024-09-13T23:09:07.162687+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:33.457982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1527,"ondisk_log_size":1527,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1600,"num_read_kb":1490,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":12,"seq":51539607620,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":151994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640322,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40492,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331348,"statfs":{"total":96636764160,"available":96595300352,"internally_reserved":0,"allocated":1011712,"data_stored":739728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705731,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40520,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331320,"statfs":{"total":96636764160,"available":96595271680,"internally_reserved":0,"allocated":1040384,"data_stored":741822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705731,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":446464,"data_stored":151868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T23:10:15.572 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T23:10:15.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.694+0000 7faf6a733640 1 Processor -- start 2024-09-13T23:10:15.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.694+0000 7faf6a733640 1 -- start start 2024-09-13T23:10:15.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.694+0000 7faf6a733640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7faf6406eda0 0x7faf6406f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:15.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.695+0000 7faf6a733640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf6406eba0 con 0x7faf6406f6c0 2024-09-13T23:10:15.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.695+0000 7faf6a733640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 -- 0x7faf6406d2f0 con 0x7faf6406eda0 2024-09-13T23:10:15.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.695+0000 7faf63fff640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7faf6406eda0 0x7faf6406f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:15.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.695+0000 7faf637fe640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7faf6406f6c0 0x7faf64121a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:35472/0 (socket says 172.21.15.17:35472) 2024-09-13T23:10:15.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.695+0000 7faf637fe640 1 -- 172.21.15.17:0/1904423465 learned_addr learned my addr 172.21.15.17:0/1904423465 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-09-13T23:10:15.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.695+0000 7faf63fff640 1 -- 172.21.15.17:0/1904423465 >> v1:172.21.15.17:6789/0 conn(0x7faf6406f6c0 legacy=0x7faf64121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:15.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.695+0000 7faf63fff640 1 -- 172.21.15.17:0/1904423465 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf64070d50 con 0x7faf6406eda0 2024-09-13T23:10:15.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.696+0000 7faf63fff640 1 --2- 172.21.15.17:0/1904423465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf6406eda0 0x7faf6406f180 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7faf54009720 tx=0x7faf5402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3cd492d05cbf3a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:15.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.696+0000 7faf62ffd640 1 -- 172.21.15.17:0/1904423465 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf54037070 con 0x7faf6406eda0 2024-09-13T23:10:15.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.696+0000 7faf62ffd640 1 -- 172.21.15.17:0/1904423465 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf5402ae20 con 0x7faf6406eda0 2024-09-13T23:10:15.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.696+0000 7faf62ffd640 1 -- 172.21.15.17:0/1904423465 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf54032590 con 0x7faf6406eda0 2024-09-13T23:10:15.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.696+0000 7faf6a733640 1 -- 172.21.15.17:0/1904423465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf6406eda0 msgr2=0x7faf6406f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:15.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.696+0000 7faf6a733640 1 --2- 172.21.15.17:0/1904423465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf6406eda0 0x7faf6406f180 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7faf54009720 tx=0x7faf5402a1a0 comp rx=0 tx=0).stop 2024-09-13T23:10:15.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.696+0000 7faf6a733640 1 -- 172.21.15.17:0/1904423465 shutdown_connections 2024-09-13T23:10:15.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.696+0000 7faf6a733640 1 --2- 172.21.15.17:0/1904423465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf6406eda0 0x7faf6406f180 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:15.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.696+0000 7faf6a733640 1 -- 172.21.15.17:0/1904423465 >> 172.21.15.17:0/1904423465 conn(0x7faf6409a890 msgr2=0x7faf6409aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:15.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.696+0000 7faf6a733640 1 -- 172.21.15.17:0/1904423465 shutdown_connections 2024-09-13T23:10:15.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.696+0000 7faf6a733640 1 -- 172.21.15.17:0/1904423465 wait complete. 2024-09-13T23:10:15.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.697+0000 7faf6a733640 1 Processor -- start 2024-09-13T23:10:15.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.697+0000 7faf6a733640 1 -- start start 2024-09-13T23:10:15.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.698+0000 7faf6a733640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf6406eda0 0x7faf641c37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:15.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.698+0000 7faf6a733640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7faf64122160 con 0x7faf6406eda0 2024-09-13T23:10:15.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.698+0000 7faf63fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf6406eda0 0x7faf641c37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:15.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.698+0000 7faf63fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf6406eda0 0x7faf641c37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56036/0 (socket says 172.21.15.17:56036) 2024-09-13T23:10:15.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.698+0000 7faf63fff640 1 -- 172.21.15.17:0/619832668 learned_addr learned my addr 172.21.15.17:0/619832668 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-13T23:10:15.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.698+0000 7faf63fff640 1 -- 172.21.15.17:0/619832668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf640914b0 con 0x7faf6406eda0 2024-09-13T23:10:15.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.698+0000 7faf63fff640 1 --2- 172.21.15.17:0/619832668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf6406eda0 0x7faf641c37c0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7faf5402a1e0 tx=0x7faf540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:15.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.698+0000 7faf60ff9640 1 -- 172.21.15.17:0/619832668 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf54042070 con 0x7faf6406eda0 2024-09-13T23:10:15.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.699+0000 7faf60ff9640 1 -- 172.21.15.17:0/619832668 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf5403e670 con 0x7faf6406eda0 2024-09-13T23:10:15.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.699+0000 7faf6a733640 1 -- 172.21.15.17:0/619832668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf640903c0 con 0x7faf6406eda0 2024-09-13T23:10:15.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.699+0000 7faf60ff9640 1 -- 172.21.15.17:0/619832668 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf54037040 con 0x7faf6406eda0 2024-09-13T23:10:15.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.699+0000 7faf6a733640 1 -- 172.21.15.17:0/619832668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf641c3d00 con 0x7faf6406eda0 2024-09-13T23:10:15.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.700+0000 7faf60ff9640 1 -- 172.21.15.17:0/619832668 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7faf54045070 con 0x7faf6406eda0 2024-09-13T23:10:15.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.700+0000 7faf6a733640 1 -- 172.21.15.17:0/619832668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf64122670 con 0x7faf6406eda0 2024-09-13T23:10:15.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.700+0000 7faf60ff9640 1 --2- 172.21.15.17:0/619832668 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faf500382d0 0x7faf5003a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:15.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.700+0000 7faf60ff9640 1 -- 172.21.15.17:0/619832668 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7faf5406c740 con 0x7faf6406eda0 2024-09-13T23:10:15.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.700+0000 7faf637fe640 1 --2- 172.21.15.17:0/619832668 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faf500382d0 0x7faf5003a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:15.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.701+0000 7faf637fe640 1 --2- 172.21.15.17:0/619832668 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faf500382d0 0x7faf5003a790 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7faf58000f60 tx=0x7faf58007a80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:15.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.704+0000 7faf60ff9640 1 -- 172.21.15.17:0/619832668 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faf5403c7b0 con 0x7faf6406eda0 2024-09-13T23:10:15.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.880+0000 7faf6a733640 1 -- 172.21.15.17:0/619832668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7faf64126f00 con 0x7faf6406eda0 2024-09-13T23:10:15.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.882+0000 7faf60ff9640 1 -- 172.21.15.17:0/619832668 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7faf5402ae20 con 0x7faf6406eda0 2024-09-13T23:10:15.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.883+0000 7faf60ff9640 1 -- 172.21.15.17:0/619832668 <== mon.0 v2:172.21.15.17:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7faf540463b0 con 0x7faf6406eda0 2024-09-13T23:10:15.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.885+0000 7faf6a733640 1 -- 172.21.15.17:0/619832668 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faf500382d0 msgr2=0x7faf5003a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:15.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.885+0000 7faf6a733640 1 --2- 172.21.15.17:0/619832668 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faf500382d0 0x7faf5003a790 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7faf58000f60 tx=0x7faf58007a80 comp rx=0 tx=0).stop 2024-09-13T23:10:15.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.885+0000 7faf6a733640 1 -- 172.21.15.17:0/619832668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf6406eda0 msgr2=0x7faf641c37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:15.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.885+0000 7faf6a733640 1 --2- 172.21.15.17:0/619832668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf6406eda0 0x7faf641c37c0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7faf5402a1e0 tx=0x7faf540046c0 comp rx=0 tx=0).stop 2024-09-13T23:10:15.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.885+0000 7faf6a733640 1 -- 172.21.15.17:0/619832668 shutdown_connections 2024-09-13T23:10:15.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.885+0000 7faf6a733640 1 --2- 172.21.15.17:0/619832668 >> [v2:172.21.15.164:6824/713838566,v1:172.21.15.164:6825/713838566] conn(0x7faf500382d0 0x7faf5003a790 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:15.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.885+0000 7faf6a733640 1 --2- 172.21.15.17:0/619832668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf6406eda0 0x7faf641c37c0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:15.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.885+0000 7faf6a733640 1 -- 172.21.15.17:0/619832668 >> 172.21.15.17:0/619832668 conn(0x7faf6409a890 msgr2=0x7faf641293b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:15.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.885+0000 7faf6a733640 1 -- 172.21.15.17:0/619832668 shutdown_connections 2024-09-13T23:10:15.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-13T23:10:15.885+0000 7faf6a733640 1 -- 172.21.15.17:0/619832668 wait complete. 2024-09-13T23:10:15.897 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T23:10:15.897 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T23:10:15.898 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T23:10:15.898 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T23:10:15.932 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T23:10:15.932 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T23:10:15.932 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T23:10:15.961 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T23:10:15.961 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T23:10:15.961 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T23:10:16.033 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T23:10:16.033 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T23:10:16.033 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T23:10:16.104 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T23:10:16.104 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T23:10:16.104 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T23:10:16.104 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T23:10:16.174 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T23:10:16.174 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T23:10:16.174 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T23:10:16.174 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T23:10:16.186 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T23:10:16.186 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T23:10:16.186 DEBUG:teuthology.orchestra.run.smithi017:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-13T23:10:16.257 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-13T23:10:16.257 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T23:10:16.415 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-13T23:10:16.416 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T23:10:16.535 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-13T23:10:16.535 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T23:10:16.617 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-13T23:10:16.617 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T23:10:16.674 INFO:tasks.ceph:Archiving mon data... 2024-09-13T23:10:16.675 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-13_21:40:02-rgw-squid-distro-default-smithi/7904378/data/mon.a.tgz 2024-09-13T23:10:16.675 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2024-09-13T23:10:16.693 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.ThxP8Zv5Bk 2024-09-13T23:10:16.694 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ThxP8Zv5Bk 2024-09-13T23:10:16.901 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.ThxP8Zv5Bk 2024-09-13T23:10:16.988 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.ThxP8Zv5Bk is 277KB 2024-09-13T23:10:17.083 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.ThxP8Zv5Bk 2024-09-13T23:10:17.099 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T23:10:17.099 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T23:10:17.141 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T23:10:17.222 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-13T23:10:17.241 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-13T23:10:17.241 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T23:10:17.242 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_21:40:02-rgw-squid-distro-default-smithi/7904378/remote/smithi017/crash 2024-09-13T23:10:17.243 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T23:10:17.289 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_21:40:02-rgw-squid-distro-default-smithi/7904378/remote/smithi164/crash 2024-09-13T23:10:17.290 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T23:10:17.334 INFO:tasks.ceph:Compressing logs... 2024-09-13T23:10:17.334 DEBUG:teuthology.orchestra.run.smithi017:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T23:10:17.337 DEBUG:teuthology.orchestra.run.smithi164:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T23:10:17.360 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-13T23:10:17.361 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31323.log 2024-09-13T23:10:17.361 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30402.log 2024-09-13T23:10:17.378 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.31323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31407.log 2024-09-13T23:10:17.378 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30402.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.31323.log.gz 2024-09-13T23:10:17.378 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31575.log 2024-09-13T23:10:17.378 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.30402.log.gz 2024-09-13T23:10:17.378 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31155.log 2024-09-13T23:10:17.378 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.31407.log: /var/log/ceph/ceph-client.admin.31575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31827.log 2024-09-13T23:10:17.378 INFO:teuthology.orchestra.run.smithi017.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.31407.log.gz 2024-09-13T23:10:17.378 INFO:teuthology.orchestra.run.smithi017.stderr: 87.0%/var/log/ceph/ceph-client.admin.31155.log: -- replaced with /var/log/ceph/ceph-client.admin.31575.log.gz 2024-09-13T23:10:17.378 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31701.log 2024-09-13T23:10:17.379 INFO:teuthology.orchestra.run.smithi017.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31155.log.gz 2024-09-13T23:10:17.379 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.31827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30889.log 2024-09-13T23:10:17.379 INFO:teuthology.orchestra.run.smithi017.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31827.log.gz/var/log/ceph/ceph-client.admin.31701.log: 2024-09-13T23:10:17.379 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28884.log 2024-09-13T23:10:17.379 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30889.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.31701.log.gz 2024-09-13T23:10:17.379 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30405.log 2024-09-13T23:10:17.379 INFO:teuthology.orchestra.run.smithi017.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.30889.log.gz 2024-09-13T23:10:17.379 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.28884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31449.log 2024-09-13T23:10:17.379 INFO:teuthology.orchestra.run.smithi017.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.28884.log.gz 2024-09-13T23:10:17.379 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30571.log 2024-09-13T23:10:17.379 INFO:teuthology.orchestra.run.smithi017.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.30405.log.gz 2024-09-13T23:10:17.379 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.31449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30404.log 2024-09-13T23:10:17.379 INFO:teuthology.orchestra.run.smithi017.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31449.log.gz 2024-09-13T23:10:17.379 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30573.log 2024-09-13T23:10:17.380 INFO:teuthology.orchestra.run.smithi017.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.30571.log.gz 2024-09-13T23:10:17.380 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30087.log 2024-09-13T23:10:17.380 INFO:teuthology.orchestra.run.smithi017.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.30404.log.gz 2024-09-13T23:10:17.380 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30929.log 2024-09-13T23:10:17.380 INFO:teuthology.orchestra.run.smithi017.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.30573.log.gz 2024-09-13T23:10:17.380 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31912.log 2024-09-13T23:10:17.380 INFO:teuthology.orchestra.run.smithi017.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30087.log.gz 2024-09-13T23:10:17.380 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31059.log 2024-09-13T23:10:17.380 INFO:teuthology.orchestra.run.smithi017.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.30929.log.gz 2024-09-13T23:10:17.380 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.31912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31017.log 2024-09-13T23:10:17.380 INFO:teuthology.orchestra.run.smithi017.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31912.log.gz 2024-09-13T23:10:17.380 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.31059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29040.log 2024-09-13T23:10:17.380 INFO:teuthology.orchestra.run.smithi017.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31059.log.gz 2024-09-13T23:10:17.381 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.31017.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-13T23:10:17.381 INFO:teuthology.orchestra.run.smithi017.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31017.log.gz 2024-09-13T23:10:17.381 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.29040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29941.log 2024-09-13T23:10:17.381 INFO:teuthology.orchestra.run.smithi017.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.29040.log.gz 2024-09-13T23:10:17.381 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31533.log 2024-09-13T23:10:17.381 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.29941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30570.log 2024-09-13T23:10:17.381 INFO:teuthology.orchestra.run.smithi017.stderr: 88.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-13T23:10:17.381 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.31533.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.29941.log.gz 2024-09-13T23:10:17.381 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30681.log 2024-09-13T23:10:17.381 INFO:teuthology.orchestra.run.smithi017.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.31533.log.gz 2024-09-13T23:10:17.381 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30168.log 2024-09-13T23:10:17.381 INFO:teuthology.orchestra.run.smithi017.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.30570.log.gz 2024-09-13T23:10:17.381 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29002.log 2024-09-13T23:10:17.382 INFO:teuthology.orchestra.run.smithi017.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30681.log.gz 2024-09-13T23:10:17.382 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31239.log 2024-09-13T23:10:17.382 INFO:teuthology.orchestra.run.smithi017.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.30168.log.gz 2024-09-13T23:10:17.382 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.29002.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-13T23:10:17.382 INFO:teuthology.orchestra.run.smithi017.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.29002.log.gz 2024-09-13T23:10:17.382 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.31239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31785.log 2024-09-13T23:10:17.382 INFO:teuthology.orchestra.run.smithi017.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31239.log.gz 2024-09-13T23:10:17.382 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30721.log 2024-09-13T23:10:17.382 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.31785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30403.log 2024-09-13T23:10:17.382 INFO:teuthology.orchestra.run.smithi017.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31785.log.gz 2024-09-13T23:10:17.382 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30143.log 2024-09-13T23:10:17.382 INFO:teuthology.orchestra.run.smithi017.stderr:gzip 86.3% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.30721.log.gz -- 2024-09-13T23:10:17.382 INFO:teuthology.orchestra.run.smithi017.stderr: /var/log/ceph/ceph-client.admin.30219.log 2024-09-13T23:10:17.382 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30403.log: /var/log/ceph/ceph-client.admin.30143.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.30403.log.gz 2024-09-13T23:10:17.383 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31101.log 2024-09-13T23:10:17.383 INFO:teuthology.orchestra.run.smithi017.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.30143.log.gz 2024-09-13T23:10:17.383 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31281.log 2024-09-13T23:10:17.383 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30219.log: /var/log/ceph/ceph-client.admin.31101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31743.log 2024-09-13T23:10:17.383 INFO:teuthology.orchestra.run.smithi017.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.30219.log.gz 2024-09-13T23:10:17.383 INFO:teuthology.orchestra.run.smithi017.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.31101.log.gz 2024-09-13T23:10:17.383 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.31281.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-13T23:10:17.383 INFO:teuthology.orchestra.run.smithi017.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.31281.log.gz 2024-09-13T23:10:17.383 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.31743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31197.log 2024-09-13T23:10:17.383 INFO:teuthology.orchestra.run.smithi017.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31743.log.gz 2024-09-13T23:10:17.383 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30261.log 2024-09-13T23:10:17.383 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.31197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30928.log 2024-09-13T23:10:17.383 INFO:teuthology.orchestra.run.smithi017.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31197.log.gz 2024-09-13T23:10:17.384 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30849.log 2024-09-13T23:10:17.384 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31659.log 86.4% 2024-09-13T23:10:17.384 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30261.log.gz 2024-09-13T23:10:17.384 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30928.log: /var/log/ceph/ceph-client.admin.30849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30761.log 2024-09-13T23:10:17.384 INFO:teuthology.orchestra.run.smithi017.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.30928.log.gz 2024-09-13T23:10:17.384 INFO:teuthology.orchestra.run.smithi017.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30849.log.gz 2024-09-13T23:10:17.384 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.31659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31491.log 2024-09-13T23:10:17.384 INFO:teuthology.orchestra.run.smithi017.stderr: 86.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-13T23:10:17.384 INFO:teuthology.orchestra.run.smithi017.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31659.log.gz 2024-09-13T23:10:17.384 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30572.log 2024-09-13T23:10:17.384 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30760.log 2024-09-13T23:10:17.384 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.31491.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.30761.log.gz 2024-09-13T23:10:17.384 INFO:teuthology.orchestra.run.smithi017.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.31491.log.gz 2024-09-13T23:10:17.384 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31365.log 2024-09-13T23:10:17.385 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30303.log 2024-09-13T23:10:17.385 INFO:teuthology.orchestra.run.smithi017.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.30572.log.gz 2024-09-13T23:10:17.385 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30760.log: /var/log/ceph/ceph-client.admin.31365.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.30760.log.gz 2024-09-13T23:10:17.385 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31870.log 2024-09-13T23:10:17.385 INFO:teuthology.orchestra.run.smithi017.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31365.log.gz 2024-09-13T23:10:17.385 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31617.log 2024-09-13T23:10:17.385 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30303.log: /var/log/ceph/ceph-client.admin.31870.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27173.log 2024-09-13T23:10:17.385 INFO:teuthology.orchestra.run.smithi017.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.30303.log.gz 2024-09-13T23:10:17.385 INFO:teuthology.orchestra.run.smithi017.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31870.log.gz 2024-09-13T23:10:17.385 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.31617.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31617.log.gz 2024-09-13T23:10:17.385 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph.tmp-client.admin.27173.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27173.log.gz 2024-09-13T23:10:17.413 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75920.log 2024-09-13T23:10:17.413 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55955.log 2024-09-13T23:10:17.413 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.75920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48695.log 2024-09-13T23:10:17.415 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.55955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45065.log 2024-09-13T23:10:17.416 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.48695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89805.log 2024-09-13T23:10:17.416 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39021.log 2024-09-13T23:10:17.416 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.45065.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.75920.log.gz 2024-09-13T23:10:17.416 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.89805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40225.log 2024-09-13T23:10:17.416 INFO:teuthology.orchestra.run.smithi164.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.48695.log.gz 2024-09-13T23:10:17.416 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.39021.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.55955.log.gz 2024-09-13T23:10:17.416 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73500.log 2024-09-13T23:10:17.416 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42645.log 2024-09-13T23:10:17.416 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.40225.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.45065.log.gz 2024-09-13T23:10:17.416 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.73500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87391.log 2024-09-13T23:10:17.421 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.42645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40830.log 2024-09-13T23:10:17.421 INFO:teuthology.orchestra.run.smithi164.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.39021.log.gz 2024-09-13T23:10:17.421 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.87391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51720.log 2024-09-13T23:10:17.421 INFO:teuthology.orchestra.run.smithi164.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.89805.log.gz 2024-09-13T23:10:17.421 INFO:teuthology.orchestra.run.smithi164.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.73500.log.gz 2024-09-13T23:10:17.421 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.40830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47485.log 2024-09-13T23:10:17.421 INFO:teuthology.orchestra.run.smithi164.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.40225.log.gz 2024-09-13T23:10:17.421 INFO:teuthology.orchestra.run.smithi164.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.0.87391.log.gz 2024-09-13T23:10:17.421 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.51720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60795.log 2024-09-13T23:10:17.421 INFO:teuthology.orchestra.run.smithi164.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.42645.log.gz 2024-09-13T23:10:17.422 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.47485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63215.log 2024-09-13T23:10:17.422 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.60795.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-13T23:10:17.422 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.63215.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40830.log.gz 2024-09-13T23:10:17.422 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61400.log 2024-09-13T23:10:17.422 INFO:teuthology.orchestra.run.smithi164.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.51720.log.gz 2024-09-13T23:10:17.422 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.1.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.47485.log.gz 2024-09-13T23:10:17.422 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-13T23:10:17.422 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46880.log 2024-09-13T23:10:17.422 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.61400.log: 90.9% -- replaced with /var/log/ceph/ceph-client.0.60795.log.gz 2024-09-13T23:10:17.422 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69870.log 2024-09-13T23:10:17.422 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ops-log-ceph-client.0.log: /var/log/ceph/ceph-client.0.46880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95855.log 2024-09-13T23:10:17.422 INFO:teuthology.orchestra.run.smithi164.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.63215.log.gz 2024-09-13T23:10:17.422 INFO:teuthology.orchestra.run.smithi164.stderr: 91.8% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-13T23:10:17.423 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.69870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49905.log 2024-09-13T23:10:17.423 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.95855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39626.log 2024-09-13T23:10:17.423 INFO:teuthology.orchestra.run.smithi164.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.61400.log.gz 2024-09-13T23:10:17.423 INFO:teuthology.orchestra.run.smithi164.stderr: 91.1%/var/log/ceph/ceph-client.0.49905.log: -- replaced with /var/log/ceph/ceph-client.0.46880.log.gz 2024-09-13T23:10:17.423 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63820.log 2024-09-13T23:10:17.423 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91620.log 2024-09-13T23:10:17.462 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.39626.log: /var/log/ceph/ceph-client.0.63820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89200.log 2024-09-13T23:10:17.462 INFO:teuthology.orchestra.run.smithi164.stderr: 91.0% 90.3% -- replaced with /var/log/ceph/ceph-client.0.39626.log.gz 2024-09-13T23:10:17.462 INFO:teuthology.orchestra.run.smithi164.stderr: -- replaced with /var/log/ceph/ceph-client.0.95855.log.gz 2024-09-13T23:10:17.462 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.91620.log: gzip -5 --verbose -- 92.6% /var/log/ceph/ceph-client.0.90410.log 2024-09-13T23:10:17.463 INFO:teuthology.orchestra.run.smithi164.stderr: -- replaced with /var/log/ceph/ceph-client.0.69870.log.gz 2024-09-13T23:10:17.463 INFO:teuthology.orchestra.run.smithi164.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.49905.log.gz 2024-09-13T23:10:17.463 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.89200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56560.log 2024-09-13T23:10:17.463 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.90410.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.63820.log.gz 2024-09-13T23:10:17.463 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35647.log 2024-09-13T23:10:17.463 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.56560.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.91620.log.gz 2024-09-13T23:10:17.463 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53535.log 2024-09-13T23:10:17.463 INFO:teuthology.orchestra.run.smithi164.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.89200.log.gz 2024-09-13T23:10:17.463 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57165.log 2024-09-13T23:10:17.463 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35647.log: /var/log/ceph/ceph-client.0.53535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95250.log 2024-09-13T23:10:17.463 INFO:teuthology.orchestra.run.smithi164.stderr: 86.0% 91.2% -- replaced with /var/log/ceph/ceph-client.admin.35647.log.gz -- replaced with /var/log/ceph/ceph-client.0.90410.log.gz 2024-09-13T23:10:17.463 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-09-13T23:10:17.464 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.57165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77735.log 2024-09-13T23:10:17.464 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.95250.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.56560.log.gz 2024-09-13T23:10:17.464 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31498.log 2024-09-13T23:10:17.464 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.77735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93435.log 2024-09-13T23:10:17.464 INFO:teuthology.orchestra.run.smithi164.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.53535.log.gz 2024-09-13T23:10:17.464 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.31498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96512.log 2024-09-13T23:10:17.464 INFO:teuthology.orchestra.run.smithi164.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.57165.log.gz 2024-09-13T23:10:17.464 INFO:teuthology.orchestra.run.smithi164.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.95250.log.gz 2024-09-13T23:10:17.464 INFO:teuthology.orchestra.run.smithi164.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31498.log.gz 2024-09-13T23:10:17.464 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.93435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41435.log 2024-09-13T23:10:17.464 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.96512.log: 91.3%gzip -- replaced with /var/log/ceph/ceph-client.0.77735.log.gz 2024-09-13T23:10:17.464 INFO:teuthology.orchestra.run.smithi164.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35727.log 2024-09-13T23:10:17.464 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.41435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43855.log 2024-09-13T23:10:17.465 INFO:teuthology.orchestra.run.smithi164.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.93435.log.gz 2024-09-13T23:10:17.465 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65030.log 2024-09-13T23:10:17.465 INFO:teuthology.orchestra.run.smithi164.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.35727.log.gz 2024-09-13T23:10:17.465 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.43855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58980.log 2024-09-13T23:10:17.465 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.65030.log: gzip 91.2% -5 --verbose -- replaced with /var/log/ceph/ceph-client.0.41435.log.gz -- 2024-09-13T23:10:17.465 INFO:teuthology.orchestra.run.smithi164.stderr: /var/log/ceph/ceph-client.0.44460.log 2024-09-13T23:10:17.465 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.58980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64425.log 2024-09-13T23:10:17.465 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.44460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87990.log 2024-09-13T23:10:17.465 INFO:teuthology.orchestra.run.smithi164.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.43855.log.gz 2024-09-13T23:10:17.465 INFO:teuthology.orchestra.run.smithi164.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.0.96512.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.51115.log 2024-09-13T23:10:17.465 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-09-13T23:10:17.465 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.64425.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.58980.log.gz 2024-09-13T23:10:17.465 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.87990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54140.log 2024-09-13T23:10:17.465 INFO:teuthology.orchestra.run.smithi164.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.65030.log.gz 2024-09-13T23:10:17.466 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.51115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69265.log 2024-09-13T23:10:17.466 INFO:teuthology.orchestra.run.smithi164.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.44460.log.gz 2024-09-13T23:10:17.466 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.54140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84995.log 2024-09-13T23:10:17.466 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.69265.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.87990.log.gz 2024-09-13T23:10:17.466 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65635.log 2024-09-13T23:10:17.466 INFO:teuthology.orchestra.run.smithi164.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.64425.log.gz 2024-09-13T23:10:17.466 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92830.log 2024-09-13T23:10:17.466 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.84995.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.51115.log.gz 2024-09-13T23:10:17.466 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.65635.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.54140.log.gz 2024-09-13T23:10:17.466 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81365.log 2024-09-13T23:10:17.466 INFO:teuthology.orchestra.run.smithi164.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.84995.log.gz 2024-09-13T23:10:17.466 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.92830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85594.log 2024-09-13T23:10:17.466 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.81365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83785.log 2024-09-13T23:10:17.467 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.85594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71685.log 2024-09-13T23:10:17.467 INFO:teuthology.orchestra.run.smithi164.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.65635.log.gz 2024-09-13T23:10:17.467 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.83785.log: gzip 91.0% -- replaced with /var/log/ceph/ceph-client.0.92830.log.gz 2024-09-13T23:10:17.467 INFO:teuthology.orchestra.run.smithi164.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.71080.log 2024-09-13T23:10:17.467 INFO:teuthology.orchestra.run.smithi164.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.85594.log.gz 2024-09-13T23:10:17.467 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.71685.log: 93.3% -- replaced with /var/log/ceph/ceph-client.0.69265.log.gz 2024-09-13T23:10:17.467 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79550.log 2024-09-13T23:10:17.467 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.71080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72895.log 2024-09-13T23:10:17.467 INFO:teuthology.orchestra.run.smithi164.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.81365.log.gz 2024-09-13T23:10:17.467 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.79550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80760.log 2024-09-13T23:10:17.467 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.72895.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.71685.log.gz 2024-09-13T23:10:17.467 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 91.6% -- replaced with /var/log/ceph/ceph-client.0.83785.log.gz 2024-09-13T23:10:17.467 INFO:teuthology.orchestra.run.smithi164.stderr: --verbose -- /var/log/ceph/ceph-client.0.77130.log 2024-09-13T23:10:17.467 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.80760.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.71080.log.gz 2024-09-13T23:10:17.468 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75315.log 2024-09-13T23:10:17.468 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.77130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38416.log 2024-09-13T23:10:17.468 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.75315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80155.log 2024-09-13T23:10:17.468 INFO:teuthology.orchestra.run.smithi164.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.72895.log.gz 2024-09-13T23:10:17.468 INFO:teuthology.orchestra.run.smithi164.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.79550.log.gz/var/log/ceph/ceph-client.0.38416.log: 2024-09-13T23:10:17.468 INFO:teuthology.orchestra.run.smithi164.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.80760.log.gz 2024-09-13T23:10:17.468 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55350.log 2024-09-13T23:10:17.468 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66240.log 2024-09-13T23:10:17.468 INFO:teuthology.orchestra.run.smithi164.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.77130.log.gz 2024-09-13T23:10:17.468 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.80155.log: /var/log/ceph/ceph-client.0.55350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35807.log 2024-09-13T23:10:17.468 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.66240.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.75315.log.gz 2024-09-13T23:10:17.468 INFO:teuthology.orchestra.run.smithi164.stderr: 91.4%gzip -- replaced with /var/log/ceph/ceph-client.0.38416.log.gz 2024-09-13T23:10:17.468 INFO:teuthology.orchestra.run.smithi164.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.68660.log 2024-09-13T23:10:17.468 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72290.log 2024-09-13T23:10:17.469 INFO:teuthology.orchestra.run.smithi164.stderr: 85.8% 91.2% -- replaced with /var/log/ceph/ceph-client.0.80155.log.gz 2024-09-13T23:10:17.469 INFO:teuthology.orchestra.run.smithi164.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35807.log.gz 2024-09-13T23:10:17.469 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.68660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45670.log 91.5% 2024-09-13T23:10:17.469 INFO:teuthology.orchestra.run.smithi164.stderr: -- replaced with /var/log/ceph/ceph-client.0.55350.log.gz 2024-09-13T23:10:17.469 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.72290.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.66240.log.gz 2024-09-13T23:10:17.469 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78340.log 2024-09-13T23:10:17.469 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68055.log 2024-09-13T23:10:17.469 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.45670.log: /var/log/ceph/ceph-client.0.78340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86193.log 2024-09-13T23:10:17.469 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.68055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31418.log 2024-09-13T23:10:17.469 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.86193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74105.log 2024-09-13T23:10:17.469 INFO:teuthology.orchestra.run.smithi164.stderr: 91.1% 92.6% -- replaced with /var/log/ceph/ceph-client.0.68660.log.gz 2024-09-13T23:10:17.469 INFO:teuthology.orchestra.run.smithi164.stderr: -- replaced with /var/log/ceph/ceph-client.0.45670.log.gz 2024-09-13T23:10:17.469 INFO:teuthology.orchestra.run.smithi164.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.78340.log.gz 2024-09-13T23:10:17.470 INFO:teuthology.orchestra.run.smithi164.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.86193.log.gz 2024-09-13T23:10:17.470 INFO:teuthology.orchestra.run.smithi164.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.72290.log.gz 2024-09-13T23:10:17.470 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.31418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94040.log 2024-09-13T23:10:17.470 INFO:teuthology.orchestra.run.smithi164.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.68055.log.gz 2024-09-13T23:10:17.470 INFO:teuthology.orchestra.run.smithi164.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.31418.log.gz 2024-09-13T23:10:17.470 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.74105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83180.log 2024-09-13T23:10:17.470 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.94040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70475.log 2024-09-13T23:10:17.470 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.83180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58375.log 2024-09-13T23:10:17.470 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.70475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82575.log 2024-09-13T23:10:17.470 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.58375.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.94040.log.gz 2024-09-13T23:10:17.470 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94645.log 91.3% -- replaced with /var/log/ceph/ceph-client.0.74105.log.gz 2024-09-13T23:10:17.470 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-09-13T23:10:17.470 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.82575.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.83180.log.gz 2024-09-13T23:10:17.471 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31378.log 2024-09-13T23:10:17.471 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.94645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37811.log 2024-09-13T23:10:17.471 INFO:teuthology.orchestra.run.smithi164.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.58375.log.gz 2024-09-13T23:10:17.471 INFO:teuthology.orchestra.run.smithi164.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.70475.log.gz 2024-09-13T23:10:17.471 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.31378.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-13T23:10:17.471 INFO:teuthology.orchestra.run.smithi164.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.82575.log.gz 2024-09-13T23:10:17.471 INFO:teuthology.orchestra.run.smithi164.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.31378.log.gz 2024-09-13T23:10:17.471 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.37811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54745.log 2024-09-13T23:10:17.471 INFO:teuthology.orchestra.run.smithi164.stderr: 91.1%gzip -- replaced with /var/log/ceph/ceph-client.0.94645.log.gz -5 2024-09-13T23:10:17.471 INFO:teuthology.orchestra.run.smithi164.stderr: --verbose -- /var/log/ceph/ceph-client.admin.31458.log 2024-09-13T23:10:17.471 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.0.54745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76525.log 2024-09-13T23:10:17.471 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.31458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52325.log 2024-09-13T23:10:17.471 INFO:teuthology.orchestra.run.smithi164.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.31458.log.gz 2024-09-13T23:10:17.472 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.76525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42040.log 2024-09-13T23:10:17.472 INFO:teuthology.orchestra.run.smithi164.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37811.log.gz 2024-09-13T23:10:17.472 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.52325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59585.log 2024-09-13T23:10:17.472 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.42040.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.54745.log.gz 2024-09-13T23:10:17.472 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60190.log 2024-09-13T23:10:17.472 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.59585.log: gzip -5 91.3% -- replaced with /var/log/ceph/ceph-client.0.76525.log.gz 2024-09-13T23:10:17.472 INFO:teuthology.orchestra.run.smithi164.stderr: --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-13T23:10:17.472 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.60190.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.52325.log.gz 2024-09-13T23:10:17.472 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84390.log 2024-09-13T23:10:17.472 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mgr.x.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.42040.log.gz 2024-09-13T23:10:17.472 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88595.log 2024-09-13T23:10:17.472 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.84390.log: 91.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52930.log 2024-09-13T23:10:17.472 INFO:teuthology.orchestra.run.smithi164.stderr: -- replaced with /var/log/ceph/ceph-client.0.59585.log.gz 2024-09-13T23:10:17.472 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.88595.log: 91.4%gzip -- replaced with /var/log/ceph/ceph-client.0.60190.log.gz -5 2024-09-13T23:10:17.473 INFO:teuthology.orchestra.run.smithi164.stderr: --verbose -- /var/log/ceph/ceph-client.0.37206.log 2024-09-13T23:10:17.473 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.0.52930.log: -- /var/log/ceph/ceph-client.0.46275.log 2024-09-13T23:10:17.473 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.37206.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.84390.log.gz 2024-09-13T23:10:17.473 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91015.log 2024-09-13T23:10:17.473 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- 91.1% -- replaced with /var/log/ceph/ceph-client.0.88595.log.gz 2024-09-13T23:10:17.473 INFO:teuthology.orchestra.run.smithi164.stderr: /var/log/ceph/ceph-client.0.62610.log 2024-09-13T23:10:17.473 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.91015.log: /var/log/ceph/ceph-client.0.46275.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 91.3% -- replaced with /var/log/ceph/ceph-client.0.52930.log.gz 2024-09-13T23:10:17.473 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-09-13T23:10:17.473 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.62610.log: gzip -5 91.4% -- replaced with /var/log/ceph/ceph-client.0.37206.log.gz 2024-09-13T23:10:17.473 INFO:teuthology.orchestra.run.smithi164.stderr: --verbose -- /var/log/ceph/ceph-client.0.78945.log 2024-09-13T23:10:17.473 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35687.log 2024-09-13T23:10:17.473 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.78945.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.91015.log.gz 2024-09-13T23:10:17.473 INFO:teuthology.orchestra.run.smithi164.stderr: 91.1% 91.2% -- replaced with /var/log/ceph/ceph-client.0.62610.log.gz 2024-09-13T23:10:17.474 INFO:teuthology.orchestra.run.smithi164.stderr: -- replaced with /var/log/ceph/ceph-client.0.46275.log.gz 2024-09-13T23:10:17.474 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50510.log 2024-09-13T23:10:17.474 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43250.log 2024-09-13T23:10:17.474 INFO:teuthology.orchestra.run.smithi164.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.35687.log.gz 2024-09-13T23:10:17.474 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.50510.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.78945.log.gz 2024-09-13T23:10:17.474 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81970.log 2024-09-13T23:10:17.474 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.43250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86792.log 2024-09-13T23:10:17.474 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.81970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57770.log 2024-09-13T23:10:17.474 INFO:teuthology.orchestra.run.smithi164.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.50510.log.gz 2024-09-13T23:10:17.474 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.86792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74710.log 2024-09-13T23:10:17.474 INFO:teuthology.orchestra.run.smithi164.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.43250.log.gz 2024-09-13T23:10:17.474 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.57770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35767.log 2024-09-13T23:10:17.475 INFO:teuthology.orchestra.run.smithi164.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.86792.log.gz 2024-09-13T23:10:17.475 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.74710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48090.log 2024-09-13T23:10:17.475 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35767.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.81970.log.gz 2024-09-13T23:10:17.475 INFO:teuthology.orchestra.run.smithi164.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.57770.log.gz 2024-09-13T23:10:17.475 INFO:teuthology.orchestra.run.smithi164.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.35767.log.gz 2024-09-13T23:10:17.475 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-13T23:10:17.475 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.48090.log: gzip -5 --verbose -- 91.7% /var/log/ceph/ceph-client.0.66845.log 2024-09-13T23:10:17.475 INFO:teuthology.orchestra.run.smithi164.stderr: -- replaced with /var/log/ceph/ceph-client.0.74710.log.gz 2024-09-13T23:10:17.475 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62005.log 2024-09-13T23:10:17.475 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36601.log 2024-09-13T23:10:17.475 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.66845.log: /var/log/ceph/ceph-client.0.62005.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.48090.log.gz 2024-09-13T23:10:17.475 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49300.log 2024-09-13T23:10:17.475 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.36601.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.66845.log.gz 2024-09-13T23:10:17.476 INFO:teuthology.orchestra.run.smithi164.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.62005.log.gz 2024-09-13T23:10:17.476 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92225.log 2024-09-13T23:10:17.476 INFO:teuthology.orchestra.run.smithi164.stderr: 92.0%/var/log/ceph/ceph-client.0.49300.log: -- replaced with /var/log/ceph/ceph-client.0.36601.log.gz 2024-09-13T23:10:17.476 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67450.log 2024-09-13T23:10:17.477 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.92225.log: /var/log/ceph/ceph-client.0.67450.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.49300.log.gz 2024-09-13T23:10:17.477 INFO:teuthology.orchestra.run.smithi164.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.92225.log.gz 2024-09-13T23:10:17.477 INFO:teuthology.orchestra.run.smithi164.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.67450.log.gz 2024-09-13T23:10:17.494 INFO:teuthology.orchestra.run.smithi164.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-13T23:10:17.504 INFO:teuthology.orchestra.run.smithi164.stderr: 92.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-13T23:10:17.551 INFO:teuthology.orchestra.run.smithi017.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-13T23:10:18.371 INFO:teuthology.orchestra.run.smithi164.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-13T23:10:18.419 INFO:teuthology.orchestra.run.smithi017.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-13T23:10:18.420 INFO:teuthology.orchestra.run.smithi017.stderr: 2024-09-13T23:10:18.420 INFO:teuthology.orchestra.run.smithi017.stderr:real 0m1.070s 2024-09-13T23:10:18.420 INFO:teuthology.orchestra.run.smithi017.stderr:user 0m1.233s 2024-09-13T23:10:18.421 INFO:teuthology.orchestra.run.smithi017.stderr:sys 0m0.078s 2024-09-13T23:10:18.503 INFO:teuthology.orchestra.run.smithi164.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-13T23:10:18.534 INFO:teuthology.orchestra.run.smithi164.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-13T23:10:18.536 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-09-13T23:10:18.537 INFO:teuthology.orchestra.run.smithi164.stderr:real 0m1.134s 2024-09-13T23:10:18.537 INFO:teuthology.orchestra.run.smithi164.stderr:user 0m3.215s 2024-09-13T23:10:18.537 INFO:teuthology.orchestra.run.smithi164.stderr:sys 0m0.222s 2024-09-13T23:10:18.537 INFO:tasks.ceph:Archiving logs... 2024-09-13T23:10:18.537 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_21:40:02-rgw-squid-distro-default-smithi/7904378/remote/smithi017/log 2024-09-13T23:10:18.538 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T23:10:18.782 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_21:40:02-rgw-squid-distro-default-smithi/7904378/remote/smithi164/log 2024-09-13T23:10:18.783 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T23:10:19.360 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T23:10:19.374 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T23:10:19.374 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T23:10:19.377 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T23:10:19.473 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T23:10:19.486 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T23:10:19.486 DEBUG:teuthology.orchestra.run.smithi017:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T23:10:19.489 DEBUG:teuthology.orchestra.run.smithi164:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T23:10:19.503 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: ntpq: command not found 2024-09-13T23:10:19.504 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: ntpq: command not found 2024-09-13T23:10:19.508 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T23:10:19.508 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2024-09-13T23:10:19.508 INFO:teuthology.orchestra.run.smithi164.stdout:^* hv01.front.sepia.ceph.com 3 6 377 35 -24us[ -13us] +/- 47ms 2024-09-13T23:10:19.508 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 36 -325ns[ +11us] +/- 61ms 2024-09-13T23:10:19.508 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 +103us[ +114us] +/- 63ms 2024-09-13T23:10:19.508 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T23:10:19.509 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T23:10:19.509 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2024-09-13T23:10:19.509 INFO:teuthology.orchestra.run.smithi017.stdout:^* hv01.front.sepia.ceph.com 3 6 377 35 -27us[-7732ns] +/- 47ms 2024-09-13T23:10:19.509 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 35 -11us[+8515ns] +/- 61ms 2024-09-13T23:10:19.509 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 35 +86us[ +106us] +/- 63ms 2024-09-13T23:10:19.509 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T23:10:19.510 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T23:10:19.519 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T23:10:19.519 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T23:10:19.565 DEBUG:teuthology.orchestra.run.smithi017:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T23:10:19.635 DEBUG:teuthology.orchestra.run.smithi164:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T23:10:19.696 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T23:10:19.727 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:10:19.728 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T23:10:19.755 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:10:19.755 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T23:10:19.764 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T23:10:19.773 INFO:teuthology.task.internal:Duration was 722.177166 seconds 2024-09-13T23:10:19.773 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T23:10:19.782 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T23:10:19.782 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T23:10:19.785 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T23:10:19.826 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T23:10:19.835 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T23:10:20.077 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T23:10:20.077 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi017.front.sepia.ceph.com 2024-09-13T23:10:20.077 DEBUG:teuthology.orchestra.run.smithi017:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T23:10:20.099 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi164.front.sepia.ceph.com 2024-09-13T23:10:20.099 DEBUG:teuthology.orchestra.run.smithi164:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T23:10:20.128 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T23:10:20.128 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T23:10:20.142 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T23:10:20.195 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T23:10:20.195 DEBUG:teuthology.orchestra.run.smithi017:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T23:10:20.211 DEBUG:teuthology.orchestra.run.smithi164:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T23:10:20.332 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T23:10:20.342 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T23:10:20.342 DEBUG:teuthology.orchestra.run.smithi017:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T23:10:20.368 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T23:10:20.393 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T23:10:20.403 DEBUG:teuthology.orchestra.run.smithi017:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T23:10:20.411 DEBUG:teuthology.orchestra.run.smithi164:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T23:10:20.433 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = core 2024-09-13T23:10:20.457 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = core 2024-09-13T23:10:20.503 DEBUG:teuthology.orchestra.run.smithi017:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T23:10:20.518 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:10:20.519 DEBUG:teuthology.orchestra.run.smithi164:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T23:10:20.557 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:10:20.558 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T23:10:20.568 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T23:10:20.569 DEBUG:teuthology.misc:Transferring archived files from smithi017:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_21:40:02-rgw-squid-distro-default-smithi/7904378/remote/smithi017 2024-09-13T23:10:20.569 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T23:10:20.604 DEBUG:teuthology.misc:Transferring archived files from smithi164:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_21:40:02-rgw-squid-distro-default-smithi/7904378/remote/smithi164 2024-09-13T23:10:20.604 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T23:10:20.637 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T23:10:20.638 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T23:10:20.641 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T23:10:20.687 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T23:10:20.698 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T23:10:20.698 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T23:10:20.707 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T23:10:20.708 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T23:10:20.710 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T23:10:20.723 INFO:teuthology.orchestra.run.smithi017.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 23:10 /home/ubuntu/cephtest 2024-09-13T23:10:20.742 INFO:teuthology.orchestra.run.smithi164.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 23:10 /home/ubuntu/cephtest 2024-09-13T23:10:20.743 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T23:10:20.753 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T23:10:20.782 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} duration: 722.177166223526 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-13T23:10:20.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T23:10:20.880 INFO:teuthology.run:pass